mlx-community/quantized-gemma-2b-it
Text Generation • Updated • 324 • 10
Quantized MLX LLMs
-
-
mlx-community/Meta-Llama-3.1-8B-Instruct-4bit
Text Generation • Updated • 10.4k • 18 -
mlx-community/Mistral-Large-Instruct-2407-4bit
Updated • 448 • 1 -
mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed
Text Generation • Updated • 618 • 3 -
mlx-community/Dolphin-2.9.3-Mistral-Nemo-12b-4bit
2B • Updated • 250 -
mlx-community/dolphin-2.9.4-gemma2-2b-4bit
Updated • 47 • 2 -
mlx-community/zephyr-7b-beta-4bit
Text Generation • Updated • 29 • 1