Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

928

Base only

Active filters: 4bit

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 7 days ago • 15.4k • 48

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated 30 days ago • 791 • 22

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 7 days ago • 14.9k • 37

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated about 11 hours ago • 22.7k • 34

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated about 11 hours ago • 3.1k • 7

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated about 11 hours ago • 1.4k • 4

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 7 days ago • 20.6k • 67

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 19k • 265

mlx-community/gemma-4-e2b-it-qat-OptiQ-4bit

Text Generation • 1B • Updated about 11 hours ago • 871 • 4

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated about 11 hours ago • 8.75k • 28

MLXBits/sulphur-2-distill-mlx-q4

Image-Text-to-Video • Updated May 12 • 719 • 21

mlx-community/NVIDIA-Nemotron-3-Nano-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 7 days ago • 1.35k • 2

mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Text Generation • 32B • Updated 7 days ago • 814 • 2

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

Text Generation • 25B • Updated about 11 hours ago • 858 • 2

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 22.6k • 133

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated Mar 2 • 28.2k • 28

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 7 days ago • 2.69k • 20

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated 7 days ago • 3.1k • 11

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 7 days ago • 6.96k • 21

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 596 • 7

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated about 11 hours ago • 2.3k • 4

majentik/gemma-4-31B-it-TurboQuant-AWQ-4bit

Image-Text-to-Text • Updated May 6 • 1

majentik/fishaudio-s2-pro-MLX-4bit

Text-to-Speech • 0.7B • Updated Apr 17 • 141 • 4

mlx-community/Qwen3.5-27B-OptiQ-4bit

Text Generation • 27B • Updated 7 days ago • 663 • 3

mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 7 days ago • 977 • 3

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated about 11 hours ago • 5.31k • 6

DuoNeural/Cosmos3-Nano-GPTQ-4bit

Text-to-Video • Updated 24 days ago • 265 • 1

Alennnndy/Qwen3.6-27B-GPTQ-4bit

Text Generation • 27B • Updated 3 days ago • 20 • 1

shamsghi/Qwen-9B-Claude-Fable-5-1M-MLX-4bit

Text Generation • 1B • Updated 2 days ago • 407 • 1

mradermacher/Ghanam-7B-Base-Pashto-v0.1-GGUF

7B • Updated 6 days ago • 398 • 1