Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

mixed-precision

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

466

Base only

Active filters: mixed-precision

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 7 days ago • 15.8k • 48

rdtand/Qwen3.6-27B-PrismaAURA-5.5bit-vllm

20B • Updated 1 day ago • 49 • 8

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 7 days ago • 15.2k • 37

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated about 4 hours ago • 21.7k • 34

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated about 4 hours ago • 1.06k • 4

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 7 days ago • 21.5k • 67

rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm

17B • Updated May 4 • 83.6k • 31

mlx-community/gemma-4-e2b-it-qat-OptiQ-4bit

Text Generation • 1B • Updated about 4 hours ago • 757 • 4

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated about 4 hours ago • 2.9k • 6

mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit

Text Generation • 122B • Updated 7 days ago • 351 • 3

WaveCut/Qwen3.6-35B-A3B-REAM-160-ru-agent-GGUF

23B • Updated 5 days ago • 1.55k • 3

avlp12/GLM-5.2-Alis-MLX-Dynamic-3.5bpw

Text Generation • 743B • Updated 4 days ago • 2.13k • 3

dealignai/Nemotron-3-Super-120B-A12B-UNCENSORED-JANG_2L

Text Generation • 13B • Updated Apr 25 • 3.58k • 13

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated about 4 hours ago • 9.11k • 28

mlx-community/NVIDIA-Nemotron-3-Nano-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 7 days ago • 1.3k • 2

mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Text Generation • 32B • Updated 7 days ago • 777 • 2

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

Text Generation • 25B • Updated about 4 hours ago • 736 • 2

mlx-community/NVIDIA-Nemotron-3-Super-120B-A12B-OptiQ-2bit

Text Generation • 121B • Updated 7 days ago • 633 • 2

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated about 23 hours ago • 399 • 2

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 7 days ago • 2.76k • 20

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated 7 days ago • 3.14k • 11

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 7 days ago • 7.38k • 21

dealignai/Qwen3.5-VL-122B-A10B-UNCENSORED-JANG_2S

Image-Text-to-Text • 11B • Updated Apr 17 • 688 • 4

dealignai/Qwen3.5-VL-122B-A10B-JANG_4K-CRACK

Image-Text-to-Text • 18B • Updated Apr 17 • 376 • 4

TheCluster/Qwen3.5-122B-A10B-Heretic-v2-MLX-mixed-6bit

Image-Text-to-Text • 122B • Updated Apr 11 • 185 • 1

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated about 4 hours ago • 2.31k • 4

TheCluster/Qwen3.6-27B-Heretic-MLX-mixed-9.4bit

Image-Text-to-Text • 28B • Updated Apr 24 • 426 • 4

FINAL-Bench/Darwin-9B-MFP4

Text Generation • 7B • Updated May 15 • 81 • 15

mlx-community/Qwen3.5-27B-OptiQ-4bit

Text Generation • 27B • Updated 7 days ago • 649 • 3

mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 7 days ago • 1.09k • 3