Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,616

Base only

Active filters: 5-bit

LiquidAI/LFM2.5-350M-MLX-5bit

Text Generation • 66.5M • Updated Apr 1 • 26 • 3

blockblockblock/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2-5bpw-exl3

Text Generation • 4B • Updated Mar 26 • 13

mlx-community/dots.mocr-5bit

Image-Text-to-Text • 2B • Updated Apr 3 • 4

mlx-community/sam3-5bit

0.2B • Updated Mar 28 • 7 • 1

groxaxo/Qwen3.5-27B-Writer-exl3-5bpw-hb8

Text Generation • 10B • Updated Mar 28 • 33

Brooooooklyn/Qwen3.5-35B-A3B-UD-Q5_K_XL-mlx

Text Generation • 8B • Updated Mar 29 • 164 • 2

Brooooooklyn/Qwen3.5-9B-UD-Q5_K_XL-mlx

Text Generation • 3B • Updated Mar 29 • 133

Brooooooklyn/Qwen3.5-27B-UD-Q5_K_XL-mlx

Text Generation • 8B • Updated Mar 29 • 59 • 1

mobbitxt/Anubis-Mini-8B-v1-oQ5

2B • Updated Mar 30 • 25

mlx-community/NVIDIA-Nemotron-3-Super-120B-A12B-5bit

Text Generation • 121B • Updated Mar 30 • 3.58k • 3

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ5

Text Generation • 4B • Updated Mar 30 • 167

mlx-community/LongCat-AudioDiT-1B-5bit

Text-to-Speech • 0.4B • Updated Mar 31 • 5

mlx-community/LongCat-AudioDiT-3.5B-5bit

Text-to-Speech • 0.8B • Updated Mar 31 • 15

UnstableLlama/Qwen3.5-27B-earica-5.00bpw-exl3

10B • Updated Mar 31 • 1

matt-here/MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-5bit

Text Generation • 27B • Updated Mar 31 • 103 • 1

mlx-community/granite-vision-3.2-2b-5bit

Image-Text-to-Text • 0.9B • Updated Apr 1 • 13

mlx-community/granite-4.0-3b-vision-5bit

Image-Text-to-Text • 1B • Updated Apr 1 • 88 • 1

himefei/Qwen3.5-35B-A3B-oQ5e

7B • Updated Apr 2 • 3

juanquivilla/sotto-cleanup-lfm25-350m-mlx-5bit

Text Generation • 66.5M • Updated about 1 month ago • 229 • 2

matt-here/MLX-Qwopus3.5-27B-v3-5bit

Text Generation • 27B • Updated Apr 11 • 25

matt-here/MLX-Qwopus3.5-27B-v3-vision-5bit

Image-Text-to-Text • 6B • Updated Apr 11 • 37

mlx-community/Trinity-Large-Thinking-5bit

Text Generation • 399B • Updated Apr 2 • 24

mlx-community/gemma-4-31b-it-5bit

Image-Text-to-Text • 6B • Updated 18 days ago • 333 • 2

mlx-community/gemma-4-26b-a4b-it-5bit

Image-Text-to-Text • 5B • Updated 18 days ago • 402 • 2

mlx-community/gemma-4-e4b-it-5bit

Any-to-Any • 2B • Updated 18 days ago • 195

mlx-community/gemma-4-e2b-it-5bit

Any-to-Any • 1B • Updated 18 days ago • 157

mlx-community/gemma-4-26b-a4b-5bit

Image-Text-to-Text • 5B • Updated Apr 3 • 104 • 1

mlx-community/gemma-4-e4b-5bit

Any-to-Any • 2B • Updated Apr 3 • 91

mlx-community/gemma-4-e2b-5bit

Any-to-Any • 1B • Updated Apr 3 • 63

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 32