Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,929

Base only

Active filters: 5-bit

mlx-community/gemma-4-12B-it-assistant-5bit

Any-to-Any • 0.4B • Updated Jun 3 • 26

mlx-community/gemma-4-12B-5bit

Any-to-Any • 12B • Updated Jun 3 • 24 • 1

usermma/Huihui-LFM2.5-8B-A1B-abliterated-mlx-5Bit

Text Generation • 8B • Updated Jun 3 • 24

blockblockblock/Mellum2-12B-A2.5B-Thinking-exl3-5.0bpw

Text Generation • 4B • Updated 23 days ago • 160

usermma/Huihui-MiniCPM5-1B-abliterated-mlx-5Bit

Text Generation • 1B • Updated Jun 3 • 14

LiquidAI/LFM2.5-1.2B-JP-202606-MLX-5bit

Text Generation • 1B • Updated Jun 4 • 281 • 8

dawncr0w/Step-3.7-Flash-oQ5-MLX

Image-Text-to-Text • 199B • Updated Jun 4 • 22

wezzel98765/gemma-4-12B-it-oQ5-fp16

12B • Updated Jun 4 • 9

wezzel98765/gemma-4-12B-oQ5-fp16

12B • Updated Jun 4 • 6

usermma/Granite-4.1-30B-Claude-4.6-Opus-Thinking-Charles-Xavier-mlx-5Bit

Text Generation • 29B • Updated Jun 4 • 18

nhe-ai/Huihui-HY-MT1.5-1.8B-abliterated-mlx-5Bit

Translation • 2B • Updated Jun 5 • 30

nhe-ai/Huihui-HY-MT1.5-7B-abliterated-mlx-5Bit

Translation • 8B • Updated Jun 5 • 31

usermma/Supra-50M-Reasoning-mlx-5Bit

Text Generation • 51.8M • Updated Jun 5 • 14

usermma/Nex-N2-mini-mlx-5Bit

Text Generation • 35B • Updated Jun 5 • 8

mlx-community/gemma-4-E2B-it-qat-5bit

Image-Text-to-Text • 5B • Updated Jun 5 • 38

mlx-community/gemma-4-E4B-it-qat-5bit

Image-Text-to-Text • 8B • Updated Jun 5 • 34

mlx-community/gemma-4-26B-A4B-it-qat-5bit

Image-Text-to-Text • 26B • Updated Jun 5 • 106

mlx-community/gemma-4-31B-it-qat-5bit

Image-Text-to-Text • 31B • Updated Jun 5 • 97 • 1

mlx-community/gemma-4-E2B-it-qat-assistant-5bit

Text Generation • 78M • Updated Jun 5 • 34

mlx-community/gemma-4-E4B-it-qat-assistant-5bit

Text Generation • 78.8M • Updated Jun 5 • 36

mlx-community/gemma-4-12B-it-qat-assistant-5bit

Text Generation • 0.4B • Updated Jun 5 • 73

mlx-community/gemma-4-26B-A4B-it-qat-assistant-5bit

Text Generation • 0.4B • Updated Jun 5 • 40

mlx-community/gemma-4-31B-it-qat-assistant-5bit

Text Generation • 0.5B • Updated Jun 5 • 45

mlx-community/gemma-4-12B-it-qat-5bit

Image-Text-to-Text • 12B • Updated Jun 5 • 68

pearsonkyle/gemma4-31b-imatrix-mtp-GGUF

Image-Text-to-Text • 31B • Updated Jul 11 • 1.49k • 3

usermma/My-Claude-4.6-Thinking-abliterated-failspy-mlx-5Bit

3B • Updated Jun 6 • 12

FurAbyss/Gemma-4-Sphinsikus-Chronist-31B-oQ5

Image-Text-to-Text • 31B • Updated Jun 7 • 13

ed90c095d3/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Jun 7 • 114

mlx-community/Nex-N2-mini-5bit

Text Generation • 35B • Updated Jun 8 • 11

avneetsb/gemma-4-12B-it-qat-oQ5-fp16

12B • Updated Jun 9 • 9