Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,924

Base only

Active filters: 5-bit

mlx-community/gemma-4-e2b-it-5bit

Image-Text-to-Text • 1B • Updated Jul 6 • 54

mlx-community/gemma-4-31b-5bit

Image-Text-to-Text • 6B • Updated Apr 2 • 43 • 2

mlx-community/gemma-4-26b-a4b-5bit

Image-Text-to-Text • 5B • Updated Apr 3 • 47 • 1

mlx-community/gemma-4-e4b-5bit

Any-to-Any • 2B • Updated Apr 3 • 27 • 1

mlx-community/gemma-4-e2b-5bit

Any-to-Any • 1B • Updated Apr 3 • 27

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 7

UnstableLlama/Qwen3.5-4B-exl3-5.00bpw

2B • Updated Apr 4 • 11

UnstableLlama/Qwen3.5-27B-exl3-5.00bpw

10B • Updated Apr 4 • 9

lmstudio-community/gemma-4-E2B-it-MLX-5bit

Any-to-Any • 1B • Updated Jul 23 • 213k

lmstudio-community/gemma-4-26B-A4B-it-MLX-5bit

Image-Text-to-Text • 5B • Updated Jul 23 • 148k

lmstudio-community/gemma-4-31B-it-MLX-5bit

Image-Text-to-Text • 6B • Updated Jul 29 • 162k

lmstudio-community/gemma-4-E4B-it-MLX-5bit

Any-to-Any • 2B • Updated Jul 23 • 1.17M

UnstableLlama/Qwen3.5-2B-exl3-5.00bpw

1B • Updated Apr 4 • 8

UnstableLlama/Qwen3.5-0.8B-exl3-5.00bpw

0.6B • Updated Apr 4 • 7

UnstableLlama/Jackrong_Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-exl3-5.00bpw

10B • Updated Apr 7 • 4

beaupi/Qianfan-OCR-oQ5

Image-Text-to-Text • 1B • Updated Apr 4 • 6

beaupi/gemma-4-26B-A4B-it-Claude-Opus-Distill-oQ5

Image-Text-to-Text • 5B • Updated Apr 4 • 5

beaupi/cohere-transcribe-03-2026-oQ5

Automatic Speech Recognition • 0.6B • Updated Apr 4 • 5

beaupi/Gemma-4-31B-Cognitive-Unshackled-oQ5

Image-Text-to-Text • 6B • Updated Apr 5 • 5

beaupi/gemma-4-31B-it-Claude-Opus-Distill-oQ5

Image-Text-to-Text • 6B • Updated Apr 5 • 4

catalystsec/gemma-4-26B-A4B-it-5bit-DWQ

Text Generation • 25B • Updated Apr 11 • 45 • 1

LiquidAI/LFM2.5-VL-450M-MLX-5bit

Image-Text-to-Text • 0.2B • Updated 20 days ago • 167 • 7

minion1905/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 9 • 53

guymy31/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-5bit

Text Generation • 35B • Updated Apr 10 • 30

khsd3648/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-oQ5

7B • Updated Apr 11 • 59

zecanard/gemma-4-31B-it-uncensored-abliterix-MLX-5bit-int5-affine

Image-Text-to-Text • 7B • Updated Jun 15 • 112 • 1

mlx-community/MiniMax-M2.7-5bit

Text Generation • 229B • Updated Apr 12 • 314 • 3

zecanard/gemma-4-31B-it-Claude-Opus-Distilled-MLX-5bit-int5-affine

Image-Text-to-Text • 7B • Updated Jun 15 • 48 • 1

zecanard/Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-MLX-5bit-int5-affine

Image-Text-to-Text • 9B • Updated Jun 12 • 132 • 2

Irfanuruchi/gemma-3-4b-it-mlx-5bit

Text Generation • 0.7B • Updated Apr 13 • 6