Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,620

Base only

Active filters: 5-bit

mlx-community/gemma-4-26b-a4b-5bit

Image-Text-to-Text • 5B • Updated Apr 3 • 104 • 1

mlx-community/gemma-4-e4b-5bit

Any-to-Any • 2B • Updated Apr 3 • 91

mlx-community/gemma-4-e2b-5bit

Any-to-Any • 1B • Updated Apr 3 • 63

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 32

UnstableLlama/Qwen3.5-4B-exl3-5.00bpw

2B • Updated Apr 4 • 8

UnstableLlama/Qwen3.5-27B-exl3-5.00bpw

10B • Updated Apr 4 • 11

lmstudio-community/gemma-4-E2B-it-MLX-5bit

Any-to-Any • 1B • Updated Apr 10 • 37.3k

lmstudio-community/gemma-4-26B-A4B-it-MLX-5bit

Image-Text-to-Text • 5B • Updated Apr 10 • 47.1k

lmstudio-community/gemma-4-31B-it-MLX-5bit

Image-Text-to-Text • 8B • Updated Apr 10 • 55.3k

lmstudio-community/gemma-4-E4B-it-MLX-5bit

Any-to-Any • 2B • Updated Apr 10 • 193k

UnstableLlama/Qwen3.5-2B-exl3-5.00bpw

1B • Updated Apr 4 • 6

UnstableLlama/Qwen3.5-0.8B-exl3-5.00bpw

0.6B • Updated Apr 4 • 2

UnstableLlama/Jackrong_Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-exl3-5.00bpw

10B • Updated Apr 7 • 4

beaupi/Qianfan-OCR-oQ5

Image-Text-to-Text • 1B • Updated Apr 4 • 7

beaupi/gemma-4-26B-A4B-it-Claude-Opus-Distill-oQ5

Image-Text-to-Text • 5B • Updated Apr 4 • 5

beaupi/cohere-transcribe-03-2026-oQ5

Automatic Speech Recognition • 0.6B • Updated Apr 4 • 4

beaupi/Gemma-4-31B-Cognitive-Unshackled-oQ5

Image-Text-to-Text • 6B • Updated Apr 5 • 4

beaupi/gemma-4-31B-it-Claude-Opus-Distill-oQ5

Image-Text-to-Text • 6B • Updated Apr 5 • 4

catalystsec/gemma-4-26B-A4B-it-5bit-DWQ

Text Generation • 25B • Updated Apr 11 • 129 • 1

NexVeridian/gemma-4-E2B-5bit

Text Generation • 0.9B • Updated Apr 22 • 23

NexVeridian/gemma-4-E2B-it-5bit

Text Generation • 0.9B • Updated Apr 22 • 48

NexVeridian/gemma-4-E4B-5bit

Text Generation • 1B • Updated Apr 12 • 31

NexVeridian/gemma-4-E4B-it-5bit

Text Generation • 1B • Updated Apr 22 • 49

NexVeridian/gemma-4-26B-A4b-5bit

Text Generation • 25B • Updated Apr 22 • 25

LiquidAI/LFM2.5-VL-450M-MLX-5bit

Image-Text-to-Text • 0.2B • Updated Apr 8 • 43 • 1

minion1905/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 9 • 72

guymy31/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-5bit

Text Generation • 35B • Updated Apr 10 • 74

khsd3648/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-oQ5

7B • Updated Apr 11 • 118

zecanard/gemma-4-31B-it-uncensored-abliterix-MLX-5bit-int5-affine

Image-Text-to-Text • 9B • Updated 15 days ago • 703 • 1

mlx-community/MiniMax-M2.7-5bit

Text Generation • 229B • Updated Apr 12 • 343 • 2