Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,929

Base only

Active filters: 5-bit

mlx-community/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-5bit

Image-Text-to-Text • 33B • Updated Apr 29 • 36

RepublicOfKorokke/Qwen3-Embedding-4B-oQ5-fp16

4B • Updated Apr 29 • 10

RepublicOfKorokke/granite-4.1-3b-oQ5-fp16

3B • Updated Apr 29 • 19

beaupi/chandra-ocr-2-oQ5-fp16

Image-Text-to-Text • 1B • Updated Apr 29 • 36 • 1

beaupi/gemma-4-E4B-it-OBLITERATED-oQ5

Text Generation • 2B • Updated Apr 29 • 23

mlx-community/Ling-2.6-flash-mlx-5bit

Text Generation • 104B • Updated Apr 30 • 67 • 1

beaupi/granite-4.1-8b-oQ5

Text Generation • 2B • Updated Apr 29 • 9

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-5Bit

Text Generation • 27B • Updated May 13 • 20

mlx-community/granite-4.1-3b-5bit

Text Generation • 3B • Updated May 1 • 25

mlx-community/granite-4.1-30b-5bit

Text Generation • 29B • Updated May 1 • 24

beezu/G4-MeroMero-31B-mlx-5bit-gs32

Text Generation • 31B • Updated May 2 • 17

sgrankin/Qwen3.6-35B-A3B-oQ5-fp16

35B • Updated May 2 • 8

sgrankin/Qwen3.6-27B-oQ5-fp16

27B • Updated May 2 • 7

RoelV/Qwen3.6-27B-oQ5-fp16

Image-Text-to-Text • 6B • Updated May 2 • 5

firedancer/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated May 2 • 186

mlx-community/granite-4.1-8b-5bit

Text Generation • 8B • Updated May 3 • 22

Mori-e/gemma-4-26B-A4B-it-uncensored-oQ5-fp16

26B • Updated May 4 • 99 • 1

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-5bit

Text Generation • 33B • Updated 24 days ago • 336

anthonyw448/DeepSeek-R1-Distill-Llama-70B_EXL2_5.0bpw_h6

Updated May 4 • 2

splats/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ5e-fp16

35B • Updated May 5 • 50 • 1

callmefattyy/gemma-4-26B-A4B-it-uncensored-oQ5-fp16

26B • Updated May 4 • 64

avneetsb/NVIDIA-Nemotron-3-Nano-4B-oQ5-fp16

4B • Updated May 5 • 3

avneetsb/Qwen3.5-9B-oQ5-fp16

9B • Updated May 5 • 1

anthonyw448/Llama-3.3-70B-Instruct-EXL3-5.0bpw-h6

Text Generation • 23B • Updated May 6 • 5

avneetsb/Qwen3.5-2B-oQ5-fp16

2B • Updated May 6 • 3

avneetsb/Qwen3.5-4B-oQ5-fp16

5B • Updated May 6 • 2

fcobos/Qwopus3.5-9B-v3.5-oQ5-mtp

10B • Updated May 7 • 10

mavis-ai/Gemma4-26B-MoE-Q5

Image-Text-to-Text • 26B • Updated Jul 1 • 151

mavis-ai/Gemma4-31B-MLX-Q5

Image-Text-to-Text • 31B • Updated Jul 1 • 40 • 1

zecanard/gemma-4-E2B-it-ultra-uncensored-heretic-MLX-5bit-int5-affine

Any-to-Any • 5B • Updated Jun 15 • 33 • 1