Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,929

Base only

Active filters: 5-bit

deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ5

Text Generation • 35B • Updated May 10 • 27 • 1

deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ5-FP16

Text Generation • 35B • Updated May 10 • 24

zecanard/Qwopus3.6-35B-A3B-v1-MLX-5bit-int5-affine

Image-Text-to-Text • 35B • Updated Jun 12 • 13 • 1

NexVeridian/zeta-2.1-5bit

Text Generation • 8B • Updated 1 day ago • 255

dr-housemd/grape-2-pro-exl3-5.00bpw

Image-Text-to-Text • 10B • Updated May 10 • 4

mlx-community/MiniCPM-V-4.6-5bit

Image-Text-to-Text • 1B • Updated May 13 • 64

cgs4huggingface/Qwen3.6-27B-MLX-VL-oQ5-fp16

Image-Text-to-Text • 27B • Updated May 14 • 29 • 1

tevino/gemma-4-E4B-it-oQ5

8B • Updated May 15 • 12

deepsweet/Qwen3.6-27B-MLX-VL-oQ5

Text Generation • 27B • Updated May 18 • 24

tevino/Qwen3.6-35B-A3B-oQ5-mtp

36B • Updated May 15 • 24 • 1

lukaskremla/Hermes-4.3-36B-mlx-5Bit

Text Generation • 36B • Updated May 15 • 396 • 2

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-Q5_K_XL-mlx

Text Generation • 26B • Updated May 15 • 36

mlx-community/Qwen3-1.7B-5bit

Text Generation • 2B • Updated May 15 • 31

pelisterio/Qwen3.6-35B-A3B-mlx-5Bit

Image-Text-to-Text • 35B • Updated May 16 • 14

Brooooooklyn/Gemma-4-31B-IT-UD-Q5_K_XL-mlx

Text Generation • 31B • Updated May 16 • 32

mlx-community/SU-01-5bit

Text Generation • 31B • Updated May 16 • 14

agemio/Qwen3.6-27B-oQ5-mtp

Image-Text-to-Text • 6B • Updated May 16 • 4

lemuralabs/DeepSeek-V4-Flash-5bit-mlx

Text Generation • 284B • Updated 28 days ago • 694

LMLiutenant/Qwen3.5-122B-A10B-oQ5-mtp

125B • Updated May 17 • 96 • 2

mlx-community/P1-VL-30B-A3B-5bit

Image-Text-to-Text • 31B • Updated May 18 • 12

numind/NuExtract3-mlx-5bits

5B • Updated May 19 • 18 • 1

mvid/Leanstral-2603-MLX-5bit

Image-Text-to-Text • 119B • Updated May 20 • 10

tfjack/Qwen3-Coder-Next-oQ5-fp16

80B • Updated May 20 • 25

tfjack/Qwen3.6-35B-A3B-oQ5-fp16-mtp

36B • Updated Jun 1 • 8

dylpickle13/Qwen3.5-9B-oQ5-mtp

Image-Text-to-Text • 10B • Updated May 22 • 22

tevino/Hy-MT2-7B-oQ5

8B • Updated May 22 • 13

tevino/Hy-MT2-1.8B-oQ5

2B • Updated May 22 • 31

mouddane/granite-speech-4.1-2b-nar-mlx-5bit

Automatic Speech Recognition • 2B • Updated May 22 • 12

NexVeridian/Equinox-31B-5bit

Text Generation • 31B • Updated 1 day ago • 65

sahilchachra/granite-4.1-8b-5bit-mlx

8B • Updated May 22 • 5