Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,914

Base only

Active filters: 5-bit

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit

Text Generation • 31B • Updated Jul 29, 2025 • 39 • 1

bullerwins/Qwen3-30B-A3B-Instruct-2507-exl3-5.0bpw

Text Generation • 10B • Updated Jul 30, 2025 • 8

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr5e-7

Text Generation • 31B • Updated Jul 31, 2025 • 14

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr3e-8

Text Generation • 31B • Updated Jul 31, 2025 • 17

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr2e-7

Text Generation • 31B • Updated Jul 31, 2025 • 15

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr9e-8

Text Generation • 31B • Updated Jul 31, 2025 • 12 • 1

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr1e-7

Text Generation • 31B • Updated Jul 31, 2025 • 13

mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit

Text Generation • 31B • Updated Jul 31, 2025 • 386 • 2

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-5bit

Text Generation • 31B • Updated Aug 1, 2025 • 124k • 9

mlx-community/XBai-o4-5bit

Text Generation • 33B • Updated Aug 2, 2025 • 12

zerofata/MS3.2-PaintedFantasy-Visage-v2-33B-exl3-5bpw

Text Generation • 11B • Updated Aug 3, 2025 • 7

Doctor-Shotgun/GLM-4.5-Air-exl3_5.0bpw-h6

Text Generation • 34B • Updated Aug 4, 2025 • 12 • 2

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-5bit

Text Generation • 0.8B • Updated Aug 6, 2025 • 47k

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-5bit

Text Generation • 0.8B • Updated Aug 6, 2025 • 63 • 1

mlx-community/Qwen3-4B-Thinking-2507-5bit

Text Generation • 0.8B • Updated Aug 6, 2025 • 16 • 1

mlx-community/Qwen3-4B-Instruct-2507-5bit

Text Generation • 0.8B • Updated Oct 9, 2025 • 26 • 1

nightmedia/Hunyuan-0.5B-Instruct-dwq5-mlx

Text Generation • 0.1B • Updated Aug 9, 2025 • 15

mlx-community/gemma-3-270m-5bit

Text Generation • 81.8M • Updated Aug 9, 2025 • 15

mlx-community/gemma-3-270m-it-5bit

Text Generation • 81.8M • Updated Aug 9, 2025 • 16

mlx-community/gemma-3-270m-qat-5bit

Text Generation • 81.8M • Updated Aug 9, 2025 • 7

mlx-community/gemma-3-270m-it-qat-5bit

Text Generation • 81.8M • Updated Aug 9, 2025 • 8

Minthy/Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw

Text Generation • 74B • Updated Aug 10, 2025 • 7

SicariusSicariiStuff/Impish_Nemo_12B_EXL3_5.0bpw

Text Generation • 4B • Updated Aug 10, 2025 • 8

Minthy/Qwen3-235B-A22B-Thinking-2507-exl3-5.0bpw

Text Generation • 74B • Updated Aug 10, 2025 • 13

mlx-community/GLM-4.5V-5bit

Updated Aug 11, 2025 • 36 • 1

bullerwins/GLM-4.5-exl3-5.0bpw

Text Generation • 111B • Updated Aug 12, 2025 • 13

mlx-community/Jan-v1-4B-5bit

Text Generation • 0.8B • Updated Aug 12, 2025 • 8

kernalkue/Sapphira-L3.3-70b-0.2-exl3-5.0bpw-h6

23B • Updated Aug 15, 2025 • 16

SicariusSicariiStuff/Impish_Longtail_12B_EXL3_5.0bpw

Text Generation • 4B • Updated Aug 16, 2025 • 6

mlx-community/LFM2-VL-450M-5bit

Image-Text-to-Text • 0.2B • Updated Aug 16, 2025 • 11 • 1