Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,397

Full-text search

Active filters: 5-bit

mlx-community/ERNIE-4.5-21B-A3B-PT-5bit

Text Generation • 22B • Updated Jul 4, 2025 • 11 • 1

SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_5.0bpw

Text Generation • Updated Jul 5, 2025

mlx-community/DeepSeek-V3-0324-5bit

Text Generation • 671B • Updated Jul 6, 2025 • 35 • 1

mlx-community/Dolphin-Mistral-24B-Venice-Edition-5bit

Text Generation • 24B • Updated Jul 6, 2025 • 30

mlx-community/gemma-3n-E2B-5bit

Image-Text-to-Text • Updated Jul 12, 2025 • 8

mlx-community/gemma-3n-E4B-5bit

Image-Text-to-Text • Updated Jul 12, 2025 • 8

fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Jul 9, 2025 • 41

mlx-community/SmolLM3-3B-5bit

Text Generation • Updated Jul 8, 2025 • 5

mlx-community/SmolLM3-3B-Base-5bit

Text Generation • Updated Jul 8, 2025 • 6

mlx-community/Kimi-Dev-72B-5bit

Text Generation • 73B • Updated Jul 11, 2025 • 133 • 2

mlx-community/Devstral-Small-2507-5bit

Text Generation • 24B • Updated Jul 11, 2025 • 17 • 1

mlx-community/LFM2-350M-5bit

Text Generation • 66.5M • Updated Jul 11, 2025 • 10 • 1

mlx-community/LFM2-700M-5bit

Text Generation • 0.1B • Updated Jul 11, 2025 • 5 • 1

mlx-community/LFM2-1.2B-5bit

Text Generation • 0.2B • Updated Jul 12, 2025 • 41 • 1

NexVeridian/Qwen3-14B-5bit

Text Generation • 15B • Updated Aug 7, 2025 • 17

matatonic/Devstral-Small-2507-5.0bpw-exl2

Text Generation • Updated Jul 20, 2025 • 4

mlx-community/Qwen3-235B-A22B-Instruct-2507-5bit

Text Generation • Updated Jul 22, 2025 • 18 • 1

nightmedia/LLama-3.1-128k-Darkest-Planet-Uncensored-16.5B-q5-mlx

Text Generation • 17B • Updated Jul 23, 2025 • 40

bullerwins/Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw

Text Generation • 74B • Updated Jul 24, 2025 • 3

mlx-community/Qwen3-235B-A22B-Thinking-2507-5bit

Text Generation • Updated Jul 25, 2025 • 13

zerofata/MS3.2-PaintedFantasy-v2-24b-exl3-5bpw

Text Generation • 8B • Updated Jul 31, 2025 • 2

mlx-community/GLM-4.5-Air-5bit

Text Generation • 107B • Updated Jul 28, 2025 • 19

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit

Text Generation • Updated Jul 29, 2025 • 30 • 1

bullerwins/Qwen3-30B-A3B-Instruct-2507-exl3-5.0bpw

Text Generation • 10B • Updated Jul 30, 2025 • 43

NexVeridian/Qwen3-30B-A3B-Thinking-2507-5bit

Text Generation • 31B • Updated Aug 18, 2025 • 15

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr5e-7

Text Generation • Updated Jul 31, 2025 • 9

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr3e-8

Text Generation • Updated Jul 31, 2025 • 10

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr2e-7

Text Generation • Updated Jul 31, 2025 • 6

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr9e-8

Text Generation • Updated Jul 31, 2025 • 14 • 1

mlx-community/Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr1e-7

Text Generation • Updated Jul 31, 2025 • 7