Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,618

Base only

Active filters: 5-bit

Irfanuruchi/SmolLM2-135M-Instruct-MLX-5bit

Text Generation • 25.3M • Updated Jan 24 • 5

NexVeridian/GLM-4.7-Flash-REAP-23B-A3B-5bit

Text Generation • 23B • Updated Mar 6 • 45

mlx-community/SERA-8B-GA-5bit

Text Generation • 8B • Updated Jan 27 • 9

mlx-community/SERA-32B-GA-5bit

Text Generation • 33B • Updated Jan 27 • 3

mlx-community/SERA-32B-5bit

Text Generation • 33B • Updated Jan 27 • 4

mlx-community/DeepSeek-OCR-2-5bit

Image-Text-to-Text • 1B • Updated Jan 28 • 68

mlx-community/Falcon-H1-Tiny-90M-Instruct-5bit

Text Generation • 17.2M • Updated Jan 28 • 11

mlx-community/Falcon-H1-Tiny-90M-Base-5bit

Text Generation • 17.2M • Updated Jan 28 • 3

mlx-community/Falcon-H1-Tiny-Multilingual-100M-Base-5bit

Text Generation • 20.3M • Updated Jan 28 • 9

mlx-community/Falcon-H1-Tiny-Multilingual-100M-Instruct-5bit

Text Generation • 20.3M • Updated Jan 28 • 16

mlx-community/Falcon-H1-Tiny-90M-Instruct-Curriculum-5bit

Text Generation • 17.2M • Updated Jan 28 • 14

mlx-community/Falcon-H1-Tiny-90M-Instruct-pre-DPO-5bit

Text Generation • 17.2M • Updated Jan 28 • 12

mlx-community/Falcon-H1-Tiny-90M-Instruct-Curriculum-pre-DPO-5bit

Text Generation • 17.2M • Updated Jan 28 • 15

mlx-community/Falcon-H1-Tiny-Coder-90M-5bit

Text Generation • 17.2M • Updated Jan 28 • 32

mlx-community/Falcon-H1-Tiny-Tool-Calling-90M-5bit

Text Generation • 17.2M • Updated Jan 28 • 24

mlx-community/Falcon-H1-Tiny-R-0.6B-5bit

Text Generation • 0.1B • Updated Jan 28 • 10

mlx-community/Falcon-H1-Tiny-R-0.6B-pre-GRPO-5bit

Text Generation • 0.1B • Updated Jan 28 • 10

mlx-community/Falcon-H1-Tiny-R-90M-5bit

Text Generation • 17.2M • Updated Jan 28 • 15

mlx-community/Qwen3-ASR-1.7B-5bit

0.6B • Updated Jan 29 • 23 • 1

mlx-community/Qwen3-ASR-0.6B-5bit

0.3B • Updated Jan 29 • 28

mlx-community/PaddleOCR-VL-1.5-5bit

Image-Text-to-Text • 0.3B • Updated Jan 29 • 32

mlx-community/Qwen3-ForcedAligner-0.6B-5bit

0.4B • Updated Jan 29 • 4

BlueMoonlight/DeepSeek-R1-Distill-Qwen-14B-mlx-5Bit

Text Generation • 15B • Updated Feb 1 • 125 • 1

mlx-community/GLM-OCR-5bit

Image-to-Text • 0.6B • Updated Feb 3 • 65

mollysama/rwkv7-2.9B-g1d-20260131-ctx8192-mlx-6bit

Text Generation • 0.6B • Updated Feb 3 • 76 • 1

NexVeridian/Qwen3-Coder-Next-5bit

Text Generation • 80B • Updated Mar 6 • 130

mlx-community/Qwen3-Coder-Next-5bit

Text Generation • 80B • Updated Feb 3 • 1.11k • 2

mlx-community/Soprano-1.1-80M-5bit

Text-to-Speech • 21M • Updated Feb 4 • 22

Wwayu/Hermes-4.3-36B-mlx-5Bit

Text Generation • 36B • Updated Feb 5 • 222

Irfanuruchi/Phi-2-MLX-5bit

Text Generation • 0.5B • Updated Feb 7 • 9