Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,923

Base only

Active filters: 5-bit

mlx-community/LFM2-2.6B-Exp-5bit

Text Generation • 0.5B • Updated Dec 26, 2025 • 22

mlx-community/MiniMax-M2.1-5bit

Text Generation • 229B • Updated Jan 6 • 34 • 1

m-i/HY-MT1.5-7B-mlx-5Bit

Translation • 1B • Updated Dec 30, 2025 • 4

mlx-community/IQuest-Coder-V1-40B-Instruct-5bit

Text Generation • 40B • Updated Jan 2 • 28

mlx-community/K-EXAONE-236B-A23B-5bit

Text Generation • 237B • Updated Jan 6 • 27

mlx-community/Soprano-80M-5bit

Text-to-Speech • 18.4M • Updated Jan 4 • 6

mlx-community/Falcon-H1R-7B-5bit

Text Generation • 1B • Updated Jan 5 • 15

aimeri/Broken-Tutu-24B-Unslop-v2.0-mlx-5Bit

Text Generation • 24B • Updated Jan 6 • 19

LiquidAI/LFM2.5-1.2B-Instruct-MLX-5bit

Text Generation • 0.2B • Updated 20 days ago • 414 • 9

LiquidAI/LFM2.5-1.2B-JP-MLX-5bit

Text Generation • 0.2B • Updated Jan 7 • 221 • 9

mlx-community/LFM2.5-VL-1.6B-5bit

Image-Text-to-Text • 0.6B • Updated Jan 6 • 21

mlx-community/LFM2.5-1.2B-Base-5bit

Text Generation • 0.2B • Updated Jan 6 • 24

mlx-community/LFM2.5-1.2B-Instruct-5bit

Text Generation • 0.2B • Updated 20 days ago • 225

mlx-community/LFM2.5-1.2B-JP-5bit

Text Generation • 0.2B • Updated Jan 6 • 19

alexcovo/MiroThinker-v1.5-30B-mlx-fp16-mlx-5Bit

Text Generation • 31B • Updated Jan 6 • 9

nightmedia/Qwen3-Next-80B-A3B-Instruct-Decensored-qx53n-mlx

Text Generation • 80B • Updated Jan 6 • 74

bradyclarke/Spark-270M-FP16-mlx-5Bit

Text Generation • 50.3M • Updated Jan 7 • 10

bradyclarke/Lightning-1.7B-mlx-5Bit

Text Generation • 0.3B • Updated Jan 7 • 10

mlx-community/LFM2-2.6B-Transcript-5bit

Text Generation • 0.5B • Updated Jan 7 • 29

LibraxisAI/Bielik-11B-v3.0-mlx-q5

Text Generation • 11B • Updated May 11 • 36

mlx-community/Molmo2-8B-5bit

Video-Text-to-Text • 3B • Updated Jan 11 • 28

alexgusevski/Mistral-Nemo-Instruct-2407-heretic-noslop-mlx-5Bit

12B • Updated Jan 12 • 9

alexgusevski/Llama-3.3-8B-Instruct-128K_Abliterated-mlx-5Bit

8B • Updated Jan 12 • 16

alexgusevski/Eva-4B-mlx-5Bit

Text Generation • 0.8B • Updated Jan 12 • 8

alexgusevski/Impish_Nemo_12B-mlx-5Bit

12B • Updated Jan 12 • 6

alexgusevski/Angelic_Eclipse_12B-mlx-5Bit

12B • Updated Jan 12 • 8

alexgusevski/LFM2.5-1.2B-Instruct-Thinking-Claude-High-Reasoning-mlx-5Bit

Text Generation • 0.2B • Updated Jan 12 • 27

alexgusevski/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-mlx-5Bit

Text Generation • 35B • Updated Jan 12 • 21

alexgusevski/Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus-mlx-5Bit

Text Generation • 12B • Updated Jan 12 • 48

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-5Bit

Text Generation • 8B • Updated Jan 12 • 44