Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,918

Base only

Active filters: 5-bit

introvoyz041/unsloth-JanusCoder-8B-dwq5-mlx-mlx-4Bit

Text Generation • 8B • Updated Dec 4, 2025 • 12 • 1

introvoyz041/unsloth-JanusCoder-14B-dwq5-mlx-mlx-4Bit

Text Generation • 15B • Updated Dec 4, 2025 • 8

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

Text Generation • 8B • Updated Dec 6, 2025 • 88.3k • 6

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated Dec 6, 2025 • 257 • 3

mlx-community/GLM-4.6V-Flash-5bit

Image-Text-to-Text • Updated Dec 8, 2025 • 33

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 89.9k • 6

mlx-community/GLM-4.6V-5bit

Image-Text-to-Text • Updated Dec 8, 2025 • 19

mlx-community/Devstral-Small-2-24B-Instruct-2512-5bit

Image-Text-to-Text • 5B • Updated Jul 4 • 106

mlx-community/Devstral-2-123B-Instruct-2512-5bit

Text Generation • 125B • Updated Dec 10, 2025 • 189

Wwayu/Qwen3-32B-heretic-mlx-5Bit

Text Generation • 33B • Updated Dec 14, 2025 • 13

mlx-community/VibeVoice-Realtime-0.5B-5bit

Text-to-Speech • 0.2B • Updated Dec 15, 2025 • 9

pj1983/Huihui-Qwen3-14B-abliterated-v2-mlx-5bit

Text Generation • 15B • Updated Dec 15, 2025 • 78

pj1983/Ministral-3-14B-Instruct-2512-heretic-mlx-5bit

Text Generation • 14B • Updated Dec 15, 2025 • 38

mlx-community/VoxCPM1.5-5bit

Text-to-Speech • 0.2B • Updated Dec 16, 2025 • 7

mlx-community/EuroLLM-22B-Instruct-2512-mlx-5bit

Text Generation • 23B • Updated Dec 16, 2025 • 29

mlx-community/chatterbox-turbo-5bit

Text-to-Speech • 0.2B • Updated Dec 17, 2025 • 13

mlx-community/chatterbox-5bit

Text-to-Speech • 0.2B • Updated Jan 5 • 27

garrison/Magidonia-24B-v4.3-mlx-5Bit

24B • Updated Dec 17, 2025 • 13

mlx-community/functiongemma-270m-it-5bit

Text Generation • 50.3M • Updated Dec 18, 2025 • 17

lmstudio-community/functiongemma-270m-it-MLX-5bit

Text Generation • 50.3M • Updated Dec 18, 2025 • 24

mlx-community/VyvoTTS-EN-Beta-5bit

Text Generation • 0.3B • Updated Dec 18, 2025

garrison/Cydonia-24B-v4.3-mlx-5Bit

24B • Updated Dec 18, 2025 • 42

BennyDaBall/qwen3-4b-Z-Image-Engineer-V2-5bit-MLX

0.8B • Updated Jun 22 • 76 • 1

mlx-community/GLM-ASR-Nano-2512-5bit

Automatic Speech Recognition • 0.4B • Updated Dec 19, 2025 • 14

mlx-community/DeepSeek-V3.2-mlx-5bit

Text Generation • 672B • Updated Jan 6 • 134 • 2

manhellis/Valkyrie-49B-v2-mlx-5Bit

50B • Updated Dec 24, 2025 • 7

mlx-community/Qwen3-Omni-30B-A3B-Instruct-5bit

Any-to-Any • 8B • Updated Dec 24, 2025 • 29

mlx-community/LFM2-2.6B-Exp-5bit

Text Generation • 0.5B • Updated Dec 26, 2025 • 20

mlx-community/MiniMax-M2.1-5bit

Text Generation • 229B • Updated Jan 6 • 27 • 1

m-i/HY-MT1.5-7B-mlx-5Bit

Translation • 1B • Updated Dec 30, 2025 • 6