Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,618

Base only

Active filters: 5-bit

MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF

Text Generation • 8B • Updated Dec 6, 2025 • 78.4k • 6

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated Dec 6, 2025 • 321 • 3

mlx-community/GLM-4.6V-Flash-5bit

Image-Text-to-Text • Updated Dec 8, 2025 • 37

mlx-community/GLM-4.6V-5bit

Image-Text-to-Text • Updated Dec 8, 2025 • 12

introvoyz041/UIGEN-X-8B-dwq5-mlx-mlx-6Bit

Text Generation • 8B • Updated Dec 8, 2025 • 14

mlx-community/Devstral-Small-2-24B-Instruct-2512-5bit

Updated Dec 9, 2025 • 142

mlx-community/Devstral-2-123B-Instruct-2512-5bit

Text Generation • 125B • Updated Dec 10, 2025 • 97

mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-5Bit

Text Generation • 24B • Updated Dec 14, 2025 • 105

Wwayu/Qwen3-32B-heretic-mlx-5Bit

Text Generation • 33B • Updated Dec 14, 2025 • 12

mlx-community/VibeVoice-Realtime-0.5B-5bit

Text-to-Speech • 0.2B • Updated Dec 15, 2025 • 15

pj1983/Huihui-Qwen3-14B-abliterated-v2-mlx-5bit

Text Generation • 15B • Updated Dec 15, 2025 • 46

mlx-community/VoxCPM1.5-5bit

Text-to-Speech • 0.2B • Updated Dec 16, 2025 • 12

mlx-community/EuroLLM-22B-Instruct-2512-mlx-5bit

Text Generation • 23B • Updated Dec 16, 2025 • 13

mlx-community/chatterbox-turbo-5bit

Text-to-Speech • 0.2B • Updated Dec 17, 2025 • 15

mlx-community/chatterbox-5bit

Text-to-Speech • 0.2B • Updated Jan 5 • 11

garrison/Magidonia-24B-v4.3-mlx-5Bit

24B • Updated Dec 17, 2025 • 7

mlx-community/functiongemma-270m-it-5bit

Text Generation • 50.3M • Updated Dec 18, 2025 • 11

lmstudio-community/functiongemma-270m-it-MLX-5bit

Text Generation • 50.3M • Updated Dec 18, 2025 • 40

mlx-community/VyvoTTS-EN-Beta-5bit

Text Generation • 0.3B • Updated Dec 18, 2025

BennyDaBall/qwen3-4b-Z-Image-Engineer-V2-5bit-MLX

0.8B • Updated Dec 19, 2025 • 114 • 1

mlx-community/GLM-ASR-Nano-2512-5bit

Automatic Speech Recognition • 0.4B • Updated Dec 19, 2025 • 18

mlx-community/DeepSeek-V3.2-mlx-5bit

Text Generation • 672B • Updated Jan 6 • 202 • 2

manhellis/Valkyrie-49B-v2-mlx-5Bit

50B • Updated Dec 24, 2025 • 2

mlx-community/Qwen3-Omni-30B-A3B-Instruct-5bit

Any-to-Any • 8B • Updated Dec 24, 2025 • 19

mlx-community/LFM2-2.6B-Exp-5bit

Text Generation • 0.5B • Updated Dec 26, 2025 • 9

mlx-community/MiniMax-M2.1-5bit

Text Generation • 229B • Updated Jan 6 • 17 • 1

m-i/HY-MT1.5-7B-mlx-5Bit

Translation • 1B • Updated Dec 30, 2025 • 11

mlx-community/IQuest-Coder-V1-40B-Instruct-5bit

Text Generation • 40B • Updated Jan 2 • 17

mlx-community/K-EXAONE-236B-A23B-5bit

Text Generation • 237B • Updated Jan 6 • 19

mlx-community/Falcon-H1R-7B-5bit

Text Generation • 1B • Updated Jan 5 • 7