Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,857

Base only

Active filters: 5-bit

majentik/Qwen3.5-122B-A10B-TurboQuant-MLX-5bit

Text Generation • 122B • Updated 27 days ago • 108

majentik/MiniCPM5-1B-RotorQuant-MLX-5bit

Text Generation • 0.2B • Updated 27 days ago • 26

majentik/MiniCPM5-1B-TurboQuant-MLX-5bit

Text Generation • 0.2B • Updated 27 days ago • 27

majentik/MiniCPM5-1B-SFT-RotorQuant-MLX-5bit

Text Generation • 0.2B • Updated 27 days ago • 23

majentik/MiniCPM5-1B-SFT-TurboQuant-MLX-5bit

Text Generation • 0.2B • Updated 27 days ago • 31

majentik/MiniCPM5-1B-Base-RotorQuant-MLX-5bit

Text Generation • 0.2B • Updated 27 days ago • 30

majentik/MiniCPM5-1B-Base-TurboQuant-MLX-5bit

Text Generation • 0.2B • Updated 27 days ago • 49

tegsvenson/gemma-4-26B-A4B-it-oQ5-fp16

5B • Updated 25 days ago • 82

Nimbus8-Labs/Nimbus-2B-MLX-4bit

Text Generation • 0.4B • Updated 23 days ago • 95

Nimbus8-Labs/Nimbus-4B-MLX-4bit

Text Generation • 0.8B • Updated 23 days ago • 40

Nimbus8-Labs/Nimbus-9B-v2.1-MLX-4bit

Text Generation • 9B • Updated 23 days ago • 38

MercuriusDream/Nanbeige4.2-3B-mlx-5bit

Text Generation • 0.8B • Updated 23 days ago • 91

mlx-community/Laguna-S-2.1-oQ5e

Text Generation • 20B • Updated 21 days ago • 1.78k • 4

aufklarer/Cohere-Transcribe-2B-MLX-5bit

Automatic Speech Recognition • 0.6B • Updated 22 days ago • 50

aufklarer/Voxtral-Mini-3B-2507-MLX-5bit

Automatic Speech Recognition • 1B • Updated 22 days ago • 80

pipenetwork/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-MLX-5bit

Image-Text-to-Text • 2B • Updated 21 days ago • 559

csrstka/Qwen3.6-27B-oQ5e-fp16-mtp

6B • Updated 21 days ago • 593 • 1

scottlowry/Qwen3.5-9B-oQ5e-mtp

2B • Updated 21 days ago • 45

elte-nlp/Racka-4B-MLX-5bit

Text Generation • Updated 21 days ago

csrstka/Qwen3.6-27B-oQ5-fp16-mtp

6B • Updated 21 days ago • 102

TheWirelessPhoenix/DeepSeek-R1-0528-Qwen3-8B-oQ5e-fp16

2B • Updated 21 days ago • 92

TheWirelessPhoenix/DeepSeek-R1-0528-Qwen3-8B-oQ5e

2B • Updated 21 days ago • 112

1qh/chandra-ocr-2-oq5-mlx

Image-Text-to-Text • 1B • Updated 21 days ago • 38

aufklarer/MOSS-Transcribe-Diarize-0.9B-MLX-5bit

Automatic Speech Recognition • Updated 21 days ago • 1.13k

scottlowry/Qwen3.5-4B-oQ5e-fp16-mtp

1B • Updated 20 days ago • 20

scottlowry/Qwen3.5-4B-oQ5e-mtp

1B • Updated 20 days ago • 22

scottlowry/Qwen3.5-9B-oQ5e-fp16-mtp

2B • Updated 20 days ago • 50

TheWirelessPhoenix/gemma-4-E4B-it-5bit-mlx

Any-to-Any • 2B • Updated 20 days ago • 41

disinfozone/kenosistron

Text Generation • 24B • Updated 19 days ago • 45

blackfan23/grug-27b-oQ5e-mtp

6B • Updated 15 days ago • 28