Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,491

Base only

Active filters: 3-bit

alexgusevski/Ministral-3-3B-Reasoning-2512-q3-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 11

alexgusevski/Ministral-3-8B-Instruct-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 12

alexgusevski/Ministral-3-8B-Reasoning-2512-q3-mlx

Text Generation • 1B • Updated Dec 11, 2025 • 18

alexgusevski/Lightning-1.7B-q3-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 7

pj1983/WeirdCompound-v1.5-24b-mlx-3bit

Text Generation • 24B • Updated Dec 12, 2025 • 13

pj1983/Cydonia-Redux-22B-v1.1-mlx-3bit

Text Generation • 22B • Updated Dec 14, 2025 • 28

garrison/Magidonia-24B-v4.3-mlx-3Bit

24B • Updated Dec 17, 2025 • 10

br2835/mistraladaptmerged-mlx-3bit

Text Generation • 24B • Updated Dec 18, 2025 • 6

garrison/Cydonia-24B-v4.3-mlx-3Bit

24B • Updated Dec 18, 2025 • 16

mrtoots/unsloth-GLM-4.7-mlx-3Bit

Text Generation • 353B • Updated Dec 23, 2025 • 172 • 1

mlx-community/MiniMax-M2.1-3bit

Text Generation • 229B • Updated Feb 18 • 2.64k • 5

DiscoStew/GLM-4.6V-3Bit

Image-Text-to-Text • Updated Dec 28, 2025 • 12

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3

Text Generation • 15B • Updated Dec 30, 2025 • 10

0xSero/DeepSeek-V3.2-345B-W3A16

Text Generation • 2B • Updated May 30 • 34 • 10

mlx-community/GLM-4.7-REAP-50-mixed-3-4-bits

Text Generation • 185B • Updated Jan 4 • 86 • 3

AiAF/Midnight-Miqu-70B-v1.5-MLX-3Bit

Text Generation • 69B • Updated Jan 6 • 33

thoddnn/Qwen3-VL-4B-Instruct-3bit

Image-Text-to-Text • 0.9B • Updated Jan 7 • 11

scaryrawr/GLM-4.7-REAP-50-mlx-3Bit

Text Generation • 185B • Updated Jan 8 • 27

alexgusevski/LFM2.5-1.2B-Nova-Function-Calling-q3-mlx

Text Generation • 0.1B • Updated Jan 10 • 20

alexgusevski/LFM2.5-VL-1.6B-q3-mlx

Image-Text-to-Text • 0.6B • Updated Jan 10 • 11

alexgusevski/Youtu-LLM-2B-q3-mlx

Text Generation • 0.2B • Updated Jan 10 • 7 • 1

alexgusevski/HY-MT1.5-1.8B-q3-mlx

Text Generation • 0.2B • Updated Jan 10 • 11

alexgusevski/Huihui-HY-MT1.5-7B-abliterated-q3-mlx

Text Generation • 0.9B • Updated Jan 10 • 11

alexgusevski/Huihui-Qwen3-VL-4B-Instruct-abliterated-q3-mlx

Image-Text-to-Text • 0.9B • Updated Jan 10 • 19

alexgusevski/Falcon-H1R-7B-q3-mlx

Text Generation • 0.9B • Updated Jan 11 • 11

alexgusevski/Huihui-Qwen3-VL-8B-Instruct-abliterated-q3-mlx

Image-Text-to-Text • 2B • Updated Jan 11 • 15

alexgusevski/Huihui-GLM-4.6V-Flash-abliterated-q3-mlx

Image-Text-to-Text • 2B • Updated Jan 11 • 36

alexgusevski/GLM-4.6V-Flash-q3-mlx

Image-Text-to-Text • 2B • Updated Jan 11 • 10

alexgusevski/Mistral-Nemo-Instruct-2407-heretic-noslop-mlx-3Bit

2B • Updated Jan 12 • 26

alexgusevski/Llama-3.3-8B-Instruct-128K_Abliterated-mlx-3Bit

1B • Updated Jan 12 • 32