Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,548

Base only

Active filters: 2-bit

shubhamg2208/tomoro-ai-colqwen3-embed-4b-auto-round-w2a16g32

1B • Updated Dec 9, 2025

Matt300209/autoround_test

1B • Updated Dec 9, 2025 • 1

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 97

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 270

alexgusevski/Ministral-3-3B-Instruct-2512-q2-mlx

Text Generation • 0.3B • Updated Dec 11, 2025 • 8

alexgusevski/Ministral-3-3B-Reasoning-2512-q2-mlx

Text Generation • 0.3B • Updated Dec 11, 2025 • 9

alexgusevski/Ministral-3-8B-Instruct-2512-q2-mlx

Text Generation • 0.8B • Updated Dec 11, 2025 • 8

alexgusevski/Ministral-3-8B-Reasoning-2512-q2-mlx

Text Generation • 0.8B • Updated Dec 11, 2025 • 4

alexgusevski/Lightning-1.7B-q2-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 2

mlx-community/YandexGPT-5-Lite-8B-instruct-q2

Text Generation • 0.8B • Updated Mar 19 • 78 • 2

garrison/Magidonia-24B-v4.3-mlx-2Bit

24B • Updated Dec 17, 2025 • 8

garrison/Cydonia-24B-v4.3-mlx-2Bit

24B • Updated Dec 18, 2025 • 192 • 1

INC4AI/Qwen3-8B-w2g64-AutoRound-test

2B • Updated Dec 23, 2025 • 5 • 1

Wwayu/GLM-4.7-PRISM-mlx-2Bit

Text Generation • 353B • Updated Dec 25, 2025 • 670 • 4

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2

Text Generation • 1B • Updated Dec 30, 2025 • 36

cosmicgob/Qwen3-30B-A3B-Instruct-2507-mlx-2Bit

Text Generation • 31B • Updated Jan 2 • 27

cosmicgob/Qwen3-0.6B-mlx-2Bit

Text Generation • 55.9M • Updated Jan 2 • 16 • 1

AiAF/Midnight-Miqu-70B-v1.5-MLX-2Bit

Text Generation • 69B • Updated Jan 6 • 65

AiAF/rp-sft-merged_1000-MLX-2Bit

Text Generation • 0.3B • Updated Jan 6 • 13

Eldadalbajob/GLM-4.7-REAP-50-mlx-2Bit

Text Generation • 185B • Updated Jan 8 • 124 • 2

alexgusevski/LFM2.5-1.2B-Nova-Function-Calling-q2-mlx

Text Generation • 0.1B • Updated Jan 10 • 33

alexgusevski/LFM2.5-VL-1.6B-q2-mlx

Image-Text-to-Text • 0.5B • Updated Jan 10 • 9

alexgusevski/Youtu-LLM-2B-q2-mlx

Text Generation • 0.2B • Updated Jan 10 • 2 • 1

alexgusevski/HY-MT1.5-1.8B-q2-mlx

Text Generation • 0.2B • Updated Jan 10 • 69

alexgusevski/Huihui-HY-MT1.5-7B-abliterated-q2-mlx

Text Generation • 0.7B • Updated Jan 10 • 16

alexgusevski/Huihui-Qwen3-VL-4B-Instruct-abliterated-q2-mlx

Image-Text-to-Text • 0.8B • Updated Jan 10 • 25

ParetoQaft/8B-Tulu-full-gptq-2bit

8B • Updated Feb 6 • 1

ParetoQaft/1B-Tulu-full-gptq-2bit

1B • Updated Feb 6 • 1

Matt300209/autoround_style_unmerged

0.4B • Updated Jan 11 • 1

alexgusevski/Falcon-H1R-7B-q2-mlx

Text Generation • 0.7B • Updated Jan 11 • 7