Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,717

Base only

Active filters: 2-bit

garrison/Magidonia-24B-v4.3-mlx-2Bit

24B • Updated Dec 17, 2025 • 9

garrison/Cydonia-24B-v4.3-mlx-2Bit

24B • Updated Dec 18, 2025 • 214 • 1

INC4AI/Qwen3-8B-w2g64-AutoRound-test

2B • Updated Dec 23, 2025 • 6 • 1

Wwayu/GLM-4.7-PRISM-mlx-2Bit

Text Generation • 353B • Updated Dec 25, 2025 • 533 • 4

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2

Text Generation • 1B • Updated Dec 30, 2025 • 14

cosmicgob/Qwen3-30B-A3B-Instruct-2507-mlx-2Bit

Text Generation • 31B • Updated Jan 2 • 36

cosmicgob/Qwen3-0.6B-mlx-2Bit

Text Generation • 55.9M • Updated Jan 2 • 16 • 1

AiAF/Midnight-Miqu-70B-v1.5-MLX-2Bit

Text Generation • 69B • Updated Jan 6 • 43

AiAF/rp-sft-merged_1000-MLX-2Bit

Text Generation • 0.3B • Updated Jan 6 • 1

Eldadalbajob/GLM-4.7-REAP-50-mlx-2Bit

Text Generation • 185B • Updated Jan 8 • 143 • 2

alexgusevski/LFM2.5-1.2B-Nova-Function-Calling-q2-mlx

Text Generation • 0.1B • Updated Jan 10 • 18

alexgusevski/LFM2.5-VL-1.6B-q2-mlx

Image-Text-to-Text • 0.5B • Updated Jan 10 • 4

alexgusevski/Youtu-LLM-2B-q2-mlx

Text Generation • 0.2B • Updated Jan 10 • 6 • 1

alexgusevski/HY-MT1.5-1.8B-q2-mlx

Text Generation • 0.2B • Updated Jan 10 • 7

alexgusevski/Huihui-HY-MT1.5-7B-abliterated-q2-mlx

Text Generation • 0.7B • Updated Jan 10 • 14

alexgusevski/Huihui-Qwen3-VL-4B-Instruct-abliterated-q2-mlx

Image-Text-to-Text • 0.8B • Updated Jan 10 • 11

ParetoQaft/8B-Tulu-full-gptq-2bit

8B • Updated Feb 6 • 1

ParetoQaft/1B-Tulu-full-gptq-2bit

1B • Updated Feb 6 • 3

Matt300209/autoround_style_unmerged

0.4B • Updated Jan 11 • 1

alexgusevski/Falcon-H1R-7B-q2-mlx

Text Generation • 0.7B • Updated Jan 11 • 3

alexgusevski/Huihui-Qwen3-VL-8B-Instruct-abliterated-q2-mlx

Image-Text-to-Text • 1B • Updated Jan 11 • 21

alexgusevski/Huihui-GLM-4.6V-Flash-abliterated-q2-mlx

Image-Text-to-Text • 2B • Updated Jan 11 • 34

alexgusevski/GLM-4.6V-Flash-q2-mlx

Image-Text-to-Text • 2B • Updated Jan 11 • 13

alexgusevski/Mistral-Nemo-Instruct-2407-heretic-noslop-mlx-2Bit

1B • Updated Jan 12 • 25

alexgusevski/Llama-3.3-8B-Instruct-128K_Abliterated-mlx-2Bit

0.8B • Updated Jan 12 • 23

alexgusevski/Eva-4B-mlx-2Bit

Text Generation • 0.4B • Updated Jan 12 • 6

alexgusevski/LFM2.5-1.2B-Instruct-Thinking-Claude-High-Reasoning-mlx-2Bit

Text Generation • 0.1B • Updated Jan 12 • 10

alexgusevski/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-mlx-2Bit

Text Generation • 35B • Updated Jan 12 • 28

alexgusevski/Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus-mlx-2Bit

Text Generation • 1B • Updated Jan 12 • 85

alexgusevski/saiga_llama3_8b-q2-mlx

Text Generation • 0.8B • Updated Jan 12 • 4