Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,718

Base only

Active filters: 2-bit

avneetsb/Qwen3.5-9B-oQ2-fp16

1B • Updated May 5 • 6

chopraanmol1/Qwen3.6-35B-A3B-mlx-2Bit

Image-Text-to-Text • 35B • Updated May 5 • 47

chopraanmol1/Qwen3.6-27B-mlx-2Bit

Image-Text-to-Text • 27B • Updated May 5 • 112

culturerevolt/Qwen3-48B-A4B-Savant-Commander-Distill-12X-Closed-Open-Heretic-Uncensored-mlx-2Bit

Text Generation • 34B • Updated May 6 • 101

avneetsb/Qwen3.5-2B-oQ2-fp16

0.5B • Updated May 6 • 5

shawon/Qwen3.6-35B-A3B-mlx-2Bit

Image-Text-to-Text • 35B • Updated Jun 3 • 296

avneetsb/Qwen3.5-4B-oQ2-fp16

0.8B • Updated May 6 • 7

tritesh/gemma-4-31B-it-mlx-2Bit

Image-Text-to-Text • 31B • Updated May 6 • 7

harishkumar12k/gemma-4-E2B-it-mlx-2Bit

Any-to-Any • 0.4B • Updated May 6 • 30

welcoma/Ternary-Bonsai-1.7B-bonsai_tq_f32-MLC

Text Generation • Updated May 6 • 3

welcoma/Ternary-Bonsai-4B-bonsai_tq_f32-MLC

Text Generation • Updated May 6 • 2

welcoma/Ternary-Bonsai-8B-bonsai_tq_f32-MLC

Text Generation • Updated May 6 • 1

fcobos/Qwen3.6-35B-A3B-oQ2-mtp

4B • Updated May 7 • 46

fcobos/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ2-mtp

4B • Updated May 7 • 171 • 1

zaydiscold/Qwen2.5-7B-Instruct-MLX-2bit

0.7B • Updated May 7 • 18

jinreiyu/Bonsai-REDUX2-MLX-2bit-pure

Text Generation • 0.6B • Updated May 15 • 58

LuciaValentine/origin_gemma3_27b_exllama3_2.0bpw

Image-Text-to-Text • 6B • Updated May 8 • 5

zecanard/gemma-4-E2B-it-ultra-uncensored-heretic-MLX-2bit-mixed_2_6

Any-to-Any • 1B • Updated about 1 month ago • 111 • 1

zecanard/Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-MLX-2bit-mixed_2_6

Image-Text-to-Text • 5B • Updated Jun 12 • 521 • 1

zecanard/gemma-4-26B-A4B-it-Claude-Opus-Distilled-v2-MLX-2bit-mixed_2_6

Image-Text-to-Text • 3B • Updated about 1 month ago • 160 • 1

zecanard/gemma-4-31B-it-Claude-Opus-Distilled-MLX-2bit-mixed_2_6

Image-Text-to-Text • 4B • Updated about 1 month ago • 79 • 1

zecanard/gemma-4-31B-it-Claude-Opus-Distilled-v2-MLX-2bit-mixed_2_6

Image-Text-to-Text • 4B • Updated about 1 month ago • 131 • 1

zecanard/Qwopus3.6-35B-A3B-v1-MLX-2bit-mixed_2_6

Image-Text-to-Text • 4B • Updated Jun 12 • 165 • 1

LuciaValentine/origin_gemma4_31b_exllama3_2.0bpw

Image-Text-to-Text • 6B • Updated May 8 • 1

jesusoctavioas/Qwen3.6-35B-A3B-mlx-2Bit

Image-Text-to-Text • 35B • Updated May 23 • 111

qsjp/granite-4.1-8b-autobit-2.5bpw-onecomp

1B • Updated May 9 • 1 • 1

LuciaValentine/origin_gemma4_26b_a4b_exllama3_2.0bpw

Image-Text-to-Text • 5B • Updated May 9 • 1

LuciaValentine/origin_gemma3_12b_exllama3_2.0bpw

Image-Text-to-Text • 3B • Updated May 9 • 4

LuciaValentine/origin_gemma3_4b_exllama3_2.0bpw

Image-Text-to-Text • 2B • Updated May 9 • 1

LuciaValentine/origin_gemma3_1b_exllama3_2.0bpw

Text Generation • 0.5B • Updated May 9 • 2