Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,719

Base only

Active filters: 2-bit

usermma/Apodex-1.0-mini-mlx-2Bit

Text Generation • 35B • Updated 30 days ago • 18

usermma/VibeThinker-3B-mlx-2Bit

Text Generation • 0.3B • Updated 29 days ago • 232

usermma/Darwin-28B-Coder-mlx-2Bit

Text Generation • 27B • Updated 29 days ago • 28 • 1

usermma/Qwable-v1-mlx-2Bit

Text Generation • 35B • Updated 29 days ago • 151

LuciaValentine/origin_gemma4_12b_exllama3_2.0bpw

Any-to-Any • 3B • Updated 29 days ago • 29

avneetsb/diffusiongemma-26B-A4B-it-oQ2-fp16

3B • Updated 28 days ago • 305

avneetsb/diffusiongemma-26B-A4B-it-oQ2.5-fp16

3B • Updated 28 days ago • 136

avneetsb/diffusiongemma-26B-A4B-it-oQ2.7-fp16

3B • Updated 28 days ago • 142

lasrevinu333-design/WizardLM-2-8x22B-GGUF

Text Generation • 141B • Updated 28 days ago • 4

jknlsn/Qwen3.6-35B-A3B-oQ2-mtp

Image-Text-to-Text • 4B • Updated 21 days ago • 252

Ontologer/FaceNet-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated 25 days ago • 16

Ontologer/NGMI-Qwen3-8B-2Bit-Heretic

Text Generation • 8B • Updated 25 days ago • 18

nahid37/deepseek-v4-gguf

Text Generation • 284B • Updated 24 days ago • 662

yw223/Meta-Llama-3.1-8B-Instruct-GPTQ-2bit

Text Generation • 8B • Updated 23 days ago • 57

yw223/Qwen3-8B-GPTQ-2bit

Text Generation • 1B • Updated 23 days ago • 46

yw223/Gemma-2-9B-it-GPTQ-2bit

Text Generation • 0.9B • Updated 23 days ago • 43

yw223/Meta-Llama-3.1-8B-Instruct-AWQ-2bit

Text Generation • 8B • Updated 23 days ago • 36

yw223/Qwen3-8B-AWQ-2bit

Text Generation • 8B • Updated 23 days ago • 27

yw223/Gemma-2-9B-it-AWQ-2bit

Text Generation • 9B • Updated 23 days ago • 19

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated 14 days ago • 4.22k • 1

iggerask/DeepSeek-V4-Flash-2bit-GB10

Text Generation • 5B • Updated 22 days ago • 1.3k • 3

alvarolizama/Qwen3.6-35B-A3B-oQ2-fp16-mtp

4B • Updated 22 days ago • 186

Ninnix96/Qwen3.6-35B-A3B-gguf

Text Generation • 35B • Updated 7 days ago • 2.82k

aufklarer/gemma-4-E4B-it-MLX-2bit

Text Generation • 0.7B • Updated 21 days ago • 54

aufklarer/gemma-4-E2B-it-MLX-2bit

Text Generation • 0.4B • Updated 21 days ago • 44

alvarolizama/Ornith-1.0-9B-oQ2-fp16

1B • Updated 20 days ago • 1.52k

usermma/Atomight-V2.2-UltraThink-0.5B-abliterated-mlx-2Bit

46.4M • Updated 17 days ago • 21

usermma/Mythos-nano-OBLITERATED-mlx-2Bit

0.3B • Updated 17 days ago • 39

usermma/QwenPaw-Flash-9B-heretic-mlx-2Bit

0.8B • Updated 17 days ago • 49

usermma/Qwythos-9B-Claude-Mythos-5-1M-mlx-2Bit

Text Generation • 0.8B • Updated 17 days ago • 152