Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,719

Base only

Active filters: 2-bit

zecanard/gemma-4-26B-A4B-it-uncensored-abliterix-MLX-2bit-mixed_2_6

Image-Text-to-Text • 3B • Updated about 1 month ago • 403 • 1

enet45/Qwen3.5-27B-Claude-4.6-OS-Auto-Variable-Heretic-Uncensored-Thinking-mlx-2Bit

Image-Text-to-Text • 27B • Updated Apr 22 • 79

enet45/Gemma-3-27b-it-Uncensored-HERETIC-Gemini-Deep-Reasoning-mlx-2Bit

Image-Text-to-Text • 27B • Updated Apr 22 • 113

frogggias/Qwen3.6-27B-mlx-oQ2

3B • Updated Apr 22 • 37 • 1

Jundot/Qwen3.6-35B-A3B-oQ2

4B • Updated Apr 23 • 107 • 2

LuciaValentine/Gemma3-hiyori-12B-2_0

3B • Updated May 2

LuciaValentine/Gemma3-hiyori-12B-2_0-Uncensored

3B • Updated May 2

LuciaValentine/Gemma3-hiyori-27B-2_0

6B • Updated May 2 • 3

LuciaValentine/Gemma3-hiyori-27B-2_0-Uncensored

6B • Updated May 2

LuciaValentine/Gemma3-hiyori-4B-2_0

2B • Updated May 2

LuciaValentine/Gemma3-hiyori-4B-2_0-Uncensored

2B • Updated May 2 • 2

cpral/Hermes-4-405B-exl3-2bpw

Text Generation • 53B • Updated Apr 24 • 10

Brooooooklyn/Qwen3.6-27B-UD-Q2_K_XL-mlx

Text Generation • 6B • Updated May 15 • 269 • 2

bearzi/Qwen3.6-27B-oQ2

Text Generation • 3B • Updated Apr 27 • 80

manjunathshiva/Nemotron-3-Super-120B-A12B-tq3a-tq2e-g32

Text Generation • 121B • Updated about 13 hours ago • 325 • 1

bearzi/gemma-4-26B-A4B-it-oQ2

Text Generation • 3B • Updated Apr 27 • 18

Yannlaff/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Apr 27 • 132

Venugopalan2610/BCJR-QAT-Llama-3.2-1B-2bit

deucebucket/Qwen3.6-27B-Cerebellum-Q2K-GGUF

Text Generation • 27B • Updated Jun 14 • 435 • 2

ParetoQaft/1B-Instruct-Tulu-LoRA-2bit

1B • Updated Apr 29

ParetoQaft/1B-Instruct-Tulu-simplel4q-2bit

1B • Updated Apr 29

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-2Bit

Text Generation • 27B • Updated May 13 • 3.39k • 5

LuciaValentine/hiyori_gemma4_26b_a4b_exllama3_gemma-4_exllama3_2.0bpw

5B • Updated May 2

jesusoctavioas/Qwen3.6-27B-mlx-2Bit

Image-Text-to-Text • 27B • Updated May 1 • 182

firedancer/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated May 2 • 261

manjunathshiva/gpt-oss-120b-tq3a-tq2e-g32

Text Generation • 117B • Updated about 13 hours ago • 145

LuciaValentine/hiyori_gemma4_31b_exllama3_gemma-4_exllama3_2.0bpw

6B • Updated May 3 • 2

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-2bit

Text Generation • 4B • Updated 1 day ago • 118 • 1

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-MLX-2bit

Text Generation • 4B • Updated 1 day ago • 52

avneetsb/NVIDIA-Nemotron-3-Nano-4B-oQ2-fp16

0.4B • Updated May 5 • 23