Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,548

Base only

Active filters: 2-bit

acab275/Qwen2.5-7B-Instruct-gptqmodel-2bit

Text Generation • 8B • Updated Mar 20

k8smee/cogito-v2-preview-llama-109B-MoE-mlx-2Bit

Image-Text-to-Text • 108B • Updated Mar 20 • 58

david-ar/20q-GGUF

187k • Updated Mar 20 • 6

spicyneuron/Qwen3.5-397B-A17B-MLX-2.6bit

Text Generation • 396B • Updated Apr 10 • 110

ParetoQaft/3B-Tulu-LoRA-75pct-autoround-standardl4q-2bit

3B • Updated Mar 22 • 21

Jurisprudence/Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW-mlx-2Bit

Text Generation • 0.9B • Updated Mar 22 • 3.34k • 6

ParetoQaft/3B-Tulu-LoRA-50pct-autoround-standardl4q-2bit

3B • Updated Mar 23 • 21

RepublicOfKorokke/Qwen3.5-4B-oQ2

Text Generation • 0.8B • Updated Mar 24 • 35

Christ9038/Qwen3.5-9B-unsloth-MLX-oQ2

1B • Updated Mar 24 • 185

Christ9038/Qwen3.5-4B-unsloth-MLX-oQ2

0.8B • Updated Mar 24 • 139

daslab-testing/Kimi-K2.5-2bit-GSQ

1T • Updated Mar 24 • 77

Hunterx/Qwen3.5-40B-RoughHouse-Claude-4.6-Opus-oQ2BENCHMARKED

Text Generation • 5B • Updated Mar 28 • 34

Brooooooklyn/Qwen3.5-35B-A3B-UD-Q2_K_XL-mlx

Text Generation • 4B • Updated Mar 29 • 63

Brooooooklyn/Qwen3.5-9B-UD-Q2_K_XL-mlx

Text Generation • 2B • Updated Mar 29 • 74

Brooooooklyn/Qwen3.5-27B-UD-Q2_K_XL-mlx

Text Generation • 6B • Updated Mar 29 • 64

mobbitxt/Anubis-Mini-8B-v1-mlx-oQ2

0.9B • Updated Mar 30

Bo-Jack/Qwen3-8B-mixed-2-6-mlx

Text Generation • 1.0B • Updated Mar 31 • 4

Bo-Jack/Qwen3-8B-2bit-mlx

Text Generation • 0.8B • Updated Mar 31 • 9

e3cola/Qwen3.5-122B-A10B-oQ2

13B • Updated Mar 31 • 63 • 1

inferencerlabs/Bonsai-8B-MLX-2.25bit

Text Generation • 0.6B • Updated Apr 2 • 278 • 4

inferencerlabs/Bonsai-4B-MLX-2.25bit

Text Generation • 0.3B • Updated Apr 2 • 57 • 2

UnstableLlama/Qwen3.5-4B-exl3-2.00bpw

2B • Updated Apr 4 • 2

UnstableLlama/Qwen3.5-27B-exl3-2.00bpw

5B • Updated Apr 4 • 5

wolfofbackstreet/gemma-4-e4b-it-oQ2

0.3B • Updated Apr 8 • 67

avlp12/GLM-5.1-Alis-MLX-Dynamic-2.7bpw

Text Generation • 744B • Updated Apr 16 • 677 • 3

spicyneuron/GLM-5.1-MLX-2.9bit

Text Generation • 744B • Updated Apr 27 • 1.13k • 2

minion1905/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 9 • 100

avlp12/Qwen3.5-35B-A3B-Alis-MLX-Dynamic-2.6bpw

Text Generation • 35B • Updated Apr 12 • 126 • 1

bearzi/Qwen3.5-397B-A17B-oQ2

Text Generation • 40B • Updated Apr 15 • 57

zecanard/gemma-4-31B-it-uncensored-abliterix-MLX-2bit-int2-affine

Image-Text-to-Text • 8B • Updated Apr 15 • 214 • 1