Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,720

Base only

Active filters: 2-bit

Matt300209/1B-Tulu-LoRA-75pct-autoround-lsq-lora-5e3-2bit

1B • Updated Mar 3 • 1

MercuriusDream/Huihui-Qwen3.5-35B-A3B-abliterated-MLX-2bit-low

Text Generation • 35B • Updated Mar 4 • 45

fifrio/aya-expanse-8b-gptq-2bit-calibration-English-128samples

8B • Updated Mar 5 • 19

fifrio/aya-expanse-8b-gptq-2bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 16

fifrio/aya-expanse-8b-gptq-2bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 16

fifrio/aya-expanse-8b-gptq-2bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 17

fifrio/aya-expanse-8b-gptq-2bit-calibration-Chinese-128samples

8B • Updated Mar 5 • 17

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-English-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 3

igarin/Qwen2.5-Coder-7B-20260302-MLX-2bit

Text Generation • 0.7B • Updated Mar 7 • 29

pradeepannepu/slm02-mlx-2Bit

Text Generation • 1.75M • Updated Mar 7 • 9

Wwayu/GLM-4.6-REAP-218B-A32B-Derestricted-mlx-2Bit

Text Generation • 218B • Updated Mar 8 • 109

duolaf/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Mar 9 • 174

alankessler/Mistral-Nemo-Instruct-2407-MLX-2bit

1B • Updated Mar 11 • 18

alankessler/Mistral-Small-3.2-24B-Instruct-2506-MLX-2bit

24B • Updated Mar 11 • 27

ParetoQaft/3B-Tulu-full-autoround-2bit

3B • Updated Mar 14

ParetoQaft/3B-Tulu-full-autoround-2bit-pile

3B • Updated Mar 14

goodman20241017/Qwen3.5-35B-A3B-BPD2-g128

Text Generation • 4B • Updated May 22 • 5

david-ar/20q

Text Generation • 187k • Updated Mar 21 • 12

acab275/Qwen2.5-7B-Instruct-gptqmodel-2bit

Text Generation • 8B • Updated Mar 20 • 3

k8smee/cogito-v2-preview-llama-109B-MoE-mlx-2Bit

Image-Text-to-Text • 108B • Updated Mar 20 • 43

david-ar/20q-GGUF

187k • Updated Mar 20 • 29

spicyneuron/Qwen3.5-397B-A17B-MLX-2.6bit

Text Generation • 396B • Updated Apr 10 • 114 • 1

ParetoQaft/3B-Tulu-LoRA-75pct-autoround-standardl4q-2bit

3B • Updated Mar 22

Jurisprudence/Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW-mlx-2Bit

Text Generation • 0.9B • Updated Mar 22 • 2.94k • 8

ParetoQaft/3B-Tulu-LoRA-50pct-autoround-standardl4q-2bit

3B • Updated Mar 23

RepublicOfKorokke/Qwen3.5-4B-oQ2

Text Generation • 0.8B • Updated Mar 24 • 21

Christ9038/Qwen3.5-9B-unsloth-MLX-oQ2

1B • Updated Mar 24 • 105