Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,548

Base only

Active filters: 2-bit

dangerusslee/FastApply-7B-v1.0-mlx-2Bit

Text Generation • 0.7B • Updated Mar 2 • 10

fifrio/Qwen3-8B-gptq-2bit-calibration-English-128samples

8B • Updated Mar 3 • 54

fifrio/Qwen3-8B-gptq-2bit-calibration-Indonesian-128samples

8B • Updated Mar 3 • 29

fifrio/Qwen3-8B-gptq-2bit-calibration-Tamil-128samples

8B • Updated Mar 3 • 28

fifrio/Qwen3-8B-gptq-2bit-calibration-Swahili-128samples

8B • Updated Mar 3 • 23

fifrio/Qwen3-8B-gptq-2bit-calibration-Chinese-128samples

8B • Updated Mar 3 • 15

MercuriusDream/Huihui-Qwen3.5-35B-A3B-abliterated-MLX-2bit

Text Generation • 35B • Updated Mar 3 • 46

MaziyarPanahi/LocoOperator-4B-GGUF

Text Generation • 4B • Updated Mar 3 • 70 • 1

Matt300209/1B-Tulu-LoRA-75pct-autoround-lsq-lora-1e3-2bit

1B • Updated Mar 3 • 2

Matt300209/1B-Tulu-LoRA-75pct-autoround-lsq-lora-5e3-2bit

1B • Updated Mar 3 • 2

MercuriusDream/Huihui-Qwen3.5-35B-A3B-abliterated-MLX-2bit-low

Text Generation • 35B • Updated Mar 4 • 70

fifrio/aya-expanse-8b-gptq-2bit-calibration-English-128samples

8B • Updated Mar 5 • 1

fifrio/aya-expanse-8b-gptq-2bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 1

fifrio/aya-expanse-8b-gptq-2bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 1

fifrio/aya-expanse-8b-gptq-2bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 2

fifrio/aya-expanse-8b-gptq-2bit-calibration-Chinese-128samples

8B • Updated Mar 5 • 3

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-English-128samples

8B • Updated Mar 5 • 2

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Tamil-128samples

8B • Updated Mar 5

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Swahili-128samples

8B • Updated Mar 5

igarin/Qwen2.5-Coder-7B-20260302-MLX-2bit

Text Generation • 0.7B • Updated Mar 7 • 70 •

pradeepannepu/slm02-mlx-2Bit

Text Generation • 1.75M • Updated Mar 7 • 4

Wwayu/GLM-4.6-REAP-218B-A32B-Derestricted-mlx-2Bit

Text Generation • 218B • Updated Mar 8 • 89

duolaf/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Mar 9 • 65

alankessler/Mistral-Nemo-Instruct-2407-MLX-2bit

1B • Updated Mar 11 • 24

alankessler/Mistral-Small-3.2-24B-Instruct-2506-MLX-2bit

24B • Updated Mar 11 • 27

ParetoQaft/3B-Tulu-full-autoround-2bit

3B • Updated Mar 14

ParetoQaft/3B-Tulu-full-autoround-2bit-pile

3B • Updated Mar 14 • 2

goodman20241017/Qwen3.5-35B-A3B-BPD2-g128

Text Generation • 4B • Updated 9 days ago • 30

david-ar/20q

Text Generation • 187k • Updated Mar 21 • 10