Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,717

Base only

Active filters: 2-bit

ParetoQaft/3B-Tulu-LoRA-50pct-autoround-2bit

3B • Updated Feb 17

ParetoQaft/3B-Tulu-LoRA-75pct-autoround-2bit

3B • Updated Feb 19

ParetoQaft/8B-Tulu-LoRA-autoround-simplel4q-25pct-2bit

8B • Updated Feb 19 • 2

BambiMC/Qwen3-Coder-Next-mlx-2Bit

Text Generation • 80B • Updated Feb 19 • 95

ParetoQaft/3B-Tulu-LoRA-75pct-autoround-simplel4q-2bit

3B • Updated Feb 20 • 1

ParetoQaft/8B-Tulu-LoRA-autoround-simplel4q-50pct-2bit

8B • Updated Feb 20 • 1

ParetoQaft/3B-Tulu-LoRA-50pct-autoround-simplel4q-2bit

3B • Updated Feb 20 • 1

Jakubrd4/bielik-q2-variant-b

11B • Updated Feb 22 • 3

thedarkstar/Magidonia-24B-v4.3-mlx-2Bit

Text Generation • 24B • Updated Feb 21 • 6

ParetoQaft/8B-Tulu-LoRA-autoround-simplel4q-100pct-2bit

8B • Updated Feb 22 • 2

Jakubrd4/Bielik-11B-v2.3-Instruct-QuIP-2bit

Text Generation • 0.6B • Updated Feb 22 • 9

jesusoctavioas/Qwen3-Coder-Next-mlx-2Bit

Text Generation • 80B • Updated Feb 23 • 85

Matt300209/1B-Tulu-LoRA-75pct-autoround-lsq-2bit

0.3B • Updated Feb 23 • 3

Matt300209/1B-Tulu-LoRA-50pct-autoround-lsq-2bit

0.3B • Updated Feb 23 • 3

Matt300209/1B-Tulu-LoRA-50pct-autoround-lsq-1e5-2bit

0.3B • Updated Feb 24 • 1

YCWTG/Qwen3-Coder-Next-int2-mixed-AutoRound

Text Generation • 8B • Updated Apr 1 • 18 • 2

MaziyarPanahi/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated Feb 24 • 208 • 2

Matt300209/lsq_unmerged

1B • Updated Feb 27 • 2

MercuriusDream/Qwen3.5-35B-A3B-MLX-2bit

Image-Text-to-Text • 35B • Updated Feb 28 • 35

dangerusslee/FastApply-1.5B-v1.0-mlx-2Bit

Text Generation • 0.1B • Updated Mar 1 • 8

dangerusslee/FastApply-7B-v1.0-mlx-2Bit

Text Generation • 0.7B • Updated Mar 2 • 10

fifrio/Qwen3-8B-gptq-2bit-calibration-English-128samples

8B • Updated Mar 3 • 37

fifrio/Qwen3-8B-gptq-2bit-calibration-Indonesian-128samples

8B • Updated Mar 3 • 30

fifrio/Qwen3-8B-gptq-2bit-calibration-Tamil-128samples

8B • Updated Mar 3 • 21

fifrio/Qwen3-8B-gptq-2bit-calibration-Swahili-128samples

8B • Updated Mar 3 • 24

fifrio/Qwen3-8B-gptq-2bit-calibration-Chinese-128samples

8B • Updated Mar 3 • 23

MercuriusDream/Huihui-Qwen3.5-35B-A3B-abliterated-MLX-2bit

Text Generation • 35B • Updated Mar 3 • 37

MaziyarPanahi/LocoOperator-4B-GGUF

Text Generation • 4B • Updated Mar 3 • 36 • 1

Matt300209/1B-Tulu-LoRA-75pct-autoround-lsq-lora-1e3-2bit

1B • Updated Mar 3 • 1

Matt300209/1B-Tulu-LoRA-75pct-autoround-lsq-lora-5e3-2bit

1B • Updated Mar 3