Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,717

Base only

Active filters: 2-bit

ParetoQaft/1B-base-autoround-simplel4q-2bit

1B • Updated Feb 7 • 3

ParetoQaft/1B-base-autoround-standardl4q-2bit

1B • Updated Feb 7 • 4

ParetoQaft/8B-Tulu-LoRA-50pct-autoround-2bit

8B • Updated Feb 8 • 1

ParetoQaft/8B-base-autoround-standardl4q-2bit

8B • Updated Feb 9 • 1

ParetoQaft/8B-Tulu-LoRA-75pct-autoround-2bit

8B • Updated Feb 10 • 1

Open4bits/Qwen3-Coder-Next-mlx-2Bit

Text Generation • 80B • Updated Feb 10 • 171

Matt300209/3B-base

1B • Updated Feb 10 • 1

ParetoQaft/8B-Tulu-LoRA-50pct-autoround-simplel4q-2bit

8B • Updated Feb 10

MaziyarPanahi/Schematron-3B-GGUF

Text Generation • 3B • Updated Feb 10 • 145

MaziyarPanahi/VulnLLM-R-7B-GGUF

Text Generation • 8B • Updated Feb 10 • 103

MaziyarPanahi/EXAONE-4.0-1.2B-GGUF

Text Generation • 1B • Updated Feb 10 • 196

MaziyarPanahi/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 10 • 38.9k • 1

ParetoQaft/8B-Tulu-LoRA-50pct-autoround-standardl4q-2bit

8B • Updated Feb 10 • 1

ParetoQaft/3B-base-autoround-standardl4q-2bit

3B • Updated Feb 11 • 3

ParetoQaft/3B-Tulu-LoRA-autoround-2bit

3B • Updated Feb 11

Open4bits/DeepSeek-R1-mlx-2Bit

Text Generation • 671B • Updated Feb 11 • 105 • 2

Open4bits/Olmo-3.1-32B-Think-mlx-2Bit

Text Generation • 32B • Updated Feb 11 • 14

ParetoQaft/8B-Tulu-LoRA-75pct-autoround-standardl4q-2bit

8B • Updated Feb 11 • 1

ParetoQaft/8B-Tulu-LoRA-75pct-autoround-simplel4q-2bit

8B • Updated Feb 11 • 2

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W2A16

1B • Updated Feb 11 • 1

Open4bits/Qwen3-14B-Base-mlx-2Bit

Text Generation • 1B • Updated Feb 14 • 20

Open4bits/Seed-OSS-36B-Instruct-mlx-2Bit

Text Generation • 36B • Updated Feb 15 • 52

ParetoQaft/3B-base-autoround-simplel4q-2bit

3B • Updated Feb 15 • 2

ParetoQaft/1B-Tulu-LoRA-75pct-autoround-lsq128l4q-2bit

1B • Updated Feb 17

ParetoQaft/1B-Tulu-LoRA-50pct-autoround-lsq128l4q-2bit

1B • Updated Feb 17

SiddhJagani/cac-v0.1-mlx-Q2

Text Generation • 0.6B • Updated Feb 16 • 23

ParetoQaft/1B-Tulu-full-gptq-c4-2bit

1B • Updated Feb 17 • 1

ParetoQaft/8B-Tulu-full-gptq-c4-2bit

8B • Updated Feb 17 • 1

ParetoQaft/1B-Tulu-full-autoround-pile-2bit

1B • Updated Feb 17 • 1

ParetoQaft/8B-Tulu-full-autoround-pile-2bit

8B • Updated Feb 17 • 1