Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,742

Base only

Active filters: 2-bit

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 137k • 7

MaziyarPanahi/Qwen3-14B-GGUF

Text Generation • 15B • Updated Apr 28, 2025 • 144k • 11

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • 33B • Updated Apr 29, 2025 • 135k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Apr 29, 2025 • 135k • 5

semran1/testing1111

16B • Updated Apr 30, 2025 • 1

kaitchup/Qwen3-32B-autoround-2bit-gptq

33B • Updated May 2, 2025 • 30 • 1

Cozmicalz/Lycanthropic-Thoughts-32B-mlx-2Bit

3B • Updated May 1, 2025

kaitchup/Qwen3-14B-autoround-2bit-gptq

15B • Updated May 2, 2025 • 22

kaitchup/Qwen3-8B-autoround-2bit-gptq

8B • Updated May 2, 2025 • 646

DanyDA/Qwen3-32B-exl3-2.0bpw

Text Generation • 5B • Updated May 2, 2025 • 6

Siddharth63/Qwen3-8B-Base-2bits-AutoRound-GPTQ-sym

8B • Updated May 2, 2025 • 4

Siddharth63/Qwen3-8B-Base-2bits-AutoRound-sym

2B • Updated May 2, 2025 • 4

MaziyarPanahi/INTELLECT-2-GGUF

Text Generation • 33B • Updated May 12, 2025 • 68.8k • 3

kaitchup/Qwen3-14B-Base-autoround-2bit-gptq

15B • Updated May 13, 2025 • 5

kaitchup/Qwen3-32B-autoround-2bit-128g-gptq

33B • Updated May 13, 2025 • 6

DanyDA/Kevin-32B-exl3-2.0bpw

5B • Updated May 15, 2025 • 2

BitDistiller/Llama-3.1-8B-Instruct-w2g64-gptq

8B • Updated May 20, 2025 • 1

kaitchup/Qwen3-30B-A3B-autoround-2bit-gptq

31B • Updated May 20, 2025 • 21

DanyDA/AM-Thinking-v1-exl3-2.0bpw

Text Generation • 5B • Updated May 21, 2025 • 3

BitDistiller/Qwen-8B-w2g64-gptq

8B • Updated May 21, 2025 • 2 • 1

Erland/softpick-1.8B-4096-model-GPTQ-2bit

Text Generation • 2B • Updated May 27, 2025 • 2

Erland/vanilla-1.8B-4096-model-GPTQ-2bit

Text Generation • 2B • Updated May 27, 2025 • 7

tvpavan/sarvam-m-mlx-2Bit

Text Generation • 2B • Updated May 24, 2025 • 7

Fang77777/Llama-3.2-3B-Instruct-2bit-exllamav2

Text Generation • Updated May 29, 2025 • 4

steampunque/Mistral-Small-3.1-24B-Instruct-2503-MP-GGUF

24B • Updated Feb 18 • 27 • 1

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 75.2k • 11

nhe-ai/Muse-12B-mlx-2Bit

Text Generation • 1B • Updated Jun 3, 2025 • 15

mlx-community-staging/gemma-3-1b-it-mlx-4Bit-dynamic

Text Generation • 0.2B • Updated Jun 4, 2025 • 15

mlx-community-staging/gemma-3-1b-it-mlx-6Bit-dynamic

Text Generation • 0.3B • Updated Jun 4, 2025 • 12

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-2bpw-hb6

Image-Text-to-Text • 6B • Updated Jun 6, 2025 • 5