Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,549

Base only

Active filters: 2-bit

MikeRoz/Meta-Llama-3.1-405B-Instruct-2.0bpw-h4-exl3

Text Generation • 53B • Updated Apr 9, 2025 • 3 • 1

sleepdeprived3/Baptist-Christian-Bible-Expert-v2.0-24B_EXL2_2bpw_H8

Text Generation • Updated Apr 15, 2025 • 3

phires/Llama-3.2-1B-Instruct-GGUF-rk3588-1.1.2

Text Generation • Updated Apr 20, 2025

MaziyarPanahi/GLM-4-32B-0414-GGUF

Text Generation • 33B • Updated Apr 22, 2025 • 36 • 1

MaziyarPanahi/cogito-v1-preview-llama-3B-GGUF

Text Generation • 4B • Updated Apr 21, 2025 • 74 • 1

MaziyarPanahi/cogito-v1-preview-llama-8B-GGUF

Text Generation • 8B • Updated Apr 21, 2025 • 49 • 1

MaziyarPanahi/cogito-v1-preview-llama-70B-GGUF

Text Generation • 71B • Updated Apr 22, 2025 • 57 • 1

Erland/softpick-340M-4096-model-GPTQ-2bit

Text Generation • 0.4B • Updated May 21, 2025 • 2

Erland/vanilla-340M-4096-model-GPTQ-2bit

Text Generation • 0.4B • Updated Apr 24, 2025 • 1

kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-32g-2048-gptq

73B • Updated May 7, 2025 • 1

kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-64g-2048-gptq

73B • Updated May 7, 2025 • 1

kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-128g-2048-gptq

73B • Updated May 7, 2025 • 1

kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-32g-4096-gptq

73B • Updated May 7, 2025 • 1

kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-64g-4096-gptq

73B • Updated May 7, 2025 • 1

kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-128g-4096-gptq

73B • Updated May 7, 2025 • 1

steampunque/Llama-4-Scout-17B-16E-Instruct-MP-GGUF

Text Generation • 108B • Updated Feb 18 • 113 • 1

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 294k • 11

MaziyarPanahi/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 287k • 7

MaziyarPanahi/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 288k • 10

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 288k • 7

MaziyarPanahi/Qwen3-14B-GGUF

Text Generation • 15B • Updated Apr 28, 2025 • 288k • 9

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • 33B • Updated Apr 29, 2025 • 281k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Apr 29, 2025 • 282k • 4

semran1/testing1111

16B • Updated Apr 30, 2025

kaitchup/Qwen3-32B-autoround-2bit-gptq

33B • Updated May 2, 2025 • 7.52k • 1

Cozmicalz/Lycanthropic-Thoughts-32B-mlx-2Bit

3B • Updated May 1, 2025 • 3

kaitchup/Qwen3-14B-autoround-2bit-gptq

15B • Updated May 2, 2025 • 430

kaitchup/Qwen3-8B-autoround-2bit-gptq

8B • Updated May 2, 2025 • 536

DanyDA/Qwen3-32B-exl3-2.0bpw

Text Generation • 5B • Updated May 2, 2025 • 1

Siddharth63/Qwen3-8B-Base-2bits-AutoRound-GPTQ-sym

8B • Updated May 2, 2025 • 11