Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,842

Base only

Active filters: awq

QuantTrio/Qwen3.6-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated Apr 17 • 760k • 28

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 56.8k • 15

sanskar003/Qwen3.5-4B-AWQ

Image-Text-to-Text • 5B • Updated 6 days ago • 31 • 2

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 295k • 110

Orion-zhen/aya-expanse-32b-AWQ

Text Generation • 34B • Updated Oct 27, 2024 • 185 • 6

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • 32B • Updated Feb 6 • 120 • 21

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21, 2025 • 1.79M • 71

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21, 2025 • 385k • 51

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 539k • 30

alonsoko/gemma-4-31b-it-abliterated-heretic-AWQ-W4A16

Image-Text-to-Text • 32B • Updated May 17 • 10.7k • 13

cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit

Image-Text-to-Text • 36B • Updated 3 days ago • 1.87M • 82

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx

Text Generation • 10B • Updated May 15 • 657 • 8

QuantTrio/Qwen3.6-27B-AWQ

Image-Text-to-Text • 28B • Updated Apr 23 • 1.44M • 19

shawnw3i/Huihui-Qwen3.6-27B-abliterated-AWQ-MTP

Image-Text-to-Text • 6B • Updated May 22 • 65.1k • 10

drawais/Granite-4.1-30B-NVFP4

Text Generation • 16B • Updated May 6 • 337 • 1

mattbucci/gemma-4-12B-AWQ

Image-Text-to-Text • 12B • Updated 29 days ago • 21.1k • 2

spectator2026/MiniMax-M3-AWQ-int4

Image-Text-to-Text • 69B • Updated 12 days ago • 537 • 1

sakamakismile/Krea-2-Turbo-NVFP4-AWQ

Text-to-Image • Updated 11 days ago • 199 • 4

BatuhanECB/vibethinker-3b-finance-sft-quantized-v1

Text Generation • 3B • Updated 9 days ago • 35 • 1

Cadododoom/Agents-A1-TextOnly-AWQ-INT4

36B • Updated about 17 hours ago • 1

Alennnndy/Qwen3.6-27B-AWQ-4bit

Text Generation • 28B • Updated 4 days ago • 71 • 2

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 15 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 50 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 15 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 12 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 13

casperhansen/opt-125m-awq

Text Generation • 0.2B • Updated Oct 31, 2023 • 143 • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 33 • 1

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 1.95k • 24