Models

openbmb/MiniCPM-o-4_5-awq

Any-to-Any • 9B • Updated about 3 hours ago • 112 • 8

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • 39B • Updated 22 days ago • 5.22k • 32

MTSAIR/Cotype-Nano-4bit

Text Generation • 2B • Updated Nov 25, 2024 • 9 • 13

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 263k • 124

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated 2 days ago • 13.9k • 2

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 49 • 1

TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 81.7k • 4

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • 7B • Updated Dec 11, 2023 • 11.8k • 52

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • 141B • Updated Apr 18, 2024 • 661 • 12

casperhansen/llama-3-8b-instruct-awq

Text Generation • 8B • Updated Jun 8, 2024 • 51.3k • 28

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 421k • 86

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • 3B • Updated Oct 9, 2024 • 42.3k • 16

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • 33B • Updated Nov 18, 2024 • 395k • 33

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • 71B • Updated Dec 6, 2024 • 173k • 37

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • 71B • Updated Dec 7, 2024 • 419k • 10

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 682k • 99

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21, 2025 • 1.06M • 53

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21, 2025 • 132k • 36

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 75.1k • 23

Qwen/Qwen2.5-Omni-7B-AWQ

Any-to-Any • 11B • Updated May 15, 2025 • 40.9k • 17

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 235B • Updated Sep 5, 2025 • 3.7k • 6

openbmb/MiniCPM-V-4_5-AWQ

Image-Text-to-Text • 9B • Updated Sep 26, 2025 • 4.74k • 12

neonconverse/gemma-3-27b-abliterated-awq-4bit

Updated Oct 7, 2025 • 1

QuantTrio/Qwen3-VL-32B-Thinking-AWQ

Image-Text-to-Text • 33B • Updated Dec 3, 2025 • 1.73k • 5

QuantTrio/DeepSeek-V3.2-AWQ

Text Generation • 685B • Updated Dec 3, 2025 • 25.3k • 10

channelcorp/Hana1.1-TTS-8B-v2-AWQ

Updated Dec 31, 2025 • 303 • 1

mratsim/MiniMax-M2.1-BF16-INT4-AWQ

Text Generation • 39B • Updated 22 days ago • 2.79k • 5

QuantTrio/GLM-4.7-Flash-AWQ

Text Generation • 31B • Updated 16 days ago • 70.3k • 3

QuantTrio/Step3-VL-10B-AWQ

Image-Text-to-Text • 10B • Updated 4 days ago • 4.43k • 5

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 8 • 3