Qwen
Image-Text-to-Text • 10B • Updated • 251 • 3Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-9B-AWQ-8bit
Image-Text-to-Text • 9B • Updated • 33 • 3Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-9B-NVFP4A16
Image-Text-to-Text • 9B • Updated • 40 • 4Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-9B-AWQ-4bit
Image-Text-to-Text • 9B • Updated • 27 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-9B-NVFP4
Image-Text-to-Text • 9B • Updated • 29 • 1Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-9B-GGUF
9B • Updated • 129 • 2Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.8-27B-FP8-dynamic
Image-Text-to-Text • 28B • Updated • 39 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.8-27B-AWQ-8bit
Image-Text-to-Text • 28B • Updated • 37 • 1Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.8-27B-NVFP4A16
Image-Text-to-Text • 28B • Updated • 44 • 1Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.8-27B-AWQ-4bit
Image-Text-to-Text • 28B • Updated • 40 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.8-27B-NVFP4
Image-Text-to-Text • 28B • Updated • 49 • 1Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.8-27B-GGUF
27B • Updated • 124 • 2Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.6-35B-A3B-FP8-dynamic
Image-Text-to-Text • 36B • Updated • 34 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.6-35B-A3B-AWQ-8bit
Image-Text-to-Text • 36B • Updated • 25 • 1Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.6-35B-A3B-AWQ-4bit
Image-Text-to-Text • 36B • Updated • 30 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.6-35B-A3B-NVFP4
Image-Text-to-Text • 36B • Updated • 41 • 1Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.6-35B-A3B-GGUF
36B • Updated • 118 • 1Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-122B-A10B-AWQ-8bit
Image-Text-to-Text • 125B • Updated • 22 • 1Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-122B-A10B-AWQ-4bit
Image-Text-to-Text • 125B • Updated • 22 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-122B-A10B-FP8-dynamic
Image-Text-to-Text • 125B • Updated • 32 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-122B-A10B-NVFP4
Image-Text-to-Text • 125B • Updated • 32 • 1Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-122B-A10B-GGUF
125B • Updated • 133 • 1Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.6-35B-A3B-NVFP4A16
Image-Text-to-Text • 36B • Updated • 35 • 1Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-122B-A10B-NVFP4A16
125B • Updated • 28 • 2Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-0.8B-FP8-dynamic
Image-Text-to-Text • 0.9B • Updated • 21Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-0.8B-AWQ-8bit
Image-Text-to-Text • 0.9B • Updated • 22Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-0.8B-NVFP4A16
Image-Text-to-Text • 0.9B • Updated • 25Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-0.8B-AWQ-4bit
Image-Text-to-Text • 0.9B • Updated • 22Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-0.8B-NVFP4
Image-Text-to-Text • 0.9B • Updated • 22Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-0.8B-GGUF
0.8B • Updated • 116Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-2B-FP8-dynamic
Image-Text-to-Text • 2B • Updated • 22Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-2B-AWQ-8bit
Image-Text-to-Text • 2B • Updated • 25Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-2B-NVFP4A16
Image-Text-to-Text • 2B • Updated • 23Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-2B-AWQ-4bit
Image-Text-to-Text • 2B • Updated • 20Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-2B-NVFP4
Image-Text-to-Text • 2B • Updated • 19Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-2B-GGUF
2B • Updated • 115Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-4B-FP8-dynamic
Image-Text-to-Text • 5B • Updated • 18Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-4B-AWQ-8bit
Image-Text-to-Text • 5B • Updated • 23Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-4B-NVFP4A16
Image-Text-to-Text • 5B • Updated • 22Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-4B-AWQ-4bit
Image-Text-to-Text • 5B • Updated • 104Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-4B-NVFP4
Image-Text-to-Text • 5B • Updated • 26Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-4B-GGUF
4B • Updated • 108Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-27B-FP8-dynamic
Image-Text-to-Text • 28B • Updated • 23Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-27B-AWQ-8bit
Image-Text-to-Text • 28B • Updated • 24Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-27B-NVFP4A16
Image-Text-to-Text • 28B • Updated • 28Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-27B-AWQ-4bit
Image-Text-to-Text • 28B • Updated • 30Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-27B-NVFP4
Image-Text-to-Text • 28B • Updated • 42Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-27B-GGUF
27B • Updated • 114Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama