AWQ quants AWQ quants of various leading models for benchmarks and testing Qwen/Qwen2.5-1.5B-Instruct-AWQ Text Generation • 2B • Updated Oct 9, 2024 • 30.4k • 12 Qwen/Qwen2.5-3B-Instruct-AWQ Text Generation • 3B • Updated Oct 9, 2024 • 970k • 26 Qwen/Qwen2.5-7B-Instruct-AWQ Text Generation • 8B • Updated Oct 9, 2024 • 1.95M • 60 Qwen/Qwen2.5-14B-Instruct-AWQ Text Generation • 15B • Updated Oct 9, 2024 • 1.29M • 52
AWQ quants AWQ quants of various leading models for benchmarks and testing Qwen/Qwen2.5-1.5B-Instruct-AWQ Text Generation • 2B • Updated Oct 9, 2024 • 30.4k • 12 Qwen/Qwen2.5-3B-Instruct-AWQ Text Generation • 3B • Updated Oct 9, 2024 • 970k • 26 Qwen/Qwen2.5-7B-Instruct-AWQ Text Generation • 8B • Updated Oct 9, 2024 • 1.95M • 60 Qwen/Qwen2.5-14B-Instruct-AWQ Text Generation • 15B • Updated Oct 9, 2024 • 1.29M • 52