TGI Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8 Text Generation • 73B • Updated Oct 9, 2024 • 965 • 37 Qwen/Qwen2.5-72B-Instruct-GGUF Text Generation • 73B • Updated Sep 20, 2024 • 12.5k • 59 Qwen/Qwen2.5-72B-Instruct-AWQ Text Generation • 73B • Updated Oct 9, 2024 • 153k • 93 nvidia/Llama-3.1-70B-Instruct-FP8 Text Generation • 71B • Updated Aug 22, 2025 • 3.8k • 21
TGI Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8 Text Generation • 73B • Updated Oct 9, 2024 • 965 • 37 Qwen/Qwen2.5-72B-Instruct-GGUF Text Generation • 73B • Updated Sep 20, 2024 • 12.5k • 59 Qwen/Qwen2.5-72B-Instruct-AWQ Text Generation • 73B • Updated Oct 9, 2024 • 153k • 93 nvidia/Llama-3.1-70B-Instruct-FP8 Text Generation • 71B • Updated Aug 22, 2025 • 3.8k • 21