Llama 3.1 GPTQ, AWQ, and BNB Quants
Collection
Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗 • 9 items • Updated • 57
Jinghui Liu
jhliu
AI & ML interests
None yet
Recent Activity
liked a model about 2 months ago
lightonai/Reason-ModernColBERT liked a model about 1 year ago
nvidia/Llama-3.1-Minitron-4B-Width-Base liked a dataset about 1 year ago
nvidia/Llama-Nemotron-Post-Training-DatasetOrganizations
None yet