One library of quantized LLMs measured by quant-agent. Rank WikiText-2 in the GitHub library/ catalog, then download these repos.
-
chris320211/flatquant-phi3-mini-4k-g52xlarge
Text Generation • Updated • 587 -
chris320211/smoothquant-granite33-2b-g52xlarge
Text Generation • Updated • 360 -
chris320211/smoothquant-qwen25-15b-g52xlarge
Text Generation • 2B • Updated • 525 -
chris320211/smoothquant-gemma2-2b-g52xlarge
Text Generation • 3B • Updated • 187