solidrust
/

Llama-3-8B-Instruct-Gradient-1048k-AWQ

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions

Llama-3-8B-Instruct-Gradient-1048k-AWQ / quant_config.json

Commit History

adding quant config

af14488
verified

Suparious commited on May 3, 2024