solidrust
/

Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions

Meta-Llama-3.1-8B-Instruct-abliterated-AWQ / quant_config.json

Commit History

adding quant config

5bd1d44
verified

Suparious commited on Jul 28, 2024