LeanQuant
/

Llama-3.1-8B-Instruct-nu-4bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

Llama-3.1-8B-Instruct-nu-4bit / generation_config.json

Commit History

Upload LlamaForCausalLM

6f69821
verified

LeanQuant commited on Feb 25, 2025