nm-testing
/

Meta-Llama-3-8B-Instruct-W4-Group128-A16-Test

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Meta-Llama-3-8B-Instruct-W4-Group128-A16-Test

Commit History

Updated compression_config to quantization_config

ff8ea6a
verified

mgoin commited on Oct 9, 2024

Upload folder using huggingface_hub

4f18740
verified

robertgshaw2 commited on Jun 25, 2024

initial commit

fcc0565
verified

robertgshaw2 commited on Jun 25, 2024