nm-testing
/

tinyllama-one-shot-w4a16-group-compressed

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

tinyllama-one-shot-w4a16-group-compressed

Commit History

Updated compression_config to quantization_config

3887b57
verified

mgoin commited on Oct 9, 2024

Upload folder using huggingface_hub

c122be5
verified

sadkins65 commited on May 9, 2024

initial commit

fcc5f74
verified

sadkins65 commited on May 9, 2024