nm-testing
/

llama-3-instruct-w8a8-dyn-per-token-test

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

llama-3-instruct-w8a8-dyn-per-token-test / generation_config.json

Commit History

Upload folder using huggingface_hub

12a7b92
verified

robertgshaw2 commited on Jun 22, 2024