nm-testing
/

llama-3-instruct-w8a8-dyn-per-token-test

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

llama-3-instruct-w8a8-dyn-per-token-test

9.09 GB

Ctrl+K

Ctrl+K

2 contributors

History: 2 commits

robertgshaw2's picture

Upload folder using huggingface_hub

12a7b92 verified almost 2 years ago

.gitattributes

1.52 kB
initial commit almost 2 years ago
config.json

1.97 kB
Upload folder using huggingface_hub almost 2 years ago
generation_config.json

194 Bytes
Upload folder using huggingface_hub almost 2 years ago
model-00001-of-00002.safetensors

5 GB
xet

Upload folder using huggingface_hub almost 2 years ago
model-00002-of-00002.safetensors

4.08 GB
xet

Upload folder using huggingface_hub almost 2 years ago
model.safetensors.index.json

43.5 kB
Upload folder using huggingface_hub almost 2 years ago
special_tokens_map.json

296 Bytes
Upload folder using huggingface_hub almost 2 years ago
tokenizer.json

9.09 MB
Upload folder using huggingface_hub almost 2 years ago
tokenizer_config.json

51 kB
Upload folder using huggingface_hub almost 2 years ago