clowman
/

Llama-3.1-8B-Instruct-GPTQ-Int4

Text Generation

4-bit precision

Model card Files Files and versions

Llama-3.1-8B-Instruct-GPTQ-Int4

5.75 GB

1 contributor

History: 3 commits

clowman's picture

Update README.md

4c4cae7 verified 11 months ago

.gitattributes

1.57 kB

Upload folder using huggingface_hub 11 months ago
README.md

44.7 kB

Update README.md 11 months ago
USE_POLICY.md

4.69 kB

Upload folder using huggingface_hub 11 months ago
args-lambda-quant.json

258 Bytes

Upload folder using huggingface_hub 11 months ago
config.json

1.52 kB

Upload folder using huggingface_hub 11 months ago
generation_config.json

184 Bytes

Upload folder using huggingface_hub 11 months ago
model-00001-of-00002.safetensors

3.97 GB
xet

Upload folder using huggingface_hub 11 months ago
model-00002-of-00002.safetensors

1.76 GB
xet

Upload folder using huggingface_hub 11 months ago
model.safetensors.index.json

78.5 kB

Upload folder using huggingface_hub 11 months ago
quant_log.csv

9.33 kB

Upload folder using huggingface_hub 11 months ago
quantize_config.json

427 Bytes

Upload folder using huggingface_hub 11 months ago
requirements-lambda-quant.txt

1.6 kB

Upload folder using huggingface_hub 11 months ago
special_tokens_map.json

340 Bytes

Upload folder using huggingface_hub 11 months ago
tokenizer.json

17.2 MB
xet

Upload folder using huggingface_hub 11 months ago
tokenizer_config.json

55.4 kB

Upload folder using huggingface_hub 11 months ago