ISTA-DASLab
/

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Model card Files Files and versions

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

21.9 GB

2 contributors

History: 7 commits

BlackSamorez's picture

Update tokenizer_config.json

46a87c2 verified over 1 year ago

.gitattributes
1.52 kB

initial commit over 1 year ago
README.md
729 Bytes

Added metrics over 1 year ago
config.json
9.38 kB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
generation_config.json
126 Bytes

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
model-00001-of-00005.safetensors
5 GB
xet

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
model-00002-of-00005.safetensors
4.96 GB
xet

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
model-00003-of-00005.safetensors
4.99 GB
xet

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
model-00004-of-00005.safetensors
4.87 GB
xet

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
model-00005-of-00005.safetensors
2.1 GB
xet

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
model.safetensors.index.json
152 kB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
special_tokens_map.json
73 Bytes

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
tokenizer.json
9.08 MB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization over 1 year ago
tokenizer_config.json
51 kB

Update tokenizer_config.json over 1 year ago