kilian-group
/

llama-quantized-1

Model card Files Files and versions

llama-quantized-1

1.07 GB

1 contributor

History: 5 commits

Albert Gong

Add requirements for custom inference handler

1bff16b verified 10 days ago

primary-LoRA-llama3-8b-8-bit-2048-tokens-64-r.json
Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
.gitattributes
1.52 kB

initial commit 10 days ago
README.md
5.1 kB

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
adapter_config.json
3.21 kB

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
adapter_model.safetensors
179 MB
xet

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
handler.py
6.57 kB

Add custom inference handler for Inference Endpoints 10 days ago
optimizer.pt
357 MB
xet

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
requirements.txt
106 Bytes

Add requirements for custom inference handler 10 days ago
rng_state.pth
14.2 kB
xet

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
scheduler.pt
1.06 kB
xet

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
trainer_state.json
37.6 kB

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago
training_args.bin
4.73 kB
xet

Upload llama-quantized-1 PEFT adapter for arxiv classification 10 days ago