inference-optimization
/

Llama-3.1-8B-Instruct_6_bits_mode_heuristic

compressed-tensors

Model card Files Files and versions

Llama-3.1-8B-Instruct_6_bits_mode_heuristic / tokenizer.json

Commit History

Upload folder using huggingface_hub

f4da162
verified

krishnateja95 commited on 5 days ago