inference-optimization
/

Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_6.25-bits

compressed-tensors

Model card Files Files and versions

Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_6.25-bits / tokenizer.json

Commit History

Upload folder using huggingface_hub

0519473
verified

krishnateja95 commited on 12 days ago