inference-optimization
/

Llama-3.1-8B-Instruct-NVFP4-DDP8

8-bit precision

compressed-tensors

Model card Files Files and versions

Llama-3.1-8B-Instruct-NVFP4-DDP8 / generation_config.json

Commit History

Upload folder using huggingface_hub

6d7bdb6
verified

kylesayrs commited on Mar 18