inference-optimization
/

Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_5.0-bits

8-bit precision

compressed-tensors

Model card Files Files and versions

Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_5.0-bits / README.md

krishnateja95's picture

initial commit

5f61b5d verified about 1 month ago

|

history blame contribute delete

31 Bytes

license: apache-2.0