inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 29 • 1
nvfp4-llama3.1-8b-ablations
-
-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 15 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 28 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 27 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-SmoothQuant
5B • Updated • 27