RedHatAI
/

Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions

how many resources were used for quantizing this model?

#4

by fengyang1995 - opened Sep 8, 2024

Could you please tell me how many resources were used for quantizing this model?

Red Hat AI org Sep 8, 2024

•

edited Sep 8, 2024

8 A100 GPUs with 80GB each

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment