How moutch vram
#1
by Sterling-Ai - opened
I do not own like a datacenter but how many tb of ram will this need?
Heres the math:
"19,980,000,000,000,000 logical 2-bit parameters"
2bits = 4p / byte
so roughly... 40,000 TB for weights loading.
or 139,000,000 VeraRubin GPUs (288GBs vram)
can i barrow the 139,000,000 VeraRubin GPUs u used to find that out
Nope - i just did the math, each gpu costs ~ 8,000,000/144 or 55K (NVL 144 rack has 144 of the gpus and costs ~8m)