VRAM requirements
#1
by twhitworth - opened
How much vram is required to run the model? My best guess is somewhere in the 150gb to 250gb range?
The weights alone are ~270GB, plus some for context.
How much vram is required to run the model? My best guess is somewhere in the 150gb to 250gb range?
The weights alone are ~270GB, plus some for context.