VRAM usage not making sense
#2
by
spanspek
- opened
The files are 6.04GB yet when I run it using transformers, pytorch is trying to use over 20GB of VRAM :
- can someone please explain why
- what is the best optimization available at the moment to bring this down
- is it possible to run this on a device with say 8GB of VRAM (which can store all of the files in memory with space to spare)
Your image is probably too large. Try a lower resolution one and see if vram usage go down.