VRAM requirement
#3
by Akansha123 - opened
Hi,
What is the memory requirement(VRAM) to load 13B model?
I am trying to load with 21GB of VRAM, but response is very slow
Hi,
What is the memory requirement(VRAM) to load 13B model?
I am trying to load with 21GB of VRAM, but response is very slow