RAM Hardware Specs

#2
by ajmiller - opened

Hi, I'm testing this out on a local desktop with a 5090. However, I was running into issues when loading the model because it used the entirety of my system's RAM. My system has 64GB, but I was only able to load the model on to the 5090 using a 128GB extra swap memory from my NVMe. Are you using north of 128GB of RAM?

My apologies, I should have included those. Yea I have an absurd amount of RAM that I forget about.

  • OS: Ubuntu 22.04.5 LTS
  • Kernel: 6.8.0-94-generic
  • CPU: Intel Core Ultra 9 285K (24 cores, 5.1 GHz max)
  • RAM: 188 GB
  • GPU: NVIDIA GeForce RTX 5090 (32 GB VRAM)
  • Disk: 1.8 TB NVMe (243 GB free)

Awesome, thanks! Yea, it seems to be really RAM hungry when loading all the model components onto the GPU. It seems to require somewhere around 150-160GB of RAM but then drops quite dramatically after loading. Adding swap memory works just fine for me besides taking a fair while to load (~15 minutes before video generation starts).

Sign up or log in to comment