torch 2.9 issue
#1
by faheemraza1 - opened
hi
this model works fine on torch version 2.8 but goes OOM on torch 2.9. Any idea how to fix it? (I had top upgrade to torch 2.9 due to vlllm, unrelated to this model/code)
did you solve it? what is your cuda version?
did you solve it? what is your cuda version?
OOM on following
2.10.0+cu130
NVIDIA GeForce RTX 5070 Ti
VRAM: 15.92 GB
it may not be torch related. someone else had this issue in the previous version of qwen-image nf4 and they had posted their solution. It's possible it really is an OOm which means you need to be more aggressive with diffusers and which weights are on the gpu versus cpu. look for the answer in my other repo under community posts
ovedrive changed discussion status to closed