run on rtx3090

#70

by gyjung0212 - opened Aug 8, 2025

Can I run this on RTX3090?
I used enable_model_cpu_offload() but OOM.... :(

V100 32G也是OOM

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment