Is it possible to use it with a 5080 16GB?
When run I receive this error:
torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 18.00 MiB. GPU 0 has a total capacity of 15.92 GiB of which 0 bytes is free. Including non-PyTorch memory, this process has 17179869184.00 GiB memory in use. Process 1 has 17179869184.00 GiB memory in use. Of the allocated memory 44.79 GiB is allocated by PyTorch, and 198.33 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)
U can run full BF16 with 10GB vram, i ComfyUI use advance diffusion loader combine it with lightning lora 8 steps, so u have quality and speed.