Fault in Demo space
#16
by Jared-The-Developer - opened
Demo space is failing with error:
Failed to generate text: FlashAttention2 has been toggled on, but it cannot be used due to the following error: Flash Attention 2 is not available on CPU. Please make sure torch can access a CUDA device.
The demo is alive now.
teowu changed discussion status to closed