model for 3090
#3
by
Onix22
- opened
it does not run on older GPUs, please make fp8e5 version
ValueError("type fp8e4nv not supported in this architecture. The supported fp8 dtypes are ('fp8e4b15', 'fp8e5')")
That's old Triton version limitation, it's been recently fixed as seen here: https://github.com/woct0rdho/triton-windows/releases
Or you can disable torch.compile if you can't update.