please convert it to nvfp4
#2
by dummy9996 - opened
I have wasted my time trying to do it myself from your mixed fp8, black outputs with my own 4-bit quant :(
usually, black video is caused by env configuration issue. SageAttention and FP16 settings can also matter, having FP16 accumulation set to true on BF16 can lead to black video too.. I’ll download those models and test them