Is mixed nvfp4 better than normal nvfp4?

#2
by pheonis - opened

Is mixed nvfp4 better than normal nvfp4?

Owner

well, yes that's the point. but the difference is small.
if you're familiar with GGUF models, it's a bit like the difference between Q4 and Q5 quantization.

Sign up or log in to comment