What's the point of this quantization?
#1
by DKingAlpha - opened
- deepseek-ai/DeepSeek-V4-Flash: 160 GB
- nvidia/DeepSeek-V4-Flash-NVFP4: 168 GB
Why would I need a quantized model worse than original and even larger?
What the hell am I gonna do with a nvfp4 model? it's not even sparse. Is it actually faster? Any data?
maybe compatibility? I've heard about problems with the original model running on an RTX 6000, for example. But that's just a guess… I thought the same as you.