Extremely misleading benchmarks

#1
by rombodawg - opened

The benchmark photo you have on your model card uses almost all diffrent models which is extremely misleading. Making people think your model is better than it really is.

For example qwen3-next-80b is only on the first benchmark. Why not the other 2??? Is it that you are trying to hide how bad your model really is?

nemotron-cascade-14b-thinking-results

14b model vs 80b model, I do think they picked the best looking benchmarks obviously; but outperforming a model that's magnitudes larger in parameters on any benchmark is impressive

14b model vs 80b model, I do think they picked the best looking benchmarks obviously; but outperforming a model that's magnitudes larger in parameters on any benchmark is impressive

Classic Nvidia, maybe next time they'll have chart with 4x Token-Gen based on the first token. (Frame gen joke)

This comment has been hidden (marked as Resolved)

Sign up or log in to comment