Really appreciate that you ran performance comparison tests with BF16!

#2
by zenmagnets - opened

Wish others did the same! That's all. Thanks.

Thanks for the feedback!

GadflyII changed discussion status to closed

Is there an easy way that I could run the same tests myself? Trying to see how much the FP8 variant differs from full

yeah, it is an open source test:

https://github.com/TIGER-AI-Lab/MMLU-Pro

Sign up or log in to comment