Polaris 7B is weaker than Polaris 4B??

#1
by BVEsun - opened

is this true?

Models AIME24 avg@32 AIME25 avg@32 Minerva Math avg@4 Olympiad Bench avg@4 AMC23 avg@8
POLARIS-7B-Preview 72.6 52.6 40.2 65.4 89.0
POLARIS-4B-Preview 81.2 79.4 44.0 69.1 94.8

Also noticed it:
image.png

If I try to compare the answers this seems to be truth. 4B beats 7B.

Sign up or log in to comment