Dumb-1.2

#13
by 56m - opened

This is my model. Please register on the leaderboard

param: 34,611K(34.6M)

https://huggingface.co/56m/Dumb-1.2-Exp-0616

MMLU (acc): 23.10%, 23.1%
HellaSwag (acc_norm): 25.51%, 25.5%
ARC-Easy (acc_norm): 28.54%, 28.5%
PIQA (acc): 54.03%, 54.0%
SciQ (acc_norm): 29.10%, 29.1%
ARC-C (acc_norm): 22.53%, 22.5%
WinoGrande (acc): 49.25%, 49.3%
OpenBookQA (acc_norm): 25.20%, 25.2%

company name: Small56.AI

Axiomic Labs org

Its up!

Datdanboi25 changed discussion status to closed

Sign up or log in to comment