Athena-v1 / README.md
leaderboard-pr-bot's picture
Adding Evaluation Results
1660b39
|
raw
history blame
832 Bytes

Experimental mythomax based ERP model. Use Alpaca format, merged models: mythomax, puddlejumper, airoboros, chronos beluga

gguf here: https://huggingface.co/TheBloke/Athena-v1-GGUF

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 52.68
ARC (25-shot) 60.07
HellaSwag (10-shot) 82.64
MMLU (5-shot) 55.61
TruthfulQA (0-shot) 46.58
Winogrande (5-shot) 74.82
GSM8K (5-shot) 4.93
DROP (3-shot) 44.11