| Experimental mythomax based ERP model. | |
| Use Alpaca format, merged models: mythomax, puddlejumper, airoboros, chronos beluga | |
| gguf here: https://huggingface.co/TheBloke/Athena-v1-GGUF | |
| # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) | |
| Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_IkariDev__Athena-v1) | |
| | Metric | Value | | |
| |-----------------------|---------------------------| | |
| | Avg. | 52.68 | | |
| | ARC (25-shot) | 60.07 | | |
| | HellaSwag (10-shot) | 82.64 | | |
| | MMLU (5-shot) | 55.61 | | |
| | TruthfulQA (0-shot) | 46.58 | | |
| | Winogrande (5-shot) | 74.82 | | |
| | GSM8K (5-shot) | 4.93 | | |
| | DROP (3-shot) | 44.11 | | |