Model Submission Request: AtomixS2-5M-v1.0
#24
by MultivexAI - opened
Hello,
Please add our latest micro-scale model, AtomixS2-5M-v1.0, to the Open SLM Leaderboard. The model weights are open-access, and the evaluations were completed using the standard EleutherAI evaluation harness and ArithMark-2.0.
Model Metadata
- Model Hub URL: https://huggingface.co/AtomixLabs/AtomixS2-5M-v1.0
- Name: AtomixS2-5M-v1.0
- Organization: AtomixLabs
- Parameters: 5,984,768
- License: Apache-2.0
- Open weights: yes
- Type: causal decoder-only language model
Evaluation Results
1. lm-evaluation-harness (v0.4.x)
| Task | Metric | Score |
|---|---|---|
| ARC-Easy | acc_norm | 0.3279 |
| ARC-Challenge | acc_norm | 0.2108 |
| HellaSwag | acc_norm | 0.2827 |
| PIQA | acc_norm | 0.5370 |
2. ArithMark-2.0
| Benchmark | Metric | Score |
|---|---|---|
| ArithMark-2.0 | acc | 0.2792 |
Scores validated and model added, Great work!
Datdanboi25 changed discussion status to closed