File size: 905 Bytes
8f5f08d 26f6193 8f5f08d 26f6193 a527ef1 26f6193 3e90183 26f6193 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 | ---
license: apache-2.0
datasets:
- 56m/math420k-dumbmathtrain
pipeline_tag: question-answering
tags:
- slm
- nano
- arithmetric
- arithmark
- small
- llm
- llama
---
## DumbMath Preview 1 0722
Today, Small56.AI releases DumbMath Preview 1 0722.
Despite its extremely small size of 665K parameters, this model outperforms a Atom-2.7M four times its size; although it is a preview version, it demonstrates arithmetic performance comparable to Qwen/Qwen2.5-0.5B.
- Parameters: 665K
- Training tokens: 0.52B
- Training time: Under 2 hours on Colab T4
### What the model cannot do
- Conversation (no alphabet tokens exist)
- Complex mathematics
- Arithmetic outside its supported scope
### arithmark
|eval|model|score|
|---|--:|:--:|
|ArithMark 2.0|mathbananamind-1.1|**90.2%**|
||our model|62.5%|
||qwen2.5-0.5B|63.0%|
|Parameters|mathbananamind-1.1|2900K|
||our model|**665K**|
||qwen2.5-0.5B|494000k| |