| --- |
| license: apache-2.0 |
| datasets: |
| - 56m/math420k-dumbmathtrain |
| pipeline_tag: question-answering |
| tags: |
| - slm |
| - nano |
| - arithmetric |
| - arithmark |
| - small |
| - llm |
| - llama |
| --- |
| ## DumbMath Preview 1 0722 |
|
|
| Today, Small56.AI releases DumbMath Preview 1 0722. |
| Despite its extremely small size of 665K parameters, this model outperforms a Atom-2.7M four times its size; although it is a preview version, it demonstrates arithmetic performance comparable to Qwen/Qwen2.5-0.5B. |
|
|
| - Parameters: 665K |
| - Training tokens: 0.52B |
| - Training time: Under 2 hours on Colab T4 |
|
|
| ### What the model cannot do |
|
|
| - Conversation (no alphabet tokens exist) |
| - Complex mathematics |
| - Arithmetic outside its supported scope |
|
|
| ### arithmark |
|
|
| |eval|model|score| |
| |---|--:|:--:| |
| |ArithMark 2.0|mathbananamind-1.1|**90.2%**| |
| ||our model|62.5%| |
| ||qwen2.5-0.5B|63.0%| |
| |Parameters|mathbananamind-1.1|2900K| |
| ||our model|**665K**| |
| ||qwen2.5-0.5B|494000k| |
