add results table
Browse files
README.md
CHANGED
|
@@ -9,6 +9,19 @@ INTELLECT-MATH is a 7B parameter model optimized for mathematical reasoning. It
|
|
| 9 |
We demonstrate that the quality of our SFT data can impact the performance and training speed of the RL stage: Due to its better synthetic SFT dataset that encourages the model to imitate the reasoning behavior of a strong teacher model, INTELLECT-MATH outperforms Eurus-2-PRIME, the previous state-of-the-art trained with PRIME-RL, and matches its performance with 10x faster training.
|
| 10 |
|
| 11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
### Links
|
| 13 |
|
| 14 |
- 📜 [Blog Post]()
|
|
|
|
| 9 |
We demonstrate that the quality of our SFT data can impact the performance and training speed of the RL stage: Due to its better synthetic SFT dataset that encourages the model to imitate the reasoning behavior of a strong teacher model, INTELLECT-MATH outperforms Eurus-2-PRIME, the previous state-of-the-art trained with PRIME-RL, and matches its performance with 10x faster training.
|
| 10 |
|
| 11 |
|
| 12 |
+
|
| 13 |
+
| | Intellect-Math (Step 255) | Intellect-Math (Step 47) | Eurus-2-Prime (Step 592) | Intellect-Math-SFT | Eurus-2-SFT | Qwen-2.5-Math |
|
| 14 |
+
|----------------|---------------------------:|--------------------------:|--------------------------:|--------------------:|------------:|-------------:|
|
| 15 |
+
| **MATH-500** | 82.0 | 81.6 | 79.2 | 72.8 | 65.1 | 79.8 |
|
| 16 |
+
| **OLYMPIADBENCH** | 49.5 | 46.7 | 42.1 | 39.1 | 29.8 | 40.7 |
|
| 17 |
+
| **AIME 2024** | 26.7 | 26.7 | 26.7 | 16.6 | 3.3 | 13.3 |
|
| 18 |
+
| **AMC** | 60.2 | 57.8 | 57.8 | 45.8 | 30.1 | 50.6 |
|
| 19 |
+
| **MINERVA MATH** | 39.7 | 37.8 | 38.6 | 33.8 | 32.7 | 34.6 |
|
| 20 |
+
| **AVG** | 51.6 | 50.1 | 48.9 | 41.6 | 32.2 | 43.8 |
|
| 21 |
+
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
|
| 25 |
### Links
|
| 26 |
|
| 27 |
- 📜 [Blog Post]()
|