Improve model card with abstract, GitHub link, and comprehensive download section
Browse filesThis pull request aims to enhance the model card for `Fast-Math-R1-14B` by:
* Adding the paper abstract for a more immediate and detailed understanding of the model.
* Introducing a prominent "Code:" link to the GitHub repository for easier access to the project's codebase.
* Replacing the current "Dataset" section with a more comprehensive "Download" section, sourced from the original GitHub repository, which includes links to the model itself and related models, in addition to the datasets.
These updates improve the discoverability of associated resources and the overall completeness of the model card.
README.md
CHANGED
|
@@ -1,15 +1,6 @@
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
- deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
|
| 4 |
-
license: apache-2.0
|
| 5 |
-
pipeline_tag: text-generation
|
| 6 |
-
library_name: transformers
|
| 7 |
-
tags:
|
| 8 |
-
- math
|
| 9 |
-
- reasoning
|
| 10 |
-
- llm
|
| 11 |
-
- mathematical-reasoning
|
| 12 |
-
- aimo
|
| 13 |
datasets:
|
| 14 |
- RabotniKuma/Fast-Math-R1-SFT
|
| 15 |
- RabotniKuma/Fast-Math-R1-GRPO
|
|
@@ -18,14 +9,28 @@ datasets:
|
|
| 18 |
- qihoo360/Light-R1-SFTData
|
| 19 |
language:
|
| 20 |
- en
|
|
|
|
|
|
|
| 21 |
metrics:
|
| 22 |
- pass@1
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
---
|
| 24 |
|
| 25 |
# Kaggle AI Mathematical Olympiad - Progress Prize 2 - 9th Place Solution (Fast-Math-R1-14B)
|
| 26 |
|
| 27 |
This model was presented in the paper [A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning](https://huggingface.co/papers/2507.08267).
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
## Team
|
| 30 |
- Hiroshi Yoshihara @ [Aillis Inc.](https://aillis.jp/en), [The Univ. of Tokyo](https://publichealth.f.u-tokyo.ac.jp/#page_home)
|
| 31 |
- Yuichi Inoue @ [Sakana AI](https://sakana.ai)
|
|
@@ -37,7 +42,7 @@ which achieves up to 60% (on average approx. 30%) faster inference while maintai
|
|
| 37 |
|
| 38 |
In addition, we trained and open-sourced `Fast-OpenMath-Nemotron-14B`, an efficiency-optimized version of NVIDIA’s `OpenMath-Nemotron-14B`, following the same approach.
|
| 39 |
|
| 40 |
-
Technical details can be found in [Kaggle Discussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252)
|
| 41 |
|
| 42 |
## Evaluation
|
| 43 |
<img src="https://github.com/analokmaus/kaggle-aimo2-fast-math-r1/blob/master/assets/pass1_aime_all.png?raw=true" max-height="400px">
|
|
@@ -87,9 +92,13 @@ Technical details can be found in [Kaggle Discussion](https://www.kaggle.com/com
|
|
| 87 |
| | 12000 | 65.1 | 7775 | 49.4 | 8733 |
|
| 88 |
| | 8000 | 50.7 | 6260 | 36 | 6618 |
|
| 89 |
|
| 90 |
-
##
|
| 91 |
-
-
|
| 92 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 93 |
|
| 94 |
## Inference
|
| 95 |
### vLLM
|
|
@@ -196,26 +205,26 @@ wait
|
|
| 196 |
## Technical details
|
| 197 |
Detailed report is available on [Kaggle Disucussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252).
|
| 198 |
|
| 199 |
-
|
| 200 |
-
|
| 201 |
- [OpenR1 Math](https://huggingface.co/datasets/open-r1/OpenR1-Math-220k): We randomly sampled 3000 examples where the R1’s trace had more than 12800 tokens and an accuracy of over 50%, along with another 3000 examples where the accuracy ranged between 50% and 75%.
|
| 202 |
-
- [openr1_hard](https://huggingface.co/datasets/hoanganhpham/openr1_hard):
|
| 203 |
- [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We used the 2nd stage data from Light-R1-SFTData.
|
| 204 |
|
| 205 |
We merged all the datasets mentioned above, removed duplicates, and selected the correct generation with the shortest token length. For samples in the Light-R1 dataset where ground truth answers were not provided, we extracted and substituted the answers from the R1 traces. As a result, we constructed a **high-difficulty dataset consisting of 7900 problem - R1 trace - answer sets**.
|
| 206 |
|
| 207 |
[Our first stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
|
| 208 |
|
| 209 |
-
|
| 210 |
A full-parameter supervised fine-tuning training was conducted on a machine with 8 H200 GPUs, using the SFTTrainer from the trl library.
|
| 211 |
|
| 212 |
-
|
| 213 |
-
|
| 214 |
- [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We extracted the answers from the 2nd stage SFT data of Light-R1.
|
| 215 |
|
| 216 |
[Our second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
|
| 217 |
|
| 218 |
-
|
| 219 |
We used the [faster implementation of trl GRPOTrainer](https://github.com/nhannguyen2709/open-r1).
|
| 220 |
|
| 221 |
Reward functions:
|
|
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
- deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
datasets:
|
| 5 |
- RabotniKuma/Fast-Math-R1-SFT
|
| 6 |
- RabotniKuma/Fast-Math-R1-GRPO
|
|
|
|
| 9 |
- qihoo360/Light-R1-SFTData
|
| 10 |
language:
|
| 11 |
- en
|
| 12 |
+
library_name: transformers
|
| 13 |
+
license: apache-2.0
|
| 14 |
metrics:
|
| 15 |
- pass@1
|
| 16 |
+
pipeline_tag: text-generation
|
| 17 |
+
tags:
|
| 18 |
+
- math
|
| 19 |
+
- reasoning
|
| 20 |
+
- llm
|
| 21 |
+
- mathematical-reasoning
|
| 22 |
+
- aimo
|
| 23 |
---
|
| 24 |
|
| 25 |
# Kaggle AI Mathematical Olympiad - Progress Prize 2 - 9th Place Solution (Fast-Math-R1-14B)
|
| 26 |
|
| 27 |
This model was presented in the paper [A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning](https://huggingface.co/papers/2507.08267).
|
| 28 |
|
| 29 |
+
## Abstract
|
| 30 |
+
Enhancing the mathematical reasoning of Large Language Models (LLMs) is a pivotal challenge in advancing AI capabilities. While Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) are the dominant training paradigms, a systematic methodology for combining them to maximize both accuracy and efficiency remains largely unexplored. This paper introduces a practical and effective training recipe that strategically integrates extended SFT with RL from online inference (GRPO). We posit that these methods play complementary, not competing, roles: a prolonged SFT phase first pushes the model's accuracy to its limits, after which a GRPO phase dramatically improves token efficiency while preserving this peak performance. Our experiments reveal that extending SFT for as many as 10 epochs is crucial for performance breakthroughs, and that the primary role of GRPO in this framework is to optimize solution length. The efficacy of our recipe is rigorously validated through top-tier performance on challenging benchmarks, including a high rank among over 2,200 teams in the strictly leak-free AI Mathematical Olympiad (AIMO). This work provides the community with a battle-tested blueprint for developing state-of-the-art mathematical reasoners that are both exceptionally accurate and practically efficient. To ensure full reproducibility and empower future research, we will open-source our entire framework, including all code, model checkpoints, and training configurations at this https URL .
|
| 31 |
+
|
| 32 |
+
Code: [https://github.com/analokmaus/kaggle-aimo2-fast-math-r1](https://github.com/analokmaus/kaggle-aimo2-fast-math-r1)
|
| 33 |
+
|
| 34 |
## Team
|
| 35 |
- Hiroshi Yoshihara @ [Aillis Inc.](https://aillis.jp/en), [The Univ. of Tokyo](https://publichealth.f.u-tokyo.ac.jp/#page_home)
|
| 36 |
- Yuichi Inoue @ [Sakana AI](https://sakana.ai)
|
|
|
|
| 42 |
|
| 43 |
In addition, we trained and open-sourced `Fast-OpenMath-Nemotron-14B`, an efficiency-optimized version of NVIDIA’s `OpenMath-Nemotron-14B`, following the same approach.
|
| 44 |
|
| 45 |
+
Technical details can be found in [Kaggle Discussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252).
|
| 46 |
|
| 47 |
## Evaluation
|
| 48 |
<img src="https://github.com/analokmaus/kaggle-aimo2-fast-math-r1/blob/master/assets/pass1_aime_all.png?raw=true" max-height="400px">
|
|
|
|
| 92 |
| | 12000 | 65.1 | 7775 | 49.4 | 8733 |
|
| 93 |
| | 8000 | 50.7 | 6260 | 36 | 6618 |
|
| 94 |
|
| 95 |
+
## Download
|
| 96 |
+
- `Fast-Math-R1-14B` model is available at [Huggingface](https://huggingface.co/RabotniKuma/Fast-Math-R1-14B) and [Kaggle Models](https://www.kaggle.com/models/analokamus/fast_math_r1_14b/).
|
| 97 |
+
- `Fast-OpenMath-Nemotron-14B` model is available at [Huggingface](https://huggingface.co/RabotniKuma/Fast-OpenMath-Nemotron-14B)
|
| 98 |
+
- `Fast-Math-Qwen3-14B` model is available at [Huggingface](https://huggingface.co/RabotniKuma/Fast-Math-Qwen3-14B)
|
| 99 |
+
- [First stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
|
| 100 |
+
- [Second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
|
| 101 |
+
- (Optional) [Token scheduler dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-Token-Scheduler)
|
| 102 |
|
| 103 |
## Inference
|
| 104 |
### vLLM
|
|
|
|
| 205 |
## Technical details
|
| 206 |
Detailed report is available on [Kaggle Disucussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252).
|
| 207 |
|
| 208 |
+
## First stage: intensive SFT using a high-difficulty dataset
|
| 209 |
+
### Dataset
|
| 210 |
- [OpenR1 Math](https://huggingface.co/datasets/open-r1/OpenR1-Math-220k): We randomly sampled 3000 examples where the R1’s trace had more than 12800 tokens and an accuracy of over 50%, along with another 3000 examples where the accuracy ranged between 50% and 75%.
|
| 211 |
+
- [openr1_hard](https://huggingface.co/datasets/hoanganhpham/openr1_hard): "~2.5k hard samples from open-r1-math-220k. Samples deemed as hard were unsolvable by r1-distill-32b after 4 tries."
|
| 212 |
- [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We used the 2nd stage data from Light-R1-SFTData.
|
| 213 |
|
| 214 |
We merged all the datasets mentioned above, removed duplicates, and selected the correct generation with the shortest token length. For samples in the Light-R1 dataset where ground truth answers were not provided, we extracted and substituted the answers from the R1 traces. As a result, we constructed a **high-difficulty dataset consisting of 7900 problem - R1 trace - answer sets**.
|
| 215 |
|
| 216 |
[Our first stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
|
| 217 |
|
| 218 |
+
### Training
|
| 219 |
A full-parameter supervised fine-tuning training was conducted on a machine with 8 H200 GPUs, using the SFTTrainer from the trl library.
|
| 220 |
|
| 221 |
+
## Second stage: GRPO for more efficient reasoning
|
| 222 |
+
### Dataset
|
| 223 |
- [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We extracted the answers from the 2nd stage SFT data of Light-R1.
|
| 224 |
|
| 225 |
[Our second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
|
| 226 |
|
| 227 |
+
### Training
|
| 228 |
We used the [faster implementation of trl GRPOTrainer](https://github.com/nhannguyen2709/open-r1).
|
| 229 |
|
| 230 |
Reward functions:
|