nielsr HF Staff commited on
Commit
f93e146
·
verified ·
1 Parent(s): abd20a4

Improve model card with abstract, GitHub link, and comprehensive download section

Browse files

This pull request aims to enhance the model card for `Fast-Math-R1-14B` by:
* Adding the paper abstract for a more immediate and detailed understanding of the model.
* Introducing a prominent "Code:" link to the GitHub repository for easier access to the project's codebase.
* Replacing the current "Dataset" section with a more comprehensive "Download" section, sourced from the original GitHub repository, which includes links to the model itself and related models, in addition to the datasets.

These updates improve the discoverability of associated resources and the overall completeness of the model card.

Files changed (1) hide show
  1. README.md +29 -20
README.md CHANGED
@@ -1,15 +1,6 @@
1
  ---
2
  base_model:
3
  - deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
4
- license: apache-2.0
5
- pipeline_tag: text-generation
6
- library_name: transformers
7
- tags:
8
- - math
9
- - reasoning
10
- - llm
11
- - mathematical-reasoning
12
- - aimo
13
  datasets:
14
  - RabotniKuma/Fast-Math-R1-SFT
15
  - RabotniKuma/Fast-Math-R1-GRPO
@@ -18,14 +9,28 @@ datasets:
18
  - qihoo360/Light-R1-SFTData
19
  language:
20
  - en
 
 
21
  metrics:
22
  - pass@1
 
 
 
 
 
 
 
23
  ---
24
 
25
  # Kaggle AI Mathematical Olympiad - Progress Prize 2 - 9th Place Solution (Fast-Math-R1-14B)
26
 
27
  This model was presented in the paper [A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning](https://huggingface.co/papers/2507.08267).
28
 
 
 
 
 
 
29
  ## Team
30
  - Hiroshi Yoshihara @ [Aillis Inc.](https://aillis.jp/en), [The Univ. of Tokyo](https://publichealth.f.u-tokyo.ac.jp/#page_home)
31
  - Yuichi Inoue @ [Sakana AI](https://sakana.ai)
@@ -37,7 +42,7 @@ which achieves up to 60% (on average approx. 30%) faster inference while maintai
37
 
38
  In addition, we trained and open-sourced `Fast-OpenMath-Nemotron-14B`, an efficiency-optimized version of NVIDIA’s `OpenMath-Nemotron-14B`, following the same approach.
39
 
40
- Technical details can be found in [Kaggle Discussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252) and [Github](https://github.com/analokmaus/kaggle-aimo2-fast-math-r1).
41
 
42
  ## Evaluation
43
  <img src="https://github.com/analokmaus/kaggle-aimo2-fast-math-r1/blob/master/assets/pass1_aime_all.png?raw=true" max-height="400px">
@@ -87,9 +92,13 @@ Technical details can be found in [Kaggle Discussion](https://www.kaggle.com/com
87
  | | 12000 | 65.1 | 7775 | 49.4 | 8733 |
88
  | | 8000 | 50.7 | 6260 | 36 | 6618 |
89
 
90
- ## Dataset
91
- - [Our first stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
92
- - [Our second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
 
 
 
 
93
 
94
  ## Inference
95
  ### vLLM
@@ -196,26 +205,26 @@ wait
196
  ## Technical details
197
  Detailed report is available on [Kaggle Disucussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252).
198
 
199
- ### First stage: intensive SFT using a high-difficulty dataset
200
- #### Dataset
201
  - [OpenR1 Math](https://huggingface.co/datasets/open-r1/OpenR1-Math-220k): We randomly sampled 3000 examples where the R1’s trace had more than 12800 tokens and an accuracy of over 50%, along with another 3000 examples where the accuracy ranged between 50% and 75%.
202
- - [openr1_hard](https://huggingface.co/datasets/hoanganhpham/openr1_hard): "~2.5k hard samples from open-r1-math-220k. Samples deemed as hard were unsolvable by r1-distill-32b after 4 tries."
203
  - [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We used the 2nd stage data from Light-R1-SFTData.
204
 
205
  We merged all the datasets mentioned above, removed duplicates, and selected the correct generation with the shortest token length. For samples in the Light-R1 dataset where ground truth answers were not provided, we extracted and substituted the answers from the R1 traces. As a result, we constructed a **high-difficulty dataset consisting of 7900 problem - R1 trace - answer sets**.
206
 
207
  [Our first stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
208
 
209
- #### Training
210
  A full-parameter supervised fine-tuning training was conducted on a machine with 8 H200 GPUs, using the SFTTrainer from the trl library.
211
 
212
- ### Second stage: GRPO for more efficient reasoning
213
- #### Dataset
214
  - [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We extracted the answers from the 2nd stage SFT data of Light-R1.
215
 
216
  [Our second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
217
 
218
- #### Training
219
  We used the [faster implementation of trl GRPOTrainer](https://github.com/nhannguyen2709/open-r1).
220
 
221
  Reward functions:
 
1
  ---
2
  base_model:
3
  - deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
 
 
 
 
 
 
 
 
 
4
  datasets:
5
  - RabotniKuma/Fast-Math-R1-SFT
6
  - RabotniKuma/Fast-Math-R1-GRPO
 
9
  - qihoo360/Light-R1-SFTData
10
  language:
11
  - en
12
+ library_name: transformers
13
+ license: apache-2.0
14
  metrics:
15
  - pass@1
16
+ pipeline_tag: text-generation
17
+ tags:
18
+ - math
19
+ - reasoning
20
+ - llm
21
+ - mathematical-reasoning
22
+ - aimo
23
  ---
24
 
25
  # Kaggle AI Mathematical Olympiad - Progress Prize 2 - 9th Place Solution (Fast-Math-R1-14B)
26
 
27
  This model was presented in the paper [A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learning](https://huggingface.co/papers/2507.08267).
28
 
29
+ ## Abstract
30
+ Enhancing the mathematical reasoning of Large Language Models (LLMs) is a pivotal challenge in advancing AI capabilities. While Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) are the dominant training paradigms, a systematic methodology for combining them to maximize both accuracy and efficiency remains largely unexplored. This paper introduces a practical and effective training recipe that strategically integrates extended SFT with RL from online inference (GRPO). We posit that these methods play complementary, not competing, roles: a prolonged SFT phase first pushes the model's accuracy to its limits, after which a GRPO phase dramatically improves token efficiency while preserving this peak performance. Our experiments reveal that extending SFT for as many as 10 epochs is crucial for performance breakthroughs, and that the primary role of GRPO in this framework is to optimize solution length. The efficacy of our recipe is rigorously validated through top-tier performance on challenging benchmarks, including a high rank among over 2,200 teams in the strictly leak-free AI Mathematical Olympiad (AIMO). This work provides the community with a battle-tested blueprint for developing state-of-the-art mathematical reasoners that are both exceptionally accurate and practically efficient. To ensure full reproducibility and empower future research, we will open-source our entire framework, including all code, model checkpoints, and training configurations at this https URL .
31
+
32
+ Code: [https://github.com/analokmaus/kaggle-aimo2-fast-math-r1](https://github.com/analokmaus/kaggle-aimo2-fast-math-r1)
33
+
34
  ## Team
35
  - Hiroshi Yoshihara @ [Aillis Inc.](https://aillis.jp/en), [The Univ. of Tokyo](https://publichealth.f.u-tokyo.ac.jp/#page_home)
36
  - Yuichi Inoue @ [Sakana AI](https://sakana.ai)
 
42
 
43
  In addition, we trained and open-sourced `Fast-OpenMath-Nemotron-14B`, an efficiency-optimized version of NVIDIA’s `OpenMath-Nemotron-14B`, following the same approach.
44
 
45
+ Technical details can be found in [Kaggle Discussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252).
46
 
47
  ## Evaluation
48
  <img src="https://github.com/analokmaus/kaggle-aimo2-fast-math-r1/blob/master/assets/pass1_aime_all.png?raw=true" max-height="400px">
 
92
  | | 12000 | 65.1 | 7775 | 49.4 | 8733 |
93
  | | 8000 | 50.7 | 6260 | 36 | 6618 |
94
 
95
+ ## Download
96
+ - `Fast-Math-R1-14B` model is available at [Huggingface](https://huggingface.co/RabotniKuma/Fast-Math-R1-14B) and [Kaggle Models](https://www.kaggle.com/models/analokamus/fast_math_r1_14b/).
97
+ - `Fast-OpenMath-Nemotron-14B` model is available at [Huggingface](https://huggingface.co/RabotniKuma/Fast-OpenMath-Nemotron-14B)
98
+ - `Fast-Math-Qwen3-14B` model is available at [Huggingface](https://huggingface.co/RabotniKuma/Fast-Math-Qwen3-14B)
99
+ - [First stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
100
+ - [Second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
101
+ - (Optional) [Token scheduler dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-Token-Scheduler)
102
 
103
  ## Inference
104
  ### vLLM
 
205
  ## Technical details
206
  Detailed report is available on [Kaggle Disucussion](https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2/discussion/571252).
207
 
208
+ ## First stage: intensive SFT using a high-difficulty dataset
209
+ ### Dataset
210
  - [OpenR1 Math](https://huggingface.co/datasets/open-r1/OpenR1-Math-220k): We randomly sampled 3000 examples where the R1’s trace had more than 12800 tokens and an accuracy of over 50%, along with another 3000 examples where the accuracy ranged between 50% and 75%.
211
+ - [openr1_hard](https://huggingface.co/datasets/hoanganhpham/openr1_hard): "~2.5k hard samples from open-r1-math-220k. Samples deemed as hard were unsolvable by r1-distill-32b after 4 tries."
212
  - [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We used the 2nd stage data from Light-R1-SFTData.
213
 
214
  We merged all the datasets mentioned above, removed duplicates, and selected the correct generation with the shortest token length. For samples in the Light-R1 dataset where ground truth answers were not provided, we extracted and substituted the answers from the R1 traces. As a result, we constructed a **high-difficulty dataset consisting of 7900 problem - R1 trace - answer sets**.
215
 
216
  [Our first stage SFT dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-SFT)
217
 
218
+ ### Training
219
  A full-parameter supervised fine-tuning training was conducted on a machine with 8 H200 GPUs, using the SFTTrainer from the trl library.
220
 
221
+ ## Second stage: GRPO for more efficient reasoning
222
+ ### Dataset
223
  - [Light-R1-SFTData](https://huggingface.co/datasets/qihoo360/Light-R1-SFTData): We extracted the answers from the 2nd stage SFT data of Light-R1.
224
 
225
  [Our second stage GRPO dataset](https://huggingface.co/datasets/RabotniKuma/Fast-Math-R1-GRPO)
226
 
227
+ ### Training
228
  We used the [faster implementation of trl GRPOTrainer](https://github.com/nhannguyen2709/open-r1).
229
 
230
  Reward functions: