Improve model card: Add library and pipeline tag

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +9 -8
README.md CHANGED
@@ -1,9 +1,10 @@
1
  ---
2
  license: llama3
 
 
3
  ---
4
- # Model Card for Model ID
5
 
6
- <!-- Provide a quick summary of what the model is/does. -->
7
 
8
  The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.co/datasets/panzs19/LEMMA). This dataset uses the training set of MATH and GSM8K to generate error-corrective reasoning trajectories. For each question in these datasets, the student model (LLaMA3-8B) generates self-generated errors, and the teacher model (GPT-4o) deliberately introduces errors based on the error type distribution of the student model. Then, both "Fix & Continue" and "Fresh & Restart" correction strategies are applied to these errors to create error-corrective revision trajectories. After filtering out trajectories with incorrect final answers, we obtain this dataset. Fine-tuning on this dataset achieves up to 13.3% average accuracy improvement for LLaMA3-8B with less than 90k synthesized data. For more details, please refer to our paper [LEMMA: Learning from Errors for MatheMatical Advancement in LLMs](https://arxiv.org/abs/2503.17439).
9
 
@@ -11,9 +12,9 @@ The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.c
11
 
12
  ### Model Description
13
 
14
- - **Finetuned from model [optional]:** [Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)
15
 
16
- ### Model Sources [optional]
17
 
18
  - **Repository:** [https://github.com/pzs19/LEMMA/](https://github.com/pzs19/LEMMA/)
19
  - **Paper:** [https://arxiv.org/abs/2503.17439](https://arxiv.org/abs/2503.17439)
@@ -34,10 +35,10 @@ The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.c
34
 
35
  | Model | Checkpoint | Paper | GSM8k | MATH | License |
36
  | ----- |------| ---- |------|-------| ----- |
37
- | LEMMA-LLAMA-3-8B | πŸ€— <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-8B" target="_blank">HF Link</a> | πŸ“ƒ <a href="" target="_blank">[LEMMA]</a>| **79.2** | **38.3** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
38
- | LEMMA-LLAMA-3-70B | πŸ€— <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-70B" target="_blank">HF Link</a> | πŸ“ƒ <a href="" target="_blank">[LEMMA]</a>| **91.5** | **51.8** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
39
 
40
- ## Citation [optional]
41
 
42
  Please cite the paper if you refer to our model, code, data or paper from MetaMath.
43
 
@@ -48,4 +49,4 @@ Please cite the paper if you refer to our model, code, data or paper from MetaMa
48
  journal={arXiv preprint arXiv:2503.17439},
49
  year={2025}
50
  }
51
- ```
 
1
  ---
2
  license: llama3
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
  ---
 
6
 
7
+ # Model Card for LEMMA-LLAMA-3-8B
8
 
9
  The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.co/datasets/panzs19/LEMMA). This dataset uses the training set of MATH and GSM8K to generate error-corrective reasoning trajectories. For each question in these datasets, the student model (LLaMA3-8B) generates self-generated errors, and the teacher model (GPT-4o) deliberately introduces errors based on the error type distribution of the student model. Then, both "Fix & Continue" and "Fresh & Restart" correction strategies are applied to these errors to create error-corrective revision trajectories. After filtering out trajectories with incorrect final answers, we obtain this dataset. Fine-tuning on this dataset achieves up to 13.3% average accuracy improvement for LLaMA3-8B with less than 90k synthesized data. For more details, please refer to our paper [LEMMA: Learning from Errors for MatheMatical Advancement in LLMs](https://arxiv.org/abs/2503.17439).
10
 
 
12
 
13
  ### Model Description
14
 
15
+ - **Finetuned from model:** [Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)
16
 
17
+ ### Model Sources
18
 
19
  - **Repository:** [https://github.com/pzs19/LEMMA/](https://github.com/pzs19/LEMMA/)
20
  - **Paper:** [https://arxiv.org/abs/2503.17439](https://arxiv.org/abs/2503.17439)
 
35
 
36
  | Model | Checkpoint | Paper | GSM8k | MATH | License |
37
  | ----- |------| ---- |------|-------| ----- |
38
+ | LEMMA-LLAMA-3-8B | πŸ€— <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-8B" target="_blank">HF Link</a> | πŸ“ƒ <a href="https://huggingface.co/papers/2503.17439" target="_blank">[LEMMA]</a>| **79.2** | **38.3** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
39
+ | LEMMA-LLAMA-3-70B | πŸ€— <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-70B" target="_blank">HF Link</a> | πŸ“ƒ <a href="https://huggingface.co/papers/2503.17439" target="_blank">[LEMMA]</a>| **91.5** | **51.8** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
40
 
41
+ ## Citation
42
 
43
  Please cite the paper if you refer to our model, code, data or paper from MetaMath.
44
 
 
49
  journal={arXiv preprint arXiv:2503.17439},
50
  year={2025}
51
  }
52
+ ```