Improve model card: Add library and pipeline tag
#1
by
nielsr
HF Staff
- opened
README.md
CHANGED
|
@@ -1,9 +1,10 @@
|
|
| 1 |
---
|
| 2 |
license: llama3
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
-
# Model Card for Model ID
|
| 5 |
|
| 6 |
-
|
| 7 |
|
| 8 |
The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.co/datasets/panzs19/LEMMA). This dataset uses the training set of MATH and GSM8K to generate error-corrective reasoning trajectories. For each question in these datasets, the student model (LLaMA3-8B) generates self-generated errors, and the teacher model (GPT-4o) deliberately introduces errors based on the error type distribution of the student model. Then, both "Fix & Continue" and "Fresh & Restart" correction strategies are applied to these errors to create error-corrective revision trajectories. After filtering out trajectories with incorrect final answers, we obtain this dataset. Fine-tuning on this dataset achieves up to 13.3% average accuracy improvement for LLaMA3-8B with less than 90k synthesized data. For more details, please refer to our paper [LEMMA: Learning from Errors for MatheMatical Advancement in LLMs](https://arxiv.org/abs/2503.17439).
|
| 9 |
|
|
@@ -11,9 +12,9 @@ The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.c
|
|
| 11 |
|
| 12 |
### Model Description
|
| 13 |
|
| 14 |
-
- **Finetuned from model
|
| 15 |
|
| 16 |
-
### Model Sources
|
| 17 |
|
| 18 |
- **Repository:** [https://github.com/pzs19/LEMMA/](https://github.com/pzs19/LEMMA/)
|
| 19 |
- **Paper:** [https://arxiv.org/abs/2503.17439](https://arxiv.org/abs/2503.17439)
|
|
@@ -34,10 +35,10 @@ The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.c
|
|
| 34 |
|
| 35 |
| Model | Checkpoint | Paper | GSM8k | MATH | License |
|
| 36 |
| ----- |------| ---- |------|-------| ----- |
|
| 37 |
-
| LEMMA-LLAMA-3-8B | π€ <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-8B" target="_blank">HF Link</a> | π <a href="" target="_blank">[LEMMA]</a>| **79.2** | **38.3** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
|
| 38 |
-
| LEMMA-LLAMA-3-70B | π€ <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-70B" target="_blank">HF Link</a> | π <a href="" target="_blank">[LEMMA]</a>| **91.5** | **51.8** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
|
| 39 |
|
| 40 |
-
## Citation
|
| 41 |
|
| 42 |
Please cite the paper if you refer to our model, code, data or paper from MetaMath.
|
| 43 |
|
|
@@ -48,4 +49,4 @@ Please cite the paper if you refer to our model, code, data or paper from MetaMa
|
|
| 48 |
journal={arXiv preprint arXiv:2503.17439},
|
| 49 |
year={2025}
|
| 50 |
}
|
| 51 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
license: llama3
|
| 3 |
+
library_name: transformers
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
---
|
|
|
|
| 6 |
|
| 7 |
+
# Model Card for LEMMA-LLAMA-3-8B
|
| 8 |
|
| 9 |
The LEMMA series models are trained on the [LEMMA Dataset](https://huggingface.co/datasets/panzs19/LEMMA). This dataset uses the training set of MATH and GSM8K to generate error-corrective reasoning trajectories. For each question in these datasets, the student model (LLaMA3-8B) generates self-generated errors, and the teacher model (GPT-4o) deliberately introduces errors based on the error type distribution of the student model. Then, both "Fix & Continue" and "Fresh & Restart" correction strategies are applied to these errors to create error-corrective revision trajectories. After filtering out trajectories with incorrect final answers, we obtain this dataset. Fine-tuning on this dataset achieves up to 13.3% average accuracy improvement for LLaMA3-8B with less than 90k synthesized data. For more details, please refer to our paper [LEMMA: Learning from Errors for MatheMatical Advancement in LLMs](https://arxiv.org/abs/2503.17439).
|
| 10 |
|
|
|
|
| 12 |
|
| 13 |
### Model Description
|
| 14 |
|
| 15 |
+
- **Finetuned from model:** [Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)
|
| 16 |
|
| 17 |
+
### Model Sources
|
| 18 |
|
| 19 |
- **Repository:** [https://github.com/pzs19/LEMMA/](https://github.com/pzs19/LEMMA/)
|
| 20 |
- **Paper:** [https://arxiv.org/abs/2503.17439](https://arxiv.org/abs/2503.17439)
|
|
|
|
| 35 |
|
| 36 |
| Model | Checkpoint | Paper | GSM8k | MATH | License |
|
| 37 |
| ----- |------| ---- |------|-------| ----- |
|
| 38 |
+
| LEMMA-LLAMA-3-8B | π€ <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-8B" target="_blank">HF Link</a> | π <a href="https://huggingface.co/papers/2503.17439" target="_blank">[LEMMA]</a>| **79.2** | **38.3** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
|
| 39 |
+
| LEMMA-LLAMA-3-70B | π€ <a href="https://huggingface.co/panzs19/LEMMA-LLAMA-3-70B" target="_blank">HF Link</a> | π <a href="https://huggingface.co/papers/2503.17439" target="_blank">[LEMMA]</a>| **91.5** | **51.8** | <a href="https://www.llama.com/llama3/license/" target="_blank">Llama 3 </a> |
|
| 40 |
|
| 41 |
+
## Citation
|
| 42 |
|
| 43 |
Please cite the paper if you refer to our model, code, data or paper from MetaMath.
|
| 44 |
|
|
|
|
| 49 |
journal={arXiv preprint arXiv:2503.17439},
|
| 50 |
year={2025}
|
| 51 |
}
|
| 52 |
+
```
|