Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ LoRA-Flow provides an efficient way to fuse different LoRA modules which can out
|
|
| 23 |

|
| 24 |
# Training Details
|
| 25 |
## LoRA modules Training
|
| 26 |
-
For language LoRA modules: we use the
|
| 27 |
|
| 28 |
For math LoRA module: the training data for English math LoRA is constructed by [Metamath](https://arxiv.org/abs/2309.12284), which is comprised of 395K mathematical problems in English.
|
| 29 |
|
|
|
|
| 23 |

|
| 24 |
# Training Details
|
| 25 |
## LoRA modules Training
|
| 26 |
+
For language LoRA modules: we use the 52K training samples respectively which from [Okapi](https://aclanthology.org/2023.emnlp-demo.28).
|
| 27 |
|
| 28 |
For math LoRA module: the training data for English math LoRA is constructed by [Metamath](https://arxiv.org/abs/2309.12284), which is comprised of 395K mathematical problems in English.
|
| 29 |
|