Commit
·
78a8ec4
1
Parent(s):
0ed61f2
Update README.md
Browse files
README.md
CHANGED
|
@@ -846,7 +846,7 @@ print(tokenizer.decode(outputs[0]))
|
|
| 846 |
|
| 847 |
- **Architecture:** Same as [bloom-1b1](https://huggingface.co/bigscience/bloom-1b1), also refer to the `config.json` file
|
| 848 |
- **Finetuning steps:** 250
|
| 849 |
-
- **Finetuning tokens:**
|
| 850 |
- **Finetuning layout:** 1x pipeline parallel, 1x tensor parallel, 1x data parallel
|
| 851 |
- **Precision:** float16
|
| 852 |
|
|
|
|
| 846 |
|
| 847 |
- **Architecture:** Same as [bloom-1b1](https://huggingface.co/bigscience/bloom-1b1), also refer to the `config.json` file
|
| 848 |
- **Finetuning steps:** 250
|
| 849 |
+
- **Finetuning tokens:** 502 million
|
| 850 |
- **Finetuning layout:** 1x pipeline parallel, 1x tensor parallel, 1x data parallel
|
| 851 |
- **Precision:** float16
|
| 852 |
|