bigscience
/

mt0-large

Text Generation

text2text-generation

Model card Files Files and versions

Muennighoff commited on Nov 4, 2022

Commit

0820e41

·

1 Parent(s): 0d28c72

Update steps

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -872,8 +872,8 @@ print(tokenizer.decode(outputs[0]))
 ## Model
 - **Architecture:** Same as [mt5-large](https://huggingface.co/google/mt5-large), also refer to the `config.json` file
-- **Finetuning steps:** 7000
-- **Finetuning tokens:** 1.29 billion
 - **Precision:** bfloat16
 ## Hardware

 ## Model
 - **Architecture:** Same as [mt5-large](https://huggingface.co/google/mt5-large), also refer to the `config.json` file
+- **Finetuning steps:** 25000
+- **Finetuning tokens:** 4.62 billion
 - **Precision:** bfloat16
 ## Hardware