bigscience
/

mt0-xxl

Text Generation

text2text-generation

Model card Files Files and versions

Muennighoff commited on Nov 4, 2022

Commit

b4b9b68

·

1 Parent(s): 0b4f30a

Update precision

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -874,7 +874,7 @@ print(tokenizer.decode(outputs[0]))
 - **Architecture:** Same as [mt5-xxl](https://huggingface.co/google/mt5-xxl), also refer to the `config.json` file
 - **Finetuning steps:** 7000
 - **Finetuning tokens:** 1.29 billion
-- **Precision:** float32 with bfloat16 activations
 ## Hardware

 - **Architecture:** Same as [mt5-xxl](https://huggingface.co/google/mt5-xxl), also refer to the `config.json` file
 - **Finetuning steps:** 7000
 - **Finetuning tokens:** 1.29 billion
+- **Precision:** bfloat16
 ## Hardware