Update README.md

README.md

@@ -9,6 +9,8 @@ datasets:
 
 # arabic-t5-small
 
+This is a T5v1.1 (small) trained on the concatenation of the Arabic Billion Words corpus and the Arabic subsets of the mC4 and Oscar datasets. The model could only be trained for about `10%` of the whole dataset due to time limitations.
+
 ## Training parameters
 
 |                       |               |