Merge branch 'main' of https://huggingface.co/onlplab/alephbert-base into main

README.md

@@ -45,8 +45,8 @@ To optimize training time we split the data into 4 sections based on max number
 3. 64 <= num tokens < 128 (10M sentences)
 4. 128 <= num tokens < 512 (70M sentences)
 
-Each section was trained for 5 epochs with an initial learning rate set to 1e-4.
+Each section was first trained for 5 epochs with an initial learning rate set to 1e-4. Then each section was trained for another 5 epochs with an initial learning rate set to 1e-5, for a total of 10 epochs.
 
-Total training time was 5 days.
+Total training time was 8 days.