SzegedAI
/

hubertusz-tiny-wiki-seq128

generated_from_keras_callback

Model card Files Files and versions

ficsort commited on Sep 27, 2022

Commit

de6e4a4

·

1 Parent(s): 334bcc0

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -15,9 +15,9 @@ model-index:
 This model was trained from scratch on the Wikipedia subset of Hungarian Webcorpus 2.0 with MLM and SOP tasks.
-### Parameters:
-- Pre-training steps: 500.000
 - Sequence length: 128 (the model is capable for 512)
 - Batch size: 1024

 This model was trained from scratch on the Wikipedia subset of Hungarian Webcorpus 2.0 with MLM and SOP tasks.
+### Pre-Training Parameters:
+- Training steps: 500.000
 - Sequence length: 128 (the model is capable for 512)
 - Batch size: 1024