Matthijs0
/

DistilBERT

Question Answering

Model card Files Files and versions

Matthijs0 commited on Apr 8, 2024

Commit

d498599

·

verified ·

1 Parent(s): bcf16d7

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -13,7 +13,8 @@ batch_size = 16
 n_epochs = 3
 max_seq_len = 512
 learning_rate = 2e-5
-optimizer=Adam
 weight_decay=0.01
 embeds_dropout_prob = 0.1
 ```

 n_epochs = 3
 max_seq_len = 512
 learning_rate = 2e-5
+optimizer=AdamW
+lr_schedule = LinearWarmup
 weight_decay=0.01
 embeds_dropout_prob = 0.1
 ```