NbAiLab
/

roberta_des_128

Model card Files Files and versions

Metrics Training metrics Community

pere commited on Dec 22, 2021

Commit

329be54

·

1 Parent(s): 3e15ced

ready to train

Files changed (1) hide show

run_step1.sh +1 -0

run_step1.sh CHANGED Viewed

@@ -15,6 +15,7 @@
     --num_train_epochs="1000" \
     --adam_beta1="0.9" \
     --adam_beta2="0.98" \
     --logging_steps="10000" \
     --save_steps="10000" \
     --eval_steps="10000" \

     --num_train_epochs="1000" \
     --adam_beta1="0.9" \
     --adam_beta2="0.98" \
+    --adam_epsilon="1e-6" \
     --logging_steps="10000" \
     --save_steps="10000" \
     --eval_steps="10000" \