phobert-vntc-chunk1 / hyperparameters.json
cochi1706's picture
Training in progress, step 500
669a56a verified
{
"num_train_epochs": 3,
"per_device_train_batch_size": 16,
"per_device_eval_batch_size": 16,
"learning_rate": 2e-05,
"optimizer": "AdamW",
"save_total_limit": 1
}