ClipFa_finetune_testsize1 / hyperparams.json
Setayeshk's picture
2lastlayer_wd0.005_wr0.1_lr1e-5_bs32_ep10
5401d13
{
"learning_rate": 1e-05,
"batch_size": 32,
"num_train_epochs": 10,
"warmup_ratio": 0.1,
"weight_decay": 0.005,
"tokenizer_maxlen": 64
}