File size: 684 Bytes
baf3373 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
========================================================================
MODEL: transformer
Best Optuna F1 (objective): 0.7527
Best Optuna AUC (val, recorded): 0.8027
Best Optuna threshold (val): 0.2453
Refit best AUC (val): 0.8212
Refit best F1@thr (val): 0.7499 at thr=0.4435
Best params:
{
"lr": 9.56421946708449e-05,
"weight_decay": 2.1595489653952028e-05,
"dropout": 0.4605897064748657,
"batch_size": 16,
"d_model": 256,
"nhead": 8,
"layers": 2,
"ff": 512
}
Saved model: /vast/projects/pranam/lab/yz927/projects/Classifier_Weight/training_classifiers/solubility/transformer_wt/best_model.pt
======================================================================== |