File size: 676 Bytes
baf3373 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
========================================================================
MODEL: transformer
Best Optuna F1 (objective): 0.7368
Best Optuna AUC (val, recorded): 0.9325
Best Optuna threshold (val): 0.7139
Refit best AUC (val): 0.9376
Refit best F1@thr (val): 0.7340 at thr=0.7404
Best params:
{
"lr": 0.00015974003034251234,
"weight_decay": 5.37876200009511e-05,
"dropout": 0.0423574526357462,
"batch_size": 32,
"d_model": 384,
"nhead": 8,
"layers": 2,
"ff": 512
}
Saved model: /vast/projects/pranam/lab/yz927/projects/Classifier_Weight/training_classifiers/nf/transformer_wt/best_model.pt
======================================================================== |