| ======================================================================== |
| MODEL: transformer |
| Best Optuna F1 (objective): 0.5440 |
| Best Optuna AUC (val, recorded): 0.7656 |
| Best Optuna threshold (val): 0.3524 |
| Refit best AUC (val): 0.7395 |
| Refit best F1@thr (val): 0.4966 at thr=0.5785 |
| Best params: |
| { |
| "lr": 5.663386706870656e-05, |
| "weight_decay": 3.322742555492305e-06, |
| "dropout": 0.2870938944037751, |
| "batch_size": 32, |
| "d_model": 384, |
| "nhead": 8, |
| "layers": 2, |
| "ff": 1024 |
| } |
| Saved model: /vast/projects/pranam/lab/yz927/projects/Classifier_Weight/training_classifiers/hemolysis/transformer_smiles/best_model.pt |
| ======================================================================== |
