diff --git "a/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_smote.log" "b/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_smote.log" --- "a/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_smote.log" +++ "b/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_smote.log" @@ -6296,3 +6296,1672 @@ Trial 76 완료 Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 17:40:24,580] Trial 77 finished with value: 0.5575035380233367 and parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3786917685194243, 'ffn_dropout': 0.2521502050234237, 'lr': 0.00014587545184136568, 'weight_decay': 0.0008125924274305289, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 77 완료 + Value (CSI): 0.557504 + Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3786917685194243, 'ffn_dropout': 0.2521502050234237, 'lr': 0.00014587545184136568, 'weight_decay': 0.0008125924274305289, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 17:41:31,078] Trial 78 pruned. + +================================================================================ +Trial 78 완료 + Value (CSI): 0.538251 + Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3620517059987306, 'ffn_dropout': 0.28223413499562866, 'lr': 0.0004113629336124001, 'weight_decay': 0.000234633059784876, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 17:44:11,296] Trial 79 pruned. + +================================================================================ +Trial 79 완료 + Value (CSI): 0.530312 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3362812592350845, 'ffn_dropout': 0.1878533770819069, 'lr': 0.00020744348198387848, 'weight_decay': 0.0003537807645318261, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 17:44:42,273] Trial 80 pruned. + +================================================================================ +Trial 80 완료 + Value (CSI): 0.530955 + Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3240097676470653, 'ffn_dropout': 0.23884319722804678, 'lr': 0.00033725322895608974, 'weight_decay': 0.0005077914369808697, 'batch_size': 64} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 17:54:19,562] Trial 81 finished with value: 0.5619965753706834 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.35697243757182073, 'ffn_dropout': 0.22095096121680724, 'lr': 0.0002307971326262494, 'weight_decay': 0.00028207228908645125, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 81 완료 + Value (CSI): 0.561997 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.35697243757182073, 'ffn_dropout': 0.22095096121680724, 'lr': 0.0002307971326262494, 'weight_decay': 0.00028207228908645125, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 17:55:32,695] Trial 82 pruned. + +================================================================================ +Trial 82 완료 + Value (CSI): 0.540107 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.34836943438501483, 'ffn_dropout': 0.2045635899913562, 'lr': 0.000280099764641132, 'weight_decay': 0.00020604597149227657, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 17:56:46,245] Trial 83 pruned. + +================================================================================ +Trial 83 완료 + Value (CSI): 0.536145 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.365400281041358, 'ffn_dropout': 0.22602945234155472, 'lr': 0.0001689391329359149, 'weight_decay': 0.0003378377079914079, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:05:11,437] Trial 84 finished with value: 0.5613987516497861 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.34205660394318593, 'ffn_dropout': 0.21869071039588409, 'lr': 0.0005283731813540785, 'weight_decay': 0.00045957798950018217, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 84 완료 + Value (CSI): 0.561399 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.34205660394318593, 'ffn_dropout': 0.21869071039588409, 'lr': 0.0005283731813540785, 'weight_decay': 0.00045957798950018217, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:06:37,020] Trial 85 pruned. + +================================================================================ +Trial 85 완료 + Value (CSI): 0.539978 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.37285392806271395, 'ffn_dropout': 0.22868398128387246, 'lr': 0.0002685402535155513, 'weight_decay': 0.00026630715233407534, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 ��: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:15:28,649] Trial 86 finished with value: 0.5646619766490142 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.33168195072092793, 'ffn_dropout': 0.24205233579297242, 'lr': 0.0003313737620774728, 'weight_decay': 0.00036269017078117407, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 86 완료 + Value (CSI): 0.564662 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.33168195072092793, 'ffn_dropout': 0.24205233579297242, 'lr': 0.0003313737620774728, 'weight_decay': 0.00036269017078117407, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:15:37,988] Trial 87 pruned. + +================================================================================ +Trial 87 완료 + Value (CSI): 0.453095 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.33157240620352796, 'ffn_dropout': 0.2423061334990648, 'lr': 0.0004422495324936617, 'weight_decay': 0.0006494477592519485, 'batch_size': 256} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:15:51,975] Trial 88 pruned. + +================================================================================ +Trial 88 완료 + Value (CSI): 0.512658 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.323261254375982, 'ffn_dropout': 0.26769016403497853, 'lr': 0.00033204447974512354, 'weight_decay': 0.0005672360091194626, 'batch_size': 128} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:16:50,735] Trial 89 pruned. + +================================================================================ +Trial 89 완료 + Value (CSI): 0.523703 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.31760090403969976, 'ffn_dropout': 0.25668645068052154, 'lr': 0.000641453296369461, 'weight_decay': 0.0003789597611529661, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:17:40,608] Trial 90 pruned. + +================================================================================ +Trial 90 완료 + Value (CSI): 0.527660 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.3391995717623639, 'ffn_dropout': 0.25034177368355454, 'lr': 0.00022315865570545474, 'weight_decay': 0.0007452806759972192, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:24:36,749] Trial 91 pruned. + +================================================================================ +Trial 91 완료 + Value (CSI): 0.514877 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3522270455310675, 'ffn_dropout': 0.23592958394974028, 'lr': 0.0003142048850216142, 'weight_decay': 0.000457025097744545, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:31:29,596] Trial 92 finished with value: 0.5625301022558141 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3316778846124803, 'ffn_dropout': 0.2167509831934703, 'lr': 0.00025252017880273515, 'weight_decay': 0.00029690462852767106, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 92 완료 + Value (CSI): 0.562530 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3316778846124803, 'ffn_dropout': 0.2167509831934703, 'lr': 0.00025252017880273515, 'weight_decay': 0.00029690462852767106, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:39:15,155] Trial 93 pruned. + +================================================================================ +Trial 93 완료 + Value (CSI): 0.515712 + Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.35700542273779784, 'ffn_dropout': 0.2285144608615685, 'lr': 0.00041009333545977237, 'weight_decay': 0.00023785043517588253, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) +[I 2025-12-25 18:43:36,536] Trial 94 pruned. + +================================================================================ +Trial 94 완료 + Value (CSI): 0.555556 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3459338394968773, 'ffn_dropout': 0.1968426831799045, 'lr': 0.00016825231175600458, 'weight_decay': 0.00033881607417409653, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:50:41,970] Trial 95 finished with value: 0.567399549943466 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3049224290468632, 'ffn_dropout': 0.262458911386045, 'lr': 0.0004705378123090436, 'weight_decay': 0.0002011568536459783, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 95 완료 + Value (CSI): 0.567400 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3049224290468632, 'ffn_dropout': 0.262458911386045, 'lr': 0.0004705378123090436, 'weight_decay': 0.0002011568536459783, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) + Fold 2 - 클래스별 가중치: {0: 1.3172, 1: 1.3172, 2: 0.6749333879893421} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14637}) + Fold 3 - 클래스별 가중치: {0: 1.3153333333333332, 1: 1.3153333333333332, 2: 0.6759164097293594} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14595}) +[I 2025-12-25 18:56:43,950] Trial 96 finished with value: 0.561816564837237 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.30896276854711474, 'ffn_dropout': 0.2630071033281542, 'lr': 0.00048624747270327744, 'weight_decay': 0.00020972461119679467, 'batch_size': 32}. Best is trial 30 with value: 0.5674050423289939. + +================================================================================ +Trial 96 완료 + Value (CSI): 0.561817 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.30896276854711474, 'ffn_dropout': 0.2630071033281542, 'lr': 0.00048624747270327744, 'weight_decay': 0.00020972461119679467, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:57:40,140] Trial 97 pruned. + +================================================================================ +Trial 97 완료 + Value (CSI): 0.537549 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.29492872114426294, 'ffn_dropout': 0.14031063910948866, 'lr': 0.0005902338352850365, 'weight_decay': 0.0004111862436463382, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:58:34,222] Trial 98 pruned. + +================================================================================ +Trial 98 완료 + Value (CSI): 0.536913 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.28072763298617825, 'ffn_dropout': 0.3336802876880405, 'lr': 0.00076676123816529, 'weight_decay': 0.00016953305738751375, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.313511111111111, 1: 1.313511111111111, 2: 0.6768814987861298} (클래스별 샘플 수: {0: 7500, 1: 7500, 2: 14554}) +[I 2025-12-25 18:59:31,145] Trial 99 pruned. + +================================================================================ +Trial 99 완료 + Value (CSI): 0.546421 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3236561361103351, 'ffn_dropout': 0.3031467734958405, 'lr': 0.00039230307339006967, 'weight_decay': 0.0005623894036993773, 'batch_size': 32} + Best Value (CSI): 0.567405 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} +================================================================================ + + +최적화 완료. +Best CSI Score: 0.5674 +Best Hyperparameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3637871224837107, 'ffn_dropout': 0.11479322703553738, 'lr': 0.0003009840584939789, 'weight_decay': 0.0003336039035587163, 'batch_size': 32} + +최적화 과정 요약: + - 총 시도 횟수: 100 + - 성공한 시도: 100 + - 최초 CSI: 0.5290 + - 최종 CSI: 0.5464 + - 최고 CSI: 0.5674 + - 최저 CSI: 0.0000 + - 평균 CSI: 0.5042 + +최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_smote_incheon_trials.pkl에 저장되었습니다. + +================================================== +최적화된 하이퍼파라미터로 최종 모델 학습 시작 +================================================== +최종 모델 학습 시작... +Fold 1 학습 중... + Early stopping at epoch 25, Best CSI: 0.5545 + Fold 1 학습 완료 (검증 CSI: 0.5545) +Fold 2 학습 중... + Early stopping at epoch 22, Best CSI: 0.6011 + Fold 2 학습 완료 (검증 CSI: 0.6011) +Fold 3 학습 중... + Early stopping at epoch 20, Best CSI: 0.5260 + Fold 3 학습 완료 (검증 CSI: 0.5260) + +모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_smote_incheon.pkl (총 3개 fold) +Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_smote_incheon_scaler.pkl (총 3개 fold) + +최종 모델 학습 및 저장 완료! +저장된 모델 경로: ../save_model/ft_transformer_optima/ft_transformer_smote_incheon.pkl + +✓ 완료: ft_transformer_smote/ft_transformer_smote_incheon.py (소요 시간: 25906초) + +---------------------------------------- +실행 중: ft_transformer_smote/ft_transformer_smote_seoul.py +시작 시간: 2025-12-25 19:04:39 +---------------------------------------- +[I 2025-12-25 19:04:40,322] A new study created in memory with name: no-name-7b6c1c0c-7f07-4abd-8acf-3eaf3c02983f + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:07:47,794] Trial 0 finished with value: 0.4938262435375931 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.17877587888051422, 'ffn_dropout': 0.25816851791180656, 'lr': 0.00013524525410014886, 'weight_decay': 0.000247082500026181, 'batch_size': 128}. Best is trial 0 with value: 0.4938262435375931. + +================================================================================ +Trial 0 완료 + Value (CSI): 0.493826 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.17877587888051422, 'ffn_dropout': 0.25816851791180656, 'lr': 0.00013524525410014886, 'weight_decay': 0.000247082500026181, 'batch_size': 128} + Best Value (CSI): 0.493826 + Best Trial: 0 + Best Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.17877587888051422, 'ffn_dropout': 0.25816851791180656, 'lr': 0.00013524525410014886, 'weight_decay': 0.000247082500026181, 'batch_size': 128} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:13:48,805] Trial 1 finished with value: 0.5334517409672329 and parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.38636882799915206, 'ffn_dropout': 0.18085902479509552, 'lr': 9.024334489666502e-05, 'weight_decay': 0.000652210057637454, 'batch_size': 64}. Best is trial 1 with value: 0.5334517409672329. + +================================================================================ +Trial 1 완료 + Value (CSI): 0.533452 + Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.38636882799915206, 'ffn_dropout': 0.18085902479509552, 'lr': 9.024334489666502e-05, 'weight_decay': 0.000652210057637454, 'batch_size': 64} + Best Value (CSI): 0.533452 + Best Trial: 1 + Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.38636882799915206, 'ffn_dropout': 0.18085902479509552, 'lr': 9.024334489666502e-05, 'weight_decay': 0.000652210057637454, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:17:03,923] Trial 2 finished with value: 0.5458125039748464 and parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1587538990323335, 'ffn_dropout': 0.2904165146005051, 'lr': 0.00018365747922966267, 'weight_decay': 0.08900255730292767, 'batch_size': 64}. Best is trial 2 with value: 0.5458125039748464. + +================================================================================ +Trial 2 완료 + Value (CSI): 0.545813 + Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1587538990323335, 'ffn_dropout': 0.2904165146005051, 'lr': 0.00018365747922966267, 'weight_decay': 0.08900255730292767, 'batch_size': 64} + Best Value (CSI): 0.545813 + Best Trial: 2 + Best Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1587538990323335, 'ffn_dropout': 0.2904165146005051, 'lr': 0.00018365747922966267, 'weight_decay': 0.08900255730292767, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:25:04,291] Trial 3 finished with value: 0.5466284706855625 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32}. Best is trial 3 with value: 0.5466284706855625. + +================================================================================ +Trial 3 완료 + Value (CSI): 0.546628 + Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32} + Best Value (CSI): 0.546628 + Best Trial: 3 + Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:28:21,226] Trial 4 finished with value: 0.4870939358844726 and parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15939959485476937, 'ffn_dropout': 0.203050088780319, 'lr': 7.605432624495413e-05, 'weight_decay': 0.02114229127092804, 'batch_size': 128}. Best is trial 3 with value: 0.5466284706855625. + +================================================================================ +Trial 4 완료 + Value (CSI): 0.487094 + Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15939959485476937, 'ffn_dropout': 0.203050088780319, 'lr': 7.605432624495413e-05, 'weight_decay': 0.02114229127092804, 'batch_size': 128} + Best Value (CSI): 0.546628 + Best Trial: 3 + Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:29:00,669] Trial 5 pruned. + +================================================================================ +Trial 5 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.262498055493321, 'ffn_dropout': 0.1268891467327522, 'lr': 0.001222995804781187, 'weight_decay': 0.004985200375250647, 'batch_size': 64} + Best Value (CSI): 0.546628 + Best Trial: 3 + Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:29:17,201] Trial 6 pruned. + +================================================================================ +Trial 6 완료 + Value (CSI): 0.309722 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.31360651123852146, 'ffn_dropout': 0.1406902470759515, 'lr': 2.031552446004212e-05, 'weight_decay': 0.0011992935202302245, 'batch_size': 128} + Best Value (CSI): 0.546628 + Best Trial: 3 + Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:29:45,485] Trial 7 pruned. + +================================================================================ +Trial 7 완료 + Value (CSI): 0.032541 + Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.23404914807934393, 'ffn_dropout': 0.13211437991876396, 'lr': 0.0015971818363471882, 'weight_decay': 0.06034816396335996, 'batch_size': 128} + Best Value (CSI): 0.546628 + Best Trial: 3 + Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2535804581397322, 'ffn_dropout': 0.38751684839588385, 'lr': 0.00042041686603716034, 'weight_decay': 0.001336629427296846, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:38:13,012] Trial 8 finished with value: 0.5520605008418618 and parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.29828015124936436, 'ffn_dropout': 0.1615812663662866, 'lr': 0.00016062851372004058, 'weight_decay': 0.004155620940999291, 'batch_size': 32}. Best is trial 8 with value: 0.5520605008418618. + +================================================================================ +Trial 8 완료 + Value (CSI): 0.552061 + Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.29828015124936436, 'ffn_dropout': 0.1615812663662866, 'lr': 0.00016062851372004058, 'weight_decay': 0.004155620940999291, 'batch_size': 32} + Best Value (CSI): 0.552061 + Best Trial: 8 + Best Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.29828015124936436, 'ffn_dropout': 0.1615812663662866, 'lr': 0.00016062851372004058, 'weight_decay': 0.004155620940999291, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:38:26,693] Trial 9 pruned. + +================================================================================ +Trial 9 완료 + Value (CSI): 0.391198 + Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22765643731941584, 'ffn_dropout': 0.3690250354489788, 'lr': 0.00033555491864971154, 'weight_decay': 0.06628616563114029, 'batch_size': 128} + Best Value (CSI): 0.552061 + Best Trial: 8 + Best Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.29828015124936436, 'ffn_dropout': 0.1615812663662866, 'lr': 0.00016062851372004058, 'weight_decay': 0.004155620940999291, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:39:55,053] Trial 10 pruned. + +================================================================================ +Trial 10 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.12024134460854768, 'ffn_dropout': 0.10266841542391442, 'lr': 0.006982061895271842, 'weight_decay': 0.004822198063230748, 'batch_size': 32} + Best Value (CSI): 0.552061 + Best Trial: 8 + Best Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.29828015124936436, 'ffn_dropout': 0.1615812663662866, 'lr': 0.00016062851372004058, 'weight_decay': 0.004155620940999291, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 19:47:10,509] Trial 11 finished with value: 0.5578292783958204 and parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32}. Best is trial 11 with value: 0.5578292783958204. + +================================================================================ +Trial 11 완료 + Value (CSI): 0.557829 + Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:50:22,509] Trial 12 pruned. + +================================================================================ +Trial 12 완료 + Value (CSI): 0.425654 + Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.31116992471832144, 'ffn_dropout': 0.31739936341585406, 'lr': 3.1044287702737566e-05, 'weight_decay': 0.007721485317587983, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:50:54,888] Trial 13 pruned. + +================================================================================ +Trial 13 완료 + Value (CSI): 0.410714 + Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3178344933477064, 'ffn_dropout': 0.20990090127857483, 'lr': 0.0006153736612946382, 'weight_decay': 0.002137043115536503, 'batch_size': 256} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:52:15,517] Trial 14 pruned. + +================================================================================ +Trial 14 완료 + Value (CSI): 0.383484 + Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.37407718474989915, 'ffn_dropout': 0.32749870977431106, 'lr': 1.1396160360865782e-05, 'weight_decay': 0.012312475883367872, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:53:45,577] Trial 15 pruned. + +================================================================================ +Trial 15 완료 + Value (CSI): 0.404919 + Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.28950542083211667, 'ffn_dropout': 0.2383486643665559, 'lr': 4.644565767203515e-05, 'weight_decay': 0.0034145033007323463, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:54:06,748] Trial 16 pruned. + +================================================================================ +Trial 16 완료 + Value (CSI): 0.400738 + Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3604632485086947, 'ffn_dropout': 0.39723730302900606, 'lr': 0.00018422805038315588, 'weight_decay': 0.00011345073719032854, 'batch_size': 256} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 19:55:33,341] Trial 17 pruned. + +================================================================================ +Trial 17 완료 + Value (CSI): 0.000368 + Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.341304612288705, 'ffn_dropout': 0.35709624930828915, 'lr': 0.000833954206267635, 'weight_decay': 0.0006363398003855473, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:00:39,536] Trial 18 finished with value: 0.5559576299465977 and parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.28535402731157145, 'ffn_dropout': 0.27419232643813984, 'lr': 0.00028408291083977357, 'weight_decay': 0.0028877204175900384, 'batch_size': 32}. Best is trial 11 with value: 0.5578292783958204. + +================================================================================ +Trial 18 완료 + Value (CSI): 0.555958 + Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.28535402731157145, 'ffn_dropout': 0.27419232643813984, 'lr': 0.00028408291083977357, 'weight_decay': 0.0028877204175900384, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:01:17,538] Trial 19 pruned. + +================================================================================ +Trial 19 완료 + Value (CSI): 0.114776 + Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.34124673680762085, 'ffn_dropout': 0.28326270713550894, 'lr': 0.002492136015271463, 'weight_decay': 0.0017882738162503095, 'batch_size': 32} + Best Value (CSI): 0.557829 + Best Trial: 11 + Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2941938157012187, 'ffn_dropout': 0.36773295501771575, 'lr': 0.0005697089836996394, 'weight_decay': 0.0019057445511098665, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:05:51,496] Trial 20 finished with value: 0.5599809245798847 and parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39733800524948154, 'ffn_dropout': 0.3456021599313298, 'lr': 0.0005197977356768663, 'weight_decay': 0.012755783722561802, 'batch_size': 32}. Best is trial 20 with value: 0.5599809245798847. + +================================================================================ +Trial 20 완료 + Value (CSI): 0.559981 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39733800524948154, 'ffn_dropout': 0.3456021599313298, 'lr': 0.0005197977356768663, 'weight_decay': 0.012755783722561802, 'batch_size': 32} + Best Value (CSI): 0.559981 + Best Trial: 20 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39733800524948154, 'ffn_dropout': 0.3456021599313298, 'lr': 0.0005197977356768663, 'weight_decay': 0.012755783722561802, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:09:42,340] Trial 21 finished with value: 0.5469949923023917 and parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3779328300507695, 'ffn_dropout': 0.34379482204582573, 'lr': 0.00041523837539485757, 'weight_decay': 0.014842552481655419, 'batch_size': 32}. Best is trial 20 with value: 0.5599809245798847. + +================================================================================ +Trial 21 완료 + Value (CSI): 0.546995 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3779328300507695, 'ffn_dropout': 0.34379482204582573, 'lr': 0.00041523837539485757, 'weight_decay': 0.014842552481655419, 'batch_size': 32} + Best Value (CSI): 0.559981 + Best Trial: 20 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39733800524948154, 'ffn_dropout': 0.3456021599313298, 'lr': 0.0005197977356768663, 'weight_decay': 0.012755783722561802, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:14:35,815] Trial 22 finished with value: 0.5633420079946059 and parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32}. Best is trial 22 with value: 0.5633420079946059. + +================================================================================ +Trial 22 완료 + Value (CSI): 0.563342 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:14:49,339] Trial 23 pruned. + +================================================================================ +Trial 23 완료 + Value (CSI): 0.386310 + Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3957397916283861, 'ffn_dropout': 0.31632777870510437, 'lr': 0.0006669706504333678, 'weight_decay': 0.03335292708832044, 'batch_size': 256} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:15:39,869] Trial 24 pruned. + +================================================================================ +Trial 24 완료 + Value (CSI): 0.410579 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.35714104155378446, 'ffn_dropout': 0.37079507967854647, 'lr': 0.0018517855077351795, 'weight_decay': 0.031637738635873484, 'batch_size': 32} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:25:15,503] Trial 25 finished with value: 0.5550903654901403 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.39942489442906143, 'ffn_dropout': 0.3404917526953313, 'lr': 0.0010769319867698513, 'weight_decay': 0.011690555123057335, 'batch_size': 32}. Best is trial 22 with value: 0.5633420079946059. + +================================================================================ +Trial 25 완료 + Value (CSI): 0.555090 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.39942489442906143, 'ffn_dropout': 0.3404917526953313, 'lr': 0.0010769319867698513, 'weight_decay': 0.011690555123057335, 'batch_size': 32} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:29:54,479] Trial 26 finished with value: 0.55939181263975 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3411040979072826, 'ffn_dropout': 0.311035543851922, 'lr': 0.0005896875676686477, 'weight_decay': 0.008178262611152964, 'batch_size': 32}. Best is trial 22 with value: 0.5633420079946059. + +================================================================================ +Trial 26 완료 + Value (CSI): 0.559392 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3411040979072826, 'ffn_dropout': 0.311035543851922, 'lr': 0.0005896875676686477, 'weight_decay': 0.008178262611152964, 'batch_size': 32} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:33:50,512] Trial 27 finished with value: 0.5504349933152191 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39883351702844466, 'ffn_dropout': 0.3003911590355156, 'lr': 0.00028910644866873944, 'weight_decay': 0.008674763492451389, 'batch_size': 32}. Best is trial 22 with value: 0.5633420079946059. + +================================================================================ +Trial 27 완료 + Value (CSI): 0.550435 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39883351702844466, 'ffn_dropout': 0.3003911590355156, 'lr': 0.00028910644866873944, 'weight_decay': 0.008674763492451389, 'batch_size': 32} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:36:21,390] Trial 28 finished with value: 0.5617702504367125 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3603219989247117, 'ffn_dropout': 0.3070740159727858, 'lr': 0.001147442549345772, 'weight_decay': 0.02153662133095635, 'batch_size': 64}. Best is trial 22 with value: 0.5633420079946059. + +================================================================================ +Trial 28 완료 + Value (CSI): 0.561770 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3603219989247117, 'ffn_dropout': 0.3070740159727858, 'lr': 0.001147442549345772, 'weight_decay': 0.02153662133095635, 'batch_size': 64} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:37:11,579] Trial 29 pruned. + +================================================================================ +Trial 29 완료 + Value (CSI): 0.404421 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3662330169848604, 'ffn_dropout': 0.25999209531996054, 'lr': 0.0029250720613883483, 'weight_decay': 0.02361092421963226, 'batch_size': 64} + Best Value (CSI): 0.563342 + Best Trial: 22 + Best Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39130884741380056, 'ffn_dropout': 0.31747304984650526, 'lr': 0.0006307339704492065, 'weight_decay': 0.029346384417081962, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:41:13,641] Trial 30 finished with value: 0.5739423798669575 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 30 완료 + Value (CSI): 0.573942 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:42:18,059] Trial 31 pruned. + +================================================================================ +Trial 31 완료 + Value (CSI): 0.436872 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3807953366579965, 'ffn_dropout': 0.3008574669872796, 'lr': 0.0010160619594718244, 'weight_decay': 0.04025909225038649, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:44:59,167] Trial 32 finished with value: 0.5618651622550636 and parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3795712151186757, 'ffn_dropout': 0.33217869025520586, 'lr': 0.0014229096680863002, 'weight_decay': 0.019542774890304003, 'batch_size': 64}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 32 완료 + Value (CSI): 0.561865 + Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3795712151186757, 'ffn_dropout': 0.33217869025520586, 'lr': 0.0014229096680863002, 'weight_decay': 0.019542774890304003, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:45:37,878] Trial 33 pruned. + +================================================================================ +Trial 33 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.35241173755029787, 'ffn_dropout': 0.3313686956858255, 'lr': 0.003361011632909906, 'weight_decay': 0.05373029045269388, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:50:03,065] Trial 34 finished with value: 0.5655181937406549 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3784401077937454, 'ffn_dropout': 0.28918021102980446, 'lr': 0.0017761212737014292, 'weight_decay': 0.022494434992569402, 'batch_size': 64}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 34 완료 + Value (CSI): 0.565518 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3784401077937454, 'ffn_dropout': 0.28918021102980446, 'lr': 0.0017761212737014292, 'weight_decay': 0.022494434992569402, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:50:53,597] Trial 35 pruned. + +================================================================================ +Trial 35 완료 + Value (CSI): 0.418049 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38035456691282044, 'ffn_dropout': 0.2834701479495254, 'lr': 0.0019484666245800318, 'weight_decay': 0.08536436271893352, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:51:26,112] Trial 36 pruned. + +================================================================================ +Trial 36 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.37379356704923183, 'ffn_dropout': 0.2663007491816, 'lr': 0.004631635199035477, 'weight_decay': 0.09939003399688277, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:52:17,610] Trial 37 pruned. + +================================================================================ +Trial 37 완료 + Value (CSI): 0.423899 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3358011605492438, 'ffn_dropout': 0.2963393646635246, 'lr': 0.0015371744859914594, 'weight_decay': 0.04212961482789545, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:53:47,335] Trial 38 pruned. + +================================================================================ +Trial 38 완료 + Value (CSI): 0.425016 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.382997367539803, 'ffn_dropout': 0.245232254370993, 'lr': 0.0008922586476283271, 'weight_decay': 0.026196118872176506, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:56:17,866] Trial 39 pruned. + +================================================================================ +Trial 39 완료 + Value (CSI): 0.564516 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3316417065930028, 'ffn_dropout': 0.2836670232286214, 'lr': 0.0014672149515341092, 'weight_decay': 0.01679567471713732, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:57:00,385] Trial 40 pruned. + +================================================================================ +Trial 40 완료 + Value (CSI): 0.439860 + Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.36357255020557244, 'ffn_dropout': 0.32883820088416715, 'lr': 0.002134183616985511, 'weight_decay': 0.04332567059798113, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 20:58:34,364] Trial 41 finished with value: 0.5491478271415667 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.35876914791226844, 'ffn_dropout': 0.30793630053418053, 'lr': 0.0013509663384419625, 'weight_decay': 0.02044411099592554, 'batch_size': 64}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 41 완료 + Value (CSI): 0.549148 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.35876914791226844, 'ffn_dropout': 0.30793630053418053, 'lr': 0.0013509663384419625, 'weight_decay': 0.02044411099592554, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:59:10,950] Trial 42 pruned. + +================================================================================ +Trial 42 완료 + Value (CSI): 0.408374 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3875825095683591, 'ffn_dropout': 0.294353465450384, 'lr': 0.0008751682569871705, 'weight_decay': 0.0247182553603873, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 20:59:51,194] Trial 43 pruned. + +================================================================================ +Trial 43 완료 + Value (CSI): 0.419002 + Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.35419582407430966, 'ffn_dropout': 0.31968769225963617, 'lr': 0.0013903669067727087, 'weight_decay': 0.017577671620451166, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:00:02,886] Trial 44 pruned. + +================================================================================ +Trial 44 완료 + Value (CSI): 0.419536 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3704721780843632, 'ffn_dropout': 0.30744347023590446, 'lr': 0.003082452093230661, 'weight_decay': 0.06486041198727516, 'batch_size': 128} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:00:49,905] Trial 45 pruned. + +================================================================================ +Trial 45 완료 + Value (CSI): 0.420447 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3834418233071221, 'ffn_dropout': 0.27733559881672915, 'lr': 0.001124694051144312, 'weight_decay': 0.03426761351175438, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:01:41,349] Trial 46 pruned. + +================================================================================ +Trial 46 완료 + Value (CSI): 0.430225 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3258115245749298, 'ffn_dropout': 0.2951572468132474, 'lr': 0.0019387029087251449, 'weight_decay': 0.05288197809421397, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:03:48,231] Trial 47 finished with value: 0.5410692749755706 and parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3504195800312222, 'ffn_dropout': 0.32527961828877716, 'lr': 0.000796585984433297, 'weight_decay': 0.025957611499380303, 'batch_size': 64}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 47 완료 + Value (CSI): 0.541069 + Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3504195800312222, 'ffn_dropout': 0.32527961828877716, 'lr': 0.000796585984433297, 'weight_decay': 0.025957611499380303, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:04:02,215] Trial 48 pruned. + +================================================================================ +Trial 48 완료 + Value (CSI): 0.231242 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.369074683718013, 'ffn_dropout': 0.26812377653928404, 'lr': 0.004275900330718431, 'weight_decay': 0.019566827768521807, 'batch_size': 128} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:04:13,681] Trial 49 pruned. + +================================================================================ +Trial 49 완료 + Value (CSI): 0.393647 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3885117876636148, 'ffn_dropout': 0.3352230174160327, 'lr': 0.0004294465780109999, 'weight_decay': 0.006388699820100441, 'batch_size': 256} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:05:25,813] Trial 50 pruned. + +================================================================================ +Trial 50 완료 + Value (CSI): 0.413793 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.31736360489497384, 'ffn_dropout': 0.35303618272460857, 'lr': 0.0007740167856545144, 'weight_decay': 0.010110776428871121, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:06:16,566] Trial 51 pruned. + +================================================================================ +Trial 51 완료 + Value (CSI): 0.446682 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.395950660694602, 'ffn_dropout': 0.3189649390773042, 'lr': 0.001177566240481648, 'weight_decay': 0.01324506264326737, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:07:04,192] Trial 52 pruned. + +================================================================================ +Trial 52 완료 + Value (CSI): 0.422251 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.38844284320069034, 'ffn_dropout': 0.34502670840653643, 'lr': 0.0005157095053941474, 'weight_decay': 0.016343983249055213, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:07:31,907] Trial 53 pruned. + +================================================================================ +Trial 53 완료 + Value (CSI): 0.391226 + Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39947863322369054, 'ffn_dropout': 0.35406762659448393, 'lr': 0.000718756721326717, 'weight_decay': 0.01162435729199829, 'batch_size': 128} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:07:42,919] Trial 54 pruned. + +================================================================================ +Trial 54 완료 + Value (CSI): 0.358849 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3695801375224326, 'ffn_dropout': 0.30998095451090996, 'lr': 0.0005063445099882185, 'weight_decay': 0.02918110238099175, 'batch_size': 256} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) +[I 2025-12-25 21:11:11,194] Trial 55 pruned. + +================================================================================ +Trial 55 완료 + Value (CSI): 0.599469 + Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3490298737939594, 'ffn_dropout': 0.33255119904366465, 'lr': 0.0010667989277785895, 'weight_decay': 0.01893896510278957, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:11:54,393] Trial 56 pruned. + +================================================================================ +Trial 56 완료 + Value (CSI): 0.413815 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.37557123205809045, 'ffn_dropout': 0.28672399896244044, 'lr': 0.0003634711928204699, 'weight_decay': 0.03777674258929632, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:13:02,618] Trial 57 pruned. + +================================================================================ +Trial 57 완료 + Value (CSI): 0.397428 + Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.3627313732525173, 'ffn_dropout': 0.36909467727156414, 'lr': 0.000640128266456393, 'weight_decay': 0.01490957664012032, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:17:18,616] Trial 58 finished with value: 0.5511796622846928 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38964197351487956, 'ffn_dropout': 0.3409667148688909, 'lr': 0.0016419398503787022, 'weight_decay': 0.023309905237820377, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 58 완료 + Value (CSI): 0.551180 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38964197351487956, 'ffn_dropout': 0.3409667148688909, 'lr': 0.0016419398503787022, 'weight_decay': 0.023309905237820377, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:17:53,538] Trial 59 pruned. + +================================================================================ +Trial 59 완료 + Value (CSI): 0.438783 + Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.35032840066018256, 'ffn_dropout': 0.31829784814184925, 'lr': 0.00023739997889007713, 'weight_decay': 0.010554268173336765, 'batch_size': 64} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:18:08,642] Trial 60 pruned. + +================================================================================ +Trial 60 완료 + Value (CSI): 0.389649 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.39999843716481176, 'ffn_dropout': 0.38295990649014866, 'lr': 0.002421069392654888, 'weight_decay': 0.052802037227199776, 'batch_size': 256} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:24:40,828] Trial 61 finished with value: 0.5602019085442339 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.37654335691627466, 'ffn_dropout': 0.3102323471459902, 'lr': 0.0005754783713231304, 'weight_decay': 0.006638880733046025, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 61 완료 + Value (CSI): 0.560202 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.37654335691627466, 'ffn_dropout': 0.3102323471459902, 'lr': 0.0005754783713231304, 'weight_decay': 0.006638880733046025, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 21:26:29,696] Trial 62 pruned. + +================================================================================ +Trial 62 완료 + Value (CSI): 0.434753 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3773865501948357, 'ffn_dropout': 0.3040078477870456, 'lr': 0.00046089664767572504, 'weight_decay': 0.006234310058972083, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:31:04,410] Trial 63 pruned. + +================================================================================ +Trial 63 완료 + Value (CSI): 0.559061 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.36422260626178843, 'ffn_dropout': 0.32455065181670145, 'lr': 0.0005968915440851955, 'weight_decay': 0.014024791992890034, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:34:48,410] Trial 64 finished with value: 0.5665880163727613 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3890792732898677, 'ffn_dropout': 0.29268256927689495, 'lr': 0.0007189259567489787, 'weight_decay': 0.03136458170589396, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 64 완료 + Value (CSI): 0.566588 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3890792732898677, 'ffn_dropout': 0.29268256927689495, 'lr': 0.0007189259567489787, 'weight_decay': 0.03136458170589396, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:38:51,737] Trial 65 finished with value: 0.5706486791923684 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.38737025053500174, 'ffn_dropout': 0.2885530256036787, 'lr': 0.0009615470402995749, 'weight_decay': 0.0298947595557374, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 65 완료 + Value (CSI): 0.570649 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.38737025053500174, 'ffn_dropout': 0.2885530256036787, 'lr': 0.0009615470402995749, 'weight_decay': 0.0298947595557374, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:42:55,975] Trial 66 finished with value: 0.5615172280155561 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3880516617886017, 'ffn_dropout': 0.29071859501263, 'lr': 0.0009684755365473027, 'weight_decay': 0.029378966445853867, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 66 완료 + Value (CSI): 0.561517 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3880516617886017, 'ffn_dropout': 0.29071859501263, 'lr': 0.0009684755365473027, 'weight_decay': 0.029378966445853867, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:46:58,418] Trial 67 finished with value: 0.5629685429875654 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.34425218202151553, 'ffn_dropout': 0.2769073742107657, 'lr': 0.0012387424376063703, 'weight_decay': 0.07546857055825353, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 67 완료 + Value (CSI): 0.562969 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.34425218202151553, 'ffn_dropout': 0.2769073742107657, 'lr': 0.0012387424376063703, 'weight_decay': 0.07546857055825353, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:51:06,738] Trial 68 finished with value: 0.5692813708774116 and parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3406548464622327, 'ffn_dropout': 0.25644132572381045, 'lr': 0.0016262866532545932, 'weight_decay': 0.07725577996196337, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 68 완료 + Value (CSI): 0.569281 + Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3406548464622327, 'ffn_dropout': 0.25644132572381045, 'lr': 0.0016262866532545932, 'weight_decay': 0.07725577996196337, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 21:58:59,748] Trial 69 finished with value: 0.5628392979329541 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.33767114719270636, 'ffn_dropout': 0.2563228033177759, 'lr': 0.0017363667797323876, 'weight_decay': 0.07371002706547067, 'batch_size': 32}. Best is trial 30 with value: 0.5739423798669575. + +================================================================================ +Trial 69 완료 + Value (CSI): 0.562839 + Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.33767114719270636, 'ffn_dropout': 0.2563228033177759, 'lr': 0.0017363667797323876, 'weight_decay': 0.07371002706547067, 'batch_size': 32} + Best Value (CSI): 0.573942 + Best Trial: 30 + Best Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.38148005983524574, 'ffn_dropout': 0.3010843219695151, 'lr': 0.0010835171323778457, 'weight_decay': 0.04092948451329147, 'batch_size': 64} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 22:09:00,517] Trial 70 finished with value: 0.5788930444782093 and parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 70 완료 + Value (CSI): 0.578893 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) +[I 2025-12-25 22:13:10,261] Trial 71 pruned. + +================================================================================ +Trial 71 완료 + Value (CSI): 0.595218 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.30008365770585377, 'ffn_dropout': 0.27491644995920816, 'lr': 0.000723688838853777, 'weight_decay': 0.08323835540876641, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 22:15:28,179] Trial 72 pruned. + +================================================================================ +Trial 72 완료 + Value (CSI): 0.410857 + Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.34253885679161217, 'ffn_dropout': 0.26632190993694255, 'lr': 0.0012053422335897349, 'weight_decay': 0.06931988179559491, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 22:23:14,343] Trial 73 finished with value: 0.5551125267882084 and parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.32248581721297853, 'ffn_dropout': 0.2785784584565224, 'lr': 0.0009249269917747778, 'weight_decay': 0.04427446957378213, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 73 완료 + Value (CSI): 0.555113 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.32248581721297853, 'ffn_dropout': 0.2785784584565224, 'lr': 0.0009249269917747778, 'weight_decay': 0.04427446957378213, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 22:32:24,659] Trial 74 finished with value: 0.5670259390135723 and parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.30996466621320123, 'ffn_dropout': 0.2517994263582584, 'lr': 0.0012537725979048621, 'weight_decay': 0.0996051466868357, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 74 완료 + Value (CSI): 0.567026 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.30996466621320123, 'ffn_dropout': 0.2517994263582584, 'lr': 0.0012537725979048621, 'weight_decay': 0.0996051466868357, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 22:39:12,999] Trial 75 finished with value: 0.5581589134457916 and parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.33100274641091665, 'ffn_dropout': 0.2370402114907833, 'lr': 0.0008142032158604621, 'weight_decay': 0.0917125256812803, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 75 완료 + Value (CSI): 0.558159 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.33100274641091665, 'ffn_dropout': 0.2370402114907833, 'lr': 0.0008142032158604621, 'weight_decay': 0.0917125256812803, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 22:40:18,580] Trial 76 pruned. + +================================================================================ +Trial 76 완료 + Value (CSI): 0.001480 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.31352276934889156, 'ffn_dropout': 0.29051072975461034, 'lr': 0.001650775700828699, 'weight_decay': 0.05764269884567653, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 22:41:23,567] Trial 77 pruned. + +================================================================================ +Trial 77 완료 + Value (CSI): 0.000000 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2824221278748904, 'ffn_dropout': 0.2545318467527504, 'lr': 0.0020954414274899497, 'weight_decay': 0.09733286345391665, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 22:43:11,854] Trial 78 pruned. + +================================================================================ +Trial 78 완료 + Value (CSI): 0.398859 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3602818586257841, 'ffn_dropout': 0.29864795802031036, 'lr': 0.0009562108701837911, 'weight_decay': 0.059737355894209414, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 22:44:32,567] Trial 79 pruned. + +================================================================================ +Trial 79 완료 + Value (CSI): 0.125343 + Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.30724566298703504, 'ffn_dropout': 0.2876518207185582, 'lr': 0.0006957193701722695, 'weight_decay': 0.03642485402655179, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 22:45:41,143] Trial 80 pruned. + +================================================================================ +Trial 80 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.37008560158513737, 'ffn_dropout': 0.26339907489289943, 'lr': 0.0013314078993539626, 'weight_decay': 0.045164283946253894, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 22:53:15,239] Trial 81 finished with value: 0.5651597176208346 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3480240975324377, 'ffn_dropout': 0.2715471757619841, 'lr': 0.001323723068581014, 'weight_decay': 0.0707799273774972, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 81 완료 + Value (CSI): 0.565160 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3480240975324377, 'ffn_dropout': 0.2715471757619841, 'lr': 0.001323723068581014, 'weight_decay': 0.0707799273774972, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 23:03:48,629] Trial 82 finished with value: 0.5628704264715482 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3573703706958984, 'ffn_dropout': 0.2504938218419798, 'lr': 0.001542618187645844, 'weight_decay': 0.07362777361146328, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 82 완료 + Value (CSI): 0.562870 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3573703706958984, 'ffn_dropout': 0.2504938218419798, 'lr': 0.001542618187645844, 'weight_decay': 0.07362777361146328, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 23:12:39,633] Trial 83 finished with value: 0.565812261770987 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3268795235299381, 'ffn_dropout': 0.2705959622998229, 'lr': 0.0010420768151247234, 'weight_decay': 0.04918193311558426, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 83 완료 + Value (CSI): 0.565812 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3268795235299381, 'ffn_dropout': 0.2705959622998229, 'lr': 0.0010420768151247234, 'weight_decay': 0.04918193311558426, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:14:01,430] Trial 84 pruned. + +================================================================================ +Trial 84 완료 + Value (CSI): 0.428181 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3271590122321988, 'ffn_dropout': 0.2705307329833598, 'lr': 0.0022634644955080965, 'weight_decay': 0.048764632133182925, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) +[I 2025-12-25 23:17:52,081] Trial 85 pruned. + +================================================================================ +Trial 85 완료 + Value (CSI): 0.583204 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.33014281590307154, 'ffn_dropout': 0.2599902383267461, 'lr': 0.0010102992357125479, 'weight_decay': 0.06143589759794122, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:19:33,360] Trial 86 pruned. + +================================================================================ +Trial 86 완료 + Value (CSI): 0.419783 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3221892430452531, 'ffn_dropout': 0.28202546254283495, 'lr': 0.0018791466531770835, 'weight_decay': 0.0796201590672731, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:20:08,918] Trial 87 pruned. + +================================================================================ +Trial 87 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.3355768427548912, 'ffn_dropout': 0.2739572592202757, 'lr': 0.0013587601011859163, 'weight_decay': 0.06292861151506204, 'batch_size': 128} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:21:09,545] Trial 88 pruned. + +================================================================================ +Trial 88 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3449721072590436, 'ffn_dropout': 0.24506762797136117, 'lr': 0.0026752949720094572, 'weight_decay': 0.03492776211596092, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 23:28:41,662] Trial 89 finished with value: 0.5565324832208595 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.35430658446143476, 'ffn_dropout': 0.26881177234303066, 'lr': 0.0008413636189470239, 'weight_decay': 0.05061578234544091, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 89 완료 + Value (CSI): 0.556532 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.35430658446143476, 'ffn_dropout': 0.26881177234303066, 'lr': 0.0008413636189470239, 'weight_decay': 0.05061578234544091, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 23:36:40,182] Trial 90 finished with value: 0.5614517821634438 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.38258481486342033, 'ffn_dropout': 0.2998804506065136, 'lr': 0.0010949431786518207, 'weight_decay': 0.09851811155962549, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 90 완료 + Value (CSI): 0.561452 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.38258481486342033, 'ffn_dropout': 0.2998804506065136, 'lr': 0.0010949431786518207, 'weight_decay': 0.09851811155962549, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) +[I 2025-12-25 23:40:02,762] Trial 91 pruned. + +================================================================================ +Trial 91 완료 + Value (CSI): 0.605410 + Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3932423152092808, 'ffn_dropout': 0.29301872108818416, 'lr': 0.0006998506199632206, 'weight_decay': 0.03970538329055356, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 23:47:21,754] Trial 92 finished with value: 0.5599567437283716 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.37251809274549397, 'ffn_dropout': 0.28150476079501385, 'lr': 0.0012287252121993462, 'weight_decay': 0.03022829917433228, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 92 완료 + Value (CSI): 0.559957 + Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.37251809274549397, 'ffn_dropout': 0.28150476079501385, 'lr': 0.0012287252121993462, 'weight_decay': 0.03022829917433228, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:48:24,023] Trial 93 pruned. + +================================================================================ +Trial 93 완료 + Value (CSI): 0.000683 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.38377935609886926, 'ffn_dropout': 0.2879655871230607, 'lr': 0.0016194408896374286, 'weight_decay': 0.048061556827654915, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:48:34,937] Trial 94 pruned. + +================================================================================ +Trial 94 완료 + Value (CSI): 0.395203 + Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.39240721936065365, 'ffn_dropout': 0.2632843898405157, 'lr': 0.0007847351498047383, 'weight_decay': 0.06391170731527436, 'batch_size': 256} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:49:21,095] Trial 95 pruned. + +================================================================================ +Trial 95 완료 + Value (CSI): 0.062007 + Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3674599917982618, 'ffn_dropout': 0.30333793777215273, 'lr': 0.0010032512033497254, 'weight_decay': 0.08173363107303909, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) +[I 2025-12-25 23:53:17,024] Trial 96 pruned. + +================================================================================ +Trial 96 완료 + Value (CSI): 0.601802 + Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3806036905422855, 'ffn_dropout': 0.31432255157989114, 'lr': 0.0006033798131889798, 'weight_decay': 0.041648225988786286, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) +[I 2025-12-25 23:53:41,012] Trial 97 pruned. + +================================================================================ +Trial 97 완료 + Value (CSI): 0.411919 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.34952380464959953, 'ffn_dropout': 0.27217217230790786, 'lr': 0.0014220974799586887, 'weight_decay': 0.032451004333123, 'batch_size': 128} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스�� 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-25 23:59:57,894] Trial 98 finished with value: 0.5566019310765739 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.39412281191838444, 'ffn_dropout': 0.2956749054464063, 'lr': 0.0008934989219919747, 'weight_decay': 0.054029038695790246, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 98 완료 + Value (CSI): 0.556602 + Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.39412281191838444, 'ffn_dropout': 0.2956749054464063, 'lr': 0.0008934989219919747, 'weight_decay': 0.054029038695790246, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + Fold 1 - 클래스별 가중치: {0: 1.3198333333333334, 1: 1.3198333333333334, 2: 0.6735561792974398} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15676}) + Fold 2 - 클래스별 가중치: {0: 1.3259583333333333, 1: 1.3259583333333333, 2: 0.6703954159556763} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15823}) + Fold 3 - 클래스별 가중치: {0: 1.3280416666666666, 1: 1.3280416666666666, 2: 0.6693336693336693} (클래스별 샘플 수: {0: 8000, 1: 8000, 2: 15873}) +[I 2025-12-26 00:03:11,808] Trial 99 finished with value: 0.553663457901731 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.36414671164460966, 'ffn_dropout': 0.2813245471284871, 'lr': 0.0019368781689484509, 'weight_decay': 0.026749424188425228, 'batch_size': 32}. Best is trial 70 with value: 0.5788930444782093. + +================================================================================ +Trial 99 완료 + Value (CSI): 0.553663 + Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.36414671164460966, 'ffn_dropout': 0.2813245471284871, 'lr': 0.0019368781689484509, 'weight_decay': 0.026749424188425228, 'batch_size': 32} + Best Value (CSI): 0.578893 + Best Trial: 70 + Best Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} +================================================================================ + + +최적화 완료. +Best CSI Score: 0.5789 +Best Hyperparameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3074211243640513, 'ffn_dropout': 0.27614330827417055, 'lr': 0.0008013502604362781, 'weight_decay': 0.07731586815781724, 'batch_size': 32} + +최적화 과정 요약: + - 총 시도 횟수: 100 + - 성공한 시도: 100 + - 최초 CSI: 0.4938 + - 최종 CSI: 0.5537 + - 최고 CSI: 0.6054 + - 최저 CSI: 0.0000 + - 평균 CSI: 0.4202 + +최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_smote_seoul_trials.pkl에 저장되었습니다. + +================================================== +최적화된 하이퍼파라미터로 최종 모델 학습 시작 +================================================== +최종 모델 학습 시작... +Fold 1 학습 중... + Early stopping at epoch 20, Best CSI: 0.4754 + Fold 1 학습 완료 (검증 CSI: 0.4754) +Fold 2 학습 중... + Early stopping at epoch 23, Best CSI: 0.6354 + Fold 2 학습 완료 (검증 CSI: 0.6354) +Fold 3 학습 중... + Early stopping at epoch 30, Best CSI: 0.5902 + Fold 3 학습 완료 (검증 CSI: 0.5902) + +모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_smote_seoul.pkl (총 3개 fold) +Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_smote_seoul_scaler.pkl (총 3개 fold) + +최종 모델 학습 및 저장 완료! +저장된 모델 경로: ../save_model/ft_transformer_optima/ft_transformer_smote_seoul.pkl + +✓ 완료: ft_transformer_smote/ft_transformer_smote_seoul.py (소요 시간: 18329초) + +========================================== +FT-Transformer SMOTE 파일 실행 완료 +종료 시간: 2025-12-26 00:10:08 +총 소요 시간: 27시간 4분 14초 +성공: 6개 +실패: 0개 +==========================================