diff --git "a/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_pure.log" "b/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_pure.log"
--- "a/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_pure.log"
+++ "b/Analysis_code/5.optima/run_bash/ft_transformer/ft_transformer_pure.log"
@@ -244,3 +244,8071 @@ Trial 16 완료
 
   Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
   Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:07:14,782] Trial 17 finished with value: 0.44057343009096755 and parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}. Best is trial 17 with value: 0.44057343009096755.
+
+================================================================================
+Trial 17 완료
+  Value (CSI): 0.440573
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+  Best Value (CSI): 0.440573
+  Best Trial: 17
+  Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:08:55,414] Trial 18 finished with value: 0.42534156192096617 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.15722836504645515, 'ffn_dropout': 0.15300674331169764, 'lr': 0.00013224064929378727, 'weight_decay': 0.0017291531999271655, 'batch_size': 256}. Best is trial 17 with value: 0.44057343009096755.
+
+================================================================================
+Trial 18 완료
+  Value (CSI): 0.425342
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.15722836504645515, 'ffn_dropout': 0.15300674331169764, 'lr': 0.00013224064929378727, 'weight_decay': 0.0017291531999271655, 'batch_size': 256}
+  Best Value (CSI): 0.440573
+  Best Trial: 17
+  Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:11:35,396] Trial 19 finished with value: 0.42547680691531214 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21492770100564465, 'ffn_dropout': 0.17765308865183607, 'lr': 0.00013337847789394913, 'weight_decay': 0.000589014061788355, 'batch_size': 64}. Best is trial 17 with value: 0.44057343009096755.
+
+================================================================================
+Trial 19 완료
+  Value (CSI): 0.425477
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21492770100564465, 'ffn_dropout': 0.17765308865183607, 'lr': 0.00013337847789394913, 'weight_decay': 0.000589014061788355, 'batch_size': 64}
+  Best Value (CSI): 0.440573
+  Best Trial: 17
+  Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:16:02,522] Trial 20 finished with value: 0.4199478691190693 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2551109743812424, 'ffn_dropout': 0.10005925493428475, 'lr': 0.0001446248966798091, 'weight_decay': 0.00044713327479039156, 'batch_size': 32}. Best is trial 17 with value: 0.44057343009096755.
+
+================================================================================
+Trial 20 완료
+  Value (CSI): 0.419948
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2551109743812424, 'ffn_dropout': 0.10005925493428475, 'lr': 0.0001446248966798091, 'weight_decay': 0.00044713327479039156, 'batch_size': 32}
+  Best Value (CSI): 0.440573
+  Best Trial: 17
+  Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:18:00,371] Trial 21 finished with value: 0.43292068719707527 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21781385759759414, 'ffn_dropout': 0.18050520653533988, 'lr': 0.00011348629783939886, 'weight_decay': 0.0005283771455974894, 'batch_size': 64}. Best is trial 17 with value: 0.44057343009096755.
+
+================================================================================
+Trial 21 완료
+  Value (CSI): 0.432921
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21781385759759414, 'ffn_dropout': 0.18050520653533988, 'lr': 0.00011348629783939886, 'weight_decay': 0.0005283771455974894, 'batch_size': 64}
+  Best Value (CSI): 0.440573
+  Best Trial: 17
+  Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:20:51,247] Trial 22 finished with value: 0.40580589408929885 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.20087117562256218, 'ffn_dropout': 0.14540865302065994, 'lr': 8.141490879403435e-05, 'weight_decay': 0.0017277855852907455, 'batch_size': 64}. Best is trial 17 with value: 0.44057343009096755.
+
+================================================================================
+Trial 22 완료
+  Value (CSI): 0.405806
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.20087117562256218, 'ffn_dropout': 0.14540865302065994, 'lr': 8.141490879403435e-05, 'weight_decay': 0.0017277855852907455, 'batch_size': 64}
+  Best Value (CSI): 0.440573
+  Best Trial: 17
+  Best Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.16944490355028666, 'ffn_dropout': 0.14932148150310504, 'lr': 0.00012797632667353558, 'weight_decay': 0.0006203480378658751, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:23:15,268] Trial 23 finished with value: 0.4408859654528239 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}. Best is trial 23 with value: 0.4408859654528239.
+
+================================================================================
+Trial 23 완료
+  Value (CSI): 0.440886
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:23:42,348] Trial 24 pruned. 
+
+================================================================================
+Trial 24 완료
+  Value (CSI): 0.434590
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.14705689182560458, 'ffn_dropout': 0.2301422825067694, 'lr': 0.00020816470971717925, 'weight_decay': 0.0004033713902101654, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:24:07,160] Trial 25 pruned. 
+
+================================================================================
+Trial 25 완료
+  Value (CSI): 0.370331
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.1685338645409166, 'ffn_dropout': 0.18788010363660446, 'lr': 0.0003041672280291468, 'weight_decay': 0.0004445217662058431, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:24:20,835] Trial 26 pruned. 
+
+================================================================================
+Trial 26 완료
+  Value (CSI): 0.365556
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.13169377571165716, 'ffn_dropout': 0.14046492811902309, 'lr': 4.2113462512600025e-05, 'weight_decay': 0.0002049665233559899, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:24:37,528] Trial 27 pruned. 
+
+================================================================================
+Trial 27 완료
+  Value (CSI): 0.072703
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.170471740004805, 'ffn_dropout': 0.1740898576481405, 'lr': 0.0010139822728750698, 'weight_decay': 0.0015293463948971167, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:27:17,552] Trial 28 pruned. 
+
+================================================================================
+Trial 28 완료
+  Value (CSI): 0.407834
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.12683701914949141, 'ffn_dropout': 0.15774549247346611, 'lr': 0.00018737159989240586, 'weight_decay': 0.0005829380100391147, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:29:03,329] Trial 29 finished with value: 0.4396152183492245 and parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.12145056202742249, 'ffn_dropout': 0.13232742929659472, 'lr': 0.00039116251467073395, 'weight_decay': 0.002460668243223156, 'batch_size': 64}. Best is trial 23 with value: 0.4408859654528239.
+
+================================================================================
+Trial 29 완료
+  Value (CSI): 0.439615
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.12145056202742249, 'ffn_dropout': 0.13232742929659472, 'lr': 0.00039116251467073395, 'weight_decay': 0.002460668243223156, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:29:23,422] Trial 30 pruned. 
+
+================================================================================
+Trial 30 완료
+  Value (CSI): 0.367421
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1142574177320691, 'ffn_dropout': 0.130643704121932, 'lr': 0.000531578567195389, 'weight_decay': 0.0023046646708570753, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:30:57,364] Trial 31 finished with value: 0.42099865366393896 and parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15166548342855268, 'ffn_dropout': 0.16066114076365856, 'lr': 0.0002701874393601726, 'weight_decay': 0.00117234538978594, 'batch_size': 64}. Best is trial 23 with value: 0.4408859654528239.
+
+================================================================================
+Trial 31 완료
+  Value (CSI): 0.420999
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15166548342855268, 'ffn_dropout': 0.16066114076365856, 'lr': 0.0002701874393601726, 'weight_decay': 0.00117234538978594, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:33:22,460] Trial 32 finished with value: 0.43915337225108164 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1221769529687865, 'ffn_dropout': 0.16767607964339762, 'lr': 0.00014558794815515584, 'weight_decay': 0.004157011020491038, 'batch_size': 64}. Best is trial 23 with value: 0.4408859654528239.
+
+================================================================================
+Trial 32 완료
+  Value (CSI): 0.439153
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1221769529687865, 'ffn_dropout': 0.16767607964339762, 'lr': 0.00014558794815515584, 'weight_decay': 0.004157011020491038, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:35:13,226] Trial 33 finished with value: 0.43008947421556815 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.10736309598341608, 'ffn_dropout': 0.12980279907750716, 'lr': 0.00040532762714498544, 'weight_decay': 0.0037310271593565957, 'batch_size': 64}. Best is trial 23 with value: 0.4408859654528239.
+
+================================================================================
+Trial 33 완료
+  Value (CSI): 0.430089
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.10736309598341608, 'ffn_dropout': 0.12980279907750716, 'lr': 0.00040532762714498544, 'weight_decay': 0.0037310271593565957, 'batch_size': 64}
+  Best Value (CSI): 0.440886
+  Best Trial: 23
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16661944788187644, 'ffn_dropout': 0.1365300998885908, 'lr': 0.0002222655324389348, 'weight_decay': 0.0004932155242453681, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:37:53,266] Trial 34 finished with value: 0.44685896765010097 and parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 34 완료
+  Value (CSI): 0.446859
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:38:00,660] Trial 35 pruned. 
+
+================================================================================
+Trial 35 완료
+  Value (CSI): 0.396004
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.14462296702616304, 'ffn_dropout': 0.1246760481582648, 'lr': 6.105469388743497e-05, 'weight_decay': 0.0028938948699263984, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:38:16,915] Trial 36 pruned. 
+
+================================================================================
+Trial 36 완료
+  Value (CSI): 0.365191
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.12035079804650102, 'ffn_dropout': 0.149510124200388, 'lr': 0.00047174414036001605, 'weight_decay': 0.0023551475298550285, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:39:07,695] Trial 37 finished with value: 0.4223602210445432 and parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1044373307277818, 'ffn_dropout': 0.14263573465399085, 'lr': 0.000302613226111262, 'weight_decay': 0.006740169967352519, 'batch_size': 256}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 37 완료
+  Value (CSI): 0.422360
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1044373307277818, 'ffn_dropout': 0.14263573465399085, 'lr': 0.000302613226111262, 'weight_decay': 0.006740169967352519, 'batch_size': 256}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:39:20,977] Trial 38 pruned. 
+
+================================================================================
+Trial 38 완료
+  Value (CSI): 0.243961
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.13290415702752417, 'ffn_dropout': 0.24727900746308162, 'lr': 0.0012326041722119587, 'weight_decay': 0.00031406212349913685, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:40:21,990] Trial 39 finished with value: 0.41469884778442173 and parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.16442188296374266, 'ffn_dropout': 0.16210633970415922, 'lr': 0.000186974792225708, 'weight_decay': 0.001286264250306955, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 39 완료
+  Value (CSI): 0.414699
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.16442188296374266, 'ffn_dropout': 0.16210633970415922, 'lr': 0.000186974792225708, 'weight_decay': 0.001286264250306955, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:40:32,679] Trial 40 pruned. 
+
+================================================================================
+Trial 40 완료
+  Value (CSI): 0.372744
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.1484605446567468, 'ffn_dropout': 0.20025990884967768, 'lr': 8.575112371582988e-05, 'weight_decay': 0.004599717044616802, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:42:14,884] Trial 41 finished with value: 0.43206459687410587 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.12273785426811507, 'ffn_dropout': 0.12118736956983608, 'lr': 0.00015856243255226292, 'weight_decay': 0.005083269704223034, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 41 완료
+  Value (CSI): 0.432065
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.12273785426811507, 'ffn_dropout': 0.12118736956983608, 'lr': 0.00015856243255226292, 'weight_decay': 0.005083269704223034, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:44:21,423] Trial 42 finished with value: 0.4446825582887692 and parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13892275054841433, 'ffn_dropout': 0.1619381505259511, 'lr': 0.0002641210845173141, 'weight_decay': 0.0029389595891957812, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 42 완료
+  Value (CSI): 0.444683
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13892275054841433, 'ffn_dropout': 0.1619381505259511, 'lr': 0.0002641210845173141, 'weight_decay': 0.0029389595891957812, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:46:10,351] Trial 43 finished with value: 0.43266945617122116 and parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13930046596010037, 'ffn_dropout': 0.13752346272528815, 'lr': 0.0002450579923866201, 'weight_decay': 0.0023122652226731906, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 43 완료
+  Value (CSI): 0.432669
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13930046596010037, 'ffn_dropout': 0.13752346272528815, 'lr': 0.0002450579923866201, 'weight_decay': 0.0023122652226731906, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:46:20,895] Trial 44 pruned. 
+
+================================================================================
+Trial 44 완료
+  Value (CSI): 0.365179
+  Parameters: {'d_token': 192, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.15857297194981307, 'ffn_dropout': 0.18772362749618376, 'lr': 0.0003675467030114775, 'weight_decay': 0.0028527944682771346, 'batch_size': 256}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:47:20,085] Trial 45 finished with value: 0.433653323906144 and parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13741300344344057, 'ffn_dropout': 0.12174163946124844, 'lr': 0.00023551225141755434, 'weight_decay': 0.0018218549065596849, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 45 완료
+  Value (CSI): 0.433653
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13741300344344057, 'ffn_dropout': 0.12174163946124844, 'lr': 0.00023551225141755434, 'weight_decay': 0.0018218549065596849, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:47:35,908] Trial 46 pruned. 
+
+================================================================================
+Trial 46 완료
+  Value (CSI): 0.371152
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11140605860647304, 'ffn_dropout': 0.14995680233029204, 'lr': 0.0006414506865666999, 'weight_decay': 0.005916597420457188, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:47:56,796] Trial 47 pruned. 
+
+================================================================================
+Trial 47 완료
+  Value (CSI): 0.426773
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.10241782277076769, 'ffn_dropout': 0.21581324465994434, 'lr': 9.59311189039552e-05, 'weight_decay': 0.0032458152681815247, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:51:40,214] Trial 48 finished with value: 0.4108988981847557 and parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1766665260205816, 'ffn_dropout': 0.16708583462416718, 'lr': 0.00037018571042276747, 'weight_decay': 0.00906381865144435, 'batch_size': 32}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 48 완료
+  Value (CSI): 0.410899
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1766665260205816, 'ffn_dropout': 0.16708583462416718, 'lr': 0.00037018571042276747, 'weight_decay': 0.00906381865144435, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:51:53,997] Trial 49 pruned. 
+
+================================================================================
+Trial 49 완료
+  Value (CSI): 0.430528
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16412432501674917, 'ffn_dropout': 0.13472811453248745, 'lr': 0.000115708873562184, 'weight_decay': 0.000730188816522402, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:51:58,560] Trial 50 pruned. 
+
+================================================================================
+Trial 50 완료
+  Value (CSI): 0.362816
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.17873897097830344, 'ffn_dropout': 0.1969202419055362, 'lr': 0.00018268836856962564, 'weight_decay': 0.0010906775597055035, 'batch_size': 256}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:53:53,517] Trial 51 finished with value: 0.43505520810714465 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.11836095934456023, 'ffn_dropout': 0.16729729931532022, 'lr': 0.0001518861250427379, 'weight_decay': 0.003900931709043469, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 51 완료
+  Value (CSI): 0.435055
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.11836095934456023, 'ffn_dropout': 0.16729729931532022, 'lr': 0.0001518861250427379, 'weight_decay': 0.003900931709043469, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:55:39,850] Trial 52 finished with value: 0.42993099838054566 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1276642556550645, 'ffn_dropout': 0.11516472013799388, 'lr': 0.00026317842150197864, 'weight_decay': 0.0045182481945233634, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 52 완료
+  Value (CSI): 0.429931
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1276642556550645, 'ffn_dropout': 0.11516472013799388, 'lr': 0.00026317842150197864, 'weight_decay': 0.0045182481945233634, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 22:55:54,276] Trial 53 pruned. 
+
+================================================================================
+Trial 53 완료
+  Value (CSI): 0.413428
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14123769766505162, 'ffn_dropout': 0.18205419602763703, 'lr': 0.00010649389516004006, 'weight_decay': 0.013794606390772679, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 22:59:18,037] Trial 54 finished with value: 0.422165865623137 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.10046554992944573, 'ffn_dropout': 0.15479480405640608, 'lr': 6.702440851520361e-05, 'weight_decay': 0.0064016116149720245, 'batch_size': 32}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 54 완료
+  Value (CSI): 0.422166
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.10046554992944573, 'ffn_dropout': 0.15479480405640608, 'lr': 6.702440851520361e-05, 'weight_decay': 0.0064016116149720245, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:01:05,420] Trial 55 finished with value: 0.42987156262218523 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15589057881876345, 'ffn_dropout': 0.11321831314617826, 'lr': 0.00015180347427543685, 'weight_decay': 0.001498105803813603, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 55 완료
+  Value (CSI): 0.429872
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15589057881876345, 'ffn_dropout': 0.11321831314617826, 'lr': 0.00015180347427543685, 'weight_decay': 0.001498105803813603, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:01:50,069] Trial 56 pruned. 
+
+================================================================================
+Trial 56 완료
+  Value (CSI): 0.414938
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.12502416532004454, 'ffn_dropout': 0.17195491618563047, 'lr': 0.00020932360677364286, 'weight_decay': 0.0007618644733752707, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:04:10,696] Trial 57 finished with value: 0.43792688267252666 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14308764252702494, 'ffn_dropout': 0.13635105515146415, 'lr': 0.0003351061913252913, 'weight_decay': 0.0010446177301177196, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 57 완료
+  Value (CSI): 0.437927
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14308764252702494, 'ffn_dropout': 0.13635105515146415, 'lr': 0.0003351061913252913, 'weight_decay': 0.0010446177301177196, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:05:45,449] Trial 58 finished with value: 0.4314030798769573 and parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11734004375718132, 'ffn_dropout': 0.15444538716281442, 'lr': 0.0004885988765810802, 'weight_decay': 0.003499031815938539, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 58 완료
+  Value (CSI): 0.431403
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11734004375718132, 'ffn_dropout': 0.15444538716281442, 'lr': 0.0004885988765810802, 'weight_decay': 0.003499031815938539, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:05:56,841] Trial 59 pruned. 
+
+================================================================================
+Trial 59 완료
+  Value (CSI): 0.340792
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13304855500949794, 'ffn_dropout': 0.14371712316118468, 'lr': 0.00012818684309719898, 'weight_decay': 0.002068584440869597, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:08:39,563] Trial 60 finished with value: 0.4183339755039925 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.19330983418143388, 'ffn_dropout': 0.10110453974514497, 'lr': 8.583449563416909e-05, 'weight_decay': 0.002721435555248054, 'batch_size': 32}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 60 완료
+  Value (CSI): 0.418334
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.19330983418143388, 'ffn_dropout': 0.10110453974514497, 'lr': 8.583449563416909e-05, 'weight_decay': 0.002721435555248054, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:10:39,268] Trial 61 finished with value: 0.4268362832508313 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14403008537893516, 'ffn_dropout': 0.13629366518715721, 'lr': 0.0002613018566136403, 'weight_decay': 0.0010618237005948106, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 61 완료
+  Value (CSI): 0.426836
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14403008537893516, 'ffn_dropout': 0.13629366518715721, 'lr': 0.0002613018566136403, 'weight_decay': 0.0010618237005948106, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:13:01,847] Trial 62 finished with value: 0.4360677530223788 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1503473590815548, 'ffn_dropout': 0.16185994294607334, 'lr': 0.00017752392111640842, 'weight_decay': 0.001394367403221107, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 62 완료
+  Value (CSI): 0.436068
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1503473590815548, 'ffn_dropout': 0.16185994294607334, 'lr': 0.00017752392111640842, 'weight_decay': 0.001394367403221107, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:13:29,817] Trial 63 pruned. 
+
+================================================================================
+Trial 63 완료
+  Value (CSI): 0.443038
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.11065610995348804, 'ffn_dropout': 0.12695571161808028, 'lr': 0.0002885646584172064, 'weight_decay': 0.000679344219588653, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:15:23,784] Trial 64 finished with value: 0.437579723259043 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17119424292801105, 'ffn_dropout': 0.1755835705372324, 'lr': 0.00033355028398536333, 'weight_decay': 0.0009619433383730276, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 64 완료
+  Value (CSI): 0.437580
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17119424292801105, 'ffn_dropout': 0.1755835705372324, 'lr': 0.00033355028398536333, 'weight_decay': 0.0009619433383730276, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:15:49,548] Trial 65 pruned. 
+
+================================================================================
+Trial 65 완료
+  Value (CSI): 0.414395
+  Parameters: {'d_token': 256, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.15995244313171714, 'ffn_dropout': 0.1469650849132134, 'lr': 0.00020932639011696742, 'weight_decay': 0.001864522752897311, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:16:03,308] Trial 66 pruned. 
+
+================================================================================
+Trial 66 완료
+  Value (CSI): 0.425864
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1338358315764653, 'ffn_dropout': 0.11643755871045142, 'lr': 0.00012607479252254634, 'weight_decay': 0.0003970226578472575, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:18:15,306] Trial 67 finished with value: 0.4377719654479156 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11548257721205969, 'ffn_dropout': 0.136160791794505, 'lr': 0.00033324894731611945, 'weight_decay': 0.0015230991516363463, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 67 완료
+  Value (CSI): 0.437772
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11548257721205969, 'ffn_dropout': 0.136160791794505, 'lr': 0.00033324894731611945, 'weight_decay': 0.0015230991516363463, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:18:49,049] Trial 68 pruned. 
+
+================================================================================
+Trial 68 완료
+  Value (CSI): 0.258376
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1833908763547541, 'ffn_dropout': 0.11055988012166172, 'lr': 0.0006009206135324157, 'weight_decay': 0.000953195189727053, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:18:58,452] Trial 69 pruned. 
+
+================================================================================
+Trial 69 완료
+  Value (CSI): 0.404412
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.15242147407379378, 'ffn_dropout': 0.1540705336246568, 'lr': 0.0005012376140565922, 'weight_decay': 0.0005463731094503438, 'batch_size': 256}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:19:15,048] Trial 70 pruned. 
+
+================================================================================
+Trial 70 완료
+  Value (CSI): 0.373062
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12216833488908127, 'ffn_dropout': 0.1647921326873882, 'lr': 0.0003906610038721315, 'weight_decay': 0.0025535524488692544, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:21:27,903] Trial 71 finished with value: 0.435993517682358 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11219350448211339, 'ffn_dropout': 0.13654059376463895, 'lr': 0.00022505341172976073, 'weight_decay': 0.0015301267090640357, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 71 완료
+  Value (CSI): 0.435994
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11219350448211339, 'ffn_dropout': 0.13654059376463895, 'lr': 0.00022505341172976073, 'weight_decay': 0.0015301267090640357, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:23:47,481] Trial 72 finished with value: 0.4347462872278883 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.12930459247642412, 'ffn_dropout': 0.13322573141255908, 'lr': 0.00031843077613118035, 'weight_decay': 0.0012381531015066725, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 72 완료
+  Value (CSI): 0.434746
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.12930459247642412, 'ffn_dropout': 0.13322573141255908, 'lr': 0.00031843077613118035, 'weight_decay': 0.0012381531015066725, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:25:50,839] Trial 73 finished with value: 0.43610147759642154 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13839404989020693, 'ffn_dropout': 0.12690642557506082, 'lr': 0.00016538841091805762, 'weight_decay': 0.0032412212655670886, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 73 완료
+  Value (CSI): 0.436101
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13839404989020693, 'ffn_dropout': 0.12690642557506082, 'lr': 0.00016538841091805762, 'weight_decay': 0.0032412212655670886, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:29:01,507] Trial 74 finished with value: 0.4312383091437722 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.11653855622684464, 'ffn_dropout': 0.14275929767641615, 'lr': 0.00028460617114638235, 'weight_decay': 0.002006987988284185, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 74 완료
+  Value (CSI): 0.431238
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.11653855622684464, 'ffn_dropout': 0.14275929767641615, 'lr': 0.00028460617114638235, 'weight_decay': 0.002006987988284185, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:30:42,138] Trial 75 finished with value: 0.42427663968001644 and parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14405291157126954, 'ffn_dropout': 0.147497862375569, 'lr': 0.0004131545606780899, 'weight_decay': 0.0008840203906735652, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 75 완료
+  Value (CSI): 0.424277
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.14405291157126954, 'ffn_dropout': 0.147497862375569, 'lr': 0.0004131545606780899, 'weight_decay': 0.0008840203906735652, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:33:00,700] Trial 76 finished with value: 0.42898336743700877 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1250015471873365, 'ffn_dropout': 0.15991870248319542, 'lr': 0.00010685658625210783, 'weight_decay': 0.002498587295823636, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 76 완료
+  Value (CSI): 0.428983
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1250015471873365, 'ffn_dropout': 0.15991870248319542, 'lr': 0.00010685658625210783, 'weight_decay': 0.002498587295823636, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:33:14,606] Trial 77 pruned. 
+
+================================================================================
+Trial 77 완료
+  Value (CSI): 0.409297
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.10916975712623853, 'ffn_dropout': 0.12418717001937549, 'lr': 0.00021568999421121357, 'weight_decay': 0.0015752792074903558, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:33:55,820] Trial 78 pruned. 
+
+================================================================================
+Trial 78 완료
+  Value (CSI): 0.335780
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.10016287107992053, 'ffn_dropout': 0.17272849593417253, 'lr': 0.0003411300597292981, 'weight_decay': 0.0041576908411654805, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:35:59,362] Trial 79 finished with value: 0.4390793126260876 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1550532097382014, 'ffn_dropout': 0.1818794838732973, 'lr': 0.000148253884079043, 'weight_decay': 0.0013142271522298573, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 79 완료
+  Value (CSI): 0.439079
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1550532097382014, 'ffn_dropout': 0.1818794838732973, 'lr': 0.000148253884079043, 'weight_decay': 0.0013142271522298573, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:36:05,974] Trial 80 pruned. 
+
+================================================================================
+Trial 80 완료
+  Value (CSI): 0.377093
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1655555030444613, 'ffn_dropout': 0.18243629556107993, 'lr': 0.00014206535072706176, 'weight_decay': 0.0006840114135102137, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:38:14,837] Trial 81 finished with value: 0.4343994600543056 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.15196026906780236, 'ffn_dropout': 0.1396717652358687, 'lr': 0.0001791175945997799, 'weight_decay': 0.002149480908811411, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 81 완료
+  Value (CSI): 0.434399
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.15196026906780236, 'ffn_dropout': 0.1396717652358687, 'lr': 0.0001791175945997799, 'weight_decay': 0.002149480908811411, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:38:48,142] Trial 82 pruned. 
+
+================================================================================
+Trial 82 완료
+  Value (CSI): 0.345076
+  Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.1397416566595478, 'ffn_dropout': 0.1535063865271314, 'lr': 0.00023753423772434744, 'weight_decay': 0.0017162014159020965, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:40:39,916] Trial 83 finished with value: 0.42227034403006697 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.13271606872472977, 'ffn_dropout': 0.13194523085355503, 'lr': 0.0001322145881891085, 'weight_decay': 0.0012002010920918662, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 83 완료
+  Value (CSI): 0.422270
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.13271606872472977, 'ffn_dropout': 0.13194523085355503, 'lr': 0.0001322145881891085, 'weight_decay': 0.0012002010920918662, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:41:02,396] Trial 84 pruned. 
+
+================================================================================
+Trial 84 완료
+  Value (CSI): 0.340257
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1579641531734757, 'ffn_dropout': 0.1685644367244534, 'lr': 0.0004262760084174622, 'weight_decay': 0.0013245417955253717, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:41:19,420] Trial 85 pruned. 
+
+================================================================================
+Trial 85 완료
+  Value (CSI): 0.423077
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.12574703884866506, 'ffn_dropout': 0.11856014757578794, 'lr': 7.661706039833143e-05, 'weight_decay': 0.0030229419881972566, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:41:23,923] Trial 86 pruned. 
+
+================================================================================
+Trial 86 완료
+  Value (CSI): 0.402184
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.14658612350938036, 'ffn_dropout': 0.14794954396294077, 'lr': 0.00010586659867601494, 'weight_decay': 0.0019688613523105836, 'batch_size': 256}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:41:44,870] Trial 87 pruned. 
+
+================================================================================
+Trial 87 완료
+  Value (CSI): 0.431214
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.17285217214915596, 'ffn_dropout': 0.1595334198213084, 'lr': 0.0001608793243989159, 'weight_decay': 0.0008323042035421292, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+[I 2025-12-24 23:42:02,780] Trial 88 pruned. 
+
+================================================================================
+Trial 88 완료
+  Value (CSI): 0.415642
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11748267530584228, 'ffn_dropout': 0.19171733739605576, 'lr': 0.00025812722699980017, 'weight_decay': 0.0010580913210353126, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:44:29,812] Trial 89 finished with value: 0.40891192863339976 and parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13725038838012077, 'ffn_dropout': 0.18277621350532858, 'lr': 0.00020032994389305542, 'weight_decay': 0.0034887933999480612, 'batch_size': 32}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 89 완료
+  Value (CSI): 0.408912
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.13725038838012077, 'ffn_dropout': 0.18277621350532858, 'lr': 0.00020032994389305542, 'weight_decay': 0.0034887933999480612, 'batch_size': 32}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:46:22,137] Trial 90 pruned. 
+
+================================================================================
+Trial 90 완료
+  Value (CSI): 0.409722
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1065001382341087, 'ffn_dropout': 0.10891632331387538, 'lr': 0.00031086432567882337, 'weight_decay': 0.0006128406106834008, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:48:35,512] Trial 91 finished with value: 0.4388294109525152 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1757127498318602, 'ffn_dropout': 0.17317353223764714, 'lr': 0.00034463574291892493, 'weight_decay': 0.0009371440081303333, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 91 완료
+  Value (CSI): 0.438829
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1757127498318602, 'ffn_dropout': 0.17317353223764714, 'lr': 0.00034463574291892493, 'weight_decay': 0.0009371440081303333, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:50:11,888] Trial 92 finished with value: 0.4237766217155063 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16466070449465317, 'ffn_dropout': 0.17511994782534973, 'lr': 0.0004476506576582681, 'weight_decay': 0.0004670382692755319, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 92 완료
+  Value (CSI): 0.423777
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.16466070449465317, 'ffn_dropout': 0.17511994782534973, 'lr': 0.0004476506576582681, 'weight_decay': 0.0004670382692755319, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:52:24,776] Trial 93 pruned. 
+
+================================================================================
+Trial 93 완료
+  Value (CSI): 0.412698
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1889739099450263, 'ffn_dropout': 0.14014996902219434, 'lr': 0.00035621865439225105, 'weight_decay': 0.0013901341053616685, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:54:19,805] Trial 94 finished with value: 0.42786243764426807 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.20234990861285176, 'ffn_dropout': 0.16680573566616572, 'lr': 0.0002397713518372184, 'weight_decay': 0.001724666556849769, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 94 완료
+  Value (CSI): 0.427862
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.20234990861285176, 'ffn_dropout': 0.16680573566616572, 'lr': 0.0002397713518372184, 'weight_decay': 0.001724666556849769, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:55:57,531] Trial 95 finished with value: 0.43135514774246975 and parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1461188107174643, 'ffn_dropout': 0.15633331482440302, 'lr': 0.0001943057787945578, 'weight_decay': 0.0024840617639411058, 'batch_size': 64}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 95 완료
+  Value (CSI): 0.431355
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1461188107174643, 'ffn_dropout': 0.15633331482440302, 'lr': 0.0001943057787945578, 'weight_decay': 0.0024840617639411058, 'batch_size': 64}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:57:03,852] Trial 96 finished with value: 0.44356656238053443 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17413605614106317, 'ffn_dropout': 0.13008596176993953, 'lr': 0.0002922785952231531, 'weight_decay': 0.0007965811418392027, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 96 완료
+  Value (CSI): 0.443567
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17413605614106317, 'ffn_dropout': 0.13008596176993953, 'lr': 0.0002922785952231531, 'weight_decay': 0.0007965811418392027, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:58:02,932] Trial 97 finished with value: 0.43062295906473214 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17190352061838166, 'ffn_dropout': 0.146661184021868, 'lr': 0.00016085569673664242, 'weight_decay': 0.0005990250766392707, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 97 완료
+  Value (CSI): 0.430623
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17190352061838166, 'ffn_dropout': 0.146661184021868, 'lr': 0.00016085569673664242, 'weight_decay': 0.0005990250766392707, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-24 23:59:08,087] Trial 98 finished with value: 0.42054051764302797 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17888044483600604, 'ffn_dropout': 0.12169457530144016, 'lr': 0.00012237394433629615, 'weight_decay': 0.0007302890920701455, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 98 완료
+  Value (CSI): 0.420541
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.17888044483600604, 'ffn_dropout': 0.12169457530144016, 'lr': 0.00012237394433629615, 'weight_decay': 0.0007302890920701455, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 110.18867924528301, 1: 5.98974358974359, 2: 0.354111084162018} (클래스별 샘플 수: {0: 53, 1: 975, 2: 16492})
+  Fold 2 - 클래스별 가중치: {0: 77.97333333333333, 1: 5.778656126482214, 2: 0.3553503068603026} (클래스별 샘플 수: {0: 75, 1: 1012, 2: 16457})
+  Fold 3 - 클래스별 가중치: {0: 97.46666666666667, 1: 5.5961722488038275, 2: 0.3557394002068252} (클래스별 샘플 수: {0: 60, 1: 1045, 2: 16439})
+[I 2025-12-25 00:00:22,256] Trial 99 finished with value: 0.43343416605689183 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.1601821574440112, 'ffn_dropout': 0.12976073895601006, 'lr': 0.00026851535849948567, 'weight_decay': 0.0008776216136817475, 'batch_size': 128}. Best is trial 34 with value: 0.44685896765010097.
+
+================================================================================
+Trial 99 완료
+  Value (CSI): 0.433434
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.1601821574440112, 'ffn_dropout': 0.12976073895601006, 'lr': 0.00026851535849948567, 'weight_decay': 0.0008776216136817475, 'batch_size': 128}
+  Best Value (CSI): 0.446859
+  Best Trial: 34
+  Best Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+================================================================================
+
+
+최적화 완료.
+Best CSI Score: 0.4469
+Best Hyperparameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.11973480060658612, 'ffn_dropout': 0.15614454735278546, 'lr': 0.00016413327466283583, 'weight_decay': 0.002548468041818763, 'batch_size': 64}
+
+최적화 과정 요약:
+  - 총 시도 횟수: 100
+  - 성공한 시도: 100
+  - 최초 CSI: 0.2717
+  - 최종 CSI: 0.4334
+  - 최고 CSI: 0.4469
+  - 최저 CSI: 0.0576
+  - 평균 CSI: 0.4003
+
+최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_pure_busan_trials.pkl에 저장되었습니다.
+
+==================================================
+최적화된 하이퍼파라미터로 최종 모델 학습 시작
+==================================================
+최종 모델 학습 시작...
+Fold 1 학습 중...
+  Early stopping at epoch 40, Best CSI: 0.4700
+  Fold 1 학습 완료 (검증 CSI: 0.4700)
+Fold 2 학습 중...
+  Early stopping at epoch 45, Best CSI: 0.4465
+  Fold 2 학습 완료 (검증 CSI: 0.4465)
+Fold 3 학습 중...
+  Early stopping at epoch 48, Best CSI: 0.4121
+  Fold 3 학습 완료 (검증 CSI: 0.4121)
+
+모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_pure_busan.pkl (총 3개 fold)
+Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_pure_busan_scaler.pkl (총 3개 fold)
+
+최종 모델 학습 및 저장 완료!
+저장된 모델 경로:
+  - .
+  - .
+  - /
+  - s
+  - a
+  - v
+  - e
+  - _
+  - m
+  - o
+  - d
+  - e
+  - l
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - o
+  - p
+  - t
+  - i
+  - m
+  - a
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - p
+  - u
+  - r
+  - e
+  - _
+  - b
+  - u
+  - s
+  - a
+  - n
+  - .
+  - p
+  - k
+  - l
+
+✓ 완료: ft_transformer_pure/ft_transforemer_pure_busan.py (소요 시간: 10631초)
+
+----------------------------------------
+실행 중: ft_transformer_pure/ft_transforemer_pure_daegu.py
+시작 시간: 2025-12-25 00:03:02
+----------------------------------------
+[I 2025-12-25 00:03:03,477] A new study created in memory with name: no-name-57303f6f-9fca-4a7e-9adb-baf8ef76290d
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:04:07,276] Trial 0 finished with value: 0.29640492038291927 and parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3381230287461169, 'ffn_dropout': 0.36757338932332717, 'lr': 0.0014413286388068006, 'weight_decay': 0.010927123335060396, 'batch_size': 128}. Best is trial 0 with value: 0.29640492038291927.
+
+================================================================================
+Trial 0 완료
+  Value (CSI): 0.296405
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3381230287461169, 'ffn_dropout': 0.36757338932332717, 'lr': 0.0014413286388068006, 'weight_decay': 0.010927123335060396, 'batch_size': 128}
+  Best Value (CSI): 0.296405
+  Best Trial: 0
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3381230287461169, 'ffn_dropout': 0.36757338932332717, 'lr': 0.0014413286388068006, 'weight_decay': 0.010927123335060396, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:05:25,980] Trial 1 finished with value: 0.05034594666863255 and parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.39087698016863215, 'ffn_dropout': 0.11898414611002428, 'lr': 0.001452510613654026, 'weight_decay': 0.00044599179342484684, 'batch_size': 64}. Best is trial 0 with value: 0.29640492038291927.
+
+================================================================================
+Trial 1 완료
+  Value (CSI): 0.050346
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.39087698016863215, 'ffn_dropout': 0.11898414611002428, 'lr': 0.001452510613654026, 'weight_decay': 0.00044599179342484684, 'batch_size': 64}
+  Best Value (CSI): 0.296405
+  Best Trial: 0
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3381230287461169, 'ffn_dropout': 0.36757338932332717, 'lr': 0.0014413286388068006, 'weight_decay': 0.010927123335060396, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:06:10,468] Trial 2 finished with value: 0.3107880741325129 and parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30512974907178914, 'ffn_dropout': 0.21970635664817653, 'lr': 0.000102852057681668, 'weight_decay': 0.00725358763806132, 'batch_size': 256}. Best is trial 2 with value: 0.3107880741325129.
+
+================================================================================
+Trial 2 완료
+  Value (CSI): 0.310788
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30512974907178914, 'ffn_dropout': 0.21970635664817653, 'lr': 0.000102852057681668, 'weight_decay': 0.00725358763806132, 'batch_size': 256}
+  Best Value (CSI): 0.310788
+  Best Trial: 2
+  Best Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30512974907178914, 'ffn_dropout': 0.21970635664817653, 'lr': 0.000102852057681668, 'weight_decay': 0.00725358763806132, 'batch_size': 256}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:06:40,173] Trial 3 finished with value: 0.26297613018764626 and parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.20586011480004948, 'ffn_dropout': 0.1390176554954961, 'lr': 0.0023164398302919172, 'weight_decay': 0.00010225359197346127, 'batch_size': 256}. Best is trial 2 with value: 0.3107880741325129.
+
+================================================================================
+Trial 3 완료
+  Value (CSI): 0.262976
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.20586011480004948, 'ffn_dropout': 0.1390176554954961, 'lr': 0.0023164398302919172, 'weight_decay': 0.00010225359197346127, 'batch_size': 256}
+  Best Value (CSI): 0.310788
+  Best Trial: 2
+  Best Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30512974907178914, 'ffn_dropout': 0.21970635664817653, 'lr': 0.000102852057681668, 'weight_decay': 0.00725358763806132, 'batch_size': 256}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:11:20,229] Trial 4 finished with value: 0.3668187349867032 and parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}. Best is trial 4 with value: 0.3668187349867032.
+
+================================================================================
+Trial 4 완료
+  Value (CSI): 0.366819
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:11:57,332] Trial 5 pruned. 
+
+================================================================================
+Trial 5 완료
+  Value (CSI): 0.192882
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.19950733516044453, 'ffn_dropout': 0.39764852055930777, 'lr': 1.0395846888169699e-05, 'weight_decay': 0.01769995069845971, 'batch_size': 32}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:13:04,756] Trial 6 finished with value: 0.3462053462346258 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3575813950382517, 'ffn_dropout': 0.17269873041744793, 'lr': 0.0001942566524715374, 'weight_decay': 0.020579710525079314, 'batch_size': 64}. Best is trial 4 with value: 0.3668187349867032.
+
+================================================================================
+Trial 6 완료
+  Value (CSI): 0.346205
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3575813950382517, 'ffn_dropout': 0.17269873041744793, 'lr': 0.0001942566524715374, 'weight_decay': 0.020579710525079314, 'batch_size': 64}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:13:52,372] Trial 7 finished with value: 0.3099725192421742 and parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.35672743118683026, 'ffn_dropout': 0.22696902030481328, 'lr': 0.0006125718433535596, 'weight_decay': 0.02082658000555602, 'batch_size': 256}. Best is trial 4 with value: 0.3668187349867032.
+
+================================================================================
+Trial 7 완료
+  Value (CSI): 0.309973
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.35672743118683026, 'ffn_dropout': 0.22696902030481328, 'lr': 0.0006125718433535596, 'weight_decay': 0.02082658000555602, 'batch_size': 256}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:14:04,109] Trial 8 pruned. 
+
+================================================================================
+Trial 8 완료
+  Value (CSI): 0.177920
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29473027671342156, 'ffn_dropout': 0.3300111152470837, 'lr': 5.3303470397916326e-05, 'weight_decay': 0.0023553640053748074, 'batch_size': 128}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:14:26,537] Trial 9 pruned. 
+
+================================================================================
+Trial 9 완료
+  Value (CSI): 0.231765
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.31398045289883136, 'ffn_dropout': 0.21280289961488602, 'lr': 0.0004801779351694766, 'weight_decay': 0.010403740920260276, 'batch_size': 64}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:14:56,862] Trial 10 pruned. 
+
+================================================================================
+Trial 10 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.11410982397162447, 'ffn_dropout': 0.10811820161463548, 'lr': 0.004628623232471164, 'weight_decay': 0.0683400981411213, 'batch_size': 32}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:16:25,548] Trial 11 finished with value: 0.3418081636360529 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3995247187345581, 'ffn_dropout': 0.16263785361632307, 'lr': 0.00013852752835741633, 'weight_decay': 0.09258009920110537, 'batch_size': 64}. Best is trial 4 with value: 0.3668187349867032.
+
+================================================================================
+Trial 11 완료
+  Value (CSI): 0.341808
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3995247187345581, 'ffn_dropout': 0.16263785361632307, 'lr': 0.00013852752835741633, 'weight_decay': 0.09258009920110537, 'batch_size': 64}
+  Best Value (CSI): 0.366819
+  Best Trial: 4
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2996103926982233, 'ffn_dropout': 0.14832668634755228, 'lr': 0.00010398138036962992, 'weight_decay': 0.06876687719690146, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:20:53,752] Trial 12 finished with value: 0.37102097275562435 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}. Best is trial 12 with value: 0.37102097275562435.
+
+================================================================================
+Trial 12 완료
+  Value (CSI): 0.371021
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}
+  Best Value (CSI): 0.371021
+  Best Trial: 12
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:21:39,057] Trial 13 pruned. 
+
+================================================================================
+Trial 13 완료
+  Value (CSI): 0.265217
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2546998253110153, 'ffn_dropout': 0.16393792606071905, 'lr': 4.768664499417311e-05, 'weight_decay': 0.059712910940831226, 'batch_size': 32}
+  Best Value (CSI): 0.371021
+  Best Trial: 12
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:26:03,977] Trial 14 finished with value: 0.3604774056077337 and parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2600901689614381, 'ffn_dropout': 0.258394378319389, 'lr': 0.0002987047063970269, 'weight_decay': 0.03910245029990228, 'batch_size': 32}. Best is trial 12 with value: 0.37102097275562435.
+
+================================================================================
+Trial 14 완료
+  Value (CSI): 0.360477
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2600901689614381, 'ffn_dropout': 0.258394378319389, 'lr': 0.0002987047063970269, 'weight_decay': 0.03910245029990228, 'batch_size': 32}
+  Best Value (CSI): 0.371021
+  Best Trial: 12
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:26:36,796] Trial 15 pruned. 
+
+================================================================================
+Trial 15 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2194669942019723, 'ffn_dropout': 0.10661868034076227, 'lr': 0.009441917837163808, 'weight_decay': 0.03947590595319887, 'batch_size': 32}
+  Best Value (CSI): 0.371021
+  Best Trial: 12
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:28:55,247] Trial 16 finished with value: 0.33785353335346757 and parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.27463888766994204, 'ffn_dropout': 0.1851949543419541, 'lr': 0.0006303182901778837, 'weight_decay': 0.08604434356624223, 'batch_size': 32}. Best is trial 12 with value: 0.37102097275562435.
+
+================================================================================
+Trial 16 완료
+  Value (CSI): 0.337854
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.27463888766994204, 'ffn_dropout': 0.1851949543419541, 'lr': 0.0006303182901778837, 'weight_decay': 0.08604434356624223, 'batch_size': 32}
+  Best Value (CSI): 0.371021
+  Best Trial: 12
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2515300932635287, 'ffn_dropout': 0.17239289985688716, 'lr': 0.00022084072000306073, 'weight_decay': 0.042215460556657966, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:33:41,546] Trial 17 finished with value: 0.3781935514399195 and parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}. Best is trial 17 with value: 0.3781935514399195.
+
+================================================================================
+Trial 17 완료
+  Value (CSI): 0.378194
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:38:21,165] Trial 18 finished with value: 0.3635361833263781 and parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.23005551233327268, 'ffn_dropout': 0.1371591619205612, 'lr': 3.394993471775902e-05, 'weight_decay': 0.0038194955307940333, 'batch_size': 32}. Best is trial 17 with value: 0.3781935514399195.
+
+================================================================================
+Trial 18 완료
+  Value (CSI): 0.363536
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.23005551233327268, 'ffn_dropout': 0.1371591619205612, 'lr': 3.394993471775902e-05, 'weight_decay': 0.0038194955307940333, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:38:34,237] Trial 19 pruned. 
+
+================================================================================
+Trial 19 완료
+  Value (CSI): 0.216017
+  Parameters: {'d_token': 256, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.16701450542264093, 'ffn_dropout': 0.1913927816359933, 'lr': 0.00026869812422733387, 'weight_decay': 0.001520190460413396, 'batch_size': 128}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:43:03,216] Trial 20 pruned. 
+
+================================================================================
+Trial 20 완료
+  Value (CSI): 0.378989
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.24027697569103826, 'ffn_dropout': 0.2549514754391863, 'lr': 2.712512810162597e-05, 'weight_decay': 0.004753392620564204, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:46:08,784] Trial 21 pruned. 
+
+================================================================================
+Trial 21 완료
+  Value (CSI): 0.398241
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.28955563008050433, 'ffn_dropout': 0.14194676951666715, 'lr': 9.446466866633282e-05, 'weight_decay': 0.03551395818967427, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:49:44,195] Trial 22 finished with value: 0.37708810870616577 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2736667393384993, 'ffn_dropout': 0.15170625593594783, 'lr': 9.659707401306993e-05, 'weight_decay': 0.0298090327084465, 'batch_size': 32}. Best is trial 17 with value: 0.3781935514399195.
+
+================================================================================
+Trial 22 완료
+  Value (CSI): 0.377088
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2736667393384993, 'ffn_dropout': 0.15170625593594783, 'lr': 9.659707401306993e-05, 'weight_decay': 0.0298090327084465, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 00:51:07,912] Trial 23 pruned. 
+
+================================================================================
+Trial 23 완료
+  Value (CSI): 0.362401
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2649784818886293, 'ffn_dropout': 0.10154704244458997, 'lr': 0.00018658315041770242, 'weight_decay': 0.014961751067695336, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 00:53:13,543] Trial 24 pruned. 
+
+================================================================================
+Trial 24 완료
+  Value (CSI): 0.357471
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.23997995894306204, 'ffn_dropout': 0.12771001296875512, 'lr': 6.432800311001589e-05, 'weight_decay': 0.007364575003852467, 'batch_size': 32}
+  Best Value (CSI): 0.378194
+  Best Trial: 17
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.22468349766909257, 'ffn_dropout': 0.13603983401789904, 'lr': 7.722413778980943e-05, 'weight_decay': 0.004254290539938868, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:56:02,205] Trial 25 finished with value: 0.3846594392002736 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 25 완료
+  Value (CSI): 0.384659
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 00:58:18,811] Trial 26 finished with value: 0.36795760244412906 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.276943901112094, 'ffn_dropout': 0.1853214861823787, 'lr': 0.0001462682045809044, 'weight_decay': 0.022542531674437004, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 26 완료
+  Value (CSI): 0.367958
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.276943901112094, 'ffn_dropout': 0.1853214861823787, 'lr': 0.0001462682045809044, 'weight_decay': 0.022542531674437004, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:58:27,408] Trial 27 pruned. 
+
+================================================================================
+Trial 27 완료
+  Value (CSI): 0.230683
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1851668595583471, 'ffn_dropout': 0.12819907056823646, 'lr': 7.466186862229132e-05, 'weight_decay': 0.027469178498408763, 'batch_size': 128}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:58:32,441] Trial 28 pruned. 
+
+================================================================================
+Trial 28 완료
+  Value (CSI): 0.210359
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.22401980641948582, 'ffn_dropout': 0.15375703330088797, 'lr': 0.00039567638254670403, 'weight_decay': 0.01221021811704656, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 00:58:38,864] Trial 29 pruned. 
+
+================================================================================
+Trial 29 완료
+  Value (CSI): 0.159314
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.32564210717116354, 'ffn_dropout': 0.1964478851149662, 'lr': 2.411338810295645e-05, 'weight_decay': 0.009340289027118242, 'batch_size': 128}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 00:59:35,785] Trial 30 pruned. 
+
+================================================================================
+Trial 30 완료
+  Value (CSI): 0.356906
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.28174577482011315, 'ffn_dropout': 0.15578645391612983, 'lr': 0.00014306815925175246, 'weight_decay': 0.013644583383725588, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:02:42,323] Trial 31 finished with value: 0.3814997399916305 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2538965342701613, 'ffn_dropout': 0.1715270645347582, 'lr': 0.00024654793000754744, 'weight_decay': 0.04590813078125738, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 31 완료
+  Value (CSI): 0.381500
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2538965342701613, 'ffn_dropout': 0.1715270645347582, 'lr': 0.00024654793000754744, 'weight_decay': 0.04590813078125738, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:03:30,978] Trial 32 pruned. 
+
+================================================================================
+Trial 32 완료
+  Value (CSI): 0.112453
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2647336609800726, 'ffn_dropout': 0.14235115699424677, 'lr': 0.00034966277051878966, 'weight_decay': 0.031042471305895013, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:06:25,091] Trial 33 finished with value: 0.37126634054290425 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24253663844056722, 'ffn_dropout': 0.12447265813235775, 'lr': 9.056471868149548e-05, 'weight_decay': 0.05763534725554885, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 33 완료
+  Value (CSI): 0.371266
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24253663844056722, 'ffn_dropout': 0.12447265813235775, 'lr': 9.056471868149548e-05, 'weight_decay': 0.05763534725554885, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:07:17,828] Trial 34 pruned. 
+
+================================================================================
+Trial 34 완료
+  Value (CSI): 0.242206
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3131971064643815, 'ffn_dropout': 0.12382386634845254, 'lr': 0.00021940676645817666, 'weight_decay': 0.0059599212067557835, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:07:42,355] Trial 35 pruned. 
+
+================================================================================
+Trial 35 완료
+  Value (CSI): 0.288212
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2810108559678304, 'ffn_dropout': 0.20523277305860907, 'lr': 0.000985234842015357, 'weight_decay': 0.024779667839241383, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:09:20,279] Trial 36 finished with value: 0.3595546205987475 and parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.29083608242093845, 'ffn_dropout': 0.17455951882678528, 'lr': 0.00011969498229601953, 'weight_decay': 0.01692278511021081, 'batch_size': 64}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 36 완료
+  Value (CSI): 0.359555
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.29083608242093845, 'ffn_dropout': 0.17455951882678528, 'lr': 0.00011969498229601953, 'weight_decay': 0.01692278511021081, 'batch_size': 64}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:11:35,904] Trial 37 pruned. 
+
+================================================================================
+Trial 37 완료
+  Value (CSI): 0.352034
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2155042585332457, 'ffn_dropout': 0.14904695830006562, 'lr': 7.670309549097895e-05, 'weight_decay': 0.008805186841907587, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:12:20,514] Trial 38 pruned. 
+
+================================================================================
+Trial 38 완료
+  Value (CSI): 0.240000
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.30196495081849317, 'ffn_dropout': 0.22446686766337226, 'lr': 0.000194151028876896, 'weight_decay': 0.09926617301109392, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:12:26,212] Trial 39 pruned. 
+
+================================================================================
+Trial 39 완료
+  Value (CSI): 0.201226
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3367792034467395, 'ffn_dropout': 0.17426735465844692, 'lr': 0.00010584347078872694, 'weight_decay': 0.05213644608611559, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:12:55,910] Trial 40 pruned. 
+
+================================================================================
+Trial 40 완료
+  Value (CSI): 0.216667
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2670313138916806, 'ffn_dropout': 0.23409115588842277, 'lr': 0.0002990911595192957, 'weight_decay': 0.027939092699228563, 'batch_size': 64}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:13:36,309] Trial 41 pruned. 
+
+================================================================================
+Trial 41 완료
+  Value (CSI): 0.289474
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24143536587159278, 'ffn_dropout': 0.11845599645802474, 'lr': 8.60145507764918e-05, 'weight_decay': 0.05362156496412405, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:16:07,443] Trial 42 finished with value: 0.375512780245531 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24794757397861558, 'ffn_dropout': 0.11859775836775327, 'lr': 5.053396197420868e-05, 'weight_decay': 0.05076568133806051, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 42 완료
+  Value (CSI): 0.375513
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24794757397861558, 'ffn_dropout': 0.11859775836775327, 'lr': 5.053396197420868e-05, 'weight_decay': 0.05076568133806051, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:18:52,254] Trial 43 finished with value: 0.36168482715052286 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25683030004415575, 'ffn_dropout': 0.1393711695040204, 'lr': 4.002861073931268e-05, 'weight_decay': 0.019340247935675816, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 43 완료
+  Value (CSI): 0.361685
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25683030004415575, 'ffn_dropout': 0.1393711695040204, 'lr': 4.002861073931268e-05, 'weight_decay': 0.019340247935675816, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:19:31,713] Trial 44 pruned. 
+
+================================================================================
+Trial 44 완료
+  Value (CSI): 0.221604
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.20590799879258337, 'ffn_dropout': 0.15777470785574413, 'lr': 5.573810967788502e-05, 'weight_decay': 0.0713951408353533, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:20:42,393] Trial 45 pruned. 
+
+================================================================================
+Trial 45 완료
+  Value (CSI): 0.366385
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.23079177438339005, 'ffn_dropout': 0.11541649633008234, 'lr': 0.0001358451439384273, 'weight_decay': 0.039793600980840935, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:24:34,160] Trial 46 finished with value: 0.37646924856967123 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25024327072948416, 'ffn_dropout': 0.10071226240862333, 'lr': 5.038194029056816e-05, 'weight_decay': 0.017013501743789003, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 46 완료
+  Value (CSI): 0.376469
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25024327072948416, 'ffn_dropout': 0.10071226240862333, 'lr': 5.038194029056816e-05, 'weight_decay': 0.017013501743789003, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:24:55,473] Trial 47 pruned. 
+
+================================================================================
+Trial 47 완료
+  Value (CSI): 0.368542
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.305066893504488, 'ffn_dropout': 0.10325124755985961, 'lr': 0.0001767758512753313, 'weight_decay': 0.01176027891772478, 'batch_size': 128}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:26:26,040] Trial 48 pruned. 
+
+================================================================================
+Trial 48 완료
+  Value (CSI): 0.375152
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.29149490260947125, 'ffn_dropout': 0.13313606317894816, 'lr': 6.525215500694195e-05, 'weight_decay': 0.018382060305199118, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:26:58,622] Trial 49 pruned. 
+
+================================================================================
+Trial 49 완료
+  Value (CSI): 0.287407
+  Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2698408270873233, 'ffn_dropout': 0.16346983019944672, 'lr': 0.0001038702263688621, 'weight_decay': 0.030442936674810028, 'batch_size': 64}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:27:13,708] Trial 50 pruned. 
+
+================================================================================
+Trial 50 완료
+  Value (CSI): 0.229095
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.25382057863434565, 'ffn_dropout': 0.14710667511561856, 'lr': 0.000260482215019166, 'weight_decay': 0.015416232554210473, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:28:29,277] Trial 51 pruned. 
+
+================================================================================
+Trial 51 완료
+  Value (CSI): 0.382950
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2508465329855773, 'ffn_dropout': 0.11270099004496292, 'lr': 4.774434042567095e-05, 'weight_decay': 0.043112821231246753, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:31:34,149] Trial 52 pruned. 
+
+================================================================================
+Trial 52 완료
+  Value (CSI): 0.381089
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2289731645958358, 'ffn_dropout': 0.10046906754393926, 'lr': 5.975534203122773e-05, 'weight_decay': 0.023698071107677927, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:32:13,306] Trial 53 pruned. 
+
+================================================================================
+Trial 53 완료
+  Value (CSI): 0.248424
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.27625114458583655, 'ffn_dropout': 0.11831624623556967, 'lr': 3.117206840839612e-05, 'weight_decay': 0.07855498001882467, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:32:49,522] Trial 54 pruned. 
+
+================================================================================
+Trial 54 완료
+  Value (CSI): 0.221976
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2468401280343273, 'ffn_dropout': 0.13410069815930403, 'lr': 2.2583802632988417e-05, 'weight_decay': 0.04922226294720182, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:33:15,552] Trial 55 pruned. 
+
+================================================================================
+Trial 55 완료
+  Value (CSI): 0.209102
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25821090272750413, 'ffn_dropout': 0.11192072104236607, 'lr': 4.598134508068652e-05, 'weight_decay': 0.0679162463748671, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:34:00,898] Trial 56 pruned. 
+
+================================================================================
+Trial 56 완료
+  Value (CSI): 0.271858
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23476335461152986, 'ffn_dropout': 0.1689347650721264, 'lr': 0.0001251306712154929, 'weight_decay': 0.03563571855732425, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:36:19,011] Trial 57 finished with value: 0.34532926140481335 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21274730512779844, 'ffn_dropout': 0.15023180816384787, 'lr': 7.553313758345565e-05, 'weight_decay': 0.020698039970127907, 'batch_size': 32}. Best is trial 25 with value: 0.3846594392002736.
+
+================================================================================
+Trial 57 완료
+  Value (CSI): 0.345329
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21274730512779844, 'ffn_dropout': 0.15023180816384787, 'lr': 7.553313758345565e-05, 'weight_decay': 0.020698039970127907, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:37:28,935] Trial 58 pruned. 
+
+================================================================================
+Trial 58 완료
+  Value (CSI): 0.371498
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2201681972822226, 'ffn_dropout': 0.1340370586037815, 'lr': 0.00016677048638332032, 'weight_decay': 0.03241099099461399, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:38:17,110] Trial 59 pruned. 
+
+================================================================================
+Trial 59 완료
+  Value (CSI): 0.257033
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.26752823764485656, 'ffn_dropout': 0.18219243601550086, 'lr': 2.0584674418846556e-05, 'weight_decay': 0.04606464334219064, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:38:25,806] Trial 60 pruned. 
+
+================================================================================
+Trial 60 완료
+  Value (CSI): 0.216895
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2818347544330957, 'ffn_dropout': 0.14311614147828705, 'lr': 3.658903235027625e-05, 'weight_decay': 0.01048636994645898, 'batch_size': 128}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:39:41,541] Trial 61 pruned. 
+
+================================================================================
+Trial 61 완료
+  Value (CSI): 0.377858
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2443987217247292, 'ffn_dropout': 0.12246747070262111, 'lr': 9.221300128520368e-05, 'weight_decay': 0.060060927272184546, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:40:20,242] Trial 62 pruned. 
+
+================================================================================
+Trial 62 완료
+  Value (CSI): 0.279601
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.23864904468354095, 'ffn_dropout': 0.1253834479666242, 'lr': 9.026806641393389e-05, 'weight_decay': 0.06320761601780531, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:41:23,774] Trial 63 pruned. 
+
+================================================================================
+Trial 63 완료
+  Value (CSI): 0.361894
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2519566117534627, 'ffn_dropout': 0.15995732491857165, 'lr': 0.00011088019211551819, 'weight_decay': 0.047591649301497514, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:42:49,213] Trial 64 pruned. 
+
+================================================================================
+Trial 64 완료
+  Value (CSI): 0.381935
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.22761126442851026, 'ffn_dropout': 0.11003836223688264, 'lr': 6.539831130594897e-05, 'weight_decay': 0.08455111462320279, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:44:14,885] Trial 65 pruned. 
+
+================================================================================
+Trial 65 완료
+  Value (CSI): 0.356751
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2618049516337553, 'ffn_dropout': 0.1296994254043359, 'lr': 0.0002220623289306713, 'weight_decay': 0.024937766359421805, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:45:27,065] Trial 66 pruned. 
+
+================================================================================
+Trial 66 완료
+  Value (CSI): 0.374831
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24514416906599937, 'ffn_dropout': 0.1515561935607681, 'lr': 0.00016056979526384368, 'weight_decay': 0.039003896438167554, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:45:54,567] Trial 67 pruned. 
+
+================================================================================
+Trial 67 완료
+  Value (CSI): 0.269022
+  Parameters: {'d_token': 256, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2713629171870476, 'ffn_dropout': 0.12058204104810842, 'lr': 5.0396561770973595e-05, 'weight_decay': 0.028173274829699446, 'batch_size': 64}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:47:20,551] Trial 68 pruned. 
+
+================================================================================
+Trial 68 완료
+  Value (CSI): 0.362269
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.28707751393163905, 'ffn_dropout': 0.11081905299849734, 'lr': 0.0001147335427001085, 'weight_decay': 0.05761019328817282, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:47:28,094] Trial 69 pruned. 
+
+================================================================================
+Trial 69 완료
+  Value (CSI): 0.224944
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.23501184316258888, 'ffn_dropout': 0.1400635623865405, 'lr': 7.577609294899357e-05, 'weight_decay': 0.014134105176864828, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:48:15,562] Trial 70 pruned. 
+
+================================================================================
+Trial 70 완료
+  Value (CSI): 0.276446
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.29675575239778684, 'ffn_dropout': 0.1670891716611272, 'lr': 0.00015287585714840164, 'weight_decay': 0.03365082008007107, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:49:56,017] Trial 71 pruned. 
+
+================================================================================
+Trial 71 완료
+  Value (CSI): 0.340351
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25737933703068944, 'ffn_dropout': 0.17796137207868157, 'lr': 0.00022521061691440413, 'weight_decay': 0.04468956383618979, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:50:27,129] Trial 72 pruned. 
+
+================================================================================
+Trial 72 완료
+  Value (CSI): 0.113223
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.24853974273349277, 'ffn_dropout': 0.19029652870010408, 'lr': 0.00040233939157278915, 'weight_decay': 0.0977870594049185, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:51:46,714] Trial 73 pruned. 
+
+================================================================================
+Trial 73 완료
+  Value (CSI): 0.352732
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2726834830127298, 'ffn_dropout': 0.15823087106128558, 'lr': 0.00013236146186103174, 'weight_decay': 0.020984024511877575, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:52:31,249] Trial 74 pruned. 
+
+================================================================================
+Trial 74 완료
+  Value (CSI): 0.250649
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.22377538146645015, 'ffn_dropout': 0.10059809317336783, 'lr': 0.00027360910126416645, 'weight_decay': 0.07597054311247373, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:53:38,741] Trial 75 pruned. 
+
+================================================================================
+Trial 75 완료
+  Value (CSI): 0.353559
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.23795816856951482, 'ffn_dropout': 0.1994553169582546, 'lr': 8.741954469949254e-05, 'weight_decay': 0.03552888814935313, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:53:59,230] Trial 76 pruned. 
+
+================================================================================
+Trial 76 완료
+  Value (CSI): 0.268392
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.26089392545197554, 'ffn_dropout': 0.17044736921182158, 'lr': 0.00018800930917454542, 'weight_decay': 0.0567672998976659, 'batch_size': 128}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 01:57:31,927] Trial 77 pruned. 
+
+================================================================================
+Trial 77 완료
+  Value (CSI): 0.398649
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.28246003953154925, 'ffn_dropout': 0.1288602574511914, 'lr': 5.937254097847339e-05, 'weight_decay': 0.026374076447417863, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 01:58:35,700] Trial 78 pruned. 
+
+================================================================================
+Trial 78 완료
+  Value (CSI): 0.383313
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2501666795767813, 'ffn_dropout': 0.14423176917594188, 'lr': 0.00010237162637743782, 'weight_decay': 0.0031510867233097055, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 01:58:57,743] Trial 79 pruned. 
+
+================================================================================
+Trial 79 완료
+  Value (CSI): 0.245963
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2671314469693315, 'ffn_dropout': 0.1822267758722683, 'lr': 0.00014882341109530802, 'weight_decay': 0.04588757495565786, 'batch_size': 64}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:00:36,045] Trial 80 pruned. 
+
+================================================================================
+Trial 80 완료
+  Value (CSI): 0.383546
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.19833162360201495, 'ffn_dropout': 0.1380597690297294, 'lr': 4.186394989308294e-05, 'weight_decay': 0.01983329347179651, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:01:31,822] Trial 81 pruned. 
+
+================================================================================
+Trial 81 완료
+  Value (CSI): 0.361355
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2764539983358285, 'ffn_dropout': 0.18866790646872159, 'lr': 0.000131562568097284, 'weight_decay': 0.015421897781673667, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:02:27,125] Trial 82 pruned. 
+
+================================================================================
+Trial 82 완료
+  Value (CSI): 0.349474
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.26033566195021013, 'ffn_dropout': 0.17650384318029463, 'lr': 0.00024158450054274696, 'weight_decay': 0.02382452245088323, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:02:55,620] Trial 83 pruned. 
+
+================================================================================
+Trial 83 완료
+  Value (CSI): 0.252513
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2958672527829419, 'ffn_dropout': 0.1649342110104734, 'lr': 0.00016828829515001332, 'weight_decay': 0.029477789168930804, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:03:53,269] Trial 84 pruned. 
+
+================================================================================
+Trial 84 완료
+  Value (CSI): 0.365408
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.24334446278218236, 'ffn_dropout': 0.1546385285082794, 'lr': 0.00019429838501662638, 'weight_decay': 0.03966097852509651, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:04:34,518] Trial 85 pruned. 
+
+================================================================================
+Trial 85 완료
+  Value (CSI): 0.284672
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.23337180521386156, 'ffn_dropout': 0.2011715822725904, 'lr': 7.066482628723317e-05, 'weight_decay': 0.017089855050382862, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:04:42,044] Trial 86 pruned. 
+
+================================================================================
+Trial 86 완료
+  Value (CSI): 0.231867
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.27558109650165885, 'ffn_dropout': 0.20955582217143295, 'lr': 0.00011019567633675305, 'weight_decay': 0.0122839116254214, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:05:17,689] Trial 87 pruned. 
+
+================================================================================
+Trial 87 완료
+  Value (CSI): 0.237981
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.28752910034323875, 'ffn_dropout': 0.19396481721062273, 'lr': 5.252093270499447e-05, 'weight_decay': 0.05337234877724441, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:05:47,855] Trial 88 pruned. 
+
+================================================================================
+Trial 88 완료
+  Value (CSI): 0.198216
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25365665857383535, 'ffn_dropout': 0.117997228974347, 'lr': 0.0003061670134929325, 'weight_decay': 0.034966758530073645, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:06:18,571] Trial 89 pruned. 
+
+================================================================================
+Trial 89 완료
+  Value (CSI): 0.336989
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.26261489189037845, 'ffn_dropout': 0.14875894019199726, 'lr': 8.26032224968283e-05, 'weight_decay': 0.07403655957298266, 'batch_size': 128}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:06:51,340] Trial 90 pruned. 
+
+================================================================================
+Trial 90 완료
+  Value (CSI): 0.114837
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.22609452963278073, 'ffn_dropout': 0.10537285661488736, 'lr': 0.0003461901495593995, 'weight_decay': 0.02251828113503891, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:08:28,007] Trial 91 pruned. 
+
+================================================================================
+Trial 91 완료
+  Value (CSI): 0.380096
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3025284403584919, 'ffn_dropout': 0.12564494381562907, 'lr': 9.721791504287365e-05, 'weight_decay': 0.06310948408287001, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:09:39,336] Trial 92 pruned. 
+
+================================================================================
+Trial 92 완료
+  Value (CSI): 0.379147
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3139911193746904, 'ffn_dropout': 0.16205379454717653, 'lr': 0.0001394609257230219, 'weight_decay': 0.04211238081061817, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:10:22,388] Trial 93 pruned. 
+
+================================================================================
+Trial 93 완료
+  Value (CSI): 0.272601
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.26681972993130537, 'ffn_dropout': 0.1343291688353294, 'lr': 6.615457016506832e-05, 'weight_decay': 0.05180702780280516, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:10:57,249] Trial 94 pruned. 
+
+================================================================================
+Trial 94 완료
+  Value (CSI): 0.260993
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2782996358791965, 'ffn_dropout': 0.15378044592427076, 'lr': 0.00012275021944088482, 'weight_decay': 0.03164396623629694, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:11:53,403] Trial 95 pruned. 
+
+================================================================================
+Trial 95 완료
+  Value (CSI): 0.372941
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.24141893745567022, 'ffn_dropout': 0.17175610027786212, 'lr': 8.302066783097746e-05, 'weight_decay': 0.07066763621481499, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:12:41,802] Trial 96 pruned. 
+
+================================================================================
+Trial 96 완료
+  Value (CSI): 0.252276
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.25036001393024215, 'ffn_dropout': 0.14795508754920153, 'lr': 0.00019038525306239407, 'weight_decay': 0.09240520501938326, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+[I 2025-12-25 02:13:01,726] Trial 97 pruned. 
+
+================================================================================
+Trial 97 완료
+  Value (CSI): 0.275538
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2845467794557007, 'ffn_dropout': 0.11416709168310722, 'lr': 5.656401600299793e-05, 'weight_decay': 0.02727770526964544, 'batch_size': 64}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+  Fold 3 - 클래스별 가중치: {0: 177.21212121212122, 1: 9.779264214046822, 2: 0.3457695263998108} (클래스별 샘플 수: {0: 33, 1: 598, 2: 16913})
+[I 2025-12-25 02:16:03,848] Trial 98 pruned. 
+
+================================================================================
+Trial 98 완료
+  Value (CSI): 0.387275
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2716837436337158, 'ffn_dropout': 0.18478747522353028, 'lr': 9.772918180337497e-05, 'weight_decay': 0.038987460176003914, 'batch_size': 32}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 171.76470588235293, 1: 6.460176991150442, 2: 0.3521891207333253} (클래스별 샘플 수: {0: 34, 1: 904, 2: 16582})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 8.213483146067416, 2: 0.34803308932928645} (클래스별 샘플 수: {0: 29, 1: 712, 2: 16803})
+[I 2025-12-25 02:16:33,144] Trial 99 pruned. 
+
+================================================================================
+Trial 99 완료
+  Value (CSI): 0.305944
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25336969552014654, 'ffn_dropout': 0.14221517883832288, 'lr': 0.00020935430753702875, 'weight_decay': 0.08478436951388278, 'batch_size': 256}
+  Best Value (CSI): 0.384659
+  Best Trial: 25
+  Best Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+================================================================================
+
+
+최적화 완료.
+Best CSI Score: 0.3847
+Best Hyperparameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2747124536980523, 'ffn_dropout': 0.1909754518903343, 'lr': 0.00016739997447268043, 'weight_decay': 0.027811856175591093, 'batch_size': 32}
+
+최적화 과정 요약:
+  - 총 시도 횟수: 100
+  - 성공한 시도: 100
+  - 최초 CSI: 0.2964
+  - 최종 CSI: 0.3059
+  - 최고 CSI: 0.3986
+  - 최저 CSI: 0.0000
+  - 평균 CSI: 0.2966
+
+최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_pure_daegu_trials.pkl에 저장되었습니다.
+
+==================================================
+최적화된 하이퍼파라미터로 최종 모델 학습 시작
+==================================================
+최종 모델 학습 시작...
+Fold 1 학습 중...
+  Early stopping at epoch 15, Best CSI: 0.2853
+  Fold 1 학습 완료 (검증 CSI: 0.2853)
+Fold 2 학습 중...
+  Early stopping at epoch 25, Best CSI: 0.3728
+  Fold 2 학습 완료 (검증 CSI: 0.3728)
+Fold 3 학습 중...
+  Early stopping at epoch 28, Best CSI: 0.3885
+  Fold 3 학습 완료 (검증 CSI: 0.3885)
+
+모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_pure_daegu.pkl (총 3개 fold)
+Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_pure_daegu_scaler.pkl (총 3개 fold)
+
+최종 모델 학습 및 저장 완료!
+저장된 모델 경로:
+  - .
+  - .
+  - /
+  - s
+  - a
+  - v
+  - e
+  - _
+  - m
+  - o
+  - d
+  - e
+  - l
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - o
+  - p
+  - t
+  - i
+  - m
+  - a
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - p
+  - u
+  - r
+  - e
+  - _
+  - d
+  - a
+  - e
+  - g
+  - u
+  - .
+  - p
+  - k
+  - l
+
+✓ 완료: ft_transformer_pure/ft_transforemer_pure_daegu.py (소요 시간: 8139초)
+
+----------------------------------------
+실행 중: ft_transformer_pure/ft_transforemer_pure_daejeon.py
+시작 시간: 2025-12-25 02:18:41
+----------------------------------------
+[I 2025-12-25 02:18:42,941] A new study created in memory with name: no-name-4f7668f7-8d36-4c4b-9ba4-8fe54d832213
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:19:13,816] Trial 0 finished with value: 0.13030681079890966 and parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.386205863505391, 'ffn_dropout': 0.2521012318195598, 'lr': 0.0027508036764389253, 'weight_decay': 0.0013064873456425207, 'batch_size': 256}. Best is trial 0 with value: 0.13030681079890966.
+
+================================================================================
+Trial 0 완료
+  Value (CSI): 0.130307
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.386205863505391, 'ffn_dropout': 0.2521012318195598, 'lr': 0.0027508036764389253, 'weight_decay': 0.0013064873456425207, 'batch_size': 256}
+  Best Value (CSI): 0.130307
+  Best Trial: 0
+  Best Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.386205863505391, 'ffn_dropout': 0.2521012318195598, 'lr': 0.0027508036764389253, 'weight_decay': 0.0013064873456425207, 'batch_size': 256}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:19:52,823] Trial 1 finished with value: 0.3391544553633025 and parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3219789740376229, 'ffn_dropout': 0.25267947395532514, 'lr': 0.0008600496582725825, 'weight_decay': 0.004994230377148241, 'batch_size': 128}. Best is trial 1 with value: 0.3391544553633025.
+
+================================================================================
+Trial 1 완료
+  Value (CSI): 0.339154
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3219789740376229, 'ffn_dropout': 0.25267947395532514, 'lr': 0.0008600496582725825, 'weight_decay': 0.004994230377148241, 'batch_size': 128}
+  Best Value (CSI): 0.339154
+  Best Trial: 1
+  Best Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3219789740376229, 'ffn_dropout': 0.25267947395532514, 'lr': 0.0008600496582725825, 'weight_decay': 0.004994230377148241, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:22:38,669] Trial 2 finished with value: 0.30718642597208246 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39398100656571566, 'ffn_dropout': 0.3938950592277768, 'lr': 1.7473639861546465e-05, 'weight_decay': 0.0005937886556325067, 'batch_size': 64}. Best is trial 1 with value: 0.3391544553633025.
+
+================================================================================
+Trial 2 완료
+  Value (CSI): 0.307186
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.39398100656571566, 'ffn_dropout': 0.3938950592277768, 'lr': 1.7473639861546465e-05, 'weight_decay': 0.0005937886556325067, 'batch_size': 64}
+  Best Value (CSI): 0.339154
+  Best Trial: 1
+  Best Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3219789740376229, 'ffn_dropout': 0.25267947395532514, 'lr': 0.0008600496582725825, 'weight_decay': 0.004994230377148241, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:24:25,039] Trial 3 finished with value: 0.44855934612463416 and parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}. Best is trial 3 with value: 0.44855934612463416.
+
+================================================================================
+Trial 3 완료
+  Value (CSI): 0.448559
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:27:40,249] Trial 4 finished with value: 0.42406414036846246 and parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29944198514797504, 'ffn_dropout': 0.17765690689159946, 'lr': 3.306077243763879e-05, 'weight_decay': 0.000780374193213055, 'batch_size': 64}. Best is trial 3 with value: 0.44855934612463416.
+
+================================================================================
+Trial 4 완료
+  Value (CSI): 0.424064
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29944198514797504, 'ffn_dropout': 0.17765690689159946, 'lr': 3.306077243763879e-05, 'weight_decay': 0.000780374193213055, 'batch_size': 64}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:27:57,810] Trial 5 pruned. 
+
+================================================================================
+Trial 5 완료
+  Value (CSI): 0.310465
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.19805755987150375, 'ffn_dropout': 0.1757244411044384, 'lr': 1.556712595249609e-05, 'weight_decay': 0.0007577872222493627, 'batch_size': 128}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:28:21,428] Trial 6 pruned. 
+
+================================================================================
+Trial 6 완료
+  Value (CSI): 0.335178
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.21016204032170777, 'ffn_dropout': 0.27014975084639836, 'lr': 6.875008575947255e-05, 'weight_decay': 0.0006885662915962751, 'batch_size': 64}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:28:46,223] Trial 7 pruned. 
+
+================================================================================
+Trial 7 완료
+  Value (CSI): 0.338322
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.28833099039090293, 'ffn_dropout': 0.12745887007797477, 'lr': 0.001323999389868429, 'weight_decay': 0.02923603888342883, 'batch_size': 128}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:29:16,474] Trial 8 pruned. 
+
+================================================================================
+Trial 8 완료
+  Value (CSI): 0.275100
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3620071144212412, 'ffn_dropout': 0.10877837624069653, 'lr': 0.0004984077953127111, 'weight_decay': 0.008771934343919804, 'batch_size': 64}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:29:22,016] Trial 9 pruned. 
+
+================================================================================
+Trial 9 완료
+  Value (CSI): 0.154831
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.37462323470489955, 'ffn_dropout': 0.21868120187732437, 'lr': 2.0436795328702492e-05, 'weight_decay': 0.0030175359299820493, 'batch_size': 128}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:29:47,226] Trial 10 pruned. 
+
+================================================================================
+Trial 10 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1118827660045983, 'ffn_dropout': 0.3173360589175065, 'lr': 0.006415415752176818, 'weight_decay': 0.00010169291389718093, 'batch_size': 32}
+  Best Value (CSI): 0.448559
+  Best Trial: 3
+  Best Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22250020483695154, 'ffn_dropout': 0.24855846298418743, 'lr': 0.0009474576937825958, 'weight_decay': 0.003135324345742673, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:34:01,612] Trial 11 finished with value: 0.4608644130883877 and parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}. Best is trial 11 with value: 0.4608644130883877.
+
+================================================================================
+Trial 11 완료
+  Value (CSI): 0.460864
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+  Best Value (CSI): 0.460864
+  Best Trial: 11
+  Best Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:38:02,074] Trial 12 finished with value: 0.4544232442299096 and parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.24545849623176033, 'ffn_dropout': 0.19251250339764825, 'lr': 0.0001665216869025282, 'weight_decay': 0.09239819754180736, 'batch_size': 64}. Best is trial 11 with value: 0.4608644130883877.
+
+================================================================================
+Trial 12 완료
+  Value (CSI): 0.454423
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.24545849623176033, 'ffn_dropout': 0.19251250339764825, 'lr': 0.0001665216869025282, 'weight_decay': 0.09239819754180736, 'batch_size': 64}
+  Best Value (CSI): 0.460864
+  Best Trial: 11
+  Best Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:44:57,228] Trial 13 finished with value: 0.45503965265223134 and parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2690310855371136, 'ffn_dropout': 0.16561062431898876, 'lr': 0.0001453353396907857, 'weight_decay': 0.07596215382887424, 'batch_size': 32}. Best is trial 11 with value: 0.4608644130883877.
+
+================================================================================
+Trial 13 완료
+  Value (CSI): 0.455040
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2690310855371136, 'ffn_dropout': 0.16561062431898876, 'lr': 0.0001453353396907857, 'weight_decay': 0.07596215382887424, 'batch_size': 32}
+  Best Value (CSI): 0.460864
+  Best Trial: 11
+  Best Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+[I 2025-12-25 02:48:43,893] Trial 14 pruned. 
+
+================================================================================
+Trial 14 완료
+  Value (CSI): 0.477273
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.27548623024746627, 'ffn_dropout': 0.15723909007738684, 'lr': 0.00012817458554516893, 'weight_decay': 0.07211967061898854, 'batch_size': 32}
+  Best Value (CSI): 0.460864
+  Best Trial: 11
+  Best Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 02:54:23,242] Trial 15 pruned. 
+
+================================================================================
+Trial 15 완료
+  Value (CSI): 0.468015
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.33666782795390526, 'ffn_dropout': 0.14123400391830365, 'lr': 0.00027647939463135536, 'weight_decay': 0.028441460889922228, 'batch_size': 32}
+  Best Value (CSI): 0.460864
+  Best Trial: 11
+  Best Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 02:54:29,833] Trial 16 pruned. 
+
+================================================================================
+Trial 16 완료
+  Value (CSI): 0.298980
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2597136985155452, 'ffn_dropout': 0.10306357961808336, 'lr': 6.648547577292476e-05, 'weight_decay': 0.03969365247771782, 'batch_size': 256}
+  Best Value (CSI): 0.460864
+  Best Trial: 11
+  Best Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25975648216177644, 'ffn_dropout': 0.17542324756869107, 'lr': 0.0001396476058783493, 'weight_decay': 0.09839404123936313, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 03:01:34,108] Trial 17 finished with value: 0.46122600267823205 and parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}. Best is trial 17 with value: 0.46122600267823205.
+
+================================================================================
+Trial 17 완료
+  Value (CSI): 0.461226
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+  Best Value (CSI): 0.461226
+  Best Trial: 17
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:02:41,546] Trial 18 pruned. 
+
+================================================================================
+Trial 18 완료
+  Value (CSI): 0.350515
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3168485196408837, 'ffn_dropout': 0.13343450116726494, 'lr': 0.0005757295357987116, 'weight_decay': 0.014904174244906926, 'batch_size': 32}
+  Best Value (CSI): 0.461226
+  Best Trial: 17
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:02:48,108] Trial 19 pruned. 
+
+================================================================================
+Trial 19 완료
+  Value (CSI): 0.306775
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.35825597872308906, 'ffn_dropout': 0.20074858502807807, 'lr': 0.0003116589866826082, 'weight_decay': 0.017198858782809124, 'batch_size': 256}
+  Best Value (CSI): 0.461226
+  Best Trial: 17
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:04:15,393] Trial 20 pruned. 
+
+================================================================================
+Trial 20 완료
+  Value (CSI): 0.362921
+  Parameters: {'d_token': 192, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3349950282653754, 'ffn_dropout': 0.15312756013636863, 'lr': 5.634856046589454e-05, 'weight_decay': 0.04433450215033534, 'batch_size': 32}
+  Best Value (CSI): 0.461226
+  Best Trial: 17
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 03:10:29,420] Trial 21 finished with value: 0.447830789557824 and parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2782528079118694, 'ffn_dropout': 0.16037319675253303, 'lr': 0.00014711697045364033, 'weight_decay': 0.09875039751362177, 'batch_size': 32}. Best is trial 17 with value: 0.46122600267823205.
+
+================================================================================
+Trial 21 완료
+  Value (CSI): 0.447831
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2782528079118694, 'ffn_dropout': 0.16037319675253303, 'lr': 0.00014711697045364033, 'weight_decay': 0.09875039751362177, 'batch_size': 32}
+  Best Value (CSI): 0.461226
+  Best Trial: 17
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:11:43,626] Trial 22 pruned. 
+
+================================================================================
+Trial 22 완료
+  Value (CSI): 0.359792
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.249201046305229, 'ffn_dropout': 0.21164493507004215, 'lr': 0.00022113220881700202, 'weight_decay': 0.05205012145541569, 'batch_size': 32}
+  Best Value (CSI): 0.461226
+  Best Trial: 17
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.30795563768884227, 'ffn_dropout': 0.15517610487893013, 'lr': 0.0003222776334143166, 'weight_decay': 0.08132868611741094, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 03:18:27,139] Trial 23 finished with value: 0.4650483385119633 and parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 23 완료
+  Value (CSI): 0.465048
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:19:33,055] Trial 24 pruned. 
+
+================================================================================
+Trial 24 완료
+  Value (CSI): 0.374922
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3083242923260655, 'ffn_dropout': 0.12875641739552787, 'lr': 0.00037044929466205405, 'weight_decay': 0.052543783586070536, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:20:33,731] Trial 25 pruned. 
+
+================================================================================
+Trial 25 완료
+  Value (CSI): 0.340400
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.29695464430191476, 'ffn_dropout': 0.18140145890848025, 'lr': 7.722357609573937e-05, 'weight_decay': 0.09504432028645285, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:20:53,245] Trial 26 pruned. 
+
+================================================================================
+Trial 26 완료
+  Value (CSI): 0.326159
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3368158295522806, 'ffn_dropout': 0.21841261519222804, 'lr': 0.00010667769129379456, 'weight_decay': 0.021900839706615265, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:20:59,111] Trial 27 pruned. 
+
+================================================================================
+Trial 27 완료
+  Value (CSI): 0.196105
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29086679444899766, 'ffn_dropout': 0.19209551573668684, 'lr': 3.829192828823051e-05, 'weight_decay': 0.04914597364594219, 'batch_size': 256}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:22:07,010] Trial 28 pruned. 
+
+================================================================================
+Trial 28 완료
+  Value (CSI): 0.370044
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.23625560793188388, 'ffn_dropout': 0.11802183847106702, 'lr': 0.00021284049168924664, 'weight_decay': 0.03118335078716931, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:22:14,280] Trial 29 pruned. 
+
+================================================================================
+Trial 29 완료
+  Value (CSI): 0.262770
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.26469890318248807, 'ffn_dropout': 0.1478267110960241, 'lr': 0.00010277233896130291, 'weight_decay': 0.05888817107606561, 'batch_size': 256}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:22:30,707] Trial 30 pruned. 
+
+================================================================================
+Trial 30 완료
+  Value (CSI): 0.331861
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.39648666739833827, 'ffn_dropout': 0.14034876522758272, 'lr': 0.00039617690740969365, 'weight_decay': 0.016702442882228948, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:23:47,690] Trial 31 pruned. 
+
+================================================================================
+Trial 31 완료
+  Value (CSI): 0.371935
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.27671875779592975, 'ffn_dropout': 0.17170602666153917, 'lr': 0.0002056998795335358, 'weight_decay': 0.06972595790011288, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+[I 2025-12-25 03:28:08,574] Trial 32 pruned. 
+
+================================================================================
+Trial 32 완료
+  Value (CSI): 0.479452
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3139333004984618, 'ffn_dropout': 0.16184792190716438, 'lr': 0.00013720637040861447, 'weight_decay': 0.07388944594720782, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+[I 2025-12-25 03:32:09,936] Trial 33 pruned. 
+
+================================================================================
+Trial 33 완료
+  Value (CSI): 0.484015
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2560772432994428, 'ffn_dropout': 0.10939491480278664, 'lr': 0.0002684907548100298, 'weight_decay': 0.03316332949972466, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:32:47,271] Trial 34 pruned. 
+
+================================================================================
+Trial 34 완료
+  Value (CSI): 0.277081
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3254085183083442, 'ffn_dropout': 0.16345816548842246, 'lr': 0.0006249853373731823, 'weight_decay': 0.09486827853352472, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:33:00,031] Trial 35 pruned. 
+
+================================================================================
+Trial 35 완료
+  Value (CSI): 0.310021
+  Parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3021966932597069, 'ffn_dropout': 0.14183973781074632, 'lr': 9.48032977101479e-05, 'weight_decay': 0.05691430113336231, 'batch_size': 128}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 03:35:46,712] Trial 36 finished with value: 0.4642646660986382 and parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2267342240802674, 'ffn_dropout': 0.17776218943120453, 'lr': 0.00014945776087991092, 'weight_decay': 0.04209109124699349, 'batch_size': 64}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 36 완료
+  Value (CSI): 0.464265
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2267342240802674, 'ffn_dropout': 0.17776218943120453, 'lr': 0.00014945776087991092, 'weight_decay': 0.04209109124699349, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:36:00,971] Trial 37 pruned. 
+
+================================================================================
+Trial 37 완료
+  Value (CSI): 0.340782
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.22310753923366405, 'ffn_dropout': 0.2366885832268742, 'lr': 4.72739974390631e-05, 'weight_decay': 0.0381473757277536, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:36:16,258] Trial 38 pruned. 
+
+================================================================================
+Trial 38 완료
+  Value (CSI): 0.267510
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23154941805813725, 'ffn_dropout': 0.18007574505785867, 'lr': 0.0007815302366605472, 'weight_decay': 0.024648361380013688, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:36:32,944] Trial 39 pruned. 
+
+================================================================================
+Trial 39 완료
+  Value (CSI): 0.337692
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.18997172703916282, 'ffn_dropout': 0.12269600481738505, 'lr': 8.840676217976613e-05, 'weight_decay': 0.012239733588227808, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:36:45,969] Trial 40 pruned. 
+
+================================================================================
+Trial 40 완료
+  Value (CSI): 0.235294
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2132537142418937, 'ffn_dropout': 0.18948056996187362, 'lr': 1.0277654099186322e-05, 'weight_decay': 0.04198576118747863, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:37:21,830] Trial 41 pruned. 
+
+================================================================================
+Trial 41 완료
+  Value (CSI): 0.377049
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2688947285786729, 'ffn_dropout': 0.16909607415704322, 'lr': 0.0001686533967450979, 'weight_decay': 0.06880858422708143, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:37:29,898] Trial 42 pruned. 
+
+================================================================================
+Trial 42 완료
+  Value (CSI): 0.281220
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.28376121656142994, 'ffn_dropout': 0.2039230154593726, 'lr': 0.0003846940557574178, 'weight_decay': 0.06732831646904867, 'batch_size': 128}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:37:46,745] Trial 43 pruned. 
+
+================================================================================
+Trial 43 완료
+  Value (CSI): 0.289284
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2922063791799537, 'ffn_dropout': 0.17130344255008872, 'lr': 0.00012896728075348615, 'weight_decay': 0.09387395241889032, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:39:03,005] Trial 44 pruned. 
+
+================================================================================
+Trial 44 완료
+  Value (CSI): 0.368804
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.24779733311726734, 'ffn_dropout': 0.1496796279205009, 'lr': 0.00019194665161242235, 'weight_decay': 0.03801390056485421, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:39:20,293] Trial 45 pruned. 
+
+================================================================================
+Trial 45 완료
+  Value (CSI): 0.302181
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3018090314684446, 'ffn_dropout': 0.18430615012418222, 'lr': 0.0002457447444210661, 'weight_decay': 0.06807761318857905, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:41:32,358] Trial 46 pruned. 
+
+================================================================================
+Trial 46 완료
+  Value (CSI): 0.359897
+  Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.26633486691424757, 'ffn_dropout': 0.19250259517936447, 'lr': 7.500280999472191e-05, 'weight_decay': 0.02337184932874585, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:41:41,479] Trial 47 pruned. 
+
+================================================================================
+Trial 47 완료
+  Value (CSI): 0.323324
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2806351346715156, 'ffn_dropout': 0.226624156725439, 'lr': 0.00015568304168309753, 'weight_decay': 0.05164813934853537, 'batch_size': 128}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:42:02,229] Trial 48 pruned. 
+
+================================================================================
+Trial 48 완료
+  Value (CSI): 0.273614
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.25786968372896785, 'ffn_dropout': 0.15319509343093857, 'lr': 0.00046108085754404104, 'weight_decay': 0.0058039311496743086, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:43:25,518] Trial 49 pruned. 
+
+================================================================================
+Trial 49 완료
+  Value (CSI): 0.348887
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.32245683685099713, 'ffn_dropout': 0.13266268562229994, 'lr': 0.000274059808714681, 'weight_decay': 0.032735009865683604, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:43:30,792] Trial 50 pruned. 
+
+================================================================================
+Trial 50 완료
+  Value (CSI): 0.250676
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2355664353006523, 'ffn_dropout': 0.20479045910321175, 'lr': 0.00011761115263079321, 'weight_decay': 0.07926097430809213, 'batch_size': 256}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:43:52,303] Trial 51 pruned. 
+
+================================================================================
+Trial 51 완료
+  Value (CSI): 0.324264
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25012746612917475, 'ffn_dropout': 0.17439271051675012, 'lr': 0.00016861565661898862, 'weight_decay': 0.09542170809947026, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:44:13,877] Trial 52 pruned. 
+
+================================================================================
+Trial 52 완료
+  Value (CSI): 0.324161
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2714804182618546, 'ffn_dropout': 0.1977181495745457, 'lr': 0.0003329047428454063, 'weight_decay': 0.04611552003129593, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:44:35,349] Trial 53 pruned. 
+
+================================================================================
+Trial 53 완료
+  Value (CSI): 0.285921
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2860687540004463, 'ffn_dropout': 0.1860297868175671, 'lr': 5.5885885311342984e-05, 'weight_decay': 0.09815781078408395, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:44:57,132] Trial 54 pruned. 
+
+================================================================================
+Trial 54 완료
+  Value (CSI): 0.330539
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.24042973518770833, 'ffn_dropout': 0.1627467129097943, 'lr': 0.00012461258035902429, 'weight_decay': 0.05570639594115275, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:45:39,360] Trial 55 pruned. 
+
+================================================================================
+Trial 55 완료
+  Value (CSI): 0.340473
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.19966882373520395, 'ffn_dropout': 0.15571034975654957, 'lr': 0.0001767141784803544, 'weight_decay': 0.07062711898044698, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:46:30,693] Trial 56 pruned. 
+
+================================================================================
+Trial 56 완료
+  Value (CSI): 0.369610
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.3009506500304082, 'ffn_dropout': 0.20998784941379028, 'lr': 9.168123099955834e-05, 'weight_decay': 0.04225848645453474, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:47:03,225] Trial 57 pruned. 
+
+================================================================================
+Trial 57 완료
+  Value (CSI): 0.347245
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2599271083912196, 'ffn_dropout': 0.17786934680411398, 'lr': 0.0002407116435874551, 'weight_decay': 0.07856157509887263, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 03:50:24,672] Trial 58 pruned. 
+
+================================================================================
+Trial 58 완료
+  Value (CSI): 0.441115
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24503427068562, 'ffn_dropout': 0.19786768781080466, 'lr': 6.914514615963278e-05, 'weight_decay': 0.026846020984466923, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:50:36,089] Trial 59 pruned. 
+
+================================================================================
+Trial 59 완료
+  Value (CSI): 0.304866
+  Parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2713899385322525, 'ffn_dropout': 0.1463708110951466, 'lr': 0.00030777945944062687, 'weight_decay': 0.057402331008289835, 'batch_size': 256}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:50:47,557] Trial 60 pruned. 
+
+================================================================================
+Trial 60 완료
+  Value (CSI): 0.312400
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3107669270478937, 'ffn_dropout': 0.1325496726545791, 'lr': 0.00014154114043603622, 'weight_decay': 0.035094361370802366, 'batch_size': 128}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:51:01,630] Trial 61 pruned. 
+
+================================================================================
+Trial 61 완료
+  Value (CSI): 0.332020
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.23304132726344665, 'ffn_dropout': 0.2652634598153322, 'lr': 0.0010725729988811882, 'weight_decay': 0.07810436958043124, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:51:14,217] Trial 62 pruned. 
+
+================================================================================
+Trial 62 완료
+  Value (CSI): 0.155522
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22188416187291823, 'ffn_dropout': 0.1673111187969517, 'lr': 0.0019067768628427148, 'weight_decay': 0.0023486968560448365, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:51:31,161] Trial 63 pruned. 
+
+================================================================================
+Trial 63 완료
+  Value (CSI): 0.328714
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.28806932251388995, 'ffn_dropout': 0.21694043201515065, 'lr': 0.00021090188777624395, 'weight_decay': 0.05863602403780413, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+[I 2025-12-25 03:54:54,222] Trial 64 pruned. 
+
+================================================================================
+Trial 64 완료
+  Value (CSI): 0.475515
+  Parameters: {'d_token': 128, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25580926494778866, 'ffn_dropout': 0.1893877174250361, 'lr': 0.0005117996815384344, 'weight_decay': 0.09827447110989218, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:55:16,788] Trial 65 pruned. 
+
+================================================================================
+Trial 65 완료
+  Value (CSI): 0.318079
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.24327397506052878, 'ffn_dropout': 0.2282766586390969, 'lr': 0.00011473685724022373, 'weight_decay': 0.04412703184916589, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:56:49,942] Trial 66 pruned. 
+
+================================================================================
+Trial 66 완료
+  Value (CSI): 0.367548
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2781440562549066, 'ffn_dropout': 0.17927609472545594, 'lr': 0.0001823514967917349, 'weight_decay': 0.018710671992557666, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:57:16,284] Trial 67 pruned. 
+
+================================================================================
+Trial 67 완료
+  Value (CSI): 0.331986
+  Parameters: {'d_token': 192, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2247585207775954, 'ffn_dropout': 0.15763024285904298, 'lr': 0.00032469137104025646, 'weight_decay': 0.029378158740838673, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:58:19,637] Trial 68 pruned. 
+
+================================================================================
+Trial 68 완료
+  Value (CSI): 0.348939
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2095833130230336, 'ffn_dropout': 0.3038196487912499, 'lr': 8.814998763564693e-05, 'weight_decay': 0.08215820979744469, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:58:41,218] Trial 69 pruned. 
+
+================================================================================
+Trial 69 완료
+  Value (CSI): 0.331621
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2629930125134808, 'ffn_dropout': 0.13976456874887552, 'lr': 0.00040592320621973886, 'weight_decay': 0.049725975156648276, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 03:58:45,940] Trial 70 pruned. 
+
+================================================================================
+Trial 70 완료
+  Value (CSI): 0.252427
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.29519081247493917, 'ffn_dropout': 0.1694399179567708, 'lr': 0.0002516582573227136, 'weight_decay': 0.06351460520348687, 'batch_size': 256}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:00:40,606] Trial 71 pruned. 
+
+================================================================================
+Trial 71 완료
+  Value (CSI): 0.374476
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2817266472143714, 'ffn_dropout': 0.16429902684217892, 'lr': 0.00014093098634472743, 'weight_decay': 0.07999560217027929, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:01:21,883] Trial 72 pruned. 
+
+================================================================================
+Trial 72 완료
+  Value (CSI): 0.341886
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3079290041872924, 'ffn_dropout': 0.15601313848273946, 'lr': 0.00010563620972163942, 'weight_decay': 0.09640854342029524, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:08:44,734] Trial 73 pruned. 
+
+================================================================================
+Trial 73 완료
+  Value (CSI): 0.486863
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2739261336957577, 'ffn_dropout': 0.17970319493498682, 'lr': 0.0001540692100227186, 'weight_decay': 0.06163027826998439, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:15:05,025] Trial 74 finished with value: 0.45084682206272 and parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.254294788049956, 'ffn_dropout': 0.14426501906887468, 'lr': 0.0006481679430742509, 'weight_decay': 0.08023295949616388, 'batch_size': 32}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 74 완료
+  Value (CSI): 0.450847
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.254294788049956, 'ffn_dropout': 0.14426501906887468, 'lr': 0.0006481679430742509, 'weight_decay': 0.08023295949616388, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:16:26,811] Trial 75 pruned. 
+
+================================================================================
+Trial 75 완료
+  Value (CSI): 0.356407
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25183578043329835, 'ffn_dropout': 0.13855450251708706, 'lr': 0.0006060536526459364, 'weight_decay': 0.045816042098822014, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:17:41,772] Trial 76 pruned. 
+
+================================================================================
+Trial 76 완료
+  Value (CSI): 0.344933
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.24007507862757438, 'ffn_dropout': 0.12010206429559603, 'lr': 0.0002006325437943349, 'weight_decay': 0.08135095428397322, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:18:10,604] Trial 77 pruned. 
+
+================================================================================
+Trial 77 완료
+  Value (CSI): 0.082650
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2646620155993172, 'ffn_dropout': 0.1488778347770608, 'lr': 0.0007192668584792978, 'weight_decay': 0.05859609933240925, 'batch_size': 64}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:18:25,982] Trial 78 pruned. 
+
+================================================================================
+Trial 78 완료
+  Value (CSI): 0.082536
+  Parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2524945988719568, 'ffn_dropout': 0.1964030675677524, 'lr': 0.0009338675261970192, 'weight_decay': 0.03396228256508752, 'batch_size': 128}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:23:16,875] Trial 79 finished with value: 0.45436899533608077 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23049911574490933, 'ffn_dropout': 0.18651180572159953, 'lr': 0.00046304265762119235, 'weight_decay': 0.07104678540529988, 'batch_size': 32}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 79 완료
+  Value (CSI): 0.454369
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23049911574490933, 'ffn_dropout': 0.18651180572159953, 'lr': 0.00046304265762119235, 'weight_decay': 0.07104678540529988, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중���: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:28:12,866] Trial 80 finished with value: 0.45703343189295076 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23048347997977794, 'ffn_dropout': 0.18750289268007883, 'lr': 0.0004350734820522211, 'weight_decay': 0.0653742620045878, 'batch_size': 32}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 80 완료
+  Value (CSI): 0.457033
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23048347997977794, 'ffn_dropout': 0.18750289268007883, 'lr': 0.0004350734820522211, 'weight_decay': 0.0653742620045878, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:33:56,196] Trial 81 finished with value: 0.4589362380806823 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23056895756818988, 'ffn_dropout': 0.18363084583665082, 'lr': 0.0003520801513432133, 'weight_decay': 0.06854022758073623, 'batch_size': 32}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 81 완료
+  Value (CSI): 0.458936
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23056895756818988, 'ffn_dropout': 0.18363084583665082, 'lr': 0.0003520801513432133, 'weight_decay': 0.06854022758073623, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:38:22,237] Trial 82 finished with value: 0.45137134090178077 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2277988711061078, 'ffn_dropout': 0.18910326729218868, 'lr': 0.00046459903023809507, 'weight_decay': 0.06530866307332514, 'batch_size': 32}. Best is trial 23 with value: 0.4650483385119633.
+
+================================================================================
+Trial 82 완료
+  Value (CSI): 0.451371
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2277988711061078, 'ffn_dropout': 0.18910326729218868, 'lr': 0.00046459903023809507, 'weight_decay': 0.06530866307332514, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:39:11,937] Trial 83 pruned. 
+
+================================================================================
+Trial 83 완료
+  Value (CSI): 0.360759
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.21741321677041275, 'ffn_dropout': 0.1742847408178841, 'lr': 0.00031910126285560243, 'weight_decay': 0.03872939404967124, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:40:06,268] Trial 84 pruned. 
+
+================================================================================
+Trial 84 완료
+  Value (CSI): 0.368020
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23038860887623194, 'ffn_dropout': 0.20457748348696742, 'lr': 0.0003886599589877962, 'weight_decay': 0.05026247177175396, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:41:20,190] Trial 85 pruned. 
+
+================================================================================
+Trial 85 완료
+  Value (CSI): 0.359302
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23900258773488933, 'ffn_dropout': 0.1817370371032135, 'lr': 0.00023144407257019077, 'weight_decay': 0.06773121333296692, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:42:05,984] Trial 86 pruned. 
+
+================================================================================
+Trial 86 완료
+  Value (CSI): 0.351114
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2440255082736722, 'ffn_dropout': 0.19482772271381382, 'lr': 0.0002897827063436645, 'weight_decay': 0.08526981779290388, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:42:57,196] Trial 87 pruned. 
+
+================================================================================
+Trial 87 완료
+  Value (CSI): 0.355063
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2102239351904792, 'ffn_dropout': 0.17238251374068608, 'lr': 0.00018442575735323118, 'weight_decay': 0.05161089413515312, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:43:41,033] Trial 88 pruned. 
+
+================================================================================
+Trial 88 완료
+  Value (CSI): 0.347083
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23591535431740157, 'ffn_dropout': 0.18324525962295476, 'lr': 0.0002684960425505086, 'weight_decay': 0.06823455246625137, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:45:02,178] Trial 89 pruned. 
+
+================================================================================
+Trial 89 완료
+  Value (CSI): 0.362025
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.22124391463619042, 'ffn_dropout': 0.16402091374871258, 'lr': 0.0005374059841365807, 'weight_decay': 0.08574377426892478, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:45:37,365] Trial 90 pruned. 
+
+================================================================================
+Trial 90 완료
+  Value (CSI): 0.344181
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2294479440288413, 'ffn_dropout': 0.18754713859844455, 'lr': 0.0004556684256290737, 'weight_decay': 0.03922819137266111, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:46:24,972] Trial 91 pruned. 
+
+================================================================================
+Trial 91 완료
+  Value (CSI): 0.338005
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.23018718229928498, 'ffn_dropout': 0.19173044585955154, 'lr': 0.0004554765120727365, 'weight_decay': 0.06250498689640645, 'batch_size': 32}
+  Best Value (CSI): 0.465048
+  Best Trial: 23
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.3015737494021433, 'ffn_dropout': 0.17734984362677814, 'lr': 0.00013586839992305125, 'weight_decay': 0.09844215442969696, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+  Fold 2 - 클래스별 가중치: {0: 50.41379310344828, 1: 3.417884278199883, 2: 0.3720811859769676} (클래스별 샘플 수: {0: 116, 1: 1711, 2: 15717})
+  Fold 3 - 클래스별 가중치: {0: 68.8, 1: 3.4913432835820895, 2: 0.3705017739483021} (클래스별 샘플 수: {0: 85, 1: 1675, 2: 15784})
+[I 2025-12-25 04:51:37,352] Trial 92 finished with value: 0.4655886251588111 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}. Best is trial 92 with value: 0.4655886251588111.
+
+================================================================================
+Trial 92 완료
+  Value (CSI): 0.465589
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:52:36,462] Trial 93 pruned. 
+
+================================================================================
+Trial 93 완료
+  Value (CSI): 0.356669
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24695528939520603, 'ffn_dropout': 0.2016898494693985, 'lr': 0.0003733027099291986, 'weight_decay': 0.07429823282039537, 'batch_size': 32}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:53:57,074] Trial 94 pruned. 
+
+================================================================================
+Trial 94 완료
+  Value (CSI): 0.370327
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.25947391435271694, 'ffn_dropout': 0.1749487831150375, 'lr': 0.0002210614647830701, 'weight_decay': 0.09700864977530034, 'batch_size': 32}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:54:58,944] Trial 95 pruned. 
+
+================================================================================
+Trial 95 완료
+  Value (CSI): 0.379261
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2698824138408282, 'ffn_dropout': 0.20932226869786041, 'lr': 0.00016027051213687697, 'weight_decay': 0.05149181775473954, 'batch_size': 32}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:55:04,775] Trial 96 pruned. 
+
+================================================================================
+Trial 96 완료
+  Value (CSI): 0.266927
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24681916906843834, 'ffn_dropout': 0.15925528603733935, 'lr': 0.00034283130668631386, 'weight_decay': 0.07449417472487424, 'batch_size': 256}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:56:28,619] Trial 97 pruned. 
+
+================================================================================
+Trial 97 완료
+  Value (CSI): 0.359033
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2377925004208892, 'ffn_dropout': 0.1668042973311131, 'lr': 0.00012959502864005269, 'weight_decay': 0.09953493546155284, 'batch_size': 32}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:56:38,850] Trial 98 pruned. 
+
+================================================================================
+Trial 98 완료
+  Value (CSI): 0.310256
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2900582142320236, 'ffn_dropout': 0.18577243562412113, 'lr': 0.0002830984196360623, 'weight_decay': 0.043690195208951836, 'batch_size': 128}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 40.275862068965516, 1: 3.0196483971044468, 2: 0.378213846253481} (클래스별 샘플 수: {0: 145, 1: 1934, 2: 15441})
+[I 2025-12-25 04:57:27,231] Trial 99 pruned. 
+
+================================================================================
+Trial 99 완료
+  Value (CSI): 0.341162
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.26062911765607766, 'ffn_dropout': 0.1994652189335202, 'lr': 0.00019789603168893626, 'weight_decay': 0.060154853924075054, 'batch_size': 32}
+  Best Value (CSI): 0.465589
+  Best Trial: 92
+  Best Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+================================================================================
+
+
+최적화 완료.
+Best CSI Score: 0.4656
+Best Hyperparameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.24759508454949322, 'ffn_dropout': 0.2013907953941948, 'lr': 0.0003711331440914647, 'weight_decay': 0.06954769328501528, 'batch_size': 32}
+
+최적화 과정 요약:
+  - 총 시도 횟수: 100
+  - 성공한 시도: 100
+  - 최초 CSI: 0.1303
+  - 최종 CSI: 0.3412
+  - 최고 CSI: 0.4869
+  - 최저 CSI: 0.0000
+  - 평균 CSI: 0.3438
+
+최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_pure_daejeon_trials.pkl에 저장되었습니다.
+
+==================================================
+최적화된 하이퍼파라미터로 최종 모델 학습 시작
+==================================================
+최종 모델 학습 시작...
+Fold 1 학습 중...
+  Early stopping at epoch 18, Best CSI: 0.3766
+  Fold 1 학습 완료 (검증 CSI: 0.3766)
+Fold 2 학습 중...
+  Early stopping at epoch 37, Best CSI: 0.4943
+  Fold 2 학습 완료 (검증 CSI: 0.4943)
+Fold 3 학습 중...
+  Early stopping at epoch 49, Best CSI: 0.4778
+  Fold 3 학습 완료 (검증 CSI: 0.4778)
+
+모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_pure_daejeon.pkl (총 3개 fold)
+Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_pure_daejeon_scaler.pkl (총 3개 fold)
+
+최종 모델 학습 및 저장 완료!
+저장된 모델 경로:
+  - .
+  - .
+  - /
+  - s
+  - a
+  - v
+  - e
+  - _
+  - m
+  - o
+  - d
+  - e
+  - l
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - o
+  - p
+  - t
+  - i
+  - m
+  - a
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - p
+  - u
+  - r
+  - e
+  - _
+  - d
+  - a
+  - e
+  - j
+  - e
+  - o
+  - n
+  - .
+  - p
+  - k
+  - l
+
+✓ 완료: ft_transformer_pure/ft_transforemer_pure_daejeon.py (소요 시간: 9802초)
+
+----------------------------------------
+실행 중: ft_transformer_pure/ft_transforemer_pure_gwangju.py
+시작 시간: 2025-12-25 05:02:03
+----------------------------------------
+[I 2025-12-25 05:02:04,162] A new study created in memory with name: no-name-3a09f0a2-83d7-42d2-b634-d45b8354cf66
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:02:54,522] Trial 0 finished with value: 0.09711722395057353 and parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}. Best is trial 0 with value: 0.09711722395057353.
+
+================================================================================
+Trial 0 완료
+  Value (CSI): 0.097117
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}
+  Best Value (CSI): 0.097117
+  Best Trial: 0
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:04:40,253] Trial 1 finished with value: 0.09167591968793302 and parameters: {'d_token': 192, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2743178890378547, 'ffn_dropout': 0.30092594792497473, 'lr': 0.0020736408681141087, 'weight_decay': 0.0870661299358735, 'batch_size': 64}. Best is trial 0 with value: 0.09711722395057353.
+
+================================================================================
+Trial 1 완료
+  Value (CSI): 0.091676
+  Parameters: {'d_token': 192, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2743178890378547, 'ffn_dropout': 0.30092594792497473, 'lr': 0.0020736408681141087, 'weight_decay': 0.0870661299358735, 'batch_size': 64}
+  Best Value (CSI): 0.097117
+  Best Trial: 0
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:06:06,109] Trial 2 finished with value: 0.027373960548928197 and parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2026868471197999, 'ffn_dropout': 0.3025630197805988, 'lr': 0.003333344593317576, 'weight_decay': 0.03784694529277321, 'batch_size': 32}. Best is trial 0 with value: 0.09711722395057353.
+
+================================================================================
+Trial 2 완료
+  Value (CSI): 0.027374
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2026868471197999, 'ffn_dropout': 0.3025630197805988, 'lr': 0.003333344593317576, 'weight_decay': 0.03784694529277321, 'batch_size': 32}
+  Best Value (CSI): 0.097117
+  Best Trial: 0
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:07:52,978] Trial 3 finished with value: 0.08981917274635197 and parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12449588652198683, 'ffn_dropout': 0.3429009226079186, 'lr': 0.0022344600807863526, 'weight_decay': 0.0017879678345691476, 'batch_size': 32}. Best is trial 0 with value: 0.09711722395057353.
+
+================================================================================
+Trial 3 완료
+  Value (CSI): 0.089819
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12449588652198683, 'ffn_dropout': 0.3429009226079186, 'lr': 0.0022344600807863526, 'weight_decay': 0.0017879678345691476, 'batch_size': 32}
+  Best Value (CSI): 0.097117
+  Best Trial: 0
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:11:10,844] Trial 4 finished with value: 0.09167591968793302 and parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.39530548107743024, 'ffn_dropout': 0.33160374097830697, 'lr': 0.0069056782512902405, 'weight_decay': 0.04913392440897764, 'batch_size': 32}. Best is trial 0 with value: 0.09711722395057353.
+
+================================================================================
+Trial 4 완료
+  Value (CSI): 0.091676
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.39530548107743024, 'ffn_dropout': 0.33160374097830697, 'lr': 0.0069056782512902405, 'weight_decay': 0.04913392440897764, 'batch_size': 32}
+  Best Value (CSI): 0.097117
+  Best Trial: 0
+  Best Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.29262855180304015, 'ffn_dropout': 0.19893286521589182, 'lr': 0.0019623690950916596, 'weight_decay': 0.0001793027408356603, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:12:53,538] Trial 5 finished with value: 0.22204656660795327 and parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2914882522894078, 'ffn_dropout': 0.20783178249421266, 'lr': 0.00046747811127472214, 'weight_decay': 0.0772041002784932, 'batch_size': 64}. Best is trial 5 with value: 0.22204656660795327.
+
+================================================================================
+Trial 5 완료
+  Value (CSI): 0.222047
+  Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2914882522894078, 'ffn_dropout': 0.20783178249421266, 'lr': 0.00046747811127472214, 'weight_decay': 0.0772041002784932, 'batch_size': 64}
+  Best Value (CSI): 0.222047
+  Best Trial: 5
+  Best Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2914882522894078, 'ffn_dropout': 0.20783178249421266, 'lr': 0.00046747811127472214, 'weight_decay': 0.0772041002784932, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:15:57,879] Trial 6 finished with value: 0.024400425015178834 and parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.27408776402465795, 'ffn_dropout': 0.11814799828174796, 'lr': 0.0019215476581536828, 'weight_decay': 0.0016069884023401377, 'batch_size': 32}. Best is trial 5 with value: 0.22204656660795327.
+
+================================================================================
+Trial 6 완료
+  Value (CSI): 0.024400
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.27408776402465795, 'ffn_dropout': 0.11814799828174796, 'lr': 0.0019215476581536828, 'weight_decay': 0.0016069884023401377, 'batch_size': 32}
+  Best Value (CSI): 0.222047
+  Best Trial: 5
+  Best Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.2914882522894078, 'ffn_dropout': 0.20783178249421266, 'lr': 0.00046747811127472214, 'weight_decay': 0.0772041002784932, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:16:49,249] Trial 7 finished with value: 0.4075205630618481 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.39925760866529836, 'ffn_dropout': 0.33973484450671276, 'lr': 0.00016610665721224484, 'weight_decay': 0.0001261438721450454, 'batch_size': 256}. Best is trial 7 with value: 0.4075205630618481.
+
+================================================================================
+Trial 7 완료
+  Value (CSI): 0.407521
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.39925760866529836, 'ffn_dropout': 0.33973484450671276, 'lr': 0.00016610665721224484, 'weight_decay': 0.0001261438721450454, 'batch_size': 256}
+  Best Value (CSI): 0.407521
+  Best Trial: 7
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.39925760866529836, 'ffn_dropout': 0.33973484450671276, 'lr': 0.00016610665721224484, 'weight_decay': 0.0001261438721450454, 'batch_size': 256}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:18:25,276] Trial 8 finished with value: 0.46013157463180815 and parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}. Best is trial 8 with value: 0.46013157463180815.
+
+================================================================================
+Trial 8 완료
+  Value (CSI): 0.460132
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:19:05,894] Trial 9 finished with value: 0.3864056835438296 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2700224417659769, 'ffn_dropout': 0.2602179867754312, 'lr': 0.001876313153377928, 'weight_decay': 0.0025295377327571623, 'batch_size': 256}. Best is trial 8 with value: 0.46013157463180815.
+
+================================================================================
+Trial 9 완료
+  Value (CSI): 0.386406
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2700224417659769, 'ffn_dropout': 0.2602179867754312, 'lr': 0.001876313153377928, 'weight_decay': 0.0025295377327571623, 'batch_size': 256}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:19:19,595] Trial 10 pruned. 
+
+================================================================================
+Trial 10 완료
+  Value (CSI): 0.289110
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.1005861961469651, 'ffn_dropout': 0.3868916395381999, 'lr': 1.58864589566609e-05, 'weight_decay': 0.011374196132424614, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:19:29,525] Trial 11 pruned. 
+
+================================================================================
+Trial 11 완료
+  Value (CSI): 0.291946
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3969727802531813, 'ffn_dropout': 0.36461355438984316, 'lr': 0.000124264334040086, 'weight_decay': 0.00012635254515303018, 'batch_size': 256}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:19:39,483] Trial 12 pruned. 
+
+================================================================================
+Trial 12 완료
+  Value (CSI): 0.371849
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1801701950985205, 'ffn_dropout': 0.3679847878882928, 'lr': 0.0002084475358430697, 'weight_decay': 0.0004322383296510278, 'batch_size': 256}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+[I 2025-12-25 05:20:16,950] Trial 13 pruned. 
+
+================================================================================
+Trial 13 완료
+  Value (CSI): 0.386139
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.33816383601401845, 'ffn_dropout': 0.3946511152846607, 'lr': 8.211769654135713e-05, 'weight_decay': 0.0005907439109310786, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:21:34,190] Trial 14 finished with value: 0.4471053892943319 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.19845745033017642, 'ffn_dropout': 0.3078664006280304, 'lr': 0.0004945624430722741, 'weight_decay': 0.008076961501678102, 'batch_size': 128}. Best is trial 8 with value: 0.46013157463180815.
+
+================================================================================
+Trial 14 완료
+  Value (CSI): 0.447105
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.19845745033017642, 'ffn_dropout': 0.3078664006280304, 'lr': 0.0004945624430722741, 'weight_decay': 0.008076961501678102, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:21:50,190] Trial 15 pruned. 
+
+================================================================================
+Trial 15 완료
+  Value (CSI): 0.409370
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.19683441510898547, 'ffn_dropout': 0.2867763607880951, 'lr': 0.0006237685003961505, 'weight_decay': 0.007407819917978954, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:22:51,437] Trial 16 finished with value: 0.45146154174905967 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.16284518012838253, 'ffn_dropout': 0.2522420270144627, 'lr': 0.0007985608493790112, 'weight_decay': 0.005982033150207093, 'batch_size': 128}. Best is trial 8 with value: 0.46013157463180815.
+
+================================================================================
+Trial 16 완료
+  Value (CSI): 0.451462
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.16284518012838253, 'ffn_dropout': 0.2522420270144627, 'lr': 0.0007985608493790112, 'weight_decay': 0.005982033150207093, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:23:07,026] Trial 17 pruned. 
+
+================================================================================
+Trial 17 완료
+  Value (CSI): 0.366712
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15556176869411126, 'ffn_dropout': 0.24490380246951735, 'lr': 0.0007716678761443495, 'weight_decay': 0.004100399837590382, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:23:27,834] Trial 18 pruned. 
+
+================================================================================
+Trial 18 완료
+  Value (CSI): 0.370551
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2278667931985267, 'ffn_dropout': 0.2617217810559588, 'lr': 0.00028393760295564207, 'weight_decay': 0.018238744121195336, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:23:44,530] Trial 19 pruned. 
+
+================================================================================
+Trial 19 완료
+  Value (CSI): 0.369475
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.14082126853676113, 'ffn_dropout': 0.2302084572127562, 'lr': 6.960168496596925e-05, 'weight_decay': 0.003464112603788143, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:24:45,179] Trial 20 finished with value: 0.31936252241261154 and parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1484117292040626, 'ffn_dropout': 0.2769221786119898, 'lr': 0.0009090109987182563, 'weight_decay': 0.0011252896577516908, 'batch_size': 64}. Best is trial 8 with value: 0.46013157463180815.
+
+================================================================================
+Trial 20 완료
+  Value (CSI): 0.319363
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1484117292040626, 'ffn_dropout': 0.2769221786119898, 'lr': 0.0009090109987182563, 'weight_decay': 0.0011252896577516908, 'batch_size': 64}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+[I 2025-12-25 05:25:30,366] Trial 21 pruned. 
+
+================================================================================
+Trial 21 완료
+  Value (CSI): 0.441022
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.17178129214328822, 'ffn_dropout': 0.3140487814323126, 'lr': 0.0005558914007216449, 'weight_decay': 0.005899356329977749, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:25:52,086] Trial 22 pruned. 
+
+================================================================================
+Trial 22 완료
+  Value (CSI): 0.414653
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22487784947661632, 'ffn_dropout': 0.3114583507201134, 'lr': 0.00033577651379597417, 'weight_decay': 0.015402129854042585, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+[I 2025-12-25 05:26:34,648] Trial 23 pruned. 
+
+================================================================================
+Trial 23 완료
+  Value (CSI): 0.433990
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.17363682239766687, 'ffn_dropout': 0.28220341531224363, 'lr': 0.0009079147826912145, 'weight_decay': 0.006364470928914251, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:26:51,196] Trial 24 pruned. 
+
+================================================================================
+Trial 24 완료
+  Value (CSI): 0.326639
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2004119772372248, 'ffn_dropout': 0.2769213367210678, 'lr': 0.00030170474913777777, 'weight_decay': 0.003762689346089469, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:27:10,820] Trial 25 pruned. 
+
+================================================================================
+Trial 25 완료
+  Value (CSI): 0.408848
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.12288253853654899, 'ffn_dropout': 0.32949439807164144, 'lr': 0.0010585890443665388, 'weight_decay': 0.009962537819236516, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:27:33,818] Trial 26 pruned. 
+
+================================================================================
+Trial 26 완료
+  Value (CSI): 0.377241
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.16229383949298243, 'ffn_dropout': 0.23849548374423873, 'lr': 0.0004257198144025464, 'weight_decay': 0.01906723754086527, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:27:57,668] Trial 27 pruned. 
+
+================================================================================
+Trial 27 완료
+  Value (CSI): 0.360973
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.18786017019095563, 'ffn_dropout': 0.3168079816519877, 'lr': 0.0002160238363794102, 'weight_decay': 0.004966735364284992, 'batch_size': 128}
+  Best Value (CSI): 0.460132
+  Best Trial: 8
+  Best Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.1663415378158141, 'ffn_dropout': 0.30898861936978617, 'lr': 0.00036352832902233055, 'weight_decay': 0.002261790524891314, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:30:31,145] Trial 28 finished with value: 0.46517686569307726 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}. Best is trial 28 with value: 0.46517686569307726.
+
+================================================================================
+Trial 28 완료
+  Value (CSI): 0.465177
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:31:51,961] Trial 29 finished with value: 0.461071532540925 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22221093325088664, 'ffn_dropout': 0.3572861091380669, 'lr': 0.0012158992947908314, 'weight_decay': 0.002534627693749831, 'batch_size': 64}. Best is trial 28 with value: 0.46517686569307726.
+
+================================================================================
+Trial 29 완료
+  Value (CSI): 0.461072
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22221093325088664, 'ffn_dropout': 0.3572861091380669, 'lr': 0.0012158992947908314, 'weight_decay': 0.002534627693749831, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:34:48,642] Trial 30 finished with value: 0.4520009478793458 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22981557876763814, 'ffn_dropout': 0.36459507802943675, 'lr': 0.0014461516017665384, 'weight_decay': 0.000872091340821586, 'batch_size': 64}. Best is trial 28 with value: 0.46517686569307726.
+
+================================================================================
+Trial 30 완료
+  Value (CSI): 0.452001
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22981557876763814, 'ffn_dropout': 0.36459507802943675, 'lr': 0.0014461516017665384, 'weight_decay': 0.000872091340821586, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:35:50,379] Trial 31 pruned. 
+
+================================================================================
+Trial 31 완료
+  Value (CSI): 0.391273
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2345111771535317, 'ffn_dropout': 0.3547749501611806, 'lr': 0.0012915401417742903, 'weight_decay': 0.0008760605205286531, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:36:29,389] Trial 32 pruned. 
+
+================================================================================
+Trial 32 완료
+  Value (CSI): 0.386364
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.24746346468511665, 'ffn_dropout': 0.3749218377186346, 'lr': 0.0013765408278672378, 'weight_decay': 0.0022166967860632347, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:36:41,751] Trial 33 pruned. 
+
+================================================================================
+Trial 33 완료
+  Value (CSI): 0.039179
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2081877165034573, 'ffn_dropout': 0.39743411340801094, 'lr': 0.0034549270490634794, 'weight_decay': 0.0013298808970797153, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:36:56,107] Trial 34 pruned. 
+
+================================================================================
+Trial 34 완료
+  Value (CSI): 0.302632
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21496052350070946, 'ffn_dropout': 0.3495988550509811, 'lr': 0.002855594477575197, 'weight_decay': 0.0023734533382712094, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:37:09,226] Trial 35 pruned. 
+
+================================================================================
+Trial 35 완료
+  Value (CSI): 0.052264
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.25103120996051304, 'ffn_dropout': 0.37829578781816575, 'lr': 0.004544169882755556, 'weight_decay': 0.002664946366427354, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:37:34,717] Trial 36 pruned. 
+
+================================================================================
+Trial 36 완료
+  Value (CSI): 0.243563
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.21676242437737786, 'ffn_dropout': 0.34796452858231725, 'lr': 0.0015240983602085206, 'weight_decay': 0.0016669257621242497, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:37:46,734] Trial 37 pruned. 
+
+================================================================================
+Trial 37 완료
+  Value (CSI): 0.087565
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.18881693326609966, 'ffn_dropout': 0.36094146943466665, 'lr': 0.0023473867033466773, 'weight_decay': 0.0009043190554852143, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:37:59,733] Trial 38 pruned. 
+
+================================================================================
+Trial 38 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.23891031199799023, 'ffn_dropout': 0.3251640335589496, 'lr': 0.009814686917414805, 'weight_decay': 0.00043360422780191007, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:38:27,397] Trial 39 pruned. 
+
+================================================================================
+Trial 39 완료
+  Value (CSI): 0.073201
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2610336984850971, 'ffn_dropout': 0.33700550506496213, 'lr': 0.0012452778567671706, 'weight_decay': 0.002984376345105177, 'batch_size': 32}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:38:43,532] Trial 40 pruned. 
+
+================================================================================
+Trial 40 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.213375689667259, 'ffn_dropout': 0.3780538007518284, 'lr': 0.001899072396845153, 'weight_decay': 0.001860530970735027, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:39:12,942] Trial 41 pruned. 
+
+================================================================================
+Trial 41 완료
+  Value (CSI): 0.385447
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.16747555755250743, 'ffn_dropout': 0.29880532353135986, 'lr': 0.0006938773377488943, 'weight_decay': 0.0035720364986428083, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:41:00,726] Trial 42 pruned. 
+
+================================================================================
+Trial 42 완료
+  Value (CSI): 0.381663
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.18570198927704246, 'ffn_dropout': 0.3390371917575428, 'lr': 0.0008765654596846273, 'weight_decay': 0.0048811133388722405, 'batch_size': 32}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:41:26,502] Trial 43 pruned. 
+
+================================================================================
+Trial 43 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2276006084136979, 'ffn_dropout': 0.350422562705314, 'lr': 0.001609754737017845, 'weight_decay': 0.0019436356164982762, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:41:35,672] Trial 44 pruned. 
+
+================================================================================
+Trial 44 완료
+  Value (CSI): 0.372173
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.284989003938103, 'ffn_dropout': 0.3628240658055896, 'lr': 0.0006880215545277704, 'weight_decay': 0.0014012451966706199, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:41:54,983] Trial 45 pruned. 
+
+================================================================================
+Trial 45 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20437588011522517, 'ffn_dropout': 0.384340675750214, 'lr': 0.0010986524674709102, 'weight_decay': 0.0029623969358937344, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:42:51,301] Trial 46 pruned. 
+
+================================================================================
+Trial 46 완료
+  Value (CSI): 0.375587
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1740621890543514, 'ffn_dropout': 0.3242837976995512, 'lr': 0.00044885580132517436, 'weight_decay': 0.0047843500336699025, 'batch_size': 32}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:43:06,694] Trial 47 pruned. 
+
+================================================================================
+Trial 47 완료
+  Value (CSI): 0.070515
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2500683816159819, 'ffn_dropout': 0.29737590307281286, 'lr': 0.002333315960631975, 'weight_decay': 0.0011420274607976933, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:43:14,145] Trial 48 pruned. 
+
+================================================================================
+Trial 48 완료
+  Value (CSI): 0.371487
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.19242257009268757, 'ffn_dropout': 0.33955996676252903, 'lr': 0.0007018587840228305, 'weight_decay': 0.0024476402195342767, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:43:29,309] Trial 49 pruned. 
+
+================================================================================
+Trial 49 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.1371215156564099, 'ffn_dropout': 0.37108076005872537, 'lr': 0.0017511665258131168, 'weight_decay': 0.00022126038282386636, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:43:57,113] Trial 50 pruned. 
+
+================================================================================
+Trial 50 완료
+  Value (CSI): 0.383929
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15738788907729614, 'ffn_dropout': 0.3585968644060297, 'lr': 0.0011279892881025898, 'weight_decay': 0.0019184457141561805, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:44:58,948] Trial 51 pruned. 
+
+================================================================================
+Trial 51 완료
+  Value (CSI): 0.465940
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.19809818515214467, 'ffn_dropout': 0.3039636458767096, 'lr': 0.0004800113690111531, 'weight_decay': 0.007275858759230468, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:45:15,166] Trial 52 pruned. 
+
+================================================================================
+Trial 52 완료
+  Value (CSI): 0.383523
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1782194199030736, 'ffn_dropout': 0.3882725662150924, 'lr': 0.0006295300153683286, 'weight_decay': 0.008661762840104599, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:46:45,249] Trial 53 finished with value: 0.4542044767929346 and parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.21901921307226072, 'ffn_dropout': 0.32688892686744137, 'lr': 0.0008702091528213914, 'weight_decay': 0.0037671432118682154, 'batch_size': 128}. Best is trial 28 with value: 0.46517686569307726.
+
+================================================================================
+Trial 53 완료
+  Value (CSI): 0.454204
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.21901921307226072, 'ffn_dropout': 0.32688892686744137, 'lr': 0.0008702091528213914, 'weight_decay': 0.0037671432118682154, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:46:57,816] Trial 54 pruned. 
+
+================================================================================
+Trial 54 완료
+  Value (CSI): 0.366188
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22072618574089317, 'ffn_dropout': 0.3174444725495746, 'lr': 0.0008891975602638085, 'weight_decay': 0.0038780695570615428, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:47:09,055] Trial 55 pruned. 
+
+================================================================================
+Trial 55 완료
+  Value (CSI): 0.352863
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.23663151614390204, 'ffn_dropout': 0.3339439630294819, 'lr': 0.0014766532550647155, 'weight_decay': 0.005966185994188241, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:47:22,118] Trial 56 pruned. 
+
+================================================================================
+Trial 56 완료
+  Value (CSI): 0.389747
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.21427661525833494, 'ffn_dropout': 0.36786529543080887, 'lr': 0.0003737764092888425, 'weight_decay': 0.0033585971022743666, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:47:29,274] Trial 57 pruned. 
+
+================================================================================
+Trial 57 완료
+  Value (CSI): 0.323804
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2691526275996794, 'ffn_dropout': 0.34860185887799855, 'lr': 0.0005571043260833596, 'weight_decay': 0.001481446310561865, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:47:36,181] Trial 58 pruned. 
+
+================================================================================
+Trial 58 완료
+  Value (CSI): 0.245392
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.20524896192559924, 'ffn_dropout': 0.3281930539443096, 'lr': 0.0009893064402221694, 'weight_decay': 0.004479506020333192, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:48:20,494] Trial 59 pruned. 
+
+================================================================================
+Trial 59 완료
+  Value (CSI): 0.412804
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.18181018176313696, 'ffn_dropout': 0.2913568337919433, 'lr': 0.0008522402683237674, 'weight_decay': 0.002840467584660579, 'batch_size': 32}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:48:41,159] Trial 60 pruned. 
+
+================================================================================
+Trial 60 완료
+  Value (CSI): 0.362745
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.22649371699807494, 'ffn_dropout': 0.26380274372292395, 'lr': 0.0005029539608235313, 'weight_decay': 0.0024025949798825094, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:48:56,486] Trial 61 pruned. 
+
+================================================================================
+Trial 61 완료
+  Value (CSI): 0.404164
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.19523082393837196, 'ffn_dropout': 0.30665671861890154, 'lr': 0.0003772828147012614, 'weight_decay': 0.008050725471452858, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:49:12,615] Trial 62 pruned. 
+
+================================================================================
+Trial 62 완료
+  Value (CSI): 0.386236
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.20582499323739398, 'ffn_dropout': 0.3200554663857304, 'lr': 0.0007193590114586899, 'weight_decay': 0.011927207836846613, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:49:30,948] Trial 63 pruned. 
+
+================================================================================
+Trial 63 완료
+  Value (CSI): 0.369252
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.16400786464751083, 'ffn_dropout': 0.3089941341623069, 'lr': 0.0012049442947190602, 'weight_decay': 0.006495049346872716, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:49:43,940] Trial 64 pruned. 
+
+================================================================================
+Trial 64 완료
+  Value (CSI): 0.393266
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22146830714751656, 'ffn_dropout': 0.34241158087887413, 'lr': 0.0005857140462077315, 'weight_decay': 0.005046533535908529, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:49:58,443] Trial 65 pruned. 
+
+================================================================================
+Trial 65 완료
+  Value (CSI): 0.391335
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.18148257746371563, 'ffn_dropout': 0.2909150756305158, 'lr': 0.0003021626981653297, 'weight_decay': 0.0036164852898987487, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:50:21,389] Trial 66 pruned. 
+
+================================================================================
+Trial 66 완료
+  Value (CSI): 0.393119
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.23546558256348837, 'ffn_dropout': 0.3580228121555677, 'lr': 0.0010578076378718554, 'weight_decay': 0.005663573099266001, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:50:34,263] Trial 67 pruned. 
+
+================================================================================
+Trial 67 완료
+  Value (CSI): 0.400290
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.19531311866770573, 'ffn_dropout': 0.3304329918864657, 'lr': 0.0013988310746714586, 'weight_decay': 0.0038821942335004697, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:51:02,379] Trial 68 pruned. 
+
+================================================================================
+Trial 68 완료
+  Value (CSI): 0.376833
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15328439750849324, 'ffn_dropout': 0.2735230099607816, 'lr': 0.0008210779200773781, 'weight_decay': 0.002123764269250208, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:51:10,679] Trial 69 pruned. 
+
+================================================================================
+Trial 69 완료
+  Value (CSI): 0.115039
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.21221501657175712, 'ffn_dropout': 0.39943238805553805, 'lr': 0.0020112673788907427, 'weight_decay': 0.0027708007900058263, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:51:37,245] Trial 70 pruned. 
+
+================================================================================
+Trial 70 완료
+  Value (CSI): 0.365782
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24508307801893614, 'ffn_dropout': 0.312761501400733, 'lr': 0.0002616712944099542, 'weight_decay': 0.009821263724479366, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:51:42,615] Trial 71 pruned. 
+
+================================================================================
+Trial 71 완료
+  Value (CSI): 0.295052
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3495938368308896, 'ffn_dropout': 0.3436467109307653, 'lr': 0.0004036337102077431, 'weight_decay': 0.00011759957867519061, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:51:48,885] Trial 72 pruned. 
+
+================================================================================
+Trial 72 완료
+  Value (CSI): 0.313180
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.23162026607027847, 'ffn_dropout': 0.3537557380874828, 'lr': 0.00014884411093250496, 'weight_decay': 0.00022350812096312578, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:51:58,821] Trial 73 pruned. 
+
+================================================================================
+Trial 73 완료
+  Value (CSI): 0.340161
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.21944597997936288, 'ffn_dropout': 0.33505451841021905, 'lr': 0.0004935656588640028, 'weight_decay': 0.0001571931242211524, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:52:10,889] Trial 74 pruned. 
+
+================================================================================
+Trial 74 완료
+  Value (CSI): 0.388100
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.25721194150571974, 'ffn_dropout': 0.37036767102697127, 'lr': 0.000555029323567799, 'weight_decay': 0.0016658297448969963, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:52:15,281] Trial 75 pruned. 
+
+================================================================================
+Trial 75 완료
+  Value (CSI): 0.304090
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.24360549622730884, 'ffn_dropout': 0.318451740789571, 'lr': 0.0002365632669682442, 'weight_decay': 0.0007390131904735075, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:54:10,572] Trial 76 pruned. 
+
+================================================================================
+Trial 76 완료
+  Value (CSI): 0.484242
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3849972050663171, 'ffn_dropout': 0.36219424517767623, 'lr': 0.00019980593585168535, 'weight_decay': 0.001086533649143069, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:54:25,144] Trial 77 pruned. 
+
+================================================================================
+Trial 77 완료
+  Value (CSI): 0.375413
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.22710796079928153, 'ffn_dropout': 0.3447564480543577, 'lr': 0.0016550015356752905, 'weight_decay': 0.0005261708526353079, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:55:07,458] Trial 78 pruned. 
+
+================================================================================
+Trial 78 완료
+  Value (CSI): 0.402768
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.20133111357686587, 'ffn_dropout': 0.3262565124850321, 'lr': 0.0007431383509760672, 'weight_decay': 0.004359685368192822, 'batch_size': 32}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+[I 2025-12-25 05:56:14,644] Trial 79 pruned. 
+
+================================================================================
+Trial 79 완료
+  Value (CSI): 0.432028
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.17047730935847139, 'ffn_dropout': 0.35331788824652566, 'lr': 0.00032347448481312945, 'weight_decay': 0.0032925650907495766, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:56:24,580] Trial 80 pruned. 
+
+================================================================================
+Trial 80 완료
+  Value (CSI): 0.064919
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.19283635734199422, 'ffn_dropout': 0.30368065499321434, 'lr': 0.0009826334417181457, 'weight_decay': 0.0003436022532237786, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:56:32,559] Trial 81 pruned. 
+
+================================================================================
+Trial 81 완료
+  Value (CSI): 0.352864
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.309816225707421, 'ffn_dropout': 0.22569486585989065, 'lr': 0.0012386082484920774, 'weight_decay': 0.00217559490473419, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:56:39,257] Trial 82 pruned. 
+
+================================================================================
+Trial 82 완료
+  Value (CSI): 0.186181
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.21035058709435583, 'ffn_dropout': 0.2487511746675919, 'lr': 0.0020830335496524193, 'weight_decay': 0.0018812669631650895, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:56:46,525] Trial 83 pruned. 
+
+================================================================================
+Trial 83 완료
+  Value (CSI): 0.206114
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.1848567498495778, 'ffn_dropout': 0.25892037052134503, 'lr': 0.0015137534420347403, 'weight_decay': 0.00257585668121529, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:56:55,620] Trial 84 pruned. 
+
+================================================================================
+Trial 84 완료
+  Value (CSI): 0.312982
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2403091363846552, 'ffn_dropout': 0.28205608512572355, 'lr': 0.0025347511755171655, 'weight_decay': 0.001285460122674878, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:57:31,514] Trial 85 pruned. 
+
+================================================================================
+Trial 85 완료
+  Value (CSI): 0.371901
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2345998236091512, 'ffn_dropout': 0.37674695361595506, 'lr': 0.0006407619518640441, 'weight_decay': 0.00010414088658001112, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:57:42,462] Trial 86 pruned. 
+
+================================================================================
+Trial 86 완료
+  Value (CSI): 0.210870
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.2567713963921216, 'ffn_dropout': 0.33543327943163503, 'lr': 0.001903746662861581, 'weight_decay': 0.0015857077181221351, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 05:59:25,717] Trial 87 finished with value: 0.4542621353196135 and parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22014459601974626, 'ffn_dropout': 0.36659844334591213, 'lr': 0.0007998324941771957, 'weight_decay': 0.0042062275733193944, 'batch_size': 64}. Best is trial 28 with value: 0.46517686569307726.
+
+================================================================================
+Trial 87 완료
+  Value (CSI): 0.454262
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22014459601974626, 'ffn_dropout': 0.36659844334591213, 'lr': 0.0007998324941771957, 'weight_decay': 0.0042062275733193944, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 05:59:46,501] Trial 88 pruned. 
+
+================================================================================
+Trial 88 완료
+  Value (CSI): 0.380762
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22986245006022354, 'ffn_dropout': 0.3649718054034906, 'lr': 0.0008141432035146417, 'weight_decay': 0.004179715130208902, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:00:14,770] Trial 89 pruned. 
+
+================================================================================
+Trial 89 완료
+  Value (CSI): 0.363897
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.21915273874116184, 'ffn_dropout': 0.3845996608392798, 'lr': 0.0009966443742309128, 'weight_decay': 0.005411218855923533, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:00:40,357] Trial 90 pruned. 
+
+================================================================================
+Trial 90 완료
+  Value (CSI): 0.402985
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2106543876426483, 'ffn_dropout': 0.355730458627069, 'lr': 0.00042844820717211573, 'weight_decay': 0.0031947046839435776, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:00:52,179] Trial 91 pruned. 
+
+================================================================================
+Trial 91 완료
+  Value (CSI): 0.209264
+  Parameters: {'d_token': 160, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.19981917592497048, 'ffn_dropout': 0.3426064494145769, 'lr': 0.0013523901953797967, 'weight_decay': 0.006877258579683283, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:01:22,516] Trial 92 pruned. 
+
+================================================================================
+Trial 92 완료
+  Value (CSI): 0.394476
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22355628560524476, 'ffn_dropout': 0.36816221327440984, 'lr': 0.0011125714472882409, 'weight_decay': 0.0029744934263087205, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:01:42,240] Trial 93 pruned. 
+
+================================================================================
+Trial 93 완료
+  Value (CSI): 0.386247
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.18991410476162215, 'ffn_dropout': 0.3210520435095761, 'lr': 0.0007829455069114803, 'weight_decay': 0.0022945090990425378, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:01:50,623] Trial 94 pruned. 
+
+================================================================================
+Trial 94 완료
+  Value (CSI): 0.366769
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2048234628706, 'ffn_dropout': 0.3509426305429772, 'lr': 0.0016579506894987372, 'weight_decay': 0.004767001010939034, 'batch_size': 256}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:02:13,777] Trial 95 pruned. 
+
+================================================================================
+Trial 95 완료
+  Value (CSI): 0.388049
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.17821817465874765, 'ffn_dropout': 0.3139832410519233, 'lr': 0.0005976572308687453, 'weight_decay': 0.006017686746266306, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:02:55,946] Trial 96 pruned. 
+
+================================================================================
+Trial 96 완료
+  Value (CSI): 0.073201
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.23884142007375667, 'ffn_dropout': 0.33083844601763823, 'lr': 0.0009213260411406948, 'weight_decay': 0.003912352190526453, 'batch_size': 32}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+  Fold 2 - 클래스별 가중치: {0: 74.0253164556962, 1: 3.4299120234604104, 2: 0.3710659898477157} (클래스별 샘플 수: {0: 79, 1: 1705, 2: 15760})
+  Fold 3 - 클래스별 가중치: {0: 114.66666666666667, 1: 4.335063009636768, 2: 0.3622398414271556} (클래스별 샘플 수: {0: 51, 1: 1349, 2: 16144})
+[I 2025-12-25 06:04:55,085] Trial 97 pruned. 
+
+================================================================================
+Trial 97 완료
+  Value (CSI): 0.486800
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24906224197316087, 'ffn_dropout': 0.29861389261342197, 'lr': 0.0006873520091813965, 'weight_decay': 0.002659948153677358, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:05:22,700] Trial 98 pruned. 
+
+================================================================================
+Trial 98 완료
+  Value (CSI): 0.378522
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.21656943991370947, 'ffn_dropout': 0.3909958804656269, 'lr': 0.0012301024257874446, 'weight_decay': 0.0017261201580247617, 'batch_size': 128}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 97.33333333333333, 1: 3.3031674208144794, 2: 0.3721641600815702} (클래스별 샘플 수: {0: 60, 1: 1768, 2: 15692})
+[I 2025-12-25 06:06:18,795] Trial 99 pruned. 
+
+================================================================================
+Trial 99 완료
+  Value (CSI): 0.390335
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.16438228655864257, 'ffn_dropout': 0.37961840655094414, 'lr': 0.00035038170096574224, 'weight_decay': 0.0020553505446097575, 'batch_size': 64}
+  Best Value (CSI): 0.465177
+  Best Trial: 28
+  Best Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+================================================================================
+
+
+최적화 완료.
+Best CSI Score: 0.4652
+Best Hyperparameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22191677554696004, 'ffn_dropout': 0.3593673195268826, 'lr': 0.001039914773988631, 'weight_decay': 0.002578609852830777, 'batch_size': 64}
+
+최적화 과정 요약:
+  - 총 시도 횟수: 100
+  - 성공한 시도: 100
+  - 최초 CSI: 0.0971
+  - 최종 CSI: 0.3903
+  - 최고 CSI: 0.4868
+  - 최저 CSI: 0.0000
+  - 평균 CSI: 0.3110
+
+최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_pure_gwangju_trials.pkl에 저장되었습니다.
+
+==================================================
+최적화된 하이퍼파라미터로 최종 모델 학습 시작
+==================================================
+최종 모델 학습 시작...
+Fold 1 학습 중...
+  Early stopping at epoch 26, Best CSI: 0.3933
+  Fold 1 학습 완료 (검증 CSI: 0.3933)
+Fold 2 학습 중...
+  Early stopping at epoch 32, Best CSI: 0.4537
+  Fold 2 학습 완료 (검증 CSI: 0.4537)
+Fold 3 학습 중...
+  Early stopping at epoch 44, Best CSI: 0.4828
+  Fold 3 학습 완료 (검증 CSI: 0.4828)
+
+모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_pure_gwangju.pkl (총 3개 fold)
+Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_pure_gwangju_scaler.pkl (총 3개 fold)
+
+최종 모델 학습 및 저장 완료!
+저장된 모델 경로:
+  - .
+  - .
+  - /
+  - s
+  - a
+  - v
+  - e
+  - _
+  - m
+  - o
+  - d
+  - e
+  - l
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - o
+  - p
+  - t
+  - i
+  - m
+  - a
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - p
+  - u
+  - r
+  - e
+  - _
+  - g
+  - w
+  - a
+  - n
+  - g
+  - j
+  - u
+  - .
+  - p
+  - k
+  - l
+
+✓ 완료: ft_transformer_pure/ft_transforemer_pure_gwangju.py (소요 시간: 3999초)
+
+----------------------------------------
+실행 중: ft_transformer_pure/ft_transforemer_pure_incheon.py
+시작 시간: 2025-12-25 06:08:42
+----------------------------------------
+[I 2025-12-25 06:08:43,887] A new study created in memory with name: no-name-5c3a1402-974f-4d2c-8636-2a105f12884d
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:09:52,419] Trial 0 finished with value: 0.5023864961275578 and parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.15168417589020827, 'ffn_dropout': 0.19782411771466096, 'lr': 5.1831628390418495e-05, 'weight_decay': 0.02318754716845433, 'batch_size': 256}. Best is trial 0 with value: 0.5023864961275578.
+
+================================================================================
+Trial 0 완료
+  Value (CSI): 0.502386
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.15168417589020827, 'ffn_dropout': 0.19782411771466096, 'lr': 5.1831628390418495e-05, 'weight_decay': 0.02318754716845433, 'batch_size': 256}
+  Best Value (CSI): 0.502386
+  Best Trial: 0
+  Best Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.15168417589020827, 'ffn_dropout': 0.19782411771466096, 'lr': 5.1831628390418495e-05, 'weight_decay': 0.02318754716845433, 'batch_size': 256}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:11:46,004] Trial 1 finished with value: 0.5331123520411832 and parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.18795117608123107, 'ffn_dropout': 0.10789686828674755, 'lr': 1.9249578885169958e-05, 'weight_decay': 0.00045278114856496656, 'batch_size': 128}. Best is trial 1 with value: 0.5331123520411832.
+
+================================================================================
+Trial 1 완료
+  Value (CSI): 0.533112
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.18795117608123107, 'ffn_dropout': 0.10789686828674755, 'lr': 1.9249578885169958e-05, 'weight_decay': 0.00045278114856496656, 'batch_size': 128}
+  Best Value (CSI): 0.533112
+  Best Trial: 1
+  Best Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.18795117608123107, 'ffn_dropout': 0.10789686828674755, 'lr': 1.9249578885169958e-05, 'weight_decay': 0.00045278114856496656, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:14:59,906] Trial 2 finished with value: 0.5465607835164977 and parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20328684851147377, 'ffn_dropout': 0.15608370575338412, 'lr': 0.00015823652235619827, 'weight_decay': 0.028387618010176596, 'batch_size': 64}. Best is trial 2 with value: 0.5465607835164977.
+
+================================================================================
+Trial 2 완료
+  Value (CSI): 0.546561
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20328684851147377, 'ffn_dropout': 0.15608370575338412, 'lr': 0.00015823652235619827, 'weight_decay': 0.028387618010176596, 'batch_size': 64}
+  Best Value (CSI): 0.546561
+  Best Trial: 2
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20328684851147377, 'ffn_dropout': 0.15608370575338412, 'lr': 0.00015823652235619827, 'weight_decay': 0.028387618010176596, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:17:52,197] Trial 3 finished with value: 0.46506627509085546 and parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3166023286367327, 'ffn_dropout': 0.2821666562759018, 'lr': 0.0006790552467163069, 'weight_decay': 0.00039395884026432917, 'batch_size': 64}. Best is trial 2 with value: 0.5465607835164977.
+
+================================================================================
+Trial 3 완료
+  Value (CSI): 0.465066
+  Parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.3166023286367327, 'ffn_dropout': 0.2821666562759018, 'lr': 0.0006790552467163069, 'weight_decay': 0.00039395884026432917, 'batch_size': 64}
+  Best Value (CSI): 0.546561
+  Best Trial: 2
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20328684851147377, 'ffn_dropout': 0.15608370575338412, 'lr': 0.00015823652235619827, 'weight_decay': 0.028387618010176596, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:18:50,744] Trial 4 finished with value: 0.5263598242156682 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21818989575866482, 'ffn_dropout': 0.3413019597759419, 'lr': 8.761146719969165e-05, 'weight_decay': 0.0007511820225075656, 'batch_size': 256}. Best is trial 2 with value: 0.5465607835164977.
+
+================================================================================
+Trial 4 완료
+  Value (CSI): 0.526360
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.21818989575866482, 'ffn_dropout': 0.3413019597759419, 'lr': 8.761146719969165e-05, 'weight_decay': 0.0007511820225075656, 'batch_size': 256}
+  Best Value (CSI): 0.546561
+  Best Trial: 2
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20328684851147377, 'ffn_dropout': 0.15608370575338412, 'lr': 0.00015823652235619827, 'weight_decay': 0.028387618010176596, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:18:59,299] Trial 5 pruned. 
+
+================================================================================
+Trial 5 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 160, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.18035432353009323, 'ffn_dropout': 0.1167007812043586, 'lr': 0.00781554388062254, 'weight_decay': 0.000541609681031691, 'batch_size': 256}
+  Best Value (CSI): 0.546561
+  Best Trial: 2
+  Best Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.20328684851147377, 'ffn_dropout': 0.15608370575338412, 'lr': 0.00015823652235619827, 'weight_decay': 0.028387618010176596, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:20:51,699] Trial 6 finished with value: 0.5499631272762147 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2980506223370139, 'ffn_dropout': 0.13679651535428397, 'lr': 0.00012603488529067887, 'weight_decay': 0.0010789166100312734, 'batch_size': 64}. Best is trial 6 with value: 0.5499631272762147.
+
+================================================================================
+Trial 6 완료
+  Value (CSI): 0.549963
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2980506223370139, 'ffn_dropout': 0.13679651535428397, 'lr': 0.00012603488529067887, 'weight_decay': 0.0010789166100312734, 'batch_size': 64}
+  Best Value (CSI): 0.549963
+  Best Trial: 6
+  Best Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2980506223370139, 'ffn_dropout': 0.13679651535428397, 'lr': 0.00012603488529067887, 'weight_decay': 0.0010789166100312734, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:21:27,530] Trial 7 pruned. 
+
+================================================================================
+Trial 7 완료
+  Value (CSI): 0.489564
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3826591479524817, 'ffn_dropout': 0.18408141908894138, 'lr': 0.00037132725027798976, 'weight_decay': 0.004432265784488715, 'batch_size': 32}
+  Best Value (CSI): 0.549963
+  Best Trial: 6
+  Best Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2980506223370139, 'ffn_dropout': 0.13679651535428397, 'lr': 0.00012603488529067887, 'weight_decay': 0.0010789166100312734, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:24:20,732] Trial 8 pruned. 
+
+================================================================================
+Trial 8 완료
+  Value (CSI): 0.558231
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2742361626951546, 'ffn_dropout': 0.14848958904783932, 'lr': 2.107202629790357e-05, 'weight_decay': 0.05858071842703583, 'batch_size': 32}
+  Best Value (CSI): 0.549963
+  Best Trial: 6
+  Best Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2980506223370139, 'ffn_dropout': 0.13679651535428397, 'lr': 0.00012603488529067887, 'weight_decay': 0.0010789166100312734, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:26:27,376] Trial 9 finished with value: 0.5609756000325428 and parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 9 완료
+  Value (CSI): 0.560976
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:27:56,254] Trial 10 finished with value: 0.5605887261807504 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12038133063917736, 'ffn_dropout': 0.24464773024938075, 'lr': 0.0012288262804192869, 'weight_decay': 0.00012680456195291018, 'batch_size': 128}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 10 완료
+  Value (CSI): 0.560589
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12038133063917736, 'ffn_dropout': 0.24464773024938075, 'lr': 0.0012288262804192869, 'weight_decay': 0.00012680456195291018, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:29:26,206] Trial 11 finished with value: 0.5607844794099125 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10288412634034222, 'ffn_dropout': 0.2457432622836574, 'lr': 0.001108065412885759, 'weight_decay': 0.00019368388896397114, 'batch_size': 128}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 11 완료
+  Value (CSI): 0.560784
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10288412634034222, 'ffn_dropout': 0.2457432622836574, 'lr': 0.001108065412885759, 'weight_decay': 0.00019368388896397114, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:30:31,255] Trial 12 finished with value: 0.5592901333677839 and parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.10865819152706158, 'ffn_dropout': 0.25847979244877933, 'lr': 0.0013252962886862575, 'weight_decay': 0.004164171163917052, 'batch_size': 128}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 12 완료
+  Value (CSI): 0.559290
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.10865819152706158, 'ffn_dropout': 0.25847979244877933, 'lr': 0.0013252962886862575, 'weight_decay': 0.004164171163917052, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:30:39,317] Trial 13 pruned. 
+
+================================================================================
+Trial 13 완료
+  Value (CSI): 0.028408
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.23950900286649165, 'ffn_dropout': 0.30902884823952853, 'lr': 0.0028492059596172802, 'weight_decay': 0.00010032739743204352, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:31:32,760] Trial 14 finished with value: 0.5557059161524593 and parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.25893449513552985, 'ffn_dropout': 0.21840088109891515, 'lr': 0.0003813496214789295, 'weight_decay': 0.010077836206100022, 'batch_size': 128}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 14 완료
+  Value (CSI): 0.555706
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.25893449513552985, 'ffn_dropout': 0.21840088109891515, 'lr': 0.0003813496214789295, 'weight_decay': 0.010077836206100022, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:31:44,328] Trial 15 pruned. 
+
+================================================================================
+Trial 15 완료
+  Value (CSI): 0.525875
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.10294109028202032, 'ffn_dropout': 0.3997769660202033, 'lr': 0.002494996899206077, 'weight_decay': 0.001876698041116484, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:32:10,367] Trial 16 pruned. 
+
+================================================================================
+Trial 16 완료
+  Value (CSI): 0.531359
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.15774092016431762, 'ffn_dropout': 0.2347317623501348, 'lr': 0.00032968399290091854, 'weight_decay': 0.0077175615895213375, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:33:31,247] Trial 17 finished with value: 0.5495731525410316 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.23828650212506322, 'ffn_dropout': 0.20771405799084558, 'lr': 0.0007441831496401034, 'weight_decay': 0.0019797132755250703, 'batch_size': 128}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 17 완료
+  Value (CSI): 0.549573
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.23828650212506322, 'ffn_dropout': 0.20771405799084558, 'lr': 0.0007441831496401034, 'weight_decay': 0.0019797132755250703, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:39:53,746] Trial 18 finished with value: 0.5600849945244285 and parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.15561174422120433, 'ffn_dropout': 0.275260950668861, 'lr': 0.000222912922404823, 'weight_decay': 0.09632694451434938, 'batch_size': 32}. Best is trial 9 with value: 0.5609756000325428.
+
+================================================================================
+Trial 18 완료
+  Value (CSI): 0.560085
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.15561174422120433, 'ffn_dropout': 0.275260950668861, 'lr': 0.000222912922404823, 'weight_decay': 0.09632694451434938, 'batch_size': 32}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:40:09,624] Trial 19 pruned. 
+
+================================================================================
+Trial 19 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.21661613222031778, 'ffn_dropout': 0.17153020016207565, 'lr': 0.007529231120839772, 'weight_decay': 0.00025884894456957794, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:40:24,290] Trial 20 pruned. 
+
+================================================================================
+Trial 20 완료
+  Value (CSI): 0.019516
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.27922152874033723, 'ffn_dropout': 0.21779728298016282, 'lr': 0.0026634242947173063, 'weight_decay': 0.00020887447140232113, 'batch_size': 128}
+  Best Value (CSI): 0.560976
+  Best Trial: 9
+  Best Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2583449749801112, 'ffn_dropout': 0.24285621080643433, 'lr': 0.0005397035080582344, 'weight_decay': 0.012404006621240261, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:42:03,293] Trial 21 finished with value: 0.5668806602309416 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12823504101007213, 'ffn_dropout': 0.24204039169440933, 'lr': 0.0008968581420613831, 'weight_decay': 0.00013612999017543234, 'batch_size': 128}. Best is trial 21 with value: 0.5668806602309416.
+
+================================================================================
+Trial 21 완료
+  Value (CSI): 0.566881
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12823504101007213, 'ffn_dropout': 0.24204039169440933, 'lr': 0.0008968581420613831, 'weight_decay': 0.00013612999017543234, 'batch_size': 128}
+  Best Value (CSI): 0.566881
+  Best Trial: 21
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12823504101007213, 'ffn_dropout': 0.24204039169440933, 'lr': 0.0008968581420613831, 'weight_decay': 0.00013612999017543234, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:42:23,673] Trial 22 pruned. 
+
+================================================================================
+Trial 22 완료
+  Value (CSI): 0.536194
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13129422928279824, 'ffn_dropout': 0.24688408243347557, 'lr': 0.0005902142846066769, 'weight_decay': 0.00024872009990851296, 'batch_size': 128}
+  Best Value (CSI): 0.566881
+  Best Trial: 21
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12823504101007213, 'ffn_dropout': 0.24204039169440933, 'lr': 0.0008968581420613831, 'weight_decay': 0.00013612999017543234, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:44:09,244] Trial 23 finished with value: 0.5673234518633549 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 23 완료
+  Value (CSI): 0.567323
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:44:21,934] Trial 24 pruned. 
+
+================================================================================
+Trial 24 완료
+  Value (CSI): 0.506753
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12930931342803847, 'ffn_dropout': 0.20009448267052468, 'lr': 0.00046698198320616063, 'weight_decay': 0.00011393573097561589, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:44:29,104] Trial 25 pruned. 
+
+================================================================================
+Trial 25 완료
+  Value (CSI): 0.503553
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1778503166472795, 'ffn_dropout': 0.18199211511259697, 'lr': 0.0002406153197737413, 'weight_decay': 0.0010509368096982261, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:45:03,385] Trial 26 pruned. 
+
+================================================================================
+Trial 26 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.13327555309804112, 'ffn_dropout': 0.22886930522275112, 'lr': 0.0007932486436691002, 'weight_decay': 0.00016317047800793708, 'batch_size': 32}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:45:10,672] Trial 27 pruned. 
+
+================================================================================
+Trial 27 완료
+  Value (CSI): 0.515767
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.14895722211917198, 'ffn_dropout': 0.17325703416848567, 'lr': 0.00177056092563618, 'weight_decay': 0.0002995911478233817, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:45:28,581] Trial 28 pruned. 
+
+================================================================================
+Trial 28 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.17593097163961852, 'ffn_dropout': 0.21693017875622592, 'lr': 0.004250221522374358, 'weight_decay': 0.0001015648020457322, 'batch_size': 64}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:45:36,256] Trial 29 pruned. 
+
+================================================================================
+Trial 29 완료
+  Value (CSI): 0.480359
+  Parameters: {'d_token': 64, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.14786245806659531, 'ffn_dropout': 0.19455262441856833, 'lr': 0.0009446705727542001, 'weight_decay': 0.0003966658643232621, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:45:49,012] Trial 30 pruned. 
+
+================================================================================
+Trial 30 완료
+  Value (CSI): 0.544792
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.20032038839491104, 'ffn_dropout': 0.20202422613339893, 'lr': 0.0004928983963896523, 'weight_decay': 0.00019321988967685937, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:47:40,045] Trial 31 finished with value: 0.563607369549601 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10260325160493375, 'ffn_dropout': 0.2597310816023563, 'lr': 0.0011424207608275207, 'weight_decay': 0.00016595787716341918, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 31 완료
+  Value (CSI): 0.563607
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10260325160493375, 'ffn_dropout': 0.2597310816023563, 'lr': 0.0011424207608275207, 'weight_decay': 0.00016595787716341918, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:47:48,390] Trial 32 pruned. 
+
+================================================================================
+Trial 32 완료
+  Value (CSI): 0.492586
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10066782348816578, 'ffn_dropout': 0.2620446181886807, 'lr': 0.0010060616036423158, 'weight_decay': 0.00016235962991251033, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:47:57,417] Trial 33 pruned. 
+
+================================================================================
+Trial 33 완료
+  Value (CSI): 0.504974
+  Parameters: {'d_token': 64, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.11802013391437569, 'ffn_dropout': 0.22938034439063423, 'lr': 0.0014823079555297896, 'weight_decay': 0.0003394316719042018, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:48:06,983] Trial 34 pruned. 
+
+================================================================================
+Trial 34 완료
+  Value (CSI): 0.492255
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.13535603010069813, 'ffn_dropout': 0.2792611411302509, 'lr': 0.000604505329307539, 'weight_decay': 0.00014685920098230396, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:48:22,784] Trial 35 pruned. 
+
+================================================================================
+Trial 35 완료
+  Value (CSI): 0.020683
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.11988769842324046, 'ffn_dropout': 0.30026225551815056, 'lr': 0.0016030332212753817, 'weight_decay': 0.0005647924324208686, 'batch_size': 64}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:48:31,260] Trial 36 pruned. 
+
+================================================================================
+Trial 36 완료
+  Value (CSI): 0.481211
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.16540779870685812, 'ffn_dropout': 0.2670630761056743, 'lr': 0.0008299796869834042, 'weight_decay': 0.0003018483422456579, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:48:38,402] Trial 37 pruned. 
+
+================================================================================
+Trial 37 완료
+  Value (CSI): 0.523694
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1951546289703142, 'ffn_dropout': 0.25350360895886237, 'lr': 0.00026953199068110214, 'weight_decay': 0.00047955483375928344, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:49:03,650] Trial 38 pruned. 
+
+================================================================================
+Trial 38 완료
+  Value (CSI): 0.532919
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.14483071853779714, 'ffn_dropout': 0.23345477464320977, 'lr': 0.0005107207953273052, 'weight_decay': 0.00014582168064134125, 'batch_size': 64}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:49:15,274] Trial 39 pruned. 
+
+================================================================================
+Trial 39 완료
+  Value (CSI): 0.523688
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.16661161613366407, 'ffn_dropout': 0.2868370859192786, 'lr': 0.00016217083519655796, 'weight_decay': 0.0006260405898636037, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:50:09,171] Trial 40 pruned. 
+
+================================================================================
+Trial 40 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.18378921102510293, 'ffn_dropout': 0.15892158426162734, 'lr': 0.0007259280627875253, 'weight_decay': 0.01960659897740812, 'batch_size': 32}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:51:30,288] Trial 41 finished with value: 0.5619844745831449 and parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10294198601110448, 'ffn_dropout': 0.2458924807981811, 'lr': 0.001109737756472616, 'weight_decay': 0.00020239751843869719, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 41 완료
+  Value (CSI): 0.561984
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10294198601110448, 'ffn_dropout': 0.2458924807981811, 'lr': 0.001109737756472616, 'weight_decay': 0.00020239751843869719, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:51:38,572] Trial 42 pruned. 
+
+================================================================================
+Trial 42 완료
+  Value (CSI): 0.513583
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.11501509157355441, 'ffn_dropout': 0.2504593212337229, 'lr': 0.001813503963596022, 'weight_decay': 0.00022864187333567125, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:53:11,818] Trial 43 pruned. 
+
+================================================================================
+Trial 43 완료
+  Value (CSI): 0.527875
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1002316940932777, 'ffn_dropout': 0.26888678752254985, 'lr': 0.0009423185812287568, 'weight_decay': 0.00013362019746969138, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:53:30,067] Trial 44 pruned. 
+
+================================================================================
+Trial 44 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12424423164453778, 'ffn_dropout': 0.24081777935534168, 'lr': 0.0011909318296277926, 'weight_decay': 0.00036957735464548204, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:55:44,698] Trial 45 finished with value: 0.5613916785166351 and parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11778256138489303, 'ffn_dropout': 0.21929231439566954, 'lr': 0.0004046090471254043, 'weight_decay': 0.0001045893534529528, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 45 완료
+  Value (CSI): 0.561392
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11778256138489303, 'ffn_dropout': 0.21929231439566954, 'lr': 0.0004046090471254043, 'weight_decay': 0.0001045893534529528, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:56:50,501] Trial 46 finished with value: 0.5570930924541627 and parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1126643681921102, 'ffn_dropout': 0.19236077231692622, 'lr': 0.000333665436367717, 'weight_decay': 0.00010369802758258233, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 46 완료
+  Value (CSI): 0.557093
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.1126643681921102, 'ffn_dropout': 0.19236077231692622, 'lr': 0.000333665436367717, 'weight_decay': 0.00010369802758258233, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:56:58,380] Trial 47 pruned. 
+
+================================================================================
+Trial 47 완료
+  Value (CSI): 0.519749
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.14035167262715945, 'ffn_dropout': 0.21498112030197747, 'lr': 0.0004090238326969228, 'weight_decay': 0.00018354642275337444, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:57:09,511] Trial 48 pruned. 
+
+================================================================================
+Trial 48 완료
+  Value (CSI): 0.532614
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.12391607429425383, 'ffn_dropout': 0.22450926692685833, 'lr': 0.0006455838651087578, 'weight_decay': 0.00013571893237180336, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:57:40,646] Trial 49 pruned. 
+
+================================================================================
+Trial 49 완료
+  Value (CSI): 0.442817
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.11290011137875997, 'ffn_dropout': 0.2097453842744962, 'lr': 0.0011233968244386344, 'weight_decay': 0.0002544969262327021, 'batch_size': 64}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:57:55,423] Trial 50 pruned. 
+
+================================================================================
+Trial 50 완료
+  Value (CSI): 0.520477
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.142906500679646, 'ffn_dropout': 0.25962043143167723, 'lr': 0.002183547662375953, 'weight_decay': 0.0004369344408503457, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:58:05,128] Trial 51 pruned. 
+
+================================================================================
+Trial 51 완료
+  Value (CSI): 0.468116
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10941723089816566, 'ffn_dropout': 0.24517957080429398, 'lr': 0.0013777718725485999, 'weight_decay': 0.00010061611254539375, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 06:59:40,653] Trial 52 finished with value: 0.5585078073512814 and parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13045934347609722, 'ffn_dropout': 0.2315861707316811, 'lr': 0.0004690003389278206, 'weight_decay': 0.00019041178321122618, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 52 완료
+  Value (CSI): 0.558508
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13045934347609722, 'ffn_dropout': 0.2315861707316811, 'lr': 0.0004690003389278206, 'weight_decay': 0.00019041178321122618, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 06:59:56,052] Trial 53 pruned. 
+
+================================================================================
+Trial 53 완료
+  Value (CSI): 0.528841
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.10151940972000272, 'ffn_dropout': 0.2093731690104555, 'lr': 0.0007482267767925803, 'weight_decay': 0.00014282175256641536, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:00:05,442] Trial 54 pruned. 
+
+================================================================================
+Trial 54 완료
+  Value (CSI): 0.490291
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.15920175376645507, 'ffn_dropout': 0.23970302614788955, 'lr': 0.0005965359702291647, 'weight_decay': 0.00022319891258199475, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:00:42,487] Trial 55 pruned. 
+
+================================================================================
+Trial 55 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.12342946785675463, 'ffn_dropout': 0.2223798276194096, 'lr': 0.0011547914666763786, 'weight_decay': 0.00030095731984255145, 'batch_size': 32}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:01:01,784] Trial 56 pruned. 
+
+================================================================================
+Trial 56 완료
+  Value (CSI): 0.531111
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1380425448327971, 'ffn_dropout': 0.24721408407777326, 'lr': 0.0003887558998240844, 'weight_decay': 0.00012737418257108757, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:01:15,598] Trial 57 pruned. 
+
+================================================================================
+Trial 57 완료
+  Value (CSI): 0.129326
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1124055161669908, 'ffn_dropout': 0.2626201951575484, 'lr': 0.0021039911887976498, 'weight_decay': 0.0001778007443822745, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:01:26,935] Trial 58 pruned. 
+
+================================================================================
+Trial 58 완료
+  Value (CSI): 0.510558
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.14896949629794498, 'ffn_dropout': 0.19907115067168207, 'lr': 0.0009390725760416146, 'weight_decay': 0.0006775809251056785, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:01:40,363] Trial 59 pruned. 
+
+================================================================================
+Trial 59 완료
+  Value (CSI): 0.499544
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.21106746040791097, 'ffn_dropout': 0.25537877962857963, 'lr': 0.0002968361599703228, 'weight_decay': 0.0001191149461477361, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:01:52,142] Trial 60 pruned. 
+
+================================================================================
+Trial 60 완료
+  Value (CSI): 0.444165
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.22947695568272905, 'ffn_dropout': 0.18596861561182923, 'lr': 0.0015021769597192136, 'weight_decay': 0.00020551666524536174, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:02:03,994] Trial 61 pruned. 
+
+================================================================================
+Trial 61 완료
+  Value (CSI): 0.503686
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10581112020050276, 'ffn_dropout': 0.23544967980553988, 'lr': 0.0011822546682288425, 'weight_decay': 0.0002701763285693385, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:02:20,258] Trial 62 pruned. 
+
+================================================================================
+Trial 62 완료
+  Value (CSI): 0.528102
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10003678990488277, 'ffn_dropout': 0.22168615525681906, 'lr': 0.0008199880254154385, 'weight_decay': 0.0001736291340956286, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:02:37,551] Trial 63 pruned. 
+
+================================================================================
+Trial 63 완료
+  Value (CSI): 0.539276
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12714415472900936, 'ffn_dropout': 0.2734734822203269, 'lr': 0.0005592318159644944, 'weight_decay': 0.00012224158543320225, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:02:50,783] Trial 64 pruned. 
+
+================================================================================
+Trial 64 완료
+  Value (CSI): 0.021465
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.11771186933477777, 'ffn_dropout': 0.24358235066778725, 'lr': 0.002837980857792554, 'weight_decay': 0.0008603752320224208, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:07:39,122] Trial 65 finished with value: 0.5589917958792664 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13245987614386515, 'ffn_dropout': 0.2541668796146638, 'lr': 0.0009530955649906689, 'weight_decay': 0.00035386203058233574, 'batch_size': 32}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 65 완료
+  Value (CSI): 0.558992
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13245987614386515, 'ffn_dropout': 0.2541668796146638, 'lr': 0.0009530955649906689, 'weight_decay': 0.00035386203058233574, 'batch_size': 32}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:07:51,284] Trial 66 pruned. 
+
+================================================================================
+Trial 66 완료
+  Value (CSI): 0.426819
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.10893112993751106, 'ffn_dropout': 0.20928653988071094, 'lr': 0.001726600418875313, 'weight_decay': 0.0002386527753523931, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:07:58,402] Trial 67 pruned. 
+
+================================================================================
+Trial 67 완료
+  Value (CSI): 0.501848
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13689322039567017, 'ffn_dropout': 0.22623479425468065, 'lr': 0.0006649976311164956, 'weight_decay': 0.00014824757684682056, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:09:18,200] Trial 68 finished with value: 0.5630920965979487 and parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15272816134906017, 'ffn_dropout': 0.2370638563231482, 'lr': 0.0013238396248552967, 'weight_decay': 0.00010137364531438386, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 68 완료
+  Value (CSI): 0.563092
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15272816134906017, 'ffn_dropout': 0.2370638563231482, 'lr': 0.0013238396248552967, 'weight_decay': 0.00010137364531438386, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:09:29,227] Trial 69 pruned. 
+
+================================================================================
+Trial 69 완료
+  Value (CSI): 0.522354
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1559264821506815, 'ffn_dropout': 0.28261431223984257, 'lr': 0.0013659953512738827, 'weight_decay': 0.00010781552968504348, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:11:40,839] Trial 70 finished with value: 0.5546036714652783 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25848758596151444, 'ffn_dropout': 0.23826408852600423, 'lr': 0.0004965327260409777, 'weight_decay': 0.0001651211795438362, 'batch_size': 64}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 70 완료
+  Value (CSI): 0.554604
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.25848758596151444, 'ffn_dropout': 0.23826408852600423, 'lr': 0.0004965327260409777, 'weight_decay': 0.0001651211795438362, 'batch_size': 64}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:11:51,344] Trial 71 pruned. 
+
+================================================================================
+Trial 71 완료
+  Value (CSI): 0.527411
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11828007405586916, 'ffn_dropout': 0.2623476950165934, 'lr': 0.0010505687073851795, 'weight_decay': 0.00010128511141521309, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:12:17,564] Trial 72 pruned. 
+
+================================================================================
+Trial 72 완료
+  Value (CSI): 0.544813
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12541009733103747, 'ffn_dropout': 0.25049082803338685, 'lr': 0.000870242479759837, 'weight_decay': 0.00019319977641739255, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:12:26,333] Trial 73 pruned. 
+
+================================================================================
+Trial 73 완료
+  Value (CSI): 0.506779
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10953656224799999, 'ffn_dropout': 0.233354403161391, 'lr': 0.0013592407478757967, 'weight_decay': 0.00012561228668832278, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:12:41,916] Trial 74 pruned. 
+
+================================================================================
+Trial 74 완료
+  Value (CSI): 0.547903
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.14178137858571038, 'ffn_dropout': 0.21999116487829629, 'lr': 0.0006437128648160788, 'weight_decay': 0.0002213536640900457, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:12:52,410] Trial 75 pruned. 
+
+================================================================================
+Trial 75 완료
+  Value (CSI): 0.498590
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.12218601701293104, 'ffn_dropout': 0.26989958842536865, 'lr': 0.0019840013376080773, 'weight_decay': 0.00016595213528509972, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:13:05,362] Trial 76 pruned. 
+
+================================================================================
+Trial 76 완료
+  Value (CSI): 0.536199
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10669035086761205, 'ffn_dropout': 0.24558832502567074, 'lr': 0.0007931159492287499, 'weight_decay': 0.0004807442069029227, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:14:23,672] Trial 77 finished with value: 0.5602677172261242 and parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.1345979958777974, 'ffn_dropout': 0.225552601916621, 'lr': 0.0004318955742744389, 'weight_decay': 0.0003035565288221005, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 77 완료
+  Value (CSI): 0.560268
+  Parameters: {'d_token': 128, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.1345979958777974, 'ffn_dropout': 0.225552601916621, 'lr': 0.0004318955742744389, 'weight_decay': 0.0003035565288221005, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:14:30,703] Trial 78 pruned. 
+
+================================================================================
+Trial 78 완료
+  Value (CSI): 0.489829
+  Parameters: {'d_token': 96, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.14812033586276363, 'ffn_dropout': 0.20478778727992406, 'lr': 0.0011635303663200484, 'weight_decay': 0.0001430355467026487, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:14:39,991] Trial 79 pruned. 
+
+================================================================================
+Trial 79 완료
+  Value (CSI): 0.450980
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11720846951128194, 'ffn_dropout': 0.213793301026177, 'lr': 0.002388519605266936, 'weight_decay': 0.00011842927282511962, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:15:19,071] Trial 80 pruned. 
+
+================================================================================
+Trial 80 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.1300993408742097, 'ffn_dropout': 0.23703139794448186, 'lr': 0.003395741664525577, 'weight_decay': 0.0028281194106626983, 'batch_size': 32}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:15:33,989] Trial 81 pruned. 
+
+================================================================================
+Trial 81 완료
+  Value (CSI): 0.534298
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10015065093858434, 'ffn_dropout': 0.25401460847135365, 'lr': 0.0016817060019209064, 'weight_decay': 0.0001512737795756964, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:17:01,635] Trial 82 finished with value: 0.557451049057104 and parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.11558986547088425, 'ffn_dropout': 0.2295377483714132, 'lr': 0.0015084798019324957, 'weight_decay': 0.00010122423589856241, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 82 완료
+  Value (CSI): 0.557451
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.11558986547088425, 'ffn_dropout': 0.2295377483714132, 'lr': 0.0015084798019324957, 'weight_decay': 0.00010122423589856241, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:17:13,234] Trial 83 pruned. 
+
+================================================================================
+Trial 83 완료
+  Value (CSI): 0.475339
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.1077347541902555, 'ffn_dropout': 0.24346040000355837, 'lr': 0.0010120425446530868, 'weight_decay': 0.00020533229648775765, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:17:24,690] Trial 84 pruned. 
+
+================================================================================
+Trial 84 완료
+  Value (CSI): 0.483297
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12321121442849256, 'ffn_dropout': 0.26570602378341474, 'lr': 0.000691813142629914, 'weight_decay': 0.00012739060865399188, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:17:46,292] Trial 85 pruned. 
+
+================================================================================
+Trial 85 완료
+  Value (CSI): 0.478136
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.14034600638018035, 'ffn_dropout': 0.25611570245356735, 'lr': 0.0013040107601561303, 'weight_decay': 0.000164234255806877, 'batch_size': 64}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:17:59,295] Trial 86 pruned. 
+
+================================================================================
+Trial 86 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12776636724510745, 'ffn_dropout': 0.21460684921266734, 'lr': 0.0019157195953662526, 'weight_decay': 0.00023208818121793167, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:18:14,278] Trial 87 pruned. 
+
+================================================================================
+Trial 87 완료
+  Value (CSI): 0.547682
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.11335811829188672, 'ffn_dropout': 0.27635358714632513, 'lr': 0.0008677533148935669, 'weight_decay': 0.00012350092021729412, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:18:26,203] Trial 88 pruned. 
+
+================================================================================
+Trial 88 완료
+  Value (CSI): 0.518460
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.16871047544982468, 'ffn_dropout': 0.2388100971514077, 'lr': 0.0005242274420110453, 'weight_decay': 0.00018809619941529134, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:20:18,602] Trial 89 finished with value: 0.5609178763332597 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15095024657967324, 'ffn_dropout': 0.25183108574848023, 'lr': 0.0010812305522258832, 'weight_decay': 0.0002673523262933242, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 89 완료
+  Value (CSI): 0.560918
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15095024657967324, 'ffn_dropout': 0.25183108574848023, 'lr': 0.0010812305522258832, 'weight_decay': 0.0002673523262933242, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+  Fold 2 - 클래스별 가중치: {0: 16.154696132596683, 1: 2.297838899803536, 2: 0.3995354239256678} (클래스별 샘플 수: {0: 362, 1: 2545, 2: 14637})
+  Fold 3 - 클래스별 가중치: {0: 19.04885993485342, 1: 2.213474640423921, 2: 0.40068516615279204} (클래스별 샘플 수: {0: 307, 1: 2642, 2: 14595})
+[I 2025-12-25 07:22:10,601] Trial 90 finished with value: 0.558089095584786 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15499310208384037, 'ffn_dropout': 0.25906732619028044, 'lr': 0.0007499848196698733, 'weight_decay': 0.00026029226063242414, 'batch_size': 128}. Best is trial 23 with value: 0.5673234518633549.
+
+================================================================================
+Trial 90 완료
+  Value (CSI): 0.558089
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.15499310208384037, 'ffn_dropout': 0.25906732619028044, 'lr': 0.0007499848196698733, 'weight_decay': 0.00026029226063242414, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:22:26,538] Trial 91 pruned. 
+
+================================================================================
+Trial 91 완료
+  Value (CSI): 0.502479
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1465665384952893, 'ffn_dropout': 0.24988385009388395, 'lr': 0.0010784811432363486, 'weight_decay': 0.0001414319092803071, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:22:46,611] Trial 92 pruned. 
+
+================================================================================
+Trial 92 완료
+  Value (CSI): 0.550133
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.13322203554273399, 'ffn_dropout': 0.2312655914423539, 'lr': 0.0012537833023604336, 'weight_decay': 0.00011585187515792863, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:22:58,413] Trial 93 pruned. 
+
+================================================================================
+Trial 93 완료
+  Value (CSI): 0.512834
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.10579157944200678, 'ffn_dropout': 0.24474105302260635, 'lr': 0.0015146555160636527, 'weight_decay': 0.00015482765291912118, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:23:12,807] Trial 94 pruned. 
+
+================================================================================
+Trial 94 완료
+  Value (CSI): 0.519523
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.11879484759434887, 'ffn_dropout': 0.2707928587500692, 'lr': 0.0005822613158079102, 'weight_decay': 0.0001993489636222018, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:23:23,308] Trial 95 pruned. 
+
+================================================================================
+Trial 95 완료
+  Value (CSI): 0.545793
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.16143115699626526, 'ffn_dropout': 0.2256022089771042, 'lr': 0.0009662977616486305, 'weight_decay': 0.00028171907157805386, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:23:31,858] Trial 96 pruned. 
+
+================================================================================
+Trial 96 완료
+  Value (CSI): 0.487982
+  Parameters: {'d_token': 64, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.15188729798183037, 'ffn_dropout': 0.26264454521101416, 'lr': 0.0017707658850600145, 'weight_decay': 0.0001737744083580078, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:23:39,198] Trial 97 pruned. 
+
+================================================================================
+Trial 97 완료
+  Value (CSI): 0.522466
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.1274005919243627, 'ffn_dropout': 0.25062578638302235, 'lr': 0.00036716551853883825, 'weight_decay': 0.0003358189414410445, 'batch_size': 128}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:23:46,036] Trial 98 pruned. 
+
+================================================================================
+Trial 98 완료
+  Value (CSI): 0.509833
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.11152821978881004, 'ffn_dropout': 0.23909790437136705, 'lr': 0.0007962193809000453, 'weight_decay': 0.00010061915238722948, 'batch_size': 256}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 15.826558265582657, 1: 2.248748556026184, 2: 0.4012642572488663} (클래스별 샘플 수: {0: 369, 1: 2597, 2: 14554})
+[I 2025-12-25 07:24:16,168] Trial 99 pruned. 
+
+================================================================================
+Trial 99 완료
+  Value (CSI): 0.451117
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.13893357896656316, 'ffn_dropout': 0.21967225610942365, 'lr': 0.0010979331658424985, 'weight_decay': 0.0001397695837883291, 'batch_size': 32}
+  Best Value (CSI): 0.567323
+  Best Trial: 23
+  Best Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+================================================================================
+
+
+최적화 완료.
+Best CSI Score: 0.5673
+Best Hyperparameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.12006219567079585, 'ffn_dropout': 0.19152888035195653, 'lr': 0.0011919865831209798, 'weight_decay': 0.00010616617862067153, 'batch_size': 128}
+
+최적화 과정 요약:
+  - 총 시도 횟수: 100
+  - 성공한 시도: 100
+  - 최초 CSI: 0.5024
+  - 최종 CSI: 0.4511
+  - 최고 CSI: 0.5673
+  - 최저 CSI: 0.0000
+  - 평균 CSI: 0.4514
+
+최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_pure_incheon_trials.pkl에 저장되었습니다.
+
+==================================================
+최적화된 하이퍼파라미터로 최종 모델 학습 시작
+==================================================
+최종 모델 학습 시작...
+Fold 1 학습 중...
+  Early stopping at epoch 31, Best CSI: 0.5529
+  Fold 1 학습 완료 (검증 CSI: 0.5529)
+Fold 2 학습 중...
+  Early stopping at epoch 39, Best CSI: 0.5763
+  Fold 2 학습 완료 (검증 CSI: 0.5763)
+Fold 3 학습 중...
+  Early stopping at epoch 57, Best CSI: 0.5337
+  Fold 3 학습 완료 (검증 CSI: 0.5337)
+
+모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_pure_incheon.pkl (총 3개 fold)
+Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_pure_incheon_scaler.pkl (총 3개 fold)
+
+최종 모델 학습 및 저장 완료!
+저장된 모델 경로:
+  - .
+  - .
+  - /
+  - s
+  - a
+  - v
+  - e
+  - _
+  - m
+  - o
+  - d
+  - e
+  - l
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - o
+  - p
+  - t
+  - i
+  - m
+  - a
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - p
+  - u
+  - r
+  - e
+  - _
+  - i
+  - n
+  - c
+  - h
+  - e
+  - o
+  - n
+  - .
+  - p
+  - k
+  - l
+
+✓ 완료: ft_transformer_pure/ft_transforemer_pure_incheon.py (소요 시간: 4632초)
+
+----------------------------------------
+실행 중: ft_transformer_pure/ft_transforemer_pure_seoul.py
+시작 시간: 2025-12-25 07:25:54
+----------------------------------------
+[I 2025-12-25 07:25:55,483] A new study created in memory with name: no-name-ae23788f-af81-465a-97aa-bb3287cd4008
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:28:26,019] Trial 0 finished with value: 0.5516272189922957 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 0 완료
+  Value (CSI): 0.551627
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:33:01,928] Trial 1 finished with value: 0.5381974059111133 and parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3957624914419582, 'ffn_dropout': 0.28221873024846195, 'lr': 5.922024977291002e-05, 'weight_decay': 0.01834449314154107, 'batch_size': 32}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 1 완료
+  Value (CSI): 0.538197
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3957624914419582, 'ffn_dropout': 0.28221873024846195, 'lr': 5.922024977291002e-05, 'weight_decay': 0.01834449314154107, 'batch_size': 32}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:34:27,239] Trial 2 finished with value: 0.34316179183287976 and parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1849419874986023, 'ffn_dropout': 0.3194382563399701, 'lr': 1.3215155944918477e-05, 'weight_decay': 0.00010723029366949362, 'batch_size': 256}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 2 완료
+  Value (CSI): 0.343162
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.1849419874986023, 'ffn_dropout': 0.3194382563399701, 'lr': 1.3215155944918477e-05, 'weight_decay': 0.00010723029366949362, 'batch_size': 256}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:40:26,567] Trial 3 finished with value: 0.502765263560935 and parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.3734167968154649, 'ffn_dropout': 0.2820248473948035, 'lr': 1.117632574228902e-05, 'weight_decay': 0.044130376903043556, 'batch_size': 32}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 3 완료
+  Value (CSI): 0.502765
+  Parameters: {'d_token': 224, 'n_blocks': 6, 'n_heads': 8, 'attention_dropout': 0.3734167968154649, 'ffn_dropout': 0.2820248473948035, 'lr': 1.117632574228902e-05, 'weight_decay': 0.044130376903043556, 'batch_size': 32}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:43:17,622] Trial 4 finished with value: 0.5249086792788855 and parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.122488946224889, 'ffn_dropout': 0.12644996179894155, 'lr': 0.0010718671209128574, 'weight_decay': 0.0014851947005563343, 'batch_size': 64}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 4 완료
+  Value (CSI): 0.524909
+  Parameters: {'d_token': 96, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.122488946224889, 'ffn_dropout': 0.12644996179894155, 'lr': 0.0010718671209128574, 'weight_decay': 0.0014851947005563343, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:46:35,629] Trial 5 finished with value: 0.5321412931059356 and parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.32084512543935795, 'ffn_dropout': 0.24110226508088783, 'lr': 0.000587923764519226, 'weight_decay': 0.00017014671016480896, 'batch_size': 32}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 5 완료
+  Value (CSI): 0.532141
+  Parameters: {'d_token': 64, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.32084512543935795, 'ffn_dropout': 0.24110226508088783, 'lr': 0.000587923764519226, 'weight_decay': 0.00017014671016480896, 'batch_size': 32}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:46:40,824] Trial 6 pruned. 
+
+================================================================================
+Trial 6 완료
+  Value (CSI): 0.298845
+  Parameters: {'d_token': 96, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.14386947983650183, 'ffn_dropout': 0.332291102133211, 'lr': 7.671551506136383e-05, 'weight_decay': 0.00031258635385618503, 'batch_size': 256}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:47:01,861] Trial 7 pruned. 
+
+================================================================================
+Trial 7 완료
+  Value (CSI): 0.420724
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3714757570198084, 'ffn_dropout': 0.3161536172905419, 'lr': 0.00010129660602362034, 'weight_decay': 0.0013472002169098482, 'batch_size': 128}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:47:52,778] Trial 8 pruned. 
+
+================================================================================
+Trial 8 완료
+  Value (CSI): 0.396172
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.31049221863361653, 'ffn_dropout': 0.30441785533549093, 'lr': 8.210429436419445e-05, 'weight_decay': 0.0018896836870957452, 'batch_size': 32}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 07:49:42,183] Trial 9 pruned. 
+
+================================================================================
+Trial 9 완료
+  Value (CSI): 0.552115
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.34316616117018295, 'ffn_dropout': 0.23488563022890852, 'lr': 0.00010812279211311514, 'weight_decay': 0.006591201554469069, 'batch_size': 32}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:50:07,448] Trial 10 pruned. 
+
+================================================================================
+Trial 10 완료
+  Value (CSI): 0.000000
+  Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.25313204325871247, 'ffn_dropout': 0.11242173336007309, 'lr': 0.005479340095904968, 'weight_decay': 0.09001629340633736, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:50:46,125] Trial 11 pruned. 
+
+================================================================================
+Trial 11 완료
+  Value (CSI): 0.415990
+  Parameters: {'d_token': 160, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.39810129115854076, 'ffn_dropout': 0.38167657547950534, 'lr': 3.644060632316875e-05, 'weight_decay': 0.02118723961381504, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:51:04,416] Trial 12 pruned. 
+
+================================================================================
+Trial 12 완료
+  Value (CSI): 0.420716
+  Parameters: {'d_token': 128, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.26455943682334065, 'ffn_dropout': 0.1813215409629474, 'lr': 0.0002512652761174567, 'weight_decay': 0.01652236140471896, 'batch_size': 128}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 07:52:46,106] Trial 13 pruned. 
+
+================================================================================
+Trial 13 완료
+  Value (CSI): 0.559690
+  Parameters: {'d_token': 192, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.21083940534141485, 'ffn_dropout': 0.17742765350306205, 'lr': 2.7230039730583293e-05, 'weight_decay': 0.08917891408168774, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 07:58:41,428] Trial 14 finished with value: 0.5315997607666519 and parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2787525644055048, 'ffn_dropout': 0.2030400087597299, 'lr': 0.00023280027847102073, 'weight_decay': 0.014229632703614848, 'batch_size': 32}. Best is trial 0 with value: 0.5516272189922957.
+
+================================================================================
+Trial 14 완료
+  Value (CSI): 0.531600
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2787525644055048, 'ffn_dropout': 0.2030400087597299, 'lr': 0.00023280027847102073, 'weight_decay': 0.014229632703614848, 'batch_size': 32}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:59:16,728] Trial 15 pruned. 
+
+================================================================================
+Trial 15 완료
+  Value (CSI): 0.390097
+  Parameters: {'d_token': 128, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.29703098872550243, 'ffn_dropout': 0.14600639818942096, 'lr': 2.8638212554517335e-05, 'weight_decay': 0.03351305719392332, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:59:23,078] Trial 16 pruned. 
+
+================================================================================
+Trial 16 완료
+  Value (CSI): 0.324988
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.23687131287685745, 'ffn_dropout': 0.10280282461178619, 'lr': 4.609241367366993e-05, 'weight_decay': 0.0056972532623146225, 'batch_size': 256}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:59:37,361] Trial 17 pruned. 
+
+================================================================================
+Trial 17 완료
+  Value (CSI): 0.398175
+  Parameters: {'d_token': 128, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.33417592642771893, 'ffn_dropout': 0.2659476425754799, 'lr': 0.00019986222076242768, 'weight_decay': 0.009291689478051977, 'batch_size': 128}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 07:59:55,298] Trial 18 pruned. 
+
+================================================================================
+Trial 18 완료
+  Value (CSI): 0.329510
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.21268367465668145, 'ffn_dropout': 0.2255176361708237, 'lr': 2.2193384046683638e-05, 'weight_decay': 0.038034618169927314, 'batch_size': 64}
+  Best Value (CSI): 0.551627
+  Best Trial: 0
+  Best Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24598045981097041, 'ffn_dropout': 0.1492675958727639, 'lr': 6.505783120864953e-05, 'weight_decay': 0.04165805124014258, 'batch_size': 64}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:04:55,355] Trial 19 finished with value: 0.5554215697637764 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}. Best is trial 19 with value: 0.5554215697637764.
+
+================================================================================
+Trial 19 완료
+  Value (CSI): 0.555422
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:07:28,171] Trial 20 pruned. 
+
+================================================================================
+Trial 20 완료
+  Value (CSI): 0.493623
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2810839842475639, 'ffn_dropout': 0.1534448693886259, 'lr': 0.00015780932911467425, 'weight_decay': 0.0032131756015100392, 'batch_size': 32}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:09:50,910] Trial 21 pruned. 
+
+================================================================================
+Trial 21 완료
+  Value (CSI): 0.557430
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.29717698961380573, 'ffn_dropout': 0.20976130652579494, 'lr': 5.343681295037588e-05, 'weight_decay': 0.010231218793211124, 'batch_size': 32}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:13:35,326] Trial 22 finished with value: 0.5417138999802594 and parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.34863429382910055, 'ffn_dropout': 0.16194611936613346, 'lr': 5.73158749607141e-05, 'weight_decay': 0.025239319775156963, 'batch_size': 32}. Best is trial 19 with value: 0.5554215697637764.
+
+================================================================================
+Trial 22 완료
+  Value (CSI): 0.541714
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.34863429382910055, 'ffn_dropout': 0.16194611936613346, 'lr': 5.73158749607141e-05, 'weight_decay': 0.025239319775156963, 'batch_size': 32}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:14:27,741] Trial 23 pruned. 
+
+================================================================================
+Trial 23 완료
+  Value (CSI): 0.405533
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.34722808720913334, 'ffn_dropout': 0.14650268513655668, 'lr': 2.0993536358958997e-05, 'weight_decay': 0.04967521473537206, 'batch_size': 32}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:18:44,093] Trial 24 finished with value: 0.5457417451729959 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.31249426454931456, 'ffn_dropout': 0.18325267410505997, 'lr': 0.000127339516024954, 'weight_decay': 0.021974288000954616, 'batch_size': 32}. Best is trial 19 with value: 0.5554215697637764.
+
+================================================================================
+Trial 24 완료
+  Value (CSI): 0.545742
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.31249426454931456, 'ffn_dropout': 0.18325267410505997, 'lr': 0.000127339516024954, 'weight_decay': 0.021974288000954616, 'batch_size': 32}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:19:25,905] Trial 25 pruned. 
+
+================================================================================
+Trial 25 완료
+  Value (CSI): 0.431646
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.26887880403103126, 'ffn_dropout': 0.1897655577332956, 'lr': 0.00013869876237473664, 'weight_decay': 0.0675509547913591, 'batch_size': 64}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:19:44,823] Trial 26 pruned. 
+
+================================================================================
+Trial 26 완료
+  Value (CSI): 0.414887
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.24056004590267777, 'ffn_dropout': 0.12609703046482773, 'lr': 0.00036972322554796184, 'weight_decay': 0.025446072008396967, 'batch_size': 128}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:19:52,559] Trial 27 pruned. 
+
+================================================================================
+Trial 27 완료
+  Value (CSI): 0.346694
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3046215289366382, 'ffn_dropout': 0.170926726735502, 'lr': 0.00012092362879186356, 'weight_decay': 0.05425113041079499, 'batch_size': 256}
+  Best Value (CSI): 0.555422
+  Best Trial: 19
+  Best Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2868389431100919, 'ffn_dropout': 0.16640752856148106, 'lr': 5.463974806450829e-05, 'weight_decay': 0.004850813772365092, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:23:33,644] Trial 28 finished with value: 0.562070126103511 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 28 완료
+  Value (CSI): 0.562070
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:25:59,934] Trial 29 finished with value: 0.5463403272253701 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2879669548127678, 'ffn_dropout': 0.21762177868970356, 'lr': 5.178662913743865e-05, 'weight_decay': 0.013703768925630307, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 29 완료
+  Value (CSI): 0.546340
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2879669548127678, 'ffn_dropout': 0.21762177868970356, 'lr': 5.178662913743865e-05, 'weight_decay': 0.013703768925630307, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:26:24,943] Trial 30 pruned. 
+
+================================================================================
+Trial 30 완료
+  Value (CSI): 0.442472
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2584861855253809, 'ffn_dropout': 0.19799860769861008, 'lr': 3.859663593043522e-05, 'weight_decay': 0.004485926336279485, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:27:56,476] Trial 31 pruned. 
+
+================================================================================
+Trial 31 완료
+  Value (CSI): 0.541916
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.28361289211352503, 'ffn_dropout': 0.22041062051725724, 'lr': 6.550896699132325e-05, 'weight_decay': 0.00971814817100261, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:28:28,648] Trial 32 pruned. 
+
+================================================================================
+Trial 32 완료
+  Value (CSI): 0.395713
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2871642182505098, 'ffn_dropout': 0.24832958834537353, 'lr': 1.819072946665581e-05, 'weight_decay': 0.013688473557228187, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:29:13,734] Trial 33 pruned. 
+
+================================================================================
+Trial 33 완료
+  Value (CSI): 0.418075
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2413919761563776, 'ffn_dropout': 0.2105842385439346, 'lr': 1.437893826267893e-05, 'weight_decay': 0.03579089733944812, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:29:42,120] Trial 34 pruned. 
+
+================================================================================
+Trial 34 완료
+  Value (CSI): 0.337775
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2711329661366219, 'ffn_dropout': 0.16718280567799854, 'lr': 1.062530947582775e-05, 'weight_decay': 0.013983875486636491, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:31:10,388] Trial 35 pruned. 
+
+================================================================================
+Trial 35 완료
+  Value (CSI): 0.548054
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.32445044927554334, 'ffn_dropout': 0.1950885405558097, 'lr': 3.3602628164525815e-05, 'weight_decay': 0.008191417158953591, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:31:19,826] Trial 36 pruned. 
+
+================================================================================
+Trial 36 완료
+  Value (CSI): 0.414695
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2936207285205797, 'ffn_dropout': 0.13472844581929178, 'lr': 7.387583928198726e-05, 'weight_decay': 0.00517446125094821, 'batch_size': 256}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:34:07,446] Trial 37 finished with value: 0.5310525741462949 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22093087860252783, 'ffn_dropout': 0.22414605069547192, 'lr': 4.425122651216155e-05, 'weight_decay': 0.030510542717127487, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 37 완료
+  Value (CSI): 0.531053
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.22093087860252783, 'ffn_dropout': 0.22414605069547192, 'lr': 4.425122651216155e-05, 'weight_decay': 0.030510542717127487, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:35:37,320] Trial 38 pruned. 
+
+================================================================================
+Trial 38 완료
+  Value (CSI): 0.560153
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2552677442034818, 'ffn_dropout': 0.15112507585529883, 'lr': 9.460362683254514e-05, 'weight_decay': 0.019125368589434925, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:37:44,272] Trial 39 finished with value: 0.5403674251668541 and parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.17877448631586923, 'ffn_dropout': 0.23720195556969415, 'lr': 6.355505571845566e-05, 'weight_decay': 0.0036785956316733545, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 39 완료
+  Value (CSI): 0.540367
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.17877448631586923, 'ffn_dropout': 0.23720195556969415, 'lr': 6.355505571845566e-05, 'weight_decay': 0.0036785956316733545, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:37:51,548] Trial 40 pruned. 
+
+================================================================================
+Trial 40 완료
+  Value (CSI): 0.380144
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.3178951311574407, 'ffn_dropout': 0.25771632176856274, 'lr': 8.646315065741757e-05, 'weight_decay': 0.0071552695227808565, 'batch_size': 128}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:42:18,116] Trial 41 finished with value: 0.5459289508978732 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30768231877857705, 'ffn_dropout': 0.1822640968989523, 'lr': 0.0001411897255038765, 'weight_decay': 0.020814956110416935, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 41 완료
+  Value (CSI): 0.545929
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30768231877857705, 'ffn_dropout': 0.1822640968989523, 'lr': 0.0001411897255038765, 'weight_decay': 0.020814956110416935, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:44:13,772] Trial 42 pruned. 
+
+================================================================================
+Trial 42 완료
+  Value (CSI): 0.566718
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.30122257987107753, 'ffn_dropout': 0.1666829430030687, 'lr': 5.353834645428403e-05, 'weight_decay': 0.01106491982443498, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:47:59,580] Trial 43 finished with value: 0.5457199576979873 and parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2738154541992785, 'ffn_dropout': 0.2016834142621864, 'lr': 0.00016374315358315842, 'weight_decay': 0.019272054116882546, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 43 완료
+  Value (CSI): 0.545720
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2738154541992785, 'ffn_dropout': 0.2016834142621864, 'lr': 0.00016374315358315842, 'weight_decay': 0.019272054116882546, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:49:31,455] Trial 44 pruned. 
+
+================================================================================
+Trial 44 완료
+  Value (CSI): 0.419580
+  Parameters: {'d_token': 256, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.32702457837667914, 'ffn_dropout': 0.18150316802767166, 'lr': 8.913288902920807e-05, 'weight_decay': 0.0026147556268247105, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:50:57,611] Trial 45 pruned. 
+
+================================================================================
+Trial 45 완료
+  Value (CSI): 0.543171
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.3126437535403685, 'ffn_dropout': 0.19331056088949622, 'lr': 3.532887605984638e-05, 'weight_decay': 0.006576006315518689, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:51:08,716] Trial 46 pruned. 
+
+================================================================================
+Trial 46 완료
+  Value (CSI): 0.393939
+  Parameters: {'d_token': 256, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.2873341218636772, 'ffn_dropout': 0.2124951160717216, 'lr': 0.00010164502781121964, 'weight_decay': 0.012519604837412867, 'batch_size': 256}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:51:42,892] Trial 47 pruned. 
+
+================================================================================
+Trial 47 완료
+  Value (CSI): 0.411305
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.26787658142993614, 'ffn_dropout': 0.17629034671019322, 'lr': 6.995684127860934e-05, 'weight_decay': 0.017251388465541355, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:52:41,946] Trial 48 pruned. 
+
+================================================================================
+Trial 48 완료
+  Value (CSI): 0.420620
+  Parameters: {'d_token': 96, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.25323615500713, 'ffn_dropout': 0.23100211798919867, 'lr': 2.6863589461420407e-05, 'weight_decay': 0.027511360374086132, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 08:53:51,434] Trial 49 pruned. 
+
+================================================================================
+Trial 49 완료
+  Value (CSI): 0.404527
+  Parameters: {'d_token': 160, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.3033265739243797, 'ffn_dropout': 0.1395342023884493, 'lr': 4.5581824251467965e-05, 'weight_decay': 0.047873432962633564, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 08:57:17,907] Trial 50 finished with value: 0.5457473549045301 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.29001734438705484, 'ffn_dropout': 0.1638789901645844, 'lr': 0.00011555556645607427, 'weight_decay': 0.0073815725730472, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 50 완료
+  Value (CSI): 0.545747
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.29001734438705484, 'ffn_dropout': 0.1638789901645844, 'lr': 0.00011555556645607427, 'weight_decay': 0.0073815725730472, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 08:58:28,962] Trial 51 pruned. 
+
+================================================================================
+Trial 51 완료
+  Value (CSI): 0.561390
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.28108494847493726, 'ffn_dropout': 0.15716615709747975, 'lr': 0.0001200240870038988, 'weight_decay': 0.008147463880996415, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:00:42,550] Trial 52 finished with value: 0.5414908259876977 and parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.29023794888645094, 'ffn_dropout': 0.16220045629486163, 'lr': 0.0001728106052313947, 'weight_decay': 0.015031125056450116, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 52 완료
+  Value (CSI): 0.541491
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.29023794888645094, 'ffn_dropout': 0.16220045629486163, 'lr': 0.0001728106052313947, 'weight_decay': 0.015031125056450116, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:02:51,162] Trial 53 finished with value: 0.5384322342255672 and parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.26375224988611623, 'ffn_dropout': 0.12580375477043804, 'lr': 0.00027375979568912434, 'weight_decay': 0.005887964021874846, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 53 완료
+  Value (CSI): 0.538432
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.26375224988611623, 'ffn_dropout': 0.12580375477043804, 'lr': 0.00027375979568912434, 'weight_decay': 0.005887964021874846, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:05:10,157] Trial 54 finished with value: 0.5465328682478096 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3065860861042893, 'ffn_dropout': 0.17523841633063436, 'lr': 8.352361967773e-05, 'weight_decay': 0.011019702919082075, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 54 완료
+  Value (CSI): 0.546533
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3065860861042893, 'ffn_dropout': 0.17523841633063436, 'lr': 8.352361967773e-05, 'weight_decay': 0.011019702919082075, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:05:33,890] Trial 55 pruned. 
+
+================================================================================
+Trial 55 완료
+  Value (CSI): 0.429242
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3353827789267406, 'ffn_dropout': 0.18706485633757103, 'lr': 8.044064082499987e-05, 'weight_decay': 0.02169917608135279, 'batch_size': 128}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:06:33,594] Trial 56 pruned. 
+
+================================================================================
+Trial 56 완료
+  Value (CSI): 0.587375
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.3087278604421053, 'ffn_dropout': 0.1786594042459489, 'lr': 5.612837829758283e-05, 'weight_decay': 0.01055731836486332, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:09:00,742] Trial 57 pruned. 
+
+================================================================================
+Trial 57 완료
+  Value (CSI): 0.589078
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2749790332941584, 'ffn_dropout': 0.2068959384018273, 'lr': 0.00019516863957490694, 'weight_decay': 0.03322828679381044, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:09:19,320] Trial 58 pruned. 
+
+================================================================================
+Trial 58 완료
+  Value (CSI): 0.409091
+  Parameters: {'d_token': 192, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.318178257455011, 'ffn_dropout': 0.19195595190603393, 'lr': 4.186498175408503e-05, 'weight_decay': 0.017944769603722103, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:09:27,509] Trial 59 pruned. 
+
+================================================================================
+Trial 59 완료
+  Value (CSI): 0.339143
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.3579873790798576, 'ffn_dropout': 0.17204756365626866, 'lr': 7.243239006818476e-05, 'weight_decay': 0.012394190321638066, 'batch_size': 256}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:12:20,391] Trial 60 pruned. 
+
+================================================================================
+Trial 60 완료
+  Value (CSI): 0.585062
+  Parameters: {'d_token': 256, 'n_blocks': 5, 'n_heads': 4, 'attention_dropout': 0.32769684530937443, 'ffn_dropout': 0.1519019206527023, 'lr': 0.00014167937452403645, 'weight_decay': 0.022893263619975755, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:12:44,204] Trial 61 pruned. 
+
+================================================================================
+Trial 61 완료
+  Value (CSI): 0.443564
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.29664161102225756, 'ffn_dropout': 0.15996563936188798, 'lr': 0.00010487961324456186, 'weight_decay': 0.0097137437289535, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:13:00,699] Trial 62 pruned. 
+
+================================================================================
+Trial 62 완료
+  Value (CSI): 0.396572
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3083426827205797, 'ffn_dropout': 0.18481500655742436, 'lr': 5.0347052380055105e-05, 'weight_decay': 0.004670181832000532, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:15:51,114] Trial 63 finished with value: 0.5525839754505822 and parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.29257810592451183, 'ffn_dropout': 0.21781445223448181, 'lr': 0.00011240275451906387, 'weight_decay': 0.008348943910945933, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 63 완료
+  Value (CSI): 0.552584
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.29257810592451183, 'ffn_dropout': 0.21781445223448181, 'lr': 0.00011240275451906387, 'weight_decay': 0.008348943910945933, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:16:45,981] Trial 64 pruned. 
+
+================================================================================
+Trial 64 완료
+  Value (CSI): 0.568536
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2780175813566006, 'ffn_dropout': 0.20461871535367468, 'lr': 6.348820485685483e-05, 'weight_decay': 0.012278106567620252, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:17:15,546] Trial 65 pruned. 
+
+================================================================================
+Trial 65 완료
+  Value (CSI): 0.440667
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.2982298404640549, 'ffn_dropout': 0.24223793467797433, 'lr': 8.266097119008794e-05, 'weight_decay': 0.008376276046408462, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:17:51,193] Trial 66 pruned. 
+
+================================================================================
+Trial 66 완료
+  Value (CSI): 0.368162
+  Parameters: {'d_token': 64, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.25933535407371394, 'ffn_dropout': 0.21210724014933782, 'lr': 0.0001961788061488939, 'weight_decay': 0.016595401608750178, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:18:01,859] Trial 67 pruned. 
+
+================================================================================
+Trial 67 완료
+  Value (CSI): 0.361702
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 8, 'attention_dropout': 0.2798575118956407, 'ffn_dropout': 0.21843966391837544, 'lr': 3.064561554736292e-05, 'weight_decay': 0.0055172211175228605, 'batch_size': 128}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:20:10,901] Trial 68 pruned. 
+
+================================================================================
+Trial 68 완료
+  Value (CSI): 0.609334
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.3192774441115201, 'ffn_dropout': 0.22954957502594683, 'lr': 0.00010263702781212295, 'weight_decay': 0.024282355729070244, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:22:20,036] Trial 69 finished with value: 0.5423219814241064 and parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.24972957462776307, 'ffn_dropout': 0.19857874156431607, 'lr': 0.00014023546913538497, 'weight_decay': 0.029019896008141404, 'batch_size': 64}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 69 완료
+  Value (CSI): 0.542322
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.24972957462776307, 'ffn_dropout': 0.19857874156431607, 'lr': 0.00014023546913538497, 'weight_decay': 0.029019896008141404, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:24:31,737] Trial 70 pruned. 
+
+================================================================================
+Trial 70 완료
+  Value (CSI): 0.569678
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.28939564909339976, 'ffn_dropout': 0.17417145581986787, 'lr': 5.014224268809361e-05, 'weight_decay': 0.03934849584042267, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:25:23,566] Trial 71 pruned. 
+
+================================================================================
+Trial 71 완료
+  Value (CSI): 0.599669
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2952197899960165, 'ffn_dropout': 0.16448188388852159, 'lr': 0.00011897101915145409, 'weight_decay': 0.0071697501748524545, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:25:39,199] Trial 72 pruned. 
+
+================================================================================
+Trial 72 완료
+  Value (CSI): 0.386637
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.3067623077313092, 'ffn_dropout': 0.18819860572380528, 'lr': 7.710303844627952e-05, 'weight_decay': 0.008726664048252506, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:26:33,815] Trial 73 pruned. 
+
+================================================================================
+Trial 73 완료
+  Value (CSI): 0.553543
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.267020865980079, 'ffn_dropout': 0.14377754245093252, 'lr': 0.00011474163485954852, 'weight_decay': 0.014960127021872986, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:26:46,700] Trial 74 pruned. 
+
+================================================================================
+Trial 74 완료
+  Value (CSI): 0.397017
+  Parameters: {'d_token': 224, 'n_blocks': 2, 'n_heads': 8, 'attention_dropout': 0.2863419566956, 'ffn_dropout': 0.15653030198481113, 'lr': 5.871599163474262e-05, 'weight_decay': 0.004171806506342129, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:27:14,645] Trial 75 pruned. 
+
+================================================================================
+Trial 75 완료
+  Value (CSI): 0.427051
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.27434514616094235, 'ffn_dropout': 0.17089464346427125, 'lr': 4.070450043993896e-05, 'weight_decay': 0.006944990963760583, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:28:45,756] Trial 76 pruned. 
+
+================================================================================
+Trial 76 완료
+  Value (CSI): 0.597613
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.30263236766050194, 'ffn_dropout': 0.21885315964356694, 'lr': 0.00015280401873982486, 'weight_decay': 0.01181418393502355, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:28:59,367] Trial 77 pruned. 
+
+================================================================================
+Trial 77 완료
+  Value (CSI): 0.374212
+  Parameters: {'d_token': 224, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.2927680244734795, 'ffn_dropout': 0.20011253854652816, 'lr': 6.667804804102877e-05, 'weight_decay': 0.010050095698690508, 'batch_size': 256}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:29:20,964] Trial 78 pruned. 
+
+================================================================================
+Trial 78 완료
+  Value (CSI): 0.409257
+  Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.31697349876545156, 'ffn_dropout': 0.1867725147723599, 'lr': 9.373396928459183e-05, 'weight_decay': 0.005966206498782802, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:30:15,541] Trial 79 pruned. 
+
+================================================================================
+Trial 79 완료
+  Value (CSI): 0.389850
+  Parameters: {'d_token': 96, 'n_blocks': 6, 'n_heads': 4, 'attention_dropout': 0.28212812007453275, 'ffn_dropout': 0.14930755981156033, 'lr': 3.5214561420353395e-05, 'weight_decay': 0.01374149828238767, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:31:17,719] Trial 80 pruned. 
+
+================================================================================
+Trial 80 완료
+  Value (CSI): 0.422333
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.31169614993397304, 'ffn_dropout': 0.13474806266116046, 'lr': 9.449054657037952e-05, 'weight_decay': 0.018197035063025124, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:36:11,107] Trial 81 finished with value: 0.5522114948820387 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.29908797322246794, 'ffn_dropout': 0.1750651361903481, 'lr': 0.00011522069731884435, 'weight_decay': 0.02130553248327465, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 81 완료
+  Value (CSI): 0.552211
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.29908797322246794, 'ffn_dropout': 0.1750651361903481, 'lr': 0.00011522069731884435, 'weight_decay': 0.02130553248327465, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:38:32,664] Trial 82 pruned. 
+
+================================================================================
+Trial 82 완료
+  Value (CSI): 0.598657
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30169231186784123, 'ffn_dropout': 0.17518513646031003, 'lr': 0.00013600338957476705, 'weight_decay': 0.021251778403280113, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:40:48,014] Trial 83 pruned. 
+
+================================================================================
+Trial 83 완료
+  Value (CSI): 0.544624
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.28809104910473904, 'ffn_dropout': 0.18138491585091573, 'lr': 8.081857523924903e-05, 'weight_decay': 0.04121820371882086, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:42:54,385] Trial 84 pruned. 
+
+================================================================================
+Trial 84 완료
+  Value (CSI): 0.557122
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2703448934802698, 'ffn_dropout': 0.19434938189993547, 'lr': 6.20057494755154e-05, 'weight_decay': 0.015895025988485915, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:43:31,924] Trial 85 pruned. 
+
+================================================================================
+Trial 85 완료
+  Value (CSI): 0.403114
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.2618991965462718, 'ffn_dropout': 0.16730191734911898, 'lr': 0.00023547578617873633, 'weight_decay': 0.027873201171358497, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:43:45,513] Trial 86 pruned. 
+
+================================================================================
+Trial 86 완료
+  Value (CSI): 0.418919
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.29590564046485685, 'ffn_dropout': 0.1587776859622761, 'lr': 0.0001141224114723154, 'weight_decay': 0.010520114849056367, 'batch_size': 128}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:44:24,444] Trial 87 pruned. 
+
+================================================================================
+Trial 87 완료
+  Value (CSI): 0.402636
+  Parameters: {'d_token': 256, 'n_blocks': 5, 'n_heads': 8, 'attention_dropout': 0.3248897780536072, 'ffn_dropout': 0.1980916602107739, 'lr': 0.00017125614956711298, 'weight_decay': 0.008306181672228827, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:46:17,746] Trial 88 pruned. 
+
+================================================================================
+Trial 88 완료
+  Value (CSI): 0.542289
+  Parameters: {'d_token': 256, 'n_blocks': 3, 'n_heads': 4, 'attention_dropout': 0.283763375023306, 'ffn_dropout': 0.17977488185772986, 'lr': 4.913836140741647e-05, 'weight_decay': 0.056103692142684486, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+[I 2025-12-25 09:47:00,107] Trial 89 pruned. 
+
+================================================================================
+Trial 89 완료
+  Value (CSI): 0.399884
+  Parameters: {'d_token': 192, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.3101021405101785, 'ffn_dropout': 0.16655329902535482, 'lr': 7.142288837572873e-05, 'weight_decay': 0.013186826745742977, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:48:02,639] Trial 90 pruned. 
+
+================================================================================
+Trial 90 완료
+  Value (CSI): 0.587186
+  Parameters: {'d_token': 224, 'n_blocks': 3, 'n_heads': 8, 'attention_dropout': 0.27582009754489833, 'ffn_dropout': 0.21200150728018638, 'lr': 9.111706541410853e-05, 'weight_decay': 0.020304620839548083, 'batch_size': 64}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:50:10,054] Trial 91 pruned. 
+
+================================================================================
+Trial 91 완료
+  Value (CSI): 0.560000
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.31658545634117, 'ffn_dropout': 0.20594646623117188, 'lr': 0.00011696339394878027, 'weight_decay': 0.03162125058731505, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 09:54:12,704] Trial 92 finished with value: 0.5513517872478811 and parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30215352866745376, 'ffn_dropout': 0.1901725577197075, 'lr': 0.00013173589045107465, 'weight_decay': 0.015576128345423467, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 92 완료
+  Value (CSI): 0.551352
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30215352866745376, 'ffn_dropout': 0.1901725577197075, 'lr': 0.00013173589045107465, 'weight_decay': 0.015576128345423467, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:56:25,272] Trial 93 pruned. 
+
+================================================================================
+Trial 93 완료
+  Value (CSI): 0.600813
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.30351941440897473, 'ffn_dropout': 0.19379599622535823, 'lr': 0.00013504335762524244, 'weight_decay': 0.011699870691978292, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 09:58:48,506] Trial 94 pruned. 
+
+================================================================================
+Trial 94 완료
+  Value (CSI): 0.578447
+  Parameters: {'d_token': 256, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.29439639906735154, 'ffn_dropout': 0.18777596563005042, 'lr': 5.559371089065815e-05, 'weight_decay': 0.014261180909866462, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+  Fold 3 - 클래스별 가중치: {0: 365.5, 1: 3.533534743202417, 2: 0.36842436842436843} (클래스별 샘플 수: {0: 16, 1: 1655, 2: 15873})
+[I 2025-12-25 10:03:08,046] Trial 95 finished with value: 0.5460386186858687 and parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.28893137693203524, 'ffn_dropout': 0.17572057601386684, 'lr': 9.788407295637717e-05, 'weight_decay': 0.025017601247231357, 'batch_size': 32}. Best is trial 28 with value: 0.562070126103511.
+
+================================================================================
+Trial 95 완료
+  Value (CSI): 0.546039
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.28893137693203524, 'ffn_dropout': 0.17572057601386684, 'lr': 9.788407295637717e-05, 'weight_decay': 0.025017601247231357, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 10:05:10,155] Trial 96 pruned. 
+
+================================================================================
+Trial 96 완료
+  Value (CSI): 0.556420
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.33481975496414573, 'ffn_dropout': 0.1778070779808575, 'lr': 7.891067472230128e-05, 'weight_decay': 0.026300142169420882, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 10:07:14,087] Trial 97 pruned. 
+
+================================================================================
+Trial 97 완료
+  Value (CSI): 0.557918
+  Parameters: {'d_token': 192, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.3043230672650425, 'ffn_dropout': 0.20149721039392232, 'lr': 9.686721971856521e-05, 'weight_decay': 0.017334106962579036, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 10:09:22,054] Trial 98 pruned. 
+
+================================================================================
+Trial 98 완료
+  Value (CSI): 0.554589
+  Parameters: {'d_token': 224, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2836297353896279, 'ffn_dropout': 0.1717945027353816, 'lr': 4.284637312921357e-05, 'weight_decay': 0.021821556229264457, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+  Fold 1 - 클래스별 가중치: {0: 176.96969696969697, 1: 3.2247377139701823, 2: 0.3725440163306966} (클래스별 샘플 수: {0: 33, 1: 1811, 2: 15676})
+  Fold 2 - 클래스별 가중치: {0: 201.6551724137931, 1: 3.4562647754137115, 2: 0.3695885735953991} (클래스별 샘플 수: {0: 29, 1: 1692, 2: 15823})
+[I 2025-12-25 10:11:28,768] Trial 99 pruned. 
+
+================================================================================
+Trial 99 완료
+  Value (CSI): 0.564177
+  Parameters: {'d_token': 160, 'n_blocks': 4, 'n_heads': 4, 'attention_dropout': 0.2705004268782494, 'ffn_dropout': 0.15423311162846828, 'lr': 0.0001751653878099956, 'weight_decay': 0.01599843705081302, 'batch_size': 32}
+  Best Value (CSI): 0.562070
+  Best Trial: 28
+  Best Parameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+================================================================================
+
+
+최적화 완료.
+Best CSI Score: 0.5621
+Best Hyperparameters: {'d_token': 256, 'n_blocks': 2, 'n_heads': 4, 'attention_dropout': 0.2855445640312001, 'ffn_dropout': 0.20563167448836292, 'lr': 7.430025637172839e-05, 'weight_decay': 0.012136192435211931, 'batch_size': 32}
+
+최적화 과정 ���약:
+  - 총 시도 횟수: 100
+  - 성공한 시도: 100
+  - 최초 CSI: 0.5516
+  - 최종 CSI: 0.5642
+  - 최고 CSI: 0.6093
+  - 최저 CSI: 0.0000
+  - 평균 CSI: 0.4795
+
+최적화 Study 객체가 /workspace/visibility_prediction/Analysis_code/optimization_history/ft_transformer_pure_seoul_trials.pkl에 저장되었습니다.
+
+==================================================
+최적화된 하이퍼파라미터로 최종 모델 학습 시작
+==================================================
+최종 모델 학습 시작...
+Fold 1 학습 중...
+  Early stopping at epoch 21, Best CSI: 0.4613
+  Fold 1 학습 완료 (검증 CSI: 0.4613)
+Fold 2 학습 중...
+  Early stopping at epoch 69, Best CSI: 0.6205
+  Fold 2 학습 완료 (검증 CSI: 0.6205)
+Fold 3 학습 중...
+  Early stopping at epoch 32, Best CSI: 0.5634
+  Fold 3 학습 완료 (검증 CSI: 0.5634)
+
+모든 모델 저장 완료: ../save_model/ft_transformer_optima/ft_transformer_pure_seoul.pkl (총 3개 fold)
+Scaler 저장 완료: ../save_model/ft_transformer_optima/scaler/ft_transformer_pure_seoul_scaler.pkl (총 3개 fold)
+
+최종 모델 학습 및 저장 완료!
+저장된 모델 경로:
+  - .
+  - .
+  - /
+  - s
+  - a
+  - v
+  - e
+  - _
+  - m
+  - o
+  - d
+  - e
+  - l
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - o
+  - p
+  - t
+  - i
+  - m
+  - a
+  - /
+  - f
+  - t
+  - _
+  - t
+  - r
+  - a
+  - n
+  - s
+  - f
+  - o
+  - r
+  - m
+  - e
+  - r
+  - _
+  - p
+  - u
+  - r
+  - e
+  - _
+  - s
+  - e
+  - o
+  - u
+  - l
+  - .
+  - p
+  - k
+  - l
+
+✓ 완료: ft_transformer_pure/ft_transforemer_pure_seoul.py (소요 시간: 10188초)
+
+==========================================
+FT-Transformer Pure 파일 실행 완료
+종료 시간: 2025-12-25 10:15:42
+총 소요 시간: 13시간 9분 51초
+성공: 6개
+실패: 0개
+==========================================