Hugging Face's logo

zokaityte
/
forest_v1_0_lr

Model card Files
xet
 Community
forest_v1_0_lr
File size: 41,070 Bytes
b0d7727
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e8f3feb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
[2025-03-07 08:10:58,172] [INFO] [hparam_search.py:214] - Configuration saved to /Users/gintare/Developer/Projects/limonade/scripts/models_training/_outputs/optuna_study_forest_v1_0_mlogloss_lr/.hydra/used_configs/hparam_search_20250307_081058.yaml
[2025-03-07 08:10:58,172] [INFO] [hparam_search.py:167] - Starting hyperparameter search...
[2025-03-07 08:10:58,172] [INFO] [data_loading.py:16] - Loading dataset: train=~/Developer/Projects/limonade/data/forest_v1_0/train.csv, test=~/Developer/Projects/limonade/data/forest_v1_0/test.csv, val=~/Developer/Projects/limonade/data/forest_v1_0/val.csv
[2025-03-07 08:10:58,540] [INFO] [data_loading.py:20] - Train dataset loaded successfully: (464808, 55)
[2025-03-07 08:10:58,587] [INFO] [data_loading.py:23] - Test dataset loaded successfully: (58102, 55)
[2025-03-07 08:10:58,636] [INFO] [data_loading.py:28] - Validation dataset loaded successfully: (58102, 55)
[2025-03-07 08:10:58,637] [INFO] [data_loading.py:51] - Dataset verification passed: 7 classes detected.
[2025-03-07 08:10:58,662] [INFO] [data_loading.py:57] - Data split completed. Shapes: Train (464808, 54), Val (58102, 54), Test (58102, 54)
[2025-03-07 08:10:58,662] [INFO] [hparam_search.py:171] - Dataset loaded: Train (464808, 54), Test (58102, 54), Val (58102, 54)
[2025-03-07 08:10:58,854] [INFO] [hparam_search.py:186] - Optuna study created. Starting optimization...
[2025-03-07 08:10:58,897] [INFO] [hparam_search.py:82] - Starting trial 2
[2025-03-07 08:10:58,898] [INFO] [hparam_search.py:82] - Starting trial 1
[2025-03-07 08:10:58,901] [INFO] [hparam_search.py:82] - Starting trial 5
[2025-03-07 08:10:58,902] [INFO] [hparam_search.py:82] - Starting trial 4
[2025-03-07 08:10:58,920] [INFO] [hparam_search.py:85] - Suggested parameters for trial 1: {'C': 4.7875359532895424e-05, 'penalty_solver': 'l2:saga', 'l1_ratio': 0.018221830648489812, 'max_iter': 802, 'tol': 0.0002727712487415353}
[2025-03-07 08:10:58,926] [INFO] [hparam_search.py:82] - Starting trial 6
[2025-03-07 08:10:58,928] [INFO] [hparam_search.py:82] - Starting trial 10
[2025-03-07 08:10:58,939] [INFO] [hparam_search.py:82] - Starting trial 7
[2025-03-07 08:10:58,941] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 1
[2025-03-07 08:10:58,943] [INFO] [hparam_search.py:85] - Suggested parameters for trial 2: {'C': 34.13344131182989, 'penalty_solver': 'l2:sag', 'l1_ratio': 0.271735709526303, 'max_iter': 653, 'tol': 0.00012121404273410466}
[2025-03-07 08:10:58,978] [INFO] [hparam_search.py:82] - Starting trial 0
[2025-03-07 08:10:58,979] [INFO] [hparam_search.py:82] - Starting trial 11
[2025-03-07 08:10:58,981] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 2
[2025-03-07 08:10:58,983] [INFO] [hparam_search.py:82] - Starting trial 9
[2025-03-07 08:10:58,983] [INFO] [hparam_search.py:82] - Starting trial 3
[2025-03-07 08:10:58,991] [INFO] [hparam_search.py:85] - Suggested parameters for trial 6: {'C': 3.6181077651453326, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.382582098762437, 'max_iter': 109, 'tol': 0.00041392892542484915}
[2025-03-07 08:10:58,995] [INFO] [hparam_search.py:82] - Starting trial 8
[2025-03-07 08:10:58,998] [INFO] [hparam_search.py:82] - Starting trial 12
[2025-03-07 08:10:59,005] [INFO] [hparam_search.py:85] - Suggested parameters for trial 10: {'C': 3.304723016424694e-05, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.4558487897247905, 'max_iter': 219, 'tol': 0.0009913557730329046}
[2025-03-07 08:10:59,011] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 6
[2025-03-07 08:10:59,019] [INFO] [hparam_search.py:85] - Suggested parameters for trial 11: {'C': 3.099102714379317, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.42263550165274577, 'max_iter': 968, 'tol': 8.666421709771902e-05}
[2025-03-07 08:10:59,024] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 11
[2025-03-07 08:10:59,032] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 10
[2025-03-07 08:10:59,044] [INFO] [hparam_search.py:85] - Suggested parameters for trial 9: {'C': 0.00010445552123911683, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.8421592738725264, 'max_iter': 605, 'tol': 5.5691220302481965e-05}
[2025-03-07 08:10:59,058] [INFO] [hparam_search.py:85] - Suggested parameters for trial 7: {'C': 16.550757089177576, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.32581243064306664, 'max_iter': 616, 'tol': 0.0001275690555421488}
[2025-03-07 08:10:59,067] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 7
[2025-03-07 08:10:59,075] [INFO] [hparam_search.py:85] - Suggested parameters for trial 12: {'C': 1.8383875772825157e-05, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.6069954638911863, 'max_iter': 129, 'tol': 1.0796652256635228e-05}
[2025-03-07 08:10:59,079] [INFO] [hparam_search.py:82] - Starting trial 13
[2025-03-07 08:10:59,083] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 12
[2025-03-07 08:10:59,102] [INFO] [hparam_search.py:85] - Suggested parameters for trial 5: {'C': 1.6326522359899025, 'penalty_solver': 'l2:sag', 'l1_ratio': 0.003021686292953185, 'max_iter': 484, 'tol': 0.0005025604309899143}
[2025-03-07 08:10:59,109] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 9
[2025-03-07 08:10:59,121] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 5
[2025-03-07 08:10:59,136] [INFO] [hparam_search.py:85] - Suggested parameters for trial 4: {'C': 2.589570571232358, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9426076326524999, 'max_iter': 935, 'tol': 0.0002836660823633425}
[2025-03-07 08:10:59,141] [INFO] [hparam_search.py:85] - Suggested parameters for trial 13: {'C': 94.72138074987807, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.9808293489208364, 'max_iter': 838, 'tol': 0.0001191094556785542}
[2025-03-07 08:10:59,145] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 13
[2025-03-07 08:10:59,155] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 4
[2025-03-07 08:10:59,159] [INFO] [hparam_search.py:85] - Suggested parameters for trial 0: {'C': 1.9632861206224492e-05, 'penalty_solver': 'l1:saga', 'l1_ratio': 0.9761918972004304, 'max_iter': 880, 'tol': 1.9341489273261066e-05}
[2025-03-07 08:10:59,163] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 0
[2025-03-07 08:10:59,167] [INFO] [hparam_search.py:85] - Suggested parameters for trial 3: {'C': 0.005228496985183292, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.8678453897787207, 'max_iter': 887, 'tol': 0.0002752128277082581}
[2025-03-07 08:10:59,177] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 3
[2025-03-07 08:10:59,216] [INFO] [hparam_search.py:85] - Suggested parameters for trial 8: {'C': 0.014745693420318746, 'penalty_solver': 'l2:sag', 'l1_ratio': 0.5824976035235025, 'max_iter': 357, 'tol': 0.00016913126055906019}
[2025-03-07 08:10:59,221] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 8
[2025-03-07 08:12:43,280] [INFO] [hparam_search.py:214] - Configuration saved to /Users/gintare/Developer/Projects/limonade/scripts/models_training/_outputs/optuna_study_forest_v1_0_mlogloss_lr/.hydra/used_configs/hparam_search_20250307_081243.yaml
[2025-03-07 08:12:43,280] [INFO] [hparam_search.py:167] - Starting hyperparameter search...
[2025-03-07 08:12:43,281] [INFO] [data_loading.py:16] - Loading dataset: train=~/Developer/Projects/limonade/data/forest_v1_0/train.csv, test=~/Developer/Projects/limonade/data/forest_v1_0/test.csv, val=~/Developer/Projects/limonade/data/forest_v1_0/val.csv
[2025-03-07 08:12:43,645] [INFO] [data_loading.py:20] - Train dataset loaded successfully: (464808, 55)
[2025-03-07 08:12:43,695] [INFO] [data_loading.py:23] - Test dataset loaded successfully: (58102, 55)
[2025-03-07 08:12:43,744] [INFO] [data_loading.py:28] - Validation dataset loaded successfully: (58102, 55)
[2025-03-07 08:12:43,745] [INFO] [data_loading.py:51] - Dataset verification passed: 7 classes detected.
[2025-03-07 08:12:43,770] [INFO] [data_loading.py:57] - Data split completed. Shapes: Train (464808, 54), Val (58102, 54), Test (58102, 54)
[2025-03-07 08:12:43,770] [INFO] [hparam_search.py:171] - Dataset loaded: Train (464808, 54), Test (58102, 54), Val (58102, 54)
[2025-03-07 08:12:43,943] [INFO] [hparam_search.py:186] - Optuna study created. Starting optimization...
[2025-03-07 08:12:43,996] [INFO] [hparam_search.py:82] - Starting trial 18
[2025-03-07 08:12:43,996] [INFO] [hparam_search.py:82] - Starting trial 17
[2025-03-07 08:12:44,004] [INFO] [hparam_search.py:82] - Starting trial 21
[2025-03-07 08:12:44,005] [INFO] [hparam_search.py:82] - Starting trial 14
[2025-03-07 08:12:44,005] [INFO] [hparam_search.py:82] - Starting trial 15
[2025-03-07 08:12:44,005] [INFO] [hparam_search.py:82] - Starting trial 16
[2025-03-07 08:12:44,010] [INFO] [hparam_search.py:82] - Starting trial 19
[2025-03-07 08:12:44,015] [INFO] [hparam_search.py:82] - Starting trial 20
[2025-03-07 08:12:44,026] [INFO] [hparam_search.py:85] - Suggested parameters for trial 18: {'C': 0.10753794163930472, 'penalty_solver': 'l1:saga', 'l1_ratio': 0.8119533855607183, 'max_iter': 251, 'tol': 7.058855209127119e-05}
[2025-03-07 08:12:44,034] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 18
[2025-03-07 08:12:44,046] [INFO] [hparam_search.py:85] - Suggested parameters for trial 21: {'C': 66.88943514438645, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.7104256340067888, 'max_iter': 862, 'tol': 2.8484414321600405e-05}
[2025-03-07 08:12:44,075] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 21
[2025-03-07 08:12:44,094] [INFO] [hparam_search.py:85] - Suggested parameters for trial 15: {'C': 0.08290917029064834, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.8780724901444901, 'max_iter': 597, 'tol': 6.516962587992502e-05}
[2025-03-07 08:12:44,181] [INFO] [hparam_search.py:85] - Suggested parameters for trial 17: {'C': 5.2959004321466774e-05, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.976635868194475, 'max_iter': 880, 'tol': 0.0001995998413593255}
[2025-03-07 08:12:44,187] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 15
[2025-03-07 08:12:44,189] [INFO] [hparam_search.py:82] - Starting trial 22
[2025-03-07 08:12:44,216] [INFO] [hparam_search.py:85] - Suggested parameters for trial 14: {'C': 0.0005228109721193718, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.8093658562012899, 'max_iter': 493, 'tol': 3.874147467551387e-05}
[2025-03-07 08:12:44,217] [INFO] [hparam_search.py:82] - Starting trial 27
[2025-03-07 08:12:44,223] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 17
[2025-03-07 08:12:44,227] [INFO] [hparam_search.py:82] - Starting trial 23
[2025-03-07 08:12:44,229] [INFO] [hparam_search.py:82] - Starting trial 24
[2025-03-07 08:12:44,229] [INFO] [hparam_search.py:82] - Starting trial 26
[2025-03-07 08:12:44,236] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 14
[2025-03-07 08:12:44,265] [INFO] [hparam_search.py:85] - Suggested parameters for trial 19: {'C': 0.04365867127670072, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.18857030681906028, 'max_iter': 936, 'tol': 1.2253441001829851e-05}
[2025-03-07 08:12:44,271] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 19
[2025-03-07 08:12:44,276] [INFO] [hparam_search.py:85] - Suggested parameters for trial 16: {'C': 0.002235922974214041, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.1749696370372762, 'max_iter': 849, 'tol': 2.491622379628421e-05}
[2025-03-07 08:12:44,280] [INFO] [hparam_search.py:82] - Starting trial 25
[2025-03-07 08:12:44,317] [INFO] [hparam_search.py:85] - Suggested parameters for trial 22: {'C': 4.725676373184278, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.37209617568379727, 'max_iter': 819, 'tol': 5.832433478492103e-05}
[2025-03-07 08:12:44,322] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 22
[2025-03-07 08:12:44,329] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 16
[2025-03-07 08:12:44,385] [INFO] [hparam_search.py:85] - Suggested parameters for trial 20: {'C': 0.0002470789370081118, 'penalty_solver': 'l2:sag', 'l1_ratio': 0.07256628067642645, 'max_iter': 174, 'tol': 0.000856655026152043}
[2025-03-07 08:12:44,416] [INFO] [hparam_search.py:85] - Suggested parameters for trial 25: {'C': 0.0019454839024506696, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.430701449464998, 'max_iter': 136, 'tol': 0.0005352514125792776}
[2025-03-07 08:12:44,478] [INFO] [hparam_search.py:85] - Suggested parameters for trial 26: {'C': 14.494867724886827, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.7872642427767997, 'max_iter': 491, 'tol': 1.695513599231274e-05}
[2025-03-07 08:12:44,502] [INFO] [hparam_search.py:85] - Suggested parameters for trial 23: {'C': 0.9852329490911322, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.6199056558332002, 'max_iter': 803, 'tol': 0.00015033229675130488}
[2025-03-07 08:12:44,557] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 23
[2025-03-07 08:12:44,565] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 26
[2025-03-07 08:12:44,585] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 20
[2025-03-07 08:12:44,594] [INFO] [hparam_search.py:85] - Suggested parameters for trial 27: {'C': 1.1034005898853718e-05, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.049352468371193, 'max_iter': 476, 'tol': 0.0004147242955185673}
[2025-03-07 08:12:44,601] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 27
[2025-03-07 08:12:44,609] [INFO] [hparam_search.py:85] - Suggested parameters for trial 24: {'C': 0.31320459939088413, 'penalty_solver': 'l2:saga', 'l1_ratio': 0.8007694096230313, 'max_iter': 750, 'tol': 7.719707411861858e-05}
[2025-03-07 08:12:44,615] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 24
[2025-03-07 08:12:44,624] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 25
[2025-03-07 08:27:43,884] [INFO] [hparam_search.py:82] - Starting trial 28
[2025-03-07 08:27:43,912] [INFO] [hparam_search.py:85] - Suggested parameters for trial 28: {'C': 0.0002585775051143828, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.28161698468553553, 'max_iter': 965, 'tol': 0.00036057203643168013}
[2025-03-07 08:27:43,936] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 28
[2025-03-07 08:31:59,875] [INFO] [hparam_search.py:82] - Starting trial 29
[2025-03-07 08:31:59,884] [INFO] [hparam_search.py:85] - Suggested parameters for trial 29: {'C': 0.01872557405037317, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.29858404227811497, 'max_iter': 972, 'tol': 0.0005317911737119296}
[2025-03-07 08:31:59,890] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 29
[2025-03-07 08:32:01,140] [INFO] [hparam_search.py:148] - Trial 23 is the best so far.
[2025-03-07 08:32:57,026] [INFO] [hparam_search.py:148] - Trial 25 is the best so far.
[2025-03-07 08:34:15,107] [INFO] [hparam_search.py:82] - Starting trial 30
[2025-03-07 08:34:15,137] [INFO] [hparam_search.py:85] - Suggested parameters for trial 30: {'C': 0.899854995828966, 'penalty_solver': 'l2:sag', 'l1_ratio': 0.6279205105919434, 'max_iter': 212, 'tol': 0.00037650298191910155}
[2025-03-07 08:34:15,157] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 30
[2025-03-07 08:34:15,515] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.927823830715556, 'val_mlogloss': 0.6765094087409561, 'val_accuracy': 0.7045712712126949, 'val_precision_micro': 0.7045712712126949, 'val_recall_micro': 0.7045712712126949, 'val_f1_micro': 0.7045712712126949, 'val_precision_weighted': 0.6886994293672783, 'val_recall_weighted': 0.7045712712126949, 'val_f1_weighted': 0.6868623111817979, 'val_precision_macro': 0.5555950175823064, 'val_recall_macro': 0.4105432040857316, 'val_f1_macro': 0.4280160645470881, 'val_cm': [[14460, 6560, 13, 0, 1, 0, 150], [4939, 22683, 617, 1, 9, 60, 21], [9, 366, 3016, 29, 0, 155, 1], [0, 0, 191, 49, 0, 35, 0], [21, 860, 61, 0, 1, 5, 1], [0, 632, 958, 0, 0, 147, 0], [1451, 12, 7, 0, 0, 0, 581]]}
[2025-03-07 08:34:15,581] [INFO] [hparam_search.py:82] - Starting trial 31
[2025-03-07 08:34:15,605] [INFO] [hparam_search.py:85] - Suggested parameters for trial 31: {'C': 2.4394692876817174, 'penalty_solver': 'l1:saga', 'l1_ratio': 0.24101962705857216, 'max_iter': 452, 'tol': 3.2310248682653125e-05}
[2025-03-07 08:34:15,615] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 31
[2025-03-07 08:35:20,984] [INFO] [hparam_search.py:82] - Starting trial 32
[2025-03-07 08:35:21,041] [INFO] [hparam_search.py:85] - Suggested parameters for trial 32: {'C': 0.00028829650171758236, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.5250608314672751, 'max_iter': 341, 'tol': 2.3173018226579656e-05}
[2025-03-07 08:35:21,058] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 32
[2025-03-07 08:36:51,732] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9140457539215289, 'val_mlogloss': 0.7226542102409799, 'val_accuracy': 0.6873601597191147, 'val_precision_micro': 0.6873601597191147, 'val_recall_micro': 0.6873601597191147, 'val_f1_micro': 0.6873601597191147, 'val_precision_weighted': 0.6618312777021531, 'val_recall_weighted': 0.6873601597191147, 'val_f1_weighted': 0.6595545116452762, 'val_precision_macro': 0.429545300361069, 'val_recall_macro': 0.32058378353907635, 'val_f1_macro': 0.31942924983510756, 'val_cm': [[14204, 6942, 0, 0, 0, 0, 38], [4832, 23179, 271, 0, 0, 32, 16], [8, 1107, 2383, 0, 0, 77, 1], [0, 0, 265, 0, 0, 10, 0], [4, 944, 0, 0, 0, 0, 1], [0, 746, 927, 0, 0, 64, 0], [1920, 24, 0, 0, 0, 0, 107]]}
[2025-03-07 08:36:51,786] [INFO] [hparam_search.py:82] - Starting trial 33
[2025-03-07 08:36:51,796] [INFO] [hparam_search.py:85] - Suggested parameters for trial 33: {'C': 0.36264409286899085, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.39534316068814, 'max_iter': 845, 'tol': 4.699941049120226e-05}
[2025-03-07 08:36:51,805] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 33
[2025-03-07 08:36:52,197] [INFO] [hparam_search.py:82] - Starting trial 34
[2025-03-07 08:36:52,207] [INFO] [hparam_search.py:85] - Suggested parameters for trial 34: {'C': 2.335829803388853, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.7564518562376523, 'max_iter': 809, 'tol': 0.0008596551415818968}
[2025-03-07 08:36:52,212] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 34
[2025-03-07 08:40:01,451] [INFO] [hparam_search.py:82] - Starting trial 35
[2025-03-07 08:40:01,464] [INFO] [hparam_search.py:85] - Suggested parameters for trial 35: {'C': 0.010368737038077025, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.7965917940036776, 'max_iter': 655, 'tol': 6.827644851696467e-05}
[2025-03-07 08:40:01,473] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 35
[2025-03-07 08:42:35,456] [INFO] [hparam_search.py:82] - Starting trial 36
[2025-03-07 08:42:35,474] [INFO] [hparam_search.py:85] - Suggested parameters for trial 36: {'C': 0.04537225302234671, 'penalty_solver': 'elasticnet:saga', 'l1_ratio': 0.8686747315831244, 'max_iter': 439, 'tol': 0.0002606702849897083}
[2025-03-07 08:42:35,487] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 36
[2025-03-07 08:43:44,799] [INFO] [hparam_search.py:82] - Starting trial 37
[2025-03-07 08:43:44,832] [INFO] [hparam_search.py:85] - Suggested parameters for trial 37: {'C': 55.06359926215541, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.4800306308532137, 'max_iter': 997, 'tol': 0.00017761040892822977}
[2025-03-07 08:43:44,838] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 37
[2025-03-07 08:48:44,507] [INFO] [hparam_search.py:148] - Trial 15 is the best so far.
[2025-03-07 08:48:45,047] [INFO] [hparam_search.py:82] - Starting trial 38
[2025-03-07 08:48:45,092] [INFO] [hparam_search.py:85] - Suggested parameters for trial 38: {'C': 0.003953269302320486, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.3337185702329081, 'max_iter': 956, 'tol': 1.187462388273072e-05}
[2025-03-07 08:48:45,106] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 38
[2025-03-07 08:49:26,494] [INFO] [hparam_search.py:82] - Starting trial 39
[2025-03-07 08:49:26,555] [INFO] [hparam_search.py:85] - Suggested parameters for trial 39: {'C': 0.006223789453814822, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.28295662768112523, 'max_iter': 995, 'tol': 1.0531311758109589e-05}
[2025-03-07 08:49:26,567] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 39
[2025-03-07 08:49:50,766] [INFO] [hparam_search.py:82] - Starting trial 40
[2025-03-07 08:49:50,838] [INFO] [hparam_search.py:85] - Suggested parameters for trial 40: {'C': 0.006795954284842855, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.38591787059598587, 'max_iter': 683, 'tol': 0.0001740758502675412}
[2025-03-07 08:49:50,851] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 40
[2025-03-07 08:51:22,122] [INFO] [hparam_search.py:82] - Starting trial 41
[2025-03-07 08:51:22,207] [INFO] [hparam_search.py:85] - Suggested parameters for trial 41: {'C': 0.006657422627218748, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.35910598144145023, 'max_iter': 645, 'tol': 0.0001631441853705579}
[2025-03-07 08:51:22,216] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 41
[2025-03-07 08:52:10,056] [INFO] [hparam_search.py:82] - Starting trial 42
[2025-03-07 08:52:10,127] [INFO] [hparam_search.py:85] - Suggested parameters for trial 42: {'C': 2.8150645392060993, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.38663190201830494, 'max_iter': 704, 'tol': 0.00015863909944384581}
[2025-03-07 08:52:10,148] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 42
[2025-03-07 08:52:10,245] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9293868124824156, 'val_mlogloss': 0.6627201442714479, 'val_accuracy': 0.7135382603008502, 'val_precision_micro': 0.7135382603008502, 'val_recall_micro': 0.7135382603008502, 'val_f1_micro': 0.7135382603008502, 'val_precision_weighted': 0.6998268051864504, 'val_recall_weighted': 0.7135382603008502, 'val_f1_weighted': 0.6988748305830644, 'val_precision_macro': 0.5867426285340545, 'val_recall_macro': 0.46211251321075913, 'val_f1_macro': 0.47582394484780915, 'val_cm': [[14555, 6223, 14, 0, 2, 0, 390], [5045, 22506, 678, 1, 31, 38, 31], [0, 358, 3080, 30, 0, 108, 0], [0, 0, 162, 74, 0, 39, 0], [9, 862, 68, 0, 10, 0, 0], [0, 627, 979, 2, 2, 127, 0], [927, 11, 7, 0, 0, 0, 1106]]}
[2025-03-07 08:52:10,363] [INFO] [hparam_search.py:82] - Starting trial 43
[2025-03-07 08:52:10,445] [INFO] [hparam_search.py:85] - Suggested parameters for trial 43: {'C': 1.523096978056629, 'penalty_solver': 'l2:liblinear', 'l1_ratio': 0.9814411176687381, 'max_iter': 673, 'tol': 0.0001297660208678293}
[2025-03-07 08:52:10,458] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 43
[2025-03-07 08:53:05,502] [INFO] [hparam_search.py:82] - Starting trial 44
[2025-03-07 08:54:02,908] [INFO] [hparam_search.py:85] - Suggested parameters for trial 44: {'C': 2.0736029621023846, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9458333900370979, 'max_iter': 642, 'tol': 0.00018518303207849614}
[2025-03-07 08:54:02,924] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 44
[2025-03-07 08:54:03,092] [INFO] [hparam_search.py:82] - Starting trial 45
[2025-03-07 08:54:03,113] [INFO] [hparam_search.py:85] - Suggested parameters for trial 45: {'C': 6.276211534727921, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.5913958548997577, 'max_iter': 644, 'tol': 0.00015164810044100748}
[2025-03-07 08:54:03,121] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 45
[2025-03-07 08:55:52,499] [INFO] [hparam_search.py:82] - Starting trial 46
[2025-03-07 08:55:52,525] [INFO] [hparam_search.py:85] - Suggested parameters for trial 46: {'C': 13.780618131926744, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9880070758449144, 'max_iter': 647, 'tol': 0.00015748967510050693}
[2025-03-07 08:55:52,535] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 46
[2025-03-07 08:57:42,640] [INFO] [hparam_search.py:82] - Starting trial 47
[2025-03-07 08:57:42,667] [INFO] [hparam_search.py:85] - Suggested parameters for trial 47: {'C': 0.2564296272715108, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9972448417654862, 'max_iter': 623, 'tol': 0.00016282735033191673}
[2025-03-07 08:57:42,674] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 47
[2025-03-07 08:59:35,488] [INFO] [hparam_search.py:82] - Starting trial 48
[2025-03-07 08:59:35,513] [INFO] [hparam_search.py:85] - Suggested parameters for trial 48: {'C': 0.01261827585323151, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9943397238138628, 'max_iter': 666, 'tol': 0.00011473280412276607}
[2025-03-07 08:59:35,520] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 48
[2025-03-07 09:00:31,721] [INFO] [final_model_training.py:127] - Uploaded study folder to zokaityte/forest_v1_0_lr
[2025-03-07 09:03:33,487] [INFO] [hparam_search.py:82] - Starting trial 49
[2025-03-07 09:03:33,508] [INFO] [hparam_search.py:85] - Suggested parameters for trial 49: {'C': 0.6272340733811133, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9703361065154678, 'max_iter': 652, 'tol': 5.6021602591641575e-05}
[2025-03-07 09:03:33,512] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 49
[2025-03-07 09:04:20,831] [INFO] [hparam_search.py:82] - Starting trial 50
[2025-03-07 09:04:20,845] [INFO] [hparam_search.py:85] - Suggested parameters for trial 50: {'C': 0.2959185431524882, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.9859223553659934, 'max_iter': 720, 'tol': 0.00011576009919516169}
[2025-03-07 09:04:20,849] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 50
[2025-03-07 09:06:36,614] [INFO] [hparam_search.py:148] - Trial 42 is the best so far.
[2025-03-07 09:08:55,358] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9293755856729281, 'val_mlogloss': 0.6620885715445897, 'val_accuracy': 0.7137275825272796, 'val_precision_micro': 0.7137275825272796, 'val_recall_micro': 0.7137275825272796, 'val_f1_micro': 0.7137275825272796, 'val_precision_weighted': 0.6994044510837508, 'val_recall_weighted': 0.7137275825272796, 'val_f1_weighted': 0.6989529512015351, 'val_precision_macro': 0.5824675877633627, 'val_recall_macro': 0.46859487330351607, 'val_f1_macro': 0.48129753834632644, 'val_cm': [[14556, 6216, 14, 0, 3, 0, 395], [5053, 22499, 673, 1, 29, 43, 32], [0, 356, 3091, 31, 0, 98, 0], [0, 0, 153, 87, 0, 35, 0], [11, 861, 68, 0, 9, 0, 0], [0, 627, 981, 8, 3, 118, 0], [924, 11, 7, 0, 0, 0, 1109]]}
[2025-03-07 09:09:01,136] [INFO] [hparam_search.py:82] - Starting trial 51
[2025-03-07 09:09:01,153] [INFO] [hparam_search.py:85] - Suggested parameters for trial 51: {'C': 8.108865453423824, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.610294064942541, 'max_iter': 587, 'tol': 0.00011542896302122851}
[2025-03-07 09:09:01,164] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 51
[2025-03-07 09:15:54,125] [INFO] [hparam_search.py:82] - Starting trial 52
[2025-03-07 09:15:54,145] [INFO] [hparam_search.py:85] - Suggested parameters for trial 52: {'C': 0.2614478349260976, 'penalty_solver': 'l2:lbfgs', 'l1_ratio': 0.5999406664335546, 'max_iter': 576, 'tol': 4.255905709858595e-05}
[2025-03-07 09:15:54,151] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 52
[2025-03-07 09:19:45,732] [INFO] [hparam_search.py:82] - Starting trial 53
[2025-03-07 09:19:45,759] [INFO] [hparam_search.py:85] - Suggested parameters for trial 53: {'C': 9.618631751361129, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5881462517633972, 'max_iter': 584, 'tol': 0.00010469135555879149}
[2025-03-07 09:19:45,765] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 53
[2025-03-07 09:32:04,097] [INFO] [hparam_search.py:148] - Trial 53 is the best so far.
[2025-03-07 09:32:26,597] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9294522467074238, 'val_mlogloss': 0.6617867217985753, 'val_accuracy': 0.7137620047502667, 'val_precision_micro': 0.7137620047502667, 'val_recall_micro': 0.7137620047502667, 'val_f1_micro': 0.7137620047502667, 'val_precision_weighted': 0.6995911075629004, 'val_recall_weighted': 0.7137620047502667, 'val_f1_weighted': 0.699120638063175, 'val_precision_macro': 0.5825050746791766, 'val_recall_macro': 0.46826596888076333, 'val_f1_macro': 0.48143998075538535, 'val_cm': [[14558, 6215, 14, 0, 3, 0, 394], [5049, 22501, 675, 1, 30, 42, 32], [0, 356, 3086, 31, 0, 103, 0], [0, 0, 153, 86, 0, 36, 0], [11, 861, 68, 0, 9, 0, 0], [0, 626, 975, 8, 3, 125, 0], [927, 11, 7, 0, 0, 0, 1106]]}
[2025-03-07 09:32:27,614] [INFO] [hparam_search.py:82] - Starting trial 54
[2025-03-07 09:32:28,566] [INFO] [hparam_search.py:85] - Suggested parameters for trial 54: {'C': 10.558278130280515, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.570497284516704, 'max_iter': 576, 'tol': 0.0001010654222999762}
[2025-03-07 09:32:28,575] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 54
[2025-03-07 09:44:47,742] [INFO] [hparam_search.py:148] - Trial 54 is the best so far.
[2025-03-07 09:45:08,557] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9294520475880966, 'val_mlogloss': 0.6617819876997856, 'val_accuracy': 0.7137275825272796, 'val_precision_micro': 0.7137275825272796, 'val_recall_micro': 0.7137275825272796, 'val_f1_micro': 0.7137275825272796, 'val_precision_weighted': 0.6993730887041032, 'val_recall_weighted': 0.7137275825272796, 'val_f1_weighted': 0.6990656117165808, 'val_precision_macro': 0.5811113222667654, 'val_recall_macro': 0.468101481669644, 'val_f1_macro': 0.4811462513699717, 'val_cm': [[14558, 6215, 14, 0, 3, 0, 394], [5048, 22501, 675, 1, 31, 42, 32], [0, 355, 3086, 31, 0, 104, 0], [0, 0, 153, 86, 0, 36, 0], [11, 861, 68, 0, 9, 0, 0], [0, 626, 977, 8, 3, 123, 0], [927, 11, 7, 0, 0, 0, 1106]]}
[2025-03-07 09:45:09,501] [INFO] [hparam_search.py:82] - Starting trial 55
[2025-03-07 09:45:10,612] [INFO] [hparam_search.py:85] - Suggested parameters for trial 55: {'C': 10.237632198036332, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5771596969169119, 'max_iter': 562, 'tol': 0.00010993659881135612}
[2025-03-07 09:45:10,627] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 55
[2025-03-07 09:53:26,421] [INFO] [hparam_search.py:82] - Starting trial 56
[2025-03-07 09:53:29,049] [INFO] [hparam_search.py:85] - Suggested parameters for trial 56: {'C': 7.459724193401961, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5559225692027648, 'max_iter': 565, 'tol': 4.528152611802195e-05}
[2025-03-07 09:53:29,058] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 56
[2025-03-07 10:00:46,356] [INFO] [hparam_search.py:82] - Starting trial 57
[2025-03-07 10:00:46,380] [INFO] [hparam_search.py:85] - Suggested parameters for trial 57: {'C': 11.655472295612883, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5673558522790473, 'max_iter': 550, 'tol': 4.4695182580481785e-05}
[2025-03-07 10:00:46,388] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 57
[2025-03-07 10:03:59,272] [INFO] [hparam_search.py:82] - Starting trial 58
[2025-03-07 10:04:18,140] [INFO] [hparam_search.py:85] - Suggested parameters for trial 58: {'C': 8.393389900978752, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5733018061701951, 'max_iter': 551, 'tol': 0.00011387818326576763}
[2025-03-07 10:04:18,155] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 58
[2025-03-07 10:20:21,213] [INFO] [hparam_search.py:148] - Trial 56 is the best so far.
[2025-03-07 10:20:21,334] [INFO] [hparam_search.py:82] - Starting trial 59
[2025-03-07 10:20:21,358] [INFO] [hparam_search.py:85] - Suggested parameters for trial 59: {'C': 12.587414498877646, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.587182254159709, 'max_iter': 568, 'tol': 0.00010290496011707416}
[2025-03-07 10:20:21,372] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 59
[2025-03-07 10:25:49,491] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9295577302110238, 'val_mlogloss': 0.6614428973570167, 'val_accuracy': 0.7139685380881897, 'val_precision_micro': 0.7139685380881897, 'val_recall_micro': 0.7139685380881897, 'val_f1_micro': 0.7139685380881897, 'val_precision_weighted': 0.7000216688216877, 'val_recall_weighted': 0.7139685380881897, 'val_f1_weighted': 0.6995278387643221, 'val_precision_macro': 0.5842054429638457, 'val_recall_macro': 0.4682777170647164, 'val_f1_macro': 0.48205887275933434, 'val_cm': [[14570, 6206, 14, 0, 3, 0, 391], [5050, 22501, 672, 1, 27, 47, 32], [0, 355, 3077, 31, 0, 113, 0], [0, 0, 154, 85, 0, 36, 0], [11, 861, 68, 0, 9, 0, 0], [0, 625, 967, 8, 3, 134, 0], [926, 11, 7, 0, 0, 0, 1107]]}
[2025-03-07 10:25:57,124] [INFO] [hparam_search.py:82] - Starting trial 60
[2025-03-07 10:25:57,161] [INFO] [hparam_search.py:85] - Suggested parameters for trial 60: {'C': 12.171604969704727, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.6697124766906287, 'max_iter': 564, 'tol': 4.634066356964722e-05}
[2025-03-07 10:25:57,167] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 60
[2025-03-07 10:27:28,946] [INFO] [hparam_search.py:82] - Starting trial 61
[2025-03-07 10:27:28,962] [INFO] [hparam_search.py:85] - Suggested parameters for trial 61: {'C': 12.625185196589724, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.6995586189884887, 'max_iter': 557, 'tol': 4.846841583410714e-05}
[2025-03-07 10:27:28,967] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 61
[2025-03-07 10:38:06,966] [INFO] [hparam_search.py:148] - Trial 57 is the best so far.
[2025-03-07 10:45:10,578] [INFO] [hparam_search.py:151] - Sneakpeak. Full validation results for best model: {'val_roc_auc': 0.9295653890657446, 'val_mlogloss': 0.6614160855772266, 'val_accuracy': 0.7140029603111769, 'val_precision_micro': 0.7140029603111769, 'val_recall_micro': 0.7140029603111769, 'val_f1_micro': 0.7140029603111769, 'val_precision_weighted': 0.6999668135610365, 'val_recall_weighted': 0.7140029603111769, 'val_f1_weighted': 0.6996098366410228, 'val_precision_macro': 0.5836258179500499, 'val_recall_macro': 0.4688393322478623, 'val_f1_macro': 0.48273987571939475, 'val_cm': [[14570, 6206, 14, 0, 3, 0, 391], [5047, 22503, 672, 1, 27, 48, 32], [0, 354, 3074, 31, 1, 116, 0], [0, 0, 154, 86, 0, 35, 0], [11, 861, 68, 0, 9, 0, 0], [0, 625, 966, 8, 3, 135, 0], [925, 11, 7, 0, 0, 0, 1108]]}
[2025-03-07 10:45:10,712] [INFO] [hparam_search.py:82] - Starting trial 62
[2025-03-07 10:45:36,543] [INFO] [hparam_search.py:85] - Suggested parameters for trial 62: {'C': 22.761017380313884, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.7013164516803247, 'max_iter': 373, 'tol': 4.737215120463014e-05}
[2025-03-07 10:45:36,551] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 62
[2025-03-07 10:50:03,979] [INFO] [hparam_search.py:82] - Starting trial 63
[2025-03-07 10:50:03,996] [INFO] [hparam_search.py:85] - Suggested parameters for trial 63: {'C': 24.4879916982142, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.6890386437865847, 'max_iter': 381, 'tol': 4.561160164255161e-05}
[2025-03-07 10:50:04,003] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 63
[2025-03-07 10:59:51,656] [INFO] [hparam_search.py:82] - Starting trial 64
[2025-03-07 10:59:51,691] [INFO] [hparam_search.py:85] - Suggested parameters for trial 64: {'C': 34.243025953023185, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.7058689812014265, 'max_iter': 357, 'tol': 4.216425664309419e-05}
[2025-03-07 10:59:51,697] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 64
[2025-03-07 11:01:23,320] [INFO] [hparam_search.py:82] - Starting trial 65
[2025-03-07 11:01:23,342] [INFO] [hparam_search.py:85] - Suggested parameters for trial 65: {'C': 91.65426524400961, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.6758871040976917, 'max_iter': 413, 'tol': 3.8746376716868805e-05}
[2025-03-07 11:01:23,349] [INFO] [hparam_search.py:123] - Training without cross-validation for trial 65
[2025-03-07 12:30:19,238] [INFO] [final_model_training.py:35] - Training final model...
[2025-03-07 12:30:19,238] [INFO] [final_model_training.py:37] - Loading dataset for final training: forest_v1_0
[2025-03-07 12:30:19,239] [INFO] [data_loading.py:16] - Loading dataset: train=~/Developer/Projects/limonade/data/forest_v1_0/train.csv, test=~/Developer/Projects/limonade/data/forest_v1_0/test.csv, val=~/Developer/Projects/limonade/data/forest_v1_0/val.csv
[2025-03-07 12:30:19,630] [INFO] [data_loading.py:20] - Train dataset loaded successfully: (464808, 55)
[2025-03-07 12:30:19,682] [INFO] [data_loading.py:23] - Test dataset loaded successfully: (58102, 55)
[2025-03-07 12:30:19,734] [INFO] [data_loading.py:28] - Validation dataset loaded successfully: (58102, 55)
[2025-03-07 12:30:19,736] [INFO] [data_loading.py:51] - Dataset verification passed: 7 classes detected.
[2025-03-07 12:30:19,779] [INFO] [data_loading.py:57] - Data split completed. Shapes: Train (464808, 54), Val (58102, 54), Test (58102, 54)
[2025-03-07 12:30:19,853] [INFO] [final_model_training.py:45] - Dataset loaded: Train (522910, 54), Test (58102, 54)
[2025-03-07 12:30:20,131] [INFO] [final_model_training.py:51] - Best trial found: 57 with params {'C': 11.655472295612883, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5673558522790473, 'max_iter': 550, 'tol': 4.4695182580481785e-05}
[2025-03-07 12:49:23,637] [INFO] [final_model_training.py:63] - Training completed in 1143.51 seconds.
[2025-03-07 12:49:23,641] [INFO] [final_model_training.py:67] - Model saved to /Users/gintare/Developer/Projects/limonade/scripts/models_training/_outputs/optuna_study_forest_v1_0_mlogloss_lr/model.pkl
[2025-03-07 12:49:25,577] [INFO] [final_model_training.py:83] - Final model evaluation: {'dataset': 'forest_v1_0', 'model_type': 'lr', 'best_trial_number': 57, 'best_trial_params': {'C': 11.655472295612883, 'penalty_solver': 'l1:liblinear', 'l1_ratio': 0.5673558522790473, 'max_iter': 550, 'tol': 4.4695182580481785e-05}, 'train_time_s': 1143.5055191516876, 'train_roc_auc': 0.930531735775758, 'train_mlogloss': 0.6590944770995031, 'train_accuracy': 0.7158421143217762, 'train_precision_micro': 0.7158421143217762, 'train_recall_micro': 0.7158421143217762, 'train_f1_micro': 0.7158421143217762, 'train_precision_weighted': 0.7033694746983873, 'train_recall_weighted': 0.7158421143217762, 'train_f1_weighted': 0.7015261167207598, 'train_precision_macro': 0.5978167007678554, 'train_recall_macro': 0.4694481833803115, 'train_f1_macro': 0.4845387544907457, 'train_cm': [[131547, 55278, 161, 0, 12, 8, 3650], [44836, 203256, 5850, 7, 255, 426, 340], [0, 3360, 27539, 274, 4, 1002, 0], [0, 0, 1441, 784, 0, 247, 0], [151, 7519, 755, 0, 112, 7, 0], [0, 5560, 8715, 58, 21, 1276, 0], [8472, 109, 71, 0, 0, 0, 9807]], 'test_roc_auc': 0.9290632207651718, 'test_mlogloss': 0.6636865217104727, 'test_accuracy': 0.712935871398575, 'test_precision_micro': 0.712935871398575, 'test_recall_micro': 0.712935871398575, 'test_f1_micro': 0.712935871398575, 'test_precision_weighted': 0.6994871846273708, 'test_recall_weighted': 0.712935871398575, 'test_f1_weighted': 0.6986838175658986, 'test_precision_macro': 0.58456365042707, 'test_recall_macro': 0.4669114486333375, 'test_f1_macro': 0.48289797979276866, 'test_cm': [[14489, 6299, 21, 0, 0, 0, 375], [4961, 22586, 667, 0, 30, 50, 37], [0, 399, 3034, 33, 0, 109, 0], [0, 0, 148, 89, 0, 38, 0], [14, 833, 94, 0, 7, 1, 0], [0, 597, 977, 6, 2, 155, 0], [967, 14, 7, 0, 0, 0, 1063]]}
[2025-03-07 12:49:25,582] [INFO] [final_model_training.py:87] - Training ended. Summary saved to /Users/gintare/Developer/Projects/limonade/scripts/models_training/_outputs/optuna_study_forest_v1_0_mlogloss_lr/model_summary.csv
[2025-03-07 12:49:26,513] [INFO] [final_model_training.py:104] - Created repo zokaityte/forest_v1_0_lr
[2025-03-07 12:49:28,955] [INFO] [final_model_training.py:112] - Uploaded study folder to zokaityte/forest_v1_0_lr