File size: 54,550 Bytes
8007cd9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
---
base_model: Daewon0808/prm800k_llama_fulltune
library_name: peft
license: llama3.1
tags:
- generated_from_trainer
model-index:
- name: VersaPRM_filtered
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# VersaPRM_filtered

This model is a fine-tuned version of [Daewon0808/prm800k_llama_fulltune](https://huggingface.co/Daewon0808/prm800k_llama_fulltune) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.4419
- Prm accuracy: 0.8889
- Prm precision: 0.9043
- Prm recall: 0.9720
- Prm specificty: 0.4211
- Prm npv: 0.7273
- Prm f1: 0.9369
- Prm f1 neg: 0.5333
- Prm f1 auc: 0.8965

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 2
- eval_batch_size: 4
- seed: 908932403
- distributed_type: multi-GPU
- num_devices: 8
- gradient_accumulation_steps: 2
- total_train_batch_size: 32
- total_eval_batch_size: 32
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 1

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Prm accuracy | Prm precision | Prm recall | Prm specificty | Prm npv | Prm f1 | Prm f1 neg | Prm f1 auc |
|:-------------:|:------:|:----:|:---------------:|:------------:|:-------------:|:----------:|:--------------:|:-------:|:------:|:----------:|:----------:|
| No log        | 0      | 0    | 0.3536          | 0.8333       | 0.8772        | 0.9346     | 0.2632         | 0.4167  | 0.9050 | 0.3226     | 0.8195     |
| 0.3678        | 0.0030 | 5    | 0.3556          | 0.8333       | 0.8772        | 0.9346     | 0.2632         | 0.4167  | 0.9050 | 0.3226     | 0.8165     |
| 0.2578        | 0.0060 | 10   | 0.3513          | 0.8333       | 0.8772        | 0.9346     | 0.2632         | 0.4167  | 0.9050 | 0.3226     | 0.8185     |
| 0.3369        | 0.0090 | 15   | 0.3488          | 0.8413       | 0.8718        | 0.9533     | 0.2105         | 0.4444  | 0.9107 | 0.2857     | 0.8227     |
| 0.2075        | 0.0120 | 20   | 0.3518          | 0.8492       | 0.8667        | 0.9720     | 0.1579         | 0.5     | 0.9163 | 0.24       | 0.8259     |
| 0.1613        | 0.0151 | 25   | 0.3895          | 0.8571       | 0.8678        | 0.9813     | 0.1579         | 0.6     | 0.9211 | 0.25       | 0.8364     |
| 0.2219        | 0.0181 | 30   | 0.3917          | 0.8413       | 0.8537        | 0.9813     | 0.0526         | 0.3333  | 0.9130 | 0.0909     | 0.8502     |
| 0.1576        | 0.0211 | 35   | 0.3520          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8566     |
| 0.1821        | 0.0241 | 40   | 0.3328          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8628     |
| 0.1773        | 0.0271 | 45   | 0.3225          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8701     |
| 0.2263        | 0.0301 | 50   | 0.3260          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8756     |
| 0.1708        | 0.0331 | 55   | 0.3259          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8778     |
| 0.1992        | 0.0361 | 60   | 0.3144          | 0.8571       | 0.8678        | 0.9813     | 0.1579         | 0.6     | 0.9211 | 0.25       | 0.8775     |
| 0.1403        | 0.0391 | 65   | 0.3022          | 0.8651       | 0.8814        | 0.9720     | 0.2632         | 0.625   | 0.9244 | 0.3704     | 0.8746     |
| 0.1494        | 0.0422 | 70   | 0.2971          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8716     |
| 0.1478        | 0.0452 | 75   | 0.3113          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8736     |
| 0.2049        | 0.0482 | 80   | 0.3156          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8733     |
| 0.1578        | 0.0512 | 85   | 0.3213          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8692     |
| 0.187         | 0.0542 | 90   | 0.3407          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8620     |
| 0.1523        | 0.0572 | 95   | 0.3882          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8642     |
| 0.1976        | 0.0602 | 100  | 0.3525          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8655     |
| 0.2146        | 0.0632 | 105  | 0.3232          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8623     |
| 0.188         | 0.0662 | 110  | 0.3881          | 0.8492       | 0.8607        | 0.9813     | 0.1053         | 0.5     | 0.9170 | 0.1739     | 0.8667     |
| 0.1701        | 0.0693 | 115  | 0.3393          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8672     |
| 0.1125        | 0.0723 | 120  | 0.3155          | 0.8492       | 0.8793        | 0.9533     | 0.2632         | 0.5     | 0.9148 | 0.3448     | 0.8630     |
| 0.1947        | 0.0753 | 125  | 0.3908          | 0.8492       | 0.8607        | 0.9813     | 0.1053         | 0.5     | 0.9170 | 0.1739     | 0.8687     |
| 0.152         | 0.0783 | 130  | 0.3040          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8574     |
| 0.1705        | 0.0813 | 135  | 0.3095          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8630     |
| 0.1848        | 0.0843 | 140  | 0.3491          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8645     |
| 0.146         | 0.0873 | 145  | 0.3668          | 0.8492       | 0.8729        | 0.9626     | 0.2105         | 0.5     | 0.9156 | 0.2963     | 0.8625     |
| 0.2446        | 0.0903 | 150  | 0.3322          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8647     |
| 0.1152        | 0.0933 | 155  | 0.3495          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8699     |
| 0.128         | 0.0964 | 160  | 0.3393          | 0.8651       | 0.8947        | 0.9533     | 0.3684         | 0.5833  | 0.9231 | 0.4516     | 0.8669     |
| 0.1425        | 0.0994 | 165  | 0.3349          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8726     |
| 0.1528        | 0.1024 | 170  | 0.3155          | 0.8651       | 0.8879        | 0.9626     | 0.3158         | 0.6     | 0.9238 | 0.4138     | 0.8672     |
| 0.1233        | 0.1054 | 175  | 0.3705          | 0.8571       | 0.8678        | 0.9813     | 0.1579         | 0.6     | 0.9211 | 0.25       | 0.8667     |
| 0.1637        | 0.1084 | 180  | 0.3753          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8574     |
| 0.1227        | 0.1114 | 185  | 0.4194          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8421     |
| 0.1523        | 0.1144 | 190  | 0.4267          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8428     |
| 0.0572        | 0.1174 | 195  | 0.3604          | 0.8571       | 0.8870        | 0.9533     | 0.3158         | 0.5455  | 0.9189 | 0.4        | 0.8490     |
| 0.1474        | 0.1204 | 200  | 0.3719          | 0.8651       | 0.8814        | 0.9720     | 0.2632         | 0.625   | 0.9244 | 0.3704     | 0.8527     |
| 0.1539        | 0.1235 | 205  | 0.3464          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8510     |
| 0.0741        | 0.1265 | 210  | 0.3895          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8529     |
| 0.1366        | 0.1295 | 215  | 0.3710          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8566     |
| 0.0901        | 0.1325 | 220  | 0.4182          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8539     |
| 0.1259        | 0.1355 | 225  | 0.4166          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8576     |
| 0.2108        | 0.1385 | 230  | 0.3671          | 0.8651       | 0.8814        | 0.9720     | 0.2632         | 0.625   | 0.9244 | 0.3704     | 0.8647     |
| 0.1041        | 0.1415 | 235  | 0.4246          | 0.8571       | 0.8618        | 0.9907     | 0.1053         | 0.6667  | 0.9217 | 0.1818     | 0.8630     |
| 0.1122        | 0.1445 | 240  | 0.3746          | 0.8651       | 0.8814        | 0.9720     | 0.2632         | 0.625   | 0.9244 | 0.3704     | 0.8620     |
| 0.1283        | 0.1475 | 245  | 0.4168          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8458     |
| 0.1782        | 0.1506 | 250  | 0.3723          | 0.8571       | 0.8803        | 0.9626     | 0.2632         | 0.5556  | 0.9196 | 0.3571     | 0.8529     |
| 0.102         | 0.1536 | 255  | 0.4007          | 0.8571       | 0.8678        | 0.9813     | 0.1579         | 0.6     | 0.9211 | 0.25       | 0.8652     |
| 0.1245        | 0.1566 | 260  | 0.3404          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8719     |
| 0.0906        | 0.1596 | 265  | 0.3198          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8748     |
| 0.1652        | 0.1626 | 270  | 0.4048          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8728     |
| 0.123         | 0.1656 | 275  | 0.4252          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8694     |
| 0.0785        | 0.1686 | 280  | 0.6088          | 0.8651       | 0.8689        | 0.9907     | 0.1579         | 0.75    | 0.9258 | 0.2609     | 0.8660     |
| 0.1453        | 0.1716 | 285  | 0.3479          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8746     |
| 0.1138        | 0.1746 | 290  | 0.3385          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8746     |
| 0.1381        | 0.1777 | 295  | 0.3432          | 0.8651       | 0.8947        | 0.9533     | 0.3684         | 0.5833  | 0.9231 | 0.4516     | 0.8815     |
| 0.059         | 0.1807 | 300  | 0.4334          | 0.8968       | 0.8983        | 0.9907     | 0.3684         | 0.875   | 0.9422 | 0.5185     | 0.8640     |
| 0.1869        | 0.1837 | 305  | 0.4668          | 0.8968       | 0.8983        | 0.9907     | 0.3684         | 0.875   | 0.9422 | 0.5185     | 0.8566     |
| 0.2032        | 0.1867 | 310  | 0.3440          | 0.8810       | 0.9035        | 0.9626     | 0.4211         | 0.6667  | 0.9321 | 0.5161     | 0.8780     |
| 0.1326        | 0.1897 | 315  | 0.3641          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8694     |
| 0.1149        | 0.1927 | 320  | 0.4066          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8633     |
| 0.0769        | 0.1957 | 325  | 0.4286          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8628     |
| 0.1237        | 0.1987 | 330  | 0.3510          | 0.8651       | 0.8947        | 0.9533     | 0.3684         | 0.5833  | 0.9231 | 0.4516     | 0.8748     |
| 0.0715        | 0.2017 | 335  | 0.3413          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8765     |
| 0.1143        | 0.2048 | 340  | 0.3981          | 0.8730       | 0.8760        | 0.9907     | 0.2105         | 0.8     | 0.9298 | 0.3333     | 0.8753     |
| 0.2085        | 0.2078 | 345  | 0.3383          | 0.8571       | 0.9009        | 0.9346     | 0.4211         | 0.5333  | 0.9174 | 0.4706     | 0.8847     |
| 0.2041        | 0.2108 | 350  | 0.3997          | 0.8492       | 0.8729        | 0.9626     | 0.2105         | 0.5     | 0.9156 | 0.2963     | 0.8775     |
| 0.0644        | 0.2138 | 355  | 0.4266          | 0.8730       | 0.8760        | 0.9907     | 0.2105         | 0.8     | 0.9298 | 0.3333     | 0.8728     |
| 0.1037        | 0.2168 | 360  | 0.3931          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8669     |
| 0.1153        | 0.2198 | 365  | 0.3426          | 0.8571       | 0.9009        | 0.9346     | 0.4211         | 0.5333  | 0.9174 | 0.4706     | 0.8660     |
| 0.1254        | 0.2228 | 370  | 0.3772          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8689     |
| 0.0605        | 0.2258 | 375  | 0.4060          | 0.8651       | 0.8879        | 0.9626     | 0.3158         | 0.6     | 0.9238 | 0.4138     | 0.8637     |
| 0.0766        | 0.2288 | 380  | 0.4248          | 0.8571       | 0.8739        | 0.9720     | 0.2105         | 0.5714  | 0.9204 | 0.3077     | 0.8623     |
| 0.1124        | 0.2319 | 385  | 0.3547          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8815     |
| 0.1141        | 0.2349 | 390  | 0.3166          | 0.8889       | 0.9115        | 0.9626     | 0.4737         | 0.6923  | 0.9364 | 0.5625     | 0.8854     |
| 0.0947        | 0.2379 | 395  | 0.3302          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8780     |
| 0.1011        | 0.2409 | 400  | 0.4250          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8613     |
| 0.2363        | 0.2439 | 405  | 0.4003          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8650     |
| 0.0928        | 0.2469 | 410  | 0.3737          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8706     |
| 0.1075        | 0.2499 | 415  | 0.3968          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8736     |
| 0.114         | 0.2529 | 420  | 0.4012          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8647     |
| 0.0785        | 0.2559 | 425  | 0.4344          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8534     |
| 0.0866        | 0.2590 | 430  | 0.4403          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8738     |
| 0.1272        | 0.2620 | 435  | 0.3997          | 0.8571       | 0.8870        | 0.9533     | 0.3158         | 0.5455  | 0.9189 | 0.4        | 0.8854     |
| 0.1322        | 0.2650 | 440  | 0.3932          | 0.8730       | 0.9027        | 0.9533     | 0.4211         | 0.6154  | 0.9273 | 0.5        | 0.8765     |
| 0.0392        | 0.2680 | 445  | 0.4634          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8574     |
| 0.0445        | 0.2710 | 450  | 0.3923          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8692     |
| 0.0949        | 0.2740 | 455  | 0.3737          | 0.8651       | 0.8879        | 0.9626     | 0.3158         | 0.6     | 0.9238 | 0.4138     | 0.8839     |
| 0.0559        | 0.2770 | 460  | 0.4511          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8847     |
| 0.1651        | 0.2800 | 465  | 0.4305          | 0.8651       | 0.8947        | 0.9533     | 0.3684         | 0.5833  | 0.9231 | 0.4516     | 0.8839     |
| 0.1601        | 0.2830 | 470  | 0.3996          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8864     |
| 0.1024        | 0.2861 | 475  | 0.4367          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8797     |
| 0.0807        | 0.2891 | 480  | 0.3707          | 0.8651       | 0.875         | 0.9813     | 0.2105         | 0.6667  | 0.9251 | 0.32       | 0.8815     |
| 0.0881        | 0.2921 | 485  | 0.3262          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8812     |
| 0.0505        | 0.2951 | 490  | 0.3560          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8819     |
| 0.0271        | 0.2981 | 495  | 0.4572          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8805     |
| 0.0756        | 0.3011 | 500  | 0.4332          | 0.8968       | 0.8983        | 0.9907     | 0.3684         | 0.875   | 0.9422 | 0.5185     | 0.8763     |
| 0.0903        | 0.3041 | 505  | 0.3597          | 0.8730       | 0.9027        | 0.9533     | 0.4211         | 0.6154  | 0.9273 | 0.5        | 0.8765     |
| 0.0639        | 0.3071 | 510  | 0.4337          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8731     |
| 0.0915        | 0.3101 | 515  | 0.4004          | 0.8968       | 0.8983        | 0.9907     | 0.3684         | 0.875   | 0.9422 | 0.5185     | 0.8773     |
| 0.0522        | 0.3132 | 520  | 0.3702          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8819     |
| 0.0932        | 0.3162 | 525  | 0.3705          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8827     |
| 0.0983        | 0.3192 | 530  | 0.4161          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8844     |
| 0.0784        | 0.3222 | 535  | 0.4878          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8864     |
| 0.099         | 0.3252 | 540  | 0.4134          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8955     |
| 0.0607        | 0.3282 | 545  | 0.3933          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8955     |
| 0.1602        | 0.3312 | 550  | 0.4176          | 0.8651       | 0.8879        | 0.9626     | 0.3158         | 0.6     | 0.9238 | 0.4138     | 0.8876     |
| 0.2345        | 0.3342 | 555  | 0.4244          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8859     |
| 0.0863        | 0.3372 | 560  | 0.3258          | 0.8571       | 0.8938        | 0.9439     | 0.3684         | 0.5385  | 0.9182 | 0.4375     | 0.8970     |
| 0.0733        | 0.3403 | 565  | 0.3567          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8906     |
| 0.1253        | 0.3433 | 570  | 0.4396          | 0.8730       | 0.8760        | 0.9907     | 0.2105         | 0.8     | 0.9298 | 0.3333     | 0.8827     |
| 0.0973        | 0.3463 | 575  | 0.3835          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8879     |
| 0.0799        | 0.3493 | 580  | 0.3279          | 0.8730       | 0.9027        | 0.9533     | 0.4211         | 0.6154  | 0.9273 | 0.5        | 0.8918     |
| 0.0625        | 0.3523 | 585  | 0.3759          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8933     |
| 0.0937        | 0.3553 | 590  | 0.5063          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8822     |
| 0.1189        | 0.3583 | 595  | 0.4078          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8883     |
| 0.1028        | 0.3613 | 600  | 0.3082          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8992     |
| 0.0798        | 0.3643 | 605  | 0.3231          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.9014     |
| 0.0855        | 0.3674 | 610  | 0.4184          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8901     |
| 0.1058        | 0.3704 | 615  | 0.3652          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8910     |
| 0.079         | 0.3734 | 620  | 0.3655          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8871     |
| 0.059         | 0.3764 | 625  | 0.4346          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8832     |
| 0.1099        | 0.3794 | 630  | 0.5183          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8797     |
| 0.0523        | 0.3824 | 635  | 0.4690          | 0.8651       | 0.8879        | 0.9626     | 0.3158         | 0.6     | 0.9238 | 0.4138     | 0.8792     |
| 0.0695        | 0.3854 | 640  | 0.4463          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8819     |
| 0.1217        | 0.3884 | 645  | 0.4508          | 0.8651       | 0.8879        | 0.9626     | 0.3158         | 0.6     | 0.9238 | 0.4138     | 0.8834     |
| 0.0513        | 0.3914 | 650  | 0.4349          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8861     |
| 0.0774        | 0.3945 | 655  | 0.3229          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9063     |
| 0.0839        | 0.3975 | 660  | 0.3058          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9058     |
| 0.0784        | 0.4005 | 665  | 0.3712          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.9026     |
| 0.1478        | 0.4035 | 670  | 0.3959          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8935     |
| 0.0797        | 0.4065 | 675  | 0.4169          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8972     |
| 0.1034        | 0.4095 | 680  | 0.4243          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8979     |
| 0.0645        | 0.4125 | 685  | 0.3868          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8997     |
| 0.0398        | 0.4155 | 690  | 0.3470          | 0.9048       | 0.9060        | 0.9907     | 0.4211         | 0.8889  | 0.9464 | 0.5714     | 0.9004     |
| 0.1113        | 0.4185 | 695  | 0.3747          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.9011     |
| 0.1202        | 0.4216 | 700  | 0.4083          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.9026     |
| 0.1156        | 0.4246 | 705  | 0.3377          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9058     |
| 0.0658        | 0.4276 | 710  | 0.3480          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9043     |
| 0.0547        | 0.4306 | 715  | 0.3962          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8994     |
| 0.0236        | 0.4336 | 720  | 0.4048          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8994     |
| 0.0542        | 0.4366 | 725  | 0.4356          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8950     |
| 0.0976        | 0.4396 | 730  | 0.4741          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8920     |
| 0.0477        | 0.4426 | 735  | 0.4458          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8883     |
| 0.0538        | 0.4456 | 740  | 0.4279          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8859     |
| 0.0658        | 0.4487 | 745  | 0.4040          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8829     |
| 0.0921        | 0.4517 | 750  | 0.3898          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8842     |
| 0.0352        | 0.4547 | 755  | 0.4056          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8827     |
| 0.0588        | 0.4577 | 760  | 0.4124          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8879     |
| 0.0648        | 0.4607 | 765  | 0.3911          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8910     |
| 0.05          | 0.4637 | 770  | 0.3883          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8933     |
| 0.0498        | 0.4667 | 775  | 0.4078          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8950     |
| 0.1127        | 0.4697 | 780  | 0.5070          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8928     |
| 0.0723        | 0.4727 | 785  | 0.4364          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8928     |
| 0.0624        | 0.4758 | 790  | 0.4118          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8965     |
| 0.0792        | 0.4788 | 795  | 0.4532          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8952     |
| 0.1286        | 0.4818 | 800  | 0.4345          | 0.8730       | 0.8760        | 0.9907     | 0.2105         | 0.8     | 0.9298 | 0.3333     | 0.8999     |
| 0.0408        | 0.4848 | 805  | 0.4087          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8923     |
| 0.0869        | 0.4878 | 810  | 0.3950          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8910     |
| 0.086         | 0.4908 | 815  | 0.3818          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8908     |
| 0.0757        | 0.4938 | 820  | 0.4097          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8942     |
| 0.1398        | 0.4968 | 825  | 0.3968          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.8960     |
| 0.1556        | 0.4998 | 830  | 0.4014          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8910     |
| 0.0334        | 0.5029 | 835  | 0.4638          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8896     |
| 0.0932        | 0.5059 | 840  | 0.4882          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8898     |
| 0.0744        | 0.5089 | 845  | 0.4852          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8896     |
| 0.0691        | 0.5119 | 850  | 0.4165          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8955     |
| 0.0533        | 0.5149 | 855  | 0.4148          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9006     |
| 0.068         | 0.5179 | 860  | 0.4289          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9038     |
| 0.0368        | 0.5209 | 865  | 0.4150          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9038     |
| 0.0832        | 0.5239 | 870  | 0.3931          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9085     |
| 0.0822        | 0.5269 | 875  | 0.3930          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.9065     |
| 0.0517        | 0.5300 | 880  | 0.4242          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9068     |
| 0.0478        | 0.5330 | 885  | 0.4243          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9061     |
| 0.107         | 0.5360 | 890  | 0.4305          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9073     |
| 0.063         | 0.5390 | 895  | 0.4867          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.9097     |
| 0.0219        | 0.5420 | 900  | 0.5191          | 0.8889       | 0.8908        | 0.9907     | 0.3158         | 0.8571  | 0.9381 | 0.4615     | 0.9095     |
| 0.0619        | 0.5450 | 905  | 0.4686          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9115     |
| 0.0784        | 0.5480 | 910  | 0.4012          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.9070     |
| 0.1324        | 0.5510 | 915  | 0.4038          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.9043     |
| 0.0405        | 0.5540 | 920  | 0.4294          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8957     |
| 0.0478        | 0.5571 | 925  | 0.4321          | 0.8651       | 0.8814        | 0.9720     | 0.2632         | 0.625   | 0.9244 | 0.3704     | 0.8952     |
| 0.0931        | 0.5601 | 930  | 0.3942          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8965     |
| 0.0768        | 0.5631 | 935  | 0.3556          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.9011     |
| 0.083         | 0.5661 | 940  | 0.3654          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9024     |
| 0.0561        | 0.5691 | 945  | 0.4170          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.8925     |
| 0.0651        | 0.5721 | 950  | 0.4502          | 0.8810       | 0.8833        | 0.9907     | 0.2632         | 0.8333  | 0.9339 | 0.4        | 0.8930     |
| 0.0527        | 0.5751 | 955  | 0.4123          | 0.8651       | 0.8814        | 0.9720     | 0.2632         | 0.625   | 0.9244 | 0.3704     | 0.8970     |
| 0.0974        | 0.5781 | 960  | 0.3897          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8957     |
| 0.1064        | 0.5812 | 965  | 0.3799          | 0.8730       | 0.8957        | 0.9626     | 0.3684         | 0.6364  | 0.9279 | 0.4667     | 0.8942     |
| 0.0904        | 0.5842 | 970  | 0.3994          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8893     |
| 0.0526        | 0.5872 | 975  | 0.4316          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8849     |
| 0.0398        | 0.5902 | 980  | 0.4119          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8881     |
| 0.0414        | 0.5932 | 985  | 0.3880          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8913     |
| 0.112         | 0.5962 | 990  | 0.3652          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8938     |
| 0.04          | 0.5992 | 995  | 0.3812          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8950     |
| 0.0396        | 0.6022 | 1000 | 0.4163          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8940     |
| 0.0431        | 0.6052 | 1005 | 0.4434          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8925     |
| 0.0899        | 0.6083 | 1010 | 0.4686          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8903     |
| 0.0775        | 0.6113 | 1015 | 0.4535          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8906     |
| 0.0312        | 0.6143 | 1020 | 0.4438          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8915     |
| 0.087         | 0.6173 | 1025 | 0.4568          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8923     |
| 0.0113        | 0.6203 | 1030 | 0.4112          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8935     |
| 0.1133        | 0.6233 | 1035 | 0.3838          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8962     |
| 0.059         | 0.6263 | 1040 | 0.3850          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8925     |
| 0.0474        | 0.6293 | 1045 | 0.3964          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8915     |
| 0.1056        | 0.6323 | 1050 | 0.3992          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8933     |
| 0.0734        | 0.6354 | 1055 | 0.3949          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8940     |
| 0.0713        | 0.6384 | 1060 | 0.4032          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8974     |
| 0.1008        | 0.6414 | 1065 | 0.4091          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8999     |
| 0.0417        | 0.6444 | 1070 | 0.3879          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9021     |
| 0.091         | 0.6474 | 1075 | 0.3752          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8977     |
| 0.0869        | 0.6504 | 1080 | 0.3916          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8955     |
| 0.0411        | 0.6534 | 1085 | 0.3969          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8970     |
| 0.0195        | 0.6564 | 1090 | 0.3770          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8955     |
| 0.0251        | 0.6594 | 1095 | 0.3721          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8965     |
| 0.0262        | 0.6625 | 1100 | 0.3930          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8962     |
| 0.0844        | 0.6655 | 1105 | 0.4328          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8925     |
| 0.1102        | 0.6685 | 1110 | 0.4661          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8896     |
| 0.1111        | 0.6715 | 1115 | 0.4330          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8913     |
| 0.0596        | 0.6745 | 1120 | 0.4037          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8913     |
| 0.0536        | 0.6775 | 1125 | 0.4028          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8913     |
| 0.0196        | 0.6805 | 1130 | 0.4216          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8915     |
| 0.0713        | 0.6835 | 1135 | 0.4365          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.8942     |
| 0.03          | 0.6865 | 1140 | 0.4306          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.8989     |
| 0.0386        | 0.6896 | 1145 | 0.4261          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9046     |
| 0.0814        | 0.6926 | 1150 | 0.4198          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.9024     |
| 0.0758        | 0.6956 | 1155 | 0.4069          | 0.8730       | 0.8824        | 0.9813     | 0.2632         | 0.7143  | 0.9292 | 0.3846     | 0.9031     |
| 0.0431        | 0.6986 | 1160 | 0.3958          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9058     |
| 0.0631        | 0.7016 | 1165 | 0.3911          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9046     |
| 0.086         | 0.7046 | 1170 | 0.4004          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9053     |
| 0.027         | 0.7076 | 1175 | 0.3878          | 0.8730       | 0.8889        | 0.9720     | 0.3158         | 0.6667  | 0.9286 | 0.4286     | 0.9038     |
| 0.1377        | 0.7106 | 1180 | 0.3852          | 0.8810       | 0.8898        | 0.9813     | 0.3158         | 0.75    | 0.9333 | 0.4444     | 0.9038     |
| 0.0226        | 0.7136 | 1185 | 0.3876          | 0.8968       | 0.8983        | 0.9907     | 0.3684         | 0.875   | 0.9422 | 0.5185     | 0.8997     |
| 0.1012        | 0.7167 | 1190 | 0.3913          | 0.8968       | 0.8983        | 0.9907     | 0.3684         | 0.875   | 0.9422 | 0.5185     | 0.8989     |
| 0.0793        | 0.7197 | 1195 | 0.3794          | 0.9048       | 0.9060        | 0.9907     | 0.4211         | 0.8889  | 0.9464 | 0.5714     | 0.8979     |
| 0.0817        | 0.7227 | 1200 | 0.3542          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8947     |
| 0.0465        | 0.7257 | 1205 | 0.3468          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8933     |
| 0.0336        | 0.7287 | 1210 | 0.3571          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8920     |
| 0.0165        | 0.7317 | 1215 | 0.3630          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8913     |
| 0.0559        | 0.7347 | 1220 | 0.3690          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8923     |
| 0.0979        | 0.7377 | 1225 | 0.3871          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8908     |
| 0.0993        | 0.7407 | 1230 | 0.3996          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8908     |
| 0.055         | 0.7438 | 1235 | 0.4120          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8871     |
| 0.0763        | 0.7468 | 1240 | 0.4184          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8896     |
| 0.0567        | 0.7498 | 1245 | 0.4035          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8935     |
| 0.0429        | 0.7528 | 1250 | 0.4027          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8913     |
| 0.0571        | 0.7558 | 1255 | 0.4149          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8935     |
| 0.0482        | 0.7588 | 1260 | 0.4408          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8913     |
| 0.0335        | 0.7618 | 1265 | 0.4618          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8930     |
| 0.0341        | 0.7648 | 1270 | 0.4767          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8935     |
| 0.1123        | 0.7678 | 1275 | 0.4728          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8920     |
| 0.0566        | 0.7709 | 1280 | 0.4591          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8933     |
| 0.0306        | 0.7739 | 1285 | 0.4508          | 0.8889       | 0.8974        | 0.9813     | 0.3684         | 0.7778  | 0.9375 | 0.5        | 0.8910     |
| 0.0259        | 0.7769 | 1290 | 0.4379          | 0.8810       | 0.8966        | 0.9720     | 0.3684         | 0.7     | 0.9327 | 0.4828     | 0.8913     |
| 0.0686        | 0.7799 | 1295 | 0.4344          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8879     |
| 0.0619        | 0.7829 | 1300 | 0.4394          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8883     |
| 0.0426        | 0.7859 | 1305 | 0.4474          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8886     |
| 0.0967        | 0.7889 | 1310 | 0.4514          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8883     |
| 0.0473        | 0.7919 | 1315 | 0.4366          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8901     |
| 0.0808        | 0.7949 | 1320 | 0.4245          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8938     |
| 0.0236        | 0.7980 | 1325 | 0.4122          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8947     |
| 0.0913        | 0.8010 | 1330 | 0.4065          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8950     |
| 0.0746        | 0.8040 | 1335 | 0.4134          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8942     |
| 0.0223        | 0.8070 | 1340 | 0.4166          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8955     |
| 0.0273        | 0.8100 | 1345 | 0.4233          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8960     |
| 0.0761        | 0.8130 | 1350 | 0.4303          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8960     |
| 0.0162        | 0.8160 | 1355 | 0.4381          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8940     |
| 0.1051        | 0.8190 | 1360 | 0.4406          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8947     |
| 0.03          | 0.8220 | 1365 | 0.4364          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8952     |
| 0.0544        | 0.8251 | 1370 | 0.4442          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8938     |
| 0.0299        | 0.8281 | 1375 | 0.4467          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8920     |
| 0.0254        | 0.8311 | 1380 | 0.4521          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8918     |
| 0.0959        | 0.8341 | 1385 | 0.4579          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8920     |
| 0.0395        | 0.8371 | 1390 | 0.4556          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8918     |
| 0.0453        | 0.8401 | 1395 | 0.4519          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8918     |
| 0.0484        | 0.8431 | 1400 | 0.4443          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8913     |
| 0.0343        | 0.8461 | 1405 | 0.4355          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8920     |
| 0.0458        | 0.8491 | 1410 | 0.4409          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8935     |
| 0.0412        | 0.8522 | 1415 | 0.4422          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8923     |
| 0.0158        | 0.8552 | 1420 | 0.4424          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8952     |
| 0.0466        | 0.8582 | 1425 | 0.4533          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8928     |
| 0.0607        | 0.8612 | 1430 | 0.4559          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8933     |
| 0.0654        | 0.8642 | 1435 | 0.4573          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8935     |
| 0.0177        | 0.8672 | 1440 | 0.4616          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8940     |
| 0.0688        | 0.8702 | 1445 | 0.4597          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8952     |
| 0.028         | 0.8732 | 1450 | 0.4612          | 0.8968       | 0.9052        | 0.9813     | 0.4211         | 0.8     | 0.9417 | 0.5517     | 0.8945     |
| 0.1213        | 0.8762 | 1455 | 0.4543          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8960     |
| 0.0254        | 0.8793 | 1460 | 0.4517          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8947     |
| 0.0399        | 0.8823 | 1465 | 0.4461          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8962     |
| 0.0312        | 0.8853 | 1470 | 0.4416          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8972     |
| 0.0252        | 0.8883 | 1475 | 0.4412          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8960     |
| 0.0279        | 0.8913 | 1480 | 0.4456          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8933     |
| 0.0688        | 0.8943 | 1485 | 0.4431          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8947     |
| 0.0342        | 0.8973 | 1490 | 0.4473          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8933     |
| 0.0455        | 0.9003 | 1495 | 0.4479          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8933     |
| 0.0238        | 0.9033 | 1500 | 0.4456          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8947     |
| 0.0421        | 0.9064 | 1505 | 0.4473          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8950     |
| 0.0427        | 0.9094 | 1510 | 0.4510          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8942     |
| 0.0638        | 0.9124 | 1515 | 0.4488          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8950     |
| 0.0479        | 0.9154 | 1520 | 0.4480          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8957     |
| 0.0397        | 0.9184 | 1525 | 0.4474          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8965     |
| 0.0542        | 0.9214 | 1530 | 0.4472          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8935     |
| 0.0767        | 0.9244 | 1535 | 0.4451          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8957     |
| 0.0169        | 0.9274 | 1540 | 0.4408          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8970     |
| 0.053         | 0.9304 | 1545 | 0.4434          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8965     |
| 0.0201        | 0.9335 | 1550 | 0.4412          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8967     |
| 0.1083        | 0.9365 | 1555 | 0.4398          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8979     |
| 0.0358        | 0.9395 | 1560 | 0.4407          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8960     |
| 0.059         | 0.9425 | 1565 | 0.4388          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8972     |
| 0.0341        | 0.9455 | 1570 | 0.4407          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8962     |
| 0.0463        | 0.9485 | 1575 | 0.4385          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8977     |
| 0.0434        | 0.9515 | 1580 | 0.4403          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8957     |
| 0.0313        | 0.9545 | 1585 | 0.4410          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8957     |
| 0.0612        | 0.9575 | 1590 | 0.4394          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8965     |
| 0.0555        | 0.9606 | 1595 | 0.4391          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8977     |
| 0.0683        | 0.9636 | 1600 | 0.4373          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8967     |
| 0.1061        | 0.9666 | 1605 | 0.4391          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8974     |
| 0.0391        | 0.9696 | 1610 | 0.4397          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8952     |
| 0.0826        | 0.9726 | 1615 | 0.4419          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8979     |
| 0.0407        | 0.9756 | 1620 | 0.4407          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8957     |
| 0.0554        | 0.9786 | 1625 | 0.4404          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8957     |
| 0.0754        | 0.9816 | 1630 | 0.4413          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8977     |
| 0.1043        | 0.9846 | 1635 | 0.4405          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8950     |
| 0.0487        | 0.9877 | 1640 | 0.4391          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8970     |
| 0.0321        | 0.9907 | 1645 | 0.4389          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8972     |
| 0.053         | 0.9937 | 1650 | 0.4385          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8977     |
| 0.046         | 0.9967 | 1655 | 0.4424          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8950     |
| 0.0383        | 0.9997 | 1660 | 0.4419          | 0.8889       | 0.9043        | 0.9720     | 0.4211         | 0.7273  | 0.9369 | 0.5333     | 0.8965     |


### Framework versions

- PEFT 0.12.0
- Transformers 4.46.0
- Pytorch 2.4.0+cu118
- Datasets 3.0.0
- Tokenizers 0.20.1