File size: 23,488 Bytes
9b43446
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
---
license: cc-by-4.0
base_model: deepset/bert-base-cased-squad2
tags:
- generated_from_trainer
model-index:
- name: bert-29
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-29

This model is a fine-tuned version of [deepset/bert-base-cased-squad2](https://huggingface.co/deepset/bert-base-cased-squad2) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 6.1544

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 10.3108       | 0.02  | 5    | 12.3308         |
| 11.3676       | 0.05  | 10   | 12.2829         |
| 12.0965       | 0.07  | 15   | 12.2339         |
| 10.877        | 0.09  | 20   | 12.1855         |
| 11.5463       | 0.11  | 25   | 12.1375         |
| 10.4439       | 0.14  | 30   | 12.0898         |
| 11.3519       | 0.16  | 35   | 12.0421         |
| 11.2558       | 0.18  | 40   | 11.9943         |
| 11.0568       | 0.21  | 45   | 11.9462         |
| 11.3265       | 0.23  | 50   | 11.8980         |
| 9.511         | 0.25  | 55   | 11.8505         |
| 10.6662       | 0.28  | 60   | 11.8043         |
| 10.2726       | 0.3   | 65   | 11.7576         |
| 11.1502       | 0.32  | 70   | 11.7108         |
| 11.2245       | 0.34  | 75   | 11.6640         |
| 10.3183       | 0.37  | 80   | 11.6173         |
| 11.3083       | 0.39  | 85   | 11.5707         |
| 10.0481       | 0.41  | 90   | 11.5243         |
| 10.6689       | 0.44  | 95   | 11.4780         |
| 10.299        | 0.46  | 100  | 11.4322         |
| 10.9093       | 0.48  | 105  | 11.3863         |
| 10.0403       | 0.5   | 110  | 11.3403         |
| 10.3065       | 0.53  | 115  | 11.2948         |
| 10.4771       | 0.55  | 120  | 11.2493         |
| 9.685         | 0.57  | 125  | 11.2040         |
| 9.6081        | 0.6   | 130  | 11.1592         |
| 9.9776        | 0.62  | 135  | 11.1145         |
| 9.8161        | 0.64  | 140  | 11.0705         |
| 10.078        | 0.67  | 145  | 11.0263         |
| 10.5549       | 0.69  | 150  | 10.9828         |
| 9.9488        | 0.71  | 155  | 10.9384         |
| 10.1075       | 0.73  | 160  | 10.8946         |
| 9.4674        | 0.76  | 165  | 10.8509         |
| 10.077        | 0.78  | 170  | 10.8070         |
| 9.5688        | 0.8   | 175  | 10.7636         |
| 8.9946        | 0.83  | 180  | 10.7205         |
| 10.4224       | 0.85  | 185  | 10.6776         |
| 8.6883        | 0.87  | 190  | 10.6344         |
| 9.5508        | 0.89  | 195  | 10.5919         |
| 9.3088        | 0.92  | 200  | 10.5493         |
| 9.3799        | 0.94  | 205  | 10.5072         |
| 8.8564        | 0.96  | 210  | 10.4656         |
| 8.7775        | 0.99  | 215  | 10.4237         |
| 9.4815        | 1.01  | 220  | 10.3824         |
| 9.2469        | 1.03  | 225  | 10.3411         |
| 8.5056        | 1.06  | 230  | 10.3003         |
| 9.8006        | 1.08  | 235  | 10.2595         |
| 9.185         | 1.1   | 240  | 10.2181         |
| 9.3379        | 1.12  | 245  | 10.1769         |
| 8.5696        | 1.15  | 250  | 10.1359         |
| 8.4981        | 1.17  | 255  | 10.0960         |
| 8.9066        | 1.19  | 260  | 10.0554         |
| 9.043         | 1.22  | 265  | 10.0155         |
| 7.9105        | 1.24  | 270  | 9.9762          |
| 8.8268        | 1.26  | 275  | 9.9372          |
| 8.5896        | 1.28  | 280  | 9.8979          |
| 8.9422        | 1.31  | 285  | 9.8578          |
| 8.2276        | 1.33  | 290  | 9.8188          |
| 9.1443        | 1.35  | 295  | 9.7795          |
| 8.7467        | 1.38  | 300  | 9.7404          |
| 9.1588        | 1.4   | 305  | 9.7015          |
| 8.9789        | 1.42  | 310  | 9.6630          |
| 7.9135        | 1.44  | 315  | 9.6252          |
| 8.9771        | 1.47  | 320  | 9.5876          |
| 8.7356        | 1.49  | 325  | 9.5499          |
| 8.1398        | 1.51  | 330  | 9.5128          |
| 8.4803        | 1.54  | 335  | 9.4754          |
| 8.5553        | 1.56  | 340  | 9.4385          |
| 8.6194        | 1.58  | 345  | 9.4006          |
| 8.1879        | 1.61  | 350  | 9.3633          |
| 8.1535        | 1.63  | 355  | 9.3269          |
| 8.8795        | 1.65  | 360  | 9.2899          |
| 8.4935        | 1.67  | 365  | 9.2536          |
| 8.5901        | 1.7   | 370  | 9.2170          |
| 8.3013        | 1.72  | 375  | 9.1808          |
| 8.1959        | 1.74  | 380  | 9.1448          |
| 8.1158        | 1.77  | 385  | 9.1093          |
| 7.6286        | 1.79  | 390  | 9.0741          |
| 8.2353        | 1.81  | 395  | 9.0397          |
| 7.822         | 1.83  | 400  | 9.0050          |
| 8.0979        | 1.86  | 405  | 8.9706          |
| 8.7221        | 1.88  | 410  | 8.9365          |
| 7.8976        | 1.9   | 415  | 8.9018          |
| 8.1378        | 1.93  | 420  | 8.8677          |
| 7.8131        | 1.95  | 425  | 8.8335          |
| 8.2754        | 1.97  | 430  | 8.7997          |
| 7.6972        | 2.0   | 435  | 8.7658          |
| 7.99          | 2.02  | 440  | 8.7324          |
| 7.7428        | 2.04  | 445  | 8.6995          |
| 8.0031        | 2.06  | 450  | 8.6671          |
| 7.9012        | 2.09  | 455  | 8.6346          |
| 7.1693        | 2.11  | 460  | 8.6023          |
| 7.8746        | 2.13  | 465  | 8.5700          |
| 7.3467        | 2.16  | 470  | 8.5386          |
| 7.863         | 2.18  | 475  | 8.5073          |
| 7.5655        | 2.2   | 480  | 8.4759          |
| 7.8374        | 2.22  | 485  | 8.4446          |
| 7.731         | 2.25  | 490  | 8.4132          |
| 7.6392        | 2.27  | 495  | 8.3820          |
| 7.4547        | 2.29  | 500  | 8.3509          |
| 7.4642        | 2.32  | 505  | 8.3204          |
| 7.9489        | 2.34  | 510  | 8.2902          |
| 7.046         | 2.36  | 515  | 8.2605          |
| 7.2211        | 2.39  | 520  | 8.2313          |
| 7.2287        | 2.41  | 525  | 8.2026          |
| 7.0018        | 2.43  | 530  | 8.1745          |
| 7.4544        | 2.45  | 535  | 8.1465          |
| 7.8701        | 2.48  | 540  | 8.1183          |
| 7.2614        | 2.5   | 545  | 8.0897          |
| 6.9922        | 2.52  | 550  | 8.0616          |
| 7.1671        | 2.55  | 555  | 8.0342          |
| 7.7866        | 2.57  | 560  | 8.0062          |
| 6.9815        | 2.59  | 565  | 7.9786          |
| 6.9534        | 2.61  | 570  | 7.9514          |
| 7.2225        | 2.64  | 575  | 7.9251          |
| 7.1113        | 2.66  | 580  | 7.8986          |
| 6.7271        | 2.68  | 585  | 7.8728          |
| 7.132         | 2.71  | 590  | 7.8475          |
| 6.8046        | 2.73  | 595  | 7.8227          |
| 7.3063        | 2.75  | 600  | 7.7977          |
| 6.8367        | 2.78  | 605  | 7.7724          |
| 7.161         | 2.8   | 610  | 7.7475          |
| 6.6636        | 2.82  | 615  | 7.7231          |
| 7.3229        | 2.84  | 620  | 7.6984          |
| 6.6655        | 2.87  | 625  | 7.6743          |
| 6.8593        | 2.89  | 630  | 7.6502          |
| 6.8838        | 2.91  | 635  | 7.6263          |
| 7.0462        | 2.94  | 640  | 7.6031          |
| 6.7336        | 2.96  | 645  | 7.5800          |
| 6.5167        | 2.98  | 650  | 7.5580          |
| 6.6102        | 3.0   | 655  | 7.5359          |
| 6.8039        | 3.03  | 660  | 7.5140          |
| 7.1668        | 3.05  | 665  | 7.4918          |
| 6.6394        | 3.07  | 670  | 7.4694          |
| 6.8593        | 3.1   | 675  | 7.4473          |
| 6.4022        | 3.12  | 680  | 7.4258          |
| 6.9173        | 3.14  | 685  | 7.4050          |
| 6.2071        | 3.17  | 690  | 7.3850          |
| 6.512         | 3.19  | 695  | 7.3654          |
| 6.6548        | 3.21  | 700  | 7.3459          |
| 6.7666        | 3.23  | 705  | 7.3263          |
| 6.3916        | 3.26  | 710  | 7.3066          |
| 6.7645        | 3.28  | 715  | 7.2874          |
| 6.5965        | 3.3   | 720  | 7.2679          |
| 6.5361        | 3.33  | 725  | 7.2490          |
| 6.8693        | 3.35  | 730  | 7.2295          |
| 6.3229        | 3.37  | 735  | 7.2106          |
| 6.7505        | 3.39  | 740  | 7.1919          |
| 6.4917        | 3.42  | 745  | 7.1739          |
| 6.5649        | 3.44  | 750  | 7.1566          |
| 6.5177        | 3.46  | 755  | 7.1392          |
| 6.6282        | 3.49  | 760  | 7.1219          |
| 6.5035        | 3.51  | 765  | 7.1051          |
| 6.5631        | 3.53  | 770  | 7.0880          |
| 6.4593        | 3.56  | 775  | 7.0715          |
| 6.5314        | 3.58  | 780  | 7.0554          |
| 6.2695        | 3.6   | 785  | 7.0400          |
| 6.4792        | 3.62  | 790  | 7.0249          |
| 6.7222        | 3.65  | 795  | 7.0091          |
| 6.4972        | 3.67  | 800  | 6.9931          |
| 6.3063        | 3.69  | 805  | 6.9776          |
| 6.1834        | 3.72  | 810  | 6.9630          |
| 6.3814        | 3.74  | 815  | 6.9485          |
| 6.3444        | 3.76  | 820  | 6.9339          |
| 6.3784        | 3.78  | 825  | 6.9195          |
| 6.4047        | 3.81  | 830  | 6.9052          |
| 6.2368        | 3.83  | 835  | 6.8916          |
| 6.1245        | 3.85  | 840  | 6.8784          |
| 6.3089        | 3.88  | 845  | 6.8657          |
| 6.3674        | 3.9   | 850  | 6.8526          |
| 6.4337        | 3.92  | 855  | 6.8393          |
| 6.2115        | 3.94  | 860  | 6.8270          |
| 6.2734        | 3.97  | 865  | 6.8145          |
| 6.2301        | 3.99  | 870  | 6.8023          |
| 6.0973        | 4.01  | 875  | 6.7905          |
| 6.2143        | 4.04  | 880  | 6.7785          |
| 6.4512        | 4.06  | 885  | 6.7665          |
| 6.1737        | 4.08  | 890  | 6.7545          |
| 6.3221        | 4.11  | 895  | 6.7427          |
| 6.2879        | 4.13  | 900  | 6.7313          |
| 5.9436        | 4.15  | 905  | 6.7214          |
| 6.1258        | 4.17  | 910  | 6.7126          |
| 6.2819        | 4.2   | 915  | 6.7031          |
| 6.1344        | 4.22  | 920  | 6.6934          |
| 6.3769        | 4.24  | 925  | 6.6833          |
| 6.3609        | 4.27  | 930  | 6.6731          |
| 5.9827        | 4.29  | 935  | 6.6632          |
| 6.039         | 4.31  | 940  | 6.6541          |
| 6.0012        | 4.33  | 945  | 6.6451          |
| 6.0147        | 4.36  | 950  | 6.6362          |
| 5.8187        | 4.38  | 955  | 6.6275          |
| 5.9193        | 4.4   | 960  | 6.6191          |
| 6.28          | 4.43  | 965  | 6.6115          |
| 6.2678        | 4.45  | 970  | 6.6027          |
| 6.0973        | 4.47  | 975  | 6.5940          |
| 6.0822        | 4.5   | 980  | 6.5855          |
| 6.1009        | 4.52  | 985  | 6.5775          |
| 6.1271        | 4.54  | 990  | 6.5701          |
| 6.1592        | 4.56  | 995  | 6.5623          |
| 6.1096        | 4.59  | 1000 | 6.5551          |
| 5.9785        | 4.61  | 1005 | 6.5481          |
| 6.3988        | 4.63  | 1010 | 6.5409          |
| 6.0417        | 4.66  | 1015 | 6.5335          |
| 6.1195        | 4.68  | 1020 | 6.5261          |
| 6.0588        | 4.7   | 1025 | 6.5189          |
| 6.1183        | 4.72  | 1030 | 6.5121          |
| 5.9251        | 4.75  | 1035 | 6.5057          |
| 5.9547        | 4.77  | 1040 | 6.5001          |
| 6.0658        | 4.79  | 1045 | 6.4946          |
| 6.1259        | 4.82  | 1050 | 6.4889          |
| 6.0679        | 4.84  | 1055 | 6.4828          |
| 6.0607        | 4.86  | 1060 | 6.4769          |
| 5.9526        | 4.89  | 1065 | 6.4715          |
| 6.0828        | 4.91  | 1070 | 6.4658          |
| 5.9547        | 4.93  | 1075 | 6.4605          |
| 6.1024        | 4.95  | 1080 | 6.4551          |
| 5.9813        | 4.98  | 1085 | 6.4495          |
| 5.8972        | 5.0   | 1090 | 6.4440          |
| 5.7935        | 5.02  | 1095 | 6.4390          |
| 5.9187        | 5.05  | 1100 | 6.4349          |
| 5.9726        | 5.07  | 1105 | 6.4305          |
| 6.1756        | 5.09  | 1110 | 6.4254          |
| 5.8363        | 5.11  | 1115 | 6.4208          |
| 5.9026        | 5.14  | 1120 | 6.4165          |
| 6.07          | 5.16  | 1125 | 6.4123          |
| 5.963         | 5.18  | 1130 | 6.4077          |
| 5.8744        | 5.21  | 1135 | 6.4032          |
| 5.7556        | 5.23  | 1140 | 6.3994          |
| 5.9779        | 5.25  | 1145 | 6.3952          |
| 5.972         | 5.28  | 1150 | 6.3913          |
| 5.9615        | 5.3   | 1155 | 6.3873          |
| 5.996         | 5.32  | 1160 | 6.3834          |
| 5.8424        | 5.34  | 1165 | 6.3795          |
| 5.7417        | 5.37  | 1170 | 6.3762          |
| 5.9022        | 5.39  | 1175 | 6.3727          |
| 6.0184        | 5.41  | 1180 | 6.3693          |
| 5.749         | 5.44  | 1185 | 6.3659          |
| 5.773         | 5.46  | 1190 | 6.3631          |
| 6.0517        | 5.48  | 1195 | 6.3601          |
| 5.7407        | 5.5   | 1200 | 6.3573          |
| 5.9687        | 5.53  | 1205 | 6.3549          |
| 5.9979        | 5.55  | 1210 | 6.3518          |
| 6.1084        | 5.57  | 1215 | 6.3482          |
| 5.8697        | 5.6   | 1220 | 6.3447          |
| 6.0638        | 5.62  | 1225 | 6.3409          |
| 6.118         | 5.64  | 1230 | 6.3371          |
| 5.7951        | 5.67  | 1235 | 6.3334          |
| 5.7953        | 5.69  | 1240 | 6.3302          |
| 5.9258        | 5.71  | 1245 | 6.3272          |
| 6.0077        | 5.73  | 1250 | 6.3240          |
| 5.7704        | 5.76  | 1255 | 6.3209          |
| 5.8541        | 5.78  | 1260 | 6.3181          |
| 5.9699        | 5.8   | 1265 | 6.3153          |
| 5.8741        | 5.83  | 1270 | 6.3126          |
| 5.917         | 5.85  | 1275 | 6.3100          |
| 5.9787        | 5.87  | 1280 | 6.3070          |
| 5.9342        | 5.89  | 1285 | 6.3044          |
| 6.0153        | 5.92  | 1290 | 6.3018          |
| 5.9102        | 5.94  | 1295 | 6.2993          |
| 5.8239        | 5.96  | 1300 | 6.2970          |
| 5.8519        | 5.99  | 1305 | 6.2946          |
| 5.7885        | 6.01  | 1310 | 6.2925          |
| 5.7097        | 6.03  | 1315 | 6.2907          |
| 5.8986        | 6.06  | 1320 | 6.2885          |
| 5.9841        | 6.08  | 1325 | 6.2864          |
| 5.706         | 6.1   | 1330 | 6.2843          |
| 5.6936        | 6.12  | 1335 | 6.2827          |
| 5.8226        | 6.15  | 1340 | 6.2810          |
| 5.8315        | 6.17  | 1345 | 6.2791          |
| 5.9115        | 6.19  | 1350 | 6.2774          |
| 5.8574        | 6.22  | 1355 | 6.2754          |
| 5.6731        | 6.24  | 1360 | 6.2736          |
| 5.8267        | 6.26  | 1365 | 6.2719          |
| 5.9179        | 6.28  | 1370 | 6.2699          |
| 5.8623        | 6.31  | 1375 | 6.2682          |
| 5.5588        | 6.33  | 1380 | 6.2668          |
| 5.675         | 6.35  | 1385 | 6.2656          |
| 5.9247        | 6.38  | 1390 | 6.2642          |
| 5.9254        | 6.4   | 1395 | 6.2624          |
| 5.6931        | 6.42  | 1400 | 6.2608          |
| 5.872         | 6.44  | 1405 | 6.2593          |
| 5.9024        | 6.47  | 1410 | 6.2574          |
| 5.8604        | 6.49  | 1415 | 6.2557          |
| 5.7363        | 6.51  | 1420 | 6.2541          |
| 5.7869        | 6.54  | 1425 | 6.2528          |
| 6.0195        | 6.56  | 1430 | 6.2511          |
| 5.8393        | 6.58  | 1435 | 6.2493          |
| 5.7697        | 6.61  | 1440 | 6.2476          |
| 5.9471        | 6.63  | 1445 | 6.2460          |
| 5.9015        | 6.65  | 1450 | 6.2440          |
| 5.9454        | 6.67  | 1455 | 6.2419          |
| 5.9572        | 6.7   | 1460 | 6.2399          |
| 5.8503        | 6.72  | 1465 | 6.2381          |
| 5.8685        | 6.74  | 1470 | 6.2361          |
| 5.9132        | 6.77  | 1475 | 6.2344          |
| 6.0508        | 6.79  | 1480 | 6.2325          |
| 5.7752        | 6.81  | 1485 | 6.2307          |
| 5.7491        | 6.83  | 1490 | 6.2292          |
| 5.8327        | 6.86  | 1495 | 6.2279          |
| 5.8021        | 6.88  | 1500 | 6.2266          |
| 5.909         | 6.9   | 1505 | 6.2253          |
| 5.7635        | 6.93  | 1510 | 6.2237          |
| 5.7958        | 6.95  | 1515 | 6.2225          |
| 5.7834        | 6.97  | 1520 | 6.2212          |
| 5.8064        | 7.0   | 1525 | 6.2202          |
| 5.7643        | 7.02  | 1530 | 6.2191          |
| 5.7698        | 7.04  | 1535 | 6.2181          |
| 5.947         | 7.06  | 1540 | 6.2168          |
| 5.651         | 7.09  | 1545 | 6.2156          |
| 5.7821        | 7.11  | 1550 | 6.2144          |
| 5.9321        | 7.13  | 1555 | 6.2133          |
| 5.7556        | 7.16  | 1560 | 6.2122          |
| 5.9326        | 7.18  | 1565 | 6.2109          |
| 5.8153        | 7.2   | 1570 | 6.2098          |
| 5.8886        | 7.22  | 1575 | 6.2086          |
| 5.791         | 7.25  | 1580 | 6.2075          |
| 5.6872        | 7.27  | 1585 | 6.2066          |
| 5.8454        | 7.29  | 1590 | 6.2054          |
| 5.6718        | 7.32  | 1595 | 6.2045          |
| 5.94          | 7.34  | 1600 | 6.2034          |
| 5.7839        | 7.36  | 1605 | 6.2023          |
| 5.7479        | 7.39  | 1610 | 6.2014          |
| 5.7667        | 7.41  | 1615 | 6.2004          |
| 5.6903        | 7.43  | 1620 | 6.1996          |
| 5.7733        | 7.45  | 1625 | 6.1988          |
| 5.7689        | 7.48  | 1630 | 6.1978          |
| 5.6635        | 7.5   | 1635 | 6.1972          |
| 5.6859        | 7.52  | 1640 | 6.1965          |
| 5.9551        | 7.55  | 1645 | 6.1955          |
| 5.9198        | 7.57  | 1650 | 6.1945          |
| 5.8671        | 7.59  | 1655 | 6.1935          |
| 5.8787        | 7.61  | 1660 | 6.1926          |
| 5.672         | 7.64  | 1665 | 6.1916          |
| 5.6778        | 7.66  | 1670 | 6.1908          |
| 5.7932        | 7.68  | 1675 | 6.1901          |
| 5.7728        | 7.71  | 1680 | 6.1893          |
| 5.7485        | 7.73  | 1685 | 6.1885          |
| 5.7004        | 7.75  | 1690 | 6.1878          |
| 5.8689        | 7.78  | 1695 | 6.1871          |
| 5.8178        | 7.8   | 1700 | 6.1862          |
| 5.7805        | 7.82  | 1705 | 6.1855          |
| 5.6899        | 7.84  | 1710 | 6.1847          |
| 5.7139        | 7.87  | 1715 | 6.1841          |
| 5.8343        | 7.89  | 1720 | 6.1834          |
| 5.617         | 7.91  | 1725 | 6.1828          |
| 5.6653        | 7.94  | 1730 | 6.1822          |
| 5.7244        | 7.96  | 1735 | 6.1817          |
| 5.7212        | 7.98  | 1740 | 6.1811          |
| 5.8714        | 8.0   | 1745 | 6.1806          |
| 5.7405        | 8.03  | 1750 | 6.1798          |
| 5.9066        | 8.05  | 1755 | 6.1792          |
| 5.8379        | 8.07  | 1760 | 6.1786          |
| 5.8899        | 8.1   | 1765 | 6.1778          |
| 5.835         | 8.12  | 1770 | 6.1770          |
| 5.691         | 8.14  | 1775 | 6.1764          |
| 5.9066        | 8.17  | 1780 | 6.1758          |
| 5.7688        | 8.19  | 1785 | 6.1751          |
| 5.7538        | 8.21  | 1790 | 6.1746          |
| 5.6364        | 8.23  | 1795 | 6.1740          |
| 5.8411        | 8.26  | 1800 | 6.1734          |
| 5.7645        | 8.28  | 1805 | 6.1729          |
| 5.8873        | 8.3   | 1810 | 6.1723          |
| 5.5752        | 8.33  | 1815 | 6.1718          |
| 5.8784        | 8.35  | 1820 | 6.1712          |
| 5.7117        | 8.37  | 1825 | 6.1710          |
| 5.8186        | 8.39  | 1830 | 6.1704          |
| 5.6907        | 8.42  | 1835 | 6.1699          |
| 5.7           | 8.44  | 1840 | 6.1694          |
| 5.5417        | 8.46  | 1845 | 6.1692          |
| 5.8637        | 8.49  | 1850 | 6.1687          |
| 5.7281        | 8.51  | 1855 | 6.1682          |
| 5.6528        | 8.53  | 1860 | 6.1677          |
| 5.7258        | 8.56  | 1865 | 6.1674          |
| 5.7621        | 8.58  | 1870 | 6.1669          |
| 5.7232        | 8.6   | 1875 | 6.1666          |
| 5.5538        | 8.62  | 1880 | 6.1661          |
| 5.7917        | 8.65  | 1885 | 6.1658          |
| 5.8579        | 8.67  | 1890 | 6.1654          |
| 5.6824        | 8.69  | 1895 | 6.1649          |
| 5.7336        | 8.72  | 1900 | 6.1646          |
| 5.7791        | 8.74  | 1905 | 6.1641          |
| 5.5699        | 8.76  | 1910 | 6.1638          |
| 5.7826        | 8.78  | 1915 | 6.1634          |
| 5.6718        | 8.81  | 1920 | 6.1632          |
| 5.829         | 8.83  | 1925 | 6.1629          |
| 5.5786        | 8.85  | 1930 | 6.1625          |
| 5.7453        | 8.88  | 1935 | 6.1622          |
| 5.6309        | 8.9   | 1940 | 6.1620          |
| 5.7146        | 8.92  | 1945 | 6.1617          |
| 5.7131        | 8.94  | 1950 | 6.1614          |
| 5.7432        | 8.97  | 1955 | 6.1609          |
| 5.6304        | 8.99  | 1960 | 6.1607          |
| 5.6925        | 9.01  | 1965 | 6.1605          |
| 5.7406        | 9.04  | 1970 | 6.1601          |
| 5.6347        | 9.06  | 1975 | 6.1600          |
| 5.6896        | 9.08  | 1980 | 6.1597          |
| 5.6159        | 9.11  | 1985 | 6.1594          |
| 5.9093        | 9.13  | 1990 | 6.1593          |
| 5.7172        | 9.15  | 1995 | 6.1590          |
| 5.7223        | 9.17  | 2000 | 6.1587          |
| 5.6943        | 9.2   | 2005 | 6.1586          |
| 5.7278        | 9.22  | 2010 | 6.1585          |
| 5.6541        | 9.24  | 2015 | 6.1583          |
| 5.8852        | 9.27  | 2020 | 6.1580          |
| 5.8833        | 9.29  | 2025 | 6.1579          |
| 5.6182        | 9.31  | 2030 | 6.1577          |
| 5.7419        | 9.33  | 2035 | 6.1575          |
| 5.8911        | 9.36  | 2040 | 6.1572          |
| 5.6314        | 9.38  | 2045 | 6.1571          |
| 5.714         | 9.4   | 2050 | 6.1568          |
| 5.7446        | 9.43  | 2055 | 6.1566          |
| 5.7887        | 9.45  | 2060 | 6.1565          |
| 5.8779        | 9.47  | 2065 | 6.1563          |
| 5.7857        | 9.5   | 2070 | 6.1561          |
| 5.8314        | 9.52  | 2075 | 6.1560          |
| 5.584         | 9.54  | 2080 | 6.1558          |
| 5.6878        | 9.56  | 2085 | 6.1556          |
| 5.9123        | 9.59  | 2090 | 6.1555          |
| 5.7777        | 9.61  | 2095 | 6.1554          |
| 5.8798        | 9.63  | 2100 | 6.1554          |
| 5.7343        | 9.66  | 2105 | 6.1552          |
| 5.6734        | 9.68  | 2110 | 6.1550          |
| 5.6331        | 9.7   | 2115 | 6.1550          |
| 5.5947        | 9.72  | 2120 | 6.1550          |
| 5.8934        | 9.75  | 2125 | 6.1549          |
| 5.6424        | 9.77  | 2130 | 6.1548          |
| 5.4537        | 9.79  | 2135 | 6.1548          |
| 5.799         | 9.82  | 2140 | 6.1547          |
| 5.5778        | 9.84  | 2145 | 6.1546          |
| 5.6188        | 9.86  | 2150 | 6.1546          |
| 5.8389        | 9.89  | 2155 | 6.1545          |
| 5.7505        | 9.91  | 2160 | 6.1544          |
| 5.7237        | 9.93  | 2165 | 6.1544          |
| 5.7           | 9.95  | 2170 | 6.1544          |
| 5.7322        | 9.98  | 2175 | 6.1544          |
| 5.6562        | 10.0  | 2180 | 6.1544          |


### Framework versions

- Transformers 4.34.1
- Pytorch 2.0.1+cu118
- Datasets 2.14.5
- Tokenizers 0.14.1