File size: 22,959 Bytes
009dceb
 
 
 
 
 
2cfeafb
009dceb
 
 
 
 
 
2cfeafb
009dceb
 
 
2cfeafb
 
 
 
009dceb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2cfeafb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
009dceb
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask2_mechanics
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask2_mechanics

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5455
- Qwk: 0.5691
- Mse: 0.5455
- Rmse: 0.7386

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk    | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:|
| No log        | 0.0213 | 2    | 3.6715          | 0.0220 | 3.6715 | 1.9161 |
| No log        | 0.0426 | 4    | 2.8563          | 0.0503 | 2.8563 | 1.6901 |
| No log        | 0.0638 | 6    | 1.2401          | 0.1393 | 1.2401 | 1.1136 |
| No log        | 0.0851 | 8    | 0.6320          | 0.3124 | 0.6320 | 0.7950 |
| No log        | 0.1064 | 10   | 0.6755          | 0.1823 | 0.6755 | 0.8219 |
| No log        | 0.1277 | 12   | 0.6662          | 0.3674 | 0.6662 | 0.8162 |
| No log        | 0.1489 | 14   | 0.6873          | 0.4927 | 0.6873 | 0.8290 |
| No log        | 0.1702 | 16   | 0.7652          | 0.4506 | 0.7652 | 0.8747 |
| No log        | 0.1915 | 18   | 0.6937          | 0.4862 | 0.6937 | 0.8329 |
| No log        | 0.2128 | 20   | 0.6393          | 0.5286 | 0.6393 | 0.7995 |
| No log        | 0.2340 | 22   | 0.6497          | 0.5065 | 0.6497 | 0.8061 |
| No log        | 0.2553 | 24   | 0.5188          | 0.5033 | 0.5188 | 0.7203 |
| No log        | 0.2766 | 26   | 0.5712          | 0.4637 | 0.5712 | 0.7558 |
| No log        | 0.2979 | 28   | 0.5273          | 0.4938 | 0.5273 | 0.7262 |
| No log        | 0.3191 | 30   | 0.5406          | 0.4374 | 0.5406 | 0.7353 |
| No log        | 0.3404 | 32   | 0.5355          | 0.4394 | 0.5355 | 0.7318 |
| No log        | 0.3617 | 34   | 0.5206          | 0.4111 | 0.5206 | 0.7215 |
| No log        | 0.3830 | 36   | 0.5333          | 0.3941 | 0.5333 | 0.7303 |
| No log        | 0.4043 | 38   | 0.5406          | 0.4039 | 0.5406 | 0.7353 |
| No log        | 0.4255 | 40   | 0.5325          | 0.4156 | 0.5325 | 0.7297 |
| No log        | 0.4468 | 42   | 0.5373          | 0.4246 | 0.5373 | 0.7330 |
| No log        | 0.4681 | 44   | 0.5923          | 0.2852 | 0.5923 | 0.7696 |
| No log        | 0.4894 | 46   | 0.6183          | 0.2807 | 0.6183 | 0.7863 |
| No log        | 0.5106 | 48   | 0.6858          | 0.2402 | 0.6858 | 0.8281 |
| No log        | 0.5319 | 50   | 0.6494          | 0.3082 | 0.6494 | 0.8058 |
| No log        | 0.5532 | 52   | 0.5569          | 0.4049 | 0.5569 | 0.7463 |
| No log        | 0.5745 | 54   | 0.4656          | 0.5388 | 0.4656 | 0.6823 |
| No log        | 0.5957 | 56   | 0.4648          | 0.5786 | 0.4648 | 0.6818 |
| No log        | 0.6170 | 58   | 0.4398          | 0.5717 | 0.4398 | 0.6632 |
| No log        | 0.6383 | 60   | 0.4197          | 0.5555 | 0.4197 | 0.6478 |
| No log        | 0.6596 | 62   | 0.4172          | 0.5539 | 0.4172 | 0.6459 |
| No log        | 0.6809 | 64   | 0.4408          | 0.6286 | 0.4408 | 0.6639 |
| No log        | 0.7021 | 66   | 0.5555          | 0.6009 | 0.5555 | 0.7453 |
| No log        | 0.7234 | 68   | 0.7550          | 0.5525 | 0.7550 | 0.8689 |
| No log        | 0.7447 | 70   | 0.8124          | 0.5613 | 0.8124 | 0.9013 |
| No log        | 0.7660 | 72   | 0.6974          | 0.5848 | 0.6974 | 0.8351 |
| No log        | 0.7872 | 74   | 0.6234          | 0.6201 | 0.6234 | 0.7895 |
| No log        | 0.8085 | 76   | 0.5605          | 0.6280 | 0.5605 | 0.7487 |
| No log        | 0.8298 | 78   | 0.4423          | 0.6579 | 0.4423 | 0.6651 |
| No log        | 0.8511 | 80   | 0.5967          | 0.5139 | 0.5967 | 0.7724 |
| No log        | 0.8723 | 82   | 0.6308          | 0.4865 | 0.6308 | 0.7942 |
| No log        | 0.8936 | 84   | 0.4449          | 0.5544 | 0.4449 | 0.6670 |
| No log        | 0.9149 | 86   | 0.4097          | 0.5727 | 0.4097 | 0.6401 |
| No log        | 0.9362 | 88   | 0.4110          | 0.5767 | 0.4110 | 0.6411 |
| No log        | 0.9574 | 90   | 0.5281          | 0.5330 | 0.5281 | 0.7267 |
| No log        | 0.9787 | 92   | 0.5240          | 0.5274 | 0.5240 | 0.7239 |
| No log        | 1.0    | 94   | 0.4051          | 0.6067 | 0.4051 | 0.6365 |
| No log        | 1.0213 | 96   | 0.4063          | 0.6368 | 0.4063 | 0.6374 |
| No log        | 1.0426 | 98   | 0.5241          | 0.5896 | 0.5241 | 0.7239 |
| No log        | 1.0638 | 100  | 0.5979          | 0.5377 | 0.5979 | 0.7732 |
| No log        | 1.0851 | 102  | 0.5571          | 0.5235 | 0.5571 | 0.7464 |
| No log        | 1.1064 | 104  | 0.5328          | 0.5192 | 0.5328 | 0.7299 |
| No log        | 1.1277 | 106  | 0.5125          | 0.4497 | 0.5125 | 0.7159 |
| No log        | 1.1489 | 108  | 0.4651          | 0.4769 | 0.4651 | 0.6820 |
| No log        | 1.1702 | 110  | 0.4263          | 0.5330 | 0.4263 | 0.6529 |
| No log        | 1.1915 | 112  | 0.4218          | 0.5453 | 0.4218 | 0.6495 |
| No log        | 1.2128 | 114  | 0.4469          | 0.4965 | 0.4469 | 0.6685 |
| No log        | 1.2340 | 116  | 0.4962          | 0.4085 | 0.4962 | 0.7044 |
| No log        | 1.2553 | 118  | 0.5140          | 0.4575 | 0.5140 | 0.7170 |
| No log        | 1.2766 | 120  | 0.5814          | 0.5020 | 0.5814 | 0.7625 |
| No log        | 1.2979 | 122  | 0.5288          | 0.5370 | 0.5288 | 0.7272 |
| No log        | 1.3191 | 124  | 0.5162          | 0.5865 | 0.5162 | 0.7185 |
| No log        | 1.3404 | 126  | 0.4904          | 0.6492 | 0.4904 | 0.7003 |
| No log        | 1.3617 | 128  | 0.4597          | 0.6086 | 0.4597 | 0.6780 |
| No log        | 1.3830 | 130  | 0.4506          | 0.6136 | 0.4506 | 0.6713 |
| No log        | 1.4043 | 132  | 0.5070          | 0.5862 | 0.5070 | 0.7120 |
| No log        | 1.4255 | 134  | 0.6795          | 0.4488 | 0.6795 | 0.8243 |
| No log        | 1.4468 | 136  | 0.6479          | 0.4579 | 0.6479 | 0.8049 |
| No log        | 1.4681 | 138  | 0.4713          | 0.5356 | 0.4713 | 0.6865 |
| No log        | 1.4894 | 140  | 0.4060          | 0.5929 | 0.4060 | 0.6372 |
| No log        | 1.5106 | 142  | 0.4000          | 0.6152 | 0.4000 | 0.6324 |
| No log        | 1.5319 | 144  | 0.4305          | 0.5835 | 0.4305 | 0.6561 |
| No log        | 1.5532 | 146  | 0.6179          | 0.4605 | 0.6179 | 0.7861 |
| No log        | 1.5745 | 148  | 0.7029          | 0.4583 | 0.7029 | 0.8384 |
| No log        | 1.5957 | 150  | 0.6621          | 0.4585 | 0.6621 | 0.8137 |
| No log        | 1.6170 | 152  | 0.4777          | 0.5244 | 0.4777 | 0.6911 |
| No log        | 1.6383 | 154  | 0.3791          | 0.6595 | 0.3791 | 0.6157 |
| No log        | 1.6596 | 156  | 0.3820          | 0.6775 | 0.3820 | 0.6180 |
| No log        | 1.6809 | 158  | 0.3948          | 0.6775 | 0.3948 | 0.6284 |
| No log        | 1.7021 | 160  | 0.4250          | 0.6125 | 0.4250 | 0.6519 |
| No log        | 1.7234 | 162  | 0.5020          | 0.5437 | 0.5020 | 0.7085 |
| No log        | 1.7447 | 164  | 0.4833          | 0.5835 | 0.4833 | 0.6952 |
| No log        | 1.7660 | 166  | 0.4224          | 0.6192 | 0.4224 | 0.6499 |
| No log        | 1.7872 | 168  | 0.4125          | 0.6347 | 0.4125 | 0.6423 |
| No log        | 1.8085 | 170  | 0.4431          | 0.5998 | 0.4431 | 0.6657 |
| No log        | 1.8298 | 172  | 0.4675          | 0.5717 | 0.4675 | 0.6837 |
| No log        | 1.8511 | 174  | 0.5781          | 0.4960 | 0.5781 | 0.7603 |
| No log        | 1.8723 | 176  | 0.6813          | 0.4511 | 0.6813 | 0.8254 |
| No log        | 1.8936 | 178  | 0.6349          | 0.4880 | 0.6349 | 0.7968 |
| No log        | 1.9149 | 180  | 0.6006          | 0.5233 | 0.6006 | 0.7750 |
| No log        | 1.9362 | 182  | 0.5224          | 0.6040 | 0.5224 | 0.7228 |
| No log        | 1.9574 | 184  | 0.5325          | 0.6257 | 0.5325 | 0.7298 |
| No log        | 1.9787 | 186  | 0.4619          | 0.6302 | 0.4619 | 0.6796 |
| No log        | 2.0    | 188  | 0.4503          | 0.6315 | 0.4503 | 0.6711 |
| No log        | 2.0213 | 190  | 0.5117          | 0.6062 | 0.5117 | 0.7154 |
| No log        | 2.0426 | 192  | 0.4414          | 0.6206 | 0.4414 | 0.6644 |
| No log        | 2.0638 | 194  | 0.3722          | 0.6819 | 0.3722 | 0.6101 |
| No log        | 2.0851 | 196  | 0.4930          | 0.5736 | 0.4930 | 0.7022 |
| No log        | 2.1064 | 198  | 0.4580          | 0.5794 | 0.4580 | 0.6767 |
| No log        | 2.1277 | 200  | 0.3627          | 0.6768 | 0.3627 | 0.6022 |
| No log        | 2.1489 | 202  | 0.5227          | 0.5595 | 0.5227 | 0.7230 |
| No log        | 2.1702 | 204  | 0.7287          | 0.4812 | 0.7287 | 0.8536 |
| No log        | 2.1915 | 206  | 0.7065          | 0.4988 | 0.7065 | 0.8406 |
| No log        | 2.2128 | 208  | 0.5782          | 0.5365 | 0.5782 | 0.7604 |
| No log        | 2.2340 | 210  | 0.5758          | 0.5643 | 0.5758 | 0.7588 |
| No log        | 2.2553 | 212  | 0.5744          | 0.5679 | 0.5744 | 0.7579 |
| No log        | 2.2766 | 214  | 0.5348          | 0.5966 | 0.5348 | 0.7313 |
| No log        | 2.2979 | 216  | 0.4977          | 0.6742 | 0.4977 | 0.7055 |
| No log        | 2.3191 | 218  | 0.4896          | 0.6507 | 0.4896 | 0.6997 |
| No log        | 2.3404 | 220  | 0.5154          | 0.6433 | 0.5154 | 0.7179 |
| No log        | 2.3617 | 222  | 0.6889          | 0.5556 | 0.6889 | 0.8300 |
| No log        | 2.3830 | 224  | 0.8044          | 0.4812 | 0.8044 | 0.8969 |
| No log        | 2.4043 | 226  | 0.5725          | 0.5152 | 0.5725 | 0.7566 |
| No log        | 2.4255 | 228  | 0.4491          | 0.5950 | 0.4491 | 0.6701 |
| No log        | 2.4468 | 230  | 0.4798          | 0.5779 | 0.4798 | 0.6927 |
| No log        | 2.4681 | 232  | 0.4933          | 0.5192 | 0.4933 | 0.7024 |
| No log        | 2.4894 | 234  | 0.5377          | 0.5041 | 0.5377 | 0.7333 |
| No log        | 2.5106 | 236  | 0.6701          | 0.4704 | 0.6701 | 0.8186 |
| No log        | 2.5319 | 238  | 0.8833          | 0.4188 | 0.8833 | 0.9399 |
| No log        | 2.5532 | 240  | 0.7746          | 0.4705 | 0.7746 | 0.8801 |
| No log        | 2.5745 | 242  | 0.4825          | 0.6108 | 0.4825 | 0.6946 |
| No log        | 2.5957 | 244  | 0.3994          | 0.6590 | 0.3994 | 0.6320 |
| No log        | 2.6170 | 246  | 0.3889          | 0.6424 | 0.3889 | 0.6236 |
| No log        | 2.6383 | 248  | 0.4917          | 0.5783 | 0.4917 | 0.7012 |
| No log        | 2.6596 | 250  | 0.5771          | 0.5361 | 0.5771 | 0.7597 |
| No log        | 2.6809 | 252  | 0.5453          | 0.5533 | 0.5453 | 0.7384 |
| No log        | 2.7021 | 254  | 0.4995          | 0.5977 | 0.4995 | 0.7068 |
| No log        | 2.7234 | 256  | 0.5162          | 0.6091 | 0.5162 | 0.7184 |
| No log        | 2.7447 | 258  | 0.4977          | 0.5981 | 0.4977 | 0.7054 |
| No log        | 2.7660 | 260  | 0.4149          | 0.6520 | 0.4149 | 0.6442 |
| No log        | 2.7872 | 262  | 0.4129          | 0.6326 | 0.4129 | 0.6426 |
| No log        | 2.8085 | 264  | 0.4302          | 0.6060 | 0.4302 | 0.6559 |
| No log        | 2.8298 | 266  | 0.6247          | 0.4856 | 0.6247 | 0.7904 |
| No log        | 2.8511 | 268  | 0.7140          | 0.4419 | 0.7140 | 0.8450 |
| No log        | 2.8723 | 270  | 0.6641          | 0.4579 | 0.6641 | 0.8149 |
| No log        | 2.8936 | 272  | 0.5411          | 0.5064 | 0.5411 | 0.7356 |
| No log        | 2.9149 | 274  | 0.4313          | 0.5826 | 0.4313 | 0.6567 |
| No log        | 2.9362 | 276  | 0.4257          | 0.5996 | 0.4257 | 0.6525 |
| No log        | 2.9574 | 278  | 0.4016          | 0.6118 | 0.4016 | 0.6337 |
| No log        | 2.9787 | 280  | 0.4714          | 0.5861 | 0.4714 | 0.6866 |
| No log        | 3.0    | 282  | 0.6176          | 0.5005 | 0.6176 | 0.7859 |
| No log        | 3.0213 | 284  | 0.6416          | 0.4673 | 0.6416 | 0.8010 |
| No log        | 3.0426 | 286  | 0.5775          | 0.4966 | 0.5775 | 0.7599 |
| No log        | 3.0638 | 288  | 0.5510          | 0.5647 | 0.5510 | 0.7423 |
| No log        | 3.0851 | 290  | 0.4327          | 0.6274 | 0.4327 | 0.6578 |
| No log        | 3.1064 | 292  | 0.4266          | 0.6463 | 0.4266 | 0.6531 |
| No log        | 3.1277 | 294  | 0.4398          | 0.6412 | 0.4398 | 0.6632 |
| No log        | 3.1489 | 296  | 0.6065          | 0.5876 | 0.6065 | 0.7788 |
| No log        | 3.1702 | 298  | 0.6857          | 0.5333 | 0.6857 | 0.8281 |
| No log        | 3.1915 | 300  | 0.5516          | 0.6002 | 0.5516 | 0.7427 |
| No log        | 3.2128 | 302  | 0.4414          | 0.6594 | 0.4414 | 0.6644 |
| No log        | 3.2340 | 304  | 0.4799          | 0.6004 | 0.4799 | 0.6927 |
| No log        | 3.2553 | 306  | 0.4841          | 0.5617 | 0.4841 | 0.6957 |
| No log        | 3.2766 | 308  | 0.4373          | 0.5795 | 0.4373 | 0.6613 |
| No log        | 3.2979 | 310  | 0.4810          | 0.5586 | 0.4810 | 0.6936 |
| No log        | 3.3191 | 312  | 0.4463          | 0.5790 | 0.4463 | 0.6681 |
| No log        | 3.3404 | 314  | 0.4365          | 0.5835 | 0.4365 | 0.6607 |
| No log        | 3.3617 | 316  | 0.4973          | 0.5784 | 0.4973 | 0.7052 |
| No log        | 3.3830 | 318  | 0.4248          | 0.6185 | 0.4248 | 0.6518 |
| No log        | 3.4043 | 320  | 0.4480          | 0.6247 | 0.4480 | 0.6694 |
| No log        | 3.4255 | 322  | 0.5717          | 0.5872 | 0.5717 | 0.7561 |
| No log        | 3.4468 | 324  | 0.6497          | 0.5552 | 0.6497 | 0.8060 |
| No log        | 3.4681 | 326  | 0.4973          | 0.6581 | 0.4973 | 0.7052 |
| No log        | 3.4894 | 328  | 0.4614          | 0.6413 | 0.4614 | 0.6792 |
| No log        | 3.5106 | 330  | 0.4517          | 0.6235 | 0.4517 | 0.6721 |
| No log        | 3.5319 | 332  | 0.4821          | 0.6276 | 0.4821 | 0.6943 |
| No log        | 3.5532 | 334  | 0.7600          | 0.5046 | 0.7600 | 0.8718 |
| No log        | 3.5745 | 336  | 0.8952          | 0.4338 | 0.8952 | 0.9462 |
| No log        | 3.5957 | 338  | 0.6456          | 0.5407 | 0.6456 | 0.8035 |
| No log        | 3.6170 | 340  | 0.4559          | 0.5763 | 0.4559 | 0.6752 |
| No log        | 3.6383 | 342  | 0.4552          | 0.5718 | 0.4552 | 0.6747 |
| No log        | 3.6596 | 344  | 0.5587          | 0.5544 | 0.5587 | 0.7475 |
| No log        | 3.6809 | 346  | 0.8736          | 0.3948 | 0.8736 | 0.9347 |
| No log        | 3.7021 | 348  | 0.9182          | 0.3913 | 0.9182 | 0.9582 |
| No log        | 3.7234 | 350  | 0.7058          | 0.4015 | 0.7058 | 0.8401 |
| No log        | 3.7447 | 352  | 0.4711          | 0.5278 | 0.4711 | 0.6863 |
| No log        | 3.7660 | 354  | 0.4213          | 0.6470 | 0.4213 | 0.6491 |
| No log        | 3.7872 | 356  | 0.4500          | 0.5697 | 0.4500 | 0.6708 |
| No log        | 3.8085 | 358  | 0.4187          | 0.6261 | 0.4187 | 0.6471 |
| No log        | 3.8298 | 360  | 0.5081          | 0.5356 | 0.5081 | 0.7128 |
| No log        | 3.8511 | 362  | 0.5966          | 0.5208 | 0.5966 | 0.7724 |
| No log        | 3.8723 | 364  | 0.5210          | 0.5622 | 0.5210 | 0.7218 |
| No log        | 3.8936 | 366  | 0.4246          | 0.6279 | 0.4246 | 0.6516 |
| No log        | 3.9149 | 368  | 0.4143          | 0.6357 | 0.4143 | 0.6437 |
| No log        | 3.9362 | 370  | 0.4246          | 0.6496 | 0.4246 | 0.6516 |
| No log        | 3.9574 | 372  | 0.5331          | 0.5969 | 0.5331 | 0.7301 |
| No log        | 3.9787 | 374  | 0.6567          | 0.5503 | 0.6567 | 0.8104 |
| No log        | 4.0    | 376  | 0.5523          | 0.5904 | 0.5523 | 0.7432 |
| No log        | 4.0213 | 378  | 0.5043          | 0.5979 | 0.5043 | 0.7102 |
| No log        | 4.0426 | 380  | 0.4688          | 0.6092 | 0.4688 | 0.6847 |
| No log        | 4.0638 | 382  | 0.4665          | 0.6092 | 0.4665 | 0.6830 |
| No log        | 4.0851 | 384  | 0.4614          | 0.6212 | 0.4614 | 0.6792 |
| No log        | 4.1064 | 386  | 0.4460          | 0.6129 | 0.4460 | 0.6678 |
| No log        | 4.1277 | 388  | 0.5354          | 0.6041 | 0.5354 | 0.7317 |
| No log        | 4.1489 | 390  | 0.7533          | 0.5257 | 0.7533 | 0.8679 |
| No log        | 4.1702 | 392  | 0.6852          | 0.5412 | 0.6852 | 0.8278 |
| No log        | 4.1915 | 394  | 0.5025          | 0.6133 | 0.5025 | 0.7089 |
| No log        | 4.2128 | 396  | 0.4772          | 0.6045 | 0.4772 | 0.6908 |
| No log        | 4.2340 | 398  | 0.4753          | 0.5917 | 0.4753 | 0.6894 |
| No log        | 4.2553 | 400  | 0.4823          | 0.6163 | 0.4823 | 0.6945 |
| No log        | 4.2766 | 402  | 0.5673          | 0.6159 | 0.5673 | 0.7532 |
| No log        | 4.2979 | 404  | 0.6892          | 0.5960 | 0.6892 | 0.8302 |
| No log        | 4.3191 | 406  | 0.6687          | 0.5977 | 0.6687 | 0.8177 |
| No log        | 4.3404 | 408  | 0.6032          | 0.5830 | 0.6032 | 0.7767 |
| No log        | 4.3617 | 410  | 0.5464          | 0.5984 | 0.5464 | 0.7392 |
| No log        | 4.3830 | 412  | 0.5776          | 0.5540 | 0.5776 | 0.7600 |
| No log        | 4.4043 | 414  | 0.6166          | 0.5130 | 0.6166 | 0.7852 |
| No log        | 4.4255 | 416  | 0.6191          | 0.5047 | 0.6191 | 0.7868 |
| No log        | 4.4468 | 418  | 0.5450          | 0.5318 | 0.5450 | 0.7382 |
| No log        | 4.4681 | 420  | 0.5421          | 0.5356 | 0.5421 | 0.7363 |
| No log        | 4.4894 | 422  | 0.4486          | 0.5492 | 0.4486 | 0.6698 |
| No log        | 4.5106 | 424  | 0.4458          | 0.6004 | 0.4458 | 0.6677 |
| No log        | 4.5319 | 426  | 0.5333          | 0.5666 | 0.5333 | 0.7303 |
| No log        | 4.5532 | 428  | 0.5325          | 0.5844 | 0.5325 | 0.7297 |
| No log        | 4.5745 | 430  | 0.4087          | 0.6809 | 0.4087 | 0.6393 |
| No log        | 4.5957 | 432  | 0.3983          | 0.6722 | 0.3983 | 0.6311 |
| No log        | 4.6170 | 434  | 0.4683          | 0.5863 | 0.4683 | 0.6843 |
| No log        | 4.6383 | 436  | 0.6688          | 0.5605 | 0.6688 | 0.8178 |
| No log        | 4.6596 | 438  | 0.6600          | 0.5609 | 0.6600 | 0.8124 |
| No log        | 4.6809 | 440  | 0.4877          | 0.5916 | 0.4877 | 0.6984 |
| No log        | 4.7021 | 442  | 0.4211          | 0.5980 | 0.4211 | 0.6489 |
| No log        | 4.7234 | 444  | 0.4257          | 0.6015 | 0.4257 | 0.6524 |
| No log        | 4.7447 | 446  | 0.5320          | 0.5658 | 0.5320 | 0.7294 |
| No log        | 4.7660 | 448  | 0.7042          | 0.5243 | 0.7042 | 0.8391 |
| No log        | 4.7872 | 450  | 0.7423          | 0.5195 | 0.7423 | 0.8615 |
| No log        | 4.8085 | 452  | 0.5433          | 0.5966 | 0.5433 | 0.7371 |
| No log        | 4.8298 | 454  | 0.4548          | 0.6130 | 0.4548 | 0.6744 |
| No log        | 4.8511 | 456  | 0.4497          | 0.6147 | 0.4497 | 0.6706 |
| No log        | 4.8723 | 458  | 0.4912          | 0.5299 | 0.4912 | 0.7009 |
| No log        | 4.8936 | 460  | 0.7400          | 0.4279 | 0.7400 | 0.8602 |
| No log        | 4.9149 | 462  | 1.0617          | 0.3786 | 1.0617 | 1.0304 |
| No log        | 4.9362 | 464  | 1.0010          | 0.4013 | 1.0010 | 1.0005 |
| No log        | 4.9574 | 466  | 0.6774          | 0.4734 | 0.6774 | 0.8230 |
| No log        | 4.9787 | 468  | 0.4630          | 0.6162 | 0.4630 | 0.6805 |
| No log        | 5.0    | 470  | 0.4588          | 0.6261 | 0.4588 | 0.6774 |
| No log        | 5.0213 | 472  | 0.4921          | 0.6324 | 0.4921 | 0.7015 |
| No log        | 5.0426 | 474  | 0.5531          | 0.5887 | 0.5531 | 0.7437 |
| No log        | 5.0638 | 476  | 0.5163          | 0.6018 | 0.5163 | 0.7185 |
| No log        | 5.0851 | 478  | 0.4896          | 0.5860 | 0.4896 | 0.6997 |
| No log        | 5.1064 | 480  | 0.5185          | 0.5351 | 0.5185 | 0.7201 |
| No log        | 5.1277 | 482  | 0.4562          | 0.5752 | 0.4562 | 0.6754 |
| No log        | 5.1489 | 484  | 0.4147          | 0.5847 | 0.4147 | 0.6440 |
| No log        | 5.1702 | 486  | 0.4666          | 0.5825 | 0.4666 | 0.6831 |
| No log        | 5.1915 | 488  | 0.4695          | 0.6160 | 0.4695 | 0.6852 |
| No log        | 5.2128 | 490  | 0.4102          | 0.6474 | 0.4102 | 0.6404 |
| No log        | 5.2340 | 492  | 0.4072          | 0.6437 | 0.4072 | 0.6381 |
| No log        | 5.2553 | 494  | 0.4182          | 0.6291 | 0.4182 | 0.6467 |
| No log        | 5.2766 | 496  | 0.4877          | 0.5953 | 0.4877 | 0.6984 |
| No log        | 5.2979 | 498  | 0.4833          | 0.5887 | 0.4833 | 0.6952 |
| 0.4408        | 5.3191 | 500  | 0.4120          | 0.6437 | 0.4120 | 0.6418 |
| 0.4408        | 5.3404 | 502  | 0.4248          | 0.6129 | 0.4248 | 0.6517 |
| 0.4408        | 5.3617 | 504  | 0.4126          | 0.6574 | 0.4126 | 0.6424 |
| 0.4408        | 5.3830 | 506  | 0.5421          | 0.5807 | 0.5421 | 0.7363 |
| 0.4408        | 5.4043 | 508  | 0.5987          | 0.5667 | 0.5987 | 0.7737 |
| 0.4408        | 5.4255 | 510  | 0.5231          | 0.6083 | 0.5231 | 0.7232 |
| 0.4408        | 5.4468 | 512  | 0.4252          | 0.6705 | 0.4252 | 0.6521 |
| 0.4408        | 5.4681 | 514  | 0.4296          | 0.6597 | 0.4296 | 0.6554 |
| 0.4408        | 5.4894 | 516  | 0.4762          | 0.6551 | 0.4762 | 0.6900 |
| 0.4408        | 5.5106 | 518  | 0.7330          | 0.5582 | 0.7330 | 0.8561 |
| 0.4408        | 5.5319 | 520  | 0.7775          | 0.5370 | 0.7775 | 0.8818 |
| 0.4408        | 5.5532 | 522  | 0.5583          | 0.5988 | 0.5583 | 0.7472 |
| 0.4408        | 5.5745 | 524  | 0.3978          | 0.6511 | 0.3978 | 0.6307 |
| 0.4408        | 5.5957 | 526  | 0.3919          | 0.6545 | 0.3919 | 0.6260 |
| 0.4408        | 5.6170 | 528  | 0.4560          | 0.6055 | 0.4560 | 0.6753 |
| 0.4408        | 5.6383 | 530  | 0.5450          | 0.5794 | 0.5450 | 0.7382 |
| 0.4408        | 5.6596 | 532  | 0.5264          | 0.6002 | 0.5264 | 0.7255 |
| 0.4408        | 5.6809 | 534  | 0.4520          | 0.6439 | 0.4520 | 0.6723 |
| 0.4408        | 5.7021 | 536  | 0.4818          | 0.6275 | 0.4818 | 0.6941 |
| 0.4408        | 5.7234 | 538  | 0.4902          | 0.6435 | 0.4902 | 0.7001 |
| 0.4408        | 5.7447 | 540  | 0.6058          | 0.5956 | 0.6058 | 0.7783 |
| 0.4408        | 5.7660 | 542  | 0.6694          | 0.5677 | 0.6694 | 0.8182 |
| 0.4408        | 5.7872 | 544  | 0.5455          | 0.5691 | 0.5455 | 0.7386 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1