File size: 24,025 Bytes
d9818fa
 
 
 
 
 
b6482db
d9818fa
 
 
 
 
 
b6482db
d9818fa
 
 
b6482db
 
 
 
d9818fa
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b6482db
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d9818fa
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask7_style
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask7_style

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5691
- Qwk: 0.5934
- Mse: 0.5691
- Rmse: 0.7544

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0202 | 2    | 4.3227          | -0.0076 | 4.3227 | 2.0791 |
| No log        | 0.0404 | 4    | 3.3441          | 0.0382  | 3.3441 | 1.8287 |
| No log        | 0.0606 | 6    | 2.0985          | 0.0954  | 2.0985 | 1.4486 |
| No log        | 0.0808 | 8    | 1.0333          | 0.1558  | 1.0333 | 1.0165 |
| No log        | 0.1010 | 10   | 0.9785          | 0.0674  | 0.9785 | 0.9892 |
| No log        | 0.1212 | 12   | 1.1256          | 0.0217  | 1.1256 | 1.0610 |
| No log        | 0.1414 | 14   | 1.0783          | 0.0335  | 1.0783 | 1.0384 |
| No log        | 0.1616 | 16   | 1.0217          | 0.0369  | 1.0217 | 1.0108 |
| No log        | 0.1818 | 18   | 0.8597          | 0.0521  | 0.8597 | 0.9272 |
| No log        | 0.2020 | 20   | 0.7914          | 0.3960  | 0.7914 | 0.8896 |
| No log        | 0.2222 | 22   | 0.7767          | 0.3927  | 0.7767 | 0.8813 |
| No log        | 0.2424 | 24   | 0.7361          | 0.3352  | 0.7361 | 0.8579 |
| No log        | 0.2626 | 26   | 0.7923          | 0.1627  | 0.7923 | 0.8901 |
| No log        | 0.2828 | 28   | 0.9069          | 0.2643  | 0.9069 | 0.9523 |
| No log        | 0.3030 | 30   | 0.9257          | 0.3637  | 0.9257 | 0.9621 |
| No log        | 0.3232 | 32   | 0.8165          | 0.3388  | 0.8165 | 0.9036 |
| No log        | 0.3434 | 34   | 0.6222          | 0.4287  | 0.6222 | 0.7888 |
| No log        | 0.3636 | 36   | 0.6558          | 0.4753  | 0.6558 | 0.8098 |
| No log        | 0.3838 | 38   | 0.8271          | 0.4929  | 0.8271 | 0.9094 |
| No log        | 0.4040 | 40   | 0.7103          | 0.4946  | 0.7103 | 0.8428 |
| No log        | 0.4242 | 42   | 0.5704          | 0.5378  | 0.5704 | 0.7553 |
| No log        | 0.4444 | 44   | 0.6903          | 0.3934  | 0.6903 | 0.8308 |
| No log        | 0.4646 | 46   | 0.8405          | 0.3595  | 0.8405 | 0.9168 |
| No log        | 0.4848 | 48   | 0.8106          | 0.3798  | 0.8106 | 0.9004 |
| No log        | 0.5051 | 50   | 0.6715          | 0.4954  | 0.6715 | 0.8195 |
| No log        | 0.5253 | 52   | 0.6224          | 0.5983  | 0.6224 | 0.7889 |
| No log        | 0.5455 | 54   | 0.5985          | 0.5916  | 0.5985 | 0.7737 |
| No log        | 0.5657 | 56   | 0.6678          | 0.4897  | 0.6678 | 0.8172 |
| No log        | 0.5859 | 58   | 0.7085          | 0.3478  | 0.7085 | 0.8417 |
| No log        | 0.6061 | 60   | 0.6377          | 0.3655  | 0.6377 | 0.7985 |
| No log        | 0.6263 | 62   | 0.5574          | 0.5211  | 0.5574 | 0.7466 |
| No log        | 0.6465 | 64   | 0.5220          | 0.5762  | 0.5220 | 0.7225 |
| No log        | 0.6667 | 66   | 0.5125          | 0.6235  | 0.5125 | 0.7159 |
| No log        | 0.6869 | 68   | 0.6175          | 0.5939  | 0.6175 | 0.7858 |
| No log        | 0.7071 | 70   | 0.8685          | 0.4753  | 0.8685 | 0.9319 |
| No log        | 0.7273 | 72   | 0.9142          | 0.4615  | 0.9142 | 0.9562 |
| No log        | 0.7475 | 74   | 0.7465          | 0.5525  | 0.7465 | 0.8640 |
| No log        | 0.7677 | 76   | 0.7036          | 0.5645  | 0.7036 | 0.8388 |
| No log        | 0.7879 | 78   | 0.6430          | 0.6032  | 0.6430 | 0.8019 |
| No log        | 0.8081 | 80   | 0.6659          | 0.5375  | 0.6659 | 0.8160 |
| No log        | 0.8283 | 82   | 0.6573          | 0.4816  | 0.6573 | 0.8107 |
| No log        | 0.8485 | 84   | 0.5860          | 0.5350  | 0.5860 | 0.7655 |
| No log        | 0.8687 | 86   | 0.5704          | 0.5408  | 0.5704 | 0.7552 |
| No log        | 0.8889 | 88   | 0.5770          | 0.5211  | 0.5770 | 0.7596 |
| No log        | 0.9091 | 90   | 0.6026          | 0.4672  | 0.6026 | 0.7763 |
| No log        | 0.9293 | 92   | 0.7363          | 0.3651  | 0.7363 | 0.8581 |
| No log        | 0.9495 | 94   | 0.7383          | 0.2972  | 0.7383 | 0.8592 |
| No log        | 0.9697 | 96   | 0.5971          | 0.5644  | 0.5971 | 0.7727 |
| No log        | 0.9899 | 98   | 0.5701          | 0.5462  | 0.5701 | 0.7551 |
| No log        | 1.0101 | 100  | 0.5929          | 0.5615  | 0.5929 | 0.7700 |
| No log        | 1.0303 | 102  | 0.5784          | 0.5788  | 0.5784 | 0.7605 |
| No log        | 1.0505 | 104  | 0.8489          | 0.4259  | 0.8489 | 0.9214 |
| No log        | 1.0707 | 106  | 0.9222          | 0.4096  | 0.9222 | 0.9603 |
| No log        | 1.0909 | 108  | 0.7488          | 0.5165  | 0.7488 | 0.8653 |
| No log        | 1.1111 | 110  | 0.5634          | 0.6133  | 0.5634 | 0.7506 |
| No log        | 1.1313 | 112  | 0.5388          | 0.6289  | 0.5388 | 0.7340 |
| No log        | 1.1515 | 114  | 0.5292          | 0.5817  | 0.5292 | 0.7275 |
| No log        | 1.1717 | 116  | 0.6410          | 0.4290  | 0.6410 | 0.8006 |
| No log        | 1.1919 | 118  | 0.7270          | 0.3362  | 0.7270 | 0.8526 |
| No log        | 1.2121 | 120  | 0.7174          | 0.3499  | 0.7174 | 0.8470 |
| No log        | 1.2323 | 122  | 0.6384          | 0.4166  | 0.6384 | 0.7990 |
| No log        | 1.2525 | 124  | 0.5768          | 0.4900  | 0.5768 | 0.7595 |
| No log        | 1.2727 | 126  | 0.5918          | 0.4689  | 0.5918 | 0.7693 |
| No log        | 1.2929 | 128  | 0.6255          | 0.4107  | 0.6255 | 0.7909 |
| No log        | 1.3131 | 130  | 0.6855          | 0.4140  | 0.6855 | 0.8280 |
| No log        | 1.3333 | 132  | 0.7496          | 0.4062  | 0.7496 | 0.8658 |
| No log        | 1.3535 | 134  | 0.6520          | 0.5457  | 0.6520 | 0.8075 |
| No log        | 1.3737 | 136  | 0.5287          | 0.6302  | 0.5287 | 0.7271 |
| No log        | 1.3939 | 138  | 0.5653          | 0.5930  | 0.5653 | 0.7519 |
| No log        | 1.4141 | 140  | 0.5424          | 0.6368  | 0.5424 | 0.7365 |
| No log        | 1.4343 | 142  | 0.6257          | 0.6163  | 0.6257 | 0.7910 |
| No log        | 1.4545 | 144  | 0.9229          | 0.4740  | 0.9229 | 0.9607 |
| No log        | 1.4747 | 146  | 0.9626          | 0.4129  | 0.9626 | 0.9811 |
| No log        | 1.4949 | 148  | 0.8675          | 0.3682  | 0.8675 | 0.9314 |
| No log        | 1.5152 | 150  | 0.8801          | 0.2882  | 0.8801 | 0.9381 |
| No log        | 1.5354 | 152  | 0.8192          | 0.3050  | 0.8192 | 0.9051 |
| No log        | 1.5556 | 154  | 0.7076          | 0.3616  | 0.7076 | 0.8412 |
| No log        | 1.5758 | 156  | 0.6195          | 0.4366  | 0.6195 | 0.7871 |
| No log        | 1.5960 | 158  | 0.5819          | 0.5847  | 0.5819 | 0.7628 |
| No log        | 1.6162 | 160  | 0.5775          | 0.6515  | 0.5775 | 0.7599 |
| No log        | 1.6364 | 162  | 0.6608          | 0.6197  | 0.6608 | 0.8129 |
| No log        | 1.6566 | 164  | 0.7693          | 0.5788  | 0.7693 | 0.8771 |
| No log        | 1.6768 | 166  | 0.7804          | 0.5864  | 0.7804 | 0.8834 |
| No log        | 1.6970 | 168  | 0.6908          | 0.6237  | 0.6908 | 0.8311 |
| No log        | 1.7172 | 170  | 0.6364          | 0.6200  | 0.6364 | 0.7977 |
| No log        | 1.7374 | 172  | 0.5606          | 0.6180  | 0.5606 | 0.7487 |
| No log        | 1.7576 | 174  | 0.5387          | 0.6213  | 0.5387 | 0.7339 |
| No log        | 1.7778 | 176  | 0.5461          | 0.6376  | 0.5461 | 0.7390 |
| No log        | 1.7980 | 178  | 0.5569          | 0.6289  | 0.5569 | 0.7462 |
| No log        | 1.8182 | 180  | 0.6621          | 0.5448  | 0.6621 | 0.8137 |
| No log        | 1.8384 | 182  | 0.9491          | 0.4308  | 0.9491 | 0.9742 |
| No log        | 1.8586 | 184  | 1.1170          | 0.3868  | 1.1170 | 1.0569 |
| No log        | 1.8788 | 186  | 1.0276          | 0.4114  | 1.0276 | 1.0137 |
| No log        | 1.8990 | 188  | 0.8119          | 0.4457  | 0.8119 | 0.9010 |
| No log        | 1.9192 | 190  | 0.5863          | 0.5680  | 0.5863 | 0.7657 |
| No log        | 1.9394 | 192  | 0.5041          | 0.6458  | 0.5041 | 0.7100 |
| No log        | 1.9596 | 194  | 0.5001          | 0.6036  | 0.5001 | 0.7072 |
| No log        | 1.9798 | 196  | 0.4987          | 0.6188  | 0.4987 | 0.7062 |
| No log        | 2.0    | 198  | 0.6112          | 0.5217  | 0.6112 | 0.7818 |
| No log        | 2.0202 | 200  | 0.8518          | 0.4263  | 0.8518 | 0.9229 |
| No log        | 2.0404 | 202  | 0.9952          | 0.4017  | 0.9952 | 0.9976 |
| No log        | 2.0606 | 204  | 1.0115          | 0.4025  | 1.0115 | 1.0057 |
| No log        | 2.0808 | 206  | 0.8517          | 0.4047  | 0.8517 | 0.9229 |
| No log        | 2.1010 | 208  | 0.6378          | 0.5148  | 0.6378 | 0.7986 |
| No log        | 2.1212 | 210  | 0.5423          | 0.6080  | 0.5423 | 0.7364 |
| No log        | 2.1414 | 212  | 0.5301          | 0.6226  | 0.5301 | 0.7281 |
| No log        | 2.1616 | 214  | 0.5391          | 0.6306  | 0.5391 | 0.7342 |
| No log        | 2.1818 | 216  | 0.5636          | 0.6278  | 0.5636 | 0.7507 |
| No log        | 2.2020 | 218  | 0.6132          | 0.5218  | 0.6132 | 0.7831 |
| No log        | 2.2222 | 220  | 0.6496          | 0.5393  | 0.6496 | 0.8060 |
| No log        | 2.2424 | 222  | 0.6348          | 0.5798  | 0.6348 | 0.7968 |
| No log        | 2.2626 | 224  | 0.6422          | 0.5727  | 0.6422 | 0.8014 |
| No log        | 2.2828 | 226  | 0.5769          | 0.6163  | 0.5769 | 0.7595 |
| No log        | 2.3030 | 228  | 0.5454          | 0.6383  | 0.5454 | 0.7385 |
| No log        | 2.3232 | 230  | 0.5983          | 0.6179  | 0.5983 | 0.7735 |
| No log        | 2.3434 | 232  | 0.6365          | 0.5899  | 0.6365 | 0.7978 |
| No log        | 2.3636 | 234  | 0.7032          | 0.5715  | 0.7032 | 0.8386 |
| No log        | 2.3838 | 236  | 0.6467          | 0.6055  | 0.6467 | 0.8042 |
| No log        | 2.4040 | 238  | 0.6618          | 0.5570  | 0.6618 | 0.8135 |
| No log        | 2.4242 | 240  | 0.7326          | 0.5313  | 0.7326 | 0.8559 |
| No log        | 2.4444 | 242  | 0.7653          | 0.5062  | 0.7653 | 0.8748 |
| No log        | 2.4646 | 244  | 0.7849          | 0.5098  | 0.7849 | 0.8859 |
| No log        | 2.4848 | 246  | 0.8622          | 0.5059  | 0.8622 | 0.9285 |
| No log        | 2.5051 | 248  | 0.6836          | 0.5651  | 0.6836 | 0.8268 |
| No log        | 2.5253 | 250  | 0.5455          | 0.6528  | 0.5455 | 0.7386 |
| No log        | 2.5455 | 252  | 0.5205          | 0.7104  | 0.5205 | 0.7215 |
| No log        | 2.5657 | 254  | 0.5215          | 0.6931  | 0.5215 | 0.7222 |
| No log        | 2.5859 | 256  | 0.6165          | 0.5772  | 0.6165 | 0.7852 |
| No log        | 2.6061 | 258  | 0.5917          | 0.5789  | 0.5917 | 0.7692 |
| No log        | 2.6263 | 260  | 0.5687          | 0.6056  | 0.5687 | 0.7541 |
| No log        | 2.6465 | 262  | 0.5365          | 0.6648  | 0.5365 | 0.7324 |
| No log        | 2.6667 | 264  | 0.5402          | 0.6674  | 0.5402 | 0.7350 |
| No log        | 2.6869 | 266  | 0.5750          | 0.6219  | 0.5750 | 0.7583 |
| No log        | 2.7071 | 268  | 0.5831          | 0.6213  | 0.5831 | 0.7636 |
| No log        | 2.7273 | 270  | 0.5139          | 0.6493  | 0.5139 | 0.7168 |
| No log        | 2.7475 | 272  | 0.5196          | 0.6633  | 0.5196 | 0.7209 |
| No log        | 2.7677 | 274  | 0.5262          | 0.6585  | 0.5262 | 0.7254 |
| No log        | 2.7879 | 276  | 0.5101          | 0.6615  | 0.5101 | 0.7142 |
| No log        | 2.8081 | 278  | 0.5417          | 0.6379  | 0.5417 | 0.7360 |
| No log        | 2.8283 | 280  | 0.6072          | 0.6038  | 0.6072 | 0.7793 |
| No log        | 2.8485 | 282  | 0.7814          | 0.5119  | 0.7814 | 0.8839 |
| No log        | 2.8687 | 284  | 0.8375          | 0.4621  | 0.8375 | 0.9152 |
| No log        | 2.8889 | 286  | 0.7040          | 0.4843  | 0.7040 | 0.8390 |
| No log        | 2.9091 | 288  | 0.5452          | 0.5967  | 0.5452 | 0.7384 |
| No log        | 2.9293 | 290  | 0.5068          | 0.6396  | 0.5068 | 0.7119 |
| No log        | 2.9495 | 292  | 0.5138          | 0.6217  | 0.5138 | 0.7168 |
| No log        | 2.9697 | 294  | 0.4974          | 0.6450  | 0.4974 | 0.7053 |
| No log        | 2.9899 | 296  | 0.5627          | 0.5746  | 0.5627 | 0.7502 |
| No log        | 3.0101 | 298  | 0.7295          | 0.5013  | 0.7295 | 0.8541 |
| No log        | 3.0303 | 300  | 0.8356          | 0.5049  | 0.8356 | 0.9141 |
| No log        | 3.0505 | 302  | 0.7753          | 0.5118  | 0.7753 | 0.8805 |
| No log        | 3.0707 | 304  | 0.6846          | 0.5536  | 0.6846 | 0.8274 |
| No log        | 3.0909 | 306  | 0.5385          | 0.6199  | 0.5385 | 0.7338 |
| No log        | 3.1111 | 308  | 0.5071          | 0.6561  | 0.5071 | 0.7121 |
| No log        | 3.1313 | 310  | 0.5143          | 0.6647  | 0.5143 | 0.7172 |
| No log        | 3.1515 | 312  | 0.5466          | 0.6369  | 0.5466 | 0.7393 |
| No log        | 3.1717 | 314  | 0.7019          | 0.5511  | 0.7019 | 0.8378 |
| No log        | 3.1919 | 316  | 0.7837          | 0.4970  | 0.7837 | 0.8853 |
| No log        | 3.2121 | 318  | 0.7284          | 0.5002  | 0.7284 | 0.8535 |
| No log        | 3.2323 | 320  | 0.6626          | 0.4889  | 0.6626 | 0.8140 |
| No log        | 3.2525 | 322  | 0.6234          | 0.5464  | 0.6234 | 0.7896 |
| No log        | 3.2727 | 324  | 0.5535          | 0.6353  | 0.5535 | 0.7440 |
| No log        | 3.2929 | 326  | 0.5547          | 0.6518  | 0.5547 | 0.7448 |
| No log        | 3.3131 | 328  | 0.5456          | 0.6543  | 0.5456 | 0.7386 |
| No log        | 3.3333 | 330  | 0.5715          | 0.6091  | 0.5715 | 0.7560 |
| No log        | 3.3535 | 332  | 0.7431          | 0.5692  | 0.7431 | 0.8620 |
| No log        | 3.3737 | 334  | 0.8491          | 0.5427  | 0.8491 | 0.9214 |
| No log        | 3.3939 | 336  | 0.7505          | 0.5756  | 0.7505 | 0.8663 |
| No log        | 3.4141 | 338  | 0.6251          | 0.6375  | 0.6251 | 0.7907 |
| No log        | 3.4343 | 340  | 0.6228          | 0.6379  | 0.6228 | 0.7892 |
| No log        | 3.4545 | 342  | 0.7063          | 0.5736  | 0.7063 | 0.8404 |
| No log        | 3.4747 | 344  | 0.7545          | 0.5069  | 0.7545 | 0.8686 |
| No log        | 3.4949 | 346  | 0.6721          | 0.5250  | 0.6721 | 0.8198 |
| No log        | 3.5152 | 348  | 0.5940          | 0.5858  | 0.5940 | 0.7707 |
| No log        | 3.5354 | 350  | 0.5540          | 0.6158  | 0.5540 | 0.7443 |
| No log        | 3.5556 | 352  | 0.4976          | 0.6233  | 0.4976 | 0.7054 |
| No log        | 3.5758 | 354  | 0.4931          | 0.6618  | 0.4931 | 0.7022 |
| No log        | 3.5960 | 356  | 0.5244          | 0.6686  | 0.5244 | 0.7241 |
| No log        | 3.6162 | 358  | 0.6516          | 0.5930  | 0.6516 | 0.8072 |
| No log        | 3.6364 | 360  | 0.7216          | 0.5860  | 0.7216 | 0.8495 |
| No log        | 3.6566 | 362  | 0.7013          | 0.5851  | 0.7013 | 0.8374 |
| No log        | 3.6768 | 364  | 0.6782          | 0.6190  | 0.6782 | 0.8235 |
| No log        | 3.6970 | 366  | 0.5630          | 0.6564  | 0.5630 | 0.7503 |
| No log        | 3.7172 | 368  | 0.5299          | 0.6753  | 0.5299 | 0.7279 |
| No log        | 3.7374 | 370  | 0.5338          | 0.6586  | 0.5338 | 0.7306 |
| No log        | 3.7576 | 372  | 0.5443          | 0.6242  | 0.5443 | 0.7378 |
| No log        | 3.7778 | 374  | 0.5804          | 0.5983  | 0.5804 | 0.7618 |
| No log        | 3.7980 | 376  | 0.6050          | 0.5953  | 0.6050 | 0.7778 |
| No log        | 3.8182 | 378  | 0.5503          | 0.6399  | 0.5503 | 0.7418 |
| No log        | 3.8384 | 380  | 0.4983          | 0.6654  | 0.4983 | 0.7059 |
| No log        | 3.8586 | 382  | 0.4848          | 0.6469  | 0.4848 | 0.6963 |
| No log        | 3.8788 | 384  | 0.5111          | 0.6280  | 0.5111 | 0.7149 |
| No log        | 3.8990 | 386  | 0.5853          | 0.5841  | 0.5853 | 0.7651 |
| No log        | 3.9192 | 388  | 0.6641          | 0.5336  | 0.6641 | 0.8150 |
| No log        | 3.9394 | 390  | 0.6720          | 0.5475  | 0.6720 | 0.8197 |
| No log        | 3.9596 | 392  | 0.5882          | 0.6217  | 0.5882 | 0.7669 |
| No log        | 3.9798 | 394  | 0.5329          | 0.6749  | 0.5329 | 0.7300 |
| No log        | 4.0    | 396  | 0.5446          | 0.6623  | 0.5446 | 0.7380 |
| No log        | 4.0202 | 398  | 0.5276          | 0.6637  | 0.5276 | 0.7264 |
| No log        | 4.0404 | 400  | 0.5509          | 0.6534  | 0.5509 | 0.7422 |
| No log        | 4.0606 | 402  | 0.5937          | 0.6243  | 0.5937 | 0.7705 |
| No log        | 4.0808 | 404  | 0.5930          | 0.6052  | 0.5930 | 0.7700 |
| No log        | 4.1010 | 406  | 0.5499          | 0.6457  | 0.5499 | 0.7416 |
| No log        | 4.1212 | 408  | 0.5322          | 0.6796  | 0.5322 | 0.7295 |
| No log        | 4.1414 | 410  | 0.5445          | 0.6366  | 0.5445 | 0.7379 |
| No log        | 4.1616 | 412  | 0.5389          | 0.6413  | 0.5389 | 0.7341 |
| No log        | 4.1818 | 414  | 0.5292          | 0.6136  | 0.5292 | 0.7275 |
| No log        | 4.2020 | 416  | 0.5515          | 0.6118  | 0.5515 | 0.7427 |
| No log        | 4.2222 | 418  | 0.5571          | 0.6003  | 0.5571 | 0.7464 |
| No log        | 4.2424 | 420  | 0.5783          | 0.6083  | 0.5783 | 0.7605 |
| No log        | 4.2626 | 422  | 0.6579          | 0.5266  | 0.6579 | 0.8111 |
| No log        | 4.2828 | 424  | 0.7728          | 0.4997  | 0.7728 | 0.8791 |
| No log        | 4.3030 | 426  | 0.8254          | 0.5064  | 0.8254 | 0.9085 |
| No log        | 4.3232 | 428  | 0.6786          | 0.5913  | 0.6786 | 0.8238 |
| No log        | 4.3434 | 430  | 0.6127          | 0.6620  | 0.6127 | 0.7828 |
| No log        | 4.3636 | 432  | 0.5379          | 0.6827  | 0.5379 | 0.7334 |
| No log        | 4.3838 | 434  | 0.5790          | 0.6308  | 0.5790 | 0.7609 |
| No log        | 4.4040 | 436  | 0.7856          | 0.5031  | 0.7856 | 0.8863 |
| No log        | 4.4242 | 438  | 1.0101          | 0.4137  | 1.0101 | 1.0050 |
| No log        | 4.4444 | 440  | 0.9490          | 0.4196  | 0.9490 | 0.9742 |
| No log        | 4.4646 | 442  | 0.6945          | 0.5454  | 0.6945 | 0.8333 |
| No log        | 4.4848 | 444  | 0.4930          | 0.6505  | 0.4930 | 0.7022 |
| No log        | 4.5051 | 446  | 0.4982          | 0.6436  | 0.4982 | 0.7058 |
| No log        | 4.5253 | 448  | 0.4962          | 0.6387  | 0.4962 | 0.7044 |
| No log        | 4.5455 | 450  | 0.4992          | 0.6301  | 0.4992 | 0.7066 |
| No log        | 4.5657 | 452  | 0.5726          | 0.6390  | 0.5726 | 0.7567 |
| No log        | 4.5859 | 454  | 0.6681          | 0.6146  | 0.6681 | 0.8174 |
| No log        | 4.6061 | 456  | 0.6627          | 0.5674  | 0.6627 | 0.8141 |
| No log        | 4.6263 | 458  | 0.6111          | 0.6073  | 0.6111 | 0.7817 |
| No log        | 4.6465 | 460  | 0.5460          | 0.6625  | 0.5460 | 0.7389 |
| No log        | 4.6667 | 462  | 0.5326          | 0.6865  | 0.5326 | 0.7298 |
| No log        | 4.6869 | 464  | 0.5196          | 0.6822  | 0.5196 | 0.7208 |
| No log        | 4.7071 | 466  | 0.5701          | 0.6151  | 0.5701 | 0.7550 |
| No log        | 4.7273 | 468  | 0.5705          | 0.6115  | 0.5705 | 0.7553 |
| No log        | 4.7475 | 470  | 0.5705          | 0.5856  | 0.5705 | 0.7553 |
| No log        | 4.7677 | 472  | 0.6239          | 0.5577  | 0.6239 | 0.7898 |
| No log        | 4.7879 | 474  | 0.8004          | 0.5118  | 0.8004 | 0.8946 |
| No log        | 4.8081 | 476  | 0.9206          | 0.4838  | 0.9206 | 0.9595 |
| No log        | 4.8283 | 478  | 0.8521          | 0.5289  | 0.8521 | 0.9231 |
| No log        | 4.8485 | 480  | 0.7690          | 0.6133  | 0.7690 | 0.8769 |
| No log        | 4.8687 | 482  | 0.6569          | 0.6158  | 0.6569 | 0.8105 |
| No log        | 4.8889 | 484  | 0.5814          | 0.6426  | 0.5814 | 0.7625 |
| No log        | 4.9091 | 486  | 0.5785          | 0.6212  | 0.5785 | 0.7606 |
| No log        | 4.9293 | 488  | 0.6568          | 0.5166  | 0.6568 | 0.8104 |
| No log        | 4.9495 | 490  | 0.6658          | 0.5226  | 0.6658 | 0.8159 |
| No log        | 4.9697 | 492  | 0.6055          | 0.5284  | 0.6055 | 0.7782 |
| No log        | 4.9899 | 494  | 0.5939          | 0.5511  | 0.5939 | 0.7706 |
| No log        | 5.0101 | 496  | 0.5528          | 0.5822  | 0.5528 | 0.7435 |
| No log        | 5.0303 | 498  | 0.5732          | 0.5964  | 0.5732 | 0.7571 |
| 0.4876        | 5.0505 | 500  | 0.6873          | 0.6186  | 0.6873 | 0.8290 |
| 0.4876        | 5.0707 | 502  | 0.8884          | 0.6061  | 0.8884 | 0.9426 |
| 0.4876        | 5.0909 | 504  | 0.8593          | 0.6336  | 0.8593 | 0.9270 |
| 0.4876        | 5.1111 | 506  | 0.8956          | 0.6180  | 0.8956 | 0.9464 |
| 0.4876        | 5.1313 | 508  | 0.7881          | 0.6336  | 0.7881 | 0.8877 |
| 0.4876        | 5.1515 | 510  | 0.5734          | 0.6585  | 0.5734 | 0.7572 |
| 0.4876        | 5.1717 | 512  | 0.4950          | 0.6904  | 0.4950 | 0.7036 |
| 0.4876        | 5.1919 | 514  | 0.5015          | 0.6835  | 0.5015 | 0.7081 |
| 0.4876        | 5.2121 | 516  | 0.5933          | 0.6268  | 0.5933 | 0.7703 |
| 0.4876        | 5.2323 | 518  | 0.7506          | 0.5706  | 0.7506 | 0.8663 |
| 0.4876        | 5.2525 | 520  | 0.7081          | 0.6079  | 0.7081 | 0.8415 |
| 0.4876        | 5.2727 | 522  | 0.5472          | 0.6717  | 0.5472 | 0.7397 |
| 0.4876        | 5.2929 | 524  | 0.5032          | 0.6665  | 0.5032 | 0.7094 |
| 0.4876        | 5.3131 | 526  | 0.4883          | 0.6676  | 0.4883 | 0.6988 |
| 0.4876        | 5.3333 | 528  | 0.5352          | 0.6655  | 0.5352 | 0.7316 |
| 0.4876        | 5.3535 | 530  | 0.7012          | 0.5468  | 0.7012 | 0.8374 |
| 0.4876        | 5.3737 | 532  | 0.7671          | 0.5028  | 0.7671 | 0.8758 |
| 0.4876        | 5.3939 | 534  | 0.6626          | 0.5728  | 0.6626 | 0.8140 |
| 0.4876        | 5.4141 | 536  | 0.5954          | 0.6111  | 0.5954 | 0.7716 |
| 0.4876        | 5.4343 | 538  | 0.5575          | 0.6613  | 0.5575 | 0.7467 |
| 0.4876        | 5.4545 | 540  | 0.5687          | 0.6405  | 0.5687 | 0.7541 |
| 0.4876        | 5.4747 | 542  | 0.6631          | 0.6029  | 0.6631 | 0.8143 |
| 0.4876        | 5.4949 | 544  | 0.8537          | 0.5212  | 0.8537 | 0.9240 |
| 0.4876        | 5.5152 | 546  | 0.8623          | 0.5287  | 0.8623 | 0.9286 |
| 0.4876        | 5.5354 | 548  | 0.7179          | 0.5904  | 0.7179 | 0.8473 |
| 0.4876        | 5.5556 | 550  | 0.5310          | 0.6952  | 0.5310 | 0.7287 |
| 0.4876        | 5.5758 | 552  | 0.5100          | 0.6914  | 0.5100 | 0.7142 |
| 0.4876        | 5.5960 | 554  | 0.5379          | 0.6800  | 0.5379 | 0.7334 |
| 0.4876        | 5.6162 | 556  | 0.6673          | 0.5900  | 0.6673 | 0.8169 |
| 0.4876        | 5.6364 | 558  | 0.8003          | 0.5491  | 0.8003 | 0.8946 |
| 0.4876        | 5.6566 | 560  | 0.7417          | 0.5467  | 0.7417 | 0.8612 |
| 0.4876        | 5.6768 | 562  | 0.6314          | 0.5719  | 0.6314 | 0.7946 |
| 0.4876        | 5.6970 | 564  | 0.5691          | 0.5934  | 0.5691 | 0.7544 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1