File size: 24,938 Bytes
8c8238f
 
 
 
 
 
086ae01
8c8238f
 
 
 
 
 
086ae01
8c8238f
 
 
086ae01
 
 
 
8c8238f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
086ae01
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8c8238f
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask1_development
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask1_development

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.4088
- Qwk: 0.5376
- Mse: 0.4088
- Rmse: 0.6394

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk    | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:|
| No log        | 0.0213 | 2    | 3.9661          | 0.0006 | 3.9661 | 1.9915 |
| No log        | 0.0426 | 4    | 2.8142          | 0.0570 | 2.8142 | 1.6775 |
| No log        | 0.0638 | 6    | 1.3758          | 0.0502 | 1.3758 | 1.1729 |
| No log        | 0.0851 | 8    | 0.8573          | 0.0440 | 0.8573 | 0.9259 |
| No log        | 0.1064 | 10   | 0.7581          | 0.0668 | 0.7581 | 0.8707 |
| No log        | 0.1277 | 12   | 0.7360          | 0.0830 | 0.7360 | 0.8579 |
| No log        | 0.1489 | 14   | 0.6776          | 0.0832 | 0.6776 | 0.8232 |
| No log        | 0.1702 | 16   | 0.6691          | 0.3161 | 0.6691 | 0.8180 |
| No log        | 0.1915 | 18   | 0.6032          | 0.3937 | 0.6032 | 0.7767 |
| No log        | 0.2128 | 20   | 0.5791          | 0.3812 | 0.5791 | 0.7610 |
| No log        | 0.2340 | 22   | 0.6016          | 0.3765 | 0.6016 | 0.7757 |
| No log        | 0.2553 | 24   | 0.6617          | 0.3275 | 0.6617 | 0.8135 |
| No log        | 0.2766 | 26   | 0.6540          | 0.3498 | 0.6540 | 0.8087 |
| No log        | 0.2979 | 28   | 0.5786          | 0.3889 | 0.5786 | 0.7607 |
| No log        | 0.3191 | 30   | 0.5534          | 0.3950 | 0.5534 | 0.7439 |
| No log        | 0.3404 | 32   | 0.6693          | 0.2150 | 0.6693 | 0.8181 |
| No log        | 0.3617 | 34   | 0.6927          | 0.2867 | 0.6927 | 0.8323 |
| No log        | 0.3830 | 36   | 0.5389          | 0.4632 | 0.5389 | 0.7341 |
| No log        | 0.4043 | 38   | 0.5280          | 0.4822 | 0.5280 | 0.7266 |
| No log        | 0.4255 | 40   | 0.5358          | 0.4835 | 0.5358 | 0.7320 |
| No log        | 0.4468 | 42   | 0.4939          | 0.4966 | 0.4939 | 0.7028 |
| No log        | 0.4681 | 44   | 0.4797          | 0.5075 | 0.4797 | 0.6926 |
| No log        | 0.4894 | 46   | 0.4909          | 0.4695 | 0.4909 | 0.7006 |
| No log        | 0.5106 | 48   | 0.4905          | 0.4695 | 0.4905 | 0.7004 |
| No log        | 0.5319 | 50   | 0.4793          | 0.5410 | 0.4793 | 0.6923 |
| No log        | 0.5532 | 52   | 0.5706          | 0.5437 | 0.5706 | 0.7554 |
| No log        | 0.5745 | 54   | 0.5039          | 0.5471 | 0.5039 | 0.7098 |
| No log        | 0.5957 | 56   | 0.4814          | 0.4922 | 0.4814 | 0.6938 |
| No log        | 0.6170 | 58   | 0.4793          | 0.4941 | 0.4793 | 0.6923 |
| No log        | 0.6383 | 60   | 0.4930          | 0.4755 | 0.4930 | 0.7021 |
| No log        | 0.6596 | 62   | 0.5077          | 0.4415 | 0.5077 | 0.7125 |
| No log        | 0.6809 | 64   | 0.5329          | 0.4281 | 0.5329 | 0.7300 |
| No log        | 0.7021 | 66   | 0.4572          | 0.5173 | 0.4572 | 0.6762 |
| No log        | 0.7234 | 68   | 0.4331          | 0.5397 | 0.4331 | 0.6581 |
| No log        | 0.7447 | 70   | 0.4294          | 0.5499 | 0.4294 | 0.6553 |
| No log        | 0.7660 | 72   | 0.4208          | 0.5787 | 0.4208 | 0.6487 |
| No log        | 0.7872 | 74   | 0.4638          | 0.5604 | 0.4638 | 0.6810 |
| No log        | 0.8085 | 76   | 0.4346          | 0.5684 | 0.4346 | 0.6592 |
| No log        | 0.8298 | 78   | 0.4511          | 0.5609 | 0.4511 | 0.6716 |
| No log        | 0.8511 | 80   | 0.4506          | 0.6079 | 0.4506 | 0.6713 |
| No log        | 0.8723 | 82   | 0.4315          | 0.5578 | 0.4315 | 0.6569 |
| No log        | 0.8936 | 84   | 0.4510          | 0.5739 | 0.4510 | 0.6716 |
| No log        | 0.9149 | 86   | 0.6624          | 0.3852 | 0.6624 | 0.8139 |
| No log        | 0.9362 | 88   | 0.7905          | 0.1659 | 0.7905 | 0.8891 |
| No log        | 0.9574 | 90   | 0.7080          | 0.2767 | 0.7080 | 0.8414 |
| No log        | 0.9787 | 92   | 0.5450          | 0.4255 | 0.5450 | 0.7382 |
| No log        | 1.0    | 94   | 0.4271          | 0.5839 | 0.4271 | 0.6535 |
| No log        | 1.0213 | 96   | 0.4668          | 0.6117 | 0.4668 | 0.6833 |
| No log        | 1.0426 | 98   | 0.4931          | 0.6038 | 0.4931 | 0.7022 |
| No log        | 1.0638 | 100  | 0.4532          | 0.6076 | 0.4532 | 0.6732 |
| No log        | 1.0851 | 102  | 0.4919          | 0.6031 | 0.4919 | 0.7013 |
| No log        | 1.1064 | 104  | 0.5006          | 0.5543 | 0.5006 | 0.7075 |
| No log        | 1.1277 | 106  | 0.4613          | 0.5426 | 0.4613 | 0.6792 |
| No log        | 1.1489 | 108  | 0.4891          | 0.5035 | 0.4891 | 0.6993 |
| No log        | 1.1702 | 110  | 0.5031          | 0.4745 | 0.5031 | 0.7093 |
| No log        | 1.1915 | 112  | 0.4780          | 0.4819 | 0.4780 | 0.6914 |
| No log        | 1.2128 | 114  | 0.4851          | 0.4873 | 0.4851 | 0.6965 |
| No log        | 1.2340 | 116  | 0.4726          | 0.5470 | 0.4726 | 0.6875 |
| No log        | 1.2553 | 118  | 0.4432          | 0.5399 | 0.4432 | 0.6657 |
| No log        | 1.2766 | 120  | 0.4471          | 0.5840 | 0.4471 | 0.6687 |
| No log        | 1.2979 | 122  | 0.4497          | 0.5659 | 0.4497 | 0.6706 |
| No log        | 1.3191 | 124  | 0.5107          | 0.5062 | 0.5107 | 0.7146 |
| No log        | 1.3404 | 126  | 0.4501          | 0.5327 | 0.4501 | 0.6709 |
| No log        | 1.3617 | 128  | 0.4368          | 0.5911 | 0.4368 | 0.6609 |
| No log        | 1.3830 | 130  | 0.4683          | 0.5990 | 0.4683 | 0.6844 |
| No log        | 1.4043 | 132  | 0.6832          | 0.5579 | 0.6832 | 0.8266 |
| No log        | 1.4255 | 134  | 0.7875          | 0.4894 | 0.7875 | 0.8874 |
| No log        | 1.4468 | 136  | 0.6340          | 0.5699 | 0.6340 | 0.7962 |
| No log        | 1.4681 | 138  | 0.5137          | 0.5868 | 0.5137 | 0.7167 |
| No log        | 1.4894 | 140  | 0.4678          | 0.5620 | 0.4678 | 0.6840 |
| No log        | 1.5106 | 142  | 0.4385          | 0.5585 | 0.4385 | 0.6622 |
| No log        | 1.5319 | 144  | 0.4237          | 0.6041 | 0.4237 | 0.6509 |
| No log        | 1.5532 | 146  | 0.4305          | 0.5749 | 0.4305 | 0.6562 |
| No log        | 1.5745 | 148  | 0.5813          | 0.5527 | 0.5813 | 0.7624 |
| No log        | 1.5957 | 150  | 0.6819          | 0.4978 | 0.6819 | 0.8258 |
| No log        | 1.6170 | 152  | 0.7632          | 0.5356 | 0.7632 | 0.8736 |
| No log        | 1.6383 | 154  | 0.6873          | 0.5606 | 0.6873 | 0.8290 |
| No log        | 1.6596 | 156  | 0.5527          | 0.6069 | 0.5527 | 0.7434 |
| No log        | 1.6809 | 158  | 0.4914          | 0.6235 | 0.4914 | 0.7010 |
| No log        | 1.7021 | 160  | 0.4513          | 0.5698 | 0.4513 | 0.6718 |
| No log        | 1.7234 | 162  | 0.4922          | 0.5259 | 0.4922 | 0.7016 |
| No log        | 1.7447 | 164  | 0.5357          | 0.4956 | 0.5357 | 0.7319 |
| No log        | 1.7660 | 166  | 0.6366          | 0.4833 | 0.6366 | 0.7979 |
| No log        | 1.7872 | 168  | 0.6920          | 0.4236 | 0.6920 | 0.8319 |
| No log        | 1.8085 | 170  | 0.5774          | 0.4567 | 0.5774 | 0.7599 |
| No log        | 1.8298 | 172  | 0.4541          | 0.4634 | 0.4541 | 0.6739 |
| No log        | 1.8511 | 174  | 0.4664          | 0.4809 | 0.4664 | 0.6829 |
| No log        | 1.8723 | 176  | 0.4637          | 0.5181 | 0.4637 | 0.6810 |
| No log        | 1.8936 | 178  | 0.4448          | 0.5077 | 0.4448 | 0.6669 |
| No log        | 1.9149 | 180  | 0.4541          | 0.4803 | 0.4541 | 0.6739 |
| No log        | 1.9362 | 182  | 0.4787          | 0.4465 | 0.4787 | 0.6919 |
| No log        | 1.9574 | 184  | 0.4791          | 0.4509 | 0.4791 | 0.6922 |
| No log        | 1.9787 | 186  | 0.4859          | 0.4643 | 0.4859 | 0.6970 |
| No log        | 2.0    | 188  | 0.4916          | 0.4921 | 0.4916 | 0.7011 |
| No log        | 2.0213 | 190  | 0.5040          | 0.5278 | 0.5040 | 0.7099 |
| No log        | 2.0426 | 192  | 0.4947          | 0.5283 | 0.4947 | 0.7034 |
| No log        | 2.0638 | 194  | 0.4736          | 0.5391 | 0.4736 | 0.6882 |
| No log        | 2.0851 | 196  | 0.4618          | 0.4665 | 0.4618 | 0.6796 |
| No log        | 2.1064 | 198  | 0.4611          | 0.4778 | 0.4611 | 0.6790 |
| No log        | 2.1277 | 200  | 0.4483          | 0.5074 | 0.4483 | 0.6696 |
| No log        | 2.1489 | 202  | 0.4489          | 0.5480 | 0.4489 | 0.6700 |
| No log        | 2.1702 | 204  | 0.4656          | 0.5593 | 0.4656 | 0.6823 |
| No log        | 2.1915 | 206  | 0.4482          | 0.5474 | 0.4482 | 0.6695 |
| No log        | 2.2128 | 208  | 0.4487          | 0.5227 | 0.4487 | 0.6699 |
| No log        | 2.2340 | 210  | 0.5469          | 0.4400 | 0.5469 | 0.7395 |
| No log        | 2.2553 | 212  | 0.7247          | 0.3853 | 0.7247 | 0.8513 |
| No log        | 2.2766 | 214  | 0.6856          | 0.3684 | 0.6856 | 0.8280 |
| No log        | 2.2979 | 216  | 0.5270          | 0.3905 | 0.5270 | 0.7259 |
| No log        | 2.3191 | 218  | 0.4537          | 0.4889 | 0.4537 | 0.6736 |
| No log        | 2.3404 | 220  | 0.4555          | 0.5166 | 0.4555 | 0.6749 |
| No log        | 2.3617 | 222  | 0.4364          | 0.5333 | 0.4364 | 0.6606 |
| No log        | 2.3830 | 224  | 0.4357          | 0.5555 | 0.4357 | 0.6600 |
| No log        | 2.4043 | 226  | 0.5339          | 0.5511 | 0.5339 | 0.7307 |
| No log        | 2.4255 | 228  | 0.6457          | 0.5215 | 0.6457 | 0.8036 |
| No log        | 2.4468 | 230  | 0.6696          | 0.5236 | 0.6696 | 0.8183 |
| No log        | 2.4681 | 232  | 0.6229          | 0.5307 | 0.6229 | 0.7892 |
| No log        | 2.4894 | 234  | 0.5367          | 0.5788 | 0.5367 | 0.7326 |
| No log        | 2.5106 | 236  | 0.5040          | 0.5810 | 0.5040 | 0.7099 |
| No log        | 2.5319 | 238  | 0.4577          | 0.5682 | 0.4577 | 0.6765 |
| No log        | 2.5532 | 240  | 0.4783          | 0.5195 | 0.4783 | 0.6916 |
| No log        | 2.5745 | 242  | 0.4666          | 0.4917 | 0.4666 | 0.6831 |
| No log        | 2.5957 | 244  | 0.4885          | 0.4597 | 0.4885 | 0.6989 |
| No log        | 2.6170 | 246  | 0.4939          | 0.4501 | 0.4939 | 0.7028 |
| No log        | 2.6383 | 248  | 0.4492          | 0.5435 | 0.4492 | 0.6703 |
| No log        | 2.6596 | 250  | 0.4392          | 0.5359 | 0.4392 | 0.6628 |
| No log        | 2.6809 | 252  | 0.5860          | 0.5539 | 0.5860 | 0.7655 |
| No log        | 2.7021 | 254  | 0.5884          | 0.5417 | 0.5884 | 0.7671 |
| No log        | 2.7234 | 256  | 0.4743          | 0.5152 | 0.4743 | 0.6887 |
| No log        | 2.7447 | 258  | 0.4565          | 0.5130 | 0.4565 | 0.6756 |
| No log        | 2.7660 | 260  | 0.5037          | 0.3659 | 0.5037 | 0.7097 |
| No log        | 2.7872 | 262  | 0.5783          | 0.2961 | 0.5783 | 0.7605 |
| No log        | 2.8085 | 264  | 0.5960          | 0.3071 | 0.5960 | 0.7720 |
| No log        | 2.8298 | 266  | 0.5651          | 0.3744 | 0.5651 | 0.7517 |
| No log        | 2.8511 | 268  | 0.4834          | 0.5467 | 0.4834 | 0.6952 |
| No log        | 2.8723 | 270  | 0.4120          | 0.6208 | 0.4120 | 0.6418 |
| No log        | 2.8936 | 272  | 0.4382          | 0.6142 | 0.4382 | 0.6620 |
| No log        | 2.9149 | 274  | 0.4525          | 0.6080 | 0.4525 | 0.6727 |
| No log        | 2.9362 | 276  | 0.4681          | 0.6217 | 0.4681 | 0.6841 |
| No log        | 2.9574 | 278  | 0.5913          | 0.5677 | 0.5913 | 0.7689 |
| No log        | 2.9787 | 280  | 0.6915          | 0.4377 | 0.6915 | 0.8316 |
| No log        | 3.0    | 282  | 0.8460          | 0.3413 | 0.8460 | 0.9198 |
| No log        | 3.0213 | 284  | 0.8891          | 0.2589 | 0.8891 | 0.9429 |
| No log        | 3.0426 | 286  | 0.7502          | 0.3368 | 0.7502 | 0.8662 |
| No log        | 3.0638 | 288  | 0.5640          | 0.4077 | 0.5640 | 0.7510 |
| No log        | 3.0851 | 290  | 0.6634          | 0.3049 | 0.6634 | 0.8145 |
| No log        | 3.1064 | 292  | 0.6560          | 0.3207 | 0.6560 | 0.8099 |
| No log        | 3.1277 | 294  | 0.5246          | 0.5175 | 0.5246 | 0.7243 |
| No log        | 3.1489 | 296  | 0.4454          | 0.5169 | 0.4454 | 0.6674 |
| No log        | 3.1702 | 298  | 0.4860          | 0.4285 | 0.4860 | 0.6971 |
| No log        | 3.1915 | 300  | 0.5543          | 0.5088 | 0.5543 | 0.7445 |
| No log        | 3.2128 | 302  | 0.5703          | 0.5592 | 0.5703 | 0.7552 |
| No log        | 3.2340 | 304  | 0.6814          | 0.5316 | 0.6814 | 0.8255 |
| No log        | 3.2553 | 306  | 0.5497          | 0.5704 | 0.5497 | 0.7414 |
| No log        | 3.2766 | 308  | 0.4852          | 0.5788 | 0.4852 | 0.6966 |
| No log        | 3.2979 | 310  | 0.4808          | 0.5853 | 0.4808 | 0.6934 |
| No log        | 3.3191 | 312  | 0.4876          | 0.6232 | 0.4876 | 0.6983 |
| No log        | 3.3404 | 314  | 0.4442          | 0.5722 | 0.4442 | 0.6665 |
| No log        | 3.3617 | 316  | 0.4602          | 0.5201 | 0.4602 | 0.6784 |
| No log        | 3.3830 | 318  | 0.5018          | 0.4900 | 0.5018 | 0.7084 |
| No log        | 3.4043 | 320  | 0.4665          | 0.5059 | 0.4665 | 0.6830 |
| No log        | 3.4255 | 322  | 0.4330          | 0.5721 | 0.4330 | 0.6580 |
| No log        | 3.4468 | 324  | 0.4265          | 0.5661 | 0.4265 | 0.6531 |
| No log        | 3.4681 | 326  | 0.4309          | 0.5708 | 0.4309 | 0.6565 |
| No log        | 3.4894 | 328  | 0.4452          | 0.5651 | 0.4452 | 0.6672 |
| No log        | 3.5106 | 330  | 0.4438          | 0.5648 | 0.4438 | 0.6662 |
| No log        | 3.5319 | 332  | 0.4198          | 0.5478 | 0.4198 | 0.6479 |
| No log        | 3.5532 | 334  | 0.4053          | 0.5411 | 0.4053 | 0.6366 |
| No log        | 3.5745 | 336  | 0.4120          | 0.5259 | 0.4120 | 0.6419 |
| No log        | 3.5957 | 338  | 0.4094          | 0.5385 | 0.4094 | 0.6398 |
| No log        | 3.6170 | 340  | 0.4232          | 0.5686 | 0.4232 | 0.6505 |
| No log        | 3.6383 | 342  | 0.4051          | 0.5656 | 0.4051 | 0.6365 |
| No log        | 3.6596 | 344  | 0.4120          | 0.5688 | 0.4120 | 0.6419 |
| No log        | 3.6809 | 346  | 0.4502          | 0.5418 | 0.4502 | 0.6710 |
| No log        | 3.7021 | 348  | 0.4652          | 0.5069 | 0.4652 | 0.6820 |
| No log        | 3.7234 | 350  | 0.4670          | 0.5426 | 0.4670 | 0.6834 |
| No log        | 3.7447 | 352  | 0.5051          | 0.5283 | 0.5051 | 0.7107 |
| No log        | 3.7660 | 354  | 0.4791          | 0.5605 | 0.4791 | 0.6921 |
| No log        | 3.7872 | 356  | 0.4123          | 0.5928 | 0.4123 | 0.6421 |
| No log        | 3.8085 | 358  | 0.3877          | 0.5926 | 0.3877 | 0.6226 |
| No log        | 3.8298 | 360  | 0.3934          | 0.5989 | 0.3934 | 0.6273 |
| No log        | 3.8511 | 362  | 0.3935          | 0.5523 | 0.3935 | 0.6273 |
| No log        | 3.8723 | 364  | 0.4069          | 0.5750 | 0.4069 | 0.6379 |
| No log        | 3.8936 | 366  | 0.4524          | 0.5934 | 0.4524 | 0.6726 |
| No log        | 3.9149 | 368  | 0.5945          | 0.5394 | 0.5945 | 0.7711 |
| No log        | 3.9362 | 370  | 0.6755          | 0.5534 | 0.6755 | 0.8219 |
| No log        | 3.9574 | 372  | 0.6053          | 0.5956 | 0.6053 | 0.7780 |
| No log        | 3.9787 | 374  | 0.4928          | 0.6326 | 0.4928 | 0.7020 |
| No log        | 4.0    | 376  | 0.4880          | 0.6508 | 0.4880 | 0.6986 |
| No log        | 4.0213 | 378  | 0.4584          | 0.6462 | 0.4584 | 0.6771 |
| No log        | 4.0426 | 380  | 0.4568          | 0.6149 | 0.4568 | 0.6758 |
| No log        | 4.0638 | 382  | 0.4601          | 0.5931 | 0.4601 | 0.6783 |
| No log        | 4.0851 | 384  | 0.4218          | 0.5833 | 0.4218 | 0.6495 |
| No log        | 4.1064 | 386  | 0.4170          | 0.5574 | 0.4170 | 0.6458 |
| No log        | 4.1277 | 388  | 0.4103          | 0.5575 | 0.4103 | 0.6406 |
| No log        | 4.1489 | 390  | 0.4059          | 0.5597 | 0.4059 | 0.6371 |
| No log        | 4.1702 | 392  | 0.4462          | 0.5944 | 0.4462 | 0.6680 |
| No log        | 4.1915 | 394  | 0.4308          | 0.6010 | 0.4308 | 0.6563 |
| No log        | 4.2128 | 396  | 0.4690          | 0.5524 | 0.4690 | 0.6848 |
| No log        | 4.2340 | 398  | 0.4814          | 0.5282 | 0.4814 | 0.6938 |
| No log        | 4.2553 | 400  | 0.5534          | 0.5092 | 0.5534 | 0.7439 |
| No log        | 4.2766 | 402  | 0.6290          | 0.5354 | 0.6290 | 0.7931 |
| No log        | 4.2979 | 404  | 0.6553          | 0.5475 | 0.6553 | 0.8095 |
| No log        | 4.3191 | 406  | 0.5146          | 0.6036 | 0.5146 | 0.7174 |
| No log        | 4.3404 | 408  | 0.5226          | 0.6054 | 0.5226 | 0.7229 |
| No log        | 4.3617 | 410  | 0.6431          | 0.5968 | 0.6431 | 0.8020 |
| No log        | 4.3830 | 412  | 0.6137          | 0.5980 | 0.6137 | 0.7834 |
| No log        | 4.4043 | 414  | 0.6730          | 0.5499 | 0.6730 | 0.8204 |
| No log        | 4.4255 | 416  | 0.5656          | 0.5738 | 0.5656 | 0.7521 |
| No log        | 4.4468 | 418  | 0.4316          | 0.6334 | 0.4316 | 0.6570 |
| No log        | 4.4681 | 420  | 0.4480          | 0.5767 | 0.4480 | 0.6693 |
| No log        | 4.4894 | 422  | 0.4281          | 0.5523 | 0.4281 | 0.6543 |
| No log        | 4.5106 | 424  | 0.4249          | 0.5525 | 0.4249 | 0.6518 |
| No log        | 4.5319 | 426  | 0.4029          | 0.5712 | 0.4029 | 0.6348 |
| No log        | 4.5532 | 428  | 0.4092          | 0.6486 | 0.4092 | 0.6397 |
| No log        | 4.5745 | 430  | 0.4363          | 0.6061 | 0.4363 | 0.6606 |
| No log        | 4.5957 | 432  | 0.4401          | 0.5857 | 0.4401 | 0.6634 |
| No log        | 4.6170 | 434  | 0.4174          | 0.6027 | 0.4174 | 0.6460 |
| No log        | 4.6383 | 436  | 0.4183          | 0.5956 | 0.4183 | 0.6467 |
| No log        | 4.6596 | 438  | 0.3976          | 0.6053 | 0.3976 | 0.6305 |
| No log        | 4.6809 | 440  | 0.4289          | 0.6319 | 0.4289 | 0.6549 |
| No log        | 4.7021 | 442  | 0.5079          | 0.6080 | 0.5079 | 0.7126 |
| No log        | 4.7234 | 444  | 0.5477          | 0.5795 | 0.5477 | 0.7401 |
| No log        | 4.7447 | 446  | 0.5512          | 0.5918 | 0.5512 | 0.7424 |
| No log        | 4.7660 | 448  | 0.5499          | 0.6019 | 0.5499 | 0.7415 |
| No log        | 4.7872 | 450  | 0.4962          | 0.5989 | 0.4962 | 0.7044 |
| No log        | 4.8085 | 452  | 0.4837          | 0.6148 | 0.4837 | 0.6955 |
| No log        | 4.8298 | 454  | 0.4119          | 0.6346 | 0.4119 | 0.6418 |
| No log        | 4.8511 | 456  | 0.4047          | 0.5990 | 0.4047 | 0.6362 |
| No log        | 4.8723 | 458  | 0.4108          | 0.5605 | 0.4108 | 0.6409 |
| No log        | 4.8936 | 460  | 0.4426          | 0.4997 | 0.4426 | 0.6653 |
| No log        | 4.9149 | 462  | 0.5077          | 0.4524 | 0.5077 | 0.7125 |
| No log        | 4.9362 | 464  | 0.4933          | 0.5046 | 0.4933 | 0.7024 |
| No log        | 4.9574 | 466  | 0.4723          | 0.5452 | 0.4723 | 0.6872 |
| No log        | 4.9787 | 468  | 0.4308          | 0.5926 | 0.4308 | 0.6564 |
| No log        | 5.0    | 470  | 0.4272          | 0.5785 | 0.4272 | 0.6536 |
| No log        | 5.0213 | 472  | 0.4132          | 0.5911 | 0.4132 | 0.6428 |
| No log        | 5.0426 | 474  | 0.4730          | 0.6206 | 0.4730 | 0.6877 |
| No log        | 5.0638 | 476  | 0.5411          | 0.5917 | 0.5411 | 0.7356 |
| No log        | 5.0851 | 478  | 0.4614          | 0.6025 | 0.4614 | 0.6792 |
| No log        | 5.1064 | 480  | 0.4207          | 0.5840 | 0.4207 | 0.6486 |
| No log        | 5.1277 | 482  | 0.4282          | 0.5737 | 0.4282 | 0.6544 |
| No log        | 5.1489 | 484  | 0.5156          | 0.5876 | 0.5156 | 0.7181 |
| No log        | 5.1702 | 486  | 0.5548          | 0.5716 | 0.5548 | 0.7448 |
| No log        | 5.1915 | 488  | 0.4640          | 0.6395 | 0.4640 | 0.6812 |
| No log        | 5.2128 | 490  | 0.4520          | 0.6008 | 0.4520 | 0.6723 |
| No log        | 5.2340 | 492  | 0.4696          | 0.6422 | 0.4696 | 0.6852 |
| No log        | 5.2553 | 494  | 0.5115          | 0.6101 | 0.5115 | 0.7152 |
| No log        | 5.2766 | 496  | 0.5953          | 0.5710 | 0.5953 | 0.7716 |
| No log        | 5.2979 | 498  | 0.5338          | 0.6147 | 0.5338 | 0.7306 |
| 0.4408        | 5.3191 | 500  | 0.4227          | 0.5767 | 0.4227 | 0.6502 |
| 0.4408        | 5.3404 | 502  | 0.4154          | 0.5858 | 0.4154 | 0.6445 |
| 0.4408        | 5.3617 | 504  | 0.4910          | 0.6080 | 0.4910 | 0.7007 |
| 0.4408        | 5.3830 | 506  | 0.6428          | 0.5427 | 0.6428 | 0.8017 |
| 0.4408        | 5.4043 | 508  | 0.5662          | 0.5934 | 0.5662 | 0.7525 |
| 0.4408        | 5.4255 | 510  | 0.4544          | 0.6087 | 0.4544 | 0.6741 |
| 0.4408        | 5.4468 | 512  | 0.4561          | 0.5974 | 0.4561 | 0.6753 |
| 0.4408        | 5.4681 | 514  | 0.5265          | 0.5743 | 0.5265 | 0.7256 |
| 0.4408        | 5.4894 | 516  | 0.6612          | 0.5555 | 0.6612 | 0.8131 |
| 0.4408        | 5.5106 | 518  | 0.5593          | 0.6011 | 0.5593 | 0.7479 |
| 0.4408        | 5.5319 | 520  | 0.4783          | 0.6292 | 0.4783 | 0.6916 |
| 0.4408        | 5.5532 | 522  | 0.4702          | 0.5976 | 0.4702 | 0.6857 |
| 0.4408        | 5.5745 | 524  | 0.4426          | 0.6160 | 0.4426 | 0.6653 |
| 0.4408        | 5.5957 | 526  | 0.4581          | 0.6378 | 0.4581 | 0.6769 |
| 0.4408        | 5.6170 | 528  | 0.5307          | 0.5955 | 0.5307 | 0.7285 |
| 0.4408        | 5.6383 | 530  | 0.5133          | 0.6090 | 0.5133 | 0.7164 |
| 0.4408        | 5.6596 | 532  | 0.4372          | 0.6279 | 0.4372 | 0.6612 |
| 0.4408        | 5.6809 | 534  | 0.4346          | 0.6228 | 0.4346 | 0.6592 |
| 0.4408        | 5.7021 | 536  | 0.4987          | 0.5880 | 0.4987 | 0.7062 |
| 0.4408        | 5.7234 | 538  | 0.6290          | 0.5233 | 0.6290 | 0.7931 |
| 0.4408        | 5.7447 | 540  | 0.5660          | 0.5294 | 0.5660 | 0.7523 |
| 0.4408        | 5.7660 | 542  | 0.4648          | 0.6267 | 0.4648 | 0.6818 |
| 0.4408        | 5.7872 | 544  | 0.4184          | 0.6184 | 0.4184 | 0.6468 |
| 0.4408        | 5.8085 | 546  | 0.4122          | 0.6284 | 0.4122 | 0.6420 |
| 0.4408        | 5.8298 | 548  | 0.4384          | 0.6273 | 0.4384 | 0.6621 |
| 0.4408        | 5.8511 | 550  | 0.5868          | 0.5337 | 0.5868 | 0.7660 |
| 0.4408        | 5.8723 | 552  | 0.7145          | 0.5199 | 0.7145 | 0.8453 |
| 0.4408        | 5.8936 | 554  | 0.5561          | 0.5821 | 0.5561 | 0.7457 |
| 0.4408        | 5.9149 | 556  | 0.4488          | 0.6387 | 0.4488 | 0.6700 |
| 0.4408        | 5.9362 | 558  | 0.4575          | 0.6300 | 0.4575 | 0.6764 |
| 0.4408        | 5.9574 | 560  | 0.5166          | 0.6150 | 0.5166 | 0.7188 |
| 0.4408        | 5.9787 | 562  | 0.7070          | 0.5283 | 0.7070 | 0.8408 |
| 0.4408        | 6.0    | 564  | 0.6845          | 0.5256 | 0.6845 | 0.8273 |
| 0.4408        | 6.0213 | 566  | 0.4975          | 0.5945 | 0.4975 | 0.7054 |
| 0.4408        | 6.0426 | 568  | 0.4445          | 0.5716 | 0.4445 | 0.6667 |
| 0.4408        | 6.0638 | 570  | 0.4293          | 0.5760 | 0.4293 | 0.6552 |
| 0.4408        | 6.0851 | 572  | 0.4427          | 0.6201 | 0.4427 | 0.6653 |
| 0.4408        | 6.1064 | 574  | 0.5550          | 0.5536 | 0.5550 | 0.7450 |
| 0.4408        | 6.1277 | 576  | 0.5314          | 0.5714 | 0.5314 | 0.7290 |
| 0.4408        | 6.1489 | 578  | 0.4474          | 0.5914 | 0.4474 | 0.6689 |
| 0.4408        | 6.1702 | 580  | 0.4070          | 0.6072 | 0.4070 | 0.6380 |
| 0.4408        | 6.1915 | 582  | 0.4053          | 0.5952 | 0.4053 | 0.6366 |
| 0.4408        | 6.2128 | 584  | 0.4212          | 0.6040 | 0.4212 | 0.6490 |
| 0.4408        | 6.2340 | 586  | 0.5671          | 0.5313 | 0.5671 | 0.7531 |
| 0.4408        | 6.2553 | 588  | 0.6355          | 0.4988 | 0.6355 | 0.7972 |
| 0.4408        | 6.2766 | 590  | 0.5195          | 0.5689 | 0.5195 | 0.7208 |
| 0.4408        | 6.2979 | 592  | 0.4083          | 0.5654 | 0.4083 | 0.6390 |
| 0.4408        | 6.3191 | 594  | 0.4088          | 0.5376 | 0.4088 | 0.6394 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1