File size: 22,119 Bytes
055908e
 
 
 
 
 
434579e
055908e
 
 
 
 
 
434579e
055908e
 
 
434579e
 
 
 
055908e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
434579e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
055908e
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask4_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask4_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.8605
- Qwk: 0.6299
- Mse: 0.8605
- Rmse: 0.9276

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0187 | 2    | 4.1512          | 0.0204  | 4.1512 | 2.0374 |
| No log        | 0.0374 | 4    | 2.7415          | 0.1026  | 2.7415 | 1.6557 |
| No log        | 0.0561 | 6    | 1.7383          | 0.1586  | 1.7383 | 1.3184 |
| No log        | 0.0748 | 8    | 1.0072          | 0.2544  | 1.0072 | 1.0036 |
| No log        | 0.0935 | 10   | 1.2004          | 0.1056  | 1.2004 | 1.0956 |
| No log        | 0.1121 | 12   | 1.5846          | -0.1779 | 1.5846 | 1.2588 |
| No log        | 0.1308 | 14   | 1.4274          | -0.0300 | 1.4274 | 1.1947 |
| No log        | 0.1495 | 16   | 1.2516          | 0.0450  | 1.2516 | 1.1187 |
| No log        | 0.1682 | 18   | 1.3111          | 0.1512  | 1.3111 | 1.1451 |
| No log        | 0.1869 | 20   | 1.1973          | 0.1270  | 1.1973 | 1.0942 |
| No log        | 0.2056 | 22   | 0.9866          | 0.1811  | 0.9866 | 0.9933 |
| No log        | 0.2243 | 24   | 0.8823          | 0.3492  | 0.8823 | 0.9393 |
| No log        | 0.2430 | 26   | 1.1442          | 0.3337  | 1.1442 | 1.0697 |
| No log        | 0.2617 | 28   | 1.0645          | 0.3763  | 1.0645 | 1.0317 |
| No log        | 0.2804 | 30   | 0.8436          | 0.3521  | 0.8436 | 0.9185 |
| No log        | 0.2991 | 32   | 0.9211          | 0.2925  | 0.9211 | 0.9597 |
| No log        | 0.3178 | 34   | 1.0492          | 0.2193  | 1.0492 | 1.0243 |
| No log        | 0.3364 | 36   | 1.0401          | 0.1966  | 1.0401 | 1.0198 |
| No log        | 0.3551 | 38   | 0.9345          | 0.2658  | 0.9345 | 0.9667 |
| No log        | 0.3738 | 40   | 0.7994          | 0.3210  | 0.7994 | 0.8941 |
| No log        | 0.3925 | 42   | 0.7436          | 0.4083  | 0.7436 | 0.8623 |
| No log        | 0.4112 | 44   | 0.8024          | 0.4110  | 0.8024 | 0.8957 |
| No log        | 0.4299 | 46   | 0.7496          | 0.4252  | 0.7496 | 0.8658 |
| No log        | 0.4486 | 48   | 0.7613          | 0.3729  | 0.7613 | 0.8725 |
| No log        | 0.4673 | 50   | 0.9850          | 0.2389  | 0.9850 | 0.9925 |
| No log        | 0.4860 | 52   | 1.0449          | 0.1985  | 1.0449 | 1.0222 |
| No log        | 0.5047 | 54   | 0.9138          | 0.2617  | 0.9138 | 0.9559 |
| No log        | 0.5234 | 56   | 0.7373          | 0.3942  | 0.7373 | 0.8587 |
| No log        | 0.5421 | 58   | 0.6902          | 0.4912  | 0.6902 | 0.8308 |
| No log        | 0.5607 | 60   | 0.6784          | 0.5205  | 0.6784 | 0.8237 |
| No log        | 0.5794 | 62   | 0.6504          | 0.5030  | 0.6504 | 0.8065 |
| No log        | 0.5981 | 64   | 0.6835          | 0.4278  | 0.6835 | 0.8267 |
| No log        | 0.6168 | 66   | 0.8242          | 0.4585  | 0.8242 | 0.9079 |
| No log        | 0.6355 | 68   | 0.8274          | 0.4728  | 0.8274 | 0.9096 |
| No log        | 0.6542 | 70   | 0.7348          | 0.5384  | 0.7348 | 0.8572 |
| No log        | 0.6729 | 72   | 0.6150          | 0.6150  | 0.6150 | 0.7842 |
| No log        | 0.6916 | 74   | 0.6306          | 0.6209  | 0.6306 | 0.7941 |
| No log        | 0.7103 | 76   | 0.6165          | 0.6355  | 0.6165 | 0.7852 |
| No log        | 0.7290 | 78   | 0.6091          | 0.6439  | 0.6091 | 0.7804 |
| No log        | 0.7477 | 80   | 0.6370          | 0.5982  | 0.6370 | 0.7981 |
| No log        | 0.7664 | 82   | 0.6908          | 0.4930  | 0.6908 | 0.8311 |
| No log        | 0.7850 | 84   | 0.7874          | 0.5079  | 0.7874 | 0.8874 |
| No log        | 0.8037 | 86   | 0.8471          | 0.4342  | 0.8471 | 0.9204 |
| No log        | 0.8224 | 88   | 0.7772          | 0.4994  | 0.7772 | 0.8816 |
| No log        | 0.8411 | 90   | 0.7175          | 0.4699  | 0.7175 | 0.8471 |
| No log        | 0.8598 | 92   | 0.6817          | 0.4579  | 0.6817 | 0.8257 |
| No log        | 0.8785 | 94   | 0.6611          | 0.4606  | 0.6611 | 0.8131 |
| No log        | 0.8972 | 96   | 0.6536          | 0.4471  | 0.6536 | 0.8084 |
| No log        | 0.9159 | 98   | 0.6371          | 0.4465  | 0.6371 | 0.7982 |
| No log        | 0.9346 | 100  | 0.6251          | 0.4640  | 0.6251 | 0.7907 |
| No log        | 0.9533 | 102  | 0.6222          | 0.4949  | 0.6222 | 0.7888 |
| No log        | 0.9720 | 104  | 0.6430          | 0.5249  | 0.6430 | 0.8019 |
| No log        | 0.9907 | 106  | 0.7397          | 0.5294  | 0.7397 | 0.8601 |
| No log        | 1.0093 | 108  | 0.8386          | 0.4899  | 0.8386 | 0.9157 |
| No log        | 1.0280 | 110  | 0.7692          | 0.5441  | 0.7692 | 0.8771 |
| No log        | 1.0467 | 112  | 0.6749          | 0.5931  | 0.6749 | 0.8215 |
| No log        | 1.0654 | 114  | 0.6820          | 0.6068  | 0.6820 | 0.8258 |
| No log        | 1.0841 | 116  | 0.7510          | 0.5562  | 0.7510 | 0.8666 |
| No log        | 1.1028 | 118  | 0.7368          | 0.5659  | 0.7368 | 0.8584 |
| No log        | 1.1215 | 120  | 0.6435          | 0.5915  | 0.6435 | 0.8022 |
| No log        | 1.1402 | 122  | 0.6140          | 0.6072  | 0.6140 | 0.7836 |
| No log        | 1.1589 | 124  | 0.6646          | 0.5826  | 0.6646 | 0.8152 |
| No log        | 1.1776 | 126  | 0.6892          | 0.5438  | 0.6892 | 0.8302 |
| No log        | 1.1963 | 128  | 0.6873          | 0.4937  | 0.6873 | 0.8290 |
| No log        | 1.2150 | 130  | 0.7477          | 0.4530  | 0.7477 | 0.8647 |
| No log        | 1.2336 | 132  | 0.7320          | 0.4505  | 0.7320 | 0.8556 |
| No log        | 1.2523 | 134  | 0.6654          | 0.5147  | 0.6654 | 0.8157 |
| No log        | 1.2710 | 136  | 0.5774          | 0.5986  | 0.5774 | 0.7599 |
| No log        | 1.2897 | 138  | 0.5777          | 0.6351  | 0.5777 | 0.7601 |
| No log        | 1.3084 | 140  | 0.5718          | 0.6751  | 0.5718 | 0.7562 |
| No log        | 1.3271 | 142  | 0.5408          | 0.6649  | 0.5408 | 0.7354 |
| No log        | 1.3458 | 144  | 0.5579          | 0.6395  | 0.5579 | 0.7469 |
| No log        | 1.3645 | 146  | 0.5984          | 0.6337  | 0.5984 | 0.7736 |
| No log        | 1.3832 | 148  | 0.5985          | 0.6058  | 0.5985 | 0.7737 |
| No log        | 1.4019 | 150  | 0.5921          | 0.5728  | 0.5921 | 0.7695 |
| No log        | 1.4206 | 152  | 0.5832          | 0.6091  | 0.5832 | 0.7637 |
| No log        | 1.4393 | 154  | 0.5952          | 0.5947  | 0.5952 | 0.7715 |
| No log        | 1.4579 | 156  | 0.6563          | 0.5726  | 0.6563 | 0.8101 |
| No log        | 1.4766 | 158  | 0.9074          | 0.5181  | 0.9074 | 0.9526 |
| No log        | 1.4953 | 160  | 1.0554          | 0.4443  | 1.0554 | 1.0274 |
| No log        | 1.5140 | 162  | 0.9148          | 0.5049  | 0.9148 | 0.9565 |
| No log        | 1.5327 | 164  | 0.7863          | 0.5285  | 0.7863 | 0.8868 |
| No log        | 1.5514 | 166  | 0.7000          | 0.5515  | 0.7000 | 0.8366 |
| No log        | 1.5701 | 168  | 0.6121          | 0.5881  | 0.6121 | 0.7824 |
| No log        | 1.5888 | 170  | 0.5812          | 0.6263  | 0.5812 | 0.7624 |
| No log        | 1.6075 | 172  | 0.5953          | 0.6218  | 0.5953 | 0.7715 |
| No log        | 1.6262 | 174  | 0.6050          | 0.6376  | 0.6050 | 0.7778 |
| No log        | 1.6449 | 176  | 0.5710          | 0.6437  | 0.5710 | 0.7556 |
| No log        | 1.6636 | 178  | 0.6117          | 0.5954  | 0.6117 | 0.7821 |
| No log        | 1.6822 | 180  | 0.7070          | 0.5410  | 0.7070 | 0.8408 |
| No log        | 1.7009 | 182  | 0.7082          | 0.5650  | 0.7082 | 0.8415 |
| No log        | 1.7196 | 184  | 0.7070          | 0.5529  | 0.7070 | 0.8408 |
| No log        | 1.7383 | 186  | 0.6388          | 0.6263  | 0.6388 | 0.7992 |
| No log        | 1.7570 | 188  | 0.5777          | 0.6550  | 0.5777 | 0.7601 |
| No log        | 1.7757 | 190  | 0.5813          | 0.6684  | 0.5813 | 0.7624 |
| No log        | 1.7944 | 192  | 0.5962          | 0.6580  | 0.5962 | 0.7722 |
| No log        | 1.8131 | 194  | 0.5893          | 0.6545  | 0.5893 | 0.7676 |
| No log        | 1.8318 | 196  | 0.5882          | 0.6819  | 0.5882 | 0.7670 |
| No log        | 1.8505 | 198  | 0.6728          | 0.6336  | 0.6728 | 0.8202 |
| No log        | 1.8692 | 200  | 0.7996          | 0.5602  | 0.7996 | 0.8942 |
| No log        | 1.8879 | 202  | 0.7845          | 0.5578  | 0.7845 | 0.8857 |
| No log        | 1.9065 | 204  | 0.6816          | 0.6133  | 0.6816 | 0.8256 |
| No log        | 1.9252 | 206  | 0.6615          | 0.5877  | 0.6615 | 0.8133 |
| No log        | 1.9439 | 208  | 0.6647          | 0.5862  | 0.6647 | 0.8153 |
| No log        | 1.9626 | 210  | 0.6940          | 0.5870  | 0.6940 | 0.8331 |
| No log        | 1.9813 | 212  | 0.6683          | 0.6313  | 0.6683 | 0.8175 |
| No log        | 2.0    | 214  | 0.6509          | 0.6078  | 0.6509 | 0.8068 |
| No log        | 2.0187 | 216  | 0.6518          | 0.6058  | 0.6518 | 0.8074 |
| No log        | 2.0374 | 218  | 0.6855          | 0.5747  | 0.6855 | 0.8279 |
| No log        | 2.0561 | 220  | 0.7135          | 0.4728  | 0.7135 | 0.8447 |
| No log        | 2.0748 | 222  | 0.6786          | 0.5292  | 0.6786 | 0.8238 |
| No log        | 2.0935 | 224  | 0.6634          | 0.5416  | 0.6634 | 0.8145 |
| No log        | 2.1121 | 226  | 0.6797          | 0.5429  | 0.6797 | 0.8244 |
| No log        | 2.1308 | 228  | 0.6489          | 0.5825  | 0.6489 | 0.8056 |
| No log        | 2.1495 | 230  | 0.5903          | 0.6384  | 0.5903 | 0.7683 |
| No log        | 2.1682 | 232  | 0.5637          | 0.6620  | 0.5637 | 0.7508 |
| No log        | 2.1869 | 234  | 0.5728          | 0.6534  | 0.5728 | 0.7568 |
| No log        | 2.2056 | 236  | 0.5494          | 0.6737  | 0.5494 | 0.7412 |
| No log        | 2.2243 | 238  | 0.5402          | 0.6748  | 0.5402 | 0.7350 |
| No log        | 2.2430 | 240  | 0.5496          | 0.6682  | 0.5496 | 0.7413 |
| No log        | 2.2617 | 242  | 0.6096          | 0.6528  | 0.6096 | 0.7808 |
| No log        | 2.2804 | 244  | 0.5963          | 0.6451  | 0.5963 | 0.7722 |
| No log        | 2.2991 | 246  | 0.6179          | 0.6440  | 0.6179 | 0.7860 |
| No log        | 2.3178 | 248  | 0.6334          | 0.6498  | 0.6334 | 0.7959 |
| No log        | 2.3364 | 250  | 0.5781          | 0.6595  | 0.5781 | 0.7604 |
| No log        | 2.3551 | 252  | 0.5603          | 0.6678  | 0.5603 | 0.7486 |
| No log        | 2.3738 | 254  | 0.5936          | 0.6826  | 0.5936 | 0.7705 |
| No log        | 2.3925 | 256  | 0.6564          | 0.6490  | 0.6564 | 0.8102 |
| No log        | 2.4112 | 258  | 0.6203          | 0.6759  | 0.6203 | 0.7876 |
| No log        | 2.4299 | 260  | 0.5515          | 0.6702  | 0.5515 | 0.7426 |
| No log        | 2.4486 | 262  | 0.5436          | 0.6593  | 0.5436 | 0.7373 |
| No log        | 2.4673 | 264  | 0.5423          | 0.6548  | 0.5423 | 0.7364 |
| No log        | 2.4860 | 266  | 0.5716          | 0.6675  | 0.5716 | 0.7560 |
| No log        | 2.5047 | 268  | 0.6823          | 0.6530  | 0.6823 | 0.8260 |
| No log        | 2.5234 | 270  | 0.7107          | 0.6519  | 0.7107 | 0.8431 |
| No log        | 2.5421 | 272  | 0.5959          | 0.6558  | 0.5959 | 0.7719 |
| No log        | 2.5607 | 274  | 0.5796          | 0.6698  | 0.5796 | 0.7613 |
| No log        | 2.5794 | 276  | 0.6370          | 0.6523  | 0.6370 | 0.7981 |
| No log        | 2.5981 | 278  | 0.7433          | 0.6025  | 0.7433 | 0.8621 |
| No log        | 2.6168 | 280  | 0.7558          | 0.6108  | 0.7558 | 0.8694 |
| No log        | 2.6355 | 282  | 0.7214          | 0.6108  | 0.7214 | 0.8494 |
| No log        | 2.6542 | 284  | 0.7315          | 0.6048  | 0.7315 | 0.8553 |
| No log        | 2.6729 | 286  | 0.6519          | 0.6052  | 0.6519 | 0.8074 |
| No log        | 2.6916 | 288  | 0.6372          | 0.6161  | 0.6372 | 0.7983 |
| No log        | 2.7103 | 290  | 0.5989          | 0.6203  | 0.5989 | 0.7739 |
| No log        | 2.7290 | 292  | 0.5735          | 0.6688  | 0.5735 | 0.7573 |
| No log        | 2.7477 | 294  | 0.5960          | 0.6358  | 0.5960 | 0.7720 |
| No log        | 2.7664 | 296  | 0.5946          | 0.6724  | 0.5946 | 0.7711 |
| No log        | 2.7850 | 298  | 0.5735          | 0.6691  | 0.5735 | 0.7573 |
| No log        | 2.8037 | 300  | 0.5592          | 0.6552  | 0.5592 | 0.7478 |
| No log        | 2.8224 | 302  | 0.5555          | 0.6607  | 0.5555 | 0.7453 |
| No log        | 2.8411 | 304  | 0.5566          | 0.6782  | 0.5566 | 0.7461 |
| No log        | 2.8598 | 306  | 0.5792          | 0.6756  | 0.5792 | 0.7611 |
| No log        | 2.8785 | 308  | 0.5419          | 0.6908  | 0.5419 | 0.7362 |
| No log        | 2.8972 | 310  | 0.5292          | 0.6782  | 0.5292 | 0.7275 |
| No log        | 2.9159 | 312  | 0.5270          | 0.6780  | 0.5270 | 0.7259 |
| No log        | 2.9346 | 314  | 0.5312          | 0.6754  | 0.5312 | 0.7289 |
| No log        | 2.9533 | 316  | 0.5304          | 0.6739  | 0.5304 | 0.7283 |
| No log        | 2.9720 | 318  | 0.5550          | 0.6516  | 0.5550 | 0.7450 |
| No log        | 2.9907 | 320  | 0.5491          | 0.6771  | 0.5491 | 0.7410 |
| No log        | 3.0093 | 322  | 0.5870          | 0.6973  | 0.5870 | 0.7661 |
| No log        | 3.0280 | 324  | 0.7666          | 0.6591  | 0.7666 | 0.8756 |
| No log        | 3.0467 | 326  | 0.8554          | 0.6114  | 0.8554 | 0.9249 |
| No log        | 3.0654 | 328  | 0.7249          | 0.6787  | 0.7249 | 0.8514 |
| No log        | 3.0841 | 330  | 0.6079          | 0.6918  | 0.6079 | 0.7797 |
| No log        | 3.1028 | 332  | 0.5624          | 0.7101  | 0.5624 | 0.7500 |
| No log        | 3.1215 | 334  | 0.5671          | 0.7236  | 0.5671 | 0.7530 |
| No log        | 3.1402 | 336  | 0.5648          | 0.7048  | 0.5648 | 0.7516 |
| No log        | 3.1589 | 338  | 0.6356          | 0.6726  | 0.6356 | 0.7972 |
| No log        | 3.1776 | 340  | 0.6706          | 0.6708  | 0.6706 | 0.8189 |
| No log        | 3.1963 | 342  | 0.5656          | 0.6760  | 0.5656 | 0.7520 |
| No log        | 3.2150 | 344  | 0.5417          | 0.6890  | 0.5417 | 0.7360 |
| No log        | 3.2336 | 346  | 0.5333          | 0.6845  | 0.5333 | 0.7302 |
| No log        | 3.2523 | 348  | 0.5260          | 0.6806  | 0.5260 | 0.7253 |
| No log        | 3.2710 | 350  | 0.5301          | 0.6929  | 0.5301 | 0.7281 |
| No log        | 3.2897 | 352  | 0.5189          | 0.6823  | 0.5189 | 0.7204 |
| No log        | 3.3084 | 354  | 0.5236          | 0.6759  | 0.5236 | 0.7236 |
| No log        | 3.3271 | 356  | 0.5187          | 0.7040  | 0.5187 | 0.7202 |
| No log        | 3.3458 | 358  | 0.5426          | 0.6881  | 0.5426 | 0.7366 |
| No log        | 3.3645 | 360  | 0.5326          | 0.7044  | 0.5326 | 0.7298 |
| No log        | 3.3832 | 362  | 0.5378          | 0.6882  | 0.5378 | 0.7334 |
| No log        | 3.4019 | 364  | 0.6033          | 0.6687  | 0.6033 | 0.7767 |
| No log        | 3.4206 | 366  | 0.6317          | 0.6429  | 0.6317 | 0.7948 |
| No log        | 3.4393 | 368  | 0.7011          | 0.6028  | 0.7011 | 0.8373 |
| No log        | 3.4579 | 370  | 0.7362          | 0.5822  | 0.7362 | 0.8580 |
| No log        | 3.4766 | 372  | 0.6642          | 0.6238  | 0.6642 | 0.8150 |
| No log        | 3.4953 | 374  | 0.5618          | 0.6708  | 0.5618 | 0.7495 |
| No log        | 3.5140 | 376  | 0.5598          | 0.6805  | 0.5598 | 0.7482 |
| No log        | 3.5327 | 378  | 0.6239          | 0.6613  | 0.6239 | 0.7899 |
| No log        | 3.5514 | 380  | 0.6843          | 0.6230  | 0.6843 | 0.8272 |
| No log        | 3.5701 | 382  | 0.6110          | 0.6382  | 0.6110 | 0.7817 |
| No log        | 3.5888 | 384  | 0.5550          | 0.6741  | 0.5550 | 0.7450 |
| No log        | 3.6075 | 386  | 0.5483          | 0.6713  | 0.5483 | 0.7405 |
| No log        | 3.6262 | 388  | 0.5898          | 0.6342  | 0.5898 | 0.7680 |
| No log        | 3.6449 | 390  | 0.7250          | 0.5979  | 0.7250 | 0.8514 |
| No log        | 3.6636 | 392  | 0.7286          | 0.6138  | 0.7286 | 0.8536 |
| No log        | 3.6822 | 394  | 0.6173          | 0.6593  | 0.6173 | 0.7857 |
| No log        | 3.7009 | 396  | 0.5660          | 0.6565  | 0.5660 | 0.7523 |
| No log        | 3.7196 | 398  | 0.5415          | 0.6697  | 0.5415 | 0.7359 |
| No log        | 3.7383 | 400  | 0.5400          | 0.6625  | 0.5400 | 0.7348 |
| No log        | 3.7570 | 402  | 0.6175          | 0.6685  | 0.6175 | 0.7858 |
| No log        | 3.7757 | 404  | 0.6847          | 0.6376  | 0.6847 | 0.8275 |
| No log        | 3.7944 | 406  | 0.6731          | 0.6374  | 0.6731 | 0.8204 |
| No log        | 3.8131 | 408  | 0.6506          | 0.6466  | 0.6506 | 0.8066 |
| No log        | 3.8318 | 410  | 0.5749          | 0.6617  | 0.5749 | 0.7582 |
| No log        | 3.8505 | 412  | 0.5310          | 0.6818  | 0.5310 | 0.7287 |
| No log        | 3.8692 | 414  | 0.5405          | 0.6732  | 0.5405 | 0.7352 |
| No log        | 3.8879 | 416  | 0.5963          | 0.6710  | 0.5963 | 0.7722 |
| No log        | 3.9065 | 418  | 0.6389          | 0.6558  | 0.6389 | 0.7993 |
| No log        | 3.9252 | 420  | 0.5552          | 0.6788  | 0.5552 | 0.7451 |
| No log        | 3.9439 | 422  | 0.5279          | 0.6853  | 0.5279 | 0.7266 |
| No log        | 3.9626 | 424  | 0.5866          | 0.6651  | 0.5866 | 0.7659 |
| No log        | 3.9813 | 426  | 0.6537          | 0.6389  | 0.6537 | 0.8085 |
| No log        | 4.0    | 428  | 0.6126          | 0.6489  | 0.6126 | 0.7827 |
| No log        | 4.0187 | 430  | 0.5334          | 0.7000  | 0.5334 | 0.7303 |
| No log        | 4.0374 | 432  | 0.6202          | 0.6410  | 0.6202 | 0.7875 |
| No log        | 4.0561 | 434  | 0.8063          | 0.6155  | 0.8063 | 0.8979 |
| No log        | 4.0748 | 436  | 0.8806          | 0.5920  | 0.8806 | 0.9384 |
| No log        | 4.0935 | 438  | 0.7559          | 0.6236  | 0.7559 | 0.8695 |
| No log        | 4.1121 | 440  | 0.6550          | 0.6586  | 0.6550 | 0.8093 |
| No log        | 4.1308 | 442  | 0.6897          | 0.6693  | 0.6897 | 0.8305 |
| No log        | 4.1495 | 444  | 0.6787          | 0.6682  | 0.6787 | 0.8238 |
| No log        | 4.1682 | 446  | 0.6326          | 0.6971  | 0.6326 | 0.7954 |
| No log        | 4.1869 | 448  | 0.6310          | 0.6866  | 0.6310 | 0.7944 |
| No log        | 4.2056 | 450  | 0.6551          | 0.6812  | 0.6551 | 0.8094 |
| No log        | 4.2243 | 452  | 0.6345          | 0.6661  | 0.6345 | 0.7965 |
| No log        | 4.2430 | 454  | 0.6768          | 0.6372  | 0.6768 | 0.8227 |
| No log        | 4.2617 | 456  | 0.6700          | 0.6233  | 0.6700 | 0.8185 |
| No log        | 4.2804 | 458  | 0.6310          | 0.6494  | 0.6310 | 0.7944 |
| No log        | 4.2991 | 460  | 0.5936          | 0.6593  | 0.5936 | 0.7705 |
| No log        | 4.3178 | 462  | 0.6004          | 0.6686  | 0.6004 | 0.7748 |
| No log        | 4.3364 | 464  | 0.6189          | 0.6683  | 0.6189 | 0.7867 |
| No log        | 4.3551 | 466  | 0.6444          | 0.6800  | 0.6444 | 0.8027 |
| No log        | 4.3738 | 468  | 0.6662          | 0.6700  | 0.6662 | 0.8162 |
| No log        | 4.3925 | 470  | 0.6395          | 0.6770  | 0.6395 | 0.7997 |
| No log        | 4.4112 | 472  | 0.7194          | 0.6909  | 0.7194 | 0.8482 |
| No log        | 4.4299 | 474  | 0.9093          | 0.6407  | 0.9093 | 0.9536 |
| No log        | 4.4486 | 476  | 0.9676          | 0.6270  | 0.9676 | 0.9837 |
| No log        | 4.4673 | 478  | 0.8043          | 0.6763  | 0.8043 | 0.8968 |
| No log        | 4.4860 | 480  | 0.6564          | 0.6648  | 0.6564 | 0.8102 |
| No log        | 4.5047 | 482  | 0.6184          | 0.6809  | 0.6184 | 0.7864 |
| No log        | 4.5234 | 484  | 0.5990          | 0.6315  | 0.5990 | 0.7740 |
| No log        | 4.5421 | 486  | 0.5745          | 0.6519  | 0.5745 | 0.7579 |
| No log        | 4.5607 | 488  | 0.6115          | 0.6688  | 0.6115 | 0.7820 |
| No log        | 4.5794 | 490  | 0.6926          | 0.6472  | 0.6926 | 0.8322 |
| No log        | 4.5981 | 492  | 0.6485          | 0.6695  | 0.6485 | 0.8053 |
| No log        | 4.6168 | 494  | 0.5874          | 0.7138  | 0.5874 | 0.7664 |
| No log        | 4.6355 | 496  | 0.5765          | 0.7000  | 0.5765 | 0.7593 |
| No log        | 4.6542 | 498  | 0.5817          | 0.6808  | 0.5817 | 0.7627 |
| 0.5458        | 4.6729 | 500  | 0.6435          | 0.6837  | 0.6435 | 0.8022 |
| 0.5458        | 4.6916 | 502  | 0.7844          | 0.6395  | 0.7844 | 0.8856 |
| 0.5458        | 4.7103 | 504  | 0.7559          | 0.6373  | 0.7559 | 0.8694 |
| 0.5458        | 4.7290 | 506  | 0.6251          | 0.7013  | 0.6251 | 0.7906 |
| 0.5458        | 4.7477 | 508  | 0.5980          | 0.6673  | 0.5980 | 0.7733 |
| 0.5458        | 4.7664 | 510  | 0.6180          | 0.6700  | 0.6180 | 0.7861 |
| 0.5458        | 4.7850 | 512  | 0.5997          | 0.6611  | 0.5997 | 0.7744 |
| 0.5458        | 4.8037 | 514  | 0.6298          | 0.6834  | 0.6298 | 0.7936 |
| 0.5458        | 4.8224 | 516  | 0.8605          | 0.6299  | 0.8605 | 0.9276 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1