File size: 21,865 Bytes
39ce835
 
 
 
 
 
5bd8cf5
39ce835
 
 
 
 
 
5bd8cf5
39ce835
 
 
5bd8cf5
 
 
 
39ce835
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5bd8cf5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39ce835
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask5_style
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask5_style

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5705
- Qwk: 0.5583
- Mse: 0.5705
- Rmse: 0.7553

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0198 | 2    | 4.2244          | -0.0026 | 4.2244 | 2.0553 |
| No log        | 0.0396 | 4    | 2.9368          | 0.0459  | 2.9368 | 1.7137 |
| No log        | 0.0594 | 6    | 1.4729          | 0.0059  | 1.4729 | 1.2136 |
| No log        | 0.0792 | 8    | 0.9333          | 0.0915  | 0.9333 | 0.9661 |
| No log        | 0.0990 | 10   | 0.7506          | 0.1245  | 0.7506 | 0.8664 |
| No log        | 0.1188 | 12   | 0.8095          | 0.0565  | 0.8095 | 0.8997 |
| No log        | 0.1386 | 14   | 0.8107          | 0.1593  | 0.8107 | 0.9004 |
| No log        | 0.1584 | 16   | 0.6680          | 0.2785  | 0.6680 | 0.8173 |
| No log        | 0.1782 | 18   | 0.6275          | 0.4380  | 0.6275 | 0.7921 |
| No log        | 0.1980 | 20   | 0.5977          | 0.4277  | 0.5977 | 0.7731 |
| No log        | 0.2178 | 22   | 0.6109          | 0.2878  | 0.6109 | 0.7816 |
| No log        | 0.2376 | 24   | 0.6240          | 0.2878  | 0.6240 | 0.7899 |
| No log        | 0.2574 | 26   | 0.6054          | 0.3293  | 0.6054 | 0.7781 |
| No log        | 0.2772 | 28   | 0.6090          | 0.3054  | 0.6090 | 0.7804 |
| No log        | 0.2970 | 30   | 0.5789          | 0.3121  | 0.5789 | 0.7609 |
| No log        | 0.3168 | 32   | 0.5348          | 0.3778  | 0.5348 | 0.7313 |
| No log        | 0.3366 | 34   | 0.5215          | 0.4081  | 0.5215 | 0.7221 |
| No log        | 0.3564 | 36   | 0.5402          | 0.5202  | 0.5402 | 0.7350 |
| No log        | 0.3762 | 38   | 0.5040          | 0.5071  | 0.5040 | 0.7099 |
| No log        | 0.3960 | 40   | 0.5986          | 0.4767  | 0.5986 | 0.7737 |
| No log        | 0.4158 | 42   | 0.6328          | 0.5036  | 0.6328 | 0.7955 |
| No log        | 0.4356 | 44   | 0.5686          | 0.5416  | 0.5686 | 0.7541 |
| No log        | 0.4554 | 46   | 0.5498          | 0.5556  | 0.5498 | 0.7415 |
| No log        | 0.4752 | 48   | 0.5875          | 0.5042  | 0.5875 | 0.7665 |
| No log        | 0.4950 | 50   | 0.5480          | 0.5329  | 0.5480 | 0.7403 |
| No log        | 0.5149 | 52   | 0.4840          | 0.5353  | 0.4840 | 0.6957 |
| No log        | 0.5347 | 54   | 0.4987          | 0.4858  | 0.4987 | 0.7062 |
| No log        | 0.5545 | 56   | 0.6363          | 0.3960  | 0.6363 | 0.7977 |
| No log        | 0.5743 | 58   | 0.7962          | 0.2936  | 0.7962 | 0.8923 |
| No log        | 0.5941 | 60   | 0.7815          | 0.3127  | 0.7815 | 0.8840 |
| No log        | 0.6139 | 62   | 0.6122          | 0.4381  | 0.6122 | 0.7824 |
| No log        | 0.6337 | 64   | 0.5006          | 0.5804  | 0.5006 | 0.7075 |
| No log        | 0.6535 | 66   | 0.5267          | 0.5835  | 0.5267 | 0.7257 |
| No log        | 0.6733 | 68   | 0.5583          | 0.5872  | 0.5583 | 0.7472 |
| No log        | 0.6931 | 70   | 0.5859          | 0.5920  | 0.5859 | 0.7654 |
| No log        | 0.7129 | 72   | 0.5630          | 0.5823  | 0.5630 | 0.7504 |
| No log        | 0.7327 | 74   | 0.5126          | 0.5583  | 0.5126 | 0.7160 |
| No log        | 0.7525 | 76   | 0.4844          | 0.5410  | 0.4844 | 0.6960 |
| No log        | 0.7723 | 78   | 0.5018          | 0.4492  | 0.5018 | 0.7084 |
| No log        | 0.7921 | 80   | 0.4826          | 0.4389  | 0.4826 | 0.6947 |
| No log        | 0.8119 | 82   | 0.4657          | 0.4876  | 0.4657 | 0.6824 |
| No log        | 0.8317 | 84   | 0.4753          | 0.4577  | 0.4753 | 0.6894 |
| No log        | 0.8515 | 86   | 0.5439          | 0.4682  | 0.5439 | 0.7375 |
| No log        | 0.8713 | 88   | 0.5935          | 0.4771  | 0.5935 | 0.7704 |
| No log        | 0.8911 | 90   | 0.6344          | 0.4879  | 0.6344 | 0.7965 |
| No log        | 0.9109 | 92   | 0.5282          | 0.5254  | 0.5282 | 0.7268 |
| No log        | 0.9307 | 94   | 0.4862          | 0.5611  | 0.4862 | 0.6973 |
| No log        | 0.9505 | 96   | 0.5130          | 0.5587  | 0.5130 | 0.7162 |
| No log        | 0.9703 | 98   | 0.5009          | 0.5721  | 0.5009 | 0.7077 |
| No log        | 0.9901 | 100  | 0.5292          | 0.5001  | 0.5292 | 0.7275 |
| No log        | 1.0099 | 102  | 0.5799          | 0.4425  | 0.5799 | 0.7615 |
| No log        | 1.0297 | 104  | 0.5400          | 0.3915  | 0.5400 | 0.7348 |
| No log        | 1.0495 | 106  | 0.5131          | 0.3848  | 0.5131 | 0.7163 |
| No log        | 1.0693 | 108  | 0.4775          | 0.4408  | 0.4775 | 0.6910 |
| No log        | 1.0891 | 110  | 0.4805          | 0.5073  | 0.4805 | 0.6932 |
| No log        | 1.1089 | 112  | 0.5244          | 0.5543  | 0.5244 | 0.7241 |
| No log        | 1.1287 | 114  | 0.4984          | 0.6325  | 0.4984 | 0.7060 |
| No log        | 1.1485 | 116  | 0.4746          | 0.6643  | 0.4746 | 0.6889 |
| No log        | 1.1683 | 118  | 0.4739          | 0.6568  | 0.4739 | 0.6884 |
| No log        | 1.1881 | 120  | 0.4621          | 0.6654  | 0.4621 | 0.6798 |
| No log        | 1.2079 | 122  | 0.5582          | 0.5043  | 0.5582 | 0.7471 |
| No log        | 1.2277 | 124  | 0.5868          | 0.4742  | 0.5868 | 0.7660 |
| No log        | 1.2475 | 126  | 0.4825          | 0.6040  | 0.4825 | 0.6947 |
| No log        | 1.2673 | 128  | 0.4912          | 0.5704  | 0.4912 | 0.7009 |
| No log        | 1.2871 | 130  | 0.4693          | 0.5978  | 0.4693 | 0.6851 |
| No log        | 1.3069 | 132  | 0.4417          | 0.6209  | 0.4417 | 0.6646 |
| No log        | 1.3267 | 134  | 0.5091          | 0.6026  | 0.5091 | 0.7135 |
| No log        | 1.3465 | 136  | 0.5345          | 0.5780  | 0.5345 | 0.7311 |
| No log        | 1.3663 | 138  | 0.5366          | 0.5788  | 0.5366 | 0.7325 |
| No log        | 1.3861 | 140  | 0.4922          | 0.5521  | 0.4922 | 0.7016 |
| No log        | 1.4059 | 142  | 0.4786          | 0.5066  | 0.4786 | 0.6918 |
| No log        | 1.4257 | 144  | 0.4795          | 0.5264  | 0.4795 | 0.6925 |
| No log        | 1.4455 | 146  | 0.4910          | 0.5283  | 0.4910 | 0.7007 |
| No log        | 1.4653 | 148  | 0.4802          | 0.4932  | 0.4802 | 0.6929 |
| No log        | 1.4851 | 150  | 0.5041          | 0.4905  | 0.5041 | 0.7100 |
| No log        | 1.5050 | 152  | 0.5059          | 0.4792  | 0.5059 | 0.7113 |
| No log        | 1.5248 | 154  | 0.5087          | 0.4735  | 0.5087 | 0.7132 |
| No log        | 1.5446 | 156  | 0.5191          | 0.4691  | 0.5191 | 0.7205 |
| No log        | 1.5644 | 158  | 0.5784          | 0.3956  | 0.5784 | 0.7605 |
| No log        | 1.5842 | 160  | 0.6929          | 0.3844  | 0.6929 | 0.8324 |
| No log        | 1.6040 | 162  | 0.7163          | 0.3803  | 0.7163 | 0.8463 |
| No log        | 1.6238 | 164  | 0.6149          | 0.4583  | 0.6149 | 0.7842 |
| No log        | 1.6436 | 166  | 0.5160          | 0.4680  | 0.5160 | 0.7183 |
| No log        | 1.6634 | 168  | 0.5861          | 0.4382  | 0.5861 | 0.7655 |
| No log        | 1.6832 | 170  | 0.6335          | 0.4023  | 0.6335 | 0.7959 |
| No log        | 1.7030 | 172  | 0.5613          | 0.4589  | 0.5613 | 0.7492 |
| No log        | 1.7228 | 174  | 0.5384          | 0.3854  | 0.5384 | 0.7337 |
| No log        | 1.7426 | 176  | 0.6251          | 0.3381  | 0.6251 | 0.7906 |
| No log        | 1.7624 | 178  | 0.6171          | 0.5126  | 0.6171 | 0.7856 |
| No log        | 1.7822 | 180  | 0.5821          | 0.5240  | 0.5821 | 0.7630 |
| No log        | 1.8020 | 182  | 0.6732          | 0.4901  | 0.6732 | 0.8205 |
| No log        | 1.8218 | 184  | 0.6049          | 0.5314  | 0.6049 | 0.7778 |
| No log        | 1.8416 | 186  | 0.6856          | 0.5023  | 0.6856 | 0.8280 |
| No log        | 1.8614 | 188  | 0.8999          | 0.3778  | 0.8999 | 0.9486 |
| No log        | 1.8812 | 190  | 0.9941          | 0.3219  | 0.9941 | 0.9971 |
| No log        | 1.9010 | 192  | 0.6968          | 0.3741  | 0.6968 | 0.8347 |
| No log        | 1.9208 | 194  | 0.6158          | 0.4469  | 0.6158 | 0.7847 |
| No log        | 1.9406 | 196  | 0.5927          | 0.4743  | 0.5927 | 0.7699 |
| No log        | 1.9604 | 198  | 0.6464          | 0.4450  | 0.6464 | 0.8040 |
| No log        | 1.9802 | 200  | 0.6228          | 0.5225  | 0.6228 | 0.7892 |
| No log        | 2.0    | 202  | 0.8286          | 0.3868  | 0.8286 | 0.9103 |
| No log        | 2.0198 | 204  | 0.9116          | 0.3823  | 0.9116 | 0.9548 |
| No log        | 2.0396 | 206  | 0.7794          | 0.4052  | 0.7794 | 0.8829 |
| No log        | 2.0594 | 208  | 0.6396          | 0.4583  | 0.6396 | 0.7997 |
| No log        | 2.0792 | 210  | 0.5545          | 0.4652  | 0.5545 | 0.7446 |
| No log        | 2.0990 | 212  | 0.5259          | 0.4448  | 0.5259 | 0.7252 |
| No log        | 2.1188 | 214  | 0.5111          | 0.4614  | 0.5111 | 0.7149 |
| No log        | 2.1386 | 216  | 0.5247          | 0.5058  | 0.5247 | 0.7244 |
| No log        | 2.1584 | 218  | 0.5363          | 0.5172  | 0.5363 | 0.7323 |
| No log        | 2.1782 | 220  | 0.4865          | 0.6010  | 0.4865 | 0.6975 |
| No log        | 2.1980 | 222  | 0.4856          | 0.6324  | 0.4856 | 0.6968 |
| No log        | 2.2178 | 224  | 0.5049          | 0.6151  | 0.5049 | 0.7105 |
| No log        | 2.2376 | 226  | 0.5938          | 0.5132  | 0.5938 | 0.7706 |
| No log        | 2.2574 | 228  | 0.5976          | 0.5038  | 0.5976 | 0.7730 |
| No log        | 2.2772 | 230  | 0.5546          | 0.5312  | 0.5546 | 0.7447 |
| No log        | 2.2970 | 232  | 0.5116          | 0.5490  | 0.5116 | 0.7152 |
| No log        | 2.3168 | 234  | 0.5047          | 0.5554  | 0.5047 | 0.7104 |
| No log        | 2.3366 | 236  | 0.5361          | 0.5485  | 0.5361 | 0.7322 |
| No log        | 2.3564 | 238  | 0.5266          | 0.5847  | 0.5266 | 0.7257 |
| No log        | 2.3762 | 240  | 0.4938          | 0.6217  | 0.4938 | 0.7027 |
| No log        | 2.3960 | 242  | 0.4678          | 0.6413  | 0.4678 | 0.6840 |
| No log        | 2.4158 | 244  | 0.5058          | 0.6257  | 0.5058 | 0.7112 |
| No log        | 2.4356 | 246  | 0.5023          | 0.5828  | 0.5023 | 0.7087 |
| No log        | 2.4554 | 248  | 0.4760          | 0.5557  | 0.4760 | 0.6900 |
| No log        | 2.4752 | 250  | 0.4806          | 0.5581  | 0.4806 | 0.6933 |
| No log        | 2.4950 | 252  | 0.4520          | 0.6126  | 0.4520 | 0.6723 |
| No log        | 2.5149 | 254  | 0.4557          | 0.6299  | 0.4557 | 0.6751 |
| No log        | 2.5347 | 256  | 0.4683          | 0.6370  | 0.4683 | 0.6843 |
| No log        | 2.5545 | 258  | 0.4980          | 0.6231  | 0.4980 | 0.7057 |
| No log        | 2.5743 | 260  | 0.5635          | 0.5634  | 0.5635 | 0.7506 |
| No log        | 2.5941 | 262  | 0.5636          | 0.5343  | 0.5636 | 0.7508 |
| No log        | 2.6139 | 264  | 0.4922          | 0.6077  | 0.4922 | 0.7016 |
| No log        | 2.6337 | 266  | 0.4837          | 0.6435  | 0.4837 | 0.6955 |
| No log        | 2.6535 | 268  | 0.4789          | 0.6600  | 0.4789 | 0.6920 |
| No log        | 2.6733 | 270  | 0.6097          | 0.5274  | 0.6097 | 0.7809 |
| No log        | 2.6931 | 272  | 0.6209          | 0.5392  | 0.6209 | 0.7880 |
| No log        | 2.7129 | 274  | 0.5749          | 0.5761  | 0.5749 | 0.7582 |
| No log        | 2.7327 | 276  | 0.4992          | 0.6308  | 0.4992 | 0.7066 |
| No log        | 2.7525 | 278  | 0.5315          | 0.6130  | 0.5315 | 0.7290 |
| No log        | 2.7723 | 280  | 0.5640          | 0.5739  | 0.5640 | 0.7510 |
| No log        | 2.7921 | 282  | 0.5246          | 0.5947  | 0.5246 | 0.7243 |
| No log        | 2.8119 | 284  | 0.5049          | 0.5805  | 0.5049 | 0.7106 |
| No log        | 2.8317 | 286  | 0.4752          | 0.5799  | 0.4752 | 0.6894 |
| No log        | 2.8515 | 288  | 0.4647          | 0.5786  | 0.4647 | 0.6817 |
| No log        | 2.8713 | 290  | 0.5799          | 0.5335  | 0.5799 | 0.7615 |
| No log        | 2.8911 | 292  | 0.8815          | 0.3798  | 0.8815 | 0.9389 |
| No log        | 2.9109 | 294  | 1.0348          | 0.3279  | 1.0348 | 1.0173 |
| No log        | 2.9307 | 296  | 0.9051          | 0.4074  | 0.9051 | 0.9513 |
| No log        | 2.9505 | 298  | 0.6188          | 0.5424  | 0.6188 | 0.7866 |
| No log        | 2.9703 | 300  | 0.4537          | 0.6378  | 0.4537 | 0.6736 |
| No log        | 2.9901 | 302  | 0.4639          | 0.6367  | 0.4639 | 0.6811 |
| No log        | 3.0099 | 304  | 0.4401          | 0.6350  | 0.4401 | 0.6634 |
| No log        | 3.0297 | 306  | 0.4437          | 0.6157  | 0.4437 | 0.6661 |
| No log        | 3.0495 | 308  | 0.5255          | 0.5816  | 0.5255 | 0.7249 |
| No log        | 3.0693 | 310  | 0.5476          | 0.5529  | 0.5476 | 0.7400 |
| No log        | 3.0891 | 312  | 0.4888          | 0.5911  | 0.4888 | 0.6991 |
| No log        | 3.1089 | 314  | 0.4276          | 0.5676  | 0.4276 | 0.6539 |
| No log        | 3.1287 | 316  | 0.4254          | 0.5537  | 0.4254 | 0.6522 |
| No log        | 3.1485 | 318  | 0.4480          | 0.5905  | 0.4480 | 0.6693 |
| No log        | 3.1683 | 320  | 0.4203          | 0.5676  | 0.4203 | 0.6483 |
| No log        | 3.1881 | 322  | 0.4765          | 0.5951  | 0.4765 | 0.6903 |
| No log        | 3.2079 | 324  | 0.5687          | 0.5883  | 0.5687 | 0.7542 |
| No log        | 3.2277 | 326  | 0.5646          | 0.5941  | 0.5646 | 0.7514 |
| No log        | 3.2475 | 328  | 0.4980          | 0.6197  | 0.4980 | 0.7057 |
| No log        | 3.2673 | 330  | 0.4097          | 0.6162  | 0.4097 | 0.6400 |
| No log        | 3.2871 | 332  | 0.3896          | 0.6591  | 0.3896 | 0.6242 |
| No log        | 3.3069 | 334  | 0.3990          | 0.6572  | 0.3990 | 0.6317 |
| No log        | 3.3267 | 336  | 0.4585          | 0.6602  | 0.4585 | 0.6771 |
| No log        | 3.3465 | 338  | 0.5288          | 0.6287  | 0.5288 | 0.7272 |
| No log        | 3.3663 | 340  | 0.5540          | 0.5843  | 0.5540 | 0.7443 |
| No log        | 3.3861 | 342  | 0.5735          | 0.5736  | 0.5735 | 0.7573 |
| No log        | 3.4059 | 344  | 0.5225          | 0.5768  | 0.5225 | 0.7229 |
| No log        | 3.4257 | 346  | 0.4938          | 0.5908  | 0.4938 | 0.7027 |
| No log        | 3.4455 | 348  | 0.5935          | 0.5408  | 0.5935 | 0.7704 |
| No log        | 3.4653 | 350  | 0.6452          | 0.4566  | 0.6452 | 0.8033 |
| No log        | 3.4851 | 352  | 0.6249          | 0.4583  | 0.6249 | 0.7905 |
| No log        | 3.5050 | 354  | 0.5794          | 0.4997  | 0.5794 | 0.7612 |
| No log        | 3.5248 | 356  | 0.5035          | 0.5768  | 0.5035 | 0.7096 |
| No log        | 3.5446 | 358  | 0.4768          | 0.6504  | 0.4768 | 0.6905 |
| No log        | 3.5644 | 360  | 0.5514          | 0.6272  | 0.5514 | 0.7425 |
| No log        | 3.5842 | 362  | 0.5728          | 0.6195  | 0.5728 | 0.7568 |
| No log        | 3.6040 | 364  | 0.5310          | 0.6335  | 0.5310 | 0.7287 |
| No log        | 3.6238 | 366  | 0.5185          | 0.6193  | 0.5185 | 0.7200 |
| No log        | 3.6436 | 368  | 0.5522          | 0.6178  | 0.5522 | 0.7431 |
| No log        | 3.6634 | 370  | 0.6056          | 0.5805  | 0.6056 | 0.7782 |
| No log        | 3.6832 | 372  | 0.6224          | 0.5587  | 0.6224 | 0.7889 |
| No log        | 3.7030 | 374  | 0.5488          | 0.5821  | 0.5488 | 0.7408 |
| No log        | 3.7228 | 376  | 0.5148          | 0.5873  | 0.5148 | 0.7175 |
| No log        | 3.7426 | 378  | 0.5430          | 0.5878  | 0.5430 | 0.7369 |
| No log        | 3.7624 | 380  | 0.5806          | 0.5780  | 0.5806 | 0.7620 |
| No log        | 3.7822 | 382  | 0.6253          | 0.4880  | 0.6253 | 0.7908 |
| No log        | 3.8020 | 384  | 0.7179          | 0.4708  | 0.7179 | 0.8473 |
| No log        | 3.8218 | 386  | 0.7220          | 0.4571  | 0.7220 | 0.8497 |
| No log        | 3.8416 | 388  | 0.6558          | 0.5352  | 0.6558 | 0.8098 |
| No log        | 3.8614 | 390  | 0.5226          | 0.5996  | 0.5226 | 0.7229 |
| No log        | 3.8812 | 392  | 0.4771          | 0.6257  | 0.4771 | 0.6907 |
| No log        | 3.9010 | 394  | 0.4664          | 0.6253  | 0.4664 | 0.6830 |
| No log        | 3.9208 | 396  | 0.4882          | 0.6287  | 0.4882 | 0.6987 |
| No log        | 3.9406 | 398  | 0.5571          | 0.6200  | 0.5571 | 0.7464 |
| No log        | 3.9604 | 400  | 0.6986          | 0.5493  | 0.6986 | 0.8358 |
| No log        | 3.9802 | 402  | 0.7403          | 0.5415  | 0.7403 | 0.8604 |
| No log        | 4.0    | 404  | 0.7231          | 0.5818  | 0.7231 | 0.8504 |
| No log        | 4.0198 | 406  | 0.6436          | 0.5975  | 0.6436 | 0.8022 |
| No log        | 4.0396 | 408  | 0.5594          | 0.5989  | 0.5594 | 0.7479 |
| No log        | 4.0594 | 410  | 0.5251          | 0.5935  | 0.5251 | 0.7247 |
| No log        | 4.0792 | 412  | 0.4995          | 0.5892  | 0.4995 | 0.7068 |
| No log        | 4.0990 | 414  | 0.6776          | 0.5147  | 0.6776 | 0.8231 |
| No log        | 4.1188 | 416  | 0.8703          | 0.3981  | 0.8703 | 0.9329 |
| No log        | 4.1386 | 418  | 0.8965          | 0.3903  | 0.8965 | 0.9468 |
| No log        | 4.1584 | 420  | 0.7560          | 0.4225  | 0.7560 | 0.8695 |
| No log        | 4.1782 | 422  | 0.6107          | 0.4733  | 0.6107 | 0.7815 |
| No log        | 4.1980 | 424  | 0.4889          | 0.5122  | 0.4889 | 0.6992 |
| No log        | 4.2178 | 426  | 0.4738          | 0.5192  | 0.4738 | 0.6884 |
| No log        | 4.2376 | 428  | 0.4964          | 0.5090  | 0.4964 | 0.7046 |
| No log        | 4.2574 | 430  | 0.5861          | 0.5455  | 0.5861 | 0.7656 |
| No log        | 4.2772 | 432  | 0.6618          | 0.5285  | 0.6618 | 0.8135 |
| No log        | 4.2970 | 434  | 0.6761          | 0.5604  | 0.6761 | 0.8223 |
| No log        | 4.3168 | 436  | 0.5690          | 0.6085  | 0.5690 | 0.7543 |
| No log        | 4.3366 | 438  | 0.5271          | 0.6033  | 0.5271 | 0.7260 |
| No log        | 4.3564 | 440  | 0.5969          | 0.5869  | 0.5969 | 0.7726 |
| No log        | 4.3762 | 442  | 0.5492          | 0.6088  | 0.5492 | 0.7411 |
| No log        | 4.3960 | 444  | 0.5130          | 0.6261  | 0.5130 | 0.7163 |
| No log        | 4.4158 | 446  | 0.5983          | 0.5908  | 0.5983 | 0.7735 |
| No log        | 4.4356 | 448  | 0.6330          | 0.5648  | 0.6330 | 0.7956 |
| No log        | 4.4554 | 450  | 0.5773          | 0.5612  | 0.5773 | 0.7598 |
| No log        | 4.4752 | 452  | 0.4904          | 0.5814  | 0.4904 | 0.7003 |
| No log        | 4.4950 | 454  | 0.4566          | 0.5996  | 0.4566 | 0.6757 |
| No log        | 4.5149 | 456  | 0.4826          | 0.6155  | 0.4826 | 0.6947 |
| No log        | 4.5347 | 458  | 0.5790          | 0.5645  | 0.5790 | 0.7609 |
| No log        | 4.5545 | 460  | 0.6902          | 0.5745  | 0.6902 | 0.8308 |
| No log        | 4.5743 | 462  | 0.7205          | 0.5905  | 0.7205 | 0.8488 |
| No log        | 4.5941 | 464  | 0.6902          | 0.6135  | 0.6902 | 0.8308 |
| No log        | 4.6139 | 466  | 0.6225          | 0.6113  | 0.6225 | 0.7890 |
| No log        | 4.6337 | 468  | 0.5521          | 0.6185  | 0.5521 | 0.7430 |
| No log        | 4.6535 | 470  | 0.5718          | 0.6076  | 0.5718 | 0.7562 |
| No log        | 4.6733 | 472  | 0.6828          | 0.5925  | 0.6828 | 0.8263 |
| No log        | 4.6931 | 474  | 0.7151          | 0.5779  | 0.7151 | 0.8456 |
| No log        | 4.7129 | 476  | 0.6134          | 0.5901  | 0.6134 | 0.7832 |
| No log        | 4.7327 | 478  | 0.5356          | 0.5923  | 0.5356 | 0.7319 |
| No log        | 4.7525 | 480  | 0.5328          | 0.5884  | 0.5328 | 0.7299 |
| No log        | 4.7723 | 482  | 0.4821          | 0.6312  | 0.4821 | 0.6943 |
| No log        | 4.7921 | 484  | 0.4674          | 0.6076  | 0.4674 | 0.6837 |
| No log        | 4.8119 | 486  | 0.4996          | 0.5995  | 0.4996 | 0.7068 |
| No log        | 4.8317 | 488  | 0.5655          | 0.5417  | 0.5655 | 0.7520 |
| No log        | 4.8515 | 490  | 0.6328          | 0.5383  | 0.6328 | 0.7955 |
| No log        | 4.8713 | 492  | 0.5947          | 0.5256  | 0.5947 | 0.7712 |
| No log        | 4.8911 | 494  | 0.6077          | 0.5483  | 0.6077 | 0.7796 |
| No log        | 4.9109 | 496  | 0.5424          | 0.5739  | 0.5424 | 0.7365 |
| No log        | 4.9307 | 498  | 0.4834          | 0.6249  | 0.4834 | 0.6953 |
| 0.494         | 4.9505 | 500  | 0.4813          | 0.6382  | 0.4813 | 0.6938 |
| 0.494         | 4.9703 | 502  | 0.5511          | 0.6129  | 0.5511 | 0.7424 |
| 0.494         | 4.9901 | 504  | 0.7097          | 0.4703  | 0.7097 | 0.8424 |
| 0.494         | 5.0099 | 506  | 0.7715          | 0.4114  | 0.7715 | 0.8783 |
| 0.494         | 5.0297 | 508  | 0.6739          | 0.4589  | 0.6739 | 0.8209 |
| 0.494         | 5.0495 | 510  | 0.5705          | 0.5583  | 0.5705 | 0.7553 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1