ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1186
• Qwk: 0.1944
• Mse: 2.1186
• Rmse: 1.4555

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0286	2	6.8075	0.0242	6.8075	2.6091
No log	0.0571	4	4.5139	0.0873	4.5139	2.1246
No log	0.0857	6	3.6151	-0.0625	3.6151	1.9013
No log	0.1143	8	3.5758	-0.0652	3.5758	1.8910
No log	0.1429	10	2.6768	0.0730	2.6768	1.6361
No log	0.1714	12	2.1851	0.1061	2.1851	1.4782
No log	0.2	14	1.8546	0.2655	1.8546	1.3618
No log	0.2286	16	2.0150	0.1833	2.0150	1.4195
No log	0.2571	18	2.2578	0.0986	2.2578	1.5026
No log	0.2857	20	2.3446	0.0405	2.3446	1.5312
No log	0.3143	22	2.2022	0.0828	2.2022	1.4840
No log	0.3429	24	1.9755	0.2479	1.9755	1.4055
No log	0.3714	26	1.7998	0.1651	1.7998	1.3416
No log	0.4	28	1.6579	0.1714	1.6579	1.2876
No log	0.4286	30	1.6059	0.2075	1.6059	1.2673
No log	0.4571	32	1.6442	0.2957	1.6442	1.2823
No log	0.4857	34	1.8066	0.3089	1.8066	1.3441
No log	0.5143	36	1.9009	0.272	1.9009	1.3787
No log	0.5429	38	1.9455	0.24	1.9455	1.3948
No log	0.5714	40	1.6859	0.1709	1.6859	1.2984
No log	0.6	42	1.5032	0.2264	1.5032	1.2261
No log	0.6286	44	1.4581	0.2264	1.4581	1.2075
No log	0.6571	46	1.4465	0.2430	1.4465	1.2027
No log	0.6857	48	1.4184	0.2778	1.4184	1.1910
No log	0.7143	50	1.4083	0.2778	1.4083	1.1867
No log	0.7429	52	1.3900	0.3604	1.3900	1.1790
No log	0.7714	54	1.4141	0.4538	1.4141	1.1891
No log	0.8	56	1.2683	0.4576	1.2683	1.1262
No log	0.8286	58	1.1614	0.4833	1.1614	1.0777
No log	0.8571	60	1.1247	0.4833	1.1247	1.0605
No log	0.8857	62	1.1909	0.4463	1.1909	1.0913
No log	0.9143	64	1.4392	0.3448	1.4392	1.1997
No log	0.9429	66	2.1484	0.1667	2.1484	1.4658
No log	0.9714	68	2.1738	0.0656	2.1738	1.4744
No log	1.0	70	1.6734	0.3465	1.6734	1.2936
No log	1.0286	72	1.7344	0.3492	1.7344	1.3170
No log	1.0571	74	2.0066	0.1774	2.0066	1.4166
No log	1.0857	76	1.7987	0.2812	1.7987	1.3411
No log	1.1143	78	2.3413	-0.0308	2.3413	1.5301
No log	1.1429	80	2.2158	0.0	2.2158	1.4885
No log	1.1714	82	1.8893	0.1778	1.8893	1.3745
No log	1.2	84	1.7054	0.3662	1.7054	1.3059
No log	1.2286	86	1.2129	0.5674	1.2129	1.1013
No log	1.2571	88	0.9576	0.5957	0.9576	0.9785
No log	1.2857	90	1.0326	0.5571	1.0326	1.0162
No log	1.3143	92	1.4900	0.4861	1.4900	1.2206
No log	1.3429	94	1.6454	0.3546	1.6454	1.2827
No log	1.3714	96	1.2818	0.5217	1.2818	1.1321
No log	1.4	98	0.9370	0.6269	0.9370	0.9680
No log	1.4286	100	0.8861	0.6260	0.8861	0.9413
No log	1.4571	102	1.0314	0.6269	1.0314	1.0156
No log	1.4857	104	1.3912	0.4818	1.3912	1.1795
No log	1.5143	106	1.3588	0.4964	1.3588	1.1657
No log	1.5429	108	1.2522	0.5185	1.2522	1.1190
No log	1.5714	110	1.1889	0.5185	1.1889	1.0904
No log	1.6	112	1.3424	0.4559	1.3424	1.1586
No log	1.6286	114	1.8791	0.3043	1.8791	1.3708
No log	1.6571	116	2.3932	0.0299	2.3932	1.5470
No log	1.6857	118	2.5226	-0.0462	2.5226	1.5883
No log	1.7143	120	2.2853	0.1806	2.2853	1.5117
No log	1.7429	122	2.1206	0.2192	2.1206	1.4562
No log	1.7714	124	1.9135	0.2621	1.9135	1.3833
No log	1.8	126	1.6167	0.3404	1.6167	1.2715
No log	1.8286	128	1.5630	0.3776	1.5630	1.2502
No log	1.8571	130	1.6525	0.3333	1.6525	1.2855
No log	1.8857	132	1.5964	0.3546	1.5964	1.2635
No log	1.9143	134	1.4707	0.4348	1.4707	1.2127
No log	1.9429	136	1.4119	0.4460	1.4119	1.1882
No log	1.9714	138	1.6045	0.3586	1.6045	1.2667
No log	2.0	140	1.9685	0.2483	1.9685	1.4030
No log	2.0286	142	1.9706	0.2740	1.9706	1.4038
No log	2.0571	144	1.8354	0.2838	1.8354	1.3548
No log	2.0857	146	1.4237	0.4225	1.4237	1.1932
No log	2.1143	148	1.2462	0.5036	1.2462	1.1163
No log	2.1429	150	1.4426	0.4225	1.4426	1.2011
No log	2.1714	152	1.8879	0.2917	1.8879	1.3740
No log	2.2	154	1.8790	0.2917	1.8790	1.3708
No log	2.2286	156	1.5755	0.4	1.5755	1.2552
No log	2.2571	158	1.1359	0.5735	1.1359	1.0658
No log	2.2857	160	1.0705	0.5926	1.0705	1.0346
No log	2.3143	162	1.2834	0.5036	1.2834	1.1329
No log	2.3429	164	1.6941	0.3497	1.6941	1.3016
No log	2.3714	166	1.8374	0.2877	1.8374	1.3555
No log	2.4	168	1.6172	0.4	1.6172	1.2717
No log	2.4286	170	1.2630	0.5401	1.2630	1.1238
No log	2.4571	172	1.2210	0.5693	1.2210	1.1050
No log	2.4857	174	1.3940	0.4714	1.3940	1.1807
No log	2.5143	176	1.7284	0.3537	1.7284	1.3147
No log	2.5429	178	1.9477	0.2361	1.9477	1.3956
No log	2.5714	180	1.9570	0.2207	1.9570	1.3989
No log	2.6	182	1.6833	0.3333	1.6833	1.2974
No log	2.6286	184	1.4892	0.4604	1.4892	1.2203
No log	2.6571	186	1.4677	0.4593	1.4677	1.2115
No log	2.6857	188	1.5102	0.4493	1.5102	1.2289
No log	2.7143	190	1.5451	0.4143	1.5451	1.2430
No log	2.7429	192	1.5268	0.4143	1.5268	1.2356
No log	2.7714	194	1.5663	0.3972	1.5663	1.2515
No log	2.8	196	1.6087	0.3972	1.6087	1.2683
No log	2.8286	198	1.6549	0.3404	1.6549	1.2864
No log	2.8571	200	1.7358	0.3239	1.7358	1.3175
No log	2.8857	202	1.6405	0.3404	1.6405	1.2808
No log	2.9143	204	1.4942	0.4460	1.4942	1.2224
No log	2.9429	206	1.5850	0.3662	1.5850	1.2590
No log	2.9714	208	1.8906	0.2917	1.8906	1.3750
No log	3.0	210	2.0405	0.2621	2.0405	1.4284
No log	3.0286	212	1.8762	0.2917	1.8762	1.3697
No log	3.0571	214	1.6997	0.3378	1.6997	1.3037
No log	3.0857	216	1.6311	0.3239	1.6311	1.2772
No log	3.1143	218	1.5735	0.4148	1.5735	1.2544
No log	3.1429	220	1.5173	0.4427	1.5173	1.2318
No log	3.1714	222	1.5067	0.3971	1.5067	1.2275
No log	3.2	224	1.5317	0.3404	1.5317	1.2376
No log	3.2286	226	1.3958	0.4167	1.3958	1.1814
No log	3.2571	228	1.5363	0.4167	1.5363	1.2395
No log	3.2857	230	1.5676	0.3699	1.5676	1.2520
No log	3.3143	232	1.7171	0.3288	1.7171	1.3104
No log	3.3429	234	1.7857	0.3239	1.7857	1.3363
No log	3.3714	236	2.0004	0.1185	2.0004	1.4143
No log	3.4	238	1.8851	0.1094	1.8851	1.3730
No log	3.4286	240	1.4926	0.4427	1.4926	1.2217
No log	3.4571	242	1.3049	0.4724	1.3049	1.1423
No log	3.4857	244	1.2350	0.512	1.2350	1.1113
No log	3.5143	246	1.3451	0.5231	1.3451	1.1598
No log	3.5429	248	1.6236	0.3741	1.6236	1.2742
No log	3.5714	250	1.7829	0.3077	1.7829	1.3353
No log	3.6	252	1.6390	0.4	1.6390	1.2803
No log	3.6286	254	1.3721	0.4706	1.3721	1.1714
No log	3.6571	256	1.3370	0.4812	1.3370	1.1563
No log	3.6857	258	1.5421	0.3582	1.5421	1.2418
No log	3.7143	260	1.8422	0.1860	1.8422	1.3573
No log	3.7429	262	1.9662	0.1417	1.9662	1.4022
No log	3.7714	264	1.9773	0.1385	1.9773	1.4062
No log	3.8	266	1.6999	0.3453	1.6999	1.3038
No log	3.8286	268	1.5134	0.4	1.5134	1.2302
No log	3.8571	270	1.5184	0.4110	1.5184	1.2322
No log	3.8857	272	1.5869	0.4354	1.5869	1.2597
No log	3.9143	274	1.5842	0.4138	1.5842	1.2586
No log	3.9429	276	1.4105	0.3906	1.4105	1.1876
No log	3.9714	278	1.3248	0.4921	1.3248	1.1510
No log	4.0	280	1.3326	0.4844	1.3326	1.1544
No log	4.0286	282	1.3145	0.4844	1.3145	1.1465
No log	4.0571	284	1.4692	0.4444	1.4692	1.2121
No log	4.0857	286	1.7891	0.3151	1.7891	1.3376
No log	4.1143	288	1.8199	0.3288	1.8199	1.3490
No log	4.1429	290	1.7900	0.3537	1.7900	1.3379
No log	4.1714	292	1.8368	0.3172	1.8368	1.3553
No log	4.2	294	1.7353	0.3172	1.7353	1.3173
No log	4.2286	296	1.5646	0.4	1.5646	1.2508
No log	4.2571	298	1.3873	0.4741	1.3873	1.1778
No log	4.2857	300	1.3861	0.5414	1.3861	1.1773
No log	4.3143	302	1.4744	0.4478	1.4744	1.2142
No log	4.3429	304	1.6021	0.3504	1.6021	1.2657
No log	4.3714	306	1.6981	0.2394	1.6981	1.3031
No log	4.4	308	1.5668	0.4029	1.5668	1.2517
No log	4.4286	310	1.2807	0.5185	1.2807	1.1317
No log	4.4571	312	1.0650	0.5385	1.0650	1.0320
No log	4.4857	314	1.0941	0.5496	1.0941	1.0460
No log	4.5143	316	1.2664	0.5075	1.2664	1.1254
No log	4.5429	318	1.4518	0.4526	1.4518	1.2049
No log	4.5714	320	1.3772	0.5075	1.3772	1.1735
No log	4.6	322	1.1757	0.5496	1.1757	1.0843
No log	4.6286	324	1.0624	0.5714	1.0624	1.0307
No log	4.6571	326	1.0487	0.5691	1.0487	1.0241
No log	4.6857	328	1.0697	0.5528	1.0697	1.0343
No log	4.7143	330	1.1785	0.5385	1.1785	1.0856
No log	4.7429	332	1.4509	0.4672	1.4509	1.2045
No log	4.7714	334	1.6426	0.3497	1.6426	1.2816
No log	4.8	336	1.6339	0.3497	1.6339	1.2782
No log	4.8286	338	1.4668	0.4143	1.4668	1.2111
No log	4.8571	340	1.3343	0.5152	1.3343	1.1551
No log	4.8857	342	1.3617	0.5113	1.3617	1.1669
No log	4.9143	344	1.4303	0.4627	1.4303	1.1960
No log	4.9429	346	1.5486	0.3497	1.5486	1.2444
No log	4.9714	348	1.6125	0.2979	1.6125	1.2698
No log	5.0	350	1.5746	0.3309	1.5746	1.2548
No log	5.0286	352	1.4699	0.4380	1.4699	1.2124
No log	5.0571	354	1.2770	0.5496	1.2770	1.1300
No log	5.0857	356	1.1730	0.5271	1.1730	1.0831
No log	5.1143	358	1.1648	0.5271	1.1648	1.0793
No log	5.1429	360	1.2536	0.5496	1.2536	1.1196
No log	5.1714	362	1.4434	0.4559	1.4434	1.2014
No log	5.2	364	1.4876	0.4030	1.4876	1.2197
No log	5.2286	366	1.3868	0.4697	1.3868	1.1776
No log	5.2571	368	1.2729	0.5496	1.2729	1.1282
No log	5.2857	370	1.2445	0.5496	1.2445	1.1156
No log	5.3143	372	1.2232	0.5496	1.2232	1.1060
No log	5.3429	374	1.2756	0.4741	1.2756	1.1294
No log	5.3714	376	1.4452	0.4380	1.4452	1.2022
No log	5.4	378	1.7097	0.3357	1.7097	1.3075
No log	5.4286	380	1.7287	0.3357	1.7287	1.3148
No log	5.4571	382	1.6302	0.4	1.6302	1.2768
No log	5.4857	384	1.5912	0.4029	1.5912	1.2614
No log	5.5143	386	1.5370	0.4380	1.5370	1.2398
No log	5.5429	388	1.3789	0.4593	1.3789	1.1743
No log	5.5714	390	1.2531	0.5736	1.2531	1.1194
No log	5.6	392	1.1949	0.5512	1.1949	1.0931
No log	5.6286	394	1.2697	0.5692	1.2697	1.1268
No log	5.6571	396	1.4988	0.4328	1.4988	1.2243
No log	5.6857	398	1.6605	0.3478	1.6605	1.2886
No log	5.7143	400	1.7019	0.3404	1.7019	1.3046
No log	5.7429	402	1.6380	0.3404	1.6380	1.2798
No log	5.7714	404	1.4572	0.4706	1.4572	1.2072
No log	5.8	406	1.3627	0.5303	1.3627	1.1674
No log	5.8286	408	1.3165	0.5385	1.3165	1.1474
No log	5.8571	410	1.3424	0.5385	1.3424	1.1586
No log	5.8857	412	1.3935	0.5191	1.3935	1.1805
No log	5.9143	414	1.3568	0.5231	1.3568	1.1648
No log	5.9429	416	1.2475	0.5312	1.2475	1.1169
No log	5.9714	418	1.1720	0.5323	1.1720	1.0826
No log	6.0	420	1.1508	0.5323	1.1508	1.0728
No log	6.0286	422	1.1585	0.5354	1.1585	1.0764
No log	6.0571	424	1.4137	0.5185	1.4137	1.1890
No log	6.0857	426	1.7920	0.3172	1.7920	1.3387
No log	6.1143	428	1.9139	0.3172	1.9139	1.3834
No log	6.1429	430	1.8421	0.3172	1.8421	1.3572
No log	6.1714	432	1.6125	0.4113	1.6125	1.2698
No log	6.2	434	1.5300	0.4255	1.5300	1.2369
No log	6.2286	436	1.5445	0.4173	1.5445	1.2428
No log	6.2571	438	1.5873	0.3857	1.5873	1.2599
No log	6.2857	440	1.4895	0.4706	1.4895	1.2205
No log	6.3143	442	1.4498	0.5075	1.4498	1.2041
No log	6.3429	444	1.3792	0.5113	1.3792	1.1744
No log	6.3714	446	1.3275	0.4697	1.3275	1.1522
No log	6.4	448	1.3887	0.4812	1.3887	1.1784
No log	6.4286	450	1.3835	0.4812	1.3835	1.1762
No log	6.4571	452	1.2577	0.5038	1.2577	1.1215
No log	6.4857	454	1.2569	0.5385	1.2569	1.1211
No log	6.5143	456	1.2625	0.5385	1.2625	1.1236
No log	6.5429	458	1.2891	0.5496	1.2891	1.1354
No log	6.5714	460	1.2873	0.5496	1.2873	1.1346
No log	6.6	462	1.2225	0.5496	1.2225	1.1057
No log	6.6286	464	1.1357	0.5385	1.1357	1.0657
No log	6.6571	466	1.1578	0.5152	1.1578	1.0760
No log	6.6857	468	1.1682	0.5152	1.1682	1.0809
No log	6.7143	470	1.2740	0.5152	1.2740	1.1287
No log	6.7429	472	1.3593	0.4776	1.3593	1.1659
No log	6.7714	474	1.3538	0.4962	1.3538	1.1635
No log	6.8	476	1.2903	0.5231	1.2903	1.1359
No log	6.8286	478	1.2080	0.5271	1.2080	1.0991
No log	6.8571	480	1.2104	0.5156	1.2104	1.1002
No log	6.8857	482	1.2271	0.5039	1.2271	1.1077
No log	6.9143	484	1.3141	0.5271	1.3141	1.1463
No log	6.9429	486	1.4399	0.4961	1.4399	1.2000
No log	6.9714	488	1.4499	0.4923	1.4499	1.2041
No log	7.0	490	1.3432	0.5231	1.3432	1.1590
No log	7.0286	492	1.2238	0.5271	1.2238	1.1062
No log	7.0571	494	1.2297	0.5271	1.2297	1.1089
No log	7.0857	496	1.3064	0.5496	1.3064	1.1430
No log	7.1143	498	1.4566	0.4412	1.4566	1.2069
0.3924	7.1429	500	1.5347	0.3885	1.5347	1.2388
0.3924	7.1714	502	1.4766	0.4444	1.4766	1.2152
0.3924	7.2	504	1.3931	0.4925	1.3931	1.1803
0.3924	7.2286	506	1.3812	0.4925	1.3812	1.1752
0.3924	7.2571	508	1.3893	0.4925	1.3893	1.1787
0.3924	7.2857	510	1.4796	0.4706	1.4796	1.2164
0.3924	7.3143	512	1.6613	0.4	1.6613	1.2889
0.3924	7.3429	514	1.7558	0.3497	1.7558	1.3251
0.3924	7.3714	516	1.7463	0.3497	1.7463	1.3215
0.3924	7.4	518	1.6475	0.4	1.6475	1.2835
0.3924	7.4286	520	1.6933	0.3688	1.6933	1.3013
0.3924	7.4571	522	1.8177	0.3077	1.8177	1.3482
0.3924	7.4857	524	2.0073	0.2917	2.0073	1.4168
0.3924	7.5143	526	2.1291	0.2207	2.1291	1.4592
0.3924	7.5429	528	2.1186	0.1944	2.1186	1.4555

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1