ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5872
• Qwk: 0.4348
• Mse: 1.5872
• Rmse: 1.2598

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0211	2	6.8016	0.0242	6.8016	2.6080
No log	0.0421	4	4.5415	0.0917	4.5415	2.1311
No log	0.0632	6	3.3942	-0.0109	3.3942	1.8423
No log	0.0842	8	2.2851	0.1351	2.2851	1.5117
No log	0.1053	10	1.8616	0.2951	1.8616	1.3644
No log	0.1263	12	1.6762	0.2000	1.6762	1.2947
No log	0.1474	14	1.8229	0.2261	1.8229	1.3501
No log	0.1684	16	2.1136	0.0984	2.1136	1.4538
No log	0.1895	18	3.2870	0.0479	3.2870	1.8130
No log	0.2105	20	4.1940	-0.0498	4.1940	2.0479
No log	0.2316	22	3.9667	-0.0103	3.9667	1.9917
No log	0.2526	24	3.0496	0.0261	3.0496	1.7463
No log	0.2737	26	2.2175	0.0000	2.2175	1.4891
No log	0.2947	28	1.9001	0.1538	1.9001	1.3784
No log	0.3158	30	1.8961	0.0784	1.8961	1.3770
No log	0.3368	32	2.0188	0.1538	2.0188	1.4209
No log	0.3579	34	2.1974	0.0161	2.1974	1.4824
No log	0.3789	36	2.3362	-0.0272	2.3362	1.5284
No log	0.4	38	2.3343	0.0	2.3343	1.5278
No log	0.4211	40	2.3108	0.0	2.3108	1.5201
No log	0.4421	42	2.2180	0.1333	2.2180	1.4893
No log	0.4632	44	2.1210	0.1212	2.1210	1.4564
No log	0.4842	46	2.2372	0.1583	2.2372	1.4957
No log	0.5053	48	2.6077	0.0544	2.6077	1.6148
No log	0.5263	50	2.4956	0.0972	2.4956	1.5797
No log	0.5474	52	2.1286	0.2443	2.1286	1.4590
No log	0.5684	54	1.9892	0.2764	1.9892	1.4104
No log	0.5895	56	1.9080	0.2645	1.9080	1.3813
No log	0.6105	58	1.8256	0.25	1.8256	1.3512
No log	0.6316	60	1.9105	0.3065	1.9105	1.3822
No log	0.6526	62	1.7863	0.25	1.7863	1.3365
No log	0.6737	64	1.5820	0.1429	1.5820	1.2578
No log	0.6947	66	1.4953	0.1538	1.4953	1.2228
No log	0.7158	68	1.4388	0.2617	1.4388	1.1995
No log	0.7368	70	1.3688	0.2857	1.3688	1.1699
No log	0.7579	72	1.3948	0.4262	1.3948	1.1810
No log	0.7789	74	1.3332	0.4262	1.3332	1.1546
No log	0.8	76	1.2850	0.4715	1.2850	1.1336
No log	0.8211	78	1.7384	0.3115	1.7384	1.3185
No log	0.8421	80	2.0071	0.0472	2.0071	1.4167
No log	0.8632	82	1.7635	0.2985	1.7635	1.3280
No log	0.8842	84	1.4374	0.4677	1.4374	1.1989
No log	0.9053	86	1.3255	0.4409	1.3255	1.1513
No log	0.9263	88	1.4215	0.2975	1.4215	1.1923
No log	0.9474	90	1.3819	0.3810	1.3819	1.1756
No log	0.9684	92	1.4936	0.4567	1.4936	1.2221
No log	0.9895	94	1.5956	0.3937	1.5956	1.2632
No log	1.0105	96	1.5772	0.3937	1.5772	1.2559
No log	1.0316	98	1.5124	0.4160	1.5124	1.2298
No log	1.0526	100	1.4928	0.4567	1.4928	1.2218
No log	1.0737	102	1.4624	0.4567	1.4624	1.2093
No log	1.0947	104	1.4791	0.3906	1.4791	1.2162
No log	1.1158	106	1.5574	0.3817	1.5574	1.2480
No log	1.1368	108	1.5345	0.3721	1.5345	1.2388
No log	1.1579	110	1.4910	0.4762	1.4910	1.2211
No log	1.1789	112	1.5690	0.4062	1.5690	1.2526
No log	1.2	114	1.6096	0.3622	1.6096	1.2687
No log	1.2211	116	1.6435	0.3566	1.6435	1.2820
No log	1.2421	118	1.5806	0.4793	1.5806	1.2572
No log	1.2632	120	1.6102	0.4333	1.6102	1.2689
No log	1.2842	122	1.6894	0.3902	1.6894	1.2998
No log	1.3053	124	1.6249	0.5041	1.6249	1.2747
No log	1.3263	126	1.5174	0.5	1.5174	1.2318
No log	1.3474	128	1.4836	0.4918	1.4836	1.2180
No log	1.3684	130	1.5333	0.5000	1.5333	1.2383
No log	1.3895	132	1.7535	0.2590	1.7535	1.3242
No log	1.4105	134	1.8711	0.2621	1.8711	1.3679
No log	1.4316	136	1.7054	0.2817	1.7054	1.3059
No log	1.4526	138	1.4201	0.4444	1.4201	1.1917
No log	1.4737	140	1.3002	0.4677	1.3002	1.1403
No log	1.4947	142	1.3053	0.48	1.3053	1.1425
No log	1.5158	144	1.4517	0.4651	1.4517	1.2049
No log	1.5368	146	1.7938	0.3378	1.7938	1.3393
No log	1.5579	148	1.7106	0.2979	1.7106	1.3079
No log	1.5789	150	1.4711	0.4444	1.4711	1.2129
No log	1.6	152	1.4313	0.3793	1.4313	1.1964
No log	1.6211	154	1.4310	0.3894	1.4310	1.1962
No log	1.6421	156	1.4006	0.3423	1.4006	1.1835
No log	1.6632	158	1.3807	0.375	1.3807	1.1750
No log	1.6842	160	1.3149	0.3894	1.3149	1.1467
No log	1.7053	162	1.2628	0.4348	1.2628	1.1237
No log	1.7263	164	1.2451	0.4833	1.2451	1.1158
No log	1.7474	166	1.2613	0.4833	1.2613	1.1231
No log	1.7684	168	1.2414	0.4706	1.2414	1.1142
No log	1.7895	170	1.2453	0.4576	1.2453	1.1159
No log	1.8105	172	1.2200	0.375	1.2200	1.1045
No log	1.8316	174	1.1973	0.3860	1.1973	1.0942
No log	1.8526	176	1.2249	0.4655	1.2249	1.1068
No log	1.8737	178	1.3114	0.5736	1.3114	1.1451
No log	1.8947	180	1.3393	0.5692	1.3393	1.1573
No log	1.9158	182	1.2494	0.5736	1.2494	1.1178
No log	1.9368	184	1.1691	0.5469	1.1691	1.0813
No log	1.9579	186	1.0885	0.5203	1.0885	1.0433
No log	1.9789	188	1.1054	0.5556	1.1054	1.0514
No log	2.0	190	1.1320	0.5781	1.1320	1.0640
No log	2.0211	192	1.1838	0.5781	1.1838	1.0880
No log	2.0421	194	1.2211	0.5736	1.2211	1.1050
No log	2.0632	196	1.1867	0.4833	1.1867	1.0894
No log	2.0842	198	1.2049	0.375	1.2049	1.0977
No log	2.1053	200	1.2629	0.3423	1.2629	1.1238
No log	2.1263	202	1.3141	0.3684	1.3141	1.1464
No log	2.1474	204	1.3371	0.3684	1.3371	1.1563
No log	2.1684	206	1.3345	0.3091	1.3345	1.1552
No log	2.1895	208	1.3048	0.3684	1.3048	1.1423
No log	2.2105	210	1.2489	0.4444	1.2489	1.1175
No log	2.2316	212	1.2776	0.5397	1.2776	1.1303
No log	2.2526	214	1.3824	0.5692	1.3824	1.1758
No log	2.2737	216	1.4967	0.4511	1.4967	1.2234
No log	2.2947	218	1.4239	0.5303	1.4239	1.1933
No log	2.3158	220	1.2815	0.5781	1.2815	1.1321
No log	2.3368	222	1.2473	0.56	1.2473	1.1168
No log	2.3579	224	1.2432	0.5203	1.2432	1.1150
No log	2.3789	226	1.2495	0.5410	1.2495	1.1178
No log	2.4	228	1.3537	0.5984	1.3537	1.1635
No log	2.4211	230	1.5173	0.4844	1.5173	1.2318
No log	2.4421	232	1.4813	0.4882	1.4813	1.2171
No log	2.4632	234	1.3536	0.5984	1.3536	1.1635
No log	2.4842	236	1.2626	0.5410	1.2626	1.1237
No log	2.5053	238	1.2535	0.5984	1.2535	1.1196
No log	2.5263	240	1.3795	0.5455	1.3795	1.1745
No log	2.5474	242	1.5190	0.4526	1.5190	1.2325
No log	2.5684	244	1.4051	0.4925	1.4051	1.1854
No log	2.5895	246	1.2103	0.5426	1.2103	1.1001
No log	2.6105	248	1.1070	0.5161	1.1070	1.0521
No log	2.6316	250	1.1202	0.5366	1.1202	1.0584
No log	2.6526	252	1.2033	0.5238	1.2033	1.0970
No log	2.6737	254	1.3377	0.5649	1.3377	1.1566
No log	2.6947	256	1.3662	0.5581	1.3662	1.1688
No log	2.7158	258	1.2747	0.5397	1.2747	1.1290
No log	2.7368	260	1.1909	0.4655	1.1909	1.0913
No log	2.7579	262	1.1747	0.4522	1.1747	1.0838
No log	2.7789	264	1.1775	0.5124	1.1775	1.0851
No log	2.8	266	1.2002	0.5238	1.2002	1.0955
No log	2.8211	268	1.2869	0.5649	1.2869	1.1344
No log	2.8421	270	1.2740	0.5385	1.2740	1.1287
No log	2.8632	272	1.2190	0.5469	1.2190	1.1041
No log	2.8842	274	1.1994	0.5469	1.1994	1.0952
No log	2.9053	276	1.2447	0.5692	1.2447	1.1156
No log	2.9263	278	1.2552	0.5692	1.2552	1.1203
No log	2.9474	280	1.2514	0.5692	1.2514	1.1187
No log	2.9684	282	1.2965	0.5496	1.2965	1.1386
No log	2.9895	284	1.2214	0.5397	1.2214	1.1052
No log	3.0105	286	1.1508	0.4615	1.1508	1.0727
No log	3.0316	288	1.1036	0.4348	1.1036	1.0505
No log	3.0526	290	1.0714	0.4746	1.0714	1.0351
No log	3.0737	292	1.1327	0.5512	1.1327	1.0643
No log	3.0947	294	1.3410	0.5113	1.3410	1.1580
No log	3.1158	296	1.4778	0.4091	1.4778	1.2156
No log	3.1368	298	1.4449	0.4627	1.4449	1.2020
No log	3.1579	300	1.3514	0.5075	1.3514	1.1625
No log	3.1789	302	1.1535	0.5581	1.1535	1.0740
No log	3.2	304	1.0410	0.5556	1.0410	1.0203
No log	3.2211	306	1.0353	0.5669	1.0353	1.0175
No log	3.2421	308	1.0933	0.528	1.0933	1.0456
No log	3.2632	310	1.3188	0.5113	1.3188	1.1484
No log	3.2842	312	1.6370	0.3731	1.6370	1.2794
No log	3.3053	314	1.6683	0.3556	1.6683	1.2916
No log	3.3263	316	1.4562	0.4444	1.4562	1.2067
No log	3.3474	318	1.1352	0.5581	1.1352	1.0655
No log	3.3684	320	1.0437	0.5042	1.0437	1.0216
No log	3.3895	322	1.0771	0.4576	1.0771	1.0378
No log	3.4105	324	1.0818	0.5085	1.0818	1.0401
No log	3.4316	326	1.2017	0.5625	1.2017	1.0962
No log	3.4526	328	1.4621	0.4030	1.4621	1.2092
No log	3.4737	330	1.7524	0.2734	1.7524	1.3238
No log	3.4947	332	1.8037	0.2571	1.8037	1.3430
No log	3.5158	334	1.6751	0.2920	1.6751	1.2942
No log	3.5368	336	1.5570	0.3939	1.5570	1.2478
No log	3.5579	338	1.4362	0.4882	1.4362	1.1984
No log	3.5789	340	1.3952	0.4167	1.3952	1.1812
No log	3.6	342	1.3877	0.4590	1.3877	1.1780
No log	3.6211	344	1.4157	0.4882	1.4157	1.1899
No log	3.6421	346	1.5315	0.4275	1.5315	1.2375
No log	3.6632	348	1.4970	0.4275	1.4970	1.2235
No log	3.6842	350	1.3492	0.5077	1.3492	1.1616
No log	3.7053	352	1.2481	0.5512	1.2481	1.1172
No log	3.7263	354	1.2542	0.5512	1.2542	1.1199
No log	3.7474	356	1.3346	0.5344	1.3346	1.1553
No log	3.7684	358	1.4664	0.4275	1.4664	1.2110
No log	3.7895	360	1.6210	0.3582	1.6210	1.2732
No log	3.8105	362	1.6028	0.3609	1.6028	1.2660
No log	3.8316	364	1.4860	0.3939	1.4860	1.2190
No log	3.8526	366	1.3279	0.5156	1.3279	1.1524
No log	3.8737	368	1.2637	0.5484	1.2637	1.1241
No log	3.8947	370	1.2596	0.5512	1.2596	1.1223
No log	3.9158	372	1.2580	0.5512	1.2580	1.1216
No log	3.9368	374	1.3380	0.5455	1.3380	1.1567
No log	3.9579	376	1.4755	0.4478	1.4755	1.2147
No log	3.9789	378	1.4653	0.4478	1.4653	1.2105
No log	4.0	380	1.4282	0.4848	1.4282	1.1951
No log	4.0211	382	1.3664	0.5191	1.3664	1.1689
No log	4.0421	384	1.2525	0.5781	1.2525	1.1192
No log	4.0632	386	1.2311	0.5082	1.2311	1.1095
No log	4.0842	388	1.2422	0.4407	1.2422	1.1145
No log	4.1053	390	1.2396	0.4667	1.2396	1.1134
No log	4.1263	392	1.2566	0.5781	1.2566	1.1210
No log	4.1474	394	1.3636	0.5191	1.3636	1.1677
No log	4.1684	396	1.6244	0.3611	1.6244	1.2745
No log	4.1895	398	1.7680	0.3217	1.7680	1.3297
No log	4.2105	400	1.7543	0.2754	1.7543	1.3245
No log	4.2316	402	1.6088	0.3676	1.6088	1.2684
No log	4.2526	404	1.4359	0.5385	1.4359	1.1983
No log	4.2737	406	1.3620	0.5781	1.3620	1.1671
No log	4.2947	408	1.3260	0.5669	1.3260	1.1515
No log	4.3158	410	1.3255	0.5397	1.3255	1.1513
No log	4.3368	412	1.4125	0.5469	1.4125	1.1885
No log	4.3579	414	1.6487	0.3788	1.6487	1.2840
No log	4.3789	416	1.8483	0.1898	1.8483	1.3595
No log	4.4	418	1.7856	0.2590	1.7856	1.3363
No log	4.4211	420	1.6189	0.3529	1.6189	1.2724
No log	4.4421	422	1.4144	0.5224	1.4144	1.1893
No log	4.4632	424	1.3194	0.5455	1.3194	1.1487
No log	4.4842	426	1.3330	0.5414	1.3330	1.1546
No log	4.5053	428	1.4140	0.5414	1.4140	1.1891
No log	4.5263	430	1.5078	0.4889	1.5078	1.2279
No log	4.5474	432	1.4357	0.5414	1.4357	1.1982
No log	4.5684	434	1.2802	0.5538	1.2802	1.1315
No log	4.5895	436	1.1786	0.5410	1.1786	1.0856
No log	4.6105	438	1.1534	0.4915	1.1534	1.0739
No log	4.6316	440	1.1404	0.5410	1.1404	1.0679
No log	4.6526	442	1.1319	0.5714	1.1319	1.0639
No log	4.6737	444	1.1613	0.5455	1.1613	1.0776
No log	4.6947	446	1.1720	0.5455	1.1720	1.0826
No log	4.7158	448	1.1442	0.5455	1.1442	1.0697
No log	4.7368	450	1.1765	0.5455	1.1765	1.0847
No log	4.7579	452	1.2336	0.5455	1.2336	1.1107
No log	4.7789	454	1.2589	0.5455	1.2589	1.1220
No log	4.8	456	1.3338	0.5263	1.3338	1.1549
No log	4.8211	458	1.3601	0.5224	1.3601	1.1662
No log	4.8421	460	1.4066	0.5224	1.4066	1.1860
No log	4.8632	462	1.4586	0.4962	1.4586	1.2077
No log	4.8842	464	1.4975	0.4962	1.4975	1.2237
No log	4.9053	466	1.4511	0.5152	1.4511	1.2046
No log	4.9263	468	1.4515	0.4962	1.4515	1.2048
No log	4.9474	470	1.4323	0.4885	1.4323	1.1968
No log	4.9684	472	1.3771	0.4923	1.3771	1.1735
No log	4.9895	474	1.3809	0.4724	1.3809	1.1751
No log	5.0105	476	1.3387	0.4754	1.3387	1.1570
No log	5.0316	478	1.3069	0.4754	1.3069	1.1432
No log	5.0526	480	1.2805	0.4463	1.2805	1.1316
No log	5.0737	482	1.2889	0.496	1.2889	1.1353
No log	5.0947	484	1.3595	0.5191	1.3595	1.1660
No log	5.1158	486	1.3850	0.5455	1.3850	1.1768
No log	5.1368	488	1.4306	0.4925	1.4306	1.1961
No log	5.1579	490	1.5304	0.4559	1.5304	1.2371
No log	5.1789	492	1.5422	0.4559	1.5422	1.2418
No log	5.2	494	1.5559	0.4741	1.5559	1.2473
No log	5.2211	496	1.5004	0.4925	1.5004	1.2249
No log	5.2421	498	1.4094	0.5538	1.4094	1.1872
0.4139	5.2632	500	1.3176	0.5041	1.3176	1.1479
0.4139	5.2842	502	1.2087	0.5289	1.2087	1.0994
0.4139	5.3053	504	1.1503	0.5333	1.1503	1.0725
0.4139	5.3263	506	1.1027	0.5246	1.1027	1.0501
0.4139	5.3474	508	1.1477	0.528	1.1477	1.0713
0.4139	5.3684	510	1.2195	0.5344	1.2195	1.1043
0.4139	5.3895	512	1.2002	0.5344	1.2002	1.0955
0.4139	5.4105	514	1.2278	0.5344	1.2278	1.1081
0.4139	5.4316	516	1.2768	0.5344	1.2768	1.1299
0.4139	5.4526	518	1.2691	0.5455	1.2691	1.1266
0.4139	5.4737	520	1.2110	0.5581	1.2110	1.1004
0.4139	5.4947	522	1.1659	0.5625	1.1659	1.0798
0.4139	5.5158	524	1.1590	0.5512	1.1590	1.0765
0.4139	5.5368	526	1.1087	0.5289	1.1087	1.0530
0.4139	5.5579	528	1.1179	0.5210	1.1179	1.0573
0.4139	5.5789	530	1.1823	0.5484	1.1823	1.0874
0.4139	5.6	532	1.2526	0.5512	1.2526	1.1192
0.4139	5.6211	534	1.3465	0.5455	1.3465	1.1604
0.4139	5.6421	536	1.4444	0.4580	1.4444	1.2018
0.4139	5.6632	538	1.4363	0.4848	1.4363	1.1985
0.4139	5.6842	540	1.2677	0.5455	1.2677	1.1259
0.4139	5.7053	542	1.1375	0.5556	1.1375	1.0665
0.4139	5.7263	544	1.1136	0.56	1.1136	1.0553
0.4139	5.7474	546	1.1545	0.5354	1.1545	1.0745
0.4139	5.7684	548	1.2546	0.5496	1.2546	1.1201
0.4139	5.7895	550	1.3697	0.5455	1.3697	1.1703
0.4139	5.8105	552	1.3391	0.5455	1.3391	1.1572
0.4139	5.8316	554	1.3474	0.5455	1.3474	1.1608
0.4139	5.8526	556	1.2762	0.5455	1.2762	1.1297
0.4139	5.8737	558	1.1436	0.5455	1.1436	1.0694
0.4139	5.8947	560	1.1263	0.5344	1.1263	1.0613
0.4139	5.9158	562	1.0836	0.5271	1.0836	1.0410
0.4139	5.9368	564	1.1333	0.5271	1.1333	1.0646
0.4139	5.9579	566	1.2054	0.5344	1.2054	1.0979
0.4139	5.9789	568	1.2326	0.5455	1.2326	1.1102
0.4139	6.0	570	1.2034	0.4724	1.2034	1.0970
0.4139	6.0211	572	1.2094	0.4724	1.2094	1.0997
0.4139	6.0421	574	1.2182	0.4724	1.2182	1.1037
0.4139	6.0632	576	1.2065	0.5231	1.2065	1.0984
0.4139	6.0842	578	1.1752	0.5496	1.1752	1.0841
0.4139	6.1053	580	1.2233	0.5455	1.2233	1.1060
0.4139	6.1263	582	1.4013	0.4962	1.4013	1.1838
0.4139	6.1474	584	1.5552	0.4118	1.5552	1.2471
0.4139	6.1684	586	1.4925	0.4412	1.4925	1.2217
0.4139	6.1895	588	1.3793	0.5224	1.3793	1.1744
0.4139	6.2105	590	1.2355	0.5224	1.2355	1.1115
0.4139	6.2316	592	1.1465	0.5455	1.1465	1.0708
0.4139	6.2526	594	1.1583	0.5455	1.1583	1.0762
0.4139	6.2737	596	1.1831	0.5414	1.1831	1.0877
0.4139	6.2947	598	1.1382	0.5414	1.1382	1.0669
0.4139	6.3158	600	1.1310	0.5455	1.1310	1.0635
0.4139	6.3368	602	1.1377	0.5414	1.1377	1.0666
0.4139	6.3579	604	1.2726	0.5037	1.2726	1.1281
0.4139	6.3789	606	1.4406	0.4672	1.4406	1.2002
0.4139	6.4	608	1.5760	0.4493	1.5760	1.2554
0.4139	6.4211	610	1.7023	0.4173	1.7023	1.3047
0.4139	6.4421	612	1.5872	0.4348	1.5872	1.2598

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1