ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1220
• Qwk: 0.2702
• Mse: 1.1220
• Rmse: 1.0593

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0244	2	4.5160	0.0010	4.5160	2.1251
No log	0.0488	4	2.4769	0.0433	2.4769	1.5738
No log	0.0732	6	1.6878	0.0372	1.6878	1.2991
No log	0.0976	8	1.3889	0.0141	1.3889	1.1785
No log	0.1220	10	1.3468	-0.0463	1.3468	1.1605
No log	0.1463	12	1.3591	0.1014	1.3591	1.1658
No log	0.1707	14	1.3268	0.0922	1.3268	1.1519
No log	0.1951	16	1.2379	0.1044	1.2379	1.1126
No log	0.2195	18	1.2382	0.0825	1.2382	1.1127
No log	0.2439	20	1.2623	0.0186	1.2623	1.1235
No log	0.2683	22	1.2766	0.0613	1.2766	1.1299
No log	0.2927	24	1.2263	0.0464	1.2263	1.1074
No log	0.3171	26	1.2565	0.0519	1.2565	1.1209
No log	0.3415	28	1.3961	0.0872	1.3961	1.1816
No log	0.3659	30	1.4524	0.0955	1.4524	1.2052
No log	0.3902	32	1.2806	0.1691	1.2806	1.1316
No log	0.4146	34	1.2694	0.2108	1.2694	1.1267
No log	0.4390	36	1.5217	0.2037	1.5217	1.2336
No log	0.4634	38	1.5073	0.1697	1.5073	1.2277
No log	0.4878	40	1.3421	0.2363	1.3421	1.1585
No log	0.5122	42	1.2339	0.0442	1.2339	1.1108
No log	0.5366	44	1.2104	0.0925	1.2104	1.1002
No log	0.5610	46	1.3817	0.1165	1.3817	1.1755
No log	0.5854	48	1.5065	0.0403	1.5065	1.2274
No log	0.6098	50	1.4160	0.0488	1.4160	1.1900
No log	0.6341	52	1.3564	0.0811	1.3564	1.1646
No log	0.6585	54	1.2789	0.1288	1.2789	1.1309
No log	0.6829	56	1.2942	0.0186	1.2942	1.1376
No log	0.7073	58	1.2162	0.2619	1.2162	1.1028
No log	0.7317	60	1.1816	0.0353	1.1816	1.0870
No log	0.7561	62	1.2014	0.0454	1.2014	1.0961
No log	0.7805	64	1.2200	0.0442	1.2200	1.1045
No log	0.8049	66	1.1525	0.1808	1.1525	1.0736
No log	0.8293	68	1.1330	0.1747	1.1330	1.0644
No log	0.8537	70	1.1217	0.2782	1.1217	1.0591
No log	0.8780	72	1.1725	0.2188	1.1725	1.0828
No log	0.9024	74	1.5871	0.1691	1.5871	1.2598
No log	0.9268	76	1.8033	0.0439	1.8033	1.3429
No log	0.9512	78	1.6945	0.1148	1.6945	1.3017
No log	0.9756	80	1.3720	0.2893	1.3720	1.1713
No log	1.0	82	1.2356	0.3361	1.2356	1.1116
No log	1.0244	84	1.1817	0.3540	1.1817	1.0871
No log	1.0488	86	1.0752	0.3926	1.0752	1.0369
No log	1.0732	88	1.0412	0.4702	1.0412	1.0204
No log	1.0976	90	1.0294	0.4882	1.0294	1.0146
No log	1.1220	92	1.1156	0.3610	1.1156	1.0562
No log	1.1463	94	1.5496	0.2498	1.5496	1.2448
No log	1.1707	96	1.7609	0.2220	1.7609	1.3270
No log	1.1951	98	1.5485	0.3189	1.5485	1.2444
No log	1.2195	100	1.0961	0.3000	1.0961	1.0470
No log	1.2439	102	0.9720	0.4180	0.9720	0.9859
No log	1.2683	104	0.9905	0.3927	0.9905	0.9952
No log	1.2927	106	1.0347	0.2640	1.0347	1.0172
No log	1.3171	108	1.3113	0.1889	1.3113	1.1451
No log	1.3415	110	1.6959	0.1806	1.6959	1.3023
No log	1.3659	112	1.8236	0.2370	1.8236	1.3504
No log	1.3902	114	1.7341	0.1702	1.7341	1.3168
No log	1.4146	116	1.4993	0.2011	1.4993	1.2245
No log	1.4390	118	1.4029	0.1818	1.4029	1.1844
No log	1.4634	120	1.4591	0.1308	1.4591	1.2079
No log	1.4878	122	1.6893	0.1386	1.6893	1.2997
No log	1.5122	124	1.8914	-0.0064	1.8914	1.3753
No log	1.5366	126	1.9200	-0.0384	1.9200	1.3856
No log	1.5610	128	1.7434	0.0817	1.7434	1.3204
No log	1.5854	130	1.5372	0.2181	1.5372	1.2399
No log	1.6098	132	1.5170	0.2525	1.5170	1.2317
No log	1.6341	134	1.5691	0.2612	1.5691	1.2526
No log	1.6585	136	1.6965	0.2568	1.6965	1.3025
No log	1.6829	138	1.8457	0.1814	1.8457	1.3586
No log	1.7073	140	1.7455	0.2148	1.7455	1.3212
No log	1.7317	142	1.4473	0.3467	1.4473	1.2031
No log	1.7561	144	1.2358	0.3570	1.2358	1.1117
No log	1.7805	146	1.0829	0.4167	1.0829	1.0406
No log	1.8049	148	1.1563	0.4025	1.1563	1.0753
No log	1.8293	150	1.3891	0.3608	1.3891	1.1786
No log	1.8537	152	1.4670	0.3243	1.4670	1.2112
No log	1.8780	154	1.5913	0.1959	1.5913	1.2615
No log	1.9024	156	1.6286	0.1588	1.6286	1.2761
No log	1.9268	158	1.6215	0.1426	1.6215	1.2734
No log	1.9512	160	1.5464	0.2014	1.5464	1.2436
No log	1.9756	162	1.4063	0.2940	1.4063	1.1859
No log	2.0	164	1.4274	0.2806	1.4274	1.1947
No log	2.0244	166	1.6161	0.3024	1.6161	1.2712
No log	2.0488	168	1.8649	0.1631	1.8649	1.3656
No log	2.0732	170	1.8567	0.1664	1.8567	1.3626
No log	2.0976	172	1.6225	0.2353	1.6225	1.2738
No log	2.1220	174	1.4356	0.3185	1.4356	1.1982
No log	2.1463	176	1.4899	0.3730	1.4899	1.2206
No log	2.1707	178	1.5803	0.2645	1.5803	1.2571
No log	2.1951	180	1.5195	0.2989	1.5195	1.2327
No log	2.2195	182	1.3202	0.3667	1.3202	1.1490
No log	2.2439	184	1.1215	0.3816	1.1215	1.0590
No log	2.2683	186	1.1390	0.4375	1.1390	1.0672
No log	2.2927	188	1.2548	0.4325	1.2548	1.1202
No log	2.3171	190	1.4361	0.3200	1.4361	1.1984
No log	2.3415	192	1.2939	0.3912	1.2939	1.1375
No log	2.3659	194	1.1011	0.3624	1.1011	1.0493
No log	2.3902	196	1.1986	0.4479	1.1986	1.0948
No log	2.4146	198	1.4321	0.4109	1.4321	1.1967
No log	2.4390	200	1.4296	0.3701	1.4296	1.1957
No log	2.4634	202	1.3853	0.3490	1.3853	1.1770
No log	2.4878	204	1.3495	0.2981	1.3495	1.1617
No log	2.5122	206	1.2685	0.3647	1.2685	1.1263
No log	2.5366	208	1.2254	0.3809	1.2254	1.1070
No log	2.5610	210	1.1943	0.4257	1.1943	1.0928
No log	2.5854	212	1.1839	0.4287	1.1839	1.0881
No log	2.6098	214	1.3144	0.4216	1.3144	1.1465
No log	2.6341	216	1.4334	0.3438	1.4334	1.1972
No log	2.6585	218	1.5299	0.3511	1.5299	1.2369
No log	2.6829	220	1.4030	0.3615	1.4030	1.1845
No log	2.7073	222	1.2675	0.3487	1.2675	1.1258
No log	2.7317	224	1.1940	0.3024	1.1940	1.0927
No log	2.7561	226	1.2059	0.2851	1.2059	1.0981
No log	2.7805	228	1.2335	0.3332	1.2335	1.1106
No log	2.8049	230	1.2249	0.3667	1.2249	1.1067
No log	2.8293	232	1.1313	0.2951	1.1313	1.0636
No log	2.8537	234	1.0848	0.3621	1.0848	1.0415
No log	2.8780	236	1.1449	0.3326	1.1449	1.0700
No log	2.9024	238	1.3843	0.3281	1.3843	1.1766
No log	2.9268	240	1.5362	0.3379	1.5362	1.2394
No log	2.9512	242	1.5205	0.3324	1.5205	1.2331
No log	2.9756	244	1.3188	0.2143	1.3188	1.1484
No log	3.0	246	1.2357	0.2317	1.2357	1.1116
No log	3.0244	248	1.2573	0.1706	1.2573	1.1213
No log	3.0488	250	1.3544	0.1405	1.3544	1.1638
No log	3.0732	252	1.4275	0.1758	1.4275	1.1948
No log	3.0976	254	1.5583	0.3163	1.5583	1.2483
No log	3.1220	256	1.6102	0.2268	1.6102	1.2690
No log	3.1463	258	1.4957	0.3197	1.4957	1.2230
No log	3.1707	260	1.4440	0.3163	1.4440	1.2017
No log	3.1951	262	1.5709	0.3134	1.5709	1.2534
No log	3.2195	264	1.4983	0.3227	1.4983	1.2241
No log	3.2439	266	1.3562	0.2542	1.3562	1.1646
No log	3.2683	268	1.3638	0.2542	1.3638	1.1678
No log	3.2927	270	1.4797	0.3687	1.4797	1.2164
No log	3.3171	272	1.4930	0.3615	1.4930	1.2219
No log	3.3415	274	1.2928	0.2743	1.2928	1.1370
No log	3.3659	276	1.1424	0.2371	1.1424	1.0688
No log	3.3902	278	1.1255	0.1977	1.1255	1.0609
No log	3.4146	280	1.1875	0.2164	1.1875	1.0897
No log	3.4390	282	1.3296	0.2615	1.3296	1.1531
No log	3.4634	284	1.4152	0.2341	1.4152	1.1896
No log	3.4878	286	1.3731	0.2707	1.3731	1.1718
No log	3.5122	288	1.3446	0.2910	1.3446	1.1596
No log	3.5366	290	1.3166	0.3174	1.3166	1.1474
No log	3.5610	292	1.3410	0.3537	1.3410	1.1580
No log	3.5854	294	1.4622	0.3404	1.4622	1.2092
No log	3.6098	296	1.4039	0.3309	1.4039	1.1848
No log	3.6341	298	1.2520	0.3607	1.2520	1.1189
No log	3.6585	300	1.1464	0.2317	1.1464	1.0707
No log	3.6829	302	1.1610	0.1761	1.1610	1.0775
No log	3.7073	304	1.2799	0.2304	1.2799	1.1313
No log	3.7317	306	1.4780	0.3005	1.4780	1.2157
No log	3.7561	308	1.6780	0.2835	1.6780	1.2954
No log	3.7805	310	1.7135	0.2693	1.7135	1.3090
No log	3.8049	312	1.5843	0.3140	1.5843	1.2587
No log	3.8293	314	1.2967	0.3026	1.2967	1.1387
No log	3.8537	316	1.1547	0.2317	1.1547	1.0746
No log	3.8780	318	1.1485	0.2604	1.1485	1.0717
No log	3.9024	320	1.1366	0.3263	1.1366	1.0661
No log	3.9268	322	1.2161	0.3657	1.2161	1.1027
No log	3.9512	324	1.4082	0.4109	1.4082	1.1867
No log	3.9756	326	1.7027	0.1814	1.7027	1.3049
No log	4.0	328	1.7780	0.1686	1.7780	1.3334
No log	4.0244	330	1.5531	0.3759	1.5531	1.2462
No log	4.0488	332	1.3779	0.3108	1.3779	1.1738
No log	4.0732	334	1.2677	0.2417	1.2677	1.1259
No log	4.0976	336	1.2355	0.1379	1.2355	1.1115
No log	4.1220	338	1.2610	0.1315	1.2610	1.1229
No log	4.1463	340	1.2605	0.0880	1.2605	1.1227
No log	4.1707	342	1.2875	0.1379	1.2875	1.1347
No log	4.1951	344	1.2739	0.2651	1.2739	1.1287
No log	4.2195	346	1.2352	0.2636	1.2352	1.1114
No log	4.2439	348	1.2751	0.3201	1.2751	1.1292
No log	4.2683	350	1.2496	0.2755	1.2496	1.1179
No log	4.2927	352	1.1883	0.3249	1.1883	1.0901
No log	4.3171	354	1.2243	0.2930	1.2243	1.1065
No log	4.3415	356	1.3075	0.2978	1.3075	1.1434
No log	4.3659	358	1.3839	0.2875	1.3839	1.1764
No log	4.3902	360	1.3991	0.3127	1.3991	1.1828
No log	4.4146	362	1.3558	0.2981	1.3558	1.1644
No log	4.4390	364	1.3198	0.3438	1.3198	1.1488
No log	4.4634	366	1.2882	0.3201	1.2882	1.1350
No log	4.4878	368	1.2870	0.3274	1.2870	1.1344
No log	4.5122	370	1.3899	0.3332	1.3899	1.1789
No log	4.5366	372	1.5008	0.2987	1.5008	1.2251
No log	4.5610	374	1.4730	0.3302	1.4730	1.2137
No log	4.5854	376	1.3499	0.2736	1.3499	1.1618
No log	4.6098	378	1.1776	0.2119	1.1776	1.0852
No log	4.6341	380	1.0925	0.1443	1.0925	1.0452
No log	4.6585	382	1.1015	0.2019	1.1015	1.0495
No log	4.6829	384	1.1344	0.3119	1.1344	1.0651
No log	4.7073	386	1.2496	0.3562	1.2496	1.1178
No log	4.7317	388	1.2326	0.3461	1.2326	1.1102
No log	4.7561	390	1.1798	0.3460	1.1798	1.0862
No log	4.7805	392	1.2022	0.3307	1.2022	1.0964
No log	4.8049	394	1.1673	0.1961	1.1673	1.0804
No log	4.8293	396	1.1489	0.1443	1.1489	1.0719
No log	4.8537	398	1.1748	0.2019	1.1748	1.0839
No log	4.8780	400	1.3410	0.3952	1.3410	1.1580
No log	4.9024	402	1.6524	0.3043	1.6524	1.2854
No log	4.9268	404	1.8523	0.1941	1.8523	1.3610
No log	4.9512	406	1.8426	0.1909	1.8426	1.3574
No log	4.9756	408	1.6095	0.3026	1.6095	1.2687
No log	5.0	410	1.3274	0.3442	1.3274	1.1521
No log	5.0244	412	1.2560	0.3317	1.2560	1.1207
No log	5.0488	414	1.2106	0.3046	1.2106	1.1003
No log	5.0732	416	1.2496	0.3317	1.2496	1.1179
No log	5.0976	418	1.3705	0.3676	1.3705	1.1707
No log	5.1220	420	1.3635	0.3478	1.3635	1.1677
No log	5.1463	422	1.3495	0.3545	1.3495	1.1617
No log	5.1707	424	1.3509	0.3105	1.3509	1.1623
No log	5.1951	426	1.2743	0.3155	1.2743	1.1289
No log	5.2195	428	1.2765	0.2602	1.2765	1.1298
No log	5.2439	430	1.2659	0.2250	1.2659	1.1251
No log	5.2683	432	1.2698	0.1755	1.2698	1.1269
No log	5.2927	434	1.3151	0.1696	1.3151	1.1468
No log	5.3171	436	1.3563	0.1750	1.3563	1.1646
No log	5.3415	438	1.4621	0.3152	1.4621	1.2092
No log	5.3659	440	1.5350	0.2915	1.5350	1.2390
No log	5.3902	442	1.5003	0.3392	1.5003	1.2249
No log	5.4146	444	1.3510	0.3025	1.3510	1.1623
No log	5.4390	446	1.1541	0.2654	1.1541	1.0743
No log	5.4634	448	1.0690	0.2640	1.0690	1.0339
No log	5.4878	450	1.0581	0.2640	1.0581	1.0287
No log	5.5122	452	1.1443	0.2470	1.1443	1.0697
No log	5.5366	454	1.2896	0.3357	1.2896	1.1356
No log	5.5610	456	1.3392	0.2938	1.3392	1.1572
No log	5.5854	458	1.3911	0.3087	1.3911	1.1795
No log	5.6098	460	1.3570	0.2747	1.3570	1.1649
No log	5.6341	462	1.2547	0.2634	1.2547	1.1201
No log	5.6585	464	1.2397	0.2330	1.2397	1.1134
No log	5.6829	466	1.2872	0.3679	1.2872	1.1345
No log	5.7073	468	1.2544	0.3601	1.2544	1.1200
No log	5.7317	470	1.1460	0.3474	1.1460	1.0705
No log	5.7561	472	1.0535	0.2175	1.0535	1.0264
No log	5.7805	474	1.0176	0.1727	1.0176	1.0087
No log	5.8049	476	1.0270	0.2231	1.0270	1.0134
No log	5.8293	478	1.0797	0.2702	1.0797	1.0391
No log	5.8537	480	1.1699	0.3730	1.1699	1.0816
No log	5.8780	482	1.2778	0.3641	1.2778	1.1304
No log	5.9024	484	1.3340	0.3805	1.3340	1.1550
No log	5.9268	486	1.2466	0.3538	1.2466	1.1165
No log	5.9512	488	1.1236	0.2417	1.1236	1.0600
No log	5.9756	490	1.0478	0.1605	1.0478	1.0236
No log	6.0	492	1.0543	0.2175	1.0543	1.0268
No log	6.0244	494	1.0868	0.2904	1.0868	1.0425
No log	6.0488	496	1.0839	0.3647	1.0839	1.0411
No log	6.0732	498	1.2013	0.4154	1.2013	1.0960
0.3907	6.0976	500	1.3599	0.3835	1.3599	1.1661
0.3907	6.1220	502	1.3622	0.3835	1.3622	1.1671
0.3907	6.1463	504	1.2224	0.3693	1.2224	1.1056
0.3907	6.1707	506	1.1120	0.3844	1.1120	1.0545
0.3907	6.1951	508	1.1074	0.3747	1.1074	1.0523
0.3907	6.2195	510	1.1251	0.3739	1.1251	1.0607
0.3907	6.2439	512	1.1249	0.2702	1.1249	1.0606
0.3907	6.2683	514	1.1365	0.2702	1.1365	1.0661
0.3907	6.2927	516	1.1220	0.2702	1.1220	1.0593

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1