ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2029
• Qwk: 0.1314
• Mse: 1.2029
• Rmse: 1.0968

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.5392	-0.0132	4.5392	2.1305
No log	0.0870	4	2.6144	0.0025	2.6144	1.6169
No log	0.1304	6	2.0477	-0.0634	2.0477	1.4310
No log	0.1739	8	2.4964	-0.0777	2.4964	1.5800
No log	0.2174	10	1.6546	0.0596	1.6546	1.2863
No log	0.2609	12	1.2478	0.1990	1.2478	1.1170
No log	0.3043	14	1.2637	-0.0010	1.2637	1.1241
No log	0.3478	16	1.3075	-0.0114	1.3075	1.1435
No log	0.3913	18	1.1879	0.2180	1.1879	1.0899
No log	0.4348	20	1.0978	0.3307	1.0978	1.0478
No log	0.4783	22	1.2352	0.1106	1.2352	1.1114
No log	0.5217	24	1.7188	0.1277	1.7188	1.3110
No log	0.5652	26	1.6947	0.1827	1.6947	1.3018
No log	0.6087	28	1.4720	0.1604	1.4720	1.2133
No log	0.6522	30	1.2747	0.1168	1.2747	1.1290
No log	0.6957	32	1.2740	0.1904	1.2740	1.1287
No log	0.7391	34	1.3932	0.1016	1.3932	1.1803
No log	0.7826	36	1.5722	0.0723	1.5722	1.2539
No log	0.8261	38	1.6145	0.0084	1.6145	1.2706
No log	0.8696	40	1.5704	0.0084	1.5704	1.2531
No log	0.9130	42	1.5551	0.0084	1.5551	1.2470
No log	0.9565	44	1.4364	0.0488	1.4364	1.1985
No log	1.0	46	1.2242	0.3135	1.2242	1.1065
No log	1.0435	48	1.1501	0.2678	1.1501	1.0724
No log	1.0870	50	1.2350	0.0918	1.2350	1.1113
No log	1.1304	52	1.2402	0.1080	1.2402	1.1136
No log	1.1739	54	1.2115	0.2188	1.2115	1.1007
No log	1.2174	56	1.2436	0.2188	1.2436	1.1152
No log	1.2609	58	1.2801	0.2188	1.2801	1.1314
No log	1.3043	60	1.3568	0.1246	1.3568	1.1648
No log	1.3478	62	1.3834	0.1085	1.3834	1.1762
No log	1.3913	64	1.3154	0.2123	1.3154	1.1469
No log	1.4348	66	1.2935	0.2310	1.2935	1.1373
No log	1.4783	68	1.3649	0.1251	1.3649	1.1683
No log	1.5217	70	1.5057	0.1499	1.5057	1.2271
No log	1.5652	72	1.5638	0.1499	1.5638	1.2505
No log	1.6087	74	1.3761	0.2695	1.3761	1.1731
No log	1.6522	76	1.2028	0.2831	1.2028	1.0967
No log	1.6957	78	1.1560	0.2318	1.1560	1.0752
No log	1.7391	80	1.2434	0.3478	1.2434	1.1151
No log	1.7826	82	1.2869	0.3227	1.2869	1.1344
No log	1.8261	84	1.4592	0.2378	1.4592	1.2080
No log	1.8696	86	1.2396	0.4078	1.2396	1.1134
No log	1.9130	88	1.1017	0.4841	1.1017	1.0496
No log	1.9565	90	1.1531	0.4716	1.1531	1.0738
No log	2.0	92	1.6415	0.1373	1.6415	1.2812
No log	2.0435	94	2.0876	0.0091	2.0876	1.4449
No log	2.0870	96	2.0196	0.0608	2.0196	1.4211
No log	2.1304	98	1.5143	0.1087	1.5143	1.2306
No log	2.1739	100	1.0257	0.3144	1.0257	1.0128
No log	2.2174	102	0.8991	0.4002	0.8991	0.9482
No log	2.2609	104	0.9778	0.3389	0.9778	0.9888
No log	2.3043	106	1.2039	0.1404	1.2039	1.0972
No log	2.3478	108	1.4502	0.2373	1.4502	1.2043
No log	2.3913	110	1.4162	0.2445	1.4162	1.1901
No log	2.4348	112	1.2399	0.2213	1.2399	1.1135
No log	2.4783	114	1.0548	0.2619	1.0548	1.0270
No log	2.5217	116	1.0567	0.3657	1.0567	1.0279
No log	2.5652	118	1.2290	0.4075	1.2290	1.1086
No log	2.6087	120	1.4256	0.4050	1.4256	1.1940
No log	2.6522	122	1.6953	0.1672	1.6953	1.3020
No log	2.6957	124	1.6456	0.1885	1.6456	1.2828
No log	2.7391	126	1.2541	0.4112	1.2541	1.1199
No log	2.7826	128	1.1299	0.4803	1.1299	1.0630
No log	2.8261	130	1.1623	0.4487	1.1623	1.0781
No log	2.8696	132	1.2953	0.3926	1.2953	1.1381
No log	2.9130	134	1.1062	0.3540	1.1062	1.0518
No log	2.9565	136	0.9814	0.2782	0.9814	0.9906
No log	3.0	138	0.9605	0.3122	0.9605	0.9801
No log	3.0435	140	0.9383	0.3122	0.9383	0.9686
No log	3.0870	142	0.9192	0.3463	0.9192	0.9588
No log	3.1304	144	0.9387	0.3069	0.9387	0.9689
No log	3.1739	146	0.9361	0.2997	0.9361	0.9675
No log	3.2174	148	0.9828	0.3492	0.9828	0.9913
No log	3.2609	150	1.1013	0.3528	1.1013	1.0494
No log	3.3043	152	1.2506	0.2870	1.2506	1.1183
No log	3.3478	154	1.3671	0.2544	1.3671	1.1692
No log	3.3913	156	1.6325	0.2632	1.6325	1.2777
No log	3.4348	158	1.6641	0.2574	1.6641	1.2900
No log	3.4783	160	1.6063	0.1704	1.6063	1.2674
No log	3.5217	162	1.4259	0.1698	1.4259	1.1941
No log	3.5652	164	1.1820	0.2015	1.1820	1.0872
No log	3.6087	166	1.1163	0.2432	1.1163	1.0565
No log	3.6522	168	1.1632	0.2313	1.1632	1.0785
No log	3.6957	170	1.4729	0.2512	1.4729	1.2136
No log	3.7391	172	1.7130	0.1149	1.7130	1.3088
No log	3.7826	174	1.7283	0.0841	1.7283	1.3147
No log	3.8261	176	1.6825	0.1961	1.6825	1.2971
No log	3.8696	178	1.5250	0.2789	1.5250	1.2349
No log	3.9130	180	1.2832	0.3136	1.2832	1.1328
No log	3.9565	182	1.2906	0.2634	1.2906	1.1360
No log	4.0	184	1.3170	0.2527	1.3170	1.1476
No log	4.0435	186	1.4300	0.3025	1.4300	1.1958
No log	4.0870	188	1.4174	0.2617	1.4174	1.1906
No log	4.1304	190	1.2390	0.2864	1.2390	1.1131
No log	4.1739	192	1.0971	0.2236	1.0971	1.0474
No log	4.2174	194	1.1667	0.2864	1.1667	1.0801
No log	4.2609	196	1.3769	0.2252	1.3769	1.1734
No log	4.3043	198	1.4032	0.1935	1.4032	1.1846
No log	4.3478	200	1.3006	0.1345	1.3006	1.1404
No log	4.3913	202	1.2641	0.2570	1.2641	1.1243
No log	4.4348	204	1.1539	0.1952	1.1539	1.0742
No log	4.4783	206	1.0315	0.2446	1.0315	1.0156
No log	4.5217	208	0.9838	0.2574	0.9838	0.9918
No log	4.5652	210	1.1298	0.3398	1.1298	1.0629
No log	4.6087	212	1.4697	0.3302	1.4697	1.2123
No log	4.6522	214	1.6553	0.2217	1.6553	1.2866
No log	4.6957	216	1.5817	0.1051	1.5817	1.2576
No log	4.7391	218	1.3477	0.1031	1.3477	1.1609
No log	4.7826	220	1.1472	0.1219	1.1472	1.0711
No log	4.8261	222	1.0066	0.2761	1.0066	1.0033
No log	4.8696	224	0.9602	0.3271	0.9602	0.9799
No log	4.9130	226	0.9673	0.2871	0.9673	0.9835
No log	4.9565	228	1.0336	0.3584	1.0336	1.0167
No log	5.0	230	1.3019	0.2701	1.3019	1.1410
No log	5.0435	232	1.5647	0.3371	1.5647	1.2509
No log	5.0870	234	1.5615	0.3572	1.5615	1.2496
No log	5.1304	236	1.2731	0.2903	1.2731	1.1283
No log	5.1739	238	1.0604	0.3394	1.0604	1.0298
No log	5.2174	240	1.0277	0.3572	1.0277	1.0138
No log	5.2609	242	1.0332	0.3572	1.0332	1.0165
No log	5.3043	244	1.0896	0.3182	1.0896	1.0439
No log	5.3478	246	1.1936	0.2664	1.1936	1.0925
No log	5.3913	248	1.3544	0.2632	1.3544	1.1638
No log	5.4348	250	1.3202	0.1886	1.3202	1.1490
No log	5.4783	252	1.1636	0.2131	1.1636	1.0787
No log	5.5217	254	1.0955	0.2927	1.0955	1.0467
No log	5.5652	256	1.0594	0.3217	1.0594	1.0293
No log	5.6087	258	1.1166	0.2743	1.1166	1.0567
No log	5.6522	260	1.3774	0.2009	1.3774	1.1736
No log	5.6957	262	1.5096	0.3173	1.5096	1.2287
No log	5.7391	264	1.4655	0.3157	1.4655	1.2106
No log	5.7826	266	1.3159	0.2359	1.3159	1.1471
No log	5.8261	268	1.1554	0.2743	1.1554	1.0749
No log	5.8696	270	1.1776	0.2367	1.1776	1.0852
No log	5.9130	272	1.2518	0.1935	1.2518	1.1188
No log	5.9565	274	1.2169	0.1935	1.2169	1.1032
No log	6.0	276	1.1153	0.2402	1.1153	1.0561
No log	6.0435	278	1.1287	0.2475	1.1287	1.0624
No log	6.0870	280	1.2534	0.2617	1.2534	1.1195
No log	6.1304	282	1.4693	0.2632	1.4693	1.2121
No log	6.1739	284	1.6402	0.3219	1.6402	1.2807
No log	6.2174	286	1.5983	0.3383	1.5983	1.2642
No log	6.2609	288	1.3257	0.2903	1.3257	1.1514
No log	6.3043	290	1.1478	0.3438	1.1478	1.0714
No log	6.3478	292	1.0507	0.2998	1.0507	1.0250
No log	6.3913	294	1.1047	0.2930	1.1047	1.0510
No log	6.4348	296	1.2789	0.2586	1.2789	1.1309
No log	6.4783	298	1.3120	0.2173	1.3120	1.1454
No log	6.5217	300	1.2591	0.1745	1.2591	1.1221
No log	6.5652	302	1.1680	0.1538	1.1680	1.0808
No log	6.6087	304	1.1659	0.1538	1.1659	1.0797
No log	6.6522	306	1.1209	0.1696	1.1209	1.0587
No log	6.6957	308	1.2066	0.1637	1.2066	1.0985
No log	6.7391	310	1.2638	0.1440	1.2638	1.1242
No log	6.7826	312	1.3769	0.1345	1.3769	1.1734
No log	6.8261	314	1.3734	0.1345	1.3734	1.1719
No log	6.8696	316	1.2693	0.1031	1.2693	1.1266
No log	6.9130	318	1.1633	0.1440	1.1633	1.0786
No log	6.9565	320	1.0853	0.1853	1.0853	1.0418
No log	7.0	322	1.1152	0.1596	1.1152	1.0560
No log	7.0435	324	1.1855	0.1889	1.1855	1.0888
No log	7.0870	326	1.2450	0.2213	1.2450	1.1158
No log	7.1304	328	1.2107	0.2512	1.2107	1.1003
No log	7.1739	330	1.0909	0.3046	1.0909	1.0445
No log	7.2174	332	1.0593	0.2857	1.0593	1.0292
No log	7.2609	334	1.1187	0.2602	1.1187	1.0577
No log	7.3043	336	1.2518	0.2512	1.2518	1.1189
No log	7.3478	338	1.3570	0.2815	1.3570	1.1649
No log	7.3913	340	1.2896	0.2512	1.2896	1.1356
No log	7.4348	342	1.0702	0.2250	1.0702	1.0345
No log	7.4783	344	1.0311	0.2417	1.0311	1.0154
No log	7.5217	346	1.1570	0.2348	1.1570	1.0757
No log	7.5652	348	1.2662	0.2586	1.2662	1.1253
No log	7.6087	350	1.3178	0.2479	1.3178	1.1480
No log	7.6522	352	1.2701	0.2317	1.2701	1.1270
No log	7.6957	354	1.2136	0.2278	1.2136	1.1016
No log	7.7391	356	1.0983	0.2046	1.0983	1.0480
No log	7.7826	358	0.9794	0.2219	0.9794	0.9896
No log	7.8261	360	0.9578	0.2219	0.9578	0.9787
No log	7.8696	362	1.0577	0.2884	1.0577	1.0284
No log	7.9130	364	1.2212	0.2725	1.2212	1.1051
No log	7.9565	366	1.2612	0.2586	1.2612	1.1230
No log	8.0	368	1.1840	0.1896	1.1840	1.0881
No log	8.0435	370	1.1137	0.2108	1.1137	1.0553
No log	8.0870	372	1.1028	0.1417	1.1028	1.0502
No log	8.1304	374	1.1177	0.1076	1.1177	1.0572
No log	8.1739	376	1.1774	0.1440	1.1774	1.0851
No log	8.2174	378	1.1361	0.2195	1.1361	1.0659
No log	8.2609	380	1.0240	0.2650	1.0240	1.0119
No log	8.3043	382	0.8850	0.3217	0.8850	0.9408
No log	8.3478	384	0.8449	0.4665	0.8449	0.9192
No log	8.3913	386	0.8725	0.3753	0.8725	0.9341
No log	8.4348	388	0.9889	0.2654	0.9889	0.9944
No log	8.4783	390	1.2072	0.2330	1.2072	1.0987
No log	8.5217	392	1.3014	0.2956	1.3014	1.1408
No log	8.5652	394	1.3158	0.2678	1.3158	1.1471
No log	8.6087	396	1.2944	0.1889	1.2944	1.1377
No log	8.6522	398	1.2360	0.2046	1.2360	1.1117
No log	8.6957	400	1.1788	0.1379	1.1788	1.0857
No log	8.7391	402	1.1893	0.1379	1.1893	1.0905
No log	8.7826	404	1.1982	0.1185	1.1982	1.0946
No log	8.8261	406	1.2300	0.1500	1.2300	1.1091
No log	8.8696	408	1.2433	0.2184	1.2433	1.1151
No log	8.9130	410	1.2045	0.3115	1.2045	1.0975
No log	8.9565	412	1.2186	0.3115	1.2186	1.1039
No log	9.0	414	1.1260	0.2978	1.1260	1.0611
No log	9.0435	416	1.0312	0.1808	1.0312	1.0155
No log	9.0870	418	1.0507	0.1808	1.0507	1.0250
No log	9.1304	420	1.1099	0.1903	1.1099	1.0535
No log	9.1739	422	1.1134	0.1903	1.1134	1.0552
No log	9.2174	424	1.1689	0.1750	1.1689	1.0811
No log	9.2609	426	1.2286	0.2586	1.2286	1.1084
No log	9.3043	428	1.2082	0.1440	1.2082	1.0992
No log	9.3478	430	1.1264	0.1952	1.1264	1.0613
No log	9.3913	432	1.0672	0.1417	1.0672	1.0331
No log	9.4348	434	1.0777	0.1417	1.0777	1.0381
No log	9.4783	436	1.1117	0.1750	1.1117	1.0544
No log	9.5217	438	1.1291	0.2439	1.1291	1.0626
No log	9.5652	440	1.1076	0.2439	1.1076	1.0524
No log	9.6087	442	1.0772	0.2439	1.0772	1.0379
No log	9.6522	444	1.1110	0.2439	1.1110	1.0541
No log	9.6957	446	1.1072	0.1846	1.1072	1.0522
No log	9.7391	448	1.0584	0.1480	1.0584	1.0288
No log	9.7826	450	1.0355	0.1645	1.0355	1.0176
No log	9.8261	452	1.0844	0.1750	1.0844	1.0413
No log	9.8696	454	1.2107	0.2553	1.2107	1.1003
No log	9.9130	456	1.2892	0.2707	1.2892	1.1354
No log	9.9565	458	1.2531	0.3433	1.2531	1.1194
No log	10.0	460	1.0939	0.2837	1.0939	1.0459
No log	10.0435	462	1.0292	0.3023	1.0292	1.0145
No log	10.0870	464	1.0794	0.2291	1.0794	1.0389
No log	10.1304	466	1.1702	0.1991	1.1702	1.0818
No log	10.1739	468	1.2384	0.1592	1.2384	1.1128
No log	10.2174	470	1.2424	0.1031	1.2424	1.1146
No log	10.2609	472	1.2259	0.0454	1.2259	1.1072
No log	10.3043	474	1.2069	0.0904	1.2069	1.0986
No log	10.3478	476	1.1624	0.1316	1.1624	1.0782
No log	10.3913	478	1.2126	0.1991	1.2126	1.1012
No log	10.4348	480	1.2176	0.2278	1.2176	1.1034
No log	10.4783	482	1.3145	0.2870	1.3145	1.1465
No log	10.5217	484	1.3001	0.2870	1.3001	1.1402
No log	10.5652	486	1.3289	0.3332	1.3289	1.1528
No log	10.6087	488	1.2368	0.2725	1.2368	1.1121
No log	10.6522	490	1.1117	0.1541	1.1117	1.0544
No log	10.6957	492	1.0247	0.1649	1.0247	1.0123
No log	10.7391	494	1.0233	0.1649	1.0233	1.0116
No log	10.7826	496	1.0247	0.1649	1.0247	1.0123
No log	10.8261	498	1.0879	0.1585	1.0879	1.0430
0.397	10.8696	500	1.2421	0.1316	1.2421	1.1145
0.397	10.9130	502	1.3193	0.2195	1.3193	1.1486
0.397	10.9565	504	1.3265	0.1316	1.3265	1.1517
0.397	11.0	506	1.3356	0.1316	1.3356	1.1557
0.397	11.0435	508	1.3610	0.0887	1.3610	1.1666
0.397	11.0870	510	1.3867	0.0887	1.3867	1.1776
0.397	11.1304	512	1.3798	0.1497	1.3798	1.1746
0.397	11.1739	514	1.3254	0.0798	1.3254	1.1513
0.397	11.2174	516	1.2646	0.0541	1.2646	1.1245
0.397	11.2609	518	1.2185	0.0541	1.2185	1.1038
0.397	11.3043	520	1.1613	0.1479	1.1613	1.0776
0.397	11.3478	522	1.1411	0.1541	1.1411	1.0682
0.397	11.3913	524	1.1351	0.1853	1.1351	1.0654
0.397	11.4348	526	1.1924	0.1696	1.1924	1.0920
0.397	11.4783	528	1.2822	0.2519	1.2822	1.1324
0.397	11.5217	530	1.3609	0.2173	1.3609	1.1666
0.397	11.5652	532	1.3422	0.1126	1.3422	1.1585
0.397	11.6087	534	1.3196	0.0098	1.3196	1.1487
0.397	11.6522	536	1.2945	0.0454	1.2945	1.1378
0.397	11.6957	538	1.2651	0.0454	1.2651	1.1248
0.397	11.7391	540	1.2029	0.1314	1.2029	1.0968

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1