ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1634
• Qwk: 0.2686
• Mse: 1.1634
• Rmse: 1.0786

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	4.7344	0.0010	4.7344	2.1759
No log	0.8	4	2.7974	-0.0187	2.7974	1.6725
No log	1.2	6	1.9628	-0.0164	1.9628	1.4010
No log	1.6	8	1.6012	0.0559	1.6012	1.2654
No log	2.0	10	1.3000	0.1530	1.3000	1.1402
No log	2.4	12	1.2599	0.1176	1.2599	1.1224
No log	2.8	14	1.2753	0.1044	1.2753	1.1293
No log	3.2	16	1.2344	0.1370	1.2344	1.1110
No log	3.6	18	1.2218	0.1532	1.2218	1.1053
No log	4.0	20	1.2376	0.0854	1.2376	1.1125
No log	4.4	22	1.2864	0.0587	1.2864	1.1342
No log	4.8	24	1.3156	0.0677	1.3156	1.1470
No log	5.2	26	1.4538	0.0800	1.4538	1.2057
No log	5.6	28	1.4483	0.0681	1.4483	1.2034
No log	6.0	30	1.3249	0.1328	1.3249	1.1510
No log	6.4	32	1.2951	0.1646	1.2951	1.1380
No log	6.8	34	1.2466	0.2146	1.2466	1.1165
No log	7.2	36	1.2534	0.2572	1.2534	1.1196
No log	7.6	38	1.2475	0.2374	1.2475	1.1169
No log	8.0	40	1.2914	0.3069	1.2914	1.1364
No log	8.4	42	1.3241	0.1667	1.3241	1.1507
No log	8.8	44	1.2455	0.2640	1.2455	1.1160
No log	9.2	46	1.2372	0.1477	1.2372	1.1123
No log	9.6	48	1.2592	0.1513	1.2592	1.1221
No log	10.0	50	1.3031	0.2076	1.3031	1.1415
No log	10.4	52	1.2482	0.1331	1.2482	1.1172
No log	10.8	54	1.2344	0.1620	1.2344	1.1110
No log	11.2	56	1.2396	0.1536	1.2396	1.1134
No log	11.6	58	1.2008	0.1719	1.2008	1.0958
No log	12.0	60	1.1918	0.3093	1.1918	1.0917
No log	12.4	62	1.2577	0.2108	1.2577	1.1215
No log	12.8	64	1.1734	0.2130	1.1734	1.0832
No log	13.2	66	1.1137	0.2145	1.1137	1.0553
No log	13.6	68	1.1383	0.2222	1.1383	1.0669
No log	14.0	70	1.1338	0.1301	1.1338	1.0648
No log	14.4	72	1.1770	0.2351	1.1770	1.0849
No log	14.8	74	1.2102	0.2351	1.2102	1.1001
No log	15.2	76	1.1717	0.2142	1.1717	1.0824
No log	15.6	78	1.1858	0.2612	1.1858	1.0889
No log	16.0	80	1.1977	0.2468	1.1977	1.0944
No log	16.4	82	1.2326	0.3045	1.2326	1.1102
No log	16.8	84	1.2478	0.3045	1.2478	1.1170
No log	17.2	86	1.2566	0.2176	1.2566	1.1210
No log	17.6	88	1.2915	0.2461	1.2915	1.1365
No log	18.0	90	1.2705	0.1881	1.2705	1.1271
No log	18.4	92	1.2330	0.2092	1.2330	1.1104
No log	18.8	94	1.2228	0.2092	1.2228	1.1058
No log	19.2	96	1.2120	0.3191	1.2120	1.1009
No log	19.6	98	1.1977	0.3165	1.1977	1.0944
No log	20.0	100	1.1608	0.2661	1.1608	1.0774
No log	20.4	102	1.1760	0.2823	1.1760	1.0844
No log	20.8	104	1.1484	0.2034	1.1484	1.0716
No log	21.2	106	1.1778	0.3326	1.1778	1.0853
No log	21.6	108	1.1900	0.1655	1.1900	1.0909
No log	22.0	110	1.2300	0.1843	1.2300	1.1090
No log	22.4	112	1.2469	0.1805	1.2469	1.1167
No log	22.8	114	1.2756	0.2474	1.2756	1.1294
No log	23.2	116	1.3341	0.1546	1.3341	1.1550
No log	23.6	118	1.4008	0.1396	1.4008	1.1836
No log	24.0	120	1.3596	0.1363	1.3596	1.1660
No log	24.4	122	1.3529	0.1849	1.3529	1.1631
No log	24.8	124	1.3498	0.1609	1.3498	1.1618
No log	25.2	126	1.3097	0.1551	1.3097	1.1444
No log	25.6	128	1.4055	0.1764	1.4055	1.1855
No log	26.0	130	1.5406	0.1670	1.5406	1.2412
No log	26.4	132	1.5292	0.1929	1.5292	1.2366
No log	26.8	134	1.4107	0.1558	1.4107	1.1877
No log	27.2	136	1.3601	0.2030	1.3601	1.1662
No log	27.6	138	1.3626	0.2291	1.3626	1.1673
No log	28.0	140	1.4633	0.2317	1.4633	1.2097
No log	28.4	142	1.4825	0.2101	1.4825	1.2176
No log	28.8	144	1.3593	0.1957	1.3593	1.1659
No log	29.2	146	1.2842	0.2083	1.2842	1.1332
No log	29.6	148	1.3001	0.1745	1.3001	1.1402
No log	30.0	150	1.3119	0.1890	1.3119	1.1454
No log	30.4	152	1.3099	0.2313	1.3099	1.1445
No log	30.8	154	1.2684	0.1150	1.2684	1.1262
No log	31.2	156	1.2645	0.2092	1.2645	1.1245
No log	31.6	158	1.2690	0.2092	1.2690	1.1265
No log	32.0	160	1.2980	0.1732	1.2980	1.1393
No log	32.4	162	1.3798	0.2261	1.3798	1.1747
No log	32.8	164	1.3637	0.2000	1.3637	1.1678
No log	33.2	166	1.3207	0.2294	1.3207	1.1492
No log	33.6	168	1.2652	0.2156	1.2652	1.1248
No log	34.0	170	1.2287	0.2156	1.2287	1.1085
No log	34.4	172	1.2041	0.1951	1.2041	1.0973
No log	34.8	174	1.2158	0.2156	1.2158	1.1026
No log	35.2	176	1.2458	0.2686	1.2458	1.1162
No log	35.6	178	1.2652	0.2417	1.2652	1.1248
No log	36.0	180	1.2472	0.2021	1.2472	1.1168
No log	36.4	182	1.2596	0.2417	1.2596	1.1223
No log	36.8	184	1.3396	0.3220	1.3396	1.1574
No log	37.2	186	1.4192	0.1890	1.4192	1.1913
No log	37.6	188	1.3415	0.3023	1.3415	1.1582
No log	38.0	190	1.2081	0.1850	1.2081	1.0991
No log	38.4	192	1.1992	0.2138	1.1992	1.0951
No log	38.8	194	1.1931	0.2177	1.1931	1.0923
No log	39.2	196	1.2103	0.1614	1.2103	1.1001
No log	39.6	198	1.3007	0.3543	1.3007	1.1405
No log	40.0	200	1.3698	0.2237	1.3698	1.1704
No log	40.4	202	1.3649	0.2237	1.3649	1.1683
No log	40.8	204	1.3156	0.2773	1.3156	1.1470
No log	41.2	206	1.2882	0.2792	1.2882	1.1350
No log	41.6	208	1.2519	0.1981	1.2519	1.1189
No log	42.0	210	1.2417	0.1568	1.2417	1.1143
No log	42.4	212	1.2679	0.2148	1.2679	1.1260
No log	42.8	214	1.2691	0.2514	1.2691	1.1265
No log	43.2	216	1.2513	0.1906	1.2513	1.1186
No log	43.6	218	1.3049	0.1885	1.3049	1.1423
No log	44.0	220	1.3863	0.1986	1.3863	1.1774
No log	44.4	222	1.3933	0.1848	1.3933	1.1804
No log	44.8	224	1.3778	0.1848	1.3778	1.1738
No log	45.2	226	1.3283	0.2532	1.3282	1.1525
No log	45.6	228	1.3162	0.2417	1.3162	1.1472
No log	46.0	230	1.3355	0.2451	1.3355	1.1557
No log	46.4	232	1.3092	0.1935	1.3092	1.1442
No log	46.8	234	1.3119	0.1667	1.3119	1.1454
No log	47.2	236	1.3615	0.2257	1.3615	1.1668
No log	47.6	238	1.4228	0.1718	1.4228	1.1928
No log	48.0	240	1.4343	0.1670	1.4343	1.1976
No log	48.4	242	1.3852	0.1621	1.3852	1.1769
No log	48.8	244	1.3039	0.2930	1.3039	1.1419
No log	49.2	246	1.2804	0.2930	1.2804	1.1315
No log	49.6	248	1.2742	0.2606	1.2742	1.1288
No log	50.0	250	1.2546	0.2515	1.2546	1.1201
No log	50.4	252	1.2580	0.2636	1.2580	1.1216
No log	50.8	254	1.2584	0.2762	1.2584	1.1218
No log	51.2	256	1.2324	0.2686	1.2324	1.1101
No log	51.6	258	1.2144	0.3352	1.2144	1.1020
No log	52.0	260	1.2034	0.3352	1.2034	1.0970
No log	52.4	262	1.1921	0.3352	1.1921	1.0919
No log	52.8	264	1.1997	0.3211	1.1997	1.0953
No log	53.2	266	1.2569	0.2525	1.2569	1.1211
No log	53.6	268	1.2874	0.1951	1.2874	1.1347
No log	54.0	270	1.2455	0.2195	1.2455	1.1160
No log	54.4	272	1.2100	0.3211	1.2100	1.1000
No log	54.8	274	1.2122	0.3352	1.2122	1.1010
No log	55.2	276	1.2074	0.2034	1.2074	1.0988
No log	55.6	278	1.2322	0.2076	1.2322	1.1100
No log	56.0	280	1.2712	0.1753	1.2712	1.1275
No log	56.4	282	1.2981	0.2417	1.2981	1.1394
No log	56.8	284	1.3439	0.3090	1.3439	1.1593
No log	57.2	286	1.3855	0.2223	1.3855	1.1771
No log	57.6	288	1.3767	0.2223	1.3767	1.1733
No log	58.0	290	1.3374	0.2223	1.3374	1.1565
No log	58.4	292	1.3049	0.2590	1.3049	1.1423
No log	58.8	294	1.2489	0.2610	1.2489	1.1176
No log	59.2	296	1.2167	0.1847	1.2167	1.1031
No log	59.6	298	1.2219	0.1847	1.2219	1.1054
No log	60.0	300	1.2563	0.3043	1.2563	1.1208
No log	60.4	302	1.3392	0.2261	1.3392	1.1572
No log	60.8	304	1.3909	0.1634	1.3909	1.1794
No log	61.2	306	1.3673	0.1984	1.3673	1.1693
No log	61.6	308	1.2929	0.2889	1.2929	1.1371
No log	62.0	310	1.2460	0.3400	1.2460	1.1163
No log	62.4	312	1.2152	0.2205	1.2152	1.1024
No log	62.8	314	1.2149	0.2747	1.2149	1.1022
No log	63.2	316	1.2270	0.3157	1.2270	1.1077
No log	63.6	318	1.2178	0.3157	1.2178	1.1035
No log	64.0	320	1.2148	0.3021	1.2148	1.1022
No log	64.4	322	1.1959	0.3021	1.1959	1.0936
No log	64.8	324	1.1830	0.3369	1.1830	1.0877
No log	65.2	326	1.1812	0.3157	1.1812	1.0868
No log	65.6	328	1.1712	0.3427	1.1712	1.0822
No log	66.0	330	1.1704	0.3427	1.1704	1.0819
No log	66.4	332	1.1751	0.3427	1.1751	1.0840
No log	66.8	334	1.2019	0.3021	1.2019	1.0963
No log	67.2	336	1.2312	0.3318	1.2312	1.1096
No log	67.6	338	1.2420	0.3294	1.2420	1.1144
No log	68.0	340	1.2446	0.3294	1.2446	1.1156
No log	68.4	342	1.2311	0.3278	1.2311	1.1095
No log	68.8	344	1.1948	0.3268	1.1948	1.0931
No log	69.2	346	1.1705	0.3427	1.1705	1.0819
No log	69.6	348	1.1466	0.2079	1.1466	1.0708
No log	70.0	350	1.1405	0.2079	1.1405	1.0679
No log	70.4	352	1.1400	0.2079	1.1400	1.0677
No log	70.8	354	1.1401	0.2703	1.1401	1.0677
No log	71.2	356	1.1439	0.3243	1.1439	1.0695
No log	71.6	358	1.1522	0.3520	1.1522	1.0734
No log	72.0	360	1.1776	0.3268	1.1776	1.0852
No log	72.4	362	1.1984	0.3375	1.1984	1.0947
No log	72.8	364	1.2042	0.3375	1.2042	1.0973
No log	73.2	366	1.1849	0.3268	1.1849	1.0885
No log	73.6	368	1.1581	0.3065	1.1581	1.0762
No log	74.0	370	1.1483	0.2479	1.1483	1.0716
No log	74.4	372	1.1432	0.2479	1.1432	1.0692
No log	74.8	374	1.1453	0.3427	1.1453	1.0702
No log	75.2	376	1.1585	0.3478	1.1585	1.0764
No log	75.6	378	1.1744	0.3584	1.1744	1.0837
No log	76.0	380	1.1761	0.3572	1.1761	1.0845
No log	76.4	382	1.1830	0.3436	1.1830	1.0877
No log	76.8	384	1.1807	0.3405	1.1807	1.0866
No log	77.2	386	1.1770	0.3405	1.1770	1.0849
No log	77.6	388	1.1817	0.2288	1.1817	1.0870
No log	78.0	390	1.1811	0.2288	1.1811	1.0868
No log	78.4	392	1.1727	0.2454	1.1727	1.0829
No log	78.8	394	1.1708	0.2454	1.1708	1.0820
No log	79.2	396	1.1740	0.2248	1.1740	1.0835
No log	79.6	398	1.1788	0.2248	1.1788	1.0857
No log	80.0	400	1.1685	0.2998	1.1685	1.0810
No log	80.4	402	1.1559	0.3533	1.1559	1.0751
No log	80.8	404	1.1473	0.3335	1.1473	1.0711
No log	81.2	406	1.1435	0.3352	1.1435	1.0693
No log	81.6	408	1.1435	0.3352	1.1435	1.0694
No log	82.0	410	1.1471	0.3352	1.1471	1.0710
No log	82.4	412	1.1508	0.3687	1.1508	1.0728
No log	82.8	414	1.1573	0.3547	1.1573	1.0758
No log	83.2	416	1.1679	0.3405	1.1679	1.0807
No log	83.6	418	1.1743	0.3046	1.1743	1.0836
No log	84.0	420	1.1897	0.2837	1.1897	1.0907
No log	84.4	422	1.2041	0.2978	1.2041	1.0973
No log	84.8	424	1.2023	0.3333	1.2023	1.0965
No log	85.2	426	1.1932	0.3299	1.1932	1.0923
No log	85.6	428	1.1761	0.3560	1.1761	1.0845
No log	86.0	430	1.1569	0.3369	1.1569	1.0756
No log	86.4	432	1.1464	0.3088	1.1464	1.0707
No log	86.8	434	1.1411	0.3065	1.1411	1.0682
No log	87.2	436	1.1392	0.2971	1.1392	1.0673
No log	87.6	438	1.1398	0.3065	1.1398	1.0676
No log	88.0	440	1.1441	0.3256	1.1441	1.0696
No log	88.4	442	1.1515	0.3352	1.1515	1.0731
No log	88.8	444	1.1571	0.3352	1.1571	1.0757
No log	89.2	446	1.1596	0.3211	1.1596	1.0768
No log	89.6	448	1.1588	0.3211	1.1588	1.0765
No log	90.0	450	1.1607	0.3211	1.1607	1.0773
No log	90.4	452	1.1645	0.3547	1.1645	1.0791
No log	90.8	454	1.1690	0.3165	1.1690	1.0812
No log	91.2	456	1.1739	0.3022	1.1739	1.0835
No log	91.6	458	1.1791	0.3046	1.1791	1.0858
No log	92.0	460	1.1835	0.3046	1.1835	1.0879
No log	92.4	462	1.1844	0.3022	1.1844	1.0883
No log	92.8	464	1.1847	0.3022	1.1847	1.0884
No log	93.2	466	1.1885	0.3022	1.1885	1.0902
No log	93.6	468	1.1917	0.3022	1.1917	1.0916
No log	94.0	470	1.1938	0.2810	1.1938	1.0926
No log	94.4	472	1.1929	0.2668	1.1929	1.0922
No log	94.8	474	1.1934	0.2668	1.1934	1.0924
No log	95.2	476	1.1909	0.2668	1.1909	1.0913
No log	95.6	478	1.1875	0.2810	1.1875	1.0897
No log	96.0	480	1.1852	0.3022	1.1852	1.0887
No log	96.4	482	1.1840	0.3022	1.1840	1.0881
No log	96.8	484	1.1815	0.3022	1.1815	1.0870
No log	97.2	486	1.1792	0.3022	1.1792	1.0859
No log	97.6	488	1.1761	0.3022	1.1761	1.0845
No log	98.0	490	1.1730	0.3022	1.1730	1.0830
No log	98.4	492	1.1697	0.3022	1.1697	1.0815
No log	98.8	494	1.1671	0.3022	1.1671	1.0803
No log	99.2	496	1.1653	0.2686	1.1653	1.0795
No log	99.6	498	1.1640	0.2686	1.1640	1.0789
0.2033	100.0	500	1.1634	0.2686	1.1634	1.0786

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1