ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1686
• Qwk: 0.1807
• Mse: 1.1686
• Rmse: 1.0810

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	4.6449	0.0010	4.6449	2.1552
No log	0.8	4	2.7202	0.0193	2.7202	1.6493
No log	1.2	6	2.1133	-0.0173	2.1133	1.4537
No log	1.6	8	1.7774	-0.0134	1.7774	1.3332
No log	2.0	10	1.3637	0.0020	1.3637	1.1678
No log	2.4	12	1.3070	0.0682	1.3070	1.1432
No log	2.8	14	1.2609	0.1271	1.2609	1.1229
No log	3.2	16	1.2413	0.0945	1.2413	1.1141
No log	3.6	18	1.2178	0.1407	1.2178	1.1036
No log	4.0	20	1.2040	0.2111	1.2040	1.0973
No log	4.4	22	1.2187	0.2223	1.2187	1.1040
No log	4.8	24	1.2107	0.1911	1.2107	1.1003
No log	5.2	26	1.2018	0.1927	1.2018	1.0962
No log	5.6	28	1.1962	0.2223	1.1962	1.0937
No log	6.0	30	1.2182	0.0977	1.2182	1.1037
No log	6.4	32	1.1684	0.1814	1.1684	1.0809
No log	6.8	34	1.1625	0.0914	1.1625	1.0782
No log	7.2	36	1.2162	0.0611	1.2162	1.1028
No log	7.6	38	1.1901	0.2043	1.1901	1.0909
No log	8.0	40	1.4759	0.1801	1.4759	1.2148
No log	8.4	42	1.5930	0.0782	1.5930	1.2621
No log	8.8	44	1.3398	0.1463	1.3398	1.1575
No log	9.2	46	1.1816	0.1302	1.1816	1.0870
No log	9.6	48	1.2275	0.2199	1.2275	1.1079
No log	10.0	50	1.2188	0.2242	1.2188	1.1040
No log	10.4	52	1.2722	0.2132	1.2722	1.1279
No log	10.8	54	1.4347	0.2028	1.4347	1.1978
No log	11.2	56	1.3758	0.2665	1.3758	1.1729
No log	11.6	58	1.2202	0.0751	1.2202	1.1046
No log	12.0	60	1.1425	0.1767	1.1425	1.0689
No log	12.4	62	1.1731	0.0653	1.1731	1.0831
No log	12.8	64	1.1640	0.0818	1.1640	1.0789
No log	13.2	66	1.1802	0.0751	1.1802	1.0864
No log	13.6	68	1.3618	0.2132	1.3618	1.1669
No log	14.0	70	1.5576	0.1854	1.5576	1.2480
No log	14.4	72	1.5231	0.1854	1.5231	1.2341
No log	14.8	74	1.2823	0.2590	1.2823	1.1324
No log	15.2	76	1.1036	0.2327	1.1036	1.0505
No log	15.6	78	1.0749	0.3263	1.0749	1.0368
No log	16.0	80	1.0900	0.2327	1.0900	1.0440
No log	16.4	82	1.2153	0.2870	1.2153	1.1024
No log	16.8	84	1.3134	0.3658	1.3134	1.1460
No log	17.2	86	1.2147	0.2738	1.2147	1.1021
No log	17.6	88	1.0518	0.1820	1.0518	1.0256
No log	18.0	90	1.0286	0.3142	1.0286	1.0142
No log	18.4	92	1.0386	0.3142	1.0386	1.0191
No log	18.8	94	1.0496	0.2132	1.0496	1.0245
No log	19.2	96	1.0811	0.1662	1.0811	1.0398
No log	19.6	98	1.1546	0.1667	1.1546	1.0745
No log	20.0	100	1.1492	0.1813	1.1492	1.0720
No log	20.4	102	1.1561	0.1371	1.1561	1.0752
No log	20.8	104	1.0970	0.1662	1.0970	1.0474
No log	21.2	106	1.0904	0.2132	1.0904	1.0442
No log	21.6	108	1.1247	0.2260	1.1247	1.0605
No log	22.0	110	1.2023	0.1906	1.2023	1.0965
No log	22.4	112	1.2269	0.1995	1.2269	1.1076
No log	22.8	114	1.1931	0.1906	1.1931	1.0923
No log	23.2	116	1.1128	0.1562	1.1128	1.0549
No log	23.6	118	1.1049	0.1662	1.1049	1.0511
No log	24.0	120	1.1401	0.1344	1.1401	1.0678
No log	24.4	122	1.1997	0.1997	1.1997	1.0953
No log	24.8	124	1.1751	0.1959	1.1751	1.0840
No log	25.2	126	1.1522	0.2409	1.1522	1.0734
No log	25.6	128	1.1487	0.2850	1.1487	1.0718
No log	26.0	130	1.1743	0.2515	1.1743	1.0837
No log	26.4	132	1.2065	0.2003	1.2065	1.0984
No log	26.8	134	1.2180	0.1997	1.2180	1.1036
No log	27.2	136	1.2659	0.2032	1.2659	1.1251
No log	27.6	138	1.2173	0.2184	1.2173	1.1033
No log	28.0	140	1.1622	0.2481	1.1622	1.0780
No log	28.4	142	1.1365	0.2557	1.1365	1.0661
No log	28.8	144	1.1211	0.2121	1.1211	1.0588
No log	29.2	146	1.1176	0.2069	1.1176	1.0572
No log	29.6	148	1.1299	0.2300	1.1299	1.0630
No log	30.0	150	1.1138	0.2481	1.1138	1.0554
No log	30.4	152	1.0882	0.2947	1.0882	1.0432
No log	30.8	154	1.0867	0.2735	1.0867	1.0425
No log	31.2	156	1.1036	0.3065	1.1036	1.0505
No log	31.6	158	1.1709	0.2259	1.1709	1.0821
No log	32.0	160	1.2111	0.2518	1.2111	1.1005
No log	32.4	162	1.2454	0.2503	1.2454	1.1160
No log	32.8	164	1.1677	0.1951	1.1677	1.0806
No log	33.2	166	1.0973	0.1867	1.0973	1.0475
No log	33.6	168	1.0717	0.2735	1.0717	1.0352
No log	34.0	170	1.0787	0.2995	1.0787	1.0386
No log	34.4	172	1.0883	0.3380	1.0883	1.0432
No log	34.8	174	1.1227	0.2683	1.1227	1.0596
No log	35.2	176	1.1531	0.2609	1.1531	1.0738
No log	35.6	178	1.2157	0.2525	1.2157	1.1026
No log	36.0	180	1.2611	0.2549	1.2611	1.1230
No log	36.4	182	1.2430	0.1850	1.2430	1.1149
No log	36.8	184	1.1803	0.2236	1.1803	1.0864
No log	37.2	186	1.1251	0.1764	1.1251	1.0607
No log	37.6	188	1.1165	0.1722	1.1165	1.0567
No log	38.0	190	1.1020	0.2258	1.1020	1.0498
No log	38.4	192	1.1105	0.2530	1.1105	1.0538
No log	38.8	194	1.1364	0.2144	1.1364	1.0660
No log	39.2	196	1.1563	0.2144	1.1563	1.0753
No log	39.6	198	1.2034	0.2223	1.2034	1.0970
No log	40.0	200	1.1973	0.2326	1.1973	1.0942
No log	40.4	202	1.1706	0.1912	1.1706	1.0820
No log	40.8	204	1.1487	0.2113	1.1487	1.0718
No log	41.2	206	1.1430	0.1732	1.1430	1.0691
No log	41.6	208	1.1447	0.1727	1.1447	1.0699
No log	42.0	210	1.1535	0.1671	1.1535	1.0740
No log	42.4	212	1.1397	0.1920	1.1397	1.0676
No log	42.8	214	1.1243	0.2024	1.1243	1.0603
No log	43.2	216	1.1104	0.2176	1.1104	1.0538
No log	43.6	218	1.1442	0.2389	1.1442	1.0697
No log	44.0	220	1.1887	0.2086	1.1887	1.0903
No log	44.4	222	1.2607	0.2077	1.2607	1.1228
No log	44.8	224	1.2942	0.2250	1.2942	1.1376
No log	45.2	226	1.2515	0.1766	1.2515	1.1187
No log	45.6	228	1.2466	0.1717	1.2466	1.1165
No log	46.0	230	1.2662	0.1850	1.2662	1.1252
No log	46.4	232	1.2625	0.1850	1.2625	1.1236
No log	46.8	234	1.2295	0.1667	1.2295	1.1088
No log	47.2	236	1.1807	0.1576	1.1807	1.0866
No log	47.6	238	1.1908	0.1576	1.1908	1.0912
No log	48.0	240	1.2536	0.1628	1.2536	1.1196
No log	48.4	242	1.3771	0.1894	1.3771	1.1735
No log	48.8	244	1.4484	0.2633	1.4484	1.2035
No log	49.2	246	1.4170	0.2555	1.4170	1.1904
No log	49.6	248	1.2795	0.2117	1.2795	1.1311
No log	50.0	250	1.1612	0.1864	1.1612	1.0776
No log	50.4	252	1.1224	0.1717	1.1224	1.0594
No log	50.8	254	1.1385	0.1717	1.1385	1.0670
No log	51.2	256	1.1936	0.1502	1.1936	1.0925
No log	51.6	258	1.2552	0.1801	1.2552	1.1204
No log	52.0	260	1.2737	0.1850	1.2737	1.1286
No log	52.4	262	1.2877	0.1943	1.2877	1.1348
No log	52.8	264	1.2715	0.1896	1.2715	1.1276
No log	53.2	266	1.2331	0.2000	1.2331	1.1104
No log	53.6	268	1.1781	0.1502	1.1781	1.0854
No log	54.0	270	1.1442	0.1562	1.1442	1.0697
No log	54.4	272	1.1316	0.2176	1.1316	1.0638
No log	54.8	274	1.1399	0.1621	1.1399	1.0677
No log	55.2	276	1.1592	0.1562	1.1592	1.0767
No log	55.6	278	1.2080	0.1995	1.2080	1.0991
No log	56.0	280	1.2485	0.2084	1.2485	1.1174
No log	56.4	282	1.2524	0.2173	1.2524	1.1191
No log	56.8	284	1.2351	0.2084	1.2351	1.1114
No log	57.2	286	1.2141	0.1995	1.2141	1.1019
No log	57.6	288	1.1786	0.1906	1.1786	1.0856
No log	58.0	290	1.1637	0.2235	1.1637	1.0787
No log	58.4	292	1.1563	0.1864	1.1563	1.0753
No log	58.8	294	1.1626	0.2154	1.1626	1.0782
No log	59.2	296	1.1680	0.2195	1.1680	1.0808
No log	59.6	298	1.1950	0.2235	1.1950	1.0932
No log	60.0	300	1.2406	0.2134	1.2406	1.1138
No log	60.4	302	1.3033	0.2237	1.3033	1.1416
No log	60.8	304	1.3164	0.2481	1.3164	1.1473
No log	61.2	306	1.2813	0.2117	1.2813	1.1320
No log	61.6	308	1.2333	0.2326	1.2334	1.1106
No log	62.0	310	1.2257	0.2326	1.2257	1.1071
No log	62.4	312	1.2188	0.2006	1.2188	1.1040
No log	62.8	314	1.2265	0.2326	1.2265	1.1075
No log	63.2	316	1.2379	0.2326	1.2379	1.1126
No log	63.6	318	1.2287	0.2235	1.2287	1.1085
No log	64.0	320	1.2129	0.2235	1.2129	1.1013
No log	64.4	322	1.2119	0.2154	1.2119	1.1009
No log	64.8	324	1.2353	0.2288	1.2353	1.1114
No log	65.2	326	1.2683	0.2236	1.2683	1.1262
No log	65.6	328	1.2692	0.2041	1.2692	1.1266
No log	66.0	330	1.2486	0.1614	1.2486	1.1174
No log	66.4	332	1.2256	0.1959	1.2256	1.1071
No log	66.8	334	1.2261	0.1671	1.2261	1.1073
No log	67.2	336	1.2399	0.1576	1.2399	1.1135
No log	67.6	338	1.2345	0.1628	1.2345	1.1111
No log	68.0	340	1.2356	0.1628	1.2356	1.1116
No log	68.4	342	1.2201	0.1771	1.2201	1.1046
No log	68.8	344	1.1863	0.1912	1.1863	1.0892
No log	69.2	346	1.1734	0.1912	1.1734	1.0832
No log	69.6	348	1.1693	0.2060	1.1693	1.0813
No log	70.0	350	1.1862	0.1576	1.1862	1.0891
No log	70.4	352	1.1848	0.1905	1.1848	1.0885
No log	70.8	354	1.1784	0.2050	1.1784	1.0856
No log	71.2	356	1.1654	0.2248	1.1654	1.0795
No log	71.6	358	1.1563	0.2154	1.1563	1.0753
No log	72.0	360	1.1601	0.2154	1.1601	1.0771
No log	72.4	362	1.1626	0.1912	1.1626	1.0783
No log	72.8	364	1.1564	0.2060	1.1564	1.0754
No log	73.2	366	1.1590	0.2060	1.1590	1.0766
No log	73.6	368	1.1603	0.1912	1.1603	1.0772
No log	74.0	370	1.1628	0.1912	1.1628	1.0783
No log	74.4	372	1.1650	0.1912	1.1650	1.0794
No log	74.8	374	1.1827	0.1813	1.1827	1.0875
No log	75.2	376	1.2107	0.1667	1.2107	1.1003
No log	75.6	378	1.2402	0.1758	1.2402	1.1136
No log	76.0	380	1.2479	0.1758	1.2479	1.1171
No log	76.4	382	1.2387	0.1758	1.2387	1.1129
No log	76.8	384	1.2231	0.1758	1.2231	1.1059
No log	77.2	386	1.2168	0.1758	1.2168	1.1031
No log	77.6	388	1.2232	0.1807	1.2232	1.1060
No log	78.0	390	1.2227	0.1758	1.2227	1.1057
No log	78.4	392	1.2111	0.1951	1.2111	1.1005
No log	78.8	394	1.2040	0.1857	1.2040	1.0973
No log	79.2	396	1.1988	0.1857	1.1988	1.0949
No log	79.6	398	1.1825	0.1959	1.1825	1.0874
No log	80.0	400	1.1597	0.1959	1.1597	1.0769
No log	80.4	402	1.1444	0.1658	1.1444	1.0698
No log	80.8	404	1.1328	0.1562	1.1328	1.0643
No log	81.2	406	1.1276	0.1717	1.1276	1.0619
No log	81.6	408	1.1225	0.1871	1.1225	1.0595
No log	82.0	410	1.1232	0.1968	1.1232	1.0598
No log	82.4	412	1.1270	0.1968	1.1270	1.0616
No log	82.8	414	1.1310	0.1658	1.1310	1.0635
No log	83.2	416	1.1417	0.2006	1.1417	1.0685
No log	83.6	418	1.1599	0.2288	1.1599	1.0770
No log	84.0	420	1.1863	0.2174	1.1863	1.0892
No log	84.4	422	1.2050	0.1857	1.2050	1.0977
No log	84.8	424	1.2098	0.2033	1.2098	1.0999
No log	85.2	426	1.2007	0.2033	1.2007	1.0958
No log	85.6	428	1.1809	0.2086	1.1809	1.0867
No log	86.0	430	1.1546	0.2375	1.1546	1.0745
No log	86.4	432	1.1409	0.2481	1.1409	1.0681
No log	86.8	434	1.1350	0.2481	1.1350	1.0654
No log	87.2	436	1.1314	0.2481	1.1314	1.0637
No log	87.6	438	1.1291	0.2446	1.1291	1.0626
No log	88.0	440	1.1356	0.2481	1.1356	1.0657
No log	88.4	442	1.1427	0.2339	1.1427	1.0690
No log	88.8	444	1.1446	0.1958	1.1446	1.0698
No log	89.2	446	1.1495	0.1958	1.1495	1.0722
No log	89.6	448	1.1533	0.1958	1.1533	1.0739
No log	90.0	450	1.1582	0.2050	1.1582	1.0762
No log	90.4	452	1.1607	0.2006	1.1607	1.0773
No log	90.8	454	1.1669	0.2006	1.1669	1.0802
No log	91.2	456	1.1729	0.2288	1.1729	1.0830
No log	91.6	458	1.1740	0.2143	1.1740	1.0835
No log	92.0	460	1.1741	0.2143	1.1741	1.0836
No log	92.4	462	1.1727	0.2100	1.1727	1.0829
No log	92.8	464	1.1725	0.2195	1.1725	1.0828
No log	93.2	466	1.1768	0.1903	1.1768	1.0848
No log	93.6	468	1.1839	0.1903	1.1839	1.0881
No log	94.0	470	1.1912	0.2195	1.1912	1.0914
No log	94.4	472	1.1926	0.2195	1.1926	1.0921
No log	94.8	474	1.1951	0.2195	1.1951	1.0932
No log	95.2	476	1.1963	0.2195	1.1963	1.0937
No log	95.6	478	1.1965	0.2195	1.1965	1.0938
No log	96.0	480	1.1946	0.2195	1.1946	1.0930
No log	96.4	482	1.1922	0.2195	1.1922	1.0919
No log	96.8	484	1.1893	0.2195	1.1893	1.0905
No log	97.2	486	1.1851	0.2195	1.1851	1.0886
No log	97.6	488	1.1809	0.2195	1.1809	1.0867
No log	98.0	490	1.1766	0.1903	1.1766	1.0847
No log	98.4	492	1.1728	0.1807	1.1728	1.0829
No log	98.8	494	1.1706	0.1807	1.1706	1.0819
No log	99.2	496	1.1695	0.1807	1.1695	1.0814
No log	99.6	498	1.1689	0.1807	1.1689	1.0812
0.2059	100.0	500	1.1686	0.1807	1.1686	1.0810

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1