ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3387
• Qwk: 0.0401
• Mse: 1.3387
• Rmse: 1.1570

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.2448	-0.0160	4.2448	2.0603
No log	0.1379	4	2.3481	0.0014	2.3481	1.5324
No log	0.2069	6	1.8020	0.0318	1.8020	1.3424
No log	0.2759	8	1.8176	0.0429	1.8176	1.3482
No log	0.3448	10	1.5671	0.0408	1.5671	1.2518
No log	0.4138	12	1.3137	0.0	1.3137	1.1462
No log	0.4828	14	1.4668	0.0	1.4668	1.2111
No log	0.5517	16	1.4522	0.0	1.4522	1.2051
No log	0.6207	18	1.3676	0.0	1.3676	1.1695
No log	0.6897	20	1.1815	0.0880	1.1815	1.0870
No log	0.7586	22	1.0890	0.1476	1.0890	1.0436
No log	0.8276	24	1.1083	0.2008	1.1083	1.0528
No log	0.8966	26	1.1708	0.1864	1.1708	1.0820
No log	0.9655	28	1.3058	0.0219	1.3058	1.1427
No log	1.0345	30	1.3333	-0.0270	1.3333	1.1547
No log	1.1034	32	1.1897	0.1971	1.1897	1.0907
No log	1.1724	34	1.2141	0.0850	1.2141	1.1018
No log	1.2414	36	1.1793	0.1211	1.1793	1.0860
No log	1.3103	38	1.0413	0.2667	1.0413	1.0204
No log	1.3793	40	1.0547	0.1167	1.0547	1.0270
No log	1.4483	42	1.0034	0.1935	1.0034	1.0017
No log	1.5172	44	0.9769	0.3266	0.9769	0.9884
No log	1.5862	46	0.9579	0.2692	0.9579	0.9787
No log	1.6552	48	0.9685	0.1810	0.9685	0.9841
No log	1.7241	50	1.0671	0.1379	1.0671	1.0330
No log	1.7931	52	1.0443	0.2346	1.0443	1.0219
No log	1.8621	54	0.9754	0.3314	0.9754	0.9876
No log	1.9310	56	1.0597	0.3027	1.0597	1.0294
No log	2.0	58	1.3597	0.1316	1.3597	1.1661
No log	2.0690	60	1.4749	0.1027	1.4749	1.2145
No log	2.1379	62	1.3401	0.1856	1.3401	1.1576
No log	2.2069	64	1.4126	0.2058	1.4126	1.1885
No log	2.2759	66	1.3062	0.2689	1.3062	1.1429
No log	2.3448	68	1.2832	0.2431	1.2832	1.1328
No log	2.4138	70	1.3847	0.2334	1.3847	1.1767
No log	2.4828	72	1.3524	0.1522	1.3524	1.1629
No log	2.5517	74	1.1907	0.2100	1.1907	1.0912
No log	2.6207	76	1.1414	0.2081	1.1414	1.0684
No log	2.6897	78	1.1471	0.1775	1.1471	1.0710
No log	2.7586	80	1.2627	0.1654	1.2627	1.1237
No log	2.8276	82	1.2888	0.1370	1.2888	1.1353
No log	2.8966	84	1.2368	0.1750	1.2368	1.1121
No log	2.9655	86	1.1190	0.1919	1.1190	1.0578
No log	3.0345	88	1.0757	0.2605	1.0757	1.0372
No log	3.1034	90	1.1400	0.2494	1.1400	1.0677
No log	3.1724	92	1.3333	0.1989	1.3333	1.1547
No log	3.2414	94	1.4827	0.1063	1.4827	1.2177
No log	3.3103	96	1.5190	0.0874	1.5190	1.2325
No log	3.3793	98	1.4333	0.1272	1.4333	1.1972
No log	3.4483	100	1.2747	0.1750	1.2747	1.1290
No log	3.5172	102	1.1760	0.1893	1.1760	1.0845
No log	3.5862	104	1.2036	0.1461	1.2036	1.0971
No log	3.6552	106	1.3540	0.1943	1.3540	1.1636
No log	3.7241	108	1.3841	0.2187	1.3841	1.1765
No log	3.7931	110	1.2381	0.1858	1.2381	1.1127
No log	3.8621	112	1.1444	0.2251	1.1444	1.0698
No log	3.9310	114	1.2317	0.2049	1.2317	1.1098
No log	4.0	116	1.3087	0.2260	1.3087	1.1440
No log	4.0690	118	1.2904	0.2260	1.2904	1.1359
No log	4.1379	120	1.2415	0.1816	1.2415	1.1142
No log	4.2069	122	1.2675	0.1202	1.2675	1.1258
No log	4.2759	124	1.2251	0.1816	1.2251	1.1068
No log	4.3448	126	1.0806	0.2130	1.0806	1.0395
No log	4.4138	128	1.0512	0.2843	1.0512	1.0253
No log	4.4828	130	1.1396	0.2592	1.1396	1.0675
No log	4.5517	132	1.1753	0.2455	1.1753	1.0841
No log	4.6207	134	1.1002	0.1816	1.1002	1.0489
No log	4.6897	136	1.0447	0.0833	1.0447	1.0221
No log	4.7586	138	1.1020	0.1473	1.1020	1.0497
No log	4.8276	140	1.3047	0.1880	1.3047	1.1422
No log	4.8966	142	1.5543	0.2170	1.5543	1.2467
No log	4.9655	144	1.5678	0.1892	1.5678	1.2521
No log	5.0345	146	1.4278	0.1744	1.4278	1.1949
No log	5.1034	148	1.3371	0.0931	1.3371	1.1563
No log	5.1724	150	1.3401	0.1017	1.3401	1.1576
No log	5.2414	152	1.4264	0.0961	1.4264	1.1943
No log	5.3103	154	1.5001	0.1222	1.5001	1.2248
No log	5.3793	156	1.6093	0.1601	1.6093	1.2686
No log	5.4483	158	1.5210	0.1533	1.5210	1.2333
No log	5.5172	160	1.4396	0.2126	1.4396	1.1998
No log	5.5862	162	1.4305	0.1814	1.4305	1.1961
No log	5.6552	164	1.3075	0.1052	1.3075	1.1435
No log	5.7241	166	1.1592	0.1351	1.1592	1.0767
No log	5.7931	168	1.0995	0.1649	1.0995	1.0486
No log	5.8621	170	1.1486	0.1697	1.1486	1.0717
No log	5.9310	172	1.2419	0.2089	1.2419	1.1144
No log	6.0	174	1.2888	0.2089	1.2888	1.1352
No log	6.0690	176	1.3868	0.1814	1.3868	1.1776
No log	6.1379	178	1.3446	0.1486	1.3446	1.1596
No log	6.2069	180	1.2397	0.1697	1.2397	1.1134
No log	6.2759	182	1.1833	0.1724	1.1833	1.0878
No log	6.3448	184	1.1666	0.1893	1.1666	1.0801
No log	6.4138	186	1.1973	0.1724	1.1973	1.0942
No log	6.4828	188	1.2567	0.1697	1.2567	1.1210
No log	6.5517	190	1.2894	0.2395	1.2894	1.1355
No log	6.6207	192	1.3128	0.2206	1.3128	1.1458
No log	6.6897	194	1.3826	0.2026	1.3826	1.1758
No log	6.7586	196	1.5130	0.1789	1.5130	1.2300
No log	6.8276	198	1.5483	0.1789	1.5483	1.2443
No log	6.8966	200	1.4865	0.1790	1.4865	1.2192
No log	6.9655	202	1.4396	0.2084	1.4396	1.1998
No log	7.0345	204	1.4580	0.1728	1.4580	1.2075
No log	7.1034	206	1.5008	0.2117	1.5008	1.2251
No log	7.1724	208	1.4926	0.2184	1.4926	1.2217
No log	7.2414	210	1.4208	0.2126	1.4208	1.1920
No log	7.3103	212	1.3345	0.1744	1.3345	1.1552
No log	7.3793	214	1.2346	0.1579	1.2346	1.1111
No log	7.4483	216	1.2237	0.1579	1.2237	1.1062
No log	7.5172	218	1.2816	0.1407	1.2816	1.1321
No log	7.5862	220	1.4286	0.2424	1.4286	1.1952
No log	7.6552	222	1.4986	0.2709	1.4986	1.2242
No log	7.7241	224	1.4430	0.2424	1.4430	1.2012
No log	7.7931	226	1.3565	0.1814	1.3565	1.1647
No log	7.8621	228	1.1968	0.2051	1.1968	1.0940
No log	7.9310	230	1.1291	0.2192	1.1291	1.0626
No log	8.0	232	1.1340	0.2192	1.1340	1.0649
No log	8.0690	234	1.1355	0.2192	1.1355	1.0656
No log	8.1379	236	1.2463	0.1952	1.2463	1.1164
No log	8.2069	238	1.3989	0.2292	1.3989	1.1827
No log	8.2759	240	1.4493	0.2522	1.4493	1.2039
No log	8.3448	242	1.3865	0.2424	1.3865	1.1775
No log	8.4138	244	1.2826	0.1952	1.2826	1.1325
No log	8.4828	246	1.1587	0.1820	1.1587	1.0764
No log	8.5517	248	1.1201	0.1397	1.1201	1.0583
No log	8.6207	250	1.1400	0.2273	1.1400	1.0677
No log	8.6897	252	1.1870	0.2192	1.1870	1.0895
No log	8.7586	254	1.2717	0.2506	1.2717	1.1277
No log	8.8276	256	1.2794	0.2506	1.2794	1.1311
No log	8.8966	258	1.3092	0.2506	1.3092	1.1442
No log	8.9655	260	1.3500	0.2203	1.3500	1.1619
No log	9.0345	262	1.3293	0.2203	1.3293	1.1529
No log	9.1034	264	1.2465	0.2105	1.2465	1.1165
No log	9.1724	266	1.2066	0.1986	1.2066	1.0985
No log	9.2414	268	1.2817	0.2773	1.2817	1.1321
No log	9.3103	270	1.3481	0.2417	1.3481	1.1611
No log	9.3793	272	1.3818	0.2417	1.3818	1.1755
No log	9.4483	274	1.3141	0.2315	1.3141	1.1464
No log	9.5172	276	1.1719	0.2308	1.1719	1.0825
No log	9.5862	278	1.1241	0.1986	1.1241	1.0602
No log	9.6552	280	1.1341	0.1986	1.1341	1.0649
No log	9.7241	282	1.2343	0.1961	1.2343	1.1110
No log	9.7931	284	1.3002	0.1961	1.3002	1.1402
No log	9.8621	286	1.2743	0.1961	1.2743	1.1289
No log	9.9310	288	1.2060	0.1488	1.2060	1.0982
No log	10.0	290	1.2618	0.1842	1.2618	1.1233
No log	10.0690	292	1.2802	0.1816	1.2802	1.1314
No log	10.1379	294	1.2219	0.1816	1.2219	1.1054
No log	10.2069	296	1.1574	0.0342	1.1574	1.0758
No log	10.2759	298	1.1269	-0.0023	1.1269	1.0616
No log	10.3448	300	1.1836	0.0496	1.1836	1.0880
No log	10.4138	302	1.2893	0.1697	1.2893	1.1355
No log	10.4828	304	1.3996	0.1770	1.3996	1.1831
No log	10.5517	306	1.5020	0.1658	1.5020	1.2255
No log	10.6207	308	1.5845	0.0958	1.5845	1.2588
No log	10.6897	310	1.5368	0.1663	1.5368	1.2397
No log	10.7586	312	1.4076	0.1512	1.4076	1.1864
No log	10.8276	314	1.2669	0.1343	1.2669	1.1256
No log	10.8966	316	1.2219	0.1343	1.2219	1.1054
No log	10.9655	318	1.2355	0.1288	1.2355	1.1115
No log	11.0345	320	1.3249	0.1744	1.3249	1.1511
No log	11.1034	322	1.4015	0.2424	1.4015	1.1839
No log	11.1724	324	1.4096	0.2424	1.4096	1.1873
No log	11.2414	326	1.3424	0.2015	1.3424	1.1586
No log	11.3103	328	1.2650	0.2051	1.2650	1.1247
No log	11.3793	330	1.2961	0.1770	1.2961	1.1384
No log	11.4483	332	1.3711	0.1744	1.3711	1.1710
No log	11.5172	334	1.4352	0.2372	1.4352	1.1980
No log	11.5862	336	1.4840	0.2292	1.4840	1.2182
No log	11.6552	338	1.4286	0.1943	1.4286	1.1952
No log	11.7241	340	1.3066	0.2089	1.3066	1.1431
No log	11.7931	342	1.2223	0.1820	1.2223	1.1056
No log	11.8621	344	1.2303	0.2137	1.2303	1.1092
No log	11.9310	346	1.3006	0.2364	1.3006	1.1404
No log	12.0	348	1.3783	0.2372	1.3783	1.1740
No log	12.0690	350	1.3675	0.2372	1.3675	1.1694
No log	12.1379	352	1.3141	0.2065	1.3141	1.1463
No log	12.2069	354	1.2512	0.2065	1.2512	1.1186
No log	12.2759	356	1.1672	0.2027	1.1672	1.0804
No log	12.3448	358	1.1108	0.1019	1.1108	1.0539
No log	12.4138	360	1.1117	0.0649	1.1117	1.0544
No log	12.4828	362	1.1630	0.0721	1.1630	1.0784
No log	12.5517	364	1.2771	0.2065	1.2771	1.1301
No log	12.6207	366	1.3733	0.2342	1.3733	1.1719
No log	12.6897	368	1.5070	0.2566	1.5070	1.2276
No log	12.7586	370	1.4913	0.2566	1.4913	1.2212
No log	12.8276	372	1.3755	0.2342	1.3755	1.1728
No log	12.8966	374	1.2578	0.2227	1.2578	1.1215
No log	12.9655	376	1.2237	0.2227	1.2237	1.1062
No log	13.0345	378	1.2810	0.2395	1.2810	1.1318
No log	13.1034	380	1.2946	0.2640	1.2946	1.1378
No log	13.1724	382	1.2340	0.1697	1.2340	1.1108
No log	13.2414	384	1.1857	0.1579	1.1857	1.0889
No log	13.3103	386	1.1683	0.1868	1.1683	1.0809
No log	13.3793	388	1.1678	0.0870	1.1678	1.0806
No log	13.4483	390	1.1324	0.0802	1.1324	1.0641
No log	13.5172	392	1.1606	0.0924	1.1606	1.0773
No log	13.5862	394	1.2524	0.1351	1.2524	1.1191
No log	13.6552	396	1.4016	0.2065	1.4016	1.1839
No log	13.7241	398	1.4960	0.2372	1.4960	1.2231
No log	13.7931	400	1.5929	0.2117	1.5929	1.2621
No log	13.8621	402	1.5467	0.2292	1.5467	1.2437
No log	13.9310	404	1.4580	0.2342	1.4580	1.2075
No log	14.0	406	1.3668	0.2367	1.3668	1.1691
No log	14.0690	408	1.2577	0.2089	1.2577	1.1215
No log	14.1379	410	1.1826	0.2027	1.1826	1.0875
No log	14.2069	412	1.1314	0.1316	1.1314	1.0637
No log	14.2759	414	1.1742	0.2089	1.1742	1.0836
No log	14.3448	416	1.2945	0.2292	1.2945	1.1378
No log	14.4138	418	1.3381	0.2342	1.3381	1.1568
No log	14.4828	420	1.3672	0.2342	1.3672	1.1693
No log	14.5517	422	1.3135	0.2372	1.3135	1.1461
No log	14.6207	424	1.2486	0.2260	1.2486	1.1174
No log	14.6897	426	1.2110	0.1628	1.2110	1.1005
No log	14.7586	428	1.1696	0.0781	1.1696	1.0815
No log	14.8276	430	1.1806	0.0781	1.1806	1.0865
No log	14.8966	432	1.2284	0.0781	1.2284	1.1083
No log	14.9655	434	1.3138	0.1744	1.3138	1.1462
No log	15.0345	436	1.3255	0.1814	1.3255	1.1513
No log	15.1034	438	1.2774	0.1750	1.2774	1.1302
No log	15.1724	440	1.2845	0.1887	1.2845	1.1334
No log	15.2414	442	1.3161	0.2062	1.3161	1.1472
No log	15.3103	444	1.3593	0.1700	1.3593	1.1659
No log	15.3793	446	1.3660	0.2184	1.3660	1.1687
No log	15.4483	448	1.3471	0.1880	1.3471	1.1607
No log	15.5172	450	1.2431	0.2051	1.2431	1.1149
No log	15.5862	452	1.2170	0.1343	1.2170	1.1032
No log	15.6552	454	1.2342	0.0811	1.2342	1.1110
No log	15.7241	456	1.2374	0.0401	1.2374	1.1124
No log	15.7931	458	1.2889	0.0401	1.2889	1.1353
No log	15.8621	460	1.3807	0.1407	1.3807	1.1750
No log	15.9310	462	1.4314	0.1814	1.4314	1.1964
No log	16.0	464	1.3749	0.1336	1.3749	1.1726
No log	16.0690	466	1.2718	0.1887	1.2718	1.1277
No log	16.1379	468	1.2603	-0.0088	1.2603	1.1226
No log	16.2069	470	1.3520	0.1744	1.3520	1.1627
No log	16.2759	472	1.4396	0.1814	1.4396	1.1998
No log	16.3448	474	1.4534	0.1814	1.4534	1.2056
No log	16.4138	476	1.4180	0.1814	1.4180	1.1908
No log	16.4828	478	1.3748	0.1814	1.3748	1.1725
No log	16.5517	480	1.3295	0.1362	1.3295	1.1530
No log	16.6207	482	1.2918	0.0935	1.2918	1.1366
No log	16.6897	484	1.3091	0.0302	1.3091	1.1442
No log	16.7586	486	1.3865	0.1407	1.3865	1.1775
No log	16.8276	488	1.4485	0.1744	1.4485	1.2035
No log	16.8966	490	1.4627	0.1744	1.4627	1.2094
No log	16.9655	492	1.4466	0.1744	1.4466	1.2027
No log	17.0345	494	1.4435	0.1744	1.4435	1.2015
No log	17.1034	496	1.4187	0.0781	1.4187	1.1911
No log	17.1724	498	1.3584	0.0781	1.3584	1.1655
0.2593	17.2414	500	1.3415	0.0401	1.3415	1.1582
0.2593	17.3103	502	1.3580	0.0401	1.3580	1.1653
0.2593	17.3793	504	1.3514	0.0401	1.3514	1.1625
0.2593	17.4483	506	1.3269	0.0401	1.3269	1.1519
0.2593	17.5172	508	1.2209	0.0556	1.2209	1.1050
0.2593	17.5862	510	1.1902	0.1552	1.1902	1.0909
0.2593	17.6552	512	1.2844	0.2315	1.2844	1.1333
0.2593	17.7241	514	1.4031	0.2731	1.4031	1.1845
0.2593	17.7931	516	1.4733	0.2694	1.4733	1.2138
0.2593	17.8621	518	1.3886	0.2568	1.3886	1.1784
0.2593	17.9310	520	1.2492	0.2089	1.2492	1.1177
0.2593	18.0	522	1.1635	0.1434	1.1635	1.0786
0.2593	18.0690	524	1.0993	0.0864	1.0993	1.0485
0.2593	18.1379	526	1.0950	-0.0057	1.0950	1.0464
0.2593	18.2069	528	1.1214	0.0342	1.1214	1.0589
0.2593	18.2759	530	1.1793	0.1500	1.1793	1.0859
0.2593	18.3448	532	1.3096	0.1770	1.3096	1.1444
0.2593	18.4138	534	1.4448	0.2315	1.4448	1.2020
0.2593	18.4828	536	1.5349	0.2437	1.5349	1.2389
0.2593	18.5517	538	1.5076	0.2417	1.5076	1.2278
0.2593	18.6207	540	1.3894	0.2206	1.3894	1.1787
0.2593	18.6897	542	1.2871	0.1500	1.2871	1.1345
0.2593	18.7586	544	1.2577	0.1500	1.2577	1.1215
0.2593	18.8276	546	1.3176	0.1434	1.3176	1.1479
0.2593	18.8966	548	1.4082	0.2065	1.4082	1.1867
0.2593	18.9655	550	1.4423	0.1407	1.4423	1.2010
0.2593	19.0345	552	1.4602	0.1744	1.4602	1.2084
0.2593	19.1034	554	1.4165	0.1407	1.4165	1.1902
0.2593	19.1724	556	1.3602	0.1052	1.3602	1.1663
0.2593	19.2414	558	1.3472	0.1052	1.3472	1.1607
0.2593	19.3103	560	1.3349	0.1407	1.3349	1.1554
0.2593	19.3793	562	1.3672	0.1814	1.3672	1.1693
0.2593	19.4483	564	1.4049	0.2126	1.4049	1.1853
0.2593	19.5172	566	1.4021	0.2126	1.4021	1.1841
0.2593	19.5862	568	1.3794	0.2126	1.3794	1.1745
0.2593	19.6552	570	1.3338	0.1407	1.3338	1.1549
0.2593	19.7241	572	1.2640	0.0401	1.2640	1.1243
0.2593	19.7931	574	1.2583	0.0401	1.2583	1.1218
0.2593	19.8621	576	1.2935	0.0781	1.2935	1.1373
0.2593	19.9310	578	1.3678	0.1744	1.3678	1.1695
0.2593	20.0	580	1.4418	0.2342	1.4418	1.2007
0.2593	20.0690	582	1.4685	0.2611	1.4685	1.2118
0.2593	20.1379	584	1.4786	0.2342	1.4786	1.2160
0.2593	20.2069	586	1.4929	0.2611	1.4929	1.2218
0.2593	20.2759	588	1.4621	0.2611	1.4621	1.2092
0.2593	20.3448	590	1.3956	0.2184	1.3956	1.1814
0.2593	20.4138	592	1.3248	0.1407	1.3248	1.1510
0.2593	20.4828	594	1.2924	0.0401	1.2924	1.1368
0.2593	20.5517	596	1.2710	0.0401	1.2710	1.1274
0.2593	20.6207	598	1.2930	0.0401	1.2930	1.1371
0.2593	20.6897	600	1.3441	0.0401	1.3441	1.1594
0.2593	20.7586	602	1.4225	0.1407	1.4225	1.1927
0.2593	20.8276	604	1.4425	0.1407	1.4425	1.2010
0.2593	20.8966	606	1.4343	0.1407	1.4343	1.1976
0.2593	20.9655	608	1.4098	0.1407	1.4098	1.1873
0.2593	21.0345	610	1.4054	0.1407	1.4054	1.1855
0.2593	21.1034	612	1.3838	0.0401	1.3838	1.1764
0.2593	21.1724	614	1.3745	0.0401	1.3745	1.1724
0.2593	21.2414	616	1.3478	0.0401	1.3478	1.1609
0.2593	21.3103	618	1.3392	0.0401	1.3392	1.1572
0.2593	21.3793	620	1.3387	0.0401	1.3387	1.1570

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1