ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3658
• Qwk: 0.1407
• Mse: 1.3658
• Rmse: 1.1687

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.2448	-0.0160	4.2448	2.0603
No log	0.1379	4	2.3481	0.0014	2.3481	1.5324
No log	0.2069	6	1.8020	0.0318	1.8020	1.3424
No log	0.2759	8	1.8176	0.0429	1.8176	1.3482
No log	0.3448	10	1.5671	0.0408	1.5671	1.2518
No log	0.4138	12	1.3137	0.0	1.3137	1.1462
No log	0.4828	14	1.4668	0.0	1.4668	1.2111
No log	0.5517	16	1.4522	0.0	1.4522	1.2051
No log	0.6207	18	1.3676	0.0	1.3676	1.1695
No log	0.6897	20	1.1815	0.0880	1.1815	1.0870
No log	0.7586	22	1.0890	0.1476	1.0890	1.0436
No log	0.8276	24	1.1083	0.2008	1.1083	1.0528
No log	0.8966	26	1.1708	0.1864	1.1708	1.0820
No log	0.9655	28	1.3058	0.0219	1.3058	1.1427
No log	1.0345	30	1.3333	-0.0270	1.3333	1.1547
No log	1.1034	32	1.1897	0.1971	1.1897	1.0907
No log	1.1724	34	1.2141	0.0850	1.2141	1.1018
No log	1.2414	36	1.1793	0.1211	1.1793	1.0860
No log	1.3103	38	1.0413	0.2667	1.0413	1.0204
No log	1.3793	40	1.0547	0.1167	1.0547	1.0270
No log	1.4483	42	1.0034	0.1935	1.0034	1.0017
No log	1.5172	44	0.9769	0.3266	0.9769	0.9884
No log	1.5862	46	0.9579	0.2692	0.9579	0.9787
No log	1.6552	48	0.9685	0.1810	0.9685	0.9841
No log	1.7241	50	1.0671	0.1379	1.0671	1.0330
No log	1.7931	52	1.0444	0.2346	1.0444	1.0219
No log	1.8621	54	0.9754	0.3314	0.9754	0.9876
No log	1.9310	56	1.0597	0.3027	1.0597	1.0294
No log	2.0	58	1.3597	0.1316	1.3597	1.1661
No log	2.0690	60	1.4749	0.1027	1.4749	1.2145
No log	2.1379	62	1.3401	0.1856	1.3401	1.1576
No log	2.2069	64	1.4126	0.2058	1.4126	1.1885
No log	2.2759	66	1.3061	0.2689	1.3061	1.1429
No log	2.3448	68	1.2831	0.2431	1.2831	1.1327
No log	2.4138	70	1.3847	0.2334	1.3847	1.1768
No log	2.4828	72	1.3525	0.1522	1.3525	1.1630
No log	2.5517	74	1.1907	0.2100	1.1907	1.0912
No log	2.6207	76	1.1414	0.2081	1.1414	1.0683
No log	2.6897	78	1.1470	0.1775	1.1470	1.0710
No log	2.7586	80	1.2627	0.1654	1.2627	1.1237
No log	2.8276	82	1.2889	0.1370	1.2889	1.1353
No log	2.8966	84	1.2369	0.1750	1.2369	1.1122
No log	2.9655	86	1.1190	0.1919	1.1190	1.0578
No log	3.0345	88	1.0757	0.2605	1.0757	1.0372
No log	3.1034	90	1.1400	0.2494	1.1400	1.0677
No log	3.1724	92	1.3333	0.1989	1.3333	1.1547
No log	3.2414	94	1.4826	0.1063	1.4826	1.2176
No log	3.3103	96	1.5189	0.0874	1.5189	1.2324
No log	3.3793	98	1.4333	0.1272	1.4333	1.1972
No log	3.4483	100	1.2747	0.1750	1.2747	1.1290
No log	3.5172	102	1.1760	0.1893	1.1760	1.0845
No log	3.5862	104	1.2036	0.1461	1.2036	1.0971
No log	3.6552	106	1.3539	0.1943	1.3539	1.1636
No log	3.7241	108	1.3840	0.2187	1.3840	1.1764
No log	3.7931	110	1.2379	0.1858	1.2379	1.1126
No log	3.8621	112	1.1444	0.2251	1.1444	1.0698
No log	3.9310	114	1.2318	0.2049	1.2318	1.1099
No log	4.0	116	1.3087	0.2260	1.3087	1.1440
No log	4.0690	118	1.2904	0.2260	1.2904	1.1359
No log	4.1379	120	1.2415	0.1816	1.2415	1.1142
No log	4.2069	122	1.2675	0.1202	1.2675	1.1258
No log	4.2759	124	1.2252	0.1816	1.2252	1.1069
No log	4.3448	126	1.0807	0.2130	1.0807	1.0396
No log	4.4138	128	1.0513	0.2843	1.0513	1.0253
No log	4.4828	130	1.1397	0.2592	1.1397	1.0676
No log	4.5517	132	1.1753	0.2455	1.1753	1.0841
No log	4.6207	134	1.1003	0.1816	1.1003	1.0489
No log	4.6897	136	1.0448	0.0833	1.0448	1.0221
No log	4.7586	138	1.1019	0.1473	1.1019	1.0497
No log	4.8276	140	1.3045	0.1880	1.3045	1.1421
No log	4.8966	142	1.5541	0.2170	1.5541	1.2466
No log	4.9655	144	1.5676	0.1892	1.5676	1.2520
No log	5.0345	146	1.4275	0.1744	1.4275	1.1948
No log	5.1034	148	1.3368	0.0931	1.3368	1.1562
No log	5.1724	150	1.3404	0.1017	1.3404	1.1578
No log	5.2414	152	1.4265	0.0961	1.4265	1.1944
No log	5.3103	154	1.4992	0.1222	1.4992	1.2244
No log	5.3793	156	1.6079	0.1601	1.6079	1.2680
No log	5.4483	158	1.5194	0.1533	1.5194	1.2326
No log	5.5172	160	1.4391	0.2126	1.4391	1.1996
No log	5.5862	162	1.4306	0.1814	1.4306	1.1961
No log	5.6552	164	1.3075	0.1052	1.3075	1.1435
No log	5.7241	166	1.1591	0.1351	1.1591	1.0766
No log	5.7931	168	1.0991	0.1649	1.0991	1.0484
No log	5.8621	170	1.1479	0.1697	1.1479	1.0714
No log	5.9310	172	1.2412	0.2089	1.2412	1.1141
No log	6.0	174	1.2876	0.2089	1.2876	1.1347
No log	6.0690	176	1.3861	0.1814	1.3861	1.1773
No log	6.1379	178	1.3447	0.1486	1.3447	1.1596
No log	6.2069	180	1.2400	0.1697	1.2400	1.1136
No log	6.2759	182	1.1828	0.1724	1.1828	1.0875
No log	6.3448	184	1.1654	0.1893	1.1654	1.0795
No log	6.4138	186	1.1957	0.1724	1.1957	1.0935
No log	6.4828	188	1.2577	0.1697	1.2577	1.1215
No log	6.5517	190	1.2950	0.2395	1.2950	1.1380
No log	6.6207	192	1.3074	0.2206	1.3074	1.1434
No log	6.6897	194	1.3739	0.2026	1.3739	1.1721
No log	6.7586	196	1.5073	0.1789	1.5073	1.2277
No log	6.8276	198	1.5471	0.1789	1.5471	1.2438
No log	6.8966	200	1.4891	0.1790	1.4891	1.2203
No log	6.9655	202	1.4407	0.2084	1.4407	1.2003
No log	7.0345	204	1.4562	0.1728	1.4562	1.2067
No log	7.1034	206	1.4996	0.2117	1.4996	1.2246
No log	7.1724	208	1.4899	0.2184	1.4899	1.2206
No log	7.2414	210	1.4177	0.2126	1.4177	1.1907
No log	7.3103	212	1.3334	0.1407	1.3334	1.1547
No log	7.3793	214	1.2353	0.1724	1.2353	1.1115
No log	7.4483	216	1.2256	0.1724	1.2256	1.1071
No log	7.5172	218	1.2830	0.1407	1.2830	1.1327
No log	7.5862	220	1.4004	0.2126	1.4004	1.1834
No log	7.6552	222	1.4589	0.2709	1.4589	1.2079
No log	7.7241	224	1.4038	0.2424	1.4038	1.1848
No log	7.7931	226	1.3224	0.1744	1.3224	1.1500
No log	7.8621	228	1.1890	0.1911	1.1890	1.0904
No log	7.9310	230	1.1440	0.1724	1.1440	1.0696
No log	8.0	232	1.1502	0.2051	1.1502	1.0725
No log	8.0690	234	1.1480	0.2051	1.1480	1.0714
No log	8.1379	236	1.2640	0.1943	1.2640	1.1243
No log	8.2069	238	1.4056	0.2709	1.4056	1.1856
No log	8.2759	240	1.4022	0.2424	1.4022	1.1842
No log	8.3448	242	1.3235	0.2126	1.3235	1.1504
No log	8.4138	244	1.2024	0.1795	1.2024	1.0965
No log	8.4828	246	1.1691	0.1488	1.1691	1.0812
No log	8.5517	248	1.1917	0.1868	1.1917	1.0917
No log	8.6207	250	1.2589	0.1842	1.2589	1.1220
No log	8.6897	252	1.3544	0.2126	1.3544	1.1638
No log	8.7586	254	1.4890	0.2752	1.4890	1.2203
No log	8.8276	256	1.4783	0.2117	1.4783	1.2158
No log	8.8966	258	1.2833	0.2209	1.2833	1.1328
No log	8.9655	260	1.1744	0.2251	1.1744	1.0837
No log	9.0345	262	1.1946	0.1882	1.1946	1.0930
No log	9.1034	264	1.2835	0.2384	1.2835	1.1329
No log	9.1724	266	1.4037	0.2187	1.4037	1.1848
No log	9.2414	268	1.4168	0.2117	1.4168	1.1903
No log	9.3103	270	1.4265	0.0471	1.4265	1.1943
No log	9.3793	272	1.3875	0.0361	1.3875	1.1779
No log	9.4483	274	1.3018	0.2341	1.3018	1.1410
No log	9.5172	276	1.2447	0.2661	1.2447	1.1156
No log	9.5862	278	1.1988	0.2359	1.1988	1.0949
No log	9.6552	280	1.1521	0.2359	1.1521	1.0734
No log	9.7241	282	1.2028	0.2516	1.2028	1.0967
No log	9.7931	284	1.2649	0.2495	1.2649	1.1247
No log	9.8621	286	1.2173	0.2468	1.2173	1.1033
No log	9.9310	288	1.1648	0.2250	1.1648	1.0793
No log	10.0	290	1.2737	0.2337	1.2737	1.1286
No log	10.0690	292	1.3424	0.2315	1.3424	1.1586
No log	10.1379	294	1.3607	0.2315	1.3607	1.1665
No log	10.2069	296	1.3335	0.1816	1.3335	1.1548
No log	10.2759	298	1.2472	0.1868	1.2472	1.1168
No log	10.3448	300	1.2119	0.1488	1.2119	1.1009
No log	10.4138	302	1.2570	0.1868	1.2570	1.1212
No log	10.4828	304	1.3545	0.1697	1.3545	1.1638
No log	10.5517	306	1.4414	0.2065	1.4414	1.2006
No log	10.6207	308	1.5376	0.2170	1.5376	1.2400
No log	10.6897	310	1.5127	0.2117	1.5127	1.2299
No log	10.7586	312	1.4074	0.2065	1.4074	1.1863
No log	10.8276	314	1.2654	0.1724	1.2654	1.1249
No log	10.8966	316	1.1809	0.1109	1.1809	1.0867
No log	10.9655	318	1.1849	0.1868	1.1849	1.0885
No log	11.0345	320	1.3351	0.2364	1.3351	1.1555
No log	11.1034	322	1.5257	0.1943	1.5257	1.2352
No log	11.1724	324	1.5622	0.1943	1.5622	1.2499
No log	11.2414	326	1.5234	0.1835	1.5234	1.2343
No log	11.3103	328	1.4430	0.1770	1.4430	1.2012
No log	11.3793	330	1.4047	0.1654	1.4047	1.1852
No log	11.4483	332	1.4264	0.1858	1.4264	1.1943
No log	11.5172	334	1.4506	0.1858	1.4506	1.2044
No log	11.5862	336	1.4815	0.2015	1.4815	1.2172
No log	11.6552	338	1.5279	0.2424	1.5279	1.2361
No log	11.7241	340	1.4720	0.2372	1.4720	1.2132
No log	11.7931	342	1.4110	0.1628	1.4110	1.1878
No log	11.8621	344	1.4036	0.1838	1.4036	1.1847
No log	11.9310	346	1.4154	0.2065	1.4154	1.1897
No log	12.0	348	1.3545	0.1407	1.3545	1.1638
No log	12.0690	350	1.3319	0.1407	1.3319	1.1541
No log	12.1379	352	1.3301	0.1744	1.3301	1.1533
No log	12.2069	354	1.3325	0.2065	1.3325	1.1543
No log	12.2759	356	1.2915	0.2149	1.2915	1.1365
No log	12.3448	358	1.3042	0.2577	1.3042	1.1420
No log	12.4138	360	1.2596	0.2528	1.2596	1.1223
No log	12.4828	362	1.2362	0.2227	1.2362	1.1119
No log	12.5517	364	1.3099	0.2261	1.3099	1.1445
No log	12.6207	366	1.3388	0.2261	1.3388	1.1571
No log	12.6897	368	1.4027	0.2070	1.4027	1.1844
No log	12.7586	370	1.4017	0.1908	1.4017	1.1839
No log	12.8276	372	1.3562	0.2015	1.3562	1.1646
No log	12.8966	374	1.2535	0.2341	1.2535	1.1196
No log	12.9655	376	1.1972	0.1820	1.1972	1.0942
No log	13.0345	378	1.2146	0.2748	1.2146	1.1021
No log	13.1034	380	1.2094	0.2748	1.2094	1.0997
No log	13.1724	382	1.2817	0.2431	1.2817	1.1321
No log	13.2414	384	1.2805	0.1750	1.2805	1.1316
No log	13.3103	386	1.2222	0.0721	1.2222	1.1055
No log	13.3793	388	1.2002	0.1139	1.2002	1.0955
No log	13.4483	390	1.1736	0.1076	1.1736	1.0833
No log	13.5172	392	1.2185	0.0342	1.2185	1.1038
No log	13.5862	394	1.3122	0.0151	1.3122	1.1455
No log	13.6552	396	1.4504	0.1407	1.4504	1.2043
No log	13.7241	398	1.5003	0.2424	1.5003	1.2249
No log	13.7931	400	1.5536	0.2062	1.5536	1.2464
No log	13.8621	402	1.4933	0.1769	1.4933	1.2220
No log	13.9310	404	1.4291	0.1323	1.4291	1.1954
No log	14.0	406	1.4316	0.1832	1.4316	1.1965
No log	14.0690	408	1.3741	0.1769	1.3741	1.1722
No log	14.1379	410	1.2862	0.1628	1.2862	1.1341
No log	14.2069	412	1.2389	0.1628	1.2389	1.1130
No log	14.2759	414	1.2279	0.1397	1.2279	1.1081
No log	14.3448	416	1.2603	0.1628	1.2603	1.1226
No log	14.4138	418	1.2799	0.1744	1.2799	1.1313
No log	14.4828	420	1.2946	0.1024	1.2946	1.1378
No log	14.5517	422	1.3061	0.0781	1.3061	1.1429
No log	14.6207	424	1.3050	0.0661	1.3050	1.1423
No log	14.6897	426	1.3362	0.0781	1.3362	1.1559
No log	14.7586	428	1.4083	0.0781	1.4083	1.1867
No log	14.8276	430	1.4723	0.2065	1.4723	1.2134
No log	14.8966	432	1.4722	0.2065	1.4722	1.2134
No log	14.9655	434	1.4524	0.2065	1.4524	1.2052
No log	15.0345	436	1.4288	0.2065	1.4288	1.1953
No log	15.1034	438	1.4174	0.2126	1.4174	1.1905
No log	15.1724	440	1.4502	0.1943	1.4502	1.2043
No log	15.2414	442	1.5175	0.2221	1.5175	1.2318
No log	15.3103	444	1.5726	0.2482	1.5726	1.2540
No log	15.3793	446	1.4933	0.2239	1.4933	1.2220
No log	15.4483	448	1.4112	0.2126	1.4112	1.1879
No log	15.5172	450	1.2945	0.1744	1.2945	1.1377
No log	15.5862	452	1.1925	0.0907	1.1925	1.0920
No log	15.6552	454	1.1376	-0.0088	1.1376	1.0666
No log	15.7241	456	1.1327	-0.0499	1.1327	1.0643
No log	15.7931	458	1.1905	0.0661	1.1905	1.0911
No log	15.8621	460	1.3067	0.1744	1.3067	1.1431
No log	15.9310	462	1.3840	0.2126	1.3840	1.1764
No log	16.0	464	1.3758	0.2126	1.3758	1.1729
No log	16.0690	466	1.3253	0.2065	1.3253	1.1512
No log	16.1379	468	1.2578	0.1628	1.2578	1.1215
No log	16.2069	470	1.2920	0.1952	1.2920	1.1367
No log	16.2759	472	1.4137	0.2315	1.4137	1.1890
No log	16.3448	474	1.4753	0.1850	1.4753	1.2146
No log	16.4138	476	1.5620	0.2016	1.5620	1.2498
No log	16.4828	478	1.5139	0.2070	1.5139	1.2304
No log	16.5517	480	1.4258	0.2015	1.4258	1.1941
No log	16.6207	482	1.3135	0.1288	1.3135	1.1461
No log	16.6897	484	1.2524	0.0278	1.2524	1.1191
No log	16.7586	486	1.2680	0.0401	1.2680	1.1260
No log	16.8276	488	1.3165	0.0401	1.3165	1.1474
No log	16.8966	490	1.4179	0.1407	1.4179	1.1908
No log	16.9655	492	1.5413	0.1562	1.5413	1.2415
No log	17.0345	494	1.5986	0.2522	1.5986	1.2643
No log	17.1034	496	1.5472	0.2239	1.5472	1.2439
No log	17.1724	498	1.3492	0.1628	1.3492	1.1616
0.2568	17.2414	500	1.2023	0.1461	1.2023	1.0965
0.2568	17.3103	502	1.1424	0.0870	1.1424	1.0688
0.2568	17.3793	504	1.0929	0.0496	1.0929	1.0454
0.2568	17.4483	506	1.1160	0.0155	1.1160	1.0564
0.2568	17.5172	508	1.2150	0.0781	1.2150	1.1023
0.2568	17.5862	510	1.3658	0.1407	1.3658	1.1687

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1