ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k6_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4413
• Qwk: 0.1634
• Mse: 1.4413
• Rmse: 1.2006

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.0648	0.0070	4.0648	2.0161
No log	0.2667	4	2.1943	0.1047	2.1943	1.4813
No log	0.4	6	1.4606	0.0143	1.4606	1.2086
No log	0.5333	8	1.2335	-0.0032	1.2335	1.1106
No log	0.6667	10	1.1203	0.1304	1.1203	1.0584
No log	0.8	12	1.1447	0.1944	1.1447	1.0699
No log	0.9333	14	1.1465	0.0761	1.1465	1.0707
No log	1.0667	16	1.1281	0.1062	1.1281	1.0621
No log	1.2	18	1.1256	0.2145	1.1256	1.0610
No log	1.3333	20	1.0531	0.2015	1.0531	1.0262
No log	1.4667	22	1.1027	0.1292	1.1027	1.0501
No log	1.6	24	1.0525	0.1629	1.0525	1.0259
No log	1.7333	26	1.0091	0.1908	1.0091	1.0046
No log	1.8667	28	1.2192	0.0950	1.2192	1.1042
No log	2.0	30	1.5284	-0.0305	1.5284	1.2363
No log	2.1333	32	1.4065	0.0102	1.4065	1.1860
No log	2.2667	34	1.0920	0.0917	1.0920	1.0450
No log	2.4	36	1.2433	0.1199	1.2433	1.1150
No log	2.5333	38	1.6740	-0.0939	1.6740	1.2938
No log	2.6667	40	1.7687	-0.1658	1.7687	1.3299
No log	2.8	42	1.5873	-0.0749	1.5873	1.2599
No log	2.9333	44	1.5556	-0.1285	1.5556	1.2472
No log	3.0667	46	1.3672	0.1702	1.3672	1.1693
No log	3.2	48	1.2001	0.2632	1.2001	1.0955
No log	3.3333	50	1.3977	0.0818	1.3977	1.1823
No log	3.4667	52	1.5670	-0.0756	1.5670	1.2518
No log	3.6	54	1.4665	0.1452	1.4665	1.2110
No log	3.7333	56	1.2472	0.2773	1.2472	1.1168
No log	3.8667	58	1.1001	0.1170	1.1001	1.0489
No log	4.0	60	1.0654	0.0886	1.0654	1.0322
No log	4.1333	62	1.1325	0.1233	1.1325	1.0642
No log	4.2667	64	1.3356	0.2728	1.3356	1.1557
No log	4.4	66	1.5044	0.2313	1.5044	1.2265
No log	4.5333	68	1.6028	0.1935	1.6028	1.2660
No log	4.6667	70	1.7481	0.0275	1.7481	1.3222
No log	4.8	72	1.6289	0.1242	1.6289	1.2763
No log	4.9333	74	1.6525	0.0876	1.6525	1.2855
No log	5.0667	76	1.8225	0.0359	1.8225	1.3500
No log	5.2	78	1.7749	0.0542	1.7749	1.3323
No log	5.3333	80	1.4799	0.2194	1.4799	1.2165
No log	5.4667	82	1.4947	0.2311	1.4947	1.2226
No log	5.6	84	1.8309	-0.0145	1.8309	1.3531
No log	5.7333	86	1.8321	-0.0653	1.8321	1.3535
No log	5.8667	88	1.4184	0.1054	1.4184	1.1910
No log	6.0	90	1.1325	0.2864	1.1325	1.0642
No log	6.1333	92	1.0947	0.2512	1.0947	1.0463
No log	6.2667	94	1.2938	0.1649	1.2938	1.1374
No log	6.4	96	1.5198	-0.0052	1.5198	1.2328
No log	6.5333	98	1.4648	-0.0171	1.4648	1.2103
No log	6.6667	100	1.2772	0.1649	1.2772	1.1301
No log	6.8	102	1.1927	0.2636	1.1927	1.0921
No log	6.9333	104	1.2843	0.1868	1.2843	1.1333
No log	7.0667	106	1.3793	0.0870	1.3793	1.1744
No log	7.2	108	1.4438	0.0483	1.4438	1.2016
No log	7.3333	110	1.2752	0.1986	1.2752	1.1293
No log	7.4667	112	1.1645	0.2105	1.1645	1.0791
No log	7.6	114	1.0062	0.2512	1.0062	1.0031
No log	7.7333	116	0.9886	0.2773	0.9886	0.9943
No log	7.8667	118	1.1602	0.2105	1.1602	1.0771
No log	8.0	120	1.4090	0.1026	1.4090	1.1870
No log	8.1333	122	1.6474	-0.0137	1.6474	1.2835
No log	8.2667	124	1.5955	-0.0313	1.5955	1.2631
No log	8.4	126	1.3919	0.1858	1.3919	1.1798
No log	8.5333	128	1.3567	0.2438	1.3567	1.1648
No log	8.6667	130	1.5119	0.2091	1.5119	1.2296
No log	8.8	132	1.5289	0.1971	1.5289	1.2365
No log	8.9333	134	1.3237	0.2528	1.3237	1.1505
No log	9.0667	136	1.1219	0.2167	1.1219	1.0592
No log	9.2	138	1.1876	0.2528	1.1876	1.0898
No log	9.3333	140	1.4345	0.1854	1.4345	1.1977
No log	9.4667	142	1.5098	0.1663	1.5098	1.2288
No log	9.6	144	1.4956	0.1354	1.4956	1.2229
No log	9.7333	146	1.2952	0.2105	1.2952	1.1381
No log	9.8667	148	1.1930	0.1986	1.1930	1.0923
No log	10.0	150	1.1884	0.2105	1.1884	1.0901
No log	10.1333	152	1.2602	0.2105	1.2602	1.1226
No log	10.2667	154	1.2742	0.2424	1.2742	1.1288
No log	10.4	156	1.3051	0.2857	1.3051	1.1424
No log	10.5333	158	1.3210	0.2857	1.3210	1.1493
No log	10.6667	160	1.3848	0.2730	1.3848	1.1768
No log	10.8	162	1.3725	0.2640	1.3725	1.1716
No log	10.9333	164	1.3730	0.2341	1.3730	1.1718
No log	11.0667	166	1.4788	0.1058	1.4788	1.2161
No log	11.2	168	1.3882	0.1370	1.3882	1.1782
No log	11.3333	170	1.3641	0.1961	1.3641	1.1679
No log	11.4667	172	1.3961	0.1512	1.3961	1.1816
No log	11.6	174	1.5546	0.0694	1.5546	1.2468
No log	11.7333	176	1.6420	0.1428	1.6420	1.2814
No log	11.8667	178	1.6865	0.1428	1.6865	1.2986
No log	12.0	180	1.5908	0.1222	1.5908	1.2613
No log	12.1333	182	1.4352	0.1886	1.4352	1.1980
No log	12.2667	184	1.3315	0.1202	1.3315	1.1539
No log	12.4	186	1.3558	0.1052	1.3558	1.1644
No log	12.5333	188	1.4045	0.2709	1.4045	1.1851
No log	12.6667	190	1.4973	0.2522	1.4973	1.2236
No log	12.8	192	1.3462	0.2239	1.3462	1.1603
No log	12.9333	194	1.2102	0.2495	1.2102	1.1001
No log	13.0667	196	1.0868	0.3126	1.0868	1.0425
No log	13.2	198	1.2549	0.2851	1.2549	1.1202
No log	13.3333	200	1.4925	0.2525	1.4925	1.2217
No log	13.4667	202	1.4468	0.1769	1.4468	1.2028
No log	13.6	204	1.3303	0.2203	1.3303	1.1534
No log	13.7333	206	1.2350	0.1622	1.2350	1.1113
No log	13.8667	208	1.2858	0.1622	1.2858	1.1339
No log	14.0	210	1.4297	0.1816	1.4297	1.1957
No log	14.1333	212	1.5152	0.2542	1.5152	1.2309
No log	14.2667	214	1.4592	0.2542	1.4592	1.2080
No log	14.4	216	1.4779	0.2542	1.4779	1.2157
No log	14.5333	218	1.5137	0.2730	1.5137	1.2303
No log	14.6667	220	1.3965	0.2730	1.3965	1.1817
No log	14.8	222	1.1797	0.1842	1.1797	1.0861
No log	14.9333	224	1.1453	0.1842	1.1453	1.0702
No log	15.0667	226	1.2413	0.1697	1.2413	1.1142
No log	15.2	228	1.3602	0.2592	1.3602	1.1663
No log	15.3333	230	1.5068	0.2568	1.5068	1.2275
No log	15.4667	232	1.5127	0.2568	1.5127	1.2299
No log	15.6	234	1.3875	0.2015	1.3875	1.1779
No log	15.7333	236	1.2705	0.1081	1.2705	1.1272
No log	15.8667	238	1.2317	0.0710	1.2317	1.1098
No log	16.0	240	1.3076	0.0781	1.3076	1.1435
No log	16.1333	242	1.4969	0.2292	1.4969	1.2235
No log	16.2667	244	1.6415	0.1955	1.6415	1.2812
No log	16.4	246	1.5782	0.1142	1.5782	1.2563
No log	16.5333	248	1.5535	-0.0624	1.5535	1.2464
No log	16.6667	250	1.4705	-0.0833	1.4705	1.2126
No log	16.8	252	1.3383	-0.0464	1.3383	1.1568
No log	16.9333	254	1.2237	0.1500	1.2237	1.1062
No log	17.0667	256	1.1779	0.1141	1.1779	1.0853
No log	17.2	258	1.2758	0.2284	1.2758	1.1295
No log	17.3333	260	1.4936	0.2647	1.4936	1.2221
No log	17.4667	262	1.5999	0.2845	1.5999	1.2649
No log	17.6	264	1.4799	0.3249	1.4799	1.2165
No log	17.7333	266	1.2662	0.2896	1.2662	1.1253
No log	17.8667	268	1.2817	0.2577	1.2817	1.1321
No log	18.0	270	1.3807	0.2446	1.3807	1.1750
No log	18.1333	272	1.3885	0.2075	1.3885	1.1783
No log	18.2667	274	1.2965	0.1697	1.2965	1.1387
No log	18.4	276	1.2244	0.1842	1.2244	1.1065
No log	18.5333	278	1.2128	0.1842	1.2128	1.1013
No log	18.6667	280	1.3000	0.2577	1.3000	1.1402
No log	18.8	282	1.4449	0.3001	1.4449	1.2020
No log	18.9333	284	1.5527	0.2511	1.5527	1.2461
No log	19.0667	286	1.5266	0.2391	1.5266	1.2356
No log	19.2	288	1.4517	0.1943	1.4517	1.2049
No log	19.3333	290	1.3418	0.2126	1.3418	1.1584
No log	19.4667	292	1.2226	0.1202	1.2226	1.1057
No log	19.6	294	1.1695	0.1141	1.1695	1.0814
No log	19.7333	296	1.2161	0.1842	1.2161	1.1028
No log	19.8667	298	1.3232	0.2592	1.3232	1.1503
No log	20.0	300	1.3701	0.2455	1.3701	1.1705
No log	20.1333	302	1.3900	0.2455	1.3900	1.1790
No log	20.2667	304	1.3350	0.2284	1.3350	1.1554
No log	20.4	306	1.3223	0.2728	1.3223	1.1499
No log	20.5333	308	1.3468	0.2528	1.3468	1.1605
No log	20.6667	310	1.3934	0.2015	1.3934	1.1804
No log	20.8	312	1.4190	0.1880	1.4190	1.1912
No log	20.9333	314	1.3343	0.1486	1.3343	1.1551
No log	21.0667	316	1.2813	0.2341	1.2813	1.1319
No log	21.2	318	1.2166	0.2424	1.2166	1.1030
No log	21.3333	320	1.2465	0.2528	1.2465	1.1165
No log	21.4667	322	1.2333	0.2227	1.2333	1.1105
No log	21.6	324	1.2760	0.1838	1.2760	1.1296
No log	21.7333	326	1.3604	0.1880	1.3604	1.1664
No log	21.8667	328	1.4262	0.2184	1.4262	1.1942
No log	22.0	330	1.4660	0.2522	1.4660	1.2108
No log	22.1333	332	1.4499	0.2522	1.4499	1.2041
No log	22.2667	334	1.3936	0.2730	1.3936	1.1805
No log	22.4	336	1.2594	0.1579	1.2594	1.1222
No log	22.5333	338	1.1770	0.1141	1.1770	1.0849
No log	22.6667	340	1.2111	0.1141	1.2111	1.1005
No log	22.8	342	1.3404	0.1770	1.3404	1.1578
No log	22.9333	344	1.3710	0.1628	1.3710	1.1709
No log	23.0667	346	1.3774	0.1628	1.3774	1.1736
No log	23.2	348	1.2960	0.1473	1.2960	1.1384
No log	23.3333	350	1.2264	0.1351	1.2264	1.1074
No log	23.4667	352	1.1712	0.2528	1.1712	1.0822
No log	23.6	354	1.2160	0.2857	1.2160	1.1027
No log	23.7333	356	1.4321	0.2789	1.4321	1.1967
No log	23.8667	358	1.6484	0.3053	1.6484	1.2839
No log	24.0	360	1.6747	0.2525	1.6747	1.2941
No log	24.1333	362	1.5266	0.1703	1.5266	1.2356
No log	24.2667	364	1.3639	0.0401	1.3639	1.1679
No log	24.4	366	1.2644	0.0401	1.2644	1.1245
No log	24.5333	368	1.2546	0.0987	1.2546	1.1201
No log	24.6667	370	1.3074	0.0556	1.3074	1.1434
No log	24.8	372	1.3365	0.1697	1.3365	1.1561
No log	24.9333	374	1.3664	0.2089	1.3664	1.1689
No log	25.0667	376	1.4856	0.2588	1.4856	1.2188
No log	25.2	378	1.4945	0.2417	1.4945	1.2225
No log	25.3333	380	1.3950	0.2089	1.3950	1.1811
No log	25.4667	382	1.2882	0.1351	1.2882	1.1350
No log	25.6	384	1.2829	0.1351	1.2829	1.1326
No log	25.7333	386	1.3529	0.1697	1.3529	1.1631
No log	25.8667	388	1.4651	0.1562	1.4651	1.2104
No log	26.0	390	1.4675	0.1943	1.4675	1.2114
No log	26.1333	392	1.3851	0.2284	1.3851	1.1769
No log	26.2667	394	1.3656	0.1697	1.3656	1.1686
No log	26.4	396	1.2957	0.1351	1.2957	1.1383
No log	26.5333	398	1.2052	0.0987	1.2052	1.0978
No log	26.6667	400	1.1887	0.0556	1.1887	1.0903
No log	26.8	402	1.2503	0.0401	1.2503	1.1182
No log	26.9333	404	1.2669	0.0401	1.2669	1.1256
No log	27.0667	406	1.2113	0.0401	1.2113	1.1006
No log	27.2	408	1.1798	0.1351	1.1798	1.0862
No log	27.3333	410	1.2004	0.1697	1.2004	1.0956
No log	27.4667	412	1.2121	0.1697	1.2121	1.1010
No log	27.6	414	1.2267	0.1288	1.2267	1.1076
No log	27.7333	416	1.2318	0.1142	1.2318	1.1099
No log	27.8667	418	1.2497	0.1142	1.2497	1.1179
No log	28.0	420	1.2278	0.1697	1.2278	1.1080
No log	28.1333	422	1.2070	0.1351	1.2070	1.0986
No log	28.2667	424	1.2065	0.1351	1.2065	1.0984
No log	28.4	426	1.1924	0.1351	1.1924	1.0920
No log	28.5333	428	1.2705	0.1697	1.2705	1.1272
No log	28.6667	430	1.3346	0.1552	1.3346	1.1553
No log	28.8	432	1.3391	0.1202	1.3391	1.1572
No log	28.9333	434	1.2819	0.1202	1.2819	1.1322
No log	29.0667	436	1.2752	0.1351	1.2752	1.1292
No log	29.2	438	1.2392	0.1351	1.2392	1.1132
No log	29.3333	440	1.2436	0.1351	1.2436	1.1152
No log	29.4667	442	1.3195	0.1697	1.3195	1.1487
No log	29.6	444	1.4677	0.2730	1.4677	1.2115
No log	29.7333	446	1.6014	0.2611	1.6014	1.2655
No log	29.8667	448	1.6255	0.2611	1.6255	1.2750
No log	30.0	450	1.5790	0.2611	1.5790	1.2566
No log	30.1333	452	1.4803	0.2812	1.4803	1.2167
No log	30.2667	454	1.3390	0.2149	1.3390	1.1572
No log	30.4	456	1.2844	0.2149	1.2844	1.1333
No log	30.5333	458	1.3392	0.2446	1.3392	1.1572
No log	30.6667	460	1.4545	0.2446	1.4545	1.2060
No log	30.8	462	1.4302	0.1697	1.4302	1.1959
No log	30.9333	464	1.4096	0.1697	1.4096	1.1873
No log	31.0667	466	1.3200	0.1697	1.3200	1.1489
No log	31.2	468	1.2894	0.1697	1.2894	1.1355
No log	31.3333	470	1.2985	0.1697	1.2985	1.1395
No log	31.4667	472	1.3630	0.2495	1.3630	1.1675
No log	31.6	474	1.3646	0.2315	1.3646	1.1682
No log	31.7333	476	1.3713	0.2315	1.3713	1.1710
No log	31.8667	478	1.3042	0.2143	1.3042	1.1420
No log	32.0	480	1.1841	0.1697	1.1841	1.0882
No log	32.1333	482	1.1732	0.1770	1.1732	1.0831
No log	32.2667	484	1.2683	0.2446	1.2683	1.1262
No log	32.4	486	1.3722	0.2772	1.3722	1.1714
No log	32.5333	488	1.3995	0.2772	1.3995	1.1830
No log	32.6667	490	1.3238	0.2446	1.3238	1.1505
No log	32.8	492	1.2609	0.1697	1.2609	1.1229
No log	32.9333	494	1.2666	0.1697	1.2666	1.1254
No log	33.0667	496	1.3122	0.1770	1.3122	1.1455
No log	33.2	498	1.3368	0.1700	1.3368	1.1562
0.2165	33.3333	500	1.3092	0.2089	1.3092	1.1442
0.2165	33.4667	502	1.2497	0.1770	1.2497	1.1179
0.2165	33.6	504	1.2109	0.1770	1.2109	1.1004
0.2165	33.7333	506	1.2731	0.1770	1.2731	1.1283
0.2165	33.8667	508	1.3820	0.1769	1.3820	1.1756
0.2165	34.0	510	1.4413	0.1634	1.4413	1.2006

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1