ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2878
• Qwk: 0.1344
• Mse: 1.2878
• Rmse: 1.1348

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	4.4727	0.0163	4.4727	2.1149
No log	0.1053	4	2.7155	0.0012	2.7155	1.6479
No log	0.1579	6	2.0518	0.0062	2.0518	1.4324
No log	0.2105	8	1.8906	0.0062	1.8906	1.3750
No log	0.2632	10	1.9512	-0.0366	1.9512	1.3969
No log	0.3158	12	1.3972	-0.0374	1.3972	1.1821
No log	0.3684	14	1.2935	0.0454	1.2935	1.1373
No log	0.4211	16	1.2797	0.0904	1.2797	1.1312
No log	0.4737	18	1.3104	0.0370	1.3104	1.1447
No log	0.5263	20	1.6451	-0.0451	1.6451	1.2826
No log	0.5789	22	1.9443	0.0	1.9443	1.3944
No log	0.6316	24	1.7241	0.0	1.7241	1.3131
No log	0.6842	26	1.4738	0.0	1.4738	1.2140
No log	0.7368	28	1.2923	0.1288	1.2923	1.1368
No log	0.7895	30	1.2202	0.1470	1.2202	1.1046
No log	0.8421	32	1.3019	0.1423	1.3019	1.1410
No log	0.8947	34	1.4520	-0.1074	1.4520	1.2050
No log	0.9474	36	1.5232	-0.0149	1.5232	1.2342
No log	1.0	38	1.5884	0.0	1.5884	1.2603
No log	1.0526	40	1.5286	0.0	1.5286	1.2364
No log	1.1053	42	1.4799	-0.0149	1.4799	1.2165
No log	1.1579	44	1.4218	-0.0029	1.4218	1.1924
No log	1.2105	46	1.3779	-0.0059	1.3779	1.1739
No log	1.2632	48	1.3998	-0.0217	1.3998	1.1831
No log	1.3158	50	1.6127	-0.1229	1.6127	1.2699
No log	1.3684	52	1.7190	-0.0839	1.7190	1.3111
No log	1.4211	54	1.7048	-0.0839	1.7048	1.3057
No log	1.4737	56	1.5835	-0.0745	1.5835	1.2584
No log	1.5263	58	1.3379	0.1108	1.3379	1.1567
No log	1.5789	60	1.3012	0.0041	1.3012	1.1407
No log	1.6316	62	1.3139	-0.0552	1.3139	1.1462
No log	1.6842	64	1.2919	-0.0616	1.2919	1.1366
No log	1.7368	66	1.2566	0.0327	1.2566	1.1210
No log	1.7895	68	1.2434	0.0642	1.2434	1.1151
No log	1.8421	70	1.2464	0.2212	1.2464	1.1164
No log	1.8947	72	1.2325	0.2155	1.2325	1.1102
No log	1.9474	74	1.2387	0.1407	1.2387	1.1130
No log	2.0	76	1.3276	0.1260	1.3276	1.1522
No log	2.0526	78	1.5823	-0.0534	1.5823	1.2579
No log	2.1053	80	1.8255	0.0	1.8255	1.3511
No log	2.1579	82	1.7509	0.0	1.7509	1.3232
No log	2.2105	84	1.4834	-0.0132	1.4834	1.2180
No log	2.2632	86	1.2676	0.0948	1.2676	1.1259
No log	2.3158	88	1.2160	0.0904	1.2160	1.1027
No log	2.3684	90	1.2481	0.0454	1.2481	1.1172
No log	2.4211	92	1.2347	0.0628	1.2347	1.1112
No log	2.4737	94	1.2456	0.1176	1.2456	1.1161
No log	2.5263	96	1.2460	0.1076	1.2460	1.1162
No log	2.5789	98	1.2373	0.0841	1.2373	1.1123
No log	2.6316	100	1.2349	0.0841	1.2349	1.1113
No log	2.6842	102	1.2377	0.1532	1.2377	1.1125
No log	2.7368	104	1.3394	0.1200	1.3394	1.1573
No log	2.7895	106	1.3919	0.0831	1.3919	1.1798
No log	2.8421	108	1.2509	0.1675	1.2509	1.1184
No log	2.8947	110	1.2393	0.0527	1.2393	1.1132
No log	2.9474	112	1.3409	0.0811	1.3409	1.1580
No log	3.0	114	1.2920	0.0711	1.2920	1.1367
No log	3.0526	116	1.2243	0.1727	1.2243	1.1065
No log	3.1053	118	1.3377	0.1696	1.3377	1.1566
No log	3.1579	120	1.5733	-0.0412	1.5733	1.2543
No log	3.2105	122	1.4278	0.0319	1.4278	1.1949
No log	3.2632	124	1.2147	0.2618	1.2147	1.1022
No log	3.3158	126	1.1645	0.2371	1.1645	1.0791
No log	3.3684	128	1.2087	0.1764	1.2087	1.0994
No log	3.4211	130	1.1806	0.1920	1.1806	1.0866
No log	3.4737	132	1.1916	0.1897	1.1916	1.0916
No log	3.5263	134	1.2295	0.2991	1.2295	1.1088
No log	3.5789	136	1.2118	0.1475	1.2118	1.1008
No log	3.6316	138	1.3350	0.1984	1.3350	1.1554
No log	3.6842	140	1.5184	0.1845	1.5184	1.2322
No log	3.7368	142	1.4236	0.2295	1.4236	1.1932
No log	3.7895	144	1.2843	0.1864	1.2843	1.1333
No log	3.8421	146	1.2620	0.1693	1.2620	1.1234
No log	3.8947	148	1.3583	0.1722	1.3583	1.1655
No log	3.9474	150	1.4027	0.2069	1.4027	1.1844
No log	4.0	152	1.4973	0.2009	1.4973	1.2237
No log	4.0526	154	1.4177	0.1618	1.4177	1.1907
No log	4.1053	156	1.3125	0.2032	1.3125	1.1457
No log	4.1579	158	1.1714	0.2431	1.1714	1.0823
No log	4.2105	160	1.1122	0.2556	1.1122	1.0546
No log	4.2632	162	1.1199	0.2556	1.1199	1.0583
No log	4.3158	164	1.1325	0.2355	1.1325	1.0642
No log	4.3684	166	1.1840	0.3405	1.1840	1.0881
No log	4.4211	168	1.2684	0.2634	1.2684	1.1262
No log	4.4737	170	1.2633	0.2909	1.2633	1.1240
No log	4.5263	172	1.2107	0.2268	1.2107	1.1003
No log	4.5789	174	1.2742	0.1928	1.2742	1.1288
No log	4.6316	176	1.2353	0.1568	1.2353	1.1114
No log	4.6842	178	1.3041	0.2259	1.3041	1.1420
No log	4.7368	180	1.3994	0.2387	1.3994	1.1830
No log	4.7895	182	1.3127	0.2391	1.3127	1.1457
No log	4.8421	184	1.2910	0.2076	1.2910	1.1362
No log	4.8947	186	1.2961	0.1921	1.2961	1.1385
No log	4.9474	188	1.4356	0.1801	1.4356	1.1982
No log	5.0	190	1.4874	0.1801	1.4874	1.2196
No log	5.0526	192	1.3882	0.1188	1.3882	1.1782
No log	5.1053	194	1.2848	0.1431	1.2848	1.1335
No log	5.1579	196	1.3075	0.0150	1.3075	1.1434
No log	5.2105	198	1.3281	0.1431	1.3281	1.1524
No log	5.2632	200	1.4146	0.1713	1.4146	1.1894
No log	5.3158	202	1.4242	0.1224	1.4242	1.1934
No log	5.3684	204	1.3784	0.0876	1.3784	1.1740
No log	5.4211	206	1.4641	0.0896	1.4641	1.2100
No log	5.4737	208	1.4035	0.0896	1.4035	1.1847
No log	5.5263	210	1.2902	0.1067	1.2902	1.1359
No log	5.5789	212	1.3708	0.1427	1.3708	1.1708
No log	5.6316	214	1.3427	0.1094	1.3427	1.1588
No log	5.6842	216	1.2716	0.1156	1.2716	1.1276
No log	5.7368	218	1.1999	0.1983	1.1999	1.0954
No log	5.7895	220	1.1967	0.1642	1.1967	1.0939
No log	5.8421	222	1.2428	0.1864	1.2428	1.1148
No log	5.8947	224	1.4396	0.0818	1.4396	1.1998
No log	5.9474	226	1.4913	0.0884	1.4913	1.2212
No log	6.0	228	1.3560	0.0937	1.3560	1.1645
No log	6.0526	230	1.2193	0.1701	1.2193	1.1042
No log	6.1053	232	1.1846	0.2276	1.1846	1.0884
No log	6.1579	234	1.2162	0.1807	1.2162	1.1028
No log	6.2105	236	1.3450	0.1371	1.3450	1.1597
No log	6.2632	238	1.4875	0.1929	1.4875	1.2196
No log	6.3158	240	1.4105	0.1395	1.4105	1.1876
No log	6.3684	242	1.2190	0.1867	1.2190	1.1041
No log	6.4211	244	1.2049	0.2871	1.2049	1.0977
No log	6.4737	246	1.2179	0.2253	1.2179	1.1036
No log	6.5263	248	1.2272	0.2273	1.2272	1.1078
No log	6.5789	250	1.3634	0.1193	1.3634	1.1676
No log	6.6316	252	1.3636	0.1339	1.3636	1.1677
No log	6.6842	254	1.4443	0.1171	1.4443	1.2018
No log	6.7368	256	1.4564	0.1112	1.4564	1.2068
No log	6.7895	258	1.3571	0.1483	1.3571	1.1649
No log	6.8421	260	1.3777	0.0964	1.3777	1.1738
No log	6.8947	262	1.3600	0.1339	1.3600	1.1662
No log	6.9474	264	1.2929	0.2878	1.2929	1.1371
No log	7.0	266	1.3432	0.1854	1.3432	1.1590
No log	7.0526	268	1.5250	0.0971	1.5250	1.2349
No log	7.1053	270	1.6469	0.1095	1.6469	1.2833
No log	7.1579	272	1.5535	0.0992	1.5535	1.2464
No log	7.2105	274	1.3751	0.1395	1.3751	1.1726
No log	7.2632	276	1.3117	0.2275	1.3117	1.1453
No log	7.3158	278	1.2984	0.2651	1.2984	1.1395
No log	7.3684	280	1.3847	0.1404	1.3847	1.1768
No log	7.4211	282	1.4757	0.0884	1.4757	1.2148
No log	7.4737	284	1.6141	0.1806	1.6141	1.2705
No log	7.5263	286	1.5803	0.1997	1.5803	1.2571
No log	7.5789	288	1.3230	0.2333	1.3230	1.1502
No log	7.6316	290	1.1627	0.3231	1.1627	1.0783
No log	7.6842	292	1.1575	0.3117	1.1575	1.0759
No log	7.7368	294	1.2139	0.2878	1.2139	1.1018
No log	7.7895	296	1.3708	0.1461	1.3708	1.1708
No log	7.8421	298	1.3773	0.1162	1.3773	1.1736
No log	7.8947	300	1.2926	0.2348	1.2926	1.1369
No log	7.9474	302	1.2458	0.2108	1.2458	1.1162
No log	8.0	304	1.2482	0.2651	1.2482	1.1172
No log	8.0526	306	1.2364	0.2263	1.2364	1.1119
No log	8.1053	308	1.2350	0.1961	1.2350	1.1113
No log	8.1579	310	1.3132	0.2291	1.3132	1.1460
No log	8.2105	312	1.3800	0.1753	1.3800	1.1747
No log	8.2632	314	1.4588	0.1310	1.4588	1.2078
No log	8.3158	316	1.4158	0.1708	1.4158	1.1899
No log	8.3684	318	1.3080	0.2097	1.3080	1.1437
No log	8.4211	320	1.2268	0.2336	1.2268	1.1076
No log	8.4737	322	1.2203	0.2392	1.2203	1.1047
No log	8.5263	324	1.2226	0.2432	1.2226	1.1057
No log	8.5789	326	1.2813	0.1650	1.2813	1.1320
No log	8.6316	328	1.3621	0.1498	1.3621	1.1671
No log	8.6842	330	1.4381	0.1228	1.4381	1.1992
No log	8.7368	332	1.3583	0.1222	1.3583	1.1655
No log	8.7895	334	1.2515	0.2490	1.2515	1.1187
No log	8.8421	336	1.2613	0.2878	1.2613	1.1231
No log	8.8947	338	1.3236	0.1309	1.3236	1.1505
No log	8.9474	340	1.4972	0.1970	1.4972	1.2236
No log	9.0	342	1.5214	0.1970	1.5214	1.2334
No log	9.0526	344	1.3778	0.1461	1.3778	1.1738
No log	9.1053	346	1.2449	0.2263	1.2449	1.1157
No log	9.1579	348	1.1967	0.1808	1.1967	1.0939
No log	9.2105	350	1.2038	0.1808	1.2038	1.0972
No log	9.2632	352	1.2910	0.0937	1.2910	1.1362
No log	9.3158	354	1.4821	0.0884	1.4821	1.2174
No log	9.3684	356	1.5428	0.1758	1.5428	1.2421
No log	9.4211	358	1.5391	0.1498	1.5391	1.2406
No log	9.4737	360	1.3966	0.0884	1.3966	1.1818
No log	9.5263	362	1.2479	0.1864	1.2479	1.1171
No log	9.5789	364	1.2314	0.2317	1.2314	1.1097
No log	9.6316	366	1.2805	0.1131	1.2805	1.1316
No log	9.6842	368	1.3069	0.1131	1.3069	1.1432
No log	9.7368	370	1.3311	0.1448	1.3311	1.1537
No log	9.7895	372	1.3886	0.1171	1.3886	1.1784
No log	9.8421	374	1.3541	0.1448	1.3541	1.1636
No log	9.8947	376	1.2748	0.2037	1.2748	1.1291
No log	9.9474	378	1.3402	0.1112	1.3402	1.1577
No log	10.0	380	1.3425	0.1254	1.3425	1.1587
No log	10.0526	382	1.2661	0.1943	1.2661	1.1252
No log	10.1053	384	1.1729	0.2263	1.1729	1.0830
No log	10.1579	386	1.1951	0.1952	1.1951	1.0932
No log	10.2105	388	1.2418	0.1896	1.2418	1.1143
No log	10.2632	390	1.2731	0.1554	1.2731	1.1283
No log	10.3158	392	1.2097	0.1654	1.2097	1.0999
No log	10.3684	394	1.1864	0.2417	1.1864	1.0892
No log	10.4211	396	1.2240	0.1951	1.2240	1.1063
No log	10.4737	398	1.3633	0.1481	1.3633	1.1676
No log	10.5263	400	1.5385	0.2009	1.5385	1.2404
No log	10.5789	402	1.5010	0.1929	1.5010	1.2252
No log	10.6316	404	1.3244	0.1345	1.3244	1.1508
No log	10.6842	406	1.1713	0.2119	1.1713	1.0823
No log	10.7368	408	1.1396	0.2513	1.1396	1.0675
No log	10.7895	410	1.1487	0.2130	1.1487	1.0718
No log	10.8421	412	1.2051	0.2009	1.2051	1.0978
No log	10.8947	414	1.3904	0.1071	1.3904	1.1792
No log	10.9474	416	1.4940	0.1112	1.4940	1.2223
No log	11.0	418	1.5617	0.1283	1.5617	1.2497
No log	11.0526	420	1.5371	0.1698	1.5371	1.2398
No log	11.1053	422	1.4038	0.1219	1.4038	1.1848
No log	11.1579	424	1.2574	0.1053	1.2574	1.1213
No log	11.2105	426	1.1677	0.1752	1.1677	1.0806
No log	11.2632	428	1.1641	0.1979	1.1641	1.0789
No log	11.3158	430	1.1910	0.1808	1.1910	1.0913
No log	11.3684	432	1.2827	0.1538	1.2827	1.1325
No log	11.4211	434	1.4013	0.1071	1.4013	1.1838
No log	11.4737	436	1.4403	0.0964	1.4403	1.2001
No log	11.5263	438	1.3963	0.1222	1.3963	1.1816
No log	11.5789	440	1.3204	0.1538	1.3204	1.1491
No log	11.6316	442	1.2774	0.1114	1.2774	1.1302
No log	11.6842	444	1.3037	0.1379	1.3037	1.1418
No log	11.7368	446	1.3340	0.1696	1.3340	1.1550
No log	11.7895	448	1.4040	0.0818	1.4040	1.1849
No log	11.8421	450	1.4372	0.0884	1.4372	1.1988
No log	11.8947	452	1.3749	0.0964	1.3749	1.1726
No log	11.9474	454	1.2980	0.1857	1.2980	1.1393
No log	12.0	456	1.2546	0.1624	1.2546	1.1201
No log	12.0526	458	1.2529	0.2033	1.2529	1.1193
No log	12.1053	460	1.2713	0.1371	1.2713	1.1275
No log	12.1579	462	1.3215	0.1766	1.3215	1.1495
No log	12.2105	464	1.3840	0.1310	1.3840	1.1764
No log	12.2632	466	1.4200	0.1171	1.4200	1.1916
No log	12.3158	468	1.3920	0.0884	1.3920	1.1798
No log	12.3684	470	1.3653	0.0884	1.3653	1.1685
No log	12.4211	472	1.2969	0.2381	1.2969	1.1388
No log	12.4737	474	1.2780	0.2829	1.2780	1.1305
No log	12.5263	476	1.3076	0.2683	1.3076	1.1435
No log	12.5789	478	1.3684	0.0964	1.3684	1.1698
No log	12.6316	480	1.4542	0.0884	1.4542	1.2059
No log	12.6842	482	1.4727	0.1310	1.4727	1.2136
No log	12.7368	484	1.4375	0.1027	1.4375	1.1990
No log	12.7895	486	1.4719	0.1310	1.4719	1.2132
No log	12.8421	488	1.5346	0.1639	1.5346	1.2388
No log	12.8947	490	1.5686	0.1232	1.5686	1.2524
No log	12.9474	492	1.4762	0.1171	1.4762	1.2150
No log	13.0	494	1.3461	0.1943	1.3461	1.1602
No log	13.0526	496	1.3167	0.1713	1.3167	1.1475
No log	13.1053	498	1.3140	0.1535	1.3140	1.1463
0.4162	13.1579	500	1.2896	0.1674	1.2896	1.1356
0.4162	13.2105	502	1.3088	0.1625	1.3088	1.1440
0.4162	13.2632	504	1.3206	0.1943	1.3206	1.1492
0.4162	13.3158	506	1.3889	0.2534	1.3889	1.1785
0.4162	13.3684	508	1.5356	0.2987	1.5356	1.2392
0.4162	13.4211	510	1.6643	0.2062	1.6643	1.2901
0.4162	13.4737	512	1.5622	0.2987	1.5622	1.2499
0.4162	13.5263	514	1.4010	0.1535	1.4010	1.1837
0.4162	13.5789	516	1.2989	0.1951	1.2989	1.1397
0.4162	13.6316	518	1.2846	0.1344	1.2846	1.1334
0.4162	13.6842	520	1.3129	0.1344	1.3129	1.1458
0.4162	13.7368	522	1.3725	0.1026	1.3725	1.1715
0.4162	13.7895	524	1.3558	0.1026	1.3558	1.1644
0.4162	13.8421	526	1.2878	0.1344	1.2878	1.1348

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1