ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1912
• Qwk: 0.1479
• Mse: 1.1912
• Rmse: 1.0914

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0263	2	4.6676	-0.0132	4.6676	2.1605
No log	0.0526	4	2.7982	-0.0420	2.7982	1.6728
No log	0.0789	6	1.9377	-0.0017	1.9377	1.3920
No log	0.1053	8	1.5447	0.0080	1.5447	1.2429
No log	0.1316	10	1.4615	-0.0297	1.4615	1.2089
No log	0.1579	12	1.3762	0.0990	1.3762	1.1731
No log	0.1842	14	1.4260	0.0141	1.4260	1.1942
No log	0.2105	16	1.4896	0.0185	1.4896	1.2205
No log	0.2368	18	1.6968	-0.0293	1.6968	1.3026
No log	0.2632	20	1.9434	-0.0146	1.9434	1.3941
No log	0.2895	22	1.7409	-0.0293	1.7409	1.3194
No log	0.3158	24	1.3349	0.1228	1.3349	1.1554
No log	0.3421	26	1.1626	0.1952	1.1626	1.0782
No log	0.3684	28	1.1511	0.2142	1.1511	1.0729
No log	0.3947	30	1.1885	0.1278	1.1885	1.0902
No log	0.4211	32	1.2596	0.1271	1.2596	1.1223
No log	0.4474	34	1.2868	0.0654	1.2868	1.1344
No log	0.4737	36	1.2138	0.1875	1.2138	1.1017
No log	0.5	38	1.2119	0.1649	1.2119	1.1009
No log	0.5263	40	1.2295	0.1507	1.2295	1.1088
No log	0.5526	42	1.2203	0.1628	1.2203	1.1047
No log	0.5789	44	1.2324	0.2255	1.2324	1.1101
No log	0.6053	46	1.2291	0.1174	1.2291	1.1086
No log	0.6316	48	1.4604	0.1226	1.4604	1.2085
No log	0.6579	50	1.5494	0.0999	1.5494	1.2448
No log	0.6842	52	1.2361	0.1354	1.2361	1.1118
No log	0.7105	54	1.0722	0.1780	1.0722	1.0355
No log	0.7368	56	1.1735	0.1857	1.1735	1.0833
No log	0.7632	58	1.2344	0.2851	1.2344	1.1110
No log	0.7895	60	1.2202	0.2261	1.2202	1.1046
No log	0.8158	62	1.0785	0.2455	1.0785	1.0385
No log	0.8421	64	1.0934	0.3091	1.0934	1.0457
No log	0.8684	66	1.0652	0.3263	1.0652	1.0321
No log	0.8947	68	1.1427	0.1951	1.1427	1.0690
No log	0.9211	70	1.1022	0.2184	1.1022	1.0499
No log	0.9474	72	1.0716	0.2933	1.0716	1.0352
No log	0.9737	74	1.1039	0.3002	1.1039	1.0507
No log	1.0	76	1.1882	0.3187	1.1882	1.0900
No log	1.0263	78	1.1220	0.3154	1.1220	1.0592
No log	1.0526	80	1.0337	0.4146	1.0337	1.0167
No log	1.0789	82	1.0844	0.4201	1.0844	1.0413
No log	1.1053	84	1.3172	0.2962	1.3172	1.1477
No log	1.1316	86	1.2252	0.3525	1.2252	1.1069
No log	1.1579	88	1.0888	0.4045	1.0888	1.0435
No log	1.1842	90	1.0672	0.3606	1.0672	1.0331
No log	1.2105	92	1.2808	0.3024	1.2808	1.1317
No log	1.2368	94	1.3000	0.2578	1.3000	1.1402
No log	1.2632	96	1.2231	0.3355	1.2231	1.1060
No log	1.2895	98	1.1347	0.3504	1.1347	1.0652
No log	1.3158	100	1.2054	0.3611	1.2054	1.0979
No log	1.3421	102	1.1303	0.3828	1.1303	1.0632
No log	1.3684	104	1.1249	0.3869	1.1249	1.0606
No log	1.3947	106	1.3673	0.3384	1.3673	1.1693
No log	1.4211	108	1.4152	0.2909	1.4152	1.1896
No log	1.4474	110	1.2575	0.1504	1.2575	1.1214
No log	1.4737	112	1.0977	0.2001	1.0977	1.0477
No log	1.5	114	1.1219	0.2941	1.1219	1.0592
No log	1.5263	116	1.1281	0.1048	1.1281	1.0621
No log	1.5526	118	1.3515	0.1311	1.3515	1.1625
No log	1.5789	120	1.5932	0.2197	1.5932	1.2622
No log	1.6053	122	1.6507	0.2841	1.6507	1.2848
No log	1.6316	124	1.4539	0.1943	1.4539	1.2058
No log	1.6579	126	1.1513	0.1467	1.1513	1.0730
No log	1.6842	128	1.1185	0.4059	1.1185	1.0576
No log	1.7105	130	1.2368	0.2313	1.2368	1.1121
No log	1.7368	132	1.1858	0.3008	1.1858	1.0889
No log	1.7632	134	1.0882	0.3927	1.0882	1.0432
No log	1.7895	136	1.2836	0.1658	1.2836	1.1330
No log	1.8158	138	1.5370	0.1417	1.5370	1.2397
No log	1.8421	140	1.5708	0.2673	1.5708	1.2533
No log	1.8684	142	1.3738	0.3148	1.3738	1.1721
No log	1.8947	144	1.1643	0.2712	1.1643	1.0790
No log	1.9211	146	1.1561	0.2909	1.1561	1.0752
No log	1.9474	148	1.2596	0.25	1.2596	1.1223
No log	1.9737	150	1.5007	0.2387	1.5007	1.2250
No log	2.0	152	1.6807	0.2895	1.6807	1.2964
No log	2.0263	154	1.6458	0.1562	1.6458	1.2829
No log	2.0526	156	1.5086	0.2163	1.5086	1.2282
No log	2.0789	158	1.3180	0.1701	1.3180	1.1480
No log	2.1053	160	1.2348	0.1505	1.2348	1.1112
No log	2.1316	162	1.2227	0.1244	1.2227	1.1058
No log	2.1579	164	1.3108	0.1764	1.3108	1.1449
No log	2.1842	166	1.5589	0.2555	1.5589	1.2486
No log	2.2105	168	1.6711	0.2797	1.6711	1.2927
No log	2.2368	170	1.6985	0.2471	1.6985	1.3033
No log	2.2632	172	1.5012	0.2550	1.5012	1.2252
No log	2.2895	174	1.2399	0.1631	1.2399	1.1135
No log	2.3158	176	1.1724	0.1825	1.1724	1.0828
No log	2.3421	178	1.1818	0.1667	1.1818	1.0871
No log	2.3684	180	1.2591	0.1063	1.2591	1.1221
No log	2.3947	182	1.3264	0.1498	1.3264	1.1517
No log	2.4211	184	1.3716	0.2317	1.3716	1.1711
No log	2.4474	186	1.3392	0.2132	1.3392	1.1572
No log	2.4737	188	1.3081	0.2381	1.3081	1.1437
No log	2.5	190	1.2838	0.2525	1.2838	1.1331
No log	2.5263	192	1.2933	0.1153	1.2933	1.1372
No log	2.5526	194	1.2789	0.0731	1.2789	1.1309
No log	2.5789	196	1.3173	0.1311	1.3173	1.1477
No log	2.6053	198	1.3427	0.2330	1.3427	1.1587
No log	2.6316	200	1.2712	0.1465	1.2712	1.1275
No log	2.6579	202	1.2146	0.0671	1.2146	1.1021
No log	2.6842	204	1.2007	0.1406	1.2007	1.0958
No log	2.7105	206	1.1815	0.1076	1.1815	1.0870
No log	2.7368	208	1.1792	0.1488	1.1792	1.0859
No log	2.7632	210	1.2465	0.2235	1.2465	1.1165
No log	2.7895	212	1.3752	0.2985	1.3752	1.1727
No log	2.8158	214	1.4074	0.3523	1.4074	1.1863
No log	2.8421	216	1.2434	0.3854	1.2434	1.1151
No log	2.8684	218	1.2058	0.3848	1.2058	1.0981
No log	2.8947	220	1.3323	0.3101	1.3323	1.1542
No log	2.9211	222	1.3876	0.2366	1.3876	1.1780
No log	2.9474	224	1.4382	0.1539	1.4382	1.1992
No log	2.9737	226	1.4370	0.1032	1.4370	1.1988
No log	3.0	228	1.2875	0.1662	1.2875	1.1347
No log	3.0263	230	1.1052	0.1727	1.1052	1.0513
No log	3.0526	232	1.0761	0.1827	1.0761	1.0373
No log	3.0789	234	1.1082	0.1309	1.1082	1.0527
No log	3.1053	236	1.0562	0.2273	1.0562	1.0277
No log	3.1316	238	1.0592	0.3352	1.0592	1.0292
No log	3.1579	240	1.1242	0.3134	1.1242	1.0603
No log	3.1842	242	1.1763	0.2773	1.1763	1.0846
No log	3.2105	244	1.1333	0.2515	1.1333	1.0646
No log	3.2368	246	1.1026	0.3231	1.1026	1.0500
No log	3.2632	248	1.0710	0.3720	1.0710	1.0349
No log	3.2895	250	1.0538	0.3463	1.0538	1.0266
No log	3.3158	252	1.0654	0.3478	1.0654	1.0322
No log	3.3421	254	1.0638	0.3069	1.0638	1.0314
No log	3.3684	256	1.0762	0.2673	1.0762	1.0374
No log	3.3947	258	1.0908	0.2772	1.0908	1.0444
No log	3.4211	260	1.1315	0.2371	1.1315	1.0637
No log	3.4474	262	1.2295	0.1951	1.2295	1.1088
No log	3.4737	264	1.2292	0.1951	1.2292	1.1087
No log	3.5	266	1.1761	0.2395	1.1761	1.0845
No log	3.5263	268	1.1298	0.1871	1.1298	1.0629
No log	3.5526	270	1.1589	0.2515	1.1589	1.0765
No log	3.5789	272	1.1743	0.2773	1.1743	1.0836
No log	3.6053	274	1.2879	0.3332	1.2879	1.1348
No log	3.6316	276	1.4297	0.3377	1.4297	1.1957
No log	3.6579	278	1.4902	0.3060	1.4902	1.2207
No log	3.6842	280	1.3628	0.3083	1.3628	1.1674
No log	3.7105	282	1.2067	0.2395	1.2067	1.0985
No log	3.7368	284	1.1530	0.2541	1.1530	1.0738
No log	3.7632	286	1.1229	0.2557	1.1229	1.0597
No log	3.7895	288	1.0691	0.2360	1.0691	1.0340
No log	3.8158	290	1.0672	0.2360	1.0672	1.0331
No log	3.8421	292	1.0779	0.2503	1.0779	1.0382
No log	3.8684	294	1.2161	0.2375	1.2161	1.1028
No log	3.8947	296	1.3228	0.3868	1.3228	1.1501
No log	3.9211	298	1.4149	0.3101	1.4149	1.1895
No log	3.9474	300	1.3061	0.2958	1.3061	1.1429
No log	3.9737	302	1.1408	0.1871	1.1408	1.0681
No log	4.0	304	1.1044	0.2360	1.1044	1.0509
No log	4.0263	306	1.1191	0.2360	1.1191	1.0579
No log	4.0526	308	1.1512	0.0909	1.1512	1.0729
No log	4.0789	310	1.2533	0.1344	1.2533	1.1195
No log	4.1053	312	1.4283	0.2132	1.4283	1.1951
No log	4.1316	314	1.4663	0.2534	1.4663	1.2109
No log	4.1579	316	1.3467	0.25	1.3467	1.1605
No log	4.1842	318	1.2336	0.2745	1.2336	1.1107
No log	4.2105	320	1.1513	0.2830	1.1513	1.0730
No log	4.2368	322	1.1724	0.2857	1.1724	1.0828
No log	4.2632	324	1.3033	0.2650	1.3033	1.1416
No log	4.2895	326	1.5017	0.2206	1.5017	1.2254
No log	4.3158	328	1.5800	0.2291	1.5800	1.2570
No log	4.3421	330	1.4967	0.2055	1.4967	1.2234
No log	4.3684	332	1.3311	0.1857	1.3311	1.1537
No log	4.3947	334	1.1670	0.1081	1.1670	1.0803
No log	4.4211	336	1.1109	0.2360	1.1109	1.0540
No log	4.4474	338	1.1124	0.2360	1.1124	1.0547
No log	4.4737	340	1.1556	0.1180	1.1556	1.0750
No log	4.5	342	1.2826	0.2195	1.2826	1.1325
No log	4.5263	344	1.3937	0.2437	1.3937	1.1805
No log	4.5526	346	1.3717	0.2387	1.3717	1.1712
No log	4.5789	348	1.2744	0.2791	1.2744	1.1289
No log	4.6053	350	1.1764	0.2260	1.1764	1.0846
No log	4.6316	352	1.1588	0.1886	1.1588	1.0765
No log	4.6579	354	1.1668	0.1244	1.1668	1.0802
No log	4.6842	356	1.2062	0.1959	1.2062	1.0983
No log	4.7105	358	1.2891	0.2100	1.2891	1.1354
No log	4.7368	360	1.3056	0.2381	1.3056	1.1426
No log	4.7632	362	1.2624	0.2100	1.2624	1.1236
No log	4.7895	364	1.1756	0.1871	1.1756	1.0842
No log	4.8158	366	1.1312	0.2692	1.1312	1.0636
No log	4.8421	368	1.1386	0.2995	1.1386	1.0670
No log	4.8684	370	1.1999	0.2352	1.1999	1.0954
No log	4.8947	372	1.2990	0.2211	1.2990	1.1397
No log	4.9211	374	1.4127	0.2191	1.4127	1.1886
No log	4.9474	376	1.4547	0.2021	1.4547	1.2061
No log	4.9737	378	1.4277	0.2191	1.4277	1.1949
No log	5.0	380	1.4162	0.2191	1.4162	1.1900
No log	5.0263	382	1.3095	0.2782	1.3095	1.1443
No log	5.0526	384	1.1624	0.1878	1.1624	1.0782
No log	5.0789	386	1.1149	0.2286	1.1149	1.0559
No log	5.1053	388	1.1327	0.1878	1.1327	1.0643
No log	5.1316	390	1.2374	0.1406	1.2374	1.1124
No log	5.1579	392	1.3425	0.0566	1.3425	1.1587
No log	5.1842	394	1.3368	0.0566	1.3368	1.1562
No log	5.2105	396	1.2813	0.1183	1.2813	1.1319
No log	5.2368	398	1.2029	0.1009	1.2029	1.0968
No log	5.2632	400	1.1446	0.1935	1.1446	1.0699
No log	5.2895	402	1.1335	0.1935	1.1335	1.0647
No log	5.3158	404	1.1643	0.0909	1.1643	1.0790
No log	5.3421	406	1.2202	0.1504	1.2202	1.1046
No log	5.3684	408	1.2883	0.2288	1.2883	1.1350
No log	5.3947	410	1.2513	0.1712	1.2513	1.1186
No log	5.4211	412	1.2040	0.1658	1.2040	1.0973
No log	5.4474	414	1.1551	0.1504	1.1551	1.0747
No log	5.4737	416	1.1389	0.1504	1.1389	1.0672
No log	5.5	418	1.1294	0.1244	1.1294	1.0627
No log	5.5263	420	1.1404	0.1244	1.1404	1.0679
No log	5.5526	422	1.1533	0.1081	1.1533	1.0739
No log	5.5789	424	1.2026	0.1523	1.2026	1.0966
No log	5.6053	426	1.3149	0.2981	1.3149	1.1467
No log	5.6316	428	1.2974	0.2981	1.2974	1.1390
No log	5.6579	430	1.2495	0.2590	1.2495	1.1178
No log	5.6842	432	1.1769	0.1920	1.1769	1.0849
No log	5.7105	434	1.0897	0.1507	1.0897	1.0439
No log	5.7368	436	1.0817	0.1507	1.0817	1.0401
No log	5.7632	438	1.1323	0.1564	1.1323	1.0641
No log	5.7895	440	1.2347	0.1617	1.2347	1.1112
No log	5.8158	442	1.4083	0.2899	1.4083	1.1867
No log	5.8421	444	1.5072	0.2004	1.5072	1.2277
No log	5.8684	446	1.5109	0.1855	1.5109	1.2292
No log	5.8947	448	1.4322	0.2130	1.4322	1.1967
No log	5.9211	450	1.4417	0.2130	1.4417	1.2007
No log	5.9474	452	1.4293	0.2306	1.4293	1.1955
No log	5.9737	454	1.3786	0.1501	1.3786	1.1741
No log	6.0	456	1.2903	0.1405	1.2903	1.1359
No log	6.0263	458	1.2878	0.1405	1.2878	1.1348
No log	6.0526	460	1.2824	0.1465	1.2824	1.1324
No log	6.0789	462	1.3071	0.1576	1.3071	1.1433
No log	6.1053	464	1.3726	0.1901	1.3726	1.1716
No log	6.1316	466	1.4138	0.2226	1.4138	1.1890
No log	6.1579	468	1.4721	0.2043	1.4721	1.2133
No log	6.1842	470	1.4979	0.1820	1.4979	1.2239
No log	6.2105	472	1.3934	0.2298	1.3934	1.1804
No log	6.2368	474	1.2622	0.1819	1.2622	1.1235
No log	6.2632	476	1.2215	0.1769	1.2215	1.1052
No log	6.2895	478	1.2545	0.1617	1.2545	1.1200
No log	6.3158	480	1.3447	0.1190	1.3447	1.1596
No log	6.3421	482	1.4007	0.2117	1.4007	1.1835
No log	6.3684	484	1.4166	0.2201	1.4166	1.1902
No log	6.3947	486	1.3429	0.1905	1.3429	1.1588
No log	6.4211	488	1.2492	0.1114	1.2492	1.1177
No log	6.4474	490	1.1794	0.1009	1.1794	1.0860
No log	6.4737	492	1.1751	0.0909	1.1751	1.0840
No log	6.5	494	1.1967	0.0941	1.1967	1.0939
No log	6.5263	496	1.2155	0.0974	1.2155	1.1025
No log	6.5526	498	1.2581	0.1944	1.2581	1.1217
0.3474	6.5789	500	1.2796	0.2141	1.2796	1.1312
0.3474	6.6053	502	1.2250	0.2046	1.2250	1.1068
0.3474	6.6316	504	1.1487	0.1864	1.1487	1.0718
0.3474	6.6579	506	1.1566	0.1864	1.1566	1.0755
0.3474	6.6842	508	1.1679	0.2195	1.1679	1.0807
0.3474	6.7105	510	1.2432	0.2634	1.2432	1.1150
0.3474	6.7368	512	1.2710	0.2754	1.2710	1.1274
0.3474	6.7632	514	1.1843	0.2475	1.1843	1.0883
0.3474	6.7895	516	1.1070	0.0741	1.1070	1.0521
0.3474	6.8158	518	1.0968	0.0741	1.0968	1.0473
0.3474	6.8421	520	1.1215	0.0741	1.1215	1.0590
0.3474	6.8684	522	1.1490	0.0841	1.1490	1.0719
0.3474	6.8947	524	1.1912	0.1479	1.1912	1.0914

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1