ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2413
• Qwk: 0.1541
• Mse: 1.2413
• Rmse: 1.1141

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0645	2	4.5105	0.0010	4.5105	2.1238
No log	0.1290	4	2.6846	0.0012	2.6846	1.6385
No log	0.1935	6	1.9300	-0.0303	1.9300	1.3892
No log	0.2581	8	1.6998	-0.0174	1.6998	1.3037
No log	0.3226	10	1.6079	-0.0594	1.6079	1.2680
No log	0.3871	12	1.4836	-0.0747	1.4836	1.2180
No log	0.4516	14	1.4279	-0.0444	1.4279	1.1950
No log	0.5161	16	1.4709	-0.0825	1.4709	1.2128
No log	0.5806	18	2.0889	-0.1518	2.0889	1.4453
No log	0.6452	20	2.2835	-0.1042	2.2835	1.5111
No log	0.7097	22	2.3144	-0.0045	2.3144	1.5213
No log	0.7742	24	1.7686	0.0	1.7686	1.3299
No log	0.8387	26	1.3738	0.0551	1.3738	1.1721
No log	0.9032	28	1.2099	0.2108	1.2099	1.0999
No log	0.9677	30	1.0753	0.3091	1.0753	1.0370
No log	1.0323	32	1.0366	0.3678	1.0366	1.0181
No log	1.0968	34	1.0905	0.3590	1.0905	1.0443
No log	1.1613	36	1.1133	0.3441	1.1133	1.0551
No log	1.2258	38	1.1797	0.1984	1.1797	1.0861
No log	1.2903	40	1.4509	0.0637	1.4509	1.2045
No log	1.3548	42	1.4353	0.0104	1.4353	1.1980
No log	1.4194	44	1.2552	0.1968	1.2552	1.1204
No log	1.4839	46	1.2508	0.0974	1.2508	1.1184
No log	1.5484	48	1.2577	0.0599	1.2577	1.1215
No log	1.6129	50	1.2628	0.1793	1.2628	1.1238
No log	1.6774	52	1.3991	-0.0078	1.3991	1.1828
No log	1.7419	54	1.6748	0.0339	1.6748	1.2941
No log	1.8065	56	1.5986	0.0637	1.5986	1.2644
No log	1.8710	58	1.3241	0.0253	1.3241	1.1507
No log	1.9355	60	1.2935	0.0561	1.2935	1.1373
No log	2.0	62	1.2790	0.0651	1.2790	1.1309
No log	2.0645	64	1.2395	0.1260	1.2395	1.1133
No log	2.1290	66	1.2731	0.1320	1.2731	1.1283
No log	2.1935	68	1.2571	0.1260	1.2571	1.1212
No log	2.2581	70	1.2962	0.1379	1.2962	1.1385
No log	2.3226	72	1.3467	0.0955	1.3467	1.1605
No log	2.3871	74	1.2028	0.1984	1.2028	1.0967
No log	2.4516	76	1.2038	0.0780	1.2038	1.0972
No log	2.5161	78	1.1803	0.1505	1.1803	1.0864
No log	2.5806	80	1.1458	0.2349	1.1458	1.0704
No log	2.6452	82	1.1498	0.2007	1.1498	1.0723
No log	2.7097	84	1.1570	0.2402	1.1570	1.0756
No log	2.7742	86	1.1564	0.2679	1.1564	1.0753
No log	2.8387	88	1.2329	0.1190	1.2329	1.1103
No log	2.9032	90	1.2903	0.1339	1.2903	1.1359
No log	2.9677	92	1.2114	0.0642	1.2114	1.1006
No log	3.0323	94	1.1004	0.3541	1.1004	1.0490
No log	3.0968	96	1.0859	0.3541	1.0859	1.0421
No log	3.1613	98	1.1803	0.1371	1.1803	1.0864
No log	3.2258	100	1.2785	0.1480	1.2785	1.1307
No log	3.2903	102	1.2291	0.1853	1.2291	1.1086
No log	3.3548	104	1.0899	0.2596	1.0899	1.0440
No log	3.4194	106	1.0873	0.3571	1.0873	1.0427
No log	3.4839	108	1.0941	0.2145	1.0941	1.0460
No log	3.5484	110	1.2732	0.2518	1.2732	1.1284
No log	3.6129	112	1.6279	0.1407	1.6279	1.2759
No log	3.6774	114	1.6621	0.2353	1.6621	1.2892
No log	3.7419	116	1.3163	0.1469	1.3163	1.1473
No log	3.8065	118	1.1778	0.2073	1.1778	1.0853
No log	3.8710	120	1.1179	0.3309	1.1179	1.0573
No log	3.9355	122	1.1365	0.2893	1.1365	1.0660
No log	4.0	124	1.1688	0.2048	1.1688	1.0811
No log	4.0645	126	1.1788	0.1683	1.1788	1.0857
No log	4.1290	128	1.1884	0.2206	1.1884	1.0901
No log	4.1935	130	1.3101	0.3003	1.3101	1.1446
No log	4.2581	132	1.3394	0.3004	1.3394	1.1573
No log	4.3226	134	1.2484	0.2211	1.2484	1.1173
No log	4.3871	136	1.2510	0.2463	1.2510	1.1185
No log	4.4516	138	1.2923	0.3355	1.2923	1.1368
No log	4.5161	140	1.3915	0.1551	1.3915	1.1796
No log	4.5806	142	1.4541	0.2025	1.4541	1.2059
No log	4.6452	144	1.4144	0.2328	1.4144	1.1893
No log	4.7097	146	1.2541	0.3197	1.2541	1.1199
No log	4.7742	148	1.3137	0.2798	1.3137	1.1462
No log	4.8387	150	1.5754	0.2066	1.5754	1.2552
No log	4.9032	152	1.7367	0.1398	1.7367	1.3179
No log	4.9677	154	1.6338	0.1541	1.6338	1.2782
No log	5.0323	156	1.4139	0.2619	1.4139	1.1891
No log	5.0968	158	1.4105	0.2527	1.4105	1.1876
No log	5.1613	160	1.4918	0.1585	1.4918	1.2214
No log	5.2258	162	1.5740	0.2017	1.5740	1.2546
No log	5.2903	164	1.5276	0.2489	1.5276	1.2360
No log	5.3548	166	1.3996	0.2263	1.3996	1.1831
No log	5.4194	168	1.3449	0.1519	1.3449	1.1597
No log	5.4839	170	1.4072	0.1943	1.4072	1.1863
No log	5.5484	172	1.6606	0.2378	1.6606	1.2887
No log	5.6129	174	1.6645	0.2407	1.6645	1.2902
No log	5.6774	176	1.5229	0.2757	1.5229	1.2341
No log	5.7419	178	1.3226	0.2471	1.3226	1.1500
No log	5.8065	180	1.2908	0.2909	1.2908	1.1361
No log	5.8710	182	1.4367	0.2173	1.4367	1.1986
No log	5.9355	184	1.4911	0.1519	1.4911	1.2211
No log	6.0	186	1.5565	0.1663	1.5565	1.2476
No log	6.0645	188	1.5735	0.2181	1.5735	1.2544
No log	6.1290	190	1.5538	0.2658	1.5538	1.2465
No log	6.1935	192	1.3683	0.2679	1.3683	1.1697
No log	6.2581	194	1.3502	0.2679	1.3502	1.1620
No log	6.3226	196	1.6060	0.2363	1.6060	1.2673
No log	6.3871	198	1.8148	0.1780	1.8148	1.3471
No log	6.4516	200	1.7092	0.1953	1.7092	1.3074
No log	6.5161	202	1.4568	0.3047	1.4568	1.2070
No log	6.5806	204	1.3442	0.1807	1.3442	1.1594
No log	6.6452	206	1.3749	0.1951	1.3749	1.1726
No log	6.7097	208	1.3367	0.1576	1.3367	1.1562
No log	6.7742	210	1.2368	0.1819	1.2368	1.1121
No log	6.8387	212	1.1747	0.1206	1.1747	1.0839
No log	6.9032	214	1.2036	0.1728	1.2036	1.0971
No log	6.9677	216	1.1606	0.2388	1.1606	1.0773
No log	7.0323	218	1.2555	0.1771	1.2555	1.1205
No log	7.0968	220	1.4631	0.3402	1.4631	1.2096
No log	7.1613	222	1.5056	0.2798	1.5056	1.2270
No log	7.2258	224	1.4889	0.2985	1.4889	1.2202
No log	7.2903	226	1.2707	0.2765	1.2707	1.1273
No log	7.3548	228	1.0948	0.2483	1.0948	1.0463
No log	7.4194	230	1.0872	0.2871	1.0872	1.0427
No log	7.4839	232	1.0914	0.2773	1.0914	1.0447
No log	7.5484	234	1.2005	0.1712	1.2005	1.0957
No log	7.6129	236	1.3481	0.2647	1.3481	1.1611
No log	7.6774	238	1.3995	0.2544	1.3995	1.1830
No log	7.7419	240	1.3028	0.2781	1.3028	1.1414
No log	7.8065	242	1.1993	0.1430	1.1993	1.0951
No log	7.8710	244	1.2415	0.2195	1.2415	1.1142
No log	7.9355	246	1.2556	0.2103	1.2556	1.1205
No log	8.0	248	1.2467	0.2103	1.2467	1.1166
No log	8.0645	250	1.2437	0.1675	1.2437	1.1152
No log	8.1290	252	1.2952	0.1628	1.2952	1.1381
No log	8.1935	254	1.4372	0.3068	1.4372	1.1988
No log	8.2581	256	1.5385	0.2303	1.5385	1.2404
No log	8.3226	258	1.4842	0.2751	1.4842	1.2183
No log	8.3871	260	1.4325	0.3180	1.4325	1.1969
No log	8.4516	262	1.3893	0.3281	1.3893	1.1787
No log	8.5161	264	1.2663	0.2933	1.2663	1.1253
No log	8.5806	266	1.1885	0.2671	1.1885	1.0902
No log	8.6452	268	1.2121	0.2389	1.2121	1.1009
No log	8.7097	270	1.2986	0.3024	1.2986	1.1396
No log	8.7742	272	1.3001	0.3024	1.3001	1.1402
No log	8.8387	274	1.2388	0.2143	1.2388	1.1130
No log	8.9032	276	1.2048	0.1559	1.2048	1.0977
No log	8.9677	278	1.1670	0.1602	1.1670	1.0803
No log	9.0323	280	1.1620	0.0653	1.1620	1.0780
No log	9.0968	282	1.1667	0.1442	1.1667	1.0801
No log	9.1613	284	1.1804	0.1504	1.1804	1.0865
No log	9.2258	286	1.2915	0.2953	1.2915	1.1364
No log	9.2903	288	1.5230	0.2389	1.5230	1.2341
No log	9.3548	290	1.5307	0.2751	1.5307	1.2372
No log	9.4194	292	1.4754	0.3025	1.4754	1.2146
No log	9.4839	294	1.3141	0.2402	1.3141	1.1463
No log	9.5484	296	1.2664	0.1853	1.2664	1.1253
No log	9.6129	298	1.2653	0.1853	1.2653	1.1249
No log	9.6774	300	1.2812	0.1853	1.2812	1.1319
No log	9.7419	302	1.2383	0.1961	1.2383	1.1128
No log	9.8065	304	1.2259	0.1860	1.2259	1.1072
No log	9.8710	306	1.2101	0.1662	1.2101	1.1000
No log	9.9355	308	1.2487	0.1541	1.2487	1.1174
No log	10.0	310	1.3172	0.1344	1.3172	1.1477
No log	10.0645	312	1.4251	0.3136	1.4251	1.1938
No log	10.1290	314	1.3881	0.3136	1.3881	1.1782
No log	10.1935	316	1.2694	0.1654	1.2694	1.1267
No log	10.2581	318	1.2653	0.2619	1.2653	1.1248
No log	10.3226	320	1.3266	0.3024	1.3266	1.1518
No log	10.3871	322	1.3507	0.2275	1.3507	1.1622
No log	10.4516	324	1.2873	0.1911	1.2873	1.1346
No log	10.5161	326	1.2196	0.1504	1.2196	1.1044
No log	10.5806	328	1.2087	0.1602	1.2087	1.0994
No log	10.6452	330	1.2036	0.1602	1.2036	1.0971
No log	10.7097	332	1.2470	0.3023	1.2470	1.1167
No log	10.7742	334	1.2736	0.2799	1.2736	1.1286
No log	10.8387	336	1.3700	0.3068	1.3700	1.1705
No log	10.9032	338	1.4170	0.3068	1.4170	1.1904
No log	10.9677	340	1.3107	0.2799	1.3107	1.1448
No log	11.0323	342	1.1832	0.1442	1.1832	1.0877
No log	11.0968	344	1.1735	0.1442	1.1735	1.0833
No log	11.1613	346	1.2913	0.2978	1.2913	1.1364
No log	11.2258	348	1.4548	0.3155	1.4548	1.2061
No log	11.2903	350	1.4790	0.3155	1.4790	1.2161
No log	11.3548	352	1.3566	0.2132	1.3566	1.1647
No log	11.4194	354	1.2228	0.1641	1.2228	1.1058
No log	11.4839	356	1.1252	0.1180	1.1252	1.0608
No log	11.5484	358	1.1243	0.0543	1.1243	1.0603
No log	11.6129	360	1.1376	0.0625	1.1376	1.0666
No log	11.6774	362	1.2109	0.1541	1.2109	1.1004
No log	11.7419	364	1.3588	0.1611	1.3588	1.1657
No log	11.8065	366	1.3966	0.2403	1.3966	1.1818
No log	11.8710	368	1.3236	0.1750	1.3236	1.1505
No log	11.9355	370	1.2183	0.1541	1.2183	1.1038
No log	12.0	372	1.1829	0.1541	1.1829	1.0876
No log	12.0645	374	1.1492	0.1761	1.1492	1.0720
No log	12.1290	376	1.1257	0.1379	1.1257	1.0610
No log	12.1935	378	1.1233	0.1761	1.1233	1.0599
No log	12.2581	380	1.1420	0.1442	1.1420	1.0687
No log	12.3226	382	1.1859	0.1541	1.1859	1.0890
No log	12.3871	384	1.1952	0.1641	1.1952	1.0933
No log	12.4516	386	1.1412	0.1701	1.1412	1.0683
No log	12.5161	388	1.0760	0.1662	1.0760	1.0373
No log	12.5806	390	1.0322	0.1722	1.0322	1.0160
No log	12.6452	392	1.0648	0.1624	1.0648	1.0319
No log	12.7097	394	1.2015	0.2009	1.2015	1.0961
No log	12.7742	396	1.2874	0.1807	1.2874	1.1346
No log	12.8387	398	1.3002	0.2009	1.3002	1.1403
No log	12.9032	400	1.2873	0.2009	1.2873	1.1346
No log	12.9677	402	1.2687	0.2304	1.2687	1.1264
No log	13.0323	404	1.1766	0.1801	1.1766	1.0847
No log	13.0968	406	1.0800	0.1504	1.0800	1.0393
No log	13.1613	408	1.0844	0.1504	1.0844	1.0413
No log	13.2258	410	1.1762	0.1952	1.1762	1.0845
No log	13.2903	412	1.2340	0.2195	1.2340	1.1109
No log	13.3548	414	1.2371	0.1637	1.2371	1.1122
No log	13.4194	416	1.1953	0.1641	1.1953	1.0933
No log	13.4839	418	1.1861	0.1641	1.1861	1.0891
No log	13.5484	420	1.1627	0.1541	1.1627	1.0783
No log	13.6129	422	1.1339	0.1564	1.1339	1.0648
No log	13.6774	424	1.1605	0.1504	1.1605	1.0773
No log	13.7419	426	1.2185	0.1641	1.2185	1.1039
No log	13.8065	428	1.2870	0.1641	1.2870	1.1344
No log	13.8710	430	1.4190	0.2132	1.4190	1.1912
No log	13.9355	432	1.4202	0.1989	1.4202	1.1917
No log	14.0	434	1.3008	0.1641	1.3008	1.1405
No log	14.0645	436	1.1930	0.1442	1.1930	1.0923
No log	14.1290	438	1.1840	0.1442	1.1840	1.0881
No log	14.1935	440	1.2197	0.1479	1.2197	1.1044
No log	14.2581	442	1.2570	0.1479	1.2570	1.1212
No log	14.3226	444	1.3179	0.3072	1.3179	1.1480
No log	14.3871	446	1.2643	0.1952	1.2643	1.1244
No log	14.4516	448	1.1897	0.1541	1.1897	1.0907
No log	14.5161	450	1.1883	0.1853	1.1883	1.0901
No log	14.5806	452	1.1996	0.1641	1.1996	1.0953
No log	14.6452	454	1.1773	0.1480	1.1773	1.0850
No log	14.7097	456	1.1564	0.1279	1.1564	1.0754
No log	14.7742	458	1.1476	0.1755	1.1476	1.0712
No log	14.8387	460	1.1430	0.1820	1.1430	1.0691
No log	14.9032	462	1.2039	0.1662	1.2039	1.0972
No log	14.9677	464	1.3118	0.2509	1.3118	1.1454
No log	15.0323	466	1.3468	0.2424	1.3468	1.1605
No log	15.0968	468	1.3218	0.2141	1.3218	1.1497
No log	15.1613	470	1.2560	0.1281	1.2560	1.1207
No log	15.2258	472	1.2206	0.1246	1.2206	1.1048
No log	15.2903	474	1.2290	0.1281	1.2290	1.1086
No log	15.3548	476	1.2471	0.1379	1.2471	1.1168
No log	15.4194	478	1.2095	0.1442	1.2095	1.0998
No log	15.4839	480	1.1778	0.1602	1.1778	1.0853
No log	15.5484	482	1.1839	0.1602	1.1839	1.0880
No log	15.6129	484	1.2223	0.2009	1.2223	1.1056
No log	15.6774	486	1.2871	0.2343	1.2871	1.1345
No log	15.7419	488	1.3016	0.2343	1.3016	1.1409
No log	15.8065	490	1.2247	0.2009	1.2247	1.1067
No log	15.8710	492	1.1714	0.1701	1.1714	1.0823
No log	15.9355	494	1.1620	0.1564	1.1620	1.0780
No log	16.0	496	1.1637	0.1406	1.1637	1.0788
No log	16.0645	498	1.2075	0.1911	1.2075	1.0989
0.3994	16.1290	500	1.2971	0.2619	1.2971	1.1389
0.3994	16.1935	502	1.3017	0.2475	1.3017	1.1409
0.3994	16.2581	504	1.2442	0.1853	1.2442	1.1155
0.3994	16.3226	506	1.2254	0.1442	1.2254	1.1070
0.3994	16.3871	508	1.2156	0.1442	1.2156	1.1025
0.3994	16.4516	510	1.2413	0.1541	1.2413	1.1141

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1