ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1731
• Qwk: 0.1341
• Mse: 1.1731
• Rmse: 1.0831

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	2.5453	-0.0702	2.5453	1.5954
No log	0.1379	4	1.4224	0.0698	1.4224	1.1926
No log	0.2069	6	1.3452	-0.2040	1.3452	1.1598
No log	0.2759	8	1.0964	-0.1887	1.0964	1.0471
No log	0.3448	10	0.9759	-0.0475	0.9759	0.9879
No log	0.4138	12	0.8375	0.0410	0.8375	0.9152
No log	0.4828	14	0.7690	0.0410	0.7690	0.8769
No log	0.5517	16	0.7869	0.0410	0.7869	0.8871
No log	0.6207	18	0.8093	0.0410	0.8093	0.8996
No log	0.6897	20	0.7982	0.0444	0.7982	0.8934
No log	0.7586	22	0.7896	0.0410	0.7896	0.8886
No log	0.8276	24	0.9493	0.0520	0.9493	0.9743
No log	0.8966	26	1.4012	-0.1847	1.4012	1.1837
No log	0.9655	28	1.4888	-0.3187	1.4888	1.2202
No log	1.0345	30	1.3264	-0.2966	1.3264	1.1517
No log	1.1034	32	1.1235	-0.1224	1.1235	1.0599
No log	1.1724	34	0.9533	-0.0444	0.9533	0.9764
No log	1.2414	36	0.8407	0.0	0.8407	0.9169
No log	1.3103	38	0.7681	0.0	0.7681	0.8764
No log	1.3793	40	0.7325	0.0840	0.7325	0.8559
No log	1.4483	42	0.7044	0.2046	0.7044	0.8393
No log	1.5172	44	0.7135	0.2677	0.7135	0.8447
No log	1.5862	46	0.8512	0.2574	0.8512	0.9226
No log	1.6552	48	0.9544	0.2651	0.9544	0.9770
No log	1.7241	50	0.9879	0.2183	0.9879	0.9939
No log	1.7931	52	0.8540	0.3538	0.8540	0.9241
No log	1.8621	54	0.6656	0.1139	0.6656	0.8158
No log	1.9310	56	0.7022	0.0947	0.7022	0.8380
No log	2.0	58	0.7555	0.2703	0.7555	0.8692
No log	2.0690	60	0.7864	0.3013	0.7864	0.8868
No log	2.1379	62	0.8470	0.3192	0.8470	0.9203
No log	2.2069	64	0.7908	0.2381	0.7908	0.8893
No log	2.2759	66	0.7680	0.0816	0.7680	0.8763
No log	2.3448	68	0.7474	0.1901	0.7474	0.8645
No log	2.4138	70	0.8377	0.3918	0.8377	0.9153
No log	2.4828	72	0.7446	0.3494	0.7446	0.8629
No log	2.5517	74	0.7025	0.3518	0.7025	0.8381
No log	2.6207	76	0.8430	0.3294	0.8430	0.9182
No log	2.6897	78	1.0078	0.2659	1.0078	1.0039
No log	2.7586	80	1.0530	0.2437	1.0530	1.0262
No log	2.8276	82	0.9996	0.2125	0.9996	0.9998
No log	2.8966	84	1.1177	0.1748	1.1177	1.0572
No log	2.9655	86	1.0087	0.2437	1.0087	1.0044
No log	3.0345	88	0.8347	0.2871	0.8347	0.9136
No log	3.1034	90	0.7763	0.3329	0.7763	0.8811
No log	3.1724	92	0.8611	0.2812	0.8611	0.9279
No log	3.2414	94	1.0145	0.1217	1.0145	1.0072
No log	3.3103	96	0.9076	0.3319	0.9076	0.9527
No log	3.3793	98	0.9212	0.3274	0.9212	0.9598
No log	3.4483	100	1.0681	0.2501	1.0681	1.0335
No log	3.5172	102	1.1306	0.2601	1.1306	1.0633
No log	3.5862	104	1.0942	0.2501	1.0942	1.0460
No log	3.6552	106	1.2848	0.2280	1.2848	1.1335
No log	3.7241	108	1.4931	0.1285	1.4931	1.2219
No log	3.7931	110	1.5257	0.0825	1.5257	1.2352
No log	3.8621	112	1.3162	0.1484	1.3162	1.1473
No log	3.9310	114	1.2135	0.2130	1.2135	1.1016
No log	4.0	116	1.1645	0.2802	1.1645	1.0791
No log	4.0690	118	1.1754	0.2982	1.1754	1.0842
No log	4.1379	120	1.2946	0.1997	1.2946	1.1378
No log	4.2069	122	1.2827	0.1966	1.2827	1.1325
No log	4.2759	124	1.0839	0.2806	1.0839	1.0411
No log	4.3448	126	0.8953	0.2012	0.8953	0.9462
No log	4.4138	128	0.8963	0.1962	0.8963	0.9467
No log	4.4828	130	1.0169	0.2810	1.0169	1.0084
No log	4.5517	132	1.0095	0.2577	1.0095	1.0047
No log	4.6207	134	1.0720	0.2876	1.0720	1.0354
No log	4.6897	136	1.0619	0.2977	1.0619	1.0305
No log	4.7586	138	1.1765	0.2319	1.1765	1.0847
No log	4.8276	140	1.0294	0.3538	1.0294	1.0146
No log	4.8966	142	0.9793	0.3538	0.9793	0.9896
No log	4.9655	144	1.0641	0.2898	1.0641	1.0315
No log	5.0345	146	1.0537	0.3052	1.0537	1.0265
No log	5.1034	148	1.1261	0.2153	1.1261	1.0612
No log	5.1724	150	1.1390	0.2579	1.1390	1.0672
No log	5.2414	152	1.2030	0.2383	1.2030	1.0968
No log	5.3103	154	1.5067	0.1386	1.5067	1.2275
No log	5.3793	156	1.7307	0.1183	1.7307	1.3156
No log	5.4483	158	1.6666	0.1361	1.6666	1.2910
No log	5.5172	160	1.3103	0.2170	1.3103	1.1447
No log	5.5862	162	0.9520	0.2866	0.9520	0.9757
No log	5.6552	164	0.9318	0.2463	0.9318	0.9653
No log	5.7241	166	0.9748	0.2670	0.9748	0.9873
No log	5.7931	168	1.0110	0.3076	1.0110	1.0055
No log	5.8621	170	1.0500	0.3076	1.0500	1.0247
No log	5.9310	172	1.1032	0.2830	1.1032	1.0503
No log	6.0	174	1.0794	0.2754	1.0794	1.0389
No log	6.0690	176	1.0626	0.2531	1.0626	1.0308
No log	6.1379	178	1.1557	0.3233	1.1557	1.0750
No log	6.2069	180	1.1561	0.3080	1.1561	1.0752
No log	6.2759	182	1.0656	0.1988	1.0656	1.0323
No log	6.3448	184	1.0377	0.2113	1.0377	1.0187
No log	6.4138	186	1.1183	0.2613	1.1183	1.0575
No log	6.4828	188	1.2341	0.2499	1.2341	1.1109
No log	6.5517	190	1.1373	0.2824	1.1373	1.0665
No log	6.6207	192	1.0465	0.2651	1.0465	1.0230
No log	6.6897	194	1.0485	0.2948	1.0485	1.0239
No log	6.7586	196	0.9931	0.2910	0.9931	0.9966
No log	6.8276	198	1.0124	0.3052	1.0124	1.0062
No log	6.8966	200	0.9924	0.3217	0.9924	0.9962
No log	6.9655	202	1.0502	0.2999	1.0502	1.0248
No log	7.0345	204	1.1927	0.2398	1.1927	1.0921
No log	7.1034	206	1.4799	0.1364	1.4799	1.2165
No log	7.1724	208	1.5990	0.0863	1.5990	1.2645
No log	7.2414	210	1.5214	0.0863	1.5214	1.2334
No log	7.3103	212	1.3682	0.1618	1.3682	1.1697
No log	7.3793	214	1.1504	0.2612	1.1504	1.0726
No log	7.4483	216	1.0448	0.1955	1.0448	1.0222
No log	7.5172	218	1.1126	0.3193	1.1126	1.0548
No log	7.5862	220	1.1956	0.2868	1.1956	1.0934
No log	7.6552	222	1.3639	0.1678	1.3639	1.1679
No log	7.7241	224	1.4861	0.1391	1.4861	1.2190
No log	7.7931	226	1.4221	0.1641	1.4221	1.1925
No log	7.8621	228	1.3256	0.1973	1.3256	1.1513
No log	7.9310	230	1.3878	0.2121	1.3878	1.1780
No log	8.0	232	1.3057	0.2008	1.3057	1.1427
No log	8.0690	234	1.3209	0.2008	1.3209	1.1493
No log	8.1379	236	1.4191	0.1648	1.4191	1.1912
No log	8.2069	238	1.3948	0.1678	1.3948	1.1810
No log	8.2759	240	1.2463	0.2280	1.2463	1.1164
No log	8.3448	242	1.1711	0.2153	1.1711	1.0822
No log	8.4138	244	1.0724	0.1543	1.0724	1.0356
No log	8.4828	246	0.9470	0.2336	0.9470	0.9731
No log	8.5517	248	0.9465	0.2336	0.9465	0.9729
No log	8.6207	250	1.0246	0.1815	1.0246	1.0122
No log	8.6897	252	1.2769	0.1973	1.2769	1.1300
No log	8.7586	254	1.4150	0.1611	1.4150	1.1895
No log	8.8276	256	1.2950	0.1973	1.2950	1.1380
No log	8.8966	258	1.1695	0.1696	1.1695	1.0814
No log	8.9655	260	1.0296	0.2029	1.0296	1.0147
No log	9.0345	262	1.0585	0.2029	1.0585	1.0288
No log	9.1034	264	1.0833	0.2568	1.0833	1.0408
No log	9.1724	266	0.9931	0.2554	0.9931	0.9965
No log	9.2414	268	0.9088	0.1765	0.9088	0.9533
No log	9.3103	270	0.9716	0.2602	0.9716	0.9857
No log	9.3793	272	1.1738	0.2358	1.1738	1.0834
No log	9.4483	274	1.3446	0.1147	1.3446	1.1596
No log	9.5172	276	1.3225	0.1147	1.3225	1.1500
No log	9.5862	278	1.2244	0.1367	1.2244	1.1065
No log	9.6552	280	1.2798	0.1450	1.2798	1.1313
No log	9.7241	282	1.2782	0.1717	1.2782	1.1306
No log	9.7931	284	1.3533	0.1717	1.3533	1.1633
No log	9.8621	286	1.3576	0.1196	1.3576	1.1652
No log	9.9310	288	1.3204	0.1791	1.3204	1.1491
No log	10.0	290	1.3132	0.1367	1.3132	1.1459
No log	10.0690	292	1.2318	0.1646	1.2318	1.1099
No log	10.1379	294	1.1065	0.2850	1.1065	1.0519
No log	10.2069	296	0.9952	0.3439	0.9952	0.9976
No log	10.2759	298	0.9831	0.2964	0.9831	0.9915
No log	10.3448	300	1.0245	0.3137	1.0245	1.0122
No log	10.4138	302	1.0427	0.2756	1.0427	1.0211
No log	10.4828	304	1.1511	0.1713	1.1511	1.0729
No log	10.5517	306	1.4083	0.1075	1.4083	1.1867
No log	10.6207	308	1.4862	0.1053	1.4862	1.2191
No log	10.6897	310	1.3645	0.1171	1.3645	1.1681
No log	10.7586	312	1.1261	0.1784	1.1261	1.0612
No log	10.8276	314	1.0255	0.2437	1.0255	1.0126
No log	10.8966	316	1.0424	0.2437	1.0424	1.0210
No log	10.9655	318	1.1483	0.2092	1.1483	1.0716
No log	11.0345	320	1.2763	0.1455	1.2763	1.1297
No log	11.1034	322	1.2567	0.1686	1.2567	1.1210
No log	11.1724	324	1.2077	0.1717	1.2077	1.0989
No log	11.2414	326	1.1087	0.2306	1.1087	1.0529
No log	11.3103	328	1.0873	0.1591	1.0873	1.0427
No log	11.3793	330	1.1139	0.1699	1.1139	1.0554
No log	11.4483	332	1.2264	0.2394	1.2264	1.1074
No log	11.5172	334	1.4303	0.0946	1.4303	1.1959
No log	11.5862	336	1.4724	0.0946	1.4724	1.2134
No log	11.6552	338	1.3847	0.0969	1.3847	1.1768
No log	11.7241	340	1.2529	0.2688	1.2529	1.1193
No log	11.7931	342	1.1872	0.2306	1.1872	1.0896
No log	11.8621	344	1.2120	0.2665	1.2120	1.1009
No log	11.9310	346	1.3658	0.0946	1.3658	1.1687
No log	12.0	348	1.4980	0.0901	1.4980	1.2239
No log	12.0690	350	1.4739	0.0901	1.4739	1.2140
No log	12.1379	352	1.3045	0.1427	1.3045	1.1422
No log	12.2069	354	1.1526	0.2665	1.1526	1.0736
No log	12.2759	356	1.0528	0.2876	1.0528	1.0261
No log	12.3448	358	1.0781	0.3088	1.0781	1.0383
No log	12.4138	360	1.1832	0.2622	1.1832	1.0877
No log	12.4828	362	1.3303	0.2008	1.3303	1.1534
No log	12.5517	364	1.4595	0.0946	1.4595	1.2081
No log	12.6207	366	1.3728	0.0946	1.3728	1.1717
No log	12.6897	368	1.1864	0.2324	1.1864	1.0892
No log	12.7586	370	1.0819	0.2504	1.0819	1.0402
No log	12.8276	372	1.0237	0.1612	1.0237	1.0118
No log	12.8966	374	1.0223	0.1955	1.0223	1.0111
No log	12.9655	376	1.1029	0.2209	1.1029	1.0502
No log	13.0345	378	1.2500	0.2622	1.2500	1.1180
No log	13.1034	380	1.4910	0.0650	1.4910	1.2211
No log	13.1724	382	1.7923	0.0702	1.7923	1.3388
No log	13.2414	384	1.8814	0.0497	1.8814	1.3716
No log	13.3103	386	1.7685	0.0555	1.7685	1.3298
No log	13.3793	388	1.5148	0.0903	1.5148	1.2308
No log	13.4483	390	1.2906	0.1513	1.2906	1.1361
No log	13.5172	392	1.1459	0.2436	1.1459	1.0705
No log	13.5862	394	1.1190	0.2141	1.1190	1.0578
No log	13.6552	396	1.1347	0.1564	1.1347	1.0652
No log	13.7241	398	1.2208	0.1312	1.2208	1.1049
No log	13.7931	400	1.3495	0.1226	1.3495	1.1617
No log	13.8621	402	1.3824	0.1226	1.3824	1.1757
No log	13.9310	404	1.3830	0.1550	1.3830	1.1760
No log	14.0	406	1.3969	0.1519	1.3969	1.1819
No log	14.0690	408	1.4312	0.1172	1.4312	1.1963
No log	14.1379	410	1.3517	0.1147	1.3517	1.1626
No log	14.2069	412	1.3068	0.1200	1.3068	1.1432
No log	14.2759	414	1.2265	0.1588	1.2265	1.1075
No log	14.3448	416	1.1746	0.1371	1.1746	1.0838
No log	14.4138	418	1.2548	0.1041	1.2548	1.1202
No log	14.4828	420	1.4020	0.0923	1.4020	1.1840
No log	14.5517	422	1.4400	0.0923	1.4400	1.2000
No log	14.6207	424	1.5277	0.0923	1.5277	1.2360
No log	14.6897	426	1.6119	0.0923	1.6119	1.2696
No log	14.7586	428	1.7573	0.0497	1.7573	1.3256
No log	14.8276	430	1.6926	0.0929	1.6926	1.3010
No log	14.8966	432	1.5284	0.0901	1.5284	1.2363
No log	14.9655	434	1.2657	0.1253	1.2657	1.1250
No log	15.0345	436	1.1338	0.2059	1.1338	1.0648
No log	15.1034	438	1.1209	0.2125	1.1209	1.0587
No log	15.1724	440	1.1860	0.1821	1.1860	1.0890
No log	15.2414	442	1.3195	0.1782	1.3195	1.1487
No log	15.3103	444	1.4513	0.0925	1.4513	1.2047
No log	15.3793	446	1.6057	0.0925	1.6057	1.2672
No log	15.4483	448	1.5813	0.0925	1.5813	1.2575
No log	15.5172	450	1.5195	0.0925	1.5195	1.2327
No log	15.5862	452	1.4720	0.1198	1.4720	1.2132
No log	15.6552	454	1.3319	0.1198	1.3319	1.1541
No log	15.7241	456	1.2193	0.1280	1.2193	1.1042
No log	15.7931	458	1.2389	0.1253	1.2389	1.1130
No log	15.8621	460	1.2464	0.1253	1.2464	1.1164
No log	15.9310	462	1.2692	0.1280	1.2692	1.1266
No log	16.0	464	1.2707	0.1280	1.2707	1.1272
No log	16.0690	466	1.2525	0.1226	1.2525	1.1192
No log	16.1379	468	1.2184	0.1200	1.2184	1.1038
No log	16.2069	470	1.2235	0.1200	1.2235	1.1061
No log	16.2759	472	1.2421	0.1309	1.2421	1.1145
No log	16.3448	474	1.3038	0.1309	1.3038	1.1418
No log	16.4138	476	1.3290	0.1309	1.3290	1.1528
No log	16.4828	478	1.2028	0.0842	1.2028	1.0967
No log	16.5517	480	1.1037	0.1492	1.1037	1.0506
No log	16.6207	482	1.1257	0.1492	1.1257	1.0610
No log	16.6897	484	1.2673	0.1352	1.2673	1.1258
No log	16.7586	486	1.4320	0.1391	1.4320	1.1967
No log	16.8276	488	1.5158	0.1198	1.5158	1.2312
No log	16.8966	490	1.4052	0.1172	1.4052	1.1854
No log	16.9655	492	1.2544	0.1550	1.2544	1.1200
No log	17.0345	494	1.2006	0.2145	1.2006	1.0957
No log	17.1034	496	1.1808	0.2522	1.1808	1.0866
No log	17.1724	498	1.0724	0.2707	1.0724	1.0356
0.3115	17.2414	500	1.0372	0.2343	1.0372	1.0184
0.3115	17.3103	502	1.0415	0.2278	1.0415	1.0205
0.3115	17.3793	504	0.9986	0.2192	0.9986	0.9993
0.3115	17.4483	506	0.9669	0.2369	0.9669	0.9833
0.3115	17.5172	508	1.0050	0.2369	1.0050	1.0025
0.3115	17.5862	510	1.0515	0.2044	1.0515	1.0254
0.3115	17.6552	512	1.1791	0.2055	1.1791	1.0859
0.3115	17.7241	514	1.3430	0.2499	1.3430	1.1589
0.3115	17.7931	516	1.4724	0.1391	1.4724	1.2134
0.3115	17.8621	518	1.5625	0.1098	1.5625	1.2500
0.3115	17.9310	520	1.5254	0.0881	1.5254	1.2351
0.3115	18.0	522	1.4059	0.1147	1.4059	1.1857
0.3115	18.0690	524	1.1731	0.1341	1.1731	1.0831

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1