ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0449
• Qwk: 0.1279
• Mse: 1.0449
• Rmse: 1.0222

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.8568	0.0010	4.8568	2.2038
No log	0.0870	4	2.7587	-0.0020	2.7587	1.6609
No log	0.1304	6	1.8344	-0.0233	1.8344	1.3544
No log	0.1739	8	2.1870	0.0023	2.1870	1.4788
No log	0.2174	10	1.5915	0.0226	1.5915	1.2615
No log	0.2609	12	1.3823	-0.0159	1.3823	1.1757
No log	0.3043	14	1.2400	0.0472	1.2400	1.1136
No log	0.3478	16	1.2251	0.1278	1.2251	1.1069
No log	0.3913	18	1.2266	0.2097	1.2266	1.1075
No log	0.4348	20	1.2598	0.1013	1.2598	1.1224
No log	0.4783	22	1.6134	-0.0284	1.6134	1.2702
No log	0.5217	24	2.1170	0.0486	2.1170	1.4550
No log	0.5652	26	2.0062	0.0683	2.0062	1.4164
No log	0.6087	28	1.5958	0.0348	1.5958	1.2632
No log	0.6522	30	1.3895	0.0232	1.3895	1.1788
No log	0.6957	32	1.3078	-0.0234	1.3078	1.1436
No log	0.7391	34	1.3492	0.0750	1.3492	1.1616
No log	0.7826	36	1.5239	0.0723	1.5239	1.2345
No log	0.8261	38	1.5328	0.0811	1.5328	1.2380
No log	0.8696	40	1.3959	0.1135	1.3959	1.1815
No log	0.9130	42	1.2339	0.1622	1.2339	1.1108
No log	0.9565	44	1.1752	0.2887	1.1752	1.0841
No log	1.0	46	1.2265	0.1407	1.2265	1.1075
No log	1.0435	48	1.2293	0.1009	1.2293	1.1087
No log	1.0870	50	1.1837	0.1918	1.1837	1.0880
No log	1.1304	52	1.1155	0.1935	1.1155	1.0562
No log	1.1739	54	1.0947	0.3145	1.0947	1.0463
No log	1.2174	56	1.1164	0.1675	1.1164	1.0566
No log	1.2609	58	1.2269	0.1772	1.2269	1.1077
No log	1.3043	60	1.4738	0.0796	1.4738	1.2140
No log	1.3478	62	1.4824	0.0230	1.4824	1.2176
No log	1.3913	64	1.3700	0.0686	1.3700	1.1705
No log	1.4348	66	1.2195	0.2574	1.2195	1.1043
No log	1.4783	68	1.2895	0.3046	1.2895	1.1356
No log	1.5217	70	1.1981	0.3274	1.1981	1.0946
No log	1.5652	72	1.0088	0.2970	1.0088	1.0044
No log	1.6087	74	0.9936	0.3728	0.9936	0.9968
No log	1.6522	76	1.0439	0.3502	1.0439	1.0217
No log	1.6957	78	0.9737	0.3318	0.9737	0.9868
No log	1.7391	80	1.0713	0.3335	1.0713	1.0350
No log	1.7826	82	1.2168	0.3129	1.2168	1.1031
No log	1.8261	84	1.2073	0.2318	1.2073	1.0988
No log	1.8696	86	1.1362	0.2265	1.1362	1.0659
No log	1.9130	88	1.1788	0.2319	1.1788	1.0857
No log	1.9565	90	1.2889	0.1239	1.2889	1.1353
No log	2.0	92	1.3390	0.1071	1.3390	1.1572
No log	2.0435	94	1.3460	0.1611	1.3460	1.1602
No log	2.0870	96	1.2305	0.3182	1.2305	1.1093
No log	2.1304	98	1.0868	0.3349	1.0868	1.0425
No log	2.1739	100	1.0055	0.3139	1.0055	1.0028
No log	2.2174	102	1.0372	0.3478	1.0372	1.0184
No log	2.2609	104	1.1969	0.3340	1.1969	1.0940
No log	2.3043	106	1.4084	0.2918	1.4084	1.1867
No log	2.3478	108	1.4040	0.2941	1.4040	1.1849
No log	2.3913	110	1.2159	0.2236	1.2159	1.1027
No log	2.4348	112	1.1014	0.2175	1.1014	1.0495
No log	2.4783	114	1.0702	0.2355	1.0702	1.0345
No log	2.5217	116	1.0816	0.2850	1.0816	1.0400
No log	2.5652	118	1.0844	0.2341	1.0844	1.0414
No log	2.6087	120	1.1404	0.2110	1.1404	1.0679
No log	2.6522	122	1.1548	0.2065	1.1548	1.0746
No log	2.6957	124	1.0872	0.1814	1.0872	1.0427
No log	2.7391	126	1.0529	0.1722	1.0529	1.0261
No log	2.7826	128	1.0577	0.1814	1.0577	1.0284
No log	2.8261	130	1.0956	0.2248	1.0956	1.0467
No log	2.8696	132	1.0473	0.2470	1.0473	1.0234
No log	2.9130	134	1.0519	0.2506	1.0519	1.0256
No log	2.9565	136	1.1881	0.3024	1.1881	1.0900
No log	3.0	138	1.3209	0.3631	1.3209	1.1493
No log	3.0435	140	1.2886	0.3537	1.2886	1.1352
No log	3.0870	142	1.1839	0.3340	1.1839	1.0881
No log	3.1304	144	1.1908	0.3340	1.1908	1.0912
No log	3.1739	146	1.1565	0.2563	1.1565	1.0754
No log	3.2174	148	1.1898	0.3109	1.1898	1.0908
No log	3.2609	150	1.1634	0.2818	1.1634	1.0786
No log	3.3043	152	1.1328	0.2110	1.1328	1.0643
No log	3.3478	154	1.1176	0.1662	1.1176	1.0572
No log	3.3913	156	1.1274	0.1662	1.1274	1.0618
No log	3.4348	158	1.1960	0.1761	1.1960	1.0936
No log	3.4783	160	1.3016	0.1750	1.3016	1.1409
No log	3.5217	162	1.3894	0.1046	1.3894	1.1787
No log	3.5652	164	1.4282	0.1339	1.4282	1.1951
No log	3.6087	166	1.4672	0.1594	1.4672	1.2113
No log	3.6522	168	1.4113	0.1447	1.4113	1.1880
No log	3.6957	170	1.2918	0.2402	1.2918	1.1366
No log	3.7391	172	1.1639	0.2557	1.1639	1.0788
No log	3.7826	174	1.1487	0.2417	1.1487	1.0718
No log	3.8261	176	1.1328	0.2263	1.1328	1.0643
No log	3.8696	178	1.0902	0.2108	1.0902	1.0441
No log	3.9130	180	1.1081	0.2454	1.1081	1.0527
No log	3.9565	182	1.1224	0.0420	1.1224	1.0595
No log	4.0	184	1.1125	0.1753	1.1125	1.0548
No log	4.0435	186	1.1084	0.3106	1.1084	1.0528
No log	4.0870	188	1.1710	0.3863	1.1710	1.0821
No log	4.1304	190	1.1892	0.3815	1.1892	1.0905
No log	4.1739	192	1.0674	0.2718	1.0674	1.0332
No log	4.2174	194	0.9993	0.2539	0.9993	0.9997
No log	4.2609	196	1.1538	0.3567	1.1538	1.0741
No log	4.3043	198	1.4414	0.3269	1.4414	1.2006
No log	4.3478	200	1.4752	0.2708	1.4752	1.2146
No log	4.3913	202	1.3169	0.3106	1.3169	1.1476
No log	4.4348	204	1.1040	0.3192	1.1040	1.0507
No log	4.4783	206	0.9788	0.2219	0.9788	0.9894
No log	4.5217	208	0.9457	0.3345	0.9457	0.9725
No log	4.5652	210	0.9472	0.2939	0.9472	0.9732
No log	4.6087	212	0.9810	0.2200	0.9810	0.9904
No log	4.6522	214	1.0351	0.1307	1.0351	1.0174
No log	4.6957	216	1.0325	0.1307	1.0325	1.0161
No log	4.7391	218	1.0038	0.2371	1.0038	1.0019
No log	4.7826	220	1.0028	0.2539	1.0028	1.0014
No log	4.8261	222	1.0314	0.2592	1.0314	1.0156
No log	4.8696	224	1.0603	0.2296	1.0603	1.0297
No log	4.9130	226	1.0698	0.2386	1.0698	1.0343
No log	4.9565	228	1.0716	0.1919	1.0716	1.0352
No log	5.0	230	1.0805	0.2417	1.0805	1.0395
No log	5.0435	232	1.0872	0.2417	1.0872	1.0427
No log	5.0870	234	1.0672	0.2317	1.0672	1.0330
No log	5.1304	236	1.0585	0.2286	1.0585	1.0288
No log	5.1739	238	1.0485	0.2341	1.0485	1.0240
No log	5.2174	240	1.0368	0.2033	1.0368	1.0182
No log	5.2609	242	1.0551	0.3206	1.0551	1.0272
No log	5.3043	244	1.0370	0.2947	1.0370	1.0183
No log	5.3478	246	1.0301	0.2801	1.0301	1.0149
No log	5.3913	248	1.0710	0.2714	1.0710	1.0349
No log	5.4348	250	1.1304	0.2696	1.1304	1.0632
No log	5.4783	252	1.1262	0.2931	1.1262	1.0612
No log	5.5217	254	1.0744	0.2780	1.0744	1.0365
No log	5.5652	256	1.0587	0.25	1.0587	1.0289
No log	5.6087	258	1.0383	0.2949	1.0383	1.0190
No log	5.6522	260	1.0842	0.2439	1.0842	1.0413
No log	5.6957	262	1.1380	0.2714	1.1380	1.0668
No log	5.7391	264	1.1445	0.2619	1.1445	1.0698
No log	5.7826	266	1.1139	0.2490	1.1139	1.0554
No log	5.8261	268	1.0974	0.2733	1.0974	1.0476
No log	5.8696	270	1.1217	0.2330	1.1217	1.0591
No log	5.9130	272	1.2194	0.3332	1.2194	1.1042
No log	5.9565	274	1.2545	0.3562	1.2545	1.1200
No log	6.0	276	1.2044	0.3093	1.2044	1.0975
No log	6.0435	278	1.1188	0.2535	1.1188	1.0577
No log	6.0870	280	1.0698	0.2683	1.0698	1.0343
No log	6.1304	282	1.0780	0.3289	1.0780	1.0383
No log	6.1739	284	1.1447	0.3341	1.1447	1.0699
No log	6.2174	286	1.1594	0.2931	1.1594	1.0768
No log	6.2609	288	1.0547	0.3046	1.0547	1.0270
No log	6.3043	290	0.9190	0.2921	0.9190	0.9586
No log	6.3478	292	0.9030	0.2773	0.9030	0.9503
No log	6.3913	294	0.9207	0.3453	0.9207	0.9595
No log	6.4348	296	0.9409	0.3453	0.9409	0.9700
No log	6.4783	298	0.9762	0.2218	0.9762	0.9880
No log	6.5217	300	1.0938	0.2772	1.0938	1.0458
No log	6.5652	302	1.2403	0.3590	1.2403	1.1137
No log	6.6087	304	1.2948	0.3590	1.2948	1.1379
No log	6.6522	306	1.2253	0.2602	1.2253	1.1070
No log	6.6957	308	1.2033	0.2602	1.2033	1.0969
No log	6.7391	310	1.2244	0.2570	1.2244	1.1065
No log	6.7826	312	1.2444	0.2570	1.2444	1.1155
No log	6.8261	314	1.2248	0.2864	1.2248	1.1067
No log	6.8696	316	1.1836	0.2509	1.1836	1.0879
No log	6.9130	318	1.1785	0.3001	1.1785	1.0856
No log	6.9565	320	1.1813	0.3249	1.1813	1.0869
No log	7.0	322	1.1570	0.2772	1.1570	1.0756
No log	7.0435	324	1.1008	0.1951	1.1008	1.0492
No log	7.0870	326	1.1117	0.2236	1.1117	1.0544
No log	7.1304	328	1.1147	0.2439	1.1147	1.0558
No log	7.1739	330	1.1319	0.2439	1.1319	1.0639
No log	7.2174	332	1.0559	0.1853	1.0559	1.0276
No log	7.2609	334	1.0273	0.1706	1.0273	1.0135
No log	7.3043	336	1.0372	0.1706	1.0372	1.0184
No log	7.3478	338	1.0986	0.1951	1.0986	1.0481
No log	7.3913	340	1.1650	0.3001	1.1650	1.0794
No log	7.4348	342	1.2015	0.3094	1.2015	1.0961
No log	7.4783	344	1.1300	0.2475	1.1300	1.0630
No log	7.5217	346	1.0705	0.1761	1.0705	1.0346
No log	7.5652	348	1.0800	0.1442	1.0800	1.0392
No log	7.6087	350	1.1783	0.3094	1.1783	1.0855
No log	7.6522	352	1.2455	0.3590	1.2455	1.1160
No log	7.6957	354	1.2221	0.3324	1.2221	1.1055
No log	7.7391	356	1.1117	0.1853	1.1117	1.0544
No log	7.7826	358	1.0542	0.1701	1.0542	1.0268
No log	7.8261	360	1.0427	0.1602	1.0427	1.0211
No log	7.8696	362	1.1162	0.2439	1.1162	1.0565
No log	7.9130	364	1.2037	0.3324	1.2037	1.0971
No log	7.9565	366	1.2143	0.3187	1.2143	1.1020
No log	8.0	368	1.1394	0.3049	1.1394	1.0674
No log	8.0435	370	1.1093	0.2439	1.1093	1.0532
No log	8.0870	372	1.1000	0.2248	1.1000	1.0488
No log	8.1304	374	1.1458	0.2439	1.1458	1.0704
No log	8.1739	376	1.2367	0.2980	1.2367	1.1121
No log	8.2174	378	1.2315	0.2460	1.2315	1.1097
No log	8.2609	380	1.1472	0.2343	1.1472	1.0711
No log	8.3043	382	1.0594	0.2591	1.0594	1.0293
No log	8.3478	384	1.0228	0.2743	1.0228	1.0113
No log	8.3913	386	1.0213	0.2754	1.0213	1.0106
No log	8.4348	388	1.1028	0.2698	1.1028	1.0501
No log	8.4783	390	1.3209	0.3512	1.3209	1.1493
No log	8.5217	392	1.4624	0.2873	1.4624	1.2093
No log	8.5652	394	1.4010	0.3188	1.4010	1.1836
No log	8.6087	396	1.2303	0.3433	1.2303	1.1092
No log	8.6522	398	1.0633	0.2250	1.0633	1.0311
No log	8.6957	400	1.0009	0.1820	1.0009	1.0004
No log	8.7391	402	1.0058	0.2065	1.0058	1.0029
No log	8.7826	404	1.0431	0.2046	1.0431	1.0213
No log	8.8261	406	1.1219	0.3433	1.1219	1.0592
No log	8.8696	408	1.0946	0.2931	1.0946	1.0462
No log	8.9130	410	1.0144	0.2304	1.0144	1.0072
No log	8.9565	412	1.0042	0.2439	1.0042	1.0021
No log	9.0	414	0.9856	0.2586	0.9856	0.9928
No log	9.0435	416	1.0648	0.3187	1.0648	1.0319
No log	9.0870	418	1.2429	0.3706	1.2429	1.1148
No log	9.1304	420	1.3380	0.3615	1.3380	1.1567
No log	9.1739	422	1.2477	0.3723	1.2477	1.1170
No log	9.2174	424	1.0856	0.3800	1.0856	1.0419
No log	9.2609	426	1.0280	0.2837	1.0280	1.0139
No log	9.3043	428	1.0367	0.2809	1.0367	1.0182
No log	9.3478	430	1.0746	0.3167	1.0746	1.0366
No log	9.3913	432	1.1609	0.3418	1.1609	1.0774
No log	9.4348	434	1.1257	0.3146	1.1257	1.0610
No log	9.4783	436	1.0476	0.1795	1.0476	1.0235
No log	9.5217	438	1.0153	0.1641	1.0153	1.0076
No log	9.5652	440	1.0379	0.1641	1.0379	1.0188
No log	9.6087	442	1.1048	0.1795	1.1048	1.0511
No log	9.6522	444	1.2247	0.3538	1.2247	1.1067
No log	9.6957	446	1.2394	0.3769	1.2394	1.1133
No log	9.7391	448	1.1595	0.2387	1.1595	1.0768
No log	9.7826	450	1.1063	0.1795	1.1063	1.0518
No log	9.8261	452	1.0311	0.1808	1.0311	1.0154
No log	9.8696	454	1.0280	0.2083	1.0280	1.0139
No log	9.9130	456	1.0800	0.1148	1.0800	1.0392
No log	9.9565	458	1.1742	0.2097	1.1742	1.0836
No log	10.0	460	1.2984	0.2781	1.2984	1.1395
No log	10.0435	462	1.2796	0.2725	1.2796	1.1312
No log	10.0870	464	1.1963	0.1801	1.1963	1.0938
No log	10.1304	466	1.1680	0.2250	1.1680	1.0807
No log	10.1739	468	1.2458	0.1650	1.2458	1.1162
No log	10.2174	470	1.3004	0.1650	1.3004	1.1403
No log	10.2609	472	1.3446	0.1252	1.3446	1.1596
No log	10.3043	474	1.3671	0.1252	1.3671	1.1692
No log	10.3478	476	1.3331	0.0937	1.3331	1.1546
No log	10.3913	478	1.2979	0.1345	1.2979	1.1393
No log	10.4348	480	1.3482	0.1252	1.3482	1.1611
No log	10.4783	482	1.4597	0.3026	1.4597	1.2082
No log	10.5217	484	1.4328	0.3238	1.4328	1.1970
No log	10.5652	486	1.3326	0.2460	1.3326	1.1544
No log	10.6087	488	1.1928	0.1952	1.1928	1.0921
No log	10.6522	490	1.0760	0.1114	1.0760	1.0373
No log	10.6957	492	1.0408	0.1114	1.0408	1.0202
No log	10.7391	494	1.0479	0.1214	1.0479	1.0236
No log	10.7826	496	1.0953	0.1853	1.0953	1.0466
No log	10.8261	498	1.1782	0.1795	1.1782	1.0855
0.3848	10.8696	500	1.2680	0.2905	1.2680	1.1260
0.3848	10.9130	502	1.2929	0.2519	1.2929	1.1370
0.3848	10.9565	504	1.2507	0.1795	1.2507	1.1183
0.3848	11.0	506	1.1557	0.1952	1.1557	1.0750
0.3848	11.0435	508	1.0805	0.1442	1.0805	1.0395
0.3848	11.0870	510	1.0449	0.1279	1.0449	1.0222

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1