ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1353
• Qwk: 0.0711
• Mse: 1.1353
• Rmse: 1.0655

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0870	2	4.7511	-0.0020	4.7511	2.1797
No log	0.1739	4	3.0278	-0.0411	3.0278	1.7400
No log	0.2609	6	1.9312	-0.0433	1.9312	1.3897
No log	0.3478	8	1.6006	0.0526	1.6006	1.2651
No log	0.4348	10	1.7462	-0.0043	1.7462	1.3215
No log	0.5217	12	1.3589	0.0091	1.3589	1.1657
No log	0.6087	14	1.3048	0.1570	1.3048	1.1423
No log	0.6957	16	1.3754	0.0977	1.3754	1.1728
No log	0.7826	18	1.2975	0.0253	1.2975	1.1391
No log	0.8696	20	1.3015	0.0532	1.3015	1.1408
No log	0.9565	22	1.6304	0.0451	1.6304	1.2769
No log	1.0435	24	1.6862	0.0283	1.6862	1.2986
No log	1.1304	26	1.4455	0.0750	1.4455	1.2023
No log	1.2174	28	1.2787	0.2246	1.2787	1.1308
No log	1.3043	30	1.4317	0.1094	1.4317	1.1965
No log	1.3913	32	1.4879	0.1692	1.4879	1.2198
No log	1.4783	34	1.3538	0.0954	1.3538	1.1635
No log	1.5652	36	1.2590	0.1271	1.2590	1.1221
No log	1.6522	38	1.4952	0.1601	1.4952	1.2228
No log	1.7391	40	1.4869	0.1884	1.4869	1.2194
No log	1.8261	42	1.2240	0.1638	1.2240	1.1063
No log	1.9130	44	1.1146	0.2944	1.1146	1.0558
No log	2.0	46	1.1118	0.2448	1.1118	1.0544
No log	2.0870	48	1.1509	0.1868	1.1509	1.0728
No log	2.1739	50	1.1383	0.2708	1.1383	1.0669
No log	2.2609	52	1.1278	0.2569	1.1278	1.0620
No log	2.3478	54	1.1180	0.2761	1.1180	1.0574
No log	2.4348	56	1.1291	0.2255	1.1291	1.0626
No log	2.5217	58	1.1468	0.2674	1.1468	1.0709
No log	2.6087	60	1.1963	0.3866	1.1963	1.0938
No log	2.6957	62	1.4475	0.2862	1.4475	1.2031
No log	2.7826	64	1.5181	0.2784	1.5181	1.2321
No log	2.8696	66	1.4051	0.3569	1.4051	1.1854
No log	2.9565	68	1.2312	0.3258	1.2312	1.1096
No log	3.0435	70	1.3070	0.3859	1.3070	1.1432
No log	3.1304	72	1.2820	0.3843	1.2820	1.1323
No log	3.2174	74	1.1491	0.4055	1.1491	1.0720
No log	3.3043	76	1.0582	0.3602	1.0582	1.0287
No log	3.3913	78	1.0515	0.3326	1.0515	1.0254
No log	3.4783	80	0.9728	0.3632	0.9728	0.9863
No log	3.5652	82	0.9467	0.3652	0.9467	0.9730
No log	3.6522	84	0.9523	0.3729	0.9523	0.9759
No log	3.7391	86	1.0958	0.3722	1.0958	1.0468
No log	3.8261	88	0.9951	0.3975	0.9951	0.9975
No log	3.9130	90	1.0438	0.3787	1.0438	1.0217
No log	4.0	92	1.2595	0.3963	1.2595	1.1223
No log	4.0870	94	1.3489	0.3533	1.3489	1.1614
No log	4.1739	96	1.3540	0.3107	1.3540	1.1636
No log	4.2609	98	1.2230	0.4276	1.2230	1.1059
No log	4.3478	100	1.1147	0.4116	1.1147	1.0558
No log	4.4348	102	1.1897	0.3665	1.1897	1.0907
No log	4.5217	104	1.3719	0.2430	1.3719	1.1713
No log	4.6087	106	1.3898	0.3209	1.3898	1.1789
No log	4.6957	108	1.1561	0.2604	1.1561	1.0752
No log	4.7826	110	1.0308	0.3174	1.0308	1.0153
No log	4.8696	112	1.0548	0.3363	1.0548	1.0271
No log	4.9565	114	1.2382	0.3394	1.2382	1.1127
No log	5.0435	116	1.3914	0.3272	1.3914	1.1796
No log	5.1304	118	1.3518	0.2898	1.3518	1.1627
No log	5.2174	120	1.3287	0.3371	1.3287	1.1527
No log	5.3043	122	1.4589	0.2824	1.4589	1.2079
No log	5.3913	124	1.4779	0.2832	1.4779	1.2157
No log	5.4783	126	1.3306	0.2647	1.3306	1.1535
No log	5.5652	128	1.3060	0.2636	1.3060	1.1428
No log	5.6522	130	1.3448	0.2087	1.3448	1.1596
No log	5.7391	132	1.4697	0.2317	1.4697	1.2123
No log	5.8261	134	1.4384	0.2090	1.4384	1.1993
No log	5.9130	136	1.2520	0.2668	1.2520	1.1189
No log	6.0	138	1.1694	0.3045	1.1694	1.0814
No log	6.0870	140	1.1703	0.3547	1.1703	1.0818
No log	6.1739	142	1.2500	0.2273	1.2500	1.1180
No log	6.2609	144	1.2313	0.25	1.2313	1.1097
No log	6.3478	146	1.2498	0.2301	1.2498	1.1179
No log	6.4348	148	1.3018	0.2201	1.3018	1.1409
No log	6.5217	150	1.2162	0.2696	1.2162	1.1028
No log	6.6087	152	1.2662	0.2354	1.2662	1.1253
No log	6.6957	154	1.4526	0.3086	1.4526	1.2053
No log	6.7826	156	1.5481	0.3248	1.5481	1.2442
No log	6.8696	158	1.3615	0.2731	1.3615	1.1668
No log	6.9565	160	1.1958	0.2345	1.1958	1.0935
No log	7.0435	162	1.1574	0.2357	1.1574	1.0758
No log	7.1304	164	1.2384	0.2503	1.2384	1.1129
No log	7.2174	166	1.2876	0.3067	1.2876	1.1347
No log	7.3043	168	1.1679	0.2956	1.1679	1.0807
No log	7.3913	170	1.1550	0.2712	1.1550	1.0747
No log	7.4783	172	1.1550	0.2755	1.1550	1.0747
No log	7.5652	174	1.2132	0.2754	1.2132	1.1014
No log	7.6522	176	1.2399	0.3049	1.2399	1.1135
No log	7.7391	178	1.1523	0.3402	1.1523	1.0734
No log	7.8261	180	1.0992	0.25	1.0992	1.0484
No log	7.9130	182	1.1421	0.3402	1.1421	1.0687
No log	8.0	184	1.1400	0.3402	1.1400	1.0677
No log	8.0870	186	1.1033	0.3095	1.1033	1.0504
No log	8.1739	188	1.2183	0.3094	1.2183	1.1038
No log	8.2609	190	1.5233	0.2669	1.5233	1.2342
No log	8.3478	192	1.6532	0.2353	1.6532	1.2858
No log	8.4348	194	1.7309	0.1953	1.7309	1.3156
No log	8.5217	196	1.6236	0.2560	1.6236	1.2742
No log	8.6087	198	1.4736	0.2668	1.4736	1.2139
No log	8.6957	200	1.4700	0.3179	1.4700	1.2124
No log	8.7826	202	1.6025	0.2557	1.6025	1.2659
No log	8.8696	204	1.5595	0.2843	1.5595	1.2488
No log	8.9565	206	1.5652	0.2843	1.5652	1.2511
No log	9.0435	208	1.3974	0.2991	1.3974	1.1821
No log	9.1304	210	1.2527	0.3621	1.2527	1.1193
No log	9.2174	212	1.3058	0.3309	1.3058	1.1427
No log	9.3043	214	1.3083	0.2731	1.3083	1.1438
No log	9.3913	216	1.3648	0.2544	1.3648	1.1682
No log	9.4783	218	1.2360	0.1650	1.2360	1.1117
No log	9.5652	220	1.0820	0.2188	1.0820	1.0402
No log	9.6522	222	1.0884	0.3021	1.0884	1.0433
No log	9.7391	224	1.1463	0.2791	1.1463	1.0707
No log	9.8261	226	1.3158	0.2604	1.3158	1.1471
No log	9.9130	228	1.5182	0.2514	1.5182	1.2322
No log	10.0	230	1.4568	0.2455	1.4568	1.2070
No log	10.0870	232	1.2248	0.3367	1.2248	1.1067
No log	10.1739	234	1.1213	0.3046	1.1213	1.0589
No log	10.2609	236	1.1519	0.2904	1.1519	1.0733
No log	10.3478	238	1.2603	0.2570	1.2603	1.1226
No log	10.4348	240	1.3247	0.3127	1.3247	1.1510
No log	10.5217	242	1.2753	0.3563	1.2753	1.1293
No log	10.6087	244	1.3071	0.3317	1.3071	1.1433
No log	10.6957	246	1.5019	0.2127	1.5019	1.2255
No log	10.7826	248	1.5292	0.1704	1.5292	1.2366
No log	10.8696	250	1.3682	0.1889	1.3682	1.1697
No log	10.9565	252	1.2224	0.2322	1.2224	1.1056
No log	11.0435	254	1.1559	0.2739	1.1559	1.0751
No log	11.1304	256	1.0985	0.3361	1.0985	1.0481
No log	11.2174	258	1.1988	0.3831	1.1988	1.0949
No log	11.3043	260	1.4618	0.2711	1.4618	1.2091
No log	11.3913	262	1.7297	0.2041	1.7297	1.3152
No log	11.4783	264	1.6563	0.2202	1.6563	1.2870
No log	11.5652	266	1.3482	0.2895	1.3482	1.1611
No log	11.6522	268	1.0631	0.2702	1.0631	1.0311
No log	11.7391	270	0.9755	0.3070	0.9755	0.9877
No log	11.8261	272	0.9712	0.3070	0.9712	0.9855
No log	11.9130	274	1.0179	0.1969	1.0179	1.0089
No log	12.0	276	1.1703	0.3002	1.1703	1.0818
No log	12.0870	278	1.3729	0.2570	1.3729	1.1717
No log	12.1739	280	1.4276	0.2152	1.4276	1.1948
No log	12.2609	282	1.3403	0.2570	1.3403	1.1577
No log	12.3478	284	1.1715	0.2884	1.1715	1.0824
No log	12.4348	286	1.0961	0.3430	1.0961	1.0470
No log	12.5217	288	1.0575	0.3072	1.0575	1.0283
No log	12.6087	290	1.0641	0.2800	1.0641	1.0316
No log	12.6957	292	1.1786	0.2884	1.1786	1.0856
No log	12.7826	294	1.2688	0.2504	1.2688	1.1264
No log	12.8696	296	1.2433	0.1633	1.2433	1.1150
No log	12.9565	298	1.1340	0.1316	1.1340	1.0649
No log	13.0435	300	1.0097	0.2708	1.0097	1.0048
No log	13.1304	302	0.9955	0.3278	0.9955	0.9977
No log	13.2174	304	1.0381	0.2496	1.0381	1.0189
No log	13.3043	306	1.1313	0.1789	1.1313	1.0636
No log	13.3913	308	1.1767	0.2615	1.1767	1.0848
No log	13.4783	310	1.1204	0.2334	1.1204	1.0585
No log	13.5652	312	1.0400	0.2669	1.0400	1.0198
No log	13.6522	314	0.9561	0.3753	0.9561	0.9778
No log	13.7391	316	0.9243	0.4278	0.9243	0.9614
No log	13.8261	318	0.9770	0.4743	0.9770	0.9884
No log	13.9130	320	1.1096	0.4022	1.1096	1.0534
No log	14.0	322	1.1399	0.3361	1.1399	1.0677
No log	14.0870	324	1.1000	0.3341	1.1000	1.0488
No log	14.1739	326	1.0127	0.3802	1.0127	1.0063
No log	14.2609	328	0.9908	0.2293	0.9908	0.9954
No log	14.3478	330	0.9887	0.2726	0.9887	0.9944
No log	14.4348	332	1.0128	0.2013	1.0128	1.0064
No log	14.5217	334	1.0481	0.2463	1.0481	1.0238
No log	14.6087	336	1.1474	0.3776	1.1474	1.0712
No log	14.6957	338	1.2551	0.2617	1.2551	1.1203
No log	14.7826	340	1.1691	0.3554	1.1691	1.0812
No log	14.8696	342	1.0782	0.3949	1.0782	1.0384
No log	14.9565	344	1.0495	0.3343	1.0495	1.0244
No log	15.0435	346	1.0265	0.2689	1.0265	1.0132
No log	15.1304	348	1.0637	0.2922	1.0637	1.0314
No log	15.2174	350	1.1389	0.2878	1.1389	1.0672
No log	15.3043	352	1.1455	0.2761	1.1455	1.0703
No log	15.3913	354	1.1519	0.2761	1.1519	1.0733
No log	15.4783	356	1.0922	0.1795	1.0922	1.0451
No log	15.5652	358	1.0749	0.1795	1.0749	1.0368
No log	15.6522	360	1.0938	0.1795	1.0938	1.0458
No log	15.7391	362	1.1039	0.2097	1.1039	1.0507
No log	15.8261	364	1.0748	0.25	1.0748	1.0367
No log	15.9130	366	1.0601	0.2800	1.0601	1.0296
No log	16.0	368	1.0971	0.3669	1.0971	1.0474
No log	16.0870	370	1.2424	0.2857	1.2424	1.1146
No log	16.1739	372	1.4206	0.2782	1.4206	1.1919
No log	16.2609	374	1.3851	0.2782	1.3851	1.1769
No log	16.3478	376	1.1981	0.3167	1.1981	1.0946
No log	16.4348	378	1.1111	0.2207	1.1111	1.0541
No log	16.5217	380	1.0708	0.2363	1.0708	1.0348
No log	16.6087	382	1.0618	0.2516	1.0618	1.0304
No log	16.6957	384	1.0694	0.2207	1.0694	1.0341
No log	16.7826	386	1.0831	0.25	1.0831	1.0407
No log	16.8696	388	1.1331	0.3025	1.1331	1.0645
No log	16.9565	390	1.1846	0.2980	1.1846	1.0884
No log	17.0435	392	1.1935	0.2980	1.1935	1.0925
No log	17.1304	394	1.1645	0.2696	1.1645	1.0791
No log	17.2174	396	1.1098	0.2402	1.1098	1.0535
No log	17.3043	398	1.0810	0.1747	1.0810	1.0397
No log	17.3913	400	1.0840	0.1747	1.0840	1.0412
No log	17.4783	402	1.0903	0.1801	1.0903	1.0442
No log	17.5652	404	1.0880	0.1801	1.0880	1.0431
No log	17.6522	406	1.1491	0.1795	1.1491	1.0720
No log	17.7391	408	1.1159	0.2207	1.1159	1.0564
No log	17.8261	410	1.0312	0.2621	1.0312	1.0155
No log	17.9130	412	1.0160	0.3021	1.0160	1.0080
No log	18.0	414	0.9857	0.3196	0.9857	0.9928
No log	18.0870	416	1.0302	0.2331	1.0302	1.0150
No log	18.1739	418	1.1179	0.1795	1.1179	1.0573
No log	18.2609	420	1.1488	0.1795	1.1488	1.0718
No log	18.3478	422	1.0782	0.2317	1.0782	1.0383
No log	18.4348	424	1.0189	0.2772	1.0189	1.0094
No log	18.5217	426	1.0415	0.2772	1.0415	1.0205
No log	18.6087	428	1.1349	0.2207	1.1349	1.0653
No log	18.6957	430	1.2325	0.1637	1.2325	1.1102
No log	18.7826	432	1.2834	0.0798	1.2834	1.1329
No log	18.8696	434	1.2374	0.0798	1.2374	1.1124
No log	18.9565	436	1.1522	0.0904	1.1522	1.0734
No log	19.0435	438	1.0922	0.1649	1.0922	1.0451
No log	19.1304	440	1.0832	0.1814	1.0832	1.0408
No log	19.2174	442	1.1216	0.1316	1.1216	1.0590
No log	19.3043	444	1.1378	0.1637	1.1378	1.0667
No log	19.3913	446	1.1548	0.1637	1.1548	1.0746
No log	19.4783	448	1.1393	0.1637	1.1393	1.0674
No log	19.5652	450	1.1726	0.1219	1.1726	1.0829
No log	19.6522	452	1.2603	0.0798	1.2603	1.1227
No log	19.7391	454	1.3125	0.0798	1.3125	1.1456
No log	19.8261	456	1.2881	0.0798	1.2881	1.1350
No log	19.9130	458	1.2165	0.1219	1.2165	1.1029
No log	20.0	460	1.1076	0.1795	1.1076	1.0524
No log	20.0870	462	1.0235	0.2812	1.0235	1.0117
No log	20.1739	464	1.0113	0.3021	1.0113	1.0056
No log	20.2609	466	1.0824	0.1696	1.0824	1.0404
No log	20.3478	468	1.2284	0.1379	1.2284	1.1083
No log	20.4348	470	1.3579	0.2225	1.3579	1.1653
No log	20.5217	472	1.3680	0.2225	1.3680	1.1696
No log	20.6087	474	1.3179	0.1935	1.3179	1.1480
No log	20.6957	476	1.2451	0.1935	1.2451	1.1158
No log	20.7826	478	1.1671	0.1637	1.1671	1.0803
No log	20.8696	480	1.1029	0.2051	1.1029	1.0502
No log	20.9565	482	1.0662	0.2317	1.0662	1.0326
No log	21.0435	484	1.0895	0.3270	1.0895	1.0438
No log	21.1304	486	1.0874	0.3270	1.0874	1.0428
No log	21.2174	488	1.1036	0.3528	1.1036	1.0505
No log	21.3043	490	1.0931	0.3528	1.0931	1.0455
No log	21.3913	492	1.0495	0.2065	1.0495	1.0245
No log	21.4783	494	1.0016	0.2386	1.0016	1.0008
No log	21.5652	496	0.9785	0.2887	0.9785	0.9892
No log	21.6522	498	0.9811	0.2464	0.9811	0.9905
0.2755	21.7391	500	1.0156	0.1711	1.0156	1.0078
0.2755	21.8261	502	1.0722	0.1741	1.0722	1.0355
0.2755	21.9130	504	1.1058	0.1637	1.1058	1.0516
0.2755	22.0	506	1.1081	0.1944	1.1081	1.0527
0.2755	22.0870	508	1.0584	0.2363	1.0584	1.0288
0.2755	22.1739	510	0.9955	0.2486	0.9955	0.9978
0.2755	22.2609	512	0.9938	0.2893	0.9938	0.9969
0.2755	22.3478	514	1.0628	0.2363	1.0628	1.0309
0.2755	22.4348	516	1.1439	0.2633	1.1439	1.0695
0.2755	22.5217	518	1.1494	0.2348	1.1494	1.0721
0.2755	22.6087	520	1.1151	0.1148	1.1151	1.0560
0.2755	22.6957	522	1.1019	0.1315	1.1019	1.0497
0.2755	22.7826	524	1.1145	0.1148	1.1145	1.0557
0.2755	22.8696	526	1.1397	0.0711	1.1397	1.0676
0.2755	22.9565	528	1.1353	0.0711	1.1353	1.0655

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1