ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5601
• Qwk: 0.4
• Mse: 1.5601
• Rmse: 1.2490

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0308	2	6.7967	0.0057	6.7967	2.6071
No log	0.0615	4	4.3979	0.0917	4.3979	2.0971
No log	0.0923	6	3.2419	-0.0347	3.2419	1.8005
No log	0.1231	8	2.3598	0.0896	2.3598	1.5362
No log	0.1538	10	1.9072	0.1368	1.9072	1.3810
No log	0.1846	12	1.8371	0.1441	1.8371	1.3554
No log	0.2154	14	3.2160	0.0351	3.2160	1.7933
No log	0.2462	16	4.3214	0.0270	4.3214	2.0788
No log	0.2769	18	4.0676	0.1333	4.0676	2.0168
No log	0.3077	20	3.3246	0.0494	3.3246	1.8234
No log	0.3385	22	2.4021	0.0800	2.4021	1.5499
No log	0.3692	24	2.0041	0.1852	2.0041	1.4157
No log	0.4	26	1.9848	0.1143	1.9848	1.4088
No log	0.4308	28	2.1003	0.1111	2.1003	1.4492
No log	0.4615	30	2.2452	0.0149	2.2452	1.4984
No log	0.4923	32	2.2414	0.0714	2.2414	1.4971
No log	0.5231	34	2.0908	0.1890	2.0908	1.4460
No log	0.5538	36	1.9760	0.3167	1.9760	1.4057
No log	0.5846	38	1.8139	0.2807	1.8139	1.3468
No log	0.6154	40	1.8340	0.3710	1.8340	1.3542
No log	0.6462	42	1.8235	0.3721	1.8235	1.3504
No log	0.6769	44	1.6971	0.4	1.6971	1.3027
No log	0.7077	46	1.6964	0.3906	1.6964	1.3025
No log	0.7385	48	2.0719	0.1831	2.0719	1.4394
No log	0.7692	50	2.1971	0.1389	2.1971	1.4823
No log	0.8	52	1.8222	0.3817	1.8222	1.3499
No log	0.8308	54	1.5817	0.4194	1.5817	1.2577
No log	0.8615	56	1.6115	0.4444	1.6115	1.2694
No log	0.8923	58	1.4608	0.3934	1.4608	1.2086
No log	0.9231	60	1.3255	0.3077	1.3255	1.1513
No log	0.9538	62	1.3885	0.3009	1.3885	1.1783
No log	0.9846	64	1.4107	0.3478	1.4107	1.1877
No log	1.0154	66	1.3288	0.4034	1.3288	1.1527
No log	1.0462	68	1.2704	0.4286	1.2704	1.1271
No log	1.0769	70	1.3938	0.3415	1.3938	1.1806
No log	1.1077	72	1.5898	0.3200	1.5898	1.2609
No log	1.1385	74	1.4747	0.4186	1.4747	1.2144
No log	1.1692	76	1.3910	0.4961	1.3910	1.1794
No log	1.2	78	1.5280	0.3548	1.5280	1.2361
No log	1.2308	80	1.2814	0.4628	1.2814	1.1320
No log	1.2615	82	1.2619	0.4483	1.2619	1.1234
No log	1.2923	84	1.1784	0.4786	1.1784	1.0855
No log	1.3231	86	1.2184	0.4167	1.2184	1.1038
No log	1.3538	88	1.6203	0.3971	1.6203	1.2729
No log	1.3846	90	1.4063	0.4426	1.4063	1.1859
No log	1.4154	92	1.1231	0.5128	1.1231	1.0598
No log	1.4462	94	1.3950	0.4604	1.3950	1.1811
No log	1.4769	96	1.6045	0.3478	1.6045	1.2667
No log	1.5077	98	1.3357	0.5649	1.3357	1.1557
No log	1.5385	100	1.0085	0.5970	1.0085	1.0043
No log	1.5692	102	1.0502	0.5344	1.0502	1.0248
No log	1.6	104	1.0526	0.5865	1.0526	1.0260
No log	1.6308	106	1.2462	0.5758	1.2462	1.1163
No log	1.6615	108	1.5325	0.4030	1.5325	1.2379
No log	1.6923	110	1.8254	0.2370	1.8254	1.3511
No log	1.7231	112	1.6304	0.3358	1.6304	1.2769
No log	1.7538	114	1.2544	0.4885	1.2544	1.1200
No log	1.7846	116	1.0737	0.5397	1.0737	1.0362
No log	1.8154	118	1.0063	0.6202	1.0063	1.0031
No log	1.8462	120	1.0144	0.5846	1.0144	1.0072
No log	1.8769	122	1.4322	0.4380	1.4322	1.1967
No log	1.9077	124	1.8270	0.2537	1.8270	1.3517
No log	1.9385	126	1.9045	0.0952	1.9045	1.3800
No log	1.9692	128	1.7928	0.1463	1.7928	1.3390
No log	2.0	130	1.2904	0.3500	1.2904	1.1360
No log	2.0308	132	1.1468	0.5484	1.1468	1.0709
No log	2.0615	134	1.1992	0.5041	1.1992	1.0951
No log	2.0923	136	1.3657	0.5312	1.3657	1.1686
No log	2.1231	138	1.4941	0.4275	1.4941	1.2223
No log	2.1538	140	1.4211	0.4848	1.4211	1.1921
No log	2.1846	142	1.1780	0.5672	1.1780	1.0854
No log	2.2154	144	0.9531	0.6	0.9531	0.9763
No log	2.2462	146	0.8817	0.6418	0.8817	0.9390
No log	2.2769	148	0.9520	0.6	0.9520	0.9757
No log	2.3077	150	1.3403	0.5075	1.3403	1.1577
No log	2.3385	152	1.4823	0.4148	1.4823	1.2175
No log	2.3692	154	1.3999	0.4848	1.3999	1.1832
No log	2.4	156	1.2255	0.6462	1.2255	1.1070
No log	2.4308	158	1.0960	0.56	1.0960	1.0469
No log	2.4615	160	1.0686	0.4667	1.0686	1.0337
No log	2.4923	162	1.1015	0.5323	1.1015	1.0495
No log	2.5231	164	1.2604	0.6202	1.2604	1.1227
No log	2.5538	166	1.5432	0.4688	1.5432	1.2422
No log	2.5846	168	1.6085	0.3582	1.6085	1.2683
No log	2.6154	170	1.5313	0.3852	1.5313	1.2375
No log	2.6462	172	1.3130	0.5522	1.3130	1.1459
No log	2.6769	174	1.2245	0.5522	1.2245	1.1066
No log	2.7077	176	1.3478	0.5	1.3478	1.1609
No log	2.7385	178	1.4331	0.4638	1.4331	1.1971
No log	2.7692	180	1.2413	0.5588	1.2413	1.1142
No log	2.8	182	1.2125	0.5926	1.2125	1.1011
No log	2.8308	184	1.2089	0.5926	1.2089	1.0995
No log	2.8615	186	1.2116	0.5926	1.2116	1.1007
No log	2.8923	188	1.0997	0.5954	1.0997	1.0487
No log	2.9231	190	1.0750	0.6047	1.0750	1.0368
No log	2.9538	192	1.1363	0.5984	1.1363	1.0660
No log	2.9846	194	1.2790	0.5564	1.2790	1.1309
No log	3.0154	196	1.3945	0.4412	1.3945	1.1809
No log	3.0462	198	1.3314	0.4925	1.3314	1.1539
No log	3.0769	200	1.4410	0.4412	1.4410	1.2004
No log	3.1077	202	1.6463	0.3188	1.6463	1.2831
No log	3.1385	204	1.5586	0.3676	1.5586	1.2484
No log	3.1692	206	1.4794	0.3852	1.4794	1.2163
No log	3.2	208	1.3271	0.5692	1.3271	1.1520
No log	3.2308	210	1.2277	0.5938	1.2277	1.1080
No log	3.2615	212	1.2230	0.5846	1.2230	1.1059
No log	3.2923	214	1.2807	0.5758	1.2807	1.1317
No log	3.3231	216	1.2742	0.5758	1.2742	1.1288
No log	3.3538	218	1.1590	0.6047	1.1590	1.0766
No log	3.3846	220	1.0492	0.5938	1.0492	1.0243
No log	3.4154	222	1.1139	0.5669	1.1139	1.0554
No log	3.4462	224	1.2640	0.5496	1.2640	1.1243
No log	3.4769	226	1.5060	0.3676	1.5060	1.2272
No log	3.5077	228	1.6067	0.3407	1.6068	1.2676
No log	3.5385	230	1.4477	0.4460	1.4477	1.2032
No log	3.5692	232	1.1508	0.5846	1.1508	1.0727
No log	3.6	234	1.0340	0.6154	1.0340	1.0169
No log	3.6308	236	1.0636	0.6	1.0636	1.0313
No log	3.6615	238	1.2629	0.5333	1.2629	1.1238
No log	3.6923	240	1.4607	0.4493	1.4607	1.2086
No log	3.7231	242	1.3347	0.4234	1.3347	1.1553
No log	3.7538	244	1.2153	0.5496	1.2153	1.1024
No log	3.7846	246	1.0746	0.6190	1.0746	1.0366
No log	3.8154	248	0.9982	0.6032	0.9982	0.9991
No log	3.8462	250	1.0225	0.625	1.0225	1.0112
No log	3.8769	252	1.1648	0.5891	1.1648	1.0793
No log	3.9077	254	1.2270	0.5891	1.2270	1.1077
No log	3.9385	256	1.2257	0.6094	1.2257	1.1071
No log	3.9692	258	1.3020	0.5649	1.3020	1.1410
No log	4.0	260	1.3544	0.5564	1.3544	1.1638
No log	4.0308	262	1.4237	0.4211	1.4237	1.1932
No log	4.0615	264	1.3005	0.5224	1.3005	1.1404
No log	4.0923	266	1.0955	0.5758	1.0955	1.0467
No log	4.1231	268	1.0666	0.5538	1.0666	1.0328
No log	4.1538	270	1.2444	0.5303	1.2444	1.1155
No log	4.1846	272	1.4956	0.4	1.4956	1.2229
No log	4.2154	274	1.4902	0.4328	1.4902	1.2207
No log	4.2462	276	1.3532	0.5	1.3532	1.1633
No log	4.2769	278	1.2560	0.5303	1.2560	1.1207
No log	4.3077	280	1.3083	0.5224	1.3083	1.1438
No log	4.3385	282	1.5028	0.4593	1.5028	1.2259
No log	4.3692	284	1.5707	0.4	1.5707	1.2533
No log	4.4	286	1.4268	0.4812	1.4268	1.1945
No log	4.4308	288	1.2038	0.5426	1.2038	1.0972
No log	4.4615	290	1.0585	0.5625	1.0585	1.0288
No log	4.4923	292	1.0443	0.5649	1.0443	1.0219
No log	4.5231	294	1.2765	0.5333	1.2765	1.1298
No log	4.5538	296	1.5558	0.4429	1.5558	1.2473
No log	4.5846	298	1.8177	0.2837	1.8177	1.3482
No log	4.6154	300	1.8877	0.2113	1.8877	1.3740
No log	4.6462	302	1.7890	0.3000	1.7890	1.3376
No log	4.6769	304	1.4862	0.4672	1.4862	1.2191
No log	4.7077	306	1.3763	0.5455	1.3763	1.1731
No log	4.7385	308	1.4372	0.4706	1.4372	1.1988
No log	4.7692	310	1.4954	0.4412	1.4954	1.2229
No log	4.8	312	1.6530	0.4058	1.6530	1.2857
No log	4.8308	314	1.5639	0.4380	1.5639	1.2506
No log	4.8615	316	1.5276	0.4412	1.5276	1.2360
No log	4.8923	318	1.2444	0.5303	1.2444	1.1155
No log	4.9231	320	1.2315	0.5191	1.2315	1.1097
No log	4.9538	322	1.3779	0.4776	1.3779	1.1738
No log	4.9846	324	1.3543	0.4812	1.3543	1.1637
No log	5.0154	326	1.3654	0.4812	1.3654	1.1685
No log	5.0462	328	1.3484	0.5	1.3484	1.1612
No log	5.0769	330	1.2479	0.5263	1.2479	1.1171
No log	5.1077	332	1.2605	0.5522	1.2605	1.1227
No log	5.1385	334	1.2061	0.5522	1.2061	1.0982
No log	5.1692	336	1.2879	0.5481	1.2879	1.1348
No log	5.2	338	1.5491	0.4234	1.5491	1.2446
No log	5.2308	340	1.6743	0.3212	1.6743	1.2939
No log	5.2615	342	1.4576	0.4234	1.4576	1.2073
No log	5.2923	344	1.2655	0.5522	1.2655	1.1250
No log	5.3231	346	1.1930	0.5758	1.1930	1.0923
No log	5.3538	348	1.1710	0.5802	1.1710	1.0821
No log	5.3846	350	1.2818	0.5333	1.2818	1.1322
No log	5.4154	352	1.4846	0.4460	1.4846	1.2184
No log	5.4462	354	1.7006	0.4173	1.7006	1.3041
No log	5.4769	356	1.5434	0.4348	1.5434	1.2424
No log	5.5077	358	1.3644	0.5263	1.3644	1.1681
No log	5.5385	360	1.3764	0.5191	1.3764	1.1732
No log	5.5692	362	1.2950	0.5271	1.2950	1.1380
No log	5.6	364	1.2120	0.5691	1.2120	1.1009
No log	5.6308	366	1.2126	0.5760	1.2126	1.1012
No log	5.6615	368	1.3042	0.5758	1.3042	1.1420
No log	5.6923	370	1.4313	0.4627	1.4313	1.1964
No log	5.7231	372	1.3663	0.4889	1.3663	1.1689
No log	5.7538	374	1.1838	0.5496	1.1838	1.0880
No log	5.7846	376	1.1010	0.5873	1.1010	1.0493
No log	5.8154	378	1.1196	0.5385	1.1196	1.0581
No log	5.8462	380	1.2289	0.5522	1.2289	1.1086
No log	5.8769	382	1.4424	0.4783	1.4424	1.2010
No log	5.9077	384	1.5381	0.4348	1.5381	1.2402
No log	5.9385	386	1.4707	0.4526	1.4707	1.2127
No log	5.9692	388	1.3317	0.5294	1.3317	1.1540
No log	6.0	390	1.1973	0.5606	1.1973	1.0942
No log	6.0308	392	1.2154	0.5522	1.2154	1.1024
No log	6.0615	394	1.2095	0.5564	1.2095	1.0998
No log	6.0923	396	1.2304	0.5075	1.2304	1.1093
No log	6.1231	398	1.1461	0.5344	1.1461	1.0705
No log	6.1538	400	1.1190	0.5606	1.1190	1.0578
No log	6.1846	402	1.0469	0.5802	1.0469	1.0232
No log	6.2154	404	1.2027	0.5333	1.2027	1.0967
No log	6.2462	406	1.3071	0.5294	1.3071	1.1433
No log	6.2769	408	1.5687	0.4593	1.5687	1.2525
No log	6.3077	410	1.7205	0.3478	1.7205	1.3117
No log	6.3385	412	1.6008	0.4511	1.6008	1.2652
No log	6.3692	414	1.2797	0.5113	1.2797	1.1312
No log	6.4	416	1.1655	0.5038	1.1655	1.0796
No log	6.4308	418	1.2237	0.4848	1.2237	1.1062
No log	6.4615	420	1.2480	0.4889	1.2480	1.1172
No log	6.4923	422	1.2136	0.5075	1.2136	1.1016
No log	6.5231	424	1.2122	0.5113	1.2122	1.1010
No log	6.5538	426	1.1768	0.5077	1.1768	1.0848
No log	6.5846	428	1.1024	0.5581	1.1024	1.0499
No log	6.6154	430	1.0732	0.5625	1.0732	1.0360
No log	6.6462	432	1.0355	0.5736	1.0355	1.0176
No log	6.6769	434	0.9924	0.5625	0.9924	0.9962
No log	6.7077	436	1.1094	0.5802	1.1094	1.0533
No log	6.7385	438	1.2314	0.5075	1.2314	1.1097
No log	6.7692	440	1.3816	0.4812	1.3816	1.1754
No log	6.8	442	1.4363	0.4776	1.4363	1.1985
No log	6.8308	444	1.4059	0.4812	1.4059	1.1857
No log	6.8615	446	1.3302	0.5075	1.3302	1.1533
No log	6.8923	448	1.2325	0.5606	1.2325	1.1102
No log	6.9231	450	1.2037	0.5649	1.2037	1.0971
No log	6.9538	452	1.2831	0.5649	1.2831	1.1328
No log	6.9846	454	1.4705	0.4211	1.4705	1.2127
No log	7.0154	456	1.5238	0.3910	1.5238	1.2344
No log	7.0462	458	1.4046	0.4615	1.4046	1.1852
No log	7.0769	460	1.2616	0.5116	1.2616	1.1232
No log	7.1077	462	1.1846	0.5649	1.1846	1.0884
No log	7.1385	464	1.1750	0.5606	1.1750	1.0840
No log	7.1692	466	1.3289	0.5430	1.3289	1.1528
No log	7.2	468	1.6328	0.4654	1.6328	1.2778
No log	7.2308	470	1.8516	0.3380	1.8516	1.3607
No log	7.2615	472	1.7256	0.3043	1.7256	1.3136
No log	7.2923	474	1.4177	0.4242	1.4177	1.1907
No log	7.3231	476	1.2162	0.5312	1.2162	1.1028
No log	7.3538	478	1.2153	0.5846	1.2153	1.1024
No log	7.3846	480	1.2923	0.5606	1.2923	1.1368
No log	7.4154	482	1.5040	0.4706	1.5040	1.2264
No log	7.4462	484	1.6206	0.4526	1.6206	1.2730
No log	7.4769	486	1.4821	0.5	1.4821	1.2174
No log	7.5077	488	1.2091	0.5564	1.2091	1.0996
No log	7.5385	490	1.0243	0.6047	1.0243	1.0121
No log	7.5692	492	1.0423	0.6047	1.0423	1.0209
No log	7.6	494	1.1160	0.6047	1.1160	1.0564
No log	7.6308	496	1.2559	0.5271	1.2559	1.1207
No log	7.6615	498	1.4080	0.4275	1.4080	1.1866
0.3934	7.6923	500	1.3807	0.4462	1.3807	1.1750
0.3934	7.7231	502	1.2494	0.5512	1.2494	1.1178
0.3934	7.7538	504	1.1669	0.5512	1.1669	1.0802
0.3934	7.7846	506	1.1432	0.5512	1.1432	1.0692
0.3934	7.8154	508	1.1829	0.5303	1.1829	1.0876
0.3934	7.8462	510	1.2813	0.4848	1.2813	1.1320
0.3934	7.8769	512	1.4081	0.4478	1.4081	1.1867
0.3934	7.9077	514	1.4529	0.4179	1.4529	1.2054
0.3934	7.9385	516	1.3430	0.4511	1.3430	1.1589
0.3934	7.9692	518	1.2649	0.4844	1.2649	1.1247
0.3934	8.0	520	1.2074	0.4839	1.2074	1.0988
0.3934	8.0308	522	1.2125	0.4715	1.2125	1.1011
0.3934	8.0615	524	1.2921	0.4444	1.2921	1.1367
0.3934	8.0923	526	1.3604	0.4186	1.3604	1.1664
0.3934	8.1231	528	1.4383	0.4122	1.4383	1.1993
0.3934	8.1538	530	1.4212	0.4211	1.4212	1.1921
0.3934	8.1846	532	1.4212	0.4478	1.4212	1.1921
0.3934	8.2154	534	1.5084	0.4265	1.5084	1.2282
0.3934	8.2462	536	1.7083	0.3913	1.7083	1.3070
0.3934	8.2769	538	1.6230	0.3971	1.6230	1.2740
0.3934	8.3077	540	1.5170	0.4	1.5170	1.2317
0.3934	8.3385	542	1.3608	0.5075	1.3608	1.1665
0.3934	8.3692	544	1.3552	0.4275	1.3552	1.1641
0.3934	8.4	546	1.3036	0.5	1.3036	1.1418
0.3934	8.4308	548	1.3163	0.4806	1.3163	1.1473
0.3934	8.4615	550	1.3574	0.4545	1.3574	1.1651
0.3934	8.4923	552	1.2829	0.4812	1.2829	1.1326
0.3934	8.5231	554	1.2775	0.5075	1.2775	1.1303
0.3934	8.5538	556	1.4552	0.4776	1.4552	1.2063
0.3934	8.5846	558	1.5118	0.4511	1.5118	1.2296
0.3934	8.6154	560	1.4376	0.4776	1.4376	1.1990
0.3934	8.6462	562	1.3132	0.5075	1.3132	1.1459
0.3934	8.6769	564	1.1345	0.6047	1.1345	1.0651
0.3934	8.7077	566	1.1217	0.5938	1.1217	1.0591
0.3934	8.7385	568	1.2134	0.5954	1.2134	1.1015
0.3934	8.7692	570	1.3941	0.5075	1.3941	1.1807
0.3934	8.8	572	1.5203	0.4328	1.5203	1.2330
0.3934	8.8308	574	1.4927	0.4511	1.4927	1.2217
0.3934	8.8615	576	1.6166	0.4060	1.6166	1.2715
0.3934	8.8923	578	1.6522	0.3731	1.6522	1.2854
0.3934	8.9231	580	1.4633	0.4776	1.4633	1.2097
0.3934	8.9538	582	1.3052	0.5263	1.3052	1.1425
0.3934	8.9846	584	1.2937	0.5263	1.2937	1.1374
0.3934	9.0154	586	1.1453	0.5606	1.1453	1.0702
0.3934	9.0462	588	1.0435	0.6	1.0435	1.0215
0.3934	9.0769	590	1.0967	0.5802	1.0967	1.0472
0.3934	9.1077	592	1.2162	0.5344	1.2162	1.1028
0.3934	9.1385	594	1.3188	0.5	1.3188	1.1484
0.3934	9.1692	596	1.2775	0.5077	1.2775	1.1302
0.3934	9.2	598	1.2781	0.5077	1.2781	1.1305
0.3934	9.2308	600	1.2140	0.5271	1.2140	1.1018
0.3934	9.2615	602	1.1711	0.5873	1.1711	1.0822
0.3934	9.2923	604	1.2190	0.5271	1.2190	1.1041
0.3934	9.3231	606	1.3385	0.5	1.3385	1.1569
0.3934	9.3538	608	1.3451	0.5	1.3451	1.1598
0.3934	9.3846	610	1.2692	0.5271	1.2692	1.1266
0.3934	9.4154	612	1.2219	0.5238	1.2219	1.1054
0.3934	9.4462	614	1.1819	0.5161	1.1819	1.0872
0.3934	9.4769	616	1.2350	0.5271	1.2350	1.1113
0.3934	9.5077	618	1.4296	0.4478	1.4296	1.1957
0.3934	9.5385	620	1.7291	0.3504	1.7291	1.3149
0.3934	9.5692	622	1.7824	0.2857	1.7824	1.3351
0.3934	9.6	624	1.7022	0.3824	1.7022	1.3047
0.3934	9.6308	626	1.5441	0.4	1.5441	1.2426
0.3934	9.6615	628	1.5601	0.4	1.5601	1.2490

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1