ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1563
• Qwk: 0.4035
• Mse: 1.1563
• Rmse: 1.0753

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	6.9801	0.0239	6.9801	2.6420
No log	0.4444	4	4.2868	0.0556	4.2868	2.0705
No log	0.6667	6	2.9437	0.0988	2.9437	1.7157
No log	0.8889	8	2.5521	0.1408	2.5521	1.5975
No log	1.1111	10	2.0280	0.0960	2.0280	1.4241
No log	1.3333	12	1.7055	0.2342	1.7055	1.3059
No log	1.5556	14	2.1370	0.0331	2.1370	1.4618
No log	1.7778	16	3.0403	0.0	3.0403	1.7436
No log	2.0	18	3.3641	0.0129	3.3641	1.8341
No log	2.2222	20	2.9426	0.0	2.9426	1.7154
No log	2.4444	22	2.5259	-0.0548	2.5259	1.5893
No log	2.6667	24	2.1485	0.0645	2.1485	1.4658
No log	2.8889	26	1.9601	0.1802	1.9601	1.4000
No log	3.1111	28	1.8542	0.2143	1.8542	1.3617
No log	3.3333	30	1.7580	0.2143	1.7580	1.3259
No log	3.5556	32	1.9269	0.2542	1.9269	1.3881
No log	3.7778	34	2.0208	0.1290	2.0208	1.4215
No log	4.0	36	2.1341	0.2059	2.1341	1.4609
No log	4.2222	38	2.3703	0.1806	2.3703	1.5396
No log	4.4444	40	2.3804	0.1656	2.3804	1.5428
No log	4.6667	42	1.8794	0.3721	1.8794	1.3709
No log	4.8889	44	1.5723	0.3077	1.5723	1.2539
No log	5.1111	46	1.4067	0.2301	1.4067	1.1861
No log	5.3333	48	1.3491	0.3103	1.3491	1.1615
No log	5.5556	50	1.2916	0.3833	1.2916	1.1365
No log	5.7778	52	1.4216	0.4390	1.4216	1.1923
No log	6.0	54	1.4028	0.4480	1.4028	1.1844
No log	6.2222	56	1.3143	0.3833	1.3143	1.1464
No log	6.4444	58	1.4373	0.4103	1.4373	1.1989
No log	6.6667	60	1.3225	0.4628	1.3225	1.1500
No log	6.8889	62	1.2920	0.4918	1.2920	1.1367
No log	7.1111	64	1.3200	0.4355	1.3200	1.1489
No log	7.3333	66	1.3902	0.4409	1.3902	1.1791
No log	7.5556	68	1.3141	0.5	1.3141	1.1464
No log	7.7778	70	1.3491	0.5039	1.3491	1.1615
No log	8.0	72	1.4007	0.4848	1.4007	1.1835
No log	8.2222	74	1.6011	0.3307	1.6011	1.2654
No log	8.4444	76	1.6018	0.3333	1.6018	1.2656
No log	8.6667	78	1.3755	0.4094	1.3755	1.1728
No log	8.8889	80	1.3807	0.3710	1.3807	1.1750
No log	9.1111	82	1.3552	0.4375	1.3552	1.1641
No log	9.3333	84	1.2485	0.5147	1.2485	1.1174
No log	9.5556	86	1.3816	0.4320	1.3816	1.1754
No log	9.7778	88	1.2749	0.4615	1.2749	1.1291
No log	10.0	90	1.1743	0.5037	1.1743	1.0837
No log	10.2222	92	1.1476	0.5038	1.1476	1.0713
No log	10.4444	94	1.1035	0.48	1.1035	1.0505
No log	10.6667	96	1.1084	0.5	1.1084	1.0528
No log	10.8889	98	1.1115	0.5385	1.1115	1.0543
No log	11.1111	100	1.1684	0.5630	1.1684	1.0809
No log	11.3333	102	1.1034	0.5231	1.1034	1.0504
No log	11.5556	104	1.0674	0.5238	1.0674	1.0332
No log	11.7778	106	1.0877	0.4553	1.0877	1.0429
No log	12.0	108	1.1341	0.4839	1.1341	1.0649
No log	12.2222	110	1.2394	0.4839	1.2394	1.1133
No log	12.4444	112	1.3080	0.4878	1.3080	1.1437
No log	12.6667	114	1.3295	0.4878	1.3295	1.1531
No log	12.8889	116	1.3858	0.4262	1.3858	1.1772
No log	13.1111	118	1.3792	0.4132	1.3792	1.1744
No log	13.3333	120	1.2922	0.4370	1.2922	1.1368
No log	13.5556	122	1.2678	0.4426	1.2678	1.1260
No log	13.7778	124	1.2839	0.4677	1.2839	1.1331
No log	14.0	126	1.2216	0.3652	1.2216	1.1052
No log	14.2222	128	1.3495	0.4603	1.3495	1.1617
No log	14.4444	130	1.7384	0.3556	1.7384	1.3185
No log	14.6667	132	1.7662	0.3382	1.7662	1.3290
No log	14.8889	134	1.4729	0.3817	1.4729	1.2136
No log	15.1111	136	1.2240	0.4138	1.2240	1.1063
No log	15.3333	138	1.2252	0.4370	1.2252	1.1069
No log	15.5556	140	1.2116	0.4	1.2116	1.1007
No log	15.7778	142	1.2601	0.4333	1.2601	1.1225
No log	16.0	144	1.3277	0.5	1.3277	1.1522
No log	16.2222	146	1.2217	0.4844	1.2217	1.1053
No log	16.4444	148	1.1129	0.4667	1.1129	1.0549
No log	16.6667	150	1.1612	0.4959	1.1612	1.0776
No log	16.8889	152	1.2079	0.4959	1.2079	1.0991
No log	17.1111	154	1.2366	0.4667	1.2366	1.1120
No log	17.3333	156	1.1483	0.4874	1.1483	1.0716
No log	17.5556	158	1.1205	0.5	1.1205	1.0586
No log	17.7778	160	1.1607	0.528	1.1607	1.0773
No log	18.0	162	1.3352	0.4580	1.3352	1.1555
No log	18.2222	164	1.3985	0.4615	1.3985	1.1826
No log	18.4444	166	1.2818	0.5238	1.2818	1.1322
No log	18.6667	168	1.1277	0.5124	1.1277	1.0619
No log	18.8889	170	1.0770	0.4874	1.0770	1.0378
No log	19.1111	172	1.1077	0.5082	1.1077	1.0525
No log	19.3333	174	1.2271	0.4921	1.2271	1.1077
No log	19.5556	176	1.3428	0.5039	1.3428	1.1588
No log	19.7778	178	1.3587	0.512	1.3587	1.1656
No log	20.0	180	1.2904	0.4262	1.2904	1.1359
No log	20.2222	182	1.2907	0.4500	1.2907	1.1361
No log	20.4444	184	1.3784	0.4839	1.3784	1.1740
No log	20.6667	186	1.3795	0.4769	1.3795	1.1745
No log	20.8889	188	1.2969	0.4806	1.2969	1.1388
No log	21.1111	190	1.2136	0.5161	1.2136	1.1017
No log	21.3333	192	1.1313	0.5556	1.1313	1.0636
No log	21.5556	194	1.1219	0.5041	1.1219	1.0592
No log	21.7778	196	1.0657	0.5827	1.0657	1.0323
No log	22.0	198	1.1003	0.5556	1.1003	1.0490
No log	22.2222	200	1.0635	0.5512	1.0635	1.0313
No log	22.4444	202	1.0615	0.6047	1.0615	1.0303
No log	22.6667	204	1.0603	0.5484	1.0603	1.0297
No log	22.8889	206	1.1153	0.5455	1.1153	1.0561
No log	23.1111	208	1.1529	0.5333	1.1529	1.0737
No log	23.3333	210	1.2056	0.5333	1.2056	1.0980
No log	23.5556	212	1.1700	0.5124	1.1700	1.0817
No log	23.7778	214	1.1185	0.4874	1.1185	1.0576
No log	24.0	216	1.1303	0.4706	1.1303	1.0631
No log	24.2222	218	1.1686	0.4407	1.1686	1.0810
No log	24.4444	220	1.2285	0.4746	1.2285	1.1084
No log	24.6667	222	1.3071	0.5500	1.3071	1.1433
No log	24.8889	224	1.3213	0.5210	1.3213	1.1495
No log	25.1111	226	1.2853	0.4874	1.2853	1.1337
No log	25.3333	228	1.2544	0.4746	1.2544	1.1200
No log	25.5556	230	1.2435	0.4959	1.2435	1.1151
No log	25.7778	232	1.2155	0.5	1.2155	1.1025
No log	26.0	234	1.2072	0.5625	1.2072	1.0987
No log	26.2222	236	1.1753	0.5354	1.1753	1.0841
No log	26.4444	238	1.1531	0.4793	1.1531	1.0738
No log	26.6667	240	1.1518	0.4538	1.1518	1.0732
No log	26.8889	242	1.1403	0.4706	1.1403	1.0679
No log	27.1111	244	1.1600	0.4667	1.1600	1.0770
No log	27.3333	246	1.2458	0.4874	1.2458	1.1162
No log	27.5556	248	1.2843	0.4706	1.2843	1.1333
No log	27.7778	250	1.3094	0.5	1.3094	1.1443
No log	28.0	252	1.2442	0.5455	1.2442	1.1154
No log	28.2222	254	1.1959	0.5714	1.1959	1.0936
No log	28.4444	256	1.2289	0.5496	1.2289	1.1085
No log	28.6667	258	1.3133	0.5113	1.3133	1.1460
No log	28.8889	260	1.4042	0.4776	1.4042	1.1850
No log	29.1111	262	1.3808	0.5113	1.3808	1.1751
No log	29.3333	264	1.3059	0.512	1.3059	1.1428
No log	29.5556	266	1.2244	0.4874	1.2244	1.1065
No log	29.7778	268	1.1461	0.4500	1.1461	1.0706
No log	30.0	270	1.0529	0.5366	1.0529	1.0261
No log	30.2222	272	1.0035	0.6466	1.0035	1.0017
No log	30.4444	274	1.0021	0.6471	1.0021	1.0010
No log	30.6667	276	1.0960	0.5909	1.0960	1.0469
No log	30.8889	278	1.1258	0.5909	1.1258	1.0611
No log	31.1111	280	1.1845	0.5846	1.1845	1.0883
No log	31.3333	282	1.1261	0.6015	1.1261	1.0612
No log	31.5556	284	1.0404	0.56	1.0404	1.0200
No log	31.7778	286	1.0230	0.4407	1.0230	1.0114
No log	32.0	288	1.0140	0.4576	1.0140	1.0070
No log	32.2222	290	0.9973	0.4874	0.9973	0.9986
No log	32.4444	292	1.0570	0.6406	1.0570	1.0281
No log	32.6667	294	1.2100	0.5469	1.2100	1.1000
No log	32.8889	296	1.2500	0.5197	1.2500	1.1180
No log	33.1111	298	1.1479	0.5649	1.1479	1.0714
No log	33.3333	300	1.0649	0.6562	1.0649	1.0320
No log	33.5556	302	1.0503	0.5082	1.0503	1.0248
No log	33.7778	304	1.0746	0.3652	1.0746	1.0367
No log	34.0	306	1.0667	0.3966	1.0667	1.0328
No log	34.2222	308	1.0676	0.56	1.0676	1.0333
No log	34.4444	310	1.1353	0.5891	1.1353	1.0655
No log	34.6667	312	1.2699	0.5455	1.2699	1.1269
No log	34.8889	314	1.3917	0.4962	1.3917	1.1797
No log	35.1111	316	1.3807	0.4962	1.3807	1.1750
No log	35.3333	318	1.2965	0.5414	1.2965	1.1386
No log	35.5556	320	1.2995	0.5414	1.2995	1.1400
No log	35.7778	322	1.2639	0.5303	1.2639	1.1242
No log	36.0	324	1.2849	0.5344	1.2849	1.1335
No log	36.2222	326	1.3395	0.5385	1.3395	1.1574
No log	36.4444	328	1.4339	0.5077	1.4339	1.1974
No log	36.6667	330	1.4112	0.4806	1.4112	1.1880
No log	36.8889	332	1.3496	0.5191	1.3496	1.1617
No log	37.1111	334	1.2326	0.5538	1.2326	1.1102
No log	37.3333	336	1.1555	0.512	1.1555	1.0749
No log	37.5556	338	1.1919	0.5354	1.1919	1.0918
No log	37.7778	340	1.2449	0.5354	1.2449	1.1157
No log	38.0	342	1.2982	0.5312	1.2982	1.1394
No log	38.2222	344	1.3517	0.4603	1.3517	1.1626
No log	38.4444	346	1.4589	0.4286	1.4589	1.2079
No log	38.6667	348	1.4732	0.4286	1.4732	1.2138
No log	38.8889	350	1.4171	0.4286	1.4171	1.1904
No log	39.1111	352	1.3066	0.4882	1.3066	1.1431
No log	39.3333	354	1.1900	0.5079	1.1900	1.0909
No log	39.5556	356	1.1162	0.5625	1.1162	1.0565
No log	39.7778	358	1.0810	0.5469	1.0810	1.0397
No log	40.0	360	1.1095	0.5426	1.1095	1.0533
No log	40.2222	362	1.2443	0.5	1.2443	1.1155
No log	40.4444	364	1.4442	0.4127	1.4442	1.2018
No log	40.6667	366	1.5139	0.3840	1.5139	1.2304
No log	40.8889	368	1.4139	0.4426	1.4139	1.1891
No log	41.1111	370	1.2968	0.5167	1.2968	1.1388
No log	41.3333	372	1.2485	0.5	1.2485	1.1174
No log	41.5556	374	1.2560	0.5041	1.2560	1.1207
No log	41.7778	376	1.3034	0.5041	1.3034	1.1417
No log	42.0	378	1.3095	0.4839	1.3095	1.1444
No log	42.2222	380	1.2916	0.5082	1.2916	1.1365
No log	42.4444	382	1.2698	0.5082	1.2698	1.1268
No log	42.6667	384	1.2734	0.4833	1.2734	1.1285
No log	42.8889	386	1.2699	0.4874	1.2699	1.1269
No log	43.1111	388	1.2453	0.4833	1.2453	1.1159
No log	43.3333	390	1.2403	0.4833	1.2403	1.1137
No log	43.5556	392	1.2640	0.5082	1.2640	1.1243
No log	43.7778	394	1.2579	0.4793	1.2579	1.1216
No log	44.0	396	1.2307	0.5124	1.2307	1.1094
No log	44.2222	398	1.2403	0.5124	1.2403	1.1137
No log	44.4444	400	1.2323	0.4786	1.2323	1.1101
No log	44.6667	402	1.2253	0.3423	1.2253	1.1069
No log	44.8889	404	1.2044	0.4348	1.2044	1.0975
No log	45.1111	406	1.2032	0.4655	1.2032	1.0969
No log	45.3333	408	1.2176	0.4615	1.2176	1.1034
No log	45.5556	410	1.2113	0.5806	1.2113	1.1006
No log	45.7778	412	1.2134	0.5873	1.2134	1.1015
No log	46.0	414	1.2382	0.5846	1.2382	1.1127
No log	46.2222	416	1.2716	0.5846	1.2716	1.1276
No log	46.4444	418	1.2657	0.5984	1.2657	1.1250
No log	46.6667	420	1.2217	0.5	1.2217	1.1053
No log	46.8889	422	1.2055	0.4746	1.2055	1.0980
No log	47.1111	424	1.1976	0.4483	1.1976	1.0944
No log	47.3333	426	1.2017	0.4348	1.2017	1.0962
No log	47.5556	428	1.2073	0.5289	1.2073	1.0988
No log	47.7778	430	1.2183	0.5760	1.2183	1.1038
No log	48.0	432	1.2156	0.5714	1.2156	1.1026
No log	48.2222	434	1.1786	0.5484	1.1786	1.0856
No log	48.4444	436	1.1372	0.5920	1.1372	1.0664
No log	48.6667	438	1.1330	0.5873	1.1330	1.0644
No log	48.8889	440	1.1212	0.56	1.1212	1.0589
No log	49.1111	442	1.1326	0.5082	1.1326	1.0642
No log	49.3333	444	1.1803	0.5366	1.1803	1.0864
No log	49.5556	446	1.2005	0.5082	1.2005	1.0957
No log	49.7778	448	1.1828	0.5082	1.1828	1.0876
No log	50.0	450	1.1560	0.5082	1.1560	1.0752
No log	50.2222	452	1.1391	0.5082	1.1391	1.0673
No log	50.4444	454	1.1108	0.5528	1.1108	1.0539
No log	50.6667	456	1.1338	0.5645	1.1338	1.0648
No log	50.8889	458	1.1489	0.56	1.1489	1.0719
No log	51.1111	460	1.1998	0.5669	1.1998	1.0954
No log	51.3333	462	1.2441	0.5385	1.2441	1.1154
No log	51.5556	464	1.2014	0.5669	1.2014	1.0961
No log	51.7778	466	1.1536	0.4959	1.1536	1.0741
No log	52.0	468	1.1545	0.5167	1.1545	1.0745
No log	52.2222	470	1.1423	0.5	1.1423	1.0688
No log	52.4444	472	1.1308	0.5	1.1308	1.0634
No log	52.6667	474	1.1519	0.5246	1.1519	1.0733
No log	52.8889	476	1.1942	0.5	1.1942	1.0928
No log	53.1111	478	1.1843	0.5891	1.1843	1.0882
No log	53.3333	480	1.1634	0.6107	1.1634	1.0786
No log	53.5556	482	1.1540	0.6107	1.1540	1.0742
No log	53.7778	484	1.1272	0.6	1.1272	1.0617
No log	54.0	486	1.0953	0.5574	1.0953	1.0466
No log	54.2222	488	1.0781	0.4915	1.0781	1.0383
No log	54.4444	490	1.0989	0.4615	1.0989	1.0483
No log	54.6667	492	1.1197	0.4615	1.1197	1.0582
No log	54.8889	494	1.1347	0.4615	1.1347	1.0652
No log	55.1111	496	1.1605	0.4746	1.1605	1.0773
No log	55.3333	498	1.1845	0.4874	1.1845	1.0883
0.2815	55.5556	500	1.2418	0.5484	1.2418	1.1144
0.2815	55.7778	502	1.2818	0.5079	1.2818	1.1322
0.2815	56.0	504	1.2809	0.5354	1.2809	1.1318
0.2815	56.2222	506	1.2334	0.5323	1.2334	1.1106
0.2815	56.4444	508	1.1808	0.4444	1.1808	1.0867
0.2815	56.6667	510	1.1563	0.4035	1.1563	1.0753

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1