ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3452
• Qwk: 0.4961
• Mse: 1.3452
• Rmse: 1.1598

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1429	2	6.7714	0.0242	6.7714	2.6022
No log	0.2857	4	4.8482	0.0530	4.8482	2.2019
No log	0.4286	6	3.2535	0.0585	3.2535	1.8037
No log	0.5714	8	3.5679	-0.0430	3.5679	1.8889
No log	0.7143	10	3.0556	-0.0265	3.0556	1.7480
No log	0.8571	12	1.9324	0.0909	1.9324	1.3901
No log	1.0	14	1.8533	0.1698	1.8533	1.3613
No log	1.1429	16	2.0799	0.2222	2.0799	1.4422
No log	1.2857	18	2.1477	0.2149	2.1477	1.4655
No log	1.4286	20	2.3993	-0.0576	2.3993	1.5490
No log	1.5714	22	2.3037	0.0148	2.3037	1.5178
No log	1.7143	24	2.1713	0.1260	2.1713	1.4735
No log	1.8571	26	2.1392	0.1587	2.1392	1.4626
No log	2.0	28	2.0057	0.1724	2.0057	1.4162
No log	2.1429	30	1.8985	0.2056	1.8985	1.3779
No log	2.2857	32	1.8460	0.2075	1.8460	1.3587
No log	2.4286	34	1.7978	0.2075	1.7978	1.3408
No log	2.5714	36	1.7815	0.2407	1.7815	1.3347
No log	2.7143	38	1.8054	0.2301	1.8054	1.3437
No log	2.8571	40	1.9207	0.3252	1.9207	1.3859
No log	3.0	42	2.0817	0.1654	2.0817	1.4428
No log	3.1429	44	1.8796	0.2742	1.8796	1.3710
No log	3.2857	46	1.4943	0.2342	1.4943	1.2224
No log	3.4286	48	1.5044	0.3248	1.5044	1.2265
No log	3.5714	50	1.5990	0.2393	1.5990	1.2645
No log	3.7143	52	1.5694	0.2261	1.5694	1.2528
No log	3.8571	54	1.5477	0.25	1.5477	1.2441
No log	4.0	56	1.7092	0.3780	1.7092	1.3073
No log	4.1429	58	1.7791	0.4	1.7791	1.3338
No log	4.2857	60	1.6968	0.3040	1.6968	1.3026
No log	4.4286	62	2.1358	0.0328	2.1358	1.4615
No log	4.5714	64	2.2642	-0.0172	2.2642	1.5047
No log	4.7143	66	1.7255	0.2301	1.7255	1.3136
No log	4.8571	68	1.3324	0.4310	1.3324	1.1543
No log	5.0	70	1.1947	0.4874	1.1947	1.0930
No log	5.1429	72	1.1962	0.4746	1.1962	1.0937
No log	5.2857	74	1.2611	0.4786	1.2611	1.1230
No log	5.4286	76	1.3148	0.4348	1.3148	1.1466
No log	5.5714	78	1.3532	0.4628	1.3532	1.1633
No log	5.7143	80	1.4299	0.3871	1.4299	1.1958
No log	5.8571	82	1.3814	0.3871	1.3814	1.1753
No log	6.0	84	1.3337	0.4310	1.3337	1.1549
No log	6.1429	86	1.3767	0.4202	1.3767	1.1733
No log	6.2857	88	1.6029	0.3306	1.6029	1.2661
No log	6.4286	90	1.7917	0.3140	1.7917	1.3386
No log	6.5714	92	1.7482	0.3077	1.7482	1.3222
No log	6.7143	94	1.5048	0.3590	1.5048	1.2267
No log	6.8571	96	1.3394	0.4068	1.3394	1.1573
No log	7.0	98	1.2895	0.4590	1.2895	1.1356
No log	7.1429	100	1.3381	0.4531	1.3381	1.1568
No log	7.2857	102	1.6325	0.3433	1.6325	1.2777
No log	7.4286	104	1.9169	0.2270	1.9169	1.3845
No log	7.5714	106	1.9370	0.2535	1.9370	1.3918
No log	7.7143	108	1.6609	0.3885	1.6609	1.2888
No log	7.8571	110	1.3992	0.4429	1.3992	1.1829
No log	8.0	112	1.4245	0.4173	1.4245	1.1935
No log	8.1429	114	1.6681	0.3546	1.6681	1.2916
No log	8.2857	116	1.5966	0.3885	1.5966	1.2636
No log	8.4286	118	1.3795	0.5185	1.3795	1.1745
No log	8.5714	120	1.3325	0.5224	1.3324	1.1543
No log	8.7143	122	1.3323	0.5036	1.3323	1.1543
No log	8.8571	124	1.4212	0.4348	1.4212	1.1921
No log	9.0	126	1.2656	0.5401	1.2656	1.1250
No log	9.1429	128	1.1381	0.5865	1.1381	1.0668
No log	9.2857	130	1.1297	0.5954	1.1297	1.0629
No log	9.4286	132	1.1550	0.5909	1.1550	1.0747
No log	9.5714	134	1.2091	0.5507	1.2091	1.0996
No log	9.7143	136	1.2415	0.5507	1.2415	1.1142
No log	9.8571	138	1.3214	0.4857	1.3214	1.1495
No log	10.0	140	1.5196	0.3286	1.5196	1.2327
No log	10.1429	142	1.4259	0.4	1.4259	1.1941
No log	10.2857	144	1.2118	0.56	1.2118	1.1008
No log	10.4286	146	1.2193	0.3866	1.2193	1.1042
No log	10.5714	148	1.1803	0.4167	1.1803	1.0864
No log	10.7143	150	1.1450	0.5669	1.1450	1.0700
No log	10.8571	152	1.2934	0.5414	1.2934	1.1373
No log	11.0	154	1.6284	0.3714	1.6284	1.2761
No log	11.1429	156	1.7977	0.2482	1.7977	1.3408
No log	11.2857	158	1.7272	0.3333	1.7272	1.3142
No log	11.4286	160	1.4586	0.4460	1.4586	1.2077
No log	11.5714	162	1.1913	0.5606	1.1913	1.0915
No log	11.7143	164	1.1310	0.5496	1.1310	1.0635
No log	11.8571	166	1.1433	0.5564	1.1433	1.0693
No log	12.0	168	1.2181	0.5333	1.2181	1.1037
No log	12.1429	170	1.4416	0.4429	1.4416	1.2007
No log	12.2857	172	1.3592	0.5143	1.3592	1.1658
No log	12.4286	174	1.2317	0.5333	1.2317	1.1098
No log	12.5714	176	1.1473	0.5481	1.1473	1.0711
No log	12.7143	178	1.2038	0.5414	1.2038	1.0972
No log	12.8571	180	1.4007	0.4853	1.4007	1.1835
No log	13.0	182	1.5403	0.4783	1.5403	1.2411
No log	13.1429	184	1.5150	0.4964	1.5150	1.2308
No log	13.2857	186	1.3569	0.5037	1.3569	1.1649
No log	13.4286	188	1.2668	0.5303	1.2668	1.1255
No log	13.5714	190	1.1957	0.5455	1.1957	1.0935
No log	13.7143	192	1.1055	0.5496	1.1055	1.0514
No log	13.8571	194	1.1468	0.5496	1.1468	1.0709
No log	14.0	196	1.2812	0.5714	1.2812	1.1319
No log	14.1429	198	1.3838	0.4706	1.3838	1.1763
No log	14.2857	200	1.2768	0.5714	1.2768	1.1300
No log	14.4286	202	1.1517	0.5606	1.1517	1.0732
No log	14.5714	204	1.0589	0.5891	1.0589	1.0290
No log	14.7143	206	1.0784	0.5538	1.0784	1.0384
No log	14.8571	208	1.2155	0.5714	1.2155	1.1025
No log	15.0	210	1.3151	0.5333	1.3151	1.1468
No log	15.1429	212	1.2940	0.5191	1.2940	1.1375
No log	15.2857	214	1.1940	0.5156	1.1940	1.0927
No log	15.4286	216	1.1825	0.4480	1.1825	1.0874
No log	15.5714	218	1.2167	0.5156	1.2167	1.1031
No log	15.7143	220	1.3110	0.5606	1.3110	1.1450
No log	15.8571	222	1.4827	0.4429	1.4827	1.2177
No log	16.0	224	1.5298	0.4113	1.5298	1.2368
No log	16.1429	226	1.4459	0.4604	1.4459	1.2025
No log	16.2857	228	1.2396	0.5865	1.2396	1.1134
No log	16.4286	230	1.0742	0.512	1.0742	1.0364
No log	16.5714	232	1.0379	0.5167	1.0379	1.0188
No log	16.7143	234	1.0414	0.5455	1.0414	1.0205
No log	16.8571	236	1.0912	0.5645	1.0912	1.0446
No log	17.0	238	1.1264	0.5426	1.1264	1.0613
No log	17.1429	240	1.1446	0.5385	1.1446	1.0699
No log	17.2857	242	1.1307	0.5496	1.1307	1.0633
No log	17.4286	244	1.1900	0.5606	1.1900	1.0909
No log	17.5714	246	1.2977	0.5714	1.2977	1.1392
No log	17.7143	248	1.3192	0.5714	1.3192	1.1486
No log	17.8571	250	1.2314	0.5649	1.2314	1.1097
No log	18.0	252	1.1401	0.5469	1.1401	1.0678
No log	18.1429	254	1.1453	0.5469	1.1453	1.0702
No log	18.2857	256	1.1703	0.5426	1.1703	1.0818
No log	18.4286	258	1.2359	0.5116	1.2359	1.1117
No log	18.5714	260	1.2775	0.5231	1.2775	1.1303
No log	18.7143	262	1.3764	0.5152	1.3764	1.1732
No log	18.8571	264	1.4596	0.5147	1.4596	1.2081
No log	19.0	266	1.4758	0.4783	1.4758	1.2148
No log	19.1429	268	1.3780	0.5333	1.3780	1.1739
No log	19.2857	270	1.2895	0.5344	1.2895	1.1356
No log	19.4286	272	1.2136	0.5606	1.2136	1.1017
No log	19.5714	274	1.1781	0.5496	1.1781	1.0854
No log	19.7143	276	1.1497	0.5581	1.1497	1.0722
No log	19.8571	278	1.1533	0.5581	1.1533	1.0739
No log	20.0	280	1.1588	0.5426	1.1588	1.0765
No log	20.1429	282	1.1571	0.5496	1.1571	1.0757
No log	20.2857	284	1.2070	0.5926	1.2070	1.0986
No log	20.4286	286	1.2063	0.5926	1.2063	1.0983
No log	20.5714	288	1.2551	0.5865	1.2551	1.1203
No log	20.7143	290	1.2437	0.5538	1.2437	1.1152
No log	20.8571	292	1.1898	0.5156	1.1898	1.0908
No log	21.0	294	1.2160	0.5156	1.2160	1.1027
No log	21.1429	296	1.2450	0.4667	1.2450	1.1158
No log	21.2857	298	1.2685	0.5042	1.2685	1.1263
No log	21.4286	300	1.2626	0.4696	1.2626	1.1237
No log	21.5714	302	1.2764	0.4655	1.2764	1.1298
No log	21.7143	304	1.2793	0.4793	1.2793	1.1311
No log	21.8571	306	1.3302	0.5496	1.3302	1.1533
No log	22.0	308	1.4064	0.5038	1.4064	1.1859
No log	22.1429	310	1.4420	0.4627	1.4420	1.2008
No log	22.2857	312	1.2771	0.5455	1.2771	1.1301
No log	22.4286	314	1.1091	0.5426	1.1091	1.0531
No log	22.5714	316	1.0535	0.576	1.0535	1.0264
No log	22.7143	318	1.0571	0.5984	1.0571	1.0281
No log	22.8571	320	1.1084	0.5827	1.1084	1.0528
No log	23.0	322	1.2018	0.5426	1.2018	1.0963
No log	23.1429	324	1.2723	0.5455	1.2723	1.1280
No log	23.2857	326	1.2598	0.5714	1.2598	1.1224
No log	23.4286	328	1.1734	0.5455	1.1734	1.0832
No log	23.5714	330	1.1374	0.5455	1.1374	1.0665
No log	23.7143	332	1.1336	0.5496	1.1336	1.0647
No log	23.8571	334	1.1528	0.5496	1.1528	1.0737
No log	24.0	336	1.1303	0.5827	1.1303	1.0631
No log	24.1429	338	1.1755	0.5806	1.1755	1.0842
No log	24.2857	340	1.2309	0.5238	1.2309	1.1094
No log	24.4286	342	1.2676	0.5385	1.2676	1.1259
No log	24.5714	344	1.2699	0.5714	1.2699	1.1269
No log	24.7143	346	1.2501	0.5970	1.2501	1.1181
No log	24.8571	348	1.2745	0.5778	1.2745	1.1290
No log	25.0	350	1.3272	0.5401	1.3272	1.1520
No log	25.1429	352	1.4061	0.4964	1.4061	1.1858
No log	25.2857	354	1.4055	0.5217	1.4055	1.1855
No log	25.4286	356	1.3432	0.5401	1.3432	1.1589
No log	25.5714	358	1.2603	0.5778	1.2603	1.1226
No log	25.7143	360	1.2183	0.5970	1.2183	1.1038
No log	25.8571	362	1.2057	0.5649	1.2057	1.0980
No log	26.0	364	1.2341	0.5538	1.2341	1.1109
No log	26.1429	366	1.2597	0.5538	1.2597	1.1223
No log	26.2857	368	1.2680	0.5538	1.2680	1.1260
No log	26.4286	370	1.2329	0.5426	1.2329	1.1104
No log	26.5714	372	1.2009	0.5426	1.2009	1.0959
No log	26.7143	374	1.1902	0.5496	1.1902	1.0910
No log	26.8571	376	1.1688	0.5455	1.1688	1.0811
No log	27.0	378	1.1515	0.5538	1.1515	1.0731
No log	27.1429	380	1.1765	0.5496	1.1765	1.0847
No log	27.2857	382	1.2541	0.5426	1.2541	1.1199
No log	27.4286	384	1.2918	0.5156	1.2918	1.1366
No log	27.5714	386	1.2859	0.528	1.2859	1.1340
No log	27.7143	388	1.2807	0.5246	1.2807	1.1317
No log	27.8571	390	1.2786	0.5246	1.2786	1.1308
No log	28.0	392	1.2796	0.5246	1.2796	1.1312
No log	28.1429	394	1.2968	0.5238	1.2968	1.1388
No log	28.2857	396	1.2814	0.5469	1.2814	1.1320
No log	28.4286	398	1.2329	0.5538	1.2329	1.1103
No log	28.5714	400	1.2133	0.5455	1.2133	1.1015
No log	28.7143	402	1.2557	0.5606	1.2557	1.1206
No log	28.8571	404	1.2305	0.5564	1.2305	1.1093
No log	29.0	406	1.2062	0.5564	1.2062	1.0983
No log	29.1429	408	1.1967	0.5564	1.1967	1.0939
No log	29.2857	410	1.2402	0.5606	1.2402	1.1136
No log	29.4286	412	1.2651	0.5426	1.2651	1.1248
No log	29.5714	414	1.2636	0.5469	1.2636	1.1241
No log	29.7143	416	1.2785	0.5238	1.2785	1.1307
No log	29.8571	418	1.2593	0.512	1.2593	1.1222
No log	30.0	420	1.2282	0.5041	1.2282	1.1082
No log	30.1429	422	1.1877	0.5082	1.1877	1.0898
No log	30.2857	424	1.1364	0.5366	1.1364	1.0660
No log	30.4286	426	1.1050	0.5312	1.1050	1.0512
No log	30.5714	428	1.1951	0.5538	1.1951	1.0932
No log	30.7143	430	1.3920	0.5	1.3920	1.1798
No log	30.8571	432	1.5115	0.4380	1.5115	1.2294
No log	31.0	434	1.5109	0.4380	1.5109	1.2292
No log	31.1429	436	1.4912	0.4380	1.4912	1.2211
No log	31.2857	438	1.3573	0.5263	1.3573	1.1650
No log	31.4286	440	1.2257	0.5496	1.2257	1.1071
No log	31.5714	442	1.1707	0.5469	1.1707	1.0820
No log	31.7143	444	1.1527	0.5827	1.1527	1.0736
No log	31.8571	446	1.1466	0.5873	1.1466	1.0708
No log	32.0	448	1.1472	0.5827	1.1472	1.0711
No log	32.1429	450	1.1547	0.5827	1.1547	1.0746
No log	32.2857	452	1.1507	0.5496	1.1507	1.0727
No log	32.4286	454	1.1680	0.5496	1.1680	1.0807
No log	32.5714	456	1.1598	0.5496	1.1598	1.0769
No log	32.7143	458	1.1935	0.5496	1.1935	1.0925
No log	32.8571	460	1.2258	0.5152	1.2258	1.1072
No log	33.0	462	1.2188	0.5496	1.2188	1.1040
No log	33.1429	464	1.2558	0.5113	1.2558	1.1206
No log	33.2857	466	1.2823	0.5224	1.2823	1.1324
No log	33.4286	468	1.2395	0.5481	1.2395	1.1133
No log	33.5714	470	1.2269	0.5481	1.2269	1.1077
No log	33.7143	472	1.2265	0.5564	1.2265	1.1075
No log	33.8571	474	1.1770	0.5512	1.1770	1.0849
No log	34.0	476	1.1591	0.5600	1.1591	1.0766
No log	34.1429	478	1.2239	0.5556	1.2239	1.1063
No log	34.2857	480	1.3194	0.4651	1.3194	1.1486
No log	34.4286	482	1.3954	0.4733	1.3954	1.1813
No log	34.5714	484	1.3735	0.4733	1.3735	1.1720
No log	34.7143	486	1.3059	0.4961	1.3059	1.1428
No log	34.8571	488	1.2600	0.4882	1.2600	1.1225
No log	35.0	490	1.2074	0.5512	1.2074	1.0988
No log	35.1429	492	1.1634	0.5600	1.1634	1.0786
No log	35.2857	494	1.1651	0.5512	1.1651	1.0794
No log	35.4286	496	1.1860	0.5156	1.1860	1.0891
No log	35.5714	498	1.2013	0.5426	1.2013	1.0961
0.3552	35.7143	500	1.2179	0.5156	1.2179	1.1036
0.3552	35.8571	502	1.2309	0.5271	1.2309	1.1095
0.3552	36.0	504	1.2285	0.5000	1.2285	1.1084
0.3552	36.1429	506	1.2250	0.5000	1.2250	1.1068
0.3552	36.2857	508	1.1927	0.5271	1.1927	1.0921
0.3552	36.4286	510	1.1657	0.5538	1.1657	1.0797
0.3552	36.5714	512	1.1562	0.5538	1.1562	1.0753
0.3552	36.7143	514	1.2121	0.5271	1.2121	1.1010
0.3552	36.8571	516	1.2751	0.5116	1.2751	1.1292
0.3552	37.0	518	1.3008	0.5038	1.3008	1.1405
0.3552	37.1429	520	1.2663	0.5038	1.2663	1.1253
0.3552	37.2857	522	1.2018	0.5496	1.2018	1.0962
0.3552	37.4286	524	1.1949	0.5496	1.1949	1.0931
0.3552	37.5714	526	1.2301	0.5231	1.2301	1.1091
0.3552	37.7143	528	1.2782	0.4923	1.2782	1.1306
0.3552	37.8571	530	1.3506	0.5113	1.3506	1.1621
0.3552	38.0	532	1.3576	0.5113	1.3576	1.1651
0.3552	38.1429	534	1.3145	0.4923	1.3145	1.1465
0.3552	38.2857	536	1.2867	0.5231	1.2867	1.1343
0.3552	38.4286	538	1.2592	0.5231	1.2592	1.1221
0.3552	38.5714	540	1.2243	0.4961	1.2243	1.1065
0.3552	38.7143	542	1.2289	0.4961	1.2289	1.1085
0.3552	38.8571	544	1.2485	0.4961	1.2485	1.1174
0.3552	39.0	546	1.2920	0.5116	1.2920	1.1366
0.3552	39.1429	548	1.3452	0.4961	1.3452	1.1598

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1