ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0733
• Qwk: 0.4174
• Mse: 1.0733
• Rmse: 1.0360

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0253	2	6.7620	0.0116	6.7620	2.6004
No log	0.0506	4	4.2295	0.0779	4.2295	2.0566
No log	0.0759	6	3.1256	0.0118	3.1256	1.7679
No log	0.1013	8	2.2349	0.0902	2.2349	1.4950
No log	0.1266	10	1.7167	0.1495	1.7167	1.3102
No log	0.1519	12	1.6625	0.2182	1.6625	1.2894
No log	0.1772	14	1.5742	0.2321	1.5742	1.2547
No log	0.2025	16	2.0986	0.2190	2.0986	1.4486
No log	0.2278	18	2.4620	0.12	2.4620	1.5691
No log	0.2532	20	2.0903	0.2628	2.0903	1.4458
No log	0.2785	22	1.6504	0.2609	1.6504	1.2847
No log	0.3038	24	1.5053	0.2182	1.5053	1.2269
No log	0.3291	26	1.4989	0.2162	1.4989	1.2243
No log	0.3544	28	1.5631	0.2414	1.5631	1.2502
No log	0.3797	30	1.5605	0.2857	1.5605	1.2492
No log	0.4051	32	1.7499	0.3944	1.7499	1.3228
No log	0.4304	34	1.9518	0.3975	1.9518	1.3971
No log	0.4557	36	1.4823	0.4507	1.4823	1.2175
No log	0.4810	38	1.2828	0.4	1.2828	1.1326
No log	0.5063	40	1.7959	0.125	1.7959	1.3401
No log	0.5316	42	1.4807	0.2832	1.4807	1.2168
No log	0.5570	44	1.1757	0.4262	1.1757	1.0843
No log	0.5823	46	1.2443	0.4496	1.2443	1.1155
No log	0.6076	48	1.5629	0.4539	1.5629	1.2502
No log	0.6329	50	1.5679	0.4030	1.5679	1.2521
No log	0.6582	52	1.6603	0.4296	1.6603	1.2885
No log	0.6835	54	1.3707	0.3934	1.3707	1.1708
No log	0.7089	56	1.2371	0.4068	1.2371	1.1123
No log	0.7342	58	1.2657	0.3243	1.2657	1.1250
No log	0.7595	60	1.2596	0.2936	1.2596	1.1223
No log	0.7848	62	1.1472	0.4444	1.1472	1.0711
No log	0.8101	64	1.1374	0.4724	1.1374	1.0665
No log	0.8354	66	1.1084	0.5373	1.1084	1.0528
No log	0.8608	68	1.0276	0.5985	1.0276	1.0137
No log	0.8861	70	1.0590	0.5714	1.0590	1.0291
No log	0.9114	72	1.1527	0.5397	1.1527	1.0736
No log	0.9367	74	1.1971	0.4915	1.1971	1.0941
No log	0.9620	76	1.0313	0.5512	1.0313	1.0155
No log	0.9873	78	1.2127	0.5735	1.2127	1.1012
No log	1.0127	80	1.6996	0.4444	1.6996	1.3037
No log	1.0380	82	1.6122	0.4636	1.6122	1.2697
No log	1.0633	84	1.2450	0.4844	1.2450	1.1158
No log	1.0886	86	1.2319	0.3571	1.2319	1.1099
No log	1.1139	88	1.5016	0.2056	1.5016	1.2254
No log	1.1392	90	1.7217	0.1121	1.7217	1.3121
No log	1.1646	92	1.5004	0.2056	1.5004	1.2249
No log	1.1899	94	1.2532	0.4103	1.2532	1.1195
No log	1.2152	96	1.1880	0.4878	1.1880	1.0899
No log	1.2405	98	1.0710	0.5323	1.0710	1.0349
No log	1.2658	100	1.0123	0.5210	1.0123	1.0061
No log	1.2911	102	0.9852	0.5854	0.9852	0.9926
No log	1.3165	104	0.9731	0.6129	0.9731	0.9865
No log	1.3418	106	0.9241	0.5968	0.9241	0.9613
No log	1.3671	108	0.9089	0.6299	0.9089	0.9533
No log	1.3924	110	0.9706	0.6567	0.9706	0.9852
No log	1.4177	112	0.9597	0.6519	0.9597	0.9796
No log	1.4430	114	0.9008	0.6094	0.9008	0.9491
No log	1.4684	116	0.8465	0.6567	0.8465	0.9200
No log	1.4937	118	0.7944	0.6857	0.7944	0.8913
No log	1.5190	120	0.7102	0.7324	0.7102	0.8427
No log	1.5443	122	0.9530	0.6111	0.9530	0.9762
No log	1.5696	124	1.0992	0.5694	1.0992	1.0484
No log	1.5949	126	0.9486	0.6174	0.9486	0.9740
No log	1.6203	128	0.8940	0.7059	0.8940	0.9455
No log	1.6456	130	0.9529	0.6577	0.9529	0.9762
No log	1.6709	132	1.1456	0.5734	1.1456	1.0703
No log	1.6962	134	1.5916	0.3852	1.5916	1.2616
No log	1.7215	136	1.5872	0.4091	1.5872	1.2598
No log	1.7468	138	1.2785	0.5113	1.2785	1.1307
No log	1.7722	140	1.0972	0.6047	1.0972	1.0475
No log	1.7975	142	1.1008	0.5246	1.1008	1.0492
No log	1.8228	144	1.1017	0.5574	1.1017	1.0496
No log	1.8481	146	1.1327	0.4833	1.1327	1.0643
No log	1.8734	148	1.1507	0.4390	1.1507	1.0727
No log	1.8987	150	1.2025	0.4724	1.2025	1.0966
No log	1.9241	152	1.1395	0.4516	1.1395	1.0675
No log	1.9494	154	1.0780	0.5645	1.0780	1.0383
No log	1.9747	156	1.0860	0.5600	1.0860	1.0421
No log	2.0	158	1.0566	0.5600	1.0566	1.0279
No log	2.0253	160	1.0308	0.56	1.0308	1.0153
No log	2.0506	162	1.1684	0.4806	1.1684	1.0809
No log	2.0759	164	1.1209	0.48	1.1209	1.0587
No log	2.1013	166	1.2273	0.5079	1.2273	1.1079
No log	2.1266	168	1.5351	0.4118	1.5351	1.2390
No log	2.1519	170	1.5139	0.4361	1.5139	1.2304
No log	2.1772	172	1.3017	0.4667	1.3017	1.1409
No log	2.2025	174	1.1956	0.3932	1.1956	1.0934
No log	2.2278	176	1.1633	0.4202	1.1633	1.0786
No log	2.2532	178	1.1197	0.5	1.1197	1.0582
No log	2.2785	180	1.2047	0.6047	1.2047	1.0976
No log	2.3038	182	1.1927	0.6	1.1927	1.0921
No log	2.3291	184	1.1520	0.6	1.1520	1.0733
No log	2.3544	186	1.0098	0.5645	1.0098	1.0049
No log	2.3797	188	0.9644	0.5781	0.9644	0.9820
No log	2.4051	190	1.0375	0.6466	1.0375	1.0186
No log	2.4304	192	1.1218	0.6165	1.1218	1.0592
No log	2.4557	194	1.1026	0.6277	1.1026	1.0500
No log	2.4810	196	1.0919	0.6087	1.0919	1.0450
No log	2.5063	198	1.2531	0.5294	1.2531	1.1194
No log	2.5316	200	1.2232	0.5333	1.2232	1.1060
No log	2.5570	202	1.0850	0.6094	1.0850	1.0417
No log	2.5823	204	0.9785	0.5625	0.9785	0.9892
No log	2.6076	206	1.0070	0.5484	1.0070	1.0035
No log	2.6329	208	1.0336	0.4333	1.0336	1.0167
No log	2.6582	210	1.0461	0.5	1.0461	1.0228
No log	2.6835	212	1.0617	0.5827	1.0617	1.0304
No log	2.7089	214	1.1830	0.5630	1.1830	1.0876
No log	2.7342	216	1.3554	0.4928	1.3554	1.1642
No log	2.7595	218	1.3497	0.4928	1.3497	1.1618
No log	2.7848	220	1.2934	0.4964	1.2934	1.1373
No log	2.8101	222	1.2636	0.5147	1.2636	1.1241
No log	2.8354	224	1.1109	0.5970	1.1109	1.0540
No log	2.8608	226	1.1012	0.5865	1.1012	1.0494
No log	2.8861	228	1.1675	0.5802	1.1675	1.0805
No log	2.9114	230	1.1404	0.5692	1.1404	1.0679
No log	2.9367	232	1.1081	0.5846	1.1081	1.0527
No log	2.9620	234	1.1426	0.6015	1.1426	1.0689
No log	2.9873	236	1.2949	0.5455	1.2949	1.1380
No log	3.0127	238	1.3539	0.5113	1.3539	1.1636
No log	3.0380	240	1.2417	0.5714	1.2417	1.1143
No log	3.0633	242	1.0893	0.5821	1.0893	1.0437
No log	3.0886	244	0.9660	0.6316	0.9660	0.9828
No log	3.1139	246	0.9978	0.6154	0.9978	0.9989
No log	3.1392	248	1.1090	0.5758	1.1090	1.0531
No log	3.1646	250	1.2551	0.5714	1.2551	1.1203
No log	3.1899	252	1.1578	0.5802	1.1578	1.0760
No log	3.2152	254	0.9935	0.5645	0.9935	0.9968
No log	3.2405	256	0.9489	0.5484	0.9489	0.9741
No log	3.2658	258	0.9324	0.5484	0.9324	0.9656
No log	3.2911	260	0.9453	0.5938	0.9453	0.9723
No log	3.3165	262	0.9357	0.6047	0.9357	0.9673
No log	3.3418	264	0.9338	0.6107	0.9338	0.9663
No log	3.3671	266	1.1461	0.5714	1.1461	1.0706
No log	3.3924	268	1.5053	0.4380	1.5053	1.2269
No log	3.4177	270	1.5131	0.4444	1.5131	1.2301
No log	3.4430	272	1.2936	0.5385	1.2936	1.1374
No log	3.4684	274	1.1101	0.5714	1.1101	1.0536
No log	3.4937	276	1.1010	0.5484	1.1010	1.0493
No log	3.5190	278	1.0859	0.5827	1.0859	1.0421
No log	3.5443	280	1.0518	0.5938	1.0518	1.0256
No log	3.5696	282	0.9431	0.5827	0.9431	0.9711
No log	3.5949	284	0.8994	0.5984	0.8994	0.9484
No log	3.6203	286	0.9533	0.6047	0.9533	0.9764
No log	3.6456	288	1.0528	0.5954	1.0528	1.0260
No log	3.6709	290	1.1350	0.5802	1.1350	1.0654
No log	3.6962	292	1.1740	0.5736	1.1740	1.0835
No log	3.7215	294	1.1237	0.5167	1.1237	1.0600
No log	3.7468	296	1.0967	0.5128	1.0967	1.0473
No log	3.7722	298	1.1015	0.5128	1.1015	1.0495
No log	3.7975	300	1.0705	0.5128	1.0705	1.0346
No log	3.8228	302	1.0350	0.4483	1.0350	1.0173
No log	3.8481	304	0.9794	0.5128	0.9794	0.9896
No log	3.8734	306	0.9759	0.5645	0.9759	0.9879
No log	3.8987	308	1.1255	0.5692	1.1255	1.0609
No log	3.9241	310	1.1582	0.5758	1.1582	1.0762
No log	3.9494	312	1.0459	0.5692	1.0459	1.0227
No log	3.9747	314	0.9559	0.5760	0.9559	0.9777
No log	4.0	316	0.9656	0.5760	0.9656	0.9827
No log	4.0253	318	1.0292	0.5827	1.0292	1.0145
No log	4.0506	320	1.1180	0.5736	1.1180	1.0574
No log	4.0759	322	1.0465	0.5528	1.0465	1.0230
No log	4.1013	324	0.9705	0.5620	0.9705	0.9851
No log	4.1266	326	0.9286	0.5455	0.9286	0.9637
No log	4.1519	328	0.9339	0.5738	0.9339	0.9664
No log	4.1772	330	1.0059	0.5669	1.0059	1.0029
No log	4.2025	332	1.1670	0.5758	1.1670	1.0803
No log	4.2278	334	1.2049	0.5714	1.2049	1.0977
No log	4.2532	336	1.0898	0.5758	1.0898	1.0439
No log	4.2785	338	0.9059	0.5968	0.9059	0.9518
No log	4.3038	340	0.8798	0.6515	0.8798	0.9380
No log	4.3291	342	0.9165	0.6466	0.9165	0.9574
No log	4.3544	344	0.9388	0.5210	0.9388	0.9689
No log	4.3797	346	1.0451	0.5378	1.0451	1.0223
No log	4.4051	348	1.1668	0.5484	1.1668	1.0802
No log	4.4304	350	1.2081	0.5354	1.2081	1.0992
No log	4.4557	352	1.1283	0.5366	1.1283	1.0622
No log	4.4810	354	1.0414	0.5410	1.0414	1.0205
No log	4.5063	356	1.0012	0.5254	1.0012	1.0006
No log	4.5316	358	0.9772	0.5378	0.9772	0.9885
No log	4.5570	360	0.9456	0.5124	0.9456	0.9724
No log	4.5823	362	1.0056	0.5984	1.0056	1.0028
No log	4.6076	364	1.1934	0.5303	1.1934	1.0924
No log	4.6329	366	1.2023	0.5303	1.2023	1.0965
No log	4.6582	368	1.0865	0.5760	1.0865	1.0423
No log	4.6835	370	1.0581	0.5124	1.0581	1.0286
No log	4.7089	372	1.0615	0.5210	1.0615	1.0303
No log	4.7342	374	1.0752	0.5124	1.0752	1.0369
No log	4.7595	376	1.1281	0.5827	1.1281	1.0621
No log	4.7848	378	1.3282	0.5414	1.3282	1.1525
No log	4.8101	380	1.5128	0.4412	1.5128	1.2300
No log	4.8354	382	1.4049	0.4672	1.4049	1.1853
No log	4.8608	384	1.0900	0.5714	1.0900	1.0440
No log	4.8861	386	0.8507	0.6047	0.8507	0.9223
No log	4.9114	388	0.8294	0.6107	0.8294	0.9107
No log	4.9367	390	0.8322	0.6047	0.8322	0.9122
No log	4.9620	392	0.8716	0.5873	0.8716	0.9336
No log	4.9873	394	0.8844	0.5854	0.8844	0.9404
No log	5.0127	396	0.8968	0.6032	0.8968	0.9470
No log	5.0380	398	0.9676	0.5827	0.9676	0.9837
No log	5.0633	400	0.9830	0.6032	0.9830	0.9915
No log	5.0886	402	1.0185	0.5854	1.0185	1.0092
No log	5.1139	404	1.0848	0.5968	1.0848	1.0415
No log	5.1392	406	1.1812	0.5827	1.1812	1.0868
No log	5.1646	408	1.3537	0.4741	1.3537	1.1635
No log	5.1899	410	1.4220	0.4478	1.4220	1.1925
No log	5.2152	412	1.3410	0.5	1.3410	1.1580
No log	5.2405	414	1.1471	0.5581	1.1471	1.0710
No log	5.2658	416	1.0060	0.6032	1.0060	1.0030
No log	5.2911	418	0.9588	0.6202	0.9588	0.9792
No log	5.3165	420	0.9876	0.6032	0.9876	0.9938
No log	5.3418	422	1.0353	0.5802	1.0353	1.0175
No log	5.3671	424	1.1918	0.5606	1.1918	1.0917
No log	5.3924	426	1.2943	0.5714	1.2943	1.1377
No log	5.4177	428	1.2754	0.5714	1.2754	1.1293
No log	5.4430	430	1.1311	0.5821	1.1311	1.0635
No log	5.4684	432	0.9175	0.5891	0.9175	0.9579
No log	5.4937	434	0.8590	0.5891	0.8590	0.9268
No log	5.5190	436	0.8523	0.6357	0.8523	0.9232
No log	5.5443	438	0.8698	0.6406	0.8698	0.9326
No log	5.5696	440	0.9156	0.608	0.9156	0.9569
No log	5.5949	442	1.0087	0.5984	1.0087	1.0044
No log	5.6203	444	1.0145	0.5984	1.0145	1.0072
No log	5.6456	446	1.0025	0.5984	1.0025	1.0012
No log	5.6709	448	1.0153	0.5984	1.0153	1.0076
No log	5.6962	450	0.9792	0.6032	0.9792	0.9895
No log	5.7215	452	1.0149	0.5984	1.0149	1.0074
No log	5.7468	454	1.1140	0.5984	1.1140	1.0555
No log	5.7722	456	1.2044	0.5781	1.2044	1.0975
No log	5.7975	458	1.2580	0.5538	1.2580	1.1216
No log	5.8228	460	1.2577	0.5538	1.2577	1.1215
No log	5.8481	462	1.1725	0.5736	1.1725	1.0828
No log	5.8734	464	1.1139	0.5781	1.1139	1.0554
No log	5.8987	466	1.0951	0.5512	1.0951	1.0465
No log	5.9241	468	1.1056	0.5781	1.1056	1.0515
No log	5.9494	470	1.1924	0.5538	1.1924	1.0920
No log	5.9747	472	1.2404	0.5538	1.2404	1.1137
No log	6.0	474	1.1882	0.56	1.1882	1.0900
No log	6.0253	476	1.1320	0.5620	1.1320	1.0640
No log	6.0506	478	1.1050	0.5378	1.1050	1.0512
No log	6.0759	480	1.0978	0.5254	1.0978	1.0478
No log	6.1013	482	1.1021	0.5378	1.1021	1.0498
No log	6.1266	484	1.1305	0.5691	1.1305	1.0633
No log	6.1519	486	1.1694	0.5691	1.1694	1.0814
No log	6.1772	488	1.2018	0.4348	1.2018	1.0963
No log	6.2025	490	1.2082	0.4211	1.2082	1.0992
No log	6.2278	492	1.1477	0.4655	1.1477	1.0713
No log	6.2532	494	1.1392	0.5760	1.1392	1.0673
No log	6.2785	496	1.2048	0.5581	1.2048	1.0977
No log	6.3038	498	1.2763	0.5692	1.2763	1.1297
0.4342	6.3291	500	1.2122	0.5968	1.2122	1.1010
0.4342	6.3544	502	1.1714	0.5574	1.1714	1.0823
0.4342	6.3797	504	1.1068	0.5620	1.1068	1.0520
0.4342	6.4051	506	1.0869	0.5210	1.0869	1.0425
0.4342	6.4304	508	1.0615	0.4915	1.0615	1.0303
0.4342	6.4557	510	1.0733	0.4174	1.0733	1.0360

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1