ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k4_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2406
• Qwk: 0.5018
• Mse: 1.2406
• Rmse: 1.1138

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	5.2550	-0.0020	5.2550	2.2924
No log	0.1905	4	3.2269	0.0461	3.2269	1.7964
No log	0.2857	6	2.0799	0.0255	2.0799	1.4422
No log	0.3810	8	1.5460	0.1352	1.5460	1.2434
No log	0.4762	10	1.4674	0.1208	1.4674	1.2114
No log	0.5714	12	1.7643	-0.0772	1.7643	1.3283
No log	0.6667	14	1.4056	0.0515	1.4056	1.1856
No log	0.7619	16	1.2628	0.1947	1.2628	1.1237
No log	0.8571	18	1.2874	0.2455	1.2874	1.1347
No log	0.9524	20	1.2339	0.2491	1.2339	1.1108
No log	1.0476	22	1.2112	0.2429	1.2112	1.1006
No log	1.1429	24	1.1834	0.2570	1.1834	1.0878
No log	1.2381	26	1.1347	0.2926	1.1347	1.0652
No log	1.3333	28	1.2572	0.2356	1.2572	1.1212
No log	1.4286	30	1.4647	0.1830	1.4647	1.2103
No log	1.5238	32	1.3244	0.2305	1.3244	1.1508
No log	1.6190	34	1.1275	0.3410	1.1275	1.0618
No log	1.7143	36	1.0760	0.2767	1.0760	1.0373
No log	1.8095	38	1.0864	0.3040	1.0864	1.0423
No log	1.9048	40	1.2220	0.2275	1.2220	1.1055
No log	2.0	42	1.3452	0.2036	1.3452	1.1598
No log	2.0952	44	1.4071	0.1303	1.4071	1.1862
No log	2.1905	46	1.2130	0.2367	1.2130	1.1013
No log	2.2857	48	1.0643	0.3692	1.0643	1.0316
No log	2.3810	50	1.0435	0.3935	1.0435	1.0215
No log	2.4762	52	1.0373	0.3691	1.0373	1.0185
No log	2.5714	54	1.0413	0.4032	1.0413	1.0205
No log	2.6667	56	1.0277	0.4249	1.0277	1.0138
No log	2.7619	58	1.0315	0.4304	1.0315	1.0156
No log	2.8571	60	1.0650	0.4294	1.0650	1.0320
No log	2.9524	62	1.1018	0.3638	1.1018	1.0497
No log	3.0476	64	1.0817	0.3573	1.0817	1.0401
No log	3.1429	66	1.0726	0.3667	1.0726	1.0357
No log	3.2381	68	1.0616	0.3684	1.0616	1.0303
No log	3.3333	70	1.1515	0.3837	1.1515	1.0731
No log	3.4286	72	1.1701	0.3816	1.1701	1.0817
No log	3.5238	74	1.1333	0.3743	1.1333	1.0646
No log	3.6190	76	1.1264	0.4419	1.1264	1.0613
No log	3.7143	78	1.1636	0.3745	1.1636	1.0787
No log	3.8095	80	1.2068	0.3002	1.2068	1.0985
No log	3.9048	82	1.2049	0.2722	1.2049	1.0977
No log	4.0	84	1.1330	0.3105	1.1330	1.0644
No log	4.0952	86	1.0060	0.4504	1.0060	1.0030
No log	4.1905	88	0.9472	0.4822	0.9472	0.9732
No log	4.2857	90	0.9385	0.4562	0.9385	0.9688
No log	4.3810	92	0.9757	0.4508	0.9757	0.9878
No log	4.4762	94	1.0390	0.4288	1.0390	1.0193
No log	4.5714	96	1.0921	0.4065	1.0921	1.0450
No log	4.6667	98	1.2559	0.4066	1.2559	1.1207
No log	4.7619	100	1.2986	0.3796	1.2986	1.1395
No log	4.8571	102	1.2061	0.4479	1.2061	1.0982
No log	4.9524	104	1.0086	0.5448	1.0086	1.0043
No log	5.0476	106	0.9684	0.5628	0.9684	0.9841
No log	5.1429	108	0.9825	0.5192	0.9825	0.9912
No log	5.2381	110	1.0814	0.3597	1.0814	1.0399
No log	5.3333	112	1.0759	0.3261	1.0759	1.0373
No log	5.4286	114	0.9730	0.4662	0.9730	0.9864
No log	5.5238	116	0.9486	0.5179	0.9486	0.9740
No log	5.6190	118	0.9684	0.5162	0.9684	0.9841
No log	5.7143	120	1.0511	0.4641	1.0511	1.0252
No log	5.8095	122	1.1017	0.4323	1.1017	1.0496
No log	5.9048	124	1.0708	0.4227	1.0708	1.0348
No log	6.0	126	0.9780	0.4246	0.9780	0.9889
No log	6.0952	128	0.9491	0.4136	0.9491	0.9742
No log	6.1905	130	0.9640	0.4371	0.9640	0.9818
No log	6.2857	132	1.0567	0.3934	1.0567	1.0279
No log	6.3810	134	1.0949	0.3620	1.0948	1.0464
No log	6.4762	136	1.1034	0.3221	1.1034	1.0504
No log	6.5714	138	1.0384	0.3550	1.0384	1.0190
No log	6.6667	140	1.0675	0.4359	1.0675	1.0332
No log	6.7619	142	1.1632	0.4166	1.1632	1.0785
No log	6.8571	144	1.3033	0.3780	1.3033	1.1416
No log	6.9524	146	1.4630	0.3787	1.4630	1.2095
No log	7.0476	148	1.5900	0.3426	1.5900	1.2609
No log	7.1429	150	1.5914	0.3416	1.5915	1.2615
No log	7.2381	152	1.4656	0.3698	1.4656	1.2106
No log	7.3333	154	1.4481	0.3899	1.4481	1.2034
No log	7.4286	156	1.3724	0.4080	1.3724	1.1715
No log	7.5238	158	1.2470	0.4221	1.2470	1.1167
No log	7.6190	160	1.1794	0.4287	1.1794	1.0860
No log	7.7143	162	1.1529	0.4251	1.1529	1.0737
No log	7.8095	164	1.2254	0.4189	1.2254	1.1070
No log	7.9048	166	1.2320	0.4327	1.2320	1.1100
No log	8.0	168	1.2251	0.4171	1.2251	1.1068
No log	8.0952	170	1.2475	0.3661	1.2475	1.1169
No log	8.1905	172	1.1958	0.3801	1.1958	1.0935
No log	8.2857	174	1.1505	0.4102	1.1505	1.0726
No log	8.3810	176	1.1411	0.3968	1.1411	1.0682
No log	8.4762	178	1.1938	0.4046	1.1938	1.0926
No log	8.5714	180	1.2062	0.4136	1.2062	1.0983
No log	8.6667	182	1.2716	0.4169	1.2716	1.1276
No log	8.7619	184	1.4046	0.3882	1.4046	1.1852
No log	8.8571	186	1.5110	0.3578	1.5110	1.2292
No log	8.9524	188	1.4979	0.3514	1.4979	1.2239
No log	9.0476	190	1.4452	0.3849	1.4452	1.2022
No log	9.1429	192	1.3750	0.3703	1.3750	1.1726
No log	9.2381	194	1.2216	0.4260	1.2216	1.1053
No log	9.3333	196	1.1626	0.4460	1.1626	1.0782
No log	9.4286	198	1.1995	0.4248	1.1995	1.0952
No log	9.5238	200	1.2096	0.4066	1.2096	1.0998
No log	9.6190	202	1.1673	0.4267	1.1673	1.0804
No log	9.7143	204	1.1246	0.4520	1.1246	1.0605
No log	9.8095	206	1.0390	0.4467	1.0390	1.0193
No log	9.9048	208	1.0240	0.4945	1.0240	1.0119
No log	10.0	210	1.0624	0.4620	1.0624	1.0307
No log	10.0952	212	1.1313	0.5079	1.1313	1.0636
No log	10.1905	214	1.2607	0.4798	1.2607	1.1228
No log	10.2857	216	1.3951	0.4148	1.3951	1.1811
No log	10.3810	218	1.3825	0.4304	1.3825	1.1758
No log	10.4762	220	1.1862	0.4437	1.1862	1.0891
No log	10.5714	222	1.1460	0.4452	1.1460	1.0705
No log	10.6667	224	1.0863	0.4285	1.0863	1.0423
No log	10.7619	226	1.0646	0.4884	1.0646	1.0318
No log	10.8571	228	1.0960	0.5117	1.0960	1.0469
No log	10.9524	230	1.1275	0.4617	1.1275	1.0618
No log	11.0476	232	1.1129	0.4768	1.1129	1.0549
No log	11.1429	234	1.1294	0.4691	1.1294	1.0627
No log	11.2381	236	1.1441	0.4533	1.1441	1.0696
No log	11.3333	238	1.0795	0.4958	1.0795	1.0390
No log	11.4286	240	0.9531	0.5258	0.9531	0.9763
No log	11.5238	242	0.9166	0.5068	0.9166	0.9574
No log	11.6190	244	0.9413	0.5245	0.9413	0.9702
No log	11.7143	246	1.0268	0.4996	1.0268	1.0133
No log	11.8095	248	1.2325	0.4383	1.2325	1.1102
No log	11.9048	250	1.4481	0.3679	1.4481	1.2034
No log	12.0	252	1.5714	0.3629	1.5714	1.2536
No log	12.0952	254	1.4283	0.3880	1.4283	1.1951
No log	12.1905	256	1.2698	0.4291	1.2698	1.1269
No log	12.2857	258	1.3607	0.4218	1.3607	1.1665
No log	12.3810	260	1.4739	0.3576	1.4739	1.2141
No log	12.4762	262	1.4968	0.3339	1.4968	1.2234
No log	12.5714	264	1.4414	0.3507	1.4414	1.2006
No log	12.6667	266	1.5300	0.3473	1.5300	1.2370
No log	12.7619	268	1.5102	0.4307	1.5102	1.2289
No log	12.8571	270	1.3684	0.4575	1.3684	1.1698
No log	12.9524	272	1.1485	0.5042	1.1485	1.0717
No log	13.0476	274	1.0912	0.4930	1.0912	1.0446
No log	13.1429	276	1.1692	0.4730	1.1692	1.0813
No log	13.2381	278	1.2550	0.4556	1.2550	1.1203
No log	13.3333	280	1.2219	0.4684	1.2219	1.1054
No log	13.4286	282	1.1157	0.5319	1.1157	1.0562
No log	13.5238	284	1.0325	0.5163	1.0325	1.0161
No log	13.6190	286	1.0678	0.5217	1.0678	1.0334
No log	13.7143	288	1.1140	0.5508	1.1140	1.0555
No log	13.8095	290	1.1735	0.4869	1.1735	1.0833
No log	13.9048	292	1.1556	0.4818	1.1556	1.0750
No log	14.0	294	1.0707	0.5376	1.0707	1.0347
No log	14.0952	296	0.9646	0.5690	0.9646	0.9821
No log	14.1905	298	1.0185	0.5309	1.0185	1.0092
No log	14.2857	300	1.1601	0.4962	1.1601	1.0771
No log	14.3810	302	1.3714	0.4474	1.3714	1.1711
No log	14.4762	304	1.3803	0.4590	1.3803	1.1749
No log	14.5714	306	1.2577	0.5002	1.2577	1.1215
No log	14.6667	308	1.1966	0.5167	1.1966	1.0939
No log	14.7619	310	1.1754	0.5102	1.1754	1.0842
No log	14.8571	312	1.2158	0.4927	1.2158	1.1027
No log	14.9524	314	1.1180	0.5329	1.1180	1.0574
No log	15.0476	316	1.0492	0.5374	1.0492	1.0243
No log	15.1429	318	0.9954	0.5413	0.9954	0.9977
No log	15.2381	320	1.0976	0.5644	1.0976	1.0477
No log	15.3333	322	1.2211	0.5160	1.2211	1.1051
No log	15.4286	324	1.2551	0.5017	1.2551	1.1203
No log	15.5238	326	1.1492	0.5285	1.1492	1.0720
No log	15.6190	328	1.0019	0.5200	1.0019	1.0009
No log	15.7143	330	0.9322	0.5142	0.9322	0.9655
No log	15.8095	332	0.9929	0.5125	0.9929	0.9965
No log	15.9048	334	1.1471	0.4511	1.1471	1.0710
No log	16.0	336	1.2552	0.4393	1.2552	1.1204
No log	16.0952	338	1.2504	0.4393	1.2504	1.1182
No log	16.1905	340	1.1400	0.4800	1.1400	1.0677
No log	16.2857	342	1.0787	0.4655	1.0787	1.0386
No log	16.3810	344	1.0720	0.5111	1.0720	1.0354
No log	16.4762	346	1.2041	0.5097	1.2041	1.0973
No log	16.5714	348	1.3669	0.4637	1.3669	1.1691
No log	16.6667	350	1.4601	0.4509	1.4601	1.2083
No log	16.7619	352	1.3485	0.4724	1.3485	1.1612
No log	16.8571	354	1.1182	0.5402	1.1182	1.0574
No log	16.9524	356	1.0657	0.5232	1.0657	1.0323
No log	17.0476	358	1.1172	0.5452	1.1172	1.0570
No log	17.1429	360	1.1231	0.5441	1.1231	1.0598
No log	17.2381	362	1.1674	0.5266	1.1674	1.0804
No log	17.3333	364	1.1957	0.4995	1.1957	1.0935
No log	17.4286	366	1.1507	0.5281	1.1507	1.0727
No log	17.5238	368	1.0558	0.5289	1.0558	1.0275
No log	17.6190	370	0.9715	0.5473	0.9715	0.9856
No log	17.7143	372	0.9983	0.5347	0.9983	0.9992
No log	17.8095	374	1.0410	0.5326	1.0410	1.0203
No log	17.9048	376	1.0853	0.5186	1.0853	1.0418
No log	18.0	378	1.1557	0.5067	1.1557	1.0750
No log	18.0952	380	1.2213	0.5031	1.2213	1.1051
No log	18.1905	382	1.2332	0.5303	1.2332	1.1105
No log	18.2857	384	1.1862	0.5639	1.1862	1.0891
No log	18.3810	386	1.1647	0.5515	1.1647	1.0792
No log	18.4762	388	1.0349	0.5280	1.0349	1.0173
No log	18.5714	390	0.9677	0.5135	0.9677	0.9837
No log	18.6667	392	0.9419	0.5308	0.9419	0.9705
No log	18.7619	394	0.9577	0.5432	0.9577	0.9786
No log	18.8571	396	1.1277	0.5288	1.1277	1.0619
No log	18.9524	398	1.4182	0.4397	1.4182	1.1909
No log	19.0476	400	1.6034	0.3766	1.6034	1.2663
No log	19.1429	402	1.5233	0.3713	1.5233	1.2342
No log	19.2381	404	1.3962	0.4304	1.3962	1.1816
No log	19.3333	406	1.2501	0.4707	1.2501	1.1181
No log	19.4286	408	1.1105	0.4910	1.1105	1.0538
No log	19.5238	410	1.0037	0.4556	1.0037	1.0019
No log	19.6190	412	0.9612	0.5072	0.9612	0.9804
No log	19.7143	414	0.9435	0.5352	0.9435	0.9713
No log	19.8095	416	0.9062	0.5545	0.9062	0.9520
No log	19.9048	418	0.9528	0.5567	0.9528	0.9761
No log	20.0	420	0.9646	0.5360	0.9646	0.9821
No log	20.0952	422	1.0397	0.4835	1.0397	1.0196
No log	20.1905	424	1.0617	0.5224	1.0617	1.0304
No log	20.2857	426	0.9938	0.5783	0.9938	0.9969
No log	20.3810	428	0.9602	0.5835	0.9602	0.9799
No log	20.4762	430	0.9944	0.5691	0.9944	0.9972
No log	20.5714	432	1.1071	0.5394	1.1071	1.0522
No log	20.6667	434	1.2438	0.4925	1.2438	1.1152
No log	20.7619	436	1.2425	0.4925	1.2425	1.1147
No log	20.8571	438	1.1830	0.5136	1.1830	1.0877
No log	20.9524	440	1.1091	0.5497	1.1091	1.0532
No log	21.0476	442	1.1264	0.5548	1.1264	1.0613
No log	21.1429	444	1.2292	0.5069	1.2292	1.1087
No log	21.2381	446	1.5181	0.3601	1.5181	1.2321
No log	21.3333	448	1.6781	0.3646	1.6781	1.2954
No log	21.4286	450	1.5304	0.3675	1.5304	1.2371
No log	21.5238	452	1.3145	0.4691	1.3145	1.1465
No log	21.6190	454	1.1453	0.5237	1.1453	1.0702
No log	21.7143	456	1.0943	0.5284	1.0943	1.0461
No log	21.8095	458	1.0089	0.4853	1.0089	1.0044
No log	21.9048	460	1.0139	0.5055	1.0139	1.0069
No log	22.0	462	1.0470	0.5239	1.0470	1.0233
No log	22.0952	464	1.1224	0.4907	1.1224	1.0594
No log	22.1905	466	1.1147	0.4763	1.1147	1.0558
No log	22.2857	468	1.0737	0.5109	1.0737	1.0362
No log	22.3810	470	0.9452	0.5447	0.9452	0.9722
No log	22.4762	472	0.9021	0.5317	0.9021	0.9498
No log	22.5714	474	0.9333	0.5010	0.9333	0.9661
No log	22.6667	476	1.0366	0.5221	1.0366	1.0181
No log	22.7619	478	1.2016	0.5032	1.2016	1.0962
No log	22.8571	480	1.3739	0.4645	1.3739	1.1721
No log	22.9524	482	1.3440	0.4722	1.3440	1.1593
No log	23.0476	484	1.2310	0.5376	1.2310	1.1095
No log	23.1429	486	1.1533	0.5758	1.1533	1.0739
No log	23.2381	488	1.1633	0.5364	1.1633	1.0786
No log	23.3333	490	1.2823	0.4690	1.2823	1.1324
No log	23.4286	492	1.3206	0.4453	1.3206	1.1492
No log	23.5238	494	1.2155	0.4926	1.2155	1.1025
No log	23.6190	496	1.0986	0.5498	1.0986	1.0481
No log	23.7143	498	1.0377	0.5371	1.0377	1.0187
0.428	23.8095	500	1.0517	0.5650	1.0517	1.0255
0.428	23.9048	502	1.1439	0.5300	1.1439	1.0695
0.428	24.0	504	1.1820	0.5345	1.1820	1.0872
0.428	24.0952	506	1.0685	0.5581	1.0685	1.0337
0.428	24.1905	508	1.0251	0.5693	1.0251	1.0125
0.428	24.2857	510	1.0103	0.5793	1.0103	1.0051
0.428	24.3810	512	1.0785	0.5487	1.0785	1.0385
0.428	24.4762	514	1.1509	0.5527	1.1509	1.0728
0.428	24.5714	516	1.1503	0.5709	1.1503	1.0725
0.428	24.6667	518	1.0906	0.5391	1.0906	1.0443
0.428	24.7619	520	1.0152	0.5438	1.0152	1.0076
0.428	24.8571	522	1.0284	0.5283	1.0284	1.0141
0.428	24.9524	524	1.1103	0.5202	1.1103	1.0537
0.428	25.0476	526	1.2406	0.5018	1.2406	1.1138

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1