ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2582
• Qwk: 0.4444
• Mse: 1.2582
• Rmse: 1.1217

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0476	2	6.6472	0.0308	6.6472	2.5782
No log	0.0952	4	4.2066	0.0684	4.2066	2.0510
No log	0.1429	6	3.0801	0.0121	3.0801	1.7550
No log	0.1905	8	2.6526	0.1111	2.6526	1.6287
No log	0.2381	10	2.2310	0.2090	2.2310	1.4936
No log	0.2857	12	1.8827	0.1587	1.8827	1.3721
No log	0.3333	14	1.7119	0.1947	1.7119	1.3084
No log	0.3810	16	1.6687	0.1468	1.6687	1.2918
No log	0.4286	18	1.7077	0.2143	1.7077	1.3068
No log	0.4762	20	1.9203	0.3200	1.9203	1.3858
No log	0.5238	22	2.2319	0.1119	2.2319	1.4940
No log	0.5714	24	2.2575	0.1119	2.2575	1.5025
No log	0.6190	26	2.0160	0.2901	2.0160	1.4198
No log	0.6667	28	1.8143	0.3175	1.8143	1.3470
No log	0.7143	30	1.8343	0.2812	1.8343	1.3543
No log	0.7619	32	1.8075	0.2748	1.8075	1.3444
No log	0.8095	34	1.8152	0.2941	1.8152	1.3473
No log	0.8571	36	1.8236	0.2958	1.8236	1.3504
No log	0.9048	38	1.9339	0.3613	1.9339	1.3906
No log	0.9524	40	2.0391	0.3797	2.0391	1.4280
No log	1.0	42	1.8790	0.3425	1.8790	1.3708
No log	1.0476	44	1.9106	0.3660	1.9106	1.3822
No log	1.0952	46	1.7269	0.3121	1.7269	1.3141
No log	1.1429	48	1.6129	0.2537	1.6129	1.2700
No log	1.1905	50	1.7054	0.2479	1.7054	1.3059
No log	1.2381	52	1.8428	0.2131	1.8428	1.3575
No log	1.2857	54	1.6470	0.3387	1.6470	1.2833
No log	1.3333	56	1.7371	0.2290	1.7371	1.3180
No log	1.3810	58	1.9184	0.3014	1.9184	1.3851
No log	1.4286	60	1.9393	0.3046	1.9393	1.3926
No log	1.4762	62	1.6272	0.3759	1.6272	1.2756
No log	1.5238	64	1.4414	0.4242	1.4414	1.2006
No log	1.5714	66	1.3736	0.4361	1.3736	1.1720
No log	1.6190	68	1.5664	0.3433	1.5664	1.2516
No log	1.6667	70	1.6920	0.3571	1.6920	1.3008
No log	1.7143	72	1.8273	0.3776	1.8273	1.3518
No log	1.7619	74	1.3764	0.4593	1.3764	1.1732
No log	1.8095	76	1.2880	0.4672	1.2880	1.1349
No log	1.8571	78	1.5029	0.4354	1.5029	1.2259
No log	1.9048	80	1.7368	0.4286	1.7368	1.3179
No log	1.9524	82	1.5037	0.4805	1.5037	1.2262
No log	2.0	84	1.2445	0.5429	1.2445	1.1156
No log	2.0476	86	1.1250	0.4839	1.1250	1.0607
No log	2.0952	88	1.0446	0.5366	1.0446	1.0221
No log	2.1429	90	1.0996	0.5455	1.0996	1.0486
No log	2.1905	92	1.7179	0.4908	1.7179	1.3107
No log	2.2381	94	1.9387	0.3721	1.9387	1.3924
No log	2.2857	96	1.6140	0.4720	1.6140	1.2704
No log	2.3333	98	1.2756	0.5306	1.2756	1.1294
No log	2.3810	100	1.3475	0.5139	1.3475	1.1608
No log	2.4286	102	1.5214	0.4755	1.5214	1.2334
No log	2.4762	104	1.5458	0.4755	1.5458	1.2433
No log	2.5238	106	1.4883	0.4667	1.4883	1.2200
No log	2.5714	108	1.3098	0.5503	1.3098	1.1445
No log	2.6190	110	1.1070	0.5455	1.1070	1.0521
No log	2.6667	112	1.0150	0.5507	1.0150	1.0075
No log	2.7143	114	0.9982	0.5649	0.9982	0.9991
No log	2.7619	116	1.0078	0.5354	1.0078	1.0039
No log	2.8095	118	1.0581	0.4878	1.0581	1.0286
No log	2.8571	120	1.1103	0.4878	1.1103	1.0537
No log	2.9048	122	1.0968	0.5	1.0968	1.0473
No log	2.9524	124	1.0680	0.4677	1.0680	1.0334
No log	3.0	126	1.0890	0.5271	1.0890	1.0436
No log	3.0476	128	1.0813	0.5758	1.0813	1.0399
No log	3.0952	130	1.0751	0.6061	1.0751	1.0369
No log	3.1429	132	1.0860	0.5564	1.0860	1.0421
No log	3.1905	134	1.0899	0.5821	1.0899	1.0440
No log	3.2381	136	1.0943	0.5564	1.0943	1.0461
No log	3.2857	138	1.1219	0.5038	1.1219	1.0592
No log	3.3333	140	1.1773	0.4252	1.1773	1.0850
No log	3.3810	142	1.2472	0.4480	1.2472	1.1168
No log	3.4286	144	1.2752	0.4480	1.2752	1.1293
No log	3.4762	146	1.2123	0.4923	1.2123	1.1011
No log	3.5238	148	1.1778	0.5248	1.1778	1.0853
No log	3.5714	150	1.1573	0.5674	1.1573	1.0758
No log	3.6190	152	1.1160	0.5874	1.1160	1.0564
No log	3.6667	154	1.1368	0.6014	1.1368	1.0662
No log	3.7143	156	1.2000	0.6111	1.2000	1.0954
No log	3.7619	158	1.1680	0.5874	1.1680	1.0807
No log	3.8095	160	1.1147	0.5781	1.1147	1.0558
No log	3.8571	162	1.1758	0.528	1.1758	1.0844
No log	3.9048	164	1.2083	0.5354	1.2083	1.0992
No log	3.9524	166	1.1355	0.5954	1.1355	1.0656
No log	4.0	168	1.0779	0.5496	1.0779	1.0382
No log	4.0476	170	1.4606	0.5229	1.4606	1.2085
No log	4.0952	172	1.9892	0.3934	1.9892	1.4104
No log	4.1429	174	1.8532	0.4372	1.8532	1.3613
No log	4.1905	176	1.5890	0.5486	1.5890	1.2606
No log	4.2381	178	1.3341	0.5422	1.3341	1.1550
No log	4.2857	180	1.2200	0.6135	1.2200	1.1045
No log	4.3333	182	1.1306	0.6115	1.1306	1.0633
No log	4.3810	184	1.0350	0.5906	1.0350	1.0174
No log	4.4286	186	1.1259	0.5752	1.1259	1.0611
No log	4.4762	188	1.2317	0.56	1.2317	1.1098
No log	4.5238	190	1.2799	0.52	1.2799	1.1313
No log	4.5714	192	1.2145	0.5315	1.2145	1.1021
No log	4.6190	194	1.1996	0.5315	1.1996	1.0953
No log	4.6667	196	1.1966	0.5248	1.1966	1.0939
No log	4.7143	198	1.3458	0.4636	1.3458	1.1601
No log	4.7619	200	1.6028	0.4684	1.6028	1.2660
No log	4.8095	202	1.2595	0.5298	1.2595	1.1223
No log	4.8571	204	0.9573	0.6014	0.9573	0.9784
No log	4.9048	206	0.9309	0.5797	0.9309	0.9648
No log	4.9524	208	0.9859	0.5630	0.9859	0.9929
No log	5.0	210	1.0402	0.5612	1.0402	1.0199
No log	5.0476	212	1.0670	0.5694	1.0670	1.0330
No log	5.0952	214	1.0413	0.5906	1.0413	1.0204
No log	5.1429	216	0.9632	0.6216	0.9632	0.9814
No log	5.1905	218	0.9811	0.6667	0.9811	0.9905
No log	5.2381	220	1.2863	0.5618	1.2863	1.1342
No log	5.2857	222	1.6420	0.53	1.6420	1.2814
No log	5.3333	224	1.5117	0.5503	1.5117	1.2295
No log	5.3810	226	1.3211	0.6	1.3211	1.1494
No log	5.4286	228	1.3365	0.5875	1.3365	1.1561
No log	5.4762	230	1.4392	0.5290	1.4392	1.1997
No log	5.5238	232	1.7117	0.4634	1.7117	1.3083
No log	5.5714	234	1.9319	0.3799	1.9319	1.3899
No log	5.6190	236	1.5185	0.4868	1.5185	1.2323
No log	5.6667	238	1.0712	0.5857	1.0712	1.0350
No log	5.7143	240	0.9442	0.6047	0.9442	0.9717
No log	5.7619	242	0.9660	0.5954	0.9660	0.9828
No log	5.8095	244	1.0431	0.6299	1.0431	1.0213
No log	5.8571	246	1.0299	0.625	1.0299	1.0148
No log	5.9048	248	0.9538	0.5984	0.9538	0.9766
No log	5.9524	250	0.9605	0.5857	0.9605	0.9801
No log	6.0	252	1.1218	0.5867	1.1218	1.0592
No log	6.0476	254	1.3765	0.5629	1.3765	1.1733
No log	6.0952	256	1.5652	0.5810	1.5652	1.2511
No log	6.1429	258	1.4702	0.5862	1.4702	1.2125
No log	6.1905	260	1.1371	0.6184	1.1371	1.0664
No log	6.2381	262	0.9405	0.5778	0.9405	0.9698
No log	6.2857	264	0.9160	0.6260	0.9160	0.9571
No log	6.3333	266	0.9142	0.6165	0.9142	0.9561
No log	6.3810	268	0.9365	0.6212	0.9365	0.9677
No log	6.4286	270	0.9625	0.6260	0.9625	0.9811
No log	6.4762	272	0.9824	0.6457	0.9824	0.9911
No log	6.5238	274	0.9827	0.5354	0.9827	0.9913
No log	6.5714	276	1.0377	0.5303	1.0377	1.0187
No log	6.6190	278	1.2391	0.5828	1.2391	1.1131
No log	6.6667	280	1.8004	0.5055	1.8004	1.3418
No log	6.7143	282	2.2646	0.4039	2.2646	1.5049
No log	6.7619	284	1.9862	0.4330	1.9862	1.4093
No log	6.8095	286	1.5252	0.5318	1.5252	1.2350
No log	6.8571	288	1.2645	0.4935	1.2645	1.1245
No log	6.9048	290	1.1673	0.5714	1.1673	1.0804
No log	6.9524	292	1.0807	0.5874	1.0807	1.0396
No log	7.0	294	0.9874	0.5692	0.9874	0.9937
No log	7.0476	296	0.9655	0.5692	0.9655	0.9826
No log	7.0952	298	1.0016	0.5920	1.0016	1.0008
No log	7.1429	300	1.0313	0.5455	1.0313	1.0155
No log	7.1905	302	1.0149	0.5528	1.0149	1.0074
No log	7.2381	304	1.0110	0.5397	1.0110	1.0055
No log	7.2857	306	1.0593	0.4848	1.0593	1.0292
No log	7.3333	308	1.1083	0.5294	1.1083	1.0527
No log	7.3810	310	1.0839	0.5441	1.0839	1.0411
No log	7.4286	312	1.1438	0.5578	1.1438	1.0695
No log	7.4762	314	1.2661	0.5844	1.2661	1.1252
No log	7.5238	316	1.3836	0.4968	1.3836	1.1763
No log	7.5714	318	1.3845	0.5256	1.3845	1.1766
No log	7.6190	320	1.3110	0.5584	1.3110	1.1450
No log	7.6667	322	1.2582	0.5563	1.2582	1.1217
No log	7.7143	324	1.2498	0.5430	1.2498	1.1179
No log	7.7619	326	1.3593	0.5605	1.3593	1.1659
No log	7.8095	328	1.4905	0.5509	1.4905	1.2208
No log	7.8571	330	1.5618	0.4941	1.5618	1.2497
No log	7.9048	332	1.7452	0.4667	1.7452	1.3211
No log	7.9524	334	2.0877	0.3731	2.0877	1.4449
No log	8.0	336	2.4492	0.3417	2.4492	1.5650
No log	8.0476	338	2.1721	0.4020	2.1721	1.4738
No log	8.0952	340	1.7283	0.4615	1.7283	1.3146
No log	8.1429	342	1.4234	0.5359	1.4234	1.1931
No log	8.1905	344	1.3259	0.5526	1.3259	1.1515
No log	8.2381	346	1.2695	0.5526	1.2695	1.1267
No log	8.2857	348	1.2073	0.5828	1.2073	1.0988
No log	8.3333	350	1.1797	0.5897	1.1797	1.0861
No log	8.3810	352	1.2101	0.5987	1.2101	1.1000
No log	8.4286	354	1.2036	0.5987	1.2036	1.0971
No log	8.4762	356	1.1513	0.5676	1.1513	1.0730
No log	8.5238	358	1.1727	0.5676	1.1727	1.0829
No log	8.5714	360	1.2555	0.6104	1.2555	1.1205
No log	8.6190	362	1.2919	0.6065	1.2919	1.1366
No log	8.6667	364	1.2634	0.6065	1.2634	1.1240
No log	8.7143	366	1.2480	0.5772	1.2480	1.1171
No log	8.7619	368	1.1525	0.5556	1.1525	1.0735
No log	8.8095	370	1.0760	0.5612	1.0760	1.0373
No log	8.8571	372	1.0583	0.5414	1.0583	1.0287
No log	8.9048	374	1.1234	0.5255	1.1234	1.0599
No log	8.9524	376	1.2110	0.5037	1.2110	1.1004
No log	9.0	378	1.1975	0.5113	1.1975	1.0943
No log	9.0476	380	1.1380	0.4844	1.1380	1.0668
No log	9.0952	382	1.0735	0.4640	1.0735	1.0361
No log	9.1429	384	1.0548	0.5231	1.0548	1.0270
No log	9.1905	386	1.1861	0.5733	1.1861	1.0891
No log	9.2381	388	1.3574	0.5732	1.3574	1.1651
No log	9.2857	390	1.4468	0.5537	1.4468	1.2028
No log	9.3333	392	1.4303	0.5363	1.4303	1.1960
No log	9.3810	394	1.3496	0.5542	1.3496	1.1617
No log	9.4286	396	1.3178	0.5660	1.3178	1.1480
No log	9.4762	398	1.2733	0.5621	1.2733	1.1284
No log	9.5238	400	1.1571	0.5906	1.1571	1.0757
No log	9.5714	402	1.0931	0.6225	1.0931	1.0455
No log	9.6190	404	1.0566	0.6040	1.0566	1.0279
No log	9.6667	406	1.0302	0.5547	1.0302	1.0150
No log	9.7143	408	1.0111	0.5926	1.0111	1.0055
No log	9.7619	410	1.0276	0.5564	1.0276	1.0137
No log	9.8095	412	1.0673	0.5038	1.0673	1.0331
No log	9.8571	414	1.1402	0.5333	1.1402	1.0678
No log	9.9048	416	1.2083	0.5401	1.2083	1.0992
No log	9.9524	418	1.1879	0.5522	1.1879	1.0899
No log	10.0	420	1.1910	0.5333	1.1910	1.0913
No log	10.0476	422	1.2275	0.5263	1.2275	1.1079
No log	10.0952	424	1.3173	0.5	1.3173	1.1477
No log	10.1429	426	1.3448	0.5255	1.3448	1.1596
No log	10.1905	428	1.3363	0.5255	1.3363	1.1560
No log	10.2381	430	1.2974	0.5	1.2974	1.1390
No log	10.2857	432	1.2605	0.4823	1.2605	1.1227
No log	10.3333	434	1.2343	0.5315	1.2343	1.1110
No log	10.3810	436	1.2371	0.5211	1.2371	1.1122
No log	10.4286	438	1.2290	0.4965	1.2290	1.1086
No log	10.4762	440	1.2682	0.4604	1.2682	1.1261
No log	10.5238	442	1.2583	0.4493	1.2583	1.1217
No log	10.5714	444	1.3011	0.4648	1.3011	1.1407
No log	10.6190	446	1.3544	0.5342	1.3544	1.1638
No log	10.6667	448	1.3958	0.5170	1.3958	1.1814
No log	10.7143	450	1.5708	0.5359	1.5708	1.2533
No log	10.7619	452	1.6767	0.4815	1.6767	1.2949
No log	10.8095	454	1.6674	0.5098	1.6674	1.2913
No log	10.8571	456	1.4777	0.5235	1.4777	1.2156
No log	10.9048	458	1.3322	0.4755	1.3322	1.1542
No log	10.9524	460	1.2564	0.4789	1.2564	1.1209
No log	11.0	462	1.2475	0.4930	1.2475	1.1169
No log	11.0476	464	1.2884	0.5175	1.2884	1.1351
No log	11.0952	466	1.3710	0.5	1.3710	1.1709
No log	11.1429	468	1.4118	0.5034	1.4118	1.1882
No log	11.1905	470	1.4078	0.4892	1.4078	1.1865
No log	11.2381	472	1.3778	0.4818	1.3778	1.1738
No log	11.2857	474	1.3127	0.4706	1.3127	1.1457
No log	11.3333	476	1.2595	0.4733	1.2595	1.1223
No log	11.3810	478	1.2553	0.4627	1.2553	1.1204
No log	11.4286	480	1.3100	0.4748	1.3100	1.1445
No log	11.4762	482	1.3904	0.4966	1.3904	1.1792
No log	11.5238	484	1.4769	0.4966	1.4769	1.2153
No log	11.5714	486	1.4272	0.4966	1.4272	1.1947
No log	11.6190	488	1.3014	0.4828	1.3014	1.1408
No log	11.6667	490	1.2514	0.4681	1.2514	1.1186
No log	11.7143	492	1.2352	0.4828	1.2352	1.1114
No log	11.7619	494	1.1912	0.4895	1.1912	1.0914
No log	11.8095	496	1.1886	0.5106	1.1886	1.0902
No log	11.8571	498	1.2480	0.4722	1.2480	1.1171
0.3993	11.9048	500	1.2697	0.4898	1.2697	1.1268
0.3993	11.9524	502	1.2444	0.5	1.2444	1.1155
0.3993	12.0	504	1.1984	0.5224	1.1984	1.0947
0.3993	12.0476	506	1.1418	0.5152	1.1418	1.0685
0.3993	12.0952	508	1.0992	0.5231	1.0992	1.0484
0.3993	12.1429	510	1.0826	0.5397	1.0826	1.0405
0.3993	12.1905	512	1.1141	0.5469	1.1141	1.0555
0.3993	12.2381	514	1.1409	0.5512	1.1409	1.0681
0.3993	12.2857	516	1.1616	0.5323	1.1616	1.0778
0.3993	12.3333	518	1.1678	0.4553	1.1678	1.0806
0.3993	12.3810	520	1.2257	0.4516	1.2257	1.1071
0.3993	12.4286	522	1.2640	0.4480	1.2640	1.1243
0.3993	12.4762	524	1.2590	0.4355	1.2590	1.1220
0.3993	12.5238	526	1.2582	0.4444	1.2582	1.1217

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1