ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5078
• Qwk: 0.4908
• Mse: 1.5078
• Rmse: 1.2279

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	6.7428	0.0308	6.7428	2.5967
No log	0.5	4	4.2901	0.0976	4.2901	2.0713
No log	0.75	6	2.9872	0.0988	2.9872	1.7284
No log	1.0	8	2.7634	0.1307	2.7634	1.6624
No log	1.25	10	3.0524	0.0641	3.0524	1.7471
No log	1.5	12	2.5440	0.1119	2.5440	1.5950
No log	1.75	14	1.7384	0.2810	1.7384	1.3185
No log	2.0	16	1.4864	0.2435	1.4864	1.2192
No log	2.25	18	1.5923	0.3471	1.5923	1.2619
No log	2.5	20	2.3176	0.1974	2.3176	1.5224
No log	2.75	22	2.5989	0.0745	2.5989	1.6121
No log	3.0	24	2.2773	0.2368	2.2773	1.5091
No log	3.25	26	1.7409	0.3796	1.7409	1.3194
No log	3.5	28	1.5204	0.4118	1.5204	1.2331
No log	3.75	30	1.5450	0.4789	1.5450	1.2430
No log	4.0	32	2.5724	0.2857	2.5724	1.6039
No log	4.25	34	2.9440	0.2913	2.9440	1.7158
No log	4.5	36	1.8802	0.4235	1.8802	1.3712
No log	4.75	38	1.2084	0.6122	1.2084	1.0993
No log	5.0	40	1.2843	0.5986	1.2843	1.1333
No log	5.25	42	1.8815	0.3626	1.8815	1.3717
No log	5.5	44	2.2466	0.3523	2.2466	1.4989
No log	5.75	46	1.8718	0.3889	1.8718	1.3682
No log	6.0	48	1.2835	0.5732	1.2835	1.1329
No log	6.25	50	1.3176	0.5939	1.3176	1.1478
No log	6.5	52	1.2914	0.5814	1.2914	1.1364
No log	6.75	54	1.2825	0.5896	1.2825	1.1325
No log	7.0	56	1.9831	0.4365	1.9831	1.4082
No log	7.25	58	2.0995	0.4205	2.0995	1.4489
No log	7.5	60	1.5461	0.5380	1.5461	1.2434
No log	7.75	62	1.1497	0.5490	1.1497	1.0722
No log	8.0	64	1.3826	0.5399	1.3826	1.1758
No log	8.25	66	1.3981	0.5422	1.3981	1.1824
No log	8.5	68	1.2375	0.5786	1.2375	1.1124
No log	8.75	70	1.1568	0.5733	1.1568	1.0755
No log	9.0	72	1.5273	0.4678	1.5273	1.2359
No log	9.25	74	2.2584	0.3704	2.2584	1.5028
No log	9.5	76	1.8368	0.4072	1.8368	1.3553
No log	9.75	78	1.1948	0.5778	1.1948	1.0931
No log	10.0	80	1.1571	0.5263	1.1571	1.0757
No log	10.25	82	1.1180	0.5606	1.1180	1.0574
No log	10.5	84	1.5112	0.4868	1.5112	1.2293
No log	10.75	86	1.7173	0.4634	1.7173	1.3104
No log	11.0	88	1.2841	0.5714	1.2841	1.1332
No log	11.25	90	1.0111	0.6176	1.0111	1.0055
No log	11.5	92	0.9885	0.6667	0.9885	0.9942
No log	11.75	94	1.1081	0.5987	1.1081	1.0527
No log	12.0	96	1.3695	0.5824	1.3695	1.1703
No log	12.25	98	1.3427	0.5444	1.3427	1.1588
No log	12.5	100	1.1577	0.575	1.1577	1.0760
No log	12.75	102	0.9482	0.6806	0.9482	0.9738
No log	13.0	104	0.9220	0.6812	0.9220	0.9602
No log	13.25	106	0.9098	0.6957	0.9098	0.9538
No log	13.5	108	0.9218	0.6074	0.9218	0.9601
No log	13.75	110	1.1083	0.5135	1.1083	1.0527
No log	14.0	112	1.6555	0.5202	1.6555	1.2867
No log	14.25	114	1.7090	0.5269	1.7090	1.3073
No log	14.5	116	1.2386	0.5556	1.2386	1.1129
No log	14.75	118	0.9804	0.5793	0.9804	0.9902
No log	15.0	120	1.0284	0.5578	1.0284	1.0141
No log	15.25	122	1.2839	0.5478	1.2839	1.1331
No log	15.5	124	1.6191	0.5349	1.6191	1.2724
No log	15.75	126	1.4672	0.5098	1.4672	1.2113
No log	16.0	128	1.2888	0.5072	1.2888	1.1352
No log	16.25	130	1.2782	0.5185	1.2782	1.1306
No log	16.5	132	1.2936	0.5036	1.2936	1.1374
No log	16.75	134	1.4470	0.5306	1.4470	1.2029
No log	17.0	136	1.4582	0.5513	1.4582	1.2076
No log	17.25	138	1.2582	0.5101	1.2582	1.1217
No log	17.5	140	1.2854	0.5432	1.2854	1.1337
No log	17.75	142	1.4050	0.5882	1.4050	1.1853
No log	18.0	144	1.3507	0.6163	1.3507	1.1622
No log	18.25	146	1.0587	0.5714	1.0587	1.0290
No log	18.5	148	1.0077	0.5857	1.0077	1.0038
No log	18.75	150	1.0549	0.5612	1.0549	1.0271
No log	19.0	152	1.2815	0.5714	1.2815	1.1320
No log	19.25	154	1.3597	0.5584	1.3597	1.1661
No log	19.5	156	1.2170	0.5490	1.2170	1.1032
No log	19.75	158	1.0668	0.5507	1.0668	1.0328
No log	20.0	160	1.0174	0.5588	1.0174	1.0087
No log	20.25	162	1.1119	0.5594	1.1119	1.0545
No log	20.5	164	1.3556	0.5513	1.3556	1.1643
No log	20.75	166	1.5128	0.5614	1.5128	1.2300
No log	21.0	168	1.3313	0.5432	1.3313	1.1538
No log	21.25	170	1.2050	0.5132	1.2050	1.0977
No log	21.5	172	1.3323	0.5132	1.3323	1.1543
No log	21.75	174	1.6382	0.5207	1.6382	1.2799
No log	22.0	176	1.6615	0.5333	1.6615	1.2890
No log	22.25	178	1.6032	0.4604	1.6032	1.2662
No log	22.5	180	1.4652	0.4480	1.4652	1.2104
No log	22.75	182	1.4112	0.4444	1.4112	1.1880
No log	23.0	184	1.4749	0.4603	1.4749	1.2144
No log	23.25	186	1.6305	0.4265	1.6305	1.2769
No log	23.5	188	1.9291	0.3473	1.9291	1.3889
No log	23.75	190	1.8859	0.4134	1.8859	1.3733
No log	24.0	192	1.5639	0.4645	1.5639	1.2506
No log	24.25	194	1.3056	0.4690	1.3056	1.1426
No log	24.5	196	1.2188	0.4648	1.2188	1.1040
No log	24.75	198	1.3079	0.4762	1.3079	1.1436
No log	25.0	200	1.6115	0.5089	1.6115	1.2695
No log	25.25	202	2.0649	0.3830	2.0649	1.4370
No log	25.5	204	1.8176	0.5169	1.8176	1.3482
No log	25.75	206	1.4129	0.5488	1.4129	1.1886
No log	26.0	208	1.1268	0.4755	1.1268	1.0615
No log	26.25	210	1.1164	0.4925	1.1164	1.0566
No log	26.5	212	1.2133	0.4493	1.2133	1.1015
No log	26.75	214	1.3715	0.5584	1.3715	1.1711
No log	27.0	216	1.3141	0.5135	1.3141	1.1463
No log	27.25	218	1.1857	0.4795	1.1857	1.0889
No log	27.5	220	1.0982	0.5	1.0982	1.0479
No log	27.75	222	1.0656	0.5714	1.0656	1.0323
No log	28.0	224	1.1494	0.5235	1.1494	1.0721
No log	28.25	226	1.1219	0.5405	1.1219	1.0592
No log	28.5	228	1.2198	0.4795	1.2198	1.1045
No log	28.75	230	1.2990	0.4935	1.2990	1.1397
No log	29.0	232	1.2218	0.4698	1.2218	1.1054
No log	29.25	234	1.3124	0.5122	1.3124	1.1456
No log	29.5	236	1.4431	0.5380	1.4431	1.2013
No log	29.75	238	1.3672	0.5269	1.3672	1.1693
No log	30.0	240	1.1657	0.4930	1.1657	1.0797
No log	30.25	242	1.1745	0.5109	1.1745	1.0838
No log	30.5	244	1.1951	0.5077	1.1951	1.0932
No log	30.75	246	1.2054	0.5077	1.2054	1.0979
No log	31.0	248	1.3465	0.5224	1.3465	1.1604
No log	31.25	250	1.5001	0.5	1.5001	1.2248
No log	31.5	252	1.5819	0.4815	1.5819	1.2577
No log	31.75	254	1.3537	0.5443	1.3537	1.1635
No log	32.0	256	1.1151	0.5468	1.1151	1.0560
No log	32.25	258	1.0326	0.6483	1.0326	1.0162
No log	32.5	260	1.1289	0.5135	1.1289	1.0625
No log	32.75	262	1.3872	0.5465	1.3872	1.1778
No log	33.0	264	1.4391	0.5263	1.4391	1.1996
No log	33.25	266	1.3663	0.5217	1.3663	1.1689
No log	33.5	268	1.3540	0.5032	1.3540	1.1636
No log	33.75	270	1.2505	0.5070	1.2505	1.1183
No log	34.0	272	1.1632	0.5324	1.1632	1.0785
No log	34.25	274	1.1680	0.5324	1.1680	1.0808
No log	34.5	276	1.3397	0.5270	1.3397	1.1574
No log	34.75	278	1.3919	0.5696	1.3919	1.1798
No log	35.0	280	1.3746	0.5590	1.3746	1.1724
No log	35.25	282	1.3072	0.5548	1.3072	1.1433
No log	35.5	284	1.1848	0.5390	1.1848	1.0885
No log	35.75	286	1.1559	0.5286	1.1559	1.0751
No log	36.0	288	1.2320	0.5101	1.2320	1.1099
No log	36.25	290	1.4710	0.55	1.4710	1.2128
No log	36.5	292	1.9258	0.4407	1.9258	1.3877
No log	36.75	294	2.1141	0.3936	2.1141	1.4540
No log	37.0	296	1.8986	0.4049	1.8986	1.3779
No log	37.25	298	1.4753	0.4901	1.4753	1.2146
No log	37.5	300	1.1331	0.4812	1.1331	1.0645
No log	37.75	302	1.0836	0.5441	1.0836	1.0410
No log	38.0	304	1.1440	0.4741	1.1440	1.0696
No log	38.25	306	1.2713	0.5067	1.2713	1.1275
No log	38.5	308	1.5256	0.5190	1.5256	1.2352
No log	38.75	310	1.4867	0.5190	1.4867	1.2193
No log	39.0	312	1.2730	0.5135	1.2730	1.1283
No log	39.25	314	1.0713	0.5588	1.0713	1.0350
No log	39.5	316	1.0049	0.6187	1.0049	1.0024
No log	39.75	318	1.0390	0.6187	1.0390	1.0193
No log	40.0	320	1.1642	0.4892	1.1642	1.0790
No log	40.25	322	1.5822	0.4557	1.5822	1.2579
No log	40.5	324	1.8198	0.3758	1.8198	1.3490
No log	40.75	326	1.7158	0.4192	1.7158	1.3099
No log	41.0	328	1.3839	0.4968	1.3839	1.1764
No log	41.25	330	1.2466	0.52	1.2466	1.1165
No log	41.5	332	1.1147	0.5342	1.1147	1.0558
No log	41.75	334	1.0548	0.5816	1.0548	1.0270
No log	42.0	336	1.0407	0.5816	1.0407	1.0201
No log	42.25	338	1.1201	0.5306	1.1201	1.0584
No log	42.5	340	1.1287	0.5442	1.1287	1.0624
No log	42.75	342	1.1161	0.5139	1.1161	1.0565
No log	43.0	344	1.1108	0.5106	1.1108	1.0539
No log	43.25	346	1.0909	0.5373	1.0909	1.0444
No log	43.5	348	1.1247	0.5217	1.1247	1.0605
No log	43.75	350	1.1843	0.4604	1.1843	1.0883
No log	44.0	352	1.2285	0.4714	1.2285	1.1084
No log	44.25	354	1.2396	0.4460	1.2396	1.1134
No log	44.5	356	1.2212	0.4348	1.2212	1.1051
No log	44.75	358	1.3239	0.4789	1.3239	1.1506
No log	45.0	360	1.3091	0.4755	1.3091	1.1442
No log	45.25	362	1.3969	0.5	1.3969	1.1819
No log	45.5	364	1.3182	0.5170	1.3182	1.1481
No log	45.75	366	1.2185	0.4828	1.2185	1.1039
No log	46.0	368	1.1408	0.4895	1.1408	1.0681
No log	46.25	370	1.0547	0.5143	1.0547	1.0270
No log	46.5	372	1.0597	0.5143	1.0597	1.0294
No log	46.75	374	1.0950	0.5248	1.0950	1.0464
No log	47.0	376	1.1620	0.5205	1.1620	1.0780
No log	47.25	378	1.3563	0.5478	1.3563	1.1646
No log	47.5	380	1.4672	0.5309	1.4672	1.2113
No log	47.75	382	1.4679	0.5309	1.4679	1.2116
No log	48.0	384	1.2927	0.5195	1.2927	1.1370
No log	48.25	386	1.1850	0.5170	1.1850	1.0886
No log	48.5	388	1.1820	0.5170	1.1820	1.0872
No log	48.75	390	1.2117	0.4932	1.2117	1.1008
No log	49.0	392	1.2127	0.4932	1.2127	1.1012
No log	49.25	394	1.2654	0.4966	1.2654	1.1249
No log	49.5	396	1.2947	0.4795	1.2947	1.1379
No log	49.75	398	1.3323	0.4762	1.3323	1.1542
No log	50.0	400	1.1916	0.4895	1.1916	1.0916
No log	50.25	402	1.0494	0.5588	1.0494	1.0244
No log	50.5	404	1.0329	0.5693	1.0329	1.0163
No log	50.75	406	1.1140	0.5493	1.1140	1.0555
No log	51.0	408	1.3096	0.4658	1.3096	1.1444
No log	51.25	410	1.5053	0.4837	1.5053	1.2269
No log	51.5	412	1.4815	0.4837	1.4815	1.2172
No log	51.75	414	1.3407	0.5	1.3407	1.1579
No log	52.0	416	1.1430	0.5493	1.1430	1.0691
No log	52.25	418	1.0634	0.5612	1.0634	1.0312
No log	52.5	420	1.0552	0.5507	1.0552	1.0272
No log	52.75	422	1.1196	0.5833	1.1196	1.0581
No log	53.0	424	1.2151	0.5135	1.2151	1.1023
No log	53.25	426	1.4209	0.5422	1.4209	1.1920
No log	53.5	428	1.6066	0.5114	1.6066	1.2675
No log	53.75	430	1.7660	0.4407	1.7660	1.3289
No log	54.0	432	1.7030	0.4407	1.7030	1.3050
No log	54.25	434	1.4548	0.5325	1.4548	1.2061
No log	54.5	436	1.3146	0.4932	1.3146	1.1465
No log	54.75	438	1.3301	0.4789	1.3301	1.1533
No log	55.0	440	1.3598	0.4789	1.3598	1.1661
No log	55.25	442	1.4577	0.4690	1.4577	1.2074
No log	55.5	444	1.4402	0.4789	1.4402	1.2001
No log	55.75	446	1.3266	0.5	1.3266	1.1518
No log	56.0	448	1.2802	0.4923	1.2802	1.1315
No log	56.25	450	1.2340	0.4961	1.2340	1.1108
No log	56.5	452	1.2388	0.5185	1.2388	1.1130
No log	56.75	454	1.2837	0.5	1.2837	1.1330
No log	57.0	456	1.2769	0.5103	1.2769	1.1300
No log	57.25	458	1.3157	0.4898	1.3157	1.1470
No log	57.5	460	1.3246	0.5067	1.3246	1.1509
No log	57.75	462	1.3223	0.5298	1.3223	1.1499
No log	58.0	464	1.3400	0.5132	1.3400	1.1576
No log	58.25	466	1.3300	0.5132	1.3300	1.1533
No log	58.5	468	1.2468	0.5103	1.2468	1.1166
No log	58.75	470	1.1803	0.5205	1.1803	1.0864
No log	59.0	472	1.1971	0.5211	1.1971	1.0941
No log	59.25	474	1.1834	0.5294	1.1834	1.0878
No log	59.5	476	1.1644	0.4925	1.1644	1.0791
No log	59.75	478	1.1520	0.4882	1.1520	1.0733
No log	60.0	480	1.1549	0.4882	1.1549	1.0747
No log	60.25	482	1.1610	0.4882	1.1610	1.0775
No log	60.5	484	1.2019	0.4844	1.2019	1.0963
No log	60.75	486	1.2478	0.4733	1.2478	1.1170
No log	61.0	488	1.3070	0.4857	1.3070	1.1432
No log	61.25	490	1.3913	0.4832	1.3913	1.1795
No log	61.5	492	1.3747	0.4832	1.3747	1.1725
No log	61.75	494	1.3133	0.5235	1.3133	1.1460
No log	62.0	496	1.2631	0.5235	1.2631	1.1239
No log	62.25	498	1.2188	0.5034	1.2188	1.1040
0.273	62.5	500	1.2559	0.5135	1.2559	1.1206
0.273	62.75	502	1.3505	0.5166	1.3505	1.1621
0.273	63.0	504	1.4068	0.5166	1.4068	1.1861
0.273	63.25	506	1.3644	0.5	1.3644	1.1681
0.273	63.5	508	1.3084	0.5070	1.3084	1.1438
0.273	63.75	510	1.2675	0.4818	1.2675	1.1258
0.273	64.0	512	1.2313	0.5191	1.2313	1.1096
0.273	64.25	514	1.2261	0.5333	1.2261	1.1073
0.273	64.5	516	1.2494	0.4857	1.2494	1.1178
0.273	64.75	518	1.2184	0.5106	1.2184	1.1038
0.273	65.0	520	1.2617	0.4755	1.2617	1.1233
0.273	65.25	522	1.3686	0.5067	1.3686	1.1699
0.273	65.5	524	1.5078	0.4908	1.5078	1.2279

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1