ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3096
• Qwk: 0.1440
• Mse: 1.3096
• Rmse: 1.1444

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.5	2	4.6044	0.0010	4.6044	2.1458
No log	1.0	4	2.6377	0.0122	2.6377	1.6241
No log	1.5	6	2.1440	-0.0361	2.1440	1.4642
No log	2.0	8	1.6024	-0.0688	1.6024	1.2659
No log	2.5	10	1.3279	0.0228	1.3279	1.1523
No log	3.0	12	1.3553	0.0527	1.3553	1.1642
No log	3.5	14	1.3485	0.0527	1.3485	1.1612
No log	4.0	16	1.2967	0.0527	1.2967	1.1387
No log	4.5	18	1.3176	-0.0031	1.3176	1.1479
No log	5.0	20	1.3594	0.0694	1.3594	1.1659
No log	5.5	22	1.3260	-0.0010	1.3260	1.1515
No log	6.0	24	1.2920	-0.0156	1.2920	1.1366
No log	6.5	26	1.2833	0.1108	1.2833	1.1328
No log	7.0	28	1.2807	0.1108	1.2807	1.1317
No log	7.5	30	1.2694	0.0446	1.2694	1.1267
No log	8.0	32	1.2655	0.0294	1.2655	1.1249
No log	8.5	34	1.2572	0.0983	1.2572	1.1213
No log	9.0	36	1.2369	0.0909	1.2369	1.1121
No log	9.5	38	1.2374	0.1009	1.2374	1.1124
No log	10.0	40	1.2300	0.1279	1.2300	1.1091
No log	10.5	42	1.2108	0.1860	1.2108	1.1004
No log	11.0	44	1.2014	0.0642	1.2014	1.0961
No log	11.5	46	1.2216	0.0789	1.2216	1.1053
No log	12.0	48	1.2461	0.1081	1.2461	1.1163
No log	12.5	50	1.2401	0.0880	1.2401	1.1136
No log	13.0	52	1.2485	0.0789	1.2485	1.1173
No log	13.5	54	1.2286	0.0612	1.2286	1.1084
No log	14.0	56	1.2786	0.0711	1.2786	1.1307
No log	14.5	58	1.2160	0.0780	1.2160	1.1027
No log	15.0	60	1.1501	0.1180	1.1501	1.0724
No log	15.5	62	1.2315	0.0780	1.2315	1.1097
No log	16.0	64	1.4661	0.1753	1.4661	1.2108
No log	16.5	66	1.4923	0.1570	1.4923	1.2216
No log	17.0	68	1.3943	0.1614	1.3943	1.1808
No log	17.5	70	1.3050	0.0664	1.3050	1.1423
No log	18.0	72	1.3231	0.0880	1.3231	1.1503
No log	18.5	74	1.4854	0.1935	1.4854	1.2188
No log	19.0	76	1.6771	0.1543	1.6771	1.2950
No log	19.5	78	1.6438	0.1257	1.6438	1.2821
No log	20.0	80	1.4020	0.2046	1.4020	1.1840
No log	20.5	82	1.3747	0.1599	1.3747	1.1725
No log	21.0	84	1.3774	0.0827	1.3774	1.1736
No log	21.5	86	1.3186	0.0365	1.3186	1.1483
No log	22.0	88	1.2876	0.0863	1.2876	1.1347
No log	22.5	90	1.4125	0.125	1.4125	1.1885
No log	23.0	92	1.6601	0.1425	1.6601	1.2884
No log	23.5	94	1.9119	0.0805	1.9119	1.3827
No log	24.0	96	1.9069	0.0880	1.9069	1.3809
No log	24.5	98	1.8172	0.0663	1.8172	1.3480
No log	25.0	100	1.6040	0.1607	1.6040	1.2665
No log	25.5	102	1.2907	0.1118	1.2907	1.1361
No log	26.0	104	1.1927	0.1753	1.1927	1.0921
No log	26.5	106	1.2083	0.1654	1.2083	1.0992
No log	27.0	108	1.2454	0.1016	1.2454	1.1160
No log	27.5	110	1.3362	0.0365	1.3362	1.1560
No log	28.0	112	1.4065	0.0415	1.4065	1.1859
No log	28.5	114	1.5159	0.1659	1.5159	1.2312
No log	29.0	116	1.6810	0.1483	1.6810	1.2965
No log	29.5	118	1.7555	0.0473	1.7555	1.3250
No log	30.0	120	1.7243	0.0147	1.7243	1.3131
No log	30.5	122	1.6587	0.0273	1.6587	1.2879
No log	31.0	124	1.5194	0.0512	1.5194	1.2326
No log	31.5	126	1.3873	0.1148	1.3873	1.1778
No log	32.0	128	1.3618	0.1148	1.3618	1.1670
No log	32.5	130	1.4632	0.0759	1.4632	1.2096
No log	33.0	132	1.6518	0.1028	1.6518	1.2852
No log	33.5	134	1.7146	0.0347	1.7146	1.3094
No log	34.0	136	1.6836	0.0681	1.6836	1.2975
No log	34.5	138	1.5709	0.1171	1.5709	1.2534
No log	35.0	140	1.4131	0.0865	1.4131	1.1887
No log	35.5	142	1.2964	0.0130	1.2964	1.1386
No log	36.0	144	1.2914	0.0374	1.2914	1.1364
No log	36.5	146	1.3116	0.0721	1.3116	1.1452
No log	37.0	148	1.3553	0.0126	1.3553	1.1642
No log	37.5	150	1.4195	0.0415	1.4195	1.1914
No log	38.0	152	1.4877	0.0430	1.4877	1.2197
No log	38.5	154	1.5833	0.1112	1.5833	1.2583
No log	39.0	156	1.6847	0.0971	1.6847	1.2980
No log	39.5	158	1.6852	0.1436	1.6852	1.2981
No log	40.0	160	1.5658	0.1283	1.5658	1.2513
No log	40.5	162	1.4223	0.1692	1.4223	1.1926
No log	41.0	164	1.3966	0.1122	1.3966	1.1818
No log	41.5	166	1.3972	0.1122	1.3972	1.1820
No log	42.0	168	1.4212	0.1316	1.4212	1.1921
No log	42.5	170	1.4277	0.1379	1.4277	1.1949
No log	43.0	172	1.4114	0.1026	1.4114	1.1880
No log	43.5	174	1.3382	0.1118	1.3382	1.1568
No log	44.0	176	1.2839	0.0568	1.2839	1.1331
No log	44.5	178	1.3010	0.1118	1.3010	1.1406
No log	45.0	180	1.3096	0.1118	1.3096	1.1444
No log	45.5	182	1.3213	0.1118	1.3213	1.1495
No log	46.0	184	1.3439	0.1282	1.3439	1.1593
No log	46.5	186	1.3401	0.0865	1.3401	1.1576
No log	47.0	188	1.3078	0.0442	1.3078	1.1436
No log	47.5	190	1.2823	0.0343	1.2823	1.1324
No log	48.0	192	1.2597	0.0780	1.2597	1.1223
No log	48.5	194	1.2737	0.1118	1.2737	1.1286
No log	49.0	196	1.2986	0.1217	1.2986	1.1396
No log	49.5	198	1.3773	0.1440	1.3773	1.1736
No log	50.0	200	1.4281	0.1283	1.4281	1.1950
No log	50.5	202	1.4791	0.1224	1.4791	1.2162
No log	51.0	204	1.4691	0.1224	1.4691	1.2121
No log	51.5	206	1.3934	0.1846	1.3934	1.1804
No log	52.0	208	1.3393	0.1750	1.3393	1.1573
No log	52.5	210	1.2605	0.1020	1.2605	1.1227
No log	53.0	212	1.2191	0.1504	1.2191	1.1041
No log	53.5	214	1.2186	0.1504	1.2186	1.1039
No log	54.0	216	1.2399	0.1118	1.2399	1.1135
No log	54.5	218	1.2889	0.0789	1.2889	1.1353
No log	55.0	220	1.3693	0.1745	1.3693	1.1702
No log	55.5	222	1.4158	0.1440	1.4158	1.1899
No log	56.0	224	1.4233	0.1745	1.4233	1.1930
No log	56.5	226	1.4655	0.1980	1.4655	1.2106
No log	57.0	228	1.4732	0.2289	1.4732	1.2138
No log	57.5	230	1.4461	0.1659	1.4461	1.2025
No log	58.0	232	1.3961	0.1498	1.3961	1.1816
No log	58.5	234	1.3345	0.1846	1.3345	1.1552
No log	59.0	236	1.2978	0.1282	1.2978	1.1392
No log	59.5	238	1.2683	0.1020	1.2683	1.1262
No log	60.0	240	1.2645	0.1020	1.2645	1.1245
No log	60.5	242	1.2747	0.1020	1.2747	1.1290
No log	61.0	244	1.2871	0.1217	1.2871	1.1345
No log	61.5	246	1.3283	0.1795	1.3283	1.1525
No log	62.0	248	1.3434	0.1846	1.3434	1.1590
No log	62.5	250	1.3729	0.1896	1.3729	1.1717
No log	63.0	252	1.3853	0.1896	1.3853	1.1770
No log	63.5	254	1.4036	0.1896	1.4036	1.1847
No log	64.0	256	1.3863	0.1846	1.3863	1.1774
No log	64.5	258	1.3777	0.1846	1.3777	1.1737
No log	65.0	260	1.3567	0.1846	1.3567	1.1648
No log	65.5	262	1.3317	0.1795	1.3317	1.1540
No log	66.0	264	1.3330	0.1795	1.3330	1.1546
No log	66.5	266	1.3576	0.1795	1.3576	1.1652
No log	67.0	268	1.3879	0.1440	1.3879	1.1781
No log	67.5	270	1.3791	0.1379	1.3791	1.1744
No log	68.0	272	1.3492	0.0789	1.3492	1.1616
No log	68.5	274	1.3178	0.1217	1.3178	1.1480
No log	69.0	276	1.3058	0.1217	1.3058	1.1427
No log	69.5	278	1.3044	0.1217	1.3044	1.1421
No log	70.0	280	1.3329	0.1217	1.3329	1.1545
No log	70.5	282	1.3587	0.0789	1.3587	1.1656
No log	71.0	284	1.3744	0.1053	1.3744	1.1724
No log	71.5	286	1.3691	0.1053	1.3691	1.1701
No log	72.0	288	1.3465	0.0442	1.3465	1.1604
No log	72.5	290	1.3288	0.0880	1.3288	1.1527
No log	73.0	292	1.3299	0.1217	1.3299	1.1532
No log	73.5	294	1.3437	0.1379	1.3437	1.1592
No log	74.0	296	1.3556	0.1440	1.3556	1.1643
No log	74.5	298	1.3692	0.1122	1.3692	1.1701
No log	75.0	300	1.3737	0.1122	1.3737	1.1721
No log	75.5	302	1.3926	0.1440	1.3926	1.1801
No log	76.0	304	1.4112	0.1498	1.4112	1.1879
No log	76.5	306	1.3966	0.1440	1.3966	1.1818
No log	77.0	308	1.3566	0.1846	1.3566	1.1647
No log	77.5	310	1.3421	0.1846	1.3421	1.1585
No log	78.0	312	1.3307	0.1846	1.3307	1.1536
No log	78.5	314	1.3247	0.1846	1.3247	1.1510
No log	79.0	316	1.3371	0.1846	1.3371	1.1564
No log	79.5	318	1.3615	0.1440	1.3615	1.1668
No log	80.0	320	1.3864	0.1440	1.3864	1.1775
No log	80.5	322	1.4054	0.1498	1.4054	1.1855
No log	81.0	324	1.4208	0.1659	1.4208	1.1920
No log	81.5	326	1.4197	0.1659	1.4197	1.1915
No log	82.0	328	1.4068	0.1313	1.4068	1.1861
No log	82.5	330	1.3867	0.1440	1.3867	1.1776
No log	83.0	332	1.3559	0.1440	1.3559	1.1645
No log	83.5	334	1.3437	0.1440	1.3437	1.1592
No log	84.0	336	1.3403	0.1026	1.3403	1.1577
No log	84.5	338	1.3361	0.1026	1.3361	1.1559
No log	85.0	340	1.3310	0.1026	1.3310	1.1537
No log	85.5	342	1.3282	0.1345	1.3282	1.1525
No log	86.0	344	1.3342	0.1440	1.3342	1.1551
No log	86.5	346	1.3299	0.1440	1.3299	1.1532
No log	87.0	348	1.3172	0.1846	1.3172	1.1477
No log	87.5	350	1.3221	0.1440	1.3221	1.1498
No log	88.0	352	1.3212	0.1440	1.3212	1.1494
No log	88.5	354	1.3266	0.1440	1.3266	1.1518
No log	89.0	356	1.3368	0.1440	1.3368	1.1562
No log	89.5	358	1.3354	0.1440	1.3354	1.1556
No log	90.0	360	1.3347	0.1440	1.3347	1.1553
No log	90.5	362	1.3381	0.1440	1.3381	1.1567
No log	91.0	364	1.3370	0.1440	1.3370	1.1563
No log	91.5	366	1.3330	0.1440	1.3330	1.1546
No log	92.0	368	1.3242	0.1440	1.3242	1.1507
No log	92.5	370	1.3197	0.1440	1.3197	1.1488
No log	93.0	372	1.3144	0.1440	1.3144	1.1465
No log	93.5	374	1.3119	0.1440	1.3119	1.1454
No log	94.0	376	1.3085	0.1440	1.3085	1.1439
No log	94.5	378	1.3057	0.1440	1.3057	1.1427
No log	95.0	380	1.3058	0.1440	1.3058	1.1427
No log	95.5	382	1.3078	0.1440	1.3078	1.1436
No log	96.0	384	1.3123	0.1440	1.3123	1.1456
No log	96.5	386	1.3132	0.1440	1.3132	1.1460
No log	97.0	388	1.3128	0.1440	1.3128	1.1458
No log	97.5	390	1.3113	0.1440	1.3113	1.1451
No log	98.0	392	1.3092	0.1440	1.3092	1.1442
No log	98.5	394	1.3086	0.1440	1.3086	1.1439
No log	99.0	396	1.3094	0.1440	1.3094	1.1443
No log	99.5	398	1.3096	0.1440	1.3096	1.1444
No log	100.0	400	1.3096	0.1440	1.3096	1.1444

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1