ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3207
• Qwk: 0.1780
• Mse: 1.3207
• Rmse: 1.1492

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.5	2	4.6542	0.0010	4.6542	2.1574
No log	1.0	4	2.6799	-0.0439	2.6799	1.6370
No log	1.5	6	2.1115	-0.0634	2.1115	1.4531
No log	2.0	8	1.8065	-0.0605	1.8065	1.3441
No log	2.5	10	1.4148	0.0855	1.4148	1.1895
No log	3.0	12	1.5509	-0.1155	1.5509	1.2453
No log	3.5	14	2.1113	-0.1252	2.1113	1.4530
No log	4.0	16	1.8026	-0.0193	1.8026	1.3426
No log	4.5	18	1.4198	0.0150	1.4198	1.1916
No log	5.0	20	1.3535	0.1028	1.3535	1.1634
No log	5.5	22	1.8888	0.0286	1.8888	1.3744
No log	6.0	24	2.3554	0.0597	2.3554	1.5347
No log	6.5	26	1.6346	0.0982	1.6346	1.2785
No log	7.0	28	1.2709	0.2188	1.2709	1.1273
No log	7.5	30	1.3099	0.1089	1.3099	1.1445
No log	8.0	32	1.3862	0.1174	1.3862	1.1774
No log	8.5	34	1.5204	0.0572	1.5204	1.2330
No log	9.0	36	1.3826	0.1829	1.3826	1.1758
No log	9.5	38	1.3735	0.0778	1.3735	1.1719
No log	10.0	40	1.4532	0.1766	1.4532	1.2055
No log	10.5	42	1.3657	0.0767	1.3657	1.1686
No log	11.0	44	1.3773	0.1446	1.3773	1.1736
No log	11.5	46	1.5182	0.0826	1.5182	1.2322
No log	12.0	48	1.3956	0.1265	1.3956	1.1813
No log	12.5	50	1.4009	0.1220	1.4009	1.1836
No log	13.0	52	1.4648	0.1641	1.4648	1.2103
No log	13.5	54	1.4273	0.1355	1.4273	1.1947
No log	14.0	56	1.6335	0.0583	1.6335	1.2781
No log	14.5	58	1.5788	0.0367	1.5788	1.2565
No log	15.0	60	1.4138	0.0680	1.4138	1.1891
No log	15.5	62	1.4329	0.1019	1.4329	1.1970
No log	16.0	64	1.4292	0.1019	1.4292	1.1955
No log	16.5	66	1.4249	0.0247	1.4249	1.1937
No log	17.0	68	1.5662	0.0275	1.5662	1.2515
No log	17.5	70	1.5589	0.0275	1.5589	1.2486
No log	18.0	72	1.4439	0.0030	1.4439	1.2016
No log	18.5	74	1.4038	0.0128	1.4038	1.1848
No log	19.0	76	1.4236	0.0955	1.4236	1.1932
No log	19.5	78	1.4258	0.1042	1.4258	1.1941
No log	20.0	80	1.3791	0.0394	1.3791	1.1744
No log	20.5	82	1.3821	0.0543	1.3821	1.1756
No log	21.0	84	1.4053	0.0454	1.4053	1.1854
No log	21.5	86	1.4029	0.0454	1.4029	1.1844
No log	22.0	88	1.3969	0.0758	1.3969	1.1819
No log	22.5	90	1.3825	0.0607	1.3825	1.1758
No log	23.0	92	1.3841	0.0247	1.3841	1.1765
No log	23.5	94	1.4149	0.1014	1.4149	1.1895
No log	24.0	96	1.3514	0.0585	1.3514	1.1625
No log	24.5	98	1.3231	0.0797	1.3231	1.1503
No log	25.0	100	1.3762	0.0817	1.3762	1.1731
No log	25.5	102	1.3593	0.0732	1.3593	1.1659
No log	26.0	104	1.3040	0.0961	1.3040	1.1419
No log	26.5	106	1.2896	0.1112	1.2896	1.1356
No log	27.0	108	1.2668	0.1553	1.2668	1.1255
No log	27.5	110	1.2673	0.1780	1.2673	1.1257
No log	28.0	112	1.4073	0.2077	1.4073	1.1863
No log	28.5	114	1.5130	0.2306	1.5130	1.2301
No log	29.0	116	1.4556	0.2333	1.4556	1.2065
No log	29.5	118	1.3304	0.1928	1.3304	1.1534
No log	30.0	120	1.3855	0.0613	1.3855	1.1771
No log	30.5	122	1.4469	0.0319	1.4469	1.2029
No log	31.0	124	1.3945	0.0276	1.3945	1.1809
No log	31.5	126	1.3169	0.1362	1.3169	1.1475
No log	32.0	128	1.3227	0.1071	1.3227	1.1501
No log	32.5	130	1.3898	0.1766	1.3898	1.1789
No log	33.0	132	1.3647	0.0930	1.3647	1.1682
No log	33.5	134	1.3000	0.1245	1.3000	1.1402
No log	34.0	136	1.3011	0.1654	1.3011	1.1407
No log	34.5	138	1.3409	0.0366	1.3409	1.1580
No log	35.0	140	1.3243	0.1579	1.3243	1.1508
No log	35.5	142	1.3079	0.1849	1.3079	1.1436
No log	36.0	144	1.3307	0.0679	1.3307	1.1536
No log	36.5	146	1.3442	0.1133	1.3442	1.1594
No log	37.0	148	1.3284	0.1247	1.3284	1.1526
No log	37.5	150	1.3015	0.1793	1.3015	1.1408
No log	38.0	152	1.2881	0.1593	1.2881	1.1349
No log	38.5	154	1.3112	0.1266	1.3112	1.1451
No log	39.0	156	1.3256	0.1076	1.3256	1.1514
No log	39.5	158	1.3209	0.1203	1.3209	1.1493
No log	40.0	160	1.3338	0.1455	1.3338	1.1549
No log	40.5	162	1.4016	0.1913	1.4016	1.1839
No log	41.0	164	1.4182	0.1591	1.4182	1.1909
No log	41.5	166	1.3901	0.1485	1.3901	1.1790
No log	42.0	168	1.3162	0.1396	1.3162	1.1473
No log	42.5	170	1.2880	0.1493	1.2880	1.1349
No log	43.0	172	1.2946	0.1049	1.2946	1.1378
No log	43.5	174	1.3042	0.1397	1.3042	1.1420
No log	44.0	176	1.3099	0.1397	1.3099	1.1445
No log	44.5	178	1.3466	0.1002	1.3466	1.1605
No log	45.0	180	1.3765	0.0776	1.3765	1.1733
No log	45.5	182	1.3695	0.0776	1.3695	1.1703
No log	46.0	184	1.3226	0.0870	1.3226	1.1500
No log	46.5	186	1.2893	0.1693	1.2893	1.1355
No log	47.0	188	1.2992	0.0883	1.2992	1.1398
No log	47.5	190	1.3253	0.1300	1.3253	1.1512
No log	48.0	192	1.3342	0.1300	1.3342	1.1551
No log	48.5	194	1.3487	0.0817	1.3487	1.1613
No log	49.0	196	1.3724	0.0723	1.3724	1.1715
No log	49.5	198	1.4021	0.0552	1.4021	1.1841
No log	50.0	200	1.4263	0.0412	1.4263	1.1943
No log	50.5	202	1.4290	0.0412	1.4290	1.1954
No log	51.0	204	1.4097	0.0325	1.4097	1.1873
No log	51.5	206	1.3884	0.0705	1.3884	1.1783
No log	52.0	208	1.3897	0.0750	1.3897	1.1789
No log	52.5	210	1.3873	0.0557	1.3873	1.1778
No log	53.0	212	1.3915	0.0869	1.3915	1.1796
No log	53.5	214	1.3915	0.0532	1.3915	1.1796
No log	54.0	216	1.3857	0.0883	1.3857	1.1771
No log	54.5	218	1.3770	0.1362	1.3770	1.1734
No log	55.0	220	1.3795	0.1363	1.3795	1.1745
No log	55.5	222	1.4002	0.0616	1.4002	1.1833
No log	56.0	224	1.4315	0.1012	1.4315	1.1965
No log	56.5	226	1.4454	0.0476	1.4454	1.2023
No log	57.0	228	1.4402	0.1012	1.4402	1.2001
No log	57.5	230	1.4279	0.0616	1.4279	1.1949
No log	58.0	232	1.4087	0.1363	1.4087	1.1869
No log	58.5	234	1.3962	0.0869	1.3962	1.1816
No log	59.0	236	1.4135	0.0322	1.4135	1.1889
No log	59.5	238	1.4320	-0.0288	1.4320	1.1967
No log	60.0	240	1.4215	-0.0288	1.4215	1.1923
No log	60.5	242	1.3914	0.0161	1.3914	1.1796
No log	61.0	244	1.3702	0.1049	1.3702	1.1705
No log	61.5	246	1.3682	0.1302	1.3682	1.1697
No log	62.0	248	1.3737	0.1699	1.3737	1.1721
No log	62.5	250	1.3951	0.1245	1.3951	1.1811
No log	63.0	252	1.4108	0.1185	1.4108	1.1878
No log	63.5	254	1.4117	0.1487	1.4117	1.1881
No log	64.0	256	1.4012	0.1337	1.4012	1.1837
No log	64.5	258	1.3860	0.1185	1.3860	1.1773
No log	65.0	260	1.3881	0.0616	1.3881	1.1782
No log	65.5	262	1.3991	0.0464	1.3991	1.1828
No log	66.0	264	1.4121	0.0864	1.4121	1.1883
No log	66.5	266	1.4114	0.1032	1.4114	1.1880
No log	67.0	268	1.4149	0.1032	1.4149	1.1895
No log	67.5	270	1.4326	0.0476	1.4326	1.1969
No log	68.0	272	1.4275	0.0156	1.4275	1.1948
No log	68.5	274	1.3984	0.0552	1.3984	1.1825
No log	69.0	276	1.3629	0.1185	1.3629	1.1674
No log	69.5	278	1.3454	0.1185	1.3454	1.1599
No log	70.0	280	1.3317	0.1121	1.3317	1.1540
No log	70.5	282	1.3166	0.1276	1.3166	1.1474
No log	71.0	284	1.3029	0.1780	1.3029	1.1415
No log	71.5	286	1.3005	0.2300	1.3005	1.1404
No log	72.0	288	1.3030	0.1693	1.3030	1.1415
No log	72.5	290	1.3069	0.1335	1.3069	1.1432
No log	73.0	292	1.3094	0.1650	1.3094	1.1443
No log	73.5	294	1.3097	0.1799	1.3097	1.1444
No log	74.0	296	1.3088	0.2188	1.3088	1.1440
No log	74.5	298	1.3098	0.1467	1.3098	1.1445
No log	75.0	300	1.3113	0.1121	1.3113	1.1451
No log	75.5	302	1.3139	0.1121	1.3139	1.1463
No log	76.0	304	1.3076	0.1121	1.3076	1.1435
No log	76.5	306	1.2996	0.1309	1.2996	1.1400
No log	77.0	308	1.2914	0.1780	1.2914	1.1364
No log	77.5	310	1.2951	0.1780	1.2951	1.1380
No log	78.0	312	1.3019	0.1584	1.3019	1.1410
No log	78.5	314	1.3087	0.1584	1.3087	1.1440
No log	79.0	316	1.3150	0.1983	1.3150	1.1467
No log	79.5	318	1.3239	0.1983	1.3239	1.1506
No log	80.0	320	1.3342	0.1638	1.3342	1.1551
No log	80.5	322	1.3424	0.1638	1.3424	1.1586
No log	81.0	324	1.3473	0.1638	1.3473	1.1607
No log	81.5	326	1.3497	0.1638	1.3497	1.1618
No log	82.0	328	1.3533	0.1245	1.3533	1.1633
No log	82.5	330	1.3580	0.1337	1.3580	1.1653
No log	83.0	332	1.3537	0.1278	1.3537	1.1635
No log	83.5	334	1.3463	0.1278	1.3463	1.1603
No log	84.0	336	1.3435	0.1278	1.3435	1.1591
No log	84.5	338	1.3437	0.1278	1.3437	1.1592
No log	85.0	340	1.3398	0.1124	1.3398	1.1575
No log	85.5	342	1.3321	0.1278	1.3321	1.1542
No log	86.0	344	1.3311	0.1278	1.3311	1.1537
No log	86.5	346	1.3263	0.1430	1.3263	1.1516
No log	87.0	348	1.3227	0.1525	1.3227	1.1501
No log	87.5	350	1.3214	0.1371	1.3214	1.1495
No log	88.0	352	1.3190	0.1371	1.3190	1.1485
No log	88.5	354	1.3173	0.1683	1.3173	1.1478
No log	89.0	356	1.3189	0.1683	1.3189	1.1484
No log	89.5	358	1.3188	0.1683	1.3188	1.1484
No log	90.0	360	1.3198	0.1683	1.3198	1.1488
No log	90.5	362	1.3196	0.1683	1.3196	1.1487
No log	91.0	364	1.3197	0.1683	1.3197	1.1488
No log	91.5	366	1.3185	0.1683	1.3185	1.1483
No log	92.0	368	1.3176	0.1683	1.3176	1.1479
No log	92.5	370	1.3176	0.1683	1.3176	1.1479
No log	93.0	372	1.3181	0.1275	1.3181	1.1481
No log	93.5	374	1.3191	0.1371	1.3191	1.1485
No log	94.0	376	1.3207	0.1371	1.3207	1.1492
No log	94.5	378	1.3223	0.1371	1.3223	1.1499
No log	95.0	380	1.3240	0.1371	1.3240	1.1507
No log	95.5	382	1.3245	0.1371	1.3245	1.1509
No log	96.0	384	1.3241	0.1371	1.3241	1.1507
No log	96.5	386	1.3226	0.1371	1.3226	1.1501
No log	97.0	388	1.3219	0.1371	1.3219	1.1497
No log	97.5	390	1.3212	0.1371	1.3212	1.1494
No log	98.0	392	1.3204	0.1780	1.3204	1.1491
No log	98.5	394	1.3204	0.1780	1.3204	1.1491
No log	99.0	396	1.3206	0.1780	1.3206	1.1492
No log	99.5	398	1.3207	0.1780	1.3207	1.1492
No log	100.0	400	1.3207	0.1780	1.3207	1.1492

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1