ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k1_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0960
• Qwk: 0.2120
• Mse: 1.0960
• Rmse: 1.0469

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.5	2	4.2873	0.0130	4.2873	2.0706
No log	1.0	4	2.6680	-0.0372	2.6680	1.6334
No log	1.5	6	2.3041	0.0446	2.3041	1.5179
No log	2.0	8	1.6440	0.0447	1.6440	1.2822
No log	2.5	10	1.2707	-0.0167	1.2707	1.1272
No log	3.0	12	1.2979	0.1164	1.2979	1.1392
No log	3.5	14	1.3045	0.0472	1.3045	1.1421
No log	4.0	16	1.2280	0.0591	1.2280	1.1081
No log	4.5	18	1.1945	0.1009	1.1945	1.0929
No log	5.0	20	1.1422	0.1129	1.1422	1.0687
No log	5.5	22	1.1173	0.1306	1.1173	1.0570
No log	6.0	24	1.1587	0.1038	1.1587	1.0764
No log	6.5	26	1.1950	0.1038	1.1950	1.0931
No log	7.0	28	1.4382	0.0445	1.4382	1.1992
No log	7.5	30	1.4042	0.0898	1.4042	1.1850
No log	8.0	32	1.2048	0.0770	1.2048	1.0976
No log	8.5	34	1.1882	0.0770	1.1882	1.0901
No log	9.0	36	1.1543	0.1827	1.1543	1.0744
No log	9.5	38	1.1706	0.1108	1.1706	1.0820
No log	10.0	40	1.1504	0.1902	1.1504	1.0726
No log	10.5	42	1.1669	0.0890	1.1669	1.0802
No log	11.0	44	1.2271	0.1034	1.2271	1.1078
No log	11.5	46	1.1369	0.1306	1.1369	1.0663
No log	12.0	48	1.1039	0.1561	1.1039	1.0506
No log	12.5	50	1.1065	0.1192	1.1065	1.0519
No log	13.0	52	1.1025	0.1561	1.1025	1.0500
No log	13.5	54	1.1770	0.1680	1.1770	1.0849
No log	14.0	56	1.3172	0.1117	1.3172	1.1477
No log	14.5	58	1.2814	0.0973	1.2814	1.1320
No log	15.0	60	1.1909	0.1297	1.1909	1.0913
No log	15.5	62	1.1573	0.1095	1.1573	1.0758
No log	16.0	64	1.1569	0.2057	1.1569	1.0756
No log	16.5	66	1.1716	0.2057	1.1716	1.0824
No log	17.0	68	1.2198	0.0180	1.2198	1.1045
No log	17.5	70	1.2363	0.0887	1.2363	1.1119
No log	18.0	72	1.1765	0.0711	1.1765	1.0847
No log	18.5	74	1.2104	0.1152	1.2104	1.1002
No log	19.0	76	1.3451	0.2103	1.3451	1.1598
No log	19.5	78	1.4573	0.1498	1.4573	1.2072
No log	20.0	80	1.3153	0.1758	1.3153	1.1469
No log	20.5	82	1.1991	0.0980	1.1991	1.0950
No log	21.0	84	1.1968	0.1662	1.1968	1.0940
No log	21.5	86	1.1825	0.0711	1.1825	1.0874
No log	22.0	88	1.2499	-0.0293	1.2499	1.1180
No log	22.5	90	1.3421	0.1650	1.3421	1.1585
No log	23.0	92	1.3415	0.1650	1.3415	1.1582
No log	23.5	94	1.2091	0.0306	1.2091	1.0996
No log	24.0	96	1.1741	0.0517	1.1741	1.0836
No log	24.5	98	1.1896	0.0306	1.1896	1.0907
No log	25.0	100	1.2102	0.1361	1.2102	1.1001
No log	25.5	102	1.2406	0.1416	1.2406	1.1138
No log	26.0	104	1.2517	0.1416	1.2517	1.1188
No log	26.5	106	1.2417	0.1416	1.2417	1.1143
No log	27.0	108	1.1679	0.0640	1.1679	1.0807
No log	27.5	110	1.1345	0.0274	1.1345	1.0651
No log	28.0	112	1.1361	0.0121	1.1361	1.0659
No log	28.5	114	1.1788	0.0671	1.1788	1.0857
No log	29.0	116	1.2868	0.0790	1.2868	1.1344
No log	29.5	118	1.3227	0.0701	1.3227	1.1501
No log	30.0	120	1.2504	0.0909	1.2504	1.1182
No log	30.5	122	1.1729	0.2318	1.1729	1.0830
No log	31.0	124	1.1257	0.0860	1.1257	1.0610
No log	31.5	126	1.1326	0.1543	1.1326	1.0642
No log	32.0	128	1.1302	0.2562	1.1302	1.0631
No log	32.5	130	1.0902	0.2043	1.0902	1.0441
No log	33.0	132	1.0607	0.1741	1.0607	1.0299
No log	33.5	134	1.0719	0.2539	1.0719	1.0353
No log	34.0	136	1.1267	0.2343	1.1267	1.0614
No log	34.5	138	1.1193	0.2465	1.1193	1.0579
No log	35.0	140	1.0902	0.2711	1.0902	1.0441
No log	35.5	142	1.0657	0.1671	1.0657	1.0323
No log	36.0	144	1.0629	0.1671	1.0629	1.0310
No log	36.5	146	1.0721	0.2268	1.0721	1.0354
No log	37.0	148	1.1043	0.2049	1.1043	1.0509
No log	37.5	150	1.1043	0.2074	1.1043	1.0508
No log	38.0	152	1.0568	0.2564	1.0568	1.0280
No log	38.5	154	1.0370	0.2291	1.0370	1.0183
No log	39.0	156	1.0563	0.2929	1.0563	1.0278
No log	39.5	158	1.0543	0.2312	1.0543	1.0268
No log	40.0	160	1.0433	0.1247	1.0433	1.0214
No log	40.5	162	1.1022	0.2489	1.1022	1.0499
No log	41.0	164	1.1494	0.1324	1.1494	1.0721
No log	41.5	166	1.1171	0.2489	1.1171	1.0569
No log	42.0	168	1.0787	0.2145	1.0787	1.0386
No log	42.5	170	1.0733	0.0884	1.0733	1.0360
No log	43.0	172	1.0918	0.2698	1.0918	1.0449
No log	43.5	174	1.0961	0.2312	1.0961	1.0470
No log	44.0	176	1.0929	0.1037	1.0929	1.0454
No log	44.5	178	1.1088	0.1549	1.1088	1.0530
No log	45.0	180	1.1461	0.2049	1.1461	1.0706
No log	45.5	182	1.1550	0.2049	1.1550	1.0747
No log	46.0	184	1.1277	0.1183	1.1277	1.0619
No log	46.5	186	1.0988	0.1313	1.0988	1.0483
No log	47.0	188	1.0940	0.1504	1.0940	1.0460
No log	47.5	190	1.0810	0.1504	1.0810	1.0397
No log	48.0	192	1.0759	0.1837	1.0759	1.0373
No log	48.5	194	1.0753	0.0914	1.0753	1.0370
No log	49.0	196	1.0755	0.1218	1.0755	1.0371
No log	49.5	198	1.0746	0.1218	1.0746	1.0366
No log	50.0	200	1.0927	0.1848	1.0927	1.0453
No log	50.5	202	1.1218	0.2074	1.1218	1.0591
No log	51.0	204	1.1815	0.1711	1.1815	1.0869
No log	51.5	206	1.1755	0.1711	1.1755	1.0842
No log	52.0	208	1.1265	0.1953	1.1265	1.0614
No log	52.5	210	1.1120	0.1361	1.1120	1.0545
No log	53.0	212	1.0980	0.1603	1.0980	1.0478
No log	53.5	214	1.0875	0.1997	1.0875	1.0428
No log	54.0	216	1.0808	0.1997	1.0808	1.0396
No log	54.5	218	1.0808	0.1997	1.0808	1.0396
No log	55.0	220	1.0667	0.1997	1.0667	1.0328
No log	55.5	222	1.0594	0.1848	1.0594	1.0293
No log	56.0	224	1.0664	0.1997	1.0664	1.0327
No log	56.5	226	1.0974	0.1953	1.0974	1.0476
No log	57.0	228	1.0987	0.2074	1.0987	1.0482
No log	57.5	230	1.0801	0.2416	1.0801	1.0393
No log	58.0	232	1.0722	0.2515	1.0722	1.0355
No log	58.5	234	1.0743	0.2094	1.0743	1.0365
No log	59.0	236	1.0838	0.2094	1.0838	1.0411
No log	59.5	238	1.0815	0.1521	1.0815	1.0399
No log	60.0	240	1.0827	0.1549	1.0827	1.0405
No log	60.5	242	1.0841	0.2094	1.0841	1.0412
No log	61.0	244	1.0831	0.1997	1.0831	1.0407
No log	61.5	246	1.0828	0.1752	1.0828	1.0406
No log	62.0	248	1.0989	0.2074	1.0989	1.0483
No log	62.5	250	1.1090	0.1953	1.1090	1.0531
No log	63.0	252	1.0919	0.1927	1.0919	1.0449
No log	63.5	254	1.0754	0.1752	1.0754	1.0370
No log	64.0	256	1.0723	0.1752	1.0723	1.0355
No log	64.5	258	1.0711	0.1752	1.0711	1.0349
No log	65.0	260	1.0604	0.1698	1.0604	1.0297
No log	65.5	262	1.0556	0.1698	1.0556	1.0274
No log	66.0	264	1.0515	0.1644	1.0515	1.0255
No log	66.5	266	1.0540	0.2108	1.0540	1.0266
No log	67.0	268	1.0768	0.2589	1.0768	1.0377
No log	67.5	270	1.1024	0.2702	1.1024	1.0500
No log	68.0	272	1.1073	0.2319	1.1073	1.0523
No log	68.5	274	1.1009	0.2401	1.1009	1.0492
No log	69.0	276	1.0697	0.2487	1.0697	1.0343
No log	69.5	278	1.0571	0.1463	1.0571	1.0281
No log	70.0	280	1.0554	0.1713	1.0554	1.0273
No log	70.5	282	1.0623	0.1616	1.0623	1.0307
No log	71.0	284	1.0700	0.1589	1.0700	1.0344
No log	71.5	286	1.0769	0.1436	1.0769	1.0378
No log	72.0	288	1.0859	0.1408	1.0859	1.0421
No log	72.5	290	1.0898	0.1491	1.0898	1.0440
No log	73.0	292	1.0859	0.1408	1.0859	1.0421
No log	73.5	294	1.0786	0.1037	1.0786	1.0386
No log	74.0	296	1.0789	0.1794	1.0789	1.0387
No log	74.5	298	1.0819	0.2243	1.0819	1.0401
No log	75.0	300	1.0798	0.2243	1.0798	1.0392
No log	75.5	302	1.0796	0.2243	1.0796	1.0391
No log	76.0	304	1.0774	0.1794	1.0774	1.0380
No log	76.5	306	1.0750	0.1794	1.0750	1.0368
No log	77.0	308	1.0745	0.1794	1.0745	1.0366
No log	77.5	310	1.0732	0.1794	1.0732	1.0359
No log	78.0	312	1.0711	0.1794	1.0711	1.0349
No log	78.5	314	1.0698	0.1794	1.0698	1.0343
No log	79.0	316	1.0674	0.1891	1.0674	1.0331
No log	79.5	318	1.0661	0.1465	1.0661	1.0325
No log	80.0	320	1.0659	0.1436	1.0659	1.0324
No log	80.5	322	1.0650	0.1465	1.0650	1.0320
No log	81.0	324	1.0656	0.1944	1.0656	1.0323
No log	81.5	326	1.0720	0.2366	1.0720	1.0354
No log	82.0	328	1.0785	0.2268	1.0785	1.0385
No log	82.5	330	1.0879	0.1752	1.0879	1.0430
No log	83.0	332	1.0927	0.1752	1.0927	1.0453
No log	83.5	334	1.0997	0.1927	1.0997	1.0487
No log	84.0	336	1.1018	0.2074	1.1018	1.0496
No log	84.5	338	1.0984	0.1927	1.0984	1.0480
No log	85.0	340	1.0925	0.1752	1.0925	1.0452
No log	85.5	342	1.0885	0.2145	1.0885	1.0433
No log	86.0	344	1.0869	0.1997	1.0869	1.0426
No log	86.5	346	1.0858	0.2243	1.0858	1.0420
No log	87.0	348	1.0853	0.2366	1.0853	1.0418
No log	87.5	350	1.0837	0.1794	1.0837	1.0410
No log	88.0	352	1.0834	0.1644	1.0834	1.0409
No log	88.5	354	1.0847	0.0639	1.0847	1.0415
No log	89.0	356	1.0869	0.0639	1.0869	1.0426
No log	89.5	358	1.0887	0.0639	1.0887	1.0434
No log	90.0	360	1.0889	0.1037	1.0889	1.0435
No log	90.5	362	1.0896	0.0792	1.0896	1.0438
No log	91.0	364	1.0917	0.1794	1.0917	1.0448
No log	91.5	366	1.0942	0.1794	1.0942	1.0460
No log	92.0	368	1.0955	0.2217	1.0955	1.0467
No log	92.5	370	1.0962	0.2366	1.0962	1.0470
No log	93.0	372	1.0967	0.2120	1.0967	1.0472
No log	93.5	374	1.0967	0.2120	1.0967	1.0472
No log	94.0	376	1.0963	0.2120	1.0963	1.0470
No log	94.5	378	1.0956	0.2243	1.0956	1.0467
No log	95.0	380	1.0957	0.2243	1.0957	1.0467
No log	95.5	382	1.0954	0.2243	1.0954	1.0466
No log	96.0	384	1.0963	0.2120	1.0963	1.0470
No log	96.5	386	1.0967	0.2120	1.0967	1.0472
No log	97.0	388	1.0975	0.2120	1.0975	1.0476
No log	97.5	390	1.0976	0.2120	1.0976	1.0477
No log	98.0	392	1.0970	0.2120	1.0970	1.0474
No log	98.5	394	1.0967	0.2120	1.0967	1.0472
No log	99.0	396	1.0963	0.2120	1.0963	1.0471
No log	99.5	398	1.0961	0.2120	1.0961	1.0469
No log	100.0	400	1.0960	0.2120	1.0960	1.0469

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1