ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0363
• Qwk: 0.6078
• Mse: 1.0363
• Rmse: 1.0180

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.4302	-0.0410	2.4302	1.5589
No log	0.0755	4	1.7563	0.0317	1.7563	1.3252
No log	0.1132	6	1.5756	0.1301	1.5756	1.2552
No log	0.1509	8	1.7909	0.1240	1.7909	1.3383
No log	0.1887	10	1.8738	-0.0350	1.8738	1.3689
No log	0.2264	12	1.7399	0.0816	1.7399	1.3190
No log	0.2642	14	1.7046	0.0035	1.7046	1.3056
No log	0.3019	16	1.5997	0.0666	1.5997	1.2648
No log	0.3396	18	1.3947	0.1399	1.3947	1.1810
No log	0.3774	20	1.3641	0.2847	1.3641	1.1679
No log	0.4151	22	1.2945	0.2941	1.2945	1.1378
No log	0.4528	24	1.2230	0.3055	1.2230	1.1059
No log	0.4906	26	1.2538	0.3505	1.2538	1.1197
No log	0.5283	28	1.4045	0.4174	1.4045	1.1851
No log	0.5660	30	1.2491	0.4400	1.2491	1.1176
No log	0.6038	32	1.0746	0.4574	1.0746	1.0366
No log	0.6415	34	1.0371	0.5164	1.0371	1.0184
No log	0.6792	36	1.0689	0.4770	1.0689	1.0339
No log	0.7170	38	1.1443	0.4633	1.1443	1.0697
No log	0.7547	40	1.3184	0.4536	1.3184	1.1482
No log	0.7925	42	1.1781	0.4266	1.1781	1.0854
No log	0.8302	44	1.1205	0.4021	1.1205	1.0585
No log	0.8679	46	1.2311	0.3989	1.2311	1.1095
No log	0.9057	48	1.2360	0.3836	1.2360	1.1118
No log	0.9434	50	1.3699	0.4282	1.3699	1.1704
No log	0.9811	52	1.4021	0.4226	1.4021	1.1841
No log	1.0189	54	1.3713	0.4550	1.3713	1.1710
No log	1.0566	56	1.2177	0.4214	1.2177	1.1035
No log	1.0943	58	1.0999	0.4427	1.0999	1.0487
No log	1.1321	60	1.0938	0.4177	1.0938	1.0458
No log	1.1698	62	1.0838	0.4743	1.0838	1.0410
No log	1.2075	64	1.0917	0.4792	1.0917	1.0448
No log	1.2453	66	1.0907	0.4882	1.0907	1.0444
No log	1.2830	68	1.0764	0.4656	1.0764	1.0375
No log	1.3208	70	1.0616	0.4882	1.0616	1.0304
No log	1.3585	72	1.0530	0.4969	1.0530	1.0262
No log	1.3962	74	1.0792	0.4964	1.0792	1.0389
No log	1.4340	76	1.1312	0.3508	1.1312	1.0636
No log	1.4717	78	1.0449	0.4989	1.0449	1.0222
No log	1.5094	80	1.0420	0.5003	1.0420	1.0208
No log	1.5472	82	1.1392	0.5265	1.1392	1.0673
No log	1.5849	84	1.1088	0.5324	1.1088	1.0530
No log	1.6226	86	0.9729	0.5049	0.9729	0.9864
No log	1.6604	88	0.9582	0.5417	0.9582	0.9789
No log	1.6981	90	0.9527	0.5417	0.9527	0.9760
No log	1.7358	92	0.9367	0.5346	0.9367	0.9679
No log	1.7736	94	1.0324	0.5438	1.0324	1.0161
No log	1.8113	96	1.2827	0.5513	1.2827	1.1325
No log	1.8491	98	1.1980	0.5881	1.1980	1.0945
No log	1.8868	100	0.9640	0.5627	0.9640	0.9818
No log	1.9245	102	0.9529	0.5903	0.9529	0.9762
No log	1.9623	104	1.2070	0.5842	1.2070	1.0986
No log	2.0	106	1.2955	0.5671	1.2955	1.1382
No log	2.0377	108	1.1418	0.5924	1.1418	1.0686
No log	2.0755	110	0.9641	0.6214	0.9641	0.9819
No log	2.1132	112	0.8799	0.6105	0.8799	0.9380
No log	2.1509	114	1.0243	0.6174	1.0243	1.0121
No log	2.1887	116	1.2645	0.5546	1.2645	1.1245
No log	2.2264	118	1.4145	0.4787	1.4145	1.1893
No log	2.2642	120	1.3666	0.4947	1.3666	1.1690
No log	2.3019	122	1.1818	0.5724	1.1818	1.0871
No log	2.3396	124	0.9426	0.5842	0.9426	0.9709
No log	2.3774	126	0.8459	0.5564	0.8459	0.9197
No log	2.4151	128	0.8408	0.5714	0.8408	0.9170
No log	2.4528	130	0.8351	0.6081	0.8351	0.9138
No log	2.4906	132	1.0113	0.6009	1.0113	1.0056
No log	2.5283	134	1.2023	0.5817	1.2023	1.0965
No log	2.5660	136	1.2259	0.5640	1.2259	1.1072
No log	2.6038	138	1.0219	0.6087	1.0219	1.0109
No log	2.6415	140	0.8703	0.5855	0.8703	0.9329
No log	2.6792	142	0.8269	0.6270	0.8269	0.9093
No log	2.7170	144	0.8249	0.6289	0.8249	0.9083
No log	2.7547	146	0.8470	0.5806	0.8470	0.9203
No log	2.7925	148	1.0118	0.5743	1.0118	1.0059
No log	2.8302	150	1.2112	0.5701	1.2112	1.1006
No log	2.8679	152	1.2582	0.5734	1.2582	1.1217
No log	2.9057	154	1.0787	0.6155	1.0787	1.0386
No log	2.9434	156	0.9624	0.6146	0.9624	0.9810
No log	2.9811	158	0.9412	0.6144	0.9412	0.9702
No log	3.0189	160	1.0742	0.6313	1.0742	1.0364
No log	3.0566	162	1.2465	0.6003	1.2465	1.1165
No log	3.0943	164	1.3394	0.5771	1.3394	1.1573
No log	3.1321	166	1.3418	0.5666	1.3418	1.1584
No log	3.1698	168	1.4277	0.5512	1.4277	1.1949
No log	3.2075	170	1.2315	0.5824	1.2315	1.1097
No log	3.2453	172	0.9606	0.6161	0.9606	0.9801
No log	3.2830	174	0.9599	0.5996	0.9599	0.9798
No log	3.3208	176	1.0525	0.5899	1.0525	1.0259
No log	3.3585	178	1.1245	0.5945	1.1245	1.0604
No log	3.3962	180	1.2313	0.5303	1.2313	1.1096
No log	3.4340	182	1.1273	0.5734	1.1273	1.0618
No log	3.4717	184	0.9835	0.6135	0.9835	0.9917
No log	3.5094	186	0.9900	0.6135	0.9900	0.9950
No log	3.5472	188	1.0336	0.5963	1.0336	1.0167
No log	3.5849	190	1.1962	0.5371	1.1962	1.0937
No log	3.6226	192	1.2395	0.4973	1.2395	1.1133
No log	3.6604	194	1.2303	0.5460	1.2303	1.1092
No log	3.6981	196	1.1334	0.5998	1.1334	1.0646
No log	3.7358	198	0.9102	0.6757	0.9102	0.9541
No log	3.7736	200	0.7982	0.6944	0.7982	0.8934
No log	3.8113	202	0.8178	0.6809	0.8178	0.9043
No log	3.8491	204	0.9400	0.6713	0.9400	0.9695
No log	3.8868	206	1.0763	0.6284	1.0763	1.0375
No log	3.9245	208	1.1081	0.6038	1.1081	1.0526
No log	3.9623	210	0.9669	0.6385	0.9669	0.9833
No log	4.0	212	0.8500	0.6935	0.8500	0.9219
No log	4.0377	214	0.7846	0.6803	0.7846	0.8858
No log	4.0755	216	0.8015	0.6925	0.8015	0.8952
No log	4.1132	218	0.9150	0.6597	0.9150	0.9566
No log	4.1509	220	1.1898	0.5640	1.1898	1.0908
No log	4.1887	222	1.3311	0.5514	1.3311	1.1537
No log	4.2264	224	1.3020	0.5683	1.3020	1.1410
No log	4.2642	226	1.1722	0.5545	1.1722	1.0827
No log	4.3019	228	1.0330	0.6398	1.0330	1.0164
No log	4.3396	230	1.0151	0.6400	1.0151	1.0075
No log	4.3774	232	1.0820	0.6341	1.0820	1.0402
No log	4.4151	234	1.1860	0.5621	1.1860	1.0890
No log	4.4528	236	1.2744	0.5646	1.2744	1.1289
No log	4.4906	238	1.2716	0.5603	1.2716	1.1277
No log	4.5283	240	1.2830	0.5603	1.2830	1.1327
No log	4.5660	242	1.3492	0.5725	1.3492	1.1616
No log	4.6038	244	1.2578	0.5694	1.2578	1.1215
No log	4.6415	246	1.1130	0.6086	1.1130	1.0550
No log	4.6792	248	1.0841	0.6082	1.0841	1.0412
No log	4.7170	250	1.1667	0.5814	1.1667	1.0801
No log	4.7547	252	1.2211	0.5693	1.2211	1.1050
No log	4.7925	254	1.2389	0.5640	1.2389	1.1131
No log	4.8302	256	1.1695	0.5701	1.1695	1.0815
No log	4.8679	258	1.1006	0.5764	1.1006	1.0491
No log	4.9057	260	0.9476	0.6317	0.9476	0.9735
No log	4.9434	262	0.9033	0.6729	0.9033	0.9504
No log	4.9811	264	0.9478	0.6533	0.9478	0.9735
No log	5.0189	266	1.0436	0.6379	1.0436	1.0215
No log	5.0566	268	1.2215	0.5793	1.2215	1.1052
No log	5.0943	270	1.2330	0.5783	1.2330	1.1104
No log	5.1321	272	1.0740	0.6004	1.0740	1.0363
No log	5.1698	274	0.9131	0.6668	0.9131	0.9556
No log	5.2075	276	0.8763	0.6860	0.8763	0.9361
No log	5.2453	278	0.9404	0.6580	0.9404	0.9698
No log	5.2830	280	1.0659	0.6090	1.0659	1.0324
No log	5.3208	282	1.1211	0.5880	1.1211	1.0588
No log	5.3585	284	1.0942	0.5963	1.0942	1.0461
No log	5.3962	286	0.9803	0.6580	0.9803	0.9901
No log	5.4340	288	0.8855	0.6515	0.8855	0.9410
No log	5.4717	290	0.8930	0.6553	0.8930	0.9450
No log	5.5094	292	0.9527	0.6341	0.9527	0.9761
No log	5.5472	294	0.9695	0.6492	0.9695	0.9846
No log	5.5849	296	1.0308	0.6378	1.0308	1.0153
No log	5.6226	298	1.1114	0.5945	1.1114	1.0542
No log	5.6604	300	1.2154	0.5518	1.2154	1.1024
No log	5.6981	302	1.3346	0.5460	1.3346	1.1553
No log	5.7358	304	1.3624	0.5551	1.3624	1.1672
No log	5.7736	306	1.2886	0.5675	1.2886	1.1352
No log	5.8113	308	1.1931	0.5599	1.1931	1.0923
No log	5.8491	310	1.1026	0.6093	1.1026	1.0500
No log	5.8868	312	1.1412	0.5965	1.1412	1.0683
No log	5.9245	314	1.2277	0.5351	1.2277	1.1080
No log	5.9623	316	1.3514	0.5310	1.3514	1.1625
No log	6.0	318	1.3759	0.5310	1.3759	1.1730
No log	6.0377	320	1.2830	0.5351	1.2830	1.1327
No log	6.0755	322	1.1644	0.5559	1.1644	1.0791
No log	6.1132	324	1.0581	0.5812	1.0581	1.0286
No log	6.1509	326	1.0478	0.5812	1.0478	1.0236
No log	6.1887	328	1.1057	0.5690	1.1057	1.0515
No log	6.2264	330	1.1475	0.5490	1.1475	1.0712
No log	6.2642	332	1.1650	0.5592	1.1650	1.0793
No log	6.3019	334	1.0894	0.5560	1.0894	1.0438
No log	6.3396	336	1.0346	0.6068	1.0346	1.0171
No log	6.3774	338	0.9968	0.6278	0.9968	0.9984
No log	6.4151	340	1.0454	0.6150	1.0454	1.0224
No log	6.4528	342	1.0914	0.5880	1.0914	1.0447
No log	6.4906	344	1.2011	0.5745	1.2011	1.0960
No log	6.5283	346	1.2223	0.5481	1.2223	1.1056
No log	6.5660	348	1.1730	0.5457	1.1730	1.0830
No log	6.6038	350	1.1069	0.5806	1.1069	1.0521
No log	6.6415	352	1.0698	0.6213	1.0698	1.0343
No log	6.6792	354	1.0659	0.6214	1.0659	1.0324
No log	6.7170	356	1.0669	0.6303	1.0669	1.0329
No log	6.7547	358	1.0685	0.6215	1.0685	1.0337
No log	6.7925	360	1.0353	0.6317	1.0353	1.0175
No log	6.8302	362	0.9474	0.6358	0.9474	0.9734
No log	6.8679	364	0.9071	0.6759	0.9071	0.9524
No log	6.9057	366	0.9317	0.6569	0.9317	0.9652
No log	6.9434	368	0.9964	0.6334	0.9964	0.9982
No log	6.9811	370	1.0861	0.5723	1.0861	1.0421
No log	7.0189	372	1.2370	0.5377	1.2370	1.1122
No log	7.0566	374	1.3867	0.5323	1.3867	1.1776
No log	7.0943	376	1.4184	0.5248	1.4184	1.1910
No log	7.1321	378	1.3390	0.5184	1.3390	1.1572
No log	7.1698	380	1.1876	0.5490	1.1876	1.0898
No log	7.2075	382	1.0861	0.5887	1.0861	1.0422
No log	7.2453	384	1.0568	0.5887	1.0568	1.0280
No log	7.2830	386	1.0704	0.5887	1.0704	1.0346
No log	7.3208	388	1.0800	0.5723	1.0800	1.0392
No log	7.3585	390	1.0707	0.6170	1.0707	1.0348
No log	7.3962	392	1.0766	0.6233	1.0766	1.0376
No log	7.4340	394	1.0797	0.6256	1.0797	1.0391
No log	7.4717	396	1.0445	0.6374	1.0445	1.0220
No log	7.5094	398	1.0360	0.6374	1.0360	1.0178
No log	7.5472	400	1.0109	0.6312	1.0109	1.0054
No log	7.5849	402	1.0079	0.6065	1.0079	1.0039
No log	7.6226	404	1.0282	0.6193	1.0282	1.0140
No log	7.6604	406	1.0635	0.6136	1.0635	1.0313
No log	7.6981	408	1.1076	0.6185	1.1076	1.0524
No log	7.7358	410	1.1154	0.6055	1.1154	1.0561
No log	7.7736	412	1.0630	0.6073	1.0630	1.0310
No log	7.8113	414	1.0090	0.6170	1.0090	1.0045
No log	7.8491	416	1.0029	0.6293	1.0029	1.0015
No log	7.8868	418	1.0158	0.6293	1.0158	1.0079
No log	7.9245	420	1.0681	0.6021	1.0681	1.0335
No log	7.9623	422	1.0985	0.6136	1.0985	1.0481
No log	8.0	424	1.1307	0.6068	1.1307	1.0634
No log	8.0377	426	1.1399	0.6025	1.1399	1.0677
No log	8.0755	428	1.1015	0.6068	1.1015	1.0495
No log	8.1132	430	1.0502	0.5955	1.0502	1.0248
No log	8.1509	432	0.9955	0.6248	0.9955	0.9977
No log	8.1887	434	0.9726	0.6471	0.9726	0.9862
No log	8.2264	436	0.9688	0.6471	0.9688	0.9843
No log	8.2642	438	0.9520	0.6550	0.9520	0.9757
No log	8.3019	440	0.9458	0.6640	0.9458	0.9725
No log	8.3396	442	0.9620	0.6399	0.9620	0.9808
No log	8.3774	444	0.9905	0.6483	0.9905	0.9953
No log	8.4151	446	1.0095	0.6387	1.0095	1.0048
No log	8.4528	448	1.0225	0.6140	1.0225	1.0112
No log	8.4906	450	1.0379	0.6140	1.0379	1.0188
No log	8.5283	452	1.0316	0.6140	1.0316	1.0157
No log	8.5660	454	1.0140	0.6234	1.0140	1.0070
No log	8.6038	456	1.0047	0.6218	1.0047	1.0024
No log	8.6415	458	1.0144	0.6218	1.0144	1.0072
No log	8.6792	460	1.0325	0.6122	1.0325	1.0161
No log	8.7170	462	1.0497	0.5911	1.0497	1.0246
No log	8.7547	464	1.0745	0.5977	1.0745	1.0366
No log	8.7925	466	1.0744	0.5977	1.0744	1.0365
No log	8.8302	468	1.0539	0.5955	1.0539	1.0266
No log	8.8679	470	1.0426	0.5955	1.0426	1.0211
No log	8.9057	472	1.0480	0.5955	1.0480	1.0237
No log	8.9434	474	1.0566	0.5955	1.0566	1.0279
No log	8.9811	476	1.0582	0.5955	1.0582	1.0287
No log	9.0189	478	1.0786	0.6136	1.0786	1.0386
No log	9.0566	480	1.1037	0.5928	1.1037	1.0506
No log	9.0943	482	1.1223	0.5723	1.1223	1.0594
No log	9.1321	484	1.1230	0.5723	1.1230	1.0597
No log	9.1698	486	1.1084	0.5897	1.1084	1.0528
No log	9.2075	488	1.0854	0.5897	1.0854	1.0418
No log	9.2453	490	1.0570	0.5955	1.0570	1.0281
No log	9.2830	492	1.0353	0.6078	1.0353	1.0175
No log	9.3208	494	1.0183	0.6170	1.0183	1.0091
No log	9.3585	496	1.0200	0.6170	1.0200	1.0100
No log	9.3962	498	1.0309	0.6170	1.0309	1.0153
0.32	9.4340	500	1.0434	0.5878	1.0434	1.0215
0.32	9.4717	502	1.0485	0.5878	1.0485	1.0240
0.32	9.5094	504	1.0613	0.5832	1.0613	1.0302
0.32	9.5472	506	1.0766	0.5897	1.0766	1.0376
0.32	9.5849	508	1.0836	0.5897	1.0836	1.0410
0.32	9.6226	510	1.0804	0.5897	1.0804	1.0394
0.32	9.6604	512	1.0771	0.5897	1.0771	1.0378
0.32	9.6981	514	1.0670	0.5832	1.0670	1.0330
0.32	9.7358	516	1.0535	0.5878	1.0535	1.0264
0.32	9.7736	518	1.0436	0.5955	1.0436	1.0215
0.32	9.8113	520	1.0381	0.6078	1.0381	1.0189
0.32	9.8491	522	1.0347	0.6078	1.0347	1.0172
0.32	9.8868	524	1.0344	0.6078	1.0344	1.0171
0.32	9.9245	526	1.0357	0.6078	1.0357	1.0177
0.32	9.9623	528	1.0360	0.6078	1.0360	1.0178
0.32	10.0	530	1.0363	0.6078	1.0363	1.0180

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1