ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9779
• Qwk: 0.6476
• Mse: 0.9779
• Rmse: 0.9889

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.2430	0.0523	2.2430	1.4977
No log	0.0755	4	1.7621	0.1069	1.7621	1.3274
No log	0.1132	6	1.3105	0.2255	1.3105	1.1448
No log	0.1509	8	1.7065	0.1720	1.7065	1.3063
No log	0.1887	10	1.9304	0.1787	1.9304	1.3894
No log	0.2264	12	2.1002	0.1700	2.1002	1.4492
No log	0.2642	14	1.9657	0.2537	1.9657	1.4020
No log	0.3019	16	1.6929	0.1570	1.6929	1.3011
No log	0.3396	18	1.5200	0.0645	1.5200	1.2329
No log	0.3774	20	1.4612	0.0645	1.4612	1.2088
No log	0.4151	22	1.4386	0.0600	1.4386	1.1994
No log	0.4528	24	1.4147	0.0930	1.4147	1.1894
No log	0.4906	26	1.4140	0.0554	1.4140	1.1891
No log	0.5283	28	1.4397	0.2308	1.4397	1.1999
No log	0.5660	30	1.4223	0.2552	1.4223	1.1926
No log	0.6038	32	1.5102	0.3548	1.5102	1.2289
No log	0.6415	34	1.5159	0.3224	1.5159	1.2312
No log	0.6792	36	1.3776	0.2942	1.3776	1.1737
No log	0.7170	38	1.3109	0.2892	1.3109	1.1450
No log	0.7547	40	1.3006	0.3544	1.3006	1.1404
No log	0.7925	42	1.2886	0.3315	1.2886	1.1352
No log	0.8302	44	1.2910	0.3536	1.2910	1.1362
No log	0.8679	46	1.2704	0.3867	1.2704	1.1271
No log	0.9057	48	1.2577	0.3628	1.2577	1.1215
No log	0.9434	50	1.2766	0.3193	1.2766	1.1299
No log	0.9811	52	1.2629	0.3987	1.2629	1.1238
No log	1.0189	54	1.3089	0.4291	1.3089	1.1441
No log	1.0566	56	1.2932	0.4286	1.2932	1.1372
No log	1.0943	58	1.3439	0.4465	1.3439	1.1593
No log	1.1321	60	1.1663	0.4894	1.1663	1.0799
No log	1.1698	62	1.1218	0.4631	1.1218	1.0592
No log	1.2075	64	1.1105	0.4985	1.1105	1.0538
No log	1.2453	66	1.0954	0.5223	1.0954	1.0466
No log	1.2830	68	1.0794	0.5218	1.0794	1.0389
No log	1.3208	70	1.0637	0.5145	1.0637	1.0314
No log	1.3585	72	1.1698	0.4875	1.1698	1.0816
No log	1.3962	74	1.3132	0.4569	1.3132	1.1459
No log	1.4340	76	1.2530	0.4709	1.2530	1.1194
No log	1.4717	78	1.2995	0.4461	1.2995	1.1399
No log	1.5094	80	1.3705	0.4536	1.3705	1.1707
No log	1.5472	82	1.3961	0.4447	1.3961	1.1816
No log	1.5849	84	1.3473	0.4879	1.3473	1.1607
No log	1.6226	86	1.2069	0.5073	1.2069	1.0986
No log	1.6604	88	1.3805	0.5000	1.3805	1.1750
No log	1.6981	90	1.6949	0.4480	1.6949	1.3019
No log	1.7358	92	1.5144	0.4876	1.5144	1.2306
No log	1.7736	94	1.1641	0.5732	1.1641	1.0790
No log	1.8113	96	1.0492	0.5778	1.0492	1.0243
No log	1.8491	98	1.2181	0.5115	1.2181	1.1037
No log	1.8868	100	1.1914	0.5185	1.1914	1.0915
No log	1.9245	102	1.1945	0.4966	1.1945	1.0929
No log	1.9623	104	1.1182	0.5128	1.1182	1.0575
No log	2.0	106	0.9202	0.5097	0.9202	0.9593
No log	2.0377	108	0.8739	0.6121	0.8739	0.9348
No log	2.0755	110	0.8747	0.5693	0.8747	0.9353
No log	2.1132	112	1.0405	0.5757	1.0405	1.0200
No log	2.1509	114	1.1669	0.5944	1.1669	1.0802
No log	2.1887	116	1.0031	0.6485	1.0031	1.0016
No log	2.2264	118	0.8872	0.6180	0.8872	0.9419
No log	2.2642	120	0.8918	0.6408	0.8918	0.9443
No log	2.3019	122	1.0404	0.6436	1.0404	1.0200
No log	2.3396	124	1.3274	0.5808	1.3274	1.1521
No log	2.3774	126	1.2591	0.6073	1.2591	1.1221
No log	2.4151	128	1.0498	0.6420	1.0498	1.0246
No log	2.4528	130	0.8662	0.6644	0.8662	0.9307
No log	2.4906	132	0.8337	0.6323	0.8337	0.9131
No log	2.5283	134	0.9285	0.6095	0.9285	0.9636
No log	2.5660	136	1.1745	0.5567	1.1745	1.0837
No log	2.6038	138	1.2536	0.5356	1.2536	1.1196
No log	2.6415	140	1.3731	0.5245	1.3731	1.1718
No log	2.6792	142	1.2984	0.5085	1.2984	1.1395
No log	2.7170	144	1.0521	0.5197	1.0521	1.0257
No log	2.7547	146	0.9636	0.6136	0.9636	0.9816
No log	2.7925	148	1.0421	0.5503	1.0421	1.0208
No log	2.8302	150	1.2836	0.5230	1.2836	1.1330
No log	2.8679	152	1.3947	0.5254	1.3947	1.1810
No log	2.9057	154	1.4283	0.5354	1.4283	1.1951
No log	2.9434	156	1.3380	0.5521	1.3380	1.1567
No log	2.9811	158	1.0478	0.6080	1.0478	1.0236
No log	3.0189	160	0.9736	0.6159	0.9736	0.9867
No log	3.0566	162	1.0859	0.5903	1.0859	1.0421
No log	3.0943	164	1.2694	0.5569	1.2694	1.1267
No log	3.1321	166	1.3014	0.5707	1.3014	1.1408
No log	3.1698	168	1.1300	0.6040	1.1300	1.0630
No log	3.2075	170	1.0048	0.6446	1.0048	1.0024
No log	3.2453	172	0.9270	0.6677	0.9270	0.9628
No log	3.2830	174	1.0122	0.6615	1.0122	1.0061
No log	3.3208	176	1.1876	0.5974	1.1876	1.0898
No log	3.3585	178	1.2102	0.5471	1.2102	1.1001
No log	3.3962	180	1.1885	0.5704	1.1885	1.0902
No log	3.4340	182	1.0973	0.6229	1.0973	1.0475
No log	3.4717	184	1.1070	0.5998	1.1070	1.0521
No log	3.5094	186	1.1932	0.5558	1.1932	1.0923
No log	3.5472	188	1.0768	0.5976	1.0768	1.0377
No log	3.5849	190	1.0621	0.5724	1.0621	1.0306
No log	3.6226	192	1.2224	0.5392	1.2224	1.1056
No log	3.6604	194	1.2498	0.5243	1.2498	1.1180
No log	3.6981	196	1.1972	0.5426	1.1972	1.0942
No log	3.7358	198	0.9859	0.6142	0.9859	0.9929
No log	3.7736	200	0.9013	0.6284	0.9013	0.9494
No log	3.8113	202	0.9729	0.6179	0.9729	0.9864
No log	3.8491	204	0.9836	0.6237	0.9836	0.9918
No log	3.8868	206	1.0590	0.6009	1.0590	1.0291
No log	3.9245	208	1.1889	0.6087	1.1889	1.0904
No log	3.9623	210	1.1994	0.6120	1.1994	1.0952
No log	4.0	212	1.0737	0.6092	1.0737	1.0362
No log	4.0377	214	1.1383	0.6072	1.1383	1.0669
No log	4.0755	216	1.1472	0.5977	1.1472	1.0711
No log	4.1132	218	1.0250	0.6146	1.0250	1.0124
No log	4.1509	220	0.9287	0.6182	0.9287	0.9637
No log	4.1887	222	0.8558	0.6376	0.8558	0.9251
No log	4.2264	224	0.8539	0.6217	0.8539	0.9240
No log	4.2642	226	0.9466	0.6354	0.9466	0.9729
No log	4.3019	228	1.1240	0.6063	1.1240	1.0602
No log	4.3396	230	1.1223	0.6114	1.1223	1.0594
No log	4.3774	232	1.0292	0.6077	1.0292	1.0145
No log	4.4151	234	0.9641	0.6389	0.9641	0.9819
No log	4.4528	236	1.0427	0.6065	1.0427	1.0211
No log	4.4906	238	1.2512	0.5726	1.2512	1.1186
No log	4.5283	240	1.3106	0.5197	1.3106	1.1448
No log	4.5660	242	1.1856	0.5296	1.1856	1.0888
No log	4.6038	244	1.0660	0.5877	1.0660	1.0325
No log	4.6415	246	1.0028	0.5998	1.0028	1.0014
No log	4.6792	248	1.0152	0.6113	1.0152	1.0076
No log	4.7170	250	0.9894	0.6303	0.9894	0.9947
No log	4.7547	252	0.9749	0.6438	0.9749	0.9874
No log	4.7925	254	1.0305	0.6077	1.0305	1.0151
No log	4.8302	256	1.1383	0.6041	1.1383	1.0669
No log	4.8679	258	1.1337	0.6041	1.1337	1.0648
No log	4.9057	260	1.1274	0.6135	1.1274	1.0618
No log	4.9434	262	1.1144	0.6302	1.1144	1.0556
No log	4.9811	264	1.0523	0.6125	1.0523	1.0258
No log	5.0189	266	1.0667	0.6185	1.0667	1.0328
No log	5.0566	268	1.0024	0.6252	1.0024	1.0012
No log	5.0943	270	0.9504	0.6395	0.9504	0.9749
No log	5.1321	272	0.9843	0.6161	0.9843	0.9921
No log	5.1698	274	1.0650	0.5956	1.0650	1.0320
No log	5.2075	276	1.1875	0.5623	1.1875	1.0897
No log	5.2453	278	1.1234	0.6046	1.1234	1.0599
No log	5.2830	280	0.9633	0.6222	0.9633	0.9815
No log	5.3208	282	0.8885	0.6331	0.8885	0.9426
No log	5.3585	284	0.8740	0.6297	0.8740	0.9349
No log	5.3962	286	0.8609	0.6297	0.8609	0.9279
No log	5.4340	288	0.9186	0.6349	0.9186	0.9584
No log	5.4717	290	0.9813	0.6383	0.9813	0.9906
No log	5.5094	292	0.9557	0.6331	0.9557	0.9776
No log	5.5472	294	0.8706	0.6273	0.8706	0.9331
No log	5.5849	296	0.8216	0.6519	0.8216	0.9064
No log	5.6226	298	0.8535	0.6406	0.8535	0.9239
No log	5.6604	300	0.9215	0.6454	0.9215	0.9599
No log	5.6981	302	0.9663	0.6150	0.9663	0.9830
No log	5.7358	304	0.9444	0.6294	0.9444	0.9718
No log	5.7736	306	0.8754	0.6376	0.8754	0.9356
No log	5.8113	308	0.8313	0.6550	0.8313	0.9118
No log	5.8491	310	0.8903	0.6482	0.8903	0.9435
No log	5.8868	312	1.0412	0.6050	1.0412	1.0204
No log	5.9245	314	1.1092	0.6036	1.1092	1.0532
No log	5.9623	316	1.2518	0.5920	1.2518	1.1188
No log	6.0	318	1.3126	0.6032	1.3126	1.1457
No log	6.0377	320	1.2065	0.6154	1.2065	1.0984
No log	6.0755	322	1.0055	0.6449	1.0055	1.0028
No log	6.1132	324	0.8710	0.6662	0.8710	0.9333
No log	6.1509	326	0.8265	0.6765	0.8265	0.9091
No log	6.1887	328	0.8857	0.6670	0.8857	0.9411
No log	6.2264	330	0.9541	0.6492	0.9541	0.9768
No log	6.2642	332	1.1055	0.6121	1.1055	1.0514
No log	6.3019	334	1.2079	0.6048	1.2079	1.0990
No log	6.3396	336	1.1524	0.6016	1.1524	1.0735
No log	6.3774	338	1.0481	0.5777	1.0481	1.0238
No log	6.4151	340	0.9256	0.6366	0.9256	0.9621
No log	6.4528	342	0.8275	0.6803	0.8275	0.9096
No log	6.4906	344	0.8373	0.6774	0.8373	0.9150
No log	6.5283	346	0.9135	0.6352	0.9135	0.9558
No log	6.5660	348	1.0833	0.6311	1.0833	1.0408
No log	6.6038	350	1.1987	0.5913	1.1987	1.0949
No log	6.6415	352	1.1670	0.5965	1.1670	1.0803
No log	6.6792	354	1.0223	0.6280	1.0223	1.0111
No log	6.7170	356	0.8885	0.6381	0.8885	0.9426
No log	6.7547	358	0.8256	0.6528	0.8256	0.9086
No log	6.7925	360	0.8330	0.6512	0.8330	0.9127
No log	6.8302	362	0.8621	0.6497	0.8621	0.9285
No log	6.8679	364	0.9685	0.6427	0.9685	0.9841
No log	6.9057	366	1.1058	0.6259	1.1058	1.0516
No log	6.9434	368	1.2231	0.5913	1.2231	1.1059
No log	6.9811	370	1.2143	0.5959	1.2143	1.1019
No log	7.0189	372	1.2007	0.5959	1.2007	1.0958
No log	7.0566	374	1.1431	0.6109	1.1431	1.0691
No log	7.0943	376	1.0683	0.6338	1.0683	1.0336
No log	7.1321	378	0.9924	0.6321	0.9924	0.9962
No log	7.1698	380	0.9046	0.6335	0.9046	0.9511
No log	7.2075	382	0.7885	0.6741	0.7885	0.8880
No log	7.2453	384	0.7398	0.6943	0.7398	0.8601
No log	7.2830	386	0.7462	0.6982	0.7462	0.8638
No log	7.3208	388	0.7905	0.6550	0.7905	0.8891
No log	7.3585	390	0.8747	0.6435	0.8747	0.9352
No log	7.3962	392	0.9358	0.6505	0.9358	0.9674
No log	7.4340	394	1.0063	0.6447	1.0063	1.0031
No log	7.4717	396	1.0157	0.64	1.0157	1.0078
No log	7.5094	398	0.9483	0.6595	0.9483	0.9738
No log	7.5472	400	0.9035	0.6618	0.9035	0.9505
No log	7.5849	402	0.8734	0.6844	0.8734	0.9346
No log	7.6226	404	0.8410	0.6940	0.8410	0.9171
No log	7.6604	406	0.8714	0.6842	0.8714	0.9335
No log	7.6981	408	0.9220	0.6570	0.9220	0.9602
No log	7.7358	410	0.9377	0.6530	0.9377	0.9683
No log	7.7736	412	0.9302	0.6545	0.9302	0.9645
No log	7.8113	414	0.9038	0.6432	0.9038	0.9507
No log	7.8491	416	0.8923	0.6522	0.8923	0.9446
No log	7.8868	418	0.8676	0.6410	0.8676	0.9315
No log	7.9245	420	0.8403	0.6695	0.8403	0.9167
No log	7.9623	422	0.8566	0.6410	0.8566	0.9256
No log	8.0	424	0.8570	0.6410	0.8570	0.9257
No log	8.0377	426	0.8286	0.6789	0.8286	0.9103
No log	8.0755	428	0.8296	0.6782	0.8296	0.9108
No log	8.1132	430	0.8562	0.6410	0.8562	0.9253
No log	8.1509	432	0.9283	0.6560	0.9283	0.9635
No log	8.1887	434	0.9603	0.6469	0.9603	0.9800
No log	8.2264	436	0.9826	0.6455	0.9826	0.9912
No log	8.2642	438	0.9673	0.6366	0.9673	0.9835
No log	8.3019	440	0.9045	0.6474	0.9045	0.9510
No log	8.3396	442	0.8736	0.6600	0.8736	0.9347
No log	8.3774	444	0.8431	0.6826	0.8431	0.9182
No log	8.4151	446	0.8374	0.6826	0.8374	0.9151
No log	8.4528	448	0.8537	0.6848	0.8537	0.9240
No log	8.4906	450	0.8756	0.6600	0.8756	0.9357
No log	8.5283	452	0.9302	0.6456	0.9302	0.9645
No log	8.5660	454	0.9935	0.6345	0.9935	0.9967
No log	8.6038	456	1.0168	0.6345	1.0168	1.0083
No log	8.6415	458	1.0132	0.6363	1.0132	1.0066
No log	8.6792	460	1.0166	0.6324	1.0166	1.0083
No log	8.7170	462	1.0339	0.6125	1.0339	1.0168
No log	8.7547	464	1.0134	0.6259	1.0134	1.0067
No log	8.7925	466	0.9647	0.6476	0.9647	0.9822
No log	8.8302	468	0.9239	0.6407	0.9239	0.9612
No log	8.8679	470	0.8850	0.6331	0.8850	0.9408
No log	8.9057	472	0.8821	0.6331	0.8821	0.9392
No log	8.9434	474	0.8985	0.6316	0.8985	0.9479
No log	8.9811	476	0.9273	0.6458	0.9273	0.9630
No log	9.0189	478	0.9285	0.6458	0.9285	0.9636
No log	9.0566	480	0.9238	0.6458	0.9238	0.9611
No log	9.0943	482	0.9171	0.6458	0.9171	0.9576
No log	9.1321	484	0.9133	0.6375	0.9133	0.9557
No log	9.1698	486	0.9052	0.6375	0.9052	0.9514
No log	9.2075	488	0.9020	0.6330	0.9020	0.9497
No log	9.2453	490	0.9200	0.6458	0.9200	0.9592
No log	9.2830	492	0.9417	0.6469	0.9417	0.9704
No log	9.3208	494	0.9549	0.6501	0.9549	0.9772
No log	9.3585	496	0.9827	0.6427	0.9827	0.9913
No log	9.3962	498	0.9921	0.6345	0.9921	0.9961
0.3129	9.4340	500	1.0002	0.64	1.0002	1.0001
0.3129	9.4717	502	0.9950	0.6345	0.9950	0.9975
0.3129	9.5094	504	0.9905	0.6345	0.9905	0.9953
0.3129	9.5472	506	0.9875	0.6345	0.9875	0.9937
0.3129	9.5849	508	0.9810	0.6427	0.9810	0.9904
0.3129	9.6226	510	0.9733	0.6486	0.9733	0.9865
0.3129	9.6604	512	0.9655	0.6476	0.9655	0.9826
0.3129	9.6981	514	0.9659	0.6476	0.9659	0.9828
0.3129	9.7358	516	0.9710	0.6476	0.9710	0.9854
0.3129	9.7736	518	0.9740	0.6476	0.9740	0.9869
0.3129	9.8113	520	0.9737	0.6476	0.9737	0.9868
0.3129	9.8491	522	0.9720	0.6476	0.9720	0.9859
0.3129	9.8868	524	0.9722	0.6476	0.9722	0.9860
0.3129	9.9245	526	0.9738	0.6476	0.9738	0.9868
0.3129	9.9623	528	0.9763	0.6476	0.9763	0.9881
0.3129	10.0	530	0.9779	0.6476	0.9779	0.9889

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1