ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0222
• Qwk: 0.6335
• Mse: 1.0222
• Rmse: 1.0111

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.3316	0.0077	2.3316	1.5270
No log	0.0755	4	1.6751	0.1489	1.6751	1.2943
No log	0.1132	6	1.6469	0.0324	1.6469	1.2833
No log	0.1509	8	1.5856	0.1838	1.5856	1.2592
No log	0.1887	10	1.4754	0.1466	1.4754	1.2147
No log	0.2264	12	1.3812	0.1952	1.3812	1.1753
No log	0.2642	14	1.3660	0.1921	1.3660	1.1688
No log	0.3019	16	1.3758	0.1608	1.3758	1.1730
No log	0.3396	18	1.4226	0.1128	1.4226	1.1927
No log	0.3774	20	1.4571	0.1381	1.4571	1.2071
No log	0.4151	22	1.4981	0.1107	1.4981	1.2240
No log	0.4528	24	1.4793	0.1107	1.4793	1.2163
No log	0.4906	26	1.3914	0.1675	1.3914	1.1796
No log	0.5283	28	1.3246	0.1740	1.3246	1.1509
No log	0.5660	30	1.3019	0.2180	1.3019	1.1410
No log	0.6038	32	1.2756	0.2459	1.2756	1.1294
No log	0.6415	34	1.2492	0.2459	1.2492	1.1177
No log	0.6792	36	1.2356	0.2886	1.2356	1.1116
No log	0.7170	38	1.2489	0.3024	1.2489	1.1176
No log	0.7547	40	1.2542	0.2772	1.2542	1.1199
No log	0.7925	42	1.2376	0.2388	1.2376	1.1125
No log	0.8302	44	1.2600	0.2481	1.2600	1.1225
No log	0.8679	46	1.2583	0.3066	1.2583	1.1217
No log	0.9057	48	1.2487	0.3541	1.2487	1.1175
No log	0.9434	50	1.2281	0.3798	1.2281	1.1082
No log	0.9811	52	1.2014	0.3569	1.2014	1.0961
No log	1.0189	54	1.2116	0.3831	1.2116	1.1007
No log	1.0566	56	1.2406	0.3192	1.2406	1.1138
No log	1.0943	58	1.1894	0.4018	1.1894	1.0906
No log	1.1321	60	1.1550	0.3483	1.1550	1.0747
No log	1.1698	62	1.1423	0.3723	1.1423	1.0688
No log	1.2075	64	1.1379	0.3441	1.1379	1.0667
No log	1.2453	66	1.1624	0.2966	1.1624	1.0782
No log	1.2830	68	1.1656	0.2668	1.1656	1.0796
No log	1.3208	70	1.1524	0.2424	1.1524	1.0735
No log	1.3585	72	1.1528	0.3093	1.1528	1.0737
No log	1.3962	74	1.1340	0.2859	1.1340	1.0649
No log	1.4340	76	1.1314	0.2530	1.1314	1.0637
No log	1.4717	78	1.1127	0.2530	1.1127	1.0548
No log	1.5094	80	1.0757	0.2945	1.0757	1.0372
No log	1.5472	82	1.0447	0.3881	1.0447	1.0221
No log	1.5849	84	1.0206	0.5241	1.0206	1.0102
No log	1.6226	86	1.0300	0.4529	1.0300	1.0149
No log	1.6604	88	1.0167	0.4350	1.0167	1.0083
No log	1.6981	90	1.0122	0.4492	1.0122	1.0061
No log	1.7358	92	1.0076	0.4850	1.0076	1.0038
No log	1.7736	94	1.0314	0.4980	1.0314	1.0156
No log	1.8113	96	1.0347	0.4663	1.0347	1.0172
No log	1.8491	98	1.0830	0.4353	1.0830	1.0407
No log	1.8868	100	1.0665	0.4445	1.0665	1.0327
No log	1.9245	102	1.0077	0.4753	1.0077	1.0039
No log	1.9623	104	0.9634	0.5226	0.9634	0.9815
No log	2.0	106	0.9686	0.4938	0.9686	0.9842
No log	2.0377	108	0.9831	0.4677	0.9831	0.9915
No log	2.0755	110	1.0866	0.4807	1.0866	1.0424
No log	2.1132	112	1.0946	0.5183	1.0946	1.0462
No log	2.1509	114	0.9635	0.5073	0.9635	0.9816
No log	2.1887	116	0.9414	0.5605	0.9414	0.9702
No log	2.2264	118	0.9742	0.5259	0.9742	0.9870
No log	2.2642	120	0.9299	0.5664	0.9299	0.9643
No log	2.3019	122	0.8985	0.5342	0.8985	0.9479
No log	2.3396	124	0.9646	0.5147	0.9646	0.9821
No log	2.3774	126	1.1810	0.4863	1.1810	1.0868
No log	2.4151	128	1.3138	0.4783	1.3138	1.1462
No log	2.4528	130	1.2498	0.5114	1.2498	1.1180
No log	2.4906	132	1.1652	0.5309	1.1652	1.0795
No log	2.5283	134	1.0451	0.5142	1.0451	1.0223
No log	2.5660	136	0.9641	0.5122	0.9641	0.9819
No log	2.6038	138	0.9706	0.4916	0.9706	0.9852
No log	2.6415	140	0.9400	0.5015	0.9400	0.9695
No log	2.6792	142	0.9622	0.5459	0.9622	0.9809
No log	2.7170	144	1.0441	0.5516	1.0441	1.0218
No log	2.7547	146	1.1112	0.5860	1.1112	1.0541
No log	2.7925	148	1.0172	0.6050	1.0172	1.0085
No log	2.8302	150	0.9663	0.6158	0.9663	0.9830
No log	2.8679	152	1.0168	0.5764	1.0168	1.0084
No log	2.9057	154	0.9929	0.5909	0.9929	0.9964
No log	2.9434	156	1.0130	0.5729	1.0130	1.0065
No log	2.9811	158	1.1386	0.5690	1.1386	1.0670
No log	3.0189	160	1.2433	0.5725	1.2433	1.1150
No log	3.0566	162	1.4297	0.5344	1.4297	1.1957
No log	3.0943	164	1.3745	0.5328	1.3745	1.1724
No log	3.1321	166	1.1660	0.5288	1.1660	1.0798
No log	3.1698	168	0.9947	0.5348	0.9947	0.9974
No log	3.2075	170	0.8956	0.5285	0.8956	0.9463
No log	3.2453	172	0.9180	0.5397	0.9180	0.9581
No log	3.2830	174	1.0893	0.5324	1.0893	1.0437
No log	3.3208	176	1.1898	0.5593	1.1898	1.0908
No log	3.3585	178	1.1965	0.5744	1.1965	1.0938
No log	3.3962	180	1.0322	0.6026	1.0322	1.0160
No log	3.4340	182	0.9590	0.6362	0.9590	0.9793
No log	3.4717	184	0.9889	0.6296	0.9889	0.9944
No log	3.5094	186	1.1318	0.6046	1.1318	1.0639
No log	3.5472	188	1.1429	0.6006	1.1429	1.0691
No log	3.5849	190	1.0712	0.6106	1.0712	1.0350
No log	3.6226	192	1.0458	0.6270	1.0458	1.0226
No log	3.6604	194	1.1257	0.5980	1.1257	1.0610
No log	3.6981	196	1.1001	0.5956	1.1001	1.0489
No log	3.7358	198	1.0994	0.5937	1.0994	1.0485
No log	3.7736	200	1.1601	0.6011	1.1601	1.0771
No log	3.8113	202	1.0524	0.6294	1.0524	1.0258
No log	3.8491	204	0.9213	0.5994	0.9213	0.9598
No log	3.8868	206	0.9380	0.5909	0.9380	0.9685
No log	3.9245	208	0.9455	0.5886	0.9455	0.9723
No log	3.9623	210	1.0397	0.6431	1.0397	1.0197
No log	4.0	212	0.9882	0.6275	0.9882	0.9941
No log	4.0377	214	1.0307	0.6187	1.0307	1.0152
No log	4.0755	216	0.9702	0.6163	0.9702	0.9850
No log	4.1132	218	0.9857	0.5982	0.9857	0.9928
No log	4.1509	220	0.9811	0.5930	0.9811	0.9905
No log	4.1887	222	0.9771	0.6119	0.9771	0.9885
No log	4.2264	224	0.9485	0.6065	0.9485	0.9739
No log	4.2642	226	0.8932	0.5894	0.8932	0.9451
No log	4.3019	228	0.9310	0.6115	0.9310	0.9649
No log	4.3396	230	0.9370	0.6359	0.9370	0.9680
No log	4.3774	232	0.9826	0.6370	0.9826	0.9913
No log	4.4151	234	0.9556	0.6427	0.9556	0.9775
No log	4.4528	236	0.9900	0.6234	0.9900	0.9950
No log	4.4906	238	0.9365	0.6312	0.9365	0.9678
No log	4.5283	240	0.8282	0.6711	0.8282	0.9100
No log	4.5660	242	0.7684	0.6468	0.7684	0.8766
No log	4.6038	244	0.7824	0.6874	0.7824	0.8845
No log	4.6415	246	0.9061	0.6417	0.9061	0.9519
No log	4.6792	248	1.2023	0.6124	1.2023	1.0965
No log	4.7170	250	1.4086	0.5570	1.4086	1.1869
No log	4.7547	252	1.3357	0.5604	1.3357	1.1557
No log	4.7925	254	1.1439	0.5765	1.1439	1.0695
No log	4.8302	256	0.9967	0.6385	0.9967	0.9984
No log	4.8679	258	0.8909	0.6406	0.8909	0.9439
No log	4.9057	260	0.8979	0.6410	0.8979	0.9476
No log	4.9434	262	1.0241	0.6286	1.0241	1.0120
No log	4.9811	264	1.2708	0.5887	1.2708	1.1273
No log	5.0189	266	1.4567	0.5052	1.4567	1.2069
No log	5.0566	268	1.3809	0.5042	1.3809	1.1751
No log	5.0943	270	1.2070	0.5138	1.2070	1.0986
No log	5.1321	272	1.0432	0.5624	1.0432	1.0214
No log	5.1698	274	0.9160	0.5745	0.9160	0.9571
No log	5.2075	276	0.9070	0.5745	0.9070	0.9524
No log	5.2453	278	0.8846	0.5913	0.8846	0.9405
No log	5.2830	280	0.9094	0.6025	0.9094	0.9536
No log	5.3208	282	0.9651	0.6097	0.9651	0.9824
No log	5.3585	284	0.9517	0.6126	0.9517	0.9756
No log	5.3962	286	0.9462	0.6017	0.9462	0.9727
No log	5.4340	288	0.9631	0.6225	0.9631	0.9814
No log	5.4717	290	0.9504	0.6097	0.9504	0.9749
No log	5.5094	292	0.9144	0.6207	0.9144	0.9562
No log	5.5472	294	0.9920	0.6311	0.9920	0.9960
No log	5.5849	296	1.0666	0.5972	1.0666	1.0328
No log	5.6226	298	1.1454	0.6101	1.1454	1.0702
No log	5.6604	300	1.1026	0.6153	1.1026	1.0501
No log	5.6981	302	1.1239	0.6168	1.1239	1.0602
No log	5.7358	304	1.1710	0.6125	1.1710	1.0821
No log	5.7736	306	1.1175	0.6338	1.1175	1.0571
No log	5.8113	308	1.0007	0.6257	1.0007	1.0004
No log	5.8491	310	0.9445	0.6605	0.9445	0.9719
No log	5.8868	312	0.9673	0.6451	0.9673	0.9835
No log	5.9245	314	1.0453	0.6253	1.0453	1.0224
No log	5.9623	316	1.1228	0.6002	1.1228	1.0596
No log	6.0	318	1.2747	0.5758	1.2747	1.1290
No log	6.0377	320	1.3309	0.5610	1.3309	1.1536
No log	6.0755	322	1.2957	0.5610	1.2957	1.1383
No log	6.1132	324	1.2066	0.5887	1.2066	1.0984
No log	6.1509	326	1.0986	0.6049	1.0986	1.0482
No log	6.1887	328	1.0364	0.6128	1.0364	1.0180
No log	6.2264	330	0.9671	0.6385	0.9671	0.9834
No log	6.2642	332	0.9018	0.6548	0.9018	0.9496
No log	6.3019	334	0.9309	0.6505	0.9309	0.9648
No log	6.3396	336	1.0042	0.6368	1.0042	1.0021
No log	6.3774	338	1.0577	0.6413	1.0577	1.0284
No log	6.4151	340	1.0236	0.6327	1.0236	1.0118
No log	6.4528	342	0.9550	0.6275	0.9550	0.9772
No log	6.4906	344	0.8921	0.6422	0.8921	0.9445
No log	6.5283	346	0.8492	0.6414	0.8492	0.9215
No log	6.5660	348	0.8787	0.6350	0.8787	0.9374
No log	6.6038	350	0.9530	0.6289	0.9530	0.9762
No log	6.6415	352	1.0474	0.6230	1.0474	1.0234
No log	6.6792	354	1.0738	0.6128	1.0738	1.0362
No log	6.7170	356	1.1143	0.5976	1.1143	1.0556
No log	6.7547	358	1.1574	0.5767	1.1574	1.0758
No log	6.7925	360	1.1644	0.5767	1.1644	1.0791
No log	6.8302	362	1.0890	0.5988	1.0890	1.0436
No log	6.8679	364	1.0304	0.6067	1.0304	1.0151
No log	6.9057	366	1.0187	0.6067	1.0187	1.0093
No log	6.9434	368	1.0162	0.6023	1.0162	1.0081
No log	6.9811	370	1.0105	0.6067	1.0105	1.0053
No log	7.0189	372	1.0230	0.6084	1.0230	1.0114
No log	7.0566	374	1.0296	0.6041	1.0296	1.0147
No log	7.0943	376	1.0547	0.6041	1.0547	1.0270
No log	7.1321	378	1.0202	0.6067	1.0202	1.0101
No log	7.1698	380	0.9920	0.6158	0.9920	0.9960
No log	7.2075	382	1.0107	0.6158	1.0107	1.0053
No log	7.2453	384	1.0049	0.6093	1.0049	1.0025
No log	7.2830	386	0.9907	0.6027	0.9907	0.9954
No log	7.3208	388	1.0239	0.6158	1.0239	1.0119
No log	7.3585	390	1.0324	0.6356	1.0324	1.0161
No log	7.3962	392	1.0410	0.6174	1.0410	1.0203
No log	7.4340	394	1.0737	0.6032	1.0737	1.0362
No log	7.4717	396	1.1458	0.6040	1.1458	1.0704
No log	7.5094	398	1.2122	0.5933	1.2122	1.1010
No log	7.5472	400	1.2540	0.5688	1.2540	1.1198
No log	7.5849	402	1.2007	0.5982	1.2007	1.0958
No log	7.6226	404	1.0867	0.5980	1.0867	1.0425
No log	7.6604	406	0.9868	0.6228	0.9868	0.9934
No log	7.6981	408	0.9410	0.6439	0.9410	0.9700
No log	7.7358	410	0.9492	0.6439	0.9492	0.9743
No log	7.7736	412	0.9834	0.6415	0.9834	0.9917
No log	7.8113	414	1.0582	0.6252	1.0582	1.0287
No log	7.8491	416	1.1192	0.6054	1.1192	1.0579
No log	7.8868	418	1.1507	0.5921	1.1507	1.0727
No log	7.9245	420	1.1291	0.5949	1.1291	1.0626
No log	7.9623	422	1.0903	0.5909	1.0903	1.0442
No log	8.0	424	1.0644	0.5952	1.0644	1.0317
No log	8.0377	426	1.0007	0.6225	1.0007	1.0003
No log	8.0755	428	0.9702	0.6269	0.9702	0.9850
No log	8.1132	430	0.9722	0.6269	0.9722	0.9860
No log	8.1509	432	0.9792	0.6269	0.9792	0.9895
No log	8.1887	434	1.0004	0.6197	1.0004	1.0002
No log	8.2264	436	1.0534	0.6179	1.0534	1.0263
No log	8.2642	438	1.0954	0.5899	1.0954	1.0466
No log	8.3019	440	1.1105	0.5919	1.1105	1.0538
No log	8.3396	442	1.0899	0.5899	1.0899	1.0440
No log	8.3774	444	1.0686	0.5953	1.0686	1.0337
No log	8.4151	446	1.0541	0.5851	1.0541	1.0267
No log	8.4528	448	1.0017	0.6293	1.0017	1.0009
No log	8.4906	450	0.9575	0.6259	0.9575	0.9785
No log	8.5283	452	0.9332	0.6459	0.9332	0.9660
No log	8.5660	454	0.9203	0.6459	0.9203	0.9593
No log	8.6038	456	0.9415	0.6471	0.9415	0.9703
No log	8.6415	458	0.9706	0.6330	0.9706	0.9852
No log	8.6792	460	0.9939	0.6548	0.9939	0.9969
No log	8.7170	462	1.0392	0.6330	1.0392	1.0194
No log	8.7547	464	1.0680	0.6221	1.0680	1.0335
No log	8.7925	466	1.0701	0.6221	1.0701	1.0345
No log	8.8302	468	1.0401	0.6362	1.0401	1.0199
No log	8.8679	470	0.9994	0.6672	0.9994	0.9997
No log	8.9057	472	0.9896	0.6587	0.9896	0.9948
No log	8.9434	474	0.9742	0.6587	0.9742	0.9870
No log	8.9811	476	0.9637	0.6587	0.9637	0.9817
No log	9.0189	478	0.9443	0.6527	0.9443	0.9718
No log	9.0566	480	0.9456	0.6516	0.9456	0.9724
No log	9.0943	482	0.9604	0.6527	0.9604	0.9800
No log	9.1321	484	0.9871	0.6705	0.9871	0.9935
No log	9.1698	486	1.0175	0.6424	1.0175	1.0087
No log	9.2075	488	1.0592	0.6161	1.0592	1.0292
No log	9.2453	490	1.0918	0.6067	1.0918	1.0449
No log	9.2830	492	1.1134	0.6187	1.1134	1.0552
No log	9.3208	494	1.1141	0.6187	1.1141	1.0555
No log	9.3585	496	1.0955	0.6127	1.0955	1.0467
No log	9.3962	498	1.0666	0.6153	1.0666	1.0328
0.3561	9.4340	500	1.0395	0.6368	1.0395	1.0196
0.3561	9.4717	502	1.0180	0.6337	1.0180	1.0090
0.3561	9.5094	504	1.0028	0.6442	1.0028	1.0014
0.3561	9.5472	506	0.9832	0.6353	0.9832	0.9916
0.3561	9.5849	508	0.9677	0.6461	0.9677	0.9837
0.3561	9.6226	510	0.9532	0.6461	0.9532	0.9763
0.3561	9.6604	512	0.9495	0.6426	0.9495	0.9744
0.3561	9.6981	514	0.9549	0.6461	0.9549	0.9772
0.3561	9.7358	516	0.9650	0.6461	0.9650	0.9823
0.3561	9.7736	518	0.9777	0.6353	0.9777	0.9888
0.3561	9.8113	520	0.9903	0.6353	0.9903	0.9952
0.3561	9.8491	522	1.0016	0.6442	1.0016	1.0008
0.3561	9.8868	524	1.0116	0.6540	1.0116	1.0058
0.3561	9.9245	526	1.0183	0.6540	1.0183	1.0091
0.3561	9.9623	528	1.0212	0.6335	1.0212	1.0105
0.3561	10.0	530	1.0222	0.6335	1.0222	1.0111

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1