ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0521
• Qwk: 0.5859
• Mse: 1.0521
• Rmse: 1.0257

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	2.3141	-0.0137	2.3141	1.5212
No log	0.0727	4	1.6485	0.0792	1.6485	1.2840
No log	0.1091	6	1.5193	0.1495	1.5193	1.2326
No log	0.1455	8	1.4558	0.1661	1.4558	1.2065
No log	0.1818	10	1.3869	0.1475	1.3869	1.1777
No log	0.2182	12	1.3849	0.1475	1.3849	1.1768
No log	0.2545	14	1.3854	0.1475	1.3854	1.1770
No log	0.2909	16	1.4663	0.1704	1.4663	1.2109
No log	0.3273	18	1.5421	0.2134	1.5421	1.2418
No log	0.3636	20	1.6098	0.3187	1.6098	1.2688
No log	0.4	22	1.7509	0.3282	1.7509	1.3232
No log	0.4364	24	1.7281	0.3012	1.7281	1.3146
No log	0.4727	26	1.5883	0.3480	1.5883	1.2603
No log	0.5091	28	1.4772	0.2885	1.4772	1.2154
No log	0.5455	30	1.3890	0.3162	1.3890	1.1786
No log	0.5818	32	1.3453	0.2767	1.3453	1.1599
No log	0.6182	34	1.3289	0.2863	1.3289	1.1528
No log	0.6545	36	1.3375	0.2874	1.3375	1.1565
No log	0.6909	38	1.4424	0.3234	1.4424	1.2010
No log	0.7273	40	1.4647	0.3123	1.4647	1.2102
No log	0.7636	42	1.6116	0.3490	1.6116	1.2695
No log	0.8	44	1.7742	0.2985	1.7742	1.3320
No log	0.8364	46	1.6220	0.3313	1.6220	1.2736
No log	0.8727	48	1.2930	0.3018	1.2930	1.1371
No log	0.9091	50	1.2213	0.2531	1.2213	1.1051
No log	0.9455	52	1.2141	0.3100	1.2141	1.1018
No log	0.9818	54	1.4354	0.3658	1.4354	1.1981
No log	1.0182	56	1.8004	0.3230	1.8004	1.3418
No log	1.0545	58	1.8259	0.3519	1.8259	1.3512
No log	1.0909	60	1.5410	0.4019	1.5410	1.2414
No log	1.1273	62	1.2611	0.3738	1.2611	1.1230
No log	1.1636	64	1.1891	0.3051	1.1891	1.0905
No log	1.2	66	1.1344	0.3399	1.1344	1.0651
No log	1.2364	68	1.0806	0.3763	1.0806	1.0395
No log	1.2727	70	1.0761	0.3984	1.0761	1.0373
No log	1.3091	72	1.3165	0.4381	1.3165	1.1474
No log	1.3455	74	1.8515	0.3290	1.8515	1.3607
No log	1.3818	76	1.9525	0.3708	1.9525	1.3973
No log	1.4182	78	1.5781	0.4146	1.5781	1.2562
No log	1.4545	80	1.1944	0.4466	1.1944	1.0929
No log	1.4909	82	1.1324	0.4633	1.1324	1.0641
No log	1.5273	84	1.1360	0.4474	1.1360	1.0658
No log	1.5636	86	1.1389	0.4467	1.1389	1.0672
No log	1.6	88	1.2028	0.4319	1.2028	1.0967
No log	1.6364	90	1.3962	0.3878	1.3962	1.1816
No log	1.6727	92	1.5349	0.3808	1.5349	1.2389
No log	1.7091	94	1.4180	0.3916	1.4180	1.1908
No log	1.7455	96	1.2708	0.4184	1.2708	1.1273
No log	1.7818	98	1.1507	0.4699	1.1507	1.0727
No log	1.8182	100	1.0878	0.4856	1.0878	1.0430
No log	1.8545	102	1.0776	0.5044	1.0776	1.0381
No log	1.8909	104	1.0456	0.5272	1.0456	1.0225
No log	1.9273	106	1.1393	0.5273	1.1393	1.0674
No log	1.9636	108	1.4679	0.4891	1.4679	1.2116
No log	2.0	110	1.8379	0.4237	1.8379	1.3557
No log	2.0364	112	1.8756	0.4199	1.8756	1.3695
No log	2.0727	114	1.6363	0.4743	1.6363	1.2792
No log	2.1091	116	1.2163	0.5197	1.2163	1.1028
No log	2.1455	118	0.9485	0.5408	0.9485	0.9739
No log	2.1818	120	0.9048	0.5429	0.9048	0.9512
No log	2.2182	122	0.8940	0.5584	0.8940	0.9455
No log	2.2545	124	0.9089	0.5802	0.9089	0.9533
No log	2.2909	126	1.0145	0.5547	1.0145	1.0072
No log	2.3273	128	1.0843	0.5191	1.0843	1.0413
No log	2.3636	130	1.2221	0.5032	1.2221	1.1055
No log	2.4	132	1.4276	0.4839	1.4276	1.1948
No log	2.4364	134	1.4406	0.4606	1.4406	1.2002
No log	2.4727	136	1.2563	0.5127	1.2563	1.1208
No log	2.5091	138	1.1489	0.4583	1.1489	1.0719
No log	2.5455	140	1.1524	0.4568	1.1524	1.0735
No log	2.5818	142	1.2217	0.4462	1.2217	1.1053
No log	2.6182	144	1.3226	0.4851	1.3226	1.1500
No log	2.6545	146	1.3185	0.4700	1.3185	1.1483
No log	2.6909	148	1.2330	0.4713	1.2330	1.1104
No log	2.7273	150	1.1103	0.4709	1.1103	1.0537
No log	2.7636	152	1.0311	0.4572	1.0311	1.0154
No log	2.8	154	1.0052	0.5060	1.0052	1.0026
No log	2.8364	156	0.9649	0.5590	0.9649	0.9823
No log	2.8727	158	0.9613	0.5890	0.9613	0.9804
No log	2.9091	160	0.9586	0.5890	0.9586	0.9791
No log	2.9455	162	0.9332	0.6086	0.9332	0.9660
No log	2.9818	164	0.8997	0.6182	0.8997	0.9485
No log	3.0182	166	0.8658	0.6622	0.8658	0.9305
No log	3.0545	168	0.9000	0.6586	0.9000	0.9487
No log	3.0909	170	1.0123	0.6322	1.0123	1.0061
No log	3.1273	172	1.1926	0.5917	1.1926	1.0921
No log	3.1636	174	1.1724	0.5827	1.1724	1.0828
No log	3.2	176	1.0510	0.6101	1.0510	1.0252
No log	3.2364	178	0.9325	0.6364	0.9325	0.9657
No log	3.2727	180	0.9142	0.6364	0.9142	0.9561
No log	3.3091	182	1.0261	0.5838	1.0261	1.0129
No log	3.3455	184	1.2762	0.5458	1.2762	1.1297
No log	3.3818	186	1.4754	0.5195	1.4754	1.2147
No log	3.4182	188	1.5076	0.5113	1.5076	1.2279
No log	3.4545	190	1.3951	0.5368	1.3951	1.1811
No log	3.4909	192	1.1969	0.5735	1.1969	1.0940
No log	3.5273	194	1.0743	0.5874	1.0743	1.0365
No log	3.5636	196	1.0848	0.5828	1.0848	1.0415
No log	3.6	198	1.2024	0.5552	1.2024	1.0966
No log	3.6364	200	1.3083	0.5340	1.3083	1.1438
No log	3.6727	202	1.2693	0.5458	1.2693	1.1266
No log	3.7091	204	1.1508	0.5800	1.1508	1.0727
No log	3.7455	206	1.1334	0.5928	1.1334	1.0646
No log	3.7818	208	1.0640	0.5982	1.0640	1.0315
No log	3.8182	210	0.9540	0.6290	0.9540	0.9767
No log	3.8545	212	0.8506	0.6562	0.8506	0.9223
No log	3.8909	214	0.8386	0.6562	0.8386	0.9158
No log	3.9273	216	0.9363	0.6414	0.9363	0.9676
No log	3.9636	218	1.0328	0.6261	1.0328	1.0163
No log	4.0	220	1.1216	0.6064	1.1216	1.0590
No log	4.0364	222	1.2626	0.5774	1.2626	1.1237
No log	4.0727	224	1.2378	0.5685	1.2378	1.1125
No log	4.1091	226	1.1746	0.6064	1.1746	1.0838
No log	4.1455	228	1.0977	0.6261	1.0977	1.0477
No log	4.1818	230	1.0795	0.6080	1.0795	1.0390
No log	4.2182	232	1.1074	0.5998	1.1074	1.0524
No log	4.2545	234	1.1304	0.5872	1.1304	1.0632
No log	4.2909	236	1.1073	0.6088	1.1073	1.0523
No log	4.3273	238	1.0329	0.6246	1.0329	1.0163
No log	4.3636	240	0.9910	0.6411	0.9910	0.9955
No log	4.4	242	0.9750	0.6398	0.9750	0.9874
No log	4.4364	244	0.9782	0.6435	0.9782	0.9890
No log	4.4727	246	1.0794	0.6334	1.0794	1.0390
No log	4.5091	248	1.2089	0.5890	1.2089	1.0995
No log	4.5455	250	1.2174	0.5880	1.2174	1.1034
No log	4.5818	252	1.1680	0.6010	1.1680	1.0807
No log	4.6182	254	1.0477	0.6280	1.0477	1.0236
No log	4.6545	256	1.0030	0.6172	1.0030	1.0015
No log	4.6909	258	0.9921	0.5860	0.9921	0.9960
No log	4.7273	260	1.0207	0.5860	1.0207	1.0103
No log	4.7636	262	1.1045	0.5856	1.1045	1.0510
No log	4.8	264	1.1280	0.5997	1.1280	1.0621
No log	4.8364	266	1.0979	0.6168	1.0979	1.0478
No log	4.8727	268	1.0134	0.6374	1.0134	1.0067
No log	4.9091	270	1.0026	0.6421	1.0026	1.0013
No log	4.9455	272	0.9792	0.6317	0.9792	0.9895
No log	4.9818	274	0.9994	0.5903	0.9994	0.9997
No log	5.0182	276	1.0676	0.5367	1.0676	1.0332
No log	5.0545	278	1.0373	0.5462	1.0373	1.0185
No log	5.0909	280	1.0356	0.5576	1.0356	1.0177
No log	5.1273	282	1.0245	0.5734	1.0245	1.0122
No log	5.1636	284	0.9683	0.6037	0.9683	0.9840
No log	5.2	286	0.9360	0.6408	0.9360	0.9675
No log	5.2364	288	0.9607	0.6245	0.9607	0.9801
No log	5.2727	290	0.9828	0.6339	0.9828	0.9913
No log	5.3091	292	0.9988	0.6280	0.9988	0.9994
No log	5.3455	294	1.0625	0.5756	1.0625	1.0308
No log	5.3818	296	1.0550	0.5811	1.0550	1.0271
No log	5.4182	298	1.0020	0.6237	1.0020	1.0010
No log	5.4545	300	0.9407	0.6414	0.9407	0.9699
No log	5.4909	302	0.9543	0.6339	0.9543	0.9769
No log	5.5273	304	0.9521	0.6339	0.9521	0.9757
No log	5.5636	306	0.9107	0.6505	0.9107	0.9543
No log	5.6	308	0.9261	0.6461	0.9261	0.9624
No log	5.6364	310	0.9811	0.6266	0.9811	0.9905
No log	5.6727	312	0.9487	0.6295	0.9487	0.9740
No log	5.7091	314	0.9299	0.6200	0.9299	0.9643
No log	5.7455	316	0.9121	0.6325	0.9121	0.9551
No log	5.7818	318	0.9886	0.6052	0.9886	0.9943
No log	5.8182	320	1.0720	0.5769	1.0720	1.0354
No log	5.8545	322	1.0673	0.5769	1.0673	1.0331
No log	5.8909	324	1.0451	0.5769	1.0451	1.0223
No log	5.9273	326	1.0679	0.5889	1.0679	1.0334
No log	5.9636	328	1.1301	0.5693	1.1301	1.0631
No log	6.0	330	1.1301	0.5853	1.1301	1.0631
No log	6.0364	332	1.0735	0.6070	1.0735	1.0361
No log	6.0727	334	1.0122	0.6193	1.0122	1.0061
No log	6.1091	336	0.9857	0.6172	0.9857	0.9928
No log	6.1455	338	0.9947	0.6237	0.9947	0.9974
No log	6.1818	340	0.9556	0.6172	0.9556	0.9775
No log	6.2182	342	0.8728	0.6626	0.8728	0.9342
No log	6.2545	344	0.8532	0.6543	0.8532	0.9237
No log	6.2909	346	0.9049	0.6433	0.9049	0.9513
No log	6.3273	348	1.0461	0.6334	1.0461	1.0228
No log	6.3636	350	1.1638	0.5873	1.1638	1.0788
No log	6.4	352	1.1849	0.5873	1.1849	1.0885
No log	6.4364	354	1.0867	0.6029	1.0867	1.0425
No log	6.4727	356	0.9335	0.6310	0.9335	0.9662
No log	6.5091	358	0.8587	0.6696	0.8587	0.9267
No log	6.5455	360	0.8656	0.6651	0.8656	0.9304
No log	6.5818	362	0.9354	0.6310	0.9354	0.9672
No log	6.6182	364	1.0773	0.6049	1.0773	1.0379
No log	6.6545	366	1.1866	0.5695	1.1866	1.0893
No log	6.6909	368	1.1757	0.5705	1.1757	1.0843
No log	6.7273	370	1.0722	0.6052	1.0722	1.0354
No log	6.7636	372	0.9577	0.6186	0.9577	0.9786
No log	6.8	374	0.8899	0.6356	0.8899	0.9433
No log	6.8364	376	0.8720	0.6420	0.8720	0.9338
No log	6.8727	378	0.9158	0.6265	0.9158	0.9570
No log	6.9091	380	0.9336	0.6250	0.9336	0.9662
No log	6.9455	382	0.9200	0.6080	0.9200	0.9592
No log	6.9818	384	0.9447	0.6153	0.9447	0.9720
No log	7.0182	386	0.9880	0.6241	0.9880	0.9940
No log	7.0545	388	1.0089	0.5988	1.0089	1.0045
No log	7.0909	390	0.9710	0.6241	0.9710	0.9854
No log	7.1273	392	0.9137	0.6348	0.9137	0.9559
No log	7.1636	394	0.8821	0.6406	0.8821	0.9392
No log	7.2	396	0.9045	0.6494	0.9045	0.9510
No log	7.2364	398	0.9668	0.6115	0.9668	0.9833
No log	7.2727	400	1.0639	0.5937	1.0639	1.0314
No log	7.3091	402	1.1729	0.5615	1.1729	1.0830
No log	7.3455	404	1.2333	0.5629	1.2333	1.1106
No log	7.3818	406	1.2280	0.5529	1.2280	1.1081
No log	7.4182	408	1.1574	0.5601	1.1574	1.0758
No log	7.4545	410	1.0506	0.5893	1.0506	1.0250
No log	7.4909	412	0.9895	0.6087	0.9895	0.9947
No log	7.5273	414	0.9750	0.6207	0.9750	0.9874
No log	7.5636	416	0.9947	0.6271	0.9947	0.9974
No log	7.6	418	1.0444	0.5937	1.0444	1.0220
No log	7.6364	420	1.1157	0.5768	1.1157	1.0562
No log	7.6727	422	1.1973	0.5638	1.1973	1.0942
No log	7.7091	424	1.2029	0.5681	1.2029	1.0967
No log	7.7455	426	1.1701	0.5681	1.1701	1.0817
No log	7.7818	428	1.1154	0.5911	1.1154	1.0561
No log	7.8182	430	1.0722	0.6122	1.0722	1.0355
No log	7.8545	432	1.0733	0.6122	1.0733	1.0360
No log	7.8909	434	1.0883	0.5982	1.0883	1.0432
No log	7.9273	436	1.1085	0.5690	1.1085	1.0528
No log	7.9636	438	1.1025	0.5690	1.1025	1.0500
No log	8.0	440	1.0834	0.5859	1.0834	1.0409
No log	8.0364	442	1.0703	0.5712	1.0703	1.0346
No log	8.0727	444	1.0341	0.5688	1.0341	1.0169
No log	8.1091	446	0.9834	0.6125	0.9834	0.9917
No log	8.1455	448	0.9459	0.6332	0.9459	0.9726
No log	8.1818	450	0.9445	0.6332	0.9445	0.9719
No log	8.2182	452	0.9616	0.6204	0.9616	0.9806
No log	8.2545	454	1.0030	0.5872	1.0030	1.0015
No log	8.2909	456	1.0532	0.5757	1.0532	1.0263
No log	8.3273	458	1.0913	0.5814	1.0913	1.0447
No log	8.3636	460	1.0946	0.5814	1.0946	1.0462
No log	8.4	462	1.0815	0.5859	1.0815	1.0400
No log	8.4364	464	1.0553	0.5859	1.0553	1.0273
No log	8.4727	466	1.0074	0.5960	1.0074	1.0037
No log	8.5091	468	0.9843	0.5985	0.9843	0.9921
No log	8.5455	470	0.9809	0.6047	0.9809	0.9904
No log	8.5818	472	0.9713	0.6047	0.9713	0.9856
No log	8.6182	474	0.9749	0.6047	0.9749	0.9874
No log	8.6545	476	0.9825	0.6047	0.9825	0.9912
No log	8.6909	478	0.9897	0.5920	0.9897	0.9948
No log	8.7273	480	1.0000	0.5746	1.0000	1.0000
No log	8.7636	482	1.0077	0.5816	1.0077	1.0039
No log	8.8	484	0.9913	0.5746	0.9913	0.9956
No log	8.8364	486	0.9826	0.5920	0.9826	0.9913
No log	8.8727	488	0.9626	0.6174	0.9626	0.9811
No log	8.9091	490	0.9444	0.6089	0.9444	0.9718
No log	8.9455	492	0.9428	0.6189	0.9428	0.9710
No log	8.9818	494	0.9552	0.6174	0.9552	0.9773
No log	9.0182	496	0.9814	0.5860	0.9814	0.9907
No log	9.0545	498	1.0002	0.5903	1.0002	1.0001
0.2898	9.0909	500	1.0137	0.5859	1.0137	1.0068
0.2898	9.1273	502	1.0238	0.5859	1.0238	1.0118
0.2898	9.1636	504	1.0326	0.5859	1.0326	1.0162
0.2898	9.2	506	1.0245	0.5859	1.0245	1.0122
0.2898	9.2364	508	1.0084	0.5903	1.0084	1.0042
0.2898	9.2727	510	0.9883	0.6207	0.9883	0.9941
0.2898	9.3091	512	0.9799	0.6207	0.9799	0.9899
0.2898	9.3455	514	0.9803	0.6207	0.9803	0.9901
0.2898	9.3818	516	0.9776	0.6207	0.9776	0.9887
0.2898	9.4182	518	0.9820	0.6207	0.9820	0.9910
0.2898	9.4545	520	0.9939	0.6207	0.9939	0.9970
0.2898	9.4909	522	1.0104	0.6026	1.0104	1.0052
0.2898	9.5273	524	1.0265	0.5903	1.0265	1.0132
0.2898	9.5636	526	1.0434	0.5859	1.0434	1.0215
0.2898	9.6	528	1.0591	0.5859	1.0591	1.0291
0.2898	9.6364	530	1.0684	0.5814	1.0684	1.0336
0.2898	9.6727	532	1.0788	0.5814	1.0788	1.0387
0.2898	9.7091	534	1.0787	0.5814	1.0787	1.0386
0.2898	9.7455	536	1.0745	0.5814	1.0745	1.0366
0.2898	9.7818	538	1.0693	0.5814	1.0693	1.0340
0.2898	9.8182	540	1.0626	0.5814	1.0626	1.0308
0.2898	9.8545	542	1.0594	0.5814	1.0594	1.0293
0.2898	9.8909	544	1.0565	0.5814	1.0565	1.0279
0.2898	9.9273	546	1.0541	0.5814	1.0541	1.0267
0.2898	9.9636	548	1.0525	0.5859	1.0525	1.0259
0.2898	10.0	550	1.0521	0.5859	1.0521	1.0257

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1