ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9667
• Qwk: 0.6015
• Mse: 0.9667
• Rmse: 0.9832

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0260	2	6.8855	0.0239	6.8855	2.6240
No log	0.0519	4	4.2049	0.0833	4.2049	2.0506
No log	0.0779	6	3.3245	0.0	3.3245	1.8233
No log	0.1039	8	2.1945	0.1045	2.1945	1.4814
No log	0.1299	10	1.7706	0.2456	1.7706	1.3306
No log	0.1558	12	1.7136	0.1607	1.7136	1.3091
No log	0.1818	14	1.6274	0.1818	1.6274	1.2757
No log	0.2078	16	1.6316	0.1538	1.6316	1.2774
No log	0.2338	18	1.6711	0.1538	1.6711	1.2927
No log	0.2597	20	1.7449	0.2143	1.7449	1.3209
No log	0.2857	22	1.9300	0.2712	1.9300	1.3892
No log	0.3117	24	2.2520	0.1277	2.2520	1.5007
No log	0.3377	26	1.9697	0.2946	1.9697	1.4034
No log	0.3636	28	1.5614	0.1852	1.5614	1.2495
No log	0.3896	30	1.4615	0.1869	1.4615	1.2089
No log	0.4156	32	1.4616	0.1714	1.4616	1.2090
No log	0.4416	34	1.4718	0.1346	1.4718	1.2132
No log	0.4675	36	1.4801	0.2056	1.4801	1.2166
No log	0.4935	38	1.4941	0.2759	1.4941	1.2223
No log	0.5195	40	1.3819	0.3009	1.3819	1.1755
No log	0.5455	42	1.3229	0.2832	1.3229	1.1502
No log	0.5714	44	1.3917	0.3866	1.3917	1.1797
No log	0.5974	46	1.4693	0.4355	1.4693	1.2121
No log	0.6234	48	1.3614	0.3932	1.3614	1.1668
No log	0.6494	50	1.3412	0.3761	1.3412	1.1581
No log	0.6753	52	1.3557	0.3529	1.3557	1.1644
No log	0.7013	54	1.4445	0.3167	1.4445	1.2019
No log	0.7273	56	1.8497	0.125	1.8497	1.3600
No log	0.7532	58	1.8922	0.1167	1.8922	1.3756
No log	0.7792	60	1.7514	0.25	1.7514	1.3234
No log	0.8052	62	1.6186	0.3582	1.6186	1.2722
No log	0.8312	64	1.4444	0.4769	1.4444	1.2018
No log	0.8571	66	1.3233	0.5039	1.3233	1.1504
No log	0.8831	68	1.2707	0.4769	1.2707	1.1273
No log	0.9091	70	1.2225	0.4885	1.2225	1.1057
No log	0.9351	72	1.4546	0.4706	1.4546	1.2061
No log	0.9610	74	1.6883	0.2647	1.6883	1.2993
No log	0.9870	76	1.6220	0.3636	1.6220	1.2736
No log	1.0130	78	1.5402	0.3016	1.5402	1.2410
No log	1.0390	80	1.2095	0.4889	1.2095	1.0998
No log	1.0649	82	1.1141	0.6069	1.1141	1.0555
No log	1.0909	84	1.0667	0.6309	1.0667	1.0328
No log	1.1169	86	0.9505	0.6712	0.9505	0.9749
No log	1.1429	88	0.9310	0.6479	0.9310	0.9649
No log	1.1688	90	0.8549	0.6316	0.8549	0.9246
No log	1.1948	92	0.9746	0.6331	0.9746	0.9872
No log	1.2208	94	1.1282	0.5630	1.1282	1.0622
No log	1.2468	96	0.9461	0.5778	0.9461	0.9727
No log	1.2727	98	0.8373	0.7164	0.8373	0.9150
No log	1.2987	100	0.8471	0.6716	0.8471	0.9204
No log	1.3247	102	0.9131	0.6232	0.9131	0.9556
No log	1.3506	104	1.1840	0.5185	1.1840	1.0881
No log	1.3766	106	1.5323	0.4380	1.5323	1.2378
No log	1.4026	108	1.4381	0.4783	1.4381	1.1992
No log	1.4286	110	1.3885	0.4818	1.3885	1.1783
No log	1.4545	112	1.4027	0.4818	1.4027	1.1844
No log	1.4805	114	1.4072	0.5037	1.4072	1.1862
No log	1.5065	116	1.2207	0.5481	1.2207	1.1049
No log	1.5325	118	1.1836	0.4964	1.1836	1.0879
No log	1.5584	120	1.2620	0.4783	1.2620	1.1234
No log	1.5844	122	1.4638	0.4429	1.4638	1.2099
No log	1.6104	124	1.4995	0.4113	1.4995	1.2245
No log	1.6364	126	1.3746	0.4429	1.3746	1.1724
No log	1.6623	128	1.4478	0.4460	1.4478	1.2032
No log	1.6883	130	1.5946	0.3609	1.5946	1.2628
No log	1.7143	132	1.5005	0.4186	1.5005	1.2249
No log	1.7403	134	1.2430	0.5522	1.2430	1.1149
No log	1.7662	136	1.1861	0.5481	1.1861	1.0891
No log	1.7922	138	1.3619	0.4173	1.3619	1.1670
No log	1.8182	140	1.4249	0.4173	1.4249	1.1937
No log	1.8442	142	1.4508	0.4143	1.4508	1.2045
No log	1.8701	144	1.2360	0.5294	1.2360	1.1117
No log	1.8961	146	1.1191	0.5985	1.1191	1.0579
No log	1.9221	148	1.1875	0.5113	1.1875	1.0897
No log	1.9481	150	1.4832	0.4380	1.4832	1.2179
No log	1.9740	152	1.5976	0.2857	1.5976	1.2640
No log	2.0	154	1.5039	0.4203	1.5039	1.2263
No log	2.0260	156	1.2667	0.5441	1.2667	1.1255
No log	2.0519	158	1.0429	0.6187	1.0429	1.0212
No log	2.0779	160	1.0209	0.6294	1.0209	1.0104
No log	2.1039	162	1.1455	0.5839	1.1455	1.0703
No log	2.1299	164	1.4192	0.4493	1.4192	1.1913
No log	2.1558	166	1.6177	0.3885	1.6177	1.2719
No log	2.1818	168	1.5855	0.3714	1.5855	1.2592
No log	2.2078	170	1.4293	0.4526	1.4293	1.1955
No log	2.2338	172	1.0674	0.5606	1.0674	1.0331
No log	2.2597	174	0.9116	0.6522	0.9116	0.9548
No log	2.2857	176	0.9196	0.6522	0.9196	0.9590
No log	2.3117	178	0.9810	0.6338	0.9810	0.9904
No log	2.3377	180	0.9166	0.6429	0.9166	0.9574
No log	2.3636	182	0.9042	0.6383	0.9042	0.9509
No log	2.3896	184	0.8629	0.6806	0.8629	0.9290
No log	2.4156	186	0.8410	0.6806	0.8410	0.9171
No log	2.4416	188	0.9011	0.6763	0.9011	0.9493
No log	2.4675	190	1.0399	0.6131	1.0399	1.0197
No log	2.4935	192	1.0066	0.6412	1.0066	1.0033
No log	2.5195	194	0.9439	0.6316	0.9439	0.9716
No log	2.5455	196	0.9000	0.6429	0.9000	0.9487
No log	2.5714	198	0.9724	0.6259	0.9724	0.9861
No log	2.5974	200	0.9852	0.64	0.9852	0.9926
No log	2.6234	202	1.0737	0.6164	1.0737	1.0362
No log	2.6494	204	1.2529	0.5833	1.2529	1.1193
No log	2.6753	206	1.2920	0.5634	1.2920	1.1366
No log	2.7013	208	1.1587	0.6099	1.1587	1.0764
No log	2.7273	210	1.0633	0.6338	1.0633	1.0312
No log	2.7532	212	1.0999	0.6345	1.0999	1.0487
No log	2.7792	214	1.2554	0.5714	1.2554	1.1205
No log	2.8052	216	1.3931	0.4552	1.3931	1.1803
No log	2.8312	218	1.4046	0.4552	1.4046	1.1852
No log	2.8571	220	1.2285	0.5468	1.2285	1.1084
No log	2.8831	222	1.0374	0.6119	1.0374	1.0185
No log	2.9091	224	0.9927	0.6412	0.9927	0.9964
No log	2.9351	226	0.9969	0.6412	0.9969	0.9984
No log	2.9610	228	1.0567	0.6412	1.0567	1.0280
No log	2.9870	230	1.1527	0.6047	1.1527	1.0736
No log	3.0130	232	1.1813	0.6047	1.1813	1.0869
No log	3.0390	234	1.1343	0.625	1.1343	1.0650
No log	3.0649	236	1.0607	0.6094	1.0607	1.0299
No log	3.0909	238	1.0068	0.6412	1.0068	1.0034
No log	3.1169	240	0.9909	0.6412	0.9909	0.9954
No log	3.1429	242	0.9404	0.6515	0.9404	0.9697
No log	3.1688	244	0.9510	0.6316	0.9510	0.9752
No log	3.1948	246	0.9707	0.6176	0.9707	0.9853
No log	3.2208	248	0.9398	0.6222	0.9398	0.9694
No log	3.2468	250	0.8992	0.6515	0.8992	0.9482
No log	3.2727	252	0.8984	0.6061	0.8984	0.9478
No log	3.2987	254	0.9038	0.6308	0.9038	0.9507
No log	3.3247	256	0.8759	0.6567	0.8759	0.9359
No log	3.3506	258	0.8673	0.6331	0.8673	0.9313
No log	3.3766	260	0.7976	0.6618	0.7976	0.8931
No log	3.4026	262	0.8563	0.6944	0.8563	0.9254
No log	3.4286	264	0.9515	0.5674	0.9515	0.9754
No log	3.4545	266	0.8989	0.5839	0.8989	0.9481
No log	3.4805	268	0.8261	0.7143	0.8261	0.9089
No log	3.5065	270	0.8216	0.6466	0.8216	0.9064
No log	3.5325	272	0.8320	0.6667	0.8320	0.9121
No log	3.5584	274	0.8079	0.6667	0.8079	0.8988
No log	3.5844	276	0.7905	0.6567	0.7905	0.8891
No log	3.6104	278	0.8223	0.6479	0.8223	0.9068
No log	3.6364	280	0.9251	0.6528	0.9251	0.9618
No log	3.6623	282	1.0715	0.5899	1.0715	1.0351
No log	3.6883	284	1.1042	0.5857	1.1042	1.0508
No log	3.7143	286	1.1060	0.5957	1.1060	1.0517
No log	3.7403	288	1.1067	0.6475	1.1067	1.0520
No log	3.7662	290	1.1246	0.5197	1.1246	1.0605
No log	3.7922	292	1.1654	0.3898	1.1654	1.0795
No log	3.8182	294	1.1206	0.4715	1.1206	1.0586
No log	3.8442	296	1.0358	0.6471	1.0358	1.0177
No log	3.8701	298	0.9440	0.6715	0.9440	0.9716
No log	3.8961	300	0.8553	0.6993	0.8553	0.9248
No log	3.9221	302	0.7843	0.7347	0.7843	0.8856
No log	3.9481	304	0.7600	0.7333	0.7600	0.8718
No log	3.9740	306	0.7872	0.6933	0.7872	0.8873
No log	4.0	308	0.9461	0.6623	0.9461	0.9727
No log	4.0260	310	0.9641	0.6711	0.9641	0.9819
No log	4.0519	312	0.9201	0.6755	0.9201	0.9592
No log	4.0779	314	0.8942	0.6755	0.8942	0.9456
No log	4.1039	316	0.8606	0.6622	0.8606	0.9277
No log	4.1299	318	0.8771	0.6800	0.8771	0.9365
No log	4.1558	320	0.9761	0.6579	0.9761	0.9880
No log	4.1818	322	1.0655	0.6536	1.0655	1.0322
No log	4.2078	324	1.0130	0.6711	1.0130	1.0065
No log	4.2338	326	0.8487	0.6968	0.8487	0.9212
No log	4.2597	328	0.8082	0.6914	0.8082	0.8990
No log	4.2857	330	0.8094	0.7284	0.8094	0.8997
No log	4.3117	332	0.8663	0.6923	0.8663	0.9308
No log	4.3377	334	0.9862	0.6711	0.9862	0.9931
No log	4.3636	336	1.1364	0.6316	1.1364	1.0660
No log	4.3896	338	1.1747	0.6184	1.1747	1.0838
No log	4.4156	340	0.9901	0.6711	0.9901	0.9950
No log	4.4416	342	0.9106	0.6622	0.9106	0.9542
No log	4.4675	344	0.8634	0.6712	0.8634	0.9292
No log	4.4935	346	0.8885	0.6573	0.8885	0.9426
No log	4.5195	348	1.0231	0.6294	1.0231	1.0115
No log	4.5455	350	1.1646	0.6027	1.1646	1.0792
No log	4.5714	352	1.1116	0.625	1.1116	1.0543
No log	4.5974	354	0.9936	0.6294	0.9936	0.9968
No log	4.6234	356	0.9480	0.6479	0.9480	0.9736
No log	4.6494	358	0.9919	0.6525	0.9919	0.9959
No log	4.6753	360	1.1083	0.6338	1.1083	1.0528
No log	4.7013	362	1.1406	0.6338	1.1406	1.0680
No log	4.7273	364	1.0349	0.6525	1.0349	1.0173
No log	4.7532	366	0.9723	0.6763	0.9723	0.9860
No log	4.7792	368	0.9378	0.6475	0.9378	0.9684
No log	4.8052	370	0.8429	0.6667	0.8429	0.9181
No log	4.8312	372	0.7931	0.6525	0.7931	0.8905
No log	4.8571	374	0.8053	0.6528	0.8053	0.8974
No log	4.8831	376	0.8902	0.6528	0.8902	0.9435
No log	4.9091	378	1.0219	0.6345	1.0219	1.0109
No log	4.9351	380	1.1149	0.6164	1.1149	1.0559
No log	4.9610	382	1.0540	0.6345	1.0540	1.0267
No log	4.9870	384	0.9127	0.6714	0.9127	0.9554
No log	5.0130	386	0.7873	0.6950	0.7873	0.8873
No log	5.0390	388	0.7705	0.6809	0.7705	0.8778
No log	5.0649	390	0.7751	0.6993	0.7751	0.8804
No log	5.0909	392	0.7541	0.6993	0.7541	0.8684
No log	5.1169	394	0.8470	0.6712	0.8470	0.9203
No log	5.1429	396	0.9782	0.6438	0.9782	0.9890
No log	5.1688	398	0.9821	0.6345	0.9821	0.9910
No log	5.1948	400	0.9419	0.6338	0.9419	0.9705
No log	5.2208	402	0.8709	0.6620	0.8709	0.9332
No log	5.2468	404	0.8404	0.6715	0.8404	0.9168
No log	5.2727	406	0.8571	0.6812	0.8571	0.9258
No log	5.2987	408	0.8787	0.6571	0.8787	0.9374
No log	5.3247	410	0.9116	0.6434	0.9116	0.9548
No log	5.3506	412	0.9178	0.6434	0.9178	0.9580
No log	5.3766	414	0.8836	0.6575	0.8836	0.9400
No log	5.4026	416	0.7854	0.6759	0.7854	0.8862
No log	5.4286	418	0.7608	0.6892	0.7608	0.8722
No log	5.4545	420	0.7616	0.7397	0.7616	0.8727
No log	5.4805	422	0.7827	0.7162	0.7827	0.8847
No log	5.5065	424	0.8525	0.6759	0.8525	0.9233
No log	5.5325	426	1.0459	0.6622	1.0459	1.0227
No log	5.5584	428	1.1962	0.64	1.1962	1.0937
No log	5.5844	430	1.3061	0.6207	1.3061	1.1428
No log	5.6104	432	1.2899	0.625	1.2899	1.1357
No log	5.6364	434	1.2080	0.6143	1.2080	1.0991
No log	5.6623	436	1.1343	0.5985	1.1343	1.0650
No log	5.6883	438	1.0489	0.6061	1.0489	1.0242
No log	5.7143	440	0.9979	0.5802	0.9979	0.9990
No log	5.7403	442	0.9807	0.5802	0.9807	0.9903
No log	5.7662	444	0.9796	0.6714	0.9796	0.9897
No log	5.7922	446	1.0170	0.6338	1.0170	1.0084
No log	5.8182	448	1.0626	0.6338	1.0626	1.0308
No log	5.8442	450	1.0653	0.6338	1.0653	1.0321
No log	5.8701	452	1.0697	0.6338	1.0697	1.0343
No log	5.8961	454	1.0256	0.6338	1.0256	1.0127
No log	5.9221	456	0.9610	0.6525	0.9610	0.9803
No log	5.9481	458	0.8907	0.6525	0.8907	0.9438
No log	5.9740	460	0.8167	0.6957	0.8167	0.9037
No log	6.0	462	0.8009	0.6857	0.8009	0.8949
No log	6.0260	464	0.8713	0.6620	0.8713	0.9335
No log	6.0519	466	0.9333	0.6620	0.9333	0.9661
No log	6.0779	468	0.8971	0.6620	0.8971	0.9472
No log	6.1039	470	0.9019	0.6849	0.9019	0.9497
No log	6.1299	472	0.8923	0.6713	0.8923	0.9446
No log	6.1558	474	0.9054	0.6620	0.9054	0.9515
No log	6.1818	476	0.9278	0.6620	0.9278	0.9632
No log	6.2078	478	0.9682	0.6620	0.9682	0.9840
No log	6.2338	480	0.9139	0.6667	0.9139	0.9560
No log	6.2597	482	0.8557	0.6763	0.8557	0.9251
No log	6.2857	484	0.8601	0.6957	0.8601	0.9274
No log	6.3117	486	0.8773	0.6571	0.8773	0.9367
No log	6.3377	488	0.8720	0.6763	0.8720	0.9338
No log	6.3636	490	0.8409	0.6370	0.8409	0.9170
No log	6.3896	492	0.8649	0.6761	0.8649	0.9300
No log	6.4156	494	0.8465	0.7083	0.8465	0.9201
No log	6.4416	496	0.8326	0.6713	0.8326	0.9124
No log	6.4675	498	0.8798	0.6623	0.8798	0.9380
0.4524	6.4935	500	1.0421	0.6786	1.0421	1.0209
0.4524	6.5195	502	1.1716	0.6707	1.1716	1.0824
0.4524	6.5455	504	1.0944	0.6667	1.0944	1.0462
0.4524	6.5714	506	0.9016	0.6575	0.9016	0.9495
0.4524	6.5974	508	0.7845	0.6759	0.7845	0.8857
0.4524	6.6234	510	0.7573	0.7183	0.7573	0.8703
0.4524	6.6494	512	0.7635	0.6950	0.7635	0.8738
0.4524	6.6753	514	0.7883	0.7092	0.7883	0.8879
0.4524	6.7013	516	0.8492	0.6853	0.8492	0.9215
0.4524	6.7273	518	0.9437	0.6620	0.9437	0.9714
0.4524	6.7532	520	0.9641	0.6620	0.9641	0.9819
0.4524	6.7792	522	0.9237	0.6853	0.9237	0.9611
0.4524	6.8052	524	0.8572	0.6950	0.8572	0.9258
0.4524	6.8312	526	0.8102	0.6713	0.8102	0.9001
0.4524	6.8571	528	0.7770	0.7034	0.7770	0.8815
0.4524	6.8831	530	0.7815	0.7027	0.7815	0.8840
0.4524	6.9091	532	0.8708	0.7215	0.8708	0.9332
0.4524	6.9351	534	1.0124	0.6839	1.0124	1.0062
0.4524	6.9610	536	1.0973	0.625	1.0973	1.0475
0.4524	6.9870	538	1.1201	0.6294	1.1201	1.0583
0.4524	7.0130	540	1.0977	0.6176	1.0977	1.0477
0.4524	7.0390	542	1.0425	0.6015	1.0425	1.0210
0.4524	7.0649	544	0.9667	0.6015	0.9667	0.9832

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1