ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9463
• Qwk: 0.6423
• Mse: 0.9463
• Rmse: 0.9728

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	6.8944	-0.0169	6.8944	2.6257
No log	0.0851	4	3.8887	0.0571	3.8887	1.9720
No log	0.1277	6	2.4780	0.1146	2.4780	1.5742
No log	0.1702	8	1.8315	0.1754	1.8315	1.3533
No log	0.2128	10	1.7146	0.1905	1.7146	1.3094
No log	0.2553	12	1.7617	0.1905	1.7617	1.3273
No log	0.2979	14	2.0241	0.1754	2.0241	1.4227
No log	0.3404	16	2.0670	0.1951	2.0670	1.4377
No log	0.3830	18	2.0819	0.2137	2.0819	1.4429
No log	0.4255	20	2.0155	0.2381	2.0155	1.4197
No log	0.4681	22	1.9095	0.3051	1.9095	1.3818
No log	0.5106	24	1.8580	0.2807	1.8580	1.3631
No log	0.5532	26	1.7563	0.2056	1.7563	1.3252
No log	0.5957	28	1.5677	0.1165	1.5677	1.2521
No log	0.6383	30	1.4202	0.2593	1.4202	1.1917
No log	0.6809	32	1.4374	0.3063	1.4374	1.1989
No log	0.7234	34	1.4611	0.2679	1.4611	1.2087
No log	0.7660	36	1.8992	0.2836	1.8992	1.3781
No log	0.8085	38	1.9674	0.2319	1.9674	1.4026
No log	0.8511	40	1.4549	0.3559	1.4549	1.2062
No log	0.8936	42	1.2801	0.3932	1.2801	1.1314
No log	0.9362	44	1.2449	0.3932	1.2449	1.1157
No log	0.9787	46	1.2277	0.3761	1.2277	1.1080
No log	1.0213	48	1.4493	0.4531	1.4493	1.2039
No log	1.0638	50	1.4998	0.4462	1.4998	1.2247
No log	1.1064	52	1.2346	0.3967	1.2346	1.1111
No log	1.1489	54	1.1690	0.3063	1.1690	1.0812
No log	1.1915	56	1.2176	0.2430	1.2176	1.1035
No log	1.2340	58	1.3803	0.1887	1.3803	1.1749
No log	1.2766	60	1.4227	0.2222	1.4227	1.1928
No log	1.3191	62	1.1863	0.2957	1.1863	1.0892
No log	1.3617	64	1.0028	0.5079	1.0028	1.0014
No log	1.4043	66	0.9687	0.5630	0.9687	0.9842
No log	1.4468	68	1.0830	0.4640	1.0830	1.0407
No log	1.4894	70	1.4500	0.4035	1.4500	1.2042
No log	1.5319	72	1.5075	0.4065	1.5075	1.2278
No log	1.5745	74	1.2700	0.5970	1.2700	1.1269
No log	1.6170	76	1.0486	0.6522	1.0486	1.0240
No log	1.6596	78	0.8839	0.6944	0.8839	0.9401
No log	1.7021	80	0.9916	0.6483	0.9916	0.9958
No log	1.7447	82	0.9336	0.6712	0.9336	0.9662
No log	1.7872	84	0.9605	0.6383	0.9605	0.9801
No log	1.8298	86	1.3849	0.4857	1.3849	1.1768
No log	1.8723	88	1.4608	0.4317	1.4608	1.2087
No log	1.9149	90	1.3535	0.5	1.3535	1.1634
No log	1.9574	92	1.1132	0.5802	1.1132	1.0551
No log	2.0	94	0.9092	0.6222	0.9092	0.9535
No log	2.0426	96	0.8818	0.6418	0.8818	0.9390
No log	2.0851	98	0.9453	0.6015	0.9453	0.9723
No log	2.1277	100	1.2634	0.5	1.2634	1.1240
No log	2.1702	102	1.3973	0.4507	1.3973	1.1821
No log	2.2128	104	1.5098	0.4306	1.5098	1.2287
No log	2.2553	106	1.6026	0.3586	1.6026	1.2659
No log	2.2979	108	1.4548	0.4255	1.4548	1.2062
No log	2.3404	110	1.2397	0.5571	1.2397	1.1134
No log	2.3830	112	1.2531	0.5401	1.2531	1.1194
No log	2.4255	114	1.2921	0.5441	1.2921	1.1367
No log	2.4681	116	1.3070	0.5606	1.3070	1.1432
No log	2.5106	118	1.1154	0.5736	1.1154	1.0561
No log	2.5532	120	0.9289	0.5806	0.9289	0.9638
No log	2.5957	122	0.8536	0.6716	0.8536	0.9239
No log	2.6383	124	0.7875	0.7234	0.7875	0.8874
No log	2.6809	126	0.7671	0.6620	0.7671	0.8758
No log	2.7234	128	1.0194	0.5865	1.0194	1.0097
No log	2.7660	130	1.3404	0.4113	1.3404	1.1578
No log	2.8085	132	1.2924	0.4366	1.2924	1.1368
No log	2.8511	134	1.1457	0.5630	1.1457	1.0704
No log	2.8936	136	1.1021	0.5672	1.1021	1.0498
No log	2.9362	138	1.0498	0.5672	1.0498	1.0246
No log	2.9787	140	1.1310	0.5588	1.1310	1.0635
No log	3.0213	142	1.1998	0.5294	1.1998	1.0954
No log	3.0638	144	1.2836	0.4928	1.2836	1.1329
No log	3.1064	146	1.4836	0.4255	1.4836	1.2180
No log	3.1489	148	1.4921	0.4255	1.4921	1.2215
No log	3.1915	150	1.2162	0.5672	1.2162	1.1028
No log	3.2340	152	1.1424	0.5672	1.1424	1.0688
No log	3.2766	154	1.0570	0.5606	1.0570	1.0281
No log	3.3191	156	1.0415	0.5469	1.0415	1.0205
No log	3.3617	158	0.9517	0.6316	0.9517	0.9755
No log	3.4043	160	0.8334	0.6377	0.8334	0.9129
No log	3.4468	162	0.7979	0.6621	0.7979	0.8933
No log	3.4894	164	1.0488	0.5882	1.0488	1.0241
No log	3.5319	166	1.3457	0.4604	1.3457	1.1600
No log	3.5745	168	1.2259	0.5481	1.2259	1.1072
No log	3.6170	170	0.9567	0.6197	0.9567	0.9781
No log	3.6596	172	0.7544	0.6755	0.7544	0.8685
No log	3.7021	174	0.7634	0.6980	0.7634	0.8737
No log	3.7447	176	0.8659	0.6277	0.8659	0.9305
No log	3.7872	178	1.0997	0.5606	1.0997	1.0487
No log	3.8298	180	1.1870	0.5606	1.1870	1.0895
No log	3.8723	182	1.1351	0.5606	1.1351	1.0654
No log	3.9149	184	0.9954	0.5985	0.9954	0.9977
No log	3.9574	186	0.9431	0.6187	0.9431	0.9711
No log	4.0	188	0.8398	0.6241	0.8398	0.9164
No log	4.0426	190	0.8679	0.6241	0.8679	0.9316
No log	4.0851	192	0.9786	0.6187	0.9786	0.9892
No log	4.1277	194	1.0609	0.5612	1.0609	1.0300
No log	4.1702	196	0.9298	0.6056	0.9298	0.9643
No log	4.2128	198	0.8053	0.6944	0.8053	0.8974
No log	4.2553	200	0.8005	0.6944	0.8005	0.8947
No log	4.2979	202	0.9158	0.6197	0.9158	0.9570
No log	4.3404	204	0.8015	0.6763	0.8015	0.8953
No log	4.3830	206	0.7647	0.7042	0.7647	0.8745
No log	4.4255	208	0.7856	0.7050	0.7856	0.8863
No log	4.4681	210	0.8093	0.6765	0.8093	0.8996
No log	4.5106	212	0.8084	0.6957	0.8084	0.8991
No log	4.5532	214	0.8924	0.6519	0.8924	0.9447
No log	4.5957	216	0.8334	0.6763	0.8334	0.9129
No log	4.6383	218	0.7167	0.7260	0.7167	0.8466
No log	4.6809	220	0.6847	0.7682	0.6847	0.8275
No log	4.7234	222	0.7397	0.6944	0.7397	0.8601
No log	4.7660	224	0.9362	0.6043	0.9362	0.9676
No log	4.8085	226	1.1693	0.5468	1.1693	1.0813
No log	4.8511	228	1.1678	0.5468	1.1678	1.0807
No log	4.8936	230	1.1204	0.5839	1.1204	1.0585
No log	4.9362	232	0.9331	0.6143	0.9331	0.9660
No log	4.9787	234	0.8416	0.6757	0.8416	0.9174
No log	5.0213	236	0.8266	0.6980	0.8266	0.9092
No log	5.0638	238	0.9170	0.6528	0.9170	0.9576
No log	5.1064	240	0.9888	0.6	0.9888	0.9944
No log	5.1489	242	0.8756	0.6536	0.8756	0.9357
No log	5.1915	244	0.6809	0.7368	0.6809	0.8252
No log	5.2340	246	0.6618	0.7260	0.6618	0.8135
No log	5.2766	248	0.6484	0.7075	0.6484	0.8053
No log	5.3191	250	0.6700	0.7333	0.6700	0.8185
No log	5.3617	252	0.7221	0.7383	0.7221	0.8498
No log	5.4043	254	0.7687	0.7383	0.7687	0.8768
No log	5.4468	256	0.7415	0.7383	0.7415	0.8611
No log	5.4894	258	0.6436	0.7692	0.6436	0.8022
No log	5.5319	260	0.6131	0.7771	0.6131	0.7830
No log	5.5745	262	0.6834	0.7516	0.6834	0.8267
No log	5.6170	264	0.8453	0.7375	0.8453	0.9194
No log	5.6596	266	1.1770	0.6026	1.1770	1.0849
No log	5.7021	268	1.3406	0.5166	1.3406	1.1578
No log	5.7447	270	1.2218	0.5522	1.2218	1.1054
No log	5.7872	272	0.9811	0.6571	0.9811	0.9905
No log	5.8298	274	0.8178	0.7034	0.8178	0.9043
No log	5.8723	276	0.8138	0.7114	0.8138	0.9021
No log	5.9149	278	0.7791	0.72	0.7791	0.8826
No log	5.9574	280	0.7396	0.7843	0.7396	0.8600
No log	6.0	282	0.8398	0.7034	0.8398	0.9164
No log	6.0426	284	1.1451	0.5612	1.1451	1.0701
No log	6.0851	286	1.3022	0.5235	1.3022	1.1411
No log	6.1277	288	1.1860	0.5987	1.1860	1.0891
No log	6.1702	290	0.9689	0.6538	0.9689	0.9843
No log	6.2128	292	0.8472	0.6621	0.8472	0.9204
No log	6.2553	294	0.7959	0.6573	0.7959	0.8921
No log	6.2979	296	0.7290	0.7568	0.7290	0.8538
No log	6.3404	298	0.7327	0.7483	0.7327	0.8560
No log	6.3830	300	0.7478	0.7273	0.7478	0.8648
No log	6.4255	302	0.7094	0.7273	0.7094	0.8422
No log	6.4681	304	0.6497	0.7755	0.6497	0.8061
No log	6.5106	306	0.6247	0.7651	0.6247	0.7904
No log	6.5532	308	0.6409	0.7403	0.6409	0.8006
No log	6.5957	310	0.5998	0.7516	0.5998	0.7744
No log	6.6383	312	0.5408	0.7975	0.5408	0.7354
No log	6.6809	314	0.5715	0.8025	0.5715	0.7560
No log	6.7234	316	0.6765	0.72	0.6765	0.8225
No log	6.7660	318	0.7767	0.6901	0.7767	0.8813
No log	6.8085	320	0.7329	0.6906	0.7329	0.8561
No log	6.8511	322	0.7082	0.7042	0.7082	0.8415
No log	6.8936	324	0.7283	0.7042	0.7283	0.8534
No log	6.9362	326	0.6625	0.7483	0.6625	0.8139
No log	6.9787	328	0.6029	0.76	0.6029	0.7764
No log	7.0213	330	0.5855	0.7564	0.5855	0.7652
No log	7.0638	332	0.5501	0.7758	0.5501	0.7417
No log	7.1064	334	0.6354	0.7308	0.6354	0.7971
No log	7.1489	336	0.7769	0.6939	0.7769	0.8814
No log	7.1915	338	0.7405	0.6939	0.7405	0.8605
No log	7.2340	340	0.7116	0.7027	0.7116	0.8436
No log	7.2766	342	0.6685	0.6939	0.6685	0.8176
No log	7.3191	344	0.7271	0.6897	0.7271	0.8527
No log	7.3617	346	0.8351	0.6277	0.8351	0.9139
No log	7.4043	348	0.9277	0.6143	0.9277	0.9632
No log	7.4468	350	0.9925	0.5942	0.9925	0.9963
No log	7.4894	352	1.0253	0.6015	1.0253	1.0126
No log	7.5319	354	0.9834	0.6370	0.9834	0.9917
No log	7.5745	356	0.9139	0.6571	0.9139	0.9560
No log	7.6170	358	0.9031	0.6897	0.9031	0.9503
No log	7.6596	360	0.8261	0.7123	0.8261	0.9089
No log	7.7021	362	0.8526	0.6800	0.8526	0.9233
No log	7.7447	364	0.8906	0.6711	0.8906	0.9437
No log	7.7872	366	0.8954	0.6575	0.8954	0.9462
No log	7.8298	368	0.9488	0.6286	0.9488	0.9741
No log	7.8723	370	0.9421	0.6316	0.9421	0.9706
No log	7.9149	372	0.9253	0.6131	0.9253	0.9619
No log	7.9574	374	0.8532	0.6434	0.8532	0.9237
No log	8.0	376	0.7708	0.7114	0.7708	0.8780
No log	8.0426	378	0.7225	0.7532	0.7225	0.8500
No log	8.0851	380	0.6414	0.75	0.6414	0.8009
No log	8.1277	382	0.6642	0.7582	0.6642	0.8150
No log	8.1702	384	0.7912	0.6667	0.7912	0.8895
No log	8.2128	386	0.8338	0.6761	0.8338	0.9131
No log	8.2553	388	0.8080	0.7172	0.8080	0.8989
No log	8.2979	390	0.7933	0.7211	0.7933	0.8907
No log	8.3404	392	0.8090	0.6939	0.8090	0.8995
No log	8.3830	394	0.9274	0.6800	0.9274	0.9630
No log	8.4255	396	0.9392	0.64	0.9392	0.9691
No log	8.4681	398	0.9382	0.6069	0.9382	0.9686
No log	8.5106	400	0.8847	0.6324	0.8847	0.9406
No log	8.5532	402	0.9644	0.6176	0.9644	0.9820
No log	8.5957	404	1.0821	0.5882	1.0821	1.0403
No log	8.6383	406	1.1504	0.5578	1.1504	1.0726
No log	8.6809	408	1.0441	0.5816	1.0441	1.0218
No log	8.7234	410	1.0351	0.5816	1.0351	1.0174
No log	8.7660	412	1.1376	0.5493	1.1376	1.0666
No log	8.8085	414	1.1298	0.5532	1.1298	1.0629
No log	8.8511	416	1.1312	0.5532	1.1312	1.0636
No log	8.8936	418	0.9871	0.6423	0.9871	0.9936
No log	8.9362	420	0.8486	0.6849	0.8486	0.9212
No log	8.9787	422	0.8020	0.6759	0.8020	0.8956
No log	9.0213	424	0.8220	0.6324	0.8220	0.9066
No log	9.0638	426	0.9087	0.6423	0.9087	0.9532
No log	9.1064	428	1.0355	0.5985	1.0355	1.0176
No log	9.1489	430	1.0430	0.6164	1.0430	1.0213
No log	9.1915	432	0.9412	0.6711	0.9412	0.9702
No log	9.2340	434	0.8364	0.6803	0.8364	0.9146
No log	9.2766	436	0.8024	0.6803	0.8024	0.8958
No log	9.3191	438	0.8528	0.6803	0.8528	0.9235
No log	9.3617	440	0.9374	0.6621	0.9374	0.9682
No log	9.4043	442	0.9411	0.6069	0.9411	0.9701
No log	9.4468	444	0.9137	0.6043	0.9137	0.9559
No log	9.4894	446	0.7946	0.6713	0.7946	0.8914
No log	9.5319	448	0.7333	0.7285	0.7333	0.8563
No log	9.5745	450	0.8270	0.7011	0.8270	0.9094
No log	9.6170	452	0.8243	0.75	0.8243	0.9079
No log	9.6596	454	0.7771	0.75	0.7771	0.8815
No log	9.7021	456	0.8373	0.7030	0.8373	0.9150
No log	9.7447	458	0.9117	0.6294	0.9117	0.9548
No log	9.7872	460	0.9241	0.6475	0.9241	0.9613
No log	9.8298	462	0.9043	0.6475	0.9043	0.9509
No log	9.8723	464	0.9271	0.6475	0.9271	0.9628
No log	9.9149	466	0.8695	0.6475	0.8695	0.9325
No log	9.9574	468	0.8186	0.6377	0.8186	0.9048
No log	10.0	470	0.7622	0.6763	0.7622	0.8731
No log	10.0426	472	0.7283	0.6809	0.7283	0.8534
No log	10.0851	474	0.6714	0.7347	0.6714	0.8194
No log	10.1277	476	0.6771	0.7347	0.6771	0.8229
No log	10.1702	478	0.6345	0.7682	0.6345	0.7965
No log	10.2128	480	0.6311	0.7785	0.6311	0.7944
No log	10.2553	482	0.6395	0.7815	0.6395	0.7997
No log	10.2979	484	0.6584	0.7733	0.6584	0.8114
No log	10.3404	486	0.6645	0.7682	0.6645	0.8151
No log	10.3830	488	0.6610	0.7682	0.6610	0.8130
No log	10.4255	490	0.6654	0.7671	0.6654	0.8157
No log	10.4681	492	0.6938	0.7413	0.6938	0.8329
No log	10.5106	494	0.7257	0.7101	0.7257	0.8519
No log	10.5532	496	0.7880	0.7050	0.7880	0.8877
No log	10.5957	498	0.8245	0.6857	0.8245	0.9080
0.4397	10.6383	500	0.8099	0.6993	0.8099	0.9000
0.4397	10.6809	502	0.8239	0.7013	0.8239	0.9077
0.4397	10.7234	504	0.7769	0.6933	0.7769	0.8814
0.4397	10.7660	506	0.7221	0.7183	0.7221	0.8498
0.4397	10.8085	508	0.7440	0.7015	0.7440	0.8626
0.4397	10.8511	510	0.8094	0.7101	0.8094	0.8997
0.4397	10.8936	512	0.8488	0.6667	0.8488	0.9213
0.4397	10.9362	514	0.8258	0.6769	0.8258	0.9087
0.4397	10.9787	516	0.8242	0.6357	0.8242	0.9079
0.4397	11.0213	518	0.7619	0.7111	0.7619	0.8729
0.4397	11.0638	520	0.7293	0.7518	0.7293	0.8540
0.4397	11.1064	522	0.8498	0.6713	0.8498	0.9219
0.4397	11.1489	524	1.0602	0.6027	1.0602	1.0297
0.4397	11.1915	526	1.2395	0.5493	1.2395	1.1133
0.4397	11.2340	528	1.1530	0.5674	1.1530	1.0738
0.4397	11.2766	530	0.9463	0.6423	0.9463	0.9728

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1