ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9623
• Qwk: 0.5781
• Mse: 0.9623
• Rmse: 0.9810

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	6.5798	0.0116	6.5798	2.5651
No log	0.1333	4	4.8139	0.0775	4.8139	2.1940
No log	0.2	6	2.9251	0.0988	2.9251	1.7103
No log	0.2667	8	2.7512	0.0137	2.7512	1.6587
No log	0.3333	10	2.0716	0.0847	2.0716	1.4393
No log	0.4	12	1.8114	0.1538	1.8114	1.3459
No log	0.4667	14	2.1186	0.1034	2.1186	1.4555
No log	0.5333	16	2.0199	0.2202	2.0199	1.4212
No log	0.6	18	1.9514	0.1524	1.9514	1.3969
No log	0.6667	20	2.0087	0.2385	2.0087	1.4173
No log	0.7333	22	2.0862	0.2149	2.0862	1.4444
No log	0.8	24	2.1208	0.2290	2.1208	1.4563
No log	0.8667	26	2.1863	0.1765	2.1863	1.4786
No log	0.9333	28	2.1570	0.2222	2.1570	1.4687
No log	1.0	30	2.0755	0.2880	2.0755	1.4407
No log	1.0667	32	2.1260	0.2482	2.1260	1.4581
No log	1.1333	34	2.2296	0.1259	2.2296	1.4932
No log	1.2	36	2.1715	0.2143	2.1715	1.4736
No log	1.2667	38	1.8290	0.3664	1.8290	1.3524
No log	1.3333	40	1.5745	0.2037	1.5745	1.2548
No log	1.4	42	1.5722	0.1538	1.5722	1.2539
No log	1.4667	44	1.5657	0.1905	1.5657	1.2513
No log	1.5333	46	1.6085	0.2018	1.6085	1.2682
No log	1.6	48	1.7625	0.2735	1.7625	1.3276
No log	1.6667	50	1.8822	0.2564	1.8822	1.3719
No log	1.7333	52	1.7670	0.2261	1.7670	1.3293
No log	1.8	54	1.6237	0.1835	1.6237	1.2742
No log	1.8667	56	1.5260	0.1121	1.5260	1.2353
No log	1.9333	58	1.4823	0.1667	1.4823	1.2175
No log	2.0	60	1.3943	0.4068	1.3943	1.1808
No log	2.0667	62	1.3984	0.5246	1.3984	1.1825
No log	2.1333	64	1.3853	0.4538	1.3853	1.1770
No log	2.2	66	1.3689	0.4590	1.3689	1.1700
No log	2.2667	68	1.4124	0.5039	1.4124	1.1884
No log	2.3333	70	1.4156	0.4921	1.4156	1.1898
No log	2.4	72	1.3126	0.4921	1.3126	1.1457
No log	2.4667	74	1.2708	0.5197	1.2708	1.1273
No log	2.5333	76	1.2452	0.4567	1.2452	1.1159
No log	2.6	78	1.2831	0.4962	1.2831	1.1327
No log	2.6667	80	1.4546	0.3796	1.4546	1.2061
No log	2.7333	82	1.3924	0.4296	1.3924	1.1800
No log	2.8	84	1.1919	0.5152	1.1919	1.0918
No log	2.8667	86	1.2555	0.4516	1.2555	1.1205
No log	2.9333	88	1.3553	0.3968	1.3553	1.1642
No log	3.0	90	1.3788	0.3566	1.3788	1.1742
No log	3.0667	92	1.2290	0.4923	1.2290	1.1086
No log	3.1333	94	1.0818	0.5669	1.0818	1.0401
No log	3.2	96	1.1048	0.625	1.1048	1.0511
No log	3.2667	98	1.1096	0.5827	1.1096	1.0534
No log	3.3333	100	1.1138	0.5984	1.1138	1.0554
No log	3.4	102	1.1352	0.4885	1.1352	1.0655
No log	3.4667	104	1.1264	0.5147	1.1264	1.0613
No log	3.5333	106	1.1455	0.5915	1.1455	1.0703
No log	3.6	108	1.1672	0.5493	1.1672	1.0804
No log	3.6667	110	1.1720	0.5248	1.1720	1.0826
No log	3.7333	112	1.1440	0.5373	1.1440	1.0696
No log	3.8	114	1.1804	0.4444	1.1804	1.0864
No log	3.8667	116	1.4514	0.4094	1.4514	1.2047
No log	3.9333	118	1.4380	0.4308	1.4380	1.1992
No log	4.0	120	1.2178	0.4531	1.2178	1.1036
No log	4.0667	122	1.0509	0.4806	1.0509	1.0251
No log	4.1333	124	1.0363	0.6714	1.0363	1.0180
No log	4.2	126	1.0397	0.6383	1.0397	1.0196
No log	4.2667	128	1.0792	0.5942	1.0792	1.0389
No log	4.3333	130	1.1207	0.5507	1.1207	1.0587
No log	4.4	132	1.0399	0.6043	1.0399	1.0198
No log	4.4667	134	0.9785	0.6519	0.9785	0.9892
No log	4.5333	136	0.9803	0.6716	0.9803	0.9901
No log	4.6	138	0.9586	0.6515	0.9586	0.9791
No log	4.6667	140	0.9470	0.6165	0.9470	0.9732
No log	4.7333	142	0.9438	0.6618	0.9438	0.9715
No log	4.8	144	0.9491	0.6667	0.9491	0.9742
No log	4.8667	146	0.9628	0.6471	0.9628	0.9812
No log	4.9333	148	0.9941	0.6	0.9941	0.9970
No log	5.0	150	0.9276	0.6667	0.9276	0.9631
No log	5.0667	152	0.8539	0.6715	0.8539	0.9240
No log	5.1333	154	0.8150	0.6906	0.8150	0.9028
No log	5.2	156	0.7911	0.6906	0.7911	0.8895
No log	5.2667	158	0.8080	0.6906	0.8080	0.8989
No log	5.3333	160	0.8536	0.7172	0.8536	0.9239
No log	5.4	162	0.8746	0.6933	0.8746	0.9352
No log	5.4667	164	0.8276	0.7467	0.8276	0.9097
No log	5.5333	166	0.7615	0.7	0.7615	0.8726
No log	5.6	168	0.7820	0.6765	0.7820	0.8843
No log	5.6667	170	0.7958	0.7101	0.7958	0.8921
No log	5.7333	172	0.8349	0.6567	0.8349	0.9137
No log	5.8	174	0.8914	0.6212	0.8914	0.9441
No log	5.8667	176	0.9800	0.5758	0.9800	0.9900
No log	5.9333	178	1.0149	0.6338	1.0149	1.0074
No log	6.0	180	0.9203	0.6197	0.9203	0.9593
No log	6.0667	182	0.8297	0.6479	0.8297	0.9109
No log	6.1333	184	0.8213	0.6619	0.8213	0.9063
No log	6.2	186	0.8488	0.6763	0.8488	0.9213
No log	6.2667	188	0.8560	0.6569	0.8560	0.9252
No log	6.3333	190	0.8714	0.6667	0.8714	0.9335
No log	6.4	192	0.8683	0.6418	0.8683	0.9318
No log	6.4667	194	0.8553	0.6667	0.8553	0.9248
No log	6.5333	196	0.8397	0.6714	0.8397	0.9163
No log	6.6	198	0.8242	0.6944	0.8242	0.9079
No log	6.6667	200	0.8093	0.6619	0.8093	0.8996
No log	6.7333	202	0.7866	0.6761	0.7866	0.8869
No log	6.8	204	0.8119	0.6809	0.8119	0.9011
No log	6.8667	206	0.8861	0.6714	0.8861	0.9414
No log	6.9333	208	0.8475	0.6906	0.8475	0.9206
No log	7.0	210	0.8426	0.6667	0.8426	0.9179
No log	7.0667	212	0.8693	0.6857	0.8693	0.9323
No log	7.1333	214	0.7836	0.7042	0.7836	0.8852
No log	7.2	216	0.6872	0.7586	0.6872	0.8290
No log	7.2667	218	0.6947	0.7432	0.6947	0.8335
No log	7.3333	220	0.7199	0.7273	0.7199	0.8485
No log	7.4	222	0.7116	0.7361	0.7116	0.8436
No log	7.4667	224	0.6817	0.75	0.6817	0.8257
No log	7.5333	226	0.6782	0.7724	0.6782	0.8235
No log	7.6	228	0.6710	0.7763	0.6710	0.8191
No log	7.6667	230	0.6584	0.7517	0.6584	0.8114
No log	7.7333	232	0.6552	0.76	0.6552	0.8094
No log	7.8	234	0.6526	0.76	0.6526	0.8078
No log	7.8667	236	0.6984	0.7383	0.6984	0.8357
No log	7.9333	238	0.6958	0.7143	0.6958	0.8342
No log	8.0	240	0.7198	0.6901	0.7198	0.8484
No log	8.0667	242	0.7708	0.6993	0.7708	0.8780
No log	8.1333	244	0.7601	0.6809	0.7601	0.8718
No log	8.2	246	0.7406	0.7172	0.7406	0.8606
No log	8.2667	248	0.7799	0.7368	0.7799	0.8831
No log	8.3333	250	0.8346	0.6986	0.8346	0.9136
No log	8.4	252	0.8009	0.7248	0.8009	0.8949
No log	8.4667	254	0.7526	0.7397	0.7526	0.8675
No log	8.5333	256	0.7966	0.7075	0.7966	0.8925
No log	8.6	258	0.8879	0.6950	0.8879	0.9423
No log	8.6667	260	0.8888	0.6569	0.8888	0.9428
No log	8.7333	262	0.8749	0.6316	0.8749	0.9353
No log	8.8	264	0.8724	0.6567	0.8724	0.9340
No log	8.8667	266	0.8603	0.6667	0.8603	0.9275
No log	8.9333	268	0.8433	0.6569	0.8433	0.9183
No log	9.0	270	0.8726	0.6667	0.8726	0.9341
No log	9.0667	272	0.9000	0.6471	0.9000	0.9487
No log	9.1333	274	0.8992	0.6569	0.8992	0.9482
No log	9.2	276	0.9361	0.6522	0.9361	0.9675
No log	9.2667	278	0.9962	0.6286	0.9962	0.9981
No log	9.3333	280	0.9921	0.5957	0.9921	0.9961
No log	9.4	282	0.9169	0.6475	0.9169	0.9576
No log	9.4667	284	0.9078	0.6165	0.9078	0.9528
No log	9.5333	286	0.9436	0.5954	0.9436	0.9714
No log	9.6	288	1.0026	0.5736	1.0026	1.0013
No log	9.6667	290	0.9982	0.5758	0.9982	0.9991
No log	9.7333	292	1.0190	0.5496	1.0190	1.0095
No log	9.8	294	0.9988	0.5714	0.9988	0.9994
No log	9.8667	296	0.9921	0.6277	0.9921	0.9961
No log	9.9333	298	1.0008	0.6331	1.0008	1.0004
No log	10.0	300	0.9621	0.6667	0.9621	0.9809
No log	10.0667	302	0.9309	0.6806	0.9309	0.9648
No log	10.1333	304	0.9218	0.6475	0.9218	0.9601
No log	10.2	306	0.8964	0.6809	0.8964	0.9468
No log	10.2667	308	0.9159	0.6667	0.9159	0.9571
No log	10.3333	310	0.9151	0.7007	0.9151	0.9566
No log	10.4	312	0.9286	0.6765	0.9286	0.9637
No log	10.4667	314	0.9698	0.5970	0.9698	0.9848
No log	10.5333	316	0.9673	0.6324	0.9673	0.9835
No log	10.6	318	0.9737	0.6074	0.9737	0.9868
No log	10.6667	320	0.9506	0.6043	0.9506	0.9750
No log	10.7333	322	0.8865	0.6806	0.8865	0.9415
No log	10.8	324	0.8417	0.6713	0.8417	0.9174
No log	10.8667	326	0.8854	0.6423	0.8854	0.9410
No log	10.9333	328	0.8909	0.6269	0.8909	0.9438
No log	11.0	330	0.8579	0.6119	0.8579	0.9262
No log	11.0667	332	0.8578	0.6316	0.8578	0.9262
No log	11.1333	334	0.8743	0.6471	0.8743	0.9350
No log	11.2	336	0.8585	0.6519	0.8585	0.9266
No log	11.2667	338	0.8599	0.6074	0.8599	0.9273
No log	11.3333	340	0.8797	0.6061	0.8797	0.9379
No log	11.4	342	0.8881	0.6074	0.8881	0.9424
No log	11.4667	344	0.9318	0.6471	0.9318	0.9653
No log	11.5333	346	1.0114	0.6471	1.0114	1.0057
No log	11.6	348	1.0028	0.6370	1.0028	1.0014
No log	11.6667	350	0.9669	0.6047	0.9669	0.9833
No log	11.7333	352	0.9689	0.5891	0.9689	0.9843
No log	11.8	354	0.9879	0.5891	0.9879	0.9939
No log	11.8667	356	0.9527	0.5692	0.9527	0.9761
No log	11.9333	358	0.9169	0.6212	0.9169	0.9576
No log	12.0	360	0.9973	0.6316	0.9973	0.9987
No log	12.0667	362	1.1034	0.5493	1.1034	1.0504
No log	12.1333	364	1.0658	0.5775	1.0658	1.0324
No log	12.2	366	0.9374	0.6364	0.9374	0.9682
No log	12.2667	368	0.8637	0.6815	0.8637	0.9293
No log	12.3333	370	0.8617	0.6479	0.8617	0.9283
No log	12.4	372	0.8498	0.6901	0.8498	0.9218
No log	12.4667	374	0.7972	0.6573	0.7972	0.8929
No log	12.5333	376	0.8219	0.6897	0.8219	0.9066
No log	12.6	378	0.8916	0.6579	0.8916	0.9442
No log	12.6667	380	0.8249	0.7083	0.8249	0.9083
No log	12.7333	382	0.7460	0.6857	0.7460	0.8637
No log	12.8	384	0.7436	0.6957	0.7436	0.8623
No log	12.8667	386	0.7591	0.6715	0.7591	0.8713
No log	12.9333	388	0.7843	0.6667	0.7843	0.8856
No log	13.0	390	0.8075	0.6212	0.8075	0.8986
No log	13.0667	392	0.8258	0.5954	0.8258	0.9087
No log	13.1333	394	0.8698	0.6466	0.8698	0.9326
No log	13.2	396	0.8943	0.6308	0.8943	0.9457
No log	13.2667	398	0.8987	0.6357	0.8987	0.9480
No log	13.3333	400	0.8603	0.6308	0.8603	0.9275
No log	13.4	402	0.8415	0.6308	0.8415	0.9173
No log	13.4667	404	0.8322	0.6471	0.8322	0.9123
No log	13.5333	406	0.8203	0.6471	0.8203	0.9057
No log	13.6	408	0.7989	0.6569	0.7989	0.8938
No log	13.6667	410	0.7851	0.7	0.7851	0.8861
No log	13.7333	412	0.8431	0.6377	0.8431	0.9182
No log	13.8	414	0.8990	0.6377	0.8990	0.9482
No log	13.8667	416	0.8694	0.6567	0.8694	0.9324
No log	13.9333	418	0.8679	0.6716	0.8679	0.9316
No log	14.0	420	0.8970	0.6618	0.8970	0.9471
No log	14.0667	422	0.8970	0.6466	0.8970	0.9471
No log	14.1333	424	0.8627	0.6519	0.8627	0.9288
No log	14.2	426	0.8194	0.6519	0.8194	0.9052
No log	14.2667	428	0.7857	0.6519	0.7857	0.8864
No log	14.3333	430	0.7905	0.6519	0.7905	0.8891
No log	14.4	432	0.8070	0.6906	0.8070	0.8983
No log	14.4667	434	0.7724	0.7101	0.7724	0.8789
No log	14.5333	436	0.7886	0.6861	0.7886	0.8880
No log	14.6	438	0.8517	0.6567	0.8517	0.9229
No log	14.6667	440	0.9041	0.6475	0.9041	0.9508
No log	14.7333	442	0.8426	0.6515	0.8426	0.9179
No log	14.8	444	0.7808	0.6615	0.7808	0.8836
No log	14.8667	446	0.7731	0.6308	0.7731	0.8792
No log	14.9333	448	0.7678	0.6308	0.7678	0.8763
No log	15.0	450	0.7692	0.6466	0.7692	0.8771
No log	15.0667	452	0.7853	0.6861	0.7853	0.8862
No log	15.1333	454	0.8193	0.7183	0.8193	0.9052
No log	15.2	456	0.8678	0.6944	0.8678	0.9316
No log	15.2667	458	0.8625	0.6569	0.8625	0.9287
No log	15.3333	460	0.8177	0.6462	0.8177	0.9043
No log	15.4	462	0.8175	0.6718	0.8175	0.9042
No log	15.4667	464	0.8417	0.6562	0.8417	0.9174
No log	15.5333	466	0.8603	0.6202	0.8603	0.9275
No log	15.6	468	0.8403	0.6364	0.8403	0.9167
No log	15.6667	470	0.8216	0.6565	0.8216	0.9064
No log	15.7333	472	0.8204	0.6815	0.8204	0.9057
No log	15.8	474	0.8042	0.6519	0.8042	0.8968
No log	15.8667	476	0.8162	0.6815	0.8162	0.9035
No log	15.9333	478	0.8446	0.6316	0.8446	0.9190
No log	16.0	480	0.9192	0.6412	0.9192	0.9587
No log	16.0667	482	0.9233	0.6047	0.9233	0.9609
No log	16.1333	484	0.8958	0.6565	0.8958	0.9465
No log	16.2	486	0.8778	0.6667	0.8778	0.9369
No log	16.2667	488	0.8988	0.6364	0.8988	0.9481
No log	16.3333	490	0.9150	0.5846	0.9150	0.9566
No log	16.4	492	0.9156	0.6364	0.9156	0.9569
No log	16.4667	494	0.9117	0.6260	0.9117	0.9548
No log	16.5333	496	0.9061	0.6667	0.9061	0.9519
No log	16.6	498	0.8507	0.6765	0.8507	0.9223
0.4292	16.6667	500	0.8238	0.7007	0.8238	0.9076
0.4292	16.7333	502	0.7972	0.7007	0.7972	0.8929
0.4292	16.8	504	0.8046	0.6567	0.8046	0.8970
0.4292	16.8667	506	0.8592	0.6364	0.8592	0.9270
0.4292	16.9333	508	0.9247	0.5984	0.9247	0.9616
0.4292	17.0	510	0.9623	0.5781	0.9623	0.9810

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1