ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k19_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8413
• Qwk: 0.0129
• Mse: 0.8413
• Rmse: 0.9172

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	3.8262	0.0094	3.8262	1.9561
No log	0.0784	4	2.0448	0.0504	2.0448	1.4300
No log	0.1176	6	1.7647	0.0304	1.7647	1.3284
No log	0.1569	8	2.2653	0.0076	2.2653	1.5051
No log	0.1961	10	1.8323	-0.0028	1.8323	1.3536
No log	0.2353	12	0.8634	-0.0870	0.8634	0.9292
No log	0.2745	14	0.7652	-0.0695	0.7652	0.8748
No log	0.3137	16	0.7526	-0.0695	0.7526	0.8675
No log	0.3529	18	0.8818	-0.0545	0.8818	0.9390
No log	0.3922	20	1.0065	-0.0435	1.0065	1.0033
No log	0.4314	22	1.0274	-0.0133	1.0274	1.0136
No log	0.4706	24	1.0621	-0.0193	1.0621	1.0306
No log	0.5098	26	0.8754	0.0207	0.8754	0.9356
No log	0.5490	28	0.7486	-0.0160	0.7486	0.8652
No log	0.5882	30	0.7842	-0.0331	0.7842	0.8856
No log	0.6275	32	1.0284	-0.0133	1.0284	1.0141
No log	0.6667	34	1.9703	-0.0085	1.9703	1.4037
No log	0.7059	36	1.9889	-0.0053	1.9889	1.4103
No log	0.7451	38	1.2092	0.0065	1.2092	1.0997
No log	0.7843	40	0.7730	-0.1233	0.7730	0.8792
No log	0.8235	42	0.8086	-0.1241	0.8086	0.8992
No log	0.8627	44	1.0242	-0.0435	1.0242	1.0120
No log	0.9020	46	1.0774	-0.0468	1.0774	1.0380
No log	0.9412	48	1.0904	-0.0468	1.0904	1.0442
No log	0.9804	50	0.9007	0.0134	0.9007	0.9490
No log	1.0196	52	0.7378	0.0	0.7378	0.8589
No log	1.0588	54	0.7251	-0.0551	0.7251	0.8515
No log	1.0980	56	0.7936	0.1097	0.7936	0.8908
No log	1.1373	58	1.3210	-0.0193	1.3210	1.1493
No log	1.1765	60	1.6936	0.0065	1.6936	1.3014
No log	1.2157	62	1.5780	-0.0193	1.5780	1.2562
No log	1.2549	64	1.0878	-0.0686	1.0878	1.0430
No log	1.2941	66	0.8381	0.1239	0.8381	0.9155
No log	1.3333	68	0.7309	0.0496	0.7309	0.8549
No log	1.3725	70	0.7579	0.1627	0.7579	0.8706
No log	1.4118	72	0.9578	-0.1282	0.9578	0.9787
No log	1.4510	74	1.0268	-0.1283	1.0268	1.0133
No log	1.4902	76	0.8012	0.1387	0.8012	0.8951
No log	1.5294	78	0.7441	0.0970	0.7441	0.8626
No log	1.5686	80	0.8189	0.1701	0.8189	0.9049
No log	1.6078	82	0.8377	0.1758	0.8377	0.9153
No log	1.6471	84	0.7729	0.0269	0.7729	0.8791
No log	1.6863	86	0.8590	0.1003	0.8590	0.9268
No log	1.7255	88	0.7639	-0.0145	0.7639	0.8740
No log	1.7647	90	0.7318	0.1027	0.7318	0.8555
No log	1.8039	92	0.7474	0.1501	0.7474	0.8645
No log	1.8431	94	0.8883	0.0257	0.8883	0.9425
No log	1.8824	96	0.8983	-0.0127	0.8983	0.9478
No log	1.9216	98	0.8115	0.1259	0.8115	0.9008
No log	1.9608	100	0.8450	0.1259	0.8450	0.9192
No log	2.0	102	0.9461	-0.0143	0.9461	0.9727
No log	2.0392	104	0.9855	0.0236	0.9855	0.9927
No log	2.0784	106	0.9755	0.1128	0.9755	0.9877
No log	2.1176	108	1.0473	0.0920	1.0473	1.0234
No log	2.1569	110	1.0312	0.1053	1.0312	1.0155
No log	2.1961	112	1.1312	0.0768	1.1312	1.0636
No log	2.2353	114	1.3854	-0.1226	1.3854	1.1770
No log	2.2745	116	1.1326	0.0	1.1326	1.0642
No log	2.3137	118	1.0967	0.0730	1.0967	1.0472
No log	2.3529	120	1.0842	-0.0231	1.0842	1.0413
No log	2.3922	122	1.2225	-0.1075	1.2225	1.1057
No log	2.4314	124	1.1369	-0.1439	1.1369	1.0662
No log	2.4706	126	0.9442	0.0392	0.9442	0.9717
No log	2.5098	128	0.8872	0.0771	0.8872	0.9419
No log	2.5490	130	1.0595	-0.0878	1.0595	1.0293
No log	2.5882	132	1.1878	-0.1276	1.1878	1.0899
No log	2.6275	134	0.9636	-0.0408	0.9636	0.9816
No log	2.6667	136	0.7796	-0.0032	0.7796	0.8829
No log	2.7059	138	0.7781	-0.1001	0.7781	0.8821
No log	2.7451	140	0.8064	-0.0145	0.8064	0.8980
No log	2.7843	142	1.0745	-0.0031	1.0745	1.0366
No log	2.8235	144	1.0334	-0.0031	1.0334	1.0166
No log	2.8627	146	0.8409	0.0226	0.8409	0.9170
No log	2.9020	148	0.7945	0.0893	0.7945	0.8914
No log	2.9412	150	0.8215	0.1199	0.8215	0.9064
No log	2.9804	152	0.8177	0.0680	0.8177	0.9042
No log	3.0196	154	0.7884	0.1199	0.7884	0.8879
No log	3.0588	156	0.8750	-0.0373	0.8750	0.9354
No log	3.0980	158	0.8248	0.0639	0.8248	0.9082
No log	3.1373	160	0.7425	0.0918	0.7425	0.8617
No log	3.1765	162	0.7606	0.1254	0.7606	0.8721
No log	3.2157	164	0.8407	0.1387	0.8407	0.9169
No log	3.2549	166	0.8080	0.0611	0.8080	0.8989
No log	3.2941	168	0.8005	0.0192	0.8005	0.8947
No log	3.3333	170	0.8608	0.1005	0.8608	0.9278
No log	3.3725	172	0.8862	-0.0347	0.8862	0.9414
No log	3.4118	174	1.0679	0.0722	1.0679	1.0334
No log	3.4510	176	0.9788	-0.1606	0.9788	0.9894
No log	3.4902	178	0.9377	0.0966	0.9377	0.9683
No log	3.5294	180	0.9148	0.0964	0.9148	0.9565
No log	3.5686	182	1.0289	-0.1060	1.0289	1.0143
No log	3.6078	184	1.6246	-0.0672	1.6246	1.2746
No log	3.6471	186	1.6028	-0.0957	1.6028	1.2660
No log	3.6863	188	1.1310	-0.0194	1.1310	1.0635
No log	3.7255	190	0.8472	-0.0054	0.8472	0.9204
No log	3.7647	192	0.8218	0.0460	0.8218	0.9065
No log	3.8039	194	0.8522	-0.0711	0.8522	0.9231
No log	3.8431	196	1.0975	0.0486	1.0975	1.0476
No log	3.8824	198	1.1755	0.0391	1.1755	1.0842
No log	3.9216	200	0.8554	0.1687	0.8554	0.9249
No log	3.9608	202	0.7551	0.1637	0.7551	0.8690
No log	4.0	204	0.8443	0.2230	0.8443	0.9188
No log	4.0392	206	0.8236	0.1896	0.8236	0.9075
No log	4.0784	208	0.7324	0.1942	0.7324	0.8558
No log	4.1176	210	0.9080	0.1980	0.9080	0.9529
No log	4.1569	212	0.9893	0.1525	0.9893	0.9946
No log	4.1961	214	0.8170	0.1935	0.8170	0.9039
No log	4.2353	216	0.6748	0.1675	0.6748	0.8215
No log	4.2745	218	0.6890	0.0513	0.6890	0.8301
No log	4.3137	220	0.6709	0.1927	0.6709	0.8191
No log	4.3529	222	0.7260	0.1553	0.7260	0.8521
No log	4.3922	224	0.9103	0.0346	0.9103	0.9541
No log	4.4314	226	0.8880	-0.0391	0.8880	0.9423
No log	4.4706	228	0.7799	0.1599	0.7799	0.8831
No log	4.5098	230	0.8316	0.1640	0.8316	0.9119
No log	4.5490	232	0.8420	0.1044	0.8420	0.9176
No log	4.5882	234	0.7407	0.1187	0.7407	0.8606
No log	4.6275	236	0.9678	0.0587	0.9678	0.9838
No log	4.6667	238	0.9789	0.0260	0.9789	0.9894
No log	4.7059	240	0.7171	0.2424	0.7171	0.8468
No log	4.7451	242	0.7678	0.0363	0.7678	0.8762
No log	4.7843	244	0.8622	0.0180	0.8622	0.9286
No log	4.8235	246	0.7788	0.0345	0.7788	0.8825
No log	4.8627	248	0.6947	0.1807	0.6947	0.8335
No log	4.9020	250	0.9251	0.1149	0.9251	0.9618
No log	4.9412	252	1.0624	0.0686	1.0624	1.0307
No log	4.9804	254	0.9401	0.1422	0.9401	0.9696
No log	5.0196	256	0.8752	0.1131	0.8752	0.9355
No log	5.0588	258	0.8915	0.0753	0.8915	0.9442
No log	5.0980	260	0.9410	0.0997	0.9410	0.9700
No log	5.1373	262	1.0514	0.1077	1.0514	1.0254
No log	5.1765	264	0.9260	0.1065	0.9260	0.9623
No log	5.2157	266	0.8255	0.0426	0.8255	0.9086
No log	5.2549	268	0.8071	0.0376	0.8071	0.8984
No log	5.2941	270	0.9454	0.0913	0.9454	0.9723
No log	5.3333	272	0.9970	-0.0163	0.9970	0.9985
No log	5.3725	274	0.8860	0.0956	0.8860	0.9413
No log	5.4118	276	0.7932	0.0869	0.7932	0.8906
No log	5.4510	278	0.7909	0.0874	0.7909	0.8893
No log	5.4902	280	0.7891	0.0884	0.7891	0.8883
No log	5.5294	282	0.8227	0.1192	0.8227	0.9070
No log	5.5686	284	0.8364	0.1240	0.8364	0.9145
No log	5.6078	286	0.8793	0.1407	0.8793	0.9377
No log	5.6471	288	0.9231	0.1102	0.9231	0.9608
No log	5.6863	290	0.9229	0.1409	0.9229	0.9607
No log	5.7255	292	0.8307	0.0265	0.8307	0.9114
No log	5.7647	294	0.7935	0.1095	0.7935	0.8908
No log	5.8039	296	0.7642	0.1199	0.7642	0.8742
No log	5.8431	298	0.8028	0.1899	0.8028	0.8960
No log	5.8824	300	0.9825	0.0873	0.9825	0.9912
No log	5.9216	302	0.9413	0.0642	0.9413	0.9702
No log	5.9608	304	0.7473	0.1553	0.7473	0.8645
No log	6.0	306	0.7534	-0.0821	0.7534	0.8680
No log	6.0392	308	0.7681	-0.0300	0.7681	0.8764
No log	6.0784	310	0.7423	0.0412	0.7423	0.8615
No log	6.1176	312	0.7679	0.1144	0.7679	0.8763
No log	6.1569	314	0.8181	0.0438	0.8181	0.9045
No log	6.1961	316	0.7395	0.1612	0.7395	0.8600
No log	6.2353	318	0.7078	0.1311	0.7078	0.8413
No log	6.2745	320	0.7408	0.2105	0.7408	0.8607
No log	6.3137	322	0.8087	0.1646	0.8087	0.8993
No log	6.3529	324	0.8219	0.2394	0.8219	0.9066
No log	6.3922	326	0.7894	0.1627	0.7894	0.8885
No log	6.4314	328	0.7521	0.1318	0.7521	0.8673
No log	6.4706	330	0.8101	0.1899	0.8101	0.9000
No log	6.5098	332	1.1051	-0.0297	1.1051	1.0512
No log	6.5490	334	1.1550	-0.0029	1.1550	1.0747
No log	6.5882	336	1.0522	0.0044	1.0522	1.0258
No log	6.6275	338	0.9598	0.1222	0.9598	0.9797
No log	6.6667	340	1.1211	0.0920	1.1211	1.0588
No log	6.7059	342	1.4675	-0.0432	1.4675	1.2114
No log	6.7451	344	1.3223	-0.0105	1.3223	1.1499
No log	6.7843	346	0.9478	0.1550	0.9478	0.9735
No log	6.8235	348	0.8873	0.1051	0.8873	0.9419
No log	6.8627	350	0.9347	0.1731	0.9347	0.9668
No log	6.9020	352	1.1683	0.1213	1.1683	1.0809
No log	6.9412	354	1.0707	0.1281	1.0707	1.0348
No log	6.9804	356	0.8457	0.2259	0.8457	0.9196
No log	7.0196	358	0.8176	0.1518	0.8176	0.9042
No log	7.0588	360	0.8143	0.0776	0.8143	0.9024
No log	7.0980	362	0.8071	0.0776	0.8071	0.8984
No log	7.1373	364	0.8348	0.0	0.8348	0.9137
No log	7.1765	366	0.8890	0.0623	0.8890	0.9428
No log	7.2157	368	0.8558	0.0423	0.8558	0.9251
No log	7.2549	370	0.8544	0.0614	0.8544	0.9243
No log	7.2941	372	0.8272	0.0709	0.8272	0.9095
No log	7.3333	374	0.7810	0.0289	0.7810	0.8837
No log	7.3725	376	0.7508	0.0414	0.7508	0.8665
No log	7.4118	378	0.7486	0.1740	0.7486	0.8652
No log	7.4510	380	0.8327	0.0409	0.8327	0.9125
No log	7.4902	382	0.8607	-0.0870	0.8607	0.9277
No log	7.5294	384	0.8177	0.1553	0.8177	0.9043
No log	7.5686	386	0.8024	-0.0446	0.8024	0.8957
No log	7.6078	388	0.9048	0.0007	0.9048	0.9512
No log	7.6471	390	0.8667	-0.0799	0.8667	0.9310
No log	7.6863	392	0.8113	0.1192	0.8113	0.9007
No log	7.7255	394	0.9218	-0.0030	0.9218	0.9601
No log	7.7647	396	0.9472	0.0283	0.9472	0.9733
No log	7.8039	398	0.8451	0.1986	0.8451	0.9193
No log	7.8431	400	0.8144	0.0828	0.8144	0.9024
No log	7.8824	402	0.8148	0.0394	0.8148	0.9027
No log	7.9216	404	0.8495	0.1942	0.8495	0.9217
No log	7.9608	406	0.9750	0.0249	0.9750	0.9874
No log	8.0	408	1.1364	-0.0280	1.1364	1.0660
No log	8.0392	410	1.1900	-0.0319	1.1900	1.0909
No log	8.0784	412	1.0379	0.0186	1.0379	1.0188
No log	8.1176	414	0.8569	0.1423	0.8569	0.9257
No log	8.1569	416	0.8436	0.1240	0.8436	0.9185
No log	8.1961	418	0.8894	0.0188	0.8894	0.9431
No log	8.2353	420	1.0051	0.0566	1.0051	1.0025
No log	8.2745	422	0.9211	0.1513	0.9211	0.9597
No log	8.3137	424	0.9293	0.0762	0.9293	0.9640
No log	8.3529	426	1.1646	0.0356	1.1646	1.0792
No log	8.3922	428	1.3993	-0.0105	1.3993	1.1829
No log	8.4314	430	1.2267	-0.0075	1.2267	1.1076
No log	8.4706	432	0.8255	0.1701	0.8255	0.9086
No log	8.5098	434	0.7397	0.0465	0.7397	0.8601
No log	8.5490	436	0.7417	0.0053	0.7417	0.8612
No log	8.5882	438	0.7811	0.3286	0.7811	0.8838
No log	8.6275	440	1.0288	0.0735	1.0288	1.0143
No log	8.6667	442	1.2245	0.1057	1.2245	1.1066
No log	8.7059	444	1.1254	0.0920	1.1254	1.0609
No log	8.7451	446	0.8269	0.1935	0.8269	0.9093
No log	8.7843	448	0.7781	-0.0268	0.7781	0.8821
No log	8.8235	450	0.7678	-0.0407	0.7678	0.8762
No log	8.8627	452	0.7458	-0.0488	0.7458	0.8636
No log	8.9020	454	0.7497	0.2053	0.7497	0.8658
No log	8.9412	456	0.8824	0.1430	0.8824	0.9394
No log	8.9804	458	1.0356	0.0334	1.0356	1.0176
No log	9.0196	460	1.1560	-0.0319	1.1560	1.0752
No log	9.0588	462	1.0850	0.0355	1.0850	1.0416
No log	9.0980	464	0.9047	0.0762	0.9047	0.9511
No log	9.1373	466	0.7715	0.1553	0.7715	0.8784
No log	9.1765	468	0.7861	0.1553	0.7861	0.8866
No log	9.2157	470	0.7930	0.1553	0.7930	0.8905
No log	9.2549	472	0.8287	0.2131	0.8287	0.9103
No log	9.2941	474	0.8359	0.2131	0.8359	0.9143
No log	9.3333	476	0.8767	0.1673	0.8767	0.9363
No log	9.3725	478	0.8847	0.0842	0.8847	0.9406
No log	9.4118	480	0.9198	0.0769	0.9198	0.9591
No log	9.4510	482	0.8057	0.1675	0.8057	0.8976
No log	9.4902	484	0.7355	0.0436	0.7355	0.8576
No log	9.5294	486	0.7388	0.0436	0.7388	0.8595
No log	9.5686	488	0.7694	0.0355	0.7694	0.8772
No log	9.6078	490	0.8038	0.1841	0.8038	0.8966
No log	9.6471	492	0.9459	0.1980	0.9459	0.9726
No log	9.6863	494	0.8831	0.2216	0.8831	0.9398
No log	9.7255	496	0.7769	0.0741	0.7769	0.8814
No log	9.7647	498	0.7557	0.0471	0.7557	0.8693
0.331	9.8039	500	0.7420	0.0914	0.7420	0.8614
0.331	9.8431	502	0.7518	0.1828	0.7518	0.8671
0.331	9.8824	504	0.8800	0.0748	0.8800	0.9381
0.331	9.9216	506	1.0518	0.0344	1.0518	1.0256
0.331	9.9608	508	0.9522	0.0193	0.9522	0.9758
0.331	10.0	510	0.7900	0.2971	0.7900	0.8888
0.331	10.0392	512	0.7610	0.1675	0.7610	0.8723
0.331	10.0784	514	0.7841	0.2078	0.7841	0.8855
0.331	10.1176	516	0.8482	0.1291	0.8482	0.9210
0.331	10.1569	518	0.9576	0.0566	0.9576	0.9786
0.331	10.1961	520	0.9077	0.1696	0.9077	0.9527
0.331	10.2353	522	0.7895	0.1879	0.7895	0.8886
0.331	10.2745	524	0.7532	0.1758	0.7532	0.8679
0.331	10.3137	526	0.7568	0.0821	0.7568	0.8699
0.331	10.3529	528	0.8048	-0.0634	0.8048	0.8971
0.331	10.3922	530	0.8368	-0.0186	0.8368	0.9148
0.331	10.4314	532	0.8924	0.0709	0.8924	0.9447
0.331	10.4706	534	0.9136	0.1019	0.9136	0.9558
0.331	10.5098	536	0.8659	0.1162	0.8659	0.9305
0.331	10.5490	538	0.8558	0.0768	0.8558	0.9251
0.331	10.5882	540	0.8353	0.1133	0.8353	0.9140
0.331	10.6275	542	0.7903	0.1172	0.7903	0.8890
0.331	10.6667	544	0.7508	0.0114	0.7508	0.8665
0.331	10.7059	546	0.7231	0.2626	0.7231	0.8503
0.331	10.7451	548	0.7429	0.1965	0.7429	0.8619
0.331	10.7843	550	0.7709	0.1775	0.7709	0.8780
0.331	10.8235	552	0.8383	-0.0101	0.8383	0.9156
0.331	10.8627	554	0.8110	-0.0079	0.8110	0.9006
0.331	10.9020	556	0.7308	0.2669	0.7308	0.8549
0.331	10.9412	558	0.7223	0.2150	0.7223	0.8499
0.331	10.9804	560	0.7467	0.0265	0.7467	0.8641
0.331	11.0196	562	0.7773	0.1571	0.7773	0.8817
0.331	11.0588	564	0.7895	0.1203	0.7895	0.8886
0.331	11.0980	566	0.8510	0.2152	0.8510	0.9225
0.331	11.1373	568	0.8886	0.2045	0.8886	0.9427
0.331	11.1765	570	0.8809	0.1479	0.8809	0.9386
0.331	11.2157	572	0.8191	0.1511	0.8191	0.9050
0.331	11.2549	574	0.8052	0.0928	0.8052	0.8973
0.331	11.2941	576	0.7930	0.0893	0.7930	0.8905
0.331	11.3333	578	0.7921	0.2914	0.7921	0.8900
0.331	11.3725	580	0.8264	0.1943	0.8264	0.9091
0.331	11.4118	582	0.9167	0.0881	0.9167	0.9575
0.331	11.4510	584	0.9449	0.0789	0.9449	0.9721
0.331	11.4902	586	0.8682	0.1149	0.8682	0.9318
0.331	11.5294	588	0.8006	0.2544	0.8006	0.8948
0.331	11.5686	590	0.7735	-0.0647	0.7735	0.8795
0.331	11.6078	592	0.7817	-0.0503	0.7817	0.8841
0.331	11.6471	594	0.7587	0.1236	0.7587	0.8711
0.331	11.6863	596	0.8372	0.1243	0.8372	0.9150
0.331	11.7255	598	0.8515	-0.0079	0.8515	0.9228
0.331	11.7647	600	0.7658	0.2150	0.7658	0.8751
0.331	11.8039	602	0.7468	0.0874	0.7468	0.8642
0.331	11.8431	604	0.7532	0.2150	0.7532	0.8679
0.331	11.8824	606	0.7905	0.2424	0.7905	0.8891
0.331	11.9216	608	0.8086	0.1836	0.8086	0.8992
0.331	11.9608	610	0.8176	0.1775	0.8176	0.9042
0.331	12.0	612	0.8623	-0.0033	0.8623	0.9286
0.331	12.0392	614	0.8729	-0.0408	0.8729	0.9343
0.331	12.0784	616	0.8394	0.0700	0.8394	0.9162
0.331	12.1176	618	0.8425	0.0129	0.8425	0.9179
0.331	12.1569	620	0.8413	0.0129	0.8413	0.9172

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1