ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7907
• Qwk: 0.7331
• Mse: 0.7907
• Rmse: 0.8892

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0339	2	2.2989	-0.0013	2.2989	1.5162
No log	0.0678	4	1.5485	0.1429	1.5485	1.2444
No log	0.1017	6	1.3867	0.1289	1.3867	1.1776
No log	0.1356	8	1.4361	0.2919	1.4361	1.1984
No log	0.1695	10	1.5645	0.3432	1.5645	1.2508
No log	0.2034	12	1.8664	0.3009	1.8664	1.3662
No log	0.2373	14	1.7126	0.3307	1.7126	1.3087
No log	0.2712	16	1.6262	0.3034	1.6262	1.2752
No log	0.3051	18	1.4393	0.2345	1.4393	1.1997
No log	0.3390	20	1.2942	0.1668	1.2942	1.1376
No log	0.3729	22	1.2367	0.1810	1.2367	1.1120
No log	0.4068	24	1.2089	0.3002	1.2089	1.0995
No log	0.4407	26	1.2500	0.3196	1.2500	1.1180
No log	0.4746	28	1.2058	0.3396	1.2058	1.0981
No log	0.5085	30	1.1931	0.3681	1.1931	1.0923
No log	0.5424	32	1.0859	0.3823	1.0859	1.0421
No log	0.5763	34	1.0316	0.4258	1.0316	1.0157
No log	0.6102	36	1.0633	0.3680	1.0633	1.0311
No log	0.6441	38	0.9921	0.5270	0.9921	0.9961
No log	0.6780	40	1.0147	0.4147	1.0147	1.0073
No log	0.7119	42	1.0493	0.4631	1.0493	1.0244
No log	0.7458	44	0.9724	0.4731	0.9724	0.9861
No log	0.7797	46	0.9711	0.4918	0.9711	0.9855
No log	0.8136	48	1.1581	0.4340	1.1581	1.0762
No log	0.8475	50	1.5797	0.3758	1.5797	1.2569
No log	0.8814	52	1.6017	0.3485	1.6017	1.2656
No log	0.9153	54	1.3071	0.4346	1.3071	1.1433
No log	0.9492	56	1.0552	0.5310	1.0552	1.0272
No log	0.9831	58	0.9740	0.4715	0.9740	0.9869
No log	1.0169	60	0.9514	0.5353	0.9514	0.9754
No log	1.0508	62	1.0611	0.5394	1.0611	1.0301
No log	1.0847	64	1.2056	0.4594	1.2056	1.0980
No log	1.1186	66	1.1785	0.5019	1.1785	1.0856
No log	1.1525	68	0.8856	0.6011	0.8856	0.9411
No log	1.1864	70	0.7848	0.6042	0.7848	0.8859
No log	1.2203	72	0.7947	0.5771	0.7947	0.8915
No log	1.2542	74	0.7407	0.6047	0.7407	0.8606
No log	1.2881	76	0.7367	0.6841	0.7367	0.8583
No log	1.3220	78	0.7356	0.6883	0.7356	0.8576
No log	1.3559	80	0.8145	0.6649	0.8145	0.9025
No log	1.3898	82	0.8021	0.6497	0.8021	0.8956
No log	1.4237	84	0.7170	0.6523	0.7170	0.8468
No log	1.4576	86	0.7075	0.6443	0.7075	0.8411
No log	1.4915	88	0.7609	0.6635	0.7609	0.8723
No log	1.5254	90	1.0171	0.6167	1.0171	1.0085
No log	1.5593	92	1.0560	0.5812	1.0560	1.0276
No log	1.5932	94	0.8417	0.6686	0.8417	0.9174
No log	1.6271	96	0.7032	0.6816	0.7032	0.8386
No log	1.6610	98	0.6761	0.6993	0.6761	0.8222
No log	1.6949	100	0.7094	0.7056	0.7094	0.8423
No log	1.7288	102	0.9244	0.6269	0.9244	0.9615
No log	1.7627	104	0.9958	0.5950	0.9958	0.9979
No log	1.7966	106	0.8427	0.6351	0.8427	0.9180
No log	1.8305	108	0.7639	0.6755	0.7639	0.8740
No log	1.8644	110	0.7835	0.6591	0.7835	0.8851
No log	1.8983	112	0.9816	0.5982	0.9816	0.9907
No log	1.9322	114	1.1306	0.5631	1.1306	1.0633
No log	1.9661	116	1.2231	0.5600	1.2231	1.1059
No log	2.0	118	1.1038	0.5606	1.1038	1.0506
No log	2.0339	120	0.8516	0.6193	0.8516	0.9228
No log	2.0678	122	0.7202	0.6795	0.7202	0.8487
No log	2.1017	124	0.7235	0.6683	0.7235	0.8506
No log	2.1356	126	0.8760	0.6247	0.8760	0.9359
No log	2.1695	128	1.1917	0.5421	1.1917	1.0916
No log	2.2034	130	1.4797	0.5376	1.4797	1.2164
No log	2.2373	132	1.3984	0.5420	1.3984	1.1825
No log	2.2712	134	1.0788	0.5348	1.0788	1.0386
No log	2.3051	136	0.8101	0.6092	0.8101	0.9000
No log	2.3390	138	0.7542	0.6363	0.7542	0.8684
No log	2.3729	140	0.8372	0.6352	0.8372	0.9150
No log	2.4068	142	1.1395	0.6034	1.1395	1.0675
No log	2.4407	144	1.2630	0.5581	1.2630	1.1238
No log	2.4746	146	1.1260	0.5967	1.1260	1.0611
No log	2.5085	148	0.8570	0.6837	0.8570	0.9258
No log	2.5424	150	0.6900	0.6832	0.6900	0.8307
No log	2.5763	152	0.6793	0.6833	0.6793	0.8242
No log	2.6102	154	0.7200	0.6886	0.7200	0.8485
No log	2.6441	156	0.8405	0.6780	0.8405	0.9168
No log	2.6780	158	0.8413	0.6670	0.8413	0.9172
No log	2.7119	160	0.6983	0.7084	0.6983	0.8356
No log	2.7458	162	0.6449	0.7270	0.6449	0.8030
No log	2.7797	164	0.6212	0.7322	0.6212	0.7882
No log	2.8136	166	0.6428	0.7269	0.6428	0.8018
No log	2.8475	168	0.7533	0.7133	0.7533	0.8679
No log	2.8814	170	1.0037	0.6634	1.0037	1.0018
No log	2.9153	172	1.0638	0.6427	1.0638	1.0314
No log	2.9492	174	0.9240	0.6979	0.9240	0.9612
No log	2.9831	176	0.7730	0.7191	0.7730	0.8792
No log	3.0169	178	0.7010	0.7293	0.7010	0.8372
No log	3.0508	180	0.6501	0.7192	0.6501	0.8063
No log	3.0847	182	0.6681	0.6894	0.6681	0.8174
No log	3.1186	184	0.7633	0.6470	0.7633	0.8737
No log	3.1525	186	0.8820	0.6607	0.8820	0.9392
No log	3.1864	188	0.9820	0.6078	0.9820	0.9910
No log	3.2203	190	1.0328	0.6116	1.0328	1.0163
No log	3.2542	192	0.9911	0.6230	0.9911	0.9955
No log	3.2881	194	0.9410	0.6356	0.9410	0.9701
No log	3.3220	196	0.8124	0.6688	0.8124	0.9013
No log	3.3559	198	0.8006	0.7132	0.8006	0.8948
No log	3.3898	200	0.8480	0.6996	0.8480	0.9209
No log	3.4237	202	0.9185	0.6807	0.9185	0.9584
No log	3.4576	204	0.8409	0.7018	0.8409	0.9170
No log	3.4915	206	0.7120	0.7265	0.7120	0.8438
No log	3.5254	208	0.6197	0.7112	0.6197	0.7872
No log	3.5593	210	0.6205	0.6875	0.6205	0.7877
No log	3.5932	212	0.6039	0.7112	0.6039	0.7771
No log	3.6271	214	0.6465	0.7467	0.6465	0.8041
No log	3.6610	216	0.8121	0.7033	0.8121	0.9012
No log	3.6949	218	0.8510	0.6881	0.8510	0.9225
No log	3.7288	220	0.7345	0.7302	0.7345	0.8570
No log	3.7627	222	0.6225	0.7515	0.6225	0.7890
No log	3.7966	224	0.5926	0.7043	0.5926	0.7698
No log	3.8305	226	0.5965	0.7043	0.5965	0.7723
No log	3.8644	228	0.6311	0.7345	0.6311	0.7944
No log	3.8983	230	0.7427	0.7034	0.7427	0.8618
No log	3.9322	232	0.9507	0.6697	0.9507	0.9750
No log	3.9661	234	0.9849	0.6656	0.9849	0.9924
No log	4.0	236	0.8641	0.6797	0.8641	0.9296
No log	4.0339	238	0.7376	0.6933	0.7376	0.8589
No log	4.0678	240	0.6931	0.6587	0.6931	0.8325
No log	4.1017	242	0.6971	0.6548	0.6971	0.8349
No log	4.1356	244	0.7425	0.6669	0.7425	0.8617
No log	4.1695	246	0.8425	0.6508	0.8425	0.9179
No log	4.2034	248	0.9418	0.6434	0.9418	0.9705
No log	4.2373	250	0.9439	0.6529	0.9439	0.9715
No log	4.2712	252	0.8786	0.6688	0.8786	0.9374
No log	4.3051	254	0.8410	0.6696	0.8410	0.9171
No log	4.3390	256	0.8581	0.6630	0.8581	0.9264
No log	4.3729	258	0.8664	0.6595	0.8664	0.9308
No log	4.4068	260	0.8762	0.6404	0.8762	0.9361
No log	4.4407	262	0.8551	0.6557	0.8551	0.9247
No log	4.4746	264	0.8468	0.6607	0.8468	0.9202
No log	4.5085	266	0.7701	0.7024	0.7701	0.8776
No log	4.5424	268	0.6988	0.7307	0.6988	0.8359
No log	4.5763	270	0.6834	0.7400	0.6834	0.8267
No log	4.6102	272	0.7229	0.7210	0.7229	0.8502
No log	4.6441	274	0.7388	0.7203	0.7388	0.8595
No log	4.6780	276	0.7007	0.7307	0.7007	0.8371
No log	4.7119	278	0.6886	0.7299	0.6886	0.8298
No log	4.7458	280	0.6885	0.7372	0.6885	0.8298
No log	4.7797	282	0.7108	0.7229	0.7108	0.8431
No log	4.8136	284	0.7070	0.7229	0.7070	0.8408
No log	4.8475	286	0.6769	0.7374	0.6769	0.8227
No log	4.8814	288	0.6613	0.7255	0.6613	0.8132
No log	4.9153	290	0.6783	0.7351	0.6783	0.8236
No log	4.9492	292	0.7162	0.7258	0.7162	0.8463
No log	4.9831	294	0.7664	0.7254	0.7664	0.8755
No log	5.0169	296	0.7421	0.7224	0.7421	0.8614
No log	5.0508	298	0.6913	0.7263	0.6913	0.8314
No log	5.0847	300	0.6737	0.7351	0.6737	0.8208
No log	5.1186	302	0.6962	0.7286	0.6962	0.8344
No log	5.1525	304	0.7450	0.7398	0.7450	0.8631
No log	5.1864	306	0.7391	0.7479	0.7391	0.8597
No log	5.2203	308	0.7196	0.7468	0.7196	0.8483
No log	5.2542	310	0.7023	0.7220	0.7023	0.8380
No log	5.2881	312	0.7395	0.7244	0.7395	0.8599
No log	5.3220	314	0.8033	0.7231	0.8033	0.8963
No log	5.3559	316	0.7968	0.7230	0.7968	0.8926
No log	5.3898	318	0.7736	0.7332	0.7736	0.8795
No log	5.4237	320	0.7803	0.7332	0.7803	0.8834
No log	5.4576	322	0.7756	0.7563	0.7756	0.8807
No log	5.4915	324	0.8164	0.7215	0.8164	0.9036
No log	5.5254	326	0.8391	0.7216	0.8391	0.9160
No log	5.5593	328	0.8060	0.7428	0.8060	0.8978
No log	5.5932	330	0.7439	0.7607	0.7439	0.8625
No log	5.6271	332	0.7554	0.7607	0.7554	0.8691
No log	5.6610	334	0.7488	0.7607	0.7488	0.8653
No log	5.6949	336	0.7685	0.7523	0.7685	0.8766
No log	5.7288	338	0.7350	0.7536	0.7350	0.8573
No log	5.7627	340	0.7019	0.7543	0.7019	0.8378
No log	5.7966	342	0.6718	0.7152	0.6718	0.8197
No log	5.8305	344	0.6627	0.7241	0.6627	0.8141
No log	5.8644	346	0.6531	0.7309	0.6531	0.8082
No log	5.8983	348	0.6300	0.7136	0.6300	0.7937
No log	5.9322	350	0.6318	0.7367	0.6318	0.7949
No log	5.9661	352	0.6378	0.7487	0.6378	0.7987
No log	6.0	354	0.6307	0.7473	0.6307	0.7941
No log	6.0339	356	0.6099	0.7230	0.6099	0.7809
No log	6.0678	358	0.6086	0.7150	0.6086	0.7801
No log	6.1017	360	0.6115	0.7057	0.6115	0.7820
No log	6.1356	362	0.6339	0.7395	0.6339	0.7962
No log	6.1695	364	0.6526	0.7461	0.6526	0.8078
No log	6.2034	366	0.6642	0.7489	0.6642	0.8150
No log	6.2373	368	0.6919	0.7365	0.6919	0.8318
No log	6.2712	370	0.7506	0.7315	0.7506	0.8664
No log	6.3051	372	0.7783	0.7187	0.7783	0.8822
No log	6.3390	374	0.7635	0.7262	0.7635	0.8738
No log	6.3729	376	0.7298	0.7365	0.7298	0.8543
No log	6.4068	378	0.6808	0.7164	0.6808	0.8251
No log	6.4407	380	0.6662	0.7004	0.6662	0.8162
No log	6.4746	382	0.6423	0.7116	0.6423	0.8015
No log	6.5085	384	0.6384	0.7201	0.6384	0.7990
No log	6.5424	386	0.6336	0.7157	0.6336	0.7960
No log	6.5763	388	0.6665	0.7410	0.6665	0.8164
No log	6.6102	390	0.7285	0.7476	0.7285	0.8535
No log	6.6441	392	0.7566	0.7227	0.7566	0.8698
No log	6.6780	394	0.7157	0.7629	0.7157	0.8460
No log	6.7119	396	0.6956	0.7809	0.6956	0.8340
No log	6.7458	398	0.6750	0.7865	0.6750	0.8216
No log	6.7797	400	0.6968	0.7782	0.6968	0.8347
No log	6.8136	402	0.7036	0.7501	0.7036	0.8388
No log	6.8475	404	0.6930	0.7424	0.6930	0.8325
No log	6.8814	406	0.6729	0.7228	0.6729	0.8203
No log	6.9153	408	0.6815	0.7099	0.6815	0.8255
No log	6.9492	410	0.7320	0.7087	0.7320	0.8556
No log	6.9831	412	0.7960	0.7014	0.7960	0.8922
No log	7.0169	414	0.8335	0.7035	0.8335	0.9130
No log	7.0508	416	0.8429	0.7142	0.8429	0.9181
No log	7.0847	418	0.8105	0.7184	0.8105	0.9003
No log	7.1186	420	0.7731	0.7188	0.7731	0.8793
No log	7.1525	422	0.7427	0.7137	0.7427	0.8618
No log	7.1864	424	0.7179	0.7041	0.7179	0.8473
No log	7.2203	426	0.7384	0.7100	0.7384	0.8593
No log	7.2542	428	0.7906	0.7096	0.7906	0.8892
No log	7.2881	430	0.8633	0.6829	0.8633	0.9291
No log	7.3220	432	0.9187	0.6721	0.9187	0.9585
No log	7.3559	434	0.9411	0.6550	0.9411	0.9701
No log	7.3898	436	0.9223	0.6613	0.9223	0.9604
No log	7.4237	438	0.8569	0.6969	0.8569	0.9257
No log	7.4576	440	0.8382	0.7007	0.8382	0.9155
No log	7.4915	442	0.8600	0.6969	0.8600	0.9274
No log	7.5254	444	0.8710	0.6969	0.8710	0.9333
No log	7.5593	446	0.9159	0.6613	0.9159	0.9570
No log	7.5932	448	0.9161	0.6529	0.9161	0.9571
No log	7.6271	450	0.9204	0.6529	0.9204	0.9594
No log	7.6610	452	0.9192	0.6529	0.9192	0.9588
No log	7.6949	454	0.8766	0.6885	0.8766	0.9362
No log	7.7288	456	0.8230	0.7162	0.8230	0.9072
No log	7.7627	458	0.8079	0.7205	0.8079	0.8989
No log	7.7966	460	0.8122	0.7247	0.8122	0.9012
No log	7.8305	462	0.8086	0.7149	0.8086	0.8992
No log	7.8644	464	0.8221	0.7149	0.8221	0.9067
No log	7.8983	466	0.8542	0.7023	0.8542	0.9242
No log	7.9322	468	0.8715	0.6885	0.8715	0.9335
No log	7.9661	470	0.8784	0.6790	0.8784	0.9372
No log	8.0	472	0.8475	0.6981	0.8475	0.9206
No log	8.0339	474	0.8080	0.7039	0.8080	0.8989
No log	8.0678	476	0.7712	0.7042	0.7712	0.8782
No log	8.1017	478	0.7566	0.7002	0.7566	0.8698
No log	8.1356	480	0.7497	0.6960	0.7497	0.8658
No log	8.1695	482	0.7379	0.7026	0.7379	0.8590
No log	8.2034	484	0.7274	0.6988	0.7274	0.8529
No log	8.2373	486	0.7317	0.7157	0.7317	0.8554
No log	8.2712	488	0.7598	0.7289	0.7598	0.8717
No log	8.3051	490	0.8039	0.7268	0.8039	0.8966
No log	8.3390	492	0.8492	0.7226	0.8492	0.9215
No log	8.3729	494	0.8557	0.7192	0.8557	0.9250
No log	8.4068	496	0.8673	0.7110	0.8673	0.9313
No log	8.4407	498	0.8793	0.6950	0.8793	0.9377
0.3017	8.4746	500	0.8799	0.6950	0.8799	0.9380
0.3017	8.5085	502	0.8918	0.6815	0.8918	0.9444
0.3017	8.5424	504	0.9037	0.6555	0.9037	0.9506
0.3017	8.5763	506	0.9201	0.6514	0.9201	0.9592
0.3017	8.6102	508	0.8995	0.6514	0.8995	0.9484
0.3017	8.6441	510	0.8611	0.7035	0.8611	0.9280
0.3017	8.6780	512	0.8169	0.6936	0.8169	0.9038
0.3017	8.7119	514	0.7729	0.7106	0.7729	0.8792
0.3017	8.7458	516	0.7499	0.7171	0.7499	0.8660
0.3017	8.7797	518	0.7426	0.7171	0.7426	0.8617
0.3017	8.8136	520	0.7510	0.7171	0.7510	0.8666
0.3017	8.8475	522	0.7693	0.7310	0.7693	0.8771
0.3017	8.8814	524	0.7878	0.7310	0.7878	0.8876
0.3017	8.9153	526	0.8117	0.7324	0.8117	0.9009
0.3017	8.9492	528	0.8292	0.7162	0.8292	0.9106
0.3017	8.9831	530	0.8381	0.7120	0.8381	0.9155
0.3017	9.0169	532	0.8352	0.7120	0.8352	0.9139
0.3017	9.0508	534	0.8336	0.7282	0.8336	0.9130
0.3017	9.0847	536	0.8287	0.7324	0.8287	0.9103
0.3017	9.1186	538	0.8191	0.7324	0.8191	0.9050
0.3017	9.1525	540	0.8042	0.7324	0.8042	0.8968
0.3017	9.1864	542	0.7893	0.7331	0.7893	0.8884
0.3017	9.2203	544	0.7715	0.7331	0.7715	0.8784
0.3017	9.2542	546	0.7583	0.7274	0.7583	0.8708
0.3017	9.2881	548	0.7524	0.7181	0.7524	0.8674
0.3017	9.3220	550	0.7521	0.7181	0.7521	0.8672
0.3017	9.3559	552	0.7508	0.7181	0.7508	0.8665
0.3017	9.3898	554	0.7506	0.7181	0.7506	0.8664
0.3017	9.4237	556	0.7507	0.7181	0.7507	0.8664
0.3017	9.4576	558	0.7572	0.7239	0.7572	0.8702
0.3017	9.4915	560	0.7617	0.7239	0.7617	0.8728
0.3017	9.5254	562	0.7630	0.7274	0.7630	0.8735
0.3017	9.5593	564	0.7633	0.7274	0.7633	0.8736
0.3017	9.5932	566	0.7599	0.7217	0.7599	0.8717
0.3017	9.6271	568	0.7589	0.7217	0.7589	0.8711
0.3017	9.6610	570	0.7622	0.7217	0.7622	0.8731
0.3017	9.6949	572	0.7683	0.7274	0.7683	0.8766
0.3017	9.7288	574	0.7726	0.7331	0.7726	0.8790
0.3017	9.7627	576	0.7791	0.7331	0.7791	0.8827
0.3017	9.7966	578	0.7840	0.7331	0.7840	0.8855
0.3017	9.8305	580	0.7872	0.7331	0.7872	0.8872
0.3017	9.8644	582	0.7891	0.7331	0.7891	0.8883
0.3017	9.8983	584	0.7905	0.7331	0.7905	0.8891
0.3017	9.9322	586	0.7911	0.7331	0.7911	0.8894
0.3017	9.9661	588	0.7910	0.7331	0.7910	0.8894
0.3017	10.0	590	0.7907	0.7331	0.7907	0.8892

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1