ArabicNewSplits5_FineTuningAraBERT_run2_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7034
• Qwk: 0.7003
• Mse: 0.7034
• Rmse: 0.8387

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.2625	-0.0045	2.2625	1.5041
No log	0.0755	4	1.6142	0.1256	1.6142	1.2705
No log	0.1132	6	1.4008	0.2183	1.4008	1.1836
No log	0.1509	8	1.3922	0.1771	1.3922	1.1799
No log	0.1887	10	1.3060	0.2515	1.3060	1.1428
No log	0.2264	12	1.3729	0.2786	1.3729	1.1717
No log	0.2642	14	1.3790	0.2406	1.3790	1.1743
No log	0.3019	16	1.2269	0.1764	1.2269	1.1077
No log	0.3396	18	1.1843	0.2153	1.1843	1.0883
No log	0.3774	20	1.1866	0.2913	1.1866	1.0893
No log	0.4151	22	1.1471	0.3040	1.1471	1.0710
No log	0.4528	24	1.1288	0.3198	1.1288	1.0624
No log	0.4906	26	1.1515	0.3399	1.1515	1.0731
No log	0.5283	28	1.1642	0.3537	1.1642	1.0790
No log	0.5660	30	1.2399	0.3444	1.2399	1.1135
No log	0.6038	32	1.4106	0.2242	1.4106	1.1877
No log	0.6415	34	1.4430	0.2137	1.4430	1.2012
No log	0.6792	36	1.2950	0.2259	1.2950	1.1380
No log	0.7170	38	1.2393	0.3161	1.2393	1.1132
No log	0.7547	40	1.1980	0.3119	1.1980	1.0946
No log	0.7925	42	1.1233	0.3917	1.1233	1.0598
No log	0.8302	44	1.0458	0.3887	1.0458	1.0227
No log	0.8679	46	1.0745	0.4064	1.0745	1.0366
No log	0.9057	48	1.1457	0.4028	1.1457	1.0704
No log	0.9434	50	1.0687	0.4473	1.0687	1.0338
No log	0.9811	52	1.1626	0.3608	1.1626	1.0782
No log	1.0189	54	1.4167	0.2516	1.4167	1.1902
No log	1.0566	56	1.3709	0.2761	1.3709	1.1709
No log	1.0943	58	1.1461	0.4004	1.1461	1.0706
No log	1.1321	60	1.0158	0.4342	1.0158	1.0079
No log	1.1698	62	1.3211	0.4147	1.3211	1.1494
No log	1.2075	64	1.4809	0.4217	1.4809	1.2169
No log	1.2453	66	1.2533	0.4262	1.2533	1.1195
No log	1.2830	68	1.0484	0.4422	1.0484	1.0239
No log	1.3208	70	1.0158	0.4401	1.0158	1.0079
No log	1.3585	72	1.0172	0.4401	1.0172	1.0085
No log	1.3962	74	1.0177	0.4584	1.0177	1.0088
No log	1.4340	76	1.0445	0.4705	1.0445	1.0220
No log	1.4717	78	1.2354	0.4463	1.2354	1.1115
No log	1.5094	80	1.5188	0.4139	1.5188	1.2324
No log	1.5472	82	1.3761	0.4067	1.3761	1.1731
No log	1.5849	84	1.0807	0.4779	1.0807	1.0396
No log	1.6226	86	0.8823	0.5654	0.8823	0.9393
No log	1.6604	88	0.8818	0.5541	0.8818	0.9391
No log	1.6981	90	0.8677	0.5541	0.8677	0.9315
No log	1.7358	92	0.8157	0.5595	0.8157	0.9031
No log	1.7736	94	0.8715	0.6182	0.8715	0.9335
No log	1.8113	96	1.0155	0.4812	1.0155	1.0077
No log	1.8491	98	1.0191	0.5189	1.0191	1.0095
No log	1.8868	100	0.9230	0.5591	0.9230	0.9607
No log	1.9245	102	0.8876	0.5812	0.8876	0.9421
No log	1.9623	104	0.8291	0.5997	0.8291	0.9106
No log	2.0	106	0.7881	0.6263	0.7881	0.8878
No log	2.0377	108	0.7856	0.6539	0.7856	0.8863
No log	2.0755	110	0.7978	0.6330	0.7978	0.8932
No log	2.1132	112	0.8891	0.6309	0.8891	0.9429
No log	2.1509	114	1.0972	0.6194	1.0972	1.0475
No log	2.1887	116	1.0868	0.6194	1.0868	1.0425
No log	2.2264	118	0.8737	0.6660	0.8737	0.9347
No log	2.2642	120	0.8426	0.6514	0.8426	0.9179
No log	2.3019	122	0.8804	0.6643	0.8804	0.9383
No log	2.3396	124	0.8763	0.6592	0.8763	0.9361
No log	2.3774	126	0.8627	0.6782	0.8627	0.9288
No log	2.4151	128	0.8641	0.6696	0.8641	0.9296
No log	2.4528	130	0.9232	0.6313	0.9232	0.9608
No log	2.4906	132	0.8510	0.6798	0.8510	0.9225
No log	2.5283	134	0.7971	0.6923	0.7971	0.8928
No log	2.5660	136	0.7568	0.7383	0.7568	0.8699
No log	2.6038	138	0.7184	0.6757	0.7184	0.8476
No log	2.6415	140	0.7190	0.6935	0.7190	0.8479
No log	2.6792	142	0.7377	0.7051	0.7377	0.8589
No log	2.7170	144	0.7753	0.6760	0.7753	0.8805
No log	2.7547	146	0.7350	0.6898	0.7350	0.8573
No log	2.7925	148	0.7033	0.6592	0.7033	0.8386
No log	2.8302	150	0.7029	0.6602	0.7029	0.8384
No log	2.8679	152	0.7064	0.6677	0.7064	0.8405
No log	2.9057	154	0.7846	0.6857	0.7846	0.8858
No log	2.9434	156	0.9703	0.6194	0.9703	0.9850
No log	2.9811	158	1.0542	0.5969	1.0542	1.0267
No log	3.0189	160	1.0685	0.5865	1.0685	1.0337
No log	3.0566	162	0.9776	0.6093	0.9776	0.9887
No log	3.0943	164	0.8831	0.6373	0.8831	0.9397
No log	3.1321	166	0.9084	0.6103	0.9084	0.9531
No log	3.1698	168	0.9695	0.5422	0.9695	0.9846
No log	3.2075	170	0.9489	0.5580	0.9489	0.9741
No log	3.2453	172	0.8325	0.5972	0.8325	0.9124
No log	3.2830	174	0.7622	0.6649	0.7622	0.8731
No log	3.3208	176	0.7670	0.6250	0.7670	0.8758
No log	3.3585	178	0.8004	0.6042	0.8004	0.8946
No log	3.3962	180	0.8485	0.6072	0.8485	0.9212
No log	3.4340	182	0.9065	0.6413	0.9065	0.9521
No log	3.4717	184	0.8440	0.6573	0.8440	0.9187
No log	3.5094	186	0.8485	0.6747	0.8485	0.9211
No log	3.5472	188	0.8440	0.6771	0.8440	0.9187
No log	3.5849	190	0.8155	0.6824	0.8155	0.9031
No log	3.6226	192	0.7579	0.6840	0.7579	0.8706
No log	3.6604	194	0.7568	0.6788	0.7568	0.8699
No log	3.6981	196	0.7668	0.6868	0.7668	0.8757
No log	3.7358	198	0.7429	0.7021	0.7429	0.8619
No log	3.7736	200	0.7129	0.6840	0.7129	0.8443
No log	3.8113	202	0.7348	0.7021	0.7348	0.8572
No log	3.8491	204	0.7976	0.6771	0.7976	0.8931
No log	3.8868	206	0.7541	0.7126	0.7541	0.8684
No log	3.9245	208	0.7228	0.6903	0.7228	0.8502
No log	3.9623	210	0.7112	0.6851	0.7112	0.8433
No log	4.0	212	0.7017	0.6685	0.7017	0.8377
No log	4.0377	214	0.7402	0.6606	0.7402	0.8604
No log	4.0755	216	0.7330	0.6562	0.7330	0.8561
No log	4.1132	218	0.6869	0.6800	0.6869	0.8288
No log	4.1509	220	0.7061	0.7012	0.7061	0.8403
No log	4.1887	222	0.7605	0.7271	0.7605	0.8721
No log	4.2264	224	0.7898	0.7242	0.7898	0.8887
No log	4.2642	226	0.7587	0.7263	0.7587	0.8711
No log	4.3019	228	0.6893	0.6900	0.6893	0.8303
No log	4.3396	230	0.6732	0.6636	0.6732	0.8205
No log	4.3774	232	0.6682	0.6784	0.6682	0.8174
No log	4.4151	234	0.6750	0.6657	0.6750	0.8216
No log	4.4528	236	0.7126	0.6754	0.7126	0.8441
No log	4.4906	238	0.7813	0.6571	0.7813	0.8839
No log	4.5283	240	0.8007	0.6361	0.8007	0.8948
No log	4.5660	242	0.7869	0.6296	0.7869	0.8871
No log	4.6038	244	0.7596	0.6578	0.7596	0.8715
No log	4.6415	246	0.7145	0.6941	0.7145	0.8453
No log	4.6792	248	0.7052	0.7039	0.7052	0.8398
No log	4.7170	250	0.7135	0.7068	0.7135	0.8447
No log	4.7547	252	0.7605	0.7218	0.7605	0.8720
No log	4.7925	254	0.8061	0.7039	0.8061	0.8978
No log	4.8302	256	0.9126	0.6199	0.9126	0.9553
No log	4.8679	258	0.9473	0.6220	0.9473	0.9733
No log	4.9057	260	0.8637	0.6304	0.8637	0.9293
No log	4.9434	262	0.7425	0.7111	0.7425	0.8617
No log	4.9811	264	0.6951	0.7118	0.6951	0.8337
No log	5.0189	266	0.6622	0.7047	0.6622	0.8137
No log	5.0566	268	0.6497	0.6840	0.6497	0.8060
No log	5.0943	270	0.6570	0.6933	0.6570	0.8106
No log	5.1321	272	0.7027	0.7183	0.7027	0.8383
No log	5.1698	274	0.7405	0.6852	0.7405	0.8605
No log	5.2075	276	0.7431	0.6892	0.7431	0.8620
No log	5.2453	278	0.7013	0.6932	0.7014	0.8375
No log	5.2830	280	0.6656	0.6549	0.6656	0.8159
No log	5.3208	282	0.6719	0.6910	0.6719	0.8197
No log	5.3585	284	0.6691	0.6910	0.6691	0.8180
No log	5.3962	286	0.6583	0.7117	0.6583	0.8114
No log	5.4340	288	0.6787	0.6922	0.6787	0.8238
No log	5.4717	290	0.7109	0.7118	0.7109	0.8432
No log	5.5094	292	0.7304	0.7102	0.7304	0.8546
No log	5.5472	294	0.7875	0.6954	0.7875	0.8874
No log	5.5849	296	0.7848	0.6954	0.7848	0.8859
No log	5.6226	298	0.7299	0.7056	0.7299	0.8544
No log	5.6604	300	0.6759	0.7121	0.6759	0.8221
No log	5.6981	302	0.6649	0.7080	0.6649	0.8154
No log	5.7358	304	0.6711	0.7072	0.6711	0.8192
No log	5.7736	306	0.6714	0.6995	0.6714	0.8194
No log	5.8113	308	0.6968	0.7006	0.6968	0.8347
No log	5.8491	310	0.7084	0.7006	0.7084	0.8417
No log	5.8868	312	0.6889	0.7055	0.6889	0.8300
No log	5.9245	314	0.6953	0.7055	0.6953	0.8338
No log	5.9623	316	0.7037	0.7059	0.7037	0.8389
No log	6.0	318	0.6892	0.7059	0.6892	0.8302
No log	6.0377	320	0.6701	0.7139	0.6701	0.8186
No log	6.0755	322	0.6502	0.6949	0.6502	0.8063
No log	6.1132	324	0.6337	0.6927	0.6337	0.7960
No log	6.1509	326	0.6287	0.6907	0.6287	0.7929
No log	6.1887	328	0.6257	0.7037	0.6257	0.7910
No log	6.2264	330	0.6279	0.6978	0.6279	0.7924
No log	6.2642	332	0.6575	0.7269	0.6575	0.8109
No log	6.3019	334	0.6994	0.7216	0.6994	0.8363
No log	6.3396	336	0.6932	0.7216	0.6932	0.8326
No log	6.3774	338	0.6645	0.7269	0.6645	0.8152
No log	6.4151	340	0.6345	0.6818	0.6345	0.7966
No log	6.4528	342	0.6345	0.7081	0.6345	0.7965
No log	6.4906	344	0.6488	0.6475	0.6488	0.8055
No log	6.5283	346	0.6481	0.6475	0.6481	0.8051
No log	6.5660	348	0.6402	0.6763	0.6402	0.8001
No log	6.6038	350	0.6392	0.6905	0.6392	0.7995
No log	6.6415	352	0.6466	0.7046	0.6466	0.8041
No log	6.6792	354	0.6663	0.7051	0.6663	0.8163
No log	6.7170	356	0.6941	0.6855	0.6941	0.8331
No log	6.7547	358	0.6880	0.6961	0.6880	0.8295
No log	6.7925	360	0.6611	0.7198	0.6611	0.8131
No log	6.8302	362	0.6268	0.7260	0.6268	0.7917
No log	6.8679	364	0.6105	0.7048	0.6105	0.7814
No log	6.9057	366	0.6074	0.7122	0.6074	0.7794
No log	6.9434	368	0.6102	0.7090	0.6102	0.7811
No log	6.9811	370	0.6262	0.7260	0.6262	0.7913
No log	7.0189	372	0.6562	0.7229	0.6562	0.8101
No log	7.0566	374	0.6801	0.6990	0.6801	0.8247
No log	7.0943	376	0.7027	0.7075	0.7027	0.8383
No log	7.1321	378	0.6806	0.6990	0.6806	0.8250
No log	7.1698	380	0.6338	0.7277	0.6338	0.7961
No log	7.2075	382	0.6054	0.7208	0.6054	0.7781
No log	7.2453	384	0.5998	0.6939	0.5998	0.7744
No log	7.2830	386	0.6018	0.6948	0.6018	0.7758
No log	7.3208	388	0.6039	0.7024	0.6039	0.7771
No log	7.3585	390	0.6162	0.7341	0.6162	0.7850
No log	7.3962	392	0.6312	0.7325	0.6312	0.7945
No log	7.4340	394	0.6397	0.7227	0.6397	0.7998
No log	7.4717	396	0.6305	0.7267	0.6305	0.7941
No log	7.5094	398	0.6232	0.7178	0.6232	0.7894
No log	7.5472	400	0.6260	0.7178	0.6260	0.7912
No log	7.5849	402	0.6348	0.7178	0.6348	0.7968
No log	7.6226	404	0.6394	0.7222	0.6394	0.7996
No log	7.6604	406	0.6410	0.7222	0.6410	0.8006
No log	7.6981	408	0.6470	0.7147	0.6470	0.8043
No log	7.7358	410	0.6538	0.7168	0.6538	0.8086
No log	7.7736	412	0.6674	0.7023	0.6674	0.8169
No log	7.8113	414	0.6852	0.7067	0.6852	0.8278
No log	7.8491	416	0.7181	0.6825	0.7181	0.8474
No log	7.8868	418	0.7229	0.6864	0.7229	0.8503
No log	7.9245	420	0.7091	0.6912	0.7091	0.8421
No log	7.9623	422	0.7103	0.6977	0.7103	0.8428
No log	8.0	424	0.7099	0.7024	0.7099	0.8426
No log	8.0377	426	0.7188	0.6956	0.7188	0.8478
No log	8.0755	428	0.7104	0.7133	0.7104	0.8428
No log	8.1132	430	0.7077	0.7140	0.7077	0.8412
No log	8.1509	432	0.7131	0.7066	0.7131	0.8444
No log	8.1887	434	0.7300	0.6890	0.7300	0.8544
No log	8.2264	436	0.7468	0.7020	0.7468	0.8642
No log	8.2642	438	0.7693	0.7054	0.7693	0.8771
No log	8.3019	440	0.7727	0.7009	0.7727	0.8790
No log	8.3396	442	0.7557	0.6988	0.7557	0.8693
No log	8.3774	444	0.7228	0.7093	0.7228	0.8502
No log	8.4151	446	0.6874	0.7121	0.6874	0.8291
No log	8.4528	448	0.6587	0.7236	0.6587	0.8116
No log	8.4906	450	0.6474	0.7152	0.6474	0.8046
No log	8.5283	452	0.6428	0.6952	0.6428	0.8018
No log	8.5660	454	0.6469	0.7152	0.6469	0.8043
No log	8.6038	456	0.6579	0.7095	0.6579	0.8111
No log	8.6415	458	0.6810	0.7053	0.6810	0.8252
No log	8.6792	460	0.7091	0.6847	0.7091	0.8421
No log	8.7170	462	0.7224	0.6912	0.7224	0.8499
No log	8.7547	464	0.7196	0.6912	0.7196	0.8483
No log	8.7925	466	0.7093	0.6847	0.7093	0.8422
No log	8.8302	468	0.6954	0.7111	0.6954	0.8339
No log	8.8679	470	0.6804	0.7023	0.6804	0.8249
No log	8.9057	472	0.6741	0.7023	0.6741	0.8211
No log	8.9434	474	0.6671	0.7095	0.6671	0.8167
No log	8.9811	476	0.6602	0.7095	0.6602	0.8125
No log	9.0189	478	0.6537	0.7095	0.6537	0.8085
No log	9.0566	480	0.6487	0.7144	0.6487	0.8054
No log	9.0943	482	0.6456	0.7076	0.6456	0.8035
No log	9.1321	484	0.6439	0.7076	0.6439	0.8025
No log	9.1698	486	0.6459	0.7095	0.6459	0.8037
No log	9.2075	488	0.6527	0.7095	0.6527	0.8079
No log	9.2453	490	0.6619	0.7162	0.6619	0.8136
No log	9.2830	492	0.6742	0.6973	0.6742	0.8211
No log	9.3208	494	0.6823	0.7133	0.6823	0.8260
No log	9.3585	496	0.6865	0.7111	0.6865	0.8286
No log	9.3962	498	0.6901	0.7201	0.6901	0.8307
0.3148	9.4340	500	0.6953	0.7073	0.6953	0.8339
0.3148	9.4717	502	0.6981	0.7073	0.6981	0.8355
0.3148	9.5094	504	0.6987	0.7073	0.6987	0.8359
0.3148	9.5472	506	0.6996	0.7073	0.6996	0.8364
0.3148	9.5849	508	0.7032	0.7052	0.7032	0.8386
0.3148	9.6226	510	0.7089	0.6987	0.7089	0.8420
0.3148	9.6604	512	0.7103	0.7109	0.7103	0.8428
0.3148	9.6981	514	0.7121	0.7109	0.7121	0.8439
0.3148	9.7358	516	0.7139	0.7109	0.7139	0.8449
0.3148	9.7736	518	0.7132	0.7109	0.7132	0.8445
0.3148	9.8113	520	0.7110	0.7109	0.7110	0.8432
0.3148	9.8491	522	0.7090	0.7048	0.7090	0.8420
0.3148	9.8868	524	0.7069	0.7090	0.7069	0.8408
0.3148	9.9245	526	0.7052	0.7003	0.7052	0.8398
0.3148	9.9623	528	0.7041	0.7003	0.7041	0.8391
0.3148	10.0	530	0.7034	0.7003	0.7034	0.8387

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1