ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6426
• Qwk: 0.7175
• Mse: 0.6426
• Rmse: 0.8016

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0317	2	5.3681	-0.0476	5.3681	2.3169
No log	0.0635	4	3.2253	0.0687	3.2253	1.7959
No log	0.0952	6	2.4011	-0.0386	2.4011	1.5496
No log	0.1270	8	2.3973	-0.1164	2.3973	1.5483
No log	0.1587	10	1.8465	-0.0122	1.8465	1.3588
No log	0.1905	12	1.6412	-0.0074	1.6412	1.2811
No log	0.2222	14	1.6727	-0.0074	1.6727	1.2933
No log	0.2540	16	1.4914	0.0243	1.4914	1.2212
No log	0.2857	18	1.3517	0.1857	1.3517	1.1626
No log	0.3175	20	1.2453	0.2589	1.2453	1.1159
No log	0.3492	22	1.3820	0.1552	1.3820	1.1756
No log	0.3810	24	1.8751	-0.0133	1.8751	1.3694
No log	0.4127	26	2.4822	-0.1072	2.4822	1.5755
No log	0.4444	28	3.3927	-0.1419	3.3927	1.8419
No log	0.4762	30	2.8127	-0.1404	2.8127	1.6771
No log	0.5079	32	1.6155	0.0825	1.6155	1.2710
No log	0.5397	34	1.3309	0.1288	1.3309	1.1537
No log	0.5714	36	1.4569	0.0712	1.4569	1.2070
No log	0.6032	38	1.4171	0.1036	1.4171	1.1904
No log	0.6349	40	1.4952	0.0884	1.4952	1.2228
No log	0.6667	42	1.5296	0.0884	1.5296	1.2368
No log	0.6984	44	1.5304	0.0884	1.5304	1.2371
No log	0.7302	46	1.4303	0.0908	1.4303	1.1960
No log	0.7619	48	1.3051	0.1824	1.3051	1.1424
No log	0.7937	50	1.4319	0.1070	1.4319	1.1966
No log	0.8254	52	1.4758	0.0585	1.4758	1.2148
No log	0.8571	54	1.4454	0.0654	1.4454	1.2023
No log	0.8889	56	1.3293	0.0942	1.3293	1.1530
No log	0.9206	58	1.3161	0.1398	1.3161	1.1472
No log	0.9524	60	1.5397	0.1300	1.5397	1.2409
No log	0.9841	62	1.6132	0.1447	1.6132	1.2701
No log	1.0159	64	1.6671	0.1737	1.6671	1.2912
No log	1.0476	66	1.8785	0.2148	1.8785	1.3706
No log	1.0794	68	1.7042	0.2057	1.7042	1.3055
No log	1.1111	70	1.3753	0.2829	1.3753	1.1727
No log	1.1429	72	1.0826	0.4033	1.0826	1.0405
No log	1.1746	74	1.0716	0.4403	1.0716	1.0352
No log	1.2063	76	1.1427	0.3709	1.1427	1.0690
No log	1.2381	78	1.2830	0.3588	1.2830	1.1327
No log	1.2698	80	1.6391	0.2860	1.6391	1.2803
No log	1.3016	82	2.0908	0.2429	2.0908	1.4459
No log	1.3333	84	2.0686	0.2574	2.0686	1.4383
No log	1.3651	86	1.6876	0.2804	1.6876	1.2991
No log	1.3968	88	1.2792	0.3360	1.2792	1.1310
No log	1.4286	90	1.0311	0.4647	1.0311	1.0155
No log	1.4603	92	0.8860	0.4435	0.8860	0.9413
No log	1.4921	94	0.8111	0.5402	0.8111	0.9006
No log	1.5238	96	0.8069	0.5024	0.8069	0.8983
No log	1.5556	98	0.7924	0.5308	0.7924	0.8902
No log	1.5873	100	0.7737	0.5817	0.7737	0.8796
No log	1.6190	102	0.7248	0.5847	0.7248	0.8514
No log	1.6508	104	0.7218	0.5786	0.7218	0.8496
No log	1.6825	106	0.7830	0.5943	0.7830	0.8849
No log	1.7143	108	0.9105	0.5459	0.9105	0.9542
No log	1.7460	110	0.9560	0.5744	0.9560	0.9777
No log	1.7778	112	0.8757	0.5670	0.8757	0.9358
No log	1.8095	114	0.7373	0.5504	0.7373	0.8587
No log	1.8413	116	0.6449	0.5932	0.6449	0.8031
No log	1.8730	118	0.5899	0.6672	0.5899	0.7680
No log	1.9048	120	0.5736	0.6839	0.5736	0.7573
No log	1.9365	122	0.5656	0.6816	0.5656	0.7520
No log	1.9683	124	0.5681	0.6527	0.5681	0.7537
No log	2.0	126	0.5767	0.6604	0.5767	0.7594
No log	2.0317	128	0.5939	0.6404	0.5939	0.7707
No log	2.0635	130	0.5903	0.6569	0.5903	0.7683
No log	2.0952	132	0.6101	0.6666	0.6101	0.7811
No log	2.1270	134	0.6157	0.6692	0.6157	0.7847
No log	2.1587	136	0.5710	0.6717	0.5710	0.7556
No log	2.1905	138	0.6208	0.6880	0.6208	0.7879
No log	2.2222	140	0.6334	0.6652	0.6334	0.7959
No log	2.2540	142	0.5943	0.6858	0.5943	0.7709
No log	2.2857	144	0.5865	0.6961	0.5865	0.7659
No log	2.3175	146	0.5418	0.7370	0.5418	0.7361
No log	2.3492	148	0.5146	0.7316	0.5146	0.7173
No log	2.3810	150	0.5546	0.7339	0.5546	0.7447
No log	2.4127	152	0.5570	0.7118	0.5570	0.7463
No log	2.4444	154	0.5945	0.7233	0.5945	0.7711
No log	2.4762	156	0.5585	0.7246	0.5585	0.7473
No log	2.5079	158	0.5266	0.7498	0.5266	0.7257
No log	2.5397	160	0.6476	0.7283	0.6476	0.8047
No log	2.5714	162	0.7600	0.6454	0.7600	0.8718
No log	2.6032	164	0.6772	0.7119	0.6772	0.8229
No log	2.6349	166	0.6198	0.6999	0.6198	0.7873
No log	2.6667	168	0.5447	0.7510	0.5447	0.7380
No log	2.6984	170	0.5688	0.6990	0.5688	0.7542
No log	2.7302	172	0.6030	0.7179	0.6030	0.7765
No log	2.7619	174	0.5754	0.7363	0.5754	0.7585
No log	2.7937	176	0.5998	0.7238	0.5998	0.7745
No log	2.8254	178	0.7116	0.6511	0.7116	0.8436
No log	2.8571	180	0.6837	0.6480	0.6837	0.8268
No log	2.8889	182	0.5720	0.7441	0.5720	0.7563
No log	2.9206	184	0.6311	0.7190	0.6311	0.7944
No log	2.9524	186	0.8523	0.6457	0.8523	0.9232
No log	2.9841	188	1.0074	0.5276	1.0074	1.0037
No log	3.0159	190	0.9778	0.5679	0.9778	0.9889
No log	3.0476	192	0.8686	0.6227	0.8686	0.9320
No log	3.0794	194	0.7872	0.6645	0.7872	0.8872
No log	3.1111	196	0.7205	0.7185	0.7205	0.8488
No log	3.1429	198	0.7554	0.6850	0.7554	0.8692
No log	3.1746	200	0.8529	0.6035	0.8529	0.9235
No log	3.2063	202	0.9469	0.5636	0.9469	0.9731
No log	3.2381	204	0.8802	0.5932	0.8802	0.9382
No log	3.2698	206	0.8139	0.6249	0.8139	0.9021
No log	3.3016	208	0.7552	0.6722	0.7552	0.8690
No log	3.3333	210	0.6780	0.6985	0.6780	0.8234
No log	3.3651	212	0.6194	0.7294	0.6194	0.7870
No log	3.3968	214	0.6056	0.7358	0.6056	0.7782
No log	3.4286	216	0.5996	0.7219	0.5996	0.7743
No log	3.4603	218	0.5996	0.7214	0.5996	0.7744
No log	3.4921	220	0.6322	0.7395	0.6322	0.7951
No log	3.5238	222	0.6439	0.7265	0.6439	0.8024
No log	3.5556	224	0.6159	0.7143	0.6159	0.7848
No log	3.5873	226	0.5605	0.7226	0.5605	0.7486
No log	3.6190	228	0.5337	0.7300	0.5337	0.7306
No log	3.6508	230	0.5436	0.7398	0.5436	0.7373
No log	3.6825	232	0.5816	0.7456	0.5816	0.7626
No log	3.7143	234	0.6235	0.7334	0.6235	0.7896
No log	3.7460	236	0.6107	0.7355	0.6107	0.7815
No log	3.7778	238	0.5432	0.7608	0.5432	0.7370
No log	3.8095	240	0.5068	0.7534	0.5068	0.7119
No log	3.8413	242	0.5086	0.7503	0.5086	0.7131
No log	3.8730	244	0.5269	0.7756	0.5269	0.7259
No log	3.9048	246	0.5073	0.7466	0.5073	0.7123
No log	3.9365	248	0.5339	0.7433	0.5339	0.7307
No log	3.9683	250	0.6607	0.7219	0.6607	0.8128
No log	4.0	252	0.7048	0.7304	0.7048	0.8395
No log	4.0317	254	0.6287	0.7371	0.6287	0.7929
No log	4.0635	256	0.5380	0.7429	0.5380	0.7335
No log	4.0952	258	0.5161	0.7546	0.5161	0.7184
No log	4.1270	260	0.5214	0.7604	0.5214	0.7221
No log	4.1587	262	0.5570	0.7379	0.5570	0.7463
No log	4.1905	264	0.5979	0.7228	0.5979	0.7732
No log	4.2222	266	0.6901	0.7118	0.6901	0.8307
No log	4.2540	268	0.7164	0.7118	0.7164	0.8464
No log	4.2857	270	0.7404	0.7138	0.7404	0.8605
No log	4.3175	272	0.7576	0.6783	0.7576	0.8704
No log	4.3492	274	0.8438	0.6197	0.8438	0.9186
No log	4.3810	276	0.8571	0.6202	0.8571	0.9258
No log	4.4127	278	0.7794	0.6504	0.7794	0.8828
No log	4.4444	280	0.6718	0.7142	0.6718	0.8196
No log	4.4762	282	0.6199	0.7319	0.6199	0.7873
No log	4.5079	284	0.6107	0.7340	0.6107	0.7815
No log	4.5397	286	0.6218	0.7381	0.6218	0.7886
No log	4.5714	288	0.6582	0.7374	0.6582	0.8113
No log	4.6032	290	0.6868	0.7151	0.6868	0.8288
No log	4.6349	292	0.7479	0.6796	0.7479	0.8648
No log	4.6667	294	0.7179	0.6876	0.7179	0.8473
No log	4.6984	296	0.6505	0.7290	0.6505	0.8065
No log	4.7302	298	0.6060	0.7295	0.6060	0.7785
No log	4.7619	300	0.6199	0.7295	0.6199	0.7873
No log	4.7937	302	0.6569	0.7300	0.6569	0.8105
No log	4.8254	304	0.6416	0.7226	0.6416	0.8010
No log	4.8571	306	0.6190	0.7326	0.6190	0.7868
No log	4.8889	308	0.6205	0.7284	0.6205	0.7877
No log	4.9206	310	0.5968	0.7247	0.5968	0.7725
No log	4.9524	312	0.5891	0.7363	0.5891	0.7675
No log	4.9841	314	0.6165	0.7324	0.6165	0.7852
No log	5.0159	316	0.6111	0.7218	0.6111	0.7818
No log	5.0476	318	0.6058	0.7200	0.6058	0.7783
No log	5.0794	320	0.5960	0.7133	0.5960	0.7720
No log	5.1111	322	0.5740	0.7490	0.5740	0.7576
No log	5.1429	324	0.5666	0.7490	0.5666	0.7528
No log	5.1746	326	0.5636	0.7453	0.5636	0.7507
No log	5.2063	328	0.5849	0.7410	0.5849	0.7648
No log	5.2381	330	0.5898	0.7451	0.5898	0.7680
No log	5.2698	332	0.5844	0.7451	0.5844	0.7644
No log	5.3016	334	0.6019	0.7507	0.6019	0.7758
No log	5.3333	336	0.6459	0.7061	0.6459	0.8037
No log	5.3651	338	0.7611	0.6966	0.7611	0.8724
No log	5.3968	340	0.8269	0.6811	0.8269	0.9093
No log	5.4286	342	0.7891	0.6871	0.7891	0.8883
No log	5.4603	344	0.6944	0.7004	0.6944	0.8333
No log	5.4921	346	0.6078	0.7320	0.6078	0.7796
No log	5.5238	348	0.5799	0.7343	0.5799	0.7615
No log	5.5556	350	0.5813	0.7313	0.5813	0.7624
No log	5.5873	352	0.5803	0.7280	0.5803	0.7618
No log	5.6190	354	0.5808	0.7374	0.5808	0.7621
No log	5.6508	356	0.5968	0.7226	0.5968	0.7725
No log	5.6825	358	0.6287	0.7297	0.6287	0.7929
No log	5.7143	360	0.6199	0.7297	0.6199	0.7873
No log	5.7460	362	0.5836	0.7228	0.5836	0.7640
No log	5.7778	364	0.5533	0.7487	0.5533	0.7439
No log	5.8095	366	0.5516	0.7530	0.5516	0.7427
No log	5.8413	368	0.5553	0.7338	0.5553	0.7452
No log	5.8730	370	0.5990	0.7346	0.5990	0.7739
No log	5.9048	372	0.6855	0.7258	0.6855	0.8279
No log	5.9365	374	0.7306	0.7073	0.7306	0.8548
No log	5.9683	376	0.6987	0.7389	0.6987	0.8359
No log	6.0	378	0.6296	0.7278	0.6296	0.7935
No log	6.0317	380	0.5869	0.7251	0.5869	0.7661
No log	6.0635	382	0.5502	0.7400	0.5502	0.7417
No log	6.0952	384	0.5410	0.7518	0.5410	0.7355
No log	6.1270	386	0.5564	0.7418	0.5564	0.7459
No log	6.1587	388	0.5923	0.7398	0.5923	0.7696
No log	6.1905	390	0.6576	0.7171	0.6576	0.8109
No log	6.2222	392	0.6653	0.7132	0.6653	0.8157
No log	6.2540	394	0.6299	0.7400	0.6299	0.7937
No log	6.2857	396	0.6414	0.7337	0.6414	0.8008
No log	6.3175	398	0.6472	0.7317	0.6472	0.8045
No log	6.3492	400	0.6528	0.7311	0.6528	0.8079
No log	6.3810	402	0.6138	0.7202	0.6138	0.7835
No log	6.4127	404	0.6155	0.7238	0.6155	0.7845
No log	6.4444	406	0.6322	0.7222	0.6322	0.7951
No log	6.4762	408	0.6723	0.7016	0.6723	0.8199
No log	6.5079	410	0.7127	0.6876	0.7127	0.8442
No log	6.5397	412	0.7275	0.6788	0.7275	0.8529
No log	6.5714	414	0.6883	0.6977	0.6883	0.8296
No log	6.6032	416	0.6892	0.6878	0.6892	0.8302
No log	6.6349	418	0.7284	0.7076	0.7284	0.8535
No log	6.6667	420	0.7910	0.6959	0.7910	0.8894
No log	6.6984	422	0.8368	0.6691	0.8368	0.9148
No log	6.7302	424	0.8314	0.6676	0.8314	0.9118
No log	6.7619	426	0.8533	0.6636	0.8533	0.9238
No log	6.7937	428	0.8113	0.6667	0.8113	0.9007
No log	6.8254	430	0.7232	0.7151	0.7232	0.8504
No log	6.8571	432	0.6478	0.7263	0.6478	0.8049
No log	6.8889	434	0.6284	0.7540	0.6284	0.7927
No log	6.9206	436	0.6116	0.7514	0.6116	0.7820
No log	6.9524	438	0.6252	0.7506	0.6252	0.7907
No log	6.9841	440	0.6366	0.7415	0.6366	0.7979
No log	7.0159	442	0.6750	0.7276	0.6750	0.8216
No log	7.0476	444	0.6765	0.7249	0.6765	0.8225
No log	7.0794	446	0.6570	0.7433	0.6570	0.8106
No log	7.1111	448	0.6319	0.7637	0.6319	0.7949
No log	7.1429	450	0.6260	0.7580	0.6260	0.7912
No log	7.1746	452	0.6086	0.7548	0.6086	0.7801
No log	7.2063	454	0.5784	0.7445	0.5784	0.7605
No log	7.2381	456	0.5541	0.7457	0.5541	0.7444
No log	7.2698	458	0.5478	0.7457	0.5478	0.7401
No log	7.3016	460	0.5586	0.7457	0.5586	0.7474
No log	7.3333	462	0.5857	0.7562	0.5857	0.7653
No log	7.3651	464	0.6143	0.7385	0.6143	0.7838
No log	7.3968	466	0.6433	0.7332	0.6433	0.8021
No log	7.4286	468	0.6543	0.7241	0.6543	0.8089
No log	7.4603	470	0.6606	0.7206	0.6606	0.8128
No log	7.4921	472	0.6925	0.7222	0.6925	0.8322
No log	7.5238	474	0.7469	0.7286	0.7469	0.8642
No log	7.5556	476	0.8097	0.6999	0.8097	0.8998
No log	7.5873	478	0.8737	0.6902	0.8737	0.9347
No log	7.6190	480	0.8708	0.6902	0.8708	0.9332
No log	7.6508	482	0.8122	0.6993	0.8122	0.9012
No log	7.6825	484	0.7435	0.7168	0.7435	0.8623
No log	7.7143	486	0.7010	0.7114	0.7010	0.8372
No log	7.7460	488	0.6766	0.7086	0.6766	0.8225
No log	7.7778	490	0.6640	0.7039	0.6640	0.8148
No log	7.8095	492	0.6622	0.7193	0.6622	0.8138
No log	7.8413	494	0.6727	0.7071	0.6727	0.8202
No log	7.8730	496	0.7032	0.6952	0.7032	0.8386
No log	7.9048	498	0.7675	0.6846	0.7675	0.8761
0.4861	7.9365	500	0.8297	0.6524	0.8297	0.9109
0.4861	7.9683	502	0.8405	0.6580	0.8405	0.9168
0.4861	8.0	504	0.8282	0.6524	0.8282	0.9101
0.4861	8.0317	506	0.8006	0.6635	0.8006	0.8948
0.4861	8.0635	508	0.7426	0.6841	0.7426	0.8617
0.4861	8.0952	510	0.6995	0.6891	0.6995	0.8363
0.4861	8.1270	512	0.6560	0.7112	0.6560	0.8099
0.4861	8.1587	514	0.6401	0.7154	0.6401	0.8001
0.4861	8.1905	516	0.6441	0.7112	0.6441	0.8026
0.4861	8.2222	518	0.6676	0.7100	0.6676	0.8171
0.4861	8.2540	520	0.6920	0.7056	0.6920	0.8319
0.4861	8.2857	522	0.7272	0.7056	0.7272	0.8528
0.4861	8.3175	524	0.7602	0.7162	0.7602	0.8719
0.4861	8.3492	526	0.7705	0.7060	0.7705	0.8778
0.4861	8.3810	528	0.7846	0.7064	0.7846	0.8858
0.4861	8.4127	530	0.7719	0.6966	0.7719	0.8786
0.4861	8.4444	532	0.7466	0.7079	0.7466	0.8640
0.4861	8.4762	534	0.7074	0.7082	0.7074	0.8410
0.4861	8.5079	536	0.6635	0.7175	0.6635	0.8145
0.4861	8.5397	538	0.6244	0.7143	0.6244	0.7902
0.4861	8.5714	540	0.6000	0.7399	0.6000	0.7746
0.4861	8.6032	542	0.5910	0.7303	0.5910	0.7687
0.4861	8.6349	544	0.5828	0.7242	0.5828	0.7634
0.4861	8.6667	546	0.5780	0.7242	0.5780	0.7603
0.4861	8.6984	548	0.5788	0.7242	0.5788	0.7608
0.4861	8.7302	550	0.5907	0.7198	0.5907	0.7686
0.4861	8.7619	552	0.6140	0.7126	0.6140	0.7836
0.4861	8.7937	554	0.6445	0.7117	0.6445	0.8028
0.4861	8.8254	556	0.6835	0.7169	0.6835	0.8268
0.4861	8.8571	558	0.7064	0.7244	0.7064	0.8405
0.4861	8.8889	560	0.7257	0.7118	0.7257	0.8519
0.4861	8.9206	562	0.7408	0.7098	0.7408	0.8607
0.4861	8.9524	564	0.7561	0.7015	0.7561	0.8695
0.4861	8.9841	566	0.7491	0.7142	0.7491	0.8655
0.4861	9.0159	568	0.7435	0.7189	0.7435	0.8622
0.4861	9.0476	570	0.7416	0.7189	0.7416	0.8612
0.4861	9.0794	572	0.7310	0.7119	0.7310	0.8550
0.4861	9.1111	574	0.7116	0.7119	0.7116	0.8435
0.4861	9.1429	576	0.6961	0.7168	0.6961	0.8343
0.4861	9.1746	578	0.6886	0.7168	0.6886	0.8298
0.4861	9.2063	580	0.6821	0.7187	0.6821	0.8259
0.4861	9.2381	582	0.6857	0.7201	0.6857	0.8281
0.4861	9.2698	584	0.6955	0.7119	0.6955	0.8340
0.4861	9.3016	586	0.7038	0.7119	0.7038	0.8389
0.4861	9.3333	588	0.7072	0.7154	0.7072	0.8409
0.4861	9.3651	590	0.7101	0.7154	0.7101	0.8427
0.4861	9.3968	592	0.7190	0.7154	0.7190	0.8479
0.4861	9.4286	594	0.7234	0.7170	0.7234	0.8505
0.4861	9.4603	596	0.7205	0.7189	0.7205	0.8488
0.4861	9.4921	598	0.7091	0.7189	0.7091	0.8421
0.4861	9.5238	600	0.6967	0.7110	0.6967	0.8347
0.4861	9.5556	602	0.6835	0.7113	0.6835	0.8267
0.4861	9.5873	604	0.6701	0.7113	0.6701	0.8186
0.4861	9.6190	606	0.6564	0.7155	0.6564	0.8102
0.4861	9.6508	608	0.6435	0.7175	0.6435	0.8022
0.4861	9.6825	610	0.6367	0.7136	0.6367	0.7979
0.4861	9.7143	612	0.6309	0.7097	0.6309	0.7943
0.4861	9.7460	614	0.6279	0.7036	0.6279	0.7924
0.4861	9.7778	616	0.6289	0.7097	0.6289	0.7930
0.4861	9.8095	618	0.6299	0.7179	0.6299	0.7936
0.4861	9.8413	620	0.6320	0.7179	0.6320	0.7950
0.4861	9.8730	622	0.6351	0.7136	0.6351	0.7969
0.4861	9.9048	624	0.6382	0.7136	0.6382	0.7989
0.4861	9.9365	626	0.6409	0.7175	0.6409	0.8006
0.4861	9.9683	628	0.6421	0.7175	0.6421	0.8013
0.4861	10.0	630	0.6426	0.7175	0.6426	0.8016

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1