ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k13_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6717
• Qwk: 0.3462
• Mse: 0.6717
• Rmse: 0.8196

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	3.0869	0.0097	3.0869	1.7570
No log	0.0656	4	1.4762	-0.0070	1.4762	1.2150
No log	0.0984	6	1.0229	0.0677	1.0229	1.0114
No log	0.1311	8	0.7477	0.1414	0.7477	0.8647
No log	0.1639	10	0.6843	0.3191	0.6843	0.8272
No log	0.1967	12	0.7801	0.2372	0.7801	0.8833
No log	0.2295	14	1.1351	0.0462	1.1351	1.0654
No log	0.2623	16	0.6937	0.25	0.6937	0.8329
No log	0.2951	18	0.6520	0.2994	0.6520	0.8075
No log	0.3279	20	0.8210	0.0823	0.8210	0.9061
No log	0.3607	22	0.8436	0.1111	0.8436	0.9185
No log	0.3934	24	0.6605	0.1429	0.6605	0.8127
No log	0.4262	26	0.6103	0.0145	0.6103	0.7812
No log	0.4590	28	0.6541	0.1195	0.6541	0.8088
No log	0.4918	30	0.7260	0.1038	0.7260	0.8520
No log	0.5246	32	0.6306	0.0725	0.6306	0.7941
No log	0.5574	34	0.6400	0.0	0.6400	0.8000
No log	0.5902	36	0.6066	0.0365	0.6066	0.7788
No log	0.6230	38	0.6288	0.1304	0.6288	0.7930
No log	0.6557	40	0.6168	0.1899	0.6168	0.7854
No log	0.6885	42	0.6613	0.3333	0.6613	0.8132
No log	0.7213	44	1.0347	0.1875	1.0347	1.0172
No log	0.7541	46	0.6881	0.1913	0.6881	0.8295
No log	0.7869	48	0.7733	0.1515	0.7733	0.8794
No log	0.8197	50	0.7514	0.1503	0.7514	0.8668
No log	0.8525	52	0.6819	0.2000	0.6819	0.8258
No log	0.8852	54	1.1513	0.0722	1.1513	1.0730
No log	0.9180	56	0.8367	0.0991	0.8367	0.9147
No log	0.9508	58	0.5909	0.1329	0.5909	0.7687
No log	0.9836	60	0.6609	0.2418	0.6609	0.8129
No log	1.0164	62	0.7714	0.1600	0.7714	0.8783
No log	1.0492	64	0.5513	0.0857	0.5513	0.7425
No log	1.0820	66	0.5577	0.3735	0.5577	0.7468
No log	1.1148	68	0.6018	0.2865	0.6018	0.7758
No log	1.1475	70	1.1082	0.0894	1.1082	1.0527
No log	1.1803	72	1.1316	0.0894	1.1316	1.0638
No log	1.2131	74	0.7459	0.2487	0.7459	0.8637
No log	1.2459	76	0.5758	0.2883	0.5758	0.7588
No log	1.2787	78	0.5927	0.3333	0.5927	0.7698
No log	1.3115	80	0.6286	0.2727	0.6286	0.7929
No log	1.3443	82	0.5965	0.2990	0.5965	0.7723
No log	1.3770	84	0.7503	0.2676	0.7503	0.8662
No log	1.4098	86	0.6903	0.2919	0.6903	0.8308
No log	1.4426	88	0.6090	0.2917	0.6090	0.7804
No log	1.4754	90	0.6594	0.1220	0.6594	0.8120
No log	1.5082	92	0.5831	0.2273	0.5831	0.7636
No log	1.5410	94	0.7075	0.2150	0.7075	0.8411
No log	1.5738	96	0.7779	0.1256	0.7779	0.8820
No log	1.6066	98	0.6011	0.3333	0.6011	0.7753
No log	1.6393	100	0.9478	0.1094	0.9478	0.9735
No log	1.6721	102	1.1376	0.0373	1.1376	1.0666
No log	1.7049	104	0.9146	0.0609	0.9146	0.9563
No log	1.7377	106	0.6578	0.2083	0.6578	0.8111
No log	1.7705	108	0.8758	0.0714	0.8758	0.9358
No log	1.8033	110	0.7072	0.1527	0.7072	0.8410
No log	1.8361	112	0.6556	0.1801	0.6556	0.8097
No log	1.8689	114	0.9793	0.1040	0.9793	0.9896
No log	1.9016	116	0.9670	0.1000	0.9670	0.9833
No log	1.9344	118	0.7299	0.1020	0.7299	0.8544
No log	1.9672	120	0.6217	0.2967	0.6217	0.7885
No log	2.0	122	0.6289	0.2432	0.6289	0.7930
No log	2.0328	124	0.6603	0.2821	0.6603	0.8126
No log	2.0656	126	0.6372	0.3016	0.6372	0.7983
No log	2.0984	128	0.6801	0.3231	0.6801	0.8247
No log	2.1311	130	0.8349	0.1597	0.8349	0.9137
No log	2.1639	132	0.9361	0.1062	0.9361	0.9675
No log	2.1967	134	0.8955	0.1304	0.8955	0.9463
No log	2.2295	136	0.5833	0.4167	0.5833	0.7637
No log	2.2623	138	0.8270	0.1493	0.8270	0.9094
No log	2.2951	140	0.8147	0.1493	0.8147	0.9026
No log	2.3279	142	0.5493	0.3617	0.5493	0.7412
No log	2.3607	144	0.6854	0.1919	0.6854	0.8279
No log	2.3934	146	0.6797	0.1590	0.6797	0.8244
No log	2.4262	148	0.5183	0.4970	0.5183	0.7199
No log	2.4590	150	0.5222	0.4023	0.5222	0.7226
No log	2.4918	152	0.5182	0.4545	0.5182	0.7199
No log	2.5246	154	0.5147	0.4699	0.5147	0.7174
No log	2.5574	156	0.5654	0.3966	0.5654	0.7519
No log	2.5902	158	0.5373	0.3778	0.5373	0.7330
No log	2.6230	160	0.6655	0.3333	0.6655	0.8158
No log	2.6557	162	0.6675	0.3761	0.6675	0.8170
No log	2.6885	164	0.6432	0.2877	0.6432	0.8020
No log	2.7213	166	0.6797	0.3524	0.6797	0.8245
No log	2.7541	168	1.0396	0.1886	1.0396	1.0196
No log	2.7869	170	1.1187	0.1672	1.1187	1.0577
No log	2.8197	172	0.7182	0.2146	0.7182	0.8475
No log	2.8525	174	0.6576	0.3052	0.6576	0.8109
No log	2.8852	176	0.8313	0.2759	0.8313	0.9118
No log	2.9180	178	1.0541	0.1418	1.0541	1.0267
No log	2.9508	180	0.7611	0.3004	0.7611	0.8724
No log	2.9836	182	0.7056	0.2811	0.7056	0.8400
No log	3.0164	184	0.6737	0.28	0.6737	0.8208
No log	3.0492	186	0.6589	0.2850	0.6589	0.8117
No log	3.0820	188	0.8403	0.2759	0.8403	0.9167
No log	3.1148	190	1.4666	0.1746	1.4666	1.2110
No log	3.1475	192	1.4176	0.1746	1.4176	1.1906
No log	3.1803	194	0.8891	0.1861	0.8891	0.9429
No log	3.2131	196	0.6579	0.2842	0.6579	0.8111
No log	3.2459	198	0.6935	0.2513	0.6935	0.8328
No log	3.2787	200	0.6100	0.3661	0.6100	0.7811
No log	3.3115	202	0.9665	0.1040	0.9665	0.9831
No log	3.3443	204	1.2285	0.1746	1.2285	1.1084
No log	3.3770	206	0.9706	0.1040	0.9706	0.9852
No log	3.4098	208	0.5749	0.4157	0.5749	0.7582
No log	3.4426	210	0.6634	0.2390	0.6634	0.8145
No log	3.4754	212	0.7093	0.2227	0.7093	0.8422
No log	3.5082	214	0.5406	0.3829	0.5406	0.7352
No log	3.5410	216	0.6369	0.2549	0.6369	0.7981
No log	3.5738	218	0.6924	0.1549	0.6924	0.8321
No log	3.6066	220	0.6973	0.1549	0.6973	0.8350
No log	3.6393	222	0.5378	0.4545	0.5378	0.7334
No log	3.6721	224	0.5338	0.4419	0.5338	0.7306
No log	3.7049	226	0.5979	0.3131	0.5979	0.7733
No log	3.7377	228	0.7888	0.2857	0.7888	0.8881
No log	3.7705	230	0.8874	0.2129	0.8874	0.9420
No log	3.8033	232	0.7548	0.2857	0.7548	0.8688
No log	3.8361	234	0.8297	0.2131	0.8297	0.9109
No log	3.8689	236	1.1261	0.1141	1.1261	1.0612
No log	3.9016	238	1.1022	0.1409	1.1022	1.0498
No log	3.9344	240	0.8451	0.2727	0.8451	0.9193
No log	3.9672	242	0.6330	0.2965	0.6330	0.7956
No log	4.0	244	0.5394	0.3878	0.5394	0.7345
No log	4.0328	246	0.5589	0.3831	0.5589	0.7476
No log	4.0656	248	0.8449	0.2269	0.8449	0.9192
No log	4.0984	250	1.0245	0.1172	1.0245	1.0122
No log	4.1311	252	0.8068	0.2618	0.8068	0.8982
No log	4.1639	254	0.4905	0.5088	0.4905	0.7003
No log	4.1967	256	0.5282	0.3609	0.5282	0.7268
No log	4.2295	258	0.4839	0.4650	0.4839	0.6956
No log	4.2623	260	0.6057	0.2258	0.6057	0.7783
No log	4.2951	262	0.8927	0.1686	0.8927	0.9448
No log	4.3279	264	0.8419	0.1652	0.8419	0.9175
No log	4.3607	266	0.5654	0.3369	0.5654	0.7519
No log	4.3934	268	0.4804	0.4805	0.4804	0.6931
No log	4.4262	270	0.4823	0.4140	0.4823	0.6945
No log	4.4590	272	0.4984	0.4286	0.4984	0.7060
No log	4.4918	274	0.6930	0.1921	0.6930	0.8325
No log	4.5246	276	0.8325	0.1588	0.8325	0.9124
No log	4.5574	278	0.6729	0.2941	0.6729	0.8203
No log	4.5902	280	0.5173	0.4607	0.5173	0.7192
No log	4.6230	282	0.5336	0.5269	0.5336	0.7305
No log	4.6557	284	0.7045	0.3422	0.7045	0.8393
No log	4.6885	286	0.7678	0.3000	0.7678	0.8762
No log	4.7213	288	0.6904	0.3394	0.6904	0.8309
No log	4.7541	290	0.7962	0.3036	0.7962	0.8923
No log	4.7869	292	0.8789	0.1635	0.8789	0.9375
No log	4.8197	294	0.7167	0.3153	0.7167	0.8466
No log	4.8525	296	0.6216	0.3200	0.6216	0.7884
No log	4.8852	298	0.5413	0.3617	0.5413	0.7357
No log	4.9180	300	0.5393	0.3708	0.5393	0.7344
No log	4.9508	302	0.5838	0.3263	0.5838	0.7641
No log	4.9836	304	0.6605	0.3267	0.6605	0.8127
No log	5.0164	306	0.6559	0.2893	0.6559	0.8098
No log	5.0492	308	0.7373	0.3128	0.7373	0.8587
No log	5.0820	310	0.7230	0.3548	0.7230	0.8503
No log	5.1148	312	0.6505	0.3131	0.6505	0.8065
No log	5.1475	314	0.6825	0.3462	0.6825	0.8261
No log	5.1803	316	0.7026	0.3143	0.7026	0.8382
No log	5.2131	318	0.7994	0.3080	0.7994	0.8941
No log	5.2459	320	0.7514	0.3514	0.7514	0.8668
No log	5.2787	322	0.7219	0.3585	0.7219	0.8497
No log	5.3115	324	0.5877	0.2842	0.5877	0.7666
No log	5.3443	326	0.5148	0.5181	0.5148	0.7175
No log	5.3770	328	0.5043	0.5030	0.5043	0.7101
No log	5.4098	330	0.5092	0.5181	0.5092	0.7136
No log	5.4426	332	0.5920	0.2179	0.5920	0.7694
No log	5.4754	334	0.6099	0.1475	0.6099	0.7810
No log	5.5082	336	0.5333	0.3580	0.5333	0.7303
No log	5.5410	338	0.4911	0.5122	0.4911	0.7008
No log	5.5738	340	0.4960	0.5122	0.4960	0.7043
No log	5.6066	342	0.5733	0.3939	0.5733	0.7571
No log	5.6393	344	0.6634	0.3951	0.6634	0.8145
No log	5.6721	346	0.6825	0.3951	0.6825	0.8262
No log	5.7049	348	0.6582	0.36	0.6582	0.8113
No log	5.7377	350	0.6251	0.3831	0.6251	0.7906
No log	5.7705	352	0.6057	0.3831	0.6057	0.7783
No log	5.8033	354	0.5832	0.3831	0.5832	0.7637
No log	5.8361	356	0.5920	0.3535	0.5920	0.7694
No log	5.8689	358	0.6330	0.2821	0.6330	0.7956
No log	5.9016	360	0.6874	0.2577	0.6874	0.8291
No log	5.9344	362	0.8204	0.2233	0.8204	0.9058
No log	5.9672	364	0.8607	0.1261	0.8607	0.9277
No log	6.0	366	0.6845	0.2821	0.6845	0.8274
No log	6.0328	368	0.5677	0.4348	0.5677	0.7534
No log	6.0656	370	0.5571	0.3548	0.5571	0.7464
No log	6.0984	372	0.5574	0.4917	0.5574	0.7466
No log	6.1311	374	0.6501	0.2821	0.6501	0.8063
No log	6.1639	376	0.6633	0.3171	0.6633	0.8144
No log	6.1967	378	0.5893	0.4286	0.5893	0.7676
No log	6.2295	380	0.5949	0.3831	0.5949	0.7713
No log	6.2623	382	0.5755	0.4839	0.5755	0.7586
No log	6.2951	384	0.5785	0.4839	0.5785	0.7606
No log	6.3279	386	0.6649	0.3462	0.6649	0.8154
No log	6.3607	388	0.7054	0.3171	0.7054	0.8399
No log	6.3934	390	0.6625	0.3462	0.6625	0.8140
No log	6.4262	392	0.6442	0.3462	0.6442	0.8026
No log	6.4590	394	0.5755	0.4839	0.5755	0.7586
No log	6.4918	396	0.5484	0.4783	0.5484	0.7406
No log	6.5246	398	0.5445	0.5402	0.5445	0.7379
No log	6.5574	400	0.5428	0.5402	0.5428	0.7367
No log	6.5902	402	0.5500	0.4917	0.5500	0.7416
No log	6.6230	404	0.5415	0.5402	0.5415	0.7359
No log	6.6557	406	0.5397	0.4884	0.5397	0.7346
No log	6.6885	408	0.5418	0.5556	0.5418	0.7361
No log	6.7213	410	0.5754	0.3617	0.5754	0.7586
No log	6.7541	412	0.6260	0.28	0.6260	0.7912
No log	6.7869	414	0.6443	0.2487	0.6443	0.8027
No log	6.8197	416	0.6060	0.2967	0.6060	0.7785
No log	6.8525	418	0.5747	0.3778	0.5747	0.7581
No log	6.8852	420	0.6014	0.2967	0.6014	0.7755
No log	6.9180	422	0.6776	0.1837	0.6776	0.8232
No log	6.9508	424	0.6486	0.2165	0.6486	0.8054
No log	6.9836	426	0.5626	0.4286	0.5626	0.7501
No log	7.0164	428	0.5385	0.5455	0.5385	0.7338
No log	7.0492	430	0.5478	0.5359	0.5478	0.7401
No log	7.0820	432	0.6082	0.3263	0.6082	0.7799
No log	7.1148	434	0.6627	0.2563	0.6627	0.8140
No log	7.1475	436	0.6518	0.2871	0.6518	0.8074
No log	7.1803	438	0.5994	0.3778	0.5994	0.7742
No log	7.2131	440	0.5813	0.5359	0.5813	0.7624
No log	7.2459	442	0.5615	0.5359	0.5615	0.7493
No log	7.2787	444	0.5782	0.5359	0.5782	0.7604
No log	7.3115	446	0.6551	0.2762	0.6551	0.8094
No log	7.3443	448	0.7405	0.2442	0.7405	0.8605
No log	7.3770	450	0.7704	0.1790	0.7704	0.8777
No log	7.4098	452	0.6862	0.2744	0.6862	0.8284
No log	7.4426	454	0.6105	0.4764	0.6105	0.7814
No log	7.4754	456	0.5631	0.5217	0.5631	0.7504
No log	7.5082	458	0.5526	0.5307	0.5526	0.7434
No log	7.5410	460	0.5691	0.5359	0.5691	0.7544
No log	7.5738	462	0.6365	0.3561	0.6365	0.7978
No log	7.6066	464	0.7097	0.2744	0.7097	0.8424
No log	7.6393	466	0.7381	0.2727	0.7381	0.8591
No log	7.6721	468	0.7537	0.2356	0.7537	0.8681
No log	7.7049	470	0.7332	0.2364	0.7332	0.8563
No log	7.7377	472	0.7038	0.2744	0.7038	0.8389
No log	7.7705	474	0.7181	0.2744	0.7181	0.8474
No log	7.8033	476	0.7890	0.2356	0.7890	0.8883
No log	7.8361	478	0.8067	0.2000	0.8067	0.8982
No log	7.8689	480	0.7780	0.2356	0.7780	0.8820
No log	7.9016	482	0.7371	0.3028	0.7371	0.8585
No log	7.9344	484	0.6750	0.3973	0.6750	0.8216
No log	7.9672	486	0.6422	0.4639	0.6422	0.8013
No log	8.0	488	0.6367	0.4639	0.6367	0.7980
No log	8.0328	490	0.6534	0.4510	0.6534	0.8083
No log	8.0656	492	0.7069	0.3028	0.7069	0.8408
No log	8.0984	494	0.7438	0.2727	0.7438	0.8624
No log	8.1311	496	0.7542	0.2348	0.7542	0.8684
No log	8.1639	498	0.7182	0.2727	0.7182	0.8475
0.4096	8.1967	500	0.6498	0.3939	0.6498	0.8061
0.4096	8.2295	502	0.6227	0.4043	0.6227	0.7891
0.4096	8.2623	504	0.5883	0.4783	0.5883	0.7670
0.4096	8.2951	506	0.5721	0.5307	0.5721	0.7564
0.4096	8.3279	508	0.5596	0.5254	0.5596	0.7481
0.4096	8.3607	510	0.5637	0.5307	0.5637	0.7508
0.4096	8.3934	512	0.5805	0.4033	0.5805	0.7619
0.4096	8.4262	514	0.6299	0.4043	0.6299	0.7937
0.4096	8.4590	516	0.6700	0.2871	0.6700	0.8185
0.4096	8.4918	518	0.6631	0.3171	0.6631	0.8143
0.4096	8.5246	520	0.6356	0.3939	0.6356	0.7972
0.4096	8.5574	522	0.6109	0.4043	0.6109	0.7816
0.4096	8.5902	524	0.6093	0.3927	0.6093	0.7806
0.4096	8.6230	526	0.6143	0.3927	0.6143	0.7838
0.4096	8.6557	528	0.6365	0.4404	0.6365	0.7978
0.4096	8.6885	530	0.6828	0.3171	0.6828	0.8263
0.4096	8.7213	532	0.6944	0.2762	0.6944	0.8333
0.4096	8.7541	534	0.6764	0.3462	0.6764	0.8224
0.4096	8.7869	536	0.6473	0.3831	0.6473	0.8045
0.4096	8.8197	538	0.6473	0.3831	0.6473	0.8046
0.4096	8.8525	540	0.6751	0.3077	0.6751	0.8216
0.4096	8.8852	542	0.6874	0.3052	0.6874	0.8291
0.4096	8.9180	544	0.6765	0.3077	0.6765	0.8225
0.4096	8.9508	546	0.6744	0.3498	0.6744	0.8212
0.4096	8.9836	548	0.6539	0.3939	0.6539	0.8086
0.4096	9.0164	550	0.6498	0.3939	0.6498	0.8061
0.4096	9.0492	552	0.6534	0.3939	0.6534	0.8083
0.4096	9.0820	554	0.6565	0.3939	0.6565	0.8102
0.4096	9.1148	556	0.6606	0.3498	0.6606	0.8127
0.4096	9.1475	558	0.6619	0.3498	0.6619	0.8136
0.4096	9.1803	560	0.6483	0.3575	0.6483	0.8051
0.4096	9.2131	562	0.6226	0.3575	0.6226	0.7891
0.4096	9.2459	564	0.6090	0.3927	0.6090	0.7804
0.4096	9.2787	566	0.6029	0.4043	0.6029	0.7764
0.4096	9.3115	568	0.5970	0.4043	0.5970	0.7727
0.4096	9.3443	570	0.5971	0.4043	0.5971	0.7727
0.4096	9.3770	572	0.5965	0.4043	0.5965	0.7723
0.4096	9.4098	574	0.6007	0.4043	0.6007	0.7751
0.4096	9.4426	576	0.6141	0.4043	0.6141	0.7836
0.4096	9.4754	578	0.6256	0.3575	0.6256	0.7909
0.4096	9.5082	580	0.6351	0.3575	0.6351	0.7969
0.4096	9.5410	582	0.6358	0.3575	0.6358	0.7974
0.4096	9.5738	584	0.6282	0.3575	0.6282	0.7926
0.4096	9.6066	586	0.6255	0.3575	0.6255	0.7909
0.4096	9.6393	588	0.6251	0.3575	0.6251	0.7906
0.4096	9.6721	590	0.6258	0.3575	0.6258	0.7911
0.4096	9.7049	592	0.6309	0.3575	0.6309	0.7943
0.4096	9.7377	594	0.6397	0.3575	0.6397	0.7998
0.4096	9.7705	596	0.6476	0.3575	0.6476	0.8048
0.4096	9.8033	598	0.6569	0.3892	0.6569	0.8105
0.4096	9.8361	600	0.6648	0.3462	0.6648	0.8154
0.4096	9.8689	602	0.6672	0.3462	0.6672	0.8168
0.4096	9.9016	604	0.6671	0.3462	0.6671	0.8168
0.4096	9.9344	606	0.6696	0.3462	0.6696	0.8183
0.4096	9.9672	608	0.6715	0.3462	0.6715	0.8195
0.4096	10.0	610	0.6717	0.3462	0.6717	0.8196

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1