ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k4_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5582
• Qwk: 0.5853
• Mse: 0.5582
• Rmse: 0.7471

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1538	2	3.8113	-0.0347	3.8113	1.9523
No log	0.3077	4	2.1127	0.0440	2.1127	1.4535
No log	0.4615	6	1.3395	0.0232	1.3395	1.1574
No log	0.6154	8	1.0519	0.2692	1.0519	1.0256
No log	0.7692	10	1.0227	0.3117	1.0227	1.0113
No log	0.9231	12	1.0832	0.2004	1.0832	1.0408
No log	1.0769	14	1.3264	0.0	1.3264	1.1517
No log	1.2308	16	1.3362	0.0	1.3362	1.1560
No log	1.3846	18	1.2685	0.0380	1.2685	1.1263
No log	1.5385	20	1.0438	0.2758	1.0438	1.0217
No log	1.6923	22	0.9944	0.2991	0.9944	0.9972
No log	1.8462	24	1.0625	0.3082	1.0625	1.0308
No log	2.0	26	1.4829	0.0380	1.4829	1.2177
No log	2.1538	28	1.7745	0.0307	1.7745	1.3321
No log	2.3077	30	1.5788	0.0057	1.5788	1.2565
No log	2.4615	32	1.1120	0.1324	1.1120	1.0545
No log	2.6154	34	0.7925	0.4285	0.7925	0.8902
No log	2.7692	36	0.7190	0.5394	0.7190	0.8479
No log	2.9231	38	0.7155	0.5455	0.7155	0.8458
No log	3.0769	40	0.7085	0.5257	0.7085	0.8417
No log	3.2308	42	0.6254	0.5302	0.6254	0.7908
No log	3.3846	44	0.6547	0.5084	0.6547	0.8091
No log	3.5385	46	0.6634	0.4838	0.6634	0.8145
No log	3.6923	48	0.6474	0.5847	0.6474	0.8046
No log	3.8462	50	0.6521	0.5644	0.6521	0.8075
No log	4.0	52	0.6577	0.5797	0.6577	0.8110
No log	4.1538	54	0.6767	0.6045	0.6767	0.8226
No log	4.3077	56	0.6838	0.5274	0.6838	0.8269
No log	4.4615	58	0.7703	0.5674	0.7703	0.8776
No log	4.6154	60	0.7339	0.5192	0.7339	0.8567
No log	4.7692	62	0.6674	0.6280	0.6674	0.8169
No log	4.9231	64	0.6709	0.6353	0.6709	0.8191
No log	5.0769	66	0.6300	0.6073	0.6300	0.7937
No log	5.2308	68	0.6490	0.6424	0.6490	0.8056
No log	5.3846	70	1.0128	0.5101	1.0128	1.0064
No log	5.5385	72	1.0154	0.5178	1.0154	1.0077
No log	5.6923	74	0.7733	0.6083	0.7733	0.8794
No log	5.8462	76	0.6242	0.6470	0.6242	0.7901
No log	6.0	78	0.6446	0.5392	0.6446	0.8029
No log	6.1538	80	0.6395	0.6419	0.6395	0.7997
No log	6.3077	82	0.6277	0.6111	0.6277	0.7923
No log	6.4615	84	0.7721	0.6397	0.7721	0.8787
No log	6.6154	86	0.9925	0.5665	0.9925	0.9962
No log	6.7692	88	0.9511	0.5665	0.9511	0.9752
No log	6.9231	90	0.7765	0.6091	0.7765	0.8812
No log	7.0769	92	0.6554	0.5991	0.6554	0.8096
No log	7.2308	94	0.6786	0.6331	0.6786	0.8238
No log	7.3846	96	0.6887	0.6459	0.6887	0.8299
No log	7.5385	98	0.6247	0.6263	0.6247	0.7904
No log	7.6923	100	0.6569	0.6551	0.6569	0.8105
No log	7.8462	102	0.7489	0.6722	0.7489	0.8654
No log	8.0	104	0.7300	0.5992	0.7300	0.8544
No log	8.1538	106	0.6237	0.5650	0.6237	0.7897
No log	8.3077	108	0.5971	0.5773	0.5971	0.7727
No log	8.4615	110	0.6204	0.6272	0.6204	0.7876
No log	8.6154	112	0.6251	0.6196	0.6251	0.7906
No log	8.7692	114	0.6313	0.6094	0.6313	0.7946
No log	8.9231	116	0.6291	0.6094	0.6291	0.7932
No log	9.0769	118	0.6236	0.6263	0.6236	0.7897
No log	9.2308	120	0.6688	0.6756	0.6688	0.8178
No log	9.3846	122	0.6892	0.6492	0.6892	0.8302
No log	9.5385	124	0.7335	0.6620	0.7335	0.8565
No log	9.6923	126	0.7269	0.6468	0.7269	0.8526
No log	9.8462	128	0.6626	0.6120	0.6626	0.8140
No log	10.0	130	0.6755	0.6260	0.6755	0.8219
No log	10.1538	132	0.6860	0.6094	0.6860	0.8282
No log	10.3077	134	0.7075	0.6465	0.7075	0.8411
No log	10.4615	136	0.7012	0.6718	0.7012	0.8374
No log	10.6154	138	0.6473	0.5935	0.6473	0.8045
No log	10.7692	140	0.6711	0.5905	0.6711	0.8192
No log	10.9231	142	0.6547	0.6406	0.6547	0.8092
No log	11.0769	144	0.6510	0.6445	0.6510	0.8069
No log	11.2308	146	0.6793	0.6711	0.6793	0.8242
No log	11.3846	148	0.6665	0.6606	0.6665	0.8164
No log	11.5385	150	0.6494	0.6846	0.6494	0.8058
No log	11.6923	152	0.6424	0.5925	0.6424	0.8015
No log	11.8462	154	0.6315	0.6408	0.6316	0.7947
No log	12.0	156	0.6272	0.6095	0.6272	0.7920
No log	12.1538	158	0.6236	0.5725	0.6236	0.7897
No log	12.3077	160	0.6198	0.5975	0.6198	0.7873
No log	12.4615	162	0.6350	0.5830	0.6350	0.7969
No log	12.6154	164	0.6488	0.5933	0.6488	0.8055
No log	12.7692	166	0.6132	0.5742	0.6132	0.7831
No log	12.9231	168	0.6485	0.6773	0.6485	0.8053
No log	13.0769	170	0.7918	0.6397	0.7918	0.8898
No log	13.2308	172	0.8161	0.6573	0.8161	0.9034
No log	13.3846	174	0.7202	0.6773	0.7202	0.8486
No log	13.5385	176	0.6370	0.6177	0.6370	0.7982
No log	13.6923	178	0.6519	0.6287	0.6519	0.8074
No log	13.8462	180	0.6332	0.6262	0.6332	0.7957
No log	14.0	182	0.6017	0.5862	0.6017	0.7757
No log	14.1538	184	0.6171	0.5663	0.6171	0.7856
No log	14.3077	186	0.5907	0.5503	0.5907	0.7686
No log	14.4615	188	0.5817	0.5594	0.5817	0.7627
No log	14.6154	190	0.6337	0.6858	0.6337	0.7961
No log	14.7692	192	0.6939	0.6795	0.6939	0.8330
No log	14.9231	194	0.7068	0.6430	0.7068	0.8407
No log	15.0769	196	0.7535	0.6525	0.7535	0.8681
No log	15.2308	198	0.8149	0.5654	0.8149	0.9027
No log	15.3846	200	0.8122	0.5654	0.8122	0.9012
No log	15.5385	202	0.7606	0.5593	0.7606	0.8721
No log	15.6923	204	0.6937	0.6934	0.6937	0.8329
No log	15.8462	206	0.6625	0.6728	0.6625	0.8139
No log	16.0	208	0.6005	0.6570	0.6005	0.7749
No log	16.1538	210	0.5656	0.6636	0.5656	0.7521
No log	16.3077	212	0.5748	0.6435	0.5748	0.7582
No log	16.4615	214	0.5790	0.6484	0.5790	0.7609
No log	16.6154	216	0.6637	0.6881	0.6637	0.8147
No log	16.7692	218	0.7838	0.5670	0.7838	0.8853
No log	16.9231	220	0.7768	0.5496	0.7768	0.8814
No log	17.0769	222	0.7013	0.5798	0.7013	0.8375
No log	17.2308	224	0.6460	0.6804	0.6460	0.8037
No log	17.3846	226	0.6784	0.6433	0.6784	0.8236
No log	17.5385	228	0.6856	0.6726	0.6856	0.8280
No log	17.6923	230	0.6464	0.6518	0.6464	0.8040
No log	17.8462	232	0.6375	0.6578	0.6375	0.7984
No log	18.0	234	0.6462	0.6305	0.6462	0.8038
No log	18.1538	236	0.6387	0.5582	0.6387	0.7992
No log	18.3077	238	0.7079	0.5230	0.7079	0.8414
No log	18.4615	240	0.8015	0.5759	0.8015	0.8953
No log	18.6154	242	0.7757	0.5759	0.7757	0.8808
No log	18.7692	244	0.6572	0.6410	0.6572	0.8107
No log	18.9231	246	0.6063	0.7147	0.6063	0.7787
No log	19.0769	248	0.6151	0.7197	0.6151	0.7843
No log	19.2308	250	0.5994	0.7209	0.5994	0.7742
No log	19.3846	252	0.5848	0.6934	0.5848	0.7647
No log	19.5385	254	0.5461	0.6624	0.5461	0.7390
No log	19.6923	256	0.5362	0.6797	0.5362	0.7323
No log	19.8462	258	0.5343	0.6728	0.5343	0.7309
No log	20.0	260	0.5279	0.6962	0.5279	0.7266
No log	20.1538	262	0.5234	0.6813	0.5234	0.7235
No log	20.3077	264	0.5258	0.7090	0.5258	0.7251
No log	20.4615	266	0.5349	0.7294	0.5349	0.7313
No log	20.6154	268	0.5646	0.7109	0.5646	0.7514
No log	20.7692	270	0.5818	0.7434	0.5818	0.7628
No log	20.9231	272	0.5565	0.7073	0.5565	0.7460
No log	21.0769	274	0.5375	0.7073	0.5375	0.7331
No log	21.2308	276	0.5277	0.6927	0.5277	0.7265
No log	21.3846	278	0.5267	0.6857	0.5267	0.7257
No log	21.5385	280	0.5143	0.6725	0.5143	0.7171
No log	21.6923	282	0.5195	0.6697	0.5195	0.7208
No log	21.8462	284	0.5239	0.6697	0.5239	0.7238
No log	22.0	286	0.5154	0.6545	0.5154	0.7179
No log	22.1538	288	0.5436	0.6929	0.5436	0.7373
No log	22.3077	290	0.5705	0.6806	0.5705	0.7553
No log	22.4615	292	0.5407	0.6929	0.5407	0.7353
No log	22.6154	294	0.5325	0.6553	0.5325	0.7297
No log	22.7692	296	0.5988	0.7054	0.5988	0.7738
No log	22.9231	298	0.6449	0.6429	0.6449	0.8031
No log	23.0769	300	0.6027	0.6865	0.6027	0.7764
No log	23.2308	302	0.5617	0.6857	0.5617	0.7495
No log	23.3846	304	0.5513	0.6553	0.5513	0.7425
No log	23.5385	306	0.5724	0.6365	0.5724	0.7566
No log	23.6923	308	0.5587	0.6235	0.5587	0.7474
No log	23.8462	310	0.5561	0.6553	0.5561	0.7458
No log	24.0	312	0.5711	0.6408	0.5711	0.7557
No log	24.1538	314	0.5790	0.6444	0.5790	0.7609
No log	24.3077	316	0.5836	0.6870	0.5836	0.7640
No log	24.4615	318	0.5808	0.6408	0.5808	0.7621
No log	24.6154	320	0.5751	0.6695	0.5751	0.7583
No log	24.7692	322	0.5934	0.6040	0.5934	0.7703
No log	24.9231	324	0.6174	0.6344	0.6174	0.7858
No log	25.0769	326	0.6321	0.6359	0.6321	0.7950
No log	25.2308	328	0.6573	0.6831	0.6573	0.8107
No log	25.3846	330	0.6556	0.6548	0.6556	0.8097
No log	25.5385	332	0.6134	0.6646	0.6134	0.7832
No log	25.6923	334	0.6053	0.6288	0.6053	0.7780
No log	25.8462	336	0.6802	0.5973	0.6802	0.8247
No log	26.0	338	0.7199	0.5756	0.7199	0.8485
No log	26.1538	340	0.6871	0.5756	0.6871	0.8289
No log	26.3077	342	0.6270	0.5774	0.6270	0.7918
No log	26.4615	344	0.5813	0.5845	0.5813	0.7625
No log	26.6154	346	0.5650	0.6196	0.5650	0.7517
No log	26.7692	348	0.5722	0.6493	0.5722	0.7565
No log	26.9231	350	0.5952	0.7073	0.5952	0.7715
No log	27.0769	352	0.6030	0.7101	0.6030	0.7765
No log	27.2308	354	0.5913	0.6888	0.5913	0.7690
No log	27.3846	356	0.5629	0.7106	0.5629	0.7503
No log	27.5385	358	0.5467	0.7035	0.5467	0.7394
No log	27.6923	360	0.5340	0.5902	0.5340	0.7307
No log	27.8462	362	0.5216	0.6104	0.5216	0.7222
No log	28.0	364	0.5163	0.6374	0.5163	0.7186
No log	28.1538	366	0.5113	0.6553	0.5113	0.7150
No log	28.3077	368	0.5265	0.6484	0.5265	0.7256
No log	28.4615	370	0.5492	0.6617	0.5492	0.7411
No log	28.6154	372	0.5535	0.6570	0.5535	0.7440
No log	28.7692	374	0.5454	0.6406	0.5454	0.7385
No log	28.9231	376	0.5380	0.6414	0.5380	0.7335
No log	29.0769	378	0.5489	0.6751	0.5489	0.7408
No log	29.2308	380	0.5522	0.6568	0.5522	0.7431
No log	29.3846	382	0.5480	0.6722	0.5480	0.7403
No log	29.5385	384	0.5449	0.6624	0.5449	0.7382
No log	29.6923	386	0.5515	0.6617	0.5515	0.7426
No log	29.8462	388	0.5741	0.6503	0.5741	0.7577
No log	30.0	390	0.5866	0.6728	0.5866	0.7659
No log	30.1538	392	0.5948	0.6012	0.5948	0.7712
No log	30.3077	394	0.5989	0.6160	0.5989	0.7739
No log	30.4615	396	0.6018	0.6160	0.6018	0.7758
No log	30.6154	398	0.6137	0.5953	0.6137	0.7834
No log	30.7692	400	0.6070	0.5953	0.6070	0.7791
No log	30.9231	402	0.6221	0.5953	0.6221	0.7887
No log	31.0769	404	0.6464	0.6654	0.6464	0.8040
No log	31.2308	406	0.6015	0.6468	0.6015	0.7756
No log	31.3846	408	0.5549	0.6388	0.5549	0.7449
No log	31.5385	410	0.5441	0.6119	0.5441	0.7377
No log	31.6923	412	0.5286	0.6102	0.5286	0.7270
No log	31.8462	414	0.5239	0.6510	0.5239	0.7238
No log	32.0	416	0.5326	0.6280	0.5326	0.7298
No log	32.1538	418	0.5552	0.6388	0.5552	0.7451
No log	32.3077	420	0.5694	0.6179	0.5694	0.7546
No log	32.4615	422	0.5615	0.6510	0.5615	0.7494
No log	32.6154	424	0.5580	0.5917	0.5580	0.7470
No log	32.7692	426	0.5664	0.6128	0.5664	0.7526
No log	32.9231	428	0.5587	0.6476	0.5587	0.7475
No log	33.0769	430	0.5391	0.6249	0.5391	0.7342
No log	33.2308	432	0.5302	0.6278	0.5302	0.7281
No log	33.3846	434	0.5672	0.6581	0.5672	0.7531
No log	33.5385	436	0.5739	0.6649	0.5739	0.7576
No log	33.6923	438	0.5530	0.6310	0.5530	0.7437
No log	33.8462	440	0.5572	0.6526	0.5572	0.7464
No log	34.0	442	0.5775	0.6857	0.5775	0.7600
No log	34.1538	444	0.5944	0.7006	0.5944	0.7710
No log	34.3077	446	0.5964	0.6368	0.5964	0.7723
No log	34.4615	448	0.5985	0.6246	0.5985	0.7736
No log	34.6154	450	0.5884	0.6057	0.5884	0.7671
No log	34.7692	452	0.5863	0.6104	0.5863	0.7657
No log	34.9231	454	0.5826	0.5990	0.5826	0.7633
No log	35.0769	456	0.5600	0.6104	0.5600	0.7483
No log	35.2308	458	0.5435	0.6227	0.5435	0.7372
No log	35.3846	460	0.5361	0.6306	0.5361	0.7322
No log	35.5385	462	0.5343	0.6374	0.5343	0.7310
No log	35.6923	464	0.5409	0.6350	0.5409	0.7355
No log	35.8462	466	0.5603	0.6526	0.5603	0.7485
No log	36.0	468	0.5931	0.6934	0.5931	0.7701
No log	36.1538	470	0.6024	0.6934	0.6024	0.7761
No log	36.3077	472	0.5927	0.6160	0.5927	0.7699
No log	36.4615	474	0.5865	0.6251	0.5865	0.7658
No log	36.6154	476	0.5770	0.5807	0.5770	0.7596
No log	36.7692	478	0.5722	0.5925	0.5722	0.7564
No log	36.9231	480	0.5673	0.5925	0.5673	0.7532
No log	37.0769	482	0.5685	0.5925	0.5685	0.7540
No log	37.2308	484	0.5697	0.5731	0.5697	0.7548
No log	37.3846	486	0.5595	0.6186	0.5595	0.7480
No log	37.5385	488	0.5536	0.5990	0.5536	0.7440
No log	37.6923	490	0.5542	0.6007	0.5542	0.7444
No log	37.8462	492	0.5719	0.6045	0.5719	0.7562
No log	38.0	494	0.5877	0.5719	0.5877	0.7666
No log	38.1538	496	0.5867	0.6045	0.5867	0.7660
No log	38.3077	498	0.5633	0.5969	0.5633	0.7505
0.2492	38.4615	500	0.5520	0.6007	0.5520	0.7430
0.2492	38.6154	502	0.5662	0.5314	0.5662	0.7525
0.2492	38.7692	504	0.5683	0.5314	0.5683	0.7539
0.2492	38.9231	506	0.5558	0.6764	0.5558	0.7456
0.2492	39.0769	508	0.5632	0.6931	0.5632	0.7505
0.2492	39.2308	510	0.5641	0.6828	0.5641	0.7510
0.2492	39.3846	512	0.5567	0.6725	0.5567	0.7461
0.2492	39.5385	514	0.5505	0.6725	0.5505	0.7419
0.2492	39.6923	516	0.5426	0.6186	0.5426	0.7366
0.2492	39.8462	518	0.5425	0.5990	0.5425	0.7365
0.2492	40.0	520	0.5418	0.5990	0.5418	0.7360
0.2492	40.1538	522	0.5393	0.5990	0.5393	0.7344
0.2492	40.3077	524	0.5353	0.6104	0.5353	0.7316
0.2492	40.4615	526	0.5373	0.6297	0.5373	0.7330
0.2492	40.6154	528	0.5405	0.6828	0.5405	0.7352
0.2492	40.7692	530	0.5449	0.6725	0.5449	0.7382
0.2492	40.9231	532	0.5610	0.5949	0.5610	0.7490
0.2492	41.0769	534	0.5986	0.5968	0.5986	0.7737
0.2492	41.2308	536	0.6282	0.6426	0.6282	0.7926
0.2492	41.3846	538	0.6044	0.6209	0.6044	0.7774
0.2492	41.5385	540	0.5620	0.6197	0.5620	0.7497
0.2492	41.6923	542	0.5457	0.6217	0.5457	0.7387
0.2492	41.8462	544	0.5461	0.6442	0.5461	0.7390
0.2492	42.0	546	0.5416	0.6407	0.5416	0.7359
0.2492	42.1538	548	0.5420	0.6297	0.5420	0.7362
0.2492	42.3077	550	0.5680	0.5832	0.5680	0.7537
0.2492	42.4615	552	0.5885	0.6198	0.5885	0.7671
0.2492	42.6154	554	0.5950	0.6091	0.5950	0.7713
0.2492	42.7692	556	0.5797	0.6083	0.5797	0.7614
0.2492	42.9231	558	0.5571	0.6186	0.5571	0.7464
0.2492	43.0769	560	0.5420	0.6553	0.5420	0.7362
0.2492	43.2308	562	0.5401	0.6828	0.5401	0.7349
0.2492	43.3846	564	0.5426	0.6638	0.5426	0.7366
0.2492	43.5385	566	0.5342	0.6284	0.5342	0.7309
0.2492	43.6923	568	0.5321	0.6001	0.5321	0.7294
0.2492	43.8462	570	0.5448	0.6441	0.5448	0.7381
0.2492	44.0	572	0.5766	0.6781	0.5766	0.7594
0.2492	44.1538	574	0.5861	0.6670	0.5861	0.7656
0.2492	44.3077	576	0.5626	0.6396	0.5626	0.7501
0.2492	44.4615	578	0.5444	0.6345	0.5444	0.7379
0.2492	44.6154	580	0.5308	0.6239	0.5308	0.7285
0.2492	44.7692	582	0.5200	0.6330	0.5200	0.7211
0.2492	44.9231	584	0.5194	0.6374	0.5194	0.7207
0.2492	45.0769	586	0.5240	0.6659	0.5240	0.7239
0.2492	45.2308	588	0.5238	0.6659	0.5238	0.7238
0.2492	45.3846	590	0.5226	0.6398	0.5226	0.7229
0.2492	45.5385	592	0.5244	0.6424	0.5244	0.7242
0.2492	45.6923	594	0.5336	0.6154	0.5336	0.7305
0.2492	45.8462	596	0.5390	0.6262	0.5390	0.7341
0.2492	46.0	598	0.5383	0.6415	0.5383	0.7337
0.2492	46.1538	600	0.5349	0.6311	0.5349	0.7314
0.2492	46.3077	602	0.5320	0.6491	0.5320	0.7294
0.2492	46.4615	604	0.5246	0.6288	0.5246	0.7243
0.2492	46.6154	606	0.5245	0.6207	0.5245	0.7242
0.2492	46.7692	608	0.5227	0.6186	0.5227	0.7230
0.2492	46.9231	610	0.5277	0.5990	0.5277	0.7264
0.2492	47.0769	612	0.5342	0.6007	0.5342	0.7309
0.2492	47.2308	614	0.5347	0.5990	0.5347	0.7312
0.2492	47.3846	616	0.5481	0.5964	0.5481	0.7403
0.2492	47.5385	618	0.5582	0.5853	0.5582	0.7471

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1