ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5899
• Qwk: 0.7499
• Mse: 0.5899
• Rmse: 0.7681

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	5.1213	-0.0001	5.1213	2.2630
No log	0.0769	4	3.0949	0.0808	3.0949	1.7592
No log	0.1154	6	2.3200	-0.0269	2.3200	1.5231
No log	0.1538	8	1.6590	0.0640	1.6590	1.2880
No log	0.1923	10	1.2042	0.2460	1.2042	1.0973
No log	0.2308	12	1.4058	0.0587	1.4058	1.1857
No log	0.2692	14	1.6287	0.0170	1.6287	1.2762
No log	0.3077	16	1.4208	0.0076	1.4208	1.1920
No log	0.3462	18	1.2802	0.1928	1.2802	1.1315
No log	0.3846	20	1.2092	0.2711	1.2092	1.0996
No log	0.4231	22	1.2808	0.2615	1.2808	1.1317
No log	0.4615	24	1.4572	0.1941	1.4572	1.2071
No log	0.5	26	1.4779	0.2895	1.4779	1.2157
No log	0.5385	28	1.3006	0.3337	1.3006	1.1405
No log	0.5769	30	1.1240	0.4559	1.1240	1.0602
No log	0.6154	32	0.9027	0.52	0.9027	0.9501
No log	0.6538	34	0.8018	0.5195	0.8018	0.8954
No log	0.6923	36	0.9803	0.4916	0.9803	0.9901
No log	0.7308	38	1.3510	0.3576	1.3510	1.1623
No log	0.7692	40	1.2524	0.4358	1.2524	1.1191
No log	0.8077	42	0.8328	0.5872	0.8328	0.9126
No log	0.8462	44	0.7251	0.5927	0.7251	0.8515
No log	0.8846	46	0.7678	0.5960	0.7678	0.8762
No log	0.9231	48	1.0325	0.5363	1.0325	1.0161
No log	0.9615	50	1.1378	0.4916	1.1378	1.0667
No log	1.0	52	1.2097	0.4864	1.2097	1.0999
No log	1.0385	54	0.8415	0.6388	0.8415	0.9174
No log	1.0769	56	0.5982	0.7271	0.5982	0.7735
No log	1.1154	58	0.5993	0.7211	0.5993	0.7741
No log	1.1538	60	0.7836	0.6646	0.7836	0.8852
No log	1.1923	62	0.9454	0.5740	0.9454	0.9723
No log	1.2308	64	0.8217	0.6347	0.8217	0.9065
No log	1.2692	66	0.6507	0.6881	0.6507	0.8066
No log	1.3077	68	0.6537	0.6673	0.6537	0.8085
No log	1.3462	70	0.7155	0.6285	0.7155	0.8458
No log	1.3846	72	0.7561	0.6150	0.7561	0.8696
No log	1.4231	74	0.7897	0.6201	0.7897	0.8886
No log	1.4615	76	0.6424	0.6973	0.6424	0.8015
No log	1.5	78	0.6060	0.7191	0.6060	0.7785
No log	1.5385	80	0.6311	0.6738	0.6311	0.7944
No log	1.5769	82	0.6495	0.6870	0.6495	0.8059
No log	1.6154	84	0.6578	0.6995	0.6578	0.8111
No log	1.6538	86	0.6619	0.7176	0.6619	0.8136
No log	1.6923	88	0.7440	0.6782	0.7440	0.8626
No log	1.7308	90	0.8134	0.6084	0.8134	0.9019
No log	1.7692	92	0.8414	0.6038	0.8414	0.9173
No log	1.8077	94	0.7785	0.6014	0.7785	0.8823
No log	1.8462	96	0.7154	0.6261	0.7154	0.8458
No log	1.8846	98	0.7509	0.6168	0.7509	0.8666
No log	1.9231	100	0.8162	0.5999	0.8162	0.9034
No log	1.9615	102	0.8172	0.6190	0.8172	0.9040
No log	2.0	104	0.8678	0.6275	0.8678	0.9315
No log	2.0385	106	0.7956	0.6481	0.7956	0.8919
No log	2.0769	108	0.7402	0.6526	0.7402	0.8603
No log	2.1154	110	0.9658	0.6173	0.9658	0.9828
No log	2.1538	112	0.9815	0.6071	0.9815	0.9907
No log	2.1923	114	0.6979	0.6985	0.6979	0.8354
No log	2.2308	116	0.5934	0.7555	0.5934	0.7703
No log	2.2692	118	0.6880	0.7003	0.6880	0.8295
No log	2.3077	120	0.7724	0.6795	0.7724	0.8789
No log	2.3462	122	0.6770	0.7224	0.6770	0.8228
No log	2.3846	124	0.6439	0.7543	0.6439	0.8024
No log	2.4231	126	0.6497	0.7362	0.6497	0.8060
No log	2.4615	128	0.6344	0.7251	0.6344	0.7965
No log	2.5	130	0.6882	0.6825	0.6882	0.8296
No log	2.5385	132	0.7140	0.6624	0.7140	0.8450
No log	2.5769	134	0.6425	0.7152	0.6425	0.8015
No log	2.6154	136	0.6437	0.6856	0.6437	0.8023
No log	2.6538	138	0.7777	0.6207	0.7777	0.8819
No log	2.6923	140	0.7494	0.6158	0.7494	0.8657
No log	2.7308	142	0.6313	0.7127	0.6313	0.7946
No log	2.7692	144	0.6318	0.7191	0.6318	0.7948
No log	2.8077	146	0.6376	0.7307	0.6376	0.7985
No log	2.8462	148	0.6753	0.7385	0.6753	0.8217
No log	2.8846	150	0.7298	0.6801	0.7298	0.8543
No log	2.9231	152	0.6803	0.7291	0.6803	0.8248
No log	2.9615	154	0.6147	0.7678	0.6147	0.7840
No log	3.0	156	0.6039	0.7292	0.6039	0.7771
No log	3.0385	158	0.5773	0.7350	0.5773	0.7598
No log	3.0769	160	0.5739	0.7449	0.5739	0.7575
No log	3.1154	162	0.7055	0.6295	0.7055	0.8399
No log	3.1538	164	0.7736	0.6296	0.7736	0.8796
No log	3.1923	166	0.6991	0.6172	0.6991	0.8361
No log	3.2308	168	0.5802	0.7060	0.5802	0.7617
No log	3.2692	170	0.5544	0.7453	0.5544	0.7446
No log	3.3077	172	0.5745	0.7457	0.5745	0.7580
No log	3.3462	174	0.5792	0.7477	0.5792	0.7610
No log	3.3846	176	0.5675	0.7750	0.5675	0.7533
No log	3.4231	178	0.5806	0.7503	0.5806	0.7620
No log	3.4615	180	0.6345	0.7403	0.6345	0.7966
No log	3.5	182	0.6870	0.7054	0.6870	0.8288
No log	3.5385	184	0.6152	0.7332	0.6152	0.7843
No log	3.5769	186	0.5690	0.7578	0.5690	0.7544
No log	3.6154	188	0.5774	0.7170	0.5774	0.7598
No log	3.6538	190	0.5660	0.7369	0.5660	0.7523
No log	3.6923	192	0.6237	0.7084	0.6237	0.7897
No log	3.7308	194	0.8668	0.6335	0.8668	0.9310
No log	3.7692	196	0.9855	0.5908	0.9855	0.9927
No log	3.8077	198	0.8320	0.6193	0.8320	0.9121
No log	3.8462	200	0.6147	0.7294	0.6147	0.7840
No log	3.8846	202	0.6119	0.7137	0.6119	0.7822
No log	3.9231	204	0.6853	0.6848	0.6853	0.8278
No log	3.9615	206	0.6569	0.6875	0.6569	0.8105
No log	4.0	208	0.6091	0.7436	0.6091	0.7804
No log	4.0385	210	0.6137	0.7427	0.6137	0.7834
No log	4.0769	212	0.6195	0.7503	0.6195	0.7871
No log	4.1154	214	0.6082	0.7200	0.6082	0.7799
No log	4.1538	216	0.5968	0.7181	0.5968	0.7725
No log	4.1923	218	0.5906	0.7318	0.5906	0.7685
No log	4.2308	220	0.6035	0.7626	0.6035	0.7769
No log	4.2692	222	0.6609	0.7284	0.6609	0.8130
No log	4.3077	224	0.7173	0.6786	0.7173	0.8470
No log	4.3462	226	0.6833	0.7074	0.6833	0.8266
No log	4.3846	228	0.6067	0.7482	0.6067	0.7789
No log	4.4231	230	0.6110	0.7223	0.6110	0.7817
No log	4.4615	232	0.6083	0.7223	0.6083	0.7799
No log	4.5	234	0.6023	0.7443	0.6023	0.7761
No log	4.5385	236	0.6636	0.7409	0.6636	0.8146
No log	4.5769	238	0.7203	0.6871	0.7203	0.8487
No log	4.6154	240	0.7613	0.6723	0.7613	0.8725
No log	4.6538	242	0.7041	0.7132	0.7041	0.8391
No log	4.6923	244	0.6281	0.7508	0.6281	0.7925
No log	4.7308	246	0.5979	0.7583	0.5979	0.7733
No log	4.7692	248	0.5867	0.7483	0.5867	0.7659
No log	4.8077	250	0.5897	0.7615	0.5897	0.7679
No log	4.8462	252	0.6056	0.7348	0.6056	0.7782
No log	4.8846	254	0.5993	0.7298	0.5993	0.7741
No log	4.9231	256	0.5981	0.7150	0.5981	0.7734
No log	4.9615	258	0.5902	0.7221	0.5902	0.7683
No log	5.0	260	0.5786	0.7000	0.5786	0.7606
No log	5.0385	262	0.5790	0.7019	0.5790	0.7609
No log	5.0769	264	0.5816	0.7038	0.5816	0.7626
No log	5.1154	266	0.5836	0.7103	0.5836	0.7639
No log	5.1538	268	0.5888	0.7031	0.5888	0.7673
No log	5.1923	270	0.5977	0.7290	0.5977	0.7731
No log	5.2308	272	0.6155	0.7462	0.6155	0.7846
No log	5.2692	274	0.6216	0.7424	0.6216	0.7884
No log	5.3077	276	0.6444	0.7168	0.6444	0.8028
No log	5.3462	278	0.7062	0.6785	0.7062	0.8404
No log	5.3846	280	0.7145	0.6696	0.7145	0.8453
No log	5.4231	282	0.6520	0.7224	0.6520	0.8075
No log	5.4615	284	0.5984	0.7611	0.5984	0.7736
No log	5.5	286	0.5854	0.7546	0.5854	0.7651
No log	5.5385	288	0.5809	0.7416	0.5809	0.7622
No log	5.5769	290	0.5733	0.7150	0.5733	0.7571
No log	5.6154	292	0.6021	0.6813	0.6021	0.7759
No log	5.6538	294	0.6853	0.6476	0.6853	0.8279
No log	5.6923	296	0.7353	0.6452	0.7353	0.8575
No log	5.7308	298	0.6988	0.6443	0.6988	0.8359
No log	5.7692	300	0.6237	0.6643	0.6237	0.7898
No log	5.8077	302	0.5800	0.6919	0.5800	0.7616
No log	5.8462	304	0.5776	0.7174	0.5776	0.7600
No log	5.8846	306	0.5776	0.7241	0.5776	0.7600
No log	5.9231	308	0.6028	0.6736	0.6028	0.7764
No log	5.9615	310	0.6245	0.6721	0.6245	0.7903
No log	6.0	312	0.6131	0.6856	0.6131	0.7830
No log	6.0385	314	0.5825	0.7553	0.5825	0.7632
No log	6.0769	316	0.5900	0.7636	0.5900	0.7681
No log	6.1154	318	0.6268	0.6990	0.6268	0.7917
No log	6.1538	320	0.6273	0.6873	0.6273	0.7920
No log	6.1923	322	0.5958	0.7598	0.5958	0.7719
No log	6.2308	324	0.5975	0.7507	0.5975	0.7730
No log	6.2692	326	0.6252	0.6765	0.6252	0.7907
No log	6.3077	328	0.6173	0.6997	0.6173	0.7857
No log	6.3462	330	0.5973	0.6751	0.5973	0.7729
No log	6.3846	332	0.6203	0.7179	0.6203	0.7876
No log	6.4231	334	0.6706	0.7060	0.6706	0.8189
No log	6.4615	336	0.6863	0.6688	0.6863	0.8284
No log	6.5	338	0.6565	0.7161	0.6565	0.8103
No log	6.5385	340	0.6207	0.7246	0.6207	0.7879
No log	6.5769	342	0.5995	0.7397	0.5995	0.7743
No log	6.6154	344	0.5871	0.7474	0.5871	0.7662
No log	6.6538	346	0.5863	0.7443	0.5863	0.7657
No log	6.6923	348	0.5912	0.7572	0.5912	0.7689
No log	6.7308	350	0.5966	0.7607	0.5966	0.7724
No log	6.7692	352	0.6060	0.7661	0.6060	0.7785
No log	6.8077	354	0.6247	0.7309	0.6247	0.7904
No log	6.8462	356	0.6407	0.7190	0.6407	0.8004
No log	6.8846	358	0.6184	0.7262	0.6184	0.7864
No log	6.9231	360	0.5941	0.7433	0.5941	0.7708
No log	6.9615	362	0.5931	0.7657	0.5931	0.7701
No log	7.0	364	0.6055	0.7272	0.6055	0.7781
No log	7.0385	366	0.6089	0.7123	0.6089	0.7803
No log	7.0769	368	0.6077	0.7187	0.6077	0.7796
No log	7.1154	370	0.6054	0.7457	0.6054	0.7781
No log	7.1538	372	0.6115	0.7044	0.6115	0.7820
No log	7.1923	374	0.6127	0.6853	0.6127	0.7827
No log	7.2308	376	0.6042	0.7044	0.6042	0.7773
No log	7.2692	378	0.5911	0.7702	0.5911	0.7688
No log	7.3077	380	0.5935	0.7562	0.5935	0.7704
No log	7.3462	382	0.6069	0.7443	0.6069	0.7790
No log	7.3846	384	0.6128	0.7155	0.6128	0.7828
No log	7.4231	386	0.6009	0.7509	0.6009	0.7752
No log	7.4615	388	0.5850	0.7502	0.5850	0.7648
No log	7.5	390	0.5781	0.7502	0.5781	0.7603
No log	7.5385	392	0.5764	0.7632	0.5764	0.7592
No log	7.5769	394	0.5794	0.7240	0.5794	0.7612
No log	7.6154	396	0.5751	0.7394	0.5751	0.7584
No log	7.6538	398	0.5713	0.7632	0.5713	0.7558
No log	7.6923	400	0.5773	0.7583	0.5773	0.7598
No log	7.7308	402	0.5923	0.7550	0.5923	0.7696
No log	7.7692	404	0.6021	0.7550	0.6021	0.7759
No log	7.8077	406	0.6097	0.7342	0.6097	0.7808
No log	7.8462	408	0.6051	0.7526	0.6051	0.7779
No log	7.8846	410	0.5870	0.7559	0.5870	0.7662
No log	7.9231	412	0.5852	0.7632	0.5852	0.7650
No log	7.9615	414	0.5916	0.7480	0.5916	0.7691
No log	8.0	416	0.5974	0.7492	0.5974	0.7729
No log	8.0385	418	0.5964	0.7492	0.5964	0.7723
No log	8.0769	420	0.5905	0.7643	0.5905	0.7685
No log	8.1154	422	0.5862	0.7765	0.5862	0.7656
No log	8.1538	424	0.5834	0.7734	0.5834	0.7638
No log	8.1923	426	0.5799	0.7666	0.5799	0.7615
No log	8.2308	428	0.5806	0.7598	0.5806	0.7620
No log	8.2692	430	0.5837	0.7573	0.5837	0.7640
No log	8.3077	432	0.5828	0.7573	0.5828	0.7634
No log	8.3462	434	0.5777	0.7494	0.5777	0.7601
No log	8.3846	436	0.5686	0.7562	0.5686	0.7541
No log	8.4231	438	0.5673	0.7498	0.5673	0.7532
No log	8.4615	440	0.5738	0.7578	0.5738	0.7575
No log	8.5	442	0.5741	0.7578	0.5741	0.7577
No log	8.5385	444	0.5719	0.7639	0.5719	0.7563
No log	8.5769	446	0.5696	0.7583	0.5696	0.7547
No log	8.6154	448	0.5695	0.7573	0.5695	0.7546
No log	8.6538	450	0.5743	0.7564	0.5743	0.7578
No log	8.6923	452	0.5809	0.7520	0.5809	0.7622
No log	8.7308	454	0.5900	0.7575	0.5900	0.7681
No log	8.7692	456	0.5944	0.7532	0.5944	0.7710
No log	8.8077	458	0.5934	0.7575	0.5934	0.7703
No log	8.8462	460	0.5929	0.7598	0.5929	0.7700
No log	8.8846	462	0.5945	0.7598	0.5945	0.7711
No log	8.9231	464	0.5938	0.7642	0.5938	0.7706
No log	8.9615	466	0.5935	0.7608	0.5935	0.7704
No log	9.0	468	0.5928	0.7734	0.5928	0.7700
No log	9.0385	470	0.5922	0.7702	0.5922	0.7695
No log	9.0769	472	0.5919	0.7702	0.5919	0.7693
No log	9.1154	474	0.5917	0.7657	0.5917	0.7692
No log	9.1538	476	0.5929	0.7529	0.5929	0.7700
No log	9.1923	478	0.5947	0.7544	0.5947	0.7711
No log	9.2308	480	0.5971	0.7491	0.5971	0.7727
No log	9.2692	482	0.5957	0.7514	0.5957	0.7718
No log	9.3077	484	0.5921	0.7499	0.5921	0.7695
No log	9.3462	486	0.5904	0.7439	0.5904	0.7684
No log	9.3846	488	0.5885	0.7484	0.5885	0.7671
No log	9.4231	490	0.5883	0.7529	0.5883	0.7670
No log	9.4615	492	0.5879	0.7529	0.5879	0.7668
No log	9.5	494	0.5872	0.7553	0.5872	0.7663
No log	9.5385	496	0.5868	0.7553	0.5868	0.7660
No log	9.5769	498	0.5859	0.7553	0.5859	0.7655
0.3654	9.6154	500	0.5852	0.7682	0.5852	0.7650
0.3654	9.6538	502	0.5845	0.7553	0.5845	0.7646
0.3654	9.6923	504	0.5842	0.7553	0.5842	0.7644
0.3654	9.7308	506	0.5846	0.7529	0.5846	0.7646
0.3654	9.7692	508	0.5852	0.7484	0.5852	0.7650
0.3654	9.8077	510	0.5863	0.7439	0.5863	0.7657
0.3654	9.8462	512	0.5872	0.7439	0.5872	0.7663
0.3654	9.8846	514	0.5883	0.7499	0.5883	0.7670
0.3654	9.9231	516	0.5891	0.7499	0.5891	0.7675
0.3654	9.9615	518	0.5897	0.7499	0.5897	0.7679
0.3654	10.0	520	0.5899	0.7499	0.5899	0.7681

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1