ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7459
• Qwk: 0.6815
• Mse: 0.7459
• Rmse: 0.8637

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0220	2	6.9880	0.0179	6.9880	2.6435
No log	0.0440	4	4.6853	0.0679	4.6853	2.1646
No log	0.0659	6	3.4574	-0.0109	3.4574	1.8594
No log	0.0879	8	2.5776	0.1633	2.5776	1.6055
No log	0.1099	10	1.9973	0.1094	1.9973	1.4133
No log	0.1319	12	1.8992	0.3167	1.8992	1.3781
No log	0.1538	14	2.1183	0.1791	2.1183	1.4554
No log	0.1758	16	2.7188	0.0263	2.7188	1.6489
No log	0.1978	18	3.2133	0.0629	3.2133	1.7926
No log	0.2198	20	3.3297	0.0727	3.3297	1.8247
No log	0.2418	22	2.8875	0.0	2.8875	1.6993
No log	0.2637	24	1.9937	0.2734	1.9937	1.4120
No log	0.2857	26	1.5442	0.3158	1.5442	1.2427
No log	0.3077	28	1.4263	0.1698	1.4263	1.1943
No log	0.3297	30	1.5133	0.3036	1.5133	1.2302
No log	0.3516	32	2.1577	0.0979	2.1577	1.4689
No log	0.3736	34	2.1694	0.1571	2.1694	1.4729
No log	0.3956	36	1.8815	0.3651	1.8815	1.3717
No log	0.4176	38	2.0524	0.1926	2.0524	1.4326
No log	0.4396	40	1.8442	0.3651	1.8442	1.3580
No log	0.4615	42	1.4638	0.3248	1.4638	1.2099
No log	0.4835	44	1.2888	0.5041	1.2888	1.1353
No log	0.5055	46	1.3249	0.4921	1.3249	1.1510
No log	0.5275	48	1.4544	0.3697	1.4544	1.2060
No log	0.5495	50	2.0056	0.2628	2.0056	1.4162
No log	0.5714	52	1.7865	0.3231	1.7865	1.3366
No log	0.5934	54	1.2240	0.4553	1.2240	1.1063
No log	0.6154	56	1.1064	0.4833	1.1064	1.0519
No log	0.6374	58	1.1127	0.4959	1.1127	1.0548
No log	0.6593	60	0.9931	0.5920	0.9931	0.9966
No log	0.6813	62	1.0330	0.5891	1.0330	1.0164
No log	0.7033	64	1.1711	0.5238	1.1711	1.0822
No log	0.7253	66	1.2289	0.5397	1.2289	1.1086
No log	0.7473	68	0.9504	0.6299	0.9504	0.9749
No log	0.7692	70	1.2318	0.5180	1.2318	1.1099
No log	0.7912	72	1.2054	0.5532	1.2054	1.0979
No log	0.8132	74	1.0344	0.5203	1.0344	1.0170
No log	0.8352	76	1.1173	0.5042	1.1173	1.0570
No log	0.8571	78	1.2326	0.5323	1.2326	1.1102
No log	0.8791	80	1.0462	0.5600	1.0462	1.0228
No log	0.9011	82	0.9372	0.5968	0.9372	0.9681
No log	0.9231	84	0.8935	0.6094	0.8935	0.9452
No log	0.9451	86	0.8202	0.6963	0.8202	0.9057
No log	0.9670	88	0.7719	0.7050	0.7719	0.8786
No log	0.9890	90	1.0054	0.5821	1.0054	1.0027
No log	1.0110	92	1.2057	0.5547	1.2057	1.0980
No log	1.0330	94	1.2621	0.5294	1.2621	1.1234
No log	1.0549	96	1.1586	0.5547	1.1586	1.0764
No log	1.0769	98	1.1064	0.5797	1.1064	1.0519
No log	1.0989	100	0.7719	0.7248	0.7719	0.8786
No log	1.1209	102	0.7281	0.7947	0.7281	0.8533
No log	1.1429	104	0.7505	0.7639	0.7505	0.8663
No log	1.1648	106	0.7880	0.7259	0.7880	0.8877
No log	1.1868	108	0.7838	0.6565	0.7838	0.8853
No log	1.2088	110	0.8043	0.7259	0.8043	0.8968
No log	1.2308	112	1.1086	0.5147	1.1086	1.0529
No log	1.2527	114	1.0394	0.6316	1.0394	1.0195
No log	1.2747	116	0.8362	0.7023	0.8362	0.9144
No log	1.2967	118	0.8089	0.6667	0.8089	0.8994
No log	1.3187	120	0.7782	0.7206	0.7782	0.8822
No log	1.3407	122	0.9460	0.6269	0.9460	0.9726
No log	1.3626	124	1.3034	0.4965	1.3034	1.1416
No log	1.3846	126	1.2213	0.5571	1.2213	1.1051
No log	1.4066	128	1.1011	0.6241	1.1011	1.0493
No log	1.4286	130	0.9027	0.6621	0.9027	0.9501
No log	1.4505	132	0.8861	0.6111	0.8861	0.9413
No log	1.4725	134	1.0215	0.6197	1.0215	1.0107
No log	1.4945	136	1.0817	0.5874	1.0817	1.0400
No log	1.5165	138	0.8639	0.7075	0.8639	0.9295
No log	1.5385	140	0.8213	0.7260	0.8213	0.9063
No log	1.5604	142	0.8117	0.7222	0.8117	0.9009
No log	1.5824	144	0.8415	0.7273	0.8415	0.9173
No log	1.6044	146	0.9306	0.6466	0.9306	0.9647
No log	1.6264	148	1.1238	0.5564	1.1238	1.0601
No log	1.6484	150	1.0576	0.5865	1.0576	1.0284
No log	1.6703	152	0.8217	0.6515	0.8217	0.9065
No log	1.6923	154	0.7343	0.7376	0.7343	0.8569
No log	1.7143	156	0.6986	0.7413	0.6986	0.8358
No log	1.7363	158	0.7752	0.7020	0.7752	0.8805
No log	1.7582	160	1.0930	0.6351	1.0930	1.0454
No log	1.7802	162	1.2094	0.5772	1.2094	1.0997
No log	1.8022	164	1.2541	0.5616	1.2541	1.1199
No log	1.8242	166	0.9908	0.6621	0.9908	0.9954
No log	1.8462	168	0.7908	0.7034	0.7908	0.8892
No log	1.8681	170	0.7432	0.7413	0.7432	0.8621
No log	1.8901	172	0.7828	0.7143	0.7828	0.8847
No log	1.9121	174	1.0866	0.5899	1.0866	1.0424
No log	1.9341	176	1.3382	0.4965	1.3382	1.1568
No log	1.9560	178	1.1103	0.5652	1.1103	1.0537
No log	1.9780	180	0.7548	0.7194	0.7548	0.8688
No log	2.0	182	0.6888	0.7639	0.6888	0.8299
No log	2.0220	184	0.6690	0.7722	0.6690	0.8180
No log	2.0440	186	0.6131	0.8267	0.6131	0.7830
No log	2.0659	188	0.7747	0.6621	0.7747	0.8802
No log	2.0879	190	0.8661	0.6531	0.8661	0.9306
No log	2.1099	192	0.7284	0.7211	0.7284	0.8535
No log	2.1319	194	0.7312	0.7763	0.7312	0.8551
No log	2.1538	196	0.7664	0.7436	0.7664	0.8755
No log	2.1758	198	0.7157	0.7547	0.7157	0.8460
No log	2.1978	200	0.6148	0.8075	0.6148	0.7841
No log	2.2198	202	0.8181	0.6434	0.8181	0.9045
No log	2.2418	204	0.8441	0.6434	0.8441	0.9188
No log	2.2637	206	0.7437	0.6950	0.7437	0.8624
No log	2.2857	208	0.7490	0.7448	0.7490	0.8654
No log	2.3077	210	0.7587	0.7383	0.7587	0.8710
No log	2.3297	212	0.7022	0.7671	0.7022	0.8379
No log	2.3516	214	0.7796	0.6713	0.7796	0.8830
No log	2.3736	216	0.9241	0.6345	0.9241	0.9613
No log	2.3956	218	0.7856	0.6483	0.7856	0.8863
No log	2.4176	220	0.5617	0.8387	0.5617	0.7494
No log	2.4396	222	0.5728	0.8176	0.5728	0.7568
No log	2.4615	224	0.5974	0.7815	0.5974	0.7729
No log	2.4835	226	0.6072	0.7733	0.6072	0.7792
No log	2.5055	228	0.6239	0.8082	0.6239	0.7899
No log	2.5275	230	0.6743	0.7194	0.6743	0.8211
No log	2.5495	232	0.7957	0.6522	0.7957	0.8920
No log	2.5714	234	0.7449	0.6667	0.7449	0.8631
No log	2.5934	236	0.6658	0.7391	0.6658	0.8160
No log	2.6154	238	0.6271	0.7536	0.6271	0.7919
No log	2.6374	240	0.6640	0.7445	0.6640	0.8149
No log	2.6593	242	0.6153	0.7862	0.6153	0.7844
No log	2.6813	244	0.5890	0.7973	0.5890	0.7675
No log	2.7033	246	0.5981	0.8079	0.5981	0.7734
No log	2.7253	248	0.7590	0.6479	0.7590	0.8712
No log	2.7473	250	0.7764	0.6479	0.7764	0.8811
No log	2.7692	252	0.6616	0.8	0.6616	0.8134
No log	2.7912	254	0.6767	0.7397	0.6767	0.8226
No log	2.8132	256	0.8441	0.6331	0.8441	0.9187
No log	2.8352	258	0.8825	0.5839	0.8825	0.9394
No log	2.8571	260	0.8848	0.5882	0.8848	0.9406
No log	2.8791	262	0.8080	0.6475	0.8080	0.8989
No log	2.9011	264	0.7472	0.6993	0.7472	0.8644
No log	2.9231	266	0.7255	0.6993	0.7255	0.8518
No log	2.9451	268	0.6539	0.7483	0.6539	0.8087
No log	2.9670	270	0.6102	0.7586	0.6102	0.7811
No log	2.9890	272	0.6297	0.7338	0.6297	0.7935
No log	3.0110	274	0.6694	0.7626	0.6694	0.8182
No log	3.0330	276	0.7150	0.6957	0.7150	0.8455
No log	3.0549	278	0.6310	0.7746	0.6310	0.7944
No log	3.0769	280	0.6469	0.7591	0.6469	0.8043
No log	3.0989	282	0.6109	0.7571	0.6109	0.7816
No log	3.1209	284	0.5472	0.8082	0.5472	0.7397
No log	3.1429	286	0.5834	0.7692	0.5834	0.7638
No log	3.1648	288	0.7302	0.7034	0.7302	0.8545
No log	3.1868	290	0.7401	0.7083	0.7401	0.8603
No log	3.2088	292	0.7022	0.7246	0.7022	0.8380
No log	3.2308	294	0.7595	0.6763	0.7595	0.8715
No log	3.2527	296	0.7818	0.6222	0.7818	0.8842
No log	3.2747	298	0.7668	0.7391	0.7668	0.8757
No log	3.2967	300	0.7767	0.7353	0.7767	0.8813
No log	3.3187	302	0.7340	0.7552	0.7340	0.8568
No log	3.3407	304	0.7579	0.7190	0.7579	0.8706
No log	3.3626	306	0.8193	0.6974	0.8193	0.9051
No log	3.3846	308	0.7579	0.7226	0.7579	0.8706
No log	3.4066	310	0.6683	0.7234	0.6683	0.8175
No log	3.4286	312	0.7934	0.7050	0.7934	0.8907
No log	3.4505	314	0.8649	0.6861	0.8649	0.9300
No log	3.4725	316	0.7756	0.7050	0.7756	0.8807
No log	3.4945	318	0.6703	0.7465	0.6703	0.8187
No log	3.5165	320	0.6459	0.7234	0.6459	0.8037
No log	3.5385	322	0.6426	0.7465	0.6426	0.8016
No log	3.5604	324	0.7035	0.7448	0.7035	0.8387
No log	3.5824	326	0.8346	0.6620	0.8346	0.9136
No log	3.6044	328	0.9536	0.6479	0.9536	0.9765
No log	3.6264	330	0.8563	0.6525	0.8563	0.9254
No log	3.6484	332	0.7174	0.7324	0.7174	0.8470
No log	3.6703	334	0.6999	0.7552	0.6999	0.8366
No log	3.6923	336	0.7288	0.6763	0.7288	0.8537
No log	3.7143	338	0.7187	0.7324	0.7187	0.8477
No log	3.7363	340	0.7265	0.7286	0.7265	0.8524
No log	3.7582	342	0.7913	0.7092	0.7913	0.8895
No log	3.7802	344	0.8449	0.6667	0.8449	0.9192
No log	3.8022	346	0.8793	0.6718	0.8793	0.9377
No log	3.8242	348	0.8363	0.6970	0.8363	0.9145
No log	3.8462	350	0.7832	0.7059	0.7832	0.8850
No log	3.8681	352	0.7751	0.7143	0.7751	0.8804
No log	3.8901	354	0.7547	0.7143	0.7547	0.8688
No log	3.9121	356	0.7245	0.7	0.7245	0.8512
No log	3.9341	358	0.7500	0.7639	0.7500	0.8660
No log	3.9560	360	0.7862	0.7429	0.7862	0.8867
No log	3.9780	362	0.7751	0.7133	0.7751	0.8804
No log	4.0	364	0.7549	0.6809	0.7549	0.8689
No log	4.0220	366	0.7953	0.6901	0.7953	0.8918
No log	4.0440	368	0.8268	0.6809	0.8268	0.9093
No log	4.0659	370	0.7900	0.6763	0.7900	0.8888
No log	4.0879	372	0.7578	0.6714	0.7578	0.8705
No log	4.1099	374	0.7731	0.6763	0.7731	0.8793
No log	4.1319	376	0.7961	0.6809	0.7961	0.8923
No log	4.1538	378	0.7605	0.6812	0.7605	0.8721
No log	4.1758	380	0.7445	0.6812	0.7445	0.8628
No log	4.1978	382	0.7490	0.6763	0.7490	0.8655
No log	4.2198	384	0.7576	0.6812	0.7576	0.8704
No log	4.2418	386	0.7598	0.6667	0.7598	0.8717
No log	4.2637	388	0.7497	0.7299	0.7497	0.8658
No log	4.2857	390	0.7512	0.7206	0.7512	0.8667
No log	4.3077	392	0.7816	0.6716	0.7816	0.8841
No log	4.3297	394	0.7823	0.6815	0.7823	0.8845
No log	4.3516	396	0.7934	0.6815	0.7934	0.8907
No log	4.3736	398	0.8005	0.6462	0.8005	0.8947
No log	4.3956	400	0.7942	0.6970	0.7942	0.8912
No log	4.4176	402	0.8704	0.6565	0.8704	0.9329
No log	4.4396	404	1.0506	0.5455	1.0506	1.0250
No log	4.4615	406	1.0916	0.5185	1.0916	1.0448
No log	4.4835	408	0.9450	0.6212	0.9450	0.9721
No log	4.5055	410	0.7909	0.6767	0.7909	0.8893
No log	4.5275	412	0.7106	0.7164	0.7106	0.8430
No log	4.5495	414	0.6651	0.7391	0.6651	0.8155
No log	4.5714	416	0.6456	0.7407	0.6456	0.8035
No log	4.5934	418	0.6771	0.7246	0.6771	0.8229
No log	4.6154	420	0.8425	0.6569	0.8425	0.9179
No log	4.6374	422	0.8811	0.6370	0.8811	0.9387
No log	4.6593	424	0.7771	0.6906	0.7771	0.8815
No log	4.6813	426	0.6365	0.7606	0.6365	0.7978
No log	4.7033	428	0.6459	0.7746	0.6459	0.8037
No log	4.7253	430	0.7143	0.6917	0.7143	0.8452
No log	4.7473	432	0.7921	0.6462	0.7921	0.8900
No log	4.7692	434	0.8321	0.6462	0.8321	0.9122
No log	4.7912	436	0.8760	0.592	0.8760	0.9360
No log	4.8132	438	0.8575	0.6032	0.8575	0.9260
No log	4.8352	440	0.7909	0.6715	0.7909	0.8893
No log	4.8571	442	0.7348	0.7467	0.7348	0.8572
No log	4.8791	444	0.7039	0.7654	0.7039	0.8390
No log	4.9011	446	0.6325	0.7654	0.6325	0.7953
No log	4.9231	448	0.5317	0.8098	0.5317	0.7292
No log	4.9451	450	0.5471	0.8	0.5471	0.7397
No log	4.9670	452	0.7355	0.7075	0.7355	0.8576
No log	4.9890	454	0.7922	0.6950	0.7922	0.8900
No log	5.0110	456	0.7904	0.6812	0.7904	0.8891
No log	5.0330	458	0.6657	0.7338	0.6657	0.8159
No log	5.0549	460	0.6052	0.7639	0.6052	0.7779
No log	5.0769	462	0.6279	0.7361	0.6279	0.7924
No log	5.0989	464	0.6351	0.76	0.6351	0.7969
No log	5.1209	466	0.5808	0.7815	0.5808	0.7621
No log	5.1429	468	0.5428	0.7671	0.5428	0.7368
No log	5.1648	470	0.5466	0.7671	0.5466	0.7393
No log	5.1868	472	0.6302	0.7448	0.6302	0.7939
No log	5.2088	474	0.6847	0.7376	0.6847	0.8275
No log	5.2308	476	0.7382	0.6917	0.7382	0.8592
No log	5.2527	478	0.7823	0.6923	0.7823	0.8845
No log	5.2747	480	0.8247	0.6822	0.8247	0.9081
No log	5.2967	482	0.8247	0.6822	0.8247	0.9081
No log	5.3187	484	0.7972	0.6923	0.7972	0.8929
No log	5.3407	486	0.7663	0.6917	0.7663	0.8754
No log	5.3626	488	0.7533	0.6866	0.7533	0.8679
No log	5.3846	490	0.7433	0.7015	0.7433	0.8622
No log	5.4066	492	0.7444	0.7015	0.7444	0.8628
No log	5.4286	494	0.7290	0.6917	0.7290	0.8538
No log	5.4505	496	0.7287	0.6917	0.7287	0.8536
No log	5.4725	498	0.7279	0.7259	0.7279	0.8532
0.4425	5.4945	500	0.7236	0.7259	0.7236	0.8506
0.4425	5.5165	502	0.7316	0.7121	0.7316	0.8554
0.4425	5.5385	504	0.7730	0.6870	0.7730	0.8792
0.4425	5.5604	506	0.7511	0.7121	0.7511	0.8667
0.4425	5.5824	508	0.7341	0.6617	0.7341	0.8568
0.4425	5.6044	510	0.7459	0.6815	0.7459	0.8637

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1