ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8157
• Qwk: 0.5321
• Mse: 0.8157
• Rmse: 0.9032

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	4.0632	-0.0259	4.0632	2.0157
No log	0.0656	4	2.2440	0.0424	2.2440	1.4980
No log	0.0984	6	1.6468	0.0098	1.6468	1.2833
No log	0.1311	8	1.0728	-0.0117	1.0728	1.0357
No log	0.1639	10	0.7353	0.2110	0.7353	0.8575
No log	0.1967	12	0.7295	0.2681	0.7295	0.8541
No log	0.2295	14	0.7400	0.2454	0.7400	0.8602
No log	0.2623	16	0.7290	0.1703	0.7290	0.8538
No log	0.2951	18	0.7082	0.2376	0.7082	0.8415
No log	0.3279	20	1.0763	-0.0075	1.0763	1.0375
No log	0.3607	22	1.2712	0.0275	1.2712	1.1275
No log	0.3934	24	0.8683	0.0792	0.8683	0.9318
No log	0.4262	26	0.6695	0.3102	0.6695	0.8182
No log	0.4590	28	0.7081	0.2714	0.7081	0.8415
No log	0.4918	30	0.8235	0.2748	0.8235	0.9075
No log	0.5246	32	0.7927	0.2920	0.7927	0.8903
No log	0.5574	34	0.7911	0.3133	0.7911	0.8894
No log	0.5902	36	0.9561	0.2578	0.9561	0.9778
No log	0.6230	38	1.3759	0.2407	1.3759	1.1730
No log	0.6557	40	1.3184	0.2520	1.3184	1.1482
No log	0.6885	42	1.0192	0.2182	1.0192	1.0096
No log	0.7213	44	0.8129	0.2991	0.8129	0.9016
No log	0.7541	46	0.7371	0.3421	0.7371	0.8586
No log	0.7869	48	0.8116	0.3393	0.8116	0.9009
No log	0.8197	50	0.9802	0.2973	0.9802	0.9901
No log	0.8525	52	0.9648	0.3048	0.9648	0.9822
No log	0.8852	54	0.8183	0.3723	0.8183	0.9046
No log	0.9180	56	0.7544	0.4274	0.7544	0.8686
No log	0.9508	58	0.7283	0.4812	0.7283	0.8534
No log	0.9836	60	0.7126	0.4723	0.7126	0.8442
No log	1.0164	62	0.8557	0.3615	0.8557	0.9250
No log	1.0492	64	1.0318	0.3592	1.0318	1.0158
No log	1.0820	66	0.8553	0.4205	0.8553	0.9248
No log	1.1148	68	0.7891	0.4540	0.7891	0.8883
No log	1.1475	70	0.8566	0.3905	0.8566	0.9255
No log	1.1803	72	0.9833	0.3742	0.9833	0.9916
No log	1.2131	74	1.2037	0.3716	1.2037	1.0971
No log	1.2459	76	0.9700	0.4030	0.9700	0.9849
No log	1.2787	78	0.6914	0.5164	0.6914	0.8315
No log	1.3115	80	0.7531	0.3985	0.7531	0.8678
No log	1.3443	82	0.7544	0.4104	0.7544	0.8686
No log	1.3770	84	0.6755	0.4980	0.6755	0.8219
No log	1.4098	86	0.8741	0.3958	0.8741	0.9349
No log	1.4426	88	1.1452	0.3520	1.1452	1.0702
No log	1.4754	90	1.0980	0.3800	1.0980	1.0479
No log	1.5082	92	0.7781	0.4026	0.7781	0.8821
No log	1.5410	94	0.6441	0.3982	0.6441	0.8025
No log	1.5738	96	0.6339	0.4646	0.6339	0.7961
No log	1.6066	98	0.6593	0.4613	0.6593	0.8120
No log	1.6393	100	0.6708	0.4554	0.6708	0.8190
No log	1.6721	102	0.6757	0.4438	0.6757	0.8220
No log	1.7049	104	0.7113	0.4599	0.7113	0.8434
No log	1.7377	106	0.7460	0.4471	0.7460	0.8637
No log	1.7705	108	0.7865	0.4264	0.7865	0.8869
No log	1.8033	110	0.8399	0.4308	0.8399	0.9165
No log	1.8361	112	0.8124	0.4013	0.8124	0.9013
No log	1.8689	114	0.7624	0.4097	0.7624	0.8732
No log	1.9016	116	0.7513	0.3868	0.7513	0.8667
No log	1.9344	118	0.7632	0.4243	0.7632	0.8736
No log	1.9672	120	0.8165	0.4023	0.8165	0.9036
No log	2.0	122	0.7774	0.4036	0.7774	0.8817
No log	2.0328	124	0.8323	0.3884	0.8323	0.9123
No log	2.0656	126	0.9308	0.4297	0.9308	0.9648
No log	2.0984	128	0.8425	0.4108	0.8425	0.9179
No log	2.1311	130	0.7318	0.4332	0.7318	0.8554
No log	2.1639	132	0.6805	0.4517	0.6805	0.8249
No log	2.1967	134	0.6918	0.4702	0.6918	0.8317
No log	2.2295	136	0.6996	0.4564	0.6996	0.8364
No log	2.2623	138	0.7126	0.4642	0.7126	0.8441
No log	2.2951	140	0.7384	0.5310	0.7384	0.8593
No log	2.3279	142	0.7291	0.5130	0.7291	0.8538
No log	2.3607	144	0.7715	0.4479	0.7715	0.8784
No log	2.3934	146	0.8092	0.4614	0.8092	0.8995
No log	2.4262	148	0.8464	0.5045	0.8464	0.9200
No log	2.4590	150	0.9173	0.4437	0.9173	0.9577
No log	2.4918	152	0.9198	0.4452	0.9198	0.9590
No log	2.5246	154	0.8472	0.4787	0.8472	0.9204
No log	2.5574	156	1.0219	0.4570	1.0219	1.0109
No log	2.5902	158	0.9741	0.4314	0.9741	0.9870
No log	2.6230	160	0.7608	0.5178	0.7608	0.8722
No log	2.6557	162	0.7196	0.4933	0.7196	0.8483
No log	2.6885	164	0.7247	0.4822	0.7247	0.8513
No log	2.7213	166	0.7335	0.5651	0.7335	0.8565
No log	2.7541	168	0.7826	0.5703	0.7826	0.8846
No log	2.7869	170	0.8408	0.5642	0.8408	0.9170
No log	2.8197	172	0.8902	0.5257	0.8902	0.9435
No log	2.8525	174	0.9306	0.5433	0.9306	0.9647
No log	2.8852	176	1.0177	0.4910	1.0177	1.0088
No log	2.9180	178	1.0368	0.4888	1.0368	1.0182
No log	2.9508	180	1.0714	0.4745	1.0714	1.0351
No log	2.9836	182	1.0516	0.4727	1.0516	1.0255
No log	3.0164	184	1.0405	0.4696	1.0405	1.0200
No log	3.0492	186	0.9341	0.5087	0.9341	0.9665
No log	3.0820	188	0.9003	0.5245	0.9003	0.9488
No log	3.1148	190	0.9026	0.5344	0.9026	0.9501
No log	3.1475	192	0.9109	0.5188	0.9109	0.9544
No log	3.1803	194	0.8947	0.5431	0.8947	0.9459
No log	3.2131	196	0.9768	0.4725	0.9768	0.9883
No log	3.2459	198	1.0334	0.4623	1.0334	1.0165
No log	3.2787	200	1.0637	0.4458	1.0637	1.0313
No log	3.3115	202	1.1031	0.4146	1.1031	1.0503
No log	3.3443	204	1.0174	0.4291	1.0174	1.0087
No log	3.3770	206	0.9349	0.4587	0.9349	0.9669
No log	3.4098	208	0.8763	0.4471	0.8763	0.9361
No log	3.4426	210	0.8591	0.4521	0.8591	0.9269
No log	3.4754	212	1.0067	0.4062	1.0067	1.0033
No log	3.5082	214	0.9861	0.3941	0.9861	0.9930
No log	3.5410	216	0.8428	0.4493	0.8428	0.9180
No log	3.5738	218	0.7997	0.5008	0.7997	0.8943
No log	3.6066	220	0.8625	0.4887	0.8625	0.9287
No log	3.6393	222	0.9096	0.4840	0.9096	0.9537
No log	3.6721	224	1.0327	0.4169	1.0327	1.0162
No log	3.7049	226	1.1022	0.4203	1.1022	1.0499
No log	3.7377	228	1.0774	0.4321	1.0774	1.0380
No log	3.7705	230	1.0549	0.4380	1.0549	1.0271
No log	3.8033	232	1.0050	0.4128	1.0050	1.0025
No log	3.8361	234	0.9852	0.4158	0.9852	0.9926
No log	3.8689	236	0.9432	0.4409	0.9432	0.9712
No log	3.9016	238	0.9373	0.4654	0.9373	0.9681
No log	3.9344	240	0.9680	0.4150	0.9680	0.9838
No log	3.9672	242	0.9328	0.4704	0.9328	0.9658
No log	4.0	244	0.8817	0.4506	0.8817	0.9390
No log	4.0328	246	0.8356	0.4565	0.8356	0.9141
No log	4.0656	248	0.7986	0.4524	0.7986	0.8936
No log	4.0984	250	0.7945	0.4932	0.7945	0.8914
No log	4.1311	252	0.8476	0.4698	0.8476	0.9207
No log	4.1639	254	0.9233	0.4012	0.9233	0.9609
No log	4.1967	256	0.9678	0.4469	0.9678	0.9838
No log	4.2295	258	0.9770	0.4676	0.9770	0.9885
No log	4.2623	260	0.9823	0.4697	0.9823	0.9911
No log	4.2951	262	0.9591	0.4765	0.9591	0.9793
No log	4.3279	264	0.9359	0.4613	0.9359	0.9674
No log	4.3607	266	0.9785	0.3851	0.9785	0.9892
No log	4.3934	268	1.0436	0.3929	1.0436	1.0216
No log	4.4262	270	0.9512	0.3720	0.9512	0.9753
No log	4.4590	272	0.8185	0.4728	0.8185	0.9047
No log	4.4918	274	0.8046	0.4926	0.8046	0.8970
No log	4.5246	276	0.8161	0.4593	0.8161	0.9034
No log	4.5574	278	0.8209	0.4870	0.8209	0.9060
No log	4.5902	280	0.8868	0.5066	0.8868	0.9417
No log	4.6230	282	0.9970	0.3714	0.9970	0.9985
No log	4.6557	284	1.0477	0.3825	1.0477	1.0236
No log	4.6885	286	1.0359	0.4569	1.0359	1.0178
No log	4.7213	288	1.0292	0.4462	1.0292	1.0145
No log	4.7541	290	1.0041	0.4461	1.0041	1.0020
No log	4.7869	292	0.9801	0.4121	0.9801	0.9900
No log	4.8197	294	0.9109	0.4475	0.9109	0.9544
No log	4.8525	296	0.8209	0.4817	0.8209	0.9061
No log	4.8852	298	0.7677	0.4592	0.7677	0.8762
No log	4.9180	300	0.7770	0.4496	0.7770	0.8815
No log	4.9508	302	0.7587	0.4540	0.7587	0.8710
No log	4.9836	304	0.7657	0.4755	0.7657	0.8751
No log	5.0164	306	0.7936	0.4267	0.7936	0.8909
No log	5.0492	308	0.7932	0.4505	0.7932	0.8906
No log	5.0820	310	0.8079	0.4351	0.8079	0.8988
No log	5.1148	312	0.8147	0.4351	0.8147	0.9026
No log	5.1475	314	0.8120	0.4687	0.8120	0.9011
No log	5.1803	316	0.8821	0.3972	0.8821	0.9392
No log	5.2131	318	0.9179	0.3752	0.9179	0.9581
No log	5.2459	320	0.9028	0.4104	0.9028	0.9501
No log	5.2787	322	0.8556	0.4518	0.8556	0.9250
No log	5.3115	324	0.8348	0.4666	0.8348	0.9137
No log	5.3443	326	0.8170	0.4408	0.8170	0.9039
No log	5.3770	328	0.7840	0.4294	0.7840	0.8854
No log	5.4098	330	0.7618	0.4661	0.7618	0.8728
No log	5.4426	332	0.7401	0.4878	0.7401	0.8603
No log	5.4754	334	0.7294	0.4957	0.7294	0.8540
No log	5.5082	336	0.7354	0.4708	0.7354	0.8575
No log	5.5410	338	0.7513	0.4897	0.7513	0.8668
No log	5.5738	340	0.7617	0.4863	0.7617	0.8727
No log	5.6066	342	0.7804	0.5112	0.7804	0.8834
No log	5.6393	344	0.7909	0.5405	0.7909	0.8893
No log	5.6721	346	0.7911	0.5335	0.7911	0.8895
No log	5.7049	348	0.7881	0.5224	0.7881	0.8878
No log	5.7377	350	0.7953	0.5296	0.7953	0.8918
No log	5.7705	352	0.7997	0.4928	0.7997	0.8943
No log	5.8033	354	0.8003	0.4928	0.8003	0.8946
No log	5.8361	356	0.8089	0.5069	0.8089	0.8994
No log	5.8689	358	0.7866	0.5034	0.7866	0.8869
No log	5.9016	360	0.7909	0.5106	0.7909	0.8893
No log	5.9344	362	0.7998	0.5457	0.7998	0.8943
No log	5.9672	364	0.7919	0.5072	0.7919	0.8899
No log	6.0	366	0.8044	0.4979	0.8044	0.8969
No log	6.0328	368	0.8104	0.5048	0.8104	0.9002
No log	6.0656	370	0.8151	0.4979	0.8151	0.9028
No log	6.0984	372	0.8264	0.4926	0.8264	0.9091
No log	6.1311	374	0.8202	0.4942	0.8202	0.9057
No log	6.1639	376	0.8232	0.5151	0.8232	0.9073
No log	6.1967	378	0.8213	0.4850	0.8213	0.9063
No log	6.2295	380	0.8418	0.4892	0.8418	0.9175
No log	6.2623	382	0.8560	0.4724	0.8560	0.9252
No log	6.2951	384	0.8564	0.4706	0.8564	0.9254
No log	6.3279	386	0.8220	0.4864	0.8220	0.9066
No log	6.3607	388	0.8096	0.4864	0.8096	0.8998
No log	6.3934	390	0.8303	0.4864	0.8303	0.9112
No log	6.4262	392	0.8048	0.4518	0.8048	0.8971
No log	6.4590	394	0.8018	0.4994	0.8018	0.8954
No log	6.4918	396	0.8261	0.4949	0.8261	0.9089
No log	6.5246	398	0.8330	0.5020	0.8330	0.9127
No log	6.5574	400	0.8391	0.4530	0.8391	0.9160
No log	6.5902	402	0.8725	0.4585	0.8725	0.9341
No log	6.6230	404	0.8817	0.4618	0.8817	0.9390
No log	6.6557	406	0.8456	0.4585	0.8456	0.9195
No log	6.6885	408	0.8086	0.4916	0.8086	0.8992
No log	6.7213	410	0.8098	0.5149	0.8098	0.8999
No log	6.7541	412	0.8119	0.4916	0.8119	0.9010
No log	6.7869	414	0.8221	0.4806	0.8221	0.9067
No log	6.8197	416	0.8143	0.4724	0.8143	0.9024
No log	6.8525	418	0.8021	0.4707	0.8021	0.8956
No log	6.8852	420	0.7885	0.4707	0.7885	0.8880
No log	6.9180	422	0.7813	0.4933	0.7813	0.8839
No log	6.9508	424	0.7773	0.5052	0.7773	0.8817
No log	6.9836	426	0.7753	0.5174	0.7753	0.8805
No log	7.0164	428	0.7820	0.5120	0.7820	0.8843
No log	7.0492	430	0.7971	0.5226	0.7971	0.8928
No log	7.0820	432	0.8202	0.4826	0.8202	0.9057
No log	7.1148	434	0.8422	0.4882	0.8422	0.9177
No log	7.1475	436	0.8403	0.4826	0.8403	0.9167
No log	7.1803	438	0.8301	0.5173	0.8301	0.9111
No log	7.2131	440	0.8313	0.5037	0.8313	0.9118
No log	7.2459	442	0.8137	0.5173	0.8137	0.9021
No log	7.2787	444	0.7946	0.5092	0.7946	0.8914
No log	7.3115	446	0.7840	0.5206	0.7840	0.8855
No log	7.3443	448	0.7838	0.5092	0.7838	0.8853
No log	7.3770	450	0.7977	0.5013	0.7977	0.8932
No log	7.4098	452	0.8102	0.4918	0.8102	0.9001
No log	7.4426	454	0.8154	0.4841	0.8154	0.9030
No log	7.4754	456	0.8204	0.4841	0.8204	0.9057
No log	7.5082	458	0.8146	0.4973	0.8146	0.9026
No log	7.5410	460	0.8189	0.5043	0.8189	0.9049
No log	7.5738	462	0.8224	0.4837	0.8224	0.9069
No log	7.6066	464	0.8388	0.4820	0.8388	0.9159
No log	7.6393	466	0.8395	0.4890	0.8395	0.9162
No log	7.6721	468	0.8327	0.4939	0.8327	0.9125
No log	7.7049	470	0.8271	0.5070	0.8271	0.9094
No log	7.7377	472	0.8186	0.4853	0.8186	0.9048
No log	7.7705	474	0.8043	0.4853	0.8043	0.8968
No log	7.8033	476	0.7958	0.4966	0.7958	0.8921
No log	7.8361	478	0.7810	0.4965	0.7810	0.8838
No log	7.8689	480	0.7836	0.4524	0.7836	0.8852
No log	7.9016	482	0.7898	0.4524	0.7898	0.8887
No log	7.9344	484	0.7868	0.4536	0.7868	0.8870
No log	7.9672	486	0.7916	0.4514	0.7916	0.8897
No log	8.0	488	0.7912	0.4514	0.7912	0.8895
No log	8.0328	490	0.7794	0.4514	0.7794	0.8828
No log	8.0656	492	0.7730	0.4514	0.7730	0.8792
No log	8.0984	494	0.7686	0.4424	0.7686	0.8767
No log	8.1311	496	0.7717	0.4932	0.7717	0.8785
No log	8.1639	498	0.7764	0.4817	0.7764	0.8811
0.4018	8.1967	500	0.7757	0.4963	0.7757	0.8808
0.4018	8.2295	502	0.7724	0.4823	0.7724	0.8789
0.4018	8.2623	504	0.7756	0.4817	0.7756	0.8807
0.4018	8.2951	506	0.7840	0.4750	0.7840	0.8854
0.4018	8.3279	508	0.7977	0.4764	0.7977	0.8931
0.4018	8.3607	510	0.8109	0.4688	0.8109	0.9005
0.4018	8.3934	512	0.8169	0.4900	0.8169	0.9038
0.4018	8.4262	514	0.8289	0.4866	0.8289	0.9104
0.4018	8.4590	516	0.8424	0.4866	0.8424	0.9178
0.4018	8.4918	518	0.8588	0.4873	0.8588	0.9267
0.4018	8.5246	520	0.8678	0.4873	0.8678	0.9316
0.4018	8.5574	522	0.8688	0.4603	0.8688	0.9321
0.4018	8.5902	524	0.8647	0.4590	0.8647	0.9299
0.4018	8.6230	526	0.8662	0.4918	0.8662	0.9307
0.4018	8.6557	528	0.8631	0.4964	0.8631	0.9291
0.4018	8.6885	530	0.8562	0.4964	0.8562	0.9253
0.4018	8.7213	532	0.8489	0.4896	0.8489	0.9213
0.4018	8.7541	534	0.8452	0.4952	0.8452	0.9193
0.4018	8.7869	536	0.8444	0.5050	0.8444	0.9189
0.4018	8.8197	538	0.8387	0.4709	0.8387	0.9158
0.4018	8.8525	540	0.8206	0.4709	0.8206	0.9059
0.4018	8.8852	542	0.7972	0.4847	0.7972	0.8929
0.4018	8.9180	544	0.7823	0.5085	0.7823	0.8845
0.4018	8.9508	546	0.7739	0.5130	0.7739	0.8797
0.4018	8.9836	548	0.7701	0.5403	0.7701	0.8775
0.4018	9.0164	550	0.7662	0.5447	0.7662	0.8753
0.4018	9.0492	552	0.7652	0.5277	0.7652	0.8748
0.4018	9.0820	554	0.7683	0.5277	0.7683	0.8765
0.4018	9.1148	556	0.7746	0.5061	0.7746	0.8801
0.4018	9.1475	558	0.7778	0.5061	0.7778	0.8819
0.4018	9.1803	560	0.7840	0.5124	0.7840	0.8855
0.4018	9.2131	562	0.7890	0.5206	0.7890	0.8883
0.4018	9.2459	564	0.7895	0.5087	0.7895	0.8885
0.4018	9.2787	566	0.7906	0.5110	0.7906	0.8892
0.4018	9.3115	568	0.7933	0.5038	0.7933	0.8907
0.4018	9.3443	570	0.7981	0.5221	0.7981	0.8934
0.4018	9.3770	572	0.8034	0.5279	0.8034	0.8963
0.4018	9.4098	574	0.8083	0.5279	0.8083	0.8991
0.4018	9.4426	576	0.8119	0.5183	0.8119	0.9010
0.4018	9.4754	578	0.8143	0.5183	0.8143	0.9024
0.4018	9.5082	580	0.8164	0.5183	0.8164	0.9035
0.4018	9.5410	582	0.8174	0.5402	0.8174	0.9041
0.4018	9.5738	584	0.8175	0.5268	0.8175	0.9041
0.4018	9.6066	586	0.8184	0.5253	0.8184	0.9046
0.4018	9.6393	588	0.8209	0.5118	0.8209	0.9060
0.4018	9.6721	590	0.8248	0.5050	0.8248	0.9082
0.4018	9.7049	592	0.8258	0.5050	0.8258	0.9087
0.4018	9.7377	594	0.8243	0.5050	0.8243	0.9079
0.4018	9.7705	596	0.8215	0.5118	0.8215	0.9064
0.4018	9.8033	598	0.8200	0.5186	0.8200	0.9056
0.4018	9.8361	600	0.8194	0.5253	0.8194	0.9052
0.4018	9.8689	602	0.8186	0.5253	0.8186	0.9048
0.4018	9.9016	604	0.8176	0.5253	0.8176	0.9042
0.4018	9.9344	606	0.8166	0.5321	0.8166	0.9037
0.4018	9.9672	608	0.8160	0.5321	0.8160	0.9034
0.4018	10.0	610	0.8157	0.5321	0.8157	0.9032

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1