ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6177
• Qwk: 0.5164
• Mse: 0.6177
• Rmse: 0.7860

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2857	2	4.2488	-0.0127	4.2488	2.0613
No log	0.5714	4	2.4912	0.0546	2.4912	1.5783
No log	0.8571	6	1.3266	0.0550	1.3266	1.1518
No log	1.1429	8	0.9356	0.0737	0.9356	0.9672
No log	1.4286	10	0.7748	0.1706	0.7748	0.8802
No log	1.7143	12	0.7372	0.2237	0.7372	0.8586
No log	2.0	14	0.8584	0.2110	0.8584	0.9265
No log	2.2857	16	1.2569	0.1804	1.2569	1.1211
No log	2.5714	18	0.9493	0.2575	0.9493	0.9743
No log	2.8571	20	0.7061	0.3098	0.7061	0.8403
No log	3.1429	22	0.7553	0.3425	0.7553	0.8691
No log	3.4286	24	0.7275	0.3815	0.7275	0.8529
No log	3.7143	26	1.2571	0.2932	1.2571	1.1212
No log	4.0	28	1.6683	0.1858	1.6683	1.2916
No log	4.2857	30	1.4653	0.2799	1.4653	1.2105
No log	4.5714	32	0.8843	0.4703	0.8843	0.9404
No log	4.8571	34	0.7768	0.4377	0.7768	0.8814
No log	5.1429	36	0.7353	0.4498	0.7353	0.8575
No log	5.4286	38	0.7321	0.4590	0.7321	0.8556
No log	5.7143	40	0.8282	0.3817	0.8282	0.9100
No log	6.0	42	0.9978	0.3399	0.9978	0.9989
No log	6.2857	44	0.9331	0.3504	0.9331	0.9660
No log	6.5714	46	0.7826	0.4610	0.7826	0.8846
No log	6.8571	48	0.8498	0.4096	0.8498	0.9218
No log	7.1429	50	0.8556	0.4206	0.8556	0.9250
No log	7.4286	52	0.7790	0.4015	0.7790	0.8826
No log	7.7143	54	0.7426	0.4540	0.7426	0.8617
No log	8.0	56	0.9116	0.3783	0.9116	0.9548
No log	8.2857	58	0.9320	0.3585	0.9320	0.9654
No log	8.5714	60	0.7527	0.4746	0.7527	0.8676
No log	8.8571	62	0.7142	0.4316	0.7142	0.8451
No log	9.1429	64	0.7762	0.4507	0.7762	0.8810
No log	9.4286	66	0.7053	0.4785	0.7053	0.8398
No log	9.7143	68	0.6820	0.4476	0.6820	0.8259
No log	10.0	70	0.8729	0.4317	0.8729	0.9343
No log	10.2857	72	0.9511	0.3982	0.9511	0.9752
No log	10.5714	74	0.7406	0.4316	0.7406	0.8606
No log	10.8571	76	0.6944	0.4393	0.6944	0.8333
No log	11.1429	78	0.6860	0.4710	0.6860	0.8283
No log	11.4286	80	0.6504	0.4512	0.6504	0.8065
No log	11.7143	82	0.6714	0.4605	0.6714	0.8194
No log	12.0	84	0.6745	0.4269	0.6745	0.8213
No log	12.2857	86	0.6137	0.3796	0.6137	0.7834
No log	12.5714	88	0.7460	0.4887	0.7460	0.8637
No log	12.8571	90	0.8752	0.4902	0.8752	0.9355
No log	13.1429	92	0.8088	0.5005	0.8088	0.8993
No log	13.4286	94	0.7243	0.4604	0.7243	0.8510
No log	13.7143	96	0.8198	0.5014	0.8198	0.9054
No log	14.0	98	0.8218	0.5025	0.8218	0.9066
No log	14.2857	100	0.6832	0.4663	0.6832	0.8266
No log	14.5714	102	0.6505	0.5271	0.6505	0.8065
No log	14.8571	104	0.7169	0.5333	0.7169	0.8467
No log	15.1429	106	0.8244	0.4730	0.8244	0.9080
No log	15.4286	108	0.7034	0.5450	0.7034	0.8387
No log	15.7143	110	0.6589	0.4961	0.6589	0.8117
No log	16.0	112	0.6785	0.5149	0.6785	0.8237
No log	16.2857	114	0.7156	0.5133	0.7156	0.8459
No log	16.5714	116	0.7477	0.5246	0.7477	0.8647
No log	16.8571	118	0.6944	0.5085	0.6944	0.8333
No log	17.1429	120	0.6755	0.5006	0.6755	0.8219
No log	17.4286	122	0.6327	0.4616	0.6327	0.7954
No log	17.7143	124	0.6288	0.4413	0.6288	0.7930
No log	18.0	126	0.6959	0.4792	0.6959	0.8342
No log	18.2857	128	0.7141	0.4782	0.7141	0.8451
No log	18.5714	130	0.6474	0.4906	0.6474	0.8046
No log	18.8571	132	0.6803	0.5048	0.6803	0.8248
No log	19.1429	134	0.8667	0.4593	0.8667	0.9309
No log	19.4286	136	0.8517	0.4601	0.8517	0.9229
No log	19.7143	138	0.7252	0.4988	0.7252	0.8516
No log	20.0	140	0.6702	0.5060	0.6702	0.8187
No log	20.2857	142	0.7886	0.4967	0.7886	0.8881
No log	20.5714	144	0.7783	0.5153	0.7783	0.8822
No log	20.8571	146	0.6800	0.5035	0.6800	0.8246
No log	21.1429	148	0.6552	0.5364	0.6552	0.8094
No log	21.4286	150	0.6487	0.4787	0.6487	0.8054
No log	21.7143	152	0.6552	0.4936	0.6552	0.8094
No log	22.0	154	0.6763	0.4787	0.6763	0.8224
No log	22.2857	156	0.7015	0.4869	0.7015	0.8375
No log	22.5714	158	0.6791	0.5138	0.6791	0.8241
No log	22.8571	160	0.6621	0.5240	0.6621	0.8137
No log	23.1429	162	0.6996	0.4727	0.6996	0.8364
No log	23.4286	164	0.7041	0.4737	0.7041	0.8391
No log	23.7143	166	0.6506	0.4593	0.6506	0.8066
No log	24.0	168	0.7060	0.4629	0.7060	0.8402
No log	24.2857	170	0.7969	0.4929	0.7969	0.8927
No log	24.5714	172	0.7479	0.4933	0.7479	0.8648
No log	24.8571	174	0.7128	0.4760	0.7128	0.8443
No log	25.1429	176	0.7671	0.4958	0.7671	0.8758
No log	25.4286	178	0.7393	0.4981	0.7393	0.8598
No log	25.7143	180	0.7297	0.5046	0.7297	0.8542
No log	26.0	182	0.7839	0.4865	0.7839	0.8854
No log	26.2857	184	0.7859	0.4753	0.7859	0.8865
No log	26.5714	186	0.7046	0.5231	0.7046	0.8394
No log	26.8571	188	0.6571	0.5210	0.6571	0.8106
No log	27.1429	190	0.6633	0.4571	0.6633	0.8144
No log	27.4286	192	0.6900	0.4997	0.6900	0.8306
No log	27.7143	194	0.6900	0.4763	0.6900	0.8307
No log	28.0	196	0.6827	0.4986	0.6827	0.8263
No log	28.2857	198	0.7008	0.5017	0.7008	0.8371
No log	28.5714	200	0.7199	0.5211	0.7199	0.8485
No log	28.8571	202	0.7190	0.5040	0.7190	0.8479
No log	29.1429	204	0.7446	0.4905	0.7446	0.8629
No log	29.4286	206	0.7613	0.4849	0.7613	0.8725
No log	29.7143	208	0.7952	0.4750	0.7952	0.8917
No log	30.0	210	0.7625	0.4914	0.7625	0.8732
No log	30.2857	212	0.7366	0.4890	0.7366	0.8582
No log	30.5714	214	0.7457	0.4755	0.7457	0.8635
No log	30.8571	216	0.7238	0.5265	0.7238	0.8508
No log	31.1429	218	0.6742	0.4920	0.6742	0.8211
No log	31.4286	220	0.6560	0.5200	0.6560	0.8099
No log	31.7143	222	0.6573	0.4873	0.6573	0.8108
No log	32.0	224	0.6568	0.4873	0.6568	0.8104
No log	32.2857	226	0.6407	0.5071	0.6407	0.8004
No log	32.5714	228	0.6331	0.4702	0.6331	0.7957
No log	32.8571	230	0.6383	0.4699	0.6383	0.7989
No log	33.1429	232	0.6563	0.4766	0.6563	0.8101
No log	33.4286	234	0.6561	0.5201	0.6561	0.8100
No log	33.7143	236	0.6752	0.5130	0.6752	0.8217
No log	34.0	238	0.7093	0.5230	0.7093	0.8422
No log	34.2857	240	0.7227	0.5309	0.7227	0.8501
No log	34.5714	242	0.6872	0.5315	0.6872	0.8289
No log	34.8571	244	0.6486	0.5119	0.6486	0.8054
No log	35.1429	246	0.6133	0.5069	0.6133	0.7831
No log	35.4286	248	0.5931	0.4960	0.5931	0.7701
No log	35.7143	250	0.5744	0.4977	0.5744	0.7579
No log	36.0	252	0.5720	0.5091	0.5720	0.7563
No log	36.2857	254	0.5743	0.5107	0.5743	0.7578
No log	36.5714	256	0.5692	0.4970	0.5692	0.7544
No log	36.8571	258	0.5797	0.5071	0.5797	0.7614
No log	37.1429	260	0.6027	0.5241	0.6027	0.7763
No log	37.4286	262	0.6385	0.4906	0.6385	0.7991
No log	37.7143	264	0.6124	0.5038	0.6124	0.7826
No log	38.0	266	0.5946	0.4946	0.5946	0.7711
No log	38.2857	268	0.6014	0.4948	0.6014	0.7755
No log	38.5714	270	0.6058	0.5073	0.6058	0.7783
No log	38.8571	272	0.6235	0.4981	0.6235	0.7896
No log	39.1429	274	0.6448	0.5460	0.6448	0.8030
No log	39.4286	276	0.6527	0.5178	0.6527	0.8079
No log	39.7143	278	0.6400	0.5460	0.6400	0.8000
No log	40.0	280	0.6334	0.5377	0.6334	0.7959
No log	40.2857	282	0.6301	0.5438	0.6301	0.7938
No log	40.5714	284	0.6094	0.5075	0.6094	0.7806
No log	40.8571	286	0.6054	0.4891	0.6054	0.7781
No log	41.1429	288	0.6015	0.4743	0.6015	0.7756
No log	41.4286	290	0.6110	0.5179	0.6110	0.7817
No log	41.7143	292	0.6335	0.4968	0.6335	0.7959
No log	42.0	294	0.6282	0.4890	0.6282	0.7926
No log	42.2857	296	0.5981	0.5135	0.5981	0.7734
No log	42.5714	298	0.5795	0.5265	0.5795	0.7612
No log	42.8571	300	0.5978	0.5446	0.5978	0.7732
No log	43.1429	302	0.6272	0.5878	0.6272	0.7920
No log	43.4286	304	0.6441	0.5794	0.6441	0.8025
No log	43.7143	306	0.6481	0.5982	0.6481	0.8050
No log	44.0	308	0.6550	0.5818	0.6550	0.8093
No log	44.2857	310	0.6613	0.5758	0.6613	0.8132
No log	44.5714	312	0.6548	0.5722	0.6548	0.8092
No log	44.8571	314	0.6441	0.5643	0.6441	0.8026
No log	45.1429	316	0.6301	0.5519	0.6301	0.7938
No log	45.4286	318	0.6182	0.5261	0.6182	0.7862
No log	45.7143	320	0.6108	0.4854	0.6108	0.7815
No log	46.0	322	0.6250	0.5237	0.6250	0.7906
No log	46.2857	324	0.6376	0.5237	0.6376	0.7985
No log	46.5714	326	0.6310	0.5237	0.6310	0.7943
No log	46.8571	328	0.6158	0.5222	0.6158	0.7847
No log	47.1429	330	0.6123	0.5219	0.6123	0.7825
No log	47.4286	332	0.6189	0.5190	0.6189	0.7867
No log	47.7143	334	0.6281	0.5399	0.6281	0.7925
No log	48.0	336	0.6138	0.5160	0.6138	0.7835
No log	48.2857	338	0.5980	0.5071	0.5980	0.7733
No log	48.5714	340	0.5929	0.5216	0.5929	0.7700
No log	48.8571	342	0.6049	0.5545	0.6049	0.7778
No log	49.1429	344	0.6139	0.5126	0.6139	0.7835
No log	49.4286	346	0.6038	0.5380	0.6038	0.7771
No log	49.7143	348	0.5871	0.5192	0.5871	0.7662
No log	50.0	350	0.5877	0.4878	0.5877	0.7666
No log	50.2857	352	0.5943	0.4848	0.5943	0.7709
No log	50.5714	354	0.5944	0.4903	0.5944	0.7710
No log	50.8571	356	0.5971	0.4978	0.5971	0.7727
No log	51.1429	358	0.6031	0.5141	0.6031	0.7766
No log	51.4286	360	0.6231	0.5337	0.6231	0.7894
No log	51.7143	362	0.6632	0.5151	0.6632	0.8144
No log	52.0	364	0.6958	0.5068	0.6958	0.8341
No log	52.2857	366	0.7378	0.4989	0.7378	0.8590
No log	52.5714	368	0.7497	0.4915	0.7497	0.8658
No log	52.8571	370	0.7104	0.4818	0.7104	0.8428
No log	53.1429	372	0.6758	0.4919	0.6758	0.8220
No log	53.4286	374	0.6454	0.5240	0.6454	0.8034
No log	53.7143	376	0.6372	0.5106	0.6372	0.7982
No log	54.0	378	0.6359	0.5257	0.6359	0.7974
No log	54.2857	380	0.6399	0.5296	0.6399	0.7999
No log	54.5714	382	0.6451	0.5035	0.6451	0.8032
No log	54.8571	384	0.6410	0.5081	0.6410	0.8006
No log	55.1429	386	0.6303	0.5138	0.6303	0.7939
No log	55.4286	388	0.6152	0.5146	0.6152	0.7843
No log	55.7143	390	0.6118	0.5118	0.6118	0.7822
No log	56.0	392	0.6154	0.5118	0.6154	0.7845
No log	56.2857	394	0.6251	0.5128	0.6251	0.7906
No log	56.5714	396	0.6362	0.5478	0.6362	0.7976
No log	56.8571	398	0.6469	0.5543	0.6469	0.8043
No log	57.1429	400	0.6555	0.5393	0.6555	0.8096
No log	57.4286	402	0.6491	0.5292	0.6491	0.8057
No log	57.7143	404	0.6421	0.5541	0.6421	0.8013
No log	58.0	406	0.6438	0.5498	0.6438	0.8023
No log	58.2857	408	0.6437	0.5224	0.6437	0.8023
No log	58.5714	410	0.6226	0.5383	0.6226	0.7890
No log	58.8571	412	0.6055	0.4482	0.6055	0.7781
No log	59.1429	414	0.6026	0.4482	0.6026	0.7763
No log	59.4286	416	0.6103	0.4276	0.6103	0.7812
No log	59.7143	418	0.6286	0.4594	0.6286	0.7929
No log	60.0	420	0.6354	0.4816	0.6354	0.7971
No log	60.2857	422	0.6316	0.4681	0.6316	0.7947
No log	60.5714	424	0.6406	0.4569	0.6406	0.8003
No log	60.8571	426	0.6470	0.5156	0.6470	0.8044
No log	61.1429	428	0.6624	0.5034	0.6624	0.8139
No log	61.4286	430	0.6701	0.5368	0.6701	0.8186
No log	61.7143	432	0.6577	0.5586	0.6577	0.8110
No log	62.0	434	0.6560	0.5641	0.6560	0.8099
No log	62.2857	436	0.6420	0.5622	0.6420	0.8012
No log	62.5714	438	0.6311	0.5247	0.6311	0.7944
No log	62.8571	440	0.6290	0.5267	0.6290	0.7931
No log	63.1429	442	0.6411	0.5165	0.6411	0.8007
No log	63.4286	444	0.6411	0.5081	0.6411	0.8007
No log	63.7143	446	0.6399	0.4777	0.6399	0.7999
No log	64.0	448	0.6410	0.4805	0.6410	0.8006
No log	64.2857	450	0.6378	0.4911	0.6378	0.7986
No log	64.5714	452	0.6258	0.4958	0.6258	0.7911
No log	64.8571	454	0.6061	0.5232	0.6061	0.7785
No log	65.1429	456	0.6015	0.5361	0.6015	0.7756
No log	65.4286	458	0.6071	0.5551	0.6071	0.7791
No log	65.7143	460	0.6263	0.5728	0.6263	0.7914
No log	66.0	462	0.6462	0.5569	0.6462	0.8039
No log	66.2857	464	0.6649	0.5297	0.6649	0.8154
No log	66.5714	466	0.6590	0.5297	0.6590	0.8118
No log	66.8571	468	0.6493	0.5297	0.6493	0.8058
No log	67.1429	470	0.6329	0.5351	0.6329	0.7955
No log	67.4286	472	0.6168	0.5577	0.6168	0.7853
No log	67.7143	474	0.6142	0.4998	0.6142	0.7837
No log	68.0	476	0.6321	0.5040	0.6321	0.7950
No log	68.2857	478	0.6436	0.4994	0.6436	0.8023
No log	68.5714	480	0.6376	0.5072	0.6376	0.7985
No log	68.8571	482	0.6209	0.4966	0.6209	0.7880
No log	69.1429	484	0.6097	0.4971	0.6097	0.7808
No log	69.4286	486	0.6033	0.4785	0.6033	0.7767
No log	69.7143	488	0.6016	0.5067	0.6016	0.7756
No log	70.0	490	0.6041	0.5005	0.6041	0.7773
No log	70.2857	492	0.6077	0.5005	0.6077	0.7795
No log	70.5714	494	0.6107	0.5005	0.6107	0.7815
No log	70.8571	496	0.6179	0.5306	0.6179	0.7860
No log	71.1429	498	0.6268	0.5461	0.6268	0.7917
0.2186	71.4286	500	0.6272	0.5461	0.6272	0.7920
0.2186	71.7143	502	0.6199	0.5461	0.6199	0.7873
0.2186	72.0	504	0.6129	0.5433	0.6129	0.7829
0.2186	72.2857	506	0.6091	0.5077	0.6091	0.7804
0.2186	72.5714	508	0.6128	0.4908	0.6128	0.7828
0.2186	72.8571	510	0.6177	0.5164	0.6177	0.7860

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1