ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k1_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.4575
• Qwk: 0.6443
• Mse: 0.4575
• Rmse: 0.6764

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	4.1723	0.0217	4.1723	2.0426
No log	0.6667	4	2.2933	-0.0593	2.2933	1.5144
No log	1.0	6	1.2273	0.1808	1.2273	1.1078
No log	1.3333	8	0.7863	0.2740	0.7863	0.8867
No log	1.6667	10	0.6293	0.2809	0.6293	0.7933
No log	2.0	12	0.8363	0.3579	0.8363	0.9145
No log	2.3333	14	0.9346	0.3689	0.9346	0.9667
No log	2.6667	16	1.0042	0.3450	1.0042	1.0021
No log	3.0	18	0.8546	0.3923	0.8546	0.9245
No log	3.3333	20	0.5920	0.5840	0.5920	0.7694
No log	3.6667	22	1.2980	0.2464	1.2980	1.1393
No log	4.0	24	1.6790	0.1702	1.6790	1.2958
No log	4.3333	26	0.9306	0.36	0.9306	0.9647
No log	4.6667	28	0.5781	0.4839	0.5781	0.7603
No log	5.0	30	0.6936	0.4536	0.6936	0.8328
No log	5.3333	32	0.6323	0.4719	0.6323	0.7952
No log	5.6667	34	0.5508	0.5379	0.5508	0.7421
No log	6.0	36	0.5371	0.4262	0.5371	0.7329
No log	6.3333	38	0.5027	0.6046	0.5027	0.7090
No log	6.6667	40	0.5459	0.5639	0.5459	0.7388
No log	7.0	42	1.0011	0.4297	1.0011	1.0006
No log	7.3333	44	1.0273	0.4613	1.0273	1.0135
No log	7.6667	46	0.5794	0.5870	0.5794	0.7612
No log	8.0	48	0.5756	0.5528	0.5756	0.7587
No log	8.3333	50	0.8444	0.3728	0.8444	0.9189
No log	8.6667	52	0.7115	0.4818	0.7115	0.8435
No log	9.0	54	0.4702	0.6292	0.4702	0.6857
No log	9.3333	56	0.6579	0.5562	0.6579	0.8111
No log	9.6667	58	0.8578	0.5015	0.8578	0.9262
No log	10.0	60	0.8489	0.5015	0.8489	0.9213
No log	10.3333	62	0.6552	0.5139	0.6552	0.8094
No log	10.6667	64	0.4395	0.6171	0.4395	0.6629
No log	11.0	66	0.4561	0.6491	0.4561	0.6753
No log	11.3333	68	0.4561	0.6252	0.4561	0.6754
No log	11.6667	70	0.6527	0.5481	0.6527	0.8079
No log	12.0	72	0.7017	0.5778	0.7017	0.8377
No log	12.3333	74	0.5331	0.5748	0.5331	0.7302
No log	12.6667	76	0.4833	0.5758	0.4833	0.6952
No log	13.0	78	0.4734	0.6371	0.4734	0.6880
No log	13.3333	80	0.4650	0.6359	0.4650	0.6819
No log	13.6667	82	0.4601	0.6443	0.4601	0.6783
No log	14.0	84	0.4675	0.6132	0.4675	0.6837
No log	14.3333	86	0.5835	0.5730	0.5835	0.7639
No log	14.6667	88	0.6602	0.5481	0.6602	0.8126
No log	15.0	90	0.5497	0.5730	0.5497	0.7414
No log	15.3333	92	0.4610	0.6201	0.4610	0.6789
No log	15.6667	94	0.4531	0.5784	0.4531	0.6731
No log	16.0	96	0.4599	0.5784	0.4599	0.6781
No log	16.3333	98	0.4669	0.5926	0.4669	0.6833
No log	16.6667	100	0.4946	0.5362	0.4946	0.7032
No log	17.0	102	0.6172	0.5747	0.6172	0.7856
No log	17.3333	104	0.8964	0.4385	0.8964	0.9468
No log	17.6667	106	0.8756	0.3869	0.8756	0.9358
No log	18.0	108	0.9110	0.3869	0.9110	0.9545
No log	18.3333	110	0.7707	0.4232	0.7707	0.8779
No log	18.6667	112	0.5565	0.5237	0.5565	0.7460
No log	19.0	114	0.4590	0.6125	0.4590	0.6775
No log	19.3333	116	0.4548	0.5765	0.4548	0.6744
No log	19.6667	118	0.4615	0.6228	0.4615	0.6793
No log	20.0	120	0.7143	0.5449	0.7143	0.8451
No log	20.3333	122	0.9774	0.4460	0.9774	0.9886
No log	20.6667	124	0.9248	0.4533	0.9248	0.9617
No log	21.0	126	0.7537	0.4364	0.7537	0.8681
No log	21.3333	128	0.6578	0.4366	0.6578	0.8110
No log	21.6667	130	0.5820	0.6006	0.5820	0.7629
No log	22.0	132	0.5402	0.6392	0.5402	0.7350
No log	22.3333	134	0.4550	0.6434	0.4550	0.6745
No log	22.6667	136	0.4459	0.6609	0.4459	0.6677
No log	23.0	138	0.4239	0.6371	0.4239	0.6511
No log	23.3333	140	0.4244	0.6566	0.4244	0.6515
No log	23.6667	142	0.4371	0.6129	0.4371	0.6611
No log	24.0	144	0.4974	0.5909	0.4974	0.7053
No log	24.3333	146	0.6500	0.4556	0.6500	0.8062
No log	24.6667	148	0.7645	0.3870	0.7645	0.8743
No log	25.0	150	0.7897	0.3870	0.7897	0.8886
No log	25.3333	152	0.8113	0.3804	0.8113	0.9007
No log	25.6667	154	0.7180	0.4705	0.7180	0.8473
No log	26.0	156	0.5038	0.6122	0.5038	0.7098
No log	26.3333	158	0.4224	0.6724	0.4224	0.6500
No log	26.6667	160	0.4165	0.6830	0.4165	0.6454
No log	27.0	162	0.4377	0.6616	0.4377	0.6616
No log	27.3333	164	0.4311	0.6443	0.4311	0.6566
No log	27.6667	166	0.4593	0.6434	0.4593	0.6777
No log	28.0	168	0.4789	0.6147	0.4789	0.6920
No log	28.3333	170	0.5548	0.5944	0.5548	0.7448
No log	28.6667	172	0.5816	0.5966	0.5816	0.7627
No log	29.0	174	0.5305	0.5568	0.5305	0.7283
No log	29.3333	176	0.4933	0.5801	0.4933	0.7023
No log	29.6667	178	0.4741	0.5995	0.4741	0.6886
No log	30.0	180	0.4711	0.5995	0.4711	0.6863
No log	30.3333	182	0.4862	0.5980	0.4862	0.6973
No log	30.6667	184	0.4701	0.5980	0.4701	0.6856
No log	31.0	186	0.5041	0.5998	0.5041	0.7100
No log	31.3333	188	0.5917	0.6	0.5917	0.7692
No log	31.6667	190	0.5825	0.5815	0.5825	0.7632
No log	32.0	192	0.5177	0.5577	0.5177	0.7195
No log	32.3333	194	0.5161	0.5671	0.5161	0.7184
No log	32.6667	196	0.5218	0.5437	0.5218	0.7224
No log	33.0	198	0.5096	0.5671	0.5096	0.7139
No log	33.3333	200	0.4709	0.6303	0.4709	0.6862
No log	33.6667	202	0.4796	0.6187	0.4796	0.6925
No log	34.0	204	0.5658	0.5803	0.5658	0.7522
No log	34.3333	206	0.6244	0.5747	0.6244	0.7902
No log	34.6667	208	0.5689	0.5497	0.5689	0.7542
No log	35.0	210	0.5225	0.5601	0.5225	0.7229
No log	35.3333	212	0.5746	0.5362	0.5746	0.7581
No log	35.6667	214	0.6502	0.5147	0.6502	0.8063
No log	36.0	216	0.7533	0.5017	0.7533	0.8679
No log	36.3333	218	0.7557	0.5017	0.7557	0.8693
No log	36.6667	220	0.6949	0.5098	0.6949	0.8336
No log	37.0	222	0.5727	0.5712	0.5727	0.7568
No log	37.3333	224	0.5225	0.5617	0.5225	0.7228
No log	37.6667	226	0.5262	0.6122	0.5262	0.7254
No log	38.0	228	0.5794	0.5722	0.5794	0.7612
No log	38.3333	230	0.5567	0.5858	0.5567	0.7461
No log	38.6667	232	0.5122	0.6495	0.5122	0.7157
No log	39.0	234	0.4811	0.6032	0.4811	0.6936
No log	39.3333	236	0.4757	0.6032	0.4757	0.6897
No log	39.6667	238	0.4911	0.5816	0.4911	0.7008
No log	40.0	240	0.5376	0.6109	0.5376	0.7332
No log	40.3333	242	0.6482	0.5725	0.6482	0.8051
No log	40.6667	244	0.6999	0.5354	0.6999	0.8366
No log	41.0	246	0.6793	0.5310	0.6793	0.8242
No log	41.3333	248	0.6022	0.4801	0.6022	0.7760
No log	41.6667	250	0.5369	0.5538	0.5369	0.7328
No log	42.0	252	0.4770	0.6228	0.4770	0.6906
No log	42.3333	254	0.4505	0.6241	0.4505	0.6712
No log	42.6667	256	0.4371	0.6439	0.4371	0.6611
No log	43.0	258	0.4286	0.6567	0.4286	0.6546
No log	43.3333	260	0.4326	0.6370	0.4326	0.6577
No log	43.6667	262	0.4359	0.6383	0.4359	0.6602
No log	44.0	264	0.4256	0.6357	0.4256	0.6524
No log	44.3333	266	0.4495	0.6408	0.4495	0.6705
No log	44.6667	268	0.5321	0.5410	0.5321	0.7294
No log	45.0	270	0.5895	0.5026	0.5895	0.7678
No log	45.3333	272	0.6275	0.4474	0.6275	0.7921
No log	45.6667	274	0.6396	0.4474	0.6396	0.7997
No log	46.0	276	0.6108	0.4568	0.6108	0.7815
No log	46.3333	278	0.5807	0.4272	0.5807	0.7620
No log	46.6667	280	0.5670	0.4272	0.5670	0.7530
No log	47.0	282	0.5601	0.4979	0.5601	0.7484
No log	47.3333	284	0.5907	0.4665	0.5907	0.7686
No log	47.6667	286	0.5820	0.4819	0.5820	0.7629
No log	48.0	288	0.5453	0.4898	0.5453	0.7384
No log	48.3333	290	0.5131	0.5744	0.5131	0.7163
No log	48.6667	292	0.4771	0.5632	0.4771	0.6907
No log	49.0	294	0.4539	0.5625	0.4539	0.6738
No log	49.3333	296	0.4453	0.6242	0.4453	0.6673
No log	49.6667	298	0.4598	0.5703	0.4598	0.6781
No log	50.0	300	0.5090	0.5324	0.5090	0.7135
No log	50.3333	302	0.5306	0.5553	0.5306	0.7284
No log	50.6667	304	0.5022	0.5741	0.5022	0.7086
No log	51.0	306	0.4544	0.5846	0.4544	0.6741
No log	51.3333	308	0.4489	0.5846	0.4489	0.6700
No log	51.6667	310	0.4752	0.5937	0.4752	0.6894
No log	52.0	312	0.5473	0.5858	0.5473	0.7398
No log	52.3333	314	0.5669	0.5342	0.5669	0.7529
No log	52.6667	316	0.5544	0.5726	0.5544	0.7446
No log	53.0	318	0.5659	0.5639	0.5659	0.7523
No log	53.3333	320	0.5592	0.5673	0.5592	0.7478
No log	53.6667	322	0.5150	0.5723	0.5150	0.7176
No log	54.0	324	0.4907	0.6032	0.4907	0.7005
No log	54.3333	326	0.4862	0.6426	0.4862	0.6973
No log	54.6667	328	0.4844	0.6214	0.4844	0.6960
No log	55.0	330	0.5061	0.5593	0.5061	0.7114
No log	55.3333	332	0.5478	0.5345	0.5478	0.7401
No log	55.6667	334	0.6170	0.4887	0.6170	0.7855
No log	56.0	336	0.7082	0.5031	0.7082	0.8416
No log	56.3333	338	0.7092	0.5031	0.7092	0.8422
No log	56.6667	340	0.6382	0.5443	0.6382	0.7989
No log	57.0	342	0.5341	0.5975	0.5341	0.7308
No log	57.3333	344	0.4816	0.5912	0.4816	0.6940
No log	57.6667	346	0.4696	0.6530	0.4696	0.6853
No log	58.0	348	0.4795	0.6032	0.4795	0.6925
No log	58.3333	350	0.5104	0.5989	0.5104	0.7144
No log	58.6667	352	0.5817	0.5609	0.5817	0.7627
No log	59.0	354	0.6764	0.52	0.6764	0.8225
No log	59.3333	356	0.7706	0.4033	0.7706	0.8778
No log	59.6667	358	0.7780	0.3945	0.7780	0.8820
No log	60.0	360	0.7563	0.3909	0.7563	0.8697
No log	60.3333	362	0.6915	0.4484	0.6915	0.8316
No log	60.6667	364	0.6321	0.5107	0.6321	0.7950
No log	61.0	366	0.5898	0.5149	0.5898	0.7680
No log	61.3333	368	0.5745	0.5237	0.5745	0.7579
No log	61.6667	370	0.5626	0.5291	0.5626	0.7501
No log	62.0	372	0.5546	0.5931	0.5546	0.7447
No log	62.3333	374	0.5014	0.6135	0.5014	0.7081
No log	62.6667	376	0.4415	0.6639	0.4415	0.6645
No log	63.0	378	0.4271	0.6267	0.4271	0.6535
No log	63.3333	380	0.4351	0.6118	0.4351	0.6596
No log	63.6667	382	0.4357	0.6197	0.4357	0.6600
No log	64.0	384	0.4387	0.6267	0.4387	0.6623
No log	64.3333	386	0.4570	0.6254	0.4570	0.6760
No log	64.6667	388	0.4864	0.6606	0.4864	0.6974
No log	65.0	390	0.5235	0.6586	0.5235	0.7235
No log	65.3333	392	0.5253	0.6248	0.5253	0.7247
No log	65.6667	394	0.5140	0.6685	0.5140	0.7169
No log	66.0	396	0.5118	0.6609	0.5118	0.7154
No log	66.3333	398	0.5163	0.6325	0.5163	0.7185
No log	66.6667	400	0.5379	0.6068	0.5379	0.7334
No log	67.0	402	0.5402	0.5726	0.5402	0.7350
No log	67.3333	404	0.5330	0.5817	0.5330	0.7301
No log	67.6667	406	0.5163	0.5617	0.5163	0.7185
No log	68.0	408	0.5188	0.6333	0.5188	0.7202
No log	68.3333	410	0.5247	0.6258	0.5247	0.7244
No log	68.6667	412	0.5312	0.6258	0.5312	0.7288
No log	69.0	414	0.5366	0.5763	0.5366	0.7325
No log	69.3333	416	0.5333	0.5705	0.5333	0.7303
No log	69.6667	418	0.5326	0.5403	0.5326	0.7298
No log	70.0	420	0.5270	0.5817	0.5270	0.7260
No log	70.3333	422	0.5260	0.5617	0.5260	0.7253
No log	70.6667	424	0.5304	0.5617	0.5304	0.7283
No log	71.0	426	0.5427	0.5442	0.5427	0.7367
No log	71.3333	428	0.5775	0.5576	0.5775	0.7599
No log	71.6667	430	0.6255	0.5678	0.6255	0.7909
No log	72.0	432	0.6486	0.5481	0.6486	0.8054
No log	72.3333	434	0.6409	0.5481	0.6409	0.8006
No log	72.6667	436	0.5961	0.5576	0.5961	0.7720
No log	73.0	438	0.5524	0.5920	0.5524	0.7432
No log	73.3333	440	0.5268	0.5692	0.5268	0.7258
No log	73.6667	442	0.5195	0.5692	0.5195	0.7208
No log	74.0	444	0.5096	0.5617	0.5096	0.7139
No log	74.3333	446	0.5138	0.5845	0.5138	0.7168
No log	74.6667	448	0.5211	0.5944	0.5211	0.7219
No log	75.0	450	0.5243	0.5906	0.5243	0.7241
No log	75.3333	452	0.5129	0.6084	0.5129	0.7161
No log	75.6667	454	0.5102	0.6099	0.5102	0.7143
No log	76.0	456	0.4975	0.6741	0.4975	0.7053
No log	76.3333	458	0.4902	0.6741	0.4902	0.7002
No log	76.6667	460	0.4811	0.6675	0.4811	0.6936
No log	77.0	462	0.4767	0.6681	0.4767	0.6904
No log	77.3333	464	0.4650	0.6599	0.4650	0.6819
No log	77.6667	466	0.4695	0.6599	0.4695	0.6852
No log	78.0	468	0.4853	0.6588	0.4853	0.6966
No log	78.3333	470	0.4855	0.6588	0.4855	0.6968
No log	78.6667	472	0.4941	0.6586	0.4941	0.7029
No log	79.0	474	0.4890	0.6586	0.4890	0.6993
No log	79.3333	476	0.4895	0.6164	0.4895	0.6996
No log	79.6667	478	0.4881	0.6164	0.4881	0.6986
No log	80.0	480	0.4929	0.6164	0.4929	0.7020
No log	80.3333	482	0.4855	0.6164	0.4855	0.6967
No log	80.6667	484	0.4765	0.6599	0.4765	0.6903
No log	81.0	486	0.4779	0.6596	0.4779	0.6913
No log	81.3333	488	0.4763	0.6596	0.4763	0.6901
No log	81.6667	490	0.4721	0.6940	0.4721	0.6871
No log	82.0	492	0.4692	0.6777	0.4692	0.6850
No log	82.3333	494	0.4612	0.6894	0.4612	0.6791
No log	82.6667	496	0.4507	0.6541	0.4507	0.6713
No log	83.0	498	0.4461	0.6639	0.4461	0.6679
0.2343	83.3333	500	0.4476	0.6643	0.4476	0.6690
0.2343	83.6667	502	0.4541	0.6339	0.4541	0.6739
0.2343	84.0	504	0.4609	0.6530	0.4609	0.6789
0.2343	84.3333	506	0.4600	0.6530	0.4600	0.6782
0.2343	84.6667	508	0.4582	0.6346	0.4582	0.6769
0.2343	85.0	510	0.4575	0.6443	0.4575	0.6764

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1