ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1541
• Qwk: 0.3665
• Mse: 2.1541
• Rmse: 1.4677

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2	2	7.7863	-0.0405	7.7863	2.7904
No log	0.4	4	4.6455	0.0465	4.6455	2.1553
No log	0.6	6	3.1053	0.0936	3.1053	1.7622
No log	0.8	8	2.5139	0.0746	2.5139	1.5855
No log	1.0	10	4.6542	-0.1525	4.6542	2.1574
No log	1.2	12	5.4708	-0.0909	5.4708	2.3390
No log	1.4	14	4.2583	-0.1256	4.2583	2.0636
No log	1.6	16	2.4169	0.0150	2.4169	1.5546
No log	1.8	18	1.9493	0.1345	1.9493	1.3962
No log	2.0	20	1.7754	0.1724	1.7754	1.3324
No log	2.2	22	1.7930	0.2602	1.7930	1.3390
No log	2.4	24	2.0830	0.2044	2.0830	1.4432
No log	2.6	26	2.8431	0.1060	2.8431	1.6862
No log	2.8	28	3.2789	0.1591	3.2789	1.8108
No log	3.0	30	3.3622	0.1277	3.3622	1.8336
No log	3.2	32	3.2579	0.1739	3.2579	1.8050
No log	3.4	34	2.8615	0.1538	2.8615	1.6916
No log	3.6	36	2.7094	0.1558	2.7094	1.6460
No log	3.8	38	2.4337	0.1361	2.4337	1.5600
No log	4.0	40	2.3697	0.1361	2.3697	1.5394
No log	4.2	42	2.9335	0.1503	2.9335	1.7127
No log	4.4	44	3.6015	0.1043	3.6015	1.8978
No log	4.6	46	3.3276	0.1294	3.3276	1.8242
No log	4.8	48	3.1009	0.1648	3.1009	1.7609
No log	5.0	50	2.1745	0.1722	2.1745	1.4746
No log	5.2	52	1.9608	0.3151	1.9608	1.4003
No log	5.4	54	2.3711	0.1699	2.3711	1.5398
No log	5.6	56	2.8627	0.2320	2.8627	1.6919
No log	5.8	58	3.8350	0.1796	3.8350	1.9583
No log	6.0	60	4.1154	0.1429	4.1154	2.0287
No log	6.2	62	3.3736	0.2321	3.3736	1.8367
No log	6.4	64	2.4917	0.3102	2.4917	1.5785
No log	6.6	66	1.5911	0.4658	1.5911	1.2614
No log	6.8	68	1.4987	0.4895	1.4987	1.2242
No log	7.0	70	2.0350	0.3571	2.0350	1.4265
No log	7.2	72	2.9479	0.1762	2.9479	1.7170
No log	7.4	74	3.5355	0.2174	3.5355	1.8803
No log	7.6	76	3.1756	0.2201	3.1756	1.7820
No log	7.8	78	3.0068	0.2030	3.0068	1.7340
No log	8.0	80	2.5060	0.2588	2.5060	1.5830
No log	8.2	82	1.9570	0.36	1.9570	1.3989
No log	8.4	84	2.1984	0.2981	2.1984	1.4827
No log	8.6	86	2.9497	0.2021	2.9497	1.7175
No log	8.8	88	3.2966	0.2443	3.2966	1.8156
No log	9.0	90	2.8937	0.2388	2.8937	1.7011
No log	9.2	92	2.2201	0.2609	2.2201	1.4900
No log	9.4	94	1.6992	0.3724	1.6992	1.3035
No log	9.6	96	1.8833	0.3129	1.8833	1.3723
No log	9.8	98	2.5656	0.2038	2.5656	1.6017
No log	10.0	100	3.4136	0.1508	3.4136	1.8476
No log	10.2	102	3.7794	0.1373	3.7794	1.9441
No log	10.4	104	3.4665	0.1801	3.4665	1.8619
No log	10.6	106	2.6633	0.1557	2.6633	1.6320
No log	10.8	108	1.9721	0.3310	1.9721	1.4043
No log	11.0	110	1.8575	0.3688	1.8575	1.3629
No log	11.2	112	2.3051	0.1707	2.3051	1.5182
No log	11.4	114	3.0473	0.2011	3.0473	1.7457
No log	11.6	116	3.2391	0.2286	3.2391	1.7997
No log	11.8	118	2.7612	0.2270	2.7612	1.6617
No log	12.0	120	2.1525	0.3333	2.1525	1.4671
No log	12.2	122	1.9086	0.3924	1.9086	1.3815
No log	12.4	124	2.0973	0.3230	2.0973	1.4482
No log	12.6	126	2.6240	0.2717	2.6240	1.6199
No log	12.8	128	2.8902	0.2335	2.8902	1.7000
No log	13.0	130	2.9453	0.2488	2.9453	1.7162
No log	13.2	132	2.6677	0.2551	2.6677	1.6333
No log	13.4	134	2.5696	0.3280	2.5696	1.6030
No log	13.6	136	2.5299	0.3385	2.5299	1.5906
No log	13.8	138	2.2055	0.3708	2.2055	1.4851
No log	14.0	140	1.8489	0.4118	1.8489	1.3598
No log	14.2	142	1.8645	0.4118	1.8645	1.3655
No log	14.4	144	2.0971	0.3503	2.0971	1.4481
No log	14.6	146	2.4498	0.3350	2.4498	1.5652
No log	14.8	148	2.3598	0.3564	2.3598	1.5361
No log	15.0	150	2.0607	0.4022	2.0607	1.4355
No log	15.2	152	1.9077	0.3956	1.9077	1.3812
No log	15.4	154	1.6880	0.4268	1.6880	1.2992
No log	15.6	156	1.7686	0.3929	1.7686	1.3299
No log	15.8	158	1.8342	0.4	1.8342	1.3543
No log	16.0	160	2.0040	0.3716	2.0040	1.4156
No log	16.2	162	1.9519	0.3678	1.9519	1.3971
No log	16.4	164	2.2065	0.3770	2.2065	1.4854
No log	16.6	166	2.0423	0.3575	2.0423	1.4291
No log	16.8	168	1.6990	0.4528	1.6990	1.3034
No log	17.0	170	1.2681	0.5248	1.2681	1.1261
No log	17.2	172	1.1665	0.5652	1.1665	1.0800
No log	17.4	174	1.3715	0.5067	1.3715	1.1711
No log	17.6	176	1.8435	0.4337	1.8435	1.3578
No log	17.8	178	2.3945	0.3838	2.3945	1.5474
No log	18.0	180	2.7946	0.3241	2.7946	1.6717
No log	18.2	182	2.7101	0.3192	2.7101	1.6462
No log	18.4	184	2.4089	0.3085	2.4089	1.5521
No log	18.6	186	1.9315	0.3133	1.9315	1.3898
No log	18.8	188	1.8310	0.2876	1.8310	1.3532
No log	19.0	190	1.9559	0.2710	1.9559	1.3985
No log	19.2	192	1.9010	0.2710	1.9010	1.3788
No log	19.4	194	1.8867	0.2710	1.8867	1.3736
No log	19.6	196	2.0256	0.2436	2.0256	1.4232
No log	19.8	198	2.0242	0.2733	2.0242	1.4227
No log	20.0	200	1.9463	0.3086	1.9463	1.3951
No log	20.2	202	1.7633	0.3694	1.7633	1.3279
No log	20.4	204	1.6049	0.4416	1.6049	1.2668
No log	20.6	206	1.4084	0.5032	1.4084	1.1867
No log	20.8	208	1.4519	0.5714	1.4519	1.2049
No log	21.0	210	1.9106	0.4390	1.9106	1.3822
No log	21.2	212	2.3909	0.4225	2.3909	1.5463
No log	21.4	214	2.2141	0.4299	2.2141	1.4880
No log	21.6	216	1.6820	0.5361	1.6820	1.2969
No log	21.8	218	1.1385	0.6706	1.1385	1.0670
No log	22.0	220	0.9489	0.7037	0.9489	0.9741
No log	22.2	222	1.0780	0.6871	1.0780	1.0383
No log	22.4	224	1.5295	0.5287	1.5295	1.2367
No log	22.6	226	1.9684	0.4385	1.9684	1.4030
No log	22.8	228	2.2099	0.3920	2.2099	1.4866
No log	23.0	230	2.2647	0.3786	2.2647	1.5049
No log	23.2	232	2.0364	0.4663	2.0364	1.4270
No log	23.4	234	1.7729	0.5134	1.7729	1.3315
No log	23.6	236	1.6942	0.5054	1.6942	1.3016
No log	23.8	238	1.6728	0.4918	1.6728	1.2934
No log	24.0	240	1.8282	0.5054	1.8282	1.3521
No log	24.2	242	2.0107	0.4301	2.0107	1.4180
No log	24.4	244	1.9208	0.3977	1.9208	1.3859
No log	24.6	246	1.9846	0.3977	1.9846	1.4088
No log	24.8	248	2.0399	0.3977	2.0399	1.4282
No log	25.0	250	2.2780	0.3627	2.2780	1.5093
No log	25.2	252	2.2042	0.3684	2.2042	1.4846
No log	25.4	254	1.7748	0.4727	1.7748	1.3322
No log	25.6	256	1.5884	0.4586	1.5884	1.2603
No log	25.8	258	1.6907	0.4403	1.6907	1.3003
No log	26.0	260	1.9588	0.4277	1.9588	1.3996
No log	26.2	262	2.4101	0.3100	2.4101	1.5524
No log	26.4	264	2.6221	0.3398	2.6221	1.6193
No log	26.6	266	2.4989	0.3251	2.4989	1.5808
No log	26.8	268	2.3397	0.3420	2.3397	1.5296
No log	27.0	270	2.2781	0.3617	2.2781	1.5093
No log	27.2	272	2.2769	0.3102	2.2769	1.5089
No log	27.4	274	2.1579	0.3494	2.1579	1.4690
No log	27.6	276	2.0494	0.3780	2.0494	1.4316
No log	27.8	278	1.7452	0.4375	1.7452	1.3211
No log	28.0	280	1.6194	0.4841	1.6194	1.2725
No log	28.2	282	1.6672	0.4780	1.6672	1.2912
No log	28.4	284	1.8581	0.4914	1.8581	1.3631
No log	28.6	286	2.0131	0.4468	2.0131	1.4189
No log	28.8	288	2.0385	0.4468	2.0385	1.4278
No log	29.0	290	2.2167	0.3980	2.2167	1.4889
No log	29.2	292	2.0843	0.4171	2.0843	1.4437
No log	29.4	294	1.8213	0.4804	1.8213	1.3496
No log	29.6	296	1.7014	0.4568	1.7014	1.3044
No log	29.8	298	1.7458	0.4431	1.7458	1.3213
No log	30.0	300	1.7759	0.4471	1.7759	1.3326
No log	30.2	302	1.7188	0.4734	1.7188	1.3110
No log	30.4	304	1.7326	0.4828	1.7326	1.3163
No log	30.6	306	1.6376	0.5172	1.6376	1.2797
No log	30.8	308	1.6052	0.5030	1.6052	1.2670
No log	31.0	310	1.8184	0.4778	1.8184	1.3485
No log	31.2	312	2.0135	0.4649	2.0135	1.4190
No log	31.4	314	2.0445	0.4444	2.0445	1.4299
No log	31.6	316	2.1203	0.3956	2.1203	1.4561
No log	31.8	318	1.9209	0.4094	1.9209	1.3860
No log	32.0	320	1.6092	0.4106	1.6092	1.2685
No log	32.2	322	1.2526	0.5594	1.2526	1.1192
No log	32.4	324	1.1767	0.5694	1.1767	1.0847
No log	32.6	326	1.3193	0.4966	1.3193	1.1486
No log	32.8	328	1.4912	0.5031	1.4912	1.2212
No log	33.0	330	1.5757	0.4795	1.5757	1.2553
No log	33.2	332	1.4794	0.5089	1.4794	1.2163
No log	33.4	334	1.4570	0.5089	1.4570	1.2071
No log	33.6	336	1.3921	0.5581	1.3921	1.1799
No log	33.8	338	1.4426	0.5294	1.4426	1.2011
No log	34.0	340	1.6721	0.5	1.6721	1.2931
No log	34.2	342	2.0196	0.4492	2.0196	1.4211
No log	34.4	344	2.0946	0.3936	2.0946	1.4473
No log	34.6	346	1.9967	0.4262	1.9967	1.4130
No log	34.8	348	1.7683	0.4121	1.7683	1.3298
No log	35.0	350	1.5737	0.4161	1.5737	1.2545
No log	35.2	352	1.6030	0.3758	1.6030	1.2661
No log	35.4	354	1.6389	0.4459	1.6389	1.2802
No log	35.6	356	1.8053	0.3976	1.8053	1.3436
No log	35.8	358	1.8527	0.4024	1.8527	1.3611
No log	36.0	360	1.9777	0.4	1.9777	1.4063
No log	36.2	362	2.0086	0.4	2.0086	1.4173
No log	36.4	364	1.9221	0.4432	1.9221	1.3864
No log	36.6	366	1.8412	0.4590	1.8412	1.3569
No log	36.8	368	2.0081	0.4385	2.0081	1.4171
No log	37.0	370	2.0841	0.3915	2.0841	1.4437
No log	37.2	372	2.1315	0.3915	2.1315	1.4600
No log	37.4	374	2.0660	0.3889	2.0660	1.4374
No log	37.6	376	1.8107	0.4327	1.8107	1.3456
No log	37.8	378	1.5699	0.4106	1.5699	1.2529
No log	38.0	380	1.4925	0.4414	1.4925	1.2217
No log	38.2	382	1.6007	0.3586	1.6007	1.2652
No log	38.4	384	1.8248	0.3377	1.8248	1.3509
No log	38.6	386	1.9501	0.3926	1.9501	1.3965
No log	38.8	388	1.9489	0.4024	1.9489	1.3960
No log	39.0	390	1.7926	0.3952	1.7926	1.3389
No log	39.2	392	1.6604	0.4431	1.6604	1.2886
No log	39.4	394	1.5825	0.5059	1.5825	1.2580
No log	39.6	396	1.7040	0.5227	1.7040	1.3054
No log	39.8	398	1.9099	0.4492	1.9099	1.3820
No log	40.0	400	1.9875	0.4301	1.9875	1.4098
No log	40.2	402	2.0037	0.3784	2.0037	1.4155
No log	40.4	404	1.7901	0.4651	1.7901	1.3379
No log	40.6	406	1.6658	0.4417	1.6658	1.2906
No log	40.8	408	1.7597	0.4417	1.7597	1.3265
No log	41.0	410	1.7947	0.4198	1.7947	1.3397
No log	41.2	412	1.8155	0.4198	1.8155	1.3474
No log	41.4	414	1.6841	0.4684	1.6841	1.2977
No log	41.6	416	1.5068	0.4868	1.5068	1.2275
No log	41.8	418	1.6152	0.5366	1.6152	1.2709
No log	42.0	420	1.8093	0.4286	1.8093	1.3451
No log	42.2	422	2.0627	0.3676	2.0627	1.4362
No log	42.4	424	2.3556	0.3655	2.3556	1.5348
No log	42.6	426	2.5111	0.3535	2.5111	1.5846
No log	42.8	428	2.3608	0.3608	2.3608	1.5365
No log	43.0	430	2.2918	0.3560	2.2918	1.5139
No log	43.2	432	2.0677	0.3636	2.0677	1.4379
No log	43.4	434	1.8198	0.4311	1.8198	1.3490
No log	43.6	436	1.8279	0.4235	1.8279	1.3520
No log	43.8	438	1.7651	0.4588	1.7651	1.3286
No log	44.0	440	1.7873	0.4588	1.7873	1.3369
No log	44.2	442	1.8606	0.4382	1.8606	1.3640
No log	44.4	444	1.8104	0.4773	1.8104	1.3455
No log	44.6	446	1.8355	0.4699	1.8355	1.3548
No log	44.8	448	1.8245	0.4891	1.8245	1.3507
No log	45.0	450	1.7901	0.4972	1.7901	1.3379
No log	45.2	452	1.7495	0.48	1.7495	1.3227
No log	45.4	454	1.6754	0.4444	1.6754	1.2944
No log	45.6	456	1.6111	0.4940	1.6111	1.2693
No log	45.8	458	1.5449	0.4615	1.5449	1.2430
No log	46.0	460	1.4443	0.5065	1.4443	1.2018
No log	46.2	462	1.4222	0.5161	1.4222	1.1926
No log	46.4	464	1.4241	0.5316	1.4241	1.1934
No log	46.6	466	1.4112	0.5316	1.4112	1.1880
No log	46.8	468	1.5214	0.5455	1.5214	1.2334
No log	47.0	470	1.6007	0.4943	1.6007	1.2652
No log	47.2	472	1.6195	0.4972	1.6195	1.2726
No log	47.4	474	1.5550	0.5114	1.5550	1.2470
No log	47.6	476	1.4794	0.5294	1.4794	1.2163
No log	47.8	478	1.5458	0.5146	1.5458	1.2433
No log	48.0	480	1.7091	0.5	1.7091	1.3073
No log	48.2	482	1.8637	0.5	1.8637	1.3652
No log	48.4	484	1.9172	0.4565	1.9172	1.3846
No log	48.6	486	1.8592	0.4667	1.8592	1.3635
No log	48.8	488	1.8209	0.4286	1.8209	1.3494
No log	49.0	490	1.8396	0.4286	1.8396	1.3563
No log	49.2	492	1.8742	0.3931	1.8742	1.3690
No log	49.4	494	1.9517	0.3584	1.9517	1.3970
No log	49.6	496	2.0222	0.375	2.0222	1.4221
No log	49.8	498	2.0774	0.3846	2.0774	1.4413
0.313	50.0	500	2.1124	0.3936	2.1124	1.4534
0.313	50.2	502	2.1547	0.3979	2.1547	1.4679
0.313	50.4	504	2.1414	0.3979	2.1414	1.4634
0.313	50.6	506	1.8522	0.4787	1.8522	1.3609
0.313	50.8	508	1.6109	0.5385	1.6109	1.2692
0.313	51.0	510	1.5616	0.5486	1.5616	1.2496
0.313	51.2	512	1.6035	0.5137	1.6035	1.2663
0.313	51.4	514	1.6000	0.5341	1.6000	1.2649
0.313	51.6	516	1.5955	0.5341	1.5955	1.2631
0.313	51.8	518	1.6623	0.48	1.6623	1.2893
0.313	52.0	520	1.7822	0.4138	1.7822	1.3350
0.313	52.2	522	1.8991	0.4181	1.8991	1.3781
0.313	52.4	524	1.9215	0.4239	1.9215	1.3862
0.313	52.6	526	1.9208	0.4239	1.9208	1.3859
0.313	52.8	528	1.7991	0.4581	1.7991	1.3413
0.313	53.0	530	1.7352	0.4651	1.7352	1.3173
0.313	53.2	532	1.7223	0.4862	1.7223	1.3124
0.313	53.4	534	1.7129	0.4651	1.7129	1.3088
0.313	53.6	536	1.6974	0.4651	1.6974	1.3029
0.313	53.8	538	1.6637	0.4337	1.6637	1.2899
0.313	54.0	540	1.7174	0.4198	1.7174	1.3105
0.313	54.2	542	1.6466	0.4568	1.6466	1.2832
0.313	54.4	544	1.5478	0.4780	1.5478	1.2441
0.313	54.6	546	1.5057	0.5	1.5057	1.2271
0.313	54.8	548	1.4805	0.5301	1.4805	1.2168
0.313	55.0	550	1.4403	0.5301	1.4403	1.2001
0.313	55.2	552	1.3906	0.5663	1.3906	1.1792
0.313	55.4	554	1.3027	0.5432	1.3027	1.1414
0.313	55.6	556	1.2744	0.5679	1.2744	1.1289
0.313	55.8	558	1.2988	0.5663	1.2988	1.1397
0.313	56.0	560	1.4063	0.5698	1.4063	1.1859
0.313	56.2	562	1.5697	0.5652	1.5697	1.2529
0.313	56.4	564	1.7145	0.5185	1.7145	1.3094
0.313	56.6	566	1.7626	0.5236	1.7626	1.3276
0.313	56.8	568	1.7293	0.5106	1.7293	1.3150
0.313	57.0	570	1.6078	0.5165	1.6078	1.2680
0.313	57.2	572	1.4740	0.5455	1.4740	1.2141
0.313	57.4	574	1.3434	0.5283	1.3434	1.1590
0.313	57.6	576	1.2999	0.5283	1.2999	1.1401
0.313	57.8	578	1.3070	0.5283	1.3070	1.1433
0.313	58.0	580	1.3826	0.5375	1.3826	1.1759
0.313	58.2	582	1.4423	0.5157	1.4423	1.2009
0.313	58.4	584	1.5190	0.5	1.5190	1.2325
0.313	58.6	586	1.6823	0.4403	1.6823	1.2970
0.313	58.8	588	1.8615	0.3952	1.8615	1.3644
0.313	59.0	590	2.0224	0.3392	2.0224	1.4221
0.313	59.2	592	2.0070	0.3392	2.0070	1.4167
0.313	59.4	594	1.8849	0.3067	1.8849	1.3729
0.313	59.6	596	1.7182	0.4	1.7182	1.3108
0.313	59.8	598	1.6044	0.4744	1.6044	1.2667
0.313	60.0	600	1.5832	0.4744	1.5832	1.2582
0.313	60.2	602	1.6560	0.4459	1.6560	1.2869
0.313	60.4	604	1.7221	0.4634	1.7221	1.3123
0.313	60.6	606	1.7818	0.4734	1.7818	1.3348
0.313	60.8	608	1.8496	0.4407	1.8496	1.3600
0.313	61.0	610	1.8165	0.5055	1.8165	1.3478
0.313	61.2	612	1.7942	0.5055	1.7942	1.3395
0.313	61.4	614	1.6893	0.5114	1.6893	1.2997
0.313	61.6	616	1.6771	0.4941	1.6771	1.2950
0.313	61.8	618	1.7197	0.4855	1.7197	1.3114
0.313	62.0	620	1.8125	0.4719	1.8125	1.3463
0.313	62.2	622	1.9521	0.3913	1.9521	1.3972
0.313	62.4	624	2.0818	0.3459	2.0818	1.4428
0.313	62.6	626	2.1191	0.3665	2.1191	1.4557
0.313	62.8	628	2.1873	0.3814	2.1873	1.4790
0.313	63.0	630	2.1541	0.3665	2.1541	1.4677

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1