ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9339
• Qwk: 0.3930
• Mse: 0.9339
• Rmse: 0.9664

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0225	2	4.7931	0.0010	4.7931	2.1893
No log	0.0449	4	3.3275	-0.0767	3.3275	1.8241
No log	0.0674	6	2.7562	-0.0942	2.7562	1.6602
No log	0.0899	8	2.1044	-0.0370	2.1044	1.4507
No log	0.1124	10	1.6908	-0.0606	1.6908	1.3003
No log	0.1348	12	1.4276	0.0571	1.4276	1.1948
No log	0.1573	14	1.5557	-0.0641	1.5557	1.2473
No log	0.1798	16	2.5511	-0.0595	2.5511	1.5972
No log	0.2022	18	4.1038	-0.0302	4.1038	2.0258
No log	0.2247	20	3.5568	0.0339	3.5568	1.8859
No log	0.2472	22	2.1477	-0.0007	2.1477	1.4655
No log	0.2697	24	1.3367	0.0860	1.3367	1.1562
No log	0.2921	26	1.3278	0.1505	1.3278	1.1523
No log	0.3146	28	1.4919	0.1851	1.4919	1.2214
No log	0.3371	30	1.7672	0.1857	1.7672	1.3294
No log	0.3596	32	2.1513	0.1243	2.1513	1.4667
No log	0.3820	34	2.5720	0.0851	2.5720	1.6038
No log	0.4045	36	2.1984	0.1314	2.1984	1.4827
No log	0.4270	38	1.5499	0.26	1.5499	1.2449
No log	0.4494	40	1.1333	0.1542	1.1333	1.0646
No log	0.4719	42	1.0715	0.2579	1.0715	1.0351
No log	0.4944	44	1.0718	0.3091	1.0718	1.0353
No log	0.5169	46	1.0704	0.2988	1.0704	1.0346
No log	0.5393	48	1.2193	0.1255	1.2193	1.1042
No log	0.5618	50	1.3700	0.2261	1.3700	1.1705
No log	0.5843	52	1.2817	0.1943	1.2817	1.1321
No log	0.6067	54	1.3499	0.2539	1.3499	1.1619
No log	0.6292	56	1.6869	0.2380	1.6869	1.2988
No log	0.6517	58	1.8231	0.2398	1.8231	1.3502
No log	0.6742	60	1.4761	0.2791	1.4761	1.2149
No log	0.6966	62	1.2907	0.2366	1.2907	1.1361
No log	0.7191	64	1.2736	0.2069	1.2736	1.1285
No log	0.7416	66	1.5277	0.2572	1.5277	1.2360
No log	0.7640	68	1.9594	0.2226	1.9594	1.3998
No log	0.7865	70	2.3935	0.1757	2.3935	1.5471
No log	0.8090	72	2.1311	0.2249	2.1311	1.4598
No log	0.8315	74	1.5772	0.1038	1.5772	1.2559
No log	0.8539	76	1.2082	0.1314	1.2082	1.0992
No log	0.8764	78	1.0980	0.2432	1.0980	1.0479
No log	0.8989	80	1.0694	0.3467	1.0694	1.0341
No log	0.9213	82	1.0372	0.3685	1.0372	1.0185
No log	0.9438	84	1.0369	0.3263	1.0369	1.0183
No log	0.9663	86	1.1637	0.1743	1.1637	1.0787
No log	0.9888	88	1.6285	0.2963	1.6285	1.2761
No log	1.0112	90	1.7464	0.2839	1.7464	1.3215
No log	1.0337	92	1.6306	0.3058	1.6306	1.2769
No log	1.0562	94	1.4205	0.3243	1.4205	1.1918
No log	1.0787	96	1.1821	0.3707	1.1821	1.0872
No log	1.1011	98	1.0075	0.3685	1.0075	1.0038
No log	1.1236	100	0.9220	0.4810	0.9220	0.9602
No log	1.1461	102	0.9497	0.4196	0.9497	0.9745
No log	1.1685	104	1.0132	0.2730	1.0132	1.0066
No log	1.1910	106	1.1680	0.2140	1.1680	1.0808
No log	1.2135	108	1.3867	0.2117	1.3867	1.1776
No log	1.2360	110	1.3370	0.1984	1.3370	1.1563
No log	1.2584	112	1.1585	0.2627	1.1585	1.0763
No log	1.2809	114	1.2202	0.3238	1.2202	1.1046
No log	1.3034	116	1.1808	0.2985	1.1808	1.0866
No log	1.3258	118	1.1751	0.3533	1.1751	1.0840
No log	1.3483	120	1.1034	0.3790	1.1034	1.0504
No log	1.3708	122	1.0935	0.3790	1.0935	1.0457
No log	1.3933	124	1.0591	0.4832	1.0591	1.0291
No log	1.4157	126	1.1971	0.4282	1.1971	1.0941
No log	1.4382	128	1.7077	0.2670	1.7077	1.3068
No log	1.4607	130	1.7002	0.2934	1.7002	1.3039
No log	1.4831	132	1.3053	0.3935	1.3053	1.1425
No log	1.5056	134	1.1217	0.3542	1.1217	1.0591
No log	1.5281	136	1.1317	0.3663	1.1317	1.0638
No log	1.5506	138	1.2956	0.2900	1.2956	1.1383
No log	1.5730	140	1.3023	0.2660	1.3023	1.1412
No log	1.5955	142	1.1575	0.3202	1.1575	1.0759
No log	1.6180	144	1.2370	0.2660	1.2370	1.1122
No log	1.6404	146	1.2748	0.3067	1.2748	1.1291
No log	1.6629	148	1.0695	0.3877	1.0695	1.0342
No log	1.6854	150	1.0315	0.4480	1.0315	1.0156
No log	1.7079	152	1.0610	0.4819	1.0610	1.0300
No log	1.7303	154	1.4051	0.3056	1.4051	1.1854
No log	1.7528	156	1.6037	0.2511	1.6037	1.2664
No log	1.7753	158	1.3475	0.3318	1.3475	1.1608
No log	1.7978	160	1.0794	0.3887	1.0794	1.0389
No log	1.8202	162	1.1414	0.3333	1.1414	1.0684
No log	1.8427	164	1.1113	0.3822	1.1113	1.0542
No log	1.8652	166	1.1210	0.3012	1.1210	1.0588
No log	1.8876	168	1.6310	0.2828	1.6310	1.2771
No log	1.9101	170	1.9299	0.1401	1.9299	1.3892
No log	1.9326	172	1.7166	0.2383	1.7166	1.3102
No log	1.9551	174	1.2429	0.2851	1.2429	1.1148
No log	1.9775	176	1.0512	0.3243	1.0512	1.0253
No log	2.0	178	1.0683	0.2893	1.0683	1.0336
No log	2.0225	180	1.0749	0.2662	1.0749	1.0368
No log	2.0449	182	1.2280	0.2005	1.2280	1.1081
No log	2.0674	184	1.4202	0.2240	1.4202	1.1917
No log	2.0899	186	1.3721	0.2364	1.3721	1.1714
No log	2.1124	188	1.1583	0.2467	1.1583	1.0763
No log	2.1348	190	1.1181	0.3812	1.1181	1.0574
No log	2.1573	192	1.0703	0.4045	1.0703	1.0346
No log	2.1798	194	1.1284	0.4256	1.1284	1.0623
No log	2.2022	196	1.1494	0.3462	1.1494	1.0721
No log	2.2247	198	1.0966	0.2876	1.0966	1.0472
No log	2.2472	200	1.0075	0.3133	1.0075	1.0038
No log	2.2697	202	1.0238	0.2716	1.0238	1.0118
No log	2.2921	204	1.0985	0.2324	1.0985	1.0481
No log	2.3146	206	1.1555	0.2549	1.1555	1.0749
No log	2.3371	208	1.0119	0.2700	1.0119	1.0059
No log	2.3596	210	0.9490	0.3729	0.9490	0.9742
No log	2.3820	212	0.9359	0.5346	0.9359	0.9674
No log	2.4045	214	0.9746	0.3865	0.9746	0.9872
No log	2.4270	216	1.1167	0.4073	1.1167	1.0567
No log	2.4494	218	1.0899	0.3839	1.0899	1.0440
No log	2.4719	220	0.9957	0.3504	0.9957	0.9978
No log	2.4944	222	0.9472	0.3090	0.9472	0.9733
No log	2.5169	224	0.9649	0.3448	0.9649	0.9823
No log	2.5393	226	0.9730	0.3017	0.9730	0.9864
No log	2.5618	228	1.0375	0.3036	1.0375	1.0186
No log	2.5843	230	1.3299	0.3205	1.3299	1.1532
No log	2.6067	232	1.4754	0.2642	1.4754	1.2147
No log	2.6292	234	1.3291	0.3166	1.3291	1.1528
No log	2.6517	236	1.0151	0.3321	1.0151	1.0075
No log	2.6742	238	0.9682	0.4808	0.9682	0.9839
No log	2.6966	240	1.0119	0.4473	1.0119	1.0059
No log	2.7191	242	0.9620	0.4595	0.9620	0.9808
No log	2.7416	244	0.9796	0.4267	0.9796	0.9898
No log	2.7640	246	1.1347	0.4050	1.1347	1.0652
No log	2.7865	248	1.1345	0.4050	1.1345	1.0651
No log	2.8090	250	1.0422	0.4672	1.0422	1.0209
No log	2.8315	252	1.0325	0.4549	1.0325	1.0161
No log	2.8539	254	1.0729	0.3935	1.0729	1.0358
No log	2.8764	256	1.0930	0.3850	1.0930	1.0454
No log	2.8989	258	1.1976	0.2962	1.1976	1.0944
No log	2.9213	260	1.1761	0.3131	1.1761	1.0845
No log	2.9438	262	1.0632	0.4948	1.0632	1.0311
No log	2.9663	264	1.0368	0.5127	1.0368	1.0182
No log	2.9888	266	1.0123	0.4847	1.0123	1.0061
No log	3.0112	268	1.0281	0.4699	1.0281	1.0139
No log	3.0337	270	0.9966	0.3256	0.9966	0.9983
No log	3.0562	272	1.0284	0.2492	1.0284	1.0141
No log	3.0787	274	1.0627	0.2033	1.0627	1.0309
No log	3.1011	276	1.0414	0.2394	1.0414	1.0205
No log	3.1236	278	1.0646	0.2988	1.0646	1.0318
No log	3.1461	280	1.0752	0.3759	1.0752	1.0369
No log	3.1685	282	1.1022	0.3759	1.1022	1.0498
No log	3.1910	284	1.0988	0.3584	1.0988	1.0483
No log	3.2135	286	1.1158	0.3584	1.1158	1.0563
No log	3.2360	288	1.0757	0.3714	1.0757	1.0372
No log	3.2584	290	1.1517	0.3595	1.1517	1.0732
No log	3.2809	292	1.2680	0.3184	1.2680	1.1260
No log	3.3034	294	1.1475	0.3254	1.1475	1.0712
No log	3.3258	296	1.0198	0.3875	1.0198	1.0098
No log	3.3483	298	1.0166	0.3935	1.0166	1.0083
No log	3.3708	300	1.0351	0.3919	1.0351	1.0174
No log	3.3933	302	1.1866	0.3047	1.1866	1.0893
No log	3.4157	304	1.4195	0.2842	1.4195	1.1914
No log	3.4382	306	1.4299	0.2912	1.4299	1.1958
No log	3.4607	308	1.1801	0.3111	1.1801	1.0863
No log	3.4831	310	1.0563	0.3579	1.0563	1.0278
No log	3.5056	312	1.0552	0.3579	1.0552	1.0272
No log	3.5281	314	1.0954	0.2670	1.0954	1.0466
No log	3.5506	316	1.2829	0.3742	1.2829	1.1327
No log	3.5730	318	1.3991	0.2665	1.3991	1.1828
No log	3.5955	320	1.2562	0.3220	1.2562	1.1208
No log	3.6180	322	1.1037	0.2593	1.1037	1.0505
No log	3.6404	324	1.1037	0.2667	1.1037	1.0506
No log	3.6629	326	1.1353	0.3052	1.1353	1.0655
No log	3.6854	328	1.2146	0.2943	1.2146	1.1021
No log	3.7079	330	1.3556	0.3139	1.3556	1.1643
No log	3.7303	332	1.3085	0.3003	1.3085	1.1439
No log	3.7528	334	1.0801	0.3432	1.0801	1.0393
No log	3.7753	336	1.0006	0.4859	1.0006	1.0003
No log	3.7978	338	0.9871	0.4714	0.9871	0.9935
No log	3.8202	340	0.9490	0.4105	0.9490	0.9741
No log	3.8427	342	0.9983	0.3634	0.9983	0.9992
No log	3.8652	344	1.0121	0.3437	1.0121	1.0060
No log	3.8876	346	0.9314	0.4299	0.9314	0.9651
No log	3.9101	348	0.9321	0.4982	0.9321	0.9655
No log	3.9326	350	0.9606	0.5077	0.9606	0.9801
No log	3.9551	352	0.9296	0.4435	0.9296	0.9642
No log	3.9775	354	0.9766	0.2744	0.9766	0.9882
No log	4.0	356	1.1593	0.3585	1.1593	1.0767
No log	4.0225	358	1.2258	0.3648	1.2258	1.1072
No log	4.0449	360	1.0976	0.2919	1.0976	1.0476
No log	4.0674	362	0.9600	0.3184	0.9600	0.9798
No log	4.0899	364	0.9586	0.4587	0.9586	0.9791
No log	4.1124	366	0.9533	0.4493	0.9533	0.9764
No log	4.1348	368	0.9534	0.4628	0.9534	0.9764
No log	4.1573	370	0.9869	0.2920	0.9869	0.9934
No log	4.1798	372	1.2372	0.3745	1.2372	1.1123
No log	4.2022	374	1.3840	0.3852	1.3840	1.1764
No log	4.2247	376	1.2713	0.3611	1.2713	1.1275
No log	4.2472	378	1.0716	0.3238	1.0716	1.0352
No log	4.2697	380	0.9434	0.3294	0.9434	0.9713
No log	4.2921	382	0.9570	0.4181	0.9570	0.9783
No log	4.3146	384	0.9715	0.3779	0.9715	0.9857
No log	4.3371	386	0.9383	0.3608	0.9383	0.9687
No log	4.3596	388	0.9915	0.3753	0.9915	0.9957
No log	4.3820	390	1.1463	0.3673	1.1463	1.0707
No log	4.4045	392	1.1343	0.3673	1.1343	1.0651
No log	4.4270	394	1.0091	0.3323	1.0091	1.0045
No log	4.4494	396	0.9417	0.3312	0.9417	0.9704
No log	4.4719	398	0.9567	0.3015	0.9567	0.9781
No log	4.4944	400	0.9779	0.3015	0.9779	0.9889
No log	4.5169	402	1.0222	0.2824	1.0222	1.0110
No log	4.5393	404	1.1459	0.2763	1.1459	1.0705
No log	4.5618	406	1.2059	0.3574	1.2059	1.0981
No log	4.5843	408	1.1755	0.3047	1.1755	1.0842
No log	4.6067	410	1.0968	0.2986	1.0968	1.0473
No log	4.6292	412	1.0600	0.2805	1.0600	1.0296
No log	4.6517	414	1.0652	0.2805	1.0652	1.0321
No log	4.6742	416	1.1126	0.3355	1.1126	1.0548
No log	4.6966	418	1.1837	0.2789	1.1837	1.0880
No log	4.7191	420	1.1837	0.2789	1.1837	1.0880
No log	4.7416	422	1.1302	0.2565	1.1302	1.0631
No log	4.7640	424	1.0699	0.2555	1.0699	1.0343
No log	4.7865	426	1.0597	0.2555	1.0597	1.0294
No log	4.8090	428	1.0990	0.2750	1.0990	1.0484
No log	4.8315	430	1.1558	0.3277	1.1558	1.0751
No log	4.8539	432	1.1347	0.3277	1.1347	1.0652
No log	4.8764	434	1.1096	0.3028	1.1096	1.0534
No log	4.8989	436	1.0656	0.3078	1.0656	1.0323
No log	4.9213	438	1.0739	0.2750	1.0739	1.0363
No log	4.9438	440	1.0674	0.2938	1.0674	1.0331
No log	4.9663	442	1.0283	0.2461	1.0283	1.0140
No log	4.9888	444	1.0216	0.2555	1.0216	1.0107
No log	5.0112	446	1.0293	0.2748	1.0293	1.0145
No log	5.0337	448	1.0877	0.2939	1.0877	1.0429
No log	5.0562	450	1.1898	0.3166	1.1898	1.0908
No log	5.0787	452	1.2107	0.3166	1.2107	1.1003
No log	5.1011	454	1.1051	0.2631	1.1051	1.0512
No log	5.1236	456	1.0810	0.2554	1.0810	1.0397
No log	5.1461	458	1.1509	0.2833	1.1509	1.0728
No log	5.1685	460	1.1611	0.2833	1.1611	1.0776
No log	5.1910	462	1.0747	0.2631	1.0747	1.0367
No log	5.2135	464	0.9917	0.4247	0.9917	0.9958
No log	5.2360	466	0.9706	0.4425	0.9706	0.9852
No log	5.2584	468	1.0014	0.3928	1.0014	1.0007
No log	5.2809	470	1.0699	0.3171	1.0699	1.0344
No log	5.3034	472	1.1480	0.3384	1.1480	1.0715
No log	5.3258	474	1.1919	0.3595	1.1919	1.0917
No log	5.3483	476	1.0518	0.3512	1.0518	1.0256
No log	5.3708	478	0.9066	0.4712	0.9066	0.9522
No log	5.3933	480	0.9847	0.4293	0.9847	0.9923
No log	5.4157	482	1.0399	0.4598	1.0399	1.0197
No log	5.4382	484	0.9725	0.3623	0.9725	0.9861
No log	5.4607	486	0.9172	0.4267	0.9172	0.9577
No log	5.4831	488	0.9718	0.4489	0.9718	0.9858
No log	5.5056	490	1.0139	0.4489	1.0139	1.0069
No log	5.5281	492	0.9579	0.4543	0.9579	0.9787
No log	5.5506	494	0.9144	0.4600	0.9144	0.9562
No log	5.5730	496	0.9196	0.3788	0.9196	0.9589
No log	5.5955	498	0.9061	0.4477	0.9061	0.9519
0.366	5.6180	500	0.9563	0.5062	0.9563	0.9779
0.366	5.6404	502	1.1484	0.3902	1.1484	1.0716
0.366	5.6629	504	1.2013	0.4199	1.2013	1.0961
0.366	5.6854	506	1.1012	0.3874	1.1012	1.0494
0.366	5.7079	508	0.9362	0.4335	0.9362	0.9676
0.366	5.7303	510	0.9339	0.3930	0.9339	0.9664

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1