ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0460
• Qwk: 0.3115
• Mse: 1.0460
• Rmse: 1.0228

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0213	2	5.0138	-0.0132	5.0138	2.2392
No log	0.0426	4	2.8177	0.0226	2.8177	1.6786
No log	0.0638	6	2.2609	-0.0846	2.2609	1.5036
No log	0.0851	8	1.8782	0.0062	1.8782	1.3705
No log	0.1064	10	1.5199	0.0635	1.5199	1.2329
No log	0.1277	12	1.2820	-0.0031	1.2820	1.1323
No log	0.1489	14	1.3440	-0.0973	1.3440	1.1593
No log	0.1702	16	1.9527	0.0915	1.9527	1.3974
No log	0.1915	18	2.9774	-0.0767	2.9774	1.7255
No log	0.2128	20	4.0133	0.0008	4.0133	2.0033
No log	0.2340	22	3.5167	0.0357	3.5167	1.8753
No log	0.2553	24	2.1706	0.0297	2.1706	1.4733
No log	0.2766	26	1.6397	0.0681	1.6397	1.2805
No log	0.2979	28	1.3946	0.0704	1.3946	1.1809
No log	0.3191	30	1.3760	0.1260	1.3760	1.1730
No log	0.3404	32	1.3933	0.0408	1.3933	1.1804
No log	0.3617	34	1.4184	0.0561	1.4184	1.1910
No log	0.3830	36	1.4318	0.0784	1.4318	1.1966
No log	0.4043	38	1.3857	0.0635	1.3857	1.1771
No log	0.4255	40	1.3757	0.0961	1.3757	1.1729
No log	0.4468	42	1.5256	0.2224	1.5256	1.2352
No log	0.4681	44	2.0842	0.1030	2.0842	1.4437
No log	0.4894	46	2.0954	0.0860	2.0954	1.4475
No log	0.5106	48	1.9503	0.1144	1.9503	1.3965
No log	0.5319	50	1.3435	0.1379	1.3435	1.1591
No log	0.5532	52	1.2487	0.1230	1.2487	1.1175
No log	0.5745	54	1.4633	0.2020	1.4633	1.2097
No log	0.5957	56	2.0280	0.1595	2.0280	1.4241
No log	0.6170	58	2.3736	0.0611	2.3736	1.5406
No log	0.6383	60	2.5705	0.0445	2.5705	1.6033
No log	0.6596	62	2.1657	0.1597	2.1657	1.4716
No log	0.6809	64	1.5529	0.0331	1.5529	1.2461
No log	0.7021	66	1.2420	0.1260	1.2420	1.1144
No log	0.7234	68	1.1769	0.2478	1.1769	1.0848
No log	0.7447	70	1.1763	0.2478	1.1763	1.0846
No log	0.7660	72	1.2833	0.1168	1.2833	1.1328
No log	0.7872	74	1.3218	0.1472	1.3218	1.1497
No log	0.8085	76	1.4352	0.1346	1.4352	1.1980
No log	0.8298	78	1.7740	0.0355	1.7740	1.3319
No log	0.8511	80	1.8509	0.0482	1.8509	1.3605
No log	0.8723	82	1.6177	0.0275	1.6177	1.2719
No log	0.8936	84	1.3811	0.1110	1.3811	1.1752
No log	0.9149	86	1.3337	0.1437	1.3337	1.1548
No log	0.9362	88	1.3771	0.1110	1.3771	1.1735
No log	0.9574	90	1.6434	0.1516	1.6434	1.2819
No log	0.9787	92	1.9889	0.0946	1.9889	1.4103
No log	1.0	94	1.8446	0.0517	1.8446	1.3582
No log	1.0213	96	1.4293	0.1438	1.4293	1.1955
No log	1.0426	98	1.1629	0.3080	1.1629	1.0784
No log	1.0638	100	1.1416	0.3473	1.1416	1.0685
No log	1.0851	102	1.1858	0.2026	1.1858	1.0889
No log	1.1064	104	1.3764	0.1199	1.3764	1.1732
No log	1.1277	106	1.6255	0.1334	1.6255	1.2750
No log	1.1489	108	1.7951	0.1249	1.7951	1.3398
No log	1.1702	110	1.7275	0.1249	1.7275	1.3144
No log	1.1915	112	1.5399	0.2029	1.5399	1.2409
No log	1.2128	114	1.3414	0.1713	1.3414	1.1582
No log	1.2340	116	1.1932	0.2170	1.1932	1.0923
No log	1.2553	118	1.0264	0.4288	1.0264	1.0131
No log	1.2766	120	1.0325	0.4514	1.0325	1.0161
No log	1.2979	122	1.0386	0.3250	1.0386	1.0191
No log	1.3191	124	1.0262	0.3230	1.0262	1.0130
No log	1.3404	126	1.1094	0.2342	1.1094	1.0533
No log	1.3617	128	1.2556	0.2690	1.2556	1.1205
No log	1.3830	130	1.2537	0.2277	1.2537	1.1197
No log	1.4043	132	1.4834	0.3002	1.4834	1.2180
No log	1.4255	134	1.7651	0.1701	1.7651	1.3286
No log	1.4468	136	1.5991	0.2111	1.5991	1.2646
No log	1.4681	138	1.3659	0.2099	1.3659	1.1687
No log	1.4894	140	1.4984	0.2191	1.4984	1.2241
No log	1.5106	142	1.8098	0.1246	1.8098	1.3453
No log	1.5319	144	1.7530	0.1336	1.7530	1.3240
No log	1.5532	146	1.3889	0.2295	1.3889	1.1785
No log	1.5745	148	1.1307	0.2740	1.1307	1.0634
No log	1.5957	150	1.1133	0.2694	1.1133	1.0551
No log	1.6170	152	1.2176	0.2273	1.2176	1.1034
No log	1.6383	154	1.4075	0.2411	1.4075	1.1864
No log	1.6596	156	1.3679	0.2347	1.3679	1.1696
No log	1.6809	158	1.2910	0.3008	1.2910	1.1362
No log	1.7021	160	1.1760	0.4108	1.1760	1.0844
No log	1.7234	162	1.2183	0.3517	1.2183	1.1038
No log	1.7447	164	1.4281	0.1978	1.4281	1.1950
No log	1.7660	166	1.5922	0.2063	1.5922	1.2618
No log	1.7872	168	1.5888	0.2285	1.5888	1.2605
No log	1.8085	170	1.3512	0.2451	1.3512	1.1624
No log	1.8298	172	1.1777	0.2128	1.1777	1.0852
No log	1.8511	174	1.1359	0.3399	1.1359	1.0658
No log	1.8723	176	1.1774	0.2180	1.1774	1.0851
No log	1.8936	178	1.3833	0.2053	1.3833	1.1761
No log	1.9149	180	1.4364	0.2053	1.4364	1.1985
No log	1.9362	182	1.3248	0.1865	1.3248	1.1510
No log	1.9574	184	1.2727	0.3073	1.2727	1.1281
No log	1.9787	186	1.3226	0.3554	1.3226	1.1500
No log	2.0	188	1.5785	0.2196	1.5785	1.2564
No log	2.0213	190	1.9704	0.1227	1.9704	1.4037
No log	2.0426	192	1.8416	0.2238	1.8416	1.3570
No log	2.0638	194	1.4613	0.2730	1.4613	1.2088
No log	2.0851	196	1.2116	0.3216	1.2116	1.1007
No log	2.1064	198	1.1869	0.3361	1.1869	1.0894
No log	2.1277	200	1.2387	0.2170	1.2387	1.1130
No log	2.1489	202	1.2744	0.2459	1.2744	1.1289
No log	2.1702	204	1.3411	0.2280	1.3411	1.1581
No log	2.1915	206	1.3016	0.2316	1.3016	1.1409
No log	2.2128	208	1.1455	0.3108	1.1455	1.0703
No log	2.2340	210	1.1193	0.2969	1.1193	1.0580
No log	2.2553	212	1.1120	0.3180	1.1120	1.0545
No log	2.2766	214	1.1906	0.2476	1.1906	1.0911
No log	2.2979	216	1.3789	0.2191	1.3789	1.1743
No log	2.3191	218	1.4393	0.2454	1.4393	1.1997
No log	2.3404	220	1.3113	0.3287	1.3113	1.1451
No log	2.3617	222	1.1879	0.3459	1.1879	1.0899
No log	2.3830	224	1.2079	0.3408	1.2079	1.0991
No log	2.4043	226	1.3377	0.3663	1.3377	1.1566
No log	2.4255	228	1.6074	0.3062	1.6074	1.2678
No log	2.4468	230	1.4519	0.3590	1.4519	1.2050
No log	2.4681	232	1.2141	0.3025	1.2141	1.1018
No log	2.4894	234	1.0654	0.3827	1.0654	1.0322
No log	2.5106	236	1.0615	0.3789	1.0615	1.0303
No log	2.5319	238	1.0561	0.4160	1.0561	1.0277
No log	2.5532	240	1.0768	0.3562	1.0768	1.0377
No log	2.5745	242	1.0990	0.3374	1.0990	1.0483
No log	2.5957	244	1.0951	0.3558	1.0951	1.0465
No log	2.6170	246	1.0815	0.3737	1.0815	1.0399
No log	2.6383	248	1.1637	0.2924	1.1637	1.0787
No log	2.6596	250	1.3827	0.3462	1.3827	1.1759
No log	2.6809	252	1.5496	0.2933	1.5496	1.2448
No log	2.7021	254	1.4851	0.3119	1.4851	1.2186
No log	2.7234	256	1.2738	0.2740	1.2738	1.1286
No log	2.7447	258	1.1966	0.2120	1.1966	1.0939
No log	2.7660	260	1.2704	0.2492	1.2704	1.1271
No log	2.7872	262	1.6035	0.2212	1.6035	1.2663
No log	2.8085	264	1.7851	0.1683	1.7851	1.3361
No log	2.8298	266	1.6490	0.1136	1.6490	1.2842
No log	2.8511	268	1.3855	0.2049	1.3855	1.1771
No log	2.8723	270	1.3159	0.2732	1.3159	1.1471
No log	2.8936	272	1.2836	0.3031	1.2836	1.1330
No log	2.9149	274	1.2502	0.3031	1.2502	1.1181
No log	2.9362	276	1.1323	0.2942	1.1323	1.0641
No log	2.9574	278	1.0924	0.2730	1.0924	1.0452
No log	2.9787	280	1.1309	0.3298	1.1309	1.0634
No log	3.0	282	1.1593	0.3050	1.1593	1.0767
No log	3.0213	284	1.3199	0.3870	1.3199	1.1489
No log	3.0426	286	1.3536	0.3870	1.3536	1.1634
No log	3.0638	288	1.1962	0.3197	1.1962	1.0937
No log	3.0851	290	1.0761	0.2832	1.0761	1.0373
No log	3.1064	292	1.0409	0.2851	1.0409	1.0203
No log	3.1277	294	1.0749	0.3126	1.0749	1.0368
No log	3.1489	296	1.0838	0.2805	1.0838	1.0410
No log	3.1702	298	1.0960	0.3126	1.0960	1.0469
No log	3.1915	300	1.1233	0.3371	1.1233	1.0599
No log	3.2128	302	1.1203	0.3101	1.1203	1.0584
No log	3.2340	304	1.1519	0.3391	1.1519	1.0733
No log	3.2553	306	1.2777	0.3067	1.2777	1.1304
No log	3.2766	308	1.4857	0.2913	1.4857	1.2189
No log	3.2979	310	1.4706	0.2877	1.4706	1.2127
No log	3.3191	312	1.3142	0.2765	1.3142	1.1464
No log	3.3404	314	1.1842	0.2504	1.1842	1.0882
No log	3.3617	316	1.1170	0.3293	1.1170	1.0569
No log	3.3830	318	1.1092	0.2944	1.1092	1.0532
No log	3.4043	320	1.1396	0.1779	1.1396	1.0675
No log	3.4255	322	1.2811	0.2762	1.2811	1.1319
No log	3.4468	324	1.3020	0.2923	1.3020	1.1410
No log	3.4681	326	1.2211	0.2805	1.2211	1.1050
No log	3.4894	328	1.1895	0.2821	1.1895	1.0906
No log	3.5106	330	1.2676	0.2698	1.2676	1.1259
No log	3.5319	332	1.3587	0.3398	1.3587	1.1657
No log	3.5532	334	1.3720	0.3347	1.3720	1.1713
No log	3.5745	336	1.2408	0.2900	1.2408	1.1139
No log	3.5957	338	1.1288	0.2608	1.1288	1.0624
No log	3.6170	340	1.1994	0.2739	1.1994	1.0952
No log	3.6383	342	1.2671	0.3006	1.2671	1.1257
No log	3.6596	344	1.3411	0.3271	1.3411	1.1581
No log	3.6809	346	1.1416	0.3720	1.1416	1.0685
No log	3.7021	348	1.0869	0.4462	1.0869	1.0425
No log	3.7234	350	1.0619	0.4229	1.0619	1.0305
No log	3.7447	352	1.0488	0.3678	1.0488	1.0241
No log	3.7660	354	1.0676	0.3297	1.0676	1.0333
No log	3.7872	356	1.0944	0.3322	1.0944	1.0461
No log	3.8085	358	1.1062	0.3070	1.1062	1.0517
No log	3.8298	360	1.0466	0.4020	1.0466	1.0230
No log	3.8511	362	1.0428	0.3601	1.0428	1.0212
No log	3.8723	364	1.0529	0.3908	1.0529	1.0261
No log	3.8936	366	1.0642	0.3887	1.0642	1.0316
No log	3.9149	368	1.0357	0.3764	1.0357	1.0177
No log	3.9362	370	1.0321	0.3059	1.0321	1.0159
No log	3.9574	372	1.0293	0.2588	1.0293	1.0146
No log	3.9787	374	1.0502	0.2730	1.0502	1.0248
No log	4.0	376	1.0536	0.2730	1.0536	1.0264
No log	4.0213	378	1.0591	0.2989	1.0591	1.0291
No log	4.0426	380	1.0493	0.2902	1.0493	1.0244
No log	4.0638	382	1.0600	0.2902	1.0600	1.0296
No log	4.0851	384	1.0709	0.2902	1.0709	1.0348
No log	4.1064	386	1.0653	0.3320	1.0653	1.0321
No log	4.1277	388	1.0777	0.2902	1.0777	1.0381
No log	4.1489	390	1.1795	0.3314	1.1795	1.0860
No log	4.1702	392	1.2180	0.3355	1.2180	1.1036
No log	4.1915	394	1.1132	0.2760	1.1132	1.0551
No log	4.2128	396	1.0390	0.3171	1.0391	1.0193
No log	4.2340	398	1.0175	0.3171	1.0175	1.0087
No log	4.2553	400	1.0087	0.2851	1.0087	1.0043
No log	4.2766	402	1.0859	0.3255	1.0859	1.0421
No log	4.2979	404	1.0802	0.3595	1.0802	1.0393
No log	4.3191	406	0.9970	0.3542	0.9970	0.9985
No log	4.3404	408	0.9936	0.4091	0.9936	0.9968
No log	4.3617	410	1.0076	0.3681	1.0076	1.0038
No log	4.3830	412	1.0263	0.2664	1.0263	1.0130
No log	4.4043	414	1.0914	0.2832	1.0914	1.0447
No log	4.4255	416	1.1231	0.2986	1.1231	1.0598
No log	4.4468	418	1.1536	0.3480	1.1536	1.0741
No log	4.4681	420	1.3336	0.3697	1.3336	1.1548
No log	4.4894	422	1.4712	0.3002	1.4712	1.2129
No log	4.5106	424	1.3668	0.3917	1.3668	1.1691
No log	4.5319	426	1.2031	0.3030	1.2031	1.0968
No log	4.5532	428	1.1042	0.3552	1.1042	1.0508
No log	4.5745	430	1.1317	0.2967	1.1317	1.0638
No log	4.5957	432	1.1859	0.3410	1.1859	1.0890
No log	4.6170	434	1.1978	0.3410	1.1978	1.0944
No log	4.6383	436	1.1394	0.3314	1.1394	1.0674
No log	4.6596	438	1.0323	0.3286	1.0323	1.0160
No log	4.6809	440	1.0293	0.3286	1.0293	1.0145
No log	4.7021	442	1.0724	0.2901	1.0724	1.0356
No log	4.7234	444	1.2446	0.3742	1.2446	1.1156
No log	4.7447	446	1.2955	0.4186	1.2955	1.1382
No log	4.7660	448	1.1429	0.3437	1.1429	1.0691
No log	4.7872	450	1.0742	0.3432	1.0742	1.0364
No log	4.8085	452	1.0238	0.3924	1.0238	1.0118
No log	4.8298	454	1.0134	0.3861	1.0134	1.0067
No log	4.8511	456	1.0156	0.3490	1.0156	1.0078
No log	4.8723	458	1.0770	0.3314	1.0770	1.0378
No log	4.8936	460	1.2342	0.3340	1.2342	1.1109
No log	4.9149	462	1.2556	0.3117	1.2556	1.1206
No log	4.9362	464	1.1388	0.3558	1.1388	1.0671
No log	4.9574	466	1.0820	0.2966	1.0820	1.0402
No log	4.9787	468	1.0848	0.2966	1.0848	1.0415
No log	5.0	470	1.1431	0.3633	1.1431	1.0692
No log	5.0213	472	1.3133	0.2863	1.3133	1.1460
No log	5.0426	474	1.3662	0.3485	1.3662	1.1689
No log	5.0638	476	1.2300	0.3384	1.2300	1.1090
No log	5.0851	478	1.0512	0.3056	1.0512	1.0253
No log	5.1064	480	1.0210	0.3949	1.0210	1.0104
No log	5.1277	482	1.0209	0.4073	1.0209	1.0104
No log	5.1489	484	1.0487	0.3459	1.0487	1.0241
No log	5.1702	486	1.0541	0.3361	1.0541	1.0267
No log	5.1915	488	1.0854	0.3812	1.0854	1.0418
No log	5.2128	490	1.1005	0.4055	1.1005	1.0491
No log	5.2340	492	1.1085	0.3883	1.1085	1.0529
No log	5.2553	494	1.1784	0.3670	1.1784	1.0856
No log	5.2766	496	1.1062	0.3755	1.1062	1.0518
No log	5.2979	498	1.0076	0.2740	1.0076	1.0038
0.3642	5.3191	500	1.0027	0.3818	1.0027	1.0013
0.3642	5.3404	502	1.0057	0.2709	1.0057	1.0028
0.3642	5.3617	504	1.0087	0.2454	1.0087	1.0043
0.3642	5.3830	506	1.0525	0.2501	1.0525	1.0259
0.3642	5.4043	508	1.0719	0.3497	1.0719	1.0353
0.3642	5.4255	510	1.0460	0.3115	1.0460	1.0228

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1