ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2732
• Qwk: 0.3004
• Mse: 1.2732
• Rmse: 1.1284

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.6387	-0.0132	4.6387	2.1538
No log	0.2667	4	3.4697	-0.0119	3.4697	1.8627
No log	0.4	6	1.8473	0.0504	1.8473	1.3591
No log	0.5333	8	1.5607	0.0227	1.5607	1.2493
No log	0.6667	10	1.6511	0.0082	1.6511	1.2850
No log	0.8	12	1.6908	-0.0064	1.6908	1.3003
No log	0.9333	14	1.5828	-0.0277	1.5828	1.2581
No log	1.0667	16	1.3686	0.0961	1.3686	1.1699
No log	1.2	18	1.5185	0.1533	1.5185	1.2323
No log	1.3333	20	1.5982	0.0504	1.5982	1.2642
No log	1.4667	22	1.5629	0.0772	1.5629	1.2502
No log	1.6	24	1.5336	0.0905	1.5336	1.2384
No log	1.7333	26	1.5278	0.0905	1.5278	1.2360
No log	1.8667	28	1.8552	0.0946	1.8552	1.3621
No log	2.0	30	1.8364	0.1202	1.8364	1.3551
No log	2.1333	32	1.6756	0.2002	1.6756	1.2944
No log	2.2667	34	1.8821	0.0972	1.8821	1.3719
No log	2.4	36	1.9304	0.1147	1.9304	1.3894
No log	2.5333	38	1.5921	0.2638	1.5921	1.2618
No log	2.6667	40	1.1573	0.2516	1.1573	1.0758
No log	2.8	42	1.1019	0.2467	1.1019	1.0497
No log	2.9333	44	1.2262	0.2516	1.2262	1.1073
No log	3.0667	46	1.5889	0.2005	1.5889	1.2605
No log	3.2	48	1.9585	0.1995	1.9585	1.3995
No log	3.3333	50	1.9105	0.2060	1.9105	1.3822
No log	3.4667	52	1.4605	0.0796	1.4605	1.2085
No log	3.6	54	1.2494	0.2439	1.2494	1.1178
No log	3.7333	56	1.1659	0.2432	1.1659	1.0798
No log	3.8667	58	1.1465	0.2672	1.1465	1.0707
No log	4.0	60	1.2522	0.3075	1.2522	1.1190
No log	4.1333	62	1.7916	0.1913	1.7916	1.3385
No log	4.2667	64	2.2053	0.1188	2.2053	1.4850
No log	4.4	66	2.3862	0.1393	2.3862	1.5447
No log	4.5333	68	1.8249	0.2049	1.8249	1.3509
No log	4.6667	70	1.5075	0.3184	1.5075	1.2278
No log	4.8	72	1.2182	0.2464	1.2182	1.1037
No log	4.9333	74	1.1606	0.2561	1.1606	1.0773
No log	5.0667	76	1.1812	0.2871	1.1812	1.0868
No log	5.2	78	1.2700	0.2864	1.2700	1.1269
No log	5.3333	80	1.3254	0.2202	1.3254	1.1513
No log	5.4667	82	1.3166	0.2690	1.3166	1.1474
No log	5.6	84	1.3980	0.2607	1.3980	1.1824
No log	5.7333	86	1.4704	0.2982	1.4704	1.2126
No log	5.8667	88	1.6627	0.2429	1.6627	1.2894
No log	6.0	90	1.6842	0.2256	1.6842	1.2978
No log	6.1333	92	1.3750	0.3496	1.3750	1.1726
No log	6.2667	94	1.1467	0.3399	1.1467	1.0708
No log	6.4	96	1.1091	0.2925	1.1091	1.0531
No log	6.5333	98	1.3070	0.3737	1.3070	1.1433
No log	6.6667	100	1.7268	0.2336	1.7268	1.3141
No log	6.8	102	1.6630	0.2132	1.6630	1.2896
No log	6.9333	104	1.2172	0.4420	1.2172	1.1033
No log	7.0667	106	1.1101	0.3162	1.1101	1.0536
No log	7.2	108	1.1675	0.3596	1.1675	1.0805
No log	7.3333	110	1.4808	0.1745	1.4808	1.2169
No log	7.4667	112	1.5570	0.2270	1.5570	1.2478
No log	7.6	114	1.3654	0.2266	1.3654	1.1685
No log	7.7333	116	1.2026	0.3231	1.2026	1.0966
No log	7.8667	118	1.1882	0.2947	1.1882	1.0900
No log	8.0	120	1.3026	0.2964	1.3027	1.1413
No log	8.1333	122	1.7009	0.2435	1.7009	1.3042
No log	8.2667	124	1.8050	0.1582	1.8050	1.3435
No log	8.4	126	1.4809	0.2679	1.4809	1.2169
No log	8.5333	128	1.1355	0.3480	1.1355	1.0656
No log	8.6667	130	1.0843	0.3741	1.0843	1.0413
No log	8.8	132	1.1732	0.3761	1.1732	1.0831
No log	8.9333	134	1.2577	0.3512	1.2577	1.1215
No log	9.0667	136	1.2582	0.3512	1.2582	1.1217
No log	9.2	138	1.3736	0.3451	1.3736	1.1720
No log	9.3333	140	1.2748	0.3570	1.2748	1.1291
No log	9.4667	142	1.1715	0.3902	1.1715	1.0824
No log	9.6	144	1.1813	0.3902	1.1813	1.0869
No log	9.7333	146	1.1389	0.3960	1.1389	1.0672
No log	9.8667	148	1.1759	0.4191	1.1759	1.0844
No log	10.0	150	1.3434	0.3766	1.3434	1.1591
No log	10.1333	152	1.3032	0.3650	1.3032	1.1416
No log	10.2667	154	1.1262	0.4191	1.1262	1.0612
No log	10.4	156	1.0610	0.3826	1.0610	1.0300
No log	10.5333	158	1.0370	0.3782	1.0370	1.0183
No log	10.6667	160	1.0846	0.3948	1.0846	1.0414
No log	10.8	162	1.2655	0.3490	1.2655	1.1249
No log	10.9333	164	1.3396	0.3722	1.3396	1.1574
No log	11.0667	166	1.1972	0.3354	1.1972	1.0941
No log	11.2	168	1.0343	0.3312	1.0343	1.0170
No log	11.3333	170	1.0308	0.3741	1.0308	1.0153
No log	11.4667	172	1.1362	0.4018	1.1362	1.0659
No log	11.6	174	1.2405	0.3233	1.2405	1.1138
No log	11.7333	176	1.2316	0.3454	1.2316	1.1098
No log	11.8667	178	1.1403	0.3330	1.1403	1.0679
No log	12.0	180	1.0480	0.4102	1.0480	1.0237
No log	12.1333	182	1.0799	0.3859	1.0799	1.0392
No log	12.2667	184	1.2222	0.2944	1.2222	1.1055
No log	12.4	186	1.2476	0.3004	1.2476	1.1169
No log	12.5333	188	1.2075	0.3254	1.2075	1.0988
No log	12.6667	190	1.1608	0.4122	1.1608	1.0774
No log	12.8	192	1.0637	0.4176	1.0637	1.0314
No log	12.9333	194	1.0208	0.3902	1.0208	1.0104
No log	13.0667	196	1.0406	0.3678	1.0406	1.0201
No log	13.2	198	1.1566	0.3949	1.1566	1.0755
No log	13.3333	200	1.3621	0.3219	1.3621	1.1671
No log	13.4667	202	1.3419	0.3168	1.3419	1.1584
No log	13.6	204	1.1662	0.3431	1.1662	1.0799
No log	13.7333	206	1.0896	0.3707	1.0896	1.0438
No log	13.8667	208	1.0714	0.3707	1.0714	1.0351
No log	14.0	210	1.1376	0.3215	1.1376	1.0666
No log	14.1333	212	1.1890	0.3839	1.1890	1.0904
No log	14.2667	214	1.3203	0.3304	1.3203	1.1491
No log	14.4	216	1.4305	0.3019	1.4305	1.1960
No log	14.5333	218	1.2809	0.3622	1.2809	1.1318
No log	14.6667	220	1.1417	0.4139	1.1417	1.0685
No log	14.8	222	1.0977	0.3952	1.0977	1.0477
No log	14.9333	224	1.1633	0.4139	1.1633	1.0786
No log	15.0667	226	1.2192	0.3111	1.2192	1.1042
No log	15.2	228	1.2030	0.3410	1.2030	1.0968
No log	15.3333	230	1.1568	0.3798	1.1568	1.0756
No log	15.4667	232	1.1621	0.3798	1.1621	1.0780
No log	15.6	234	1.2693	0.3026	1.2693	1.1266
No log	15.7333	236	1.1874	0.3798	1.1874	1.0897
No log	15.8667	238	1.1433	0.3976	1.1433	1.0693
No log	16.0	240	1.1103	0.4156	1.1103	1.0537
No log	16.1333	242	1.0872	0.3767	1.0872	1.0427
No log	16.2667	244	1.1613	0.3672	1.1613	1.0776
No log	16.4	246	1.2633	0.3188	1.2633	1.1240
No log	16.5333	248	1.3342	0.2890	1.3342	1.1551
No log	16.6667	250	1.1906	0.3382	1.1906	1.0911
No log	16.8	252	1.1196	0.3941	1.1196	1.0581
No log	16.9333	254	1.0562	0.4297	1.0562	1.0277
No log	17.0667	256	1.0841	0.3868	1.0841	1.0412
No log	17.2	258	1.2331	0.3701	1.2331	1.1105
No log	17.3333	260	1.2397	0.3467	1.2397	1.1134
No log	17.4667	262	1.1326	0.4055	1.1326	1.0643
No log	17.6	264	1.0830	0.3691	1.0830	1.0406
No log	17.7333	266	1.0990	0.3735	1.0990	1.0483
No log	17.8667	268	1.1734	0.3856	1.1734	1.0832
No log	18.0	270	1.1450	0.3935	1.1450	1.0701
No log	18.1333	272	1.1663	0.4125	1.1663	1.0799
No log	18.2667	274	1.2475	0.4186	1.2475	1.1169
No log	18.4	276	1.2421	0.3778	1.2421	1.1145
No log	18.5333	278	1.2476	0.3772	1.2476	1.1170
No log	18.6667	280	1.2205	0.3730	1.2205	1.1048
No log	18.8	282	1.1098	0.3675	1.1098	1.0535
No log	18.9333	284	1.0790	0.3448	1.0790	1.0388
No log	19.0667	286	1.0822	0.3418	1.0822	1.0403
No log	19.2	288	1.1282	0.3602	1.1282	1.0622
No log	19.3333	290	1.2204	0.3339	1.2204	1.1047
No log	19.4667	292	1.2505	0.3395	1.2505	1.1183
No log	19.6	294	1.2391	0.3772	1.2391	1.1132
No log	19.7333	296	1.1866	0.3704	1.1866	1.0893
No log	19.8667	298	1.1210	0.3913	1.1210	1.0588
No log	20.0	300	1.1192	0.3797	1.1192	1.0579
No log	20.1333	302	1.1301	0.3832	1.1301	1.0630
No log	20.2667	304	1.1829	0.3768	1.1829	1.0876
No log	20.4	306	1.2852	0.3188	1.2852	1.1337
No log	20.5333	308	1.2508	0.3497	1.2508	1.1184
No log	20.6667	310	1.1702	0.3467	1.1702	1.0818
No log	20.8	312	1.1682	0.3606	1.1682	1.0808
No log	20.9333	314	1.2441	0.3719	1.2441	1.1154
No log	21.0667	316	1.3524	0.3462	1.3524	1.1629
No log	21.2	318	1.4332	0.2490	1.4332	1.1972
No log	21.3333	320	1.4024	0.3309	1.4024	1.1842
No log	21.4667	322	1.2674	0.3410	1.2674	1.1258
No log	21.6	324	1.1691	0.4021	1.1691	1.0812
No log	21.7333	326	1.1664	0.4021	1.1664	1.0800
No log	21.8667	328	1.2379	0.3410	1.2379	1.1126
No log	22.0	330	1.2314	0.3410	1.2314	1.1097
No log	22.1333	332	1.1950	0.3497	1.1950	1.0931
No log	22.2667	334	1.1623	0.3798	1.1623	1.0781
No log	22.4	336	1.1486	0.3798	1.1486	1.0717
No log	22.5333	338	1.1552	0.4009	1.1552	1.0748
No log	22.6667	340	1.1659	0.4009	1.1659	1.0798
No log	22.8	342	1.1761	0.4009	1.1761	1.0845
No log	22.9333	344	1.1383	0.4226	1.1383	1.0669
No log	23.0667	346	1.1241	0.4226	1.1241	1.0602
No log	23.2	348	1.2272	0.3918	1.2272	1.1078
No log	23.3333	350	1.3769	0.3585	1.3769	1.1734
No log	23.4667	352	1.4777	0.2321	1.4777	1.2156
No log	23.6	354	1.4214	0.3098	1.4214	1.1922
No log	23.7333	356	1.2157	0.4260	1.2157	1.1026
No log	23.8667	358	1.0952	0.3634	1.0952	1.0465
No log	24.0	360	1.0520	0.3056	1.0520	1.0257
No log	24.1333	362	1.1173	0.3887	1.1173	1.0570
No log	24.2667	364	1.2529	0.3959	1.2529	1.1193
No log	24.4	366	1.2727	0.3872	1.2727	1.1281
No log	24.5333	368	1.1507	0.4226	1.1507	1.0727
No log	24.6667	370	1.0521	0.3407	1.0521	1.0257
No log	24.8	372	1.0377	0.3441	1.0377	1.0187
No log	24.9333	374	1.0755	0.3862	1.0755	1.0370
No log	25.0667	376	1.2685	0.3872	1.2685	1.1263
No log	25.2	378	1.4239	0.2666	1.4239	1.1933
No log	25.3333	380	1.3698	0.2418	1.3698	1.1704
No log	25.4667	382	1.1803	0.4226	1.1803	1.0864
No log	25.6	384	1.0758	0.3694	1.0758	1.0372
No log	25.7333	386	1.0800	0.3353	1.0800	1.0392
No log	25.8667	388	1.1612	0.4015	1.1612	1.0776
No log	26.0	390	1.3012	0.3959	1.3012	1.1407
No log	26.1333	392	1.3451	0.3548	1.3451	1.1598
No log	26.2667	394	1.2461	0.3701	1.2461	1.1163
No log	26.4	396	1.1987	0.4015	1.1987	1.0948
No log	26.5333	398	1.1153	0.3459	1.1153	1.0561
No log	26.6667	400	1.0782	0.3855	1.0782	1.0383
No log	26.8	402	1.0725	0.3720	1.0725	1.0356
No log	26.9333	404	1.0992	0.3459	1.0992	1.0484
No log	27.0667	406	1.1278	0.3682	1.1278	1.0620
No log	27.2	408	1.1746	0.3497	1.1746	1.0838
No log	27.3333	410	1.1871	0.3719	1.1871	1.0896
No log	27.4667	412	1.1145	0.3682	1.1145	1.0557
No log	27.6	414	1.0560	0.3531	1.0560	1.0276
No log	27.7333	416	1.0356	0.3395	1.0356	1.0176
No log	27.8667	418	1.0426	0.3450	1.0426	1.0211
No log	28.0	420	1.0637	0.3415	1.0637	1.0314
No log	28.1333	422	1.1141	0.3375	1.1141	1.0555
No log	28.2667	424	1.1793	0.3897	1.1793	1.0860
No log	28.4	426	1.2656	0.3377	1.2656	1.1250
No log	28.5333	428	1.3953	0.3496	1.3953	1.1812
No log	28.6667	430	1.3711	0.3103	1.3711	1.1710
No log	28.8	432	1.2102	0.3701	1.2102	1.1001
No log	28.9333	434	1.0862	0.3519	1.0862	1.0422
No log	29.0667	436	1.0350	0.3490	1.0350	1.0173
No log	29.2	438	1.0363	0.3541	1.0363	1.0180
No log	29.3333	440	1.0855	0.3948	1.0855	1.0419
No log	29.4667	442	1.1579	0.3719	1.1579	1.0760
No log	29.6	444	1.2051	0.3410	1.2051	1.0978
No log	29.7333	446	1.2408	0.3612	1.2408	1.1139
No log	29.8667	448	1.2923	0.3660	1.2923	1.1368
No log	30.0	450	1.2811	0.3612	1.2811	1.1319
No log	30.1333	452	1.3339	0.3127	1.3339	1.1550
No log	30.2667	454	1.2889	0.3612	1.2889	1.1353
No log	30.4	456	1.1878	0.3137	1.1878	1.0899
No log	30.5333	458	1.0944	0.3877	1.0944	1.0461
No log	30.6667	460	1.0624	0.3579	1.0624	1.0307
No log	30.8	462	1.0602	0.4048	1.0602	1.0297
No log	30.9333	464	1.1102	0.3534	1.1102	1.0536
No log	31.0667	466	1.2097	0.3612	1.2097	1.0999
No log	31.2	468	1.2600	0.3523	1.2600	1.1225
No log	31.3333	470	1.2599	0.3523	1.2599	1.1225
No log	31.4667	472	1.2241	0.3612	1.2241	1.1064
No log	31.6	474	1.1561	0.3923	1.1561	1.0752
No log	31.7333	476	1.1075	0.3731	1.1075	1.0524
No log	31.8667	478	1.1162	0.3531	1.1162	1.0565
No log	32.0	480	1.1543	0.3385	1.1543	1.0744
No log	32.1333	482	1.2401	0.3612	1.2401	1.1136
No log	32.2667	484	1.3125	0.3133	1.3125	1.1457
No log	32.4	486	1.2494	0.3612	1.2494	1.1178
No log	32.5333	488	1.1414	0.3534	1.1414	1.0684
No log	32.6667	490	1.0884	0.3617	1.0884	1.0433
No log	32.8	492	1.0975	0.3531	1.0975	1.0476
No log	32.9333	494	1.1295	0.3843	1.1295	1.0628
No log	33.0667	496	1.2116	0.3701	1.2116	1.1007
No log	33.2	498	1.2424	0.3701	1.2424	1.1146
0.2673	33.3333	500	1.2709	0.3238	1.2709	1.1273
0.2673	33.4667	502	1.2440	0.3701	1.2440	1.1153
0.2673	33.6	504	1.1809	0.3701	1.1809	1.0867
0.2673	33.7333	506	1.1285	0.3939	1.1285	1.0623
0.2673	33.8667	508	1.1269	0.3939	1.1269	1.0615
0.2673	34.0	510	1.1685	0.3701	1.1685	1.0810
0.2673	34.1333	512	1.2190	0.3612	1.2190	1.1041
0.2673	34.2667	514	1.2106	0.3701	1.2106	1.1003
0.2673	34.4	516	1.1627	0.3404	1.1627	1.0783
0.2673	34.5333	518	1.1187	0.3363	1.1187	1.0577
0.2673	34.6667	520	1.0868	0.3694	1.0868	1.0425
0.2673	34.8	522	1.1025	0.3393	1.1025	1.0500
0.2673	34.9333	524	1.1332	0.3393	1.1332	1.0645
0.2673	35.0667	526	1.1874	0.3546	1.1874	1.0897
0.2673	35.2	528	1.2398	0.3633	1.2398	1.1135
0.2673	35.3333	530	1.2523	0.3633	1.2523	1.1191
0.2673	35.4667	532	1.2351	0.3584	1.2351	1.1114
0.2673	35.6	534	1.2782	0.3449	1.2782	1.1306
0.2673	35.7333	536	1.3466	0.2564	1.3466	1.1604
0.2673	35.8667	538	1.3441	0.2489	1.3441	1.1593
0.2673	36.0	540	1.3261	0.2631	1.3261	1.1516
0.2673	36.1333	542	1.2753	0.3471	1.2753	1.1293
0.2673	36.2667	544	1.2313	0.3415	1.2313	1.1096
0.2673	36.4	546	1.2289	0.3415	1.2289	1.1085
0.2673	36.5333	548	1.2395	0.3415	1.2395	1.1133
0.2673	36.6667	550	1.2231	0.3415	1.2231	1.1060
0.2673	36.8	552	1.2260	0.3471	1.2260	1.1072
0.2673	36.9333	554	1.3105	0.2704	1.3105	1.1448
0.2673	37.0667	556	1.4105	0.1863	1.4105	1.1876
0.2673	37.2	558	1.3872	0.2350	1.3872	1.1778
0.2673	37.3333	560	1.3131	0.2922	1.3131	1.1459
0.2673	37.4667	562	1.2732	0.3004	1.2732	1.1284

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1