ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k5_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3177
• Qwk: 0.1652
• Mse: 1.3177
• Rmse: 1.1479

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.7476	0.0010	4.7476	2.1789
No log	0.2222	4	2.8391	-0.0278	2.8391	1.6850
No log	0.3333	6	2.1660	-0.0575	2.1660	1.4717
No log	0.4444	8	2.7209	-0.0778	2.7209	1.6495
No log	0.5556	10	2.2506	-0.0524	2.2506	1.5002
No log	0.6667	12	1.7245	0.0428	1.7245	1.3132
No log	0.7778	14	1.6260	0.1257	1.6260	1.2752
No log	0.8889	16	1.6942	0.1395	1.6942	1.3016
No log	1.0	18	1.6402	0.1395	1.6402	1.2807
No log	1.1111	20	1.4096	0.1459	1.4096	1.1873
No log	1.2222	22	1.3497	0.1779	1.3497	1.1618
No log	1.3333	24	1.5925	0.2005	1.5925	1.2619
No log	1.4444	26	1.5440	0.2653	1.5440	1.2426
No log	1.5556	28	1.8207	0.2021	1.8207	1.3493
No log	1.6667	30	2.0540	0.1019	2.0540	1.4332
No log	1.7778	32	1.7600	0.1824	1.7600	1.3267
No log	1.8889	34	1.3816	0.2605	1.3816	1.1754
No log	2.0	36	1.2574	0.1549	1.2574	1.1214
No log	2.1111	38	1.3069	0.2851	1.3069	1.1432
No log	2.2222	40	1.5706	0.3133	1.5706	1.2532
No log	2.3333	42	1.6028	0.3133	1.6028	1.2660
No log	2.4444	44	1.6233	0.2544	1.6233	1.2741
No log	2.5556	46	1.4258	0.2880	1.4258	1.1941
No log	2.6667	48	1.2478	0.2738	1.2478	1.1170
No log	2.7778	50	1.1830	0.2647	1.1830	1.0877
No log	2.8889	52	1.2579	0.2808	1.2579	1.1215
No log	3.0	54	1.3277	0.3144	1.3277	1.1523
No log	3.1111	56	1.4231	0.3056	1.4231	1.1930
No log	3.2222	58	1.7321	0.2808	1.7321	1.3161
No log	3.3333	60	1.9797	0.2853	1.9797	1.4070
No log	3.4444	62	1.5448	0.2658	1.5448	1.2429
No log	3.5556	64	1.0565	0.3556	1.0565	1.0279
No log	3.6667	66	1.0994	0.3455	1.0994	1.0485
No log	3.7778	68	1.1591	0.2218	1.1591	1.0766
No log	3.8889	70	1.0440	0.1935	1.0440	1.0218
No log	4.0	72	1.0822	0.2938	1.0822	1.0403
No log	4.1111	74	1.2919	0.2074	1.2919	1.1366
No log	4.2222	76	1.3029	0.2074	1.3029	1.1415
No log	4.3333	78	1.2480	0.2161	1.2480	1.1172
No log	4.4444	80	1.2352	0.2446	1.2352	1.1114
No log	4.5556	82	1.3092	0.1875	1.3092	1.1442
No log	4.6667	84	1.3898	0.1621	1.3898	1.1789
No log	4.7778	86	1.4169	0.1501	1.4169	1.1903
No log	4.8889	88	1.3393	0.1395	1.3393	1.1573
No log	5.0	90	1.1955	0.2702	1.1955	1.0934
No log	5.1111	92	1.1490	0.2824	1.1490	1.0719
No log	5.2222	94	1.1816	0.3436	1.1816	1.0870
No log	5.3333	96	1.2783	0.3361	1.2783	1.1306
No log	5.4444	98	1.5598	0.2526	1.5598	1.2489
No log	5.5556	100	1.8485	0.2052	1.8485	1.3596
No log	5.6667	102	1.7682	0.2246	1.7682	1.3297
No log	5.7778	104	1.3949	0.2469	1.3949	1.1811
No log	5.8889	106	1.1065	0.3033	1.1065	1.0519
No log	6.0	108	1.0707	0.4160	1.0707	1.0347
No log	6.1111	110	1.0603	0.3205	1.0603	1.0297
No log	6.2222	112	1.1192	0.2824	1.1192	1.0579
No log	6.3333	114	1.2779	0.2564	1.2779	1.1305
No log	6.4444	116	1.2175	0.2280	1.2175	1.1034
No log	6.5556	118	1.1052	0.2593	1.1052	1.0513
No log	6.6667	120	1.1127	0.2501	1.1127	1.0548
No log	6.7778	122	1.1054	0.2824	1.1054	1.0514
No log	6.8889	124	1.1137	0.2824	1.1137	1.0553
No log	7.0	126	1.0805	0.3397	1.0805	1.0395
No log	7.1111	128	1.1789	0.2985	1.1789	1.0858
No log	7.2222	130	1.1384	0.3584	1.1384	1.0670
No log	7.3333	132	1.0798	0.3812	1.0798	1.0391
No log	7.4444	134	1.1013	0.4246	1.1013	1.0494
No log	7.5556	136	1.1624	0.3682	1.1624	1.0781
No log	7.6667	138	1.2994	0.3087	1.2994	1.1399
No log	7.7778	140	1.3392	0.2922	1.3392	1.1573
No log	7.8889	142	1.2923	0.2789	1.2923	1.1368
No log	8.0	144	1.4526	0.2880	1.4526	1.2052
No log	8.1111	146	1.4075	0.3355	1.4075	1.1864
No log	8.2222	148	1.2356	0.2746	1.2356	1.1116
No log	8.3333	150	1.1451	0.2361	1.1451	1.0701
No log	8.4444	152	1.0979	0.4323	1.0979	1.0478
No log	8.5556	154	1.1120	0.3305	1.1120	1.0545
No log	8.6667	156	1.2412	0.2673	1.2412	1.1141
No log	8.7778	158	1.2851	0.2359	1.2851	1.1336
No log	8.8889	160	1.1901	0.3074	1.1901	1.0909
No log	9.0	162	1.1216	0.2501	1.1216	1.0591
No log	9.1111	164	1.1330	0.2501	1.1330	1.0644
No log	9.2222	166	1.2713	0.2746	1.2713	1.1275
No log	9.3333	168	1.4340	0.2602	1.4340	1.1975
No log	9.4444	170	1.3790	0.3290	1.3790	1.1743
No log	9.5556	172	1.3845	0.3204	1.3845	1.1766
No log	9.6667	174	1.2104	0.3111	1.2104	1.1002
No log	9.7778	176	1.1952	0.3111	1.1952	1.0933
No log	9.8889	178	1.2727	0.2798	1.2727	1.1281
No log	10.0	180	1.1620	0.3484	1.1620	1.0780
No log	10.1111	182	1.1292	0.3355	1.1292	1.0626
No log	10.2222	184	1.0969	0.4549	1.0969	1.0473
No log	10.3333	186	1.2070	0.3307	1.2070	1.0986
No log	10.4444	188	1.3476	0.3002	1.3476	1.1609
No log	10.5556	190	1.2029	0.3307	1.2029	1.0968
No log	10.6667	192	1.1533	0.2895	1.1533	1.0739
No log	10.7778	194	1.0789	0.3516	1.0789	1.0387
No log	10.8889	196	1.1043	0.2511	1.1043	1.0509
No log	11.0	198	1.2067	0.2507	1.2067	1.0985
No log	11.1111	200	1.1575	0.2796	1.1575	1.0759
No log	11.2222	202	1.1604	0.2654	1.1604	1.0772
No log	11.3333	204	1.1451	0.2366	1.1451	1.0701
No log	11.4444	206	1.2403	0.2597	1.2403	1.1137
No log	11.5556	208	1.4762	0.2223	1.4762	1.2150
No log	11.6667	210	1.5330	0.2593	1.5330	1.2381
No log	11.7778	212	1.2862	0.2529	1.2862	1.1341
No log	11.8889	214	1.1027	0.3584	1.1027	1.0501
No log	12.0	216	1.0848	0.3688	1.0848	1.0415
No log	12.1111	218	1.1207	0.3891	1.1207	1.0586
No log	12.2222	220	1.2448	0.2604	1.2448	1.1157
No log	12.3333	222	1.2321	0.2615	1.2321	1.1100
No log	12.4444	224	1.1313	0.3572	1.1313	1.0636
No log	12.5556	226	1.0688	0.2633	1.0688	1.0338
No log	12.6667	228	1.0695	0.2633	1.0695	1.0342
No log	12.7778	230	1.1407	0.2605	1.1407	1.0680
No log	12.8889	232	1.2795	0.3621	1.2795	1.1311
No log	13.0	234	1.2674	0.3466	1.2674	1.1258
No log	13.1111	236	1.0998	0.3312	1.0998	1.0487
No log	13.2222	238	1.0820	0.3607	1.0820	1.0402
No log	13.3333	240	1.0960	0.3648	1.0960	1.0469
No log	13.4444	242	1.1714	0.3008	1.1714	1.0823
No log	13.5556	244	1.1777	0.3008	1.1777	1.0852
No log	13.6667	246	1.1604	0.3056	1.1604	1.0772
No log	13.7778	248	1.2063	0.2467	1.2063	1.0983
No log	13.8889	250	1.2838	0.2895	1.2838	1.1330
No log	14.0	252	1.3982	0.2017	1.3982	1.1824
No log	14.1111	254	1.4189	0.2017	1.4189	1.1912
No log	14.2222	256	1.2895	0.2702	1.2895	1.1356
No log	14.3333	258	1.1903	0.2452	1.1903	1.0910
No log	14.4444	260	1.1982	0.1943	1.1982	1.0946
No log	14.5556	262	1.2337	0.2467	1.2337	1.1107
No log	14.6667	264	1.2229	0.2088	1.2229	1.1059
No log	14.7778	266	1.2148	0.1691	1.2148	1.1022
No log	14.8889	268	1.2034	0.0925	1.2034	1.0970
No log	15.0	270	1.2224	0.1503	1.2224	1.1056
No log	15.1111	272	1.2941	0.2374	1.2941	1.1376
No log	15.2222	274	1.4009	0.3061	1.4009	1.1836
No log	15.3333	276	1.3380	0.2757	1.3380	1.1567
No log	15.4444	278	1.1603	0.2311	1.1603	1.0772
No log	15.5556	280	1.1256	0.3085	1.1256	1.0609
No log	15.6667	282	1.1248	0.3113	1.1248	1.0606
No log	15.7778	284	1.1151	0.1975	1.1151	1.0560
No log	15.8889	286	1.1683	0.1996	1.1683	1.0809
No log	16.0	288	1.2648	0.2687	1.2648	1.1246
No log	16.1111	290	1.2696	0.3395	1.2696	1.1268
No log	16.2222	292	1.1354	0.2270	1.1354	1.0656
No log	16.3333	294	1.0934	0.3566	1.0934	1.0457
No log	16.4444	296	1.1028	0.3482	1.1028	1.0501
No log	16.5556	298	1.0914	0.2871	1.0914	1.0447
No log	16.6667	300	1.1638	0.2581	1.1638	1.0788
No log	16.7778	302	1.2953	0.3061	1.2953	1.1381
No log	16.8889	304	1.3126	0.3304	1.3126	1.1457
No log	17.0	306	1.1593	0.2806	1.1593	1.0767
No log	17.1111	308	1.0736	0.4232	1.0736	1.0362
No log	17.2222	310	1.0745	0.4232	1.0745	1.0366
No log	17.3333	312	1.0901	0.2871	1.0901	1.0441
No log	17.4444	314	1.1855	0.2266	1.1855	1.0888
No log	17.5556	316	1.2560	0.2520	1.2560	1.1207
No log	17.6667	318	1.1788	0.3144	1.1788	1.0857
No log	17.7778	320	1.1157	0.2779	1.1157	1.0563
No log	17.8889	322	1.0750	0.2544	1.0750	1.0368
No log	18.0	324	1.0690	0.3733	1.0690	1.0339
No log	18.1111	326	1.0869	0.2730	1.0869	1.0426
No log	18.2222	328	1.1647	0.2657	1.1647	1.0792
No log	18.3333	330	1.2782	0.3145	1.2782	1.1306
No log	18.4444	332	1.3373	0.3159	1.3373	1.1564
No log	18.5556	334	1.2583	0.3179	1.2583	1.1217
No log	18.6667	336	1.2301	0.2984	1.2301	1.1091
No log	18.7778	338	1.2907	0.3220	1.2907	1.1361
No log	18.8889	340	1.3533	0.2875	1.3533	1.1633
No log	19.0	342	1.4951	0.1977	1.4951	1.2228
No log	19.1111	344	1.5784	0.2338	1.5784	1.2564
No log	19.2222	346	1.4148	0.2430	1.4148	1.1895
No log	19.3333	348	1.2033	0.2984	1.2033	1.0970
No log	19.4444	350	1.0984	0.2169	1.0984	1.0480
No log	19.5556	352	1.0939	0.1517	1.0939	1.0459
No log	19.6667	354	1.1190	0.2461	1.1190	1.0578
No log	19.7778	356	1.2545	0.2825	1.2545	1.1200
No log	19.8889	358	1.3439	0.2411	1.3439	1.1593
No log	20.0	360	1.3368	0.1935	1.3368	1.1562
No log	20.1111	362	1.2445	0.3074	1.2445	1.1156
No log	20.2222	364	1.2170	0.3389	1.2170	1.1032
No log	20.3333	366	1.2068	0.3389	1.2068	1.0985
No log	20.4444	368	1.2033	0.3389	1.2033	1.0970
No log	20.5556	370	1.2762	0.2620	1.2762	1.1297
No log	20.6667	372	1.2654	0.3207	1.2654	1.1249
No log	20.7778	374	1.1934	0.3389	1.1934	1.0924
No log	20.8889	376	1.1651	0.2732	1.1651	1.0794
No log	21.0	378	1.1467	0.2273	1.1467	1.0709
No log	21.1111	380	1.1226	0.1785	1.1226	1.0595
No log	21.2222	382	1.1159	0.1766	1.1159	1.0563
No log	21.3333	384	1.1398	0.2521	1.1398	1.0676
No log	21.4444	386	1.2182	0.2459	1.2182	1.1037
No log	21.5556	388	1.3386	0.2554	1.3386	1.1570
No log	21.6667	390	1.3597	0.2744	1.3597	1.1661
No log	21.7778	392	1.2216	0.2772	1.2216	1.1053
No log	21.8889	394	1.1425	0.3397	1.1425	1.0689
No log	22.0	396	1.1606	0.3347	1.1606	1.0773
No log	22.1111	398	1.1808	0.2657	1.1808	1.0867
No log	22.2222	400	1.1994	0.2746	1.1994	1.0952
No log	22.3333	402	1.1393	0.2917	1.1393	1.0674
No log	22.4444	404	1.1328	0.2417	1.1328	1.0643
No log	22.5556	406	1.1578	0.2088	1.1578	1.0760
No log	22.6667	408	1.1495	0.1943	1.1495	1.0722
No log	22.7778	410	1.1702	0.2467	1.1702	1.0818
No log	22.8889	412	1.1353	0.1841	1.1353	1.0655
No log	23.0	414	1.1166	0.1841	1.1166	1.0567
No log	23.1111	416	1.1198	0.1841	1.1198	1.0582
No log	23.2222	418	1.1094	0.1841	1.1094	1.0533
No log	23.3333	420	1.1155	0.1990	1.1155	1.0562
No log	23.4444	422	1.1916	0.2100	1.1916	1.0916
No log	23.5556	424	1.3374	0.1984	1.3374	1.1564
No log	23.6667	426	1.3763	0.2236	1.3763	1.1731
No log	23.7778	428	1.2163	0.3028	1.2163	1.1029
No log	23.8889	430	1.1025	0.2088	1.1025	1.0500
No log	24.0	432	1.0669	0.3286	1.0669	1.0329
No log	24.1111	434	1.0634	0.4160	1.0634	1.0312
No log	24.2222	436	1.0695	0.3555	1.0695	1.0342
No log	24.3333	438	1.1756	0.2746	1.1756	1.0842
No log	24.4444	440	1.3459	0.2586	1.3459	1.1601
No log	24.5556	442	1.3039	0.2314	1.3039	1.1419
No log	24.6667	444	1.1445	0.2762	1.1445	1.0698
No log	24.7778	446	1.0566	0.3039	1.0566	1.0279
No log	24.8889	448	1.0838	0.2995	1.0838	1.0410
No log	25.0	450	1.0887	0.2995	1.0887	1.0434
No log	25.1111	452	1.0559	0.3652	1.0559	1.0276
No log	25.2222	454	1.0681	0.2795	1.0681	1.0335
No log	25.3333	456	1.2035	0.3028	1.2035	1.0971
No log	25.4444	458	1.3404	0.2075	1.3404	1.1578
No log	25.5556	460	1.3714	0.2357	1.3714	1.1711
No log	25.6667	462	1.2633	0.2663	1.2633	1.1240
No log	25.7778	464	1.1940	0.2734	1.1940	1.0927
No log	25.8889	466	1.1117	0.1943	1.1117	1.0544
No log	26.0	468	1.0964	0.2366	1.0964	1.0471
No log	26.1111	470	1.0845	0.3250	1.0845	1.0414
No log	26.2222	472	1.0915	0.3390	1.0915	1.0448
No log	26.3333	474	1.1321	0.2232	1.1321	1.0640
No log	26.4444	476	1.2207	0.1667	1.2207	1.1049
No log	26.5556	478	1.3621	0.2411	1.3621	1.1671
No log	26.6667	480	1.3168	0.2366	1.3168	1.1475
No log	26.7778	482	1.2057	0.2718	1.2057	1.0981
No log	26.8889	484	1.1484	0.2232	1.1484	1.0716
No log	27.0	486	1.1482	0.2232	1.1482	1.0715
No log	27.1111	488	1.1439	0.2232	1.1439	1.0695
No log	27.2222	490	1.1595	0.2232	1.1595	1.0768
No log	27.3333	492	1.1505	0.2085	1.1505	1.0726
No log	27.4444	494	1.1472	0.1990	1.1472	1.0711
No log	27.5556	496	1.1529	0.2138	1.1529	1.0737
No log	27.6667	498	1.1927	0.1951	1.1927	1.0921
0.3047	27.7778	500	1.2881	0.2010	1.2881	1.1350
0.3047	27.8889	502	1.3182	0.1921	1.3182	1.1481
0.3047	28.0	504	1.3402	0.1921	1.3402	1.1577
0.3047	28.1111	506	1.3467	0.2010	1.3467	1.1605
0.3047	28.2222	508	1.2586	0.2049	1.2586	1.1219
0.3047	28.3333	510	1.1771	0.2593	1.1771	1.0850
0.3047	28.4444	512	1.1859	0.2593	1.1859	1.0890
0.3047	28.5556	514	1.2557	0.2002	1.2557	1.1206
0.3047	28.6667	516	1.3231	0.1257	1.3231	1.1503
0.3047	28.7778	518	1.3030	0.1257	1.3030	1.1415
0.3047	28.8889	520	1.2058	0.2374	1.2058	1.0981
0.3047	29.0	522	1.1346	0.3174	1.1346	1.0652
0.3047	29.1111	524	1.1554	0.3590	1.1554	1.0749
0.3047	29.2222	526	1.1669	0.3590	1.1669	1.0802
0.3047	29.3333	528	1.1460	0.3661	1.1460	1.0705
0.3047	29.4444	530	1.1763	0.3169	1.1763	1.0846
0.3047	29.5556	532	1.3614	0.1009	1.3614	1.1668
0.3047	29.6667	534	1.4941	0.1522	1.4941	1.2223
0.3047	29.7778	536	1.4585	0.1566	1.4585	1.2077
0.3047	29.8889	538	1.3202	0.1311	1.3202	1.1490
0.3047	30.0	540	1.1973	0.2942	1.1973	1.0942
0.3047	30.1111	542	1.1620	0.2757	1.1620	1.0780
0.3047	30.2222	544	1.1556	0.2966	1.1556	1.0750
0.3047	30.3333	546	1.1541	0.2616	1.1541	1.0743
0.3047	30.4444	548	1.1565	0.2454	1.1565	1.0754
0.3047	30.5556	550	1.1956	0.1996	1.1956	1.0935
0.3047	30.6667	552	1.3420	0.1395	1.3420	1.1584
0.3047	30.7778	554	1.4615	0.0876	1.4615	1.2089
0.3047	30.8889	556	1.4540	0.1457	1.4540	1.2058
0.3047	31.0	558	1.3177	0.1652	1.3177	1.1479

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1