ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2589
• Qwk: 0.2007
• Mse: 1.2589
• Rmse: 1.1220

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	4.7154	-0.0132	4.7154	2.1715
No log	0.0606	4	2.8496	0.0205	2.8496	1.6881
No log	0.0909	6	2.0231	-0.0017	2.0231	1.4223
No log	0.1212	8	2.7365	-0.0790	2.7365	1.6542
No log	0.1515	10	2.7919	-0.0944	2.7919	1.6709
No log	0.1818	12	1.9271	0.0372	1.9271	1.3882
No log	0.2121	14	1.6524	0.0372	1.6524	1.2854
No log	0.2424	16	1.7386	0.0372	1.7386	1.3186
No log	0.2727	18	1.8868	0.0504	1.8868	1.3736
No log	0.3030	20	1.7839	0.0504	1.7839	1.3356
No log	0.3333	22	1.9224	0.0486	1.9224	1.3865
No log	0.3636	24	1.9429	0.0215	1.9429	1.3939
No log	0.3939	26	1.7292	0.0504	1.7292	1.3150
No log	0.4242	28	1.4226	0.1427	1.4226	1.1927
No log	0.4545	30	1.1721	0.2622	1.1721	1.0826
No log	0.4848	32	1.1246	0.2167	1.1246	1.0605
No log	0.5152	34	1.1449	0.2735	1.1449	1.0700
No log	0.5455	36	1.3092	0.2058	1.3092	1.1442
No log	0.5758	38	1.4379	0.1483	1.4379	1.1991
No log	0.6061	40	1.4980	0.0972	1.4980	1.2239
No log	0.6364	42	1.6250	0.0749	1.6250	1.2748
No log	0.6667	44	1.8884	0.0856	1.8884	1.3742
No log	0.6970	46	1.7702	0.1110	1.7702	1.3305
No log	0.7273	48	1.5275	0.1949	1.5275	1.2359
No log	0.7576	50	1.5674	0.1458	1.5674	1.2520
No log	0.7879	52	1.6673	0.1466	1.6673	1.2912
No log	0.8182	54	1.5401	0.2979	1.5401	1.2410
No log	0.8485	56	1.4811	0.1537	1.4811	1.2170
No log	0.8788	58	1.2783	0.1659	1.2783	1.1306
No log	0.9091	60	1.3076	0.1772	1.3076	1.1435
No log	0.9394	62	1.2889	0.2149	1.2889	1.1353
No log	0.9697	64	1.3059	0.2054	1.3059	1.1428
No log	1.0	66	1.4411	0.1016	1.4411	1.2004
No log	1.0303	68	1.6022	0.0652	1.6022	1.2658
No log	1.0606	70	1.4505	0.0984	1.4505	1.2044
No log	1.0909	72	1.3087	0.1588	1.3087	1.1440
No log	1.1212	74	1.4379	0.1055	1.4379	1.1991
No log	1.1515	76	1.3814	0.1694	1.3814	1.1753
No log	1.1818	78	1.4657	0.1694	1.4657	1.2107
No log	1.2121	80	1.4545	0.1165	1.4545	1.2060
No log	1.2424	82	1.3710	0.1165	1.3710	1.1709
No log	1.2727	84	1.2942	0.1530	1.2942	1.1376
No log	1.3030	86	1.2725	0.1959	1.2725	1.1281
No log	1.3333	88	1.2420	0.1912	1.2420	1.1144
No log	1.3636	90	1.3354	0.1851	1.3354	1.1556
No log	1.3939	92	1.4978	0.2611	1.4978	1.2238
No log	1.4242	94	1.4033	0.1995	1.4033	1.1846
No log	1.4545	96	1.3293	0.2211	1.3293	1.1530
No log	1.4848	98	1.4477	0.1222	1.4477	1.2032
No log	1.5152	100	1.5214	0.1022	1.5214	1.2335
No log	1.5455	102	1.5628	0.1891	1.5628	1.2501
No log	1.5758	104	1.4356	0.1004	1.4356	1.1982
No log	1.6061	106	1.4186	0.1869	1.4186	1.1911
No log	1.6364	108	1.3892	0.2069	1.3892	1.1786
No log	1.6667	110	1.3657	0.2457	1.3657	1.1686
No log	1.6970	112	1.2935	0.2056	1.2935	1.1373
No log	1.7273	114	1.3444	0.2405	1.3444	1.1595
No log	1.7576	116	1.3562	0.2275	1.3562	1.1646
No log	1.7879	118	1.4503	0.1942	1.4503	1.2043
No log	1.8182	120	1.3402	0.2191	1.3402	1.1577
No log	1.8485	122	1.1612	0.2438	1.1612	1.0776
No log	1.8788	124	1.0850	0.3014	1.0850	1.0416
No log	1.9091	126	1.0791	0.2785	1.0791	1.0388
No log	1.9394	128	1.1027	0.2694	1.1027	1.0501
No log	1.9697	130	1.1411	0.2504	1.1411	1.0682
No log	2.0	132	1.1829	0.2540	1.1829	1.0876
No log	2.0303	134	1.1561	0.3093	1.1561	1.0752
No log	2.0606	136	1.2045	0.2868	1.2045	1.0975
No log	2.0909	138	1.2168	0.3007	1.2168	1.1031
No log	2.1212	140	1.1790	0.3321	1.1790	1.0858
No log	2.1515	142	1.1820	0.3373	1.1820	1.0872
No log	2.1818	144	1.2822	0.2852	1.2822	1.1323
No log	2.2121	146	1.4594	0.2946	1.4594	1.2081
No log	2.2424	148	1.3764	0.2903	1.3764	1.1732
No log	2.2727	150	1.1760	0.3277	1.1760	1.0844
No log	2.3030	152	1.0723	0.2812	1.0723	1.0355
No log	2.3333	154	1.0665	0.2767	1.0665	1.0327
No log	2.3636	156	1.0961	0.3697	1.0961	1.0469
No log	2.3939	158	1.2101	0.3232	1.2101	1.1000
No log	2.4242	160	1.2183	0.3232	1.2183	1.1038
No log	2.4545	162	1.1905	0.1986	1.1905	1.0911
No log	2.4848	164	1.2109	0.1900	1.2109	1.1004
No log	2.5152	166	1.2930	0.2632	1.2930	1.1371
No log	2.5455	168	1.2811	0.2133	1.2811	1.1318
No log	2.5758	170	1.2534	0.2659	1.2534	1.1196
No log	2.6061	172	1.3792	0.3682	1.3792	1.1744
No log	2.6364	174	1.3890	0.3902	1.3890	1.1786
No log	2.6667	176	1.1642	0.3050	1.1642	1.0790
No log	2.6970	178	1.0576	0.3641	1.0576	1.0284
No log	2.7273	180	1.1611	0.3455	1.1611	1.0776
No log	2.7576	182	1.1513	0.3608	1.1513	1.0730
No log	2.7879	184	1.2575	0.1436	1.2575	1.1214
No log	2.8182	186	1.7187	0.1907	1.7187	1.3110
No log	2.8485	188	1.9149	0.2056	1.9149	1.3838
No log	2.8788	190	1.6838	0.2397	1.6838	1.2976
No log	2.9091	192	1.3886	0.1929	1.3886	1.1784
No log	2.9394	194	1.2722	0.1080	1.2722	1.1279
No log	2.9697	196	1.1701	0.1595	1.1701	1.0817
No log	3.0	198	1.1712	0.3763	1.1712	1.0822
No log	3.0303	200	1.2461	0.3657	1.2461	1.1163
No log	3.0606	202	1.2730	0.3021	1.2730	1.1283
No log	3.0909	204	1.1427	0.2546	1.1427	1.0690
No log	3.1212	206	1.1186	0.2677	1.1186	1.0576
No log	3.1515	208	1.1611	0.2805	1.1611	1.0775
No log	3.1818	210	1.3236	0.3129	1.3236	1.1505
No log	3.2121	212	1.5244	0.2928	1.5244	1.2347
No log	3.2424	214	1.4204	0.2447	1.4204	1.1918
No log	3.2727	216	1.1385	0.2657	1.1385	1.0670
No log	3.3030	218	1.0384	0.2815	1.0384	1.0190
No log	3.3333	220	1.0558	0.2618	1.0558	1.0275
No log	3.3636	222	1.1202	0.2439	1.1202	1.0584
No log	3.3939	224	1.2738	0.2062	1.2738	1.1286
No log	3.4242	226	1.5477	0.1569	1.5477	1.2441
No log	3.4545	228	1.5703	0.1857	1.5703	1.2531
No log	3.4848	230	1.4448	0.2235	1.4448	1.2020
No log	3.5152	232	1.2167	0.2672	1.2167	1.1031
No log	3.5455	234	1.1622	0.2315	1.1622	1.0781
No log	3.5758	236	1.1730	0.2624	1.1730	1.0831
No log	3.6061	238	1.2467	0.2657	1.2467	1.1165
No log	3.6364	240	1.2786	0.2961	1.2786	1.1308
No log	3.6667	242	1.3063	0.3071	1.3063	1.1429
No log	3.6970	244	1.2371	0.2961	1.2371	1.1123
No log	3.7273	246	1.2330	0.2961	1.2330	1.1104
No log	3.7576	248	1.3046	0.2325	1.3046	1.1422
No log	3.7879	250	1.4603	0.1923	1.4603	1.2084
No log	3.8182	252	1.7826	0.2362	1.7826	1.3352
No log	3.8485	254	1.8175	0.2424	1.8175	1.3482
No log	3.8788	256	1.4736	0.3126	1.4736	1.2139
No log	3.9091	258	1.1454	0.2895	1.1454	1.0702
No log	3.9394	260	1.0663	0.3310	1.0663	1.0326
No log	3.9697	262	1.0536	0.3110	1.0536	1.0264
No log	4.0	264	1.1256	0.3298	1.1256	1.0609
No log	4.0303	266	1.1866	0.3307	1.1866	1.0893
No log	4.0606	268	1.1743	0.3339	1.1743	1.0836
No log	4.0909	270	1.1455	0.3218	1.1455	1.0703
No log	4.1212	272	1.1367	0.3008	1.1367	1.0662
No log	4.1515	274	1.2685	0.2564	1.2685	1.1263
No log	4.1818	276	1.3321	0.2885	1.3321	1.1542
No log	4.2121	278	1.2238	0.2939	1.2238	1.1063
No log	4.2424	280	1.1297	0.3453	1.1297	1.0629
No log	4.2727	282	1.1622	0.3389	1.1622	1.0781
No log	4.3030	284	1.2854	0.2863	1.2854	1.1338
No log	4.3333	286	1.4001	0.2563	1.4001	1.1833
No log	4.3636	288	1.4298	0.2926	1.4298	1.1957
No log	4.3939	290	1.3282	0.2593	1.3282	1.1525
No log	4.4242	292	1.4351	0.2814	1.4351	1.1980
No log	4.4545	294	1.6998	0.2325	1.6998	1.3038
No log	4.4848	296	1.7663	0.2219	1.7663	1.3290
No log	4.5152	298	1.4678	0.2519	1.4678	1.2115
No log	4.5455	300	1.1868	0.2825	1.1868	1.0894
No log	4.5758	302	1.0773	0.3126	1.0773	1.0379
No log	4.6061	304	1.0722	0.3218	1.0722	1.0355
No log	4.6364	306	1.1428	0.3165	1.1428	1.0690
No log	4.6667	308	1.1209	0.3424	1.1209	1.0587
No log	4.6970	310	1.1283	0.3424	1.1283	1.0622
No log	4.7273	312	1.2963	0.3098	1.2963	1.1386
No log	4.7576	314	1.5152	0.3126	1.5152	1.2310
No log	4.7879	316	1.4738	0.2778	1.4738	1.2140
No log	4.8182	318	1.3367	0.2927	1.3367	1.1562
No log	4.8485	320	1.1904	0.2209	1.1904	1.0911
No log	4.8788	322	1.1557	0.2633	1.1557	1.0750
No log	4.9091	324	1.1377	0.3930	1.1377	1.0666
No log	4.9394	326	1.2081	0.2301	1.2081	1.0991
No log	4.9697	328	1.3182	0.2863	1.3182	1.1481
No log	5.0	330	1.3206	0.2783	1.3206	1.1492
No log	5.0303	332	1.2301	0.2181	1.2301	1.1091
No log	5.0606	334	1.2362	0.2181	1.2362	1.1119
No log	5.0909	336	1.3407	0.2863	1.3407	1.1579
No log	5.1212	338	1.3286	0.2863	1.3286	1.1527
No log	5.1515	340	1.2171	0.3029	1.2171	1.1032
No log	5.1818	342	1.1976	0.2900	1.1976	1.0943
No log	5.2121	344	1.2587	0.3309	1.2587	1.1219
No log	5.2424	346	1.2569	0.3309	1.2569	1.1211
No log	5.2727	348	1.1876	0.3202	1.1876	1.0898
No log	5.3030	350	1.2073	0.3314	1.2073	1.0988
No log	5.3333	352	1.2289	0.3249	1.2289	1.1085
No log	5.3636	354	1.1689	0.2896	1.1689	1.0811
No log	5.3939	356	1.1920	0.2984	1.1920	1.0918
No log	5.4242	358	1.1807	0.2984	1.1807	1.0866
No log	5.4545	360	1.1088	0.3169	1.1088	1.0530
No log	5.4848	362	1.0986	0.3648	1.0986	1.0481
No log	5.5152	364	1.1434	0.3161	1.1434	1.0693
No log	5.5455	366	1.2467	0.3227	1.2467	1.1165
No log	5.5758	368	1.2396	0.2752	1.2396	1.1134
No log	5.6061	370	1.2698	0.2791	1.2698	1.1268
No log	5.6364	372	1.2707	0.3004	1.2707	1.1272
No log	5.6667	374	1.1814	0.2220	1.1814	1.0869
No log	5.6970	376	1.1540	0.2813	1.1540	1.0743
No log	5.7273	378	1.1669	0.2561	1.1669	1.0802
No log	5.7576	380	1.2242	0.2219	1.2242	1.1064
No log	5.7879	382	1.3790	0.2715	1.3790	1.1743
No log	5.8182	384	1.3606	0.2806	1.3606	1.1665
No log	5.8485	386	1.2241	0.2304	1.2241	1.1064
No log	5.8788	388	1.1370	0.2922	1.1370	1.0663
No log	5.9091	390	1.1242	0.2680	1.1242	1.0603
No log	5.9394	392	1.2205	0.2832	1.2205	1.1048
No log	5.9697	394	1.3162	0.2983	1.3162	1.1472
No log	6.0	396	1.3469	0.3022	1.3469	1.1605
No log	6.0303	398	1.2361	0.3092	1.2361	1.1118
No log	6.0606	400	1.1789	0.2687	1.1789	1.0858
No log	6.0909	402	1.1464	0.2315	1.1465	1.0707
No log	6.1212	404	1.1964	0.2085	1.1964	1.0938
No log	6.1515	406	1.3255	0.2411	1.3255	1.1513
No log	6.1818	408	1.3986	0.2747	1.3986	1.1826
No log	6.2121	410	1.4702	0.2536	1.4702	1.2125
No log	6.2424	412	1.4205	0.2394	1.4205	1.1919
No log	6.2727	414	1.2978	0.2851	1.2978	1.1392
No log	6.3030	416	1.1898	0.2380	1.1898	1.0908
No log	6.3333	418	1.1831	0.2417	1.1831	1.0877
No log	6.3636	420	1.2763	0.2597	1.2763	1.1297
No log	6.3939	422	1.4460	0.2026	1.4460	1.2025
No log	6.4242	424	1.5092	0.2148	1.5092	1.2285
No log	6.4545	426	1.5006	0.2105	1.5006	1.2250
No log	6.4848	428	1.4675	0.2105	1.4675	1.2114
No log	6.5152	430	1.5040	0.2182	1.5040	1.2264
No log	6.5455	432	1.4698	0.1874	1.4698	1.2123
No log	6.5758	434	1.4017	0.2181	1.4017	1.1839
No log	6.6061	436	1.3355	0.2309	1.3355	1.1556
No log	6.6364	438	1.2497	0.2716	1.2497	1.1179
No log	6.6667	440	1.1810	0.2608	1.1810	1.0867
No log	6.6970	442	1.1971	0.2742	1.1971	1.0941
No log	6.7273	444	1.3209	0.2604	1.3209	1.1493
No log	6.7576	446	1.3826	0.2461	1.3826	1.1758
No log	6.7879	448	1.3022	0.2529	1.3022	1.1412
No log	6.8182	450	1.1968	0.2870	1.1968	1.0940
No log	6.8485	452	1.1781	0.2963	1.1781	1.0854
No log	6.8788	454	1.2054	0.2916	1.2054	1.0979
No log	6.9091	456	1.2135	0.2597	1.2135	1.1016
No log	6.9394	458	1.1890	0.2916	1.1890	1.0904
No log	6.9697	460	1.1656	0.2732	1.1656	1.0796
No log	7.0	462	1.1612	0.2732	1.1612	1.0776
No log	7.0303	464	1.1205	0.3081	1.1205	1.0585
No log	7.0606	466	1.1339	0.2989	1.1339	1.0649
No log	7.0909	468	1.2171	0.2270	1.2171	1.1032
No log	7.1212	470	1.3555	0.2624	1.3555	1.1642
No log	7.1515	472	1.5228	0.2554	1.5228	1.2340
No log	7.1818	474	1.5035	0.2653	1.5035	1.2262
No log	7.2121	476	1.3363	0.2350	1.3363	1.1560
No log	7.2424	478	1.1825	0.2549	1.1825	1.0874
No log	7.2727	480	1.1310	0.2685	1.1310	1.0635
No log	7.3030	482	1.1028	0.2555	1.1028	1.0501
No log	7.3333	484	1.1278	0.2501	1.1278	1.0620
No log	7.3636	486	1.2252	0.3323	1.2252	1.1069
No log	7.3939	488	1.2604	0.3005	1.2604	1.1227
No log	7.4242	490	1.2112	0.2131	1.2112	1.1005
No log	7.4545	492	1.2293	0.2044	1.2293	1.1087
No log	7.4848	494	1.2832	0.2141	1.2832	1.1328
No log	7.5152	496	1.3576	0.2690	1.3576	1.1652
No log	7.5455	498	1.4792	0.2536	1.4792	1.2162
0.3461	7.5758	500	1.4507	0.2545	1.4507	1.2045
0.3461	7.6061	502	1.3640	0.2690	1.3640	1.1679
0.3461	7.6364	504	1.3520	0.2833	1.3520	1.1628
0.3461	7.6667	506	1.2557	0.2807	1.2557	1.1206
0.3461	7.6970	508	1.2875	0.3160	1.2875	1.1347
0.3461	7.7273	510	1.2861	0.3071	1.2861	1.1340
0.3461	7.7576	512	1.1756	0.2984	1.1756	1.0843
0.3461	7.7879	514	1.0891	0.2759	1.0891	1.0436
0.3461	7.8182	516	1.0873	0.3012	1.0873	1.0427
0.3461	7.8485	518	1.1329	0.2486	1.1329	1.0644
0.3461	7.8788	520	1.2720	0.3210	1.2720	1.1278
0.3461	7.9091	522	1.3762	0.3103	1.3762	1.1731
0.3461	7.9394	524	1.3563	0.2983	1.3563	1.1646
0.3461	7.9697	526	1.2374	0.2007	1.2374	1.1124
0.3461	8.0	528	1.2512	0.2313	1.2512	1.1186
0.3461	8.0303	530	1.2322	0.2007	1.2322	1.1100
0.3461	8.0606	532	1.2272	0.2007	1.2272	1.1078
0.3461	8.0909	534	1.2589	0.2007	1.2589	1.1220

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1