ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2212
• Qwk: 0.0833
• Mse: 1.2212
• Rmse: 1.1051

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	4.6670	0.0010	4.6670	2.1603
No log	0.0741	4	2.7455	0.0051	2.7455	1.6570
No log	0.1111	6	1.9027	0.0041	1.9027	1.3794
No log	0.1481	8	1.8112	0.0041	1.8112	1.3458
No log	0.1852	10	1.4147	0.0697	1.4147	1.1894
No log	0.2222	12	1.2029	0.1422	1.2029	1.0967
No log	0.2593	14	1.3518	-0.0112	1.3518	1.1626
No log	0.2963	16	1.3421	0.0672	1.3421	1.1585
No log	0.3333	18	1.4925	0.1055	1.4925	1.2217
No log	0.3704	20	1.2443	0.1472	1.2443	1.1155
No log	0.4074	22	1.6423	0.0201	1.6423	1.2815
No log	0.4444	24	2.2291	-0.0044	2.2291	1.4930
No log	0.4815	26	2.1820	-0.0166	2.1820	1.4772
No log	0.5185	28	1.6576	0.0426	1.6576	1.2875
No log	0.5556	30	1.2971	0.1472	1.2971	1.1389
No log	0.5926	32	1.2308	0.2342	1.2308	1.1094
No log	0.6296	34	1.3783	0.1679	1.3783	1.1740
No log	0.6667	36	1.4692	0.1196	1.4692	1.2121
No log	0.7037	38	1.5274	0.1309	1.5274	1.2359
No log	0.7407	40	1.4338	0.1138	1.4338	1.1974
No log	0.7778	42	1.3079	0.2295	1.3079	1.1436
No log	0.8148	44	1.1709	0.2815	1.1709	1.0821
No log	0.8519	46	1.2379	0.1809	1.2379	1.1126
No log	0.8889	48	1.2537	0.2014	1.2537	1.1197
No log	0.9259	50	1.1170	0.3451	1.1170	1.0569
No log	0.9630	52	1.1298	0.2424	1.1298	1.0629
No log	1.0	54	1.3163	0.2095	1.3163	1.1473
No log	1.0370	56	1.6079	0.0676	1.6079	1.2680
No log	1.0741	58	1.6924	0.1071	1.6924	1.3009
No log	1.1111	60	1.4738	0.1704	1.4738	1.2140
No log	1.1481	62	1.3290	0.1951	1.3290	1.1528
No log	1.1852	64	1.2835	0.2718	1.2835	1.1329
No log	1.2222	66	1.2472	0.2891	1.2472	1.1168
No log	1.2593	68	1.3732	0.2191	1.3732	1.1718
No log	1.2963	70	1.6091	0.2653	1.6091	1.2685
No log	1.3333	72	1.5602	0.2586	1.5602	1.2491
No log	1.3704	74	1.3529	0.3092	1.3529	1.1631
No log	1.4074	76	1.2898	0.2762	1.2898	1.1357
No log	1.4444	78	1.2471	0.2870	1.2471	1.1167
No log	1.4815	80	1.1330	0.2766	1.1330	1.0644
No log	1.5185	82	1.1172	0.2886	1.1172	1.0570
No log	1.5556	84	1.1450	0.2766	1.1450	1.0700
No log	1.5926	86	1.2346	0.2851	1.2346	1.1111
No log	1.6296	88	1.3742	0.3402	1.3742	1.1722
No log	1.6667	90	1.5643	0.25	1.5643	1.2507
No log	1.7037	92	1.8081	0.2249	1.8081	1.3446
No log	1.7407	94	1.6412	0.2704	1.6412	1.2811
No log	1.7778	96	1.4487	0.2362	1.4487	1.2036
No log	1.8148	98	1.3412	0.1796	1.3412	1.1581
No log	1.8519	100	1.2363	0.2098	1.2363	1.1119
No log	1.8889	102	1.1696	0.2328	1.1696	1.0815
No log	1.9259	104	1.1314	0.2432	1.1314	1.0637
No log	1.9630	106	1.1092	0.2864	1.1092	1.0532
No log	2.0	108	1.1400	0.2733	1.1400	1.0677
No log	2.0370	110	1.2370	0.1990	1.2370	1.1122
No log	2.0741	112	1.5074	0.1984	1.5074	1.2278
No log	2.1111	114	1.5569	0.1831	1.5569	1.2478
No log	2.1481	116	1.3900	0.2100	1.3900	1.1790
No log	2.1852	118	1.3869	0.1779	1.3869	1.1777
No log	2.2222	120	1.2812	0.2270	1.2812	1.1319
No log	2.2593	122	1.1959	0.1557	1.1959	1.0936
No log	2.2963	124	1.2079	0.1557	1.2079	1.0991
No log	2.3333	126	1.2869	0.1896	1.2869	1.1344
No log	2.3704	128	1.4359	0.2060	1.4359	1.1983
No log	2.4074	130	1.4023	0.1921	1.4023	1.1842
No log	2.4444	132	1.2391	0.2718	1.2391	1.1131
No log	2.4815	134	1.1820	0.2353	1.1820	1.0872
No log	2.5185	136	1.1730	0.2340	1.1730	1.0830
No log	2.5556	138	1.2446	0.2605	1.2446	1.1156
No log	2.5926	140	1.3691	0.2520	1.3691	1.1701
No log	2.6296	142	1.2541	0.2824	1.2541	1.1199
No log	2.6667	144	1.1975	0.2605	1.1975	1.0943
No log	2.7037	146	1.2069	0.2605	1.2069	1.0986
No log	2.7407	148	1.1815	0.2605	1.1815	1.0870
No log	2.7778	150	1.2007	0.2044	1.2007	1.0958
No log	2.8148	152	1.2943	0.2049	1.2943	1.1377
No log	2.8519	154	1.2278	0.2044	1.2278	1.1080
No log	2.8889	156	1.1492	0.1683	1.1492	1.0720
No log	2.9259	158	1.1751	0.1501	1.1751	1.0840
No log	2.9630	160	1.2516	0.1950	1.2516	1.1188
No log	3.0	162	1.3968	0.2309	1.3968	1.1819
No log	3.0370	164	1.3487	0.2444	1.3487	1.1613
No log	3.0741	166	1.1807	0.2461	1.1807	1.0866
No log	3.1111	168	1.1366	0.2410	1.1366	1.0661
No log	3.1481	170	1.1525	0.2555	1.1525	1.0736
No log	3.1852	172	1.1689	0.1891	1.1689	1.0811
No log	3.2222	174	1.1820	0.2418	1.1820	1.0872
No log	3.2593	176	1.2966	0.2589	1.2966	1.1387
No log	3.2963	178	1.3437	0.2863	1.3437	1.1592
No log	3.3333	180	1.3541	0.2368	1.3541	1.1637
No log	3.3704	182	1.3353	0.1814	1.3353	1.1556
No log	3.4074	184	1.2587	0.2237	1.2587	1.1219
No log	3.4444	186	1.2668	0.2330	1.2668	1.1255
No log	3.4815	188	1.3033	0.2005	1.3033	1.1416
No log	3.5185	190	1.2670	0.1788	1.2670	1.1256
No log	3.5556	192	1.2795	0.2198	1.2795	1.1312
No log	3.5926	194	1.3530	0.2130	1.3530	1.1632
No log	3.6296	196	1.4081	0.1596	1.4081	1.1866
No log	3.6667	198	1.2521	0.2561	1.2521	1.1190
No log	3.7037	200	1.1582	0.2723	1.1582	1.0762
No log	3.7407	202	1.1344	0.3379	1.1344	1.0651
No log	3.7778	204	1.1848	0.3154	1.1848	1.0885
No log	3.8148	206	1.2446	0.2461	1.2446	1.1156
No log	3.8519	208	1.2108	0.2897	1.2108	1.1004
No log	3.8889	210	1.2822	0.2169	1.2822	1.1323
No log	3.9259	212	1.4092	0.1259	1.4092	1.1871
No log	3.9630	214	1.3359	0.1682	1.3359	1.1558
No log	4.0	216	1.3474	0.1342	1.3474	1.1608
No log	4.0370	218	1.2316	0.2403	1.2316	1.1098
No log	4.0741	220	1.1452	0.3661	1.1452	1.0701
No log	4.1111	222	1.1325	0.3186	1.1325	1.0642
No log	4.1481	224	1.2242	0.2221	1.2242	1.1064
No log	4.1852	226	1.2874	0.2180	1.2874	1.1346
No log	4.2222	228	1.4285	0.2021	1.4285	1.1952
No log	4.2593	230	1.3835	0.2021	1.3835	1.1762
No log	4.2963	232	1.1681	0.2261	1.1681	1.0808
No log	4.3333	234	1.1161	0.3658	1.1161	1.0565
No log	4.3704	236	1.1922	0.2270	1.1922	1.0919
No log	4.4074	238	1.2072	0.2492	1.2072	1.0987
No log	4.4444	240	1.1236	0.3218	1.1236	1.0600
No log	4.4815	242	1.0583	0.4102	1.0583	1.0287
No log	4.5185	244	1.0926	0.2795	1.0926	1.0453
No log	4.5556	246	1.1873	0.2622	1.1873	1.0896
No log	4.5926	248	1.1973	0.2622	1.1973	1.0942
No log	4.6296	250	1.0941	0.2682	1.0941	1.0460
No log	4.6667	252	1.0544	0.4337	1.0544	1.0269
No log	4.7037	254	1.0476	0.4040	1.0476	1.0235
No log	4.7407	256	1.1190	0.2464	1.1190	1.0579
No log	4.7778	258	1.4112	0.2807	1.4112	1.1879
No log	4.8148	260	1.4916	0.2889	1.4916	1.2213
No log	4.8519	262	1.3191	0.3249	1.3191	1.1485
No log	4.8889	264	1.1276	0.2511	1.1276	1.0619
No log	4.9259	266	1.0911	0.2546	1.0911	1.0445
No log	4.9630	268	1.1412	0.2311	1.1412	1.0683
No log	5.0	270	1.2785	0.2744	1.2785	1.1307
No log	5.0370	272	1.3720	0.2343	1.3720	1.1713
No log	5.0741	274	1.3113	0.2744	1.3113	1.1451
No log	5.1111	276	1.1705	0.2389	1.1705	1.0819
No log	5.1481	278	1.1299	0.2602	1.1299	1.0630
No log	5.1852	280	1.1242	0.3017	1.1242	1.0603
No log	5.2222	282	1.1179	0.2757	1.1179	1.0573
No log	5.2593	284	1.1699	0.2777	1.1699	1.0816
No log	5.2963	286	1.2503	0.2806	1.2503	1.1182
No log	5.3333	288	1.2379	0.2806	1.2379	1.1126
No log	5.3704	290	1.1669	0.2917	1.1669	1.0802
No log	5.4074	292	1.0996	0.3346	1.0996	1.0486
No log	5.4444	294	1.1049	0.3250	1.1049	1.0511
No log	5.4815	296	1.1884	0.2984	1.1884	1.0901
No log	5.5185	298	1.3358	0.2915	1.3358	1.1558
No log	5.5556	300	1.4407	0.2154	1.4407	1.2003
No log	5.5926	302	1.3453	0.2763	1.3453	1.1599
No log	5.6296	304	1.2011	0.2779	1.2011	1.0960
No log	5.6667	306	1.1062	0.2664	1.1062	1.0518
No log	5.7037	308	1.0789	0.4146	1.0789	1.0387
No log	5.7407	310	1.1005	0.3986	1.1005	1.0490
No log	5.7778	312	1.0985	0.2830	1.0985	1.0481
No log	5.8148	314	1.1390	0.2697	1.1390	1.0672
No log	5.8519	316	1.1788	0.2601	1.1788	1.0857
No log	5.8889	318	1.1654	0.1678	1.1654	1.0795
No log	5.9259	320	1.1964	0.1774	1.1964	1.0938
No log	5.9630	322	1.2449	0.2700	1.2449	1.1158
No log	6.0	324	1.2749	0.2233	1.2749	1.1291
No log	6.0370	326	1.2454	0.2233	1.2454	1.1160
No log	6.0741	328	1.1752	0.2469	1.1752	1.0840
No log	6.1111	330	1.1785	0.2126	1.1785	1.0856
No log	6.1481	332	1.2095	0.2128	1.2095	1.0998
No log	6.1852	334	1.1965	0.2169	1.1965	1.0938
No log	6.2222	336	1.2167	0.2169	1.2167	1.1030
No log	6.2593	338	1.2439	0.2180	1.2439	1.1153
No log	6.2963	340	1.2019	0.1675	1.2019	1.0963
No log	6.3333	342	1.1401	0.1904	1.1401	1.0678
No log	6.3704	344	1.1202	0.2928	1.1202	1.0584
No log	6.4074	346	1.1330	0.2147	1.1330	1.0644
No log	6.4444	348	1.2058	0.2777	1.2058	1.0981
No log	6.4815	350	1.3151	0.2343	1.3151	1.1468
No log	6.5185	352	1.4440	0.2314	1.4440	1.2017
No log	6.5556	354	1.3374	0.2660	1.3374	1.1565
No log	6.5926	356	1.1780	0.2669	1.1780	1.0853
No log	6.6296	358	1.1210	0.2369	1.1210	1.0588
No log	6.6667	360	1.1412	0.2167	1.1412	1.0683
No log	6.7037	362	1.2008	0.2071	1.2008	1.0958
No log	6.7407	364	1.3759	0.2788	1.3759	1.1730
No log	6.7778	366	1.4003	0.2788	1.4003	1.1834
No log	6.8148	368	1.4645	0.2264	1.4645	1.2102
No log	6.8519	370	1.4566	0.2264	1.4566	1.2069
No log	6.8889	372	1.4196	0.2484	1.4196	1.1915
No log	6.9259	374	1.3963	0.2750	1.3963	1.1817
No log	6.9630	376	1.3230	0.1887	1.3230	1.1502
No log	7.0	378	1.3336	0.1999	1.3336	1.1548
No log	7.0370	380	1.2858	0.2439	1.2858	1.1339
No log	7.0741	382	1.3221	0.2380	1.3221	1.1498
No log	7.1111	384	1.3683	0.2417	1.3683	1.1698
No log	7.1481	386	1.2857	0.2795	1.2857	1.1339
No log	7.1852	388	1.2543	0.2480	1.2543	1.1199
No log	7.2222	390	1.2345	0.1967	1.2345	1.1111
No log	7.2593	392	1.2360	0.1267	1.2360	1.1117
No log	7.2963	394	1.3006	0.1687	1.3006	1.1404
No log	7.3333	396	1.3320	0.1557	1.3320	1.1541
No log	7.3704	398	1.2962	0.1824	1.2962	1.1385
No log	7.4074	400	1.2324	0.1301	1.2324	1.1102
No log	7.4444	402	1.2226	0.1432	1.2226	1.1057
No log	7.4815	404	1.2089	0.1688	1.2089	1.0995
No log	7.5185	406	1.2263	0.1267	1.2263	1.1074
No log	7.5556	408	1.2516	0.1481	1.2516	1.1188
No log	7.5926	410	1.2446	0.1388	1.2446	1.1156
No log	7.6296	412	1.2544	0.1388	1.2544	1.1200
No log	7.6667	414	1.2471	0.1824	1.2471	1.1168
No log	7.7037	416	1.2551	0.1824	1.2551	1.1203
No log	7.7407	418	1.2552	0.1671	1.2552	1.1204
No log	7.7778	420	1.2655	0.2026	1.2655	1.1249
No log	7.8148	422	1.3447	0.1596	1.3447	1.1596
No log	7.8519	424	1.3223	0.2268	1.3223	1.1499
No log	7.8889	426	1.2815	0.2356	1.2815	1.1320
No log	7.9259	428	1.1941	0.1671	1.1941	1.0928
No log	7.9630	430	1.1399	0.1688	1.1399	1.0677
No log	8.0	432	1.1314	0.1683	1.1314	1.0637
No log	8.0370	434	1.1450	0.2024	1.1450	1.0700
No log	8.0741	436	1.1476	0.1179	1.1476	1.0713
No log	8.1111	438	1.1606	0.1553	1.1606	1.0773
No log	8.1481	440	1.1779	0.2651	1.1779	1.0853
No log	8.1852	442	1.2371	0.2221	1.2371	1.1123
No log	8.2222	444	1.3514	0.1898	1.3514	1.1625
No log	8.2593	446	1.3634	0.1898	1.3634	1.1677
No log	8.2963	448	1.2768	0.2221	1.2768	1.1299
No log	8.3333	450	1.3043	0.1797	1.3043	1.1420
No log	8.3704	452	1.3565	0.1797	1.3565	1.1647
No log	8.4074	454	1.2810	0.2128	1.2810	1.1318
No log	8.4444	456	1.2594	0.2128	1.2594	1.1222
No log	8.4815	458	1.1893	0.2168	1.1893	1.0905
No log	8.5185	460	1.1668	0.2265	1.1668	1.0802
No log	8.5556	462	1.2002	0.2505	1.2002	1.0955
No log	8.5926	464	1.2217	0.2505	1.2217	1.1053
No log	8.6296	466	1.2551	0.2128	1.2551	1.1203
No log	8.6667	468	1.2434	0.2128	1.2434	1.1151
No log	8.7037	470	1.1977	0.2168	1.1977	1.0944
No log	8.7407	472	1.1503	0.2310	1.1503	1.0725
No log	8.7778	474	1.1430	0.2850	1.1430	1.0691
No log	8.8148	476	1.1503	0.2447	1.1503	1.0725
No log	8.8519	478	1.2193	0.2071	1.2193	1.1042
No log	8.8889	480	1.3058	0.2140	1.3058	1.1427
No log	8.9259	482	1.3387	0.2230	1.3387	1.1570
No log	8.9630	484	1.2795	0.1691	1.2795	1.1312
No log	9.0	486	1.2058	0.1805	1.2058	1.0981
No log	9.0370	488	1.2126	0.1847	1.2126	1.1012
No log	9.0741	490	1.2294	0.1847	1.2294	1.1088
No log	9.1111	492	1.2335	0.1397	1.2335	1.1106
No log	9.1481	494	1.2795	0.1766	1.2795	1.1311
No log	9.1852	496	1.3409	0.1651	1.3409	1.1580
No log	9.2222	498	1.3237	0.1651	1.3237	1.1505
0.359	9.2593	500	1.2637	0.1397	1.2637	1.1242
0.359	9.2963	502	1.2696	0.1397	1.2696	1.1268
0.359	9.3333	504	1.2872	0.1362	1.2872	1.1346
0.359	9.3704	506	1.2942	0.0833	1.2942	1.1376
0.359	9.4074	508	1.2901	0.0833	1.2901	1.1358
0.359	9.4444	510	1.2212	0.0833	1.2212	1.1051

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1