ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3677
• Qwk: 0.1459
• Mse: 1.3677
• Rmse: 1.1695

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	4.4923	0.0042	4.4923	2.1195
No log	0.0656	4	2.5719	0.0274	2.5719	1.6037
No log	0.0984	6	2.6166	-0.0594	2.6166	1.6176
No log	0.1311	8	2.0691	-0.0362	2.0691	1.4384
No log	0.1639	10	1.7406	-0.0222	1.7406	1.3193
No log	0.1967	12	1.3993	0.0697	1.3993	1.1829
No log	0.2295	14	1.3247	0.1257	1.3247	1.1510
No log	0.2623	16	1.3192	0.1639	1.3192	1.1486
No log	0.2951	18	1.4389	0.1080	1.4389	1.1995
No log	0.3279	20	1.5360	0.0538	1.5360	1.2393
No log	0.3607	22	1.6009	0.0538	1.6009	1.2653
No log	0.3934	24	1.3716	0.2110	1.3716	1.1711
No log	0.4262	26	1.1734	0.2285	1.1734	1.0832
No log	0.4590	28	1.2121	0.2374	1.2121	1.1010
No log	0.4918	30	1.7159	0.1151	1.7159	1.3099
No log	0.5246	32	2.4105	0.1040	2.4105	1.5526
No log	0.5574	34	2.0681	0.1306	2.0681	1.4381
No log	0.5902	36	1.4048	0.1438	1.4048	1.1853
No log	0.6230	38	1.1066	0.2333	1.1066	1.0520
No log	0.6557	40	1.0939	0.2333	1.0939	1.0459
No log	0.6885	42	1.1958	0.1904	1.1958	1.0935
No log	0.7213	44	1.3668	0.0776	1.3668	1.1691
No log	0.7541	46	1.4797	0.1283	1.4797	1.2164
No log	0.7869	48	1.4259	0.1838	1.4259	1.1941
No log	0.8197	50	1.3146	0.1784	1.3146	1.1465
No log	0.8525	52	1.3302	0.1838	1.3302	1.1533
No log	0.8852	54	1.4511	0.2037	1.4511	1.2046
No log	0.9180	56	1.3792	0.2201	1.3792	1.1744
No log	0.9508	58	1.2351	0.1704	1.2351	1.1113
No log	0.9836	60	1.4018	0.2679	1.4018	1.1840
No log	1.0164	62	1.3411	0.2213	1.3411	1.1581
No log	1.0492	64	1.1455	0.2285	1.1455	1.0703
No log	1.0820	66	1.0491	0.3190	1.0491	1.0243
No log	1.1148	68	1.0493	0.3190	1.0493	1.0243
No log	1.1475	70	1.0748	0.2988	1.0748	1.0367
No log	1.1803	72	1.3705	0.1935	1.3705	1.1707
No log	1.2131	74	1.6364	0.2005	1.6364	1.2792
No log	1.2459	76	1.4522	0.1990	1.4522	1.2051
No log	1.2787	78	1.1287	0.2824	1.1287	1.0624
No log	1.3115	80	1.0857	0.2915	1.0857	1.0420
No log	1.3443	82	1.0833	0.3113	1.0833	1.0408
No log	1.3770	84	1.2275	0.2600	1.2275	1.1079
No log	1.4098	86	1.6678	0.1483	1.6678	1.2914
No log	1.4426	88	2.1516	0.1011	2.1516	1.4668
No log	1.4754	90	1.9675	0.1245	1.9675	1.4027
No log	1.5082	92	1.4623	0.0210	1.4623	1.2093
No log	1.5410	94	1.2923	0.1622	1.2923	1.1368
No log	1.5738	96	1.1577	0.2716	1.1577	1.0760
No log	1.6066	98	1.1425	0.2199	1.1425	1.0689
No log	1.6393	100	1.1553	0.2843	1.1553	1.0748
No log	1.6721	102	1.2137	0.2476	1.2137	1.1017
No log	1.7049	104	1.3405	0.1772	1.3405	1.1578
No log	1.7377	106	1.5337	0.1768	1.5337	1.2384
No log	1.7705	108	1.9112	0.1027	1.9112	1.3825
No log	1.8033	110	1.8347	0.0993	1.8347	1.3545
No log	1.8361	112	1.5946	0.2424	1.5946	1.2628
No log	1.8689	114	1.4230	0.3064	1.4230	1.1929
No log	1.9016	116	1.2252	0.3180	1.2252	1.1069
No log	1.9344	118	1.4038	0.2713	1.4038	1.1848
No log	1.9672	120	1.8567	0.1421	1.8567	1.3626
No log	2.0	122	1.9534	0.0896	1.9534	1.3977
No log	2.0328	124	1.6150	0.1536	1.6150	1.2708
No log	2.0656	126	1.2401	0.2605	1.2401	1.1136
No log	2.0984	128	1.2372	0.2913	1.2372	1.1123
No log	2.1311	130	1.4458	0.1690	1.4458	1.2024
No log	2.1639	132	1.6817	0.1657	1.6817	1.2968
No log	2.1967	134	1.5098	0.2799	1.5098	1.2287
No log	2.2295	136	1.1595	0.3504	1.1595	1.0768
No log	2.2623	138	1.0518	0.3535	1.0518	1.0256
No log	2.2951	140	1.0789	0.3237	1.0789	1.0387
No log	2.3279	142	1.2984	0.3506	1.2984	1.1395
No log	2.3607	144	1.8239	0.2138	1.8239	1.3505
No log	2.3934	146	2.0441	0.1603	2.0441	1.4297
No log	2.4262	148	1.7514	0.2002	1.7514	1.3234
No log	2.4590	150	1.2769	0.2896	1.2769	1.1300
No log	2.4918	152	1.1306	0.1856	1.1306	1.0633
No log	2.5246	154	1.1895	0.2052	1.1895	1.0907
No log	2.5574	156	1.3962	0.1943	1.3962	1.1816
No log	2.5902	158	1.4666	0.2451	1.4666	1.2110
No log	2.6230	160	1.6059	0.1551	1.6059	1.2672
No log	2.6557	162	1.5748	0.2108	1.5748	1.2549
No log	2.6885	164	1.3886	0.2062	1.3886	1.1784
No log	2.7213	166	1.3859	0.2312	1.3859	1.1773
No log	2.7541	168	1.3441	0.2754	1.3441	1.1594
No log	2.7869	170	1.3088	0.2814	1.3088	1.1440
No log	2.8197	172	1.3416	0.2131	1.3416	1.1583
No log	2.8525	174	1.2788	0.2814	1.2788	1.1308
No log	2.8852	176	1.1745	0.3080	1.1745	1.0837
No log	2.9180	178	1.1731	0.2225	1.1731	1.0831
No log	2.9508	180	1.3066	0.1999	1.3066	1.1430
No log	2.9836	182	1.3550	0.2560	1.3550	1.1640
No log	3.0164	184	1.1751	0.2989	1.1751	1.0840
No log	3.0492	186	1.0567	0.3537	1.0567	1.0280
No log	3.0820	188	1.0349	0.3200	1.0349	1.0173
No log	3.1148	190	1.1280	0.3056	1.1280	1.0621
No log	3.1475	192	1.1778	0.2670	1.1778	1.0852
No log	3.1803	194	1.0897	0.3081	1.0897	1.0439
No log	3.2131	196	1.0324	0.3256	1.0324	1.0161
No log	3.2459	198	1.0120	0.3408	1.0120	1.0060
No log	3.2787	200	1.0286	0.2991	1.0286	1.0142
No log	3.3115	202	1.1648	0.2702	1.1648	1.0792
No log	3.3443	204	1.6734	0.2221	1.6734	1.2936
No log	3.3770	206	2.0309	0.0771	2.0309	1.4251
No log	3.4098	208	1.9296	0.0741	1.9296	1.3891
No log	3.4426	210	1.5970	0.2981	1.5970	1.2637
No log	3.4754	212	1.3338	0.1720	1.3338	1.1549
No log	3.5082	214	1.2216	0.1792	1.2216	1.1052
No log	3.5410	216	1.1922	0.2660	1.1922	1.0919
No log	3.5738	218	1.2109	0.2226	1.2109	1.1004
No log	3.6066	220	1.1958	0.2137	1.1958	1.0935
No log	3.6393	222	1.2181	0.2158	1.2181	1.1037
No log	3.6721	224	1.3466	0.2002	1.3466	1.1604
No log	3.7049	226	1.3733	0.2141	1.3733	1.1719
No log	3.7377	228	1.2783	0.1898	1.2783	1.1306
No log	3.7705	230	1.2010	0.2118	1.2010	1.0959
No log	3.8033	232	1.1680	0.2012	1.1680	1.0807
No log	3.8361	234	1.1557	0.2344	1.1557	1.0750
No log	3.8689	236	1.1714	0.2065	1.1714	1.0823
No log	3.9016	238	1.3056	0.1943	1.3056	1.1426
No log	3.9344	240	1.6135	0.2368	1.6135	1.2702
No log	3.9672	242	1.7131	0.1860	1.7131	1.3089
No log	4.0	244	1.5221	0.1903	1.5221	1.2337
No log	4.0328	246	1.2960	0.2438	1.2960	1.1384
No log	4.0656	248	1.1261	0.3036	1.1261	1.0612
No log	4.0984	250	1.1014	0.3062	1.1014	1.0495
No log	4.1311	252	1.1194	0.2651	1.1194	1.0580
No log	4.1639	254	1.1757	0.2516	1.1757	1.0843
No log	4.1967	256	1.2033	0.2890	1.2033	1.0969
No log	4.2295	258	1.2139	0.2890	1.2139	1.1018
No log	4.2623	260	1.1927	0.2549	1.1927	1.0921
No log	4.2951	262	1.2509	0.2961	1.2509	1.1184
No log	4.3279	264	1.2867	0.3028	1.2867	1.1343
No log	4.3607	266	1.1758	0.3033	1.1758	1.0843
No log	4.3934	268	1.1428	0.2986	1.1428	1.0690
No log	4.4262	270	1.1780	0.2963	1.1780	1.0853
No log	4.4590	272	1.1728	0.2986	1.1728	1.0830
No log	4.4918	274	1.1335	0.2747	1.1335	1.0646
No log	4.5246	276	1.1030	0.2336	1.1030	1.0503
No log	4.5574	278	1.1034	0.2898	1.1034	1.0504
No log	4.5902	280	1.1181	0.2453	1.1181	1.0574
No log	4.6230	282	1.1374	0.3155	1.1374	1.0665
No log	4.6557	284	1.2678	0.2081	1.2678	1.1260
No log	4.6885	286	1.4432	0.2366	1.4432	1.2013
No log	4.7213	288	1.4067	0.2105	1.4067	1.1861
No log	4.7541	290	1.2272	0.2397	1.2272	1.1078
No log	4.7869	292	1.1732	0.2397	1.1732	1.0832
No log	4.8197	294	1.2352	0.2397	1.2352	1.1114
No log	4.8525	296	1.2869	0.2040	1.2869	1.1344
No log	4.8852	298	1.2474	0.2478	1.2474	1.1169
No log	4.9180	300	1.1179	0.3151	1.1179	1.0573
No log	4.9508	302	1.0944	0.3482	1.0944	1.0461
No log	4.9836	304	1.0889	0.3243	1.0889	1.0435
No log	5.0164	306	1.0965	0.3379	1.0965	1.0471
No log	5.0492	308	1.1741	0.2771	1.1741	1.0836
No log	5.0820	310	1.2897	0.3347	1.2897	1.1357
No log	5.1148	312	1.2562	0.3429	1.2562	1.1208
No log	5.1475	314	1.1501	0.3202	1.1501	1.0724
No log	5.1803	316	1.0701	0.3329	1.0701	1.0344
No log	5.2131	318	1.0846	0.3237	1.0846	1.0415
No log	5.2459	320	1.1948	0.2832	1.1948	1.0931
No log	5.2787	322	1.4291	0.3325	1.4291	1.1954
No log	5.3115	324	1.4373	0.3325	1.4373	1.1989
No log	5.3443	326	1.3275	0.2736	1.3275	1.1522
No log	5.3770	328	1.1227	0.2324	1.1227	1.0596
No log	5.4098	330	1.0629	0.2915	1.0629	1.0310
No log	5.4426	332	1.0769	0.2471	1.0769	1.0377
No log	5.4754	334	1.1365	0.2511	1.1365	1.0661
No log	5.5082	336	1.3570	0.2895	1.3570	1.1649
No log	5.5410	338	1.5226	0.2830	1.5226	1.2339
No log	5.5738	340	1.4567	0.2191	1.4567	1.2069
No log	5.6066	342	1.2664	0.2597	1.2664	1.1254
No log	5.6393	344	1.1410	0.2261	1.1410	1.0682
No log	5.6721	346	1.1073	0.2664	1.1073	1.0523
No log	5.7049	348	1.1222	0.2249	1.1222	1.0594
No log	5.7377	350	1.2023	0.2232	1.2023	1.0965
No log	5.7705	352	1.3052	0.2329	1.3052	1.1425
No log	5.8033	354	1.3658	0.2154	1.3658	1.1687
No log	5.8361	356	1.3205	0.2153	1.3205	1.1491
No log	5.8689	358	1.2181	0.2424	1.2181	1.1037
No log	5.9016	360	1.1501	0.2273	1.1501	1.0724
No log	5.9344	362	1.1312	0.1980	1.1312	1.0636
No log	5.9672	364	1.1304	0.2120	1.1304	1.0632
No log	6.0	366	1.1359	0.2259	1.1359	1.0658
No log	6.0328	368	1.1407	0.2259	1.1407	1.0681
No log	6.0656	370	1.2155	0.3007	1.2155	1.1025
No log	6.0984	372	1.3383	0.2191	1.3383	1.1568
No log	6.1311	374	1.4807	0.2281	1.4807	1.2169
No log	6.1639	376	1.4492	0.2281	1.4492	1.2038
No log	6.1967	378	1.3076	0.2411	1.3076	1.1435
No log	6.2295	380	1.2971	0.2554	1.2971	1.1389
No log	6.2623	382	1.2311	0.2002	1.2311	1.1096
No log	6.2951	384	1.1610	0.2259	1.1610	1.0775
No log	6.3279	386	1.1208	0.2567	1.1208	1.0587
No log	6.3607	388	1.1151	0.3200	1.1151	1.0560
No log	6.3934	390	1.1050	0.1750	1.1050	1.0512
No log	6.4262	392	1.1339	0.2667	1.1339	1.0649
No log	6.4590	394	1.2183	0.2627	1.2183	1.1038
No log	6.4918	396	1.2735	0.2718	1.2735	1.1285
No log	6.5246	398	1.3069	0.2544	1.3069	1.1432
No log	6.5574	400	1.2515	0.2734	1.2515	1.1187
No log	6.5902	402	1.2071	0.3100	1.2071	1.0987
No log	6.6230	404	1.1871	0.2796	1.1871	1.0895
No log	6.6557	406	1.1590	0.2796	1.1590	1.0766
No log	6.6885	408	1.2038	0.2597	1.2038	1.0972
No log	6.7213	410	1.3584	0.2690	1.3584	1.1655
No log	6.7541	412	1.3877	0.2815	1.3877	1.1780
No log	6.7869	414	1.2809	0.2961	1.2809	1.1318
No log	6.8197	416	1.1912	0.2687	1.1912	1.0914
No log	6.8525	418	1.1156	0.2620	1.1156	1.0562
No log	6.8852	420	1.1065	0.2198	1.1065	1.0519
No log	6.9180	422	1.1448	0.2620	1.1448	1.0700
No log	6.9508	424	1.2574	0.2734	1.2574	1.1213
No log	6.9836	426	1.4298	0.2072	1.4298	1.1957
No log	7.0164	428	1.5623	0.2430	1.5623	1.2499
No log	7.0492	430	1.4995	0.2430	1.4995	1.2245
No log	7.0820	432	1.3117	0.2718	1.3117	1.1453
No log	7.1148	434	1.1483	0.3397	1.1483	1.0716
No log	7.1475	436	1.1171	0.2786	1.1171	1.0570
No log	7.1803	438	1.1454	0.3891	1.1454	1.0702
No log	7.2131	440	1.2521	0.2417	1.2521	1.1190
No log	7.2459	442	1.3671	0.1851	1.3671	1.1692
No log	7.2787	444	1.4236	0.2201	1.4236	1.1932
No log	7.3115	446	1.3853	0.1892	1.3853	1.1770
No log	7.3443	448	1.2848	0.1928	1.2848	1.1335
No log	7.3770	450	1.2400	0.2191	1.2400	1.1136
No log	7.4098	452	1.2032	0.3255	1.2032	1.0969
No log	7.4426	454	1.2296	0.3255	1.2296	1.1089
No log	7.4754	456	1.3137	0.2825	1.3137	1.1462
No log	7.5082	458	1.4030	0.2152	1.4030	1.1845
No log	7.5410	460	1.3856	0.2152	1.3856	1.1771
No log	7.5738	462	1.2538	0.2896	1.2538	1.1197
No log	7.6066	464	1.2109	0.2403	1.2109	1.1004
No log	7.6393	466	1.1722	0.2012	1.1722	1.0827
No log	7.6721	468	1.1484	0.1959	1.1484	1.0716
No log	7.7049	470	1.1791	0.2403	1.1791	1.0858
No log	7.7377	472	1.2434	0.2560	1.2434	1.1151
No log	7.7705	474	1.3215	0.2870	1.3215	1.1496
No log	7.8033	476	1.3493	0.1448	1.3493	1.1616
No log	7.8361	478	1.3136	0.2507	1.3136	1.1461
No log	7.8689	480	1.2376	0.2870	1.2376	1.1125
No log	7.9016	482	1.1316	0.3013	1.1316	1.0638
No log	7.9344	484	1.1103	0.2344	1.1103	1.0537
No log	7.9672	486	1.1243	0.2896	1.1243	1.0603
No log	8.0	488	1.1850	0.2624	1.1850	1.0886
No log	8.0328	490	1.3000	0.3207	1.3000	1.1402
No log	8.0656	492	1.3065	0.2718	1.3065	1.1430
No log	8.0984	494	1.2159	0.3237	1.2159	1.1027
No log	8.1311	496	1.1325	0.2730	1.1325	1.0642
No log	8.1639	498	1.1140	0.2505	1.1140	1.0555
0.309	8.1967	500	1.1347	0.2529	1.1347	1.0652
0.309	8.2295	502	1.1787	0.2851	1.1787	1.0857
0.309	8.2623	504	1.2992	0.2417	1.2992	1.1398
0.309	8.2951	506	1.3423	0.2377	1.3423	1.1586
0.309	8.3279	508	1.3105	0.2644	1.3105	1.1448
0.309	8.3607	510	1.2464	0.3144	1.2464	1.1164
0.309	8.3934	512	1.2196	0.2654	1.2196	1.1043
0.309	8.4262	514	1.1988	0.2844	1.1988	1.0949
0.309	8.4590	516	1.1660	0.2555	1.1660	1.0798
0.309	8.4918	518	1.1904	0.2511	1.1904	1.0911
0.309	8.5246	520	1.2237	0.2088	1.2237	1.1062
0.309	8.5574	522	1.3073	0.2100	1.3073	1.1434
0.309	8.5902	524	1.3728	0.1371	1.3728	1.1717
0.309	8.6230	526	1.3677	0.1459	1.3677	1.1695

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1