ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1534
• Qwk: 0.1646
• Mse: 1.1534
• Rmse: 1.0740

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0267	2	4.7981	0.0010	4.7981	2.1905
No log	0.0533	4	3.0938	-0.0233	3.0938	1.7589
No log	0.08	6	1.7228	0.0504	1.7228	1.3126
No log	0.1067	8	1.8146	0.0372	1.8146	1.3471
No log	0.1333	10	1.6844	-0.0293	1.6844	1.2978
No log	0.16	12	1.1615	0.1875	1.1615	1.0777
No log	0.1867	14	1.4565	-0.0149	1.4565	1.2068
No log	0.2133	16	1.6857	0.0724	1.6857	1.2983
No log	0.24	18	1.4439	0.0	1.4439	1.2016
No log	0.2667	20	1.1880	0.1974	1.1880	1.0899
No log	0.2933	22	1.1263	0.2439	1.1263	1.0613
No log	0.32	24	1.1586	0.2386	1.1586	1.0764
No log	0.3467	26	1.1121	0.2684	1.1121	1.0545
No log	0.3733	28	1.0828	0.3091	1.0828	1.0406
No log	0.4	30	1.0699	0.3041	1.0699	1.0344
No log	0.4267	32	1.0935	0.2386	1.0935	1.0457
No log	0.4533	34	1.4233	0.1106	1.4233	1.1930
No log	0.48	36	1.8849	0.0603	1.8849	1.3729
No log	0.5067	38	2.0380	0.0528	2.0380	1.4276
No log	0.5333	40	1.7719	0.0709	1.7719	1.3311
No log	0.56	42	1.4540	0.0310	1.4540	1.2058
No log	0.5867	44	1.2871	0.2864	1.2871	1.1345
No log	0.6133	46	1.1687	0.2203	1.1687	1.0810
No log	0.64	48	1.1744	0.2243	1.1744	1.0837
No log	0.6667	50	1.1496	0.2243	1.1496	1.0722
No log	0.6933	52	1.2584	0.2150	1.2584	1.1218
No log	0.72	54	1.2614	0.1772	1.2614	1.1231
No log	0.7467	56	1.1424	0.2589	1.1424	1.0688
No log	0.7733	58	1.2360	0.1966	1.2360	1.1118
No log	0.8	60	1.4382	0.2337	1.4382	1.1992
No log	0.8267	62	1.5728	0.1615	1.5728	1.2541
No log	0.8533	64	1.4545	0.2706	1.4545	1.2060
No log	0.88	66	1.3565	0.3003	1.3565	1.1647
No log	0.9067	68	1.2758	0.2676	1.2758	1.1295
No log	0.9333	70	1.2789	0.2676	1.2789	1.1309
No log	0.96	72	1.1199	0.3255	1.1199	1.0583
No log	0.9867	74	1.2129	0.3670	1.2129	1.1013
No log	1.0133	76	1.2911	0.3630	1.2911	1.1363
No log	1.04	78	1.4635	0.3273	1.4635	1.2098
No log	1.0667	80	1.3030	0.3562	1.3030	1.1415
No log	1.0933	82	1.1348	0.2986	1.1348	1.0653
No log	1.12	84	1.0512	0.3016	1.0512	1.0253
No log	1.1467	86	1.0435	0.2703	1.0435	1.0215
No log	1.1733	88	1.0867	0.2844	1.0867	1.0424
No log	1.2	90	1.3576	0.3348	1.3576	1.1652
No log	1.2267	92	1.5182	0.2155	1.5182	1.2322
No log	1.2533	94	1.3649	0.3348	1.3649	1.1683
No log	1.28	96	1.1333	0.2700	1.1333	1.0646
No log	1.3067	98	1.0871	0.2902	1.0871	1.0426
No log	1.3333	100	1.1148	0.3595	1.1148	1.0558
No log	1.3600	102	1.0959	0.3018	1.0959	1.0469
No log	1.3867	104	1.0932	0.3101	1.0932	1.0456
No log	1.4133	106	1.2475	0.2712	1.2475	1.1169
No log	1.44	108	1.4976	0.2523	1.4976	1.2238
No log	1.4667	110	1.5598	0.2328	1.5598	1.2489
No log	1.4933	112	1.3396	0.2398	1.3396	1.1574
No log	1.52	114	1.2335	0.2273	1.2335	1.1106
No log	1.5467	116	1.1571	0.2021	1.1571	1.0757
No log	1.5733	118	1.1604	0.2075	1.1604	1.0772
No log	1.6	120	1.1859	0.1651	1.1859	1.0890
No log	1.6267	122	1.2320	0.1898	1.2320	1.1099
No log	1.6533	124	1.4028	0.2525	1.4028	1.1844
No log	1.6800	126	1.4038	0.2191	1.4038	1.1848
No log	1.7067	128	1.3200	0.1234	1.3200	1.1489
No log	1.7333	130	1.3458	0.1379	1.3458	1.1601
No log	1.76	132	1.3258	0.1781	1.3258	1.1514
No log	1.7867	134	1.2857	0.2051	1.2857	1.1339
No log	1.8133	136	1.2484	0.2802	1.2484	1.1173
No log	1.8400	138	1.2251	0.1863	1.2251	1.1068
No log	1.8667	140	1.3577	0.1503	1.3577	1.1652
No log	1.8933	142	1.5632	0.1487	1.5632	1.2503
No log	1.92	144	1.4616	0.2015	1.4616	1.2089
No log	1.9467	146	1.3164	0.2054	1.3164	1.1473
No log	1.9733	148	1.1906	0.1412	1.1906	1.0912
No log	2.0	150	1.1789	0.1687	1.1789	1.0858
No log	2.0267	152	1.2442	0.1835	1.2442	1.1154
No log	2.0533	154	1.3389	0.2259	1.3389	1.1571
No log	2.08	156	1.4104	0.1914	1.4104	1.1876
No log	2.1067	158	1.3437	0.2344	1.3437	1.1592
No log	2.1333	160	1.2759	0.1498	1.2759	1.1296
No log	2.16	162	1.2221	0.2089	1.2221	1.1055
No log	2.1867	164	1.1550	0.2227	1.1550	1.0747
No log	2.2133	166	1.1613	0.1966	1.1613	1.0777
No log	2.24	168	1.1639	0.2108	1.1639	1.0789
No log	2.2667	170	1.1248	0.2794	1.1248	1.0605
No log	2.2933	172	1.1401	0.3154	1.1401	1.0678
No log	2.32	174	1.1879	0.3033	1.1879	1.0899
No log	2.3467	176	1.2374	0.3033	1.2374	1.1124
No log	2.3733	178	1.2937	0.2478	1.2937	1.1374
No log	2.4	180	1.3294	0.2493	1.3294	1.1530
No log	2.4267	182	1.4503	0.2527	1.4503	1.2043
No log	2.4533	184	1.5244	0.2355	1.5244	1.2347
No log	2.48	186	1.4045	0.2070	1.4045	1.1851
No log	2.5067	188	1.3381	0.1563	1.3381	1.1568
No log	2.5333	190	1.3303	0.2241	1.3303	1.1534
No log	2.56	192	1.3290	0.1356	1.3290	1.1528
No log	2.5867	194	1.3324	0.0820	1.3324	1.1543
No log	2.6133	196	1.4849	0.1914	1.4849	1.2186
No log	2.64	198	1.4242	0.2438	1.4242	1.1934
No log	2.6667	200	1.2992	0.1841	1.2992	1.1398
No log	2.6933	202	1.1906	0.2021	1.1906	1.0912
No log	2.7200	204	1.2874	0.3029	1.2874	1.1346
No log	2.7467	206	1.5371	0.2418	1.5371	1.2398
No log	2.7733	208	1.4614	0.2582	1.4614	1.2089
No log	2.8	210	1.2688	0.2814	1.2688	1.1264
No log	2.8267	212	1.3950	0.2674	1.3950	1.1811
No log	2.8533	214	1.6198	0.1727	1.6198	1.2727
No log	2.88	216	1.5742	0.1991	1.5742	1.2547
No log	2.9067	218	1.3977	0.2096	1.3977	1.1822
No log	2.9333	220	1.2625	0.2270	1.2625	1.1236
No log	2.96	222	1.3347	0.1957	1.3347	1.1553
No log	2.9867	224	1.5876	0.2226	1.5876	1.2600
No log	3.0133	226	1.6159	0.2303	1.6159	1.2712
No log	3.04	228	1.3735	0.1561	1.3735	1.1720
No log	3.0667	230	1.2475	0.1576	1.2475	1.1169
No log	3.0933	232	1.2249	0.1468	1.2249	1.1067
No log	3.12	234	1.1972	0.2221	1.1972	1.0942
No log	3.1467	236	1.1352	0.2249	1.1352	1.0654
No log	3.1733	238	1.1416	0.2249	1.1416	1.0685
No log	3.2	240	1.1830	0.2366	1.1830	1.0876
No log	3.2267	242	1.3091	0.3028	1.3091	1.1442
No log	3.2533	244	1.3119	0.2772	1.3119	1.1454
No log	3.2800	246	1.1859	0.3202	1.1859	1.0890
No log	3.3067	248	1.1674	0.3115	1.1674	1.0805
No log	3.3333	250	1.2752	0.3137	1.2752	1.1292
No log	3.36	252	1.3038	0.2788	1.3038	1.1418
No log	3.3867	254	1.2898	0.2946	1.2898	1.1357
No log	3.4133	256	1.2855	0.3401	1.2855	1.1338
No log	3.44	258	1.2819	0.3132	1.2819	1.1322
No log	3.4667	260	1.2795	0.3132	1.2795	1.1311
No log	3.4933	262	1.4195	0.1997	1.4195	1.1914
No log	3.52	264	1.5861	0.1427	1.5861	1.2594
No log	3.5467	266	1.5601	0.1427	1.5601	1.2491
No log	3.5733	268	1.3788	0.1956	1.3788	1.1742
No log	3.6	270	1.3377	0.1950	1.3377	1.1566
No log	3.6267	272	1.3006	0.2159	1.3006	1.1404
No log	3.6533	274	1.3249	0.2122	1.3249	1.1510
No log	3.68	276	1.3546	0.2270	1.3546	1.1639
No log	3.7067	278	1.2562	0.2159	1.2562	1.1208
No log	3.7333	280	1.1988	0.2236	1.1988	1.0949
No log	3.76	282	1.1683	0.3651	1.1683	1.0809
No log	3.7867	284	1.1563	0.3377	1.1563	1.0753
No log	3.8133	286	1.1800	0.2514	1.1800	1.0863
No log	3.84	288	1.2663	0.2565	1.2663	1.1253
No log	3.8667	290	1.3568	0.2424	1.3568	1.1648
No log	3.8933	292	1.3178	0.1914	1.3178	1.1479
No log	3.92	294	1.2358	0.2308	1.2358	1.1117
No log	3.9467	296	1.1957	0.2634	1.1957	1.0935
No log	3.9733	298	1.2211	0.2108	1.2211	1.1050
No log	4.0	300	1.2536	0.2156	1.2536	1.1196
No log	4.0267	302	1.3319	0.2067	1.3319	1.1541
No log	4.0533	304	1.5874	0.1858	1.5874	1.2599
No log	4.08	306	1.6833	0.1595	1.6833	1.2974
No log	4.1067	308	1.5371	0.1758	1.5371	1.2398
No log	4.1333	310	1.4206	0.1098	1.4206	1.1919
No log	4.16	312	1.3377	0.1379	1.3377	1.1566
No log	4.1867	314	1.2895	0.1609	1.2895	1.1356
No log	4.2133	316	1.2930	0.2208	1.2930	1.1371
No log	4.24	318	1.3840	0.2134	1.3840	1.1764
No log	4.2667	320	1.4369	0.2424	1.4369	1.1987
No log	4.2933	322	1.3923	0.2047	1.3923	1.1800
No log	4.32	324	1.4351	0.2424	1.4351	1.1979
No log	4.3467	326	1.4642	0.2550	1.4642	1.2100
No log	4.3733	328	1.3489	0.2048	1.3489	1.1614
No log	4.4	330	1.2060	0.2697	1.2060	1.0982
No log	4.4267	332	1.1298	0.2146	1.1298	1.0629
No log	4.4533	334	1.1085	0.2146	1.1085	1.0529
No log	4.48	336	1.1404	0.2567	1.1404	1.0679
No log	4.5067	338	1.2583	0.2040	1.2583	1.1217
No log	4.5333	340	1.4065	0.1751	1.4065	1.1860
No log	4.5600	342	1.3973	0.2060	1.3973	1.1821
No log	4.5867	344	1.2534	0.2445	1.2534	1.1195
No log	4.6133	346	1.2298	0.2246	1.2298	1.1090
No log	4.64	348	1.3139	0.2035	1.3139	1.1462
No log	4.6667	350	1.3758	0.1742	1.3758	1.1729
No log	4.6933	352	1.3820	0.1873	1.3820	1.1756
No log	4.72	354	1.3830	0.2004	1.3830	1.1760
No log	4.7467	356	1.2796	0.2464	1.2796	1.1312
No log	4.7733	358	1.2335	0.1674	1.2335	1.1106
No log	4.8	360	1.2468	0.1993	1.2468	1.1166
No log	4.8267	362	1.2822	0.1958	1.2822	1.1324
No log	4.8533	364	1.3160	0.2418	1.3160	1.1472
No log	4.88	366	1.2819	0.1958	1.2819	1.1322
No log	4.9067	368	1.2830	0.1741	1.2830	1.1327
No log	4.9333	370	1.3958	0.1824	1.3958	1.1815
No log	4.96	372	1.5036	0.2306	1.5036	1.2262
No log	4.9867	374	1.4905	0.2017	1.4905	1.2208
No log	5.0133	376	1.3872	0.1660	1.3872	1.1778
No log	5.04	378	1.3398	0.1849	1.3398	1.1575
No log	5.0667	380	1.3993	0.1830	1.3993	1.1829
No log	5.0933	382	1.4941	0.1845	1.4941	1.2223
No log	5.12	384	1.5501	0.1646	1.5501	1.2450
No log	5.1467	386	1.4369	0.2052	1.4369	1.1987
No log	5.1733	388	1.3637	0.1507	1.3637	1.1678
No log	5.2	390	1.2958	0.1151	1.2958	1.1383
No log	5.2267	392	1.2801	0.1151	1.2801	1.1314
No log	5.2533	394	1.3184	0.1292	1.3184	1.1482
No log	5.28	396	1.4552	0.1880	1.4552	1.2063
No log	5.3067	398	1.4803	0.2099	1.4803	1.2167
No log	5.3333	400	1.4732	0.2227	1.4732	1.2137
No log	5.36	402	1.3311	0.2088	1.3311	1.1537
No log	5.3867	404	1.2554	0.1054	1.2554	1.1205
No log	5.4133	406	1.2783	0.1205	1.2783	1.1306
No log	5.44	408	1.3506	0.1906	1.3506	1.1621
No log	5.4667	410	1.3848	0.2484	1.3848	1.1768
No log	5.4933	412	1.3164	0.1725	1.3164	1.1473
No log	5.52	414	1.2875	0.2366	1.2875	1.1347
No log	5.5467	416	1.2495	0.1869	1.2495	1.1178
No log	5.5733	418	1.2415	0.2572	1.2415	1.1142
No log	5.6	420	1.2653	0.1803	1.2653	1.1248
No log	5.6267	422	1.2879	0.2181	1.2879	1.1349
No log	5.6533	424	1.2454	0.2511	1.2454	1.1160
No log	5.68	426	1.2015	0.2169	1.2015	1.0961
No log	5.7067	428	1.2043	0.2075	1.2043	1.0974
No log	5.7333	430	1.2407	0.2044	1.2407	1.1139
No log	5.76	432	1.3311	0.2451	1.3311	1.1537
No log	5.7867	434	1.4638	0.2335	1.4638	1.2099
No log	5.8133	436	1.5712	0.2099	1.5712	1.2535
No log	5.84	438	1.4421	0.2260	1.4421	1.2009
No log	5.8667	440	1.2273	0.2181	1.2273	1.1078
No log	5.8933	442	1.1202	0.2654	1.1202	1.0584
No log	5.92	444	1.0741	0.2364	1.0741	1.0364
No log	5.9467	446	1.1136	0.2296	1.1136	1.0553
No log	5.9733	448	1.2169	0.2561	1.2169	1.1031
No log	6.0	450	1.3175	0.2398	1.3175	1.1478
No log	6.0267	452	1.3406	0.2398	1.3406	1.1578
No log	6.0533	454	1.2634	0.1990	1.2634	1.1240
No log	6.08	456	1.2678	0.1691	1.2678	1.1260
No log	6.1067	458	1.3530	0.1855	1.3530	1.1632
No log	6.1333	460	1.4524	0.2090	1.4524	1.2052
No log	6.16	462	1.4281	0.1955	1.4281	1.1950
No log	6.1867	464	1.3719	0.1855	1.3719	1.1713
No log	6.2133	466	1.3798	0.1682	1.3798	1.1747
No log	6.24	468	1.3819	0.1458	1.3819	1.1755
No log	6.2667	470	1.3806	0.1458	1.3806	1.1750
No log	6.2933	472	1.2991	0.1560	1.2991	1.1398
No log	6.32	474	1.2292	0.1919	1.2292	1.1087
No log	6.3467	476	1.2535	0.2169	1.2535	1.1196
No log	6.3733	478	1.3823	0.2048	1.3823	1.1757
No log	6.4	480	1.6510	0.1766	1.6510	1.2849
No log	6.4267	482	1.8002	0.1367	1.8002	1.3417
No log	6.4533	484	1.7437	0.1550	1.7437	1.3205
No log	6.48	486	1.4985	0.1935	1.4985	1.2241
No log	6.5067	488	1.3170	0.1865	1.3170	1.1476
No log	6.5333	490	1.2739	0.2901	1.2739	1.1287
No log	6.5600	492	1.2821	0.2510	1.2821	1.1323
No log	6.5867	494	1.3328	0.2048	1.3328	1.1545
No log	6.6133	496	1.3288	0.2181	1.3288	1.1527
No log	6.64	498	1.2192	0.2501	1.2192	1.1042
0.3337	6.6667	500	1.1561	0.1919	1.1561	1.0752
0.3337	6.6933	502	1.1350	0.1863	1.1350	1.0654
0.3337	6.72	504	1.1901	0.2685	1.1901	1.0909
0.3337	6.7467	506	1.2538	0.2091	1.2538	1.1198
0.3337	6.7733	508	1.2683	0.2404	1.2683	1.1262
0.3337	6.8	510	1.2496	0.2320	1.2496	1.1179
0.3337	6.8267	512	1.2139	0.3010	1.2139	1.1018
0.3337	6.8533	514	1.2505	0.2410	1.2505	1.1183
0.3337	6.88	516	1.3190	0.2320	1.3190	1.1485
0.3337	6.9067	518	1.3549	0.2404	1.3549	1.1640
0.3337	6.9333	520	1.2964	0.2637	1.2964	1.1386
0.3337	6.96	522	1.2335	0.1733	1.2335	1.1107
0.3337	6.9867	524	1.2126	0.1589	1.2126	1.1012
0.3337	7.0133	526	1.2281	0.2158	1.2281	1.1082
0.3337	7.04	528	1.2809	0.2361	1.2809	1.1318
0.3337	7.0667	530	1.2704	0.2732	1.2704	1.1271
0.3337	7.0933	532	1.2055	0.2495	1.2055	1.0979
0.3337	7.12	534	1.1652	0.2633	1.1652	1.0794
0.3337	7.1467	536	1.1719	0.2446	1.1719	1.0825
0.3337	7.1733	538	1.2822	0.2750	1.2822	1.1323
0.3337	7.2	540	1.3295	0.2424	1.3295	1.1530
0.3337	7.2267	542	1.2318	0.2609	1.2318	1.1098
0.3337	7.2533	544	1.1418	0.2682	1.1418	1.0686
0.3337	7.28	546	1.1365	0.2682	1.1365	1.0661
0.3337	7.3067	548	1.1893	0.2732	1.1893	1.0906
0.3337	7.3333	550	1.2346	0.2609	1.2346	1.1111
0.3337	7.36	552	1.2310	0.2963	1.2310	1.1095
0.3337	7.3867	554	1.2439	0.2824	1.2439	1.1153
0.3337	7.4133	556	1.2381	0.2824	1.2381	1.1127
0.3337	7.44	558	1.2301	0.2650	1.2301	1.1091
0.3337	7.4667	560	1.3451	0.2716	1.3451	1.1598
0.3337	7.4933	562	1.4985	0.2339	1.4985	1.2241
0.3337	7.52	564	1.4494	0.2262	1.4494	1.2039
0.3337	7.5467	566	1.3112	0.2180	1.3112	1.1451
0.3337	7.5733	568	1.2185	0.1723	1.2185	1.1039
0.3337	7.6	570	1.1959	0.1704	1.1959	1.0936
0.3337	7.6267	572	1.2040	0.1609	1.2040	1.0973
0.3337	7.6533	574	1.2677	0.1447	1.2677	1.1259
0.3337	7.68	576	1.3721	0.1958	1.3721	1.1714
0.3337	7.7067	578	1.5188	0.1845	1.5188	1.2324
0.3337	7.7333	580	1.4843	0.2143	1.4843	1.2183
0.3337	7.76	582	1.4035	0.2053	1.4035	1.1847
0.3337	7.7867	584	1.3243	0.2230	1.3243	1.1508
0.3337	7.8133	586	1.2442	0.1920	1.2442	1.1155
0.3337	7.84	588	1.2254	0.1912	1.2254	1.1070
0.3337	7.8667	590	1.2200	0.1824	1.2200	1.1045
0.3337	7.8933	592	1.1795	0.1457	1.1795	1.0860
0.3337	7.92	594	1.1561	0.1590	1.1561	1.0752
0.3337	7.9467	596	1.1534	0.1646	1.1534	1.0740

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1