ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1389
• Qwk: 0.2071
• Mse: 1.1389
• Rmse: 1.0672

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	4.5744	0.0010	4.5744	2.1388
No log	0.0741	4	2.4634	0.0397	2.4634	1.5695
No log	0.1111	6	1.6141	0.0372	1.6141	1.2705
No log	0.1481	8	1.4390	0.0242	1.4390	1.1996
No log	0.1852	10	1.2383	0.0768	1.2383	1.1128
No log	0.2222	12	1.4089	0.0704	1.4089	1.1870
No log	0.2593	14	2.0575	-0.125	2.0575	1.4344
No log	0.2963	16	2.1650	-0.1098	2.1650	1.4714
No log	0.3333	18	1.8081	0.0019	1.8081	1.3447
No log	0.3704	20	1.3777	0.1168	1.3777	1.1738
No log	0.4074	22	1.1820	0.1772	1.1820	1.0872
No log	0.4444	24	1.2206	0.2491	1.2206	1.1048
No log	0.4815	26	1.4595	0.0688	1.4595	1.2081
No log	0.5185	28	1.6799	0.0608	1.6799	1.2961
No log	0.5556	30	1.5460	0.0688	1.5460	1.2434
No log	0.5926	32	1.2575	0.1715	1.2575	1.1214
No log	0.6296	34	1.3198	0.2110	1.3198	1.1488
No log	0.6667	36	1.3528	0.1748	1.3528	1.1631
No log	0.7037	38	1.4363	0.1674	1.4363	1.1985
No log	0.7407	40	1.3182	0.1255	1.3182	1.1481
No log	0.7778	42	1.2191	0.1904	1.2191	1.1042
No log	0.8148	44	1.1427	0.1507	1.1427	1.0690
No log	0.8519	46	1.1813	0.2396	1.1813	1.0869
No log	0.8889	48	1.2672	0.1516	1.2672	1.1257
No log	0.9259	50	1.1366	0.2488	1.1366	1.0661
No log	0.9630	52	1.1001	0.2626	1.1001	1.0488
No log	1.0	54	1.0567	0.2786	1.0567	1.0280
No log	1.0370	56	1.1121	0.1507	1.1121	1.0545
No log	1.0741	58	1.1906	0.1821	1.1906	1.0912
No log	1.1111	60	1.3450	0.1784	1.3450	1.1597
No log	1.1481	62	1.8384	0.0997	1.8384	1.3559
No log	1.1852	64	2.0426	0.1594	2.0426	1.4292
No log	1.2222	66	1.8376	0.2085	1.8376	1.3556
No log	1.2593	68	1.5498	0.2459	1.5498	1.2449
No log	1.2963	70	1.3826	0.1256	1.3826	1.1758
No log	1.3333	72	1.3152	0.1438	1.3152	1.1468
No log	1.3704	74	1.1998	0.1136	1.1998	1.0953
No log	1.4074	76	1.1594	0.1472	1.1594	1.0768
No log	1.4444	78	1.1889	0.1622	1.1889	1.0904
No log	1.4815	80	1.1693	0.1622	1.1693	1.0813
No log	1.5185	82	1.1587	0.1622	1.1587	1.0764
No log	1.5556	84	1.1423	0.2095	1.1423	1.0688
No log	1.5926	86	1.1539	0.1848	1.1539	1.0742
No log	1.6296	88	1.2085	0.1753	1.2085	1.0993
No log	1.6667	90	1.1643	0.2137	1.1643	1.0790
No log	1.7037	92	1.1995	0.1753	1.1995	1.0952
No log	1.7407	94	1.2357	0.2243	1.2357	1.1116
No log	1.7778	96	1.2174	0.1753	1.2174	1.1034
No log	1.8148	98	1.1326	0.2555	1.1326	1.0642
No log	1.8519	100	1.1280	0.2620	1.1280	1.0621
No log	1.8889	102	1.1618	0.2871	1.1618	1.0779
No log	1.9259	104	1.2039	0.2044	1.2039	1.0972
No log	1.9630	106	1.1375	0.2555	1.1375	1.0665
No log	2.0	108	1.1090	0.2943	1.1090	1.0531
No log	2.0370	110	1.1490	0.2529	1.1490	1.0719
No log	2.0741	112	1.2747	0.1950	1.2747	1.1290
No log	2.1111	114	1.3405	0.2007	1.3405	1.1578
No log	2.1481	116	1.3184	0.2133	1.3184	1.1482
No log	2.1852	118	1.3453	0.2701	1.3453	1.1599
No log	2.2222	120	1.2396	0.2344	1.2396	1.1134
No log	2.2593	122	1.1426	0.3450	1.1426	1.0689
No log	2.2963	124	1.1108	0.3249	1.1108	1.0539
No log	2.3333	126	1.1022	0.3590	1.1022	1.0499
No log	2.3704	128	1.1082	0.3711	1.1082	1.0527
No log	2.4074	130	1.1194	0.3418	1.1194	1.0580
No log	2.4444	132	1.1881	0.2698	1.1881	1.0900
No log	2.4815	134	1.1949	0.2568	1.1949	1.0931
No log	2.5185	136	1.1526	0.3831	1.1526	1.0736
No log	2.5556	138	1.2186	0.3460	1.2186	1.1039
No log	2.5926	140	1.2284	0.3358	1.2284	1.1083
No log	2.6296	142	1.1875	0.3918	1.1875	1.0897
No log	2.6667	144	1.1667	0.3595	1.1667	1.0801
No log	2.7037	146	1.1586	0.3143	1.1586	1.0764
No log	2.7407	148	1.2383	0.3270	1.2383	1.1128
No log	2.7778	150	1.5482	0.2583	1.5482	1.2443
No log	2.8148	152	1.8075	0.2049	1.8075	1.3444
No log	2.8519	154	1.5639	0.2402	1.5639	1.2506
No log	2.8889	156	1.1910	0.2770	1.1910	1.0913
No log	2.9259	158	1.0984	0.3750	1.0984	1.0480
No log	2.9630	160	1.1007	0.3584	1.1007	1.0491
No log	3.0	162	1.0897	0.3473	1.0897	1.0439
No log	3.0370	164	1.1634	0.2966	1.1634	1.0786
No log	3.0741	166	1.2339	0.2746	1.2339	1.1108
No log	3.1111	168	1.4252	0.3019	1.4252	1.1938
No log	3.1481	170	1.4832	0.3258	1.4832	1.2179
No log	3.1852	172	1.2656	0.2822	1.2656	1.1250
No log	3.2222	174	1.0846	0.2906	1.0846	1.0414
No log	3.2593	176	1.0765	0.3708	1.0765	1.0376
No log	3.2963	178	1.0824	0.3296	1.0824	1.0404
No log	3.3333	180	1.1983	0.2696	1.1983	1.0947
No log	3.3704	182	1.4086	0.2407	1.4086	1.1869
No log	3.4074	184	1.4304	0.2372	1.4304	1.1960
No log	3.4444	186	1.2330	0.2806	1.2330	1.1104
No log	3.4815	188	1.0981	0.2514	1.0981	1.0479
No log	3.5185	190	1.0988	0.3320	1.0988	1.0482
No log	3.5556	192	1.1538	0.2770	1.1538	1.0741
No log	3.5926	194	1.2023	0.2839	1.2023	1.0965
No log	3.6296	196	1.2228	0.2625	1.2228	1.1058
No log	3.6667	198	1.2116	0.2233	1.2116	1.1007
No log	3.7037	200	1.2288	0.2073	1.2288	1.1085
No log	3.7407	202	1.2732	0.2820	1.2732	1.1283
No log	3.7778	204	1.2414	0.2734	1.2414	1.1142
No log	3.8148	206	1.2109	0.2482	1.2109	1.1004
No log	3.8519	208	1.1691	0.3059	1.1691	1.0813
No log	3.8889	210	1.1942	0.3729	1.1942	1.0928
No log	3.9259	212	1.2005	0.2508	1.2005	1.0957
No log	3.9630	214	1.2714	0.1798	1.2714	1.1276
No log	4.0	216	1.3919	0.1820	1.3919	1.1798
No log	4.0370	218	1.2765	0.1885	1.2765	1.1298
No log	4.0741	220	1.1926	0.2995	1.1926	1.0920
No log	4.1111	222	1.1948	0.3712	1.1948	1.0931
No log	4.1481	224	1.1503	0.2675	1.1503	1.0725
No log	4.1852	226	1.1868	0.2699	1.1868	1.0894
No log	4.2222	228	1.3429	0.2752	1.3429	1.1588
No log	4.2593	230	1.3070	0.2688	1.3070	1.1432
No log	4.2963	232	1.1472	0.2947	1.1472	1.0711
No log	4.3333	234	1.1133	0.3781	1.1133	1.0551
No log	4.3704	236	1.1004	0.4340	1.1004	1.0490
No log	4.4074	238	1.0801	0.4275	1.0801	1.0393
No log	4.4444	240	1.0573	0.4369	1.0573	1.0283
No log	4.4815	242	1.0511	0.3728	1.0511	1.0252
No log	4.5185	244	1.0619	0.2941	1.0619	1.0305
No log	4.5556	246	1.0656	0.3943	1.0656	1.0323
No log	4.5926	248	1.1036	0.2969	1.1036	1.0505
No log	4.6296	250	1.1637	0.2664	1.1637	1.0788
No log	4.6667	252	1.1855	0.2431	1.1855	1.0888
No log	4.7037	254	1.2058	0.2989	1.2058	1.0981
No log	4.7407	256	1.1796	0.3169	1.1796	1.0861
No log	4.7778	258	1.1692	0.2714	1.1692	1.0813
No log	4.8148	260	1.1433	0.2529	1.1433	1.0693
No log	4.8519	262	1.1550	0.1882	1.1550	1.0747
No log	4.8889	264	1.1503	0.1630	1.1503	1.0725
No log	4.9259	266	1.1537	0.2431	1.1537	1.0741
No log	4.9630	268	1.1481	0.3684	1.1481	1.0715
No log	5.0	270	1.1928	0.3579	1.1928	1.0921
No log	5.0370	272	1.1764	0.3737	1.1764	1.0846
No log	5.0741	274	1.1565	0.2947	1.1565	1.0754
No log	5.1111	276	1.1616	0.2247	1.1616	1.0778
No log	5.1481	278	1.1248	0.2572	1.1248	1.0606
No log	5.1852	280	1.0877	0.4278	1.0877	1.0429
No log	5.2222	282	1.0797	0.2871	1.0797	1.0391
No log	5.2593	284	1.1126	0.2651	1.1126	1.0548
No log	5.2963	286	1.1036	0.2709	1.1036	1.0505
No log	5.3333	288	1.1077	0.2803	1.1077	1.0525
No log	5.3704	290	1.1192	0.2850	1.1192	1.0579
No log	5.4074	292	1.1418	0.3081	1.1418	1.0686
No log	5.4444	294	1.2182	0.2593	1.2182	1.1037
No log	5.4815	296	1.1686	0.2786	1.1686	1.0810
No log	5.5185	298	1.1328	0.3418	1.1328	1.0643
No log	5.5556	300	1.1625	0.3087	1.1625	1.0782
No log	5.5926	302	1.1645	0.3375	1.1645	1.0791
No log	5.6296	304	1.1187	0.3826	1.1187	1.0577
No log	5.6667	306	1.1188	0.2290	1.1188	1.0577
No log	5.7037	308	1.1745	0.2832	1.1745	1.0837
No log	5.7407	310	1.1252	0.2712	1.1252	1.0608
No log	5.7778	312	1.0757	0.3430	1.0757	1.0372
No log	5.8148	314	1.0670	0.3134	1.0670	1.0330
No log	5.8519	316	1.0652	0.3811	1.0652	1.0321
No log	5.8889	318	1.0663	0.3293	1.0663	1.0326
No log	5.9259	320	1.1051	0.2966	1.1051	1.0512
No log	5.9630	322	1.1491	0.2670	1.1491	1.0720
No log	6.0	324	1.1383	0.3169	1.1383	1.0669
No log	6.0370	326	1.1496	0.2871	1.1496	1.0722
No log	6.0741	328	1.1447	0.2495	1.1447	1.0699
No log	6.1111	330	1.0906	0.3453	1.0906	1.0443
No log	6.1481	332	1.0802	0.3380	1.0802	1.0393
No log	6.1852	334	1.0706	0.3380	1.0706	1.0347
No log	6.2222	336	1.0767	0.3243	1.0767	1.0376
No log	6.2593	338	1.1109	0.1984	1.1109	1.0540
No log	6.2963	340	1.0768	0.3237	1.0768	1.0377
No log	6.3333	342	1.0789	0.3412	1.0789	1.0387
No log	6.3704	344	1.1173	0.3268	1.1173	1.0570
No log	6.4074	346	1.1327	0.3635	1.1327	1.0643
No log	6.4444	348	1.1294	0.2644	1.1294	1.0627
No log	6.4815	350	1.2294	0.2754	1.2294	1.1088
No log	6.5185	352	1.2309	0.2160	1.2309	1.1095
No log	6.5556	354	1.1424	0.3162	1.1424	1.0688
No log	6.5926	356	1.0931	0.3243	1.0931	1.0455
No log	6.6296	358	1.0635	0.2948	1.0635	1.0313
No log	6.6667	360	1.0458	0.2819	1.0458	1.0226
No log	6.7037	362	1.0288	0.3764	1.0288	1.0143
No log	6.7407	364	1.0486	0.3571	1.0486	1.0240
No log	6.7778	366	1.1596	0.2940	1.1596	1.0768
No log	6.8148	368	1.2032	0.2762	1.2032	1.0969
No log	6.8519	370	1.1124	0.2700	1.1124	1.0547
No log	6.8889	372	1.0513	0.3550	1.0513	1.0253
No log	6.9259	374	1.0735	0.3455	1.0735	1.0361
No log	6.9630	376	1.0583	0.3787	1.0583	1.0287
No log	7.0	378	1.0724	0.3382	1.0724	1.0356
No log	7.0370	380	1.1884	0.2581	1.1884	1.0901
No log	7.0741	382	1.2050	0.2320	1.2050	1.0977
No log	7.1111	384	1.1167	0.3133	1.1167	1.0568
No log	7.1481	386	1.0636	0.2755	1.0636	1.0313
No log	7.1852	388	1.0664	0.2903	1.0664	1.0327
No log	7.2222	390	1.0832	0.2755	1.0832	1.0408
No log	7.2593	392	1.1615	0.3378	1.1615	1.0777
No log	7.2963	394	1.2012	0.3135	1.2012	1.0960
No log	7.3333	396	1.1776	0.3446	1.1776	1.0852
No log	7.3704	398	1.1284	0.3205	1.1284	1.0623
No log	7.4074	400	1.1112	0.3256	1.1112	1.0541
No log	7.4444	402	1.1541	0.1935	1.1541	1.0743
No log	7.4815	404	1.2336	0.2191	1.2336	1.1107
No log	7.5185	406	1.2954	0.2150	1.2954	1.1382
No log	7.5556	408	1.2505	0.2283	1.2505	1.1183
No log	7.5926	410	1.1460	0.2601	1.1460	1.0705
No log	7.6296	412	1.1331	0.3482	1.1331	1.0645
No log	7.6667	414	1.1464	0.3442	1.1464	1.0707
No log	7.7037	416	1.1353	0.3509	1.1353	1.0655
No log	7.7407	418	1.1583	0.2601	1.1583	1.0763
No log	7.7778	420	1.2233	0.2035	1.2233	1.1060
No log	7.8148	422	1.2591	0.2255	1.2591	1.1221
No log	7.8519	424	1.1999	0.2259	1.1999	1.0954
No log	7.8889	426	1.1539	0.3301	1.1539	1.0742
No log	7.9259	428	1.1293	0.3180	1.1293	1.0627
No log	7.9630	430	1.1393	0.2664	1.1393	1.0674
No log	8.0	432	1.1811	0.2519	1.1811	1.0868
No log	8.0370	434	1.1839	0.2169	1.1839	1.0881
No log	8.0741	436	1.1825	0.1845	1.1825	1.0874
No log	8.1111	438	1.1381	0.2222	1.1381	1.0668
No log	8.1481	440	1.0966	0.2417	1.0966	1.0472
No log	8.1852	442	1.0959	0.2515	1.0959	1.0469
No log	8.2222	444	1.1413	0.1880	1.1413	1.0683
No log	8.2593	446	1.2769	0.1830	1.2769	1.1300
No log	8.2963	448	1.4519	0.2503	1.4519	1.2049
No log	8.3333	450	1.5167	0.2382	1.5167	1.2315
No log	8.3704	452	1.4189	0.1840	1.4189	1.1912
No log	8.4074	454	1.2507	0.2319	1.2507	1.1183
No log	8.4444	456	1.2211	0.3083	1.2211	1.1050
No log	8.4815	458	1.2092	0.3172	1.2092	1.0996
No log	8.5185	460	1.1818	0.2794	1.1818	1.0871
No log	8.5556	462	1.1533	0.3151	1.1533	1.0739
No log	8.5926	464	1.1313	0.2824	1.1313	1.0636
No log	8.6296	466	1.1234	0.2366	1.1234	1.0599
No log	8.6667	468	1.1107	0.2654	1.1107	1.0539
No log	8.7037	470	1.0800	0.2555	1.0800	1.0392
No log	8.7407	472	1.0681	0.2319	1.0681	1.0335
No log	8.7778	474	1.0740	0.2941	1.0740	1.0363
No log	8.8148	476	1.1157	0.2896	1.1157	1.0563
No log	8.8519	478	1.1232	0.3237	1.1232	1.0598
No log	8.8889	480	1.1451	0.2968	1.1451	1.0701
No log	8.9259	482	1.2147	0.2742	1.2147	1.1021
No log	8.9630	484	1.2432	0.2641	1.2432	1.1150
No log	9.0	486	1.1793	0.2742	1.1793	1.0860
No log	9.0370	488	1.1218	0.2750	1.1218	1.0591
No log	9.0741	490	1.1205	0.2750	1.1205	1.0586
No log	9.1111	492	1.1576	0.2851	1.1576	1.0759
No log	9.1481	494	1.2205	0.1889	1.2205	1.1048
No log	9.1852	496	1.3233	0.2055	1.3233	1.1504
No log	9.2222	498	1.4311	0.2582	1.4311	1.1963
0.3646	9.2593	500	1.3852	0.2582	1.3852	1.1770
0.3646	9.2963	502	1.2236	0.1898	1.2236	1.1062
0.3646	9.3333	504	1.1251	0.2505	1.1251	1.0607
0.3646	9.3704	506	1.0645	0.3256	1.0645	1.0317
0.3646	9.4074	508	1.0378	0.3511	1.0378	1.0187
0.3646	9.4444	510	1.0353	0.3500	1.0353	1.0175
0.3646	9.4815	512	1.0946	0.3287	1.0946	1.0463
0.3646	9.5185	514	1.1133	0.2609	1.1133	1.0551
0.3646	9.5556	516	1.1061	0.2609	1.1061	1.0517
0.3646	9.5926	518	1.0414	0.3668	1.0414	1.0205
0.3646	9.6296	520	1.0356	0.2941	1.0356	1.0176
0.3646	9.6667	522	1.0692	0.2747	1.0692	1.0340
0.3646	9.7037	524	1.0937	0.2555	1.0937	1.0458
0.3646	9.7407	526	1.0570	0.3039	1.0570	1.0281
0.3646	9.7778	528	1.0222	0.3015	1.0222	1.0110
0.3646	9.8148	530	1.0181	0.3015	1.0181	1.0090
0.3646	9.8519	532	1.0401	0.3301	1.0401	1.0199
0.3646	9.8889	534	1.0734	0.2844	1.0734	1.0361
0.3646	9.9259	536	1.0922	0.2824	1.0922	1.0451
0.3646	9.9630	538	1.0753	0.3433	1.0753	1.0370
0.3646	10.0	540	1.0467	0.3205	1.0467	1.0231
0.3646	10.0370	542	1.0374	0.3639	1.0374	1.0185
0.3646	10.0741	544	1.0584	0.4219	1.0584	1.0288
0.3646	10.1111	546	1.0688	0.3200	1.0688	1.0338
0.3646	10.1481	548	1.1008	0.3692	1.1008	1.0492
0.3646	10.1852	550	1.1098	0.3108	1.1098	1.0535
0.3646	10.2222	552	1.0984	0.3458	1.0984	1.0480
0.3646	10.2593	554	1.1207	0.2319	1.1207	1.0586
0.3646	10.2963	556	1.1398	0.1671	1.1398	1.0676
0.3646	10.3333	558	1.1578	0.1671	1.1578	1.0760
0.3646	10.3704	560	1.1840	0.1671	1.1840	1.0881
0.3646	10.4074	562	1.1389	0.2071	1.1389	1.0672

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1