ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1959
• Qwk: 0.1542
• Mse: 1.1959
• Rmse: 1.0936

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.6372	0.0010	4.6372	2.1534
No log	0.1143	4	2.8791	-0.0314	2.8791	1.6968
No log	0.1714	6	1.7762	0.0504	1.7762	1.3327
No log	0.2286	8	1.5653	-0.0271	1.5653	1.2511
No log	0.2857	10	1.3967	0.0428	1.3967	1.1818
No log	0.3429	12	1.7917	0.0017	1.7917	1.3385
No log	0.4	14	1.8331	0.0816	1.8331	1.3539
No log	0.4571	16	1.2421	0.1044	1.2421	1.1145
No log	0.5143	18	1.2428	0.0454	1.2428	1.1148
No log	0.5714	20	1.4423	-0.0901	1.4423	1.2010
No log	0.6286	22	1.6816	-0.0149	1.6816	1.2968
No log	0.6857	24	1.7541	0.0	1.7541	1.3244
No log	0.7429	26	1.6087	0.0	1.6087	1.2684
No log	0.8	28	1.4038	-0.0149	1.4038	1.1848
No log	0.8571	30	1.1593	0.2439	1.1593	1.0767
No log	0.9143	32	1.0966	0.2513	1.0966	1.0472
No log	0.9714	34	1.1020	0.2782	1.1020	1.0498
No log	1.0286	36	1.1381	0.2938	1.1381	1.0668
No log	1.0857	38	1.1109	0.3041	1.1109	1.0540
No log	1.1429	40	1.1003	0.2887	1.1003	1.0489
No log	1.2	42	1.0891	0.2991	1.0891	1.0436
No log	1.2571	44	1.1314	0.2386	1.1314	1.0637
No log	1.3143	46	1.3273	0.1865	1.3273	1.1521
No log	1.3714	48	1.9411	0.1586	1.9411	1.3932
No log	1.4286	50	2.2443	0.1612	2.2443	1.4981
No log	1.4857	52	1.9598	0.0538	1.9598	1.3999
No log	1.5429	54	1.5575	-0.0149	1.5575	1.2480
No log	1.6	56	1.3756	0.1827	1.3756	1.1728
No log	1.6571	58	1.2591	0.1772	1.2591	1.1221
No log	1.7143	60	1.2536	0.1815	1.2536	1.1196
No log	1.7714	62	1.4923	0.1730	1.4923	1.2216
No log	1.8286	64	1.5058	0.1708	1.5058	1.2271
No log	1.8857	66	1.4472	0.1051	1.4472	1.2030
No log	1.9429	68	1.4352	0.0707	1.4352	1.1980
No log	2.0	70	1.3038	0.1076	1.3038	1.1418
No log	2.0571	72	1.2275	0.1679	1.2275	1.1079
No log	2.1143	74	1.2169	0.1772	1.2169	1.1031
No log	2.1714	76	1.2086	0.1772	1.2086	1.0994
No log	2.2286	78	1.1532	0.1848	1.1532	1.0739
No log	2.2857	80	1.1199	0.2358	1.1199	1.0582
No log	2.3429	82	1.1160	0.2823	1.1160	1.0564
No log	2.4	84	1.1092	0.2601	1.1092	1.0532
No log	2.4571	86	1.1456	0.2735	1.1456	1.0703
No log	2.5143	88	1.4650	0.1568	1.4650	1.2104
No log	2.5714	90	1.7553	0.2117	1.7553	1.3249
No log	2.6286	92	1.5126	0.2486	1.5126	1.2299
No log	2.6857	94	1.2340	0.3007	1.2340	1.1109
No log	2.7429	96	1.1330	0.3009	1.1330	1.0644
No log	2.8	98	1.1240	0.3009	1.1240	1.0602
No log	2.8571	100	1.3451	0.1928	1.3451	1.1598
No log	2.9143	102	1.2717	0.2832	1.2717	1.1277
No log	2.9714	104	1.0922	0.2923	1.0922	1.0451
No log	3.0286	106	1.2438	0.2117	1.2438	1.1152
No log	3.0857	108	1.2334	0.3220	1.2334	1.1106
No log	3.1429	110	1.1022	0.2923	1.1022	1.0498
No log	3.2	112	1.3579	0.2105	1.3579	1.1653
No log	3.2571	114	1.5872	0.0324	1.5872	1.2598
No log	3.3143	116	1.5237	0.0324	1.5237	1.2344
No log	3.3714	118	1.3115	0.2202	1.3115	1.1452
No log	3.4286	120	1.1507	0.2446	1.1507	1.0727
No log	3.4857	122	1.1385	0.2651	1.1385	1.0670
No log	3.5429	124	1.1530	0.3036	1.1530	1.0738
No log	3.6	126	1.1931	0.2446	1.1931	1.0923
No log	3.6571	128	1.2346	0.2675	1.2346	1.1111
No log	3.7143	130	1.1773	0.2654	1.1773	1.0850
No log	3.7714	132	1.1303	0.2712	1.1303	1.0631
No log	3.8286	134	1.1036	0.2474	1.1036	1.0505
No log	3.8857	136	1.1192	0.3036	1.1192	1.0579
No log	3.9429	138	1.2570	0.2515	1.2570	1.1212
No log	4.0	140	1.7002	0.1799	1.7002	1.3039
No log	4.0571	142	2.0865	0.1225	2.0865	1.4445
No log	4.1143	144	2.1074	0.1306	2.1074	1.4517
No log	4.1714	146	2.0822	0.1391	2.0822	1.4430
No log	4.2286	148	1.8258	0.0504	1.8258	1.3512
No log	4.2857	150	1.4721	0.1051	1.4721	1.2133
No log	4.3429	152	1.3085	0.0926	1.3085	1.1439
No log	4.4	154	1.1632	0.2333	1.1632	1.0785
No log	4.4571	156	1.1112	0.2579	1.1112	1.0541
No log	4.5143	158	1.2476	0.2609	1.2476	1.1169
No log	4.5714	160	1.3334	0.2424	1.3334	1.1547
No log	4.6286	162	1.2394	0.1797	1.2394	1.1133
No log	4.6857	164	1.3457	0.2506	1.3457	1.1600
No log	4.7429	166	1.6370	0.2912	1.6370	1.2794
No log	4.8	168	1.5411	0.3387	1.5411	1.2414
No log	4.8571	170	1.2489	0.2024	1.2489	1.1175
No log	4.9143	172	1.1729	0.2094	1.1729	1.0830
No log	4.9714	174	1.1792	0.2159	1.1792	1.0859
No log	5.0286	176	1.2693	0.2040	1.2693	1.1266
No log	5.0857	178	1.4070	0.2181	1.4070	1.1862
No log	5.1429	180	1.3797	0.2484	1.3797	1.1746
No log	5.2	182	1.3168	0.2257	1.3168	1.1475
No log	5.2571	184	1.3712	0.2268	1.3712	1.1710
No log	5.3143	186	1.3458	0.2268	1.3458	1.1601
No log	5.3714	188	1.2502	0.2319	1.2502	1.1181
No log	5.4286	190	1.2125	0.2379	1.2125	1.1011
No log	5.4857	192	1.1813	0.3083	1.1813	1.0869
No log	5.5429	194	1.1590	0.2820	1.1590	1.0766
No log	5.6	196	1.3011	0.2327	1.3011	1.1407
No log	5.6571	198	1.8798	0.2044	1.8798	1.3711
No log	5.7143	200	1.9091	0.1946	1.9091	1.3817
No log	5.7714	202	1.4508	0.2172	1.4508	1.2045
No log	5.8286	204	1.1247	0.2557	1.1247	1.0605
No log	5.8857	206	1.1914	0.3595	1.1914	1.0915
No log	5.9429	208	1.1882	0.3326	1.1882	1.0901
No log	6.0	210	1.2065	0.2995	1.2065	1.0984
No log	6.0571	212	1.2395	0.2932	1.2395	1.1133
No log	6.1143	214	1.3771	0.2079	1.3771	1.1735
No log	6.1714	216	1.8059	0.1883	1.8059	1.3438
No log	6.2286	218	1.9078	0.1460	1.9078	1.3812
No log	6.2857	220	1.5736	0.2728	1.5736	1.2544
No log	6.3429	222	1.2160	0.2735	1.2160	1.1027
No log	6.4	224	1.1615	0.2377	1.1615	1.0777
No log	6.4571	226	1.1394	0.2686	1.1394	1.0674
No log	6.5143	228	1.1445	0.2385	1.1445	1.0698
No log	6.5714	230	1.1762	0.2882	1.1762	1.0845
No log	6.6286	232	1.3147	0.2771	1.3147	1.1466
No log	6.6857	234	1.3484	0.2771	1.3484	1.1612
No log	6.7429	236	1.1804	0.3329	1.1804	1.0865
No log	6.8	238	1.1570	0.3371	1.1570	1.0756
No log	6.8571	240	1.1915	0.3529	1.1915	1.0916
No log	6.9143	242	1.3172	0.2771	1.3172	1.1477
No log	6.9714	244	1.2812	0.2727	1.2812	1.1319
No log	7.0286	246	1.2441	0.2727	1.2441	1.1154
No log	7.0857	248	1.2289	0.2496	1.2289	1.1086
No log	7.1429	250	1.1836	0.2001	1.1836	1.0879
No log	7.2	252	1.1736	0.2177	1.1736	1.0833
No log	7.2571	254	1.1851	0.2991	1.1851	1.0886
No log	7.3143	256	1.2420	0.2078	1.2420	1.1145
No log	7.3714	258	1.2293	0.2667	1.2293	1.1087
No log	7.4286	260	1.1781	0.3516	1.1781	1.0854
No log	7.4857	262	1.2358	0.2876	1.2358	1.1117
No log	7.5429	264	1.2211	0.3180	1.2211	1.1050
No log	7.6	266	1.1490	0.2949	1.1490	1.0719
No log	7.6571	268	1.1212	0.3369	1.1212	1.0589
No log	7.7143	270	1.1291	0.3919	1.1291	1.0626
No log	7.7714	272	1.1840	0.3493	1.1840	1.0881
No log	7.8286	274	1.1763	0.3493	1.1763	1.0846
No log	7.8857	276	1.1545	0.3304	1.1545	1.0745
No log	7.9429	278	1.1590	0.2877	1.1590	1.0766
No log	8.0	280	1.1647	0.2095	1.1647	1.0792
No log	8.0571	282	1.1623	0.3468	1.1623	1.0781
No log	8.1143	284	1.1670	0.3040	1.1670	1.0803
No log	8.1714	286	1.1837	0.1770	1.1837	1.0880
No log	8.2286	288	1.3131	0.2487	1.3131	1.1459
No log	8.2857	290	1.3935	0.1674	1.3935	1.1805
No log	8.3429	292	1.2902	0.1809	1.2902	1.1359
No log	8.4	294	1.2282	0.1697	1.2282	1.1082
No log	8.4571	296	1.1955	0.2012	1.1955	1.0934
No log	8.5143	298	1.2196	0.2302	1.2196	1.1044
No log	8.5714	300	1.2356	0.2588	1.2356	1.1116
No log	8.6286	302	1.3296	0.1780	1.3296	1.1531
No log	8.6857	304	1.3253	0.1696	1.3253	1.1512
No log	8.7429	306	1.2701	0.2565	1.2701	1.1270
No log	8.8	308	1.2450	0.2353	1.2450	1.1158
No log	8.8571	310	1.2855	0.1403	1.2855	1.1338
No log	8.9143	312	1.2360	0.1845	1.2360	1.1117
No log	8.9714	314	1.1326	0.2004	1.1326	1.0642
No log	9.0286	316	1.1135	0.2227	1.1135	1.0552
No log	9.0857	318	1.1307	0.2599	1.1307	1.0634
No log	9.1429	320	1.1450	0.3035	1.1450	1.0700
No log	9.2	322	1.1575	0.2735	1.1575	1.0759
No log	9.2571	324	1.1944	0.2735	1.1944	1.0929
No log	9.3143	326	1.2572	0.2246	1.2572	1.1212
No log	9.3714	328	1.2330	0.2857	1.2330	1.1104
No log	9.4286	330	1.2311	0.3249	1.2311	1.1096
No log	9.4857	332	1.0938	0.2278	1.0938	1.0459
No log	9.5429	334	1.0684	0.2502	1.0684	1.0336
No log	9.6	336	1.0653	0.2831	1.0653	1.0321
No log	9.6571	338	1.1063	0.3250	1.1063	1.0518
No log	9.7143	340	1.2115	0.2640	1.2115	1.1007
No log	9.7714	342	1.2179	0.2964	1.2179	1.1036
No log	9.8286	344	1.1925	0.2920	1.1925	1.0920
No log	9.8857	346	1.1934	0.2411	1.1934	1.0924
No log	9.9429	348	1.1629	0.2863	1.1629	1.0784
No log	10.0	350	1.1437	0.3123	1.1437	1.0695
No log	10.0571	352	1.1509	0.3083	1.1509	1.0728
No log	10.1143	354	1.2003	0.2138	1.2003	1.0956
No log	10.1714	356	1.4903	0.2662	1.4903	1.2208
No log	10.2286	358	1.8426	0.1227	1.8426	1.3574
No log	10.2857	360	1.7762	0.0664	1.7762	1.3327
No log	10.3429	362	1.4823	0.2857	1.4823	1.2175
No log	10.4	364	1.2701	0.1354	1.2701	1.1270
No log	10.4571	366	1.2289	0.1457	1.2289	1.1085
No log	10.5143	368	1.2487	0.1362	1.2487	1.1174
No log	10.5714	370	1.2740	0.1501	1.2740	1.1287
No log	10.6286	372	1.2970	0.1006	1.2970	1.1388
No log	10.6857	374	1.3199	0.1663	1.3199	1.1489
No log	10.7429	376	1.3307	0.2031	1.3307	1.1535
No log	10.8	378	1.3487	0.2181	1.3487	1.1613
No log	10.8571	380	1.2468	0.2511	1.2468	1.1166
No log	10.9143	382	1.2019	0.2555	1.2019	1.0963
No log	10.9714	384	1.2610	0.2424	1.2610	1.1230
No log	11.0286	386	1.3786	0.2154	1.3786	1.1741
No log	11.0857	388	1.4582	0.2072	1.4582	1.2076
No log	11.1429	390	1.3565	0.2154	1.3565	1.1647
No log	11.2	392	1.2091	0.2871	1.2091	1.0996
No log	11.2571	394	1.1427	0.2943	1.1427	1.0690
No log	11.3143	396	1.1332	0.2664	1.1332	1.0645
No log	11.3714	398	1.1521	0.2943	1.1521	1.0733
No log	11.4286	400	1.1813	0.2730	1.1813	1.0869
No log	11.4857	402	1.2292	0.2130	1.2292	1.1087
No log	11.5429	404	1.1797	0.2221	1.1797	1.0861
No log	11.6	406	1.1486	0.2776	1.1486	1.0717
No log	11.6571	408	1.1279	0.2728	1.1279	1.0620
No log	11.7143	410	1.1160	0.2728	1.1160	1.0564
No log	11.7714	412	1.1377	0.2988	1.1377	1.0666
No log	11.8286	414	1.1373	0.2988	1.1373	1.0664
No log	11.8857	416	1.1194	0.3250	1.1194	1.0580
No log	11.9429	418	1.1206	0.3250	1.1206	1.0586
No log	12.0	420	1.1186	0.3443	1.1186	1.0576
No log	12.0571	422	1.1238	0.3443	1.1238	1.0601
No log	12.1143	424	1.1281	0.3301	1.1281	1.0621
No log	12.1714	426	1.1389	0.2966	1.1389	1.0672
No log	12.2286	428	1.1443	0.2966	1.1443	1.0697
No log	12.2857	430	1.1909	0.2261	1.1909	1.0913
No log	12.3429	432	1.2321	0.2078	1.2321	1.1100
No log	12.4	434	1.1997	0.1882	1.1997	1.0953
No log	12.4571	436	1.1908	0.1928	1.1908	1.0912
No log	12.5143	438	1.2076	0.1889	1.2076	1.0989
No log	12.5714	440	1.1785	0.2745	1.1785	1.0856
No log	12.6286	442	1.1763	0.2898	1.1763	1.0846
No log	12.6857	444	1.2292	0.2065	1.2292	1.1087
No log	12.7429	446	1.3144	0.2130	1.3144	1.1465
No log	12.8	448	1.4355	0.2321	1.4355	1.1981
No log	12.8571	450	1.4449	0.2791	1.4449	1.2021
No log	12.9143	452	1.4048	0.2201	1.4048	1.1853
No log	12.9714	454	1.2995	0.1951	1.2995	1.1400
No log	13.0286	456	1.2288	0.2030	1.2288	1.1085
No log	13.0857	458	1.2046	0.1873	1.2046	1.0975
No log	13.1429	460	1.2678	0.1447	1.2678	1.1260
No log	13.2	462	1.3789	0.2746	1.3789	1.1743
No log	13.2571	464	1.3622	0.1991	1.3622	1.1671
No log	13.3143	466	1.2531	0.1817	1.2531	1.1194
No log	13.3714	468	1.2135	0.2137	1.2135	1.1016
No log	13.4286	470	1.2255	0.1533	1.2255	1.1070
No log	13.4857	472	1.2695	0.1412	1.2695	1.1267
No log	13.5429	474	1.2489	0.1412	1.2489	1.1175
No log	13.6	476	1.1680	0.2293	1.1680	1.0807
No log	13.6571	478	1.1576	0.2330	1.1576	1.0759
No log	13.7143	480	1.1658	0.2417	1.1658	1.0797
No log	13.7714	482	1.1616	0.1853	1.1616	1.0778
No log	13.8286	484	1.2757	0.1751	1.2757	1.1295
No log	13.8857	486	1.4238	0.2444	1.4238	1.1932
No log	13.9429	488	1.3750	0.2411	1.3750	1.1726
No log	14.0	490	1.2474	0.1803	1.2474	1.1169
No log	14.0571	492	1.1525	0.2584	1.1525	1.0736
No log	14.1143	494	1.1268	0.2562	1.1268	1.0615
No log	14.1714	496	1.1227	0.2562	1.1227	1.0596
No log	14.2286	498	1.1245	0.2803	1.1245	1.0604
0.3918	14.2857	500	1.1613	0.2251	1.1613	1.0777
0.3918	14.3429	502	1.2164	0.2403	1.2164	1.1029
0.3918	14.4	504	1.3038	0.2613	1.3038	1.1419
0.3918	14.4571	506	1.3531	0.1884	1.3531	1.1632
0.3918	14.5143	508	1.4386	0.1481	1.4386	1.1994
0.3918	14.5714	510	1.3936	0.1460	1.3936	1.1805
0.3918	14.6286	512	1.2548	0.1875	1.2548	1.1202
0.3918	14.6857	514	1.1959	0.1542	1.1959	1.0936

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1