ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run2_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1957
• Qwk: 0.2397
• Mse: 1.1957
• Rmse: 1.0935

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	4.6783	0.0010	4.6783	2.1629
No log	0.5	4	3.1359	-0.0352	3.1359	1.7709
No log	0.75	6	1.9364	0.1169	1.9364	1.3915
No log	1.0	8	1.7198	0.0062	1.7198	1.3114
No log	1.25	10	1.5235	0.0372	1.5235	1.2343
No log	1.5	12	1.3670	0.0994	1.3670	1.1692
No log	1.75	14	1.3009	0.1051	1.3009	1.1406
No log	2.0	16	1.2822	0.1283	1.2822	1.1324
No log	2.25	18	1.3490	0.1339	1.3490	1.1615
No log	2.5	20	1.4343	0.1080	1.4343	1.1976
No log	2.75	22	1.5221	0.0889	1.5221	1.2337
No log	3.0	24	1.8263	0.0925	1.8263	1.3514
No log	3.25	26	2.1614	0.0809	2.1614	1.4702
No log	3.5	28	1.9829	0.1075	1.9829	1.4082
No log	3.75	30	1.4886	0.1195	1.4886	1.2201
No log	4.0	32	1.1517	0.2298	1.1517	1.0732
No log	4.25	34	1.2136	0.1966	1.2136	1.1016
No log	4.5	36	1.2647	0.1966	1.2647	1.1246
No log	4.75	38	1.3651	0.1283	1.3651	1.1684
No log	5.0	40	1.3702	0.1928	1.3702	1.1706
No log	5.25	42	1.4830	0.0858	1.4830	1.2178
No log	5.5	44	1.3902	0.1481	1.3902	1.1791
No log	5.75	46	1.2046	0.2203	1.2046	1.0976
No log	6.0	48	1.1450	0.2298	1.1450	1.0700
No log	6.25	50	1.2596	0.2240	1.2596	1.1223
No log	6.5	52	1.3807	0.2115	1.3807	1.1750
No log	6.75	54	1.4653	0.1817	1.4653	1.2105
No log	7.0	56	1.5514	0.1908	1.5514	1.2455
No log	7.25	58	1.5065	0.1908	1.5065	1.2274
No log	7.5	60	1.3100	0.2382	1.3100	1.1445
No log	7.75	62	1.2434	0.2554	1.2434	1.1151
No log	8.0	64	1.1761	0.3348	1.1761	1.0845
No log	8.25	66	1.1922	0.2549	1.1922	1.0919
No log	8.5	68	1.2916	0.2015	1.2916	1.1365
No log	8.75	70	1.1825	0.2609	1.1825	1.0874
No log	9.0	72	1.0870	0.3204	1.0870	1.0426
No log	9.25	74	1.0620	0.3110	1.0620	1.0305
No log	9.5	76	1.1749	0.2572	1.1749	1.0839
No log	9.75	78	1.5451	0.2536	1.5451	1.2430
No log	10.0	80	1.6575	0.2873	1.6575	1.2874
No log	10.25	82	1.6802	0.2981	1.6802	1.2962
No log	10.5	84	1.4221	0.2863	1.4221	1.1925
No log	10.75	86	1.1203	0.2816	1.1203	1.0584
No log	11.0	88	1.0161	0.2913	1.0161	1.0080
No log	11.25	90	0.9735	0.2864	0.9735	0.9866
No log	11.5	92	1.0556	0.2432	1.0556	1.0274
No log	11.75	94	1.3712	0.1877	1.3712	1.1710
No log	12.0	96	1.6378	0.1457	1.6378	1.2798
No log	12.25	98	1.5254	0.2201	1.5254	1.2351
No log	12.5	100	1.2878	0.2522	1.2878	1.1348
No log	12.75	102	1.1463	0.2482	1.1463	1.0706
No log	13.0	104	1.0475	0.2988	1.0475	1.0235
No log	13.25	106	1.0498	0.2601	1.0498	1.0246
No log	13.5	108	1.1346	0.2890	1.1346	1.0652
No log	13.75	110	1.4329	0.3002	1.4329	1.1970
No log	14.0	112	1.8358	0.1225	1.8358	1.3549
No log	14.25	114	2.0172	0.1321	2.0172	1.4203
No log	14.5	116	1.8074	0.1309	1.8074	1.3444
No log	14.75	118	1.4404	0.1977	1.4404	1.2002
No log	15.0	120	1.1999	0.2964	1.1999	1.0954
No log	15.25	122	1.1572	0.3219	1.1572	1.0757
No log	15.5	124	1.1948	0.3512	1.1948	1.0931
No log	15.75	126	1.2487	0.2759	1.2487	1.1175
No log	16.0	128	1.5679	0.2306	1.5679	1.2522
No log	16.25	130	1.7900	0.2075	1.7900	1.3379
No log	16.5	132	1.5643	0.2227	1.5643	1.2507
No log	16.75	134	1.2362	0.2870	1.2362	1.1118
No log	17.0	136	1.0860	0.3276	1.0860	1.0421
No log	17.25	138	1.0800	0.2647	1.0800	1.0392
No log	17.5	140	1.1848	0.2287	1.1848	1.0885
No log	17.75	142	1.2846	0.3243	1.2846	1.1334
No log	18.0	144	1.4446	0.1636	1.4446	1.2019
No log	18.25	146	1.6140	0.1707	1.6140	1.2704
No log	18.5	148	1.6500	0.1844	1.6500	1.2845
No log	18.75	150	1.4637	0.1121	1.4637	1.2098
No log	19.0	152	1.2115	0.3365	1.2115	1.1007
No log	19.25	154	1.1420	0.3276	1.1420	1.0686
No log	19.5	156	1.1667	0.2871	1.1667	1.0801
No log	19.75	158	1.2712	0.3262	1.2712	1.1275
No log	20.0	160	1.4535	0.1882	1.4535	1.2056
No log	20.25	162	1.6469	0.1503	1.6469	1.2833
No log	20.5	164	1.6355	0.1475	1.6355	1.2789
No log	20.75	166	1.4743	0.1790	1.4743	1.2142
No log	21.0	168	1.3225	0.2657	1.3225	1.1500
No log	21.25	170	1.2048	0.2521	1.2048	1.0976
No log	21.5	172	1.1747	0.2469	1.1747	1.0838
No log	21.75	174	1.2094	0.2511	1.2094	1.0997
No log	22.0	176	1.3428	0.2229	1.3428	1.1588
No log	22.25	178	1.3753	0.2316	1.3753	1.1727
No log	22.5	180	1.3130	0.2424	1.3130	1.1458
No log	22.75	182	1.2963	0.2011	1.2963	1.1386
No log	23.0	184	1.3276	0.2259	1.3276	1.1522
No log	23.25	186	1.3319	0.2259	1.3319	1.1541
No log	23.5	188	1.3880	0.2464	1.3880	1.1781
No log	23.75	190	1.3811	0.3052	1.3811	1.1752
No log	24.0	192	1.4326	0.2814	1.4326	1.1969
No log	24.25	194	1.3892	0.3052	1.3892	1.1786
No log	24.5	196	1.2794	0.2839	1.2794	1.1311
No log	24.75	198	1.1941	0.3255	1.1941	1.0927
No log	25.0	200	1.1452	0.3965	1.1452	1.0702
No log	25.25	202	1.1596	0.3813	1.1596	1.0769
No log	25.5	204	1.2125	0.2832	1.2125	1.1012
No log	25.75	206	1.1892	0.3078	1.1892	1.0905
No log	26.0	208	1.1459	0.4100	1.1459	1.0704
No log	26.25	210	1.1526	0.3189	1.1526	1.0736
No log	26.5	212	1.1381	0.3280	1.1381	1.0668
No log	26.75	214	1.1675	0.3386	1.1675	1.0805
No log	27.0	216	1.2366	0.2787	1.2366	1.1120
No log	27.25	218	1.3594	0.2965	1.3594	1.1660
No log	27.5	220	1.4200	0.2431	1.4200	1.1916
No log	27.75	222	1.3503	0.2702	1.3503	1.1620
No log	28.0	224	1.3453	0.2673	1.3453	1.1599
No log	28.25	226	1.3318	0.1500	1.3318	1.1541
No log	28.5	228	1.2849	0.1790	1.2849	1.1336
No log	28.75	230	1.2047	0.2404	1.2047	1.0976
No log	29.0	232	1.1397	0.3243	1.1397	1.0676
No log	29.25	234	1.1651	0.3412	1.1651	1.0794
No log	29.5	236	1.2140	0.3412	1.2140	1.1018
No log	29.75	238	1.2491	0.3412	1.2491	1.1176
No log	30.0	240	1.2868	0.3169	1.2868	1.1344
No log	30.25	242	1.3047	0.3078	1.3047	1.1422
No log	30.5	244	1.2973	0.2986	1.2973	1.1390
No log	30.75	246	1.2167	0.3237	1.2167	1.1030
No log	31.0	248	1.1990	0.3174	1.1990	1.0950
No log	31.25	250	1.2540	0.2963	1.2540	1.1198
No log	31.5	252	1.2745	0.2230	1.2745	1.1289
No log	31.75	254	1.2280	0.2796	1.2280	1.1082
No log	32.0	256	1.1751	0.3443	1.1751	1.0840
No log	32.25	258	1.1978	0.3130	1.1978	1.0945
No log	32.5	260	1.2616	0.2247	1.2616	1.1232
No log	32.75	262	1.3751	0.2600	1.3751	1.1726
No log	33.0	264	1.6556	0.1321	1.6556	1.2867
No log	33.25	266	1.8189	0.1498	1.8189	1.3487
No log	33.5	268	1.7092	0.1132	1.7092	1.3073
No log	33.75	270	1.4599	0.1466	1.4599	1.2083
No log	34.0	272	1.2743	0.3169	1.2743	1.1288
No log	34.25	274	1.1725	0.2898	1.1725	1.0828
No log	34.5	276	1.1195	0.2676	1.1195	1.0581
No log	34.75	278	1.0998	0.3337	1.0998	1.0487
No log	35.0	280	1.1231	0.2914	1.1231	1.0598
No log	35.25	282	1.1467	0.3087	1.1467	1.0708
No log	35.5	284	1.1650	0.2748	1.1650	1.0794
No log	35.75	286	1.1831	0.2366	1.1831	1.0877
No log	36.0	288	1.2133	0.2685	1.2133	1.1015
No log	36.25	290	1.2703	0.2732	1.2703	1.1271
No log	36.5	292	1.2832	0.2760	1.2832	1.1328
No log	36.75	294	1.2558	0.2296	1.2558	1.1206
No log	37.0	296	1.2615	0.1980	1.2615	1.1232
No log	37.25	298	1.3110	0.2624	1.3110	1.1450
No log	37.5	300	1.3098	0.1988	1.3098	1.1445
No log	37.75	302	1.2469	0.2577	1.2469	1.1166
No log	38.0	304	1.1921	0.2964	1.1921	1.0918
No log	38.25	306	1.1889	0.3059	1.1889	1.0904
No log	38.5	308	1.1787	0.3059	1.1787	1.0857
No log	38.75	310	1.1919	0.2667	1.1919	1.0918
No log	39.0	312	1.1941	0.3280	1.1941	1.0928
No log	39.25	314	1.1808	0.3255	1.1808	1.0867
No log	39.5	316	1.1882	0.3255	1.1882	1.0900
No log	39.75	318	1.2119	0.3490	1.2119	1.1009
No log	40.0	320	1.1963	0.3218	1.1963	1.0938
No log	40.25	322	1.1733	0.3036	1.1733	1.0832
No log	40.5	324	1.1687	0.3719	1.1687	1.0811
No log	40.75	326	1.1861	0.3193	1.1861	1.0891
No log	41.0	328	1.2407	0.2870	1.2407	1.1139
No log	41.25	330	1.2612	0.2549	1.2612	1.1230
No log	41.5	332	1.2056	0.2870	1.2056	1.0980
No log	41.75	334	1.1268	0.3572	1.1268	1.0615
No log	42.0	336	1.0913	0.3821	1.0913	1.0447
No log	42.25	338	1.0721	0.3554	1.0721	1.0354
No log	42.5	340	1.0676	0.3829	1.0676	1.0332
No log	42.75	342	1.0907	0.3294	1.0907	1.0444
No log	43.0	344	1.1523	0.3128	1.1523	1.0735
No log	43.25	346	1.2709	0.1256	1.2709	1.1274
No log	43.5	348	1.3475	0.1226	1.3475	1.1608
No log	43.75	350	1.3183	0.1087	1.3183	1.1482
No log	44.0	352	1.2538	0.1913	1.2538	1.1198
No log	44.25	354	1.1818	0.3365	1.1818	1.0871
No log	44.5	356	1.1325	0.3104	1.1325	1.0642
No log	44.75	358	1.1145	0.3312	1.1145	1.0557
No log	45.0	360	1.1358	0.2844	1.1358	1.0657
No log	45.25	362	1.1777	0.2844	1.1777	1.0852
No log	45.5	364	1.2478	0.3033	1.2478	1.1170
No log	45.75	366	1.3290	0.0927	1.3290	1.1528
No log	46.0	368	1.2949	0.2549	1.2949	1.1379
No log	46.25	370	1.2271	0.3193	1.2271	1.1078
No log	46.5	372	1.1950	0.3614	1.1950	1.0932
No log	46.75	374	1.1855	0.3169	1.1855	1.0888
No log	47.0	376	1.1430	0.3572	1.1430	1.0691
No log	47.25	378	1.1376	0.3321	1.1376	1.0666
No log	47.5	380	1.1518	0.2917	1.1518	1.0732
No log	47.75	382	1.1415	0.3010	1.1415	1.0684
No log	48.0	384	1.1499	0.3010	1.1499	1.0723
No log	48.25	386	1.1905	0.3614	1.1905	1.0911
No log	48.5	388	1.2458	0.3519	1.2458	1.1161
No log	48.75	390	1.2518	0.3078	1.2518	1.1188
No log	49.0	392	1.2347	0.2896	1.2347	1.1112
No log	49.25	394	1.2270	0.2896	1.2270	1.1077
No log	49.5	396	1.2334	0.3078	1.2334	1.1106
No log	49.75	398	1.2701	0.3347	1.2701	1.1270
No log	50.0	400	1.3672	0.2056	1.3672	1.1693
No log	50.25	402	1.4142	0.1971	1.4142	1.1892
No log	50.5	404	1.3785	0.2056	1.3785	1.1741
No log	50.75	406	1.2884	0.3347	1.2884	1.1351
No log	51.0	408	1.2287	0.2942	1.2287	1.1085
No log	51.25	410	1.2122	0.3189	1.2122	1.1010
No log	51.5	412	1.2112	0.3189	1.2112	1.1006
No log	51.75	414	1.2197	0.3544	1.2197	1.1044
No log	52.0	416	1.2621	0.3031	1.2621	1.1234
No log	52.25	418	1.3174	0.2181	1.3174	1.1478
No log	52.5	420	1.3119	0.2181	1.3119	1.1454
No log	52.75	422	1.2518	0.3031	1.2518	1.1188
No log	53.0	424	1.2239	0.3584	1.2239	1.1063
No log	53.25	426	1.2398	0.3273	1.2398	1.1135
No log	53.5	428	1.2530	0.3273	1.2530	1.1194
No log	53.75	430	1.2382	0.3273	1.2382	1.1127
No log	54.0	432	1.2362	0.3031	1.2362	1.1118
No log	54.25	434	1.2432	0.2716	1.2432	1.1150
No log	54.5	436	1.2151	0.2870	1.2151	1.1023
No log	54.75	438	1.1858	0.3519	1.1858	1.0889
No log	55.0	440	1.1670	0.3937	1.1670	1.0803
No log	55.25	442	1.1710	0.3668	1.1710	1.0821
No log	55.5	444	1.1936	0.3010	1.1936	1.0925
No log	55.75	446	1.2427	0.2940	1.2427	1.1148
No log	56.0	448	1.2627	0.2940	1.2627	1.1237
No log	56.25	450	1.2513	0.2760	1.2513	1.1186
No log	56.5	452	1.2484	0.2787	1.2484	1.1173
No log	56.75	454	1.2627	0.2787	1.2627	1.1237
No log	57.0	456	1.2678	0.2760	1.2678	1.1260
No log	57.25	458	1.2643	0.2760	1.2643	1.1244
No log	57.5	460	1.2503	0.2760	1.2503	1.1182
No log	57.75	462	1.2472	0.2445	1.2472	1.1168
No log	58.0	464	1.2955	0.2445	1.2955	1.1382
No log	58.25	466	1.3163	0.2702	1.3163	1.1473
No log	58.5	468	1.3251	0.2702	1.3251	1.1511
No log	58.75	470	1.3079	0.2702	1.3079	1.1436
No log	59.0	472	1.2817	0.3007	1.2817	1.1321
No log	59.25	474	1.2500	0.2445	1.2500	1.1180
No log	59.5	476	1.2461	0.2940	1.2461	1.1163
No log	59.75	478	1.2265	0.2940	1.2265	1.1075
No log	60.0	480	1.1995	0.3381	1.1995	1.0952
No log	60.25	482	1.1991	0.3056	1.1991	1.0950
No log	60.5	484	1.1972	0.2963	1.1972	1.0942
No log	60.75	486	1.1811	0.3519	1.1811	1.0868
No log	61.0	488	1.1505	0.3798	1.1505	1.0726
No log	61.25	490	1.1314	0.3798	1.1314	1.0637
No log	61.5	492	1.1135	0.3062	1.1135	1.0552
No log	61.75	494	1.1199	0.3602	1.1199	1.0583
No log	62.0	496	1.1497	0.3302	1.1497	1.0723
No log	62.25	498	1.1795	0.3193	1.1795	1.0860
0.245	62.5	500	1.2107	0.3031	1.2107	1.1003
0.245	62.75	502	1.2380	0.2940	1.2380	1.1126
0.245	63.0	504	1.2238	0.2940	1.2238	1.1062
0.245	63.25	506	1.2028	0.2654	1.2028	1.0967
0.245	63.5	508	1.1870	0.2820	1.1870	1.0895
0.245	63.75	510	1.1826	0.3059	1.1826	1.0875
0.245	64.0	512	1.1847	0.2812	1.1847	1.0884
0.245	64.25	514	1.1798	0.3180	1.1798	1.0862
0.245	64.5	516	1.1743	0.2919	1.1743	1.0837
0.245	64.75	518	1.1736	0.2633	1.1736	1.0833
0.245	65.0	520	1.1757	0.2776	1.1757	1.0843
0.245	65.25	522	1.1889	0.2871	1.1889	1.0904
0.245	65.5	524	1.1957	0.2397	1.1957	1.0935

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1