ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k4_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2125
• Qwk: 0.2672
• Mse: 1.2125
• Rmse: 1.1011

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.1026	0.0130	4.1026	2.0255
No log	0.2222	4	2.2623	0.0868	2.2623	1.5041
No log	0.3333	6	1.3713	-0.0256	1.3713	1.1710
No log	0.4444	8	1.1019	0.1874	1.1019	1.0497
No log	0.5556	10	1.1394	0.3014	1.1394	1.0674
No log	0.6667	12	1.2684	0.0807	1.2684	1.1262
No log	0.7778	14	1.0655	0.3365	1.0655	1.0322
No log	0.8889	16	1.0518	0.2133	1.0518	1.0256
No log	1.0	18	1.1606	0.3105	1.1606	1.0773
No log	1.1111	20	1.8099	0.0403	1.8099	1.3453
No log	1.2222	22	2.1092	0.0520	2.1092	1.4523
No log	1.3333	24	2.0320	0.0246	2.0320	1.4255
No log	1.4444	26	1.4608	0.2292	1.4608	1.2086
No log	1.5556	28	1.1353	0.2557	1.1353	1.0655
No log	1.6667	30	1.0796	0.2551	1.0796	1.0390
No log	1.7778	32	1.1389	0.2485	1.1389	1.0672
No log	1.8889	34	1.6214	0.1201	1.6214	1.2733
No log	2.0	36	1.7201	0.1201	1.7201	1.3115
No log	2.1111	38	1.2971	0.2049	1.2971	1.1389
No log	2.2222	40	1.0946	0.3066	1.0946	1.0462
No log	2.3333	42	1.1013	0.3126	1.1013	1.0494
No log	2.4444	44	1.2008	0.2404	1.2008	1.0958
No log	2.5556	46	1.5172	0.2436	1.5172	1.2318
No log	2.6667	48	2.0741	0.0773	2.0741	1.4402
No log	2.7778	50	2.1751	0.1105	2.1751	1.4748
No log	2.8889	52	1.8810	0.1575	1.8810	1.3715
No log	3.0	54	1.3667	0.2393	1.3667	1.1691
No log	3.1111	56	1.2767	0.2660	1.2767	1.1299
No log	3.2222	58	1.3400	0.2871	1.3400	1.1576
No log	3.3333	60	1.4316	0.1659	1.4316	1.1965
No log	3.4444	62	1.7105	0.2533	1.7105	1.3079
No log	3.5556	64	2.2199	0.1122	2.2199	1.4899
No log	3.6667	66	2.4129	0.0804	2.4129	1.5533
No log	3.7778	68	1.8670	0.2193	1.8670	1.3664
No log	3.8889	70	1.3934	0.2455	1.3934	1.1804
No log	4.0	72	1.2248	0.1300	1.2248	1.1067
No log	4.1111	74	1.2874	0.2620	1.2874	1.1346
No log	4.2222	76	1.2893	0.2327	1.2893	1.1355
No log	4.3333	78	1.3774	0.2262	1.3774	1.1736
No log	4.4444	80	1.8720	0.2092	1.8720	1.3682
No log	4.5556	82	2.3803	0.1250	2.3803	1.5428
No log	4.6667	84	2.0722	0.1502	2.0722	1.4395
No log	4.7778	86	1.5954	0.2621	1.5954	1.2631
No log	4.8889	88	1.2923	0.2230	1.2923	1.1368
No log	5.0	90	1.2841	0.2989	1.2841	1.1332
No log	5.1111	92	1.2557	0.2702	1.2557	1.1206
No log	5.2222	94	1.2472	0.2498	1.2472	1.1168
No log	5.3333	96	1.2760	0.1379	1.2760	1.1296
No log	5.4444	98	1.2648	0.1943	1.2648	1.1246
No log	5.5556	100	1.2834	0.1943	1.2834	1.1329
No log	5.6667	102	1.3078	0.2560	1.3078	1.1436
No log	5.7778	104	1.4838	0.2553	1.4838	1.2181
No log	5.8889	106	1.4985	0.2658	1.4985	1.2241
No log	6.0	108	1.4963	0.2747	1.4963	1.2232
No log	6.1111	110	1.3038	0.2260	1.3038	1.1419
No log	6.2222	112	1.2509	0.3222	1.2509	1.1184
No log	6.3333	114	1.1914	0.3892	1.1914	1.0915
No log	6.4444	116	1.1588	0.2542	1.1588	1.0765
No log	6.5556	118	1.2217	0.2566	1.2217	1.1053
No log	6.6667	120	1.2123	0.2863	1.2123	1.1011
No log	6.7778	122	1.1255	0.2022	1.1255	1.0609
No log	6.8889	124	1.1064	0.2439	1.1064	1.0519
No log	7.0	126	1.1593	0.1735	1.1593	1.0767
No log	7.1111	128	1.1856	0.2001	1.1856	1.0889
No log	7.2222	130	1.2166	0.3056	1.2166	1.1030
No log	7.3333	132	1.2899	0.2314	1.2899	1.1358
No log	7.4444	134	1.4268	0.2287	1.4268	1.1945
No log	7.5556	136	1.4116	0.2287	1.4116	1.1881
No log	7.6667	138	1.2994	0.2488	1.2994	1.1399
No log	7.7778	140	1.2371	0.2612	1.2371	1.1123
No log	7.8889	142	1.2028	0.2100	1.2028	1.0967
No log	8.0	144	1.2621	0.2201	1.2621	1.1234
No log	8.1111	146	1.3674	0.2845	1.3674	1.1694
No log	8.2222	148	1.3512	0.2845	1.3512	1.1624
No log	8.3333	150	1.2934	0.2923	1.2934	1.1373
No log	8.4444	152	1.3532	0.2769	1.3532	1.1633
No log	8.5556	154	1.3175	0.2940	1.3175	1.1478
No log	8.6667	156	1.2414	0.2074	1.2414	1.1142
No log	8.7778	158	1.2494	0.2301	1.2494	1.1178
No log	8.8889	160	1.2727	0.1994	1.2727	1.1282
No log	9.0	162	1.3428	0.2240	1.3428	1.1588
No log	9.1111	164	1.2376	0.2100	1.2376	1.1125
No log	9.2222	166	1.1935	0.2721	1.1935	1.0925
No log	9.3333	168	1.2093	0.2850	1.2093	1.0997
No log	9.4444	170	1.1968	0.2700	1.1968	1.0940
No log	9.5556	172	1.2242	0.1884	1.2242	1.1064
No log	9.6667	174	1.3197	0.1476	1.3197	1.1488
No log	9.7778	176	1.3780	0.2067	1.3780	1.1739
No log	9.8889	178	1.2886	0.1789	1.2886	1.1352
No log	10.0	180	1.2450	0.1663	1.2450	1.1158
No log	10.1111	182	1.2728	0.1334	1.2728	1.1282
No log	10.2222	184	1.2953	0.2058	1.2953	1.1381
No log	10.3333	186	1.2702	0.2718	1.2702	1.1270
No log	10.4444	188	1.2608	0.2938	1.2608	1.1229
No log	10.5556	190	1.2439	0.3030	1.2439	1.1153
No log	10.6667	192	1.2321	0.2288	1.2321	1.1100
No log	10.7778	194	1.1917	0.2338	1.1917	1.0917
No log	10.8889	196	1.1423	0.2760	1.1423	1.0688
No log	11.0	198	1.1268	0.2883	1.1268	1.0615
No log	11.1111	200	1.1348	0.2922	1.1348	1.0653
No log	11.2222	202	1.1812	0.2221	1.1812	1.0868
No log	11.3333	204	1.2534	0.2099	1.2534	1.1195
No log	11.4444	206	1.2214	0.2887	1.2214	1.1052
No log	11.5556	208	1.1912	0.2857	1.1912	1.0914
No log	11.6667	210	1.2474	0.3520	1.2474	1.1169
No log	11.7778	212	1.2504	0.3232	1.2504	1.1182
No log	11.8889	214	1.2921	0.3574	1.2921	1.1367
No log	12.0	216	1.3517	0.2483	1.3517	1.1626
No log	12.1111	218	1.2902	0.2525	1.2902	1.1359
No log	12.2222	220	1.1783	0.2697	1.1783	1.0855
No log	12.3333	222	1.1445	0.2192	1.1445	1.0698
No log	12.4444	224	1.1584	0.2346	1.1584	1.0763
No log	12.5556	226	1.1588	0.2742	1.1588	1.0765
No log	12.6667	228	1.1882	0.2735	1.1882	1.0901
No log	12.7778	230	1.3657	0.2780	1.3657	1.1686
No log	12.8889	232	1.4267	0.2933	1.4267	1.1944
No log	13.0	234	1.2721	0.2449	1.2721	1.1279
No log	13.1111	236	1.1743	0.2798	1.1743	1.0836
No log	13.2222	238	1.1642	0.2798	1.1642	1.0790
No log	13.3333	240	1.2199	0.2463	1.2199	1.1045
No log	13.4444	242	1.3034	0.3105	1.3034	1.1417
No log	13.5556	244	1.4040	0.2539	1.4040	1.1849
No log	13.6667	246	1.3251	0.2907	1.3251	1.1511
No log	13.7778	248	1.2478	0.2662	1.2478	1.1170
No log	13.8889	250	1.2725	0.3155	1.2725	1.1281
No log	14.0	252	1.2761	0.3203	1.2761	1.1296
No log	14.1111	254	1.2905	0.3013	1.2905	1.1360
No log	14.2222	256	1.3027	0.2938	1.3027	1.1414
No log	14.3333	258	1.2653	0.2904	1.2653	1.1249
No log	14.4444	260	1.2139	0.2819	1.2139	1.1018
No log	14.5556	262	1.1918	0.2844	1.1918	1.0917
No log	14.6667	264	1.2203	0.3250	1.2203	1.1047
No log	14.7778	266	1.2359	0.3062	1.2359	1.1117
No log	14.8889	268	1.2131	0.2680	1.2131	1.1014
No log	15.0	270	1.1296	0.2655	1.1296	1.0628
No log	15.1111	272	1.0822	0.1814	1.0822	1.0403
No log	15.2222	274	1.1177	0.2535	1.1177	1.0572
No log	15.3333	276	1.1547	0.2735	1.1547	1.0745
No log	15.4444	278	1.1433	0.2989	1.1433	1.0693
No log	15.5556	280	1.1481	0.3162	1.1481	1.0715
No log	15.6667	282	1.1656	0.3858	1.1656	1.0796
No log	15.7778	284	1.1523	0.3858	1.1523	1.0734
No log	15.8889	286	1.1274	0.3268	1.1274	1.0618
No log	16.0	288	1.1198	0.2891	1.1198	1.0582
No log	16.1111	290	1.1296	0.2222	1.1296	1.0628
No log	16.2222	292	1.1683	0.2344	1.1683	1.0809
No log	16.3333	294	1.2176	0.2229	1.2176	1.1035
No log	16.4444	296	1.3042	0.2214	1.3042	1.1420
No log	16.5556	298	1.3141	0.2309	1.3141	1.1463
No log	16.6667	300	1.2592	0.1984	1.2592	1.1221
No log	16.7778	302	1.2166	0.3297	1.2166	1.1030
No log	16.8889	304	1.2003	0.2824	1.2003	1.0956
No log	17.0	306	1.1905	0.2030	1.1905	1.0911
No log	17.1111	308	1.1743	0.1675	1.1743	1.0837
No log	17.2222	310	1.1661	0.2808	1.1661	1.0798
No log	17.3333	312	1.1652	0.2891	1.1652	1.0795
No log	17.4444	314	1.1541	0.2370	1.1541	1.0743
No log	17.5556	316	1.1230	0.2265	1.1230	1.0597
No log	17.6667	318	1.1199	0.2980	1.1199	1.0583
No log	17.7778	320	1.1406	0.2804	1.1406	1.0680
No log	17.8889	322	1.1897	0.2755	1.1897	1.0908
No log	18.0	324	1.3254	0.1929	1.3254	1.1513
No log	18.1111	326	1.3835	0.2272	1.3835	1.1762
No log	18.2222	328	1.3137	0.2487	1.3137	1.1461
No log	18.3333	330	1.2646	0.2482	1.2646	1.1245
No log	18.4444	332	1.2775	0.2046	1.2775	1.1303
No log	18.5556	334	1.2860	0.2331	1.2860	1.1340
No log	18.6667	336	1.2420	0.2004	1.2420	1.1145
No log	18.7778	338	1.1393	0.2175	1.1393	1.0674
No log	18.8889	340	1.0813	0.1794	1.0813	1.0399
No log	19.0	342	1.0818	0.2133	1.0818	1.0401
No log	19.1111	344	1.1373	0.1740	1.1373	1.0665
No log	19.2222	346	1.3039	0.2553	1.3039	1.1419
No log	19.3333	348	1.4069	0.1640	1.4069	1.1861
No log	19.4444	350	1.3221	0.2367	1.3221	1.1498
No log	19.5556	352	1.1683	0.3050	1.1683	1.0809
No log	19.6667	354	1.1120	0.3371	1.1120	1.0545
No log	19.7778	356	1.1129	0.3371	1.1129	1.0549
No log	19.8889	358	1.1412	0.3162	1.1412	1.0683
No log	20.0	360	1.1539	0.3082	1.1539	1.0742
No log	20.1111	362	1.1500	0.2814	1.1500	1.0724
No log	20.2222	364	1.1153	0.2341	1.1153	1.0561
No log	20.3333	366	1.1039	0.3268	1.1039	1.0507
No log	20.4444	368	1.1374	0.2486	1.1374	1.0665
No log	20.5556	370	1.2057	0.2712	1.2057	1.0981
No log	20.6667	372	1.2341	0.2888	1.2341	1.1109
No log	20.7778	374	1.2043	0.2869	1.2043	1.0974
No log	20.8889	376	1.1850	0.2754	1.1850	1.0886
No log	21.0	378	1.2362	0.2391	1.2362	1.1119
No log	21.1111	380	1.2763	0.2457	1.2763	1.1297
No log	21.2222	382	1.2820	0.2457	1.2820	1.1322
No log	21.3333	384	1.2543	0.2752	1.2543	1.1200
No log	21.4444	386	1.2650	0.2880	1.2650	1.1247
No log	21.5556	388	1.2947	0.3130	1.2947	1.1379
No log	21.6667	390	1.3943	0.2465	1.3943	1.1808
No log	21.7778	392	1.4196	0.2308	1.4196	1.1915
No log	21.8889	394	1.3646	0.2317	1.3646	1.1681
No log	22.0	396	1.2553	0.2355	1.2553	1.1204
No log	22.1111	398	1.1468	0.3708	1.1468	1.0709
No log	22.2222	400	1.1135	0.3052	1.1135	1.0552
No log	22.3333	402	1.1033	0.2409	1.1033	1.0504
No log	22.4444	404	1.0775	0.2054	1.0775	1.0380
No log	22.5556	406	1.0828	0.2479	1.0828	1.0406
No log	22.6667	408	1.1070	0.1912	1.1070	1.0521
No log	22.7778	410	1.1079	0.1912	1.1079	1.0526
No log	22.8889	412	1.1063	0.1912	1.1063	1.0518
No log	23.0	414	1.1119	0.3602	1.1119	1.0545
No log	23.1111	416	1.1348	0.3408	1.1348	1.0653
No log	23.2222	418	1.1551	0.3931	1.1551	1.0748
No log	23.3333	420	1.1494	0.3804	1.1494	1.0721
No log	23.4444	422	1.1437	0.3804	1.1437	1.0694
No log	23.5556	424	1.1325	0.3804	1.1325	1.0642
No log	23.6667	426	1.1115	0.3346	1.1115	1.0543
No log	23.7778	428	1.0897	0.3335	1.0897	1.0439
No log	23.8889	430	1.0726	0.2961	1.0726	1.0357
No log	24.0	432	1.0468	0.3284	1.0468	1.0231
No log	24.1111	434	1.0339	0.3418	1.0339	1.0168
No log	24.2222	436	1.0377	0.3354	1.0377	1.0187
No log	24.3333	438	1.0546	0.3529	1.0546	1.0270
No log	24.4444	440	1.0823	0.2838	1.0823	1.0403
No log	24.5556	442	1.1461	0.3271	1.1461	1.0706
No log	24.6667	444	1.1766	0.2638	1.1766	1.0847
No log	24.7778	446	1.1569	0.3459	1.1569	1.0756
No log	24.8889	448	1.1213	0.3376	1.1213	1.0589
No log	25.0	450	1.1338	0.3393	1.1338	1.0648
No log	25.1111	452	1.1896	0.2520	1.1896	1.0907
No log	25.2222	454	1.2132	0.2443	1.2132	1.1014
No log	25.3333	456	1.1487	0.2445	1.1487	1.0718
No log	25.4444	458	1.0775	0.3567	1.0775	1.0380
No log	25.5556	460	1.0717	0.3441	1.0717	1.0352
No log	25.6667	462	1.0957	0.3415	1.0957	1.0467
No log	25.7778	464	1.1461	0.3435	1.1461	1.0705
No log	25.8889	466	1.1578	0.3435	1.1578	1.0760
No log	26.0	468	1.1378	0.3740	1.1378	1.0667
No log	26.1111	470	1.1409	0.3962	1.1409	1.0681
No log	26.2222	472	1.1301	0.3962	1.1301	1.0631
No log	26.3333	474	1.1011	0.4672	1.1011	1.0493
No log	26.4444	476	1.0792	0.4171	1.0792	1.0389
No log	26.5556	478	1.0689	0.3345	1.0689	1.0339
No log	26.6667	480	1.0560	0.3296	1.0560	1.0276
No log	26.7778	482	1.0419	0.3445	1.0419	1.0207
No log	26.8889	484	1.0320	0.3091	1.0320	1.0159
No log	27.0	486	1.0169	0.3552	1.0169	1.0084
No log	27.1111	488	1.0181	0.3152	1.0181	1.0090
No log	27.2222	490	1.0397	0.3484	1.0397	1.0197
No log	27.3333	492	1.0753	0.2838	1.0753	1.0370
No log	27.4444	494	1.1137	0.2813	1.1137	1.0553
No log	27.5556	496	1.1261	0.3050	1.1261	1.0612
No log	27.6667	498	1.1593	0.3003	1.1593	1.0767
0.2906	27.7778	500	1.1944	0.3070	1.1944	1.0929
0.2906	27.8889	502	1.2330	0.3163	1.2330	1.1104
0.2906	28.0	504	1.3228	0.2390	1.3228	1.1501
0.2906	28.1111	506	1.3745	0.2424	1.3745	1.1724
0.2906	28.2222	508	1.3622	0.2138	1.3622	1.1671
0.2906	28.3333	510	1.2942	0.2658	1.2942	1.1376
0.2906	28.4444	512	1.1945	0.3709	1.1945	1.0929
0.2906	28.5556	514	1.1560	0.3643	1.1560	1.0752
0.2906	28.6667	516	1.1602	0.2950	1.1602	1.0771
0.2906	28.7778	518	1.2037	0.2568	1.2037	1.0971
0.2906	28.8889	520	1.2348	0.2281	1.2348	1.1112
0.2906	29.0	522	1.2172	0.2691	1.2172	1.1033
0.2906	29.1111	524	1.2125	0.2672	1.2125	1.1011

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1