ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k9_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1281
• Qwk: 0.2244
• Mse: 1.1281
• Rmse: 1.0621

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0476	2	4.1323	0.0086	4.1323	2.0328
No log	0.0952	4	2.4488	0.0282	2.4488	1.5649
No log	0.1429	6	1.9211	-0.0597	1.9211	1.3860
No log	0.1905	8	1.8791	-0.0800	1.8791	1.3708
No log	0.2381	10	1.3387	0.0441	1.3387	1.1570
No log	0.2857	12	1.0913	0.1814	1.0913	1.0446
No log	0.3333	14	1.0026	0.2958	1.0026	1.0013
No log	0.3810	16	1.2617	0.1142	1.2617	1.1233
No log	0.4286	18	1.4002	0.0513	1.4002	1.1833
No log	0.4762	20	1.3581	0.1140	1.3581	1.1654
No log	0.5238	22	1.1524	0.2354	1.1524	1.0735
No log	0.5714	24	1.1074	0.2282	1.1074	1.0523
No log	0.6190	26	1.1570	0.2238	1.1570	1.0756
No log	0.6667	28	1.6374	0.1304	1.6374	1.2796
No log	0.7143	30	1.7239	0.1085	1.7239	1.3130
No log	0.7619	32	1.5449	0.1566	1.5449	1.2429
No log	0.8095	34	1.3857	0.2260	1.3857	1.1772
No log	0.8571	36	1.1161	0.2800	1.1161	1.0565
No log	0.9048	38	1.0868	0.2281	1.0868	1.0425
No log	0.9524	40	1.0725	0.2371	1.0725	1.0356
No log	1.0	42	1.1915	0.2402	1.1915	1.0916
No log	1.0476	44	1.3219	0.2303	1.3219	1.1497
No log	1.0952	46	1.6707	0.1859	1.6707	1.2926
No log	1.1429	48	1.4583	0.1957	1.4583	1.2076
No log	1.1905	50	1.1404	0.2843	1.1404	1.0679
No log	1.2381	52	1.0341	0.2976	1.0341	1.0169
No log	1.2857	54	1.0505	0.2597	1.0505	1.0249
No log	1.3333	56	1.2365	0.2184	1.2365	1.1120
No log	1.3810	58	1.6838	0.1366	1.6838	1.2976
No log	1.4286	60	2.0557	0.0541	2.0557	1.4338
No log	1.4762	62	2.1877	0.0775	2.1877	1.4791
No log	1.5238	64	1.9928	0.1422	1.9928	1.4117
No log	1.5714	66	1.7064	0.1635	1.7064	1.3063
No log	1.6190	68	1.3790	0.2273	1.3790	1.1743
No log	1.6667	70	1.2656	0.2240	1.2656	1.1250
No log	1.7143	72	1.4126	0.1855	1.4126	1.1885
No log	1.7619	74	1.3354	0.2812	1.3354	1.1556
No log	1.8095	76	1.5145	0.1453	1.5145	1.2307
No log	1.8571	78	1.7352	0.2005	1.7352	1.3173
No log	1.9048	80	1.4035	0.2194	1.4035	1.1847
No log	1.9524	82	1.2589	0.2166	1.2589	1.1220
No log	2.0	84	1.2487	0.2195	1.2487	1.1174
No log	2.0476	86	1.1450	0.2385	1.1450	1.0700
No log	2.0952	88	1.1614	0.2097	1.1614	1.0777
No log	2.1429	90	1.1759	0.2371	1.1759	1.0844
No log	2.1905	92	1.3077	0.2396	1.3077	1.1435
No log	2.2381	94	1.4165	0.1909	1.4165	1.1902
No log	2.2857	96	1.5376	0.1823	1.5376	1.2400
No log	2.3333	98	1.4701	0.2744	1.4701	1.2125
No log	2.3810	100	1.6635	0.1657	1.6635	1.2898
No log	2.4286	102	1.4229	0.1136	1.4229	1.1928
No log	2.4762	104	1.1710	0.2759	1.1710	1.0821
No log	2.5238	106	1.1660	0.2759	1.1660	1.0798
No log	2.5714	108	1.3026	0.2371	1.3026	1.1413
No log	2.6190	110	1.8681	0.1919	1.8681	1.3668
No log	2.6667	112	2.1865	0.1294	2.1865	1.4787
No log	2.7143	114	1.8972	0.1444	1.8972	1.3774
No log	2.7619	116	1.4127	0.1161	1.4127	1.1886
No log	2.8095	118	1.2654	0.2225	1.2654	1.1249
No log	2.8571	120	1.3055	0.2115	1.3055	1.1426
No log	2.9048	122	1.5729	0.1016	1.5729	1.2542
No log	2.9524	124	1.7444	0.1612	1.7444	1.3208
No log	3.0	126	1.5798	0.1408	1.5798	1.2569
No log	3.0476	128	1.2996	0.1705	1.2996	1.1400
No log	3.0952	130	1.2530	0.2177	1.2530	1.1194
No log	3.1429	132	1.2163	0.3544	1.2163	1.1029
No log	3.1905	134	1.2657	0.2891	1.2657	1.1251
No log	3.2381	136	1.2321	0.3475	1.2321	1.1100
No log	3.2857	138	1.2159	0.3450	1.2159	1.1027
No log	3.3333	140	1.2709	0.3339	1.2709	1.1273
No log	3.3810	142	1.4500	0.1900	1.4500	1.2041
No log	3.4286	144	1.4798	0.1332	1.4798	1.2165
No log	3.4762	146	1.4238	0.1184	1.4238	1.1932
No log	3.5238	148	1.2631	0.1995	1.2631	1.1239
No log	3.5714	150	1.2517	0.2445	1.2517	1.1188
No log	3.6190	152	1.2286	0.3121	1.2286	1.1084
No log	3.6667	154	1.3588	0.2037	1.3588	1.1657
No log	3.7143	156	1.3065	0.2040	1.3065	1.1430
No log	3.7619	158	1.1168	0.3666	1.1168	1.0568
No log	3.8095	160	1.1110	0.2857	1.1110	1.0540
No log	3.8571	162	1.0926	0.2835	1.0926	1.0453
No log	3.9048	164	1.0877	0.2857	1.0877	1.0429
No log	3.9524	166	1.1176	0.2807	1.1176	1.0572
No log	4.0	168	1.2211	0.2913	1.2211	1.1051
No log	4.0476	170	1.1574	0.2807	1.1574	1.0758
No log	4.0952	172	1.1193	0.3356	1.1193	1.0580
No log	4.1429	174	1.1836	0.2871	1.1836	1.0879
No log	4.1905	176	1.1806	0.2932	1.1806	1.0866
No log	4.2381	178	1.1132	0.3418	1.1132	1.0551
No log	4.2857	180	1.1044	0.3418	1.1044	1.0509
No log	4.3333	182	1.1435	0.2807	1.1435	1.0694
No log	4.3810	184	1.3144	0.1807	1.3144	1.1465
No log	4.4286	186	1.2790	0.2028	1.2790	1.1309
No log	4.4762	188	1.1634	0.2963	1.1634	1.0786
No log	4.5238	190	1.1684	0.2879	1.1684	1.0809
No log	4.5714	192	1.1882	0.2743	1.1882	1.0901
No log	4.6190	194	1.2336	0.2829	1.2336	1.1107
No log	4.6667	196	1.3924	0.0942	1.3924	1.1800
No log	4.7143	198	1.3360	0.0829	1.3360	1.1558
No log	4.7619	200	1.2466	0.2214	1.2466	1.1165
No log	4.8095	202	1.1749	0.3896	1.1749	1.0839
No log	4.8571	204	1.1771	0.3389	1.1771	1.0849
No log	4.9048	206	1.1463	0.3689	1.1463	1.0707
No log	4.9524	208	1.2812	0.2074	1.2812	1.1319
No log	5.0	210	1.4479	0.0851	1.4479	1.2033
No log	5.0476	212	1.3482	0.0911	1.3482	1.1611
No log	5.0952	214	1.2093	0.1422	1.2093	1.0997
No log	5.1429	216	1.1710	0.2738	1.1710	1.0821
No log	5.1905	218	1.2321	0.1777	1.2321	1.1100
No log	5.2381	220	1.2162	0.2604	1.2162	1.1028
No log	5.2857	222	1.2380	0.0955	1.2380	1.1126
No log	5.3333	224	1.2430	0.2302	1.2430	1.1149
No log	5.3810	226	1.2908	0.1709	1.2908	1.1361
No log	5.4286	228	1.4248	0.0527	1.4248	1.1937
No log	5.4762	230	1.5067	0.0766	1.5067	1.2275
No log	5.5238	232	1.4128	0.0591	1.4128	1.1886
No log	5.5714	234	1.2755	0.3093	1.2755	1.1294
No log	5.6190	236	1.2268	0.2941	1.2268	1.1076
No log	5.6667	238	1.1939	0.2394	1.1939	1.0927
No log	5.7143	240	1.3049	0.1228	1.3049	1.1423
No log	5.7619	242	1.4311	0.0263	1.4311	1.1963
No log	5.8095	244	1.3934	-0.0239	1.3934	1.1804
No log	5.8571	246	1.2892	0.1121	1.2892	1.1354
No log	5.9048	248	1.2876	0.1777	1.2876	1.1347
No log	5.9524	250	1.3153	0.1777	1.3153	1.1468
No log	6.0	252	1.2814	0.2312	1.2814	1.1320
No log	6.0476	254	1.2579	0.3284	1.2579	1.1216
No log	6.0952	256	1.2650	0.1519	1.2650	1.1247
No log	6.1429	258	1.3491	0.0629	1.3491	1.1615
No log	6.1905	260	1.3285	0.0741	1.3285	1.1526
No log	6.2381	262	1.3717	0.0296	1.3717	1.1712
No log	6.2857	264	1.3008	0.1121	1.3008	1.1405
No log	6.3333	266	1.2529	0.2560	1.2529	1.1193
No log	6.3810	268	1.2508	0.2560	1.2508	1.1184
No log	6.4286	270	1.2431	0.2509	1.2431	1.1150
No log	6.4762	272	1.2363	0.3229	1.2363	1.1119
No log	6.5238	274	1.2281	0.2836	1.2281	1.1082
No log	6.5714	276	1.2042	0.2836	1.2042	1.0973
No log	6.6190	278	1.2726	0.1040	1.2726	1.1281
No log	6.6667	280	1.4311	0.0323	1.4311	1.1963
No log	6.7143	282	1.5143	0.1187	1.5143	1.2306
No log	6.7619	284	1.3423	0.0876	1.3423	1.1586
No log	6.8095	286	1.1879	0.2449	1.1879	1.0899
No log	6.8571	288	1.2073	0.1857	1.2073	1.0988
No log	6.9048	290	1.2155	0.1519	1.2155	1.1025
No log	6.9524	292	1.2658	0.2279	1.2658	1.1251
No log	7.0	294	1.2387	0.1987	1.2387	1.1130
No log	7.0476	296	1.1629	0.2497	1.1629	1.0784
No log	7.0952	298	1.0993	0.3326	1.0993	1.0485
No log	7.1429	300	1.0855	0.2769	1.0855	1.0419
No log	7.1905	302	1.0410	0.3188	1.0410	1.0203
No log	7.2381	304	1.0542	0.2788	1.0542	1.0267
No log	7.2857	306	1.1472	0.2268	1.1472	1.0711
No log	7.3333	308	1.2879	0.1745	1.2879	1.1349
No log	7.3810	310	1.2943	0.1171	1.2943	1.1377
No log	7.4286	312	1.2347	0.1846	1.2347	1.1112
No log	7.4762	314	1.1830	0.2835	1.1830	1.0877
No log	7.5238	316	1.2384	0.2607	1.2384	1.1128
No log	7.5714	318	1.2313	0.2696	1.2313	1.1096
No log	7.6190	320	1.1959	0.2053	1.1959	1.0936
No log	7.6667	322	1.3078	0.0987	1.3078	1.1436
No log	7.7143	324	1.6385	0.1670	1.6385	1.2800
No log	7.7619	326	1.7158	0.1617	1.7158	1.3099
No log	7.8095	328	1.5237	0.1628	1.5237	1.2344
No log	7.8571	330	1.2276	0.1275	1.2276	1.1080
No log	7.9048	332	1.1760	0.2300	1.1760	1.0844
No log	7.9524	334	1.1727	0.2761	1.1727	1.0829
No log	8.0	336	1.1820	0.2216	1.1820	1.0872
No log	8.0476	338	1.1809	0.1275	1.1809	1.0867
No log	8.0952	340	1.1985	0.1531	1.1985	1.0947
No log	8.1429	342	1.2208	0.1698	1.2208	1.1049
No log	8.1905	344	1.1603	0.2268	1.1603	1.0772
No log	8.2381	346	1.1488	0.2410	1.1488	1.0718
No log	8.2857	348	1.1676	0.2278	1.1676	1.0806
No log	8.3333	350	1.2008	0.2331	1.2008	1.0958
No log	8.3810	352	1.2311	0.2299	1.2311	1.1096
No log	8.4286	354	1.2309	0.2246	1.2309	1.1095
No log	8.4762	356	1.2286	0.1292	1.2286	1.1084
No log	8.5238	358	1.1777	0.1519	1.1777	1.0852
No log	8.5714	360	1.1298	0.2449	1.1298	1.0629
No log	8.6190	362	1.1105	0.2497	1.1105	1.0538
No log	8.6667	364	1.1026	0.2254	1.1026	1.0501
No log	8.7143	366	1.1472	0.1773	1.1472	1.0711
No log	8.7619	368	1.2237	0.1675	1.2237	1.1062
No log	8.8095	370	1.2210	0.1174	1.2210	1.1050
No log	8.8571	372	1.2236	0.1457	1.2236	1.1062
No log	8.9048	374	1.2636	0.1596	1.2636	1.1241
No log	8.9524	376	1.2896	0.1621	1.2896	1.1356
No log	9.0	378	1.2004	0.1720	1.2004	1.0956
No log	9.0476	380	1.1759	0.1249	1.1759	1.0844
No log	9.0952	382	1.1819	0.1623	1.1819	1.0871
No log	9.1429	384	1.2144	0.1720	1.2144	1.1020
No log	9.1905	386	1.2364	0.1772	1.2364	1.1119
No log	9.2381	388	1.2587	0.1843	1.2587	1.1219
No log	9.2857	390	1.2900	0.1312	1.2900	1.1358
No log	9.3333	392	1.2810	0.1447	1.2810	1.1318
No log	9.3810	394	1.2031	0.1431	1.2031	1.0969
No log	9.4286	396	1.1661	0.2716	1.1661	1.0799
No log	9.4762	398	1.1532	0.24	1.1532	1.0739
No log	9.5238	400	1.1452	0.24	1.1452	1.0701
No log	9.5714	402	1.1543	0.1797	1.1543	1.0744
No log	9.6190	404	1.1238	0.24	1.1238	1.0601
No log	9.6667	406	1.0857	0.2932	1.0857	1.0420
No log	9.7143	408	1.0811	0.2795	1.0811	1.0397
No log	9.7619	410	1.0747	0.3107	1.0747	1.0367
No log	9.8095	412	1.0466	0.3052	1.0466	1.0230
No log	9.8571	414	1.1020	0.2325	1.1020	1.0498
No log	9.9048	416	1.2138	0.1892	1.2138	1.1017
No log	9.9524	418	1.1749	0.2754	1.1749	1.0839
No log	10.0	420	1.0935	0.3286	1.0935	1.0457
No log	10.0476	422	1.0784	0.3412	1.0784	1.0384
No log	10.0952	424	1.0702	0.3609	1.0702	1.0345
No log	10.1429	426	1.0561	0.3293	1.0561	1.0277
No log	10.1905	428	1.0418	0.3403	1.0418	1.0207
No log	10.2381	430	1.0349	0.3403	1.0349	1.0173
No log	10.2857	432	1.0347	0.3134	1.0347	1.0172
No log	10.3333	434	1.0347	0.3425	1.0347	1.0172
No log	10.3810	436	1.0491	0.2788	1.0491	1.0242
No log	10.4286	438	1.1104	0.1869	1.1104	1.0538
No log	10.4762	440	1.1474	0.2128	1.1474	1.0712
No log	10.5238	442	1.1268	0.2134	1.1268	1.0615
No log	10.5714	444	1.1196	0.3112	1.1196	1.0581
No log	10.6190	446	1.1683	0.2747	1.1683	1.0809
No log	10.6667	448	1.1982	0.2545	1.1982	1.0946
No log	10.7143	450	1.1336	0.1228	1.1336	1.0647
No log	10.7619	452	1.0696	0.2842	1.0696	1.0342
No log	10.8095	454	1.0434	0.3033	1.0434	1.0215
No log	10.8571	456	1.0684	0.2158	1.0684	1.0336
No log	10.9048	458	1.0707	0.2545	1.0707	1.0347
No log	10.9524	460	1.0689	0.3280	1.0689	1.0339
No log	11.0	462	1.1439	0.2836	1.1439	1.0695
No log	11.0476	464	1.1576	0.2836	1.1576	1.0759
No log	11.0952	466	1.1086	0.2769	1.1086	1.0529
No log	11.1429	468	1.0845	0.3156	1.0845	1.0414
No log	11.1905	470	1.0922	0.1818	1.0922	1.0451
No log	11.2381	472	1.0907	0.3033	1.0907	1.0443
No log	11.2857	474	1.0988	0.2742	1.0988	1.0482
No log	11.3333	476	1.1110	0.3052	1.1110	1.0540
No log	11.3810	478	1.1300	0.2255	1.1300	1.0630
No log	11.4286	480	1.1619	0.2785	1.1619	1.0779
No log	11.4762	482	1.1655	0.2785	1.1655	1.0796
No log	11.5238	484	1.1344	0.2370	1.1344	1.0651
No log	11.5714	486	1.1308	0.2312	1.1308	1.0634
No log	11.6190	488	1.1071	0.2276	1.1071	1.0522
No log	11.6667	490	1.0892	0.3178	1.0892	1.0437
No log	11.7143	492	1.0971	0.2716	1.0971	1.0474
No log	11.7619	494	1.0797	0.3178	1.0797	1.0391
No log	11.8095	496	1.0779	0.3033	1.0779	1.0382
No log	11.8571	498	1.0864	0.2574	1.0864	1.0423
0.2932	11.9048	500	1.0995	0.2463	1.0995	1.0486
0.2932	11.9524	502	1.1172	0.2043	1.1172	1.0570
0.2932	12.0	504	1.1051	0.2043	1.1051	1.0513
0.2932	12.0476	506	1.0863	0.2147	1.0863	1.0423
0.2932	12.0952	508	1.0923	0.2759	1.0923	1.0451
0.2932	12.1429	510	1.0834	0.2291	1.0834	1.0409
0.2932	12.1905	512	1.0461	0.3446	1.0461	1.0228
0.2932	12.2381	514	1.0895	0.1979	1.0895	1.0438
0.2932	12.2857	516	1.1390	0.1343	1.1390	1.0672
0.2932	12.3333	518	1.1109	0.1830	1.1109	1.0540
0.2932	12.3810	520	1.0595	0.2865	1.0595	1.0293
0.2932	12.4286	522	1.1037	0.1912	1.1037	1.0506
0.2932	12.4762	524	1.2004	0.2311	1.2004	1.0956
0.2932	12.5238	526	1.1880	0.2311	1.1880	1.0900
0.2932	12.5714	528	1.0979	0.2518	1.0979	1.0478
0.2932	12.6190	530	1.0364	0.2765	1.0364	1.0180
0.2932	12.6667	532	1.0457	0.3129	1.0457	1.0226
0.2932	12.7143	534	1.0266	0.3008	1.0266	1.0132
0.2932	12.7619	536	1.0049	0.2788	1.0049	1.0024
0.2932	12.8095	538	1.0288	0.2857	1.0288	1.0143
0.2932	12.8571	540	1.0490	0.2857	1.0490	1.0242
0.2932	12.9048	542	1.0467	0.2834	1.0467	1.0231
0.2932	12.9524	544	1.0464	0.3215	1.0464	1.0229
0.2932	13.0	546	1.0686	0.3056	1.0686	1.0337
0.2932	13.0476	548	1.0962	0.3035	1.0962	1.0470
0.2932	13.0952	550	1.1161	0.2242	1.1161	1.0565
0.2932	13.1429	552	1.1228	0.2242	1.1228	1.0596
0.2932	13.1905	554	1.1246	0.2791	1.1246	1.0605
0.2932	13.2381	556	1.1260	0.2480	1.1260	1.0612
0.2932	13.2857	558	1.0894	0.2031	1.0894	1.0438
0.2932	13.3333	560	1.0758	0.2619	1.0758	1.0372
0.2932	13.3810	562	1.0703	0.2057	1.0703	1.0346
0.2932	13.4286	564	1.0691	0.2911	1.0691	1.0340
0.2932	13.4762	566	1.0725	0.2154	1.0725	1.0356
0.2932	13.5238	568	1.0769	0.2154	1.0769	1.0377
0.2932	13.5714	570	1.0822	0.1909	1.0822	1.0403
0.2932	13.6190	572	1.1033	0.2078	1.1033	1.0504
0.2932	13.6667	574	1.1281	0.2244	1.1281	1.0621

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1