ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1286
• Qwk: 0.2906
• Mse: 1.1286
• Rmse: 1.0623

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	4.7320	0.0010	4.7320	2.1753
No log	0.0741	4	2.7009	-0.0019	2.7009	1.6434
No log	0.1111	6	2.0182	0.0041	2.0182	1.4206
No log	0.1481	8	1.5639	0.0363	1.5639	1.2506
No log	0.1852	10	1.3488	0.1289	1.3488	1.1614
No log	0.2222	12	1.1996	0.2156	1.1996	1.0952
No log	0.2593	14	1.2804	0.1448	1.2804	1.1316
No log	0.2963	16	1.4815	0.1016	1.4815	1.2172
No log	0.3333	18	1.7057	0.0707	1.7057	1.3060
No log	0.3704	20	1.5846	0.1252	1.5846	1.2588
No log	0.4074	22	1.4954	0.0936	1.4954	1.2229
No log	0.4444	24	1.5136	0.0792	1.5136	1.2303
No log	0.4815	26	1.6625	0.0707	1.6625	1.2894
No log	0.5185	28	1.8388	0.0363	1.8388	1.3560
No log	0.5556	30	1.7855	0.0444	1.7855	1.3362
No log	0.5926	32	1.6833	0.0707	1.6833	1.2974
No log	0.6296	34	1.8410	0.1145	1.8410	1.3568
No log	0.6667	36	1.7856	0.1145	1.7856	1.3363
No log	0.7037	38	1.6365	0.0792	1.6365	1.2793
No log	0.7407	40	1.4142	0.1346	1.4142	1.1892
No log	0.7778	42	1.3206	0.1865	1.3206	1.1492
No log	0.8148	44	1.2975	0.1379	1.2975	1.1391
No log	0.8519	46	1.3881	0.1346	1.3881	1.1782
No log	0.8889	48	1.5198	0.1283	1.5198	1.2328
No log	0.9259	50	1.4398	0.1838	1.4398	1.1999
No log	0.9630	52	1.3193	0.1495	1.3193	1.1486
No log	1.0	54	1.2273	0.1791	1.2273	1.1078
No log	1.0370	56	1.2374	0.2233	1.2374	1.1124
No log	1.0741	58	1.3564	0.2232	1.3564	1.1646
No log	1.1111	60	1.6826	0.1790	1.6826	1.2971
No log	1.1481	62	2.8039	0.0594	2.8039	1.6745
No log	1.1852	64	3.1517	0.0422	3.1517	1.7753
No log	1.2222	66	2.3034	-0.0049	2.3034	1.5177
No log	1.2593	68	1.5792	0.1922	1.5792	1.2566
No log	1.2963	70	1.4510	0.1365	1.4510	1.2046
No log	1.3333	72	1.5134	0.1628	1.5134	1.2302
No log	1.3704	74	1.5434	0.1254	1.5434	1.2424
No log	1.4074	76	1.4826	0.1599	1.4826	1.2176
No log	1.4444	78	1.4144	0.1458	1.4144	1.1893
No log	1.4815	80	1.2773	0.2395	1.2773	1.1302
No log	1.5185	82	1.2552	0.1935	1.2552	1.1203
No log	1.5556	84	1.2513	0.1987	1.2513	1.1186
No log	1.5926	86	1.2908	0.1986	1.2908	1.1361
No log	1.6296	88	1.4823	0.2559	1.4823	1.2175
No log	1.6667	90	1.3562	0.2171	1.3562	1.1646
No log	1.7037	92	1.3907	0.2262	1.3907	1.1793
No log	1.7407	94	1.3947	0.1975	1.3947	1.1810
No log	1.7778	96	1.3618	0.2550	1.3618	1.1670
No log	1.8148	98	1.2939	0.2484	1.2939	1.1375
No log	1.8519	100	1.3332	0.2484	1.3333	1.1547
No log	1.8889	102	1.3318	0.2644	1.3318	1.1540
No log	1.9259	104	1.3109	0.2462	1.3109	1.1449
No log	1.9630	106	1.2670	0.2710	1.2670	1.1256
No log	2.0	108	1.2487	0.2576	1.2487	1.1175
No log	2.0370	110	1.3164	0.3672	1.3164	1.1473
No log	2.0741	112	1.5261	0.2044	1.5261	1.2354
No log	2.1111	114	1.5796	0.1922	1.5796	1.2568
No log	2.1481	116	1.4275	0.3389	1.4275	1.1948
No log	2.1852	118	1.4376	0.2905	1.4376	1.1990
No log	2.2222	120	1.3715	0.2665	1.3715	1.1711
No log	2.2593	122	1.3829	0.2909	1.3829	1.1760
No log	2.2963	124	1.4796	0.2368	1.4796	1.2164
No log	2.3333	126	1.5437	0.2017	1.5437	1.2425
No log	2.3704	128	1.3675	0.2242	1.3675	1.1694
No log	2.4074	130	1.2676	0.3018	1.2676	1.1259
No log	2.4444	132	1.2459	0.3335	1.2459	1.1162
No log	2.4815	134	1.2372	0.2803	1.2372	1.1123
No log	2.5185	136	1.2244	0.3451	1.2244	1.1065
No log	2.5556	138	1.2653	0.3540	1.2653	1.1249
No log	2.5926	140	1.2505	0.3830	1.2505	1.1182
No log	2.6296	142	1.2401	0.3396	1.2401	1.1136
No log	2.6667	144	1.2649	0.2869	1.2649	1.1247
No log	2.7037	146	1.3311	0.2676	1.3311	1.1538
No log	2.7407	148	1.3252	0.3202	1.3252	1.1512
No log	2.7778	150	1.3683	0.3661	1.3683	1.1697
No log	2.8148	152	1.3009	0.3496	1.3009	1.1406
No log	2.8519	154	1.1440	0.2819	1.1440	1.0696
No log	2.8889	156	1.1461	0.2105	1.1461	1.0706
No log	2.9259	158	1.1107	0.2694	1.1107	1.0539
No log	2.9630	160	1.1975	0.3031	1.1975	1.0943
No log	3.0	162	1.5774	0.2318	1.5774	1.2560
No log	3.0370	164	1.6154	0.2486	1.6154	1.2710
No log	3.0741	166	1.3285	0.3047	1.3285	1.1526
No log	3.1111	168	1.1373	0.3438	1.1373	1.0664
No log	3.1481	170	1.1409	0.2760	1.1409	1.0681
No log	3.1852	172	1.2092	0.3368	1.2092	1.0996
No log	3.2222	174	1.3770	0.3111	1.3770	1.1735
No log	3.2593	176	1.3460	0.3284	1.3460	1.1602
No log	3.2963	178	1.1898	0.3162	1.1898	1.0908
No log	3.3333	180	1.1523	0.3186	1.1523	1.0735
No log	3.3704	182	1.1886	0.2108	1.1886	1.0902
No log	3.4074	184	1.2365	0.2486	1.2365	1.1120
No log	3.4444	186	1.3808	0.3227	1.3808	1.1751
No log	3.4815	188	1.3627	0.2907	1.3627	1.1673
No log	3.5185	190	1.2965	0.3370	1.2965	1.1386
No log	3.5556	192	1.2634	0.3095	1.2634	1.1240
No log	3.5926	194	1.2132	0.2708	1.2132	1.1015
No log	3.6296	196	1.1963	0.3119	1.1963	1.0938
No log	3.6667	198	1.2070	0.3289	1.2070	1.0987
No log	3.7037	200	1.2099	0.3381	1.2099	1.1000
No log	3.7407	202	1.3093	0.2989	1.3093	1.1442
No log	3.7778	204	1.3919	0.2331	1.3919	1.1798
No log	3.8148	206	1.3918	0.2331	1.3918	1.1798
No log	3.8519	208	1.2768	0.2035	1.2768	1.1299
No log	3.8889	210	1.1911	0.2069	1.1911	1.0914
No log	3.9259	212	1.1836	0.2353	1.1836	1.0880
No log	3.9630	214	1.2488	0.2220	1.2488	1.1175
No log	4.0	216	1.1831	0.1882	1.1831	1.0877
No log	4.0370	218	1.1568	0.1776	1.1568	1.0755
No log	4.0741	220	1.2029	0.2371	1.2029	1.0968
No log	4.1111	222	1.2165	0.3552	1.2165	1.1030
No log	4.1481	224	1.1941	0.3056	1.1941	1.0927
No log	4.1852	226	1.1948	0.3432	1.1948	1.0931
No log	4.2222	228	1.2350	0.3351	1.2350	1.1113
No log	4.2593	230	1.3218	0.3771	1.3218	1.1497
No log	4.2963	232	1.3205	0.3368	1.3205	1.1491
No log	4.3333	234	1.1831	0.2786	1.1831	1.0877
No log	4.3704	236	1.1062	0.3336	1.1062	1.0518
No log	4.4074	238	1.0899	0.3608	1.0899	1.0440
No log	4.4444	240	1.0864	0.2157	1.0864	1.0423
No log	4.4815	242	1.1467	0.2495	1.1467	1.0708
No log	4.5185	244	1.1656	0.2577	1.1656	1.0797
No log	4.5556	246	1.1040	0.3237	1.1040	1.0507
No log	4.5926	248	1.1159	0.3237	1.1159	1.0564
No log	4.6296	250	1.1562	0.2927	1.1562	1.0753
No log	4.6667	252	1.2483	0.2490	1.2483	1.1173
No log	4.7037	254	1.2959	0.2835	1.2959	1.1384
No log	4.7407	256	1.2388	0.2424	1.2388	1.1130
No log	4.7778	258	1.1992	0.3426	1.1992	1.0951
No log	4.8148	260	1.1713	0.3852	1.1713	1.0823
No log	4.8519	262	1.1442	0.3460	1.1442	1.0697
No log	4.8889	264	1.1531	0.2678	1.1531	1.0738
No log	4.9259	266	1.2234	0.2901	1.2234	1.1061
No log	4.9630	268	1.2149	0.2951	1.2149	1.1022
No log	5.0	270	1.1972	0.3373	1.1972	1.0941
No log	5.0370	272	1.2586	0.3364	1.2586	1.1219
No log	5.0741	274	1.3543	0.3153	1.3543	1.1637
No log	5.1111	276	1.2708	0.3254	1.2708	1.1273
No log	5.1481	278	1.1484	0.3115	1.1484	1.0716
No log	5.1852	280	1.1439	0.3766	1.1439	1.0696
No log	5.2222	282	1.1295	0.3446	1.1295	1.0628
No log	5.2593	284	1.1541	0.2786	1.1541	1.0743
No log	5.2963	286	1.4360	0.3318	1.4360	1.1983
No log	5.3333	288	1.6520	0.3230	1.6520	1.2853
No log	5.3704	290	1.5301	0.3238	1.5301	1.2370
No log	5.4074	292	1.2803	0.2940	1.2803	1.1315
No log	5.4444	294	1.1593	0.3033	1.1593	1.0767
No log	5.4815	296	1.1574	0.2993	1.1574	1.0758
No log	5.5185	298	1.1657	0.2887	1.1657	1.0797
No log	5.5556	300	1.1742	0.2968	1.1742	1.0836
No log	5.5926	302	1.2634	0.3509	1.2634	1.1240
No log	5.6296	304	1.3385	0.2907	1.3385	1.1569
No log	5.6667	306	1.3518	0.2907	1.3518	1.1627
No log	5.7037	308	1.2864	0.3509	1.2864	1.1342
No log	5.7407	310	1.2110	0.2887	1.2110	1.1005
No log	5.7778	312	1.2095	0.2761	1.2095	1.0998
No log	5.8148	314	1.1707	0.3056	1.1707	1.0820
No log	5.8519	316	1.1647	0.3515	1.1647	1.0792
No log	5.8889	318	1.2706	0.3719	1.2706	1.1272
No log	5.9259	320	1.3762	0.2593	1.3762	1.1731
No log	5.9630	322	1.3116	0.3719	1.3116	1.1453
No log	6.0	324	1.1794	0.3541	1.1794	1.0860
No log	6.0370	326	1.1538	0.3298	1.1538	1.0742
No log	6.0741	328	1.1494	0.3760	1.1494	1.0721
No log	6.1111	330	1.1543	0.3815	1.1543	1.0744
No log	6.1481	332	1.2017	0.4002	1.2017	1.0962
No log	6.1852	334	1.4206	0.3024	1.4206	1.1919
No log	6.2222	336	1.5306	0.2531	1.5306	1.2372
No log	6.2593	338	1.3801	0.3361	1.3801	1.1748
No log	6.2963	340	1.1831	0.2662	1.1831	1.0877
No log	6.3333	342	1.1513	0.3584	1.1513	1.0730
No log	6.3704	344	1.1348	0.3584	1.1348	1.0652
No log	6.4074	346	1.1189	0.3204	1.1189	1.0578
No log	6.4444	348	1.2071	0.2320	1.2071	1.0987
No log	6.4815	350	1.2888	0.2369	1.2888	1.1352
No log	6.5185	352	1.2287	0.2049	1.2287	1.1085
No log	6.5556	354	1.1403	0.2353	1.1403	1.0679
No log	6.5926	356	1.1501	0.2446	1.1501	1.0724
No log	6.6296	358	1.2162	0.2026	1.2162	1.1028
No log	6.6667	360	1.3808	0.2470	1.3808	1.1751
No log	6.7037	362	1.5954	0.2196	1.5954	1.2631
No log	6.7407	364	1.7536	0.2031	1.7536	1.3242
No log	6.7778	366	1.9917	0.1682	1.9917	1.4113
No log	6.8148	368	1.8693	0.1627	1.8693	1.3672
No log	6.8519	370	1.5031	0.1978	1.5031	1.2260
No log	6.8889	372	1.2799	0.2972	1.2799	1.1313
No log	6.9259	374	1.1906	0.3167	1.1906	1.0912
No log	6.9630	376	1.1848	0.2353	1.1848	1.0885
No log	7.0	378	1.3190	0.2049	1.3190	1.1485
No log	7.0370	380	1.5272	0.2823	1.5272	1.2358
No log	7.0741	382	1.4931	0.2525	1.4931	1.2219
No log	7.1111	384	1.2573	0.1958	1.2573	1.1213
No log	7.1481	386	1.0846	0.2395	1.0846	1.0414
No log	7.1852	388	1.0676	0.2784	1.0676	1.0332
No log	7.2222	390	1.0589	0.3268	1.0589	1.0290
No log	7.2593	392	1.0905	0.3237	1.0905	1.0443
No log	7.2963	394	1.1967	0.3487	1.1967	1.0940
No log	7.3333	396	1.2118	0.3845	1.2118	1.1008
No log	7.3704	398	1.1185	0.2901	1.1185	1.0576
No log	7.4074	400	1.0409	0.3881	1.0409	1.0203
No log	7.4444	402	1.0145	0.5059	1.0145	1.0072
No log	7.4815	404	1.0022	0.4181	1.0022	1.0011
No log	7.5185	406	0.9893	0.3256	0.9893	0.9946
No log	7.5556	408	0.9879	0.3399	0.9879	0.9939
No log	7.5926	410	0.9919	0.3013	0.9919	0.9959
No log	7.6296	412	1.0019	0.3059	1.0019	1.0009
No log	7.6667	414	0.9877	0.3554	0.9877	0.9938
No log	7.7037	416	0.9986	0.3717	0.9986	0.9993
No log	7.7407	418	1.0192	0.3995	1.0192	1.0095
No log	7.7778	420	1.0476	0.4177	1.0476	1.0235
No log	7.8148	422	1.0837	0.3720	1.0837	1.0410
No log	7.8519	424	1.0866	0.3266	1.0866	1.0424
No log	7.8889	426	1.0917	0.3189	1.0917	1.0448
No log	7.9259	428	1.0886	0.2188	1.0886	1.0434
No log	7.9630	430	1.0929	0.2588	1.0929	1.0454
No log	8.0	432	1.1099	0.2588	1.1099	1.0535
No log	8.0370	434	1.1127	0.2516	1.1127	1.0548
No log	8.0741	436	1.1223	0.2263	1.1223	1.0594
No log	8.1111	438	1.1074	0.2350	1.1074	1.0523
No log	8.1481	440	1.1294	0.1786	1.1294	1.0627
No log	8.1852	442	1.1723	0.2366	1.1723	1.0827
No log	8.2222	444	1.1970	0.2180	1.1970	1.0941
No log	8.2593	446	1.1437	0.2060	1.1437	1.0695
No log	8.2963	448	1.0987	0.3498	1.0987	1.0482
No log	8.3333	450	1.0900	0.3498	1.0900	1.0440
No log	8.3704	452	1.0941	0.2091	1.0941	1.0460
No log	8.4074	454	1.0949	0.2091	1.0949	1.0464
No log	8.4444	456	1.1005	0.2561	1.1005	1.0491
No log	8.4815	458	1.0806	0.3243	1.0806	1.0395
No log	8.5185	460	1.0761	0.3328	1.0761	1.0374
No log	8.5556	462	1.0635	0.2785	1.0635	1.0312
No log	8.5926	464	1.0302	0.3953	1.0302	1.0150
No log	8.6296	466	1.0225	0.3482	1.0225	1.0112
No log	8.6667	468	1.0377	0.2785	1.0377	1.0187
No log	8.7037	470	1.0664	0.3329	1.0664	1.0327
No log	8.7407	472	1.0971	0.3361	1.0971	1.0474
No log	8.7778	474	1.1123	0.3628	1.1123	1.0546
No log	8.8148	476	1.1272	0.3226	1.1272	1.0617
No log	8.8519	478	1.1039	0.3032	1.1039	1.0506
No log	8.8889	480	1.0857	0.3529	1.0857	1.0420
No log	8.9259	482	1.1167	0.3595	1.1167	1.0567
No log	8.9630	484	1.1729	0.2539	1.1729	1.0830
No log	9.0	486	1.1244	0.3506	1.1244	1.0604
No log	9.0370	488	1.0272	0.3696	1.0272	1.0135
No log	9.0741	490	1.0397	0.3558	1.0397	1.0196
No log	9.1111	492	1.0348	0.3546	1.0348	1.0173
No log	9.1481	494	1.0452	0.4349	1.0452	1.0224
No log	9.1852	496	1.1971	0.3347	1.1971	1.0941
No log	9.2222	498	1.3066	0.3238	1.3066	1.1430
0.35	9.2593	500	1.2530	0.3226	1.2530	1.1194
0.35	9.2963	502	1.1368	0.3675	1.1368	1.0662
0.35	9.3333	504	1.0622	0.4023	1.0622	1.0306
0.35	9.3704	506	1.0857	0.3485	1.0857	1.0420
0.35	9.4074	508	1.1116	0.4028	1.1116	1.0543
0.35	9.4444	510	1.1029	0.3633	1.1029	1.0502
0.35	9.4815	512	1.0988	0.3100	1.0988	1.0482
0.35	9.5185	514	1.1697	0.3371	1.1697	1.0815
0.35	9.5556	516	1.2553	0.2716	1.2553	1.1204
0.35	9.5926	518	1.2660	0.2716	1.2660	1.1252
0.35	9.6296	520	1.2073	0.2732	1.2073	1.0988
0.35	9.6667	522	1.1431	0.2896	1.1431	1.0692
0.35	9.7037	524	1.1286	0.2906	1.1286	1.0623

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1