ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1363
• Qwk: 0.2593
• Mse: 1.1363
• Rmse: 1.0660

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0286	2	4.7244	0.0010	4.7244	2.1736
No log	0.0571	4	2.9685	-0.0109	2.9685	1.7229
No log	0.0857	6	2.2689	-0.0169	2.2689	1.5063
No log	0.1143	8	1.7629	0.0062	1.7629	1.3277
No log	0.1429	10	1.7681	0.0062	1.7681	1.3297
No log	0.1714	12	1.8231	0.0372	1.8231	1.3502
No log	0.2	14	1.9244	0.0372	1.9244	1.3872
No log	0.2286	16	1.6443	0.0227	1.6443	1.2823
No log	0.2571	18	1.3531	0.1288	1.3531	1.1632
No log	0.2857	20	1.4353	0.1639	1.4353	1.1980
No log	0.3143	22	1.3338	0.1601	1.3338	1.1549
No log	0.3429	24	1.2003	0.1812	1.2003	1.0956
No log	0.3714	26	1.4479	0.0825	1.4479	1.2033
No log	0.4	28	2.2681	0.0465	2.2681	1.5060
No log	0.4286	30	2.4606	-0.0030	2.4606	1.5686
No log	0.4571	32	1.7973	0.0348	1.7973	1.3406
No log	0.4857	34	1.2036	0.1515	1.2036	1.0971
No log	0.5143	36	1.2020	0.0616	1.2020	1.0963
No log	0.5429	38	1.1798	0.0616	1.1798	1.0862
No log	0.5714	40	1.1238	0.2323	1.1238	1.0601
No log	0.6	42	1.1782	0.2298	1.1782	1.0854
No log	0.6286	44	1.5263	0.1135	1.5263	1.2355
No log	0.6571	46	1.7762	0.0355	1.7762	1.3327
No log	0.6857	48	1.6258	0.0707	1.6258	1.2750
No log	0.7143	50	1.2701	0.1959	1.2701	1.1270
No log	0.7429	52	1.1615	0.2298	1.1615	1.0777
No log	0.7714	54	1.1025	0.2735	1.1025	1.0500
No log	0.8	56	1.1558	0.2395	1.1558	1.0751
No log	0.8286	58	1.2186	0.1530	1.2186	1.1039
No log	0.8571	60	1.3318	0.1346	1.3318	1.1540
No log	0.8857	62	1.2787	0.1346	1.2787	1.1308
No log	0.9143	64	1.2115	0.2180	1.2115	1.1007
No log	0.9429	66	1.2606	0.2276	1.2606	1.1228
No log	0.9714	68	1.2917	0.2138	1.2917	1.1365
No log	1.0	70	1.7644	0.1713	1.7644	1.3283
No log	1.0286	72	2.1084	0.0394	2.1084	1.4520
No log	1.0571	74	2.0616	0.0007	2.0616	1.4358
No log	1.0857	76	1.5485	0.1570	1.5485	1.2444
No log	1.1143	78	1.1752	0.2276	1.1752	1.0841
No log	1.1429	80	1.1103	0.1845	1.1103	1.0537
No log	1.1714	82	1.1171	0.2001	1.1171	1.0569
No log	1.2	84	1.1381	0.3087	1.1381	1.0668
No log	1.2286	86	1.3824	0.1698	1.3824	1.1757
No log	1.2571	88	1.7790	0.0062	1.7790	1.3338
No log	1.2857	90	2.0356	0.1088	2.0356	1.4267
No log	1.3143	92	1.8492	0.0062	1.8492	1.3599
No log	1.3429	94	1.5494	0.0317	1.5494	1.2448
No log	1.3714	96	1.3302	0.0898	1.3302	1.1534
No log	1.4	98	1.2958	0.1643	1.2958	1.1383
No log	1.4286	100	1.2140	0.2589	1.2140	1.1018
No log	1.4571	102	1.2839	0.1530	1.2839	1.1331
No log	1.4857	104	1.6026	0.2156	1.6026	1.2660
No log	1.5143	106	1.6627	0.2740	1.6627	1.2895
No log	1.5429	108	1.7420	0.1915	1.7420	1.3198
No log	1.5714	110	1.7751	0.1591	1.7751	1.3323
No log	1.6	112	1.6350	0.2107	1.6350	1.2787
No log	1.6286	114	1.7368	0.2249	1.7368	1.3179
No log	1.6571	116	1.6538	0.2231	1.6538	1.2860
No log	1.6857	118	1.2664	0.1599	1.2664	1.1253
No log	1.7143	120	1.0807	0.3154	1.0807	1.0396
No log	1.7429	122	1.0642	0.3399	1.0642	1.0316
No log	1.7714	124	1.1067	0.3199	1.1067	1.0520
No log	1.8	126	1.1215	0.2654	1.1215	1.0590
No log	1.8286	128	1.1672	0.2654	1.1672	1.0804
No log	1.8571	130	1.3860	0.2277	1.3860	1.1773
No log	1.8857	132	1.3317	0.2227	1.3317	1.1540
No log	1.9143	134	1.1498	0.2763	1.1498	1.0723
No log	1.9429	136	1.2721	0.3558	1.2721	1.1279
No log	1.9714	138	1.2645	0.2501	1.2645	1.1245
No log	2.0	140	1.1683	0.3072	1.1683	1.0809
No log	2.0286	142	1.2142	0.3088	1.2142	1.1019
No log	2.0571	144	1.4309	0.2260	1.4309	1.1962
No log	2.0857	146	1.3929	0.2017	1.3929	1.1802
No log	2.1143	148	1.2345	0.2725	1.2345	1.1111
No log	2.1429	150	1.2069	0.2912	1.2069	1.0986
No log	2.1714	152	1.2231	0.3266	1.2231	1.1059
No log	2.2	154	1.2568	0.2546	1.2568	1.1211
No log	2.2286	156	1.5950	0.2314	1.5950	1.2629
No log	2.2571	158	1.8020	0.1894	1.8020	1.3424
No log	2.2857	160	1.5660	0.2057	1.5660	1.2514
No log	2.3143	162	1.2778	0.3185	1.2778	1.1304
No log	2.3429	164	1.2114	0.3742	1.2114	1.1006
No log	2.3714	166	1.2404	0.2391	1.2404	1.1137
No log	2.4	168	1.1590	0.3449	1.1590	1.0766
No log	2.4286	170	1.1563	0.2928	1.1563	1.0753
No log	2.4571	172	1.4862	0.2846	1.4862	1.2191
No log	2.4857	174	1.9128	0.1497	1.9128	1.3830
No log	2.5143	176	1.8761	0.1827	1.8761	1.3697
No log	2.5429	178	1.4667	0.2758	1.4667	1.2111
No log	2.5714	180	1.1647	0.2812	1.1647	1.0792
No log	2.6	182	1.1869	0.2637	1.1869	1.0895
No log	2.6286	184	1.1856	0.2837	1.1856	1.0889
No log	2.6571	186	1.1666	0.2336	1.1666	1.0801
No log	2.6857	188	1.3654	0.1830	1.3654	1.1685
No log	2.7143	190	1.6560	0.2147	1.6560	1.2868
No log	2.7429	192	1.6706	0.2147	1.6706	1.2925
No log	2.7714	194	1.4271	0.2048	1.4271	1.1946
No log	2.8	196	1.2564	0.2177	1.2564	1.1209
No log	2.8286	198	1.2400	0.2156	1.2400	1.1136
No log	2.8571	200	1.2575	0.1600	1.2575	1.1214
No log	2.8857	202	1.3014	0.1292	1.3014	1.1408
No log	2.9143	204	1.3441	0.1763	1.3441	1.1594
No log	2.9429	206	1.2876	0.1265	1.2876	1.1347
No log	2.9714	208	1.2223	0.2318	1.2223	1.1056
No log	3.0	210	1.2036	0.1513	1.2036	1.0971
No log	3.0286	212	1.2291	0.1960	1.2291	1.1087
No log	3.0571	214	1.2440	0.1634	1.2440	1.1154
No log	3.0857	216	1.3594	0.2181	1.3594	1.1659
No log	3.1143	218	1.3855	0.2218	1.3855	1.1771
No log	3.1429	220	1.3234	0.1289	1.3234	1.1504
No log	3.1714	222	1.2924	0.2058	1.2924	1.1368
No log	3.2	224	1.3074	0.2381	1.3074	1.1434
No log	3.2286	226	1.3123	0.2143	1.3123	1.1455
No log	3.2571	228	1.2869	0.1606	1.2869	1.1344
No log	3.2857	230	1.2445	0.1263	1.2445	1.1156
No log	3.3143	232	1.2041	0.1885	1.2041	1.0973
No log	3.3429	234	1.1682	0.2273	1.1682	1.0808
No log	3.3714	236	1.1631	0.2022	1.1631	1.0785
No log	3.4	238	1.2503	0.3026	1.2503	1.1182
No log	3.4286	240	1.2971	0.2941	1.2971	1.1389
No log	3.4571	242	1.2522	0.3026	1.2522	1.1190
No log	3.4857	244	1.1691	0.3094	1.1691	1.0813
No log	3.5143	246	1.1432	0.3073	1.1432	1.0692
No log	3.5429	248	1.2017	0.3029	1.2017	1.0962
No log	3.5714	250	1.2247	0.2729	1.2247	1.1067
No log	3.6	252	1.1499	0.2876	1.1499	1.0723
No log	3.6286	254	1.0962	0.3514	1.0962	1.0470
No log	3.6571	256	1.1011	0.3618	1.1011	1.0493
No log	3.6857	258	1.1581	0.2989	1.1581	1.0762
No log	3.7143	260	1.2778	0.2965	1.2778	1.1304
No log	3.7429	262	1.2889	0.3108	1.2889	1.1353
No log	3.7714	264	1.2424	0.3322	1.2424	1.1146
No log	3.8	266	1.2586	0.3595	1.2586	1.1219
No log	3.8286	268	1.2442	0.3595	1.2442	1.1154
No log	3.8571	270	1.2343	0.3088	1.2343	1.1110
No log	3.8857	272	1.1997	0.2771	1.1997	1.0953
No log	3.9143	274	1.1915	0.2787	1.1915	1.0915
No log	3.9429	276	1.1254	0.3134	1.1254	1.0608
No log	3.9714	278	1.0657	0.3562	1.0657	1.0323
No log	4.0	280	1.0279	0.3134	1.0279	1.0138
No log	4.0286	282	1.0216	0.3119	1.0216	1.0107
No log	4.0571	284	1.1889	0.3622	1.1889	1.0903
No log	4.0857	286	1.3424	0.3254	1.3424	1.1586
No log	4.1143	288	1.2485	0.3757	1.2485	1.1174
No log	4.1429	290	1.0882	0.3997	1.0882	1.0432
No log	4.1714	292	1.0781	0.3997	1.0781	1.0383
No log	4.2	294	1.1244	0.4681	1.1244	1.0604
No log	4.2286	296	1.2695	0.2840	1.2695	1.1267
No log	4.2571	298	1.1563	0.4002	1.1563	1.0753
No log	4.2857	300	1.0388	0.4848	1.0388	1.0192
No log	4.3143	302	1.0360	0.4848	1.0360	1.0178
No log	4.3429	304	1.1368	0.3622	1.1368	1.0662
No log	4.3714	306	1.2041	0.3026	1.2041	1.0973
No log	4.4	308	1.0974	0.3837	1.0974	1.0476
No log	4.4286	310	1.0141	0.3527	1.0141	1.0070
No log	4.4571	312	1.0246	0.4306	1.0246	1.0122
No log	4.4857	314	1.0659	0.3345	1.0659	1.0324
No log	4.5143	316	1.0892	0.3542	1.0892	1.0436
No log	4.5429	318	1.0855	0.3542	1.0855	1.0419
No log	4.5714	320	1.0928	0.3213	1.0928	1.0454
No log	4.6	322	1.0595	0.3618	1.0595	1.0293
No log	4.6286	324	1.0306	0.4125	1.0306	1.0152
No log	4.6571	326	1.0263	0.3787	1.0263	1.0130
No log	4.6857	328	1.0384	0.3194	1.0384	1.0190
No log	4.7143	330	1.0692	0.3161	1.0692	1.0340
No log	4.7429	332	1.1331	0.3355	1.1331	1.0645
No log	4.7714	334	1.1425	0.3584	1.1425	1.0689
No log	4.8	336	1.2764	0.3347	1.2764	1.1298
No log	4.8286	338	1.3923	0.2885	1.3923	1.1800
No log	4.8571	340	1.2794	0.2716	1.2794	1.1311
No log	4.8857	342	1.1194	0.3672	1.1194	1.0580
No log	4.9143	344	1.0649	0.3952	1.0649	1.0319
No log	4.9429	346	1.0666	0.3767	1.0666	1.0327
No log	4.9714	348	1.0802	0.3812	1.0802	1.0393
No log	5.0	350	1.1438	0.3558	1.1438	1.0695
No log	5.0286	352	1.1549	0.3437	1.1549	1.0747
No log	5.0571	354	1.1043	0.3506	1.1043	1.0509
No log	5.0857	356	1.0824	0.3429	1.0824	1.0404
No log	5.1143	358	1.1416	0.3635	1.1416	1.0684
No log	5.1429	360	1.2484	0.2775	1.2484	1.1173
No log	5.1714	362	1.2016	0.3201	1.2016	1.0962
No log	5.2	364	1.1469	0.2839	1.1469	1.0709
No log	5.2286	366	1.1099	0.2561	1.1099	1.0535
No log	5.2571	368	1.1011	0.2730	1.1011	1.0493
No log	5.2857	370	1.1047	0.2777	1.1047	1.0510
No log	5.3143	372	1.0568	0.2918	1.0568	1.0280
No log	5.3429	374	1.0542	0.4006	1.0542	1.0268
No log	5.3714	376	1.0432	0.4013	1.0432	1.0214
No log	5.4	378	1.0307	0.3554	1.0307	1.0152
No log	5.4286	380	1.0954	0.2356	1.0954	1.0466
No log	5.4571	382	1.2319	0.3261	1.2319	1.1099
No log	5.4857	384	1.2162	0.3317	1.2162	1.1028
No log	5.5143	386	1.0765	0.2964	1.0765	1.0376
No log	5.5429	388	0.9920	0.3981	0.9920	0.9960
No log	5.5714	390	1.0484	0.3686	1.0484	1.0239
No log	5.6	392	1.0403	0.3505	1.0403	1.0199
No log	5.6286	394	1.0114	0.4321	1.0114	1.0057
No log	5.6571	396	1.0890	0.3504	1.0890	1.0436
No log	5.6857	398	1.1283	0.3031	1.1283	1.0622
No log	5.7143	400	1.0850	0.3463	1.0850	1.0416
No log	5.7429	402	1.0513	0.2923	1.0513	1.0253
No log	5.7714	404	1.0487	0.2785	1.0487	1.0241
No log	5.8	406	1.0466	0.3268	1.0466	1.0230
No log	5.8286	408	1.0926	0.2896	1.0926	1.0453
No log	5.8571	410	1.1215	0.3074	1.1215	1.0590
No log	5.8857	412	1.0876	0.3427	1.0876	1.0429
No log	5.9143	414	1.0377	0.3406	1.0377	1.0187
No log	5.9429	416	1.0150	0.4064	1.0150	1.0075
No log	5.9714	418	1.0101	0.4064	1.0101	1.0050
No log	6.0	420	1.0111	0.3875	1.0111	1.0055
No log	6.0286	422	1.0063	0.3886	1.0063	1.0031
No log	6.0571	424	1.0324	0.3596	1.0324	1.0161
No log	6.0857	426	1.1323	0.3424	1.1323	1.0641
No log	6.1143	428	1.0995	0.2670	1.0995	1.0486
No log	6.1429	430	1.0261	0.3688	1.0261	1.0130
No log	6.1714	432	1.0271	0.3688	1.0271	1.0135
No log	6.2	434	1.0352	0.3448	1.0352	1.0175
No log	6.2286	436	1.0362	0.3728	1.0362	1.0179
No log	6.2571	438	1.0412	0.4176	1.0412	1.0204
No log	6.2857	440	1.0620	0.4086	1.0620	1.0305
No log	6.3143	442	1.1282	0.3494	1.1282	1.0622
No log	6.3429	444	1.1448	0.3812	1.1448	1.0700
No log	6.3714	446	1.1659	0.3812	1.1659	1.0798
No log	6.4	448	1.2301	0.3226	1.2301	1.1091
No log	6.4286	450	1.3003	0.2881	1.3003	1.1403
No log	6.4571	452	1.2861	0.2881	1.2861	1.1341
No log	6.4857	454	1.1808	0.2670	1.1808	1.0866
No log	6.5143	456	1.1016	0.3387	1.1016	1.0496
No log	6.5429	458	1.1528	0.2976	1.1528	1.0737
No log	6.5714	460	1.1635	0.2654	1.1635	1.0786
No log	6.6	462	1.1393	0.2658	1.1393	1.0674
No log	6.6286	464	1.1865	0.1458	1.1865	1.0893
No log	6.6571	466	1.2611	0.1322	1.2611	1.1230
No log	6.6857	468	1.2385	0.1322	1.2385	1.1129
No log	6.7143	470	1.1783	0.1928	1.1783	1.0855
No log	6.7429	472	1.1740	0.1928	1.1740	1.0835
No log	6.7714	474	1.1453	0.2794	1.1453	1.0702
No log	6.8	476	1.1320	0.2515	1.1320	1.0639
No log	6.8286	478	1.1029	0.3483	1.1029	1.0502
No log	6.8571	480	1.0789	0.3066	1.0789	1.0387
No log	6.8857	482	1.0773	0.3411	1.0773	1.0379
No log	6.9143	484	1.1322	0.2572	1.1322	1.0641
No log	6.9429	486	1.1921	0.2746	1.1921	1.0918
No log	6.9714	488	1.1231	0.3007	1.1231	1.0598
No log	7.0	490	1.0963	0.3714	1.0963	1.0470
No log	7.0286	492	1.1156	0.3007	1.1156	1.0562
No log	7.0571	494	1.1204	0.2788	1.1204	1.0585
No log	7.0857	496	1.1314	0.2788	1.1314	1.0637
No log	7.1143	498	1.0814	0.3490	1.0814	1.0399
0.3996	7.1429	500	1.0562	0.3584	1.0562	1.0277
0.3996	7.1714	502	1.0442	0.4159	1.0442	1.0218
0.3996	7.2	504	1.0787	0.3584	1.0787	1.0386
0.3996	7.2286	506	1.1529	0.3682	1.1529	1.0737
0.3996	7.2571	508	1.1236	0.3859	1.1236	1.0600
0.3996	7.2857	510	1.0747	0.2965	1.0747	1.0367
0.3996	7.3143	512	1.0729	0.2625	1.0729	1.0358
0.3996	7.3429	514	1.0782	0.2608	1.0782	1.0384
0.3996	7.3714	516	1.0753	0.2793	1.0753	1.0370
0.3996	7.4	518	1.1363	0.2593	1.1363	1.0660

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1