ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1141
• Qwk: 0.2450
• Mse: 1.1141
• Rmse: 1.0555

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	4.4925	0.0042	4.4925	2.1195
No log	0.0741	4	2.9849	-0.0443	2.9849	1.7277
No log	0.1111	6	1.6380	0.0504	1.6380	1.2798
No log	0.1481	8	1.4450	0.0372	1.4450	1.2021
No log	0.1852	10	1.3566	0.0362	1.3566	1.1647
No log	0.2222	12	1.3610	0.0587	1.3610	1.1666
No log	0.2593	14	1.5770	-0.0745	1.5770	1.2558
No log	0.2963	16	1.5510	-0.0114	1.5510	1.2454
No log	0.3333	18	1.6259	-0.0132	1.6259	1.2751
No log	0.3704	20	1.7032	0.0403	1.7032	1.3051
No log	0.4074	22	1.4952	-0.0267	1.4952	1.2228
No log	0.4444	24	1.2164	0.0982	1.2164	1.1029
No log	0.4815	26	1.1714	0.1397	1.1714	1.0823
No log	0.5185	28	1.2652	0.1045	1.2652	1.1248
No log	0.5556	30	1.4905	0.0124	1.4905	1.2208
No log	0.5926	32	1.7423	0.0165	1.7423	1.3200
No log	0.6296	34	1.9599	0.0504	1.9599	1.4000
No log	0.6667	36	2.0756	0.0414	2.0756	1.4407
No log	0.7037	38	1.7719	0.0227	1.7719	1.3311
No log	0.7407	40	1.6072	0.0575	1.6072	1.2678
No log	0.7778	42	1.4235	0.0512	1.4235	1.1931
No log	0.8148	44	1.3639	0.1255	1.3639	1.1679
No log	0.8519	46	1.3567	0.1827	1.3567	1.1648
No log	0.8889	48	1.3289	0.2203	1.3289	1.1528
No log	0.9259	50	1.3915	0.0449	1.3915	1.1796
No log	0.9630	52	1.5650	0.0895	1.5650	1.2510
No log	1.0	54	1.5238	0.0780	1.5238	1.2344
No log	1.0370	56	1.3846	0.2242	1.3846	1.1767
No log	1.0741	58	1.1797	0.2700	1.1797	1.0861
No log	1.1111	60	1.1637	0.3012	1.1637	1.0788
No log	1.1481	62	1.2175	0.2742	1.2175	1.1034
No log	1.1852	64	1.1688	0.2263	1.1688	1.0811
No log	1.2222	66	1.1663	0.2038	1.1663	1.0799
No log	1.2593	68	1.1589	0.3623	1.1589	1.0765
No log	1.2963	70	1.1819	0.2941	1.1819	1.0872
No log	1.3333	72	1.1815	0.2843	1.1815	1.0870
No log	1.3704	74	1.3051	0.2417	1.3051	1.1424
No log	1.4074	76	1.3168	0.1562	1.3168	1.1475
No log	1.4444	78	1.2840	0.1354	1.2840	1.1332
No log	1.4815	80	1.1899	0.2499	1.1899	1.0908
No log	1.5185	82	1.2037	0.2596	1.2037	1.0971
No log	1.5556	84	1.2580	0.1989	1.2580	1.1216
No log	1.5926	86	1.3226	0.1388	1.3226	1.1500
No log	1.6296	88	1.3499	0.1595	1.3499	1.1618
No log	1.6667	90	1.4049	0.0098	1.4049	1.1853
No log	1.7037	92	1.3410	0.0958	1.3410	1.1580
No log	1.7407	94	1.2873	0.1866	1.2873	1.1346
No log	1.7778	96	1.2711	0.2813	1.2711	1.1274
No log	1.8148	98	1.3521	0.2462	1.3521	1.1628
No log	1.8519	100	1.4666	0.2250	1.4666	1.2110
No log	1.8889	102	1.3969	0.2004	1.3969	1.1819
No log	1.9259	104	1.2944	0.1792	1.2944	1.1377
No log	1.9630	106	1.3125	0.2299	1.3125	1.1456
No log	2.0	108	1.3567	0.2257	1.3567	1.1648
No log	2.0370	110	1.3520	0.2608	1.3520	1.1628
No log	2.0741	112	1.2204	0.2975	1.2204	1.1047
No log	2.1111	114	1.1817	0.3564	1.1817	1.0871
No log	2.1481	116	1.1511	0.3294	1.1511	1.0729
No log	2.1852	118	1.1413	0.3546	1.1413	1.0683
No log	2.2222	120	1.2212	0.2896	1.2212	1.1051
No log	2.2593	122	1.2242	0.3262	1.2242	1.1064
No log	2.2963	124	1.1071	0.3237	1.1071	1.0522
No log	2.3333	126	1.0752	0.3838	1.0752	1.0369
No log	2.3704	128	1.1132	0.3184	1.1132	1.0551
No log	2.4074	130	1.2663	0.2128	1.2663	1.1253
No log	2.4444	132	1.3141	0.1950	1.3141	1.1464
No log	2.4815	134	1.2002	0.1774	1.2002	1.0955
No log	2.5185	136	1.1988	0.3382	1.1988	1.0949
No log	2.5556	138	1.2280	0.3860	1.2280	1.1082
No log	2.5926	140	1.2113	0.3209	1.2113	1.1006
No log	2.6296	142	1.2454	0.2311	1.2454	1.1160
No log	2.6667	144	1.4164	0.2570	1.4164	1.1901
No log	2.7037	146	1.3188	0.2596	1.3188	1.1484
No log	2.7407	148	1.2002	0.3633	1.2002	1.0955
No log	2.7778	150	1.2275	0.3610	1.2275	1.1079
No log	2.8148	152	1.1923	0.3511	1.1923	1.0919
No log	2.8519	154	1.2393	0.3011	1.2393	1.1132
No log	2.8889	156	1.5612	0.1805	1.5612	1.2495
No log	2.9259	158	1.6462	0.1998	1.6462	1.2830
No log	2.9630	160	1.3304	0.2900	1.3304	1.1534
No log	3.0	162	1.1446	0.3831	1.1446	1.0699
No log	3.0370	164	1.2027	0.3125	1.2027	1.0967
No log	3.0741	166	1.1921	0.2783	1.1921	1.0918
No log	3.1111	168	1.2129	0.2508	1.2129	1.1013
No log	3.1481	170	1.4107	0.2356	1.4107	1.1877
No log	3.1852	172	1.3149	0.2450	1.3149	1.1467
No log	3.2222	174	1.1833	0.3448	1.1833	1.0878
No log	3.2593	176	1.2004	0.3205	1.2004	1.0956
No log	3.2963	178	1.0866	0.2864	1.0866	1.0424
No log	3.3333	180	1.0416	0.3780	1.0416	1.0206
No log	3.3704	182	1.1000	0.3338	1.1000	1.0488
No log	3.4074	184	1.1625	0.3213	1.1625	1.0782
No log	3.4444	186	1.0906	0.3059	1.0906	1.0443
No log	3.4815	188	1.0343	0.3796	1.0343	1.0170
No log	3.5185	190	1.0470	0.3148	1.0470	1.0232
No log	3.5556	192	1.1288	0.2964	1.1288	1.0624
No log	3.5926	194	1.1457	0.2964	1.1457	1.0704
No log	3.6296	196	1.1342	0.2363	1.1342	1.0650
No log	3.6667	198	1.1762	0.2101	1.1762	1.0845
No log	3.7037	200	1.2260	0.2577	1.2260	1.1072
No log	3.7407	202	1.2781	0.2896	1.2781	1.1305
No log	3.7778	204	1.2613	0.2331	1.2613	1.1231
No log	3.8148	206	1.2197	0.2906	1.2197	1.1044
No log	3.8519	208	1.2210	0.3204	1.2210	1.1050
No log	3.8889	210	1.2060	0.3524	1.2060	1.0982
No log	3.9259	212	1.2562	0.3198	1.2562	1.1208
No log	3.9630	214	1.2698	0.3154	1.2698	1.1268
No log	4.0	216	1.4085	0.2652	1.4085	1.1868
No log	4.0370	218	1.3557	0.2946	1.3557	1.1643
No log	4.0741	220	1.1866	0.2963	1.1866	1.0893
No log	4.1111	222	1.1060	0.2897	1.1060	1.0517
No log	4.1481	224	1.1116	0.2739	1.1116	1.0543
No log	4.1852	226	1.1550	0.3012	1.1550	1.0747
No log	4.2222	228	1.2168	0.3056	1.2168	1.1031
No log	4.2593	230	1.2510	0.3193	1.2510	1.1185
No log	4.2963	232	1.1491	0.2225	1.1491	1.0720
No log	4.3333	234	1.1399	0.2972	1.1399	1.0677
No log	4.3704	236	1.1379	0.2972	1.1379	1.0667
No log	4.4074	238	1.1540	0.2592	1.1540	1.0742
No log	4.4444	240	1.1858	0.2942	1.1858	1.0889
No log	4.4815	242	1.1503	0.2247	1.1503	1.0725
No log	4.5185	244	1.1115	0.3186	1.1115	1.0543
No log	4.5556	246	1.1054	0.3186	1.1054	1.0514
No log	4.5926	248	1.1042	0.3359	1.1042	1.0508
No log	4.6296	250	1.1108	0.3413	1.1108	1.0540
No log	4.6667	252	1.1759	0.3194	1.1759	1.0844
No log	4.7037	254	1.2530	0.2926	1.2530	1.1194
No log	4.7407	256	1.2140	0.2968	1.2140	1.1018
No log	4.7778	258	1.1354	0.3312	1.1354	1.0655
No log	4.8148	260	1.1320	0.2845	1.1320	1.0639
No log	4.8519	262	1.1458	0.3035	1.1458	1.0704
No log	4.8889	264	1.1287	0.2911	1.1287	1.0624
No log	4.9259	266	1.0941	0.3498	1.0941	1.0460
No log	4.9630	268	1.0738	0.3596	1.0738	1.0363
No log	5.0	270	1.0580	0.3224	1.0580	1.0286
No log	5.0370	272	1.0646	0.3250	1.0646	1.0318
No log	5.0741	274	1.0527	0.3301	1.0527	1.0260
No log	5.1111	276	1.0420	0.3983	1.0420	1.0208
No log	5.1481	278	1.0654	0.3297	1.0654	1.0322
No log	5.1852	280	1.0769	0.2901	1.0769	1.0377
No log	5.2222	282	1.0526	0.4128	1.0526	1.0260
No log	5.2593	284	1.0877	0.3255	1.0877	1.0429
No log	5.2963	286	1.0875	0.3882	1.0875	1.0428
No log	5.3333	288	1.1056	0.4181	1.1056	1.0515
No log	5.3704	290	1.1074	0.3745	1.1074	1.0523
No log	5.4074	292	1.1749	0.3337	1.1749	1.0839
No log	5.4444	294	1.2557	0.2852	1.2557	1.1206
No log	5.4815	296	1.1159	0.3735	1.1159	1.0564
No log	5.5185	298	1.0653	0.3381	1.0653	1.0321
No log	5.5556	300	1.0478	0.3668	1.0478	1.0236
No log	5.5926	302	1.0624	0.3289	1.0624	1.0308
No log	5.6296	304	1.1120	0.3009	1.1120	1.0545
No log	5.6667	306	1.0817	0.3166	1.0817	1.0400
No log	5.7037	308	1.0463	0.3243	1.0463	1.0229
No log	5.7407	310	1.0595	0.3489	1.0595	1.0293
No log	5.7778	312	1.1522	0.3154	1.1522	1.0734
No log	5.8148	314	1.1746	0.2909	1.1746	1.0838
No log	5.8519	316	1.0911	0.3574	1.0911	1.0446
No log	5.8889	318	1.0982	0.3651	1.0982	1.0480
No log	5.9259	320	1.1077	0.3969	1.1077	1.0525
No log	5.9630	322	1.1402	0.3292	1.1402	1.0678
No log	6.0	324	1.2510	0.3555	1.2510	1.1185
No log	6.0370	326	1.1751	0.2772	1.1751	1.0840
No log	6.0741	328	1.0822	0.3649	1.0822	1.0403
No log	6.1111	330	1.0732	0.3649	1.0732	1.0360
No log	6.1481	332	1.0844	0.2820	1.0844	1.0413
No log	6.1852	334	1.0746	0.3512	1.0746	1.0366
No log	6.2222	336	1.0774	0.3787	1.0774	1.0380
No log	6.2593	338	1.0691	0.3825	1.0691	1.0340
No log	6.2963	340	1.0809	0.3203	1.0809	1.0397
No log	6.3333	342	1.1541	0.3496	1.1541	1.0743
No log	6.3704	344	1.1280	0.3114	1.1280	1.0621
No log	6.4074	346	1.0650	0.3803	1.0650	1.0320
No log	6.4444	348	1.0551	0.3550	1.0551	1.0272
No log	6.4815	350	1.0713	0.3668	1.0713	1.0350
No log	6.5185	352	1.2365	0.3385	1.2365	1.1120
No log	6.5556	354	1.4569	0.2407	1.4569	1.2070
No log	6.5926	356	1.4679	0.2407	1.4679	1.2116
No log	6.6296	358	1.2540	0.3557	1.2540	1.1198
No log	6.6667	360	1.1022	0.4285	1.1022	1.0499
No log	6.7037	362	1.1267	0.3311	1.1267	1.0615
No log	6.7407	364	1.1159	0.3913	1.1159	1.0564
No log	6.7778	366	1.1785	0.2927	1.1785	1.0856
No log	6.8148	368	1.2569	0.3652	1.2569	1.1211
No log	6.8519	370	1.1933	0.3227	1.1933	1.0924
No log	6.8889	372	1.1169	0.3782	1.1169	1.0568
No log	6.9259	374	1.1062	0.3782	1.1062	1.0517
No log	6.9630	376	1.1484	0.3380	1.1484	1.0717
No log	7.0	378	1.1928	0.3345	1.1928	1.0921
No log	7.0370	380	1.1833	0.3818	1.1833	1.0878
No log	7.0741	382	1.2022	0.3569	1.2022	1.0965
No log	7.1111	384	1.1296	0.3306	1.1296	1.0628
No log	7.1481	386	1.1298	0.3458	1.1298	1.0629
No log	7.1852	388	1.1605	0.3458	1.1605	1.0773
No log	7.2222	390	1.0989	0.3723	1.0989	1.0483
No log	7.2593	392	1.0731	0.3189	1.0731	1.0359
No log	7.2963	394	1.0755	0.2989	1.0755	1.0370
No log	7.3333	396	1.0797	0.3226	1.0797	1.0391
No log	7.3704	398	1.0525	0.3249	1.0525	1.0259
No log	7.4074	400	1.0423	0.3758	1.0423	1.0210
No log	7.4444	402	1.0321	0.3590	1.0321	1.0159
No log	7.4815	404	1.0214	0.3379	1.0214	1.0106
No log	7.5185	406	1.0216	0.3379	1.0216	1.0108
No log	7.5556	408	1.0349	0.3697	1.0350	1.0173
No log	7.5926	410	1.0419	0.3697	1.0419	1.0208
No log	7.6296	412	1.0301	0.3379	1.0301	1.0149
No log	7.6667	414	1.0540	0.3386	1.0540	1.0267
No log	7.7037	416	1.1180	0.3471	1.1180	1.0574
No log	7.7407	418	1.1196	0.3193	1.1196	1.0581
No log	7.7778	420	1.0577	0.3390	1.0577	1.0284
No log	7.8148	422	1.0532	0.2567	1.0532	1.0263
No log	7.8519	424	1.0841	0.3157	1.0841	1.0412
No log	7.8889	426	1.0809	0.2783	1.0809	1.0397
No log	7.9259	428	1.0683	0.2871	1.0683	1.0336
No log	7.9630	430	1.0853	0.3036	1.0853	1.0418
No log	8.0	432	1.1350	0.3305	1.1350	1.0654
No log	8.0370	434	1.1472	0.3439	1.1472	1.0711
No log	8.0741	436	1.1017	0.3036	1.1017	1.0496
No log	8.1111	438	1.1032	0.3128	1.1032	1.0503
No log	8.1481	440	1.1195	0.2794	1.1195	1.0581
No log	8.1852	442	1.1494	0.2906	1.1494	1.0721
No log	8.2222	444	1.1659	0.3032	1.1659	1.0798
No log	8.2593	446	1.1448	0.3162	1.1448	1.0699
No log	8.2963	448	1.1156	0.2706	1.1156	1.0562
No log	8.3333	450	1.1082	0.2749	1.1082	1.0527
No log	8.3704	452	1.0913	0.2706	1.0913	1.0446
No log	8.4074	454	1.1352	0.3397	1.1352	1.0655
No log	8.4444	456	1.2912	0.3546	1.2912	1.1363
No log	8.4815	458	1.3354	0.3370	1.3354	1.1556
No log	8.5185	460	1.2019	0.3266	1.2019	1.0963
No log	8.5556	462	1.0944	0.3190	1.0944	1.0462
No log	8.5926	464	1.0901	0.3214	1.0901	1.0441
No log	8.6296	466	1.0700	0.3562	1.0700	1.0344
No log	8.6667	468	1.1044	0.2991	1.1044	1.0509
No log	8.7037	470	1.2465	0.3458	1.2465	1.1165
No log	8.7407	472	1.2502	0.3458	1.2502	1.1181
No log	8.7778	474	1.1782	0.3121	1.1782	1.0854
No log	8.8148	476	1.0557	0.3213	1.0557	1.0275
No log	8.8519	478	1.0360	0.3243	1.0360	1.0178
No log	8.8889	480	1.0773	0.3686	1.0773	1.0380
No log	8.9259	482	1.0545	0.3400	1.0545	1.0269
No log	8.9630	484	1.0176	0.3016	1.0176	1.0088
No log	9.0	486	1.1368	0.3682	1.1368	1.0662
No log	9.0370	488	1.2692	0.3595	1.2692	1.1266
No log	9.0741	490	1.2028	0.3633	1.2028	1.0967
No log	9.1111	492	1.0587	0.3412	1.0587	1.0289
No log	9.1481	494	0.9899	0.3458	0.9899	0.9949
No log	9.1852	496	0.9937	0.3998	0.9937	0.9968
No log	9.2222	498	0.9910	0.3639	0.9910	0.9955
0.3319	9.2593	500	1.0043	0.2991	1.0043	1.0021
0.3319	9.2963	502	1.0256	0.3012	1.0256	1.0127
0.3319	9.3333	504	1.0137	0.3329	1.0137	1.0068
0.3319	9.3704	506	1.0019	0.3363	1.0019	1.0010
0.3319	9.4074	508	1.0200	0.3294	1.0200	1.0100
0.3319	9.4444	510	1.0325	0.3199	1.0325	1.0161
0.3319	9.4815	512	1.0015	0.3527	1.0015	1.0008
0.3319	9.5185	514	0.9907	0.3979	0.9907	0.9953
0.3319	9.5556	516	0.9896	0.4023	0.9896	0.9948
0.3319	9.5926	518	1.0055	0.3268	1.0055	1.0027
0.3319	9.6296	520	1.0256	0.3504	1.0256	1.0127
0.3319	9.6667	522	1.0429	0.3412	1.0429	1.0212
0.3319	9.7037	524	1.0170	0.3504	1.0170	1.0085
0.3319	9.7407	526	0.9746	0.3925	0.9746	0.9872
0.3319	9.7778	528	0.9780	0.4540	0.9780	0.9889
0.3319	9.8148	530	0.9833	0.4181	0.9833	0.9916
0.3319	9.8519	532	0.9859	0.3935	0.9859	0.9929
0.3319	9.8889	534	1.0241	0.3493	1.0241	1.0120
0.3319	9.9259	536	1.0830	0.3944	1.0830	1.0407
0.3319	9.9630	538	1.0928	0.3944	1.0928	1.0454
0.3319	10.0	540	1.0275	0.3694	1.0275	1.0137
0.3319	10.0370	542	1.0001	0.4197	1.0001	1.0001
0.3319	10.0741	544	0.9909	0.4292	0.9909	0.9954
0.3319	10.1111	546	0.9829	0.3780	0.9829	0.9914
0.3319	10.1481	548	0.9854	0.4636	0.9854	0.9927
0.3319	10.1852	550	0.9784	0.4458	0.9784	0.9891
0.3319	10.2222	552	1.0065	0.3059	1.0065	1.0032
0.3319	10.2593	554	1.0209	0.3490	1.0209	1.0104
0.3319	10.2963	556	1.0459	0.3338	1.0459	1.0227
0.3319	10.3333	558	1.0639	0.3338	1.0639	1.0314
0.3319	10.3704	560	1.0530	0.3199	1.0530	1.0262
0.3319	10.4074	562	1.0560	0.2918	1.0560	1.0276
0.3319	10.4444	564	1.0592	0.2918	1.0592	1.0292
0.3319	10.4815	566	1.0655	0.2712	1.0655	1.0322
0.3319	10.5185	568	1.0897	0.2824	1.0897	1.0439
0.3319	10.5556	570	1.1403	0.3675	1.1403	1.0678
0.3319	10.5926	572	1.1428	0.3180	1.1428	1.0690
0.3319	10.6296	574	1.1058	0.2308	1.1058	1.0516
0.3319	10.6667	576	1.0974	0.2392	1.0974	1.0476
0.3319	10.7037	578	1.0719	0.3226	1.0719	1.0353
0.3319	10.7407	580	1.0613	0.3226	1.0613	1.0302
0.3319	10.7778	582	1.0574	0.3563	1.0574	1.0283
0.3319	10.8148	584	1.1017	0.3283	1.1017	1.0496
0.3319	10.8519	586	1.1500	0.3682	1.1500	1.0724
0.3319	10.8889	588	1.0997	0.3446	1.0997	1.0487
0.3319	10.9259	590	1.0264	0.3774	1.0264	1.0131
0.3319	10.9630	592	1.0328	0.3633	1.0328	1.0163
0.3319	11.0	594	1.0319	0.3712	1.0319	1.0158
0.3319	11.0370	596	1.0145	0.3279	1.0145	1.0072
0.3319	11.0741	598	1.0269	0.3504	1.0269	1.0134
0.3319	11.1111	600	1.0108	0.3781	1.0108	1.0054
0.3319	11.1481	602	1.0124	0.3913	1.0124	1.0062
0.3319	11.1852	604	1.0006	0.375	1.0006	1.0003
0.3319	11.2222	606	1.0096	0.3623	1.0096	1.0048
0.3319	11.2593	608	1.0380	0.3545	1.0380	1.0188
0.3319	11.2963	610	1.0597	0.3816	1.0597	1.0294
0.3319	11.3333	612	1.0312	0.3573	1.0312	1.0155
0.3319	11.3704	614	1.0187	0.3473	1.0187	1.0093
0.3319	11.4074	616	1.0389	0.3320	1.0389	1.0192
0.3319	11.4444	618	1.0437	0.3121	1.0437	1.0216
0.3319	11.4815	620	1.0438	0.3226	1.0438	1.0217
0.3319	11.5185	622	1.0540	0.3035	1.0540	1.0266
0.3319	11.5556	624	1.1144	0.3306	1.1144	1.0557
0.3319	11.5926	626	1.1582	0.3135	1.1582	1.0762
0.3319	11.6296	628	1.1133	0.3180	1.1133	1.0551
0.3319	11.6667	630	1.0661	0.3208	1.0661	1.0325
0.3319	11.7037	632	1.0561	0.2438	1.0561	1.0277
0.3319	11.7407	634	1.0714	0.2602	1.0714	1.0351
0.3319	11.7778	636	1.0898	0.2308	1.0898	1.0439
0.3319	11.8148	638	1.1240	0.2925	1.1240	1.0602
0.3319	11.8519	640	1.1141	0.2450	1.1141	1.0555

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1