ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k4_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1018
• Qwk: 0.1685
• Mse: 1.1018
• Rmse: 1.0497

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.0868	-0.0019	4.0868	2.0216
No log	0.2222	4	2.3653	0.0203	2.3653	1.5379
No log	0.3333	6	1.5756	0.0105	1.5756	1.2552
No log	0.4444	8	1.2531	0.0380	1.2531	1.1194
No log	0.5556	10	1.1504	0.0730	1.1504	1.0726
No log	0.6667	12	1.4757	0.1365	1.4757	1.2148
No log	0.7778	14	1.1820	0.2514	1.1820	1.0872
No log	0.8889	16	1.1580	0.2632	1.1580	1.0761
No log	1.0	18	1.1509	0.1379	1.1509	1.0728
No log	1.1111	20	1.0962	0.1864	1.0962	1.0470
No log	1.2222	22	1.6857	0.0957	1.6857	1.2983
No log	1.3333	24	2.1030	0.1404	2.1030	1.4502
No log	1.4444	26	1.5313	0.0902	1.5313	1.2374
No log	1.5556	28	1.0419	0.1096	1.0419	1.0207
No log	1.6667	30	1.1559	0.0981	1.1559	1.0751
No log	1.7778	32	1.1454	0.0636	1.1454	1.0702
No log	1.8889	34	1.0279	0.2061	1.0279	1.0138
No log	2.0	36	1.0133	0.1698	1.0133	1.0066
No log	2.1111	38	1.1113	0.1876	1.1113	1.0542
No log	2.2222	40	1.4303	0.0701	1.4303	1.1959
No log	2.3333	42	1.8437	0.0999	1.8437	1.3578
No log	2.4444	44	1.5910	0.1223	1.5910	1.2613
No log	2.5556	46	1.2380	0.2271	1.2380	1.1127
No log	2.6667	48	1.2469	0.1967	1.2469	1.1166
No log	2.7778	50	1.2855	0.1792	1.2855	1.1338
No log	2.8889	52	1.5370	0.1491	1.5370	1.2397
No log	3.0	54	1.3965	0.1656	1.3965	1.1818
No log	3.1111	56	1.2068	0.2411	1.2068	1.0986
No log	3.2222	58	1.2293	0.2031	1.2293	1.1087
No log	3.3333	60	1.1879	0.1637	1.1879	1.0899
No log	3.4444	62	1.1923	0.2959	1.1923	1.0919
No log	3.5556	64	1.2140	0.2557	1.2140	1.1018
No log	3.6667	66	1.5197	0.2572	1.5197	1.2328
No log	3.7778	68	1.3822	0.3490	1.3822	1.1757
No log	3.8889	70	1.1782	0.2523	1.1782	1.0855
No log	4.0	72	1.3601	0.2839	1.3601	1.1662
No log	4.1111	74	1.2745	0.2595	1.2745	1.1289
No log	4.2222	76	1.1201	0.2379	1.1201	1.0584
No log	4.3333	78	1.2751	0.1745	1.2751	1.1292
No log	4.4444	80	1.8119	0.1776	1.8119	1.3461
No log	4.5556	82	1.8920	0.1652	1.8920	1.3755
No log	4.6667	84	1.5182	0.1896	1.5182	1.2321
No log	4.7778	86	1.1342	0.2455	1.1342	1.0650
No log	4.8889	88	1.0267	0.2510	1.0267	1.0133
No log	5.0	90	1.0482	0.2487	1.0482	1.0238
No log	5.1111	92	1.0599	0.2857	1.0599	1.0295
No log	5.2222	94	1.1108	0.2361	1.1108	1.0539
No log	5.3333	96	1.1057	0.2440	1.1057	1.0515
No log	5.4444	98	1.1879	0.2909	1.1879	1.0899
No log	5.5556	100	1.2007	0.3303	1.2007	1.0958
No log	5.6667	102	1.2435	0.3271	1.2435	1.1151
No log	5.7778	104	1.2829	0.3462	1.2829	1.1327
No log	5.8889	106	1.2143	0.3465	1.2143	1.1019
No log	6.0	108	1.2932	0.2540	1.2932	1.1372
No log	6.1111	110	1.2154	0.2613	1.2154	1.1025
No log	6.2222	112	1.1722	0.2850	1.1722	1.0827
No log	6.3333	114	1.1704	0.3361	1.1704	1.0818
No log	6.4444	116	1.0824	0.1619	1.0824	1.0404
No log	6.5556	118	1.0835	0.1910	1.0835	1.0409
No log	6.6667	120	1.0970	0.2361	1.0970	1.0474
No log	6.7778	122	1.0418	0.2241	1.0418	1.0207
No log	6.8889	124	1.0570	0.1852	1.0570	1.0281
No log	7.0	126	1.0284	0.1342	1.0284	1.0141
No log	7.1111	128	1.0520	0.2521	1.0520	1.0256
No log	7.2222	130	1.2336	0.1854	1.2336	1.1107
No log	7.3333	132	1.2230	0.1722	1.2230	1.1059
No log	7.4444	134	1.1061	0.2463	1.1061	1.0517
No log	7.5556	136	1.1378	0.2589	1.1378	1.0667
No log	7.6667	138	1.2002	0.3119	1.2002	1.0955
No log	7.7778	140	1.1492	0.2857	1.1492	1.0720
No log	7.8889	142	1.1987	0.1251	1.1987	1.0949
No log	8.0	144	1.3540	0.1283	1.3540	1.1636
No log	8.1111	146	1.2759	0.1242	1.2759	1.1296
No log	8.2222	148	1.1440	0.3049	1.1440	1.0696
No log	8.3333	150	1.1548	0.3269	1.1548	1.0746
No log	8.4444	152	1.1282	0.3049	1.1282	1.0621
No log	8.5556	154	1.1351	0.3091	1.1351	1.0654
No log	8.6667	156	1.1086	0.2696	1.1086	1.0529
No log	8.7778	158	1.1062	0.2929	1.1062	1.0518
No log	8.8889	160	1.1144	0.3066	1.1144	1.0556
No log	9.0	162	1.1281	0.2674	1.1281	1.0621
No log	9.1111	164	1.1224	0.2699	1.1224	1.0594
No log	9.2222	166	1.1176	0.2470	1.1176	1.0572
No log	9.3333	168	1.1194	0.2108	1.1194	1.0580
No log	9.4444	170	1.1117	0.2108	1.1117	1.0544
No log	9.5556	172	1.0869	0.2497	1.0869	1.0426
No log	9.6667	174	1.0964	0.2108	1.0964	1.0471
No log	9.7778	176	1.1659	0.1461	1.1659	1.0798
No log	9.8889	178	1.2725	0.1674	1.2725	1.1280
No log	10.0	180	1.2170	0.2476	1.2170	1.1032
No log	10.1111	182	1.1114	0.3162	1.1114	1.0542
No log	10.2222	184	1.1015	0.4056	1.1015	1.0495
No log	10.3333	186	1.0797	0.2961	1.0797	1.0391
No log	10.4444	188	1.1420	0.2280	1.1420	1.0686
No log	10.5556	190	1.1383	0.2959	1.1383	1.0669
No log	10.6667	192	1.1088	0.3567	1.1088	1.0530
No log	10.7778	194	1.1588	0.3753	1.1588	1.0765
No log	10.8889	196	1.1510	0.2628	1.1510	1.0728
No log	11.0	198	1.1112	0.1992	1.1112	1.0541
No log	11.1111	200	1.1098	0.2140	1.1098	1.0535
No log	11.2222	202	1.1094	0.2140	1.1094	1.0533
No log	11.3333	204	1.0999	0.2005	1.0999	1.0488
No log	11.4444	206	1.1574	0.2252	1.1574	1.0758
No log	11.5556	208	1.2595	0.2632	1.2595	1.1223
No log	11.6667	210	1.2719	0.1935	1.2719	1.1278
No log	11.7778	212	1.1734	0.2172	1.1734	1.0833
No log	11.8889	214	1.1447	0.2147	1.1447	1.0699
No log	12.0	216	1.1583	0.1772	1.1583	1.0762
No log	12.1111	218	1.1355	0.1189	1.1355	1.0656
No log	12.2222	220	1.1335	0.2252	1.1335	1.0647
No log	12.3333	222	1.1042	0.2252	1.1042	1.0508
No log	12.4444	224	1.0809	0.1734	1.0809	1.0397
No log	12.5556	226	1.0822	0.1734	1.0822	1.0403
No log	12.6667	228	1.0895	0.1927	1.0895	1.0438
No log	12.7778	230	1.0945	0.2159	1.0945	1.0462
No log	12.8889	232	1.1205	0.1812	1.1205	1.0585
No log	13.0	234	1.1515	0.2298	1.1515	1.0731
No log	13.1111	236	1.1754	0.2633	1.1754	1.0841
No log	13.2222	238	1.2097	0.2118	1.2097	1.0999
No log	13.3333	240	1.1897	0.2252	1.1897	1.0907
No log	13.4444	242	1.1636	0.2165	1.1636	1.0787
No log	13.5556	244	1.2039	0.2562	1.2039	1.0972
No log	13.6667	246	1.2983	0.1509	1.2983	1.1394
No log	13.7778	248	1.2273	0.1285	1.2273	1.1079
No log	13.8889	250	1.1787	0.2234	1.1787	1.0857
No log	14.0	252	1.1655	0.1547	1.1655	1.0796
No log	14.1111	254	1.1377	0.1706	1.1377	1.0666
No log	14.2222	256	1.1056	0.3378	1.1056	1.0515
No log	14.3333	258	1.2445	0.2159	1.2445	1.1156
No log	14.4444	260	1.3288	0.2191	1.3288	1.1527
No log	14.5556	262	1.3240	0.2465	1.3240	1.1507
No log	14.6667	264	1.2690	0.2373	1.2690	1.1265
No log	14.7778	266	1.1712	0.2651	1.1712	1.0822
No log	14.8889	268	1.1302	0.2651	1.1302	1.0631
No log	15.0	270	1.1152	0.2252	1.1152	1.0560
No log	15.1111	272	1.1290	0.2746	1.1290	1.0625
No log	15.2222	274	1.1770	0.2908	1.1770	1.0849
No log	15.3333	276	1.1565	0.3196	1.1565	1.0754
No log	15.4444	278	1.1050	0.3217	1.1050	1.0512
No log	15.5556	280	1.0620	0.3237	1.0620	1.0305
No log	15.6667	282	1.0505	0.3237	1.0505	1.0250
No log	15.7778	284	1.0202	0.3209	1.0202	1.0100
No log	15.8889	286	1.0211	0.2742	1.0211	1.0105
No log	16.0	288	1.0162	0.2791	1.0162	1.0081
No log	16.1111	290	1.0253	0.2628	1.0253	1.0125
No log	16.2222	292	0.9938	0.3188	0.9938	0.9969
No log	16.3333	294	0.9906	0.4115	0.9906	0.9953
No log	16.4444	296	1.0117	0.3642	1.0117	1.0058
No log	16.5556	298	1.0089	0.3762	1.0089	1.0044
No log	16.6667	300	1.0339	0.3066	1.0339	1.0168
No log	16.7778	302	1.0470	0.3066	1.0470	1.0232
No log	16.8889	304	1.0232	0.3223	1.0232	1.0115
No log	17.0	306	0.9938	0.3052	0.9938	0.9969
No log	17.1111	308	1.0227	0.2812	1.0227	1.0113
No log	17.2222	310	1.0087	0.3266	1.0087	1.0043
No log	17.3333	312	1.0083	0.3052	1.0083	1.0041
No log	17.4444	314	1.0200	0.2952	1.0200	1.0099
No log	17.5556	316	1.0481	0.3223	1.0481	1.0238
No log	17.6667	318	1.0620	0.3223	1.0620	1.0305
No log	17.7778	320	1.0474	0.3609	1.0474	1.0234
No log	17.8889	322	1.0319	0.3347	1.0319	1.0158
No log	18.0	324	1.0408	0.3229	1.0408	1.0202
No log	18.1111	326	1.0625	0.3347	1.0625	1.0308
No log	18.2222	328	1.0875	0.2931	1.0875	1.0428
No log	18.3333	330	1.1081	0.2694	1.1081	1.0527
No log	18.4444	332	1.1882	0.1581	1.1882	1.0900
No log	18.5556	334	1.1787	0.1447	1.1787	1.0857
No log	18.6667	336	1.1424	0.2255	1.1424	1.0688
No log	18.7778	338	1.1783	0.3528	1.1783	1.0855
No log	18.8889	340	1.2135	0.2898	1.2135	1.1016
No log	19.0	342	1.1843	0.2857	1.1843	1.0883
No log	19.1111	344	1.1286	0.3223	1.1286	1.0624
No log	19.2222	346	1.0972	0.1741	1.0972	1.0475
No log	19.3333	348	1.0860	0.2241	1.0860	1.0421
No log	19.4444	350	1.0961	0.2480	1.0961	1.0470
No log	19.5556	352	1.1358	0.2369	1.1358	1.0657
No log	19.6667	354	1.1665	0.2369	1.1665	1.0801
No log	19.7778	356	1.1490	0.2252	1.1490	1.0719
No log	19.8889	358	1.1248	0.3087	1.1248	1.0606
No log	20.0	360	1.1207	0.2651	1.1207	1.0586
No log	20.1111	362	1.1359	0.2278	1.1359	1.0658
No log	20.2222	364	1.1342	0.3014	1.1342	1.0650
No log	20.3333	366	1.1311	0.3011	1.1311	1.0635
No log	20.4444	368	1.1338	0.3237	1.1338	1.0648
No log	20.5556	370	1.1241	0.2857	1.1241	1.0602
No log	20.6667	372	1.0783	0.2562	1.0783	1.0384
No log	20.7778	374	1.0401	0.2312	1.0401	1.0198
No log	20.8889	376	0.9965	0.2887	0.9965	0.9982
No log	21.0	378	0.9925	0.2473	0.9925	0.9962
No log	21.1111	380	1.0080	0.2133	1.0080	1.0040
No log	21.2222	382	1.0280	0.2741	1.0280	1.0139
No log	21.3333	384	1.0677	0.3747	1.0677	1.0333
No log	21.4444	386	1.1196	0.3771	1.1196	1.0581
No log	21.5556	388	1.1494	0.3491	1.1494	1.0721
No log	21.6667	390	1.1255	0.2929	1.1255	1.0609
No log	21.7778	392	1.0836	0.2791	1.0836	1.0409
No log	21.8889	394	1.0757	0.2813	1.0757	1.0372
No log	22.0	396	1.0656	0.2670	1.0656	1.0323
No log	22.1111	398	1.0572	0.2670	1.0572	1.0282
No log	22.2222	400	1.0548	0.2504	1.0548	1.0270
No log	22.3333	402	1.1022	0.2346	1.1022	1.0498
No log	22.4444	404	1.1260	0.1919	1.1260	1.0612
No log	22.5556	406	1.0846	0.2346	1.0846	1.0414
No log	22.6667	408	1.0373	0.2887	1.0373	1.0185
No log	22.7778	410	1.0510	0.2569	1.0510	1.0252
No log	22.8889	412	1.0660	0.2620	1.0660	1.0325
No log	23.0	414	1.0689	0.2857	1.0689	1.0339
No log	23.1111	416	1.1032	0.2721	1.1032	1.0503
No log	23.2222	418	1.1164	0.2951	1.1164	1.0566
No log	23.3333	420	1.0992	0.3149	1.0992	1.0484
No log	23.4444	422	1.1197	0.2620	1.1197	1.0581
No log	23.5556	424	1.1308	0.2569	1.1308	1.0634
No log	23.6667	426	1.1105	0.2479	1.1105	1.0538
No log	23.7778	428	1.0868	0.2790	1.0868	1.0425
No log	23.8889	430	1.1119	0.2651	1.1119	1.0545
No log	24.0	432	1.1289	0.2929	1.1289	1.0625
No log	24.1111	434	1.1525	0.2929	1.1525	1.0736
No log	24.2222	436	1.1420	0.3217	1.1420	1.0686
No log	24.3333	438	1.1297	0.3657	1.1297	1.0629
No log	24.4444	440	1.1175	0.3427	1.1175	1.0571
No log	24.5556	442	1.1253	0.3149	1.1253	1.0608
No log	24.6667	444	1.1172	0.3014	1.1172	1.0570
No log	24.7778	446	1.1207	0.3027	1.1207	1.0586
No log	24.8889	448	1.1794	0.3062	1.1794	1.0860
No log	25.0	450	1.2147	0.2680	1.2147	1.1022
No log	25.1111	452	1.1687	0.2516	1.1687	1.0811
No log	25.2222	454	1.1041	0.2628	1.1041	1.0508
No log	25.3333	456	1.0748	0.2031	1.0748	1.0367
No log	25.4444	458	1.0761	0.2179	1.0761	1.0373
No log	25.5556	460	1.0865	0.2031	1.0865	1.0423
No log	25.6667	462	1.1111	0.2276	1.1111	1.0541
No log	25.7778	464	1.1303	0.2276	1.1303	1.0631
No log	25.8889	466	1.1639	0.2878	1.1639	1.0788
No log	26.0	468	1.1985	0.2878	1.1985	1.0947
No log	26.1111	470	1.1784	0.2584	1.1784	1.0855
No log	26.2222	472	1.1440	0.3128	1.1440	1.0696
No log	26.3333	474	1.1289	0.2584	1.1289	1.0625
No log	26.4444	476	1.1255	0.2970	1.1255	1.0609
No log	26.5556	478	1.1404	0.2545	1.1404	1.0679
No log	26.6667	480	1.1217	0.2378	1.1217	1.0591
No log	26.7778	482	1.1081	0.2378	1.1081	1.0527
No log	26.8889	484	1.0816	0.2562	1.0816	1.0400
No log	27.0	486	1.0741	0.2562	1.0741	1.0364
No log	27.1111	488	1.0586	0.2562	1.0586	1.0289
No log	27.2222	490	1.0657	0.2951	1.0657	1.0323
No log	27.3333	492	1.0775	0.2562	1.0775	1.0380
No log	27.4444	494	1.0858	0.3217	1.0858	1.0420
No log	27.5556	496	1.0670	0.3463	1.0670	1.0330
No log	27.6667	498	1.0425	0.2929	1.0425	1.0210
0.2622	27.7778	500	1.0299	0.2628	1.0299	1.0149
0.2622	27.8889	502	1.0198	0.2628	1.0198	1.0099
0.2622	28.0	504	0.9862	0.2721	0.9862	0.9931
0.2622	28.1111	506	0.9765	0.2473	0.9765	0.9882
0.2622	28.2222	508	0.9845	0.2566	0.9845	0.9922
0.2622	28.3333	510	0.9767	0.2473	0.9767	0.9883
0.2622	28.4444	512	0.9914	0.3172	0.9914	0.9957
0.2622	28.5556	514	1.0306	0.3237	1.0306	1.0152
0.2622	28.6667	516	1.0832	0.3596	1.0832	1.0408
0.2622	28.7778	518	1.0919	0.3250	1.0919	1.0449
0.2622	28.8889	520	1.0598	0.3596	1.0598	1.0295
0.2622	29.0	522	1.0076	0.3172	1.0076	1.0038
0.2622	29.1111	524	0.9936	0.2865	0.9936	0.9968
0.2622	29.2222	526	0.9898	0.2865	0.9898	0.9949
0.2622	29.3333	528	0.9951	0.2865	0.9951	0.9976
0.2622	29.4444	530	1.0145	0.2473	1.0145	1.0072
0.2622	29.5556	532	1.0364	0.2473	1.0364	1.0181
0.2622	29.6667	534	1.0684	0.2790	1.0684	1.0336
0.2622	29.7778	536	1.0980	0.2241	1.0980	1.0479
0.2622	29.8889	538	1.1380	0.1662	1.1380	1.0668
0.2622	30.0	540	1.1312	0.1662	1.1312	1.0636
0.2622	30.1111	542	1.1114	0.1734	1.1114	1.0542
0.2622	30.2222	544	1.1018	0.1685	1.1018	1.0497

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1