ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1235
• Qwk: 0.2584
• Mse: 1.1235
• Rmse: 1.0599

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0253	2	4.6246	0.0010	4.6246	2.1505
No log	0.0506	4	2.6197	0.0274	2.6197	1.6185
No log	0.0759	6	2.2050	0.0296	2.2050	1.4849
No log	0.1013	8	1.6212	0.1533	1.6212	1.2733
No log	0.1266	10	1.2469	0.1530	1.2469	1.1166
No log	0.1519	12	1.2660	0.0700	1.2660	1.1252
No log	0.1772	14	1.2900	-0.0010	1.2900	1.1358
No log	0.2025	16	1.4477	0.0205	1.4477	1.2032
No log	0.2278	18	1.6077	0.0227	1.6077	1.2679
No log	0.2532	20	1.9037	0.1060	1.9037	1.3797
No log	0.2785	22	2.1763	0.1271	2.1763	1.4752
No log	0.3038	24	1.9323	0.1169	1.9323	1.3901
No log	0.3291	26	1.5766	0.0585	1.5766	1.2556
No log	0.3544	28	1.3234	0.1604	1.3234	1.1504
No log	0.3797	30	1.3685	0.0865	1.3685	1.1698
No log	0.4051	32	1.3266	0.1565	1.3266	1.1518
No log	0.4304	34	1.2710	0.1848	1.2710	1.1274
No log	0.4557	36	1.2877	0.1848	1.2877	1.1348
No log	0.4810	38	1.5488	0.0575	1.5488	1.2445
No log	0.5063	40	1.7392	0.0222	1.7392	1.3188
No log	0.5316	42	1.7270	0.1094	1.7270	1.3141
No log	0.5570	44	1.8533	0.1412	1.8533	1.3614
No log	0.5823	46	1.8369	0.1586	1.8369	1.3553
No log	0.6076	48	1.4483	0.1812	1.4483	1.2035
No log	0.6329	50	1.1906	0.2162	1.1906	1.0911
No log	0.6582	52	1.1530	0.1809	1.1530	1.0738
No log	0.6835	54	1.3196	0.1495	1.3196	1.1487
No log	0.7089	56	1.4856	0.0723	1.4856	1.2188
No log	0.7342	58	1.0923	0.1848	1.0923	1.0451
No log	0.7595	60	1.0223	0.2886	1.0223	1.0111
No log	0.7848	62	1.2059	0.1045	1.2059	1.0981
No log	0.8101	64	1.6526	-0.0149	1.6526	1.2855
No log	0.8354	66	1.7104	-0.0300	1.7104	1.3078
No log	0.8608	68	1.4449	0.0575	1.4449	1.2021
No log	0.8861	70	1.2318	0.1865	1.2318	1.1099
No log	0.9114	72	1.1225	0.1999	1.1225	1.0595
No log	0.9367	74	1.2440	0.2014	1.2440	1.1154
No log	0.9620	76	1.3963	0.1784	1.3963	1.1816
No log	0.9873	78	1.4192	0.2227	1.4192	1.1913
No log	1.0127	80	1.4819	0.2018	1.4819	1.2173
No log	1.0380	82	1.5270	0.2290	1.5270	1.2357
No log	1.0633	84	1.6352	0.1550	1.6352	1.2788
No log	1.0886	86	1.8371	0.1027	1.8371	1.3554
No log	1.1139	88	1.9135	0.0780	1.9135	1.3833
No log	1.1392	90	1.7595	0.0920	1.7595	1.3265
No log	1.1646	92	1.5805	0.0749	1.5805	1.2572
No log	1.1899	94	1.3710	0.2213	1.3710	1.1709
No log	1.2152	96	1.3015	0.1958	1.3015	1.1408
No log	1.2405	98	1.3731	0.1565	1.3731	1.1718
No log	1.2658	100	1.4167	0.1821	1.4167	1.1903
No log	1.2911	102	1.4011	0.1547	1.4011	1.1837
No log	1.3165	104	1.3084	0.2191	1.3084	1.1439
No log	1.3418	106	1.2719	0.1459	1.2719	1.1278
No log	1.3671	108	1.1708	0.2654	1.1708	1.0820
No log	1.3924	110	1.1584	0.2560	1.1584	1.0763
No log	1.4177	112	1.2690	0.2049	1.2690	1.1265
No log	1.4430	114	1.3346	0.3192	1.3346	1.1552
No log	1.4684	116	1.3448	0.2868	1.3448	1.1597
No log	1.4937	118	1.5055	0.2350	1.5055	1.2270
No log	1.5190	120	1.5198	0.2346	1.5198	1.2328
No log	1.5443	122	1.5534	0.2409	1.5534	1.2464
No log	1.5696	124	1.5160	0.2948	1.5160	1.2313
No log	1.5949	126	1.4022	0.3018	1.4022	1.1841
No log	1.6203	128	1.2139	0.3293	1.2139	1.1018
No log	1.6456	130	1.2115	0.3475	1.2115	1.1007
No log	1.6709	132	1.0325	0.2844	1.0325	1.0161
No log	1.6962	134	0.9781	0.3527	0.9781	0.9890
No log	1.7215	136	0.9902	0.3301	0.9902	0.9951
No log	1.7468	138	1.0616	0.3273	1.0616	1.0304
No log	1.7722	140	1.1958	0.3750	1.1958	1.0935
No log	1.7975	142	1.2531	0.3977	1.2531	1.1194
No log	1.8228	144	1.0555	0.4101	1.0555	1.0274
No log	1.8481	146	0.9828	0.3443	0.9828	0.9914
No log	1.8734	148	1.0956	0.3650	1.0956	1.0467
No log	1.8987	150	1.3954	0.1321	1.3954	1.1813
No log	1.9241	152	1.6989	0.0789	1.6989	1.3034
No log	1.9494	154	1.9923	0.1518	1.9923	1.4115
No log	1.9747	156	1.9936	0.1741	1.9936	1.4119
No log	2.0	158	1.8911	0.2022	1.8911	1.3752
No log	2.0253	160	1.4472	0.1488	1.4472	1.2030
No log	2.0506	162	1.1753	0.2328	1.1753	1.0841
No log	2.0759	164	1.1770	0.2358	1.1770	1.0849
No log	2.1013	166	1.3231	0.1996	1.3231	1.1503
No log	2.1266	168	1.7230	0.2010	1.7230	1.3126
No log	2.1519	170	2.1804	0.1827	2.1804	1.4766
No log	2.1772	172	2.1139	0.1889	2.1139	1.4539
No log	2.2025	174	1.6527	0.2286	1.6527	1.2856
No log	2.2278	176	1.1470	0.2891	1.1470	1.0710
No log	2.2532	178	1.0292	0.3804	1.0292	1.0145
No log	2.2785	180	1.1076	0.3606	1.1076	1.0524
No log	2.3038	182	1.1043	0.3625	1.1043	1.0509
No log	2.3291	184	1.0233	0.2942	1.0233	1.0116
No log	2.3544	186	1.2848	0.2019	1.2848	1.1335
No log	2.3797	188	1.3705	0.2019	1.3705	1.1707
No log	2.4051	190	1.3943	0.1604	1.3943	1.1808
No log	2.4304	192	1.2144	0.2095	1.2144	1.1020
No log	2.4557	194	1.1179	0.2864	1.1179	1.0573
No log	2.4810	196	1.1292	0.2455	1.1292	1.0626
No log	2.5063	198	1.1629	0.3090	1.1629	1.0784
No log	2.5316	200	1.2708	0.1935	1.2708	1.1273
No log	2.5570	202	1.6617	0.1277	1.6617	1.2891
No log	2.5823	204	1.8757	0.1249	1.8757	1.3696
No log	2.6076	206	1.6002	0.0882	1.6002	1.2650
No log	2.6329	208	1.4066	0.1965	1.4066	1.1860
No log	2.6582	210	1.1899	0.2065	1.1899	1.0908
No log	2.6835	212	1.1574	0.2908	1.1574	1.0758
No log	2.7089	214	1.1270	0.3152	1.1270	1.0616
No log	2.7342	216	1.1219	0.2850	1.1219	1.0592
No log	2.7595	218	1.1015	0.3014	1.1015	1.0495
No log	2.7848	220	1.0818	0.3303	1.0818	1.0401
No log	2.8101	222	1.1549	0.2624	1.1549	1.0747
No log	2.8354	224	1.0987	0.3303	1.0987	1.0482
No log	2.8608	226	1.1576	0.3353	1.1576	1.0759
No log	2.8861	228	1.7117	0.2712	1.7117	1.3083
No log	2.9114	230	1.8235	0.2143	1.8235	1.3504
No log	2.9367	232	1.4382	0.2846	1.4382	1.1992
No log	2.9620	234	1.1551	0.3363	1.1551	1.0748
No log	2.9873	236	1.0958	0.3472	1.0958	1.0468
No log	3.0127	238	1.1053	0.3304	1.1053	1.0513
No log	3.0380	240	1.3032	0.3047	1.3032	1.1416
No log	3.0633	242	1.5406	0.2614	1.5406	1.2412
No log	3.0886	244	1.3512	0.2781	1.3512	1.1624
No log	3.1139	246	1.1132	0.2663	1.1132	1.0551
No log	3.1392	248	1.1247	0.3174	1.1247	1.0605
No log	3.1646	250	1.1579	0.3133	1.1579	1.0760
No log	3.1899	252	1.1576	0.2939	1.1576	1.0759
No log	3.2152	254	1.0814	0.3230	1.0814	1.0399
No log	3.2405	256	1.0377	0.3039	1.0377	1.0187
No log	3.2658	258	1.0206	0.3403	1.0206	1.0103
No log	3.2911	260	1.0596	0.3442	1.0596	1.0294
No log	3.3165	262	1.0772	0.3712	1.0772	1.0379
No log	3.3418	264	1.0591	0.3522	1.0591	1.0291
No log	3.3671	266	1.1633	0.3506	1.1633	1.0786
No log	3.3924	268	1.2731	0.2789	1.2731	1.1283
No log	3.4177	270	1.1782	0.2964	1.1782	1.0854
No log	3.4430	272	1.1275	0.3199	1.1275	1.0618
No log	3.4684	274	1.1736	0.2597	1.1736	1.0833
No log	3.4937	276	1.2831	0.2791	1.2831	1.1327
No log	3.5190	278	1.2055	0.2752	1.2055	1.0979
No log	3.5443	280	1.0392	0.3443	1.0392	1.0194
No log	3.5696	282	1.0234	0.3924	1.0234	1.0116
No log	3.5949	284	1.0887	0.3725	1.0887	1.0434
No log	3.6203	286	1.0655	0.3278	1.0655	1.0322
No log	3.6456	288	1.0866	0.2927	1.0866	1.0424
No log	3.6709	290	1.3120	0.3067	1.3120	1.1454
No log	3.6962	292	1.3326	0.2716	1.3326	1.1544
No log	3.7215	294	1.1566	0.2596	1.1566	1.0754
No log	3.7468	296	1.1227	0.2989	1.1227	1.0596
No log	3.7722	298	1.1918	0.2987	1.1918	1.0917
No log	3.7975	300	1.2295	0.3175	1.2295	1.1088
No log	3.8228	302	1.1353	0.2710	1.1353	1.0655
No log	3.8481	304	1.1196	0.2592	1.1196	1.0581
No log	3.8734	306	1.1297	0.2239	1.1297	1.0629
No log	3.8987	308	1.1500	0.2239	1.1500	1.0724
No log	3.9241	310	1.2154	0.1742	1.2154	1.1024
No log	3.9494	312	1.3131	0.2295	1.3131	1.1459
No log	3.9747	314	1.2759	0.2439	1.2759	1.1296
No log	4.0	316	1.1657	0.2527	1.1657	1.0797
No log	4.0253	318	1.1314	0.2380	1.1314	1.0637
No log	4.0506	320	1.2056	0.2825	1.2056	1.0980
No log	4.0759	322	1.1542	0.2986	1.1542	1.0743
No log	4.1013	324	1.0185	0.3681	1.0185	1.0092
No log	4.1266	326	1.1178	0.4007	1.1178	1.0573
No log	4.1519	328	1.2255	0.3325	1.2255	1.1070
No log	4.1772	330	1.1563	0.2532	1.1563	1.0753
No log	4.2025	332	1.1322	0.2483	1.1322	1.0641
No log	4.2278	334	1.2090	0.2665	1.2090	1.0996
No log	4.2532	336	1.1236	0.2515	1.1236	1.0600
No log	4.2785	338	1.0843	0.2562	1.0843	1.0413
No log	4.3038	340	1.0741	0.3250	1.0741	1.0364
No log	4.3291	342	1.0583	0.3159	1.0583	1.0287
No log	4.3544	344	1.0512	0.2966	1.0512	1.0253
No log	4.3797	346	1.0240	0.3159	1.0240	1.0119
No log	4.4051	348	1.0125	0.3013	1.0125	1.0062
No log	4.4304	350	0.9862	0.2991	0.9862	0.9931
No log	4.4557	352	0.9932	0.4476	0.9932	0.9966
No log	4.4810	354	1.0199	0.3756	1.0199	1.0099
No log	4.5063	356	0.9858	0.4575	0.9858	0.9929
No log	4.5316	358	0.9705	0.4002	0.9705	0.9852
No log	4.5570	360	0.9624	0.3062	0.9624	0.9810
No log	4.5823	362	1.0053	0.3985	1.0053	1.0026
No log	4.6076	364	1.0443	0.3985	1.0443	1.0219
No log	4.6329	366	1.0496	0.3514	1.0496	1.0245
No log	4.6582	368	1.0782	0.3155	1.0782	1.0383
No log	4.6835	370	1.0978	0.2583	1.0978	1.0478
No log	4.7089	372	1.1254	0.3319	1.1254	1.0608
No log	4.7342	374	1.1804	0.2311	1.1804	1.0865
No log	4.7595	376	1.1751	0.2651	1.1751	1.0840
No log	4.7848	378	1.1556	0.2674	1.1556	1.0750
No log	4.8101	380	1.1714	0.3018	1.1714	1.0823
No log	4.8354	382	1.1650	0.2726	1.1650	1.0793
No log	4.8608	384	1.1801	0.1824	1.1801	1.0863
No log	4.8861	386	1.1938	0.2700	1.1938	1.0926
No log	4.9114	388	1.1474	0.2651	1.1474	1.0711
No log	4.9367	390	1.0712	0.3554	1.0712	1.0350
No log	4.9620	392	1.0787	0.3343	1.0787	1.0386
No log	4.9873	394	1.1174	0.3567	1.1174	1.0571
No log	5.0127	396	1.0749	0.3613	1.0749	1.0368
No log	5.0380	398	1.0539	0.2871	1.0539	1.0266
No log	5.0633	400	1.1334	0.2572	1.1334	1.0646
No log	5.0886	402	1.1852	0.2243	1.1852	1.0887
No log	5.1139	404	1.1468	0.2273	1.1468	1.0709
No log	5.1392	406	1.0892	0.3036	1.0892	1.0437
No log	5.1646	408	1.0491	0.3747	1.0491	1.0243
No log	5.1899	410	1.0490	0.3705	1.0490	1.0242
No log	5.2152	412	1.0598	0.3256	1.0598	1.0295
No log	5.2405	414	1.0792	0.2714	1.0792	1.0389
No log	5.2658	416	1.0714	0.2310	1.0714	1.0351
No log	5.2911	418	1.0961	0.2871	1.0961	1.0470
No log	5.3165	420	1.1162	0.3069	1.1162	1.0565
No log	5.3418	422	1.0816	0.2156	1.0816	1.0400
No log	5.3671	424	1.0884	0.2714	1.0884	1.0432
No log	5.3924	426	1.0960	0.2319	1.0960	1.0469
No log	5.4177	428	1.0972	0.2864	1.0972	1.0475
No log	5.4430	430	1.1398	0.2138	1.1398	1.0676
No log	5.4684	432	1.1888	0.2750	1.1888	1.0903
No log	5.4937	434	1.2705	0.2752	1.2705	1.1272
No log	5.5190	436	1.2798	0.2289	1.2798	1.1313
No log	5.5443	438	1.1728	0.2959	1.1728	1.0830
No log	5.5696	440	1.1105	0.1928	1.1105	1.0538
No log	5.5949	442	1.0523	0.2968	1.0523	1.0258
No log	5.6203	444	1.1190	0.3385	1.1190	1.0579
No log	5.6456	446	1.1571	0.3045	1.1571	1.0757
No log	5.6709	448	1.1455	0.2134	1.1455	1.0703
No log	5.6962	450	1.1281	0.2893	1.1281	1.0621
No log	5.7215	452	1.1028	0.2743	1.1028	1.0502
No log	5.7468	454	1.0893	0.2355	1.0893	1.0437
No log	5.7722	456	1.0789	0.2814	1.0789	1.0387
No log	5.7975	458	1.0912	0.2567	1.0912	1.0446
No log	5.8228	460	1.0996	0.2601	1.0996	1.0486
No log	5.8481	462	1.1159	0.2871	1.1159	1.0564
No log	5.8734	464	1.1189	0.3554	1.1189	1.0578
No log	5.8987	466	1.1249	0.3214	1.1249	1.0606
No log	5.9241	468	1.1156	0.2950	1.1156	1.0562
No log	5.9494	470	1.1507	0.2697	1.1507	1.0727
No log	5.9747	472	1.1967	0.3031	1.1967	1.0939
No log	6.0	474	1.1025	0.2892	1.1025	1.0500
No log	6.0253	476	1.0510	0.3108	1.0510	1.0252
No log	6.0506	478	1.0427	0.3650	1.0427	1.0211
No log	6.0759	480	1.0923	0.3363	1.0923	1.0451
No log	6.1013	482	1.1288	0.2520	1.1288	1.0625
No log	6.1266	484	1.1599	0.2681	1.1599	1.0770
No log	6.1519	486	1.2193	0.2124	1.2193	1.1042
No log	6.1772	488	1.2248	0.2223	1.2248	1.1067
No log	6.2025	490	1.1991	0.2212	1.1991	1.0950
No log	6.2278	492	1.2234	0.1662	1.2234	1.1061
No log	6.2532	494	1.2060	0.1662	1.2060	1.0982
No log	6.2785	496	1.1289	0.2545	1.1289	1.0625
No log	6.3038	498	1.0936	0.2892	1.0936	1.0457
0.437	6.3291	500	1.0644	0.2892	1.0644	1.0317
0.437	6.3544	502	1.0474	0.3090	1.0474	1.0234
0.437	6.3797	504	1.0339	0.2991	1.0339	1.0168
0.437	6.4051	506	1.0308	0.3039	1.0308	1.0153
0.437	6.4304	508	1.0216	0.3301	1.0216	1.0108
0.437	6.4557	510	1.0146	0.4026	1.0146	1.0073
0.437	6.4810	512	1.0191	0.4256	1.0191	1.0095
0.437	6.5063	514	1.0087	0.3443	1.0087	1.0043
0.437	6.5316	516	0.9919	0.3036	0.9919	0.9959
0.437	6.5570	518	0.9920	0.3338	0.9920	0.9960
0.437	6.5823	520	0.9619	0.3154	0.9619	0.9808
0.437	6.6076	522	0.9557	0.4444	0.9557	0.9776
0.437	6.6329	524	1.0709	0.3913	1.0709	1.0348
0.437	6.6582	526	1.1131	0.3438	1.1131	1.0550
0.437	6.6835	528	1.0546	0.4300	1.0546	1.0269
0.437	6.7089	530	1.0314	0.3066	1.0314	1.0156
0.437	6.7342	532	1.0632	0.3011	1.0632	1.0311
0.437	6.7595	534	1.0444	0.3011	1.0444	1.0220
0.437	6.7848	536	0.9882	0.3237	0.9882	0.9941
0.437	6.8101	538	1.0075	0.4373	1.0075	1.0038
0.437	6.8354	540	1.0108	0.4373	1.0108	1.0054
0.437	6.8608	542	1.0026	0.4217	1.0026	1.0013
0.437	6.8861	544	1.0123	0.3443	1.0123	1.0062
0.437	6.9114	546	1.0786	0.2700	1.0786	1.0386
0.437	6.9367	548	1.0796	0.2795	1.0796	1.0391
0.437	6.9620	550	1.0531	0.3184	1.0531	1.0262
0.437	6.9873	552	1.0352	0.2823	1.0352	1.0174
0.437	7.0127	554	1.0285	0.3508	1.0285	1.0142
0.437	7.0380	556	1.0621	0.3463	1.0621	1.0306
0.437	7.0633	558	1.0170	0.3508	1.0170	1.0085
0.437	7.0886	560	0.9744	0.3066	0.9744	0.9871
0.437	7.1139	562	0.9947	0.3291	0.9947	0.9974
0.437	7.1392	564	0.9862	0.3498	0.9862	0.9931
0.437	7.1646	566	0.9840	0.3347	0.9840	0.9920
0.437	7.1899	568	0.9827	0.3373	0.9827	0.9913
0.437	7.2152	570	0.9678	0.3626	0.9678	0.9838
0.437	7.2405	572	0.9340	0.3692	0.9340	0.9664
0.437	7.2658	574	0.9138	0.4575	0.9138	0.9559
0.437	7.2911	576	0.9194	0.4122	0.9194	0.9589
0.437	7.3165	578	0.9482	0.3943	0.9482	0.9737
0.437	7.3418	580	0.9887	0.4142	0.9887	0.9944
0.437	7.3671	582	1.0166	0.4142	1.0166	1.0083
0.437	7.3924	584	1.0301	0.4142	1.0301	1.0149
0.437	7.4177	586	1.0156	0.3608	1.0156	1.0078
0.437	7.4430	588	0.9992	0.3511	0.9992	0.9996
0.437	7.4684	590	0.9921	0.3256	0.9921	0.9960
0.437	7.4937	592	0.9907	0.3511	0.9907	0.9953
0.437	7.5190	594	1.0121	0.4042	1.0121	1.0061
0.437	7.5443	596	1.1135	0.3113	1.1135	1.0552
0.437	7.5696	598	1.1496	0.2745	1.1496	1.0722
0.437	7.5949	600	1.0848	0.3282	1.0848	1.0415
0.437	7.6203	602	1.0578	0.3596	1.0578	1.0285
0.437	7.6456	604	1.1812	0.2356	1.1812	1.0868
0.437	7.6709	606	1.2404	0.2492	1.2404	1.1137
0.437	7.6962	608	1.1321	0.2031	1.1321	1.0640
0.437	7.7215	610	1.0880	0.3811	1.0880	1.0431
0.437	7.7468	612	1.1499	0.3716	1.1499	1.0723
0.437	7.7722	614	1.1278	0.3091	1.1278	1.0620
0.437	7.7975	616	1.0617	0.3762	1.0617	1.0304
0.437	7.8228	618	1.0300	0.3159	1.0300	1.0149
0.437	7.8481	620	1.0497	0.3062	1.0497	1.0245
0.437	7.8734	622	1.0686	0.3159	1.0686	1.0337
0.437	7.8987	624	1.1178	0.2944	1.1178	1.0573
0.437	7.9241	626	1.1577	0.2803	1.1577	1.0759
0.437	7.9494	628	1.1725	0.2584	1.1725	1.0828
0.437	7.9747	630	1.1800	0.2550	1.1800	1.0863
0.437	8.0	632	1.1764	0.2601	1.1764	1.0846
0.437	8.0253	634	1.1235	0.2584	1.1235	1.0599

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1