ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1214
• Qwk: 0.3257
• Mse: 1.1214
• Rmse: 1.0590

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0247	2	4.0816	-0.0048	4.0816	2.0203
No log	0.0494	4	2.3588	0.0540	2.3588	1.5358
No log	0.0741	6	1.3364	-0.0973	1.3364	1.1560
No log	0.0988	8	1.0968	0.1504	1.0968	1.0473
No log	0.1235	10	1.2162	0.1071	1.2162	1.1028
No log	0.1481	12	1.2626	0.1379	1.2626	1.1237
No log	0.1728	14	1.3242	0.0093	1.3242	1.1507
No log	0.1975	16	1.2495	0.1442	1.2495	1.1178
No log	0.2222	18	1.1926	0.0890	1.1926	1.0921
No log	0.2469	20	1.4080	0.1876	1.4080	1.1866
No log	0.2716	22	1.7218	0.1288	1.7218	1.3122
No log	0.2963	24	1.5916	0.1230	1.5916	1.2616
No log	0.3210	26	1.1664	0.2138	1.1664	1.0800
No log	0.3457	28	1.1074	0.1821	1.1074	1.0523
No log	0.3704	30	1.2522	0.2188	1.2522	1.1190
No log	0.3951	32	1.6946	0.0902	1.6946	1.3018
No log	0.4198	34	1.8234	0.0404	1.8234	1.3503
No log	0.4444	36	1.5160	0.1416	1.5160	1.2313
No log	0.4691	38	1.1296	0.1067	1.1296	1.0628
No log	0.4938	40	1.0757	0.1221	1.0757	1.0371
No log	0.5185	42	1.0741	0.1341	1.0741	1.0364
No log	0.5432	44	1.2764	0.2583	1.2764	1.1298
No log	0.5679	46	1.9804	0.1512	1.9804	1.4073
No log	0.5926	48	2.7999	0.0786	2.7999	1.6733
No log	0.6173	50	2.5687	0.0546	2.5687	1.6027
No log	0.6420	52	1.9004	0.1484	1.9004	1.3785
No log	0.6667	54	1.3432	0.1354	1.3432	1.1590
No log	0.6914	56	1.0680	0.2145	1.0680	1.0334
No log	0.7160	58	1.0500	0.1476	1.0500	1.0247
No log	0.7407	60	1.0468	0.1653	1.0468	1.0231
No log	0.7654	62	1.0078	0.1532	1.0078	1.0039
No log	0.7901	64	1.3393	0.0840	1.3393	1.1573
No log	0.8148	66	2.3624	0.0696	2.3624	1.5370
No log	0.8395	68	2.4866	0.0819	2.4866	1.5769
No log	0.8642	70	1.8111	0.1569	1.8111	1.3458
No log	0.8889	72	1.2251	0.0834	1.2251	1.1069
No log	0.9136	74	1.0215	0.3835	1.0215	1.0107
No log	0.9383	76	1.0472	0.2827	1.0472	1.0233
No log	0.9630	78	1.3108	0.1224	1.3108	1.1449
No log	0.9877	80	1.5515	0.1280	1.5515	1.2456
No log	1.0123	82	1.7916	0.1358	1.7916	1.3385
No log	1.0370	84	1.7511	0.1179	1.7511	1.3233
No log	1.0617	86	1.4907	0.0651	1.4907	1.2209
No log	1.0864	88	1.2322	0.0496	1.2322	1.1100
No log	1.1111	90	1.0885	0.2343	1.0885	1.0433
No log	1.1358	92	1.0754	0.1810	1.0754	1.0370
No log	1.1605	94	1.0948	0.0884	1.0948	1.0463
No log	1.1852	96	1.1299	0.2564	1.1299	1.0630
No log	1.2099	98	1.1541	0.1732	1.1541	1.0743
No log	1.2346	100	1.1955	0.2145	1.1955	1.0934
No log	1.2593	102	1.1763	0.1797	1.1763	1.0846
No log	1.2840	104	1.1898	0.2256	1.1898	1.0908
No log	1.3086	106	1.2173	0.2410	1.2173	1.1033
No log	1.3333	108	1.2970	0.2149	1.2970	1.1388
No log	1.3580	110	1.2484	0.1912	1.2484	1.1173
No log	1.3827	112	1.1865	0.2069	1.1865	1.0893
No log	1.4074	114	1.2118	0.1935	1.2118	1.1008
No log	1.4321	116	1.1754	0.2073	1.1754	1.0841
No log	1.4568	118	1.2062	0.1797	1.2062	1.0983
No log	1.4815	120	1.2321	0.1728	1.2321	1.1100
No log	1.5062	122	1.3079	0.1305	1.3079	1.1436
No log	1.5309	124	1.5135	0.1689	1.5135	1.2302
No log	1.5556	126	1.4548	0.1216	1.4548	1.2062
No log	1.5802	128	1.2662	0.1766	1.2662	1.1253
No log	1.6049	130	1.2866	0.1515	1.2866	1.1343
No log	1.6296	132	1.3143	0.1576	1.3143	1.1464
No log	1.6543	134	1.3769	0.1655	1.3769	1.1734
No log	1.6790	136	1.4710	0.1463	1.4710	1.2129
No log	1.7037	138	1.4021	0.0837	1.4021	1.1841
No log	1.7284	140	1.4452	0.2108	1.4452	1.2022
No log	1.7531	142	1.3979	0.1837	1.3979	1.1823
No log	1.7778	144	1.3389	0.1300	1.3389	1.1571
No log	1.8025	146	1.4199	0.1485	1.4199	1.1916
No log	1.8272	148	1.3058	0.0958	1.3058	1.1427
No log	1.8519	150	1.2409	0.1650	1.2409	1.1140
No log	1.8765	152	1.2447	0.2095	1.2447	1.1157
No log	1.9012	154	1.2229	0.2432	1.2229	1.1059
No log	1.9259	156	1.5461	0.0943	1.5461	1.2434
No log	1.9506	158	1.8553	0.1604	1.8553	1.3621
No log	1.9753	160	1.7209	0.1511	1.7209	1.3118
No log	2.0	162	1.3978	0.1015	1.3978	1.1823
No log	2.0247	164	1.2308	0.1818	1.2308	1.1094
No log	2.0494	166	1.2411	0.1701	1.2411	1.1141
No log	2.0741	168	1.4105	0.1116	1.4105	1.1876
No log	2.0988	170	1.6546	0.0918	1.6546	1.2863
No log	2.1235	172	1.6373	0.0827	1.6373	1.2796
No log	2.1481	174	1.3854	0.2070	1.3854	1.1771
No log	2.1728	176	1.2348	0.1822	1.2348	1.1112
No log	2.1975	178	1.1668	0.1841	1.1668	1.0802
No log	2.2222	180	1.1838	0.2667	1.1838	1.0880
No log	2.2469	182	1.2772	0.1740	1.2772	1.1301
No log	2.2716	184	1.3329	0.1193	1.3329	1.1545
No log	2.2963	186	1.1935	0.1521	1.1935	1.0925
No log	2.3210	188	1.1183	0.2159	1.1183	1.0575
No log	2.3457	190	1.1762	0.2179	1.1762	1.0845
No log	2.3704	192	1.1396	0.1979	1.1396	1.0675
No log	2.3951	194	1.1073	0.2083	1.1073	1.0523
No log	2.4198	196	1.1638	0.1867	1.1638	1.0788
No log	2.4444	198	1.2541	0.1279	1.2541	1.1199
No log	2.4691	200	1.3682	0.1232	1.3682	1.1697
No log	2.4938	202	1.3444	0.1424	1.3444	1.1595
No log	2.5185	204	1.1783	0.2942	1.1783	1.0855
No log	2.5432	206	1.1512	0.3513	1.1512	1.0729
No log	2.5679	208	1.1521	0.3169	1.1521	1.0734
No log	2.5926	210	1.1640	0.2479	1.1640	1.0789
No log	2.6173	212	1.1861	0.2366	1.1861	1.0891
No log	2.6420	214	1.2693	0.1893	1.2693	1.1266
No log	2.6667	216	1.2566	0.1652	1.2566	1.1210
No log	2.6914	218	1.2127	0.3010	1.2127	1.1012
No log	2.7160	220	1.1974	0.2486	1.1974	1.0942
No log	2.7407	222	1.2242	0.3131	1.2242	1.1064
No log	2.7654	224	1.3388	0.2176	1.3388	1.1571
No log	2.7901	226	1.4159	0.2401	1.4159	1.1899
No log	2.8148	228	1.3583	0.2478	1.3583	1.1655
No log	2.8395	230	1.1836	0.2477	1.1836	1.0879
No log	2.8642	232	1.0761	0.3112	1.0761	1.0374
No log	2.8889	234	1.0626	0.2432	1.0626	1.0308
No log	2.9136	236	1.1084	0.2669	1.1084	1.0528
No log	2.9383	238	1.1702	0.2822	1.1702	1.0818
No log	2.9630	240	1.1067	0.2625	1.1067	1.0520
No log	2.9877	242	1.0852	0.3820	1.0852	1.0417
No log	3.0123	244	1.1194	0.4089	1.1194	1.0580
No log	3.0370	246	1.1464	0.2876	1.1464	1.0707
No log	3.0617	248	1.1551	0.2983	1.1551	1.0748
No log	3.0864	250	1.0945	0.3820	1.0945	1.0462
No log	3.1111	252	1.0615	0.3408	1.0615	1.0303
No log	3.1358	254	1.0397	0.3398	1.0397	1.0197
No log	3.1605	256	1.0385	0.2532	1.0385	1.0191
No log	3.1852	258	1.0371	0.2763	1.0371	1.0184
No log	3.2099	260	1.0707	0.2554	1.0707	1.0347
No log	3.2346	262	1.0885	0.3101	1.0885	1.0433
No log	3.2593	264	1.0570	0.3418	1.0570	1.0281
No log	3.2840	266	1.0791	0.3689	1.0791	1.0388
No log	3.3086	268	1.0827	0.3689	1.0827	1.0406
No log	3.3333	270	1.0661	0.3316	1.0661	1.0325
No log	3.3580	272	1.0569	0.3097	1.0569	1.0281
No log	3.3827	274	1.0317	0.2370	1.0317	1.0157
No log	3.4074	276	1.0234	0.2347	1.0234	1.0116
No log	3.4321	278	1.0189	0.2718	1.0189	1.0094
No log	3.4568	280	1.0446	0.2857	1.0446	1.0221
No log	3.4815	282	1.1012	0.2690	1.1012	1.0494
No log	3.5062	284	1.1034	0.2579	1.1034	1.0504
No log	3.5309	286	1.0522	0.2901	1.0522	1.0258
No log	3.5556	288	1.0597	0.2879	1.0597	1.0294
No log	3.5802	290	1.1120	0.2871	1.1120	1.0545
No log	3.6049	292	1.0835	0.2462	1.0835	1.0409
No log	3.6296	294	1.0489	0.2790	1.0489	1.0242
No log	3.6543	296	1.0495	0.2865	1.0495	1.0244
No log	3.6790	298	1.0389	0.3091	1.0389	1.0193
No log	3.7037	300	1.1339	0.3236	1.1339	1.0649
No log	3.7284	302	1.2448	0.1809	1.2448	1.1157
No log	3.7531	304	1.1953	0.2302	1.1953	1.0933
No log	3.7778	306	1.0785	0.2694	1.0785	1.0385
No log	3.8025	308	1.0878	0.3048	1.0878	1.0430
No log	3.8272	310	1.1112	0.2252	1.1112	1.0542
No log	3.8519	312	1.1096	0.2974	1.1096	1.0534
No log	3.8765	314	1.1833	0.2491	1.1833	1.0878
No log	3.9012	316	1.2224	0.2844	1.2224	1.1056
No log	3.9259	318	1.1861	0.3076	1.1861	1.0891
No log	3.9506	320	1.1844	0.2694	1.1844	1.0883
No log	3.9753	322	1.1991	0.3076	1.1991	1.0950
No log	4.0	324	1.2016	0.2982	1.2016	1.0962
No log	4.0247	326	1.1871	0.2982	1.1871	1.0895
No log	4.0494	328	1.1995	0.2502	1.1995	1.0952
No log	4.0741	330	1.1967	0.2475	1.1967	1.0940
No log	4.0988	332	1.1335	0.2857	1.1335	1.0646
No log	4.1235	334	1.1040	0.2952	1.1040	1.0507
No log	4.1481	336	1.1032	0.2931	1.1032	1.0503
No log	4.1728	338	1.0996	0.2835	1.0996	1.0486
No log	4.1975	340	1.1235	0.2456	1.1235	1.0600
No log	4.2222	342	1.0962	0.2053	1.0962	1.0470
No log	4.2469	344	1.0644	0.2528	1.0644	1.0317
No log	4.2716	346	1.0664	0.2572	1.0664	1.0327
No log	4.2963	348	1.0570	0.2572	1.0570	1.0281
No log	4.3210	350	1.0630	0.1793	1.0630	1.0310
No log	4.3457	352	1.0959	0.1585	1.0959	1.0469
No log	4.3704	354	1.1067	0.2078	1.1067	1.0520
No log	4.3951	356	1.1236	0.2049	1.1236	1.0600
No log	4.4198	358	1.1289	0.3042	1.1289	1.0625
No log	4.4444	360	1.1031	0.3250	1.1031	1.0503
No log	4.4691	362	1.0903	0.3358	1.0903	1.0442
No log	4.4938	364	1.0722	0.3747	1.0722	1.0354
No log	4.5185	366	1.0292	0.2057	1.0292	1.0145
No log	4.5432	368	1.0669	0.2304	1.0669	1.0329
No log	4.5679	370	1.1847	0.2070	1.1847	1.0885
No log	4.5926	372	1.1809	0.2212	1.1809	1.0867
No log	4.6173	374	1.0437	0.3001	1.0437	1.0216
No log	4.6420	376	1.0096	0.3765	1.0096	1.0048
No log	4.6667	378	1.1144	0.4259	1.1144	1.0556
No log	4.6914	380	1.1048	0.4259	1.1048	1.0511
No log	4.7160	382	1.0243	0.3540	1.0243	1.0121
No log	4.7407	384	1.0167	0.3323	1.0167	1.0083
No log	4.7654	386	1.0373	0.3583	1.0373	1.0185
No log	4.7901	388	1.0141	0.2812	1.0141	1.0070
No log	4.8148	390	1.0200	0.2910	1.0200	1.0099
No log	4.8395	392	1.0618	0.3008	1.0618	1.0304
No log	4.8642	394	1.1390	0.2677	1.1390	1.0673
No log	4.8889	396	1.1993	0.2401	1.1993	1.0951
No log	4.9136	398	1.2546	0.2454	1.2546	1.1201
No log	4.9383	400	1.2351	0.2677	1.2351	1.1113
No log	4.9630	402	1.2092	0.3408	1.2092	1.0996
No log	4.9877	404	1.1853	0.2850	1.1853	1.0887
No log	5.0123	406	1.1827	0.3128	1.1827	1.0875
No log	5.0370	408	1.1549	0.2602	1.1549	1.0746
No log	5.0617	410	1.1269	0.2694	1.1269	1.0616
No log	5.0864	412	1.1052	0.2829	1.1052	1.0513
No log	5.1111	414	1.1135	0.2829	1.1135	1.0552
No log	5.1358	416	1.0879	0.2432	1.0879	1.0430
No log	5.1605	418	1.0793	0.2432	1.0793	1.0389
No log	5.1852	420	1.0914	0.2738	1.0914	1.0447
No log	5.2099	422	1.0728	0.2469	1.0728	1.0358
No log	5.2346	424	1.0560	0.3052	1.0560	1.0276
No log	5.2593	426	1.1118	0.3463	1.1118	1.0544
No log	5.2840	428	1.1292	0.3463	1.1292	1.0626
No log	5.3086	430	1.0654	0.3209	1.0654	1.0322
No log	5.3333	432	1.0384	0.3052	1.0384	1.0190
No log	5.3580	434	1.0512	0.3017	1.0512	1.0253
No log	5.3827	436	1.0471	0.3112	1.0471	1.0233
No log	5.4074	438	1.0568	0.2910	1.0568	1.0280
No log	5.4321	440	1.0672	0.2767	1.0672	1.0331
No log	5.4568	442	1.1276	0.3182	1.1276	1.0619
No log	5.4815	444	1.1237	0.3027	1.1237	1.0600
No log	5.5062	446	1.0905	0.2767	1.0905	1.0443
No log	5.5309	448	1.0753	0.2767	1.0753	1.0370
No log	5.5556	450	1.0591	0.2910	1.0591	1.0291
No log	5.5802	452	1.0616	0.24	1.0616	1.0304
No log	5.6049	454	1.0507	0.3017	1.0507	1.0250
No log	5.6296	456	1.0445	0.3154	1.0445	1.0220
No log	5.6543	458	1.0265	0.2545	1.0265	1.0132
No log	5.6790	460	1.0065	0.3485	1.0065	1.0033
No log	5.7037	462	0.9993	0.2108	0.9993	0.9996
No log	5.7284	464	1.0341	0.3386	1.0341	1.0169
No log	5.7531	466	1.0601	0.2880	1.0601	1.0296
No log	5.7778	468	1.0459	0.3386	1.0459	1.0227
No log	5.8025	470	1.0102	0.2690	1.0102	1.0051
No log	5.8272	472	1.0055	0.2596	1.0055	1.0027
No log	5.8519	474	1.0207	0.2449	1.0207	1.0103
No log	5.8765	476	1.0218	0.2449	1.0218	1.0109
No log	5.9012	478	1.0318	0.2278	1.0318	1.0158
No log	5.9259	480	1.0668	0.3646	1.0668	1.0329
No log	5.9506	482	1.0407	0.3216	1.0407	1.0202
No log	5.9753	484	1.0118	0.2767	1.0118	1.0059
No log	6.0	486	1.0930	0.3822	1.0930	1.0454
No log	6.0247	488	1.1420	0.2632	1.1420	1.0686
No log	6.0494	490	1.0716	0.3434	1.0716	1.0352
No log	6.0741	492	0.9942	0.2204	0.9942	0.9971
No log	6.0988	494	1.0097	0.2978	1.0097	1.0048
No log	6.1235	496	1.0635	0.2945	1.0635	1.0313
No log	6.1481	498	1.0598	0.3257	1.0598	1.0294
0.3477	6.1728	500	1.0203	0.3270	1.0203	1.0101
0.3477	6.1975	502	1.0054	0.3448	1.0054	1.0027
0.3477	6.2222	504	0.9900	0.3408	0.9900	0.9950
0.3477	6.2469	506	0.9887	0.3278	0.9887	0.9943
0.3477	6.2716	508	1.0066	0.3299	1.0066	1.0033
0.3477	6.2963	510	0.9931	0.2901	0.9931	0.9965
0.3477	6.3210	512	0.9957	0.2574	0.9957	0.9979
0.3477	6.3457	514	1.0167	0.2528	1.0167	1.0083
0.3477	6.3704	516	1.0115	0.2763	1.0115	1.0057
0.3477	6.3951	518	1.0332	0.3382	1.0332	1.0165
0.3477	6.4198	520	1.0602	0.3382	1.0602	1.0296
0.3477	6.4444	522	1.0469	0.2871	1.0469	1.0232
0.3477	6.4691	524	1.0464	0.3229	1.0464	1.0229
0.3477	6.4938	526	1.0445	0.2314	1.0445	1.0220
0.3477	6.5185	528	1.0675	0.2784	1.0675	1.0332
0.3477	6.5432	530	1.1214	0.3257	1.1214	1.0590

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1