ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k6_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1006
• Qwk: 0.2721
• Mse: 1.1006
• Rmse: 1.0491

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0741	2	3.8892	-0.0032	3.8892	1.9721
No log	0.1481	4	2.3786	0.0110	2.3786	1.5423
No log	0.2222	6	2.0180	0.0142	2.0180	1.4206
No log	0.2963	8	1.2665	0.1486	1.2665	1.1254
No log	0.3704	10	1.0655	0.2663	1.0655	1.0322
No log	0.4444	12	1.1052	0.3236	1.1052	1.0513
No log	0.5185	14	1.4163	0.1819	1.4163	1.1901
No log	0.5926	16	1.1509	0.3431	1.1509	1.0728
No log	0.6667	18	1.0243	0.2690	1.0243	1.0121
No log	0.7407	20	1.0261	0.3160	1.0261	1.0129
No log	0.8148	22	1.1727	0.3090	1.1727	1.0829
No log	0.8889	24	1.3319	0.2201	1.3319	1.1541
No log	0.9630	26	1.5807	0.1386	1.5807	1.2572
No log	1.0370	28	1.3639	0.2386	1.3639	1.1678
No log	1.1111	30	1.2024	0.2793	1.2024	1.0966
No log	1.1852	32	1.1745	0.2754	1.1745	1.0838
No log	1.2593	34	1.2642	0.2951	1.2642	1.1244
No log	1.3333	36	1.2701	0.2840	1.2701	1.1270
No log	1.4074	38	1.2841	0.2674	1.2841	1.1332
No log	1.4815	40	1.2573	0.2804	1.2573	1.1213
No log	1.5556	42	1.1904	0.2752	1.1904	1.0911
No log	1.6296	44	1.1352	0.2659	1.1352	1.0655
No log	1.7037	46	1.2129	0.2869	1.2129	1.1013
No log	1.7778	48	1.4787	0.2105	1.4787	1.2160
No log	1.8519	50	1.2583	0.3107	1.2583	1.1218
No log	1.9259	52	1.0535	0.3736	1.0535	1.0264
No log	2.0	54	1.0881	0.4176	1.0881	1.0431
No log	2.0741	56	1.0005	0.2871	1.0005	1.0002
No log	2.1481	58	1.2205	0.2857	1.2205	1.1048
No log	2.2222	60	1.7437	0.1929	1.7437	1.3205
No log	2.2963	62	1.8080	0.1464	1.8080	1.3446
No log	2.3704	64	1.4387	0.1395	1.4387	1.1995
No log	2.4444	66	1.1066	0.2640	1.1066	1.0520
No log	2.5185	68	1.0381	0.2739	1.0381	1.0189
No log	2.5926	70	1.0459	0.1158	1.0459	1.0227
No log	2.6667	72	1.0610	0.1573	1.0610	1.0300
No log	2.7407	74	1.0945	0.2479	1.0945	1.0462
No log	2.8148	76	1.2180	0.2304	1.2180	1.1036
No log	2.8889	78	1.3414	0.1815	1.3414	1.1582
No log	2.9630	80	1.2217	0.1984	1.2217	1.1053
No log	3.0370	82	1.1730	0.1960	1.1730	1.0830
No log	3.1111	84	1.1664	0.1960	1.1664	1.0800
No log	3.1852	86	1.1455	0.1960	1.1455	1.0703
No log	3.2593	88	1.1365	0.2432	1.1365	1.0661
No log	3.3333	90	1.1377	0.3584	1.1377	1.0666
No log	3.4074	92	1.1712	0.3931	1.1712	1.0822
No log	3.4815	94	1.2354	0.3349	1.2354	1.1115
No log	3.5556	96	1.3210	0.2620	1.3210	1.1494
No log	3.6296	98	1.2410	0.3858	1.2410	1.1140
No log	3.7037	100	1.1813	0.3268	1.1813	1.0869
No log	3.7778	102	1.1132	0.3924	1.1132	1.0551
No log	3.8519	104	1.1488	0.3859	1.1488	1.0718
No log	3.9259	106	1.1522	0.4094	1.1522	1.0734
No log	4.0	108	1.1056	0.3875	1.1056	1.0515
No log	4.0741	110	1.0841	0.3543	1.0841	1.0412
No log	4.1481	112	1.0898	0.3543	1.0898	1.0439
No log	4.2222	114	1.1196	0.3543	1.1196	1.0581
No log	4.2963	116	1.1550	0.3875	1.1550	1.0747
No log	4.3704	118	1.1922	0.3141	1.1922	1.0919
No log	4.4444	120	1.1982	0.2469	1.1982	1.0946
No log	4.5185	122	1.2485	0.3029	1.2485	1.1174
No log	4.5926	124	1.2176	0.2602	1.2176	1.1035
No log	4.6667	126	1.1356	0.2810	1.1356	1.0657
No log	4.7407	128	1.1857	0.3648	1.1857	1.0889
No log	4.8148	130	1.2144	0.3255	1.2144	1.1020
No log	4.8889	132	1.2506	0.2699	1.2506	1.1183
No log	4.9630	134	1.2211	0.3047	1.2211	1.1051
No log	5.0370	136	1.1934	0.3385	1.1934	1.0924
No log	5.1111	138	1.1405	0.4444	1.1405	1.0679
No log	5.1852	140	1.0898	0.3965	1.0898	1.0439
No log	5.2593	142	1.0998	0.4025	1.0998	1.0487
No log	5.3333	144	1.0802	0.4025	1.0802	1.0393
No log	5.4074	146	1.0475	0.3784	1.0475	1.0235
No log	5.4815	148	1.0355	0.4076	1.0355	1.0176
No log	5.5556	150	1.0988	0.4170	1.0988	1.0482
No log	5.6296	152	1.2391	0.3395	1.2391	1.1132
No log	5.7037	154	1.2045	0.3320	1.2045	1.0975
No log	5.7778	156	1.1692	0.2118	1.1692	1.0813
No log	5.8519	158	1.2102	0.2527	1.2102	1.1001
No log	5.9259	160	1.1330	0.2060	1.1330	1.0644
No log	6.0	162	1.0973	0.2982	1.0973	1.0475
No log	6.0741	164	1.1080	0.3931	1.1080	1.0526
No log	6.1481	166	1.1209	0.4069	1.1209	1.0587
No log	6.2222	168	1.0974	0.2759	1.0974	1.0476
No log	6.2963	170	1.1005	0.3474	1.1005	1.0490
No log	6.3704	172	1.1635	0.3067	1.1635	1.0787
No log	6.4444	174	1.2062	0.2725	1.2062	1.0983
No log	6.5185	176	1.1049	0.4022	1.1049	1.0512
No log	6.5926	178	1.0610	0.3561	1.0610	1.0300
No log	6.6667	180	1.0737	0.4196	1.0737	1.0362
No log	6.7407	182	1.2197	0.3639	1.2197	1.1044
No log	6.8148	184	1.2847	0.3203	1.2847	1.1334
No log	6.8889	186	1.1181	0.4503	1.1181	1.0574
No log	6.9630	188	1.0209	0.4013	1.0209	1.0104
No log	7.0370	190	1.0517	0.3415	1.0517	1.0255
No log	7.1111	192	1.0194	0.3544	1.0194	1.0097
No log	7.1852	194	0.9803	0.3184	0.9803	0.9901
No log	7.2593	196	1.0671	0.4590	1.0671	1.0330
No log	7.3333	198	1.0887	0.4590	1.0887	1.0434
No log	7.4074	200	1.0096	0.4164	1.0096	1.0048
No log	7.4815	202	1.0020	0.3892	1.0020	1.0010
No log	7.5556	204	1.0478	0.4082	1.0478	1.0236
No log	7.6296	206	1.0820	0.4157	1.0820	1.0402
No log	7.7037	208	1.0629	0.4036	1.0629	1.0310
No log	7.7778	210	1.0773	0.4554	1.0773	1.0379
No log	7.8519	212	1.0681	0.4323	1.0681	1.0335
No log	7.9259	214	1.0545	0.3998	1.0545	1.0269
No log	8.0	216	1.0305	0.4181	1.0305	1.0151
No log	8.0741	218	1.0141	0.2850	1.0141	1.0070
No log	8.1481	220	1.0114	0.2850	1.0114	1.0057
No log	8.2222	222	1.0017	0.3076	1.0017	1.0009
No log	8.2963	224	1.0340	0.2864	1.0340	1.0169
No log	8.3704	226	1.0266	0.3117	1.0266	1.0132
No log	8.4444	228	1.0188	0.3000	1.0188	1.0094
No log	8.5185	230	1.0430	0.3261	1.0430	1.0213
No log	8.5926	232	1.0644	0.4053	1.0644	1.0317
No log	8.6667	234	1.1262	0.4022	1.1262	1.0612
No log	8.7407	236	1.1619	0.4022	1.1619	1.0779
No log	8.8148	238	1.2328	0.3892	1.2328	1.1103
No log	8.8889	240	1.2739	0.3350	1.2739	1.1287
No log	8.9630	242	1.2218	0.4155	1.2218	1.1054
No log	9.0370	244	1.1988	0.3128	1.1988	1.0949
No log	9.1111	246	1.1966	0.2092	1.1966	1.0939
No log	9.1852	248	1.1992	0.2097	1.1992	1.0951
No log	9.2593	250	1.1931	0.1353	1.1931	1.0923
No log	9.3333	252	1.2003	0.1679	1.2003	1.0956
No log	9.4074	254	1.2275	0.3483	1.2275	1.1079
No log	9.4815	256	1.2019	0.3250	1.2019	1.0963
No log	9.5556	258	1.2031	0.2424	1.2031	1.0969
No log	9.6296	260	1.2410	0.3311	1.2410	1.1140
No log	9.7037	262	1.1627	0.2403	1.1627	1.0783
No log	9.7778	264	1.1894	0.3498	1.1894	1.0906
No log	9.8519	266	1.1750	0.3758	1.1750	1.0840
No log	9.9259	268	1.1140	0.3109	1.1140	1.0554
No log	10.0	270	1.1072	0.3109	1.1072	1.0522
No log	10.0741	272	1.1173	0.3789	1.1173	1.0570
No log	10.1481	274	1.1197	0.3789	1.1197	1.0582
No log	10.2222	276	1.1230	0.3573	1.1230	1.0597
No log	10.2963	278	1.1853	0.3278	1.1853	1.0887
No log	10.3704	280	1.1193	0.3255	1.1193	1.0580
No log	10.4444	282	1.0906	0.4217	1.0906	1.0443
No log	10.5185	284	1.0774	0.4289	1.0774	1.0380
No log	10.5926	286	1.0731	0.3786	1.0731	1.0359
No log	10.6667	288	1.0754	0.4056	1.0754	1.0370
No log	10.7407	290	1.0670	0.3523	1.0670	1.0329
No log	10.8148	292	1.1281	0.2895	1.1281	1.0621
No log	10.8889	294	1.2079	0.3034	1.2079	1.0991
No log	10.9630	296	1.1336	0.3837	1.1336	1.0647
No log	11.0370	298	1.1083	0.4242	1.1083	1.0528
No log	11.1111	300	1.1152	0.4202	1.1152	1.0560
No log	11.1852	302	1.0706	0.3403	1.0706	1.0347
No log	11.2593	304	1.0533	0.3394	1.0533	1.0263
No log	11.3333	306	1.0492	0.3210	1.0492	1.0243
No log	11.4074	308	1.0349	0.3154	1.0349	1.0173
No log	11.4815	310	1.0400	0.2370	1.0400	1.0198
No log	11.5556	312	1.0555	0.3035	1.0555	1.0274
No log	11.6296	314	1.0691	0.3243	1.0691	1.0340
No log	11.7037	316	1.0710	0.3765	1.0710	1.0349
No log	11.7778	318	1.0510	0.3378	1.0510	1.0252
No log	11.8519	320	1.0365	0.3014	1.0365	1.0181
No log	11.9259	322	1.0364	0.3708	1.0364	1.0180
No log	12.0	324	1.0457	0.3117	1.0457	1.0226
No log	12.0741	326	1.0237	0.3466	1.0237	1.0118
No log	12.1481	328	1.1080	0.3930	1.1080	1.0526
No log	12.2222	330	1.2049	0.2955	1.2049	1.0977
No log	12.2963	332	1.1591	0.4139	1.1591	1.0766
No log	12.3704	334	1.0759	0.3722	1.0759	1.0373
No log	12.4444	336	1.0242	0.3931	1.0242	1.0120
No log	12.5185	338	1.0079	0.3671	1.0079	1.0039
No log	12.5926	340	1.0701	0.3822	1.0701	1.0344
No log	12.6667	342	1.1075	0.3511	1.1075	1.0524
No log	12.7407	344	1.0628	0.3921	1.0628	1.0309
No log	12.8148	346	1.0006	0.3209	1.0006	1.0003
No log	12.8889	348	1.0237	0.2944	1.0237	1.0118
No log	12.9630	350	1.0646	0.3082	1.0646	1.0318
No log	13.0370	352	1.0416	0.2669	1.0416	1.0206
No log	13.1111	354	1.0353	0.2509	1.0353	1.0175
No log	13.1852	356	1.0910	0.3662	1.0910	1.0445
No log	13.2593	358	1.1737	0.3809	1.1737	1.0834
No log	13.3333	360	1.1360	0.4275	1.1360	1.0658
No log	13.4074	362	1.0308	0.3736	1.0308	1.0153
No log	13.4815	364	1.0038	0.3147	1.0038	1.0019
No log	13.5556	366	0.9822	0.3323	0.9822	0.9910
No log	13.6296	368	0.9647	0.3112	0.9647	0.9822
No log	13.7037	370	0.9614	0.3784	0.9614	0.9805
No log	13.7778	372	1.0071	0.4023	1.0071	1.0035
No log	13.8519	374	0.9987	0.4375	0.9987	0.9993
No log	13.9259	376	0.9637	0.3914	0.9637	0.9817
No log	14.0	378	0.9352	0.3455	0.9352	0.9670
No log	14.0741	380	0.9251	0.3804	0.9251	0.9618
No log	14.1481	382	0.9395	0.4153	0.9395	0.9693
No log	14.2222	384	0.9708	0.4741	0.9708	0.9853
No log	14.2963	386	1.0011	0.4037	1.0011	1.0006
No log	14.3704	388	0.9758	0.3804	0.9758	0.9878
No log	14.4444	390	0.9615	0.3711	0.9615	0.9805
No log	14.5185	392	0.9836	0.3804	0.9836	0.9918
No log	14.5926	394	1.0655	0.3826	1.0655	1.0322
No log	14.6667	396	1.0480	0.3618	1.0480	1.0237
No log	14.7407	398	0.9865	0.3455	0.9865	0.9932
No log	14.8148	400	0.9816	0.4126	0.9816	0.9908
No log	14.8889	402	0.9736	0.3427	0.9736	0.9867
No log	14.9630	404	1.0414	0.3897	1.0414	1.0205
No log	15.0370	406	1.1214	0.3649	1.1214	1.0590
No log	15.1111	408	1.0992	0.4115	1.0992	1.0484
No log	15.1852	410	1.0216	0.3584	1.0216	1.0107
No log	15.2593	412	1.0122	0.3035	1.0122	1.0061
No log	15.3333	414	1.0192	0.3608	1.0192	1.0096
No log	15.4074	416	1.0499	0.3897	1.0499	1.0247
No log	15.4815	418	1.0412	0.3897	1.0412	1.0204
No log	15.5556	420	0.9974	0.3931	0.9974	0.9987
No log	15.6296	422	0.9953	0.3324	0.9953	0.9977
No log	15.7037	424	1.0090	0.4048	1.0090	1.0045
No log	15.7778	426	0.9953	0.3324	0.9953	0.9977
No log	15.8519	428	1.0082	0.4305	1.0082	1.0041
No log	15.9259	430	1.0582	0.4159	1.0582	1.0287
No log	16.0	432	1.0744	0.3792	1.0744	1.0365
No log	16.0741	434	1.0386	0.4499	1.0386	1.0191
No log	16.1481	436	0.9665	0.3540	0.9665	0.9831
No log	16.2222	438	0.9433	0.4048	0.9433	0.9712
No log	16.2963	440	0.9452	0.3496	0.9452	0.9722
No log	16.3704	442	0.9507	0.3781	0.9507	0.9750
No log	16.4444	444	1.0326	0.3809	1.0326	1.0162
No log	16.5185	446	1.0773	0.3671	1.0773	1.0380
No log	16.5926	448	1.0421	0.3807	1.0421	1.0208
No log	16.6667	450	1.0062	0.3966	1.0062	1.0031
No log	16.7407	452	1.0567	0.3602	1.0567	1.0279
No log	16.8148	454	1.1003	0.2857	1.1003	1.0489
No log	16.8889	456	1.0792	0.2932	1.0792	1.0388
No log	16.9630	458	1.0708	0.2942	1.0708	1.0348
No log	17.0370	460	1.1177	0.2510	1.1177	1.0572
No log	17.1111	462	1.1900	0.3649	1.1900	1.0909
No log	17.1852	464	1.1471	0.3644	1.1471	1.0710
No log	17.2593	466	1.0673	0.3346	1.0673	1.0331
No log	17.3333	468	1.0479	0.3767	1.0479	1.0237
No log	17.4074	470	1.0547	0.3596	1.0547	1.0270
No log	17.4815	472	1.0705	0.375	1.0705	1.0347
No log	17.5556	474	1.0881	0.3375	1.0881	1.0431
No log	17.6296	476	1.0887	0.3770	1.0887	1.0434
No log	17.7037	478	1.0710	0.3500	1.0710	1.0349
No log	17.7778	480	1.0411	0.3474	1.0411	1.0203
No log	17.8519	482	1.0267	0.3493	1.0267	1.0133
No log	17.9259	484	1.0146	0.3983	1.0146	1.0073
No log	18.0	486	1.0144	0.3839	1.0144	1.0072
No log	18.0741	488	1.0494	0.2830	1.0494	1.0244
No log	18.1481	490	1.0718	0.3289	1.0718	1.0353
No log	18.2222	492	1.0742	0.3572	1.0742	1.0364
No log	18.2963	494	1.0460	0.3198	1.0460	1.0227
No log	18.3704	496	1.0331	0.3032	1.0331	1.0164
No log	18.4444	498	1.0208	0.3820	1.0208	1.0104
0.2674	18.5185	500	1.0274	0.3820	1.0274	1.0136
0.2674	18.5926	502	1.0549	0.3164	1.0549	1.0271
0.2674	18.6667	504	1.1134	0.2991	1.1134	1.0552
0.2674	18.7407	506	1.1445	0.3217	1.1445	1.0698
0.2674	18.8148	508	1.1184	0.2878	1.1184	1.0576
0.2674	18.8889	510	1.1006	0.2721	1.1006	1.0491

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1