ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0375
• Qwk: 0.3184
• Mse: 1.0375
• Rmse: 1.0186

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	4.6028	-0.0132	4.6028	2.1454
No log	0.1818	4	2.8463	0.0074	2.8463	1.6871
No log	0.2727	6	1.9694	-0.0303	1.9694	1.4034
No log	0.3636	8	1.7207	0.0385	1.7207	1.3117
No log	0.4545	10	1.4709	0.0992	1.4709	1.2128
No log	0.5455	12	1.3754	0.0473	1.3754	1.1728
No log	0.6364	14	1.5006	0.0169	1.5006	1.2250
No log	0.7273	16	1.7554	0.0	1.7554	1.3249
No log	0.8182	18	1.8932	0.0145	1.8932	1.3759
No log	0.9091	20	1.7345	0.0	1.7345	1.3170
No log	1.0	22	1.4215	0.0189	1.4215	1.1923
No log	1.0909	24	1.3978	0.0512	1.3978	1.1823
No log	1.1818	26	1.7590	0.1333	1.7590	1.3263
No log	1.2727	28	1.7482	0.1080	1.7482	1.3222
No log	1.3636	30	1.6583	0.0538	1.6583	1.2877
No log	1.4545	32	1.3921	0.0575	1.3921	1.1799
No log	1.5455	34	1.2502	0.1438	1.2502	1.1181
No log	1.6364	36	1.2147	0.2298	1.2147	1.1021
No log	1.7273	38	1.2728	0.2203	1.2728	1.1282
No log	1.8182	40	1.4813	-0.0132	1.4813	1.2171
No log	1.9091	42	1.5586	0.0625	1.5586	1.2485
No log	2.0	44	1.6877	0.1345	1.6877	1.2991
No log	2.0909	46	1.6721	0.1026	1.6721	1.2931
No log	2.1818	48	1.6676	0.1466	1.6676	1.2914
No log	2.2727	50	1.5024	0.0930	1.5024	1.2257
No log	2.3636	52	1.4279	0.0999	1.4279	1.1950
No log	2.4545	54	1.3102	0.1972	1.3102	1.1447
No log	2.5455	56	1.2539	0.2202	1.2539	1.1198
No log	2.6364	58	1.1920	0.1951	1.1920	1.0918
No log	2.7273	60	1.1574	0.2081	1.1574	1.0758
No log	2.8182	62	1.1639	0.2180	1.1639	1.0788
No log	2.9091	64	1.3338	0.1690	1.3338	1.1549
No log	3.0	66	1.3789	0.1790	1.3789	1.1743
No log	3.0909	68	1.3642	0.2060	1.3642	1.1680
No log	3.1818	70	1.3118	0.2143	1.3118	1.1453
No log	3.2727	72	1.4538	0.3098	1.4538	1.2057
No log	3.3636	74	1.4187	0.2582	1.4187	1.1911
No log	3.4545	76	1.4605	0.2613	1.4605	1.2085
No log	3.5455	78	1.3778	0.2983	1.3778	1.1738
No log	3.6364	80	1.3754	0.1822	1.3754	1.1728
No log	3.7273	82	1.2756	0.2807	1.2756	1.1294
No log	3.8182	84	1.1701	0.2815	1.1701	1.0817
No log	3.9091	86	1.1129	0.3283	1.1129	1.0549
No log	4.0	88	1.0778	0.3283	1.0778	1.0382
No log	4.0909	90	1.0725	0.3283	1.0725	1.0356
No log	4.1818	92	1.2264	0.2825	1.2264	1.1074
No log	4.2727	94	1.4377	0.2613	1.4377	1.1990
No log	4.3636	96	1.3299	0.2716	1.3299	1.1532
No log	4.4545	98	1.1059	0.2380	1.1059	1.0516
No log	4.5455	100	1.0834	0.2532	1.0834	1.0409
No log	4.6364	102	1.0741	0.2167	1.0741	1.0364
No log	4.7273	104	1.0615	0.2836	1.0615	1.0303
No log	4.8182	106	1.2967	0.2481	1.2967	1.1387
No log	4.9091	108	1.5665	0.2504	1.5665	1.2516
No log	5.0	110	1.4258	0.2704	1.4258	1.1941
No log	5.0909	112	1.1055	0.3280	1.1055	1.0514
No log	5.1818	114	0.9809	0.3921	0.9809	0.9904
No log	5.2727	116	0.9944	0.3510	0.9944	0.9972
No log	5.3636	118	0.9959	0.3513	0.9959	0.9979
No log	5.4545	120	1.0838	0.2961	1.0838	1.0410
No log	5.5455	122	1.2265	0.3537	1.2265	1.1075
No log	5.6364	124	1.1566	0.3323	1.1566	1.0755
No log	5.7273	126	1.0662	0.3397	1.0662	1.0325
No log	5.8182	128	1.0789	0.3280	1.0789	1.0387
No log	5.9091	130	1.1971	0.3935	1.1971	1.0941
No log	6.0	132	1.2678	0.3392	1.2678	1.1260
No log	6.0909	134	1.1362	0.3136	1.1362	1.0659
No log	6.1818	136	1.0614	0.4161	1.0614	1.0302
No log	6.2727	138	1.0211	0.4091	1.0211	1.0105
No log	6.3636	140	1.0373	0.2926	1.0373	1.0185
No log	6.4545	142	1.3470	0.3694	1.3470	1.1606
No log	6.5455	144	1.5016	0.3559	1.5016	1.2254
No log	6.6364	146	1.2756	0.3870	1.2756	1.1294
No log	6.7273	148	1.0138	0.3126	1.0138	1.0069
No log	6.8182	150	0.9948	0.3648	0.9948	0.9974
No log	6.9091	152	1.0677	0.3280	1.0677	1.0333
No log	7.0	154	1.0435	0.3255	1.0435	1.0215
No log	7.0909	156	1.0214	0.3678	1.0214	1.0107
No log	7.1818	158	1.0103	0.4603	1.0103	1.0051
No log	7.2727	160	1.0286	0.3551	1.0286	1.0142
No log	7.3636	162	1.1444	0.2900	1.1444	1.0697
No log	7.4545	164	1.3432	0.3694	1.3432	1.1589
No log	7.5455	166	1.2126	0.3590	1.2126	1.1012
No log	7.6364	168	1.0235	0.4196	1.0235	1.0117
No log	7.7273	170	1.0152	0.4651	1.0152	1.0076
No log	7.8182	172	1.0143	0.4161	1.0143	1.0071
No log	7.9091	174	1.0429	0.3551	1.0429	1.0212
No log	8.0	176	1.0585	0.2561	1.0585	1.0288
No log	8.0909	178	1.0057	0.3728	1.0057	1.0029
No log	8.1818	180	1.0128	0.4035	1.0128	1.0064
No log	8.2727	182	1.0425	0.3774	1.0425	1.0210
No log	8.3636	184	1.1541	0.3450	1.1541	1.0743
No log	8.4545	186	1.2516	0.3998	1.2516	1.1187
No log	8.5455	188	1.1411	0.3210	1.1411	1.0682
No log	8.6364	190	1.1368	0.3361	1.1368	1.0662
No log	8.7273	192	1.0795	0.3493	1.0795	1.0390
No log	8.8182	194	1.0568	0.3977	1.0568	1.0280
No log	8.9091	196	1.0539	0.3836	1.0539	1.0266
No log	9.0	198	1.0448	0.3788	1.0448	1.0221
No log	9.0909	200	1.0678	0.2941	1.0678	1.0333
No log	9.1818	202	1.1713	0.2283	1.1713	1.0823
No log	9.2727	204	1.3795	0.2962	1.3795	1.1745
No log	9.3636	206	1.2981	0.3044	1.2981	1.1394
No log	9.4545	208	1.0456	0.2876	1.0456	1.0225
No log	9.5455	210	0.9569	0.3925	0.9569	0.9782
No log	9.6364	212	0.9394	0.3925	0.9394	0.9692
No log	9.7273	214	0.9595	0.4140	0.9595	0.9796
No log	9.8182	216	0.9620	0.3956	0.9620	0.9808
No log	9.9091	218	0.9392	0.4738	0.9392	0.9691
No log	10.0	220	0.9564	0.4865	0.9564	0.9780
No log	10.0909	222	0.9715	0.3609	0.9715	0.9856
No log	10.1818	224	0.9668	0.3483	0.9668	0.9833
No log	10.2727	226	1.0206	0.3668	1.0206	1.0102
No log	10.3636	228	1.1053	0.3705	1.1053	1.0513
No log	10.4545	230	1.0517	0.3439	1.0517	1.0255
No log	10.5455	232	0.9875	0.3821	0.9875	0.9937
No log	10.6364	234	0.9776	0.4685	0.9776	0.9887
No log	10.7273	236	0.9909	0.4644	0.9909	0.9954
No log	10.8182	238	0.9732	0.4601	0.9732	0.9865
No log	10.9091	240	1.3310	0.2886	1.3310	1.1537
No log	11.0	242	1.4994	0.1766	1.4994	1.2245
No log	11.0909	244	1.2420	0.3005	1.2420	1.1145
No log	11.1818	246	1.1509	0.2890	1.1509	1.0728
No log	11.2727	248	1.0188	0.3756	1.0188	1.0093
No log	11.3636	250	0.9954	0.3584	0.9954	0.9977
No log	11.4545	252	0.9984	0.3584	0.9984	0.9992
No log	11.5455	254	1.0134	0.3390	1.0134	1.0067
No log	11.6364	256	1.0563	0.3902	1.0563	1.0278
No log	11.7273	258	1.0402	0.3902	1.0402	1.0199
No log	11.8182	260	1.0085	0.3965	1.0085	1.0042
No log	11.9091	262	0.9861	0.3415	0.9861	0.9930
No log	12.0	264	0.9894	0.3829	0.9894	0.9947
No log	12.0909	266	0.9895	0.3965	0.9895	0.9947
No log	12.1818	268	0.9839	0.3965	0.9839	0.9919
No log	12.2727	270	0.9958	0.4004	0.9958	0.9979
No log	12.3636	272	0.9934	0.3723	0.9934	0.9967
No log	12.4545	274	0.9829	0.3584	0.9829	0.9914
No log	12.5455	276	1.0260	0.4175	1.0260	1.0129
No log	12.6364	278	1.0539	0.4604	1.0539	1.0266
No log	12.7273	280	1.0315	0.4175	1.0315	1.0156
No log	12.8182	282	1.0430	0.4444	1.0430	1.0213
No log	12.9091	284	1.0910	0.3705	1.0910	1.0445
No log	13.0	286	1.2046	0.3380	1.2046	1.0976
No log	13.0909	288	1.2019	0.3430	1.2019	1.0963
No log	13.1818	290	1.0989	0.2939	1.0989	1.0483
No log	13.2727	292	1.0292	0.3497	1.0292	1.0145
No log	13.3636	294	1.0180	0.3190	1.0180	1.0090
No log	13.4545	296	1.0541	0.3728	1.0541	1.0267
No log	13.5455	298	1.1292	0.3881	1.1292	1.0627
No log	13.6364	300	1.0816	0.3930	1.0816	1.0400
No log	13.7273	302	1.0123	0.3113	1.0123	1.0061
No log	13.8182	304	1.0233	0.3327	1.0233	1.0116
No log	13.9091	306	1.0234	0.2991	1.0234	1.0117
No log	14.0	308	1.0724	0.3447	1.0724	1.0356
No log	14.0909	310	1.1216	0.3590	1.1216	1.0590
No log	14.1818	312	1.1012	0.3462	1.1012	1.0494
No log	14.2727	314	1.0567	0.3529	1.0567	1.0280
No log	14.3636	316	1.0393	0.3639	1.0393	1.0195
No log	14.4545	318	1.0358	0.3210	1.0358	1.0178
No log	14.5455	320	1.0551	0.3781	1.0551	1.0272
No log	14.6364	322	1.0950	0.4030	1.0950	1.0464
No log	14.7273	324	1.0934	0.3865	1.0934	1.0457
No log	14.8182	326	1.0838	0.3820	1.0838	1.0410
No log	14.9091	328	1.0693	0.3250	1.0693	1.0341
No log	15.0	330	1.0454	0.2850	1.0454	1.0224
No log	15.0909	332	1.0494	0.2707	1.0494	1.0244
No log	15.1818	334	1.0382	0.3511	1.0382	1.0189
No log	15.2727	336	1.0390	0.3542	1.0390	1.0193
No log	15.3636	338	1.0470	0.3719	1.0470	1.0232
No log	15.4545	340	1.0345	0.3584	1.0345	1.0171
No log	15.5455	342	1.0097	0.3542	1.0097	1.0048
No log	15.6364	344	1.0039	0.3448	1.0039	1.0019
No log	15.7273	346	1.0310	0.4080	1.0310	1.0154
No log	15.8182	348	1.0417	0.4119	1.0417	1.0206
No log	15.9091	350	1.2135	0.3959	1.2135	1.1016
No log	16.0	352	1.2680	0.3500	1.2680	1.1261
No log	16.0909	354	1.0945	0.3805	1.0945	1.0462
No log	16.1818	356	0.9805	0.3275	0.9805	0.9902
No log	16.2727	358	0.9859	0.3282	0.9859	0.9929
No log	16.3636	360	0.9804	0.3468	0.9804	0.9902
No log	16.4545	362	1.0067	0.3250	1.0067	1.0033
No log	16.5455	364	1.0526	0.3765	1.0526	1.0260
No log	16.6364	366	1.0692	0.3668	1.0692	1.0340
No log	16.7273	368	1.0456	0.3765	1.0456	1.0225
No log	16.8182	370	1.1040	0.3204	1.1040	1.0507
No log	16.9091	372	1.1257	0.3009	1.1257	1.0610
No log	17.0	374	1.0305	0.3373	1.0305	1.0151
No log	17.0909	376	0.9963	0.3399	0.9963	0.9981
No log	17.1818	378	0.9920	0.3497	0.9920	0.9960
No log	17.2727	380	1.0408	0.3082	1.0408	1.0202
No log	17.3636	382	1.1440	0.3828	1.1440	1.0696
No log	17.4545	384	1.1643	0.4171	1.1643	1.0790
No log	17.5455	386	1.0584	0.3476	1.0584	1.0288
No log	17.6364	388	1.0041	0.3879	1.0041	1.0021
No log	17.7273	390	1.0125	0.3134	1.0125	1.0062
No log	17.8182	392	1.0262	0.2871	1.0262	1.0130
No log	17.9091	394	1.0651	0.2864	1.0651	1.0320
No log	18.0	396	1.1976	0.3030	1.1976	1.0944
No log	18.0909	398	1.2936	0.3421	1.2936	1.1374
No log	18.1818	400	1.2295	0.3262	1.2295	1.1088
No log	18.2727	402	1.1147	0.2700	1.1147	1.0558
No log	18.3636	404	1.0380	0.2991	1.0380	1.0188
No log	18.4545	406	1.0346	0.3205	1.0346	1.0172
No log	18.5455	408	1.0777	0.3036	1.0777	1.0381
No log	18.6364	410	1.1802	0.2984	1.1802	1.0864
No log	18.7273	412	1.1802	0.2672	1.1802	1.0864
No log	18.8182	414	1.1455	0.2748	1.1455	1.0703
No log	18.9091	416	1.0744	0.3059	1.0744	1.0365
No log	19.0	418	1.0602	0.3250	1.0602	1.0297
No log	19.0909	420	1.0645	0.3276	1.0645	1.0317
No log	19.1818	422	1.0761	0.3082	1.0761	1.0374
No log	19.2727	424	1.0561	0.3082	1.0561	1.0277
No log	19.3636	426	1.0399	0.3373	1.0399	1.0198
No log	19.4545	428	1.0416	0.2939	1.0416	1.0206
No log	19.5455	430	1.0612	0.2961	1.0612	1.0301
No log	19.6364	432	1.0616	0.2815	1.0616	1.0303
No log	19.7273	434	1.0791	0.3287	1.0791	1.0388
No log	19.8182	436	1.0677	0.3149	1.0677	1.0333
No log	19.9091	438	1.0633	0.3149	1.0633	1.0312
No log	20.0	440	1.0828	0.3149	1.0828	1.0406
No log	20.0909	442	1.1576	0.3330	1.1576	1.0759
No log	20.1818	444	1.1643	0.2285	1.1643	1.0790
No log	20.2727	446	1.0939	0.2939	1.0939	1.0459
No log	20.3636	448	1.0842	0.2939	1.0842	1.0413
No log	20.4545	450	1.0697	0.2939	1.0697	1.0343
No log	20.5455	452	1.0530	0.2892	1.0530	1.0261
No log	20.6364	454	1.0360	0.3346	1.0360	1.0178
No log	20.7273	456	1.0450	0.2747	1.0450	1.0222
No log	20.8182	458	1.0626	0.2939	1.0626	1.0308
No log	20.9091	460	1.0513	0.2795	1.0513	1.0253
No log	21.0	462	1.0343	0.2892	1.0343	1.0170
No log	21.0909	464	1.0462	0.2795	1.0462	1.0228
No log	21.1818	466	1.0742	0.2844	1.0742	1.0364
No log	21.2727	468	1.0811	0.2917	1.0811	1.0398
No log	21.3636	470	1.1069	0.3287	1.1069	1.0521
No log	21.4545	472	1.0612	0.2917	1.0612	1.0302
No log	21.5455	474	1.0336	0.3283	1.0336	1.0166
No log	21.6364	476	1.0303	0.3483	1.0303	1.0150
No log	21.7273	478	1.0300	0.3427	1.0300	1.0149
No log	21.8182	480	1.0538	0.3373	1.0538	1.0266
No log	21.9091	482	1.0678	0.2939	1.0678	1.0333
No log	22.0	484	1.0409	0.3373	1.0409	1.0202
No log	22.0909	486	1.0178	0.3318	1.0178	1.0088
No log	22.1818	488	1.0208	0.3174	1.0208	1.0104
No log	22.2727	490	1.0104	0.3223	1.0104	1.0052
No log	22.3636	492	1.0144	0.3527	1.0144	1.0072
No log	22.4545	494	1.0241	0.3086	1.0241	1.0120
No log	22.5455	496	1.0113	0.3184	1.0113	1.0056
No log	22.6364	498	1.0010	0.3527	1.0010	1.0005
0.2905	22.7273	500	0.9939	0.3382	0.9939	0.9969
0.2905	22.8182	502	0.9956	0.3527	0.9956	0.9978
0.2905	22.9091	504	0.9987	0.3184	0.9987	0.9994
0.2905	23.0	506	1.0182	0.3184	1.0182	1.0090
0.2905	23.0909	508	1.0295	0.3184	1.0295	1.0146
0.2905	23.1818	510	1.0512	0.3276	1.0512	1.0253
0.2905	23.2727	512	1.0375	0.3184	1.0375	1.0186

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1