ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k7_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0465
• Qwk: 0.2432
• Mse: 1.0465
• Rmse: 1.0230

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	4.3101	0.0132	4.3101	2.0761
No log	0.1212	4	2.5607	0.0180	2.5607	1.6002
No log	0.1818	6	1.9230	0.0727	1.9230	1.3867
No log	0.2424	8	1.2852	0.2304	1.2852	1.1337
No log	0.3030	10	1.0934	0.0823	1.0934	1.0456
No log	0.3636	12	1.0448	0.1589	1.0448	1.0221
No log	0.4242	14	1.1488	0.2850	1.1488	1.0718
No log	0.4848	16	1.9462	0.1282	1.9462	1.3951
No log	0.5455	18	2.0048	0.1046	2.0048	1.4159
No log	0.6061	20	1.4218	0.1685	1.4218	1.1924
No log	0.6667	22	1.2452	0.2870	1.2452	1.1159
No log	0.7273	24	1.2886	0.2750	1.2886	1.1351
No log	0.7879	26	1.2931	0.2771	1.2931	1.1371
No log	0.8485	28	1.2118	0.2752	1.2118	1.1008
No log	0.9091	30	1.3966	0.2332	1.3966	1.1818
No log	0.9697	32	1.4874	0.2299	1.4874	1.2196
No log	1.0303	34	1.4879	0.2541	1.4879	1.2198
No log	1.0909	36	1.1616	0.3493	1.1616	1.0778
No log	1.1515	38	1.0426	0.2904	1.0426	1.0211
No log	1.2121	40	1.0394	0.2712	1.0394	1.0195
No log	1.2727	42	1.2626	0.3243	1.2626	1.1236
No log	1.3333	44	1.6355	0.2645	1.6355	1.2789
No log	1.3939	46	1.6258	0.2739	1.6258	1.2751
No log	1.4545	48	1.3274	0.2991	1.3274	1.1521
No log	1.5152	50	1.0414	0.3435	1.0414	1.0205
No log	1.5758	52	1.0516	0.3435	1.0516	1.0255
No log	1.6364	54	1.2128	0.3508	1.2128	1.1013
No log	1.6970	56	1.1166	0.3564	1.1166	1.0567
No log	1.7576	58	0.9349	0.2991	0.9349	0.9669
No log	1.8182	60	0.8880	0.3896	0.8880	0.9423
No log	1.8788	62	0.8906	0.4345	0.8906	0.9437
No log	1.9394	64	0.9624	0.4019	0.9624	0.9810
No log	2.0	66	1.3928	0.3228	1.3928	1.1802
No log	2.0606	68	1.4132	0.2672	1.4132	1.1888
No log	2.1212	70	1.0112	0.4318	1.0112	1.0056
No log	2.1818	72	0.8969	0.3335	0.8969	0.9471
No log	2.2424	74	0.9639	0.2424	0.9639	0.9818
No log	2.3030	76	1.0445	0.2975	1.0445	1.0220
No log	2.3636	78	1.1886	0.3519	1.1886	1.0902
No log	2.4242	80	1.2640	0.2689	1.2640	1.1243
No log	2.4848	82	1.0717	0.3607	1.0717	1.0353
No log	2.5455	84	0.9450	0.3671	0.9450	0.9721
No log	2.6061	86	0.9938	0.3237	0.9938	0.9969
No log	2.6667	88	1.0371	0.3474	1.0371	1.0184
No log	2.7273	90	1.0814	0.3513	1.0814	1.0399
No log	2.7879	92	1.1807	0.2502	1.1807	1.0866
No log	2.8485	94	1.3936	0.1158	1.3936	1.1805
No log	2.9091	96	1.2527	0.1612	1.2527	1.1192
No log	2.9697	98	1.0343	0.4056	1.0343	1.0170
No log	3.0303	100	1.0236	0.3483	1.0236	1.0117
No log	3.0909	102	1.0052	0.3483	1.0052	1.0026
No log	3.1515	104	1.0244	0.3483	1.0244	1.0122
No log	3.2121	106	1.0609	0.3786	1.0609	1.0300
No log	3.2727	108	1.0740	0.3806	1.0740	1.0363
No log	3.3333	110	1.1121	0.3618	1.1121	1.0546
No log	3.3939	112	1.1195	0.2714	1.1195	1.0581
No log	3.4545	114	1.2274	0.2119	1.2274	1.1079
No log	3.5152	116	1.0793	0.2797	1.0793	1.0389
No log	3.5758	118	0.9577	0.4164	0.9577	0.9786
No log	3.6364	120	1.0217	0.3773	1.0217	1.0108
No log	3.6970	122	0.9664	0.4148	0.9664	0.9831
No log	3.7576	124	0.9746	0.4154	0.9746	0.9872
No log	3.8182	126	1.2513	0.2711	1.2513	1.1186
No log	3.8788	128	1.2354	0.2852	1.2354	1.1115
No log	3.9394	130	1.0062	0.3544	1.0062	1.0031
No log	4.0	132	0.9428	0.3547	0.9428	0.9710
No log	4.0606	134	1.0709	0.3210	1.0709	1.0349
No log	4.1212	136	1.1146	0.3738	1.1146	1.0557
No log	4.1818	138	0.9928	0.3771	0.9928	0.9964
No log	4.2424	140	1.0324	0.3522	1.0324	1.0161
No log	4.3030	142	1.2419	0.2524	1.2419	1.1144
No log	4.3636	144	1.1693	0.3135	1.1693	1.0813
No log	4.4242	146	1.0071	0.3559	1.0071	1.0035
No log	4.4848	148	0.9435	0.3502	0.9435	0.9713
No log	4.5455	150	0.9327	0.3502	0.9327	0.9658
No log	4.6061	152	0.9629	0.3528	0.9629	0.9813
No log	4.6667	154	0.9582	0.3502	0.9582	0.9789
No log	4.7273	156	0.9837	0.3802	0.9837	0.9918
No log	4.7879	158	1.0424	0.3132	1.0424	1.0210
No log	4.8485	160	1.0268	0.3590	1.0268	1.0133
No log	4.9091	162	0.9691	0.3932	0.9691	0.9844
No log	4.9697	164	0.9441	0.3030	0.9441	0.9716
No log	5.0303	166	0.9463	0.2718	0.9463	0.9728
No log	5.0909	168	0.9942	0.3038	0.9942	0.9971
No log	5.1515	170	1.0548	0.3117	1.0548	1.0270
No log	5.2121	172	1.0070	0.3323	1.0070	1.0035
No log	5.2727	174	1.0141	0.3704	1.0141	1.0070
No log	5.3333	176	1.1772	0.1929	1.1772	1.0850
No log	5.3939	178	1.4806	0.2622	1.4806	1.2168
No log	5.4545	180	1.2995	0.2691	1.2995	1.1399
No log	5.5152	182	0.9570	0.3873	0.9570	0.9783
No log	5.5758	184	0.9740	0.4480	0.9740	0.9869
No log	5.6364	186	1.0058	0.4570	1.0058	1.0029
No log	5.6970	188	0.9260	0.3842	0.9260	0.9623
No log	5.7576	190	0.8868	0.3306	0.8868	0.9417
No log	5.8182	192	0.8943	0.2473	0.8943	0.9457
No log	5.8788	194	0.9090	0.2744	0.9090	0.9534
No log	5.9394	196	0.9618	0.3973	0.9618	0.9807
No log	6.0	198	1.0349	0.4234	1.0349	1.0173
No log	6.0606	200	1.0322	0.3973	1.0322	1.0160
No log	6.1212	202	1.0201	0.3350	1.0201	1.0100
No log	6.1818	204	0.9808	0.2791	0.9808	0.9904
No log	6.2424	206	0.9869	0.2480	0.9869	0.9934
No log	6.3030	208	1.0327	0.2117	1.0327	1.0162
No log	6.3636	210	1.0447	0.2263	1.0447	1.0221
No log	6.4242	212	1.0883	0.3119	1.0883	1.0432
No log	6.4848	214	1.1445	0.3721	1.1445	1.0698
No log	6.5455	216	1.1025	0.3546	1.1025	1.0500
No log	6.6061	218	0.9734	0.4089	0.9734	0.9866
No log	6.6667	220	0.9643	0.2669	0.9643	0.9820
No log	6.7273	222	0.9966	0.2402	0.9966	0.9983
No log	6.7879	224	0.9548	0.2835	0.9548	0.9771
No log	6.8485	226	0.9498	0.3861	0.9498	0.9746
No log	6.9091	228	0.9817	0.4586	0.9817	0.9908
No log	6.9697	230	0.9496	0.3502	0.9496	0.9745
No log	7.0303	232	0.9525	0.3652	0.9525	0.9760
No log	7.0909	234	0.9704	0.3276	0.9704	0.9851
No log	7.1515	236	0.9827	0.2579	0.9827	0.9913
No log	7.2121	238	1.0109	0.3276	1.0109	1.0054
No log	7.2727	240	1.0351	0.3089	1.0351	1.0174
No log	7.3333	242	1.0771	0.2742	1.0771	1.0378
No log	7.3939	244	1.1296	0.3052	1.1296	1.0628
No log	7.4545	246	1.1371	0.2784	1.1371	1.0663
No log	7.5152	248	1.1273	0.2871	1.1273	1.0617
No log	7.5758	250	1.1246	0.2718	1.1246	1.0605
No log	7.6364	252	1.0999	0.3403	1.0999	1.0488
No log	7.6970	254	1.0925	0.4710	1.0925	1.0452
No log	7.7576	256	1.0426	0.4343	1.0426	1.0211
No log	7.8182	258	0.9787	0.4089	0.9787	0.9893
No log	7.8788	260	0.9454	0.3070	0.9454	0.9723
No log	7.9394	262	0.9344	0.3070	0.9344	0.9666
No log	8.0	264	0.9408	0.4106	0.9408	0.9699
No log	8.0606	266	0.9564	0.4231	0.9564	0.9779
No log	8.1212	268	0.9905	0.4231	0.9905	0.9953
No log	8.1818	270	1.0322	0.4241	1.0322	1.0160
No log	8.2424	272	1.0148	0.4231	1.0148	1.0073
No log	8.3030	274	1.0165	0.4480	1.0165	1.0082
No log	8.3636	276	0.9400	0.4273	0.9400	0.9696
No log	8.4242	278	0.9215	0.4042	0.9215	0.9599
No log	8.4848	280	0.9456	0.3505	0.9456	0.9724
No log	8.5455	282	0.9516	0.4042	0.9516	0.9755
No log	8.6061	284	1.0236	0.3879	1.0236	1.0117
No log	8.6667	286	1.0735	0.4098	1.0735	1.0361
No log	8.7273	288	1.0592	0.3844	1.0592	1.0292
No log	8.7879	290	1.0271	0.2972	1.0271	1.0134
No log	8.8485	292	1.0227	0.2624	1.0227	1.0113
No log	8.9091	294	1.0582	0.2929	1.0582	1.0287
No log	8.9697	296	1.0985	0.3371	1.0985	1.0481
No log	9.0303	298	1.0558	0.3517	1.0558	1.0275
No log	9.0909	300	1.0127	0.3399	1.0127	1.0063
No log	9.1515	302	1.0074	0.3269	1.0074	1.0037
No log	9.2121	304	0.9840	0.3577	0.9840	0.9919
No log	9.2727	306	1.0119	0.3672	1.0119	1.0059
No log	9.3333	308	1.0150	0.3806	1.0150	1.0075
No log	9.3939	310	0.9692	0.3841	0.9692	0.9845
No log	9.4545	312	0.9729	0.3861	0.9729	0.9864
No log	9.5152	314	1.0048	0.3528	1.0048	1.0024
No log	9.5758	316	1.0677	0.3535	1.0677	1.0333
No log	9.6364	318	1.1019	0.3790	1.1019	1.0497
No log	9.6970	320	1.1231	0.4098	1.1231	1.0597
No log	9.7576	322	1.1743	0.3937	1.1743	1.0836
No log	9.8182	324	1.1935	0.3571	1.1935	1.0925
No log	9.8788	326	1.2046	0.3224	1.2046	1.0975
No log	9.9394	328	1.1046	0.3145	1.1046	1.0510
No log	10.0	330	1.0690	0.2384	1.0690	1.0339
No log	10.0606	332	1.0646	0.2528	1.0646	1.0318
No log	10.1212	334	1.0587	0.2424	1.0587	1.0289
No log	10.1818	336	1.1141	0.3714	1.1141	1.0555
No log	10.2424	338	1.0786	0.3551	1.0786	1.0386
No log	10.3030	340	1.0210	0.2572	1.0210	1.0105
No log	10.3636	342	1.0304	0.2670	1.0304	1.0151
No log	10.4242	344	1.0191	0.2670	1.0191	1.0095
No log	10.4848	346	1.0417	0.3182	1.0417	1.0206
No log	10.5455	348	1.1042	0.3808	1.1042	1.0508
No log	10.6061	350	1.1501	0.3681	1.1501	1.0724
No log	10.6667	352	1.0752	0.3434	1.0752	1.0369
No log	10.7273	354	0.9890	0.3844	0.9890	0.9945
No log	10.7879	356	0.9584	0.3596	0.9584	0.9790
No log	10.8485	358	0.9478	0.3091	0.9478	0.9735
No log	10.9091	360	0.9503	0.3398	0.9503	0.9748
No log	10.9697	362	0.9729	0.3399	0.9729	0.9863
No log	11.0303	364	1.0186	0.3662	1.0186	1.0093
No log	11.0909	366	1.1095	0.3845	1.1095	1.0533
No log	11.1515	368	1.1378	0.3677	1.1378	1.0667
No log	11.2121	370	1.1138	0.3808	1.1138	1.0554
No log	11.2727	372	1.0986	0.3808	1.0986	1.0481
No log	11.3333	374	1.0367	0.3691	1.0367	1.0182
No log	11.3939	376	0.9791	0.3483	0.9791	0.9895
No log	11.4545	378	0.9888	0.4006	0.9888	0.9944
No log	11.5152	380	1.0343	0.4334	1.0343	1.0170
No log	11.5758	382	1.0507	0.4334	1.0507	1.0250
No log	11.6364	384	1.0198	0.3844	1.0198	1.0099
No log	11.6970	386	1.0170	0.3956	1.0170	1.0085
No log	11.7576	388	1.0360	0.3558	1.0360	1.0179
No log	11.8182	390	1.0665	0.3584	1.0665	1.0327
No log	11.8788	392	1.0776	0.3584	1.0776	1.0381
No log	11.9394	394	1.0537	0.3668	1.0537	1.0265
No log	12.0	396	1.0402	0.3318	1.0402	1.0199
No log	12.0606	398	1.0258	0.3540	1.0258	1.0128
No log	12.1212	400	1.0371	0.3427	1.0371	1.0184
No log	12.1818	402	1.0595	0.3269	1.0595	1.0293
No log	12.2424	404	1.0617	0.3535	1.0617	1.0304
No log	12.3030	406	1.0250	0.2842	1.0250	1.0124
No log	12.3636	408	1.0091	0.2276	1.0091	1.0045
No log	12.4242	410	1.0140	0.2963	1.0140	1.0070
No log	12.4848	412	1.0192	0.3005	1.0192	1.0096
No log	12.5455	414	1.0888	0.3956	1.0888	1.0434
No log	12.6061	416	1.1761	0.3391	1.1761	1.0845
No log	12.6667	418	1.1343	0.3829	1.1343	1.0651
No log	12.7273	420	1.0199	0.3298	1.0198	1.0099
No log	12.7879	422	0.9764	0.2718	0.9764	0.9881
No log	12.8485	424	0.9871	0.3074	0.9871	0.9935
No log	12.9091	426	0.9882	0.2596	0.9882	0.9941
No log	12.9697	428	0.9930	0.2842	0.9930	0.9965
No log	13.0303	430	1.0777	0.3714	1.0777	1.0381
No log	13.0909	432	1.1407	0.3415	1.1407	1.0680
No log	13.1515	434	1.1359	0.3492	1.1359	1.0658
No log	13.2121	436	1.0995	0.3140	1.0995	1.0485
No log	13.2727	438	1.0602	0.2865	1.0602	1.0297
No log	13.3333	440	1.0308	0.2698	1.0308	1.0153
No log	13.3939	442	1.0417	0.3577	1.0417	1.0206
No log	13.4545	444	1.0419	0.3434	1.0419	1.0207
No log	13.5152	446	1.0315	0.3822	1.0315	1.0156
No log	13.5758	448	1.0273	0.3250	1.0273	1.0135
No log	13.6364	450	1.0168	0.3188	1.0168	1.0084
No log	13.6970	452	1.0050	0.2790	1.0050	1.0025
No log	13.7576	454	1.0027	0.2551	1.0027	1.0013
No log	13.8182	456	1.0009	0.2954	1.0009	1.0005
No log	13.8788	458	0.9877	0.2551	0.9877	0.9938
No log	13.9394	460	0.9823	0.2551	0.9823	0.9911
No log	14.0	462	0.9769	0.2954	0.9769	0.9884
No log	14.0606	464	0.9855	0.3609	0.9855	0.9927
No log	14.1212	466	1.0156	0.3182	1.0156	1.0078
No log	14.1818	468	1.0110	0.3182	1.0110	1.0055
No log	14.2424	470	0.9838	0.3378	0.9838	0.9918
No log	14.3030	472	0.9991	0.3076	0.9991	0.9996
No log	14.3636	474	1.0273	0.3237	1.0273	1.0136
No log	14.4242	476	1.0466	0.3519	1.0466	1.0231
No log	14.4848	478	1.0448	0.2982	1.0448	1.0222
No log	14.5455	480	1.0503	0.2764	1.0503	1.0248
No log	14.6061	482	1.0616	0.2951	1.0616	1.0304
No log	14.6667	484	1.0892	0.3243	1.0892	1.0437
No log	14.7273	486	1.1279	0.2886	1.1279	1.0620
No log	14.7879	488	1.0931	0.3826	1.0931	1.0455
No log	14.8485	490	1.0339	0.3369	1.0339	1.0168
No log	14.9091	492	0.9825	0.3347	0.9825	0.9912
No log	14.9697	494	0.9792	0.2857	0.9792	0.9896
No log	15.0303	496	0.9694	0.3154	0.9694	0.9846
No log	15.0909	498	0.9824	0.3493	0.9824	0.9912
0.309	15.1515	500	1.0765	0.3361	1.0765	1.0376
0.309	15.2121	502	1.1514	0.3778	1.1514	1.0730
0.309	15.2727	504	1.1061	0.3938	1.1061	1.0517
0.309	15.3333	506	1.0060	0.3264	1.0060	1.0030
0.309	15.3939	508	0.9656	0.2742	0.9656	0.9827
0.309	15.4545	510	0.9705	0.2497	0.9705	0.9852
0.309	15.5152	512	0.9768	0.2888	0.9768	0.9884
0.309	15.5758	514	1.0006	0.3652	1.0006	1.0003
0.309	15.6364	516	1.0325	0.3389	1.0325	1.0161
0.309	15.6970	518	1.0442	0.3027	1.0442	1.0219
0.309	15.7576	520	1.0339	0.2553	1.0339	1.0168
0.309	15.8182	522	1.0203	0.2005	1.0203	1.0101
0.309	15.8788	524	1.0210	0.2005	1.0210	1.0104
0.309	15.9394	526	1.0465	0.2432	1.0465	1.0230

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1