ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2611
• Qwk: 0.1951
• Mse: 1.2611
• Rmse: 1.1230

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0222	2	4.3775	0.0138	4.3775	2.0923
No log	0.0444	4	2.5092	0.0762	2.5092	1.5841
No log	0.0667	6	2.1374	-0.0189	2.1374	1.4620
No log	0.0889	8	1.5780	0.1084	1.5780	1.2562
No log	0.1111	10	1.1290	0.1867	1.1290	1.0625
No log	0.1333	12	1.0717	0.2204	1.0717	1.0352
No log	0.1556	14	1.3471	0.1745	1.3471	1.1606
No log	0.1778	16	1.9579	0.0672	1.9579	1.3993
No log	0.2	18	2.4251	0.0441	2.4251	1.5573
No log	0.2222	20	1.7415	0.1320	1.7415	1.3197
No log	0.2444	22	1.3532	0.1991	1.3532	1.1633
No log	0.2667	24	1.3966	0.2178	1.3966	1.1818
No log	0.2889	26	1.7368	0.1415	1.7368	1.3179
No log	0.3111	28	1.6090	0.2331	1.6090	1.2685
No log	0.3333	30	1.1412	0.3902	1.1412	1.0683
No log	0.3556	32	1.1059	0.4449	1.1059	1.0516
No log	0.3778	34	1.1107	0.5094	1.1107	1.0539
No log	0.4	36	1.2040	0.2823	1.2040	1.0972
No log	0.4222	38	1.5019	0.2609	1.5019	1.2255
No log	0.4444	40	1.3378	0.2442	1.3378	1.1566
No log	0.4667	42	1.0597	0.3332	1.0597	1.0294
No log	0.4889	44	1.1280	0.2159	1.1280	1.0621
No log	0.5111	46	1.6227	0.2724	1.6227	1.2739
No log	0.5333	48	1.7889	0.2328	1.7889	1.3375
No log	0.5556	50	1.4021	0.2902	1.4021	1.1841
No log	0.5778	52	1.1355	0.2812	1.1355	1.0656
No log	0.6	54	1.0577	0.2915	1.0577	1.0284
No log	0.6222	56	1.1779	0.2961	1.1779	1.0853
No log	0.6444	58	1.7060	0.2471	1.7060	1.3061
No log	0.6667	60	2.0614	0.1479	2.0614	1.4358
No log	0.6889	62	1.7122	0.2142	1.7122	1.3085
No log	0.7111	64	1.2060	0.1609	1.2060	1.0982
No log	0.7333	66	1.1194	0.2339	1.1194	1.0580
No log	0.7556	68	1.1231	0.2223	1.1231	1.0597
No log	0.7778	70	1.2123	0.1510	1.2123	1.1011
No log	0.8	72	1.1831	0.2574	1.1831	1.0877
No log	0.8222	74	1.1462	0.2191	1.1462	1.0706
No log	0.8444	76	1.1214	0.2579	1.1214	1.0590
No log	0.8667	78	1.2241	0.2851	1.2241	1.1064
No log	0.8889	80	1.2513	0.2690	1.2513	1.1186
No log	0.9111	82	1.1632	0.2773	1.1632	1.0785
No log	0.9333	84	1.2634	0.2653	1.2634	1.1240
No log	0.9556	86	1.2359	0.2975	1.2359	1.1117
No log	0.9778	88	1.1241	0.3441	1.1241	1.0602
No log	1.0	90	1.1158	0.3499	1.1158	1.0563
No log	1.0222	92	1.1133	0.3499	1.1133	1.0551
No log	1.0444	94	1.0734	0.4082	1.0734	1.0360
No log	1.0667	96	1.0493	0.3147	1.0493	1.0244
No log	1.0889	98	1.1527	0.2280	1.1527	1.0737
No log	1.1111	100	1.0274	0.2759	1.0274	1.0136
No log	1.1333	102	0.9700	0.3657	0.9700	0.9849
No log	1.1556	104	0.9351	0.3781	0.9351	0.9670
No log	1.1778	106	1.1736	0.3056	1.1736	1.0833
No log	1.2	108	1.4956	0.2813	1.4956	1.2230
No log	1.2222	110	1.4085	0.2782	1.4085	1.1868
No log	1.2444	112	1.2677	0.2707	1.2677	1.1259
No log	1.2667	114	1.1678	0.2665	1.1678	1.0806
No log	1.2889	116	0.9887	0.2078	0.9887	0.9943
No log	1.3111	118	0.9798	0.2835	0.9798	0.9899
No log	1.3333	120	1.0277	0.1961	1.0277	1.0138
No log	1.3556	122	1.2842	0.1166	1.2842	1.1332
No log	1.3778	124	1.7222	0.1948	1.7222	1.3123
No log	1.4	126	1.6728	0.2036	1.6728	1.2934
No log	1.4222	128	1.2563	0.1705	1.2563	1.1208
No log	1.4444	130	1.0846	0.2049	1.0846	1.0414
No log	1.4667	132	1.0716	0.2278	1.0716	1.0352
No log	1.4889	134	1.1183	0.2716	1.1183	1.0575
No log	1.5111	136	1.4303	0.1929	1.4303	1.1960
No log	1.5333	138	1.5843	0.1784	1.5843	1.2587
No log	1.5556	140	1.2901	0.2520	1.2901	1.1358
No log	1.5778	142	0.9929	0.3753	0.9929	0.9964
No log	1.6	144	0.9854	0.4379	0.9854	0.9926
No log	1.6222	146	0.9233	0.4186	0.9233	0.9609
No log	1.6444	148	0.9266	0.4149	0.9266	0.9626
No log	1.6667	150	0.9986	0.3701	0.9986	0.9993
No log	1.6889	152	0.9879	0.3699	0.9879	0.9940
No log	1.7111	154	1.0090	0.4388	1.0090	1.0045
No log	1.7333	156	1.0889	0.3792	1.0889	1.0435
No log	1.7556	158	1.1229	0.4230	1.1229	1.0597
No log	1.7778	160	1.1522	0.4064	1.1522	1.0734
No log	1.8	162	1.1722	0.4253	1.1722	1.0827
No log	1.8222	164	1.2568	0.3830	1.2568	1.1211
No log	1.8444	166	1.3464	0.1993	1.3464	1.1604
No log	1.8667	168	1.3040	0.2729	1.3040	1.1419
No log	1.8889	170	1.1434	0.3607	1.1434	1.0693
No log	1.9111	172	1.0349	0.2971	1.0349	1.0173
No log	1.9333	174	1.1882	0.2731	1.1882	1.0900
No log	1.9556	176	1.1499	0.3068	1.1499	1.0723
No log	1.9778	178	0.9769	0.2922	0.9769	0.9884
No log	2.0	180	0.9819	0.3502	0.9819	0.9909
No log	2.0222	182	1.0702	0.4020	1.0702	1.0345
No log	2.0444	184	1.0967	0.4379	1.0967	1.0472
No log	2.0667	186	1.1020	0.4370	1.1020	1.0498
No log	2.0889	188	1.2818	0.2347	1.2818	1.1322
No log	2.1111	190	1.3249	0.2482	1.3249	1.1510
No log	2.1333	192	1.1717	0.3175	1.1717	1.0825
No log	2.1556	194	1.1045	0.4110	1.1045	1.0510
No log	2.1778	196	1.0662	0.3375	1.0662	1.0326
No log	2.2	198	1.0293	0.3346	1.0293	1.0145
No log	2.2222	200	1.0163	0.3493	1.0163	1.0081
No log	2.2444	202	1.0543	0.4020	1.0543	1.0268
No log	2.2667	204	1.0352	0.3786	1.0352	1.0174
No log	2.2889	206	1.0163	0.3784	1.0163	1.0081
No log	2.3111	208	1.0576	0.3276	1.0576	1.0284
No log	2.3333	210	1.0514	0.3202	1.0514	1.0254
No log	2.3556	212	1.0268	0.375	1.0268	1.0133
No log	2.3778	214	1.0118	0.4039	1.0118	1.0059
No log	2.4	216	1.0503	0.3837	1.0503	1.0248
No log	2.4222	218	1.1038	0.3435	1.1038	1.0506
No log	2.4444	220	1.0523	0.3196	1.0523	1.0258
No log	2.4667	222	1.0426	0.3690	1.0426	1.0211
No log	2.4889	224	1.0834	0.3483	1.0834	1.0409
No log	2.5111	226	1.0954	0.3463	1.0954	1.0466
No log	2.5333	228	1.0253	0.3483	1.0253	1.0126
No log	2.5556	230	0.9364	0.2952	0.9364	0.9677
No log	2.5778	232	0.9539	0.3577	0.9539	0.9767
No log	2.6	234	0.9772	0.3602	0.9772	0.9885
No log	2.6222	236	0.9960	0.3317	0.9960	0.9980
No log	2.6444	238	1.0031	0.3284	1.0031	1.0015
No log	2.6667	240	1.0040	0.3793	1.0040	1.0020
No log	2.6889	242	0.9432	0.3464	0.9432	0.9712
No log	2.7111	244	0.9313	0.3818	0.9313	0.9650
No log	2.7333	246	0.9240	0.3642	0.9240	0.9612
No log	2.7556	248	0.9075	0.3070	0.9075	0.9526
No log	2.7778	250	0.9057	0.3263	0.9057	0.9517
No log	2.8	252	0.9760	0.4249	0.9760	0.9879
No log	2.8222	254	0.9963	0.4656	0.9963	0.9981
No log	2.8444	256	0.9049	0.3747	0.9049	0.9513
No log	2.8667	258	0.9453	0.4066	0.9453	0.9723
No log	2.8889	260	1.0146	0.4218	1.0146	1.0073
No log	2.9111	262	0.9850	0.4214	0.9850	0.9925
No log	2.9333	264	0.9585	0.3897	0.9585	0.9790
No log	2.9556	266	0.9427	0.3839	0.9427	0.9709
No log	2.9778	268	0.9547	0.4013	0.9547	0.9771
No log	3.0	270	0.9680	0.3314	0.9680	0.9839
No log	3.0222	272	0.9519	0.3665	0.9519	0.9756
No log	3.0444	274	0.9504	0.4633	0.9504	0.9749
No log	3.0667	276	0.9616	0.4037	0.9616	0.9806
No log	3.0889	278	0.9729	0.4037	0.9729	0.9864
No log	3.1111	280	0.9960	0.3914	0.9960	0.9980
No log	3.1333	282	0.9693	0.3806	0.9693	0.9845
No log	3.1556	284	0.9928	0.3306	0.9928	0.9964
No log	3.1778	286	0.9885	0.3914	0.9885	0.9942
No log	3.2	288	1.0124	0.3879	1.0124	1.0062
No log	3.2222	290	1.0839	0.3631	1.0839	1.0411
No log	3.2444	292	1.0901	0.3631	1.0901	1.0441
No log	3.2667	294	1.0284	0.2887	1.0284	1.0141
No log	3.2889	296	1.0204	0.3035	1.0204	1.0101
No log	3.3111	298	1.0204	0.3035	1.0204	1.0102
No log	3.3333	300	1.0151	0.3014	1.0151	1.0075
No log	3.3556	302	1.0607	0.3217	1.0607	1.0299
No log	3.3778	304	1.0495	0.3217	1.0495	1.0244
No log	3.4	306	1.0000	0.3583	1.0000	1.0000
No log	3.4222	308	1.0327	0.3192	1.0327	1.0162
No log	3.4444	310	1.0628	0.2844	1.0628	1.0309
No log	3.4667	312	1.0155	0.3078	1.0155	1.0077
No log	3.4889	314	1.0416	0.3308	1.0416	1.0206
No log	3.5111	316	1.0564	0.3308	1.0564	1.0278
No log	3.5333	318	1.0695	0.3338	1.0695	1.0342
No log	3.5556	320	1.0494	0.3389	1.0494	1.0244
No log	3.5778	322	1.0409	0.3365	1.0409	1.0202
No log	3.6	324	1.0386	0.3493	1.0386	1.0191
No log	3.6222	326	1.0474	0.3365	1.0474	1.0234
No log	3.6444	328	1.0671	0.3408	1.0671	1.0330
No log	3.6667	330	1.0566	0.3399	1.0566	1.0279
No log	3.6889	332	1.0452	0.3974	1.0452	1.0224
No log	3.7111	334	1.0378	0.3823	1.0378	1.0187
No log	3.7333	336	1.0231	0.4153	1.0231	1.0115
No log	3.7556	338	1.0395	0.3440	1.0395	1.0196
No log	3.7778	340	1.1080	0.2864	1.1080	1.0526
No log	3.8	342	1.0777	0.2922	1.0777	1.0381
No log	3.8222	344	1.0381	0.4042	1.0381	1.0189
No log	3.8444	346	1.1186	0.4298	1.1186	1.0576
No log	3.8667	348	1.2087	0.3249	1.2087	1.0994
No log	3.8889	350	1.1529	0.4004	1.1529	1.0737
No log	3.9111	352	1.0871	0.3879	1.0871	1.0427
No log	3.9333	354	1.0695	0.3447	1.0695	1.0341
No log	3.9556	356	1.0656	0.3447	1.0656	1.0323
No log	3.9778	358	1.0575	0.3711	1.0575	1.0283
No log	4.0	360	1.0347	0.4128	1.0347	1.0172
No log	4.0222	362	1.0143	0.3840	1.0143	1.0071
No log	4.0444	364	1.0020	0.3603	1.0020	1.0010
No log	4.0667	366	1.0163	0.3369	1.0163	1.0081
No log	4.0889	368	1.0007	0.3634	1.0007	1.0003
No log	4.1111	370	0.9853	0.3164	0.9853	0.9926
No log	4.1333	372	0.9797	0.2808	0.9797	0.9898
No log	4.1556	374	0.9686	0.2995	0.9686	0.9842
No log	4.1778	376	1.0083	0.3873	1.0083	1.0041
No log	4.2	378	1.0323	0.3780	1.0323	1.0160
No log	4.2222	380	1.0036	0.3744	1.0036	1.0018
No log	4.2444	382	1.0157	0.4073	1.0157	1.0078
No log	4.2667	384	1.0273	0.4413	1.0273	1.0136
No log	4.2889	386	1.0184	0.4522	1.0184	1.0092
No log	4.3111	388	0.9828	0.4413	0.9828	0.9913
No log	4.3333	390	0.9889	0.4264	0.9889	0.9944
No log	4.3556	392	0.9880	0.4264	0.9880	0.9940
No log	4.3778	394	0.9642	0.4065	0.9642	0.9819
No log	4.4	396	0.9735	0.4065	0.9735	0.9866
No log	4.4222	398	0.9880	0.4450	0.9880	0.9940
No log	4.4444	400	1.0199	0.3696	1.0199	1.0099
No log	4.4667	402	1.0387	0.4297	1.0387	1.0192
No log	4.4889	404	1.0602	0.4169	1.0602	1.0297
No log	4.5111	406	1.0671	0.3357	1.0671	1.0330
No log	4.5333	408	1.0687	0.3437	1.0687	1.0338
No log	4.5556	410	1.0394	0.3784	1.0394	1.0195
No log	4.5778	412	1.0671	0.3320	1.0671	1.0330
No log	4.6	414	1.1108	0.3320	1.1108	1.0540
No log	4.6222	416	1.0908	0.4232	1.0908	1.0444
No log	4.6444	418	1.0754	0.3036	1.0754	1.0370
No log	4.6667	420	1.1283	0.3320	1.1283	1.0622
No log	4.6889	422	1.1658	0.3292	1.1658	1.0797
No log	4.7111	424	1.1069	0.2701	1.1069	1.0521
No log	4.7333	426	1.1018	0.3495	1.1018	1.0496
No log	4.7556	428	1.1035	0.3270	1.1035	1.0505
No log	4.7778	430	1.0842	0.3089	1.0842	1.0412
No log	4.8	432	1.1289	0.3014	1.1289	1.0625
No log	4.8222	434	1.0954	0.2743	1.0954	1.0466
No log	4.8444	436	1.0443	0.3685	1.0443	1.0219
No log	4.8667	438	1.0432	0.3836	1.0432	1.0214
No log	4.8889	440	1.0346	0.4186	1.0346	1.0171
No log	4.9111	442	1.0619	0.2997	1.0619	1.0305
No log	4.9333	444	1.0817	0.3395	1.0817	1.0401
No log	4.9556	446	1.0466	0.3821	1.0466	1.0230
No log	4.9778	448	1.0436	0.3529	1.0436	1.0216
No log	5.0	450	1.0569	0.3042	1.0569	1.0281
No log	5.0222	452	1.0400	0.3529	1.0400	1.0198
No log	5.0444	454	1.0238	0.3237	1.0238	1.0119
No log	5.0667	456	1.0515	0.3596	1.0515	1.0254
No log	5.0889	458	1.0568	0.3577	1.0568	1.0280
No log	5.1111	460	1.0287	0.3338	1.0287	1.0142
No log	5.1333	462	1.0144	0.3347	1.0144	1.0072
No log	5.1556	464	1.0209	0.3552	1.0209	1.0104
No log	5.1778	466	1.0314	0.3316	1.0314	1.0156
No log	5.2	468	1.0641	0.3693	1.0641	1.0315
No log	5.2222	470	1.1074	0.3049	1.1074	1.0523
No log	5.2444	472	1.0760	0.3198	1.0760	1.0373
No log	5.2667	474	1.0614	0.3577	1.0614	1.0303
No log	5.2889	476	1.0672	0.3839	1.0672	1.0331
No log	5.3111	478	1.0817	0.3584	1.0817	1.0400
No log	5.3333	480	1.0882	0.3584	1.0882	1.0432
No log	5.3556	482	1.0963	0.3466	1.0963	1.0470
No log	5.3778	484	1.1271	0.3113	1.1271	1.0617
No log	5.4	486	1.1668	0.3384	1.1668	1.0802
No log	5.4222	488	1.2236	0.2937	1.2236	1.1062
No log	5.4444	490	1.2548	0.2668	1.2548	1.1202
No log	5.4667	492	1.2111	0.2918	1.2111	1.1005
No log	5.4889	494	1.1349	0.3715	1.1349	1.0653
No log	5.5111	496	1.0882	0.3113	1.0882	1.0432
No log	5.5333	498	1.0921	0.3230	1.0921	1.0450
0.3204	5.5556	500	1.0881	0.2944	1.0881	1.0431
0.3204	5.5778	502	1.0967	0.3080	1.0967	1.0472
0.3204	5.6	504	1.0774	0.3059	1.0774	1.0380
0.3204	5.6222	506	1.0986	0.3124	1.0986	1.0482
0.3204	5.6444	508	1.1753	0.3319	1.1753	1.0841
0.3204	5.6667	510	1.1938	0.2595	1.1938	1.0926
0.3204	5.6889	512	1.1476	0.3565	1.1476	1.0712
0.3204	5.7111	514	1.1319	0.2850	1.1319	1.0639
0.3204	5.7333	516	1.1539	0.2871	1.1539	1.0742
0.3204	5.7556	518	1.2138	0.2658	1.2138	1.1017
0.3204	5.7778	520	1.2642	0.2085	1.2642	1.1244
0.3204	5.8	522	1.2611	0.1951	1.2611	1.1230

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1