ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.2228
• Qwk: 0.3425
• Mse: 2.2228
• Rmse: 1.4909

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	7.0935	0.0056	7.0935	2.6634
No log	0.4444	4	4.5660	0.0873	4.5660	2.1368
No log	0.6667	6	3.4747	0.0	3.4747	1.8640
No log	0.8889	8	2.9962	0.0359	2.9962	1.7310
No log	1.1111	10	2.6688	0.0153	2.6688	1.6337
No log	1.3333	12	2.5046	-0.0472	2.5046	1.5826
No log	1.5556	14	2.9147	-0.0276	2.9147	1.7073
No log	1.7778	16	2.6066	0.0986	2.6066	1.6145
No log	2.0	18	2.7371	0.0927	2.7371	1.6544
No log	2.2222	20	3.0803	0.1236	3.0803	1.7551
No log	2.4444	22	3.1563	0.1753	3.1563	1.7766
No log	2.6667	24	2.0465	0.2857	2.0465	1.4306
No log	2.8889	26	1.6698	0.3824	1.6698	1.2922
No log	3.1111	28	1.8007	0.3421	1.8007	1.3419
No log	3.3333	30	2.6205	0.3350	2.6205	1.6188
No log	3.5556	32	3.4942	0.1847	3.4942	1.8693
No log	3.7778	34	3.9829	0.1575	3.9829	1.9957
No log	4.0	36	3.5624	0.2075	3.5624	1.8874
No log	4.2222	38	2.9090	0.2941	2.9090	1.7056
No log	4.4444	40	2.2102	0.3106	2.2102	1.4867
No log	4.6667	42	1.7230	0.3401	1.7230	1.3126
No log	4.8889	44	1.9324	0.3311	1.9324	1.3901
No log	5.1111	46	2.4920	0.2584	2.4920	1.5786
No log	5.3333	48	2.6045	0.2902	2.6045	1.6139
No log	5.5556	50	2.5487	0.2902	2.5487	1.5965
No log	5.7778	52	1.9067	0.4076	1.9067	1.3808
No log	6.0	54	1.5124	0.4768	1.5124	1.2298
No log	6.2222	56	1.8624	0.4483	1.8624	1.3647
No log	6.4444	58	2.4333	0.3883	2.4333	1.5599
No log	6.6667	60	2.1147	0.4352	2.1147	1.4542
No log	6.8889	62	1.8815	0.4624	1.8815	1.3717
No log	7.1111	64	2.5769	0.3786	2.5769	1.6053
No log	7.3333	66	2.5235	0.3663	2.5235	1.5886
No log	7.5556	68	1.5598	0.4845	1.5598	1.2489
No log	7.7778	70	1.2068	0.5507	1.2068	1.0985
No log	8.0	72	1.2782	0.5109	1.2782	1.1306
No log	8.2222	74	1.2514	0.5255	1.2514	1.1187
No log	8.4444	76	1.5289	0.4805	1.5289	1.2365
No log	8.6667	78	2.6997	0.3796	2.6997	1.6431
No log	8.8889	80	2.9143	0.3229	2.9143	1.7071
No log	9.1111	82	2.1432	0.4481	2.1432	1.4640
No log	9.3333	84	1.7589	0.3875	1.7589	1.3262
No log	9.5556	86	1.4662	0.4533	1.4662	1.2109
No log	9.7778	88	1.6612	0.4099	1.6612	1.2889
No log	10.0	90	2.4226	0.3756	2.4226	1.5565
No log	10.2222	92	3.4465	0.2222	3.4465	1.8565
No log	10.4444	94	3.3314	0.2632	3.3314	1.8252
No log	10.6667	96	2.3359	0.2874	2.3359	1.5284
No log	10.8889	98	1.8292	0.3924	1.8292	1.3525
No log	11.1111	100	2.0240	0.3678	2.0240	1.4227
No log	11.3333	102	2.4920	0.3819	2.4920	1.5786
No log	11.5556	104	2.4293	0.3960	2.4293	1.5586
No log	11.7778	106	1.7322	0.4865	1.7322	1.3161
No log	12.0	108	1.1384	0.6358	1.1384	1.0669
No log	12.2222	110	1.0478	0.6620	1.0478	1.0236
No log	12.4444	112	1.0730	0.6429	1.0730	1.0358
No log	12.6667	114	1.2739	0.4932	1.2739	1.1287
No log	12.8889	116	1.9136	0.4505	1.9136	1.3833
No log	13.1111	118	2.4196	0.3663	2.4196	1.5555
No log	13.3333	120	2.2090	0.4103	2.2090	1.4863
No log	13.5556	122	1.6326	0.4586	1.6326	1.2777
No log	13.7778	124	1.4836	0.4605	1.4836	1.2180
No log	14.0	126	1.4497	0.4516	1.4497	1.2040
No log	14.2222	128	1.6835	0.4852	1.6835	1.2975
No log	14.4444	130	2.2657	0.4062	2.2657	1.5052
No log	14.6667	132	3.1591	0.2456	3.1591	1.7774
No log	14.8889	134	3.3526	0.2328	3.3526	1.8310
No log	15.1111	136	2.6016	0.3627	2.6016	1.6130
No log	15.3333	138	1.6823	0.4167	1.6823	1.2970
No log	15.5556	140	1.5307	0.4713	1.5307	1.2372
No log	15.7778	142	1.8219	0.4494	1.8219	1.3498
No log	16.0	144	2.4619	0.4098	2.4619	1.5691
No log	16.2222	146	2.7624	0.3519	2.7624	1.6621
No log	16.4444	148	2.6015	0.3689	2.6015	1.6129
No log	16.6667	150	2.1481	0.4167	2.1481	1.4656
No log	16.8889	152	1.5343	0.4238	1.5343	1.2387
No log	17.1111	154	1.4128	0.4932	1.4128	1.1886
No log	17.3333	156	1.6947	0.4238	1.6947	1.3018
No log	17.5556	158	2.2145	0.3676	2.2145	1.4881
No log	17.7778	160	2.5858	0.3200	2.5858	1.6081
No log	18.0	162	2.4510	0.3350	2.4510	1.5656
No log	18.2222	164	2.1771	0.4255	2.1771	1.4755
No log	18.4444	166	1.9365	0.4804	1.9365	1.3916
No log	18.6667	168	1.9788	0.4945	1.9788	1.4067
No log	18.8889	170	2.1959	0.4467	2.1959	1.4818
No log	19.1111	172	2.3283	0.4179	2.3283	1.5259
No log	19.3333	174	2.2409	0.4179	2.2409	1.4970
No log	19.5556	176	1.8120	0.4444	1.8120	1.3461
No log	19.7778	178	1.6007	0.4099	1.6007	1.2652
No log	20.0	180	1.6461	0.4268	1.6461	1.2830
No log	20.2222	182	1.8670	0.4471	1.8670	1.3664
No log	20.4444	184	1.8788	0.4545	1.8788	1.3707
No log	20.6667	186	1.8410	0.4545	1.8410	1.3569
No log	20.8889	188	1.7063	0.4678	1.7063	1.3063
No log	21.1111	190	1.9886	0.4176	1.9886	1.4102
No log	21.3333	192	1.9535	0.4309	1.9535	1.3977
No log	21.5556	194	1.5193	0.4780	1.5193	1.2326
No log	21.7778	196	1.3720	0.4868	1.3720	1.1713
No log	22.0	198	1.4587	0.4872	1.4587	1.2078
No log	22.2222	200	1.8116	0.4393	1.8116	1.3460
No log	22.4444	202	2.0425	0.4468	2.0425	1.4292
No log	22.6667	204	2.0930	0.4536	2.0930	1.4467
No log	22.8889	206	2.1575	0.4412	2.1575	1.4688
No log	23.1111	208	1.8767	0.4492	1.8767	1.3699
No log	23.3333	210	1.5061	0.5	1.5061	1.2272
No log	23.5556	212	1.5623	0.5	1.5623	1.2499
No log	23.7778	214	2.0892	0.4167	2.0892	1.4454
No log	24.0	216	2.8449	0.3302	2.8449	1.6867
No log	24.2222	218	2.7566	0.3254	2.7566	1.6603
No log	24.4444	220	2.0497	0.3955	2.0497	1.4317
No log	24.6667	222	1.7637	0.4048	1.7637	1.3281
No log	24.8889	224	1.7615	0.4343	1.7615	1.3272
No log	25.1111	226	1.8647	0.4318	1.8647	1.3656
No log	25.3333	228	1.7265	0.4545	1.7265	1.3140
No log	25.5556	230	1.7554	0.4598	1.7554	1.3249
No log	25.7778	232	1.8394	0.4974	1.8394	1.3563
No log	26.0	234	1.7908	0.4894	1.7908	1.3382
No log	26.2222	236	1.8497	0.5	1.8497	1.3600
No log	26.4444	238	1.7896	0.4894	1.7896	1.3378
No log	26.6667	240	1.7921	0.4787	1.7921	1.3387
No log	26.8889	242	1.6744	0.4253	1.6744	1.2940
No log	27.1111	244	1.3943	0.5122	1.3943	1.1808
No log	27.3333	246	1.1496	0.5931	1.1496	1.0722
No log	27.5556	248	1.1934	0.5395	1.1934	1.0924
No log	27.7778	250	1.5433	0.4706	1.5433	1.2423
No log	28.0	252	1.9163	0.4526	1.9163	1.3843
No log	28.2222	254	1.8717	0.4526	1.8717	1.3681
No log	28.4444	256	1.9666	0.4526	1.9666	1.4024
No log	28.6667	258	1.7114	0.4444	1.7114	1.3082
No log	28.8889	260	1.5264	0.3974	1.5264	1.2355
No log	29.1111	262	1.4046	0.4521	1.4046	1.1852
No log	29.3333	264	1.5771	0.3742	1.5771	1.2558
No log	29.5556	266	1.9470	0.4590	1.9470	1.3953
No log	29.7778	268	2.0996	0.4330	2.0996	1.4490
No log	30.0	270	2.0708	0.4513	2.0708	1.4390
No log	30.2222	272	1.8351	0.4762	1.8351	1.3547
No log	30.4444	274	1.5957	0.5140	1.5957	1.2632
No log	30.6667	276	1.5278	0.5143	1.5278	1.2360
No log	30.8889	278	1.4960	0.5263	1.4960	1.2231
No log	31.1111	280	1.5099	0.4540	1.5099	1.2288
No log	31.3333	282	1.4217	0.4774	1.4217	1.1924
No log	31.5556	284	1.5370	0.4387	1.5370	1.2398
No log	31.7778	286	1.8118	0.4260	1.8118	1.3460
No log	32.0	288	2.0452	0.4339	2.0452	1.4301
No log	32.2222	290	2.1325	0.4286	2.1325	1.4603
No log	32.4444	292	1.9794	0.4574	1.9794	1.4069
No log	32.6667	294	1.5472	0.4971	1.5472	1.2439
No log	32.8889	296	1.3784	0.5093	1.3784	1.1740
No log	33.1111	298	1.3920	0.5062	1.3920	1.1798
No log	33.3333	300	1.6183	0.4571	1.6183	1.2721
No log	33.5556	302	2.0199	0.4706	2.0199	1.4212
No log	33.7778	304	2.2064	0.4343	2.2064	1.4854
No log	34.0	306	2.0458	0.4706	2.0458	1.4303
No log	34.2222	308	1.6234	0.4535	1.6234	1.2741
No log	34.4444	310	1.2468	0.5556	1.2468	1.1166
No log	34.6667	312	1.2184	0.5674	1.2184	1.1038
No log	34.8889	314	1.4104	0.5	1.4104	1.1876
No log	35.1111	316	1.8212	0.4607	1.8212	1.3495
No log	35.3333	318	2.0607	0.4503	2.0607	1.4355
No log	35.5556	320	1.9795	0.4712	1.9795	1.4070
No log	35.7778	322	1.7667	0.4762	1.7667	1.3292
No log	36.0	324	1.6870	0.4889	1.6870	1.2989
No log	36.2222	326	1.7378	0.4809	1.7378	1.3182
No log	36.4444	328	1.7303	0.4725	1.7303	1.3154
No log	36.6667	330	1.7208	0.4725	1.7208	1.3118
No log	36.8889	332	1.6512	0.4379	1.6512	1.2850
No log	37.1111	334	1.5760	0.4217	1.5760	1.2554
No log	37.3333	336	1.6753	0.4471	1.6753	1.2943
No log	37.5556	338	1.8970	0.4530	1.8970	1.3773
No log	37.7778	340	2.0238	0.4526	2.0238	1.4226
No log	38.0	342	2.2332	0.4433	2.2332	1.4944
No log	38.2222	344	2.5082	0.3905	2.5082	1.5837
No log	38.4444	346	2.3559	0.4059	2.3559	1.5349
No log	38.6667	348	2.0093	0.4309	2.0093	1.4175
No log	38.8889	350	1.6569	0.3949	1.6569	1.2872
No log	39.1111	352	1.5070	0.3974	1.5070	1.2276
No log	39.3333	354	1.6206	0.3922	1.6206	1.2730
No log	39.5556	356	1.8834	0.4192	1.8834	1.3724
No log	39.7778	358	2.0568	0.3977	2.0568	1.4342
No log	40.0	360	2.1234	0.3699	2.1234	1.4572
No log	40.2222	362	1.9326	0.4327	1.9326	1.3902
No log	40.4444	364	1.7285	0.4561	1.7285	1.3147
No log	40.6667	366	1.7944	0.4561	1.7944	1.3395
No log	40.8889	368	1.9597	0.4469	1.9597	1.3999
No log	41.1111	370	2.0402	0.4239	2.0402	1.4284
No log	41.3333	372	1.9230	0.4393	1.9230	1.3867
No log	41.5556	374	1.8100	0.4471	1.8100	1.3454
No log	41.7778	376	1.7224	0.4311	1.7224	1.3124
No log	42.0	378	1.5986	0.4224	1.5986	1.2644
No log	42.2222	380	1.6087	0.4390	1.6087	1.2683
No log	42.4444	382	1.7208	0.4311	1.7208	1.3118
No log	42.6667	384	1.8851	0.4094	1.8851	1.3730
No log	42.8889	386	2.0017	0.3908	2.0017	1.4148
No log	43.1111	388	1.9776	0.4246	1.9776	1.4063
No log	43.3333	390	1.8685	0.4457	1.8685	1.3669
No log	43.5556	392	1.7483	0.4121	1.7483	1.3222
No log	43.7778	394	1.7580	0.4286	1.7580	1.3259
No log	44.0	396	1.6875	0.4025	1.6875	1.2990
No log	44.2222	398	1.7175	0.3797	1.7175	1.3105
No log	44.4444	400	1.7529	0.3797	1.7529	1.3240
No log	44.6667	402	1.6869	0.3613	1.6869	1.2988
No log	44.8889	404	1.7011	0.3613	1.7011	1.3043
No log	45.1111	406	1.6710	0.3613	1.6710	1.2927
No log	45.3333	408	1.6305	0.3846	1.6305	1.2769
No log	45.5556	410	1.7279	0.3949	1.7279	1.3145
No log	45.7778	412	1.9386	0.4	1.9386	1.3923
No log	46.0	414	2.0505	0.3956	2.0505	1.4320
No log	46.2222	416	2.0114	0.3956	2.0114	1.4182
No log	46.4444	418	1.7664	0.4242	1.7664	1.3291
No log	46.6667	420	1.5606	0.4026	1.5606	1.2492
No log	46.8889	422	1.5288	0.4	1.5288	1.2364
No log	47.1111	424	1.5545	0.4026	1.5545	1.2468
No log	47.3333	426	1.6755	0.4224	1.6755	1.2944
No log	47.5556	428	1.8622	0.4024	1.8622	1.3646
No log	47.7778	430	2.0541	0.3864	2.0541	1.4332
No log	48.0	432	2.1169	0.3846	2.1169	1.4549
No log	48.2222	434	2.0166	0.4	2.0166	1.4201
No log	48.4444	436	1.8217	0.4024	1.8217	1.3497
No log	48.6667	438	1.5912	0.4204	1.5912	1.2614
No log	48.8889	440	1.4682	0.4706	1.4682	1.2117
No log	49.1111	442	1.4827	0.4586	1.4827	1.2177
No log	49.3333	444	1.6934	0.4405	1.6934	1.3013
No log	49.5556	446	1.9469	0.4556	1.9469	1.3953
No log	49.7778	448	2.1431	0.4084	2.1431	1.4639
No log	50.0	450	2.0904	0.4211	2.0904	1.4458
No log	50.2222	452	1.8870	0.4483	1.8870	1.3737
No log	50.4444	454	1.7168	0.4405	1.7168	1.3103
No log	50.6667	456	1.5376	0.4459	1.5376	1.2400
No log	50.8889	458	1.5277	0.4204	1.5277	1.2360
No log	51.1111	460	1.6422	0.4242	1.6422	1.2815
No log	51.3333	462	1.8490	0.4633	1.8490	1.3598
No log	51.5556	464	1.9104	0.4565	1.9104	1.3822
No log	51.7778	466	1.7945	0.4556	1.7945	1.3396
No log	52.0	468	1.6289	0.4615	1.6289	1.2763
No log	52.2222	470	1.5678	0.4364	1.5678	1.2521
No log	52.4444	472	1.6667	0.4535	1.6667	1.2910
No log	52.6667	474	1.8175	0.4556	1.8175	1.3482
No log	52.8889	476	2.0308	0.4574	2.0308	1.4251
No log	53.1111	478	2.0742	0.4339	2.0742	1.4402
No log	53.3333	480	1.8932	0.3953	1.8932	1.3759
No log	53.5556	482	1.6313	0.4146	1.6313	1.2772
No log	53.7778	484	1.5763	0.4177	1.5763	1.2555
No log	54.0	486	1.5929	0.4051	1.5929	1.2621
No log	54.2222	488	1.6172	0.4051	1.6172	1.2717
No log	54.4444	490	1.8191	0.3926	1.8191	1.3487
No log	54.6667	492	2.1422	0.4211	2.1422	1.4636
No log	54.8889	494	2.2206	0.4211	2.2206	1.4902
No log	55.1111	496	2.1771	0.4211	2.1771	1.4755
No log	55.3333	498	1.9566	0.4162	1.9566	1.3988
0.324	55.5556	500	1.7985	0.3822	1.7985	1.3411
0.324	55.7778	502	1.5747	0.4051	1.5747	1.2549
0.324	56.0	504	1.4629	0.4354	1.4629	1.2095
0.324	56.2222	506	1.4957	0.4196	1.4957	1.2230
0.324	56.4444	508	1.6160	0.3699	1.6160	1.2712
0.324	56.6667	510	1.8132	0.3636	1.8132	1.3465
0.324	56.8889	512	2.0615	0.3457	2.0615	1.4358
0.324	57.1111	514	2.1935	0.3314	2.1935	1.4810
0.324	57.3333	516	2.2228	0.3425	2.2228	1.4909

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1