ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run2_AugV5_k5_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0217
• Qwk: 0.3705
• Mse: 1.0217
• Rmse: 1.0108

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.6730	0.0010	4.6730	2.1617
No log	0.2222	4	2.6605	0.0159	2.6605	1.6311
No log	0.3333	6	2.0411	-0.0303	2.0411	1.4287
No log	0.4444	8	2.4235	-0.0229	2.4235	1.5567
No log	0.5556	10	2.0029	-0.0289	2.0029	1.4153
No log	0.6667	12	1.6008	-0.0313	1.6008	1.2652
No log	0.7778	14	1.4723	0.0203	1.4723	1.2134
No log	0.8889	16	1.4301	0.0291	1.4301	1.1958
No log	1.0	18	1.4615	0.0485	1.4615	1.2089
No log	1.1111	20	1.5237	0.0741	1.5237	1.2344
No log	1.2222	22	1.7009	0.1091	1.7009	1.3042
No log	1.3333	24	1.6337	0.1253	1.6337	1.2782
No log	1.4444	26	1.2859	0.1560	1.2859	1.1340
No log	1.5556	28	1.2808	0.1671	1.2808	1.1317
No log	1.6667	30	1.5004	0.1892	1.5004	1.2249
No log	1.7778	32	1.7429	0.0727	1.7429	1.3202
No log	1.8889	34	1.7479	0.0996	1.7479	1.3221
No log	2.0	36	1.5596	0.1169	1.5596	1.2488
No log	2.1111	38	1.3607	0.1016	1.3607	1.1665
No log	2.2222	40	1.2305	0.2054	1.2305	1.1093
No log	2.3333	42	1.1294	0.2223	1.1294	1.0627
No log	2.4444	44	1.1376	0.2268	1.1376	1.0666
No log	2.5556	46	1.2147	0.1601	1.2147	1.1021
No log	2.6667	48	1.5213	0.1196	1.5213	1.2334
No log	2.7778	50	1.9622	0.1360	1.9622	1.4008
No log	2.8889	52	2.1331	0.1184	2.1331	1.4605
No log	3.0	54	2.0671	0.1263	2.0671	1.4377
No log	3.1111	56	1.7847	0.1152	1.7847	1.3359
No log	3.2222	58	1.3835	0.2371	1.3835	1.1762
No log	3.3333	60	1.1761	0.1927	1.1761	1.0845
No log	3.4444	62	1.1478	0.2579	1.1478	1.0714
No log	3.5556	64	1.1493	0.2733	1.1493	1.0720
No log	3.6667	66	1.2363	0.2374	1.2363	1.1119
No log	3.7778	68	1.2999	0.2644	1.2999	1.1401
No log	3.8889	70	1.4305	0.2495	1.4305	1.1960
No log	4.0	72	1.6176	0.1828	1.6176	1.2718
No log	4.1111	74	1.8203	0.1408	1.8203	1.3492
No log	4.2222	76	1.5610	0.2070	1.5610	1.2494
No log	4.3333	78	1.3699	0.2876	1.3699	1.1704
No log	4.4444	80	1.4023	0.2181	1.4023	1.1842
No log	4.5556	82	1.4341	0.2454	1.4341	1.1975
No log	4.6667	84	1.3171	0.2459	1.3171	1.1476
No log	4.7778	86	1.1571	0.2062	1.1571	1.0757
No log	4.8889	88	1.1424	0.2199	1.1424	1.0688
No log	5.0	90	1.2011	0.3011	1.2011	1.0959
No log	5.1111	92	1.4289	0.2650	1.4289	1.1954
No log	5.2222	94	1.5132	0.2702	1.5132	1.2301
No log	5.3333	96	1.4693	0.2903	1.4693	1.2121
No log	5.4444	98	1.2615	0.2750	1.2615	1.1232
No log	5.5556	100	1.1117	0.2265	1.1117	1.0544
No log	5.6667	102	1.1340	0.2395	1.1340	1.0649
No log	5.7778	104	1.2995	0.2459	1.2995	1.1400
No log	5.8889	106	1.6454	0.2392	1.6454	1.2827
No log	6.0	108	1.9134	0.1225	1.9134	1.3833
No log	6.1111	110	2.2268	0.1058	2.2268	1.4923
No log	6.2222	112	1.8742	0.1225	1.8742	1.3690
No log	6.3333	114	1.3423	0.2140	1.3423	1.1586
No log	6.4444	116	1.1898	0.2085	1.1898	1.0908
No log	6.5556	118	1.1190	0.2785	1.1190	1.0578
No log	6.6667	120	1.0870	0.2369	1.0870	1.0426
No log	6.7778	122	1.0575	0.2471	1.0575	1.0284
No log	6.8889	124	1.0437	0.2355	1.0437	1.0216
No log	7.0	126	1.0472	0.2509	1.0472	1.0233
No log	7.1111	128	1.0552	0.2965	1.0552	1.0272
No log	7.2222	130	1.1036	0.3036	1.1036	1.0505
No log	7.3333	132	1.1505	0.2939	1.1505	1.0726
No log	7.4444	134	1.1336	0.2939	1.1336	1.0647
No log	7.5556	136	1.0525	0.3674	1.0526	1.0259
No log	7.6667	138	1.0821	0.3734	1.0821	1.0402
No log	7.7778	140	1.0078	0.2793	1.0078	1.0039
No log	7.8889	142	1.2211	0.2690	1.2211	1.1050
No log	8.0	144	1.9269	0.1584	1.9269	1.3881
No log	8.1111	146	2.2621	0.1774	2.2621	1.5040
No log	8.2222	148	2.0336	0.2127	2.0336	1.4260
No log	8.3333	150	1.4482	0.2119	1.4482	1.2034
No log	8.4444	152	1.0374	0.3516	1.0374	1.0186
No log	8.5556	154	1.0575	0.2946	1.0575	1.0284
No log	8.6667	156	1.0837	0.3108	1.0837	1.0410
No log	8.7778	158	1.2308	0.2825	1.2308	1.1094
No log	8.8889	160	1.4438	0.2733	1.4438	1.2016
No log	9.0	162	1.5001	0.2516	1.5001	1.2248
No log	9.1111	164	1.3264	0.2191	1.3264	1.1517
No log	9.2222	166	1.0865	0.3433	1.0865	1.0423
No log	9.3333	168	1.0477	0.2792	1.0477	1.0236
No log	9.4444	170	1.0323	0.2503	1.0323	1.0160
No log	9.5556	172	1.0139	0.3527	1.0139	1.0069
No log	9.6667	174	1.0974	0.3759	1.0974	1.0476
No log	9.7778	176	1.1556	0.3887	1.1556	1.0750
No log	9.8889	178	1.1829	0.3679	1.1829	1.0876
No log	10.0	180	1.1425	0.3197	1.1425	1.0689
No log	10.1111	182	1.0441	0.3476	1.0441	1.0218
No log	10.2222	184	0.9909	0.3301	0.9909	0.9955
No log	10.3333	186	0.9878	0.3541	0.9878	0.9939
No log	10.4444	188	1.0096	0.3529	1.0096	1.0048
No log	10.5556	190	1.0215	0.3433	1.0215	1.0107
No log	10.6667	192	1.0321	0.3572	1.0321	1.0159
No log	10.7778	194	1.0225	0.3637	1.0225	1.0112
No log	10.8889	196	1.0336	0.3355	1.0336	1.0167
No log	11.0	198	1.1204	0.3100	1.1204	1.0585
No log	11.1111	200	1.2223	0.3323	1.2223	1.1056
No log	11.2222	202	1.1844	0.3050	1.1844	1.0883
No log	11.3333	204	1.0486	0.2963	1.0486	1.0240
No log	11.4444	206	0.9936	0.3500	0.9936	0.9968
No log	11.5556	208	0.9912	0.2947	0.9912	0.9956
No log	11.6667	210	1.0223	0.3584	1.0223	1.0111
No log	11.7778	212	1.0183	0.4030	1.0183	1.0091
No log	11.8889	214	0.9840	0.4476	0.9840	0.9920
No log	12.0	216	0.9337	0.4007	0.9337	0.9663
No log	12.1111	218	0.8898	0.4830	0.8898	0.9433
No log	12.2222	220	0.8558	0.4910	0.8558	0.9251
No log	12.3333	222	0.8796	0.4694	0.8796	0.9379
No log	12.4444	224	0.8932	0.4694	0.8932	0.9451
No log	12.5556	226	0.8996	0.4369	0.8996	0.9485
No log	12.6667	228	0.8574	0.4257	0.8574	0.9260
No log	12.7778	230	0.8777	0.3762	0.8777	0.9369
No log	12.8889	232	0.8920	0.3762	0.8920	0.9445
No log	13.0	234	0.9084	0.3230	0.9084	0.9531
No log	13.1111	236	0.9413	0.3803	0.9413	0.9702
No log	13.2222	238	1.0424	0.4431	1.0424	1.0210
No log	13.3333	240	1.4491	0.3405	1.4491	1.2038
No log	13.4444	242	1.7432	0.2479	1.7432	1.3203
No log	13.5556	244	1.5354	0.3956	1.5354	1.2391
No log	13.6667	246	1.1372	0.4376	1.1372	1.0664
No log	13.7778	248	0.9438	0.4023	0.9438	0.9715
No log	13.8889	250	0.9405	0.4575	0.9405	0.9698
No log	14.0	252	0.9265	0.4603	0.9265	0.9626
No log	14.1111	254	0.8943	0.3974	0.8943	0.9457
No log	14.2222	256	0.9662	0.4120	0.9662	0.9829
No log	14.3333	258	1.0609	0.4581	1.0609	1.0300
No log	14.4444	260	1.0540	0.4347	1.0540	1.0267
No log	14.5556	262	0.9473	0.3859	0.9473	0.9733
No log	14.6667	264	0.9235	0.4160	0.9235	0.9610
No log	14.7778	266	0.9555	0.4636	0.9555	0.9775
No log	14.8889	268	0.9646	0.4798	0.9646	0.9822
No log	15.0	270	0.9709	0.4626	0.9709	0.9853
No log	15.1111	272	0.9796	0.4483	0.9796	0.9897
No log	15.2222	274	0.9559	0.4667	0.9559	0.9777
No log	15.3333	276	0.9269	0.4590	0.9269	0.9628
No log	15.4444	278	0.8971	0.4197	0.8971	0.9471
No log	15.5556	280	0.8911	0.3866	0.8911	0.9440
No log	15.6667	282	0.9067	0.4367	0.9067	0.9522
No log	15.7778	284	0.9039	0.3769	0.9039	0.9508
No log	15.8889	286	0.8841	0.3616	0.8841	0.9403
No log	16.0	288	0.8678	0.3933	0.8678	0.9316
No log	16.1111	290	0.8614	0.3705	0.8614	0.9281
No log	16.2222	292	0.8679	0.3991	0.8679	0.9316
No log	16.3333	294	0.8807	0.3671	0.8807	0.9385
No log	16.4444	296	0.9256	0.4082	0.9256	0.9621
No log	16.5556	298	1.0114	0.4259	1.0114	1.0057
No log	16.6667	300	1.0490	0.3363	1.0490	1.0242
No log	16.7778	302	0.9974	0.4645	0.9974	0.9987
No log	16.8889	304	0.9594	0.4406	0.9594	0.9795
No log	17.0	306	0.9798	0.4347	0.9798	0.9899
No log	17.1111	308	0.9343	0.4372	0.9343	0.9666
No log	17.2222	310	0.9156	0.4045	0.9156	0.9569
No log	17.3333	312	0.9340	0.4459	0.9340	0.9665
No log	17.4444	314	0.9482	0.4663	0.9482	0.9738
No log	17.5556	316	1.0075	0.3976	1.0075	1.0038
No log	17.6667	318	1.0220	0.3976	1.0220	1.0109
No log	17.7778	320	0.9917	0.3850	0.9917	0.9958
No log	17.8889	322	0.9705	0.3625	0.9705	0.9851
No log	18.0	324	0.9887	0.3891	0.9887	0.9943
No log	18.1111	326	0.9296	0.3390	0.9296	0.9642
No log	18.2222	328	0.9125	0.3723	0.9125	0.9552
No log	18.3333	330	0.9193	0.3678	0.9193	0.9588
No log	18.4444	332	0.9021	0.4004	0.9021	0.9498
No log	18.5556	334	0.8876	0.3821	0.8876	0.9421
No log	18.6667	336	0.8847	0.3681	0.8847	0.9406
No log	18.7778	338	0.8969	0.4218	0.8969	0.9470
No log	18.8889	340	0.9083	0.4681	0.9083	0.9530
No log	19.0	342	0.8849	0.4822	0.8849	0.9407
No log	19.1111	344	0.8794	0.4396	0.8794	0.9377
No log	19.2222	346	0.8982	0.3859	0.8982	0.9477
No log	19.3333	348	0.8872	0.4176	0.8872	0.9419
No log	19.4444	350	0.8728	0.4045	0.8728	0.9342
No log	19.5556	352	0.8814	0.4141	0.8814	0.9388
No log	19.6667	354	0.9143	0.3868	0.9143	0.9562
No log	19.7778	356	0.9007	0.4381	0.9007	0.9491
No log	19.8889	358	0.8859	0.3885	0.8859	0.9412
No log	20.0	360	0.8867	0.3885	0.8867	0.9417
No log	20.1111	362	0.8910	0.4277	0.8910	0.9439
No log	20.2222	364	0.8787	0.4418	0.8787	0.9374
No log	20.3333	366	0.8633	0.4079	0.8633	0.9291
No log	20.4444	368	0.8672	0.4598	0.8672	0.9312
No log	20.5556	370	0.8915	0.4435	0.8915	0.9442
No log	20.6667	372	0.8945	0.4212	0.8945	0.9458
No log	20.7778	374	0.8921	0.4624	0.8921	0.9445
No log	20.8889	376	0.8885	0.4180	0.8885	0.9426
No log	21.0	378	0.9303	0.3744	0.9303	0.9645
No log	21.1111	380	0.9272	0.4140	0.9272	0.9629
No log	21.2222	382	0.9300	0.3615	0.9300	0.9644
No log	21.3333	384	0.9903	0.4212	0.9903	0.9952
No log	21.4444	386	1.0626	0.3843	1.0626	1.0308
No log	21.5556	388	1.0197	0.4155	1.0197	1.0098
No log	21.6667	390	0.9260	0.3194	0.9260	0.9623
No log	21.7778	392	0.9662	0.5326	0.9662	0.9830
No log	21.8889	394	1.0127	0.4337	1.0127	1.0064
No log	22.0	396	0.9951	0.4337	0.9951	0.9975
No log	22.1111	398	0.9305	0.4166	0.9305	0.9646
No log	22.2222	400	0.8663	0.3925	0.8663	0.9308
No log	22.3333	402	1.0286	0.4698	1.0286	1.0142
No log	22.4444	404	1.3997	0.3295	1.3997	1.1831
No log	22.5556	406	1.5548	0.3084	1.5548	1.2469
No log	22.6667	408	1.4292	0.3210	1.4292	1.1955
No log	22.7778	410	1.1770	0.4461	1.1770	1.0849
No log	22.8889	412	0.9182	0.4212	0.9182	0.9582
No log	23.0	414	0.8435	0.4282	0.8435	0.9184
No log	23.1111	416	0.8946	0.5080	0.8946	0.9458
No log	23.2222	418	0.8981	0.4631	0.8981	0.9477
No log	23.3333	420	0.8423	0.3896	0.8423	0.9177
No log	23.4444	422	0.8216	0.5010	0.8216	0.9064
No log	23.5556	424	0.9630	0.4283	0.9630	0.9813
No log	23.6667	426	1.1464	0.4539	1.1464	1.0707
No log	23.7778	428	1.1684	0.4330	1.1684	1.0809
No log	23.8889	430	1.0426	0.4403	1.0426	1.0211
No log	24.0	432	0.9256	0.4191	0.9256	0.9621
No log	24.1111	434	0.8632	0.4155	0.8632	0.9291
No log	24.2222	436	0.8431	0.4308	0.8431	0.9182
No log	24.3333	438	0.8432	0.4175	0.8432	0.9183
No log	24.4444	440	0.8635	0.4308	0.8635	0.9292
No log	24.5556	442	0.9019	0.3985	0.9019	0.9497
No log	24.6667	444	0.9141	0.3942	0.9141	0.9561
No log	24.7778	446	0.9073	0.4197	0.9073	0.9525
No log	24.8889	448	0.8984	0.4118	0.8984	0.9478
No log	25.0	450	0.8942	0.3974	0.8942	0.9456
No log	25.1111	452	0.9011	0.3965	0.9011	0.9493
No log	25.2222	454	0.9335	0.4042	0.9335	0.9662
No log	25.3333	456	0.9503	0.4042	0.9503	0.9748
No log	25.4444	458	0.9707	0.3759	0.9707	0.9853
No log	25.5556	460	1.0442	0.4101	1.0442	1.0219
No log	25.6667	462	1.1025	0.3449	1.1025	1.0500
No log	25.7778	464	1.0870	0.3744	1.0870	1.0426
No log	25.8889	466	1.0175	0.3790	1.0175	1.0087
No log	26.0	468	0.9382	0.4175	0.9382	0.9686
No log	26.1111	470	0.8908	0.4118	0.8908	0.9438
No log	26.2222	472	0.8658	0.3700	0.8658	0.9305
No log	26.3333	474	0.8663	0.3564	0.8663	0.9308
No log	26.4444	476	0.8578	0.3957	0.8578	0.9262
No log	26.5556	478	0.8367	0.4583	0.8367	0.9147
No log	26.6667	480	0.8703	0.4774	0.8703	0.9329
No log	26.7778	482	0.9543	0.4497	0.9543	0.9769
No log	26.8889	484	1.0527	0.4101	1.0527	1.0260
No log	27.0	486	1.0458	0.4101	1.0458	1.0226
No log	27.1111	488	0.9797	0.3846	0.9797	0.9898
No log	27.2222	490	0.8937	0.4406	0.8937	0.9454
No log	27.3333	492	0.8923	0.4221	0.8923	0.9446
No log	27.4444	494	0.9035	0.3478	0.9035	0.9505
No log	27.5556	496	0.9138	0.3478	0.9138	0.9559
No log	27.6667	498	0.9158	0.3478	0.9158	0.9570
0.3136	27.7778	500	0.9051	0.4075	0.9051	0.9514
0.3136	27.8889	502	0.9040	0.3762	0.9040	0.9508
0.3136	28.0	504	0.9117	0.3855	0.9117	0.9548
0.3136	28.1111	506	0.9287	0.3657	0.9287	0.9637
0.3136	28.2222	508	0.9236	0.4212	0.9236	0.9610
0.3136	28.3333	510	0.8997	0.4042	0.8997	0.9485
0.3136	28.4444	512	0.8898	0.4696	0.8898	0.9433
0.3136	28.5556	514	0.8761	0.4826	0.8761	0.9360
0.3136	28.6667	516	0.8708	0.4220	0.8708	0.9332
0.3136	28.7778	518	0.8676	0.3927	0.8676	0.9314
0.3136	28.8889	520	0.8735	0.4504	0.8735	0.9346
0.3136	29.0	522	0.8735	0.4401	0.8735	0.9346
0.3136	29.1111	524	0.8772	0.4397	0.8772	0.9366
0.3136	29.2222	526	0.8921	0.4626	0.8921	0.9445
0.3136	29.3333	528	0.8984	0.4197	0.8984	0.9478
0.3136	29.4444	530	0.8984	0.4294	0.8984	0.9478
0.3136	29.5556	532	0.9196	0.3657	0.9196	0.9590
0.3136	29.6667	534	0.9891	0.3106	0.9891	0.9946
0.3136	29.7778	536	1.0508	0.2734	1.0508	1.0251
0.3136	29.8889	538	1.0725	0.2644	1.0725	1.0356
0.3136	30.0	540	1.0217	0.3705	1.0217	1.0108

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1