ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k8_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6204
• Qwk: 0.3299
• Mse: 0.6204
• Rmse: 0.7877

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	2.5813	-0.0262	2.5813	1.6066
No log	0.1818	4	1.3516	0.1000	1.3516	1.1626
No log	0.2727	6	0.7837	0.1372	0.7837	0.8852
No log	0.3636	8	0.8019	-0.0500	0.8019	0.8955
No log	0.4545	10	0.8678	0.0715	0.8678	0.9316
No log	0.5455	12	0.8221	0.1103	0.8221	0.9067
No log	0.6364	14	0.7702	0.1561	0.7702	0.8776
No log	0.7273	16	0.9536	0.1318	0.9536	0.9765
No log	0.8182	18	1.0841	0.0044	1.0841	1.0412
No log	0.9091	20	0.8890	0.1637	0.8890	0.9429
No log	1.0	22	0.7669	0.0771	0.7669	0.8757
No log	1.0909	24	0.7564	0.0679	0.7564	0.8697
No log	1.1818	26	0.7537	0.1050	0.7537	0.8681
No log	1.2727	28	0.7880	0.3518	0.7880	0.8877
No log	1.3636	30	0.7801	0.2652	0.7801	0.8832
No log	1.4545	32	0.7622	0.1598	0.7622	0.8730
No log	1.5455	34	0.7702	-0.0054	0.7702	0.8776
No log	1.6364	36	0.7821	0.0	0.7821	0.8844
No log	1.7273	38	0.8127	0.0	0.8127	0.9015
No log	1.8182	40	0.8914	0.0481	0.8914	0.9441
No log	1.9091	42	0.8700	0.0481	0.8700	0.9328
No log	2.0	44	0.7873	0.0	0.7873	0.8873
No log	2.0909	46	0.7074	-0.0500	0.7074	0.8410
No log	2.1818	48	0.7108	0.2407	0.7108	0.8431
No log	2.2727	50	0.7094	0.2883	0.7094	0.8423
No log	2.3636	52	0.6804	0.3622	0.6804	0.8249
No log	2.4545	54	0.7412	0.2940	0.7412	0.8610
No log	2.5455	56	0.8426	0.3754	0.8426	0.9179
No log	2.6364	58	0.7594	0.3590	0.7594	0.8714
No log	2.7273	60	0.6594	0.3243	0.6594	0.8120
No log	2.8182	62	0.7013	0.3425	0.7013	0.8375
No log	2.9091	64	0.8077	0.3483	0.8077	0.8987
No log	3.0	66	0.7763	0.3149	0.7763	0.8811
No log	3.0909	68	0.6635	0.2852	0.6635	0.8145
No log	3.1818	70	0.6558	0.3183	0.6558	0.8098
No log	3.2727	72	0.6607	0.3523	0.6607	0.8128
No log	3.3636	74	0.7775	0.3688	0.7775	0.8818
No log	3.4545	76	0.7903	0.3913	0.7903	0.8890
No log	3.5455	78	0.6966	0.4179	0.6966	0.8346
No log	3.6364	80	0.8274	0.4064	0.8274	0.9096
No log	3.7273	82	0.9230	0.3357	0.9230	0.9607
No log	3.8182	84	0.7741	0.3946	0.7741	0.8798
No log	3.9091	86	0.7510	0.3287	0.7510	0.8666
No log	4.0	88	0.8603	0.3560	0.8603	0.9275
No log	4.0909	90	0.7629	0.3344	0.7629	0.8734
No log	4.1818	92	0.7016	0.3669	0.7016	0.8376
No log	4.2727	94	0.7425	0.4245	0.7425	0.8617
No log	4.3636	96	0.7187	0.4533	0.7187	0.8478
No log	4.4545	98	0.7081	0.4840	0.7081	0.8415
No log	4.5455	100	0.7662	0.4725	0.7662	0.8753
No log	4.6364	102	0.9252	0.3123	0.9252	0.9619
No log	4.7273	104	0.8999	0.2705	0.8999	0.9486
No log	4.8182	106	0.7253	0.4315	0.7253	0.8517
No log	4.9091	108	0.7856	0.3092	0.7856	0.8863
No log	5.0	110	0.9252	0.2613	0.9252	0.9619
No log	5.0909	112	0.8716	0.3074	0.8716	0.9336
No log	5.1818	114	0.7103	0.3144	0.7103	0.8428
No log	5.2727	116	0.7101	0.3363	0.7101	0.8427
No log	5.3636	118	0.7153	0.3363	0.7153	0.8458
No log	5.4545	120	0.7146	0.3363	0.7147	0.8454
No log	5.5455	122	0.7153	0.3398	0.7153	0.8458
No log	5.6364	124	0.7359	0.2313	0.7359	0.8578
No log	5.7273	126	0.7316	0.2661	0.7316	0.8553
No log	5.8182	128	0.8089	0.3673	0.8089	0.8994
No log	5.9091	130	0.8603	0.4131	0.8603	0.9275
No log	6.0	132	0.7910	0.3433	0.7910	0.8894
No log	6.0909	134	0.7349	0.3144	0.7349	0.8573
No log	6.1818	136	0.8062	0.3719	0.8062	0.8979
No log	6.2727	138	0.8504	0.3067	0.8504	0.9222
No log	6.3636	140	0.8749	0.2849	0.8749	0.9354
No log	6.4545	142	0.9378	0.2916	0.9378	0.9684
No log	6.5455	144	0.8863	0.1209	0.8863	0.9414
No log	6.6364	146	0.8791	0.2202	0.8791	0.9376
No log	6.7273	148	0.8576	0.2223	0.8576	0.9261
No log	6.8182	150	0.9254	0.2993	0.9254	0.9620
No log	6.9091	152	0.8732	0.2555	0.8732	0.9344
No log	7.0	154	0.7430	0.4562	0.7430	0.8620
No log	7.0909	156	0.7507	0.3586	0.7507	0.8664
No log	7.1818	158	0.7558	0.3946	0.7558	0.8693
No log	7.2727	160	0.7060	0.2862	0.7060	0.8402
No log	7.3636	162	0.7041	0.3417	0.7041	0.8391
No log	7.4545	164	0.6996	0.2862	0.6996	0.8364
No log	7.5455	166	0.7058	0.3417	0.7058	0.8401
No log	7.6364	168	0.7070	0.3667	0.7070	0.8408
No log	7.7273	170	0.7287	0.3408	0.7287	0.8536
No log	7.8182	172	0.7528	0.3723	0.7528	0.8676
No log	7.9091	174	0.7111	0.3417	0.7111	0.8433
No log	8.0	176	0.7086	0.2958	0.7086	0.8418
No log	8.0909	178	0.7180	0.2889	0.7180	0.8473
No log	8.1818	180	0.7074	0.2683	0.7074	0.8411
No log	8.2727	182	0.7225	0.2590	0.7225	0.8500
No log	8.3636	184	0.7125	0.2621	0.7125	0.8441
No log	8.4545	186	0.6691	0.2360	0.6691	0.8180
No log	8.5455	188	0.6660	0.3320	0.6660	0.8161
No log	8.6364	190	0.6466	0.3407	0.6466	0.8041
No log	8.7273	192	0.6406	0.2683	0.6406	0.8004
No log	8.8182	194	0.6470	0.3293	0.6470	0.8044
No log	8.9091	196	0.6535	0.2994	0.6535	0.8084
No log	9.0	198	0.6748	0.3813	0.6748	0.8215
No log	9.0909	200	0.6800	0.4455	0.6800	0.8246
No log	9.1818	202	0.6754	0.4342	0.6754	0.8219
No log	9.2727	204	0.6723	0.4078	0.6723	0.8199
No log	9.3636	206	0.7221	0.4284	0.7221	0.8498
No log	9.4545	208	0.7749	0.4468	0.7749	0.8803
No log	9.5455	210	0.7070	0.4665	0.7070	0.8409
No log	9.6364	212	0.6446	0.4206	0.6446	0.8029
No log	9.7273	214	0.6189	0.2683	0.6189	0.7867
No log	9.8182	216	0.6361	0.3607	0.6361	0.7975
No log	9.9091	218	0.6528	0.3762	0.6528	0.8080
No log	10.0	220	0.6486	0.4137	0.6486	0.8054
No log	10.0909	222	0.7404	0.4124	0.7404	0.8605
No log	10.1818	224	0.8892	0.3669	0.8892	0.9430
No log	10.2727	226	0.8276	0.3466	0.8276	0.9097
No log	10.3636	228	0.6770	0.4642	0.6770	0.8228
No log	10.4545	230	0.6991	0.4329	0.6991	0.8361
No log	10.5455	232	0.7476	0.4140	0.7476	0.8647
No log	10.6364	234	0.7674	0.4160	0.7674	0.8760
No log	10.7273	236	0.7438	0.4675	0.7438	0.8624
No log	10.8182	238	0.7076	0.3673	0.7076	0.8412
No log	10.9091	240	0.7173	0.3774	0.7173	0.8469
No log	11.0	242	0.7448	0.3836	0.7448	0.8630
No log	11.0909	244	0.7671	0.2942	0.7671	0.8758
No log	11.1818	246	0.7519	0.3369	0.7519	0.8671
No log	11.2727	248	0.7248	0.3336	0.7248	0.8514
No log	11.3636	250	0.7268	0.2901	0.7268	0.8525
No log	11.4545	252	0.7308	0.3069	0.7308	0.8549
No log	11.5455	254	0.7485	0.3836	0.7485	0.8652
No log	11.6364	256	0.7632	0.3838	0.7632	0.8736
No log	11.7273	258	0.7832	0.3283	0.7832	0.8850
No log	11.8182	260	0.8368	0.3548	0.8368	0.9147
No log	11.9091	262	0.8420	0.3489	0.8420	0.9176
No log	12.0	264	0.7885	0.2643	0.7885	0.8880
No log	12.0909	266	0.7561	0.3754	0.7561	0.8695
No log	12.1818	268	0.7568	0.3608	0.7568	0.8700
No log	12.2727	270	0.7347	0.2955	0.7347	0.8572
No log	12.3636	272	0.7591	0.2294	0.7591	0.8713
No log	12.4545	274	0.8681	0.2153	0.8681	0.9317
No log	12.5455	276	0.8991	0.3280	0.8991	0.9482
No log	12.6364	278	0.8426	0.2871	0.8426	0.9179
No log	12.7273	280	0.7606	0.1699	0.7606	0.8721
No log	12.8182	282	0.7270	0.2063	0.7270	0.8526
No log	12.9091	284	0.7327	0.2413	0.7327	0.8560
No log	13.0	286	0.7541	0.2379	0.7541	0.8684
No log	13.0909	288	0.7664	0.2661	0.7664	0.8755
No log	13.1818	290	0.7983	0.2549	0.7983	0.8935
No log	13.2727	292	0.8362	0.2516	0.8362	0.9144
No log	13.3636	294	0.7872	0.3121	0.7872	0.8872
No log	13.4545	296	0.7347	0.2471	0.7347	0.8571
No log	13.5455	298	0.6972	0.2007	0.6972	0.8350
No log	13.6364	300	0.6713	0.2413	0.6713	0.8193
No log	13.7273	302	0.6584	0.2386	0.6584	0.8114
No log	13.8182	304	0.6608	0.2353	0.6608	0.8129
No log	13.9091	306	0.6551	0.2413	0.6551	0.8094
No log	14.0	308	0.6603	0.2715	0.6603	0.8126
No log	14.0909	310	0.6650	0.2715	0.6650	0.8155
No log	14.1818	312	0.6842	0.2780	0.6842	0.8272
No log	14.2727	314	0.6929	0.2953	0.6929	0.8324
No log	14.3636	316	0.7022	0.2953	0.7022	0.8380
No log	14.4545	318	0.7516	0.3867	0.7516	0.8669
No log	14.5455	320	0.8308	0.2697	0.8308	0.9115
No log	14.6364	322	0.8086	0.2904	0.8086	0.8992
No log	14.7273	324	0.7541	0.2285	0.7541	0.8684
No log	14.8182	326	0.7454	0.2621	0.7454	0.8634
No log	14.9091	328	0.7315	0.2838	0.7315	0.8553
No log	15.0	330	0.7315	0.2867	0.7315	0.8553
No log	15.0909	332	0.7353	0.2834	0.7353	0.8575
No log	15.1818	334	0.7335	0.2834	0.7335	0.8565
No log	15.2727	336	0.7455	0.3478	0.7455	0.8634
No log	15.3636	338	0.7485	0.3324	0.7485	0.8652
No log	15.4545	340	0.7855	0.2129	0.7855	0.8863
No log	15.5455	342	0.8723	0.3012	0.8723	0.9340
No log	15.6364	344	0.8918	0.2826	0.8918	0.9443
No log	15.7273	346	0.8190	0.3206	0.8190	0.9050
No log	15.8182	348	0.7140	0.3524	0.7140	0.8450
No log	15.9091	350	0.6841	0.3492	0.6841	0.8271
No log	16.0	352	0.6941	0.4294	0.6941	0.8331
No log	16.0909	354	0.6999	0.4536	0.6999	0.8366
No log	16.1818	356	0.6796	0.4536	0.6796	0.8244
No log	16.2727	358	0.6469	0.4051	0.6469	0.8043
No log	16.3636	360	0.6600	0.4375	0.6600	0.8124
No log	16.4545	362	0.7098	0.4444	0.7098	0.8425
No log	16.5455	364	0.6898	0.4597	0.6898	0.8305
No log	16.6364	366	0.6500	0.4292	0.6500	0.8062
No log	16.7273	368	0.6156	0.2715	0.6156	0.7846
No log	16.8182	370	0.6183	0.4036	0.6183	0.7863
No log	16.9091	372	0.6763	0.4931	0.6763	0.8223
No log	17.0	374	0.6673	0.4931	0.6673	0.8169
No log	17.0909	376	0.6331	0.3883	0.6331	0.7957
No log	17.1818	378	0.6666	0.5059	0.6666	0.8165
No log	17.2727	380	0.7685	0.4748	0.7685	0.8766
No log	17.3636	382	0.7684	0.4805	0.7684	0.8766
No log	17.4545	384	0.6847	0.4602	0.6847	0.8275
No log	17.5455	386	0.6260	0.3865	0.6260	0.7912
No log	17.6364	388	0.6223	0.3280	0.6223	0.7889
No log	17.7273	390	0.6251	0.3280	0.6251	0.7907
No log	17.8182	392	0.6331	0.3599	0.6331	0.7957
No log	17.9091	394	0.6489	0.3524	0.6489	0.8056
No log	18.0	396	0.6894	0.4059	0.6894	0.8303
No log	18.0909	398	0.7161	0.4350	0.7161	0.8462
No log	18.1818	400	0.7304	0.4057	0.7304	0.8546
No log	18.2727	402	0.7037	0.3329	0.7037	0.8389
No log	18.3636	404	0.6762	0.3524	0.6762	0.8223
No log	18.4545	406	0.6629	0.2943	0.6629	0.8142
No log	18.5455	408	0.6559	0.2783	0.6559	0.8099
No log	18.6364	410	0.6540	0.2852	0.6540	0.8087
No log	18.7273	412	0.6572	0.2852	0.6572	0.8107
No log	18.8182	414	0.6635	0.2852	0.6635	0.8145
No log	18.9091	416	0.6749	0.2852	0.6749	0.8215
No log	19.0	418	0.6848	0.2327	0.6848	0.8275
No log	19.0909	420	0.6659	0.3183	0.6659	0.8160
No log	19.1818	422	0.6553	0.3258	0.6553	0.8095
No log	19.2727	424	0.6545	0.3530	0.6545	0.8090
No log	19.3636	426	0.6548	0.3580	0.6548	0.8092
No log	19.4545	428	0.6575	0.4345	0.6575	0.8109
No log	19.5455	430	0.6519	0.4345	0.6519	0.8074
No log	19.6364	432	0.6460	0.3454	0.6460	0.8037
No log	19.7273	434	0.6520	0.2980	0.6520	0.8075
No log	19.8182	436	0.6554	0.3640	0.6554	0.8096
No log	19.9091	438	0.6539	0.3498	0.6539	0.8087
No log	20.0	440	0.6556	0.3498	0.6556	0.8097
No log	20.0909	442	0.6610	0.3763	0.6610	0.8130
No log	20.1818	444	0.6481	0.3011	0.6481	0.8051
No log	20.2727	446	0.6391	0.2783	0.6391	0.7994
No log	20.3636	448	0.6297	0.2815	0.6297	0.7935
No log	20.4545	450	0.6327	0.2852	0.6327	0.7954
No log	20.5455	452	0.6493	0.2852	0.6493	0.8058
No log	20.6364	454	0.7114	0.2621	0.7114	0.8435
No log	20.7273	456	0.7872	0.4385	0.7872	0.8872
No log	20.8182	458	0.7995	0.3766	0.7995	0.8942
No log	20.9091	460	0.7315	0.4193	0.7315	0.8553
No log	21.0	462	0.6639	0.2652	0.6639	0.8148
No log	21.0909	464	0.6599	0.3213	0.6599	0.8123
No log	21.1818	466	0.6653	0.3141	0.6653	0.8157
No log	21.2727	468	0.6786	0.2652	0.6786	0.8238
No log	21.3636	470	0.7131	0.3572	0.7131	0.8445
No log	21.4545	472	0.7215	0.3267	0.7215	0.8494
No log	21.5455	474	0.6992	0.2943	0.6992	0.8362
No log	21.6364	476	0.6791	0.2652	0.6791	0.8241
No log	21.7273	478	0.6576	0.3141	0.6576	0.8109
No log	21.8182	480	0.6493	0.3141	0.6493	0.8058
No log	21.9091	482	0.6476	0.2652	0.6476	0.8047
No log	22.0	484	0.6449	0.3551	0.6449	0.8030
No log	22.0909	486	0.6411	0.3813	0.6411	0.8007
No log	22.1818	488	0.6308	0.2652	0.6308	0.7942
No log	22.2727	490	0.6296	0.2936	0.6296	0.7935
No log	22.3636	492	0.6407	0.3211	0.6407	0.8005
No log	22.4545	494	0.6808	0.4081	0.6808	0.8251
No log	22.5455	496	0.7171	0.4827	0.7171	0.8468
No log	22.6364	498	0.7131	0.4513	0.7131	0.8445
0.2994	22.7273	500	0.7010	0.3763	0.7010	0.8373
0.2994	22.8182	502	0.6697	0.3002	0.6697	0.8184
0.2994	22.9091	504	0.6576	0.3141	0.6576	0.8109
0.2994	23.0	506	0.6563	0.3407	0.6563	0.8102
0.2994	23.0909	508	0.6586	0.3511	0.6586	0.8116
0.2994	23.1818	510	0.6628	0.3984	0.6628	0.8141
0.2994	23.2727	512	0.6767	0.3574	0.6767	0.8226
0.2994	23.3636	514	0.6957	0.3629	0.6957	0.8341
0.2994	23.4545	516	0.7167	0.4768	0.7167	0.8466
0.2994	23.5455	518	0.6928	0.4622	0.6928	0.8324
0.2994	23.6364	520	0.6668	0.3599	0.6668	0.8166
0.2994	23.7273	522	0.6499	0.3324	0.6499	0.8062
0.2994	23.8182	524	0.6479	0.3369	0.6479	0.8049
0.2994	23.9091	526	0.6562	0.3296	0.6562	0.8100
0.2994	24.0	528	0.6708	0.4437	0.6708	0.8190
0.2994	24.0909	530	0.6747	0.4437	0.6747	0.8214
0.2994	24.1818	532	0.6562	0.3840	0.6562	0.8101
0.2994	24.2727	534	0.6244	0.3654	0.6244	0.7902
0.2994	24.3636	536	0.6231	0.3934	0.6231	0.7893
0.2994	24.4545	538	0.6201	0.4149	0.6201	0.7874
0.2994	24.5455	540	0.6265	0.3787	0.6265	0.7915
0.2994	24.6364	542	0.6438	0.3763	0.6438	0.8024
0.2994	24.7273	544	0.6451	0.3688	0.6451	0.8032
0.2994	24.8182	546	0.6373	0.3688	0.6373	0.7983
0.2994	24.9091	548	0.6478	0.3688	0.6478	0.8049
0.2994	25.0	550	0.6875	0.4664	0.6875	0.8291
0.2994	25.0909	552	0.7795	0.4247	0.7795	0.8829
0.2994	25.1818	554	0.8085	0.4413	0.8085	0.8992
0.2994	25.2727	556	0.7500	0.4413	0.7500	0.8660
0.2994	25.3636	558	0.7179	0.4614	0.7179	0.8473
0.2994	25.4545	560	0.6710	0.5195	0.6710	0.8191
0.2994	25.5455	562	0.6642	0.5259	0.6642	0.8150
0.2994	25.6364	564	0.6880	0.4745	0.6880	0.8295
0.2994	25.7273	566	0.7304	0.4512	0.7304	0.8546
0.2994	25.8182	568	0.7132	0.4808	0.7132	0.8445
0.2994	25.9091	570	0.6756	0.4664	0.6756	0.8219
0.2994	26.0	572	0.6364	0.3942	0.6364	0.7977
0.2994	26.0909	574	0.6268	0.3966	0.6268	0.7917
0.2994	26.1818	576	0.6274	0.4125	0.6274	0.7921
0.2994	26.2727	578	0.6315	0.3953	0.6315	0.7947
0.2994	26.3636	580	0.6323	0.4016	0.6323	0.7952
0.2994	26.4545	582	0.6390	0.4696	0.6390	0.7994
0.2994	26.5455	584	0.6604	0.4444	0.6604	0.8126
0.2994	26.6364	586	0.6983	0.4522	0.6983	0.8356
0.2994	26.7273	588	0.7362	0.4952	0.7362	0.8580
0.2994	26.8182	590	0.7335	0.4952	0.7335	0.8564
0.2994	26.9091	592	0.7215	0.4513	0.7215	0.8494
0.2994	27.0	594	0.7199	0.4964	0.7199	0.8484
0.2994	27.0909	596	0.6798	0.3640	0.6798	0.8245
0.2994	27.1818	598	0.6454	0.3728	0.6454	0.8033
0.2994	27.2727	600	0.6263	0.3352	0.6263	0.7914
0.2994	27.3636	602	0.6188	0.3211	0.6188	0.7866
0.2994	27.4545	604	0.6204	0.3299	0.6204	0.7877

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1