ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5519
• Qwk: 0.7591
• Mse: 0.5519
• Rmse: 0.7429

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	5.2487	-0.0042	5.2487	2.2910
No log	0.0690	4	3.2805	0.0863	3.2805	1.8112
No log	0.1034	6	1.7553	0.1210	1.7553	1.3249
No log	0.1379	8	1.3612	0.2539	1.3612	1.1667
No log	0.1724	10	1.6056	0.1855	1.6056	1.2671
No log	0.2069	12	1.3916	0.2176	1.3916	1.1796
No log	0.2414	14	0.9607	0.4554	0.9607	0.9802
No log	0.2759	16	0.8600	0.3879	0.8600	0.9274
No log	0.3103	18	0.7826	0.5385	0.7826	0.8846
No log	0.3448	20	0.7476	0.6149	0.7476	0.8647
No log	0.3793	22	0.7929	0.6327	0.7929	0.8904
No log	0.4138	24	0.9314	0.5640	0.9314	0.9651
No log	0.4483	26	1.4520	0.4606	1.4520	1.2050
No log	0.4828	28	1.4734	0.4654	1.4734	1.2138
No log	0.5172	30	1.0768	0.5940	1.0768	1.0377
No log	0.5517	32	1.2017	0.5091	1.2017	1.0962
No log	0.5862	34	1.5903	0.4272	1.5903	1.2611
No log	0.6207	36	1.2820	0.4910	1.2820	1.1323
No log	0.6552	38	0.7515	0.7011	0.7515	0.8669
No log	0.6897	40	0.6477	0.7022	0.6477	0.8048
No log	0.7241	42	0.6048	0.6826	0.6048	0.7777
No log	0.7586	44	0.7333	0.6144	0.7333	0.8563
No log	0.7931	46	0.8405	0.6020	0.8405	0.9168
No log	0.8276	48	0.8736	0.5839	0.8736	0.9347
No log	0.8621	50	0.8295	0.6158	0.8295	0.9107
No log	0.8966	52	0.8926	0.5929	0.8926	0.9448
No log	0.9310	54	1.0122	0.5971	1.0122	1.0061
No log	0.9655	56	1.0539	0.5940	1.0539	1.0266
No log	1.0	58	0.8760	0.6399	0.8760	0.9359
No log	1.0345	60	0.7334	0.7070	0.7334	0.8564
No log	1.0690	62	0.6691	0.6925	0.6691	0.8180
No log	1.1034	64	0.6432	0.6999	0.6432	0.8020
No log	1.1379	66	0.6704	0.6639	0.6704	0.8188
No log	1.1724	68	0.8878	0.5526	0.8878	0.9422
No log	1.2069	70	1.1210	0.5422	1.1210	1.0588
No log	1.2414	72	0.9356	0.5528	0.9356	0.9672
No log	1.2759	74	0.7117	0.6371	0.7117	0.8436
No log	1.3103	76	0.6510	0.7118	0.6510	0.8068
No log	1.3448	78	0.6492	0.6891	0.6492	0.8057
No log	1.3793	80	0.7263	0.6490	0.7263	0.8522
No log	1.4138	82	0.7635	0.6659	0.7635	0.8738
No log	1.4483	84	0.6973	0.6345	0.6973	0.8351
No log	1.4828	86	0.6807	0.7450	0.6807	0.8250
No log	1.5172	88	0.7439	0.7667	0.7439	0.8625
No log	1.5517	90	0.6851	0.7712	0.6851	0.8277
No log	1.5862	92	0.6383	0.7658	0.6383	0.7990
No log	1.6207	94	0.6042	0.7290	0.6042	0.7773
No log	1.6552	96	0.5992	0.7439	0.5992	0.7741
No log	1.6897	98	0.6257	0.7620	0.6257	0.7910
No log	1.7241	100	0.6145	0.7350	0.6145	0.7839
No log	1.7586	102	0.7331	0.6689	0.7331	0.8562
No log	1.7931	104	0.7140	0.6932	0.7140	0.8450
No log	1.8276	106	0.6397	0.7410	0.6397	0.7998
No log	1.8621	108	0.6850	0.7398	0.6850	0.8276
No log	1.8966	110	0.7127	0.7484	0.7127	0.8442
No log	1.9310	112	0.6601	0.7767	0.6601	0.8125
No log	1.9655	114	0.6941	0.7203	0.6941	0.8331
No log	2.0	116	0.7923	0.6928	0.7923	0.8901
No log	2.0345	118	0.8642	0.6769	0.8642	0.9296
No log	2.0690	120	0.6953	0.7046	0.6953	0.8339
No log	2.1034	122	0.6117	0.7322	0.6117	0.7821
No log	2.1379	124	0.6100	0.7316	0.6100	0.7811
No log	2.1724	126	0.6551	0.7280	0.6551	0.8094
No log	2.2069	128	0.8454	0.6842	0.8454	0.9194
No log	2.2414	130	0.8905	0.6722	0.8905	0.9436
No log	2.2759	132	0.7102	0.7451	0.7102	0.8427
No log	2.3103	134	0.6498	0.7666	0.6498	0.8061
No log	2.3448	136	0.6524	0.7522	0.6524	0.8077
No log	2.3793	138	0.5588	0.7923	0.5588	0.7476
No log	2.4138	140	0.5491	0.7409	0.5491	0.7410
No log	2.4483	142	0.5634	0.7858	0.5634	0.7506
No log	2.4828	144	0.6156	0.7870	0.6156	0.7846
No log	2.5172	146	0.6845	0.7675	0.6845	0.8274
No log	2.5517	148	0.6914	0.7611	0.6914	0.8315
No log	2.5862	150	0.6456	0.7814	0.6456	0.8035
No log	2.6207	152	0.6455	0.7468	0.6455	0.8035
No log	2.6552	154	0.6830	0.7444	0.6830	0.8265
No log	2.6897	156	0.6358	0.7451	0.6358	0.7974
No log	2.7241	158	0.6086	0.7607	0.6086	0.7801
No log	2.7586	160	0.6359	0.7356	0.6359	0.7974
No log	2.7931	162	0.6033	0.7468	0.6033	0.7767
No log	2.8276	164	0.6487	0.7306	0.6487	0.8054
No log	2.8621	166	0.6528	0.7343	0.6528	0.8080
No log	2.8966	168	0.6317	0.7589	0.6317	0.7948
No log	2.9310	170	0.6708	0.7322	0.6708	0.8190
No log	2.9655	172	0.7267	0.7284	0.7267	0.8525
No log	3.0	174	0.7862	0.7109	0.7862	0.8867
No log	3.0345	176	0.7732	0.7073	0.7732	0.8793
No log	3.0690	178	0.7176	0.7467	0.7176	0.8471
No log	3.1034	180	0.5925	0.7705	0.5925	0.7697
No log	3.1379	182	0.5894	0.7614	0.5894	0.7677
No log	3.1724	184	0.5637	0.7693	0.5637	0.7508
No log	3.2069	186	0.5718	0.7687	0.5718	0.7562
No log	3.2414	188	0.7037	0.7185	0.7037	0.8389
No log	3.2759	190	0.7321	0.7295	0.7321	0.8556
No log	3.3103	192	0.6157	0.7736	0.6157	0.7846
No log	3.3448	194	0.6141	0.7757	0.6141	0.7836
No log	3.3793	196	0.6202	0.7418	0.6202	0.7875
No log	3.4138	198	0.5899	0.7645	0.5899	0.7680
No log	3.4483	200	0.5762	0.7811	0.5762	0.7591
No log	3.4828	202	0.5795	0.7714	0.5795	0.7612
No log	3.5172	204	0.6748	0.7180	0.6748	0.8215
No log	3.5517	206	0.6928	0.7205	0.6928	0.8324
No log	3.5862	208	0.5941	0.7575	0.5941	0.7708
No log	3.6207	210	0.5808	0.7644	0.5808	0.7621
No log	3.6552	212	0.5752	0.7457	0.5752	0.7584
No log	3.6897	214	0.6009	0.7370	0.6009	0.7752
No log	3.7241	216	0.6347	0.7168	0.6347	0.7967
No log	3.7586	218	0.6004	0.7444	0.6004	0.7749
No log	3.7931	220	0.6314	0.7424	0.6314	0.7946
No log	3.8276	222	0.9323	0.6717	0.9323	0.9656
No log	3.8621	224	1.0741	0.6452	1.0741	1.0364
No log	3.8966	226	0.9450	0.6698	0.9450	0.9721
No log	3.9310	228	0.6996	0.7046	0.6996	0.8364
No log	3.9655	230	0.6305	0.7522	0.6305	0.7941
No log	4.0	232	0.6494	0.7267	0.6494	0.8058
No log	4.0345	234	0.6728	0.7343	0.6728	0.8203
No log	4.0690	236	0.7646	0.7213	0.7646	0.8744
No log	4.1034	238	0.9694	0.6685	0.9694	0.9846
No log	4.1379	240	1.0027	0.6805	1.0027	1.0013
No log	4.1724	242	0.8362	0.6910	0.8362	0.9144
No log	4.2069	244	0.6729	0.7580	0.6729	0.8203
No log	4.2414	246	0.6261	0.7363	0.6261	0.7913
No log	4.2759	248	0.6442	0.7478	0.6442	0.8026
No log	4.3103	250	0.6773	0.7297	0.6773	0.8230
No log	4.3448	252	0.6689	0.7308	0.6689	0.8179
No log	4.3793	254	0.6188	0.7640	0.6188	0.7867
No log	4.4138	256	0.6168	0.7551	0.6168	0.7853
No log	4.4483	258	0.6302	0.7618	0.6302	0.7938
No log	4.4828	260	0.7202	0.7234	0.7202	0.8487
No log	4.5172	262	0.8203	0.6977	0.8203	0.9057
No log	4.5517	264	0.9262	0.6675	0.9262	0.9624
No log	4.5862	266	0.9283	0.6795	0.9283	0.9635
No log	4.6207	268	0.7945	0.6776	0.7945	0.8913
No log	4.6552	270	0.6383	0.7505	0.6383	0.7989
No log	4.6897	272	0.6225	0.7385	0.6225	0.7890
No log	4.7241	274	0.6664	0.7120	0.6664	0.8163
No log	4.7586	276	0.6569	0.7234	0.6569	0.8105
No log	4.7931	278	0.6426	0.7573	0.6426	0.8016
No log	4.8276	280	0.6661	0.7575	0.6661	0.8162
No log	4.8621	282	0.6527	0.7371	0.6527	0.8079
No log	4.8966	284	0.6196	0.7651	0.6196	0.7872
No log	4.9310	286	0.5991	0.7461	0.5991	0.7740
No log	4.9655	288	0.6044	0.7452	0.6044	0.7775
No log	5.0	290	0.5967	0.7439	0.5967	0.7725
No log	5.0345	292	0.6152	0.7773	0.6152	0.7843
No log	5.0690	294	0.6327	0.7667	0.6327	0.7954
No log	5.1034	296	0.6080	0.7789	0.6080	0.7797
No log	5.1379	298	0.5950	0.7652	0.5950	0.7713
No log	5.1724	300	0.6036	0.7656	0.6036	0.7769
No log	5.2069	302	0.6714	0.7624	0.6714	0.8194
No log	5.2414	304	0.7591	0.7114	0.7591	0.8713
No log	5.2759	306	0.7898	0.7050	0.7898	0.8887
No log	5.3103	308	0.7350	0.7109	0.7350	0.8573
No log	5.3448	310	0.6481	0.7513	0.6481	0.8050
No log	5.3793	312	0.6032	0.7392	0.6032	0.7767
No log	5.4138	314	0.5999	0.7478	0.5999	0.7745
No log	5.4483	316	0.6045	0.7425	0.6045	0.7775
No log	5.4828	318	0.6152	0.7504	0.6152	0.7844
No log	5.5172	320	0.6390	0.7387	0.6390	0.7994
No log	5.5517	322	0.6586	0.7574	0.6586	0.8115
No log	5.5862	324	0.6427	0.7614	0.6427	0.8017
No log	5.6207	326	0.6028	0.7343	0.6028	0.7764
No log	5.6552	328	0.5838	0.7150	0.5838	0.7641
No log	5.6897	330	0.5911	0.7441	0.5911	0.7688
No log	5.7241	332	0.6051	0.7504	0.6051	0.7779
No log	5.7586	334	0.6419	0.7487	0.6419	0.8012
No log	5.7931	336	0.7076	0.7243	0.7076	0.8412
No log	5.8276	338	0.7222	0.7128	0.7222	0.8498
No log	5.8621	340	0.6801	0.7262	0.6801	0.8247
No log	5.8966	342	0.6702	0.7300	0.6702	0.8186
No log	5.9310	344	0.7318	0.7009	0.7318	0.8554
No log	5.9655	346	0.7771	0.6932	0.7771	0.8816
No log	6.0	348	0.7597	0.6967	0.7597	0.8716
No log	6.0345	350	0.6999	0.7196	0.6999	0.8366
No log	6.0690	352	0.6383	0.7694	0.6383	0.7989
No log	6.1034	354	0.6259	0.7520	0.6259	0.7911
No log	6.1379	356	0.6336	0.7557	0.6336	0.7960
No log	6.1724	358	0.6491	0.7607	0.6491	0.8057
No log	6.2069	360	0.6903	0.7224	0.6903	0.8309
No log	6.2414	362	0.7569	0.7217	0.7569	0.8700
No log	6.2759	364	0.7807	0.7296	0.7807	0.8836
No log	6.3103	366	0.7311	0.7354	0.7311	0.8550
No log	6.3448	368	0.6725	0.7170	0.6725	0.8201
No log	6.3793	370	0.6324	0.7528	0.6324	0.7952
No log	6.4138	372	0.6257	0.7459	0.6257	0.7910
No log	6.4483	374	0.6324	0.7498	0.6324	0.7952
No log	6.4828	376	0.6360	0.7583	0.6360	0.7975
No log	6.5172	378	0.6619	0.7375	0.6619	0.8136
No log	6.5517	380	0.6903	0.7450	0.6903	0.8309
No log	6.5862	382	0.6969	0.7410	0.6969	0.8348
No log	6.6207	384	0.6865	0.7410	0.6865	0.8286
No log	6.6552	386	0.6863	0.7410	0.6863	0.8284
No log	6.6897	388	0.6742	0.7448	0.6742	0.8211
No log	6.7241	390	0.6569	0.7345	0.6569	0.8105
No log	6.7586	392	0.6296	0.7500	0.6296	0.7935
No log	6.7931	394	0.6009	0.7615	0.6009	0.7752
No log	6.8276	396	0.5914	0.7560	0.5914	0.7690
No log	6.8621	398	0.5989	0.7560	0.5989	0.7739
No log	6.8966	400	0.6246	0.7536	0.6246	0.7903
No log	6.9310	402	0.6585	0.7577	0.6585	0.8115
No log	6.9655	404	0.6479	0.7565	0.6479	0.8049
No log	7.0	406	0.6108	0.7489	0.6108	0.7816
No log	7.0345	408	0.6000	0.7611	0.6000	0.7746
No log	7.0690	410	0.5997	0.7541	0.5997	0.7744
No log	7.1034	412	0.5965	0.7635	0.5965	0.7723
No log	7.1379	414	0.6013	0.7638	0.6013	0.7754
No log	7.1724	416	0.6028	0.7494	0.6028	0.7764
No log	7.2069	418	0.6028	0.7557	0.6028	0.7764
No log	7.2414	420	0.5847	0.7421	0.5847	0.7646
No log	7.2759	422	0.5718	0.7564	0.5718	0.7562
No log	7.3103	424	0.5676	0.7649	0.5676	0.7534
No log	7.3448	426	0.5680	0.7649	0.5680	0.7537
No log	7.3793	428	0.5717	0.7537	0.5717	0.7561
No log	7.4138	430	0.5809	0.7417	0.5809	0.7622
No log	7.4483	432	0.5879	0.7466	0.5879	0.7667
No log	7.4828	434	0.5804	0.7459	0.5804	0.7618
No log	7.5172	436	0.5739	0.7578	0.5739	0.7576
No log	7.5517	438	0.5754	0.7707	0.5754	0.7585
No log	7.5862	440	0.5795	0.7753	0.5795	0.7613
No log	7.6207	442	0.5906	0.7606	0.5906	0.7685
No log	7.6552	444	0.6014	0.7499	0.6014	0.7755
No log	7.6897	446	0.5939	0.7678	0.5939	0.7707
No log	7.7241	448	0.5844	0.7753	0.5844	0.7644
No log	7.7586	450	0.5786	0.7794	0.5786	0.7606
No log	7.7931	452	0.5824	0.7573	0.5824	0.7632
No log	7.8276	454	0.5836	0.7654	0.5836	0.7640
No log	7.8621	456	0.5751	0.7608	0.5751	0.7584
No log	7.8966	458	0.5689	0.7791	0.5689	0.7542
No log	7.9310	460	0.5825	0.7506	0.5825	0.7632
No log	7.9655	462	0.6040	0.7526	0.6040	0.7772
No log	8.0	464	0.6237	0.7513	0.6237	0.7898
No log	8.0345	466	0.6331	0.7429	0.6331	0.7957
No log	8.0690	468	0.6198	0.7513	0.6198	0.7873
No log	8.1034	470	0.6012	0.7580	0.6012	0.7754
No log	8.1379	472	0.5925	0.7449	0.5925	0.7697
No log	8.1724	474	0.5934	0.7433	0.5934	0.7703
No log	8.2069	476	0.5865	0.7560	0.5865	0.7659
No log	8.2414	478	0.5900	0.7560	0.5900	0.7681
No log	8.2759	480	0.6005	0.7433	0.6005	0.7749
No log	8.3103	482	0.6011	0.7433	0.6011	0.7753
No log	8.3448	484	0.5992	0.7433	0.5992	0.7741
No log	8.3793	486	0.5956	0.7531	0.5956	0.7717
No log	8.4138	488	0.5829	0.7618	0.5829	0.7635
No log	8.4483	490	0.5668	0.7817	0.5668	0.7528
No log	8.4828	492	0.5599	0.7597	0.5599	0.7483
No log	8.5172	494	0.5571	0.7597	0.5571	0.7464
No log	8.5517	496	0.5534	0.7560	0.5534	0.7439
No log	8.5862	498	0.5523	0.7560	0.5523	0.7432
0.3928	8.6207	500	0.5523	0.7597	0.5523	0.7432
0.3928	8.6552	502	0.5507	0.7615	0.5507	0.7421
0.3928	8.6897	504	0.5482	0.7714	0.5482	0.7404
0.3928	8.7241	506	0.5479	0.7714	0.5479	0.7402
0.3928	8.7586	508	0.5520	0.7714	0.5520	0.7430
0.3928	8.7931	510	0.5564	0.7799	0.5564	0.7459
0.3928	8.8276	512	0.5560	0.7853	0.5560	0.7457
0.3928	8.8621	514	0.5540	0.7727	0.5540	0.7443
0.3928	8.8966	516	0.5512	0.7727	0.5512	0.7424
0.3928	8.9310	518	0.5504	0.7727	0.5504	0.7419
0.3928	8.9655	520	0.5500	0.7708	0.5500	0.7416
0.3928	9.0	522	0.5523	0.7708	0.5523	0.7432
0.3928	9.0345	524	0.5573	0.7721	0.5573	0.7465
0.3928	9.0690	526	0.5591	0.7619	0.5591	0.7477
0.3928	9.1034	528	0.5581	0.7619	0.5581	0.7471
0.3928	9.1379	530	0.5562	0.7536	0.5562	0.7458
0.3928	9.1724	532	0.5534	0.7581	0.5534	0.7439
0.3928	9.2069	534	0.5505	0.7548	0.5505	0.7420
0.3928	9.2414	536	0.5483	0.7591	0.5483	0.7405
0.3928	9.2759	538	0.5458	0.7591	0.5458	0.7388
0.3928	9.3103	540	0.5453	0.7591	0.5453	0.7385
0.3928	9.3448	542	0.5460	0.7591	0.5460	0.7389
0.3928	9.3793	544	0.5484	0.7591	0.5484	0.7405
0.3928	9.4138	546	0.5495	0.7591	0.5495	0.7413
0.3928	9.4483	548	0.5510	0.7591	0.5510	0.7423
0.3928	9.4828	550	0.5532	0.7488	0.5532	0.7438
0.3928	9.5172	552	0.5529	0.7488	0.5529	0.7436
0.3928	9.5517	554	0.5534	0.7544	0.5534	0.7439
0.3928	9.5862	556	0.5535	0.7544	0.5535	0.7440
0.3928	9.6207	558	0.5538	0.7539	0.5538	0.7442
0.3928	9.6552	560	0.5529	0.7482	0.5529	0.7436
0.3928	9.6897	562	0.5513	0.7591	0.5513	0.7425
0.3928	9.7241	564	0.5506	0.7591	0.5506	0.7420
0.3928	9.7586	566	0.5502	0.7591	0.5502	0.7418
0.3928	9.7931	568	0.5495	0.7591	0.5495	0.7413
0.3928	9.8276	570	0.5497	0.7591	0.5497	0.7414
0.3928	9.8621	572	0.5503	0.7591	0.5503	0.7418
0.3928	9.8966	574	0.5510	0.7591	0.5510	0.7423
0.3928	9.9310	576	0.5514	0.7591	0.5514	0.7425
0.3928	9.9655	578	0.5517	0.7591	0.5517	0.7428
0.3928	10.0	580	0.5519	0.7591	0.5519	0.7429

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1