ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5668
• Qwk: 0.4286
• Mse: 0.5668
• Rmse: 0.7529

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	3.3328	-0.0138	3.3328	1.8256
No log	0.0645	4	1.7633	-0.0070	1.7633	1.3279
No log	0.0968	6	1.3471	0.0270	1.3471	1.1606
No log	0.1290	8	0.8771	0.1770	0.8771	0.9365
No log	0.1613	10	0.6398	0.0725	0.6398	0.7999
No log	0.1935	12	0.6519	-0.0196	0.6519	0.8074
No log	0.2258	14	1.4722	0.0789	1.4722	1.2133
No log	0.2581	16	0.7648	0.2169	0.7648	0.8745
No log	0.2903	18	0.6911	0.0	0.6911	0.8313
No log	0.3226	20	0.9672	0.2131	0.9672	0.9834
No log	0.3548	22	0.6000	0.1169	0.6000	0.7746
No log	0.3871	24	0.8665	0.0164	0.8665	0.9308
No log	0.4194	26	0.8084	0.0213	0.8084	0.8991
No log	0.4516	28	0.7082	0.2161	0.7082	0.8415
No log	0.4839	30	1.1686	0.0201	1.1686	1.0810
No log	0.5161	32	0.8447	0.1579	0.8447	0.9191
No log	0.5484	34	0.5767	0.1773	0.5767	0.7594
No log	0.5806	36	0.5990	0.2308	0.5990	0.7740
No log	0.6129	38	0.5538	0.1176	0.5538	0.7442
No log	0.6452	40	0.6078	0.2381	0.6078	0.7796
No log	0.6774	42	0.7405	0.2432	0.7405	0.8605
No log	0.7097	44	0.6987	0.2381	0.6987	0.8359
No log	0.7419	46	0.6749	0.2157	0.6749	0.8215
No log	0.7742	48	0.5344	0.1773	0.5344	0.7310
No log	0.8065	50	0.8328	0.2294	0.8328	0.9126
No log	0.8387	52	0.6910	0.2707	0.6910	0.8313
No log	0.8710	54	0.6386	0.2577	0.6386	0.7991
No log	0.9032	56	1.4083	0.1566	1.4083	1.1867
No log	0.9355	58	1.2614	0.1672	1.2614	1.1231
No log	0.9677	60	0.5298	0.2683	0.5298	0.7279
No log	1.0	62	0.7075	0.2809	0.7075	0.8411
No log	1.0323	64	0.7153	0.2787	0.7153	0.8457
No log	1.0645	66	0.4939	0.3197	0.4939	0.7027
No log	1.0968	68	0.5687	0.2865	0.5687	0.7541
No log	1.1290	70	0.6664	0.3116	0.6664	0.8163
No log	1.1613	72	0.4891	0.3407	0.4891	0.6994
No log	1.1935	74	0.8260	0.2520	0.8260	0.9088
No log	1.2258	76	0.7897	0.2397	0.7897	0.8887
No log	1.2581	78	0.5195	0.4607	0.5195	0.7208
No log	1.2903	80	0.7360	0.3000	0.7360	0.8579
No log	1.3226	82	0.6005	0.3402	0.6005	0.7749
No log	1.3548	84	0.4637	0.2533	0.4637	0.6810
No log	1.3871	86	0.4542	0.2821	0.4542	0.6739
No log	1.4194	88	0.5307	0.4225	0.5307	0.7285
No log	1.4516	90	0.4757	0.3953	0.4757	0.6897
No log	1.4839	92	0.4638	0.4286	0.4638	0.6810
No log	1.5161	94	0.6328	0.2965	0.6328	0.7955
No log	1.5484	96	0.4647	0.4348	0.4647	0.6817
No log	1.5806	98	0.6501	0.3004	0.6501	0.8063
No log	1.6129	100	0.5947	0.3846	0.5947	0.7711
No log	1.6452	102	0.5093	0.3829	0.5093	0.7137
No log	1.6774	104	0.7641	0.1525	0.7641	0.8741
No log	1.7097	106	0.5880	0.3966	0.5880	0.7668
No log	1.7419	108	0.5686	0.2245	0.5686	0.7541
No log	1.7742	110	0.7249	0.3251	0.7249	0.8514
No log	1.8065	112	0.5102	0.3684	0.5102	0.7143
No log	1.8387	114	0.8199	0.1535	0.8199	0.9055
No log	1.8710	116	1.1664	0.1945	1.1664	1.0800
No log	1.9032	118	0.7433	0.2511	0.7433	0.8622
No log	1.9355	120	0.5109	0.3191	0.5109	0.7148
No log	1.9677	122	0.9307	0.1884	0.9307	0.9647
No log	2.0	124	0.9798	0.2664	0.9798	0.9898
No log	2.0323	126	0.5951	0.3394	0.5951	0.7714
No log	2.0645	128	0.6856	0.4050	0.6856	0.8280
No log	2.0968	130	0.6703	0.4286	0.6703	0.8187
No log	2.1290	132	0.4837	0.4526	0.4837	0.6955
No log	2.1613	134	0.5970	0.3077	0.5970	0.7727
No log	2.1935	136	0.4956	0.3939	0.4956	0.7040
No log	2.2258	138	0.5257	0.5025	0.5257	0.7250
No log	2.2581	140	0.7618	0.2741	0.7618	0.8728
No log	2.2903	142	0.7007	0.3600	0.7007	0.8371
No log	2.3226	144	0.5259	0.4909	0.5259	0.7252
No log	2.3548	146	0.4842	0.4627	0.4842	0.6958
No log	2.3871	148	0.4845	0.52	0.4845	0.6961
No log	2.4194	150	0.8159	0.3669	0.8159	0.9033
No log	2.4516	152	1.0376	0.25	1.0376	1.0186
No log	2.4839	154	0.8307	0.3258	0.8307	0.9114
No log	2.5161	156	0.7796	0.3258	0.7796	0.8830
No log	2.5484	158	0.4942	0.4975	0.4942	0.7030
No log	2.5806	160	0.4612	0.5644	0.4612	0.6792
No log	2.6129	162	0.6566	0.4338	0.6566	0.8103
No log	2.6452	164	1.0397	0.2418	1.0397	1.0196
No log	2.6774	166	0.8346	0.2401	0.8346	0.9135
No log	2.7097	168	0.5256	0.4833	0.5256	0.7250
No log	2.7419	170	0.5105	0.5248	0.5105	0.7145
No log	2.7742	172	0.6923	0.3684	0.6923	0.8321
No log	2.8065	174	0.7043	0.3571	0.7043	0.8392
No log	2.8387	176	0.5527	0.4694	0.5527	0.7435
No log	2.8710	178	0.5477	0.5074	0.5477	0.7400
No log	2.9032	180	0.5924	0.4732	0.5924	0.7697
No log	2.9355	182	0.8026	0.2389	0.8026	0.8959
No log	2.9677	184	0.9297	0.1818	0.9297	0.9642
No log	3.0	186	0.6602	0.4233	0.6602	0.8125
No log	3.0323	188	0.6188	0.3939	0.6188	0.7867
No log	3.0645	190	0.5799	0.4526	0.5799	0.7615
No log	3.0968	192	0.5614	0.4526	0.5614	0.7493
No log	3.1290	194	0.6737	0.2070	0.6737	0.8208
No log	3.1613	196	0.8411	0.2797	0.8411	0.9171
No log	3.1935	198	0.6800	0.3080	0.6800	0.8246
No log	3.2258	200	0.4877	0.5183	0.4877	0.6984
No log	3.2581	202	0.5894	0.4862	0.5894	0.7677
No log	3.2903	204	0.4459	0.5145	0.4459	0.6678
No log	3.3226	206	0.5812	0.1828	0.5812	0.7624
No log	3.3548	208	0.5813	0.2809	0.5813	0.7624
No log	3.3871	210	0.4685	0.4937	0.4685	0.6845
No log	3.4194	212	0.5810	0.3297	0.5810	0.7622
No log	3.4516	214	0.7275	0.0741	0.7275	0.8530
No log	3.4839	216	0.6808	0.1770	0.6808	0.8251
No log	3.5161	218	0.4846	0.4491	0.4846	0.6962
No log	3.5484	220	0.8423	0.2456	0.8423	0.9178
No log	3.5806	222	1.0871	0.2418	1.0871	1.0426
No log	3.6129	224	0.7812	0.2416	0.7812	0.8839
No log	3.6452	226	0.5207	0.4872	0.5207	0.7216
No log	3.6774	228	0.6357	0.2676	0.6357	0.7973
No log	3.7097	230	0.5524	0.4227	0.5524	0.7433
No log	3.7419	232	0.5106	0.4286	0.5106	0.7145
No log	3.7742	234	0.5934	0.3990	0.5934	0.7703
No log	3.8065	236	0.5537	0.4098	0.5537	0.7441
No log	3.8387	238	0.5027	0.5	0.5027	0.7090
No log	3.8710	240	0.4837	0.4634	0.4837	0.6955
No log	3.9032	242	0.4781	0.4012	0.4781	0.6915
No log	3.9355	244	0.4969	0.5359	0.4969	0.7049
No log	3.9677	246	0.5186	0.4839	0.5186	0.7201
No log	4.0	248	0.6676	0.3739	0.6676	0.8170
No log	4.0323	250	0.8115	0.2672	0.8115	0.9008
No log	4.0645	252	0.7304	0.2727	0.7304	0.8546
No log	4.0968	254	0.5482	0.5681	0.5482	0.7404
No log	4.1290	256	0.5569	0.5681	0.5569	0.7463
No log	4.1613	258	0.5831	0.4783	0.5831	0.7636
No log	4.1935	260	0.5340	0.4732	0.5340	0.7308
No log	4.2258	262	0.5160	0.5468	0.5160	0.7184
No log	4.2581	264	0.5388	0.4732	0.5388	0.7340
No log	4.2903	266	0.5575	0.4833	0.5575	0.7467
No log	4.3226	268	0.6175	0.4554	0.6175	0.7858
No log	4.3548	270	0.6467	0.4439	0.6467	0.8042
No log	4.3871	272	0.6550	0.4286	0.6550	0.8093
No log	4.4194	274	0.7299	0.2405	0.7299	0.8543
No log	4.4516	276	0.7461	0.2397	0.7461	0.8638
No log	4.4839	278	0.6398	0.3846	0.6398	0.7999
No log	4.5161	280	0.6037	0.4396	0.6037	0.7770
No log	4.5484	282	0.7118	0.3138	0.7118	0.8437
No log	4.5806	284	0.7803	0.2756	0.7803	0.8834
No log	4.6129	286	0.6547	0.4237	0.6547	0.8092
No log	4.6452	288	0.6139	0.4632	0.6139	0.7835
No log	4.6774	290	0.5882	0.4495	0.5882	0.7669
No log	4.7097	292	0.6531	0.3448	0.6531	0.8081
No log	4.7419	294	0.6664	0.3418	0.6664	0.8163
No log	4.7742	296	0.5826	0.4233	0.5826	0.7633
No log	4.8065	298	0.5749	0.4233	0.5749	0.7582
No log	4.8387	300	0.6139	0.4286	0.6139	0.7835
No log	4.8710	302	0.5715	0.4286	0.5715	0.7560
No log	4.9032	304	0.5423	0.4233	0.5423	0.7364
No log	4.9355	306	0.5286	0.4341	0.5286	0.7271
No log	4.9677	308	0.5994	0.3886	0.5994	0.7742
No log	5.0	310	0.7754	0.2977	0.7754	0.8806
No log	5.0323	312	0.8126	0.2797	0.8126	0.9015
No log	5.0645	314	0.6334	0.4188	0.6334	0.7959
No log	5.0968	316	0.4954	0.3913	0.4954	0.7039
No log	5.1290	318	0.4767	0.4483	0.4767	0.6904
No log	5.1613	320	0.5224	0.3878	0.5224	0.7227
No log	5.1935	322	0.6728	0.3427	0.6728	0.8203
No log	5.2258	324	0.6344	0.2332	0.6344	0.7965
No log	5.2581	326	0.5046	0.5056	0.5046	0.7104
No log	5.2903	328	0.4706	0.4483	0.4706	0.6860
No log	5.3226	330	0.5140	0.4468	0.5140	0.7170
No log	5.3548	332	0.7536	0.3103	0.7536	0.8681
No log	5.3871	334	0.9621	0.2806	0.9621	0.9808
No log	5.4194	336	0.9135	0.3063	0.9135	0.9558
No log	5.4516	338	0.6971	0.4150	0.6971	0.8349
No log	5.4839	340	0.5233	0.4615	0.5233	0.7234
No log	5.5161	342	0.5128	0.4615	0.5128	0.7161
No log	5.5484	344	0.6001	0.3684	0.6001	0.7747
No log	5.5806	346	0.8442	0.2782	0.8442	0.9188
No log	5.6129	348	1.0687	0.2703	1.0687	1.0338
No log	5.6452	350	0.9885	0.2715	0.9885	0.9943
No log	5.6774	352	0.7347	0.2531	0.7347	0.8571
No log	5.7097	354	0.5240	0.4225	0.5240	0.7239
No log	5.7419	356	0.4379	0.5238	0.4379	0.6617
No log	5.7742	358	0.4401	0.5132	0.4401	0.6634
No log	5.8065	360	0.4420	0.5847	0.4420	0.6648
No log	5.8387	362	0.5057	0.4747	0.5057	0.7111
No log	5.8710	364	0.6700	0.3518	0.6700	0.8185
No log	5.9032	366	0.6444	0.4104	0.6444	0.8027
No log	5.9355	368	0.5711	0.4690	0.5711	0.7557
No log	5.9677	370	0.4958	0.5434	0.4958	0.7042
No log	6.0	372	0.5213	0.4751	0.5213	0.7220
No log	6.0323	374	0.6238	0.4622	0.6238	0.7898
No log	6.0645	376	0.5708	0.4035	0.5708	0.7555
No log	6.0968	378	0.4775	0.4468	0.4775	0.6910
No log	6.1290	380	0.4577	0.5238	0.4577	0.6765
No log	6.1613	382	0.4461	0.5238	0.4461	0.6679
No log	6.1935	384	0.4626	0.4909	0.4626	0.6802
No log	6.2258	386	0.4790	0.4909	0.4790	0.6921
No log	6.2581	388	0.4786	0.4909	0.4786	0.6918
No log	6.2903	390	0.4548	0.4943	0.4548	0.6744
No log	6.3226	392	0.4677	0.4943	0.4677	0.6839
No log	6.3548	394	0.5062	0.4229	0.5062	0.7115
No log	6.3871	396	0.5992	0.3818	0.5992	0.7741
No log	6.4194	398	0.5665	0.4128	0.5665	0.7526
No log	6.4516	400	0.5518	0.4680	0.5518	0.7428
No log	6.4839	402	0.4913	0.4909	0.4913	0.7009
No log	6.5161	404	0.4639	0.4491	0.4639	0.6811
No log	6.5484	406	0.4639	0.3810	0.4639	0.6811
No log	6.5806	408	0.4607	0.3939	0.4607	0.6788
No log	6.6129	410	0.4729	0.5	0.4729	0.6877
No log	6.6452	412	0.5235	0.4074	0.5235	0.7236
No log	6.6774	414	0.5403	0.4012	0.5403	0.7351
No log	6.7097	416	0.5539	0.3846	0.5539	0.7442
No log	6.7419	418	0.5846	0.4182	0.5846	0.7646
No log	6.7742	420	0.5320	0.4462	0.5320	0.7294
No log	6.8065	422	0.4818	0.4802	0.4818	0.6941
No log	6.8387	424	0.4798	0.5556	0.4798	0.6927
No log	6.8710	426	0.4947	0.4802	0.4947	0.7034
No log	6.9032	428	0.5511	0.4615	0.5511	0.7424
No log	6.9355	430	0.6176	0.3778	0.6176	0.7859
No log	6.9677	432	0.7202	0.3684	0.7202	0.8486
No log	7.0	434	0.7276	0.3443	0.7276	0.8530
No log	7.0323	436	0.6531	0.3702	0.6531	0.8081
No log	7.0645	438	0.5470	0.3927	0.5470	0.7396
No log	7.0968	440	0.5073	0.5183	0.5073	0.7122
No log	7.1290	442	0.5062	0.4343	0.5062	0.7115
No log	7.1613	444	0.5099	0.5254	0.5099	0.7141
No log	7.1935	446	0.5628	0.3535	0.5628	0.7502
No log	7.2258	448	0.6273	0.3299	0.6273	0.7920
No log	7.2581	450	0.6549	0.3725	0.6549	0.8093
No log	7.2903	452	0.6073	0.3299	0.6073	0.7793
No log	7.3226	454	0.5366	0.4162	0.5366	0.7325
No log	7.3548	456	0.5144	0.3708	0.5144	0.7172
No log	7.3871	458	0.4994	0.4091	0.4994	0.7067
No log	7.4194	460	0.5351	0.4105	0.5351	0.7315
No log	7.4516	462	0.6064	0.3623	0.6064	0.7787
No log	7.4839	464	0.6544	0.3739	0.6544	0.8090
No log	7.5161	466	0.6513	0.3739	0.6513	0.8070
No log	7.5484	468	0.5668	0.4	0.5668	0.7528
No log	7.5806	470	0.5270	0.4286	0.5270	0.7259
No log	7.6129	472	0.5125	0.4682	0.5125	0.7159
No log	7.6452	474	0.5458	0.4105	0.5458	0.7388
No log	7.6774	476	0.6245	0.3962	0.6245	0.7902
No log	7.7097	478	0.6991	0.2727	0.6991	0.8361
No log	7.7419	480	0.6637	0.3514	0.6637	0.8147
No log	7.7742	482	0.5701	0.3706	0.5701	0.7550
No log	7.8065	484	0.4961	0.4286	0.4961	0.7044
No log	7.8387	486	0.4805	0.4682	0.4805	0.6932
No log	7.8710	488	0.5013	0.4286	0.5013	0.7080
No log	7.9032	490	0.5755	0.3706	0.5755	0.7586
No log	7.9355	492	0.6514	0.3480	0.6514	0.8071
No log	7.9677	494	0.6465	0.3667	0.6465	0.8040
No log	8.0	496	0.5684	0.3706	0.5684	0.7539
No log	8.0323	498	0.4924	0.4286	0.4924	0.7017
0.4254	8.0645	500	0.4714	0.5	0.4714	0.6866
0.4254	8.0968	502	0.4761	0.5	0.4761	0.6900
0.4254	8.1290	504	0.4879	0.4353	0.4879	0.6985
0.4254	8.1613	506	0.5023	0.4286	0.5023	0.7087
0.4254	8.1935	508	0.5035	0.4286	0.5035	0.7096
0.4254	8.2258	510	0.5368	0.4222	0.5368	0.7326
0.4254	8.2581	512	0.5454	0.4162	0.5454	0.7385
0.4254	8.2903	514	0.5341	0.4162	0.5341	0.7308
0.4254	8.3226	516	0.5003	0.4353	0.5003	0.7073
0.4254	8.3548	518	0.4924	0.5	0.4924	0.7017
0.4254	8.3871	520	0.4969	0.5	0.4969	0.7049
0.4254	8.4194	522	0.5169	0.4764	0.5169	0.7190
0.4254	8.4516	524	0.5529	0.4051	0.5529	0.7436
0.4254	8.4839	526	0.5779	0.4231	0.5779	0.7602
0.4254	8.5161	528	0.5580	0.4231	0.5580	0.7470
0.4254	8.5484	530	0.5453	0.4404	0.5453	0.7384
0.4254	8.5806	532	0.5251	0.4764	0.5251	0.7246
0.4254	8.6129	534	0.5251	0.4764	0.5251	0.7247
0.4254	8.6452	536	0.5334	0.4404	0.5334	0.7303
0.4254	8.6774	538	0.5627	0.4231	0.5627	0.7501
0.4254	8.7097	540	0.5828	0.4178	0.5828	0.7634
0.4254	8.7419	542	0.5805	0.4178	0.5805	0.7619
0.4254	8.7742	544	0.5979	0.4495	0.5979	0.7732
0.4254	8.8065	546	0.5903	0.4178	0.5903	0.7683
0.4254	8.8387	548	0.5674	0.4	0.5674	0.7532
0.4254	8.8710	550	0.5501	0.4105	0.5501	0.7417
0.4254	8.9032	552	0.5502	0.4105	0.5502	0.7417
0.4254	8.9355	554	0.5553	0.4051	0.5553	0.7452
0.4254	8.9677	556	0.5666	0.4	0.5666	0.7527
0.4254	9.0	558	0.5696	0.4	0.5696	0.7547
0.4254	9.0323	560	0.5669	0.4	0.5669	0.7529
0.4254	9.0645	562	0.5716	0.4	0.5716	0.7561
0.4254	9.0968	564	0.5860	0.4	0.5860	0.7655
0.4254	9.1290	566	0.5822	0.4	0.5822	0.7630
0.4254	9.1613	568	0.5823	0.4	0.5823	0.7631
0.4254	9.1935	570	0.5798	0.4178	0.5798	0.7615
0.4254	9.2258	572	0.5987	0.4178	0.5987	0.7738
0.4254	9.2581	574	0.6127	0.4128	0.6127	0.7827
0.4254	9.2903	576	0.6213	0.4128	0.6213	0.7882
0.4254	9.3226	578	0.6266	0.4439	0.6266	0.7916
0.4254	9.3548	580	0.6192	0.4128	0.6192	0.7869
0.4254	9.3871	582	0.6073	0.4128	0.6073	0.7793
0.4254	9.4194	584	0.6000	0.4389	0.6000	0.7746
0.4254	9.4516	586	0.5992	0.4389	0.5992	0.7741
0.4254	9.4839	588	0.6088	0.4128	0.6088	0.7802
0.4254	9.5161	590	0.6085	0.4128	0.6085	0.7800
0.4254	9.5484	592	0.6045	0.4128	0.6045	0.7775
0.4254	9.5806	594	0.5903	0.4444	0.5903	0.7683
0.4254	9.6129	596	0.5817	0.4286	0.5817	0.7627
0.4254	9.6452	598	0.5782	0.4286	0.5782	0.7604
0.4254	9.6774	600	0.5813	0.4286	0.5813	0.7624
0.4254	9.7097	602	0.5809	0.4286	0.5809	0.7622
0.4254	9.7419	604	0.5817	0.4286	0.5817	0.7627
0.4254	9.7742	606	0.5833	0.4286	0.5833	0.7637
0.4254	9.8065	608	0.5826	0.4286	0.5826	0.7633
0.4254	9.8387	610	0.5780	0.4286	0.5780	0.7602
0.4254	9.8710	612	0.5724	0.4286	0.5724	0.7566
0.4254	9.9032	614	0.5679	0.4286	0.5679	0.7536
0.4254	9.9355	616	0.5667	0.4286	0.5667	0.7528
0.4254	9.9677	618	0.5666	0.4286	0.5666	0.7527
0.4254	10.0	620	0.5668	0.4286	0.5668	0.7529

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1