ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7505
• Qwk: 0.7180
• Mse: 0.7505
• Rmse: 0.8663

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	2.3093	0.0485	2.3093	1.5196
No log	0.0976	4	1.6228	0.2043	1.6228	1.2739
No log	0.1463	6	1.4374	0.1477	1.4374	1.1989
No log	0.1951	8	1.6755	0.1933	1.6755	1.2944
No log	0.2439	10	1.8701	0.2644	1.8701	1.3675
No log	0.2927	12	1.9137	0.2336	1.9137	1.3834
No log	0.3415	14	1.5607	0.1022	1.5607	1.2493
No log	0.3902	16	1.4914	0.1504	1.4914	1.2212
No log	0.4390	18	1.4634	0.1551	1.4634	1.2097
No log	0.4878	20	1.7128	0.3185	1.7128	1.3087
No log	0.5366	22	1.9576	0.2731	1.9576	1.3992
No log	0.5854	24	1.8912	0.2829	1.8912	1.3752
No log	0.6341	26	1.5893	0.3151	1.5893	1.2607
No log	0.6829	28	1.4040	0.2766	1.4040	1.1849
No log	0.7317	30	1.3435	0.3413	1.3435	1.1591
No log	0.7805	32	1.4384	0.3729	1.4384	1.1993
No log	0.8293	34	1.3642	0.3346	1.3642	1.1680
No log	0.8780	36	1.2255	0.3460	1.2255	1.1070
No log	0.9268	38	1.1646	0.3818	1.1646	1.0792
No log	0.9756	40	1.2134	0.4211	1.2134	1.1015
No log	1.0244	42	1.3045	0.3417	1.3045	1.1421
No log	1.0732	44	1.3274	0.3496	1.3274	1.1521
No log	1.1220	46	1.2634	0.3267	1.2634	1.1240
No log	1.1707	48	1.1124	0.4010	1.1124	1.0547
No log	1.2195	50	1.1079	0.4233	1.1079	1.0526
No log	1.2683	52	1.1493	0.3597	1.1493	1.0721
No log	1.3171	54	1.2458	0.3168	1.2458	1.1162
No log	1.3659	56	1.2598	0.3176	1.2598	1.1224
No log	1.4146	58	1.1884	0.3566	1.1884	1.0901
No log	1.4634	60	1.1718	0.3397	1.1718	1.0825
No log	1.5122	62	1.1683	0.3998	1.1683	1.0809
No log	1.5610	64	1.2867	0.4103	1.2867	1.1343
No log	1.6098	66	1.2591	0.4331	1.2591	1.1221
No log	1.6585	68	1.2264	0.4245	1.2264	1.1074
No log	1.7073	70	1.2352	0.4416	1.2352	1.1114
No log	1.7561	72	1.1621	0.4482	1.1621	1.0780
No log	1.8049	74	1.0999	0.4886	1.0999	1.0488
No log	1.8537	76	1.1117	0.5272	1.1117	1.0544
No log	1.9024	78	1.0057	0.5276	1.0057	1.0029
No log	1.9512	80	1.1280	0.5326	1.1280	1.0621
No log	2.0	82	1.2703	0.5454	1.2703	1.1271
No log	2.0488	84	1.2249	0.5497	1.2249	1.1067
No log	2.0976	86	1.1750	0.5646	1.1750	1.0840
No log	2.1463	88	1.3702	0.5015	1.3702	1.1706
No log	2.1951	90	1.4562	0.4999	1.4562	1.2067
No log	2.2439	92	1.2384	0.5527	1.2384	1.1128
No log	2.2927	94	1.0232	0.5419	1.0232	1.0115
No log	2.3415	96	1.0254	0.5375	1.0254	1.0126
No log	2.3902	98	1.3660	0.5303	1.3660	1.1688
No log	2.4390	100	1.9181	0.4450	1.9181	1.3850
No log	2.4878	102	1.7570	0.4643	1.7570	1.3255
No log	2.5366	104	1.2053	0.5166	1.2053	1.0979
No log	2.5854	106	1.0222	0.5209	1.0222	1.0110
No log	2.6341	108	0.9426	0.5444	0.9426	0.9709
No log	2.6829	110	0.9655	0.5716	0.9655	0.9826
No log	2.7317	112	1.0580	0.5409	1.0580	1.0286
No log	2.7805	114	1.2646	0.5459	1.2646	1.1246
No log	2.8293	116	1.0675	0.5854	1.0675	1.0332
No log	2.8780	118	0.9243	0.6057	0.9243	0.9614
No log	2.9268	120	0.8362	0.6491	0.8362	0.9144
No log	2.9756	122	0.8715	0.6231	0.8715	0.9335
No log	3.0244	124	0.9279	0.6317	0.9279	0.9633
No log	3.0732	126	1.1015	0.6027	1.1015	1.0495
No log	3.1220	128	1.1281	0.5703	1.1281	1.0621
No log	3.1707	130	1.1147	0.5703	1.1147	1.0558
No log	3.2195	132	1.1059	0.5810	1.1059	1.0516
No log	3.2683	134	1.3626	0.5215	1.3626	1.1673
No log	3.3171	136	1.5905	0.5134	1.5905	1.2612
No log	3.3659	138	1.3751	0.5206	1.3751	1.1727
No log	3.4146	140	1.0783	0.6046	1.0783	1.0384
No log	3.4634	142	0.8889	0.6303	0.8889	0.9428
No log	3.5122	144	0.9683	0.6186	0.9683	0.9840
No log	3.5610	146	1.1465	0.5806	1.1465	1.0708
No log	3.6098	148	1.0754	0.6094	1.0754	1.0370
No log	3.6585	150	1.0120	0.6140	1.0120	1.0060
No log	3.7073	152	1.1116	0.6106	1.1116	1.0543
No log	3.7561	154	1.3154	0.5885	1.3154	1.1469
No log	3.8049	156	1.2573	0.5715	1.2573	1.1213
No log	3.8537	158	1.0012	0.6053	1.0012	1.0006
No log	3.9024	160	0.9097	0.6480	0.9097	0.9538
No log	3.9512	162	1.0063	0.6188	1.0063	1.0031
No log	4.0	164	1.1566	0.5776	1.1566	1.0755
No log	4.0488	166	1.0958	0.5916	1.0958	1.0468
No log	4.0976	168	1.0846	0.6033	1.0846	1.0414
No log	4.1463	170	1.0561	0.6205	1.0561	1.0277
No log	4.1951	172	0.9943	0.6461	0.9943	0.9971
No log	4.2439	174	0.8951	0.6652	0.8951	0.9461
No log	4.2927	176	0.9209	0.6423	0.9209	0.9596
No log	4.3415	178	1.1057	0.6391	1.1057	1.0515
No log	4.3902	180	1.1977	0.5852	1.1977	1.0944
No log	4.4390	182	1.0190	0.6444	1.0190	1.0095
No log	4.4878	184	0.9425	0.6515	0.9425	0.9708
No log	4.5366	186	0.9684	0.6647	0.9684	0.9841
No log	4.5854	188	0.9863	0.6721	0.9863	0.9931
No log	4.6341	190	1.1118	0.5996	1.1118	1.0544
No log	4.6829	192	1.1947	0.6068	1.1947	1.0930
No log	4.7317	194	1.1698	0.6222	1.1698	1.0816
No log	4.7805	196	1.0634	0.6296	1.0634	1.0312
No log	4.8293	198	0.9034	0.6639	0.9034	0.9505
No log	4.8780	200	0.9190	0.6639	0.9190	0.9587
No log	4.9268	202	1.0125	0.6498	1.0125	1.0062
No log	4.9756	204	0.9852	0.6474	0.9852	0.9926
No log	5.0244	206	0.8251	0.7002	0.8251	0.9083
No log	5.0732	208	0.8329	0.6983	0.8329	0.9126
No log	5.1220	210	0.9053	0.6287	0.9053	0.9515
No log	5.1707	212	0.9635	0.6414	0.9635	0.9816
No log	5.2195	214	0.8513	0.6978	0.8513	0.9226
No log	5.2683	216	0.8607	0.6865	0.8607	0.9278
No log	5.3171	218	0.9613	0.6656	0.9613	0.9805
No log	5.3659	220	0.9677	0.6656	0.9677	0.9837
No log	5.4146	222	1.0750	0.6531	1.0750	1.0368
No log	5.4634	224	0.9422	0.6811	0.9422	0.9707
No log	5.5122	226	0.8470	0.6905	0.8470	0.9203
No log	5.5610	228	0.7966	0.7032	0.7966	0.8925
No log	5.6098	230	0.7420	0.7154	0.7420	0.8614
No log	5.6585	232	0.8580	0.6865	0.8580	0.9263
No log	5.7073	234	1.1597	0.6159	1.1597	1.0769
No log	5.7561	236	1.3653	0.6132	1.3653	1.1685
No log	5.8049	238	1.3577	0.6143	1.3577	1.1652
No log	5.8537	240	1.1297	0.6145	1.1297	1.0629
No log	5.9024	242	0.9182	0.6679	0.9182	0.9582
No log	5.9512	244	0.8698	0.6928	0.8698	0.9327
No log	6.0	246	0.7896	0.7079	0.7896	0.8886
No log	6.0488	248	0.8171	0.7079	0.8171	0.9039
No log	6.0976	250	0.8830	0.6887	0.8830	0.9397
No log	6.1463	252	0.8605	0.6958	0.8605	0.9276
No log	6.1951	254	0.8631	0.6958	0.8631	0.9290
No log	6.2439	256	0.8062	0.6998	0.8062	0.8979
No log	6.2927	258	0.7843	0.7006	0.7843	0.8856
No log	6.3415	260	0.9107	0.7008	0.9107	0.9543
No log	6.3902	262	0.9758	0.6665	0.9758	0.9878
No log	6.4390	264	0.8787	0.7008	0.8787	0.9374
No log	6.4878	266	0.7302	0.7223	0.7302	0.8545
No log	6.5366	268	0.6731	0.7156	0.6731	0.8204
No log	6.5854	270	0.7218	0.7185	0.7218	0.8496
No log	6.6341	272	0.8933	0.6775	0.8933	0.9451
No log	6.6829	274	1.0963	0.6385	1.0963	1.0470
No log	6.7317	276	1.1059	0.6373	1.1059	1.0516
No log	6.7805	278	0.9715	0.6610	0.9715	0.9856
No log	6.8293	280	0.8051	0.7072	0.8051	0.8973
No log	6.8780	282	0.7121	0.7265	0.7121	0.8439
No log	6.9268	284	0.7253	0.7302	0.7253	0.8517
No log	6.9756	286	0.7620	0.7139	0.7620	0.8729
No log	7.0244	288	0.7432	0.7266	0.7432	0.8621
No log	7.0732	290	0.7185	0.7187	0.7185	0.8477
No log	7.1220	292	0.7514	0.7288	0.7514	0.8668
No log	7.1707	294	0.8895	0.6878	0.8895	0.9431
No log	7.2195	296	1.0797	0.6644	1.0797	1.0391
No log	7.2683	298	1.1126	0.6505	1.1126	1.0548
No log	7.3171	300	1.0273	0.6650	1.0273	1.0136
No log	7.3659	302	0.9621	0.6626	0.9621	0.9809
No log	7.4146	304	0.9298	0.6562	0.9298	0.9642
No log	7.4634	306	0.9249	0.6647	0.9249	0.9617
No log	7.5122	308	0.9468	0.6664	0.9468	0.9730
No log	7.5610	310	0.9313	0.6623	0.9313	0.9650
No log	7.6098	312	0.9417	0.6656	0.9417	0.9704
No log	7.6585	314	0.9076	0.6696	0.9076	0.9527
No log	7.7073	316	0.8344	0.6956	0.8344	0.9135
No log	7.7561	318	0.7898	0.7009	0.7898	0.8887
No log	7.8049	320	0.8020	0.6990	0.8020	0.8955
No log	7.8537	322	0.8234	0.7002	0.8234	0.9074
No log	7.9024	324	0.8324	0.7006	0.8324	0.9124
No log	7.9512	326	0.8713	0.6928	0.8713	0.9335
No log	8.0	328	0.8967	0.6916	0.8967	0.9469
No log	8.0488	330	0.8871	0.6916	0.8871	0.9419
No log	8.0976	332	0.8571	0.6928	0.8571	0.9258
No log	8.1463	334	0.8054	0.7048	0.8054	0.8975
No log	8.1951	336	0.7408	0.7329	0.7408	0.8607
No log	8.2439	338	0.7283	0.7330	0.7283	0.8534
No log	8.2927	340	0.7409	0.7329	0.7409	0.8608
No log	8.3415	342	0.7872	0.7154	0.7872	0.8873
No log	8.3902	344	0.8725	0.6916	0.8725	0.9341
No log	8.4390	346	0.9566	0.6736	0.9566	0.9781
No log	8.4878	348	1.0009	0.6477	1.0009	1.0004
No log	8.5366	350	0.9781	0.6609	0.9781	0.9890
No log	8.5854	352	0.9234	0.6624	0.9234	0.9609
No log	8.6341	354	0.8739	0.6819	0.8739	0.9348
No log	8.6829	356	0.8261	0.7060	0.8261	0.9089
No log	8.7317	358	0.8201	0.7060	0.8201	0.9056
No log	8.7805	360	0.8174	0.7060	0.8174	0.9041
No log	8.8293	362	0.7951	0.7099	0.7951	0.8917
No log	8.8780	364	0.7796	0.7180	0.7796	0.8829
No log	8.9268	366	0.7580	0.7180	0.7580	0.8706
No log	8.9756	368	0.7451	0.7302	0.7451	0.8632
No log	9.0244	370	0.7598	0.7180	0.7598	0.8717
No log	9.0732	372	0.7853	0.7180	0.7853	0.8861
No log	9.1220	374	0.8125	0.7101	0.8125	0.9014
No log	9.1707	376	0.8615	0.6923	0.8615	0.9282
No log	9.2195	378	0.9165	0.6481	0.9165	0.9573
No log	9.2683	380	0.9525	0.6562	0.9525	0.9759
No log	9.3171	382	0.9713	0.6452	0.9713	0.9856
No log	9.3659	384	0.9796	0.6452	0.9796	0.9898
No log	9.4146	386	0.9609	0.6452	0.9609	0.9803
No log	9.4634	388	0.9262	0.6495	0.9262	0.9624
No log	9.5122	390	0.8871	0.6836	0.8871	0.9419
No log	9.5610	392	0.8434	0.7060	0.8434	0.9184
No log	9.6098	394	0.8095	0.7067	0.8095	0.8997
No log	9.6585	396	0.7808	0.7080	0.7808	0.8836
No log	9.7073	398	0.7655	0.7180	0.7655	0.8749
No log	9.7561	400	0.7544	0.7259	0.7544	0.8686
No log	9.8049	402	0.7500	0.7259	0.7500	0.8660
No log	9.8537	404	0.7477	0.7259	0.7477	0.8647
No log	9.9024	406	0.7479	0.7259	0.7479	0.8648
No log	9.9512	408	0.7493	0.7180	0.7493	0.8656
No log	10.0	410	0.7505	0.7180	0.7505	0.8663

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1