ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k6_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5655
• Qwk: 0.3224
• Mse: 0.5655
• Rmse: 0.7520

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	3.0216	-0.0075	3.0216	1.7383
No log	0.1212	4	1.5959	0.0255	1.5959	1.2633
No log	0.1818	6	1.3052	0.0294	1.3052	1.1425
No log	0.2424	8	1.0128	0.0901	1.0128	1.0064
No log	0.3030	10	1.6475	0.0476	1.6475	1.2836
No log	0.3636	12	0.7544	0.1193	0.7544	0.8686
No log	0.4242	14	0.6090	0.0815	0.6090	0.7804
No log	0.4848	16	0.6047	-0.0303	0.6047	0.7776
No log	0.5455	18	0.6219	0.0933	0.6219	0.7886
No log	0.6061	20	0.6480	0.1429	0.6480	0.8050
No log	0.6667	22	0.6475	0.0286	0.6475	0.8047
No log	0.7273	24	0.6578	0.2432	0.6578	0.8110
No log	0.7879	26	0.7705	0.1373	0.7705	0.8778
No log	0.8485	28	0.7079	0.3814	0.7079	0.8414
No log	0.9091	30	1.1796	0.0790	1.1796	1.0861
No log	0.9697	32	0.8030	0.2068	0.8030	0.8961
No log	1.0303	34	0.6344	0.2184	0.6344	0.7965
No log	1.0909	36	0.6485	0.2093	0.6485	0.8053
No log	1.1515	38	0.6243	0.1411	0.6243	0.7901
No log	1.2121	40	0.8473	0.1790	0.8473	0.9205
No log	1.2727	42	0.8903	0.1795	0.8903	0.9435
No log	1.3333	44	0.6752	0.3061	0.6752	0.8217
No log	1.3939	46	0.7240	0.2621	0.7240	0.8509
No log	1.4545	48	1.2731	0.0949	1.2731	1.1283
No log	1.5152	50	1.6168	0.0850	1.6168	1.2715
No log	1.5758	52	1.0413	0.1040	1.0413	1.0204
No log	1.6364	54	0.7448	0.2475	0.7448	0.8630
No log	1.6970	56	0.7297	0.1388	0.7297	0.8542
No log	1.7576	58	0.6595	0.4051	0.6595	0.8121
No log	1.8182	60	1.1658	0.1045	1.1658	1.0797
No log	1.8788	62	1.2273	0.1158	1.2273	1.1078
No log	1.9394	64	0.5991	0.3043	0.5991	0.7740
No log	2.0	66	0.5187	0.2542	0.5187	0.7202
No log	2.0606	68	0.5108	0.2542	0.5108	0.7147
No log	2.1212	70	0.6298	0.3402	0.6298	0.7936
No log	2.1818	72	0.9484	0.2659	0.9484	0.9738
No log	2.2424	74	0.7065	0.2919	0.7065	0.8405
No log	2.3030	76	0.6691	0.2893	0.6691	0.8180
No log	2.3636	78	0.8366	0.1718	0.8366	0.9147
No log	2.4242	80	0.6334	0.4171	0.6334	0.7959
No log	2.4848	82	0.6658	0.2653	0.6658	0.8159
No log	2.5455	84	0.7885	0.4123	0.7885	0.8880
No log	2.6061	86	1.1084	0.1143	1.1084	1.0528
No log	2.6667	88	1.0505	0.1062	1.0505	1.0249
No log	2.7273	90	0.9942	0.0988	0.9942	0.9971
No log	2.7879	92	0.8066	0.3301	0.8066	0.8981
No log	2.8485	94	0.7627	0.2000	0.7627	0.8733
No log	2.9091	96	0.7437	0.3237	0.7437	0.8624
No log	2.9697	98	0.8875	0.1351	0.8875	0.9421
No log	3.0303	100	0.6647	0.3966	0.6647	0.8153
No log	3.0909	102	0.6818	0.1919	0.6818	0.8257
No log	3.1515	104	0.6291	0.2832	0.6291	0.7932
No log	3.2121	106	0.7883	0.1698	0.7883	0.8879
No log	3.2727	108	0.8530	0.1644	0.8530	0.9236
No log	3.3333	110	0.6378	0.3778	0.6378	0.7986
No log	3.3939	112	0.6577	0.3535	0.6577	0.8110
No log	3.4545	114	0.6807	0.3498	0.6807	0.8250
No log	3.5152	116	0.6830	0.2340	0.6830	0.8264
No log	3.5758	118	0.7321	0.3028	0.7321	0.8556
No log	3.6364	120	1.0119	0.1937	1.0119	1.0059
No log	3.6970	122	0.8443	0.2479	0.8443	0.9189
No log	3.7576	124	0.7201	0.2294	0.7201	0.8486
No log	3.8182	126	0.8659	0.1605	0.8659	0.9305
No log	3.8788	128	0.6971	0.2239	0.6971	0.8349
No log	3.9394	130	0.6562	0.2577	0.6562	0.8101
No log	4.0	132	0.6951	0.3103	0.6951	0.8337
No log	4.0606	134	0.5964	0.4098	0.5964	0.7723
No log	4.1212	136	0.5814	0.3182	0.5814	0.7625
No log	4.1818	138	0.5918	0.3757	0.5918	0.7693
No log	4.2424	140	0.5827	0.3182	0.5827	0.7633
No log	4.3030	142	0.5990	0.3369	0.5990	0.7739
No log	4.3636	144	0.7118	0.3103	0.7118	0.8437
No log	4.4242	146	0.7946	0.3394	0.7946	0.8914
No log	4.4848	148	0.8482	0.2646	0.8482	0.9210
No log	4.5455	150	0.6396	0.3862	0.6396	0.7998
No log	4.6061	152	0.5946	0.3617	0.5946	0.7711
No log	4.6667	154	0.6570	0.3684	0.6570	0.8106
No log	4.7273	156	0.7501	0.2850	0.7501	0.8661
No log	4.7879	158	0.6634	0.3684	0.6634	0.8145
No log	4.8485	160	0.6676	0.3684	0.6676	0.8171
No log	4.9091	162	0.6412	0.3927	0.6412	0.8008
No log	4.9697	164	0.6156	0.2432	0.6156	0.7846
No log	5.0303	166	0.7409	0.1852	0.7409	0.8608
No log	5.0909	168	0.6664	0.2079	0.6664	0.8163
No log	5.1515	170	0.6900	0.3469	0.6900	0.8307
No log	5.2121	172	1.0822	0.1781	1.0822	1.0403
No log	5.2727	174	1.1000	0.1781	1.1000	1.0488
No log	5.3333	176	0.7867	0.2074	0.7867	0.8869
No log	5.3939	178	0.6144	0.2626	0.6144	0.7838
No log	5.4545	180	0.6379	0.2251	0.6379	0.7987
No log	5.5152	182	0.6061	0.2626	0.6061	0.7785
No log	5.5758	184	0.6390	0.3769	0.6390	0.7994
No log	5.6364	186	0.8401	0.1776	0.8401	0.9165
No log	5.6970	188	0.8874	0.1504	0.8874	0.9420
No log	5.7576	190	0.7010	0.3684	0.7010	0.8372
No log	5.8182	192	0.5994	0.2527	0.5994	0.7742
No log	5.8788	194	0.6525	0.2245	0.6525	0.8078
No log	5.9394	196	0.6265	0.3118	0.6265	0.7915
No log	6.0	198	0.5976	0.2626	0.5976	0.7730
No log	6.0606	200	0.6208	0.3661	0.6208	0.7879
No log	6.1212	202	0.7144	0.3263	0.7144	0.8452
No log	6.1818	204	0.6928	0.3263	0.6928	0.8323
No log	6.2424	206	0.6053	0.3161	0.6053	0.7780
No log	6.3030	208	0.6046	0.2990	0.6046	0.7775
No log	6.3636	210	0.6220	0.3161	0.6220	0.7887
No log	6.4242	212	0.7094	0.3263	0.7094	0.8422
No log	6.4848	214	0.7782	0.3561	0.7782	0.8822
No log	6.5455	216	0.6986	0.3191	0.6986	0.8358
No log	6.6061	218	0.6733	0.2990	0.6733	0.8206
No log	6.6667	220	0.7202	0.2746	0.7202	0.8487
No log	6.7273	222	0.6938	0.3191	0.6938	0.8330
No log	6.7879	224	0.6947	0.2746	0.6947	0.8335
No log	6.8485	226	0.6709	0.3191	0.6709	0.8191
No log	6.9091	228	0.6748	0.2746	0.6748	0.8215
No log	6.9697	230	0.6183	0.3161	0.6183	0.7863
No log	7.0303	232	0.6162	0.3575	0.6162	0.7850
No log	7.0909	234	0.6115	0.3535	0.6115	0.7820
No log	7.1515	236	0.6162	0.2965	0.6162	0.7850
No log	7.2121	238	0.6937	0.2727	0.6937	0.8329
No log	7.2727	240	0.7654	0.3524	0.7654	0.8749
No log	7.3333	242	0.7241	0.3103	0.7241	0.8509
No log	7.3939	244	0.6406	0.3035	0.6406	0.8004
No log	7.4545	246	0.6283	0.3267	0.6283	0.7927
No log	7.5152	248	0.6243	0.3161	0.6243	0.7901
No log	7.5758	250	0.6483	0.2653	0.6483	0.8052
No log	7.6364	252	0.7102	0.36	0.7102	0.8427
No log	7.6970	254	0.6791	0.2746	0.6791	0.8241
No log	7.7576	256	0.6047	0.3016	0.6047	0.7776
No log	7.8182	258	0.5695	0.4033	0.5695	0.7547
No log	7.8788	260	0.5696	0.3407	0.5696	0.7547
No log	7.9394	262	0.5537	0.4033	0.5537	0.7441
No log	8.0	264	0.5616	0.3016	0.5616	0.7494
No log	8.0606	266	0.6245	0.3333	0.6245	0.7903
No log	8.1212	268	0.7197	0.3641	0.7197	0.8484
No log	8.1818	270	0.7345	0.3951	0.7345	0.8570
No log	8.2424	272	0.6656	0.3641	0.6656	0.8159
No log	8.3030	274	0.5849	0.3118	0.5849	0.7648
No log	8.3636	276	0.5671	0.3263	0.5671	0.7531
No log	8.4242	278	0.5717	0.3575	0.5717	0.7561
No log	8.4848	280	0.5941	0.3016	0.5941	0.7708
No log	8.5455	282	0.6484	0.2746	0.6484	0.8052
No log	8.6061	284	0.7204	0.4	0.7204	0.8488
No log	8.6667	286	0.7342	0.4	0.7342	0.8568
No log	8.7273	288	0.6924	0.3131	0.6924	0.8321
No log	8.7879	290	0.6290	0.2990	0.6290	0.7931
No log	8.8485	292	0.5881	0.3333	0.5881	0.7669
No log	8.9091	294	0.5874	0.3575	0.5874	0.7664
No log	8.9697	296	0.5917	0.3575	0.5917	0.7692
No log	9.0303	298	0.5859	0.3575	0.5859	0.7654
No log	9.0909	300	0.5811	0.3797	0.5811	0.7623
No log	9.1515	302	0.5815	0.3469	0.5815	0.7626
No log	9.2121	304	0.5818	0.2727	0.5818	0.7627
No log	9.2727	306	0.5811	0.3333	0.5811	0.7623
No log	9.3333	308	0.5863	0.3333	0.5863	0.7657
No log	9.3939	310	0.5882	0.3333	0.5882	0.7669
No log	9.4545	312	0.5809	0.3333	0.5809	0.7622
No log	9.5152	314	0.5740	0.3797	0.5740	0.7576
No log	9.5758	316	0.5711	0.3797	0.5711	0.7557
No log	9.6364	318	0.5674	0.3730	0.5674	0.7533
No log	9.6970	320	0.5644	0.3258	0.5644	0.7513
No log	9.7576	322	0.5635	0.3258	0.5635	0.7507
No log	9.8182	324	0.5641	0.3258	0.5641	0.7511
No log	9.8788	326	0.5645	0.3258	0.5645	0.7514
No log	9.9394	328	0.5651	0.3224	0.5651	0.7517
No log	10.0	330	0.5655	0.3224	0.5655	0.7520

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1