ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k11_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7417
• Qwk: 0.7093
• Mse: 0.7417
• Rmse: 0.8612

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	2.1987	0.0124	2.1987	1.4828
No log	0.0909	4	1.4518	0.2569	1.4518	1.2049
No log	0.1364	6	1.3369	0.1912	1.3369	1.1562
No log	0.1818	8	1.6573	0.1843	1.6573	1.2873
No log	0.2273	10	1.5674	0.3442	1.5674	1.2519
No log	0.2727	12	1.2978	0.2461	1.2978	1.1392
No log	0.3182	14	1.2904	0.2590	1.2904	1.1359
No log	0.3636	16	1.3852	0.3640	1.3852	1.1769
No log	0.4091	18	1.4443	0.3038	1.4443	1.2018
No log	0.4545	20	1.4190	0.2592	1.4190	1.1912
No log	0.5	22	1.4412	0.4017	1.4412	1.2005
No log	0.5455	24	1.4148	0.4206	1.4148	1.1894
No log	0.5909	26	1.3053	0.2761	1.3053	1.1425
No log	0.6364	28	1.2519	0.1371	1.2519	1.1189
No log	0.6818	30	1.2453	0.2389	1.2453	1.1159
No log	0.7273	32	1.2559	0.3051	1.2559	1.1206
No log	0.7727	34	1.2158	0.2516	1.2158	1.1026
No log	0.8182	36	1.2082	0.3160	1.2082	1.0992
No log	0.8636	38	1.2676	0.4321	1.2676	1.1259
No log	0.9091	40	1.3153	0.4411	1.3153	1.1469
No log	0.9545	42	1.2373	0.4225	1.2373	1.1124
No log	1.0	44	1.1063	0.4152	1.1063	1.0518
No log	1.0455	46	1.0787	0.4152	1.0787	1.0386
No log	1.0909	48	1.1578	0.4579	1.1578	1.0760
No log	1.1364	50	1.2822	0.4666	1.2822	1.1324
No log	1.1818	52	1.4083	0.4609	1.4083	1.1867
No log	1.2273	54	1.1743	0.4767	1.1743	1.0837
No log	1.2727	56	1.0205	0.4819	1.0205	1.0102
No log	1.3182	58	1.0208	0.5072	1.0208	1.0104
No log	1.3636	60	1.1797	0.4987	1.1797	1.0861
No log	1.4091	62	1.3175	0.5185	1.3175	1.1478
No log	1.4545	64	1.1756	0.4946	1.1756	1.0843
No log	1.5	66	1.0130	0.5524	1.0130	1.0065
No log	1.5455	68	0.8984	0.6038	0.8984	0.9478
No log	1.5909	70	0.8030	0.6977	0.8030	0.8961
No log	1.6364	72	0.8588	0.6933	0.8588	0.9267
No log	1.6818	74	0.9004	0.6718	0.9004	0.9489
No log	1.7273	76	0.8413	0.6852	0.8413	0.9172
No log	1.7727	78	0.6609	0.6791	0.6609	0.8130
No log	1.8182	80	0.6737	0.6636	0.6737	0.8208
No log	1.8636	82	0.6745	0.7088	0.6745	0.8213
No log	1.9091	84	0.8305	0.6526	0.8305	0.9113
No log	1.9545	86	0.8850	0.6428	0.8850	0.9408
No log	2.0	88	0.7902	0.7120	0.7902	0.8890
No log	2.0455	90	0.6879	0.6967	0.6879	0.8294
No log	2.0909	92	0.6764	0.6978	0.6764	0.8224
No log	2.1364	94	0.6834	0.6838	0.6834	0.8267
No log	2.1818	96	0.6722	0.7129	0.6722	0.8199
No log	2.2273	98	0.8842	0.7060	0.8842	0.9403
No log	2.2727	100	1.0874	0.6486	1.0874	1.0428
No log	2.3182	102	1.0236	0.6552	1.0236	1.0117
No log	2.3636	104	0.8019	0.7191	0.8019	0.8955
No log	2.4091	106	0.7004	0.7293	0.7004	0.8369
No log	2.4545	108	0.7071	0.7309	0.7071	0.8409
No log	2.5	110	0.8098	0.7157	0.8098	0.8999
No log	2.5455	112	0.9381	0.6527	0.9381	0.9685
No log	2.5909	114	1.0354	0.6254	1.0354	1.0175
No log	2.6364	116	0.9691	0.6455	0.9691	0.9844
No log	2.6818	118	0.7871	0.6978	0.7871	0.8872
No log	2.7273	120	0.7209	0.7518	0.7209	0.8490
No log	2.7727	122	0.7408	0.7207	0.7408	0.8607
No log	2.8182	124	0.9563	0.7038	0.9563	0.9779
No log	2.8636	126	1.3691	0.6164	1.3691	1.1701
No log	2.9091	128	1.4212	0.6030	1.4212	1.1921
No log	2.9545	130	1.1515	0.5980	1.1515	1.0731
No log	3.0	132	0.8280	0.7041	0.8280	0.9099
No log	3.0455	134	0.6855	0.7733	0.6855	0.8280
No log	3.0909	136	0.6606	0.7585	0.6606	0.8128
No log	3.1364	138	0.6873	0.7617	0.6873	0.8290
No log	3.1818	140	0.6540	0.7677	0.6540	0.8087
No log	3.2273	142	0.6622	0.7715	0.6622	0.8137
No log	3.2727	144	0.6894	0.7709	0.6894	0.8303
No log	3.3182	146	0.7663	0.7405	0.7663	0.8754
No log	3.3636	148	0.9398	0.6565	0.9398	0.9695
No log	3.4091	150	0.9237	0.6465	0.9237	0.9611
No log	3.4545	152	0.9100	0.6602	0.9100	0.9539
No log	3.5	154	0.8885	0.6637	0.8885	0.9426
No log	3.5455	156	0.7743	0.6791	0.7743	0.8799
No log	3.5909	158	0.6968	0.7440	0.6968	0.8348
No log	3.6364	160	0.7079	0.7371	0.7079	0.8414
No log	3.6818	162	0.7041	0.7235	0.7041	0.8391
No log	3.7273	164	0.8218	0.6556	0.8218	0.9065
No log	3.7727	166	0.8728	0.6561	0.8728	0.9342
No log	3.8182	168	0.8974	0.6561	0.8974	0.9473
No log	3.8636	170	0.9723	0.6303	0.9723	0.9860
No log	3.9091	172	0.9078	0.6754	0.9078	0.9528
No log	3.9545	174	0.9088	0.6852	0.9088	0.9533
No log	4.0	176	0.9428	0.6773	0.9428	0.9710
No log	4.0455	178	1.0876	0.6298	1.0876	1.0429
No log	4.0909	180	1.1113	0.6298	1.1113	1.0542
No log	4.1364	182	0.9717	0.6527	0.9717	0.9857
No log	4.1818	184	0.8018	0.7126	0.8018	0.8954
No log	4.2273	186	0.6790	0.7503	0.6790	0.8240
No log	4.2727	188	0.6501	0.7748	0.6501	0.8063
No log	4.3182	190	0.6898	0.7622	0.6898	0.8306
No log	4.3636	192	0.8295	0.6722	0.8295	0.9108
No log	4.4091	194	0.9859	0.6635	0.9859	0.9929
No log	4.4545	196	1.0463	0.6510	1.0463	1.0229
No log	4.5	198	0.9863	0.6635	0.9863	0.9931
No log	4.5455	200	0.8537	0.7059	0.8537	0.9240
No log	4.5909	202	0.7869	0.7254	0.7869	0.8871
No log	4.6364	204	0.7831	0.7254	0.7831	0.8849
No log	4.6818	206	0.8428	0.7111	0.8428	0.9180
No log	4.7273	208	0.9345	0.7071	0.9345	0.9667
No log	4.7727	210	1.0863	0.6687	1.0863	1.0423
No log	4.8182	212	1.1494	0.6567	1.1494	1.0721
No log	4.8636	214	1.0833	0.6626	1.0833	1.0408
No log	4.9091	216	0.9677	0.6798	0.9677	0.9837
No log	4.9545	218	0.8061	0.7170	0.8061	0.8978
No log	5.0	220	0.7357	0.7525	0.7357	0.8577
No log	5.0455	222	0.7422	0.7485	0.7422	0.8615
No log	5.0909	224	0.7405	0.7605	0.7405	0.8605
No log	5.1364	226	0.6942	0.7758	0.6942	0.8332
No log	5.1818	228	0.6643	0.7727	0.6643	0.8150
No log	5.2273	230	0.6819	0.7751	0.6819	0.8258
No log	5.2727	232	0.7951	0.7683	0.7951	0.8917
No log	5.3182	234	0.8623	0.7341	0.8623	0.9286
No log	5.3636	236	0.7964	0.7446	0.7964	0.8924
No log	5.4091	238	0.6574	0.7899	0.6574	0.8108
No log	5.4545	240	0.5765	0.7871	0.5765	0.7593
No log	5.5	242	0.5579	0.7817	0.5579	0.7469
No log	5.5455	244	0.5837	0.7886	0.5837	0.7640
No log	5.5909	246	0.6015	0.7961	0.6015	0.7756
No log	5.6364	248	0.6049	0.7918	0.6049	0.7778
No log	5.6818	250	0.6356	0.7834	0.6356	0.7972
No log	5.7273	252	0.7022	0.7482	0.7022	0.8380
No log	5.7727	254	0.7791	0.7505	0.7791	0.8827
No log	5.8182	256	0.7778	0.7359	0.7778	0.8819
No log	5.8636	258	0.7467	0.7255	0.7467	0.8641
No log	5.9091	260	0.7189	0.7372	0.7189	0.8479
No log	5.9545	262	0.7310	0.7373	0.7310	0.8550
No log	6.0	264	0.7920	0.7294	0.7920	0.8900
No log	6.0455	266	0.8191	0.7293	0.8191	0.9050
No log	6.0909	268	0.7692	0.7356	0.7692	0.8770
No log	6.1364	270	0.7323	0.7412	0.7323	0.8558
No log	6.1818	272	0.7236	0.7343	0.7236	0.8506
No log	6.2273	274	0.6783	0.7537	0.6783	0.8236
No log	6.2727	276	0.6685	0.7464	0.6685	0.8176
No log	6.3182	278	0.7011	0.7266	0.7011	0.8373
No log	6.3636	280	0.7324	0.7328	0.7324	0.8558
No log	6.4091	282	0.8030	0.7228	0.8030	0.8961
No log	6.4545	284	0.8181	0.7149	0.8181	0.9045
No log	6.5	286	0.7684	0.7443	0.7684	0.8766
No log	6.5455	288	0.6917	0.7337	0.6917	0.8317
No log	6.5909	290	0.6689	0.7423	0.6689	0.8179
No log	6.6364	292	0.6984	0.7337	0.6984	0.8357
No log	6.6818	294	0.7718	0.7341	0.7718	0.8785
No log	6.7273	296	0.8262	0.7242	0.8262	0.9090
No log	6.7727	298	0.8175	0.7242	0.8175	0.9041
No log	6.8182	300	0.8465	0.7223	0.8465	0.9200
No log	6.8636	302	0.8301	0.7222	0.8301	0.9111
No log	6.9091	304	0.7749	0.7183	0.7749	0.8803
No log	6.9545	306	0.7121	0.7301	0.7121	0.8439
No log	7.0	308	0.6761	0.7607	0.6761	0.8222
No log	7.0455	310	0.6851	0.7674	0.6851	0.8277
No log	7.0909	312	0.7152	0.7623	0.7152	0.8457
No log	7.1364	314	0.7144	0.7623	0.7144	0.8452
No log	7.1818	316	0.7231	0.7446	0.7231	0.8504
No log	7.2273	318	0.6921	0.7623	0.6921	0.8319
No log	7.2727	320	0.6514	0.7715	0.6514	0.8071
No log	7.3182	322	0.6358	0.7746	0.6358	0.7974
No log	7.3636	324	0.6319	0.7760	0.6319	0.7949
No log	7.4091	326	0.6627	0.7439	0.6627	0.8141
No log	7.4545	328	0.6923	0.7230	0.6923	0.8320
No log	7.5	330	0.7330	0.7225	0.7330	0.8562
No log	7.5455	332	0.8090	0.7443	0.8090	0.8994
No log	7.5909	334	0.8751	0.6882	0.8751	0.9355
No log	7.6364	336	0.9038	0.6854	0.9038	0.9507
No log	7.6818	338	0.8731	0.6882	0.8731	0.9344
No log	7.7273	340	0.8069	0.7161	0.8069	0.8983
No log	7.7727	342	0.7661	0.7357	0.7661	0.8753
No log	7.8182	344	0.7325	0.7380	0.7325	0.8559
No log	7.8636	346	0.7423	0.7380	0.7423	0.8616
No log	7.9091	348	0.7828	0.7092	0.7828	0.8848
No log	7.9545	350	0.8381	0.7161	0.8381	0.9155
No log	8.0	352	0.8539	0.7161	0.8539	0.9241
No log	8.0455	354	0.8925	0.6921	0.8925	0.9447
No log	8.0909	356	0.9008	0.6955	0.9008	0.9491
No log	8.1364	358	0.8702	0.6996	0.8702	0.9328
No log	8.1818	360	0.8401	0.7003	0.8401	0.9165
No log	8.2273	362	0.8246	0.7044	0.8246	0.9081
No log	8.2727	364	0.7949	0.7240	0.7949	0.8916
No log	8.3182	366	0.7749	0.7204	0.7749	0.8803
No log	8.3636	368	0.7516	0.7137	0.7516	0.8670
No log	8.4091	370	0.7267	0.7137	0.7267	0.8525
No log	8.4545	372	0.7159	0.7120	0.7159	0.8461
No log	8.5	374	0.7295	0.7158	0.7295	0.8541
No log	8.5455	376	0.7628	0.7213	0.7628	0.8734
No log	8.5909	378	0.8132	0.7208	0.8132	0.9018
No log	8.6364	380	0.8489	0.7173	0.8489	0.9214
No log	8.6818	382	0.8622	0.7173	0.8622	0.9285
No log	8.7273	384	0.8449	0.7202	0.8449	0.9192
No log	8.7727	386	0.8106	0.7281	0.8106	0.9003
No log	8.8182	388	0.7937	0.7281	0.7937	0.8909
No log	8.8636	390	0.7853	0.7281	0.7853	0.8862
No log	8.9091	392	0.7836	0.7206	0.7836	0.8852
No log	8.9545	394	0.7724	0.7128	0.7724	0.8789
No log	9.0	396	0.7525	0.7128	0.7525	0.8674
No log	9.0455	398	0.7382	0.7126	0.7382	0.8592
No log	9.0909	400	0.7387	0.7128	0.7387	0.8595
No log	9.1364	402	0.7373	0.7128	0.7373	0.8587
No log	9.1818	404	0.7379	0.7128	0.7379	0.8590
No log	9.2273	406	0.7425	0.7128	0.7425	0.8617
No log	9.2727	408	0.7422	0.7093	0.7422	0.8615
No log	9.3182	410	0.7345	0.7058	0.7345	0.8570
No log	9.3636	412	0.7246	0.7100	0.7246	0.8512
No log	9.4091	414	0.7143	0.7097	0.7143	0.8452
No log	9.4545	416	0.7139	0.7097	0.7139	0.8449
No log	9.5	418	0.7191	0.7100	0.7191	0.8480
No log	9.5455	420	0.7289	0.7100	0.7289	0.8537
No log	9.5909	422	0.7366	0.7093	0.7366	0.8583
No log	9.6364	424	0.7419	0.7093	0.7419	0.8613
No log	9.6818	426	0.7445	0.7093	0.7445	0.8629
No log	9.7273	428	0.7448	0.7093	0.7448	0.8630
No log	9.7727	430	0.7441	0.7093	0.7441	0.8626
No log	9.8182	432	0.7415	0.7093	0.7415	0.8611
No log	9.8636	434	0.7403	0.7093	0.7403	0.8604
No log	9.9091	436	0.7412	0.7093	0.7412	0.8609
No log	9.9545	438	0.7419	0.7093	0.7419	0.8613
No log	10.0	440	0.7417	0.7093	0.7417	0.8612

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1