ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6361
• Qwk: 0.7411
• Mse: 0.6361
• Rmse: 0.7976

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0339	2	5.2297	-0.0027	5.2297	2.2869
No log	0.0678	4	3.0520	0.0747	3.0520	1.7470
No log	0.1017	6	1.9085	0.0238	1.9085	1.3815
No log	0.1356	8	1.3357	0.1258	1.3357	1.1557
No log	0.1695	10	1.1697	0.2269	1.1697	1.0815
No log	0.2034	12	1.2007	0.1334	1.2007	1.0958
No log	0.2373	14	1.1464	0.1168	1.1464	1.0707
No log	0.2712	16	1.1310	0.1457	1.1310	1.0635
No log	0.3051	18	1.0963	0.1753	1.0963	1.0471
No log	0.3390	20	1.1366	0.2865	1.1366	1.0661
No log	0.3729	22	1.2056	0.3472	1.2056	1.0980
No log	0.4068	24	1.0903	0.3445	1.0903	1.0442
No log	0.4407	26	1.0162	0.4580	1.0162	1.0080
No log	0.4746	28	0.9988	0.4126	0.9988	0.9994
No log	0.5085	30	1.2441	0.3537	1.2441	1.1154
No log	0.5424	32	1.4857	0.2726	1.4857	1.2189
No log	0.5763	34	1.2017	0.3860	1.2017	1.0962
No log	0.6102	36	0.8437	0.5192	0.8437	0.9185
No log	0.6441	38	1.1639	0.4440	1.1639	1.0788
No log	0.6780	40	1.1741	0.4169	1.1741	1.0836
No log	0.7119	42	0.8070	0.5847	0.8070	0.8983
No log	0.7458	44	0.7643	0.5754	0.7643	0.8743
No log	0.7797	46	0.8036	0.5731	0.8036	0.8964
No log	0.8136	48	0.7607	0.6165	0.7607	0.8722
No log	0.8475	50	0.7683	0.6677	0.7683	0.8765
No log	0.8814	52	0.7736	0.6555	0.7736	0.8795
No log	0.9153	54	0.9817	0.5955	0.9817	0.9908
No log	0.9492	56	1.1755	0.5557	1.1755	1.0842
No log	0.9831	58	0.9368	0.5491	0.9368	0.9679
No log	1.0169	60	0.7777	0.5820	0.7777	0.8819
No log	1.0508	62	0.8188	0.5233	0.8188	0.9049
No log	1.0847	64	0.7284	0.5940	0.7284	0.8535
No log	1.1186	66	0.8112	0.6154	0.8112	0.9006
No log	1.1525	68	1.0148	0.5783	1.0148	1.0074
No log	1.1864	70	1.3163	0.5209	1.3163	1.1473
No log	1.2203	72	1.2158	0.5428	1.2158	1.1026
No log	1.2542	74	0.8039	0.6751	0.8039	0.8966
No log	1.2881	76	0.6469	0.7004	0.6469	0.8043
No log	1.3220	78	0.6280	0.7198	0.6280	0.7925
No log	1.3559	80	0.6438	0.7014	0.6438	0.8024
No log	1.3898	82	0.5439	0.7764	0.5439	0.7375
No log	1.4237	84	0.7591	0.6935	0.7591	0.8712
No log	1.4576	86	0.8980	0.6614	0.8980	0.9476
No log	1.4915	88	0.6899	0.7296	0.6899	0.8306
No log	1.5254	90	0.5388	0.7802	0.5388	0.7340
No log	1.5593	92	0.8227	0.6500	0.8227	0.9070
No log	1.5932	94	1.0052	0.5597	1.0052	1.0026
No log	1.6271	96	0.9242	0.5999	0.9242	0.9614
No log	1.6610	98	0.6449	0.7033	0.6449	0.8031
No log	1.6949	100	0.5659	0.7251	0.5659	0.7523
No log	1.7288	102	0.9806	0.6237	0.9806	0.9902
No log	1.7627	104	1.5019	0.4799	1.5019	1.2255
No log	1.7966	106	1.4448	0.4853	1.4448	1.2020
No log	1.8305	108	1.0346	0.5506	1.0346	1.0171
No log	1.8644	110	0.6963	0.6470	0.6963	0.8345
No log	1.8983	112	0.6720	0.6354	0.6720	0.8197
No log	1.9322	114	0.6825	0.5969	0.6825	0.8261
No log	1.9661	116	0.6604	0.6248	0.6604	0.8126
No log	2.0	118	0.6018	0.7116	0.6018	0.7758
No log	2.0339	120	0.6650	0.7384	0.6650	0.8155
No log	2.0678	122	0.6987	0.7447	0.6987	0.8359
No log	2.1017	124	0.7342	0.7112	0.7342	0.8569
No log	2.1356	126	0.6383	0.7301	0.6383	0.7989
No log	2.1695	128	0.6521	0.6887	0.6521	0.8075
No log	2.2034	130	0.7003	0.6797	0.7003	0.8368
No log	2.2373	132	0.6241	0.6905	0.6241	0.7900
No log	2.2712	134	0.5605	0.7553	0.5605	0.7487
No log	2.3051	136	0.6310	0.7425	0.6310	0.7944
No log	2.3390	138	0.6309	0.7338	0.6309	0.7943
No log	2.3729	140	0.6084	0.7448	0.6084	0.7800
No log	2.4068	142	0.5655	0.6995	0.5655	0.7520
No log	2.4407	144	0.5931	0.7149	0.5931	0.7701
No log	2.4746	146	0.7083	0.7266	0.7083	0.8416
No log	2.5085	148	0.6944	0.7293	0.6944	0.8333
No log	2.5424	150	0.7616	0.6972	0.7616	0.8727
No log	2.5763	152	0.7457	0.7170	0.7457	0.8635
No log	2.6102	154	0.6785	0.7036	0.6785	0.8237
No log	2.6441	156	0.6559	0.7121	0.6559	0.8099
No log	2.6780	158	0.6497	0.7412	0.6497	0.8060
No log	2.7119	160	0.7127	0.7174	0.7127	0.8442
No log	2.7458	162	0.6941	0.7269	0.6941	0.8331
No log	2.7797	164	0.6647	0.7252	0.6647	0.8153
No log	2.8136	166	0.6579	0.7133	0.6579	0.8111
No log	2.8475	168	0.5912	0.6995	0.5912	0.7689
No log	2.8814	170	0.5742	0.6962	0.5742	0.7578
No log	2.9153	172	0.5740	0.7091	0.5740	0.7576
No log	2.9492	174	0.5900	0.7192	0.5900	0.7681
No log	2.9831	176	0.5755	0.7166	0.5755	0.7586
No log	3.0169	178	0.6111	0.7174	0.6111	0.7818
No log	3.0508	180	0.6701	0.7104	0.6701	0.8186
No log	3.0847	182	0.5990	0.7556	0.5990	0.7739
No log	3.1186	184	0.6650	0.7508	0.6650	0.8155
No log	3.1525	186	1.0054	0.6450	1.0054	1.0027
No log	3.1864	188	1.1210	0.6090	1.1210	1.0588
No log	3.2203	190	1.0634	0.5850	1.0634	1.0312
No log	3.2542	192	0.8546	0.6586	0.8546	0.9245
No log	3.2881	194	0.6776	0.7058	0.6776	0.8231
No log	3.3220	196	0.6513	0.6956	0.6513	0.8070
No log	3.3559	198	0.6934	0.7132	0.6934	0.8327
No log	3.3898	200	0.7328	0.7059	0.7328	0.8561
No log	3.4237	202	0.8641	0.7052	0.8641	0.9296
No log	3.4576	204	0.8530	0.6994	0.8530	0.9236
No log	3.4915	206	0.8431	0.7113	0.8431	0.9182
No log	3.5254	208	0.8418	0.7111	0.8418	0.9175
No log	3.5593	210	0.7055	0.7452	0.7055	0.8399
No log	3.5932	212	0.6465	0.7488	0.6465	0.8040
No log	3.6271	214	0.5796	0.7185	0.5796	0.7613
No log	3.6610	216	0.5767	0.7242	0.5767	0.7594
No log	3.6949	218	0.5880	0.7349	0.5880	0.7668
No log	3.7288	220	0.6309	0.7443	0.6309	0.7943
No log	3.7627	222	0.6257	0.7413	0.6257	0.7910
No log	3.7966	224	0.6178	0.7243	0.6178	0.7860
No log	3.8305	226	0.6304	0.7473	0.6304	0.7939
No log	3.8644	228	0.6373	0.7482	0.6373	0.7983
No log	3.8983	230	0.6390	0.7352	0.6390	0.7994
No log	3.9322	232	0.6332	0.7104	0.6332	0.7957
No log	3.9661	234	0.5868	0.7312	0.5868	0.7660
No log	4.0	236	0.5617	0.7498	0.5617	0.7494
No log	4.0339	238	0.5501	0.7521	0.5501	0.7417
No log	4.0678	240	0.5493	0.7498	0.5493	0.7412
No log	4.1017	242	0.5363	0.7627	0.5363	0.7323
No log	4.1356	244	0.5375	0.7696	0.5375	0.7331
No log	4.1695	246	0.5534	0.7616	0.5534	0.7439
No log	4.2034	248	0.6107	0.7560	0.6107	0.7815
No log	4.2373	250	0.6408	0.7408	0.6408	0.8005
No log	4.2712	252	0.6120	0.7613	0.6120	0.7823
No log	4.3051	254	0.6169	0.7467	0.6169	0.7854
No log	4.3390	256	0.6468	0.7202	0.6468	0.8042
No log	4.3729	258	0.6164	0.7239	0.6164	0.7851
No log	4.4068	260	0.6445	0.7154	0.6445	0.8028
No log	4.4407	262	0.7699	0.7263	0.7699	0.8775
No log	4.4746	264	0.9031	0.6903	0.9031	0.9503
No log	4.5085	266	0.8709	0.7082	0.8709	0.9332
No log	4.5424	268	0.7386	0.7322	0.7386	0.8594
No log	4.5763	270	0.6204	0.7076	0.6204	0.7877
No log	4.6102	272	0.6351	0.7374	0.6351	0.7969
No log	4.6441	274	0.6520	0.7103	0.6520	0.8075
No log	4.6780	276	0.6101	0.7383	0.6101	0.7811
No log	4.7119	278	0.6166	0.7436	0.6166	0.7853
No log	4.7458	280	0.8059	0.7103	0.8059	0.8977
No log	4.7797	282	0.9591	0.6851	0.9591	0.9794
No log	4.8136	284	0.9410	0.6851	0.9410	0.9701
No log	4.8475	286	0.7696	0.7176	0.7696	0.8773
No log	4.8814	288	0.6289	0.7521	0.6289	0.7930
No log	4.9153	290	0.5824	0.7221	0.5824	0.7632
No log	4.9492	292	0.5868	0.7177	0.5868	0.7660
No log	4.9831	294	0.6176	0.7408	0.6176	0.7859
No log	5.0169	296	0.6663	0.7249	0.6663	0.8163
No log	5.0508	298	0.7165	0.7375	0.7165	0.8465
No log	5.0847	300	0.6858	0.7114	0.6858	0.8281
No log	5.1186	302	0.6809	0.7240	0.6809	0.8252
No log	5.1525	304	0.7369	0.7191	0.7369	0.8584
No log	5.1864	306	0.7806	0.7097	0.7806	0.8835
No log	5.2203	308	0.7432	0.7193	0.7432	0.8621
No log	5.2542	310	0.7169	0.7225	0.7169	0.8467
No log	5.2881	312	0.6527	0.7204	0.6527	0.8079
No log	5.3220	314	0.6141	0.7026	0.6141	0.7837
No log	5.3559	316	0.5951	0.7057	0.5951	0.7714
No log	5.3898	318	0.5910	0.7065	0.5910	0.7688
No log	5.4237	320	0.6024	0.7246	0.6024	0.7761
No log	5.4576	322	0.6482	0.7661	0.6482	0.8051
No log	5.4915	324	0.6692	0.7536	0.6692	0.8181
No log	5.5254	326	0.6459	0.7552	0.6459	0.8037
No log	5.5593	328	0.6267	0.7575	0.6267	0.7917
No log	5.5932	330	0.5832	0.7321	0.5832	0.7637
No log	5.6271	332	0.5785	0.7287	0.5785	0.7606
No log	5.6610	334	0.5983	0.6952	0.5983	0.7735
No log	5.6949	336	0.6014	0.6927	0.6014	0.7755
No log	5.7288	338	0.6075	0.7467	0.6075	0.7794
No log	5.7627	340	0.6901	0.7301	0.6901	0.8307
No log	5.7966	342	0.8510	0.6652	0.8510	0.9225
No log	5.8305	344	0.9253	0.6322	0.9253	0.9619
No log	5.8644	346	0.8603	0.6635	0.8603	0.9275
No log	5.8983	348	0.7810	0.6638	0.7810	0.8837
No log	5.9322	350	0.7188	0.6838	0.7188	0.8478
No log	5.9661	352	0.7052	0.7093	0.7052	0.8398
No log	6.0	354	0.7318	0.7139	0.7318	0.8555
No log	6.0339	356	0.7421	0.7113	0.7421	0.8615
No log	6.0678	358	0.7324	0.7260	0.7324	0.8558
No log	6.1017	360	0.6619	0.7328	0.6619	0.8136
No log	6.1356	362	0.6309	0.7364	0.6309	0.7943
No log	6.1695	364	0.6209	0.7133	0.6209	0.7880
No log	6.2034	366	0.6251	0.7283	0.6251	0.7906
No log	6.2373	368	0.6485	0.7274	0.6485	0.8053
No log	6.2712	370	0.6722	0.7181	0.6722	0.8199
No log	6.3051	372	0.6868	0.7073	0.6868	0.8287
No log	6.3390	374	0.6709	0.7201	0.6709	0.8191
No log	6.3729	376	0.6579	0.7097	0.6579	0.8111
No log	6.4068	378	0.6293	0.6844	0.6293	0.7933
No log	6.4407	380	0.6131	0.6967	0.6131	0.7830
No log	6.4746	382	0.6110	0.7128	0.6110	0.7817
No log	6.5085	384	0.6313	0.7290	0.6313	0.7946
No log	6.5424	386	0.6741	0.7173	0.6741	0.8210
No log	6.5763	388	0.7397	0.6914	0.7397	0.8601
No log	6.6102	390	0.8288	0.6889	0.8288	0.9104
No log	6.6441	392	0.8430	0.6792	0.8430	0.9182
No log	6.6780	394	0.7825	0.7076	0.7825	0.8846
No log	6.7119	396	0.6783	0.7214	0.6783	0.8236
No log	6.7458	398	0.6061	0.7380	0.6061	0.7785
No log	6.7797	400	0.5908	0.7019	0.5908	0.7686
No log	6.8136	402	0.5948	0.6964	0.5948	0.7712
No log	6.8475	404	0.5906	0.7061	0.5906	0.7685
No log	6.8814	406	0.5942	0.7366	0.5942	0.7708
No log	6.9153	408	0.6147	0.7224	0.6147	0.7841
No log	6.9492	410	0.6592	0.7288	0.6592	0.8119
No log	6.9831	412	0.7176	0.6869	0.7176	0.8471
No log	7.0169	414	0.7752	0.6920	0.7752	0.8805
No log	7.0508	416	0.7907	0.6919	0.7907	0.8892
No log	7.0847	418	0.8051	0.6901	0.8051	0.8973
No log	7.1186	420	0.7635	0.7050	0.7635	0.8738
No log	7.1525	422	0.6828	0.7244	0.6828	0.8263
No log	7.1864	424	0.6262	0.7663	0.6262	0.7913
No log	7.2203	426	0.6015	0.7229	0.6015	0.7755
No log	7.2542	428	0.6017	0.7229	0.6017	0.7757
No log	7.2881	430	0.6155	0.7286	0.6155	0.7845
No log	7.3220	432	0.6187	0.7548	0.6187	0.7866
No log	7.3559	434	0.6192	0.7578	0.6192	0.7869
No log	7.3898	436	0.6428	0.7425	0.6428	0.8017
No log	7.4237	438	0.6514	0.7425	0.6514	0.8071
No log	7.4576	440	0.6621	0.7479	0.6621	0.8137
No log	7.4915	442	0.6607	0.7295	0.6607	0.8128
No log	7.5254	444	0.6455	0.7525	0.6455	0.8035
No log	7.5593	446	0.6312	0.7511	0.6312	0.7945
No log	7.5932	448	0.6232	0.7473	0.6232	0.7894
No log	7.6271	450	0.6123	0.7539	0.6123	0.7825
No log	7.6610	452	0.6063	0.7461	0.6063	0.7787
No log	7.6949	454	0.6012	0.7539	0.6012	0.7754
No log	7.7288	456	0.6064	0.7536	0.6064	0.7787
No log	7.7627	458	0.5995	0.7620	0.5995	0.7743
No log	7.7966	460	0.5988	0.7663	0.5988	0.7738
No log	7.8305	462	0.6049	0.7573	0.6049	0.7778
No log	7.8644	464	0.6159	0.7528	0.6159	0.7848
No log	7.8983	466	0.6321	0.7219	0.6321	0.7951
No log	7.9322	468	0.6608	0.7282	0.6608	0.8129
No log	7.9661	470	0.6599	0.7282	0.6599	0.8124
No log	8.0	472	0.6606	0.7282	0.6606	0.8128
No log	8.0339	474	0.6828	0.7343	0.6828	0.8263
No log	8.0678	476	0.6927	0.7240	0.6927	0.8323
No log	8.1017	478	0.6939	0.7204	0.6939	0.8330
No log	8.1356	480	0.6713	0.7472	0.6713	0.8193
No log	8.1695	482	0.6417	0.7462	0.6417	0.8011
No log	8.2034	484	0.6436	0.7462	0.6436	0.8023
No log	8.2373	486	0.6548	0.7392	0.6548	0.8092
No log	8.2712	488	0.6664	0.7327	0.6664	0.8164
No log	8.3051	490	0.6586	0.7327	0.6586	0.8115
No log	8.3390	492	0.6597	0.7259	0.6597	0.8122
No log	8.3729	494	0.6741	0.7259	0.6741	0.8210
No log	8.4068	496	0.6777	0.7259	0.6777	0.8232
No log	8.4407	498	0.6807	0.7190	0.6807	0.8251
0.4562	8.4746	500	0.6896	0.7206	0.6896	0.8304
0.4562	8.5085	502	0.6941	0.7098	0.6941	0.8332
0.4562	8.5424	504	0.6910	0.7013	0.6910	0.8313
0.4562	8.5763	506	0.6871	0.7013	0.6871	0.8289
0.4562	8.6102	508	0.6917	0.7088	0.6917	0.8317
0.4562	8.6441	510	0.7013	0.7085	0.7013	0.8374
0.4562	8.6780	512	0.7135	0.7085	0.7135	0.8447
0.4562	8.7119	514	0.7096	0.7138	0.7096	0.8424
0.4562	8.7458	516	0.6950	0.7138	0.6950	0.8337
0.4562	8.7797	518	0.6849	0.7332	0.6849	0.8276
0.4562	8.8136	520	0.6818	0.7332	0.6818	0.8257
0.4562	8.8475	522	0.6767	0.7433	0.6767	0.8226
0.4562	8.8814	524	0.6734	0.7416	0.6734	0.8206
0.4562	8.9153	526	0.6652	0.7596	0.6652	0.8156
0.4562	8.9492	528	0.6593	0.7539	0.6593	0.8120
0.4562	8.9831	530	0.6560	0.7539	0.6560	0.8100
0.4562	9.0169	532	0.6658	0.7596	0.6658	0.8159
0.4562	9.0508	534	0.6719	0.7596	0.6719	0.8197
0.4562	9.0847	536	0.6696	0.7444	0.6696	0.8183
0.4562	9.1186	538	0.6645	0.7384	0.6645	0.8152
0.4562	9.1525	540	0.6661	0.7384	0.6661	0.8162
0.4562	9.1864	542	0.6595	0.7384	0.6595	0.8121
0.4562	9.2203	544	0.6483	0.7345	0.6483	0.8052
0.4562	9.2542	546	0.6437	0.7345	0.6437	0.8023
0.4562	9.2881	548	0.6420	0.7345	0.6420	0.8012
0.4562	9.3220	550	0.6440	0.7345	0.6440	0.8025
0.4562	9.3559	552	0.6509	0.7345	0.6509	0.8068
0.4562	9.3898	554	0.6577	0.7384	0.6577	0.8110
0.4562	9.4237	556	0.6620	0.7401	0.6620	0.8137
0.4562	9.4576	558	0.6693	0.7333	0.6693	0.8181
0.4562	9.4915	560	0.6737	0.7333	0.6737	0.8208
0.4562	9.5254	562	0.6781	0.7143	0.6781	0.8234
0.4562	9.5593	564	0.6794	0.7205	0.6794	0.8242
0.4562	9.5932	566	0.6807	0.7205	0.6807	0.8250
0.4562	9.6271	568	0.6784	0.7205	0.6784	0.8236
0.4562	9.6610	570	0.6715	0.7401	0.6715	0.8195
0.4562	9.6949	572	0.6623	0.7401	0.6623	0.8138
0.4562	9.7288	574	0.6536	0.7384	0.6536	0.8085
0.4562	9.7627	576	0.6462	0.7345	0.6462	0.8039
0.4562	9.7966	578	0.6406	0.7345	0.6406	0.8004
0.4562	9.8305	580	0.6380	0.7345	0.6380	0.7988
0.4562	9.8644	582	0.6366	0.7411	0.6366	0.7979
0.4562	9.8983	584	0.6358	0.7411	0.6358	0.7974
0.4562	9.9322	586	0.6355	0.7411	0.6355	0.7972
0.4562	9.9661	588	0.6359	0.7411	0.6359	0.7974
0.4562	10.0	590	0.6361	0.7411	0.6361	0.7976

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1