ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8352
• Qwk: 0.6716
• Mse: 0.8352
• Rmse: 0.9139

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	5.4272	-0.0139	5.4272	2.3296
No log	0.0690	4	3.1807	0.0759	3.1807	1.7835
No log	0.1034	6	1.7845	0.1455	1.7845	1.3358
No log	0.1379	8	2.0658	-0.0139	2.0658	1.4373
No log	0.1724	10	1.6913	0.0603	1.6913	1.3005
No log	0.2069	12	1.2234	0.2647	1.2234	1.1061
No log	0.2414	14	1.1804	0.2957	1.1804	1.0865
No log	0.2759	16	1.1518	0.3152	1.1518	1.0732
No log	0.3103	18	1.1743	0.2560	1.1743	1.0837
No log	0.3448	20	1.3942	0.1995	1.3942	1.1808
No log	0.3793	22	1.4443	0.2768	1.4443	1.2018
No log	0.4138	24	1.2828	0.3938	1.2828	1.1326
No log	0.4483	26	1.1964	0.4478	1.1964	1.0938
No log	0.4828	28	1.5844	0.3265	1.5844	1.2587
No log	0.5172	30	1.8200	0.2919	1.8200	1.3491
No log	0.5517	32	1.3761	0.3670	1.3761	1.1731
No log	0.5862	34	1.2417	0.4503	1.2417	1.1143
No log	0.6207	36	1.1525	0.4503	1.1525	1.0736
No log	0.6552	38	1.1772	0.3814	1.1772	1.0850
No log	0.6897	40	1.1639	0.3785	1.1639	1.0789
No log	0.7241	42	1.0272	0.4521	1.0272	1.0135
No log	0.7586	44	0.9171	0.5230	0.9171	0.9576
No log	0.7931	46	1.1584	0.4930	1.1584	1.0763
No log	0.8276	48	1.2486	0.4667	1.2486	1.1174
No log	0.8621	50	0.9795	0.56	0.9795	0.9897
No log	0.8966	52	0.8271	0.6372	0.8271	0.9094
No log	0.9310	54	0.8008	0.6636	0.8008	0.8949
No log	0.9655	56	0.8638	0.6233	0.8638	0.9294
No log	1.0	58	0.9227	0.6164	0.9227	0.9606
No log	1.0345	60	0.7870	0.6747	0.7870	0.8872
No log	1.0690	62	0.8385	0.6144	0.8385	0.9157
No log	1.1034	64	0.7941	0.6472	0.7941	0.8911
No log	1.1379	66	0.7560	0.6825	0.7560	0.8695
No log	1.1724	68	0.9141	0.6360	0.9141	0.9561
No log	1.2069	70	0.9971	0.5788	0.9971	0.9986
No log	1.2414	72	0.8391	0.6296	0.8391	0.9160
No log	1.2759	74	0.8369	0.5986	0.8369	0.9148
No log	1.3103	76	0.8399	0.5880	0.8399	0.9164
No log	1.3448	78	0.8769	0.6246	0.8769	0.9364
No log	1.3793	80	1.2176	0.5303	1.2176	1.1034
No log	1.4138	82	1.2169	0.5324	1.2169	1.1031
No log	1.4483	84	0.8904	0.6111	0.8904	0.9436
No log	1.4828	86	0.7702	0.5896	0.7702	0.8776
No log	1.5172	88	0.7742	0.6105	0.7742	0.8799
No log	1.5517	90	0.8641	0.6135	0.8641	0.9296
No log	1.5862	92	0.8719	0.6475	0.8719	0.9337
No log	1.6207	94	0.8132	0.6582	0.8132	0.9018
No log	1.6552	96	0.8752	0.6446	0.8752	0.9355
No log	1.6897	98	1.1494	0.5317	1.1494	1.0721
No log	1.7241	100	1.3124	0.5042	1.3124	1.1456
No log	1.7586	102	1.2844	0.5032	1.2844	1.1333
No log	1.7931	104	0.9034	0.6603	0.9034	0.9505
No log	1.8276	106	0.6851	0.6519	0.6851	0.8277
No log	1.8621	108	0.7804	0.6476	0.7804	0.8834
No log	1.8966	110	0.7119	0.6944	0.7119	0.8437
No log	1.9310	112	0.6676	0.6546	0.6676	0.8170
No log	1.9655	114	0.8730	0.6633	0.8730	0.9344
No log	2.0	116	1.1868	0.6041	1.1868	1.0894
No log	2.0345	118	1.1340	0.6162	1.1340	1.0649
No log	2.0690	120	0.7950	0.7170	0.7950	0.8916
No log	2.1034	122	0.7323	0.6933	0.7323	0.8557
No log	2.1379	124	0.7968	0.7030	0.7968	0.8927
No log	2.1724	126	0.6972	0.6990	0.6972	0.8350
No log	2.2069	128	0.6611	0.6837	0.6611	0.8130
No log	2.2414	130	0.6827	0.6801	0.6827	0.8262
No log	2.2759	132	0.8520	0.6933	0.8520	0.9230
No log	2.3103	134	0.8847	0.6955	0.8847	0.9406
No log	2.3448	136	0.8061	0.6987	0.8061	0.8978
No log	2.3793	138	0.7120	0.6977	0.7120	0.8438
No log	2.4138	140	0.7268	0.7243	0.7268	0.8525
No log	2.4483	142	0.7200	0.7001	0.7200	0.8485
No log	2.4828	144	0.8009	0.6838	0.8009	0.8949
No log	2.5172	146	0.9382	0.6552	0.9382	0.9686
No log	2.5517	148	0.9023	0.6599	0.9023	0.9499
No log	2.5862	150	0.8504	0.6664	0.8504	0.9221
No log	2.6207	152	0.8429	0.6640	0.8429	0.9181
No log	2.6552	154	0.8367	0.6676	0.8367	0.9147
No log	2.6897	156	0.9599	0.6345	0.9599	0.9798
No log	2.7241	158	1.1445	0.5854	1.1445	1.0698
No log	2.7586	160	1.1490	0.5946	1.1490	1.0719
No log	2.7931	162	1.0380	0.6245	1.0380	1.0188
No log	2.8276	164	1.1878	0.5963	1.1878	1.0899
No log	2.8621	166	1.4021	0.5490	1.4021	1.1841
No log	2.8966	168	1.3980	0.5504	1.3980	1.1824
No log	2.9310	170	1.0841	0.6119	1.0841	1.0412
No log	2.9655	172	0.9511	0.6439	0.9511	0.9752
No log	3.0	174	0.8826	0.6529	0.8826	0.9395
No log	3.0345	176	0.8330	0.6605	0.8330	0.9127
No log	3.0690	178	0.7580	0.6427	0.7580	0.8707
No log	3.1034	180	0.7850	0.6538	0.7850	0.8860
No log	3.1379	182	0.8659	0.6763	0.8659	0.9305
No log	3.1724	184	0.9470	0.6429	0.9470	0.9731
No log	3.2069	186	0.8539	0.6536	0.8539	0.9241
No log	3.2414	188	0.7631	0.6839	0.7631	0.8736
No log	3.2759	190	0.7374	0.6758	0.7374	0.8587
No log	3.3103	192	0.8528	0.6473	0.8528	0.9235
No log	3.3448	194	0.9620	0.6218	0.9620	0.9808
No log	3.3793	196	0.8924	0.6620	0.8924	0.9447
No log	3.4138	198	0.7184	0.7009	0.7184	0.8476
No log	3.4483	200	0.7138	0.6616	0.7138	0.8448
No log	3.4828	202	0.8385	0.6754	0.8385	0.9157
No log	3.5172	204	1.0783	0.5924	1.0783	1.0384
No log	3.5517	206	1.0704	0.5708	1.0704	1.0346
No log	3.5862	208	0.8903	0.6524	0.8903	0.9435
No log	3.6207	210	0.7704	0.6229	0.7704	0.8777
No log	3.6552	212	0.7600	0.6314	0.7600	0.8718
No log	3.6897	214	0.7264	0.6319	0.7264	0.8523
No log	3.7241	216	0.7737	0.6608	0.7737	0.8796
No log	3.7586	218	0.9889	0.6514	0.9889	0.9944
No log	3.7931	220	1.0843	0.6290	1.0843	1.0413
No log	3.8276	222	1.0599	0.6463	1.0599	1.0295
No log	3.8621	224	0.9865	0.6598	0.9865	0.9932
No log	3.8966	226	1.0191	0.6447	1.0191	1.0095
No log	3.9310	228	1.1943	0.5805	1.1943	1.0928
No log	3.9655	230	1.2302	0.5664	1.2302	1.1092
No log	4.0	232	1.1088	0.5618	1.1088	1.0530
No log	4.0345	234	0.9738	0.6158	0.9738	0.9868
No log	4.0690	236	0.8409	0.6735	0.8409	0.9170
No log	4.1034	238	0.8345	0.6655	0.8345	0.9135
No log	4.1379	240	0.8717	0.6616	0.8717	0.9337
No log	4.1724	242	0.9650	0.6671	0.9650	0.9823
No log	4.2069	244	1.1093	0.6337	1.1093	1.0533
No log	4.2414	246	1.2011	0.5860	1.2011	1.0960
No log	4.2759	248	1.0233	0.6051	1.0233	1.0116
No log	4.3103	250	0.7919	0.6762	0.7919	0.8899
No log	4.3448	252	0.7122	0.6886	0.7122	0.8439
No log	4.3793	254	0.6899	0.6807	0.6899	0.8306
No log	4.4138	256	0.7404	0.6931	0.7404	0.8605
No log	4.4483	258	0.9029	0.6488	0.9029	0.9502
No log	4.4828	260	1.0170	0.6311	1.0170	1.0085
No log	4.5172	262	0.9655	0.6471	0.9655	0.9826
No log	4.5517	264	0.9559	0.6456	0.9559	0.9777
No log	4.5862	266	0.9463	0.6559	0.9463	0.9728
No log	4.6207	268	1.0316	0.6429	1.0316	1.0157
No log	4.6552	270	1.0521	0.6383	1.0521	1.0257
No log	4.6897	272	1.0577	0.6309	1.0577	1.0284
No log	4.7241	274	0.9801	0.6158	0.9801	0.9900
No log	4.7586	276	0.9905	0.6158	0.9905	0.9952
No log	4.7931	278	0.9380	0.6303	0.9380	0.9685
No log	4.8276	280	0.9532	0.6269	0.9532	0.9763
No log	4.8621	282	1.0045	0.6424	1.0045	1.0022
No log	4.8966	284	0.9683	0.6398	0.9683	0.9840
No log	4.9310	286	0.9290	0.6419	0.9290	0.9639
No log	4.9655	288	0.8726	0.6615	0.8726	0.9341
No log	5.0	290	0.9300	0.6534	0.9300	0.9644
No log	5.0345	292	1.0277	0.6223	1.0277	1.0138
No log	5.0690	294	1.1331	0.6338	1.1331	1.0645
No log	5.1034	296	1.1186	0.6338	1.1186	1.0576
No log	5.1379	298	1.0341	0.6183	1.0341	1.0169
No log	5.1724	300	0.9412	0.6094	0.9412	0.9702
No log	5.2069	302	0.8959	0.6494	0.8959	0.9465
No log	5.2414	304	0.8387	0.6710	0.8387	0.9158
No log	5.2759	306	0.8338	0.6721	0.8338	0.9131
No log	5.3103	308	0.8804	0.6331	0.8804	0.9383
No log	5.3448	310	0.9404	0.6094	0.9404	0.9698
No log	5.3793	312	0.9340	0.6325	0.9340	0.9664
No log	5.4138	314	0.9230	0.6332	0.9230	0.9608
No log	5.4483	316	0.9248	0.6398	0.9248	0.9617
No log	5.4828	318	0.8888	0.6700	0.8888	0.9428
No log	5.5172	320	0.8873	0.6716	0.8873	0.9420
No log	5.5517	322	0.9339	0.6292	0.9339	0.9664
No log	5.5862	324	0.9502	0.6298	0.9502	0.9748
No log	5.6207	326	0.8405	0.6454	0.8405	0.9168
No log	5.6552	328	0.7461	0.7094	0.7461	0.8638
No log	5.6897	330	0.7206	0.7272	0.7206	0.8489
No log	5.7241	332	0.7100	0.7317	0.7100	0.8426
No log	5.7586	334	0.7807	0.6859	0.7807	0.8836
No log	5.7931	336	0.9428	0.6243	0.9428	0.9710
No log	5.8276	338	1.0423	0.6116	1.0423	1.0209
No log	5.8621	340	1.0441	0.6156	1.0441	1.0218
No log	5.8966	342	1.0178	0.6180	1.0178	1.0088
No log	5.9310	344	1.0139	0.6180	1.0139	1.0069
No log	5.9655	346	1.0458	0.6156	1.0458	1.0226
No log	6.0	348	1.0640	0.6227	1.0640	1.0315
No log	6.0345	350	0.9937	0.6291	0.9937	0.9968
No log	6.0690	352	0.9528	0.6202	0.9528	0.9761
No log	6.1034	354	0.8452	0.6707	0.8452	0.9193
No log	6.1379	356	0.8041	0.6662	0.8041	0.8967
No log	6.1724	358	0.8122	0.6662	0.8122	0.9012
No log	6.2069	360	0.8384	0.6707	0.8384	0.9156
No log	6.2414	362	0.8507	0.6533	0.8507	0.9223
No log	6.2759	364	0.8574	0.6533	0.8574	0.9260
No log	6.3103	366	0.8223	0.6662	0.8223	0.9068
No log	6.3448	368	0.8327	0.6391	0.8327	0.9125
No log	6.3793	370	0.8183	0.6570	0.8183	0.9046
No log	6.4138	372	0.8548	0.6376	0.8548	0.9245
No log	6.4483	374	0.9157	0.6521	0.9157	0.9569
No log	6.4828	376	0.9673	0.6345	0.9673	0.9835
No log	6.5172	378	0.9989	0.6392	0.9989	0.9995
No log	6.5517	380	1.0380	0.6164	1.0380	1.0188
No log	6.5862	382	1.0495	0.6164	1.0495	1.0244
No log	6.6207	384	1.0128	0.6250	1.0128	1.0064
No log	6.6552	386	0.9325	0.6400	0.9325	0.9657
No log	6.6897	388	0.9102	0.6400	0.9102	0.9541
No log	6.7241	390	0.8833	0.6537	0.8833	0.9398
No log	6.7586	392	0.9458	0.6400	0.9458	0.9725
No log	6.7931	394	0.9964	0.6269	0.9964	0.9982
No log	6.8276	396	0.9899	0.6269	0.9899	0.9949
No log	6.8621	398	0.9153	0.6499	0.9153	0.9567
No log	6.8966	400	0.8121	0.6761	0.8121	0.9011
No log	6.9310	402	0.7306	0.6635	0.7306	0.8547
No log	6.9655	404	0.7191	0.6567	0.7191	0.8480
No log	7.0	406	0.7643	0.6656	0.7643	0.8742
No log	7.0345	408	0.8892	0.6754	0.8892	0.9430
No log	7.0690	410	1.0059	0.6310	1.0059	1.0029
No log	7.1034	412	1.1280	0.5942	1.1280	1.0621
No log	7.1379	414	1.1133	0.6023	1.1133	1.0551
No log	7.1724	416	1.0163	0.6431	1.0163	1.0081
No log	7.2069	418	0.8970	0.6676	0.8970	0.9471
No log	7.2414	420	0.8813	0.6676	0.8813	0.9388
No log	7.2759	422	0.8585	0.6693	0.8585	0.9265
No log	7.3103	424	0.8481	0.6693	0.8481	0.9209
No log	7.3448	426	0.8935	0.6676	0.8935	0.9453
No log	7.3793	428	1.0108	0.6297	1.0108	1.0054
No log	7.4138	430	1.1830	0.5831	1.1830	1.0877
No log	7.4483	432	1.2764	0.5754	1.2764	1.1298
No log	7.4828	434	1.2627	0.5754	1.2627	1.1237
No log	7.5172	436	1.1647	0.5903	1.1647	1.0792
No log	7.5517	438	1.0074	0.6343	1.0074	1.0037
No log	7.5862	440	0.8457	0.6726	0.8457	0.9196
No log	7.6207	442	0.7408	0.6768	0.7408	0.8607
No log	7.6552	444	0.7038	0.6879	0.7038	0.8389
No log	7.6897	446	0.7119	0.7008	0.7119	0.8437
No log	7.7241	448	0.7562	0.6649	0.7562	0.8696
No log	7.7586	450	0.8128	0.6725	0.8128	0.9016
No log	7.7931	452	0.9013	0.6476	0.9013	0.9494
No log	7.8276	454	0.9788	0.6304	0.9788	0.9893
No log	7.8621	456	1.0625	0.6279	1.0625	1.0308
No log	7.8966	458	1.0573	0.6292	1.0573	1.0283
No log	7.9310	460	0.9925	0.6345	0.9925	0.9962
No log	7.9655	462	0.9475	0.6345	0.9475	0.9734
No log	8.0	464	0.9333	0.6372	0.9333	0.9661
No log	8.0345	466	0.9158	0.6386	0.9158	0.9570
No log	8.0690	468	0.9123	0.6491	0.9123	0.9551
No log	8.1034	470	0.9206	0.6435	0.9206	0.9595
No log	8.1379	472	0.9565	0.6186	0.9565	0.9780
No log	8.1724	474	0.9814	0.6254	0.9814	0.9907
No log	8.2069	476	0.9751	0.6212	0.9751	0.9875
No log	8.2414	478	0.9446	0.6281	0.9446	0.9719
No log	8.2759	480	0.9079	0.6387	0.9079	0.9528
No log	8.3103	482	0.8427	0.6693	0.8427	0.9180
No log	8.3448	484	0.8125	0.6852	0.8125	0.9014
No log	8.3793	486	0.8121	0.6841	0.8121	0.9012
No log	8.4138	488	0.8149	0.6744	0.8149	0.9027
No log	8.4483	490	0.8407	0.6788	0.8407	0.9169
No log	8.4828	492	0.8885	0.6476	0.8885	0.9426
No log	8.5172	494	0.9512	0.6371	0.9512	0.9753
No log	8.5517	496	0.9963	0.6344	0.9963	0.9981
No log	8.5862	498	1.0014	0.6344	1.0014	1.0007
0.4205	8.6207	500	0.9863	0.6344	0.9863	0.9931
0.4205	8.6552	502	0.9360	0.6371	0.9360	0.9675
0.4205	8.6897	504	0.8719	0.6457	0.8719	0.9338
0.4205	8.7241	506	0.8407	0.6690	0.8407	0.9169
0.4205	8.7586	508	0.7997	0.6819	0.7997	0.8943
0.4205	8.7931	510	0.7532	0.6829	0.7532	0.8679
0.4205	8.8276	512	0.7298	0.6701	0.7298	0.8543
0.4205	8.8621	514	0.7325	0.6739	0.7325	0.8558
0.4205	8.8966	516	0.7464	0.6829	0.7464	0.8639
0.4205	8.9310	518	0.7752	0.6916	0.7752	0.8804
0.4205	8.9655	520	0.8088	0.6733	0.8088	0.8994
0.4205	9.0	522	0.8546	0.6657	0.8546	0.9245
0.4205	9.0345	524	0.9032	0.6491	0.9032	0.9503
0.4205	9.0690	526	0.9336	0.6103	0.9336	0.9662
0.4205	9.1034	528	0.9408	0.6103	0.9408	0.9699
0.4205	9.1379	530	0.9347	0.6174	0.9347	0.9668
0.4205	9.1724	532	0.9403	0.6245	0.9403	0.9697
0.4205	9.2069	534	0.9391	0.6245	0.9391	0.9691
0.4205	9.2414	536	0.9206	0.6386	0.9206	0.9595
0.4205	9.2759	538	0.9042	0.6476	0.9042	0.9509
0.4205	9.3103	540	0.8813	0.6442	0.8813	0.9388
0.4205	9.3448	542	0.8732	0.6422	0.8732	0.9345
0.4205	9.3793	544	0.8743	0.6422	0.8743	0.9350
0.4205	9.4138	546	0.8644	0.6513	0.8644	0.9297
0.4205	9.4483	548	0.8611	0.6513	0.8611	0.9279
0.4205	9.4828	550	0.8452	0.6716	0.8452	0.9193
0.4205	9.5172	552	0.8359	0.6716	0.8359	0.9143
0.4205	9.5517	554	0.8345	0.6716	0.8345	0.9135
0.4205	9.5862	556	0.8376	0.6716	0.8376	0.9152
0.4205	9.6207	558	0.8381	0.6716	0.8381	0.9155
0.4205	9.6552	560	0.8408	0.6716	0.8408	0.9169
0.4205	9.6897	562	0.8477	0.6716	0.8477	0.9207
0.4205	9.7241	564	0.8482	0.6700	0.8482	0.9210
0.4205	9.7586	566	0.8474	0.6700	0.8474	0.9205
0.4205	9.7931	568	0.8452	0.6700	0.8452	0.9194
0.4205	9.8276	570	0.8412	0.6716	0.8412	0.9172
0.4205	9.8621	572	0.8388	0.6716	0.8388	0.9159
0.4205	9.8966	574	0.8358	0.6716	0.8358	0.9142
0.4205	9.9310	576	0.8357	0.6716	0.8357	0.9142
0.4205	9.9655	578	0.8354	0.6716	0.8354	0.9140
0.4205	10.0	580	0.8352	0.6716	0.8352	0.9139

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1