ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0576
• Qwk: 0.5878
• Mse: 1.0576
• Rmse: 1.0284

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0317	2	2.3308	-0.0139	2.3308	1.5267
No log	0.0635	4	1.5119	0.1162	1.5119	1.2296
No log	0.0952	6	1.6121	0.1430	1.6121	1.2697
No log	0.1270	8	1.7649	0.2135	1.7649	1.3285
No log	0.1587	10	1.8650	0.1893	1.8650	1.3656
No log	0.1905	12	2.0627	0.2403	2.0627	1.4362
No log	0.2222	14	2.1341	0.2175	2.1341	1.4608
No log	0.2540	16	2.0747	0.2190	2.0747	1.4404
No log	0.2857	18	1.7800	0.0915	1.7800	1.3342
No log	0.3175	20	1.7933	0.0662	1.7933	1.3391
No log	0.3492	22	1.9504	0.1569	1.9504	1.3966
No log	0.3810	24	1.9907	0.2533	1.9907	1.4109
No log	0.4127	26	1.9181	0.2529	1.9181	1.3850
No log	0.4444	28	1.7901	0.2512	1.7901	1.3380
No log	0.4762	30	1.7047	0.2533	1.7047	1.3056
No log	0.5079	32	1.6162	0.2156	1.6162	1.2713
No log	0.5397	34	1.5336	0.1827	1.5336	1.2384
No log	0.5714	36	1.5339	0.1980	1.5339	1.2385
No log	0.6032	38	1.6552	0.2874	1.6552	1.2866
No log	0.6349	40	1.7783	0.3481	1.7783	1.3335
No log	0.6667	42	1.6888	0.3520	1.6888	1.2995
No log	0.6984	44	1.5747	0.3006	1.5747	1.2549
No log	0.7302	46	1.5975	0.2766	1.5975	1.2639
No log	0.7619	48	1.6868	0.3382	1.6868	1.2988
No log	0.7937	50	1.7725	0.3364	1.7725	1.3314
No log	0.8254	52	1.6702	0.3225	1.6702	1.2924
No log	0.8571	54	1.7492	0.3228	1.7492	1.3226
No log	0.8889	56	2.0356	0.2872	2.0356	1.4267
No log	0.9206	58	2.4540	0.1974	2.4540	1.5665
No log	0.9524	60	2.7445	0.2067	2.7445	1.6566
No log	0.9841	62	2.6250	0.2917	2.6250	1.6202
No log	1.0159	64	2.0564	0.3260	2.0564	1.4340
No log	1.0476	66	1.8504	0.3412	1.8504	1.3603
No log	1.0794	68	1.7802	0.3412	1.7802	1.3343
No log	1.1111	70	2.1390	0.3611	2.1390	1.4625
No log	1.1429	72	2.1681	0.3431	2.1681	1.4724
No log	1.1746	74	2.0890	0.3007	2.0890	1.4453
No log	1.2063	76	1.8879	0.3888	1.8879	1.3740
No log	1.2381	78	1.8476	0.3887	1.8476	1.3593
No log	1.2698	80	1.7163	0.4082	1.7163	1.3101
No log	1.3016	82	1.5149	0.4831	1.5149	1.2308
No log	1.3333	84	1.9047	0.3787	1.9047	1.3801
No log	1.3651	86	2.5995	0.3659	2.5995	1.6123
No log	1.3968	88	2.4274	0.3784	2.4274	1.5580
No log	1.4286	90	1.8433	0.3975	1.8433	1.3577
No log	1.4603	92	1.9396	0.3690	1.9396	1.3927
No log	1.4921	94	2.2761	0.3203	2.2761	1.5087
No log	1.5238	96	2.1952	0.3477	2.1952	1.4816
No log	1.5556	98	1.6676	0.4187	1.6676	1.2913
No log	1.5873	100	1.2711	0.4955	1.2711	1.1274
No log	1.6190	102	1.3895	0.4668	1.3895	1.1788
No log	1.6508	104	2.0744	0.4186	2.0744	1.4403
No log	1.6825	106	2.5721	0.3838	2.5721	1.6038
No log	1.7143	108	2.0804	0.4196	2.0804	1.4424
No log	1.7460	110	1.4056	0.4763	1.4056	1.1856
No log	1.7778	112	1.3052	0.5028	1.3052	1.1425
No log	1.8095	114	1.5751	0.4695	1.5751	1.2550
No log	1.8413	116	1.9955	0.4079	1.9955	1.4126
No log	1.8730	118	1.7613	0.4418	1.7613	1.3271
No log	1.9048	120	1.4029	0.4728	1.4029	1.1844
No log	1.9365	122	1.1596	0.5478	1.1596	1.0768
No log	1.9683	124	1.1638	0.5469	1.1638	1.0788
No log	2.0	126	1.3473	0.5224	1.3473	1.1607
No log	2.0317	128	2.0135	0.4593	2.0135	1.4190
No log	2.0635	130	2.3032	0.4287	2.3032	1.5176
No log	2.0952	132	2.2111	0.4430	2.2111	1.4870
No log	2.1270	134	1.5031	0.5171	1.5031	1.2260
No log	2.1587	136	1.1349	0.5629	1.1349	1.0653
No log	2.1905	138	1.2466	0.5738	1.2466	1.1165
No log	2.2222	140	1.7724	0.4774	1.7724	1.3313
No log	2.2540	142	2.1024	0.4329	2.1024	1.4500
No log	2.2857	144	1.8525	0.4435	1.8525	1.3611
No log	2.3175	146	1.5042	0.4670	1.5042	1.2264
No log	2.3492	148	1.5734	0.4908	1.5734	1.2544
No log	2.3810	150	1.7672	0.4865	1.7672	1.3293
No log	2.4127	152	1.4688	0.5449	1.4688	1.2119
No log	2.4444	154	1.1739	0.5937	1.1739	1.0834
No log	2.4762	156	1.2187	0.5728	1.2187	1.1040
No log	2.5079	158	1.5362	0.5088	1.5362	1.2394
No log	2.5397	160	1.5603	0.4616	1.5603	1.2491
No log	2.5714	162	1.4048	0.4770	1.4048	1.1852
No log	2.6032	164	1.1953	0.5602	1.1953	1.0933
No log	2.6349	166	0.9731	0.5748	0.9731	0.9864
No log	2.6667	168	0.9573	0.6021	0.9573	0.9784
No log	2.6984	170	1.0492	0.6174	1.0492	1.0243
No log	2.7302	172	1.1922	0.5454	1.1922	1.0919
No log	2.7619	174	1.1385	0.5942	1.1385	1.0670
No log	2.7937	176	1.2293	0.5570	1.2293	1.1087
No log	2.8254	178	1.2014	0.5802	1.2014	1.0961
No log	2.8571	180	1.0695	0.6077	1.0695	1.0342
No log	2.8889	182	1.0010	0.6107	1.0010	1.0005
No log	2.9206	184	1.1382	0.5960	1.1382	1.0669
No log	2.9524	186	1.2935	0.5844	1.2935	1.1373
No log	2.9841	188	1.3558	0.5720	1.3558	1.1644
No log	3.0159	190	1.3005	0.5932	1.3005	1.1404
No log	3.0476	192	1.0620	0.6246	1.0620	1.0305
No log	3.0794	194	0.9944	0.6099	0.9944	0.9972
No log	3.1111	196	1.1717	0.6137	1.1717	1.0824
No log	3.1429	198	1.2394	0.6051	1.2394	1.1133
No log	3.1746	200	1.3280	0.5507	1.3280	1.1524
No log	3.2063	202	1.3214	0.5406	1.3214	1.1495
No log	3.2381	204	1.2866	0.5597	1.2866	1.1343
No log	3.2698	206	1.5437	0.5130	1.5437	1.2425
No log	3.3016	208	1.7416	0.4707	1.7416	1.3197
No log	3.3333	210	1.4691	0.5523	1.4691	1.2121
No log	3.3651	212	1.0212	0.6248	1.0212	1.0105
No log	3.3968	214	0.8944	0.6466	0.8944	0.9457
No log	3.4286	216	0.9853	0.6286	0.9853	0.9926
No log	3.4603	218	1.1681	0.5918	1.1681	1.0808
No log	3.4921	220	1.2455	0.5666	1.2455	1.1160
No log	3.5238	222	1.1506	0.5803	1.1506	1.0727
No log	3.5556	224	0.9077	0.5909	0.9077	0.9527
No log	3.5873	226	0.8643	0.5879	0.8643	0.9297
No log	3.6190	228	1.0624	0.5935	1.0624	1.0307
No log	3.6508	230	1.5256	0.5026	1.5256	1.2352
No log	3.6825	232	1.8052	0.4748	1.8052	1.3436
No log	3.7143	234	1.6603	0.4872	1.6603	1.2885
No log	3.7460	236	1.2550	0.5739	1.2550	1.1203
No log	3.7778	238	1.0287	0.5874	1.0287	1.0142
No log	3.8095	240	1.0421	0.5850	1.0421	1.0208
No log	3.8413	242	1.2866	0.5560	1.2866	1.1343
No log	3.8730	244	1.5767	0.5032	1.5767	1.2557
No log	3.9048	246	1.5429	0.5032	1.5429	1.2421
No log	3.9365	248	1.3582	0.5167	1.3582	1.1654
No log	3.9683	250	1.0777	0.5495	1.0777	1.0381
No log	4.0	252	0.9962	0.6308	0.9962	0.9981
No log	4.0317	254	1.0518	0.5564	1.0518	1.0256
No log	4.0635	256	1.1995	0.5320	1.1995	1.0952
No log	4.0952	258	1.3739	0.5036	1.3739	1.1721
No log	4.1270	260	1.5103	0.5030	1.5103	1.2290
No log	4.1587	262	1.3811	0.5324	1.3811	1.1752
No log	4.1905	264	1.0769	0.5947	1.0769	1.0377
No log	4.2222	266	0.9773	0.6233	0.9773	0.9886
No log	4.2540	268	1.0687	0.5891	1.0687	1.0338
No log	4.2857	270	1.1457	0.5939	1.1457	1.0704
No log	4.3175	272	1.2581	0.5897	1.2581	1.1216
No log	4.3492	274	1.2042	0.5628	1.2042	1.0974
No log	4.3810	276	1.1531	0.5714	1.1531	1.0738
No log	4.4127	278	1.0289	0.5792	1.0289	1.0143
No log	4.4444	280	0.9185	0.5568	0.9185	0.9584
No log	4.4762	282	0.9436	0.5757	0.9436	0.9714
No log	4.5079	284	0.9757	0.5895	0.9757	0.9878
No log	4.5397	286	1.0835	0.6009	1.0835	1.0409
No log	4.5714	288	1.0389	0.6082	1.0389	1.0193
No log	4.6032	290	0.9115	0.6224	0.9115	0.9547
No log	4.6349	292	0.9116	0.6354	0.9116	0.9548
No log	4.6667	294	1.0524	0.6022	1.0524	1.0259
No log	4.6984	296	1.2048	0.6033	1.2048	1.0977
No log	4.7302	298	1.1780	0.6013	1.1780	1.0853
No log	4.7619	300	1.1309	0.6170	1.1309	1.0634
No log	4.7937	302	1.0754	0.6090	1.0754	1.0370
No log	4.8254	304	0.9445	0.6400	0.9445	0.9719
No log	4.8571	306	0.9262	0.6172	0.9262	0.9624
No log	4.8889	308	1.0030	0.6092	1.0030	1.0015
No log	4.9206	310	1.0491	0.6079	1.0491	1.0242
No log	4.9524	312	1.1783	0.5645	1.1783	1.0855
No log	4.9841	314	1.1807	0.5778	1.1807	1.0866
No log	5.0159	316	1.0812	0.6022	1.0812	1.0398
No log	5.0476	318	0.9562	0.5893	0.9562	0.9779
No log	5.0794	320	0.9522	0.5940	0.9522	0.9758
No log	5.1111	322	1.0656	0.5893	1.0656	1.0323
No log	5.1429	324	1.1718	0.5651	1.1718	1.0825
No log	5.1746	326	1.1327	0.5552	1.1327	1.0643
No log	5.2063	328	1.0042	0.5953	1.0042	1.0021
No log	5.2381	330	1.0007	0.6070	1.0007	1.0004
No log	5.2698	332	1.1415	0.5736	1.1415	1.0684
No log	5.3016	334	1.2137	0.5767	1.2137	1.1017
No log	5.3333	336	1.1130	0.5946	1.1130	1.0550
No log	5.3651	338	0.9612	0.6011	0.9612	0.9804
No log	5.3968	340	0.8522	0.6575	0.8522	0.9231
No log	5.4286	342	0.8624	0.6445	0.8624	0.9286
No log	5.4603	344	0.9703	0.5975	0.9703	0.9850
No log	5.4921	346	1.1302	0.5769	1.1302	1.0631
No log	5.5238	348	1.3278	0.5470	1.3278	1.1523
No log	5.5556	350	1.3037	0.5580	1.3037	1.1418
No log	5.5873	352	1.1212	0.5758	1.1212	1.0588
No log	5.6190	354	0.9495	0.6181	0.9495	0.9744
No log	5.6508	356	0.9028	0.6089	0.9028	0.9501
No log	5.6825	358	0.9845	0.6258	0.9845	0.9922
No log	5.7143	360	1.1423	0.5617	1.1423	1.0688
No log	5.7460	362	1.2509	0.5311	1.2509	1.1184
No log	5.7778	364	1.2364	0.5294	1.2364	1.1119
No log	5.8095	366	1.1912	0.5566	1.1912	1.0914
No log	5.8413	368	1.2237	0.5487	1.2237	1.1062
No log	5.8730	370	1.1849	0.5678	1.1849	1.0885
No log	5.9048	372	1.1245	0.6167	1.1245	1.0604
No log	5.9365	374	1.1965	0.5878	1.1965	1.0939
No log	5.9683	376	1.3119	0.5492	1.3119	1.1454
No log	6.0	378	1.3168	0.5592	1.3168	1.1475
No log	6.0317	380	1.1797	0.5537	1.1797	1.0861
No log	6.0635	382	0.9792	0.6373	0.9792	0.9895
No log	6.0952	384	0.8688	0.6233	0.8688	0.9321
No log	6.1270	386	0.8703	0.6333	0.8703	0.9329
No log	6.1587	388	0.9544	0.6466	0.9544	0.9769
No log	6.1905	390	1.1036	0.5378	1.1036	1.0505
No log	6.2222	392	1.2136	0.5283	1.2136	1.1017
No log	6.2540	394	1.2299	0.5310	1.2299	1.1090
No log	6.2857	396	1.2463	0.5197	1.2463	1.1164
No log	6.3175	398	1.2668	0.5197	1.2668	1.1255
No log	6.3492	400	1.2623	0.5310	1.2623	1.1235
No log	6.3810	402	1.2834	0.5310	1.2834	1.1329
No log	6.4127	404	1.2541	0.5392	1.2541	1.1199
No log	6.4444	406	1.2852	0.5392	1.2852	1.1337
No log	6.4762	408	1.2784	0.5392	1.2784	1.1307
No log	6.5079	410	1.2500	0.5361	1.2500	1.1180
No log	6.5397	412	1.1555	0.5664	1.1555	1.0749
No log	6.5714	414	1.0814	0.6119	1.0814	1.0399
No log	6.6032	416	1.0485	0.6161	1.0485	1.0240
No log	6.6349	418	1.0703	0.6119	1.0703	1.0346
No log	6.6667	420	1.0092	0.6229	1.0092	1.0046
No log	6.6984	422	0.9242	0.6317	0.9242	0.9613
No log	6.7302	424	0.9091	0.6410	0.9091	0.9535
No log	6.7619	426	0.9780	0.6227	0.9780	0.9889
No log	6.7937	428	0.9986	0.6108	0.9986	0.9993
No log	6.8254	430	1.0328	0.6142	1.0328	1.0163
No log	6.8571	432	1.1004	0.6065	1.1004	1.0490
No log	6.8889	434	1.0893	0.6106	1.0893	1.0437
No log	6.9206	436	1.0454	0.5951	1.0454	1.0225
No log	6.9524	438	1.0859	0.5972	1.0859	1.0421
No log	6.9841	440	1.0942	0.5909	1.0942	1.0460
No log	7.0159	442	1.0534	0.5945	1.0534	1.0264
No log	7.0476	444	0.9686	0.6168	0.9686	0.9842
No log	7.0794	446	0.9232	0.6469	0.9232	0.9608
No log	7.1111	448	0.9693	0.6107	0.9693	0.9845
No log	7.1429	450	1.0575	0.5945	1.0575	1.0283
No log	7.1746	452	1.0900	0.5824	1.0900	1.0440
No log	7.2063	454	1.0913	0.5940	1.0913	1.0447
No log	7.2381	456	1.0594	0.6079	1.0594	1.0293
No log	7.2698	458	1.0437	0.6258	1.0437	1.0216
No log	7.3016	460	1.0262	0.6383	1.0262	1.0130
No log	7.3333	462	1.0690	0.6504	1.0690	1.0339
No log	7.3651	464	1.1366	0.6224	1.1366	1.0661
No log	7.3968	466	1.1508	0.6157	1.1508	1.0728
No log	7.4286	468	1.0688	0.6132	1.0688	1.0338
No log	7.4603	470	0.9997	0.6195	0.9997	0.9999
No log	7.4921	472	0.9106	0.6437	0.9106	0.9543
No log	7.5238	474	0.8488	0.6491	0.8488	0.9213
No log	7.5556	476	0.8561	0.6478	0.8561	0.9253
No log	7.5873	478	0.8905	0.6357	0.8905	0.9437
No log	7.6190	480	0.9592	0.6036	0.9592	0.9794
No log	7.6508	482	1.0724	0.5648	1.0724	1.0356
No log	7.6825	484	1.1320	0.5747	1.1320	1.0640
No log	7.7143	486	1.1542	0.5747	1.1542	1.0743
No log	7.7460	488	1.0931	0.5768	1.0931	1.0455
No log	7.7778	490	1.0015	0.5979	1.0015	1.0008
No log	7.8095	492	0.9309	0.6181	0.9309	0.9648
No log	7.8413	494	0.9129	0.6290	0.9129	0.9555
No log	7.8730	496	0.9415	0.6040	0.9415	0.9703
No log	7.9048	498	1.0133	0.5957	1.0133	1.0066
0.3653	7.9365	500	1.0837	0.5527	1.0837	1.0410
0.3653	7.9683	502	1.1287	0.5575	1.1287	1.0624
0.3653	8.0	504	1.1073	0.5527	1.1073	1.0523
0.3653	8.0317	506	1.0969	0.5527	1.0969	1.0473
0.3653	8.0635	508	1.0821	0.5527	1.0821	1.0402
0.3653	8.0952	510	1.0370	0.5614	1.0370	1.0183
0.3653	8.1270	512	1.0132	0.5566	1.0132	1.0066
0.3653	8.1587	514	1.0164	0.5566	1.0164	1.0082
0.3653	8.1905	516	1.0237	0.5666	1.0237	1.0118
0.3653	8.2222	518	1.0341	0.5666	1.0341	1.0169
0.3653	8.2540	520	1.0360	0.5666	1.0360	1.0179
0.3653	8.2857	522	1.0353	0.5666	1.0353	1.0175
0.3653	8.3175	524	1.0296	0.5666	1.0296	1.0147
0.3653	8.3492	526	1.0190	0.5791	1.0190	1.0095
0.3653	8.3810	528	0.9914	0.5839	0.9914	0.9957
0.3653	8.4127	530	0.9998	0.5978	0.9998	0.9999
0.3653	8.4444	532	1.0108	0.5857	1.0108	1.0054
0.3653	8.4762	534	1.0643	0.5758	1.0643	1.0317
0.3653	8.5079	536	1.0924	0.5758	1.0924	1.0452
0.3653	8.5397	538	1.1114	0.5715	1.1114	1.0542
0.3653	8.5714	540	1.1136	0.5715	1.1136	1.0553
0.3653	8.6032	542	1.1433	0.5233	1.1433	1.0693
0.3653	8.6349	544	1.1647	0.5218	1.1647	1.0792
0.3653	8.6667	546	1.1452	0.5463	1.1452	1.0701
0.3653	8.6984	548	1.1112	0.5517	1.1112	1.0541
0.3653	8.7302	550	1.0698	0.5682	1.0698	1.0343
0.3653	8.7619	552	1.0480	0.5682	1.0480	1.0237
0.3653	8.7937	554	1.0543	0.5658	1.0543	1.0268
0.3653	8.8254	556	1.0830	0.5561	1.0830	1.0407
0.3653	8.8571	558	1.1087	0.5517	1.1087	1.0530
0.3653	8.8889	560	1.1041	0.5517	1.1041	1.0508
0.3653	8.9206	562	1.1187	0.5517	1.1187	1.0577
0.3653	8.9524	564	1.1209	0.5517	1.1209	1.0587
0.3653	8.9841	566	1.1069	0.5638	1.1069	1.0521
0.3653	9.0159	568	1.1115	0.5704	1.1115	1.0543
0.3653	9.0476	570	1.1230	0.5738	1.1230	1.0597
0.3653	9.0794	572	1.1357	0.5651	1.1357	1.0657
0.3653	9.1111	574	1.1363	0.5684	1.1363	1.0660
0.3653	9.1429	576	1.1219	0.5771	1.1219	1.0592
0.3653	9.1746	578	1.1018	0.5826	1.1018	1.0497
0.3653	9.2063	580	1.0887	0.5869	1.0887	1.0434
0.3653	9.2381	582	1.0803	0.5836	1.0803	1.0394
0.3653	9.2698	584	1.0590	0.5923	1.0590	1.0291
0.3653	9.3016	586	1.0571	0.5923	1.0571	1.0281
0.3653	9.3333	588	1.0645	0.5942	1.0645	1.0318
0.3653	9.3651	590	1.0771	0.5942	1.0771	1.0378
0.3653	9.3968	592	1.0828	0.5942	1.0828	1.0406
0.3653	9.4286	594	1.0883	0.5975	1.0883	1.0432
0.3653	9.4603	596	1.1073	0.5965	1.1073	1.0523
0.3653	9.4921	598	1.1189	0.5598	1.1189	1.0578
0.3653	9.5238	600	1.1190	0.5759	1.1190	1.0578
0.3653	9.5556	602	1.1217	0.5759	1.1217	1.0591
0.3653	9.5873	604	1.1248	0.5598	1.1248	1.0606
0.3653	9.6190	606	1.1310	0.5598	1.1310	1.0635
0.3653	9.6508	608	1.1319	0.5598	1.1319	1.0639
0.3653	9.6825	610	1.1304	0.5598	1.1304	1.0632
0.3653	9.7143	612	1.1208	0.5759	1.1208	1.0587
0.3653	9.7460	614	1.1069	0.5846	1.1069	1.0521
0.3653	9.7778	616	1.0957	0.5846	1.0957	1.0467
0.3653	9.8095	618	1.0850	0.6008	1.0850	1.0416
0.3653	9.8413	620	1.0762	0.6008	1.0762	1.0374
0.3653	9.8730	622	1.0680	0.5942	1.0680	1.0334
0.3653	9.9048	624	1.0622	0.5878	1.0622	1.0306
0.3653	9.9365	626	1.0598	0.5878	1.0598	1.0295
0.3653	9.9683	628	1.0584	0.5878	1.0584	1.0288
0.3653	10.0	630	1.0576	0.5878	1.0576	1.0284

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1