ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0311
• Qwk: 0.6551
• Mse: 1.0311
• Rmse: 1.0154

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.2489	0.0523	2.2489	1.4996
No log	0.0755	4	1.4613	0.1815	1.4613	1.2088
No log	0.1132	6	1.3887	0.1575	1.3887	1.1784
No log	0.1509	8	1.4162	0.2015	1.4162	1.1900
No log	0.1887	10	1.5631	0.3510	1.5631	1.2502
No log	0.2264	12	1.6306	0.3322	1.6306	1.2769
No log	0.2642	14	1.5097	0.1666	1.5097	1.2287
No log	0.3019	16	1.4299	0.1711	1.4299	1.1958
No log	0.3396	18	1.4116	0.1258	1.4116	1.1881
No log	0.3774	20	1.4241	0.1711	1.4241	1.1934
No log	0.4151	22	1.5291	0.3109	1.5291	1.2366
No log	0.4528	24	1.6232	0.3769	1.6232	1.2740
No log	0.4906	26	1.7126	0.3318	1.7126	1.3087
No log	0.5283	28	1.7142	0.3329	1.7142	1.3093
No log	0.5660	30	1.6618	0.3950	1.6618	1.2891
No log	0.6038	32	1.6418	0.3853	1.6418	1.2813
No log	0.6415	34	1.5816	0.3134	1.5816	1.2576
No log	0.6792	36	1.5473	0.3101	1.5473	1.2439
No log	0.7170	38	1.6520	0.3439	1.6520	1.2853
No log	0.7547	40	1.8531	0.3136	1.8531	1.3613
No log	0.7925	42	1.9959	0.2766	1.9959	1.4127
No log	0.8302	44	1.8526	0.3054	1.8526	1.3611
No log	0.8679	46	1.5661	0.3614	1.5661	1.2514
No log	0.9057	48	1.3676	0.4335	1.3676	1.1695
No log	0.9434	50	1.2637	0.4656	1.2637	1.1241
No log	0.9811	52	1.1884	0.5170	1.1884	1.0902
No log	1.0189	54	1.3761	0.4555	1.3761	1.1731
No log	1.0566	56	1.6777	0.4420	1.6777	1.2953
No log	1.0943	58	1.8271	0.4294	1.8271	1.3517
No log	1.1321	60	1.6343	0.4685	1.6343	1.2784
No log	1.1698	62	1.6704	0.4778	1.6704	1.2924
No log	1.2075	64	1.8927	0.4393	1.8927	1.3758
No log	1.2453	66	1.8381	0.4390	1.8381	1.3558
No log	1.2830	68	1.7684	0.4355	1.7684	1.3298
No log	1.3208	70	1.6071	0.4780	1.6071	1.2677
No log	1.3585	72	1.3052	0.5144	1.3052	1.1424
No log	1.3962	74	1.1610	0.5357	1.1610	1.0775
No log	1.4340	76	1.3522	0.5010	1.3522	1.1628
No log	1.4717	78	1.9280	0.4741	1.9280	1.3885
No log	1.5094	80	2.2270	0.4607	2.2270	1.4923
No log	1.5472	82	2.1049	0.4721	2.1049	1.4508
No log	1.5849	84	1.6809	0.4981	1.6809	1.2965
No log	1.6226	86	1.6228	0.4886	1.6228	1.2739
No log	1.6604	88	1.7947	0.4825	1.7947	1.3397
No log	1.6981	90	1.9373	0.4598	1.9373	1.3919
No log	1.7358	92	1.9145	0.4814	1.9145	1.3836
No log	1.7736	94	1.7177	0.4994	1.7177	1.3106
No log	1.8113	96	1.6006	0.5429	1.6006	1.2651
No log	1.8491	98	1.3956	0.5780	1.3956	1.1814
No log	1.8868	100	1.1335	0.6136	1.1335	1.0646
No log	1.9245	102	1.1254	0.6099	1.1254	1.0608
No log	1.9623	104	1.0380	0.6665	1.0380	1.0188
No log	2.0	106	1.0994	0.6122	1.0994	1.0485
No log	2.0377	108	1.2437	0.5880	1.2437	1.1152
No log	2.0755	110	1.2915	0.6062	1.2915	1.1364
No log	2.1132	112	1.4995	0.5623	1.4995	1.2245
No log	2.1509	114	1.6393	0.5531	1.6393	1.2804
No log	2.1887	116	1.6711	0.5435	1.6711	1.2927
No log	2.2264	118	1.5657	0.5552	1.5657	1.2513
No log	2.2642	120	1.3434	0.5727	1.3434	1.1591
No log	2.3019	122	1.3007	0.5652	1.3007	1.1405
No log	2.3396	124	1.2346	0.5775	1.2346	1.1111
No log	2.3774	126	1.2529	0.5794	1.2529	1.1193
No log	2.4151	128	1.4128	0.5474	1.4128	1.1886
No log	2.4528	130	1.4243	0.5460	1.4243	1.1934
No log	2.4906	132	1.2560	0.5603	1.2560	1.1207
No log	2.5283	134	1.1742	0.5736	1.1742	1.0836
No log	2.5660	136	1.4003	0.5517	1.4003	1.1833
No log	2.6038	138	1.4112	0.5561	1.4112	1.1879
No log	2.6415	140	1.4060	0.5540	1.4060	1.1858
No log	2.6792	142	1.2769	0.5668	1.2769	1.1300
No log	2.7170	144	1.1000	0.5906	1.1000	1.0488
No log	2.7547	146	1.0976	0.5873	1.0976	1.0477
No log	2.7925	148	1.1818	0.5688	1.1818	1.0871
No log	2.8302	150	1.1416	0.5805	1.1416	1.0684
No log	2.8679	152	0.9422	0.6606	0.9422	0.9707
No log	2.9057	154	0.9359	0.6606	0.9359	0.9674
No log	2.9434	156	0.9569	0.6517	0.9569	0.9782
No log	2.9811	158	1.0114	0.6263	1.0114	1.0057
No log	3.0189	160	0.9717	0.6470	0.9717	0.9858
No log	3.0566	162	1.1658	0.5965	1.1658	1.0797
No log	3.0943	164	1.4858	0.5788	1.4858	1.2189
No log	3.1321	166	1.3374	0.5736	1.3374	1.1565
No log	3.1698	168	1.0424	0.6261	1.0424	1.0210
No log	3.2075	170	0.8923	0.6723	0.8923	0.9446
No log	3.2453	172	0.9994	0.6496	0.9994	0.9997
No log	3.2830	174	1.2459	0.5688	1.2459	1.1162
No log	3.3208	176	1.5709	0.5344	1.5709	1.2533
No log	3.3585	178	1.4944	0.5453	1.4944	1.2224
No log	3.3962	180	1.2408	0.5717	1.2408	1.1139
No log	3.4340	182	0.9443	0.6723	0.9443	0.9718
No log	3.4717	184	0.8833	0.6861	0.8833	0.9399
No log	3.5094	186	1.0207	0.6087	1.0207	1.0103
No log	3.5472	188	1.1177	0.6071	1.1177	1.0572
No log	3.5849	190	1.0199	0.6143	1.0199	1.0099
No log	3.6226	192	0.9685	0.6240	0.9685	0.9841
No log	3.6604	194	0.8809	0.6884	0.8809	0.9386
No log	3.6981	196	0.9118	0.6768	0.9118	0.9549
No log	3.7358	198	1.0065	0.6418	1.0065	1.0033
No log	3.7736	200	1.1082	0.6010	1.1082	1.0527
No log	3.8113	202	1.1584	0.6010	1.1584	1.0763
No log	3.8491	204	1.0282	0.6207	1.0282	1.0140
No log	3.8868	206	0.9188	0.6542	0.9188	0.9586
No log	3.9245	208	0.8755	0.6592	0.8755	0.9357
No log	3.9623	210	1.0042	0.6269	1.0042	1.0021
No log	4.0	212	1.3481	0.5711	1.3481	1.1611
No log	4.0377	214	1.6937	0.5245	1.6937	1.3014
No log	4.0755	216	1.7108	0.5355	1.7108	1.3080
No log	4.1132	218	1.4239	0.5635	1.4239	1.1933
No log	4.1509	220	1.0764	0.6282	1.0764	1.0375
No log	4.1887	222	0.8401	0.6797	0.8401	0.9166
No log	4.2264	224	0.8385	0.6616	0.8385	0.9157
No log	4.2642	226	0.9953	0.6263	0.9953	0.9977
No log	4.3019	228	1.3300	0.5797	1.3300	1.1533
No log	4.3396	230	1.7169	0.5259	1.7169	1.3103
No log	4.3774	232	1.7949	0.5181	1.7949	1.3397
No log	4.4151	234	1.6453	0.5336	1.6453	1.2827
No log	4.4528	236	1.3461	0.5557	1.3461	1.1602
No log	4.4906	238	1.1359	0.5928	1.1359	1.0658
No log	4.5283	240	1.0529	0.6359	1.0529	1.0261
No log	4.5660	242	1.1249	0.5897	1.1249	1.0606
No log	4.6038	244	1.1041	0.6021	1.1041	1.0508
No log	4.6415	246	1.1141	0.6156	1.1141	1.0555
No log	4.6792	248	1.1627	0.6117	1.1627	1.0783
No log	4.7170	250	1.1077	0.6282	1.1077	1.0525
No log	4.7547	252	0.9599	0.6420	0.9599	0.9797
No log	4.7925	254	0.9455	0.6354	0.9455	0.9724
No log	4.8302	256	0.9623	0.6325	0.9623	0.9810
No log	4.8679	258	0.9750	0.6311	0.9750	0.9874
No log	4.9057	260	0.9551	0.6542	0.9551	0.9773
No log	4.9434	262	0.9627	0.6494	0.9627	0.9812
No log	4.9811	264	0.9079	0.6750	0.9079	0.9528
No log	5.0189	266	0.8164	0.6979	0.8164	0.9036
No log	5.0566	268	0.7856	0.7188	0.7856	0.8863
No log	5.0943	270	0.7929	0.7185	0.7929	0.8905
No log	5.1321	272	0.7914	0.7230	0.7914	0.8896
No log	5.1698	274	0.7899	0.7230	0.7899	0.8888
No log	5.2075	276	0.9106	0.6664	0.9106	0.9542
No log	5.2453	278	1.1329	0.6078	1.1329	1.0644
No log	5.2830	280	1.3067	0.5474	1.3067	1.1431
No log	5.3208	282	1.3046	0.5450	1.3046	1.1422
No log	5.3585	284	1.1988	0.5490	1.1988	1.0949
No log	5.3962	286	1.1526	0.5920	1.1526	1.0736
No log	5.4340	288	1.1292	0.6068	1.1292	1.0626
No log	5.4717	290	1.0411	0.6423	1.0411	1.0204
No log	5.5094	292	1.0156	0.6439	1.0156	1.0078
No log	5.5472	294	1.0881	0.6165	1.0881	1.0431
No log	5.5849	296	1.1376	0.6020	1.1376	1.0666
No log	5.6226	298	1.1465	0.6070	1.1466	1.0708
No log	5.6604	300	1.0485	0.6227	1.0485	1.0239
No log	5.6981	302	0.9814	0.6402	0.9814	0.9907
No log	5.7358	304	0.8915	0.6421	0.8915	0.9442
No log	5.7736	306	0.8133	0.6855	0.8133	0.9018
No log	5.8113	308	0.7803	0.6901	0.7803	0.8834
No log	5.8491	310	0.8222	0.6855	0.8222	0.9068
No log	5.8868	312	0.9551	0.6426	0.9551	0.9773
No log	5.9245	314	1.0467	0.6521	1.0467	1.0231
No log	5.9623	316	1.2040	0.6069	1.2040	1.0973
No log	6.0	318	1.2395	0.6099	1.2395	1.1133
No log	6.0377	320	1.1251	0.6483	1.1251	1.0607
No log	6.0755	322	0.9806	0.6465	0.9806	0.9903
No log	6.1132	324	0.9660	0.6473	0.9660	0.9829
No log	6.1509	326	0.9972	0.6421	0.9972	0.9986
No log	6.1887	328	1.0857	0.6289	1.0857	1.0420
No log	6.2264	330	1.2671	0.5740	1.2671	1.1256
No log	6.2642	332	1.3505	0.5788	1.3505	1.1621
No log	6.3019	334	1.3118	0.5891	1.3118	1.1453
No log	6.3396	336	1.2801	0.6069	1.2801	1.1314
No log	6.3774	338	1.2427	0.6312	1.2427	1.1148
No log	6.4151	340	1.2152	0.6405	1.2152	1.1024
No log	6.4528	342	1.1440	0.6216	1.1440	1.0696
No log	6.4906	344	1.0878	0.6347	1.0878	1.0430
No log	6.5283	346	1.0853	0.6347	1.0853	1.0418
No log	6.5660	348	1.1469	0.6216	1.1469	1.0709
No log	6.6038	350	1.1744	0.6257	1.1744	1.0837
No log	6.6415	352	1.2738	0.6193	1.2738	1.1286
No log	6.6792	354	1.3057	0.6066	1.3057	1.1427
No log	6.7170	356	1.2605	0.6217	1.2605	1.1227
No log	6.7547	358	1.1304	0.6372	1.1304	1.0632
No log	6.7925	360	1.0801	0.6360	1.0801	1.0393
No log	6.8302	362	1.1108	0.6360	1.1108	1.0539
No log	6.8679	364	1.1222	0.6360	1.1222	1.0594
No log	6.9057	366	1.1383	0.6359	1.1383	1.0669
No log	6.9434	368	1.1354	0.6441	1.1354	1.0655
No log	6.9811	370	1.1743	0.6463	1.1743	1.0836
No log	7.0189	372	1.1560	0.6371	1.1560	1.0752
No log	7.0566	374	1.0902	0.6407	1.0902	1.0441
No log	7.0943	376	1.0545	0.6407	1.0545	1.0269
No log	7.1321	378	1.0058	0.6462	1.0058	1.0029
No log	7.1698	380	0.9403	0.6521	0.9403	0.9697
No log	7.2075	382	0.9286	0.6521	0.9286	0.9636
No log	7.2453	384	0.9931	0.6567	0.9931	0.9966
No log	7.2830	386	1.1253	0.6386	1.1253	1.0608
No log	7.3208	388	1.2376	0.5960	1.2376	1.1125
No log	7.3585	390	1.2593	0.5861	1.2593	1.1222
No log	7.3962	392	1.1910	0.6186	1.1910	1.0913
No log	7.4340	394	1.0566	0.6536	1.0566	1.0279
No log	7.4717	396	0.9695	0.6591	0.9695	0.9846
No log	7.5094	398	0.9336	0.6682	0.9336	0.9662
No log	7.5472	400	0.9488	0.6682	0.9488	0.9741
No log	7.5849	402	1.0241	0.6541	1.0241	1.0120
No log	7.6226	404	1.1211	0.6206	1.1211	1.0588
No log	7.6604	406	1.1762	0.6092	1.1762	1.0845
No log	7.6981	408	1.1939	0.6092	1.1939	1.0927
No log	7.7358	410	1.1407	0.6092	1.1407	1.0681
No log	7.7736	412	1.0527	0.6431	1.0527	1.0260
No log	7.8113	414	0.9434	0.6604	0.9434	0.9713
No log	7.8491	416	0.8714	0.6672	0.8714	0.9335
No log	7.8868	418	0.8410	0.7028	0.8410	0.9171
No log	7.9245	420	0.8495	0.6928	0.8495	0.9217
No log	7.9623	422	0.8889	0.6786	0.8889	0.9428
No log	8.0	424	0.9591	0.6557	0.9591	0.9793
No log	8.0377	426	1.0298	0.6423	1.0298	1.0148
No log	8.0755	428	1.0782	0.6398	1.0782	1.0383
No log	8.1132	430	1.1059	0.6326	1.1059	1.0516
No log	8.1509	432	1.0824	0.6339	1.0824	1.0404
No log	8.1887	434	1.0141	0.6541	1.0141	1.0070
No log	8.2264	436	0.9211	0.6656	0.9211	0.9598
No log	8.2642	438	0.8537	0.6909	0.8537	0.9240
No log	8.3019	440	0.8271	0.6936	0.8271	0.9094
No log	8.3396	442	0.8363	0.6972	0.8363	0.9145
No log	8.3774	444	0.8690	0.6909	0.8690	0.9322
No log	8.4151	446	0.9108	0.6656	0.9108	0.9544
No log	8.4528	448	0.9817	0.6559	0.9817	0.9908
No log	8.4906	450	1.0378	0.6488	1.0378	1.0187
No log	8.5283	452	1.0759	0.6447	1.0759	1.0373
No log	8.5660	454	1.1173	0.6274	1.1173	1.0570
No log	8.6038	456	1.1553	0.6318	1.1553	1.0749
No log	8.6415	458	1.1612	0.6209	1.1612	1.0776
No log	8.6792	460	1.1284	0.6247	1.1284	1.0623
No log	8.7170	462	1.0834	0.6274	1.0834	1.0409
No log	8.7547	464	1.0617	0.6328	1.0617	1.0304
No log	8.7925	466	1.0569	0.6328	1.0569	1.0281
No log	8.8302	468	1.0705	0.6328	1.0705	1.0347
No log	8.8679	470	1.0763	0.6328	1.0763	1.0374
No log	8.9057	472	1.0842	0.6328	1.0842	1.0412
No log	8.9434	474	1.0969	0.6412	1.0969	1.0473
No log	8.9811	476	1.0888	0.6412	1.0888	1.0434
No log	9.0189	478	1.0775	0.6412	1.0775	1.0380
No log	9.0566	480	1.0566	0.6328	1.0566	1.0279
No log	9.0943	482	1.0648	0.6328	1.0648	1.0319
No log	9.1321	484	1.0664	0.6389	1.0664	1.0327
No log	9.1698	486	1.0779	0.6389	1.0779	1.0382
No log	9.2075	488	1.1030	0.6328	1.1030	1.0502
No log	9.2453	490	1.1087	0.6229	1.1087	1.0529
No log	9.2830	492	1.1015	0.6287	1.1015	1.0495
No log	9.3208	494	1.0934	0.6447	1.0934	1.0456
No log	9.3585	496	1.0702	0.6551	1.0702	1.0345
No log	9.3962	498	1.0611	0.6551	1.0611	1.0301
0.3535	9.4340	500	1.0560	0.6551	1.0560	1.0276
0.3535	9.4717	502	1.0514	0.6551	1.0514	1.0254
0.3535	9.5094	504	1.0572	0.6462	1.0572	1.0282
0.3535	9.5472	506	1.0659	0.6462	1.0659	1.0324
0.3535	9.5849	508	1.0664	0.6462	1.0664	1.0327
0.3535	9.6226	510	1.0602	0.6462	1.0602	1.0297
0.3535	9.6604	512	1.0543	0.6462	1.0543	1.0268
0.3535	9.6981	514	1.0493	0.6462	1.0493	1.0244
0.3535	9.7358	516	1.0427	0.6462	1.0427	1.0211
0.3535	9.7736	518	1.0385	0.6462	1.0385	1.0191
0.3535	9.8113	520	1.0365	0.6462	1.0365	1.0181
0.3535	9.8491	522	1.0369	0.6462	1.0369	1.0183
0.3535	9.8868	524	1.0356	0.6462	1.0356	1.0176
0.3535	9.9245	526	1.0331	0.6462	1.0331	1.0164
0.3535	9.9623	528	1.0319	0.6551	1.0319	1.0158
0.3535	10.0	530	1.0311	0.6551	1.0311	1.0154

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1