ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0436
• Qwk: 0.6346
• Mse: 1.0436
• Rmse: 1.0216

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	2.2403	0.0408	2.2403	1.4968
No log	0.0667	4	1.4856	0.2212	1.4856	1.2189
No log	0.1	6	1.6302	0.1871	1.6302	1.2768
No log	0.1333	8	1.8776	0.1317	1.8776	1.3703
No log	0.1667	10	1.9330	0.1440	1.9330	1.3903
No log	0.2	12	1.8389	0.2228	1.8389	1.3561
No log	0.2333	14	1.8087	0.2398	1.8087	1.3449
No log	0.2667	16	1.6067	0.1405	1.6067	1.2676
No log	0.3	18	1.4854	0.0848	1.4854	1.2188
No log	0.3333	20	1.4765	0.1011	1.4765	1.2151
No log	0.3667	22	1.4573	0.1057	1.4573	1.2072
No log	0.4	24	1.4485	0.1057	1.4485	1.2035
No log	0.4333	26	1.4279	0.1057	1.4279	1.1949
No log	0.4667	28	1.4351	0.1724	1.4351	1.1980
No log	0.5	30	1.4776	0.1691	1.4776	1.2156
No log	0.5333	32	1.5367	0.3164	1.5367	1.2396
No log	0.5667	34	1.4232	0.2509	1.4232	1.1930
No log	0.6	36	1.2954	0.1686	1.2954	1.1382
No log	0.6333	38	1.2668	0.1819	1.2668	1.1255
No log	0.6667	40	1.2665	0.1834	1.2665	1.1254
No log	0.7	42	1.3027	0.2461	1.3027	1.1414
No log	0.7333	44	1.3329	0.2767	1.3329	1.1545
No log	0.7667	46	1.2622	0.3284	1.2622	1.1235
No log	0.8	48	1.2055	0.3436	1.2055	1.0980
No log	0.8333	50	1.2156	0.3531	1.2156	1.1025
No log	0.8667	52	1.2044	0.3481	1.2044	1.0975
No log	0.9	54	1.2077	0.3458	1.2077	1.0990
No log	0.9333	56	1.2052	0.3536	1.2052	1.0978
No log	0.9667	58	1.2396	0.3787	1.2396	1.1134
No log	1.0	60	1.1355	0.4060	1.1355	1.0656
No log	1.0333	62	1.0883	0.4614	1.0883	1.0432
No log	1.0667	64	1.1019	0.4780	1.1019	1.0497
No log	1.1	66	1.1000	0.4998	1.1000	1.0488
No log	1.1333	68	1.1368	0.4653	1.1368	1.0662
No log	1.1667	70	1.0316	0.5328	1.0316	1.0157
No log	1.2	72	0.9775	0.5353	0.9775	0.9887
No log	1.2333	74	0.9146	0.5571	0.9146	0.9563
No log	1.2667	76	0.9707	0.5342	0.9707	0.9852
No log	1.3	78	1.2627	0.4849	1.2627	1.1237
No log	1.3333	80	1.3150	0.4706	1.3150	1.1467
No log	1.3667	82	1.0691	0.5571	1.0691	1.0340
No log	1.4	84	0.8998	0.5584	0.8998	0.9486
No log	1.4333	86	0.8936	0.5365	0.8936	0.9453
No log	1.4667	88	0.8990	0.5267	0.8990	0.9482
No log	1.5	90	0.9110	0.5319	0.9110	0.9544
No log	1.5333	92	0.8914	0.5546	0.8914	0.9442
No log	1.5667	94	0.9617	0.5905	0.9617	0.9807
No log	1.6	96	1.2503	0.5513	1.2503	1.1182
No log	1.6333	98	1.2466	0.5611	1.2466	1.1165
No log	1.6667	100	1.1525	0.5830	1.1525	1.0736
No log	1.7	102	1.0143	0.6354	1.0143	1.0071
No log	1.7333	104	0.8910	0.6288	0.8910	0.9439
No log	1.7667	106	0.9195	0.6383	0.9195	0.9589
No log	1.8	108	1.1120	0.6055	1.1120	1.0545
No log	1.8333	110	1.1103	0.5966	1.1103	1.0537
No log	1.8667	112	0.9486	0.6489	0.9486	0.9740
No log	1.9	114	0.8456	0.5569	0.8456	0.9195
No log	1.9333	116	0.8535	0.5569	0.8535	0.9238
No log	1.9667	118	0.9647	0.6051	0.9647	0.9822
No log	2.0	120	1.1351	0.5571	1.1351	1.0654
No log	2.0333	122	1.1520	0.5593	1.1520	1.0733
No log	2.0667	124	1.0237	0.6013	1.0237	1.0118
No log	2.1	126	0.8673	0.6460	0.8673	0.9313
No log	2.1333	128	0.8900	0.6427	0.8900	0.9434
No log	2.1667	130	0.9849	0.6170	0.9849	0.9924
No log	2.2	132	0.9582	0.6428	0.9582	0.9789
No log	2.2333	134	1.0547	0.6333	1.0547	1.0270
No log	2.2667	136	0.9179	0.6374	0.9179	0.9581
No log	2.3	138	0.8477	0.6588	0.8477	0.9207
No log	2.3333	140	0.8148	0.6647	0.8148	0.9027
No log	2.3667	142	0.9586	0.6364	0.9586	0.9791
No log	2.4	144	1.3417	0.5351	1.3417	1.1583
No log	2.4333	146	1.5358	0.4888	1.5358	1.2393
No log	2.4667	148	1.4224	0.5051	1.4224	1.1926
No log	2.5	150	1.2299	0.5712	1.2299	1.1090
No log	2.5333	152	1.0985	0.5838	1.0985	1.0481
No log	2.5667	154	1.1342	0.5946	1.1342	1.0650
No log	2.6	156	1.2542	0.5318	1.2542	1.1199
No log	2.6333	158	1.3562	0.4772	1.3562	1.1646
No log	2.6667	160	1.3119	0.5337	1.3119	1.1454
No log	2.7	162	1.1298	0.5837	1.1298	1.0629
No log	2.7333	164	1.0600	0.6030	1.0600	1.0296
No log	2.7667	166	1.0244	0.6141	1.0244	1.0121
No log	2.8	168	1.0913	0.5905	1.0913	1.0447
No log	2.8333	170	1.3106	0.5693	1.3106	1.1448
No log	2.8667	172	1.4105	0.5677	1.4105	1.1877
No log	2.9	174	1.3229	0.5756	1.3229	1.1502
No log	2.9333	176	1.0769	0.5907	1.0769	1.0377
No log	2.9667	178	0.8957	0.5770	0.8957	0.9464
No log	3.0	180	0.8892	0.5422	0.8892	0.9430
No log	3.0333	182	1.0190	0.5673	1.0190	1.0095
No log	3.0667	184	1.2724	0.5537	1.2724	1.1280
No log	3.1	186	1.3120	0.5595	1.3120	1.1454
No log	3.1333	188	1.1857	0.5891	1.1857	1.0889
No log	3.1667	190	1.0418	0.6037	1.0418	1.0207
No log	3.2	192	1.0030	0.6002	1.0030	1.0015
No log	3.2333	194	1.0477	0.6024	1.0477	1.0236
No log	3.2667	196	0.9805	0.6087	0.9805	0.9902
No log	3.3	198	0.9894	0.5996	0.9894	0.9947
No log	3.3333	200	1.1496	0.5888	1.1496	1.0722
No log	3.3667	202	1.2839	0.5736	1.2839	1.1331
No log	3.4	204	1.2987	0.5544	1.2987	1.1396
No log	3.4333	206	1.1655	0.5937	1.1655	1.0796
No log	3.4667	208	0.9623	0.6184	0.9623	0.9810
No log	3.5	210	0.8845	0.6475	0.8845	0.9405
No log	3.5333	212	0.9502	0.6326	0.9502	0.9748
No log	3.5667	214	1.0924	0.6139	1.0924	1.0452
No log	3.6	216	1.1772	0.5994	1.1772	1.0850
No log	3.6333	218	1.1870	0.5826	1.1870	1.0895
No log	3.6667	220	1.0275	0.6068	1.0275	1.0136
No log	3.7	222	0.8520	0.6094	0.8520	0.9230
No log	3.7333	224	0.8111	0.6024	0.8111	0.9006
No log	3.7667	226	0.8514	0.6110	0.8514	0.9227
No log	3.8	228	0.9767	0.5834	0.9767	0.9883
No log	3.8333	230	1.2398	0.5340	1.2398	1.1135
No log	3.8667	232	1.3984	0.4672	1.3984	1.1825
No log	3.9	234	1.3400	0.5167	1.3400	1.1576
No log	3.9333	236	1.1026	0.5811	1.1026	1.0500
No log	3.9667	238	0.8874	0.6571	0.8874	0.9420
No log	4.0	240	0.7634	0.6606	0.7634	0.8737
No log	4.0333	242	0.7485	0.6561	0.7485	0.8652
No log	4.0667	244	0.8432	0.6573	0.8432	0.9183
No log	4.1	246	1.0631	0.6099	1.0631	1.0311
No log	4.1333	248	1.2199	0.5736	1.2199	1.1045
No log	4.1667	250	1.1797	0.5777	1.1797	1.0861
No log	4.2	252	1.0304	0.6320	1.0304	1.0151
No log	4.2333	254	0.8671	0.6650	0.8671	0.9312
No log	4.2667	256	0.7767	0.6533	0.7767	0.8813
No log	4.3	258	0.7669	0.6457	0.7669	0.8758
No log	4.3333	260	0.7892	0.6533	0.7892	0.8884
No log	4.3667	262	0.8631	0.6640	0.8631	0.9290
No log	4.4	264	0.9522	0.6497	0.9522	0.9758
No log	4.4333	266	0.9884	0.6256	0.9884	0.9942
No log	4.4667	268	0.9778	0.6451	0.9778	0.9888
No log	4.5	270	0.9951	0.6451	0.9951	0.9975
No log	4.5333	272	1.0041	0.6322	1.0041	1.0020
No log	4.5667	274	0.9427	0.6652	0.9427	0.9709
No log	4.6	276	0.9508	0.6554	0.9508	0.9751
No log	4.6333	278	1.0708	0.5832	1.0708	1.0348
No log	4.6667	280	1.1664	0.5649	1.1664	1.0800
No log	4.7	282	1.1215	0.5735	1.1215	1.0590
No log	4.7333	284	1.0217	0.6271	1.0217	1.0108
No log	4.7667	286	0.9918	0.6286	0.9918	0.9959
No log	4.8	288	1.0523	0.5911	1.0523	1.0258
No log	4.8333	290	1.1622	0.5530	1.1622	1.0781
No log	4.8667	292	1.1833	0.5530	1.1833	1.0878
No log	4.9	294	1.0776	0.5779	1.0776	1.0381
No log	4.9333	296	0.9388	0.6505	0.9388	0.9689
No log	4.9667	298	0.9282	0.6405	0.9282	0.9634
No log	5.0	300	0.8889	0.6418	0.8889	0.9428
No log	5.0333	302	0.9353	0.6405	0.9353	0.9671
No log	5.0667	304	1.0191	0.6277	1.0191	1.0095
No log	5.1	306	0.9856	0.6277	0.9856	0.9928
No log	5.1333	308	0.8878	0.6255	0.8878	0.9422
No log	5.1667	310	0.8085	0.6385	0.8085	0.8991
No log	5.2	312	0.8078	0.6489	0.8078	0.8988
No log	5.2333	314	0.8835	0.6359	0.8835	0.9400
No log	5.2667	316	0.9455	0.6447	0.9455	0.9724
No log	5.3	318	1.0244	0.5998	1.0244	1.0121
No log	5.3333	320	1.1169	0.5967	1.1169	1.0568
No log	5.3667	322	1.0750	0.6050	1.0750	1.0368
No log	5.4	324	0.9743	0.6603	0.9743	0.9871
No log	5.4333	326	0.9457	0.6565	0.9457	0.9725
No log	5.4667	328	0.9518	0.6617	0.9518	0.9756
No log	5.5	330	0.9147	0.6732	0.9146	0.9564
No log	5.5333	332	0.8679	0.6668	0.8679	0.9316
No log	5.5667	334	0.9062	0.6742	0.9062	0.9520
No log	5.6	336	0.9353	0.6652	0.9353	0.9671
No log	5.6333	338	1.0110	0.6242	1.0110	1.0055
No log	5.6667	340	1.0253	0.6105	1.0253	1.0126
No log	5.7	342	0.9308	0.6492	0.9308	0.9648
No log	5.7333	344	0.8367	0.6870	0.8367	0.9147
No log	5.7667	346	0.8245	0.6870	0.8245	0.9080
No log	5.8	348	0.8893	0.6742	0.8893	0.9430
No log	5.8333	350	0.9235	0.6617	0.9235	0.9610
No log	5.8667	352	0.9130	0.6761	0.9130	0.9555
No log	5.9	354	0.8623	0.6905	0.8623	0.9286
No log	5.9333	356	0.8270	0.6772	0.8270	0.9094
No log	5.9667	358	0.8182	0.6844	0.8182	0.9045
No log	6.0	360	0.8683	0.6843	0.8683	0.9318
No log	6.0333	362	0.9683	0.6363	0.9683	0.9840
No log	6.0667	364	1.1001	0.6338	1.1001	1.0489
No log	6.1	366	1.2017	0.6065	1.2017	1.0962
No log	6.1333	368	1.2243	0.6023	1.2243	1.1065
No log	6.1667	370	1.1643	0.6099	1.1643	1.0790
No log	6.2	372	1.0528	0.6068	1.0528	1.0261
No log	6.2333	374	0.9892	0.6190	0.9892	0.9946
No log	6.2667	376	0.9436	0.6318	0.9436	0.9714
No log	6.3	378	0.9208	0.6318	0.9208	0.9596
No log	6.3333	380	0.9239	0.6497	0.9239	0.9612
No log	6.3667	382	1.0016	0.6393	1.0016	1.0008
No log	6.4	384	1.1205	0.6305	1.1205	1.0585
No log	6.4333	386	1.2029	0.6013	1.2029	1.0968
No log	6.4667	388	1.1788	0.6063	1.1788	1.0857
No log	6.5	390	1.1699	0.5959	1.1699	1.0816
No log	6.5333	392	1.1489	0.6074	1.1489	1.0719
No log	6.5667	394	1.0498	0.6429	1.0498	1.0246
No log	6.6	396	0.9191	0.6382	0.9191	0.9587
No log	6.6333	398	0.8777	0.6586	0.8777	0.9368
No log	6.6667	400	0.8483	0.6402	0.8483	0.9210
No log	6.7	402	0.8746	0.6477	0.8746	0.9352
No log	6.7333	404	0.9533	0.6359	0.9533	0.9764
No log	6.7667	406	1.0315	0.6231	1.0315	1.0156
No log	6.8	408	1.0903	0.6219	1.0903	1.0442
No log	6.8333	410	1.0546	0.6263	1.0546	1.0269
No log	6.8667	412	0.9842	0.6231	0.9842	0.9921
No log	6.9	414	0.9742	0.6328	0.9742	0.9870
No log	6.9333	416	0.9490	0.6456	0.9490	0.9742
No log	6.9667	418	0.9592	0.6456	0.9592	0.9794
No log	7.0	420	0.9196	0.6689	0.9196	0.9589
No log	7.0333	422	0.9184	0.6627	0.9184	0.9583
No log	7.0667	424	0.9164	0.6627	0.9164	0.9573
No log	7.1	426	0.9247	0.6627	0.9247	0.9616
No log	7.1333	428	0.9640	0.6529	0.9640	0.9818
No log	7.1667	430	0.9719	0.6529	0.9719	0.9858
No log	7.2	432	0.9712	0.6529	0.9712	0.9855
No log	7.2333	434	0.9611	0.6529	0.9611	0.9804
No log	7.2667	436	0.9603	0.6529	0.9603	0.9800
No log	7.3	438	0.9640	0.6529	0.9640	0.9818
No log	7.3333	440	0.9978	0.6410	0.9978	0.9989
No log	7.3667	442	1.0128	0.6410	1.0128	1.0064
No log	7.4	444	1.0136	0.6410	1.0136	1.0068
No log	7.4333	446	0.9954	0.6410	0.9954	0.9977
No log	7.4667	448	0.9390	0.6680	0.9390	0.9690
No log	7.5	450	0.9229	0.6680	0.9229	0.9607
No log	7.5333	452	0.9506	0.6655	0.9506	0.9750
No log	7.5667	454	1.0005	0.6529	1.0005	1.0003
No log	7.6	456	1.0883	0.6170	1.0883	1.0432
No log	7.6333	458	1.1680	0.5976	1.1680	1.0808
No log	7.6667	460	1.1685	0.5884	1.1685	1.0810
No log	7.7	462	1.1101	0.6116	1.1101	1.0536
No log	7.7333	464	1.0483	0.6263	1.0483	1.0239
No log	7.7667	466	0.9537	0.6644	0.9537	0.9766
No log	7.8	468	0.8703	0.6491	0.8703	0.9329
No log	7.8333	470	0.8382	0.6268	0.8382	0.9156
No log	7.8667	472	0.8406	0.6268	0.8406	0.9168
No log	7.9	474	0.8565	0.6258	0.8565	0.9255
No log	7.9333	476	0.8994	0.6507	0.8994	0.9484
No log	7.9667	478	0.9684	0.6644	0.9684	0.9841
No log	8.0	480	1.0718	0.6219	1.0718	1.0353
No log	8.0333	482	1.1364	0.6163	1.1364	1.0660
No log	8.0667	484	1.1424	0.6254	1.1424	1.0688
No log	8.1	486	1.1188	0.6296	1.1188	1.0577
No log	8.1333	488	1.0531	0.6444	1.0531	1.0262
No log	8.1667	490	0.9861	0.6545	0.9861	0.9930
No log	8.2	492	0.9227	0.6689	0.9227	0.9606
No log	8.2333	494	0.8967	0.6609	0.8967	0.9470
No log	8.2667	496	0.9116	0.6644	0.9116	0.9548
No log	8.3	498	0.9560	0.6689	0.9560	0.9777
0.3388	8.3333	500	1.0243	0.6529	1.0243	1.0121
0.3388	8.3667	502	1.1024	0.6203	1.1024	1.0500
0.3388	8.4	504	1.1512	0.6161	1.1512	1.0729
0.3388	8.4333	506	1.1647	0.6161	1.1647	1.0792
0.3388	8.4667	508	1.1438	0.6161	1.1438	1.0695
0.3388	8.5	510	1.1055	0.6338	1.1055	1.0514
0.3388	8.5333	512	1.0613	0.6353	1.0613	1.0302
0.3388	8.5667	514	1.0275	0.6354	1.0275	1.0137
0.3388	8.6	516	0.9971	0.6681	0.9971	0.9985
0.3388	8.6333	518	0.9722	0.6663	0.9722	0.9860
0.3388	8.6667	520	0.9396	0.6617	0.9396	0.9693
0.3388	8.7	522	0.9313	0.6607	0.9313	0.9651
0.3388	8.7333	524	0.9216	0.6607	0.9216	0.9600
0.3388	8.7667	526	0.9172	0.6607	0.9172	0.9577
0.3388	8.8	528	0.9299	0.6607	0.9299	0.9643
0.3388	8.8333	530	0.9640	0.6672	0.9640	0.9818
0.3388	8.8667	532	0.9859	0.6716	0.9859	0.9929
0.3388	8.9	534	0.9861	0.6716	0.9861	0.9930
0.3388	8.9333	536	0.9766	0.6716	0.9766	0.9882
0.3388	8.9667	538	0.9682	0.6716	0.9682	0.9840
0.3388	9.0	540	0.9580	0.6672	0.9580	0.9788
0.3388	9.0333	542	0.9631	0.6716	0.9631	0.9814
0.3388	9.0667	544	0.9829	0.6716	0.9829	0.9914
0.3388	9.1	546	1.0036	0.6716	1.0036	1.0018
0.3388	9.1333	548	1.0182	0.6699	1.0182	1.0090
0.3388	9.1667	550	1.0270	0.6439	1.0270	1.0134
0.3388	9.2	552	1.0434	0.6439	1.0434	1.0215
0.3388	9.2333	554	1.0628	0.6331	1.0628	1.0309
0.3388	9.2667	556	1.0680	0.6331	1.0680	1.0335
0.3388	9.3	558	1.0703	0.6331	1.0703	1.0345
0.3388	9.3333	560	1.0743	0.6331	1.0743	1.0365
0.3388	9.3667	562	1.0686	0.6346	1.0686	1.0337
0.3388	9.4	564	1.0638	0.6346	1.0638	1.0314
0.3388	9.4333	566	1.0467	0.6439	1.0467	1.0231
0.3388	9.4667	568	1.0233	0.6455	1.0233	1.0116
0.3388	9.5	570	1.0029	0.6550	1.0029	1.0014
0.3388	9.5333	572	0.9891	0.6716	0.9891	0.9945
0.3388	9.5667	574	0.9773	0.6716	0.9773	0.9886
0.3388	9.6	576	0.9695	0.6734	0.9695	0.9847
0.3388	9.6333	578	0.9724	0.6716	0.9724	0.9861
0.3388	9.6667	580	0.9820	0.6716	0.9820	0.9909
0.3388	9.7	582	0.9967	0.6716	0.9968	0.9984
0.3388	9.7333	584	1.0094	0.6716	1.0094	1.0047
0.3388	9.7667	586	1.0174	0.6594	1.0174	1.0087
0.3388	9.8	588	1.0261	0.6533	1.0261	1.0130
0.3388	9.8333	590	1.0322	0.6533	1.0322	1.0160
0.3388	9.8667	592	1.0386	0.6346	1.0386	1.0191
0.3388	9.9	594	1.0427	0.6346	1.0427	1.0211
0.3388	9.9333	596	1.0432	0.6346	1.0432	1.0214
0.3388	9.9667	598	1.0435	0.6346	1.0435	1.0215
0.3388	10.0	600	1.0436	0.6346	1.0436	1.0216

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1