ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3246
• Qwk: 0.5231
• Mse: 1.3246
• Rmse: 1.1509

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0667	2	6.8379	0.0242	6.8379	2.6149
No log	0.1333	4	4.4830	0.0667	4.4830	2.1173
No log	0.2	6	3.1915	0.0235	3.1915	1.7865
No log	0.2667	8	2.2902	0.0839	2.2902	1.5134
No log	0.3333	10	1.8932	0.2301	1.8932	1.3759
No log	0.4	12	1.7612	0.1887	1.7612	1.3271
No log	0.4667	14	1.7997	0.3387	1.7997	1.3415
No log	0.5333	16	1.8678	0.3115	1.8678	1.3667
No log	0.6	18	2.0818	0.1000	2.0818	1.4429
No log	0.6667	20	2.1797	-0.0656	2.1797	1.4764
No log	0.7333	22	1.9454	0.1682	1.9454	1.3948
No log	0.8	24	1.7952	0.1538	1.7952	1.3398
No log	0.8667	26	1.5397	0.2243	1.5397	1.2409
No log	0.9333	28	1.4112	0.2500	1.4112	1.1880
No log	1.0	30	1.4253	0.2832	1.4253	1.1939
No log	1.0667	32	1.5298	0.2364	1.5298	1.2369
No log	1.1333	34	1.6374	0.2261	1.6374	1.2796
No log	1.2	36	1.6784	0.25	1.6784	1.2955
No log	1.2667	38	1.6683	0.3465	1.6683	1.2916
No log	1.3333	40	1.8444	0.2941	1.8444	1.3581
No log	1.4	42	2.2829	0.2516	2.2829	1.5109
No log	1.4667	44	2.2536	0.2405	2.2536	1.5012
No log	1.5333	46	1.7233	0.2897	1.7233	1.3127
No log	1.6	48	1.3212	0.3793	1.3212	1.1494
No log	1.6667	50	1.4479	0.3478	1.4479	1.2033
No log	1.7333	52	1.6798	0.1913	1.6798	1.2961
No log	1.8	54	1.6041	0.2609	1.6041	1.2665
No log	1.8667	56	1.5222	0.4098	1.5222	1.2338
No log	1.9333	58	1.4327	0.3577	1.4327	1.1970
No log	2.0	60	1.3257	0.4237	1.3257	1.1514
No log	2.0667	62	1.3133	0.4202	1.3133	1.1460
No log	2.1333	64	1.2926	0.2727	1.2926	1.1369
No log	2.2	66	1.2039	0.3604	1.2039	1.0972
No log	2.2667	68	1.2239	0.3826	1.2239	1.1063
No log	2.3333	70	1.2055	0.3793	1.2055	1.0979
No log	2.4	72	1.2135	0.4407	1.2135	1.1016
No log	2.4667	74	1.2775	0.4590	1.2775	1.1303
No log	2.5333	76	1.2322	0.4068	1.2322	1.1100
No log	2.6	78	1.3291	0.4	1.3291	1.1529
No log	2.6667	80	1.2898	0.3866	1.2898	1.1357
No log	2.7333	82	1.2503	0.4390	1.2503	1.1182
No log	2.8	84	1.2882	0.4341	1.2882	1.1350
No log	2.8667	86	1.3101	0.4662	1.3101	1.1446
No log	2.9333	88	1.2646	0.4375	1.2646	1.1245
No log	3.0	90	1.2618	0.4531	1.2618	1.1233
No log	3.0667	92	1.2643	0.4308	1.2643	1.1244
No log	3.1333	94	1.2575	0.5079	1.2575	1.1214
No log	3.2	96	1.2286	0.4923	1.2286	1.1084
No log	3.2667	98	1.3358	0.4394	1.3358	1.1558
No log	3.3333	100	1.4382	0.4651	1.4382	1.1992
No log	3.4	102	1.4766	0.4878	1.4766	1.2151
No log	3.4667	104	1.4680	0.4286	1.4680	1.2116
No log	3.5333	106	1.4469	0.4427	1.4469	1.2029
No log	3.6	108	1.4200	0.4	1.4200	1.1916
No log	3.6667	110	1.3793	0.4444	1.3793	1.1744
No log	3.7333	112	1.3697	0.4697	1.3697	1.1703
No log	3.8	114	1.3330	0.4667	1.3330	1.1545
No log	3.8667	116	1.3150	0.4	1.3150	1.1468
No log	3.9333	118	1.2828	0.4463	1.2828	1.1326
No log	4.0	120	1.3283	0.4593	1.3283	1.1525
No log	4.0667	122	1.3882	0.4234	1.3882	1.1782
No log	4.1333	124	1.5345	0.3741	1.5345	1.2388
No log	4.2	126	1.6155	0.3382	1.6155	1.2710
No log	4.2667	128	1.5433	0.3529	1.5433	1.2423
No log	4.3333	130	1.4872	0.3731	1.4872	1.2195
No log	4.4	132	1.4786	0.3556	1.4786	1.2160
No log	4.4667	134	1.3906	0.4275	1.3906	1.1792
No log	4.5333	136	1.3337	0.4715	1.3337	1.1549
No log	4.6	138	1.3033	0.5	1.3033	1.1416
No log	4.6667	140	1.3531	0.4697	1.3531	1.1632
No log	4.7333	142	1.3483	0.4328	1.3483	1.1612
No log	4.8	144	1.3557	0.4627	1.3557	1.1643
No log	4.8667	146	1.3023	0.5191	1.3023	1.1412
No log	4.9333	148	1.2513	0.5238	1.2513	1.1186
No log	5.0	150	1.2843	0.4878	1.2843	1.1333
No log	5.0667	152	1.3918	0.4098	1.3918	1.1797
No log	5.1333	154	1.5724	0.4118	1.5724	1.2540
No log	5.2	156	1.8834	0.2754	1.8834	1.3724
No log	5.2667	158	1.9918	0.2394	1.9918	1.4113
No log	5.3333	160	1.9531	0.3000	1.9531	1.3975
No log	5.4	162	1.7826	0.2754	1.7826	1.3351
No log	5.4667	164	1.5683	0.4211	1.5683	1.2523
No log	5.5333	166	1.4170	0.3906	1.4170	1.1904
No log	5.6	168	1.3802	0.4496	1.3802	1.1748
No log	5.6667	170	1.3354	0.4604	1.3354	1.1556
No log	5.7333	172	1.2013	0.5390	1.2013	1.0961
No log	5.8	174	1.2165	0.5352	1.2165	1.1030
No log	5.8667	176	1.2820	0.4898	1.2820	1.1322
No log	5.9333	178	1.3103	0.4286	1.3103	1.1447
No log	6.0	180	1.2892	0.5	1.2892	1.1354
No log	6.0667	182	1.3123	0.5203	1.3123	1.1456
No log	6.1333	184	1.2685	0.5238	1.2685	1.1263
No log	6.2	186	1.2881	0.4776	1.2881	1.1349
No log	6.2667	188	1.2614	0.5373	1.2614	1.1231
No log	6.3333	190	1.1708	0.5649	1.1708	1.0820
No log	6.4	192	1.1419	0.5484	1.1419	1.0686
No log	6.4667	194	1.1318	0.4628	1.1318	1.0638
No log	6.5333	196	1.1277	0.5323	1.1277	1.0619
No log	6.6	198	1.1392	0.5397	1.1392	1.0673
No log	6.6667	200	1.2088	0.5496	1.2088	1.0995
No log	6.7333	202	1.3628	0.4526	1.3628	1.1674
No log	6.8	204	1.5062	0.4029	1.5062	1.2273
No log	6.8667	206	1.4463	0.4234	1.4463	1.2026
No log	6.9333	208	1.3746	0.4697	1.3746	1.1724
No log	7.0	210	1.4044	0.4444	1.4044	1.1851
No log	7.0667	212	1.3631	0.4444	1.3631	1.1675
No log	7.1333	214	1.2886	0.5037	1.2886	1.1352
No log	7.2	216	1.2141	0.5496	1.2141	1.1018
No log	7.2667	218	1.1840	0.5581	1.1840	1.0881
No log	7.3333	220	1.1878	0.5414	1.1878	1.0899
No log	7.4	222	1.3072	0.4672	1.3072	1.1433
No log	7.4667	224	1.3687	0.4507	1.3687	1.1699
No log	7.5333	226	1.3449	0.4672	1.3449	1.1597
No log	7.6	228	1.2965	0.4925	1.2965	1.1387
No log	7.6667	230	1.2595	0.4889	1.2595	1.1223
No log	7.7333	232	1.2626	0.5	1.2626	1.1237
No log	7.8	234	1.2093	0.5672	1.2093	1.0997
No log	7.8667	236	1.1686	0.5758	1.1686	1.0810
No log	7.9333	238	1.0627	0.6222	1.0627	1.0309
No log	8.0	240	1.0415	0.6176	1.0415	1.0206
No log	8.0667	242	1.0029	0.5797	1.0029	1.0014
No log	8.1333	244	0.9750	0.6043	0.9750	0.9874
No log	8.2	246	1.0189	0.6	1.0189	1.0094
No log	8.2667	248	1.0913	0.5775	1.0913	1.0446
No log	8.3333	250	1.2055	0.5556	1.2055	1.0979
No log	8.4	252	1.3052	0.4932	1.3052	1.1425
No log	8.4667	254	1.3537	0.5035	1.3537	1.1635
No log	8.5333	256	1.3821	0.4580	1.3821	1.1756
No log	8.6	258	1.3904	0.3968	1.3904	1.1791
No log	8.6667	260	1.3458	0.4844	1.3458	1.1601
No log	8.7333	262	1.3075	0.5	1.3075	1.1434
No log	8.8	264	1.2349	0.5441	1.2349	1.1112
No log	8.8667	266	1.1826	0.5970	1.1826	1.0875
No log	8.9333	268	1.2265	0.5469	1.2265	1.1075
No log	9.0	270	1.2541	0.5	1.2541	1.1198
No log	9.0667	272	1.2484	0.5039	1.2484	1.1173
No log	9.1333	274	1.3088	0.4776	1.3088	1.1440
No log	9.2	276	1.4311	0.4143	1.4311	1.1963
No log	9.2667	278	1.3895	0.4173	1.3895	1.1788
No log	9.3333	280	1.2192	0.5496	1.2192	1.1042
No log	9.4	282	1.1196	0.5827	1.1196	1.0581
No log	9.4667	284	1.1390	0.528	1.1390	1.0673
No log	9.5333	286	1.1532	0.5203	1.1532	1.0739
No log	9.6	288	1.1629	0.5827	1.1629	1.0784
No log	9.6667	290	1.2384	0.5147	1.2384	1.1128
No log	9.7333	292	1.3165	0.4493	1.3165	1.1474
No log	9.8	294	1.3011	0.4748	1.3011	1.1407
No log	9.8667	296	1.2546	0.5072	1.2546	1.1201
No log	9.9333	298	1.1520	0.5507	1.1520	1.0733
No log	10.0	300	1.0968	0.5588	1.0968	1.0473
No log	10.0667	302	1.0870	0.5630	1.0870	1.0426
No log	10.1333	304	1.1884	0.5255	1.1884	1.0901
No log	10.2	306	1.3185	0.4783	1.3185	1.1482
No log	10.2667	308	1.4246	0.4173	1.4246	1.1935
No log	10.3333	310	1.4196	0.4058	1.4196	1.1915
No log	10.4	312	1.3739	0.4697	1.3739	1.1721
No log	10.4667	314	1.3890	0.4211	1.3890	1.1785
No log	10.5333	316	1.4390	0.4118	1.4390	1.1996
No log	10.6	318	1.5394	0.3768	1.5394	1.2407
No log	10.6667	320	1.6375	0.3546	1.6375	1.2796
No log	10.7333	322	1.6668	0.3165	1.6668	1.2911
No log	10.8	324	1.5855	0.4030	1.5855	1.2592
No log	10.8667	326	1.5233	0.4328	1.5233	1.2342
No log	10.9333	328	1.4644	0.4627	1.4644	1.2101
No log	11.0	330	1.4275	0.4559	1.4275	1.1948
No log	11.0667	332	1.3990	0.4317	1.3990	1.1828
No log	11.1333	334	1.3306	0.4493	1.3306	1.1535
No log	11.2	336	1.2467	0.5401	1.2467	1.1165
No log	11.2667	338	1.1880	0.6061	1.1880	1.0900
No log	11.3333	340	1.1616	0.5846	1.1616	1.0778
No log	11.4	342	1.1623	0.6154	1.1623	1.0781
No log	11.4667	344	1.2279	0.5109	1.2279	1.1081
No log	11.5333	346	1.2998	0.4783	1.2998	1.1401
No log	11.6	348	1.3114	0.4672	1.3114	1.1452
No log	11.6667	350	1.2988	0.4889	1.2988	1.1397
No log	11.7333	352	1.3807	0.4030	1.3807	1.1750
No log	11.8	354	1.5086	0.3796	1.5086	1.2282
No log	11.8667	356	1.6168	0.3776	1.6168	1.2716
No log	11.9333	358	1.5481	0.3741	1.5481	1.2442
No log	12.0	360	1.5049	0.3741	1.5049	1.2267
No log	12.0667	362	1.4690	0.3857	1.4690	1.2120
No log	12.1333	364	1.4077	0.4681	1.4077	1.1865
No log	12.2	366	1.3758	0.5	1.3758	1.1730
No log	12.2667	368	1.2791	0.5	1.2791	1.1310
No log	12.3333	370	1.1843	0.5693	1.1843	1.0883
No log	12.4	372	1.1351	0.5693	1.1351	1.0654
No log	12.4667	374	1.1464	0.5507	1.1464	1.0707
No log	12.5333	376	1.1687	0.5324	1.1687	1.0810
No log	12.6	378	1.2262	0.5324	1.2262	1.1074
No log	12.6667	380	1.1835	0.5507	1.1835	1.0879
No log	12.7333	382	1.1205	0.5865	1.1205	1.0585
No log	12.8	384	1.1108	0.6	1.1108	1.0539
No log	12.8667	386	1.0721	0.6142	1.0721	1.0354
No log	12.9333	388	1.0532	0.5802	1.0532	1.0263
No log	13.0	390	1.0723	0.5972	1.0723	1.0355
No log	13.0667	392	1.0943	0.6	1.0943	1.0461
No log	13.1333	394	1.1068	0.5612	1.1068	1.0520
No log	13.2	396	1.1410	0.5630	1.1410	1.0682
No log	13.2667	398	1.1894	0.5496	1.1894	1.0906
No log	13.3333	400	1.2102	0.5649	1.2102	1.1001
No log	13.4	402	1.2555	0.5385	1.2555	1.1205
No log	13.4667	404	1.3013	0.4812	1.3013	1.1408
No log	13.5333	406	1.4536	0.4058	1.4536	1.2056
No log	13.6	408	1.5756	0.4	1.5756	1.2552
No log	13.6667	410	1.5155	0.4645	1.5155	1.2311
No log	13.7333	412	1.3444	0.4706	1.3444	1.1595
No log	13.8	414	1.2718	0.4889	1.2718	1.1278
No log	13.8667	416	1.2753	0.5147	1.2753	1.1293
No log	13.9333	418	1.2649	0.5401	1.2649	1.1247
No log	14.0	420	1.2395	0.5522	1.2395	1.1133
No log	14.0667	422	1.2719	0.5564	1.2719	1.1278
No log	14.1333	424	1.3511	0.4580	1.3511	1.1624
No log	14.2	426	1.4552	0.3731	1.4552	1.2063
No log	14.2667	428	1.5158	0.3382	1.5158	1.2312
No log	14.3333	430	1.5233	0.3741	1.5233	1.2342
No log	14.4	432	1.4082	0.4	1.4082	1.1867
No log	14.4667	434	1.3524	0.3939	1.3524	1.1629
No log	14.5333	436	1.3774	0.4060	1.3774	1.1736
No log	14.6	438	1.5149	0.3862	1.5149	1.2308
No log	14.6667	440	1.6330	0.3636	1.6330	1.2779
No log	14.7333	442	1.5543	0.3243	1.5543	1.2467
No log	14.8	444	1.3921	0.4341	1.3921	1.1799
No log	14.8667	446	1.2948	0.4882	1.2948	1.1379
No log	14.9333	448	1.2747	0.4426	1.2747	1.1290
No log	15.0	450	1.2486	0.576	1.2486	1.1174
No log	15.0667	452	1.2428	0.6154	1.2428	1.1148
No log	15.1333	454	1.2438	0.5778	1.2438	1.1152
No log	15.2	456	1.1965	0.5778	1.1965	1.0939
No log	15.2667	458	1.1182	0.5926	1.1182	1.0575
No log	15.3333	460	1.0781	0.6029	1.0781	1.0383
No log	15.4	462	1.0633	0.5839	1.0633	1.0311
No log	15.4667	464	1.0133	0.6277	1.0133	1.0066
No log	15.5333	466	0.9449	0.6241	0.9449	0.9721
No log	15.6	468	0.9848	0.6331	0.9848	0.9924
No log	15.6667	470	0.9336	0.6479	0.9336	0.9662
No log	15.7333	472	0.9913	0.6087	0.9913	0.9956
No log	15.8	474	1.0579	0.5821	1.0579	1.0286
No log	15.8667	476	1.1072	0.6154	1.1072	1.0522
No log	15.9333	478	1.1781	0.5373	1.1781	1.0854
No log	16.0	480	1.2612	0.5224	1.2612	1.1230
No log	16.0667	482	1.3026	0.4748	1.3026	1.1413
No log	16.1333	484	1.4016	0.4521	1.4016	1.1839
No log	16.2	486	1.3483	0.4444	1.3483	1.1611
No log	16.2667	488	1.2484	0.4889	1.2484	1.1173
No log	16.3333	490	1.1382	0.4962	1.1382	1.0668
No log	16.4	492	1.1175	0.5303	1.1175	1.0571
No log	16.4667	494	1.0911	0.5538	1.0911	1.0446
No log	16.5333	496	1.1147	0.5802	1.1147	1.0558
No log	16.6	498	1.1794	0.6	1.1794	1.0860
0.4219	16.6667	500	1.2820	0.5401	1.2820	1.1322
0.4219	16.7333	502	1.3001	0.5072	1.3001	1.1402
0.4219	16.8	504	1.2735	0.5401	1.2735	1.1285
0.4219	16.8667	506	1.1691	0.5778	1.1691	1.0812
0.4219	16.9333	508	1.1027	0.6565	1.1027	1.0501
0.4219	17.0	510	1.0993	0.6565	1.0993	1.0485
0.4219	17.0667	512	1.1662	0.5630	1.1662	1.0799
0.4219	17.1333	514	1.3473	0.4615	1.3473	1.1607
0.4219	17.2	516	1.5189	0.4295	1.5189	1.2324
0.4219	17.2667	518	1.5241	0.4143	1.5241	1.2346
0.4219	17.3333	520	1.4219	0.4741	1.4219	1.1924
0.4219	17.4	522	1.3246	0.5231	1.3246	1.1509

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1