ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k4_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0644
• Qwk: 0.5455
• Mse: 1.0644
• Rmse: 1.0317

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	7.0329	0.0	7.0329	2.6520
No log	0.1905	4	4.6360	0.0317	4.6360	2.1531
No log	0.2857	6	3.0731	0.0988	3.0731	1.7530
No log	0.3810	8	2.3746	0.1259	2.3746	1.5410
No log	0.4762	10	2.0488	0.1000	2.0488	1.4314
No log	0.5714	12	1.8100	0.1682	1.8100	1.3454
No log	0.6667	14	1.6874	0.1333	1.6874	1.2990
No log	0.7619	16	1.6608	0.1333	1.6608	1.2887
No log	0.8571	18	1.6589	0.2222	1.6589	1.2880
No log	0.9524	20	1.8075	0.1636	1.8075	1.3444
No log	1.0476	22	2.1267	0.0690	2.1267	1.4583
No log	1.1429	24	2.1174	0.0893	2.1174	1.4551
No log	1.2381	26	2.0235	0.1091	2.0235	1.4225
No log	1.3333	28	1.6297	0.2069	1.6297	1.2766
No log	1.4286	30	1.5806	0.3511	1.5806	1.2572
No log	1.5238	32	1.7088	0.4238	1.7088	1.3072
No log	1.6190	34	1.6346	0.3741	1.6346	1.2785
No log	1.7143	36	1.5743	0.3025	1.5743	1.2547
No log	1.8095	38	2.0000	0.1525	2.0000	1.4142
No log	1.9048	40	2.5476	-0.0161	2.5476	1.5961
No log	2.0	42	2.7623	-0.0746	2.7623	1.6620
No log	2.0952	44	2.4324	0.0630	2.4324	1.5596
No log	2.1905	46	1.7449	0.2992	1.7449	1.3210
No log	2.2857	48	1.7992	0.2137	1.7992	1.3414
No log	2.3810	50	2.0556	0.1120	2.0556	1.4337
No log	2.4762	52	1.7849	0.2419	1.7849	1.3360
No log	2.5714	54	1.6287	0.3846	1.6287	1.2762
No log	2.6667	56	1.6193	0.3731	1.6193	1.2725
No log	2.7619	58	1.5586	0.3459	1.5586	1.2484
No log	2.8571	60	1.3941	0.5038	1.3941	1.1807
No log	2.9524	62	1.3627	0.4603	1.3627	1.1674
No log	3.0476	64	1.3979	0.5039	1.3979	1.1823
No log	3.1429	66	1.4641	0.496	1.4641	1.2100
No log	3.2381	68	1.3752	0.528	1.3752	1.1727
No log	3.3333	70	1.3611	0.5231	1.3611	1.1666
No log	3.4286	72	1.4445	0.4662	1.4445	1.2019
No log	3.5238	74	1.4172	0.3548	1.4172	1.1905
No log	3.6190	76	1.6104	0.2764	1.6104	1.2690
No log	3.7143	78	1.7328	0.2787	1.7328	1.3163
No log	3.8095	80	1.7729	0.2645	1.7729	1.3315
No log	3.9048	82	1.3821	0.3810	1.3821	1.1756
No log	4.0	84	1.1712	0.5625	1.1712	1.0822
No log	4.0952	86	1.3667	0.3902	1.3667	1.1691
No log	4.1905	88	1.7226	0.3333	1.7226	1.3125
No log	4.2857	90	1.6636	0.2969	1.6636	1.2898
No log	4.3810	92	1.4640	0.4062	1.4640	1.2100
No log	4.4762	94	1.3757	0.3780	1.3757	1.1729
No log	4.5714	96	1.3160	0.4194	1.3160	1.1472
No log	4.6667	98	1.2469	0.4355	1.2469	1.1167
No log	4.7619	100	1.2021	0.4878	1.2021	1.0964
No log	4.8571	102	1.1364	0.5041	1.1364	1.0660
No log	4.9524	104	1.0882	0.5246	1.0882	1.0432
No log	5.0476	106	1.0839	0.5620	1.0839	1.0411
No log	5.1429	108	1.1909	0.5344	1.1909	1.0913
No log	5.2381	110	1.3240	0.4627	1.3240	1.1507
No log	5.3333	112	1.4530	0.3881	1.4530	1.2054
No log	5.4286	114	1.5752	0.3650	1.5752	1.2551
No log	5.5238	116	1.2626	0.5109	1.2626	1.1237
No log	5.6190	118	1.2395	0.5517	1.2395	1.1133
No log	5.7143	120	1.7373	0.4970	1.7373	1.3181
No log	5.8095	122	1.9136	0.4074	1.9136	1.3833
No log	5.9048	124	1.7507	0.4	1.7507	1.3231
No log	6.0	126	1.4145	0.4638	1.4145	1.1893
No log	6.0952	128	1.0457	0.5692	1.0457	1.0226
No log	6.1905	130	1.0544	0.5556	1.0544	1.0268
No log	6.2857	132	1.0428	0.5161	1.0428	1.0212
No log	6.3810	134	0.9448	0.5397	0.9448	0.9720
No log	6.4762	136	0.9741	0.6047	0.9741	0.9870
No log	6.5714	138	1.1062	0.5891	1.1062	1.0518
No log	6.6667	140	1.1067	0.5802	1.1067	1.0520
No log	6.7619	142	1.0435	0.6029	1.0435	1.0215
No log	6.8571	144	1.0754	0.5401	1.0754	1.0370
No log	6.9524	146	1.1784	0.5468	1.1784	1.0856
No log	7.0476	148	1.2285	0.5468	1.2285	1.1084
No log	7.1429	150	1.1552	0.5180	1.1552	1.0748
No log	7.2381	152	1.0977	0.5352	1.0977	1.0477
No log	7.3333	154	1.1029	0.6143	1.1029	1.0502
No log	7.4286	156	1.1196	0.5693	1.1196	1.0581
No log	7.5238	158	1.2374	0.4714	1.2374	1.1124
No log	7.6190	160	1.2580	0.4697	1.2580	1.1216
No log	7.7143	162	1.2694	0.4688	1.2694	1.1267
No log	7.8095	164	1.2996	0.4480	1.2996	1.1400
No log	7.9048	166	1.2375	0.5116	1.2375	1.1124
No log	8.0	168	1.2357	0.5156	1.2357	1.1116
No log	8.0952	170	1.3017	0.4427	1.3017	1.1409
No log	8.1905	172	1.3564	0.4706	1.3564	1.1646
No log	8.2857	174	1.3195	0.4545	1.3195	1.1487
No log	8.3810	176	1.2332	0.4580	1.2332	1.1105
No log	8.4762	178	1.1973	0.5116	1.1973	1.0942
No log	8.5714	180	1.1747	0.5038	1.1747	1.0838
No log	8.6667	182	1.1909	0.5414	1.1909	1.0913
No log	8.7619	184	1.3323	0.5072	1.3323	1.1543
No log	8.8571	186	1.5913	0.4444	1.5913	1.2615
No log	8.9524	188	1.5837	0.4636	1.5837	1.2585
No log	9.0476	190	1.4587	0.4286	1.4587	1.2078
No log	9.1429	192	1.3505	0.4681	1.3505	1.1621
No log	9.2381	194	1.2523	0.5180	1.2523	1.1191
No log	9.3333	196	1.1605	0.5271	1.1605	1.0773
No log	9.4286	198	1.1538	0.5077	1.1538	1.0741
No log	9.5238	200	1.1623	0.5606	1.1623	1.0781
No log	9.6190	202	1.1880	0.5481	1.1880	1.0900
No log	9.7143	204	1.2853	0.5106	1.2853	1.1337
No log	9.8095	206	1.2698	0.5135	1.2698	1.1268
No log	9.9048	208	1.1540	0.5581	1.1540	1.0742
No log	10.0	210	1.0742	0.5781	1.0742	1.0364
No log	10.0952	212	0.9799	0.6094	0.9799	0.9899
No log	10.1905	214	0.9587	0.5802	0.9587	0.9792
No log	10.2857	216	0.9344	0.6569	0.9344	0.9666
No log	10.3810	218	0.9269	0.6119	0.9269	0.9628
No log	10.4762	220	0.9122	0.6316	0.9122	0.9551
No log	10.5714	222	0.9610	0.6029	0.9610	0.9803
No log	10.6667	224	0.9507	0.5865	0.9507	0.9750
No log	10.7619	226	0.9597	0.6316	0.9597	0.9796
No log	10.8571	228	0.9860	0.5865	0.9860	0.9930
No log	10.9524	230	1.0148	0.5865	1.0148	1.0074
No log	11.0476	232	0.9808	0.6277	0.9808	0.9904
No log	11.1429	234	0.9942	0.6222	0.9942	0.9971
No log	11.2381	236	1.0148	0.6119	1.0148	1.0074
No log	11.3333	238	1.0512	0.6212	1.0512	1.0253
No log	11.4286	240	1.0543	0.6212	1.0543	1.0268
No log	11.5238	242	1.0692	0.6212	1.0692	1.0340
No log	11.6190	244	1.0673	0.5882	1.0673	1.0331
No log	11.7143	246	1.0791	0.5931	1.0791	1.0388
No log	11.8095	248	1.1243	0.6241	1.1243	1.0603
No log	11.9048	250	1.0805	0.6087	1.0805	1.0395
No log	12.0	252	1.0698	0.6087	1.0698	1.0343
No log	12.0952	254	1.0307	0.5926	1.0307	1.0152
No log	12.1905	256	1.0088	0.6131	1.0088	1.0044
No log	12.2857	258	1.1303	0.6144	1.1303	1.0632
No log	12.3810	260	1.2635	0.5641	1.2635	1.1241
No log	12.4762	262	1.2134	0.5733	1.2134	1.1016
No log	12.5714	264	1.1236	0.5985	1.1236	1.0600
No log	12.6667	266	1.1150	0.6131	1.1150	1.0559
No log	12.7619	268	1.1708	0.5674	1.1708	1.0820
No log	12.8571	270	1.1765	0.5634	1.1765	1.0846
No log	12.9524	272	1.0944	0.5735	1.0944	1.0461
No log	13.0476	274	1.0969	0.6	1.0969	1.0473
No log	13.1429	276	1.1116	0.5890	1.1116	1.0543
No log	13.2381	278	1.0957	0.6225	1.0957	1.0468
No log	13.3333	280	1.1175	0.5921	1.1175	1.0571
No log	13.4286	282	1.1392	0.65	1.1392	1.0673
No log	13.5238	284	1.0719	0.5503	1.0719	1.0353
No log	13.6190	286	0.9945	0.6324	0.9945	0.9972
No log	13.7143	288	1.0210	0.5714	1.0210	1.0105
No log	13.8095	290	1.0609	0.5926	1.0609	1.0300
No log	13.9048	292	1.0855	0.5758	1.0855	1.0419
No log	14.0	294	1.1013	0.5714	1.1013	1.0494
No log	14.0952	296	1.1364	0.5522	1.1364	1.0660
No log	14.1905	298	1.2347	0.4818	1.2347	1.1112
No log	14.2857	300	1.2255	0.5522	1.2255	1.1070
No log	14.3810	302	1.1650	0.5344	1.1650	1.0794
No log	14.4762	304	1.1150	0.5469	1.1150	1.0559
No log	14.5714	306	1.1068	0.5414	1.1068	1.0520
No log	14.6667	308	1.0879	0.5714	1.0879	1.0430
No log	14.7619	310	1.0423	0.625	1.0423	1.0210
No log	14.8571	312	1.0478	0.6533	1.0478	1.0236
No log	14.9524	314	1.0442	0.6301	1.0442	1.0219
No log	15.0476	316	0.9870	0.6395	0.9870	0.9935
No log	15.1429	318	0.9787	0.6438	0.9787	0.9893
No log	15.2381	320	1.0555	0.6111	1.0555	1.0274
No log	15.3333	322	1.1330	0.6259	1.1330	1.0644
No log	15.4286	324	1.1497	0.5867	1.1497	1.0722
No log	15.5238	326	1.0353	0.6259	1.0353	1.0175
No log	15.6190	328	1.0749	0.6267	1.0749	1.0368
No log	15.7143	330	1.0836	0.6275	1.0836	1.0409
No log	15.8095	332	1.1204	0.6104	1.1204	1.0585
No log	15.9048	334	1.0780	0.5957	1.0780	1.0383
No log	16.0	336	0.9803	0.6119	0.9803	0.9901
No log	16.0952	338	0.9598	0.5938	0.9598	0.9797
No log	16.1905	340	0.9667	0.6202	0.9667	0.9832
No log	16.2857	342	0.9255	0.6119	0.9255	0.9620
No log	16.3810	344	0.8608	0.6232	0.8608	0.9278
No log	16.4762	346	0.8771	0.6395	0.8771	0.9365
No log	16.5714	348	0.9185	0.6538	0.9185	0.9584
No log	16.6667	350	0.9665	0.6579	0.9665	0.9831
No log	16.7619	352	0.9901	0.6131	0.9901	0.9950
No log	16.8571	354	1.0501	0.5942	1.0501	1.0248
No log	16.9524	356	1.0862	0.5821	1.0862	1.0422
No log	17.0476	358	1.1085	0.5926	1.1085	1.0529
No log	17.1429	360	1.1037	0.5821	1.1037	1.0506
No log	17.2381	362	1.0666	0.6119	1.0666	1.0328
No log	17.3333	364	1.0396	0.6029	1.0396	1.0196
No log	17.4286	366	1.0480	0.6029	1.0480	1.0237
No log	17.5238	368	0.9733	0.6519	0.9733	0.9866
No log	17.6190	370	0.9582	0.6260	0.9582	0.9789
No log	17.7143	372	1.0000	0.6462	1.0000	1.0000
No log	17.8095	374	1.0061	0.6316	1.0061	1.0031
No log	17.9048	376	1.0038	0.6324	1.0038	1.0019
No log	18.0	378	0.9922	0.6345	0.9922	0.9961
No log	18.0952	380	1.0033	0.6197	1.0033	1.0017
No log	18.1905	382	1.0688	0.6294	1.0688	1.0338
No log	18.2857	384	1.0731	0.6197	1.0731	1.0359
No log	18.3810	386	1.1158	0.6294	1.1158	1.0563
No log	18.4762	388	1.1417	0.6099	1.1417	1.0685
No log	18.5714	390	1.0492	0.5909	1.0492	1.0243
No log	18.6667	392	0.9934	0.6142	0.9934	0.9967
No log	18.7619	394	0.9605	0.6190	0.9605	0.9800
No log	18.8571	396	0.9344	0.6107	0.9344	0.9666
No log	18.9524	398	0.9648	0.6029	0.9648	0.9822
No log	19.0476	400	1.0715	0.6410	1.0715	1.0352
No log	19.1429	402	1.0618	0.6415	1.0618	1.0304
No log	19.2381	404	0.9454	0.6056	0.9454	0.9723
No log	19.3333	406	0.8946	0.6015	0.8946	0.9458
No log	19.4286	408	0.9473	0.5865	0.9473	0.9733
No log	19.5238	410	1.0800	0.5972	1.0800	1.0392
No log	19.6190	412	1.0732	0.5778	1.0732	1.0359
No log	19.7143	414	0.9797	0.6154	0.9797	0.9898
No log	19.8095	416	0.9339	0.5873	0.9339	0.9664
No log	19.9048	418	0.9232	0.6308	0.9232	0.9608
No log	20.0	420	0.9449	0.6015	0.9449	0.9721
No log	20.0952	422	0.9506	0.6015	0.9506	0.9750
No log	20.1905	424	1.0337	0.6119	1.0337	1.0167
No log	20.2857	426	1.0640	0.6119	1.0640	1.0315
No log	20.3810	428	1.0597	0.6119	1.0597	1.0294
No log	20.4762	430	1.1062	0.6043	1.1062	1.0517
No log	20.5714	432	1.1645	0.5957	1.1645	1.0791
No log	20.6667	434	1.1432	0.5957	1.1432	1.0692
No log	20.7619	436	1.1073	0.5857	1.1073	1.0523
No log	20.8571	438	1.0364	0.6143	1.0364	1.0180
No log	20.9524	440	1.0158	0.6131	1.0158	1.0079
No log	21.0476	442	0.9671	0.6131	0.9671	0.9834
No log	21.1429	444	0.9255	0.6232	0.9255	0.9620
No log	21.2381	446	0.9104	0.6483	0.9104	0.9542
No log	21.3333	448	0.9837	0.6625	0.9837	0.9918
No log	21.4286	450	1.0708	0.6467	1.0708	1.0348
No log	21.5238	452	1.0089	0.6667	1.0089	1.0045
No log	21.6190	454	0.9563	0.6946	0.9563	0.9779
No log	21.7143	456	0.9421	0.6395	0.9421	0.9706
No log	21.8095	458	0.9595	0.6222	0.9595	0.9795
No log	21.9048	460	0.9540	0.6222	0.9540	0.9767
No log	22.0	462	1.0151	0.6119	1.0151	1.0075
No log	22.0952	464	1.0700	0.6222	1.0700	1.0344
No log	22.1905	466	1.0259	0.6222	1.0259	1.0129
No log	22.2857	468	1.0027	0.6222	1.0027	1.0014
No log	22.3810	470	0.9485	0.6222	0.9485	0.9739
No log	22.4762	472	0.9611	0.6222	0.9611	0.9803
No log	22.5714	474	1.0128	0.6222	1.0128	1.0064
No log	22.6667	476	0.9952	0.6222	0.9952	0.9976
No log	22.7619	478	1.0115	0.6143	1.0115	1.0057
No log	22.8571	480	1.0411	0.5455	1.0411	1.0203
No log	22.9524	482	1.0614	0.5455	1.0614	1.0303
No log	23.0476	484	1.0416	0.5324	1.0416	1.0206
No log	23.1429	486	1.0528	0.5324	1.0528	1.0260
No log	23.2381	488	0.9707	0.6471	0.9707	0.9852
No log	23.3333	490	0.9507	0.6324	0.9507	0.9750
No log	23.4286	492	1.0124	0.5652	1.0124	1.0062
No log	23.5238	494	1.0567	0.5429	1.0567	1.0280
No log	23.6190	496	1.0401	0.5693	1.0401	1.0199
No log	23.7143	498	1.0208	0.5672	1.0208	1.0103
0.3979	23.8095	500	1.0613	0.5972	1.0613	1.0302
0.3979	23.9048	502	1.0541	0.5957	1.0541	1.0267
0.3979	24.0	504	1.0675	0.5957	1.0675	1.0332
0.3979	24.0952	506	1.0135	0.5672	1.0135	1.0067
0.3979	24.1905	508	0.9243	0.6357	0.9243	0.9614
0.3979	24.2857	510	0.9020	0.6269	0.9020	0.9498
0.3979	24.3810	512	0.8990	0.6331	0.8990	0.9482
0.3979	24.4762	514	0.9619	0.6533	0.9619	0.9808
0.3979	24.5714	516	1.0877	0.6115	1.0877	1.0429
0.3979	24.6667	518	1.1561	0.5823	1.1561	1.0752
0.3979	24.7619	520	1.1557	0.5915	1.1557	1.0750
0.3979	24.8571	522	1.1055	0.5821	1.1055	1.0514
0.3979	24.9524	524	1.0925	0.5802	1.0925	1.0452
0.3979	25.0476	526	1.0644	0.5455	1.0644	1.0317

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1