ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1310
• Qwk: 0.5746
• Mse: 1.1310
• Rmse: 1.0635

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.4445	0.0104	2.4445	1.5635
No log	0.0645	4	1.6918	0.1241	1.6918	1.3007
No log	0.0968	6	1.5150	0.1154	1.5150	1.2309
No log	0.1290	8	1.5701	0.1963	1.5701	1.2530
No log	0.1613	10	1.5855	0.2448	1.5855	1.2592
No log	0.1935	12	1.5423	0.3328	1.5423	1.2419
No log	0.2258	14	1.4629	0.2810	1.4629	1.2095
No log	0.2581	16	1.3530	0.1371	1.3530	1.1632
No log	0.2903	18	1.3629	0.1128	1.3629	1.1674
No log	0.3226	20	1.4048	0.1700	1.4048	1.1852
No log	0.3548	22	1.3840	0.1301	1.3840	1.1764
No log	0.3871	24	1.4019	0.0645	1.4019	1.1840
No log	0.4194	26	1.4595	0.1288	1.4595	1.2081
No log	0.4516	28	1.4116	0.2564	1.4116	1.1881
No log	0.4839	30	1.3274	0.2546	1.3274	1.1521
No log	0.5161	32	1.3117	0.2756	1.3117	1.1453
No log	0.5484	34	1.2808	0.2873	1.2808	1.1317
No log	0.5806	36	1.4077	0.3957	1.4077	1.1865
No log	0.6129	38	1.5751	0.3289	1.5751	1.2550
No log	0.6452	40	1.5771	0.3028	1.5771	1.2558
No log	0.6774	42	1.3677	0.3643	1.3677	1.1695
No log	0.7097	44	1.1890	0.3055	1.1890	1.0904
No log	0.7419	46	1.2087	0.3624	1.2087	1.0994
No log	0.7742	48	1.2843	0.3215	1.2843	1.1333
No log	0.8065	50	1.1740	0.4016	1.1740	1.0835
No log	0.8387	52	1.1265	0.4140	1.1265	1.0614
No log	0.8710	54	1.1821	0.3560	1.1821	1.0872
No log	0.9032	56	1.3144	0.3836	1.3144	1.1465
No log	0.9355	58	1.3414	0.3940	1.3414	1.1582
No log	0.9677	60	1.2379	0.3871	1.2379	1.1126
No log	1.0	62	1.0830	0.4885	1.0830	1.0407
No log	1.0323	64	1.0433	0.4753	1.0433	1.0214
No log	1.0645	66	1.0293	0.5144	1.0293	1.0146
No log	1.0968	68	1.1519	0.4814	1.1519	1.0733
No log	1.1290	70	1.4591	0.4474	1.4591	1.2079
No log	1.1613	72	1.5873	0.4435	1.5873	1.2599
No log	1.1935	74	1.4583	0.4354	1.4583	1.2076
No log	1.2258	76	1.2813	0.4367	1.2813	1.1319
No log	1.2581	78	1.1064	0.4852	1.1064	1.0519
No log	1.2903	80	1.0257	0.4953	1.0257	1.0128
No log	1.3226	82	1.0457	0.5601	1.0457	1.0226
No log	1.3548	84	1.2409	0.5053	1.2409	1.1139
No log	1.3871	86	1.5160	0.4561	1.5160	1.2312
No log	1.4194	88	1.4739	0.4711	1.4739	1.2141
No log	1.4516	90	1.2811	0.4884	1.2811	1.1319
No log	1.4839	92	1.1259	0.5526	1.1259	1.0611
No log	1.5161	94	1.1638	0.5231	1.1638	1.0788
No log	1.5484	96	1.2771	0.4791	1.2771	1.1301
No log	1.5806	98	1.4101	0.3970	1.4101	1.1875
No log	1.6129	100	1.5252	0.4071	1.5252	1.2350
No log	1.6452	102	1.4368	0.4391	1.4368	1.1987
No log	1.6774	104	1.3675	0.4453	1.3675	1.1694
No log	1.7097	106	1.1395	0.5852	1.1395	1.0675
No log	1.7419	108	1.0654	0.5980	1.0654	1.0322
No log	1.7742	110	1.1348	0.5804	1.1348	1.0653
No log	1.8065	112	1.0497	0.5864	1.0497	1.0246
No log	1.8387	114	1.0549	0.5721	1.0549	1.0271
No log	1.8710	116	1.1192	0.5369	1.1192	1.0579
No log	1.9032	118	1.2424	0.5079	1.2424	1.1146
No log	1.9355	120	1.4646	0.4846	1.4646	1.2102
No log	1.9677	122	1.6251	0.4520	1.6251	1.2748
No log	2.0	124	1.5759	0.4551	1.5759	1.2553
No log	2.0323	126	1.3201	0.5461	1.3201	1.1490
No log	2.0645	128	1.3013	0.5344	1.3013	1.1407
No log	2.0968	130	1.2190	0.5766	1.2190	1.1041
No log	2.1290	132	1.4028	0.5033	1.4028	1.1844
No log	2.1613	134	1.3931	0.5491	1.3931	1.1803
No log	2.1935	136	1.2615	0.5382	1.2615	1.1232
No log	2.2258	138	1.1594	0.5454	1.1594	1.0768
No log	2.2581	140	1.3085	0.5428	1.3085	1.1439
No log	2.2903	142	1.6872	0.4618	1.6872	1.2989
No log	2.3226	144	1.7673	0.4553	1.7673	1.3294
No log	2.3548	146	1.4745	0.4593	1.4745	1.2143
No log	2.3871	148	1.0465	0.5639	1.0465	1.0230
No log	2.4194	150	0.8756	0.5766	0.8756	0.9357
No log	2.4516	152	0.8733	0.5781	0.8733	0.9345
No log	2.4839	154	0.9401	0.5642	0.9401	0.9696
No log	2.5161	156	1.1439	0.5138	1.1439	1.0695
No log	2.5484	158	1.4331	0.4515	1.4331	1.1971
No log	2.5806	160	1.5602	0.4157	1.5602	1.2491
No log	2.6129	162	1.4754	0.4506	1.4754	1.2147
No log	2.6452	164	1.2315	0.4672	1.2315	1.1097
No log	2.6774	166	1.1357	0.5426	1.1357	1.0657
No log	2.7097	168	1.1159	0.5312	1.1159	1.0564
No log	2.7419	170	1.1941	0.5094	1.1941	1.0927
No log	2.7742	172	1.3836	0.4737	1.3836	1.1763
No log	2.8065	174	1.4316	0.4661	1.4316	1.1965
No log	2.8387	176	1.2869	0.5233	1.2869	1.1344
No log	2.8710	178	1.2050	0.5301	1.2050	1.0977
No log	2.9032	180	1.0405	0.5745	1.0405	1.0201
No log	2.9355	182	0.9808	0.5925	0.9808	0.9904
No log	2.9677	184	0.9307	0.6159	0.9307	0.9647
No log	3.0	186	0.9579	0.6117	0.9579	0.9787
No log	3.0323	188	1.1246	0.5545	1.1246	1.0605
No log	3.0645	190	1.2146	0.5304	1.2146	1.1021
No log	3.0968	192	1.3429	0.4682	1.3429	1.1589
No log	3.1290	194	1.4142	0.4510	1.4142	1.1892
No log	3.1613	196	1.3602	0.4516	1.3602	1.1663
No log	3.1935	198	1.2155	0.5000	1.2155	1.1025
No log	3.2258	200	1.0729	0.5351	1.0729	1.0358
No log	3.2581	202	0.9263	0.5677	0.9263	0.9625
No log	3.2903	204	0.9287	0.5924	0.9287	0.9637
No log	3.3226	206	1.0489	0.5653	1.0489	1.0242
No log	3.3548	208	1.3228	0.5598	1.3228	1.1501
No log	3.3871	210	1.4619	0.5202	1.4619	1.2091
No log	3.4194	212	1.4302	0.5411	1.4302	1.1959
No log	3.4516	214	1.2377	0.5656	1.2377	1.1125
No log	3.4839	216	1.0892	0.5549	1.0892	1.0436
No log	3.5161	218	1.0527	0.5646	1.0527	1.0260
No log	3.5484	220	1.1689	0.5518	1.1689	1.0812
No log	3.5806	222	1.2299	0.5509	1.2299	1.1090
No log	3.6129	224	1.1459	0.5573	1.1459	1.0705
No log	3.6452	226	1.0996	0.5636	1.0996	1.0486
No log	3.6774	228	1.1283	0.5592	1.1283	1.0622
No log	3.7097	230	1.1003	0.5853	1.1003	1.0490
No log	3.7419	232	1.2410	0.5777	1.2410	1.1140
No log	3.7742	234	1.4716	0.5189	1.4716	1.2131
No log	3.8065	236	1.4116	0.5304	1.4116	1.1881
No log	3.8387	238	1.2670	0.5344	1.2670	1.1256
No log	3.8710	240	1.1462	0.5735	1.1462	1.0706
No log	3.9032	242	1.0897	0.5544	1.0897	1.0439
No log	3.9355	244	1.0781	0.5564	1.0781	1.0383
No log	3.9677	246	1.0715	0.5633	1.0715	1.0351
No log	4.0	248	1.2088	0.5597	1.2088	1.0994
No log	4.0323	250	1.2697	0.5519	1.2697	1.1268
No log	4.0645	252	1.2279	0.5151	1.2279	1.1081
No log	4.0968	254	1.1449	0.5473	1.1449	1.0700
No log	4.1290	256	1.1044	0.5629	1.1044	1.0509
No log	4.1613	258	1.1571	0.5500	1.1571	1.0757
No log	4.1935	260	1.3193	0.4888	1.3193	1.1486
No log	4.2258	262	1.4545	0.4908	1.4545	1.2060
No log	4.2581	264	1.3953	0.4953	1.3953	1.1812
No log	4.2903	266	1.1637	0.5593	1.1637	1.0787
No log	4.3226	268	0.9976	0.5834	0.9976	0.9988
No log	4.3548	270	0.9488	0.6240	0.9488	0.9741
No log	4.3871	272	1.0077	0.5832	1.0077	1.0039
No log	4.4194	274	1.1409	0.5806	1.1409	1.0681
No log	4.4516	276	1.2714	0.5591	1.2714	1.1276
No log	4.4839	278	1.2265	0.5786	1.2265	1.1075
No log	4.5161	280	1.0942	0.5723	1.0942	1.0461
No log	4.5484	282	1.0350	0.6036	1.0350	1.0173
No log	4.5806	284	1.0166	0.6044	1.0166	1.0082
No log	4.6129	286	1.0248	0.5903	1.0248	1.0123
No log	4.6452	288	1.0296	0.5903	1.0296	1.0147
No log	4.6774	290	0.9612	0.6113	0.9612	0.9804
No log	4.7097	292	0.9844	0.5955	0.9844	0.9922
No log	4.7419	294	1.0871	0.5816	1.0871	1.0426
No log	4.7742	296	1.3187	0.5735	1.3187	1.1483
No log	4.8065	298	1.4446	0.5078	1.4446	1.2019
No log	4.8387	300	1.3750	0.5319	1.3750	1.1726
No log	4.8710	302	1.2297	0.5472	1.2297	1.1089
No log	4.9032	304	1.2154	0.5453	1.2154	1.1024
No log	4.9355	306	1.2704	0.5177	1.2704	1.1271
No log	4.9677	308	1.3246	0.5035	1.3246	1.1509
No log	5.0	310	1.2561	0.5476	1.2561	1.1208
No log	5.0323	312	1.2161	0.5606	1.2161	1.1028
No log	5.0645	314	1.2121	0.5725	1.2121	1.1009
No log	5.0968	316	1.3001	0.5412	1.3001	1.1402
No log	5.1290	318	1.4584	0.5107	1.4584	1.2076
No log	5.1613	320	1.5507	0.5001	1.5507	1.2453
No log	5.1935	322	1.5090	0.4771	1.5090	1.2284
No log	5.2258	324	1.3291	0.5147	1.3291	1.1529
No log	5.2581	326	1.1990	0.5461	1.1990	1.0950
No log	5.2903	328	1.1673	0.5548	1.1673	1.0804
No log	5.3226	330	1.2310	0.5252	1.2310	1.1095
No log	5.3548	332	1.4036	0.5145	1.4036	1.1847
No log	5.3871	334	1.5611	0.4918	1.5611	1.2495
No log	5.4194	336	1.5519	0.4909	1.5519	1.2457
No log	5.4516	338	1.4146	0.5395	1.4146	1.1894
No log	5.4839	340	1.2625	0.5475	1.2625	1.1236
No log	5.5161	342	1.1963	0.5651	1.1963	1.0937
No log	5.5484	344	1.2045	0.5609	1.2045	1.0975
No log	5.5806	346	1.2882	0.5537	1.2882	1.1350
No log	5.6129	348	1.3250	0.5620	1.3250	1.1511
No log	5.6452	350	1.3192	0.5585	1.3192	1.1486
No log	5.6774	352	1.3408	0.5394	1.3408	1.1579
No log	5.7097	354	1.3208	0.5259	1.3208	1.1493
No log	5.7419	356	1.1879	0.5386	1.1879	1.0899
No log	5.7742	358	1.0484	0.5756	1.0484	1.0239
No log	5.8065	360	1.0129	0.5882	1.0129	1.0064
No log	5.8387	362	1.0614	0.5733	1.0614	1.0303
No log	5.8710	364	1.1398	0.5456	1.1398	1.0676
No log	5.9032	366	1.1156	0.5564	1.1156	1.0562
No log	5.9355	368	1.0117	0.5721	1.0117	1.0058
No log	5.9677	370	0.9306	0.6172	0.9306	0.9647
No log	6.0	372	0.8860	0.6315	0.8860	0.9413
No log	6.0323	374	0.9327	0.6077	0.9327	0.9658
No log	6.0645	376	0.9797	0.5846	0.9797	0.9898
No log	6.0968	378	1.0177	0.5820	1.0177	1.0088
No log	6.1290	380	0.9818	0.5765	0.9818	0.9909
No log	6.1613	382	1.0065	0.5643	1.0065	1.0033
No log	6.1935	384	1.0809	0.5724	1.0809	1.0397
No log	6.2258	386	1.1083	0.5724	1.1083	1.0528
No log	6.2581	388	1.1387	0.5639	1.1387	1.0671
No log	6.2903	390	1.1657	0.5554	1.1657	1.0797
No log	6.3226	392	1.1159	0.5430	1.1159	1.0564
No log	6.3548	394	1.0796	0.5559	1.0796	1.0390
No log	6.3871	396	1.0524	0.5492	1.0524	1.0259
No log	6.4194	398	1.0197	0.5623	1.0197	1.0098
No log	6.4516	400	1.0225	0.5623	1.0225	1.0112
No log	6.4839	402	1.0829	0.5570	1.0829	1.0406
No log	6.5161	404	1.0909	0.5579	1.0909	1.0445
No log	6.5484	406	1.1303	0.5483	1.1303	1.0632
No log	6.5806	408	1.1802	0.5606	1.1802	1.0864
No log	6.6129	410	1.2229	0.5610	1.2229	1.1059
No log	6.6452	412	1.2939	0.5604	1.2939	1.1375
No log	6.6774	414	1.2575	0.5673	1.2575	1.1214
No log	6.7097	416	1.1634	0.5446	1.1634	1.0786
No log	6.7419	418	1.1311	0.5490	1.1311	1.0635
No log	6.7742	420	1.0889	0.5700	1.0889	1.0435
No log	6.8065	422	1.0487	0.5789	1.0487	1.0241
No log	6.8387	424	1.0536	0.5789	1.0536	1.0264
No log	6.8710	426	1.0798	0.5887	1.0798	1.0391
No log	6.9032	428	1.1429	0.5863	1.1429	1.0691
No log	6.9355	430	1.1887	0.5601	1.1887	1.0903
No log	6.9677	432	1.1699	0.5551	1.1699	1.0816
No log	7.0	434	1.1083	0.5895	1.1083	1.0528
No log	7.0323	436	1.1148	0.5877	1.1148	1.0558
No log	7.0645	438	1.1419	0.5522	1.1419	1.0686
No log	7.0968	440	1.1899	0.5559	1.1899	1.0908
No log	7.1290	442	1.1870	0.5518	1.1870	1.0895
No log	7.1613	444	1.1733	0.5495	1.1733	1.0832
No log	7.1935	446	1.1674	0.5536	1.1674	1.0805
No log	7.2258	448	1.1655	0.5460	1.1655	1.0796
No log	7.2581	450	1.1153	0.5854	1.1153	1.0561
No log	7.2903	452	1.0573	0.5734	1.0573	1.0283
No log	7.3226	454	0.9965	0.5833	0.9965	0.9982
No log	7.3548	456	0.9919	0.5778	0.9919	0.9959
No log	7.3871	458	1.0093	0.5801	1.0093	1.0046
No log	7.4194	460	1.0405	0.5701	1.0405	1.0201
No log	7.4516	462	1.0707	0.5669	1.0707	1.0347
No log	7.4839	464	1.0639	0.5669	1.0639	1.0315
No log	7.5161	466	1.0417	0.5669	1.0417	1.0206
No log	7.5484	468	1.0161	0.5779	1.0161	1.0080
No log	7.5806	470	0.9520	0.5835	0.9520	0.9757
No log	7.6129	472	0.9249	0.6067	0.9249	0.9617
No log	7.6452	474	0.9292	0.5973	0.9292	0.9639
No log	7.6774	476	0.9875	0.5790	0.9875	0.9937
No log	7.7097	478	1.0924	0.5455	1.0924	1.0452
No log	7.7419	480	1.1767	0.5581	1.1767	1.0847
No log	7.7742	482	1.2551	0.5332	1.2551	1.1203
No log	7.8065	484	1.3300	0.5287	1.3300	1.1533
No log	7.8387	486	1.3527	0.5173	1.3527	1.1631
No log	7.8710	488	1.3560	0.5173	1.3560	1.1645
No log	7.9032	490	1.3037	0.5201	1.3037	1.1418
No log	7.9355	492	1.2622	0.5277	1.2622	1.1235
No log	7.9677	494	1.2183	0.5406	1.2183	1.1038
No log	8.0	496	1.1627	0.5557	1.1627	1.0783
No log	8.0323	498	1.1264	0.5587	1.1264	1.0613
0.3173	8.0645	500	1.1345	0.5646	1.1345	1.0651
0.3173	8.0968	502	1.1778	0.5538	1.1778	1.0853
0.3173	8.1290	504	1.2357	0.5608	1.2357	1.1116
0.3173	8.1613	506	1.3021	0.5382	1.3021	1.1411
0.3173	8.1935	508	1.3383	0.5222	1.3383	1.1569
0.3173	8.2258	510	1.3289	0.5222	1.3289	1.1528
0.3173	8.2581	512	1.2769	0.5473	1.2769	1.1300
0.3173	8.2903	514	1.2402	0.5585	1.2402	1.1136
0.3173	8.3226	516	1.2129	0.5527	1.2129	1.1013
0.3173	8.3548	518	1.1578	0.5571	1.1578	1.0760
0.3173	8.3871	520	1.1004	0.5611	1.1004	1.0490
0.3173	8.4194	522	1.0608	0.5780	1.0608	1.0299
0.3173	8.4516	524	1.0310	0.5723	1.0310	1.0154
0.3173	8.4839	526	1.0373	0.5723	1.0373	1.0185
0.3173	8.5161	528	1.0669	0.5656	1.0669	1.0329
0.3173	8.5484	530	1.1040	0.5611	1.1040	1.0507
0.3173	8.5806	532	1.1203	0.5659	1.1203	1.0584
0.3173	8.6129	534	1.1052	0.5713	1.1052	1.0513
0.3173	8.6452	536	1.1072	0.5812	1.1072	1.0522
0.3173	8.6774	538	1.1018	0.5757	1.1018	1.0497
0.3173	8.7097	540	1.0903	0.5800	1.0903	1.0442
0.3173	8.7419	542	1.0958	0.5789	1.0958	1.0468
0.3173	8.7742	544	1.0923	0.5789	1.0923	1.0451
0.3173	8.8065	546	1.0759	0.5789	1.0759	1.0373
0.3173	8.8387	548	1.0649	0.5811	1.0649	1.0319
0.3173	8.8710	550	1.0380	0.5757	1.0380	1.0188
0.3173	8.9032	552	1.0058	0.5790	1.0058	1.0029
0.3173	8.9355	554	0.9962	0.5790	0.9962	0.9981
0.3173	8.9677	556	1.0084	0.5857	1.0084	1.0042
0.3173	9.0	558	1.0364	0.5757	1.0364	1.0181
0.3173	9.0323	560	1.0795	0.5704	1.0795	1.0390
0.3173	9.0645	562	1.1192	0.5861	1.1192	1.0579
0.3173	9.0968	564	1.1533	0.5930	1.1533	1.0739
0.3173	9.1290	566	1.1742	0.5890	1.1742	1.0836
0.3173	9.1613	568	1.1766	0.5890	1.1766	1.0847
0.3173	9.1935	570	1.1598	0.5930	1.1598	1.0769
0.3173	9.2258	572	1.1337	0.5808	1.1337	1.0647
0.3173	9.2581	574	1.1068	0.5821	1.1068	1.0520
0.3173	9.2903	576	1.0789	0.5735	1.0789	1.0387
0.3173	9.3226	578	1.0623	0.5866	1.0623	1.0307
0.3173	9.3548	580	1.0557	0.5923	1.0557	1.0275
0.3173	9.3871	582	1.0432	0.5757	1.0432	1.0214
0.3173	9.4194	584	1.0464	0.5757	1.0464	1.0229
0.3173	9.4516	586	1.0493	0.5757	1.0493	1.0244
0.3173	9.4839	588	1.0574	0.5757	1.0574	1.0283
0.3173	9.5161	590	1.0715	0.5780	1.0715	1.0351
0.3173	9.5484	592	1.0863	0.5768	1.0863	1.0423
0.3173	9.5806	594	1.1034	0.5679	1.1034	1.0504
0.3173	9.6129	596	1.1174	0.5625	1.1174	1.0571
0.3173	9.6452	598	1.1323	0.5757	1.1323	1.0641
0.3173	9.6774	600	1.1470	0.5736	1.1470	1.0710
0.3173	9.7097	602	1.1559	0.5694	1.1559	1.0751
0.3173	9.7419	604	1.1588	0.5694	1.1588	1.0765
0.3173	9.7742	606	1.1558	0.5595	1.1558	1.0751
0.3173	9.8065	608	1.1520	0.5595	1.1520	1.0733
0.3173	9.8387	610	1.1453	0.5757	1.1453	1.0702
0.3173	9.8710	612	1.1386	0.5812	1.1386	1.0670
0.3173	9.9032	614	1.1337	0.5746	1.1337	1.0648
0.3173	9.9355	616	1.1321	0.5746	1.1321	1.0640
0.3173	9.9677	618	1.1312	0.5746	1.1312	1.0636
0.3173	10.0	620	1.1310	0.5746	1.1310	1.0635

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1