ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6358
• Qwk: 0.7016
• Mse: 0.6358
• Rmse: 0.7974

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	5.1392	-0.0067	5.1392	2.2670
No log	0.0727	4	3.4861	0.0539	3.4861	1.8671
No log	0.1091	6	2.1516	0.0937	2.1516	1.4668
No log	0.1455	8	2.2365	-0.0662	2.2365	1.4955
No log	0.1818	10	2.0478	-0.0223	2.0478	1.4310
No log	0.2182	12	1.4138	0.0318	1.4138	1.1891
No log	0.2545	14	1.2144	0.2511	1.2144	1.1020
No log	0.2909	16	1.1762	0.2689	1.1762	1.0845
No log	0.3273	18	1.2036	0.1799	1.2036	1.0971
No log	0.3636	20	1.1861	0.2466	1.1861	1.0891
No log	0.4	22	1.3224	0.2065	1.3224	1.1499
No log	0.4364	24	1.3460	0.2161	1.3460	1.1602
No log	0.4727	26	1.2813	0.2014	1.2813	1.1319
No log	0.5091	28	1.1467	0.1771	1.1467	1.0708
No log	0.5455	30	1.1080	0.2063	1.1080	1.0526
No log	0.5818	32	1.0879	0.2260	1.0879	1.0430
No log	0.6182	34	1.1438	0.1571	1.1438	1.0695
No log	0.6545	36	1.3036	0.1705	1.3036	1.1417
No log	0.6909	38	1.5827	0.1227	1.5827	1.2581
No log	0.7273	40	1.7646	0.1293	1.7646	1.3284
No log	0.7636	42	1.9130	0.1616	1.9130	1.3831
No log	0.8	44	1.9479	0.2186	1.9479	1.3957
No log	0.8364	46	1.7110	0.1964	1.7110	1.3080
No log	0.8727	48	1.4645	0.2325	1.4645	1.2102
No log	0.9091	50	1.2004	0.2781	1.2004	1.0956
No log	0.9455	52	1.0890	0.2849	1.0890	1.0436
No log	0.9818	54	1.0120	0.3425	1.0120	1.0060
No log	1.0182	56	1.0072	0.3518	1.0072	1.0036
No log	1.0545	58	1.0032	0.4015	1.0032	1.0016
No log	1.0909	60	1.0386	0.3354	1.0386	1.0191
No log	1.1273	62	1.1162	0.3064	1.1162	1.0565
No log	1.1636	64	1.2025	0.2792	1.2025	1.0966
No log	1.2	66	1.2507	0.3379	1.2507	1.1183
No log	1.2364	68	1.2100	0.3571	1.2100	1.1000
No log	1.2727	70	1.1521	0.4092	1.1521	1.0734
No log	1.3091	72	1.1114	0.3684	1.1114	1.0542
No log	1.3455	74	1.0936	0.3982	1.0936	1.0458
No log	1.3818	76	1.2286	0.4001	1.2286	1.1084
No log	1.4182	78	1.4361	0.4025	1.4361	1.1984
No log	1.4545	80	1.7897	0.2411	1.7897	1.3378
No log	1.4909	82	2.0414	0.1682	2.0414	1.4288
No log	1.5273	84	2.0917	0.1833	2.0917	1.4463
No log	1.5636	86	2.0443	0.2135	2.0443	1.4298
No log	1.6	88	1.8870	0.2639	1.8870	1.3737
No log	1.6364	90	1.5579	0.3141	1.5579	1.2481
No log	1.6727	92	1.1669	0.4397	1.1669	1.0802
No log	1.7091	94	1.0439	0.4704	1.0439	1.0217
No log	1.7455	96	1.1243	0.4672	1.1243	1.0603
No log	1.7818	98	1.1936	0.4083	1.1936	1.0925
No log	1.8182	100	1.0772	0.4058	1.0772	1.0379
No log	1.8545	102	0.8974	0.4922	0.8974	0.9473
No log	1.8909	104	0.8681	0.5349	0.8681	0.9317
No log	1.9273	106	0.8717	0.5560	0.8717	0.9336
No log	1.9636	108	0.8880	0.5434	0.8880	0.9423
No log	2.0	110	0.8265	0.5273	0.8265	0.9091
No log	2.0364	112	0.8233	0.5802	0.8233	0.9074
No log	2.0727	114	0.8012	0.5766	0.8012	0.8951
No log	2.1091	116	0.8591	0.5664	0.8591	0.9269
No log	2.1455	118	1.1389	0.4973	1.1389	1.0672
No log	2.1818	120	1.2675	0.4331	1.2675	1.1258
No log	2.2182	122	1.1908	0.4802	1.1908	1.0913
No log	2.2545	124	1.1161	0.5112	1.1161	1.0565
No log	2.2909	126	1.1475	0.5239	1.1475	1.0712
No log	2.3273	128	1.0981	0.5455	1.0981	1.0479
No log	2.3636	130	0.9695	0.5855	0.9695	0.9846
No log	2.4	132	0.8730	0.5941	0.8730	0.9343
No log	2.4364	134	0.8526	0.5826	0.8526	0.9234
No log	2.4727	136	0.7723	0.6704	0.7723	0.8788
No log	2.5091	138	0.7019	0.6529	0.7019	0.8378
No log	2.5455	140	0.7077	0.6578	0.7077	0.8412
No log	2.5818	142	0.6575	0.6548	0.6575	0.8109
No log	2.6182	144	0.6201	0.7080	0.6201	0.7875
No log	2.6545	146	0.7045	0.6563	0.7045	0.8393
No log	2.6909	148	0.8353	0.5756	0.8353	0.9139
No log	2.7273	150	0.8747	0.5111	0.8747	0.9353
No log	2.7636	152	0.8137	0.5793	0.8137	0.9020
No log	2.8	154	0.7810	0.5956	0.7810	0.8837
No log	2.8364	156	0.8989	0.6201	0.8989	0.9481
No log	2.8727	158	0.9723	0.5758	0.9723	0.9860
No log	2.9091	160	0.9111	0.5958	0.9111	0.9545
No log	2.9455	162	0.8016	0.6393	0.8016	0.8953
No log	2.9818	164	0.7534	0.5985	0.7534	0.8680
No log	3.0182	166	0.7993	0.5927	0.7993	0.8940
No log	3.0545	168	0.8583	0.5998	0.8583	0.9264
No log	3.0909	170	0.9483	0.5841	0.9483	0.9738
No log	3.1273	172	1.0122	0.5511	1.0122	1.0061
No log	3.1636	174	0.9472	0.5741	0.9472	0.9732
No log	3.2	176	0.8349	0.6265	0.8349	0.9137
No log	3.2364	178	0.7823	0.6659	0.7823	0.8845
No log	3.2727	180	0.7095	0.6970	0.7095	0.8423
No log	3.3091	182	0.6797	0.6636	0.6797	0.8245
No log	3.3455	184	0.7306	0.6413	0.7306	0.8547
No log	3.3818	186	0.8273	0.5965	0.8273	0.9095
No log	3.4182	188	0.8342	0.5667	0.8342	0.9134
No log	3.4545	190	0.7733	0.6248	0.7733	0.8794
No log	3.4909	192	0.6994	0.6570	0.6994	0.8363
No log	3.5273	194	0.6641	0.7183	0.6641	0.8149
No log	3.5636	196	0.6593	0.7230	0.6593	0.8120
No log	3.6	198	0.6620	0.6776	0.6620	0.8137
No log	3.6364	200	0.6662	0.6828	0.6662	0.8162
No log	3.6727	202	0.7025	0.6482	0.7025	0.8382
No log	3.7091	204	0.7517	0.6212	0.7517	0.8670
No log	3.7455	206	0.7987	0.5935	0.7987	0.8937
No log	3.7818	208	0.7801	0.5945	0.7801	0.8832
No log	3.8182	210	0.7443	0.6410	0.7443	0.8627
No log	3.8545	212	0.7136	0.6745	0.7136	0.8448
No log	3.8909	214	0.7188	0.6800	0.7188	0.8478
No log	3.9273	216	0.7123	0.6713	0.7123	0.8440
No log	3.9636	218	0.7022	0.6828	0.7022	0.8380
No log	4.0	220	0.7151	0.6715	0.7151	0.8456
No log	4.0364	222	0.7282	0.6668	0.7282	0.8533
No log	4.0727	224	0.7521	0.6657	0.7521	0.8672
No log	4.1091	226	0.7572	0.6392	0.7572	0.8702
No log	4.1455	228	0.7498	0.6392	0.7498	0.8659
No log	4.1818	230	0.7485	0.6646	0.7485	0.8652
No log	4.2182	232	0.7732	0.6487	0.7732	0.8793
No log	4.2545	234	0.7808	0.6590	0.7808	0.8836
No log	4.2909	236	0.7551	0.6662	0.7551	0.8690
No log	4.3273	238	0.7099	0.6910	0.7099	0.8426
No log	4.3636	240	0.6710	0.7227	0.6710	0.8192
No log	4.4	242	0.6524	0.7033	0.6524	0.8077
No log	4.4364	244	0.6800	0.6854	0.6800	0.8246
No log	4.4727	246	0.6938	0.6740	0.6938	0.8329
No log	4.5091	248	0.6846	0.6766	0.6846	0.8274
No log	4.5455	250	0.6868	0.6552	0.6868	0.8287
No log	4.5818	252	0.6941	0.6592	0.6941	0.8331
No log	4.6182	254	0.6977	0.6725	0.6977	0.8353
No log	4.6545	256	0.6944	0.6619	0.6944	0.8333
No log	4.6909	258	0.6896	0.6926	0.6896	0.8304
No log	4.7273	260	0.6879	0.6890	0.6879	0.8294
No log	4.7636	262	0.6873	0.6926	0.6873	0.8290
No log	4.8	264	0.7048	0.6609	0.7048	0.8396
No log	4.8364	266	0.7159	0.6535	0.7159	0.8461
No log	4.8727	268	0.7171	0.6677	0.7171	0.8468
No log	4.9091	270	0.7476	0.6094	0.7476	0.8646
No log	4.9455	272	0.7532	0.6084	0.7532	0.8678
No log	4.9818	274	0.7459	0.6176	0.7459	0.8637
No log	5.0182	276	0.7509	0.6123	0.7509	0.8666
No log	5.0545	278	0.7527	0.6304	0.7527	0.8676
No log	5.0909	280	0.7336	0.6225	0.7336	0.8565
No log	5.1273	282	0.7108	0.6582	0.7108	0.8431
No log	5.1636	284	0.7085	0.6595	0.7085	0.8417
No log	5.2	286	0.7004	0.6739	0.7004	0.8369
No log	5.2364	288	0.6899	0.6918	0.6899	0.8306
No log	5.2727	290	0.6800	0.6884	0.6800	0.8246
No log	5.3091	292	0.6792	0.6871	0.6792	0.8242
No log	5.3455	294	0.6826	0.6856	0.6826	0.8262
No log	5.3818	296	0.6826	0.6762	0.6826	0.8262
No log	5.4182	298	0.6832	0.6736	0.6832	0.8266
No log	5.4545	300	0.6744	0.6624	0.6744	0.8212
No log	5.4909	302	0.6752	0.6696	0.6752	0.8217
No log	5.5273	304	0.6629	0.6746	0.6629	0.8142
No log	5.5636	306	0.6557	0.6859	0.6557	0.8098
No log	5.6	308	0.6551	0.6822	0.6551	0.8094
No log	5.6364	310	0.6628	0.6813	0.6628	0.8141
No log	5.6727	312	0.6629	0.6813	0.6629	0.8142
No log	5.7091	314	0.6534	0.6864	0.6534	0.8083
No log	5.7455	316	0.6553	0.6864	0.6553	0.8095
No log	5.7818	318	0.6585	0.6758	0.6585	0.8115
No log	5.8182	320	0.6518	0.6809	0.6518	0.8073
No log	5.8545	322	0.6446	0.6859	0.6446	0.8028
No log	5.8909	324	0.6395	0.7234	0.6395	0.7997
No log	5.9273	326	0.6493	0.6851	0.6493	0.8058
No log	5.9636	328	0.6797	0.6451	0.6797	0.8245
No log	6.0	330	0.7164	0.6261	0.7164	0.8464
No log	6.0364	332	0.7697	0.5866	0.7697	0.8773
No log	6.0727	334	0.7833	0.5972	0.7833	0.8850
No log	6.1091	336	0.7436	0.6082	0.7436	0.8623
No log	6.1455	338	0.6944	0.6876	0.6944	0.8333
No log	6.1818	340	0.6668	0.6925	0.6668	0.8166
No log	6.2182	342	0.6672	0.7080	0.6672	0.8168
No log	6.2545	344	0.6672	0.7066	0.6672	0.8168
No log	6.2909	346	0.6759	0.7146	0.6759	0.8221
No log	6.3273	348	0.6677	0.7115	0.6677	0.8171
No log	6.3636	350	0.6714	0.6769	0.6714	0.8194
No log	6.4	352	0.7252	0.6641	0.7252	0.8516
No log	6.4364	354	0.7570	0.6274	0.7570	0.8701
No log	6.4727	356	0.7352	0.6274	0.7352	0.8574
No log	6.5091	358	0.6772	0.6803	0.6772	0.8229
No log	6.5455	360	0.6518	0.6829	0.6518	0.8073
No log	6.5818	362	0.6491	0.6794	0.6491	0.8057
No log	6.6182	364	0.6714	0.6907	0.6714	0.8194
No log	6.6545	366	0.6865	0.6803	0.6865	0.8286
No log	6.6909	368	0.6789	0.6913	0.6789	0.8240
No log	6.7273	370	0.6737	0.6913	0.6737	0.8208
No log	6.7636	372	0.6620	0.6947	0.6620	0.8136
No log	6.8	374	0.6581	0.6750	0.6581	0.8112
No log	6.8364	376	0.6571	0.6854	0.6571	0.8106
No log	6.8727	378	0.6705	0.6729	0.6705	0.8188
No log	6.9091	380	0.6698	0.6755	0.6698	0.8184
No log	6.9455	382	0.6831	0.6642	0.6831	0.8265
No log	6.9818	384	0.6978	0.6740	0.6978	0.8354
No log	7.0182	386	0.7013	0.6671	0.7013	0.8374
No log	7.0545	388	0.6902	0.6983	0.6902	0.8308
No log	7.0909	390	0.6678	0.6994	0.6678	0.8172
No log	7.1273	392	0.6593	0.7050	0.6593	0.8120
No log	7.1636	394	0.6557	0.6904	0.6557	0.8098
No log	7.2	396	0.6497	0.6974	0.6497	0.8060
No log	7.2364	398	0.6452	0.6765	0.6452	0.8032
No log	7.2727	400	0.6387	0.6880	0.6387	0.7992
No log	7.3091	402	0.6318	0.6880	0.6318	0.7949
No log	7.3455	404	0.6272	0.6880	0.6272	0.7919
No log	7.3818	406	0.6227	0.6838	0.6227	0.7891
No log	7.4182	408	0.6221	0.6917	0.6221	0.7888
No log	7.4545	410	0.6295	0.6880	0.6295	0.7934
No log	7.4909	412	0.6613	0.6878	0.6613	0.8132
No log	7.5273	414	0.7112	0.6206	0.7112	0.8433
No log	7.5636	416	0.7574	0.6325	0.7574	0.8703
No log	7.6	418	0.7658	0.6325	0.7658	0.8751
No log	7.6364	420	0.7346	0.6033	0.7346	0.8571
No log	7.6727	422	0.6844	0.6759	0.6844	0.8273
No log	7.7091	424	0.6469	0.6910	0.6469	0.8043
No log	7.7455	426	0.6333	0.7081	0.6333	0.7958
No log	7.7818	428	0.6302	0.7026	0.6302	0.7939
No log	7.8182	430	0.6266	0.7081	0.6266	0.7916
No log	7.8545	432	0.6258	0.7033	0.6258	0.7911
No log	7.8909	434	0.6357	0.6715	0.6357	0.7973
No log	7.9273	436	0.6661	0.6724	0.6661	0.8161
No log	7.9636	438	0.6979	0.6571	0.6979	0.8354
No log	8.0	440	0.7099	0.6525	0.7099	0.8426
No log	8.0364	442	0.7136	0.6432	0.7136	0.8448
No log	8.0727	444	0.6981	0.6644	0.6981	0.8355
No log	8.1091	446	0.6830	0.6828	0.6830	0.8264
No log	8.1455	448	0.6646	0.6795	0.6646	0.8152
No log	8.1818	450	0.6579	0.6719	0.6579	0.8111
No log	8.2182	452	0.6461	0.6719	0.6461	0.8038
No log	8.2545	454	0.6323	0.6666	0.6323	0.7952
No log	8.2909	456	0.6334	0.6666	0.6334	0.7959
No log	8.3273	458	0.6418	0.6610	0.6418	0.8011
No log	8.3636	460	0.6552	0.6742	0.6552	0.8095
No log	8.4	462	0.6809	0.7031	0.6809	0.8251
No log	8.4364	464	0.7106	0.6571	0.7106	0.8430
No log	8.4727	466	0.7268	0.6340	0.7268	0.8526
No log	8.5091	468	0.7257	0.6195	0.7257	0.8519
No log	8.5455	470	0.7037	0.6845	0.7037	0.8389
No log	8.5818	472	0.6774	0.6836	0.6774	0.8231
No log	8.6182	474	0.6497	0.6809	0.6497	0.8061
No log	8.6545	476	0.6275	0.7014	0.6275	0.7922
No log	8.6909	478	0.6149	0.7096	0.6149	0.7841
No log	8.7273	480	0.6122	0.7066	0.6122	0.7825
No log	8.7636	482	0.6137	0.7099	0.6137	0.7834
No log	8.8	484	0.6157	0.7099	0.6157	0.7847
No log	8.8364	486	0.6177	0.7099	0.6177	0.7859
No log	8.8727	488	0.6215	0.7113	0.6215	0.7883
No log	8.9091	490	0.6277	0.7007	0.6277	0.7923
No log	8.9455	492	0.6388	0.6944	0.6388	0.7993
No log	8.9818	494	0.6563	0.6914	0.6563	0.8101
No log	9.0182	496	0.6764	0.7166	0.6764	0.8225
No log	9.0545	498	0.6935	0.7120	0.6935	0.8327
0.4567	9.0909	500	0.6994	0.7075	0.6994	0.8363
0.4567	9.1273	502	0.6962	0.7075	0.6962	0.8344
0.4567	9.1636	504	0.6875	0.7120	0.6875	0.8291
0.4567	9.2	506	0.6791	0.6992	0.6791	0.8241
0.4567	9.2364	508	0.6650	0.6682	0.6650	0.8155
0.4567	9.2727	510	0.6513	0.6859	0.6513	0.8070
0.4567	9.3091	512	0.6429	0.7090	0.6429	0.8018
0.4567	9.3455	514	0.6389	0.7001	0.6389	0.7993
0.4567	9.3818	516	0.6361	0.7078	0.6361	0.7976
0.4567	9.4182	518	0.6353	0.6972	0.6353	0.7971
0.4567	9.4545	520	0.6359	0.6972	0.6359	0.7974
0.4567	9.4909	522	0.6374	0.6972	0.6374	0.7984
0.4567	9.5273	524	0.6397	0.6972	0.6397	0.7998
0.4567	9.5636	526	0.6393	0.6972	0.6393	0.7996
0.4567	9.6	528	0.6396	0.6895	0.6396	0.7997
0.4567	9.6364	530	0.6375	0.6972	0.6375	0.7985
0.4567	9.6727	532	0.6360	0.6895	0.6360	0.7975
0.4567	9.7091	534	0.6355	0.6895	0.6355	0.7972
0.4567	9.7455	536	0.6351	0.6895	0.6351	0.7970
0.4567	9.7818	538	0.6352	0.6909	0.6352	0.7970
0.4567	9.8182	540	0.6355	0.6909	0.6355	0.7972
0.4567	9.8545	542	0.6351	0.7016	0.6351	0.7969
0.4567	9.8909	544	0.6349	0.7016	0.6349	0.7968
0.4567	9.9273	546	0.6351	0.7016	0.6351	0.7969
0.4567	9.9636	548	0.6356	0.7016	0.6356	0.7972
0.4567	10.0	550	0.6358	0.7016	0.6358	0.7974

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1