ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7367
• Qwk: 0.5296
• Mse: 0.7367
• Rmse: 0.8583

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	4.0951	-0.0256	4.0951	2.0236
No log	0.0690	4	2.3006	0.0094	2.3006	1.5168
No log	0.1034	6	2.0508	-0.0725	2.0508	1.4320
No log	0.1379	8	1.5048	-0.0826	1.5048	1.2267
No log	0.1724	10	1.0620	0.0306	1.0620	1.0305
No log	0.2069	12	0.7585	0.1955	0.7585	0.8709
No log	0.2414	14	0.6918	0.2832	0.6918	0.8318
No log	0.2759	16	0.7401	0.2819	0.7401	0.8603
No log	0.3103	18	0.8753	0.2910	0.8753	0.9356
No log	0.3448	20	1.1289	0.2161	1.1289	1.0625
No log	0.3793	22	1.1959	0.2132	1.1959	1.0935
No log	0.4138	24	1.5653	0.1991	1.5653	1.2511
No log	0.4483	26	1.8065	0.1308	1.8065	1.3441
No log	0.4828	28	1.3293	0.2114	1.3293	1.1530
No log	0.5172	30	0.8851	0.2663	0.8851	0.9408
No log	0.5517	32	0.8288	0.2531	0.8288	0.9104
No log	0.5862	34	0.8528	0.2387	0.8528	0.9235
No log	0.6207	36	0.8260	0.2531	0.8260	0.9088
No log	0.6552	38	0.6680	0.3491	0.6680	0.8173
No log	0.6897	40	0.5763	0.4	0.5763	0.7591
No log	0.7241	42	0.5920	0.4125	0.5920	0.7694
No log	0.7586	44	0.8732	0.3115	0.8732	0.9344
No log	0.7931	46	1.4194	0.1940	1.4194	1.1914
No log	0.8276	48	1.5596	0.2118	1.5596	1.2488
No log	0.8621	50	1.2691	0.2838	1.2691	1.1265
No log	0.8966	52	0.9218	0.3539	0.9218	0.9601
No log	0.9310	54	0.7146	0.4223	0.7146	0.8453
No log	0.9655	56	0.7739	0.4129	0.7739	0.8797
No log	1.0	58	0.8080	0.4085	0.8080	0.8989
No log	1.0345	60	0.9883	0.3528	0.9883	0.9941
No log	1.0690	62	1.1114	0.3339	1.1114	1.0542
No log	1.1034	64	1.0591	0.3682	1.0591	1.0291
No log	1.1379	66	0.8499	0.4282	0.8499	0.9219
No log	1.1724	68	0.7122	0.4077	0.7122	0.8439
No log	1.2069	70	0.6947	0.3965	0.6947	0.8335
No log	1.2414	72	0.7382	0.3992	0.7382	0.8592
No log	1.2759	74	1.1177	0.3996	1.1177	1.0572
No log	1.3103	76	1.5130	0.2707	1.5130	1.2300
No log	1.3448	78	1.3798	0.3639	1.3798	1.1746
No log	1.3793	80	1.0569	0.4617	1.0569	1.0281
No log	1.4138	82	0.8527	0.4312	0.8527	0.9234
No log	1.4483	84	0.7077	0.4805	0.7077	0.8412
No log	1.4828	86	0.7217	0.4713	0.7217	0.8496
No log	1.5172	88	0.8254	0.4695	0.8254	0.9085
No log	1.5517	90	1.1039	0.4272	1.1039	1.0507
No log	1.5862	92	1.1137	0.4037	1.1137	1.0553
No log	1.6207	94	0.8690	0.5121	0.8690	0.9322
No log	1.6552	96	0.7343	0.5408	0.7343	0.8569
No log	1.6897	98	0.7069	0.5324	0.7069	0.8408
No log	1.7241	100	0.6999	0.4931	0.6999	0.8366
No log	1.7586	102	0.8220	0.4460	0.8220	0.9067
No log	1.7931	104	0.7515	0.4735	0.7515	0.8669
No log	1.8276	106	0.6721	0.471	0.6721	0.8198
No log	1.8621	108	0.7036	0.4847	0.7036	0.8388
No log	1.8966	110	0.7991	0.4203	0.7991	0.8939
No log	1.9310	112	0.9099	0.4194	0.9099	0.9539
No log	1.9655	114	0.8442	0.4438	0.8442	0.9188
No log	2.0	116	0.7452	0.5285	0.7452	0.8632
No log	2.0345	118	0.7381	0.5101	0.7381	0.8592
No log	2.0690	120	0.7432	0.5436	0.7432	0.8621
No log	2.1034	122	0.8826	0.5012	0.8826	0.9395
No log	2.1379	124	1.1477	0.3928	1.1477	1.0713
No log	2.1724	126	1.0992	0.3993	1.0992	1.0484
No log	2.2069	128	0.8532	0.4785	0.8532	0.9237
No log	2.2414	130	0.6833	0.4695	0.6833	0.8266
No log	2.2759	132	0.6528	0.4736	0.6528	0.8080
No log	2.3103	134	0.6665	0.4991	0.6665	0.8164
No log	2.3448	136	0.6806	0.4551	0.6806	0.8250
No log	2.3793	138	0.7455	0.4533	0.7455	0.8634
No log	2.4138	140	0.8138	0.4770	0.8138	0.9021
No log	2.4483	142	0.8821	0.4829	0.8821	0.9392
No log	2.4828	144	0.9376	0.4922	0.9376	0.9683
No log	2.5172	146	0.8840	0.5055	0.8840	0.9402
No log	2.5517	148	0.8957	0.4722	0.8957	0.9464
No log	2.5862	150	0.9842	0.4891	0.9842	0.9921
No log	2.6207	152	0.9839	0.4479	0.9839	0.9919
No log	2.6552	154	0.7953	0.4840	0.7953	0.8918
No log	2.6897	156	0.7023	0.5037	0.7023	0.8380
No log	2.7241	158	0.7042	0.4973	0.7042	0.8392
No log	2.7586	160	0.7385	0.4627	0.7385	0.8593
No log	2.7931	162	0.8423	0.4882	0.8423	0.9178
No log	2.8276	164	1.0092	0.4379	1.0092	1.0046
No log	2.8621	166	1.0012	0.4297	1.0012	1.0006
No log	2.8966	168	0.8768	0.4841	0.8768	0.9364
No log	2.9310	170	0.8059	0.4408	0.8059	0.8977
No log	2.9655	172	0.8556	0.4871	0.8556	0.9250
No log	3.0	174	1.0398	0.4051	1.0398	1.0197
No log	3.0345	176	1.2570	0.3484	1.2570	1.1212
No log	3.0690	178	1.1924	0.3560	1.1924	1.0920
No log	3.1034	180	0.9866	0.4149	0.9866	0.9933
No log	3.1379	182	0.8102	0.4906	0.8102	0.9001
No log	3.1724	184	0.7298	0.4537	0.7298	0.8543
No log	3.2069	186	0.7257	0.4684	0.7257	0.8519
No log	3.2414	188	0.7846	0.4547	0.7846	0.8858
No log	3.2759	190	0.8321	0.4609	0.8321	0.9122
No log	3.3103	192	0.9162	0.3926	0.9162	0.9572
No log	3.3448	194	0.8468	0.4394	0.8468	0.9202
No log	3.3793	196	0.7737	0.4575	0.7737	0.8796
No log	3.4138	198	0.7512	0.4873	0.7512	0.8667
No log	3.4483	200	0.8115	0.4062	0.8115	0.9008
No log	3.4828	202	0.8568	0.4438	0.8568	0.9256
No log	3.5172	204	0.8993	0.4639	0.8993	0.9483
No log	3.5517	206	0.8212	0.4309	0.8212	0.9062
No log	3.5862	208	0.7928	0.4458	0.7928	0.8904
No log	3.6207	210	0.7486	0.4690	0.7486	0.8652
No log	3.6552	212	0.8148	0.4121	0.8148	0.9026
No log	3.6897	214	0.8990	0.4440	0.8990	0.9481
No log	3.7241	216	0.8831	0.4437	0.8831	0.9397
No log	3.7586	218	0.8052	0.4932	0.8052	0.8973
No log	3.7931	220	0.7326	0.5307	0.7326	0.8559
No log	3.8276	222	0.7318	0.5175	0.7318	0.8554
No log	3.8621	224	0.7481	0.5179	0.7481	0.8649
No log	3.8966	226	0.7873	0.4952	0.7873	0.8873
No log	3.9310	228	0.8444	0.5283	0.8444	0.9189
No log	3.9655	230	0.8022	0.5050	0.8022	0.8957
No log	4.0	232	0.7555	0.5538	0.7555	0.8692
No log	4.0345	234	0.7607	0.4720	0.7607	0.8722
No log	4.0690	236	0.7491	0.4825	0.7491	0.8655
No log	4.1034	238	0.7593	0.4770	0.7593	0.8714
No log	4.1379	240	0.7853	0.5039	0.7853	0.8862
No log	4.1724	242	0.8399	0.4956	0.8399	0.9165
No log	4.2069	244	0.8527	0.4964	0.8527	0.9234
No log	4.2414	246	0.7971	0.5030	0.7971	0.8928
No log	4.2759	248	0.7739	0.5238	0.7739	0.8797
No log	4.3103	250	0.7266	0.5035	0.7266	0.8524
No log	4.3448	252	0.6761	0.5474	0.6761	0.8223
No log	4.3793	254	0.6659	0.4845	0.6659	0.8160
No log	4.4138	256	0.6473	0.5309	0.6473	0.8046
No log	4.4483	258	0.6495	0.5276	0.6495	0.8059
No log	4.4828	260	0.6990	0.4792	0.6990	0.8360
No log	4.5172	262	0.8176	0.3955	0.8176	0.9042
No log	4.5517	264	0.8536	0.3842	0.8536	0.9239
No log	4.5862	266	0.7907	0.4157	0.7907	0.8892
No log	4.6207	268	0.7100	0.5167	0.7100	0.8426
No log	4.6552	270	0.6943	0.5835	0.6943	0.8332
No log	4.6897	272	0.7118	0.5579	0.7118	0.8437
No log	4.7241	274	0.7219	0.5432	0.7219	0.8497
No log	4.7586	276	0.7161	0.5258	0.7161	0.8462
No log	4.7931	278	0.7223	0.5230	0.7223	0.8499
No log	4.8276	280	0.7253	0.5326	0.7253	0.8517
No log	4.8621	282	0.7508	0.5441	0.7508	0.8665
No log	4.8966	284	0.7341	0.5467	0.7341	0.8568
No log	4.9310	286	0.6883	0.5331	0.6883	0.8297
No log	4.9655	288	0.6588	0.5363	0.6588	0.8117
No log	5.0	290	0.6523	0.5060	0.6523	0.8076
No log	5.0345	292	0.6429	0.4964	0.6429	0.8018
No log	5.0690	294	0.6209	0.5347	0.6209	0.7880
No log	5.1034	296	0.6486	0.5585	0.6486	0.8054
No log	5.1379	298	0.6919	0.5422	0.6919	0.8318
No log	5.1724	300	0.6721	0.5540	0.6721	0.8198
No log	5.2069	302	0.6341	0.5792	0.6341	0.7963
No log	5.2414	304	0.6261	0.5773	0.6261	0.7913
No log	5.2759	306	0.6225	0.5532	0.6225	0.7890
No log	5.3103	308	0.6290	0.5836	0.6290	0.7931
No log	5.3448	310	0.6555	0.5709	0.6555	0.8096
No log	5.3793	312	0.7086	0.5597	0.7086	0.8418
No log	5.4138	314	0.7771	0.5684	0.7771	0.8816
No log	5.4483	316	0.7777	0.5584	0.7777	0.8819
No log	5.4828	318	0.7474	0.5665	0.7474	0.8645
No log	5.5172	320	0.7406	0.5038	0.7406	0.8606
No log	5.5517	322	0.7541	0.5127	0.7541	0.8684
No log	5.5862	324	0.7277	0.5206	0.7277	0.8530
No log	5.6207	326	0.7045	0.5738	0.7045	0.8393
No log	5.6552	328	0.7173	0.5689	0.7173	0.8469
No log	5.6897	330	0.7300	0.5572	0.7300	0.8544
No log	5.7241	332	0.7388	0.5572	0.7388	0.8596
No log	5.7586	334	0.6950	0.5616	0.6950	0.8337
No log	5.7931	336	0.6843	0.5763	0.6843	0.8272
No log	5.8276	338	0.6866	0.5873	0.6866	0.8286
No log	5.8621	340	0.6847	0.5718	0.6847	0.8275
No log	5.8966	342	0.6832	0.5718	0.6832	0.8266
No log	5.9310	344	0.6915	0.5658	0.6915	0.8316
No log	5.9655	346	0.7091	0.5539	0.7091	0.8421
No log	6.0	348	0.7347	0.5844	0.7347	0.8572
No log	6.0345	350	0.7484	0.5311	0.7484	0.8651
No log	6.0690	352	0.7356	0.5556	0.7356	0.8577
No log	6.1034	354	0.7465	0.5557	0.7465	0.8640
No log	6.1379	356	0.7484	0.5382	0.7484	0.8651
No log	6.1724	358	0.7838	0.4827	0.7838	0.8853
No log	6.2069	360	0.7797	0.4827	0.7797	0.8830
No log	6.2414	362	0.7835	0.4756	0.7835	0.8852
No log	6.2759	364	0.7653	0.4989	0.7653	0.8748
No log	6.3103	366	0.7123	0.5601	0.7123	0.8440
No log	6.3448	368	0.6934	0.5788	0.6934	0.8327
No log	6.3793	370	0.6906	0.5788	0.6906	0.8310
No log	6.4138	372	0.7079	0.5709	0.7079	0.8414
No log	6.4483	374	0.7140	0.5692	0.7140	0.8450
No log	6.4828	376	0.7309	0.5658	0.7309	0.8549
No log	6.5172	378	0.7363	0.5598	0.7363	0.8581
No log	6.5517	380	0.7307	0.5316	0.7307	0.8548
No log	6.5862	382	0.7290	0.5094	0.7290	0.8538
No log	6.6207	384	0.7152	0.5104	0.7152	0.8457
No log	6.6552	386	0.7018	0.5564	0.7018	0.8377
No log	6.6897	388	0.7003	0.5878	0.7003	0.8368
No log	6.7241	390	0.7232	0.5346	0.7232	0.8504
No log	6.7586	392	0.7484	0.5003	0.7484	0.8651
No log	6.7931	394	0.7365	0.5003	0.7365	0.8582
No log	6.8276	396	0.6832	0.5494	0.6832	0.8265
No log	6.8621	398	0.6388	0.5903	0.6388	0.7993
No log	6.8966	400	0.6394	0.5340	0.6394	0.7996
No log	6.9310	402	0.6765	0.4846	0.6765	0.8225
No log	6.9655	404	0.6868	0.4650	0.6868	0.8287
No log	7.0	406	0.6799	0.4819	0.6799	0.8246
No log	7.0345	408	0.6897	0.5551	0.6897	0.8305
No log	7.0690	410	0.7370	0.5796	0.7370	0.8585
No log	7.1034	412	0.7619	0.5353	0.7619	0.8728
No log	7.1379	414	0.7620	0.5353	0.7620	0.8729
No log	7.1724	416	0.7434	0.5658	0.7434	0.8622
No log	7.2069	418	0.7275	0.5838	0.7275	0.8529
No log	7.2414	420	0.7029	0.5566	0.7029	0.8384
No log	7.2759	422	0.6871	0.5157	0.6871	0.8289
No log	7.3103	424	0.6762	0.5644	0.6762	0.8223
No log	7.3448	426	0.6755	0.5898	0.6755	0.8219
No log	7.3793	428	0.6739	0.5835	0.6739	0.8209
No log	7.4138	430	0.6703	0.5898	0.6703	0.8187
No log	7.4483	432	0.6679	0.5898	0.6679	0.8172
No log	7.4828	434	0.6668	0.5727	0.6668	0.8166
No log	7.5172	436	0.6804	0.5097	0.6804	0.8249
No log	7.5517	438	0.7050	0.4973	0.7050	0.8396
No log	7.5862	440	0.7233	0.4589	0.7233	0.8505
No log	7.6207	442	0.7202	0.4806	0.7202	0.8486
No log	7.6552	444	0.7035	0.5214	0.7035	0.8387
No log	7.6897	446	0.6879	0.5672	0.6879	0.8294
No log	7.7241	448	0.6906	0.5970	0.6906	0.8310
No log	7.7586	450	0.6943	0.5585	0.6943	0.8332
No log	7.7931	452	0.6958	0.5705	0.6958	0.8341
No log	7.8276	454	0.6907	0.6025	0.6907	0.8311
No log	7.8621	456	0.6914	0.5535	0.6914	0.8315
No log	7.8966	458	0.6916	0.5430	0.6916	0.8316
No log	7.9310	460	0.6841	0.5427	0.6841	0.8271
No log	7.9655	462	0.6774	0.5736	0.6774	0.8230
No log	8.0	464	0.6771	0.5534	0.6771	0.8229
No log	8.0345	466	0.6808	0.5611	0.6808	0.8251
No log	8.0690	468	0.6748	0.5566	0.6748	0.8215
No log	8.1034	470	0.6737	0.5566	0.6737	0.8208
No log	8.1379	472	0.6750	0.5582	0.6750	0.8216
No log	8.1724	474	0.6801	0.5827	0.6801	0.8247
No log	8.2069	476	0.6858	0.5827	0.6858	0.8281
No log	8.2414	478	0.6923	0.5569	0.6923	0.8321
No log	8.2759	480	0.6926	0.5827	0.6926	0.8322
No log	8.3103	482	0.6892	0.5827	0.6892	0.8302
No log	8.3448	484	0.6894	0.5521	0.6894	0.8303
No log	8.3793	486	0.6862	0.5628	0.6862	0.8284
No log	8.4138	488	0.6878	0.5358	0.6878	0.8293
No log	8.4483	490	0.6928	0.5023	0.6928	0.8324
No log	8.4828	492	0.6861	0.5033	0.6861	0.8283
No log	8.5172	494	0.6859	0.5023	0.6859	0.8282
No log	8.5517	496	0.6781	0.5033	0.6781	0.8235
No log	8.5862	498	0.6756	0.5267	0.6756	0.8219
0.3804	8.6207	500	0.6758	0.5295	0.6758	0.8221
0.3804	8.6552	502	0.6765	0.5644	0.6765	0.8225
0.3804	8.6897	504	0.6803	0.5582	0.6803	0.8248
0.3804	8.7241	506	0.6835	0.5733	0.6835	0.8268
0.3804	8.7586	508	0.6817	0.5736	0.6817	0.8256
0.3804	8.7931	510	0.6809	0.5733	0.6809	0.8252
0.3804	8.8276	512	0.6858	0.5690	0.6858	0.8281
0.3804	8.8621	514	0.6914	0.5629	0.6914	0.8315
0.3804	8.8966	516	0.6940	0.5629	0.6940	0.8331
0.3804	8.9310	518	0.6891	0.5690	0.6891	0.8301
0.3804	8.9655	520	0.6857	0.5690	0.6857	0.8281
0.3804	9.0	522	0.6803	0.5736	0.6803	0.8248
0.3804	9.0345	524	0.6787	0.5566	0.6787	0.8238
0.3804	9.0690	526	0.6806	0.5566	0.6806	0.8250
0.3804	9.1034	528	0.6816	0.5566	0.6816	0.8256
0.3804	9.1379	530	0.6854	0.5566	0.6854	0.8279
0.3804	9.1724	532	0.6858	0.5566	0.6858	0.8282
0.3804	9.2069	534	0.6857	0.5566	0.6857	0.8281
0.3804	9.2414	536	0.6857	0.5551	0.6857	0.8281
0.3804	9.2759	538	0.6877	0.5551	0.6877	0.8293
0.3804	9.3103	540	0.6894	0.5551	0.6894	0.8303
0.3804	9.3448	542	0.6933	0.5360	0.6933	0.8326
0.3804	9.3793	544	0.6966	0.5360	0.6966	0.8347
0.3804	9.4138	546	0.6997	0.5551	0.6997	0.8365
0.3804	9.4483	548	0.7023	0.5535	0.7023	0.8380
0.3804	9.4828	550	0.7047	0.5579	0.7047	0.8395
0.3804	9.5172	552	0.7081	0.5358	0.7081	0.8415
0.3804	9.5517	554	0.7128	0.5416	0.7128	0.8443
0.3804	9.5862	556	0.7184	0.5403	0.7184	0.8476
0.3804	9.6207	558	0.7242	0.5390	0.7242	0.8510
0.3804	9.6552	560	0.7280	0.5390	0.7280	0.8532
0.3804	9.6897	562	0.7313	0.5390	0.7313	0.8552
0.3804	9.7241	564	0.7339	0.5390	0.7339	0.8567
0.3804	9.7586	566	0.7364	0.5390	0.7364	0.8581
0.3804	9.7931	568	0.7368	0.5336	0.7368	0.8584
0.3804	9.8276	570	0.7378	0.5336	0.7378	0.8590
0.3804	9.8621	572	0.7378	0.5336	0.7378	0.8590
0.3804	9.8966	574	0.7375	0.5292	0.7375	0.8588
0.3804	9.9310	576	0.7371	0.5296	0.7371	0.8586
0.3804	9.9655	578	0.7368	0.5296	0.7368	0.8584
0.3804	10.0	580	0.7367	0.5296	0.7367	0.8583

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1