ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5504
• Qwk: 0.7462
• Mse: 0.5504
• Rmse: 0.7419

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	4.8527	-0.0078	4.8527	2.2029
No log	0.0727	4	2.7519	0.0588	2.7519	1.6589
No log	0.1091	6	1.9772	0.0238	1.9772	1.4061
No log	0.1455	8	1.4885	0.1186	1.4885	1.2201
No log	0.1818	10	1.2149	0.2645	1.2149	1.1022
No log	0.2182	12	1.7641	0.1883	1.7641	1.3282
No log	0.2545	14	1.2933	0.3183	1.2933	1.1372
No log	0.2909	16	1.0244	0.4194	1.0244	1.0121
No log	0.3273	18	1.0496	0.4032	1.0496	1.0245
No log	0.3636	20	1.0004	0.4238	1.0004	1.0002
No log	0.4	22	1.1873	0.3608	1.1873	1.0897
No log	0.4364	24	1.3648	0.3044	1.3648	1.1682
No log	0.4727	26	1.2773	0.3415	1.2773	1.1302
No log	0.5091	28	1.0419	0.4100	1.0419	1.0207
No log	0.5455	30	0.9072	0.5219	0.9072	0.9525
No log	0.5818	32	1.0284	0.4897	1.0284	1.0141
No log	0.6182	34	1.0824	0.4749	1.0824	1.0404
No log	0.6545	36	1.2791	0.4284	1.2791	1.1310
No log	0.6909	38	1.5501	0.3131	1.5501	1.2450
No log	0.7273	40	1.3871	0.3493	1.3871	1.1778
No log	0.7636	42	0.8287	0.5810	0.8287	0.9103
No log	0.8	44	0.7201	0.5506	0.7201	0.8486
No log	0.8364	46	0.7200	0.5884	0.7200	0.8485
No log	0.8727	48	0.8244	0.5671	0.8244	0.9079
No log	0.9091	50	1.1382	0.5217	1.1382	1.0669
No log	0.9455	52	0.9845	0.5617	0.9845	0.9922
No log	0.9818	54	0.6905	0.7118	0.6905	0.8310
No log	1.0182	56	0.6571	0.6293	0.6571	0.8106
No log	1.0545	58	0.6571	0.6767	0.6571	0.8106
No log	1.0909	60	0.7743	0.6083	0.7743	0.8799
No log	1.1273	62	0.9402	0.5776	0.9402	0.9696
No log	1.1636	64	0.9935	0.5821	0.9935	0.9968
No log	1.2	66	0.9530	0.5935	0.9530	0.9762
No log	1.2364	68	0.6705	0.6775	0.6705	0.8188
No log	1.2727	70	0.6286	0.6915	0.6286	0.7928
No log	1.3091	72	0.7828	0.6093	0.7828	0.8848
No log	1.3455	74	1.1194	0.5347	1.1194	1.0580
No log	1.3818	76	0.9550	0.5820	0.9550	0.9772
No log	1.4182	78	0.6351	0.7058	0.6351	0.7969
No log	1.4545	80	0.5806	0.7125	0.5806	0.7619
No log	1.4909	82	0.6107	0.7320	0.6107	0.7815
No log	1.5273	84	0.7609	0.6025	0.7609	0.8723
No log	1.5636	86	0.8776	0.5637	0.8776	0.9368
No log	1.6	88	0.8097	0.5759	0.8097	0.8998
No log	1.6364	90	0.7450	0.6570	0.7450	0.8631
No log	1.6727	92	0.7308	0.6845	0.7308	0.8549
No log	1.7091	94	0.6944	0.7094	0.6944	0.8333
No log	1.7455	96	0.7874	0.6831	0.7874	0.8874
No log	1.7818	98	0.9714	0.6011	0.9714	0.9856
No log	1.8182	100	1.3316	0.4976	1.3316	1.1539
No log	1.8545	102	1.3030	0.4971	1.3030	1.1415
No log	1.8909	104	1.4786	0.4345	1.4786	1.2160
No log	1.9273	106	1.2275	0.5204	1.2275	1.1079
No log	1.9636	108	0.8186	0.6463	0.8186	0.9048
No log	2.0	110	0.6216	0.7646	0.6216	0.7884
No log	2.0364	112	0.5790	0.7432	0.5790	0.7609
No log	2.0727	114	0.5640	0.7471	0.5640	0.7510
No log	2.1091	116	0.5815	0.7617	0.5815	0.7626
No log	2.1455	118	0.5889	0.7586	0.5889	0.7674
No log	2.1818	120	0.5591	0.7660	0.5591	0.7477
No log	2.2182	122	0.5636	0.7562	0.5636	0.7507
No log	2.2545	124	0.5574	0.7558	0.5574	0.7466
No log	2.2909	126	0.5555	0.7583	0.5555	0.7453
No log	2.3273	128	0.6083	0.6912	0.6083	0.7800
No log	2.3636	130	0.7729	0.6513	0.7729	0.8792
No log	2.4	132	0.7310	0.6533	0.7310	0.8550
No log	2.4364	134	0.6089	0.7516	0.6089	0.7803
No log	2.4727	136	0.6008	0.7682	0.6008	0.7751
No log	2.5091	138	0.7172	0.6693	0.7172	0.8469
No log	2.5455	140	0.8008	0.6345	0.8008	0.8949
No log	2.5818	142	0.7209	0.6508	0.7209	0.8490
No log	2.6182	144	0.6712	0.6808	0.6712	0.8193
No log	2.6545	146	0.6630	0.6551	0.6630	0.8143
No log	2.6909	148	0.7684	0.6585	0.7684	0.8766
No log	2.7273	150	0.8530	0.6343	0.8530	0.9236
No log	2.7636	152	0.7888	0.6529	0.7888	0.8881
No log	2.8	154	0.5983	0.7367	0.5983	0.7735
No log	2.8364	156	0.5537	0.7687	0.5537	0.7441
No log	2.8727	158	0.5855	0.7396	0.5855	0.7652
No log	2.9091	160	0.6231	0.7356	0.6231	0.7894
No log	2.9455	162	0.5857	0.7490	0.5857	0.7653
No log	2.9818	164	0.5471	0.7617	0.5471	0.7397
No log	3.0182	166	0.5408	0.7562	0.5408	0.7354
No log	3.0545	168	0.5668	0.7375	0.5668	0.7529
No log	3.0909	170	0.6132	0.6943	0.6132	0.7831
No log	3.1273	172	0.6455	0.6889	0.6455	0.8035
No log	3.1636	174	0.7344	0.6789	0.7344	0.8570
No log	3.2	176	0.7255	0.6922	0.7255	0.8518
No log	3.2364	178	0.7697	0.6785	0.7697	0.8773
No log	3.2727	180	0.9586	0.5958	0.9586	0.9791
No log	3.3091	182	0.9611	0.5992	0.9611	0.9803
No log	3.3455	184	0.7910	0.6559	0.7910	0.8894
No log	3.3818	186	0.5939	0.7469	0.5939	0.7707
No log	3.4182	188	0.5942	0.7347	0.5942	0.7709
No log	3.4545	190	0.6509	0.7198	0.6509	0.8068
No log	3.4909	192	0.6503	0.7173	0.6503	0.8064
No log	3.5273	194	0.5891	0.7391	0.5891	0.7675
No log	3.5636	196	0.5794	0.7417	0.5794	0.7612
No log	3.6	198	0.6094	0.7043	0.6094	0.7806
No log	3.6364	200	0.5789	0.7448	0.5789	0.7609
No log	3.6727	202	0.6060	0.7384	0.6060	0.7785
No log	3.7091	204	0.6907	0.7016	0.6907	0.8311
No log	3.7455	206	0.6833	0.7029	0.6833	0.8266
No log	3.7818	208	0.5862	0.7302	0.5862	0.7656
No log	3.8182	210	0.6265	0.6892	0.6265	0.7915
No log	3.8545	212	0.8101	0.6449	0.8101	0.9000
No log	3.8909	214	0.9035	0.6062	0.9035	0.9505
No log	3.9273	216	0.9022	0.6067	0.9022	0.9498
No log	3.9636	218	0.7550	0.6662	0.7550	0.8689
No log	4.0	220	0.6030	0.6975	0.6030	0.7766
No log	4.0364	222	0.5776	0.7351	0.5776	0.7600
No log	4.0727	224	0.5820	0.7312	0.5820	0.7629
No log	4.1091	226	0.5885	0.7166	0.5885	0.7671
No log	4.1455	228	0.6246	0.7084	0.6246	0.7903
No log	4.1818	230	0.6669	0.6853	0.6669	0.8166
No log	4.2182	232	0.6126	0.7260	0.6126	0.7827
No log	4.2545	234	0.5711	0.7495	0.5711	0.7557
No log	4.2909	236	0.5869	0.7189	0.5869	0.7661
No log	4.3273	238	0.5875	0.7253	0.5875	0.7665
No log	4.3636	240	0.5781	0.7222	0.5781	0.7603
No log	4.4	242	0.5905	0.7558	0.5905	0.7684
No log	4.4364	244	0.5905	0.7646	0.5905	0.7684
No log	4.4727	246	0.5644	0.7386	0.5644	0.7513
No log	4.5091	248	0.6166	0.7133	0.6166	0.7853
No log	4.5455	250	0.7255	0.6916	0.7255	0.8518
No log	4.5818	252	0.7354	0.6819	0.7354	0.8575
No log	4.6182	254	0.6928	0.7186	0.6928	0.8324
No log	4.6545	256	0.6224	0.7222	0.6224	0.7889
No log	4.6909	258	0.5877	0.7304	0.5877	0.7666
No log	4.7273	260	0.5914	0.7316	0.5914	0.7690
No log	4.7636	262	0.5937	0.7235	0.5937	0.7705
No log	4.8	264	0.5946	0.7344	0.5946	0.7711
No log	4.8364	266	0.5946	0.7301	0.5946	0.7711
No log	4.8727	268	0.5877	0.7338	0.5877	0.7666
No log	4.9091	270	0.5788	0.7267	0.5788	0.7608
No log	4.9455	272	0.5782	0.7273	0.5782	0.7604
No log	4.9818	274	0.5636	0.7246	0.5636	0.7507
No log	5.0182	276	0.5613	0.7123	0.5613	0.7492
No log	5.0545	278	0.5570	0.7158	0.5570	0.7463
No log	5.0909	280	0.5734	0.6829	0.5734	0.7572
No log	5.1273	282	0.5858	0.6805	0.5858	0.7653
No log	5.1636	284	0.5829	0.6805	0.5829	0.7635
No log	5.2	286	0.5852	0.6917	0.5852	0.7650
No log	5.2364	288	0.6193	0.7130	0.6193	0.7870
No log	5.2727	290	0.6314	0.7161	0.6314	0.7946
No log	5.3091	292	0.5820	0.7035	0.5820	0.7629
No log	5.3455	294	0.5692	0.7256	0.5692	0.7544
No log	5.3818	296	0.5592	0.7144	0.5592	0.7478
No log	5.4182	298	0.5569	0.7037	0.5569	0.7462
No log	5.4545	300	0.5533	0.7236	0.5533	0.7438
No log	5.4909	302	0.5564	0.7515	0.5564	0.7460
No log	5.5273	304	0.5554	0.7144	0.5554	0.7453
No log	5.5636	306	0.5844	0.6696	0.5844	0.7645
No log	5.6	308	0.6187	0.7076	0.6187	0.7866
No log	5.6364	310	0.6020	0.7073	0.6020	0.7759
No log	5.6727	312	0.5592	0.7324	0.5592	0.7478
No log	5.7091	314	0.5674	0.7417	0.5674	0.7532
No log	5.7455	316	0.5850	0.7227	0.5850	0.7648
No log	5.7818	318	0.5724	0.7369	0.5724	0.7566
No log	5.8182	320	0.5784	0.7432	0.5784	0.7605
No log	5.8545	322	0.5836	0.7357	0.5836	0.7639
No log	5.8909	324	0.5748	0.7434	0.5748	0.7581
No log	5.9273	326	0.6035	0.7315	0.6035	0.7769
No log	5.9636	328	0.6659	0.7297	0.6659	0.8160
No log	6.0	330	0.6818	0.7313	0.6818	0.8257
No log	6.0364	332	0.6349	0.7282	0.6349	0.7968
No log	6.0727	334	0.5939	0.7358	0.5939	0.7707
No log	6.1091	336	0.5622	0.7636	0.5622	0.7498
No log	6.1455	338	0.5503	0.7632	0.5503	0.7418
No log	6.1818	340	0.5487	0.7581	0.5487	0.7407
No log	6.2182	342	0.5770	0.7468	0.5770	0.7596
No log	6.2545	344	0.6712	0.7294	0.6712	0.8193
No log	6.2909	346	0.7541	0.7012	0.7541	0.8684
No log	6.3273	348	0.7607	0.7055	0.7607	0.8722
No log	6.3636	350	0.6885	0.7171	0.6885	0.8297
No log	6.4	352	0.6135	0.7434	0.6135	0.7832
No log	6.4364	354	0.5849	0.7461	0.5849	0.7648
No log	6.4727	356	0.5733	0.7578	0.5733	0.7572
No log	6.5091	358	0.5600	0.7597	0.5600	0.7483
No log	6.5455	360	0.5493	0.7746	0.5493	0.7412
No log	6.5818	362	0.5498	0.7698	0.5498	0.7415
No log	6.6182	364	0.5646	0.7528	0.5646	0.7514
No log	6.6545	366	0.5879	0.7504	0.5879	0.7668
No log	6.6909	368	0.5802	0.7528	0.5802	0.7617
No log	6.7273	370	0.5851	0.7484	0.5851	0.7649
No log	6.7636	372	0.5686	0.7515	0.5686	0.7541
No log	6.8	374	0.5527	0.7439	0.5527	0.7434
No log	6.8364	376	0.5426	0.7693	0.5426	0.7366
No log	6.8727	378	0.5341	0.7693	0.5341	0.7308
No log	6.9091	380	0.5245	0.7587	0.5245	0.7242
No log	6.9455	382	0.5220	0.7501	0.5220	0.7225
No log	6.9818	384	0.5387	0.7287	0.5387	0.7340
No log	7.0182	386	0.5425	0.7349	0.5425	0.7365
No log	7.0545	388	0.5243	0.7398	0.5243	0.7241
No log	7.0909	390	0.5227	0.7576	0.5227	0.7230
No log	7.1273	392	0.5474	0.7619	0.5474	0.7399
No log	7.1636	394	0.5519	0.7619	0.5519	0.7429
No log	7.2	396	0.5383	0.7735	0.5383	0.7337
No log	7.2364	398	0.5248	0.7577	0.5248	0.7244
No log	7.2727	400	0.5242	0.7603	0.5242	0.7240
No log	7.3091	402	0.5285	0.7577	0.5285	0.7270
No log	7.3455	404	0.5528	0.7498	0.5528	0.7435
No log	7.3818	406	0.5965	0.7522	0.5965	0.7723
No log	7.4182	408	0.6195	0.7478	0.6195	0.7871
No log	7.4545	410	0.6047	0.7453	0.6047	0.7776
No log	7.4909	412	0.5948	0.7399	0.5948	0.7712
No log	7.5273	414	0.5739	0.7553	0.5739	0.7576
No log	7.5636	416	0.5686	0.7553	0.5686	0.7541
No log	7.6	418	0.5590	0.7553	0.5590	0.7476
No log	7.6364	420	0.5554	0.7558	0.5554	0.7452
No log	7.6727	422	0.5537	0.7412	0.5537	0.7441
No log	7.7091	424	0.5550	0.7412	0.5550	0.7450
No log	7.7455	426	0.5517	0.7412	0.5517	0.7428
No log	7.7818	428	0.5493	0.7558	0.5493	0.7412
No log	7.8182	430	0.5502	0.7491	0.5502	0.7418
No log	7.8545	432	0.5508	0.7544	0.5508	0.7422
No log	7.8909	434	0.5620	0.7474	0.5620	0.7497
No log	7.9273	436	0.5629	0.7474	0.5629	0.7503
No log	7.9636	438	0.5519	0.7480	0.5519	0.7429
No log	8.0	440	0.5447	0.7488	0.5447	0.7380
No log	8.0364	442	0.5455	0.7532	0.5455	0.7386
No log	8.0727	444	0.5436	0.7581	0.5436	0.7373
No log	8.1091	446	0.5417	0.7475	0.5417	0.7360
No log	8.1455	448	0.5426	0.7377	0.5426	0.7366
No log	8.1818	450	0.5420	0.7493	0.5420	0.7362
No log	8.2182	452	0.5410	0.7418	0.5410	0.7355
No log	8.2545	454	0.5475	0.7467	0.5475	0.7400
No log	8.2909	456	0.5508	0.7506	0.5508	0.7422
No log	8.3273	458	0.5482	0.7467	0.5482	0.7404
No log	8.3636	460	0.5479	0.7506	0.5479	0.7402
No log	8.4	462	0.5459	0.7470	0.5459	0.7388
No log	8.4364	464	0.5462	0.7470	0.5462	0.7391
No log	8.4727	466	0.5508	0.7470	0.5508	0.7422
No log	8.5091	468	0.5559	0.7462	0.5559	0.7456
No log	8.5455	470	0.5640	0.7480	0.5640	0.7510
No log	8.5818	472	0.5686	0.7480	0.5686	0.7541
No log	8.6182	474	0.5754	0.7430	0.5754	0.7585
No log	8.6545	476	0.5833	0.7385	0.5833	0.7638
No log	8.6909	478	0.5950	0.7335	0.5950	0.7714
No log	8.7273	480	0.6014	0.7374	0.6014	0.7755
No log	8.7636	482	0.5937	0.7441	0.5937	0.7705
No log	8.8	484	0.5743	0.7510	0.5743	0.7579
No log	8.8364	486	0.5542	0.7498	0.5542	0.7445
No log	8.8727	488	0.5423	0.7422	0.5423	0.7364
No log	8.9091	490	0.5387	0.7484	0.5387	0.7339
No log	8.9455	492	0.5400	0.7484	0.5400	0.7348
No log	8.9818	494	0.5417	0.7484	0.5417	0.7360
No log	9.0182	496	0.5425	0.7484	0.5425	0.7365
No log	9.0545	498	0.5434	0.7466	0.5434	0.7371
0.3439	9.0909	500	0.5448	0.7466	0.5448	0.7381
0.3439	9.1273	502	0.5482	0.7491	0.5482	0.7404
0.3439	9.1636	504	0.5564	0.7462	0.5564	0.7459
0.3439	9.2	506	0.5663	0.7480	0.5663	0.7526
0.3439	9.2364	508	0.5741	0.7480	0.5741	0.7577
0.3439	9.2727	510	0.5760	0.7436	0.5760	0.7589
0.3439	9.3091	512	0.5797	0.7436	0.5797	0.7614
0.3439	9.3455	514	0.5786	0.7436	0.5786	0.7607
0.3439	9.3818	516	0.5767	0.7436	0.5767	0.7594
0.3439	9.4182	518	0.5759	0.7418	0.5759	0.7589
0.3439	9.4545	520	0.5717	0.7462	0.5717	0.7561
0.3439	9.4909	522	0.5688	0.7462	0.5688	0.7542
0.3439	9.5273	524	0.5675	0.7462	0.5675	0.7533
0.3439	9.5636	526	0.5647	0.7462	0.5647	0.7515
0.3439	9.6	528	0.5622	0.7462	0.5622	0.7498
0.3439	9.6364	530	0.5591	0.7462	0.5591	0.7477
0.3439	9.6727	532	0.5573	0.7462	0.5573	0.7465
0.3439	9.7091	534	0.5555	0.7462	0.5555	0.7453
0.3439	9.7455	536	0.5539	0.7462	0.5539	0.7443
0.3439	9.7818	538	0.5524	0.7462	0.5524	0.7432
0.3439	9.8182	540	0.5517	0.7462	0.5517	0.7428
0.3439	9.8545	542	0.5509	0.7462	0.5509	0.7422
0.3439	9.8909	544	0.5504	0.7462	0.5504	0.7419
0.3439	9.9273	546	0.5505	0.7462	0.5505	0.7420
0.3439	9.9636	548	0.5505	0.7462	0.5505	0.7419
0.3439	10.0	550	0.5504	0.7462	0.5504	0.7419

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1