ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8256
• Qwk: 0.6950
• Mse: 0.8256
• Rmse: 0.9086

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0274	2	7.0431	0.0056	7.0431	2.6539
No log	0.0548	4	4.3669	0.0928	4.3669	2.0897
No log	0.0822	6	3.1837	0.0714	3.1837	1.7843
No log	0.1096	8	2.6432	0.0755	2.6432	1.6258
No log	0.1370	10	2.2348	0.1727	2.2348	1.4949
No log	0.1644	12	1.8249	0.2520	1.8249	1.3509
No log	0.1918	14	1.7978	0.3817	1.7978	1.3408
No log	0.2192	16	1.5800	0.3306	1.5800	1.2570
No log	0.2466	18	1.3791	0.3036	1.3791	1.1744
No log	0.2740	20	1.2955	0.2545	1.2955	1.1382
No log	0.3014	22	1.2538	0.3304	1.2538	1.1197
No log	0.3288	24	1.2998	0.3932	1.2998	1.1401
No log	0.3562	26	1.2076	0.4370	1.2076	1.0989
No log	0.3836	28	1.1033	0.4833	1.1033	1.0504
No log	0.4110	30	1.1703	0.4463	1.1703	1.0818
No log	0.4384	32	1.1029	0.4667	1.1029	1.0502
No log	0.4658	34	1.0821	0.5042	1.0821	1.0402
No log	0.4932	36	1.2980	0.4348	1.2980	1.1393
No log	0.5205	38	1.3862	0.4103	1.3862	1.1774
No log	0.5479	40	1.1398	0.5556	1.1398	1.0676
No log	0.5753	42	1.1428	0.5312	1.1428	1.0690
No log	0.6027	44	1.7016	0.3167	1.7016	1.3045
No log	0.6301	46	1.6571	0.3471	1.6571	1.2873
No log	0.6575	48	1.1821	0.5303	1.1821	1.0873
No log	0.6849	50	1.1517	0.5481	1.1517	1.0732
No log	0.7123	52	1.0478	0.6119	1.0478	1.0236
No log	0.7397	54	1.2679	0.5649	1.2679	1.1260
No log	0.7671	56	1.2914	0.5197	1.2914	1.1364
No log	0.7945	58	1.3278	0.3871	1.3278	1.1523
No log	0.8219	60	1.7051	0.4380	1.7051	1.3058
No log	0.8493	62	1.6260	0.4265	1.6260	1.2751
No log	0.8767	64	1.2046	0.3478	1.2046	1.0976
No log	0.9041	66	1.1374	0.5669	1.1374	1.0665
No log	0.9315	68	1.1177	0.5954	1.1177	1.0572
No log	0.9589	70	1.3061	0.5294	1.3061	1.1428
No log	0.9863	72	1.2864	0.5294	1.2864	1.1342
No log	1.0137	74	0.9919	0.6475	0.9919	0.9959
No log	1.0411	76	0.8733	0.6993	0.8733	0.9345
No log	1.0685	78	0.8155	0.7347	0.8155	0.9030
No log	1.0959	80	0.8477	0.6892	0.8477	0.9207
No log	1.1233	82	0.7611	0.7297	0.7611	0.8724
No log	1.1507	84	0.7094	0.7143	0.7094	0.8423
No log	1.1781	86	0.7211	0.7	0.7211	0.8492
No log	1.2055	88	0.7604	0.6809	0.7604	0.8720
No log	1.2329	90	0.7188	0.7299	0.7188	0.8478
No log	1.2603	92	0.8607	0.6901	0.8607	0.9277
No log	1.2877	94	0.8346	0.6715	0.8346	0.9135
No log	1.3151	96	0.7222	0.7429	0.7222	0.8498
No log	1.3425	98	0.9110	0.6618	0.9110	0.9545
No log	1.3699	100	1.1408	0.5303	1.1408	1.0681
No log	1.3973	102	1.0023	0.6269	1.0023	1.0012
No log	1.4247	104	0.7732	0.6950	0.7732	0.8793
No log	1.4521	106	0.7295	0.7101	0.7295	0.8541
No log	1.4795	108	0.7223	0.7153	0.7223	0.8499
No log	1.5068	110	0.7749	0.6912	0.7749	0.8803
No log	1.5342	112	0.9451	0.6087	0.9451	0.9722
No log	1.5616	114	1.0232	0.5755	1.0232	1.0115
No log	1.5890	116	0.8088	0.6667	0.8088	0.8993
No log	1.6164	118	0.6835	0.7947	0.6835	0.8267
No log	1.6438	120	0.7809	0.6479	0.7809	0.8837
No log	1.6712	122	0.6720	0.7733	0.6720	0.8197
No log	1.6986	124	0.6575	0.7534	0.6575	0.8108
No log	1.7260	126	0.9456	0.6294	0.9456	0.9724
No log	1.7534	128	1.1491	0.5294	1.1491	1.0720
No log	1.7808	130	0.9491	0.6803	0.9491	0.9742
No log	1.8082	132	0.7182	0.7682	0.7182	0.8474
No log	1.8356	134	0.6909	0.7619	0.6909	0.8312
No log	1.8630	136	0.8196	0.7034	0.8196	0.9053
No log	1.8904	138	1.0296	0.5931	1.0296	1.0147
No log	1.9178	140	0.9796	0.6111	0.9796	0.9897
No log	1.9452	142	0.7842	0.6980	0.7842	0.8855
No log	1.9726	144	0.6653	0.7898	0.6653	0.8157
No log	2.0	146	0.7114	0.7792	0.7114	0.8435
No log	2.0274	148	0.7903	0.6806	0.7903	0.8890
No log	2.0548	150	0.8936	0.6573	0.8936	0.9453
No log	2.0822	152	0.8522	0.6479	0.8522	0.9231
No log	2.1096	154	0.7406	0.7383	0.7406	0.8606
No log	2.1370	156	0.6350	0.7722	0.6350	0.7969
No log	2.1644	158	0.5847	0.7848	0.5847	0.7647
No log	2.1918	160	0.5933	0.7771	0.5933	0.7702
No log	2.2192	162	0.6861	0.7333	0.6861	0.8283
No log	2.2466	164	0.6123	0.7692	0.6123	0.7825
No log	2.2740	166	0.5269	0.8101	0.5269	0.7259
No log	2.3014	168	0.5405	0.8176	0.5405	0.7352
No log	2.3288	170	0.6248	0.8075	0.6248	0.7905
No log	2.3562	172	0.7162	0.7733	0.7162	0.8463
No log	2.3836	174	0.7041	0.7785	0.7041	0.8391
No log	2.4110	176	0.7230	0.7733	0.7230	0.8503
No log	2.4384	178	0.7211	0.7613	0.7211	0.8492
No log	2.4658	180	0.7449	0.7484	0.7449	0.8631
No log	2.4932	182	0.6857	0.8075	0.6857	0.8281
No log	2.5205	184	0.5876	0.8098	0.5876	0.7665
No log	2.5479	186	0.5422	0.8050	0.5422	0.7364
No log	2.5753	188	0.5135	0.8171	0.5135	0.7166
No log	2.6027	190	0.5349	0.8171	0.5349	0.7313
No log	2.6301	192	0.7738	0.7636	0.7738	0.8797
No log	2.6575	194	0.8199	0.7239	0.8199	0.9055
No log	2.6849	196	0.5951	0.8075	0.5951	0.7714
No log	2.7123	198	0.6109	0.7815	0.6109	0.7816
No log	2.7397	200	0.5993	0.8	0.5993	0.7741
No log	2.7671	202	0.6037	0.8148	0.6037	0.7770
No log	2.7945	204	0.6038	0.825	0.6038	0.7770
No log	2.8219	206	0.6223	0.7895	0.6223	0.7889
No log	2.8493	208	0.7066	0.7383	0.7066	0.8406
No log	2.8767	210	0.7213	0.7483	0.7213	0.8493
No log	2.9041	212	0.6289	0.7785	0.6289	0.7931
No log	2.9315	214	0.6083	0.8258	0.6083	0.7799
No log	2.9589	216	0.7126	0.7607	0.7126	0.8442
No log	2.9863	218	0.6582	0.8072	0.6582	0.8113
No log	3.0137	220	0.5217	0.825	0.5217	0.7223
No log	3.0411	222	0.6605	0.7432	0.6605	0.8127
No log	3.0685	224	0.8032	0.6849	0.8032	0.8962
No log	3.0959	226	0.6903	0.7413	0.6903	0.8308
No log	3.1233	228	0.5233	0.8280	0.5233	0.7234
No log	3.1507	230	0.6553	0.8075	0.6553	0.8095
No log	3.1781	232	0.7168	0.7952	0.7168	0.8466
No log	3.2055	234	0.6312	0.8	0.6312	0.7945
No log	3.2329	236	0.6132	0.8105	0.6132	0.7831
No log	3.2603	238	0.6012	0.7974	0.6012	0.7754
No log	3.2877	240	0.5718	0.8	0.5718	0.7562
No log	3.3151	242	0.5427	0.8075	0.5427	0.7367
No log	3.3425	244	0.5613	0.8176	0.5613	0.7492
No log	3.3699	246	0.5795	0.8077	0.5795	0.7612
No log	3.3973	248	0.6018	0.7843	0.6018	0.7758
No log	3.4247	250	0.6137	0.7682	0.6137	0.7834
No log	3.4521	252	0.6329	0.7974	0.6329	0.7955
No log	3.4795	254	0.6627	0.8026	0.6627	0.8141
No log	3.5068	256	0.6493	0.7947	0.6493	0.8058
No log	3.5342	258	0.6339	0.8182	0.6339	0.7962
No log	3.5616	260	0.6422	0.7895	0.6422	0.8014
No log	3.5890	262	0.6237	0.8026	0.6237	0.7898
No log	3.6164	264	0.6231	0.7895	0.6231	0.7894
No log	3.6438	266	0.6553	0.76	0.6553	0.8095
No log	3.6712	268	0.6692	0.7483	0.6692	0.8181
No log	3.6986	270	0.6702	0.7947	0.6702	0.8187
No log	3.7260	272	0.7469	0.6883	0.7469	0.8642
No log	3.7534	274	0.6753	0.7875	0.6753	0.8218
No log	3.7808	276	0.5386	0.8077	0.5386	0.7339
No log	3.8082	278	0.6525	0.7848	0.6525	0.8078
No log	3.8356	280	0.8201	0.6267	0.8201	0.9056
No log	3.8630	282	0.7912	0.6939	0.7912	0.8895
No log	3.8904	284	0.6844	0.7871	0.6844	0.8273
No log	3.9178	286	0.6789	0.8	0.6789	0.8240
No log	3.9452	288	0.6768	0.8	0.6768	0.8227
No log	3.9726	290	0.7593	0.7211	0.7593	0.8714
No log	4.0	292	1.0558	0.5541	1.0558	1.0275
No log	4.0274	294	1.2961	0.5405	1.2961	1.1385
No log	4.0548	296	1.2540	0.5442	1.2540	1.1198
No log	4.0822	298	1.0963	0.5616	1.0963	1.0470
No log	4.1096	300	0.8816	0.6712	0.8816	0.9390
No log	4.1370	302	0.7760	0.7383	0.7760	0.8809
No log	4.1644	304	0.7783	0.7172	0.7783	0.8822
No log	4.1918	306	0.8100	0.7123	0.8100	0.9000
No log	4.2192	308	0.8773	0.6571	0.8773	0.9366
No log	4.2466	310	0.8769	0.6571	0.8769	0.9364
No log	4.2740	312	0.8306	0.7092	0.8306	0.9114
No log	4.3014	314	0.8273	0.6667	0.8273	0.9096
No log	4.3288	316	0.7851	0.7324	0.7851	0.8860
No log	4.3562	318	0.7485	0.7092	0.7485	0.8651
No log	4.3836	320	0.7008	0.75	0.7008	0.8371
No log	4.4110	322	0.5845	0.76	0.5845	0.7645
No log	4.4384	324	0.5249	0.8	0.5249	0.7245
No log	4.4658	326	0.5168	0.8	0.5168	0.7189
No log	4.4932	328	0.5405	0.7755	0.5405	0.7352
No log	4.5205	330	0.5627	0.7586	0.5627	0.7502
No log	4.5479	332	0.6468	0.7552	0.6468	0.8042
No log	4.5753	334	0.6926	0.7143	0.6926	0.8322
No log	4.6027	336	0.6122	0.7606	0.6122	0.7824
No log	4.6301	338	0.5782	0.7919	0.5782	0.7604
No log	4.6575	340	0.7068	0.7848	0.7068	0.8407
No log	4.6849	342	0.7233	0.7564	0.7233	0.8504
No log	4.7123	344	0.6049	0.7898	0.6049	0.7777
No log	4.7397	346	0.5422	0.7867	0.5422	0.7364
No log	4.7671	348	0.6424	0.75	0.6424	0.8015
No log	4.7945	350	0.7166	0.7448	0.7166	0.8465
No log	4.8219	352	0.7098	0.7413	0.7098	0.8425
No log	4.8493	354	0.6833	0.7445	0.6833	0.8266
No log	4.8767	356	0.7077	0.7571	0.7077	0.8413
No log	4.9041	358	0.6447	0.7552	0.6447	0.8029
No log	4.9315	360	0.5981	0.7671	0.5981	0.7734
No log	4.9589	362	0.5545	0.7838	0.5545	0.7446
No log	4.9863	364	0.5253	0.8	0.5253	0.7247
No log	5.0137	366	0.5314	0.7879	0.5314	0.7290
No log	5.0411	368	0.6354	0.7826	0.6354	0.7971
No log	5.0685	370	0.6247	0.7613	0.6247	0.7904
No log	5.0959	372	0.5664	0.7692	0.5664	0.7526
No log	5.1233	374	0.5871	0.8052	0.5871	0.7662
No log	5.1507	376	0.6560	0.7895	0.6560	0.8100
No log	5.1781	378	0.6784	0.7582	0.6784	0.8236
No log	5.2055	380	0.6308	0.7821	0.6308	0.7942
No log	5.2329	382	0.6265	0.8052	0.6265	0.7915
No log	5.2603	384	0.6216	0.7742	0.6216	0.7884
No log	5.2877	386	0.6057	0.7843	0.6057	0.7783
No log	5.3151	388	0.6044	0.7792	0.6044	0.7774
No log	5.3425	390	0.5927	0.8077	0.5927	0.7699
No log	5.3699	392	0.5994	0.8025	0.5994	0.7742
No log	5.3973	394	0.5892	0.8026	0.5892	0.7676
No log	5.4247	396	0.6084	0.7843	0.6084	0.7800
No log	5.4521	398	0.6762	0.7568	0.6762	0.8223
No log	5.4795	400	0.6952	0.7619	0.6952	0.8338
No log	5.5068	402	0.6973	0.7619	0.6973	0.8351
No log	5.5342	404	0.6834	0.7682	0.6834	0.8267
No log	5.5616	406	0.6947	0.7867	0.6947	0.8335
No log	5.5890	408	0.7080	0.7867	0.7080	0.8414
No log	5.6164	410	0.6883	0.7682	0.6883	0.8296
No log	5.6438	412	0.7004	0.7742	0.7004	0.8369
No log	5.6712	414	0.7972	0.7215	0.7972	0.8929
No log	5.6986	416	0.7759	0.7595	0.7759	0.8809
No log	5.7260	418	0.6785	0.7922	0.6785	0.8237
No log	5.7534	420	0.6459	0.7843	0.6459	0.8037
No log	5.7808	422	0.6896	0.7901	0.6896	0.8304
No log	5.8082	424	0.7433	0.75	0.7433	0.8621
No log	5.8356	426	0.7004	0.7898	0.7004	0.8369
No log	5.8630	428	0.6296	0.7682	0.6296	0.7935
No log	5.8904	430	0.6418	0.7843	0.6418	0.8011
No log	5.9178	432	0.6573	0.7730	0.6573	0.8107
No log	5.9452	434	0.5796	0.8050	0.5796	0.7613
No log	5.9726	436	0.5471	0.8049	0.5471	0.7397
No log	6.0	438	0.6904	0.7927	0.6904	0.8309
No log	6.0274	440	0.7915	0.7702	0.7915	0.8897
No log	6.0548	442	0.6714	0.775	0.6714	0.8194
No log	6.0822	444	0.5868	0.8129	0.5868	0.7660
No log	6.1096	446	0.6259	0.7843	0.6259	0.7911
No log	6.1370	448	0.6773	0.7643	0.6773	0.8230
No log	6.1644	450	0.6834	0.7643	0.6834	0.8267
No log	6.1918	452	0.6998	0.7564	0.6998	0.8366
No log	6.2192	454	0.7043	0.7712	0.7043	0.8392
No log	6.2466	456	0.7105	0.7712	0.7105	0.8429
No log	6.2740	458	0.7139	0.7383	0.7139	0.8449
No log	6.3014	460	0.7024	0.7226	0.7024	0.8381
No log	6.3288	462	0.6602	0.7389	0.6602	0.8125
No log	6.3562	464	0.6182	0.7875	0.6182	0.7862
No log	6.3836	466	0.6473	0.8293	0.6473	0.8046
No log	6.4110	468	0.7314	0.7975	0.7314	0.8552
No log	6.4384	470	0.7562	0.775	0.7562	0.8696
No log	6.4658	472	0.7018	0.8221	0.7018	0.8377
No log	6.4932	474	0.6550	0.8176	0.6550	0.8093
No log	6.5205	476	0.6651	0.7742	0.6651	0.8155
No log	6.5479	478	0.6550	0.7742	0.6550	0.8093
No log	6.5753	480	0.6191	0.8125	0.6191	0.7868
No log	6.6027	482	0.6399	0.8364	0.6399	0.7999
No log	6.6301	484	0.6885	0.7901	0.6885	0.8297
No log	6.6575	486	0.7149	0.7771	0.7149	0.8455
No log	6.6849	488	0.6728	0.8	0.6728	0.8202
No log	6.7123	490	0.6123	0.8077	0.6123	0.7825
No log	6.7397	492	0.5945	0.8075	0.5945	0.7710
No log	6.7671	494	0.6629	0.7407	0.6629	0.8142
No log	6.7945	496	0.6575	0.7735	0.6575	0.8109
No log	6.8219	498	0.6159	0.8098	0.6159	0.7848
0.3908	6.8493	500	0.6206	0.825	0.6206	0.7878
0.3908	6.8767	502	0.6367	0.825	0.6367	0.7979
0.3908	6.9041	504	0.6418	0.8079	0.6418	0.8012
0.3908	6.9315	506	0.7221	0.7361	0.7221	0.8498
0.3908	6.9589	508	0.8417	0.6950	0.8417	0.9175
0.3908	6.9863	510	0.8256	0.6950	0.8256	0.9086

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1