ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6387
• Qwk: 0.7821
• Mse: 0.6387
• Rmse: 0.7992

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	7.2136	0.0056	7.2136	2.6858
No log	0.1053	4	5.4351	0.0211	5.4351	2.3313
No log	0.1579	6	3.4567	0.0702	3.4567	1.8592
No log	0.2105	8	2.6311	0.0645	2.6311	1.6221
No log	0.2632	10	2.1942	0.0709	2.1942	1.4813
No log	0.3158	12	2.1956	0.0325	2.1956	1.4817
No log	0.3684	14	2.2612	-0.0000	2.2612	1.5037
No log	0.4211	16	2.5964	-0.0704	2.5964	1.6113
No log	0.4737	18	2.3515	-0.0305	2.3515	1.5335
No log	0.5263	20	2.0485	0.0901	2.0485	1.4313
No log	0.5789	22	1.8975	0.1481	1.8975	1.3775
No log	0.6316	24	1.9993	0.2203	1.9993	1.4140
No log	0.6842	26	2.0562	0.1120	2.0562	1.4340
No log	0.7368	28	2.0282	0.2080	2.0282	1.4241
No log	0.7895	30	1.6481	0.2456	1.6481	1.2838
No log	0.8421	32	1.4671	0.2243	1.4671	1.2112
No log	0.8947	34	1.4642	0.2909	1.4642	1.2100
No log	0.9474	36	1.5713	0.2881	1.5713	1.2535
No log	1.0	38	2.1419	0.2466	2.1419	1.4635
No log	1.0526	40	2.5627	0.2156	2.5627	1.6008
No log	1.1053	42	2.3394	0.2331	2.3394	1.5295
No log	1.1579	44	2.1984	0.2222	2.1984	1.4827
No log	1.2105	46	1.7184	0.3796	1.7184	1.3109
No log	1.2632	48	1.2918	0.4715	1.2918	1.1366
No log	1.3158	50	1.2356	0.2857	1.2356	1.1116
No log	1.3684	52	1.2240	0.3243	1.2240	1.1064
No log	1.4211	54	1.1388	0.3894	1.1388	1.0671
No log	1.4737	56	1.0371	0.5167	1.0371	1.0184
No log	1.5263	58	0.9327	0.5781	0.9327	0.9657
No log	1.5789	60	0.9298	0.5778	0.9298	0.9643
No log	1.6316	62	1.0311	0.6187	1.0311	1.0154
No log	1.6842	64	1.2423	0.6081	1.2423	1.1146
No log	1.7368	66	1.2254	0.5789	1.2254	1.1070
No log	1.7895	68	1.0896	0.5772	1.0896	1.0438
No log	1.8421	70	0.7879	0.6569	0.7879	0.8877
No log	1.8947	72	0.7692	0.6901	0.7692	0.8770
No log	1.9474	74	0.8397	0.7172	0.8397	0.9163
No log	2.0	76	0.9459	0.6014	0.9459	0.9726
No log	2.0526	78	0.8108	0.6849	0.8108	0.9004
No log	2.1053	80	0.8601	0.6364	0.8601	0.9274
No log	2.1579	82	0.8784	0.6260	0.8784	0.9372
No log	2.2105	84	0.8001	0.7050	0.8001	0.8945
No log	2.2632	86	0.8023	0.6569	0.8023	0.8957
No log	2.3158	88	0.8008	0.6423	0.8008	0.8949
No log	2.3684	90	0.8662	0.5954	0.8662	0.9307
No log	2.4211	92	0.8622	0.5802	0.8622	0.9286
No log	2.4737	94	0.8735	0.5846	0.8735	0.9346
No log	2.5263	96	0.9532	0.5781	0.9532	0.9763
No log	2.5789	98	1.2063	0.5606	1.2063	1.0983
No log	2.6316	100	1.6856	0.4575	1.6856	1.2983
No log	2.6842	102	1.4930	0.4768	1.4930	1.2219
No log	2.7368	104	0.8578	0.6412	0.8578	0.9262
No log	2.7895	106	0.7634	0.6567	0.7634	0.8737
No log	2.8421	108	0.7383	0.7050	0.7383	0.8592
No log	2.8947	110	0.7149	0.7260	0.7149	0.8455
No log	2.9474	112	0.6810	0.76	0.6810	0.8252
No log	3.0	114	0.5901	0.7821	0.5901	0.7682
No log	3.0526	116	0.6930	0.7297	0.6930	0.8325
No log	3.1053	118	0.6385	0.7517	0.6385	0.7991
No log	3.1579	120	0.5670	0.8	0.5670	0.7530
No log	3.2105	122	0.6594	0.7785	0.6594	0.8120
No log	3.2632	124	0.6355	0.7867	0.6355	0.7972
No log	3.3158	126	0.5654	0.8	0.5654	0.7520
No log	3.3684	128	0.5582	0.75	0.5582	0.7471
No log	3.4211	130	0.5719	0.7799	0.5719	0.7562
No log	3.4737	132	0.5590	0.7975	0.5590	0.7477
No log	3.5263	134	0.6012	0.8075	0.6012	0.7754
No log	3.5789	136	0.6121	0.775	0.6121	0.7824
No log	3.6316	138	0.6841	0.7550	0.6841	0.8271
No log	3.6842	140	0.6777	0.7613	0.6777	0.8232
No log	3.7368	142	0.6430	0.7654	0.6430	0.8019
No log	3.7895	144	0.6988	0.8	0.6988	0.8360
No log	3.8421	146	0.6526	0.7950	0.6526	0.8078
No log	3.8947	148	0.6620	0.8101	0.6620	0.8136
No log	3.9474	150	0.6124	0.7950	0.6124	0.7825
No log	4.0	152	0.6958	0.8025	0.6958	0.8341
No log	4.0526	154	0.6821	0.7792	0.6821	0.8259
No log	4.1053	156	0.7156	0.7417	0.7156	0.8459
No log	4.1579	158	0.7018	0.7632	0.7018	0.8378
No log	4.2105	160	0.7350	0.7975	0.7350	0.8573
No log	4.2632	162	0.6964	0.7826	0.6964	0.8345
No log	4.3158	164	0.7012	0.7692	0.7012	0.8374
No log	4.3684	166	0.7143	0.7799	0.7143	0.8451
No log	4.4211	168	0.6941	0.7853	0.6941	0.8331
No log	4.4737	170	0.8247	0.6752	0.8247	0.9081
No log	4.5263	172	0.9492	0.6275	0.9492	0.9743
No log	4.5789	174	0.8614	0.6710	0.8614	0.9281
No log	4.6316	176	0.8249	0.75	0.8249	0.9082
No log	4.6842	178	0.7827	0.7662	0.7827	0.8847
No log	4.7368	180	0.7953	0.75	0.7953	0.8918
No log	4.7895	182	0.7461	0.7662	0.7461	0.8638
No log	4.8421	184	0.7136	0.7733	0.7136	0.8448
No log	4.8947	186	0.7234	0.7843	0.7234	0.8506
No log	4.9474	188	0.6868	0.7682	0.6868	0.8287
No log	5.0	190	0.6634	0.7974	0.6634	0.8145
No log	5.0526	192	0.6347	0.7815	0.6347	0.7967
No log	5.1053	194	0.6246	0.7815	0.6246	0.7903
No log	5.1579	196	0.6288	0.8105	0.6288	0.7930
No log	5.2105	198	0.5958	0.7975	0.5958	0.7719
No log	5.2632	200	0.6258	0.7785	0.6258	0.7911
No log	5.3158	202	0.7483	0.7162	0.7483	0.8651
No log	5.3684	204	0.7390	0.6993	0.7390	0.8597
No log	5.4211	206	0.6869	0.7397	0.6869	0.8288
No log	5.4737	208	0.6972	0.7517	0.6972	0.8350
No log	5.5263	210	0.6270	0.7871	0.6270	0.7919
No log	5.5789	212	0.6624	0.7722	0.6624	0.8139
No log	5.6316	214	0.6542	0.7771	0.6542	0.8088
No log	5.6842	216	0.6183	0.7922	0.6183	0.7863
No log	5.7368	218	0.6497	0.8	0.6497	0.8060
No log	5.7895	220	0.6723	0.7862	0.6723	0.8199
No log	5.8421	222	0.6588	0.7917	0.6588	0.8117
No log	5.8947	224	0.6285	0.7919	0.6285	0.7928
No log	5.9474	226	0.5690	0.8075	0.5690	0.7543
No log	6.0	228	0.4750	0.8372	0.4750	0.6892
No log	6.0526	230	0.5046	0.8415	0.5046	0.7104
No log	6.1053	232	0.5642	0.8168	0.5642	0.7511
No log	6.1579	234	0.7278	0.7602	0.7278	0.8531
No log	6.2105	236	0.7965	0.6892	0.7965	0.8925
No log	6.2632	238	0.7713	0.7114	0.7713	0.8782
No log	6.3158	240	0.6511	0.8077	0.6511	0.8069
No log	6.3684	242	0.7039	0.7821	0.7039	0.8390
No log	6.4211	244	0.7328	0.7436	0.7328	0.8560
No log	6.4737	246	0.6992	0.7792	0.6992	0.8362
No log	6.5263	248	0.7231	0.7945	0.7231	0.8504
No log	6.5789	250	0.7318	0.8027	0.7318	0.8555
No log	6.6316	252	0.6530	0.8188	0.6530	0.8081
No log	6.6842	254	0.5999	0.8	0.5999	0.7745
No log	6.7368	256	0.6210	0.8	0.6210	0.7880
No log	6.7895	258	0.6097	0.7975	0.6097	0.7808
No log	6.8421	260	0.6453	0.7619	0.6453	0.8033
No log	6.8947	262	0.7629	0.7297	0.7629	0.8734
No log	6.9474	264	0.8211	0.7183	0.8211	0.9062
No log	7.0	266	0.7462	0.7568	0.7462	0.8638
No log	7.0526	268	0.7201	0.7619	0.7201	0.8486
No log	7.1053	270	0.7063	0.7651	0.7063	0.8404
No log	7.1579	272	0.6910	0.7432	0.6910	0.8313
No log	7.2105	274	0.7131	0.7517	0.7131	0.8445
No log	7.2632	276	0.7224	0.7517	0.7224	0.8500
No log	7.3158	278	0.6639	0.7417	0.6639	0.8148
No log	7.3684	280	0.6206	0.7632	0.6206	0.7878
No log	7.4211	282	0.5951	0.7871	0.5951	0.7715
No log	7.4737	284	0.6141	0.775	0.6141	0.7836
No log	7.5263	286	0.6272	0.775	0.6272	0.7919
No log	7.5789	288	0.5934	0.8025	0.5934	0.7703
No log	7.6316	290	0.5931	0.8025	0.5931	0.7702
No log	7.6842	292	0.5552	0.8125	0.5552	0.7451
No log	7.7368	294	0.5360	0.8242	0.5360	0.7321
No log	7.7895	296	0.5470	0.8125	0.5470	0.7396
No log	7.8421	298	0.5715	0.8228	0.5715	0.7559
No log	7.8947	300	0.5855	0.8025	0.5855	0.7652
No log	7.9474	302	0.5635	0.8354	0.5635	0.7506
No log	8.0	304	0.6154	0.7682	0.6154	0.7845
No log	8.0526	306	0.6801	0.7582	0.6801	0.8247
No log	8.1053	308	0.6468	0.7785	0.6468	0.8042
No log	8.1579	310	0.6795	0.7586	0.6795	0.8243
No log	8.2105	312	0.7266	0.7222	0.7266	0.8524
No log	8.2632	314	0.6870	0.7671	0.6870	0.8288
No log	8.3158	316	0.5831	0.8079	0.5831	0.7636
No log	8.3684	318	0.5589	0.8	0.5589	0.7476
No log	8.4211	320	0.5266	0.8077	0.5266	0.7256
No log	8.4737	322	0.5416	0.8052	0.5416	0.7359
No log	8.5263	324	0.7339	0.7857	0.7339	0.8567
No log	8.5789	326	0.8148	0.7515	0.8148	0.9027
No log	8.6316	328	0.7051	0.7692	0.7051	0.8397
No log	8.6842	330	0.6342	0.7755	0.6342	0.7964
No log	8.7368	332	0.8375	0.6331	0.8375	0.9151
No log	8.7895	334	0.9257	0.6331	0.9257	0.9622
No log	8.8421	336	0.8823	0.6331	0.8823	0.9393
No log	8.8947	338	0.7366	0.7891	0.7366	0.8582
No log	8.9474	340	0.6635	0.7671	0.6635	0.8145
No log	9.0	342	0.6253	0.8052	0.6253	0.7908
No log	9.0526	344	0.6381	0.7692	0.6381	0.7988
No log	9.1053	346	0.6853	0.7342	0.6853	0.8278
No log	9.1579	348	0.6442	0.7421	0.6442	0.8026
No log	9.2105	350	0.5940	0.8125	0.5940	0.7707
No log	9.2632	352	0.6205	0.7595	0.6205	0.7877
No log	9.3158	354	0.6458	0.7843	0.6458	0.8036
No log	9.3684	356	0.6820	0.7947	0.6820	0.8258
No log	9.4211	358	0.7487	0.7534	0.7487	0.8653
No log	9.4737	360	0.8087	0.7050	0.8087	0.8993
No log	9.5263	362	0.8372	0.6861	0.8372	0.9150
No log	9.5789	364	0.8087	0.6957	0.8087	0.8993
No log	9.6316	366	0.7359	0.7429	0.7359	0.8579
No log	9.6842	368	0.6717	0.7671	0.6717	0.8196
No log	9.7368	370	0.6949	0.8	0.6949	0.8336
No log	9.7895	372	0.6913	0.7898	0.6913	0.8314
No log	9.8421	374	0.6727	0.7755	0.6727	0.8202
No log	9.8947	376	0.6546	0.7755	0.6546	0.8091
No log	9.9474	378	0.6554	0.7534	0.6554	0.8095
No log	10.0	380	0.6654	0.7639	0.6654	0.8157
No log	10.0526	382	0.6618	0.7703	0.6618	0.8135
No log	10.1053	384	0.6602	0.7755	0.6602	0.8125
No log	10.1579	386	0.6877	0.7619	0.6877	0.8293
No log	10.2105	388	0.6789	0.7682	0.6789	0.8240
No log	10.2632	390	0.6317	0.7692	0.6317	0.7948
No log	10.3158	392	0.5495	0.7826	0.5495	0.7413
No log	10.3684	394	0.5489	0.8221	0.5489	0.7409
No log	10.4211	396	0.6095	0.8075	0.6095	0.7807
No log	10.4737	398	0.5993	0.8075	0.5993	0.7741
No log	10.5263	400	0.6105	0.8101	0.6105	0.7813
No log	10.5789	402	0.6038	0.7895	0.6038	0.7771
No log	10.6316	404	0.6677	0.7763	0.6677	0.8171
No log	10.6842	406	0.7115	0.7417	0.7115	0.8435
No log	10.7368	408	0.7110	0.7375	0.7110	0.8432
No log	10.7895	410	0.6698	0.7927	0.6698	0.8184
No log	10.8421	412	0.6121	0.7673	0.6121	0.7824
No log	10.8947	414	0.6180	0.7821	0.6180	0.7861
No log	10.9474	416	0.6130	0.7848	0.6130	0.7829
No log	11.0	418	0.6352	0.775	0.6352	0.7970
No log	11.0526	420	0.6395	0.7613	0.6395	0.7997
No log	11.1053	422	0.6554	0.7568	0.6554	0.8096
No log	11.1579	424	0.6923	0.7534	0.6923	0.8320
No log	11.2105	426	0.7368	0.7397	0.7368	0.8584
No log	11.2632	428	0.7571	0.7397	0.7571	0.8701
No log	11.3158	430	0.7229	0.7297	0.7229	0.8502
No log	11.3684	432	0.6679	0.7417	0.6679	0.8173
No log	11.4211	434	0.6068	0.7925	0.6068	0.7790
No log	11.4737	436	0.5814	0.7975	0.5814	0.7625
No log	11.5263	438	0.5762	0.8221	0.5762	0.7591
No log	11.5789	440	0.5569	0.7975	0.5569	0.7463
No log	11.6316	442	0.6086	0.8101	0.6086	0.7801
No log	11.6842	444	0.7236	0.7532	0.7236	0.8507
No log	11.7368	446	0.7116	0.7467	0.7116	0.8435
No log	11.7895	448	0.6430	0.7867	0.6430	0.8019
No log	11.8421	450	0.6044	0.7467	0.6044	0.7774
No log	11.8947	452	0.6441	0.7662	0.6441	0.8025
No log	11.9474	454	0.6726	0.7625	0.6726	0.8201
No log	12.0	456	0.7196	0.7355	0.7196	0.8483
No log	12.0526	458	0.6965	0.7451	0.6965	0.8345
No log	12.1053	460	0.6933	0.7484	0.6933	0.8326
No log	12.1579	462	0.7427	0.7574	0.7427	0.8618
No log	12.2105	464	0.8494	0.7356	0.8494	0.9217
No log	12.2632	466	0.9057	0.7135	0.9057	0.9517
No log	12.3158	468	0.8866	0.7051	0.8866	0.9416
No log	12.3684	470	0.8362	0.6573	0.8362	0.9144
No log	12.4211	472	0.7740	0.6522	0.7740	0.8798
No log	12.4737	474	0.7556	0.6763	0.7556	0.8693
No log	12.5263	476	0.7176	0.7133	0.7176	0.8471
No log	12.5789	478	0.6874	0.7639	0.6874	0.8291
No log	12.6316	480	0.6299	0.7671	0.6299	0.7936
No log	12.6842	482	0.5909	0.7947	0.5909	0.7687
No log	12.7368	484	0.6006	0.7651	0.6006	0.7750
No log	12.7895	486	0.7029	0.6928	0.7029	0.8384
No log	12.8421	488	0.7914	0.6667	0.7914	0.8896
No log	12.8947	490	0.7241	0.6928	0.7241	0.8509
No log	12.9474	492	0.6189	0.7564	0.6189	0.7867
No log	13.0	494	0.5988	0.7613	0.5988	0.7738
No log	13.0526	496	0.5826	0.7564	0.5826	0.7633
No log	13.1053	498	0.5754	0.7673	0.5754	0.7586
0.4144	13.1579	500	0.5298	0.8025	0.5298	0.7278
0.4144	13.2105	502	0.5304	0.7925	0.5304	0.7283
0.4144	13.2632	504	0.5411	0.8221	0.5411	0.7356
0.4144	13.3158	506	0.5562	0.8193	0.5562	0.7458
0.4144	13.3684	508	0.5567	0.8242	0.5567	0.7461
0.4144	13.4211	510	0.5824	0.7763	0.5824	0.7631
0.4144	13.4737	512	0.6162	0.7919	0.6162	0.7850
0.4144	13.5263	514	0.6215	0.7867	0.6215	0.7883
0.4144	13.5789	516	0.6048	0.7763	0.6048	0.7777
0.4144	13.6316	518	0.6387	0.7821	0.6387	0.7992

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1