ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8441
• Qwk: 0.7229
• Mse: 0.8441
• Rmse: 0.9188

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0263	2	6.8956	0.0179	6.8956	2.6259
No log	0.0526	4	4.5415	0.0898	4.5415	2.1311
No log	0.0789	6	3.4915	-0.0423	3.4915	1.8686
No log	0.1053	8	2.4524	0.1806	2.4524	1.5660
No log	0.1316	10	1.8672	0.2203	1.8672	1.3665
No log	0.1579	12	1.7101	0.25	1.7101	1.3077
No log	0.1842	14	2.4643	0.1795	2.4643	1.5698
No log	0.2105	16	2.5652	0.1013	2.5652	1.6016
No log	0.2368	18	1.8397	0.1774	1.8397	1.3563
No log	0.2632	20	1.4427	0.3248	1.4427	1.2011
No log	0.2895	22	1.5171	0.3415	1.5171	1.2317
No log	0.3158	24	1.4401	0.3333	1.4401	1.2001
No log	0.3421	26	1.3166	0.3740	1.3166	1.1474
No log	0.3684	28	1.3746	0.3390	1.3746	1.1724
No log	0.3947	30	1.3199	0.4	1.3199	1.1489
No log	0.4211	32	1.2754	0.4496	1.2754	1.1293
No log	0.4474	34	1.2297	0.4769	1.2297	1.1089
No log	0.4737	36	1.5083	0.3946	1.5083	1.2281
No log	0.5	38	1.9961	0.3396	1.9961	1.4129
No log	0.5263	40	2.2479	0.2909	2.2479	1.4993
No log	0.5526	42	1.9869	0.3333	1.9869	1.4096
No log	0.5789	44	1.4874	0.4658	1.4874	1.2196
No log	0.6053	46	1.1153	0.6027	1.1153	1.0561
No log	0.6316	48	1.0723	0.625	1.0723	1.0355
No log	0.6579	50	1.1969	0.6040	1.1969	1.0940
No log	0.6842	52	1.5986	0.5087	1.5986	1.2644
No log	0.7105	54	1.7607	0.4813	1.7607	1.3269
No log	0.7368	56	1.8454	0.5208	1.8454	1.3585
No log	0.7632	58	1.7875	0.5	1.7875	1.3370
No log	0.7895	60	1.8386	0.5026	1.8386	1.3559
No log	0.8158	62	1.3839	0.5444	1.3839	1.1764
No log	0.8421	64	1.2887	0.5359	1.2887	1.1352
No log	0.8684	66	1.3854	0.5067	1.3854	1.1770
No log	0.8947	68	1.3471	0.5443	1.3471	1.1607
No log	0.9211	70	1.1992	0.625	1.1992	1.0951
No log	0.9474	72	1.3239	0.5679	1.3239	1.1506
No log	0.9737	74	1.1301	0.5974	1.1301	1.0631
No log	1.0	76	0.9511	0.6573	0.9511	0.9752
No log	1.0263	78	0.9655	0.6667	0.9655	0.9826
No log	1.0526	80	0.9649	0.6711	0.9649	0.9823
No log	1.0789	82	0.8579	0.7320	0.8579	0.9262
No log	1.1053	84	0.8375	0.7237	0.8375	0.9151
No log	1.1316	86	0.8747	0.6875	0.8747	0.9352
No log	1.1579	88	0.8853	0.6835	0.8853	0.9409
No log	1.1842	90	1.1324	0.6477	1.1324	1.0641
No log	1.2105	92	1.5097	0.5312	1.5097	1.2287
No log	1.2368	94	1.4594	0.5445	1.4594	1.2081
No log	1.2632	96	1.1601	0.6386	1.1601	1.0771
No log	1.2895	98	0.9098	0.7	0.9098	0.9538
No log	1.3158	100	0.9523	0.6710	0.9523	0.9759
No log	1.3421	102	1.0810	0.65	1.0810	1.0397
No log	1.3684	104	1.2763	0.6012	1.2763	1.1297
No log	1.3947	106	1.1758	0.6098	1.1758	1.0843
No log	1.4211	108	0.8846	0.7059	0.8846	0.9405
No log	1.4474	110	0.9183	0.7285	0.9183	0.9583
No log	1.4737	112	0.9523	0.72	0.9523	0.9759
No log	1.5	114	0.9408	0.6846	0.9408	0.9699
No log	1.5263	116	1.0583	0.6013	1.0583	1.0287
No log	1.5526	118	1.2356	0.5765	1.2356	1.1116
No log	1.5789	120	1.2338	0.5795	1.2338	1.1108
No log	1.6053	122	0.9627	0.6667	0.9627	0.9812
No log	1.6316	124	0.8526	0.6923	0.8526	0.9234
No log	1.6579	126	0.7679	0.6974	0.7679	0.8763
No log	1.6842	128	0.7600	0.6968	0.7600	0.8718
No log	1.7105	130	0.7754	0.7097	0.7754	0.8806
No log	1.7368	132	0.7499	0.7226	0.7499	0.8660
No log	1.7632	134	0.7497	0.7355	0.7497	0.8658
No log	1.7895	136	0.8489	0.7134	0.8489	0.9213
No log	1.8158	138	1.0781	0.6587	1.0781	1.0383
No log	1.8421	140	1.0641	0.6335	1.0641	1.0316
No log	1.8684	142	0.9989	0.6013	0.9989	0.9994
No log	1.8947	144	1.0363	0.5676	1.0363	1.0180
No log	1.9211	146	1.1704	0.5442	1.1704	1.0819
No log	1.9474	148	1.1476	0.5974	1.1476	1.0713
No log	1.9737	150	1.1415	0.6190	1.1415	1.0684
No log	2.0	152	1.0071	0.6977	1.0071	1.0035
No log	2.0263	154	0.7717	0.7545	0.7717	0.8785
No log	2.0526	156	0.7169	0.7665	0.7169	0.8467
No log	2.0789	158	0.7189	0.7647	0.7189	0.8479
No log	2.1053	160	0.8815	0.7363	0.8815	0.9389
No log	2.1316	162	1.3626	0.6700	1.3626	1.1673
No log	2.1579	164	1.4478	0.6269	1.4478	1.2033
No log	2.1842	166	1.0647	0.7053	1.0647	1.0318
No log	2.2105	168	0.8162	0.7399	0.8162	0.9034
No log	2.2368	170	0.7382	0.7485	0.7382	0.8592
No log	2.2632	172	0.6986	0.7654	0.6986	0.8358
No log	2.2895	174	0.6768	0.7826	0.6768	0.8227
No log	2.3158	176	0.6665	0.7683	0.6665	0.8164
No log	2.3421	178	0.6500	0.7975	0.6500	0.8063
No log	2.3684	180	0.6394	0.7949	0.6394	0.7996
No log	2.3947	182	0.6490	0.7898	0.6490	0.8056
No log	2.4211	184	0.7566	0.7075	0.7566	0.8698
No log	2.4474	186	0.7590	0.7222	0.7590	0.8712
No log	2.4737	188	0.7765	0.7413	0.7765	0.8812
No log	2.5	190	0.7958	0.7660	0.7958	0.8921
No log	2.5263	192	0.7529	0.7891	0.7529	0.8677
No log	2.5526	194	0.6603	0.7927	0.6603	0.8126
No log	2.5789	196	0.6773	0.8	0.6773	0.8230
No log	2.6053	198	0.6787	0.8249	0.6787	0.8238
No log	2.6316	200	0.7794	0.7283	0.7794	0.8828
No log	2.6579	202	0.9907	0.6503	0.9907	0.9954
No log	2.6842	204	0.8889	0.6905	0.8889	0.9428
No log	2.7105	206	0.9096	0.7166	0.9096	0.9537
No log	2.7368	208	1.5117	0.6162	1.5117	1.2295
No log	2.7632	210	1.8784	0.53	1.8784	1.3706
No log	2.7895	212	1.5762	0.5900	1.5762	1.2554
No log	2.8158	214	0.9734	0.7380	0.9734	0.9866
No log	2.8421	216	0.7724	0.7349	0.7724	0.8789
No log	2.8684	218	0.7513	0.7329	0.7513	0.8668
No log	2.8947	220	0.7196	0.7831	0.7196	0.8483
No log	2.9211	222	0.7048	0.8072	0.7048	0.8395
No log	2.9474	224	0.7389	0.7826	0.7389	0.8596
No log	2.9737	226	0.9594	0.6225	0.9594	0.9795
No log	3.0	228	1.1736	0.5517	1.1736	1.0833
No log	3.0263	230	1.0809	0.5793	1.0809	1.0397
No log	3.0526	232	0.8753	0.64	0.8753	0.9356
No log	3.0789	234	0.7465	0.7821	0.7465	0.8640
No log	3.1053	236	0.7430	0.8	0.7430	0.8620
No log	3.1316	238	0.8110	0.7643	0.8110	0.9005
No log	3.1579	240	0.8789	0.6536	0.8789	0.9375
No log	3.1842	242	0.9219	0.6443	0.9219	0.9601
No log	3.2105	244	0.8043	0.7051	0.8043	0.8969
No log	3.2368	246	0.7360	0.8	0.7360	0.8579
No log	3.2632	248	0.7046	0.8	0.7046	0.8394
No log	3.2895	250	0.7139	0.7901	0.7139	0.8449
No log	3.3158	252	0.7632	0.7403	0.7632	0.8736
No log	3.3421	254	0.7957	0.7417	0.7957	0.8920
No log	3.3684	256	0.7715	0.7483	0.7715	0.8783
No log	3.3947	258	0.7518	0.7417	0.7518	0.8671
No log	3.4211	260	0.7545	0.7595	0.7545	0.8686
No log	3.4474	262	0.8538	0.7586	0.8538	0.9240
No log	3.4737	264	0.8498	0.7586	0.8498	0.9218
No log	3.5	266	0.8470	0.7571	0.8470	0.9203
No log	3.5263	268	0.9539	0.6957	0.9539	0.9767
No log	3.5526	270	0.9850	0.6919	0.9850	0.9925
No log	3.5789	272	0.9313	0.7204	0.9313	0.9650
No log	3.6053	274	0.8096	0.7514	0.8096	0.8998
No log	3.6316	276	0.6869	0.7421	0.6869	0.8288
No log	3.6579	278	0.6676	0.7421	0.6676	0.8171
No log	3.6842	280	0.7130	0.7375	0.7130	0.8444
No log	3.7105	282	0.7539	0.7205	0.7539	0.8683
No log	3.7368	284	0.7928	0.7134	0.7928	0.8904
No log	3.7632	286	0.7708	0.7059	0.7708	0.8779
No log	3.7895	288	0.7791	0.7059	0.7791	0.8827
No log	3.8158	290	0.7592	0.6933	0.7592	0.8713
No log	3.8421	292	0.7092	0.72	0.7092	0.8422
No log	3.8684	294	0.6855	0.7375	0.6855	0.8279
No log	3.8947	296	0.7073	0.7273	0.7073	0.8410
No log	3.9211	298	0.7103	0.7349	0.7103	0.8428
No log	3.9474	300	0.6962	0.7665	0.6962	0.8344
No log	3.9737	302	0.7864	0.7186	0.7864	0.8868
No log	4.0	304	0.7947	0.7073	0.7947	0.8914
No log	4.0263	306	0.7387	0.7342	0.7387	0.8595
No log	4.0526	308	0.7055	0.7613	0.7055	0.8399
No log	4.0789	310	0.7340	0.7389	0.7340	0.8568
No log	4.1053	312	0.8408	0.6667	0.8408	0.9169
No log	4.1316	314	0.9305	0.625	0.9305	0.9646
No log	4.1579	316	0.8956	0.6460	0.8956	0.9463
No log	4.1842	318	0.7838	0.7239	0.7838	0.8853
No log	4.2105	320	0.6970	0.7389	0.6970	0.8349
No log	4.2368	322	0.6901	0.7484	0.6901	0.8307
No log	4.2632	324	0.7032	0.75	0.7032	0.8386
No log	4.2895	326	0.7457	0.7125	0.7457	0.8635
No log	4.3158	328	0.8089	0.7030	0.8089	0.8994
No log	4.3421	330	0.7824	0.7305	0.7824	0.8845
No log	4.3684	332	0.6808	0.7439	0.6808	0.8251
No log	4.3947	334	0.6332	0.7742	0.6332	0.7957
No log	4.4211	336	0.6242	0.7643	0.6242	0.7901
No log	4.4474	338	0.6475	0.7547	0.6475	0.8047
No log	4.4737	340	0.6657	0.7226	0.6657	0.8159
No log	4.5	342	0.6813	0.7532	0.6813	0.8254
No log	4.5263	344	0.7163	0.7226	0.7163	0.8463
No log	4.5526	346	0.7654	0.7089	0.7654	0.8748
No log	4.5789	348	0.7470	0.7355	0.7470	0.8643
No log	4.6053	350	0.7286	0.7451	0.7286	0.8536
No log	4.6316	352	0.7136	0.7712	0.7136	0.8448
No log	4.6579	354	0.6635	0.7662	0.6635	0.8145
No log	4.6842	356	0.6737	0.7484	0.6737	0.8208
No log	4.7105	358	0.6480	0.7662	0.6480	0.8050
No log	4.7368	360	0.6739	0.7355	0.6739	0.8209
No log	4.7632	362	0.7228	0.7333	0.7228	0.8502
No log	4.7895	364	0.6947	0.7273	0.6947	0.8335
No log	4.8158	366	0.7009	0.7484	0.7009	0.8372
No log	4.8421	368	0.7145	0.7190	0.7145	0.8453
No log	4.8684	370	0.7316	0.7561	0.7316	0.8553
No log	4.8947	372	0.7486	0.7607	0.7486	0.8652
No log	4.9211	374	0.7394	0.7607	0.7394	0.8599
No log	4.9474	376	0.7109	0.7665	0.7109	0.8431
No log	4.9737	378	0.6829	0.7607	0.6829	0.8264
No log	5.0	380	0.6773	0.75	0.6773	0.8230
No log	5.0263	382	0.7281	0.7407	0.7281	0.8533
No log	5.0526	384	0.8724	0.6951	0.8724	0.9340
No log	5.0789	386	0.8905	0.6905	0.8905	0.9437
No log	5.1053	388	0.7652	0.7602	0.7652	0.8747
No log	5.1316	390	0.6702	0.7574	0.6702	0.8186
No log	5.1579	392	0.6630	0.7665	0.6630	0.8142
No log	5.1842	394	0.7159	0.7719	0.7159	0.8461
No log	5.2105	396	0.7566	0.7674	0.7566	0.8698
No log	5.2368	398	0.8607	0.7186	0.8607	0.9278
No log	5.2632	400	0.8121	0.7037	0.8121	0.9012
No log	5.2895	402	0.7831	0.7125	0.7831	0.8849
No log	5.3158	404	0.7285	0.775	0.7285	0.8535
No log	5.3421	406	0.7738	0.7595	0.7738	0.8797
No log	5.3684	408	0.8065	0.7375	0.8065	0.8981
No log	5.3947	410	0.8058	0.7607	0.8058	0.8977
No log	5.4211	412	0.7622	0.7665	0.7622	0.8731
No log	5.4474	414	0.7534	0.7831	0.7534	0.8680
No log	5.4737	416	0.7310	0.7665	0.7310	0.8550
No log	5.5	418	0.7350	0.7831	0.7350	0.8573
No log	5.5263	420	0.7892	0.7317	0.7892	0.8884
No log	5.5526	422	0.8079	0.7362	0.8079	0.8988
No log	5.5789	424	0.7801	0.7561	0.7801	0.8832
No log	5.6053	426	0.7490	0.7515	0.7490	0.8655
No log	5.6316	428	0.7872	0.7362	0.7872	0.8873
No log	5.6579	430	0.8303	0.7362	0.8303	0.9112
No log	5.6842	432	0.8401	0.7439	0.8401	0.9165
No log	5.7105	434	0.8501	0.7284	0.8501	0.9220
No log	5.7368	436	0.8563	0.7205	0.8563	0.9254
No log	5.7632	438	0.8228	0.7362	0.8228	0.9071
No log	5.7895	440	0.7581	0.7362	0.7581	0.8707
No log	5.8158	442	0.7799	0.7237	0.7799	0.8831
No log	5.8421	444	0.8068	0.7105	0.8068	0.8982
No log	5.8684	446	0.7483	0.7355	0.7483	0.8651
No log	5.8947	448	0.7303	0.7758	0.7303	0.8546
No log	5.9211	450	0.7525	0.7758	0.7525	0.8675
No log	5.9474	452	0.7463	0.7758	0.7463	0.8639
No log	5.9737	454	0.7576	0.7453	0.7576	0.8704
No log	6.0	456	0.7638	0.7516	0.7638	0.8739
No log	6.0263	458	0.7760	0.7516	0.7760	0.8809
No log	6.0526	460	0.7744	0.7547	0.7744	0.8800
No log	6.0789	462	0.7557	0.7654	0.7557	0.8693
No log	6.1053	464	0.7188	0.7784	0.7188	0.8478
No log	6.1316	466	0.6977	0.7811	0.6977	0.8353
No log	6.1579	468	0.6776	0.7578	0.6776	0.8232
No log	6.1842	470	0.6797	0.75	0.6797	0.8244
No log	6.2105	472	0.6992	0.75	0.6992	0.8362
No log	6.2368	474	0.7670	0.7407	0.7670	0.8758
No log	6.2632	476	0.9308	0.6962	0.9308	0.9648
No log	6.2895	478	1.1809	0.5952	1.1809	1.0867
No log	6.3158	480	1.2668	0.5955	1.2668	1.1255
No log	6.3421	482	1.1704	0.6057	1.1704	1.0818
No log	6.3684	484	0.9865	0.6790	0.9865	0.9932
No log	6.3947	486	0.8496	0.7470	0.8496	0.9217
No log	6.4211	488	0.8138	0.7561	0.8138	0.9021
No log	6.4474	490	0.7649	0.7561	0.7649	0.8746
No log	6.4737	492	0.7262	0.7879	0.7262	0.8522
No log	6.5	494	0.7228	0.7349	0.7228	0.8502
No log	6.5263	496	0.7348	0.7349	0.7348	0.8572
No log	6.5526	498	0.7226	0.7545	0.7226	0.8501
0.3809	6.5789	500	0.7886	0.7636	0.7886	0.8880
0.3809	6.6053	502	0.9264	0.7170	0.9264	0.9625
0.3809	6.6316	504	0.9370	0.7037	0.9370	0.9680
0.3809	6.6579	506	0.9389	0.675	0.9389	0.9690
0.3809	6.6842	508	0.8416	0.7229	0.8416	0.9174
0.3809	6.7105	510	0.8441	0.7229	0.8441	0.9188

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1