ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6423
• Qwk: 0.5346
• Mse: 0.6423
• Rmse: 0.8014

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	4.2315	0.0277	4.2315	2.0571
No log	0.0645	4	2.6246	0.0035	2.6246	1.6200
No log	0.0968	6	2.4643	-0.0500	2.4643	1.5698
No log	0.1290	8	1.5600	-0.0204	1.5600	1.2490
No log	0.1613	10	1.0837	0.2711	1.0837	1.0410
No log	0.1935	12	1.0558	0.3815	1.0558	1.0275
No log	0.2258	14	1.0254	0.2569	1.0254	1.0126
No log	0.2581	16	1.0374	0.2492	1.0374	1.0185
No log	0.2903	18	1.1249	0.0682	1.1249	1.0606
No log	0.3226	20	1.0942	0.0671	1.0942	1.0461
No log	0.3548	22	1.0763	0.2217	1.0763	1.0374
No log	0.3871	24	1.1067	0.1858	1.1067	1.0520
No log	0.4194	26	1.0984	0.2004	1.0984	1.0480
No log	0.4516	28	1.0421	0.2841	1.0421	1.0208
No log	0.4839	30	1.0336	0.2921	1.0336	1.0167
No log	0.5161	32	1.0448	0.1826	1.0448	1.0221
No log	0.5484	34	1.0323	0.2618	1.0323	1.0160
No log	0.5806	36	1.0478	0.2687	1.0478	1.0236
No log	0.6129	38	1.0575	0.2318	1.0575	1.0284
No log	0.6452	40	1.0453	0.2391	1.0453	1.0224
No log	0.6774	42	1.0585	0.2318	1.0585	1.0288
No log	0.7097	44	1.0434	0.2391	1.0434	1.0215
No log	0.7419	46	1.0087	0.2515	1.0087	1.0043
No log	0.7742	48	0.9994	0.2200	0.9994	0.9997
No log	0.8065	50	1.0482	0.1998	1.0482	1.0238
No log	0.8387	52	1.1174	0.2105	1.1174	1.0570
No log	0.8710	54	1.0646	0.1598	1.0646	1.0318
No log	0.9032	56	0.9597	0.3280	0.9597	0.9796
No log	0.9355	58	0.9789	0.2318	0.9789	0.9894
No log	0.9677	60	0.9223	0.3631	0.9223	0.9604
No log	1.0	62	0.9037	0.2988	0.9037	0.9506
No log	1.0323	64	0.9463	0.2569	0.9463	0.9728
No log	1.0645	66	0.9483	0.2667	0.9483	0.9738
No log	1.0968	68	0.8912	0.4248	0.8912	0.9440
No log	1.1290	70	0.8615	0.3896	0.8615	0.9282
No log	1.1613	72	0.8656	0.3757	0.8656	0.9304
No log	1.1935	74	1.0936	0.1918	1.0936	1.0458
No log	1.2258	76	1.5023	0.1565	1.5023	1.2257
No log	1.2581	78	1.6030	0.1279	1.6030	1.2661
No log	1.2903	80	1.2643	0.2315	1.2643	1.1244
No log	1.3226	82	0.9769	0.2961	0.9769	0.9884
No log	1.3548	84	0.9923	0.2678	0.9923	0.9961
No log	1.3871	86	1.1087	0.1770	1.1087	1.0530
No log	1.4194	88	1.2710	0.1886	1.2710	1.1274
No log	1.4516	90	1.1225	0.2821	1.1225	1.0595
No log	1.4839	92	0.8917	0.3819	0.8917	0.9443
No log	1.5161	94	0.8891	0.3375	0.8891	0.9429
No log	1.5484	96	1.0083	0.2684	1.0083	1.0041
No log	1.5806	98	0.9504	0.2731	0.9504	0.9749
No log	1.6129	100	0.8427	0.3478	0.8427	0.9180
No log	1.6452	102	0.9511	0.3342	0.9511	0.9752
No log	1.6774	104	1.1785	0.2528	1.1785	1.0856
No log	1.7097	106	1.2052	0.2773	1.2052	1.0978
No log	1.7419	108	1.0757	0.2917	1.0757	1.0372
No log	1.7742	110	0.9159	0.2474	0.9159	0.9570
No log	1.8065	112	0.8692	0.3112	0.8692	0.9323
No log	1.8387	114	0.8709	0.3236	0.8709	0.9332
No log	1.8710	116	0.9323	0.3201	0.9323	0.9656
No log	1.9032	118	1.0417	0.3478	1.0417	1.0206
No log	1.9355	120	1.1313	0.3409	1.1313	1.0636
No log	1.9677	122	1.1650	0.3383	1.1650	1.0793
No log	2.0	124	1.1322	0.2816	1.1322	1.0641
No log	2.0323	126	1.1151	0.1047	1.1151	1.0560
No log	2.0645	128	1.1361	0.1379	1.1361	1.0659
No log	2.0968	130	1.1022	0.2284	1.1022	1.0498
No log	2.1290	132	1.0456	0.2512	1.0456	1.0226
No log	2.1613	134	0.9201	0.2149	0.9201	0.9592
No log	2.1935	136	0.8406	0.3221	0.8406	0.9169
No log	2.2258	138	0.8272	0.3982	0.8272	0.9095
No log	2.2581	140	0.8359	0.4090	0.8359	0.9142
No log	2.2903	142	0.8736	0.3175	0.8736	0.9347
No log	2.3226	144	0.8934	0.4186	0.8934	0.9452
No log	2.3548	146	0.9084	0.3667	0.9084	0.9531
No log	2.3871	148	0.9407	0.4186	0.9407	0.9699
No log	2.4194	150	1.1173	0.2953	1.1173	1.0570
No log	2.4516	152	1.1340	0.2550	1.1340	1.0649
No log	2.4839	154	0.9890	0.3140	0.9890	0.9945
No log	2.5161	156	0.9422	0.2671	0.9422	0.9707
No log	2.5484	158	0.9859	0.2820	0.9859	0.9929
No log	2.5806	160	1.0807	0.3039	1.0807	1.0396
No log	2.6129	162	1.0677	0.3039	1.0677	1.0333
No log	2.6452	164	0.9345	0.3185	0.9345	0.9667
No log	2.6774	166	0.8845	0.2873	0.8845	0.9405
No log	2.7097	168	0.8922	0.3001	0.8922	0.9446
No log	2.7419	170	0.9148	0.3295	0.9148	0.9565
No log	2.7742	172	0.8660	0.3001	0.8660	0.9306
No log	2.8065	174	0.8117	0.3774	0.8117	0.9009
No log	2.8387	176	0.8290	0.5098	0.8290	0.9105
No log	2.8710	178	0.8454	0.4619	0.8454	0.9194
No log	2.9032	180	0.7931	0.4965	0.7931	0.8906
No log	2.9355	182	0.7778	0.4328	0.7778	0.8820
No log	2.9677	184	0.7716	0.4173	0.7716	0.8784
No log	3.0	186	0.7991	0.4292	0.7991	0.8939
No log	3.0323	188	0.7560	0.4697	0.7560	0.8695
No log	3.0645	190	0.6673	0.5123	0.6673	0.8169
No log	3.0968	192	0.6455	0.6173	0.6455	0.8035
No log	3.1290	194	0.6479	0.5746	0.6479	0.8049
No log	3.1613	196	0.6656	0.5865	0.6656	0.8158
No log	3.1935	198	0.6785	0.5687	0.6785	0.8237
No log	3.2258	200	0.7404	0.4357	0.7404	0.8605
No log	3.2581	202	0.8176	0.4162	0.8176	0.9042
No log	3.2903	204	0.7608	0.4903	0.7608	0.8722
No log	3.3226	206	0.6667	0.6172	0.6667	0.8165
No log	3.3548	208	0.5987	0.6143	0.5987	0.7738
No log	3.3871	210	0.9284	0.3913	0.9284	0.9635
No log	3.4194	212	1.1282	0.3995	1.1282	1.0622
No log	3.4516	214	0.9559	0.3995	0.9559	0.9777
No log	3.4839	216	0.7474	0.5054	0.7474	0.8645
No log	3.5161	218	0.6985	0.5710	0.6985	0.8357
No log	3.5484	220	0.7445	0.4444	0.7445	0.8628
No log	3.5806	222	0.8332	0.3790	0.8332	0.9128
No log	3.6129	224	0.8602	0.4016	0.8602	0.9275
No log	3.6452	226	0.7656	0.3617	0.7656	0.8750
No log	3.6774	228	0.7391	0.4327	0.7391	0.8597
No log	3.7097	230	0.8135	0.4051	0.8135	0.9020
No log	3.7419	232	0.8304	0.3703	0.8304	0.9113
No log	3.7742	234	0.7592	0.4198	0.7592	0.8713
No log	3.8065	236	0.7618	0.4675	0.7618	0.8728
No log	3.8387	238	0.7694	0.4129	0.7694	0.8772
No log	3.8710	240	0.7501	0.4192	0.7501	0.8661
No log	3.9032	242	0.8599	0.3659	0.8599	0.9273
No log	3.9355	244	0.9305	0.3952	0.9305	0.9646
No log	3.9677	246	0.8606	0.4033	0.8606	0.9277
No log	4.0	248	0.8173	0.4681	0.8173	0.9040
No log	4.0323	250	0.8525	0.4889	0.8525	0.9233
No log	4.0645	252	0.8559	0.4769	0.8559	0.9252
No log	4.0968	254	0.9131	0.4318	0.9131	0.9556
No log	4.1290	256	0.8875	0.4987	0.8875	0.9421
No log	4.1613	258	0.7616	0.5343	0.7616	0.8727
No log	4.1935	260	0.6839	0.6857	0.6839	0.8270
No log	4.2258	262	0.6965	0.6287	0.6965	0.8346
No log	4.2581	264	0.7449	0.6417	0.7449	0.8631
No log	4.2903	266	0.6657	0.6167	0.6657	0.8159
No log	4.3226	268	0.6181	0.6733	0.6181	0.7862
No log	4.3548	270	0.6716	0.5005	0.6716	0.8195
No log	4.3871	272	0.6796	0.5131	0.6796	0.8244
No log	4.4194	274	0.6047	0.5748	0.6047	0.7776
No log	4.4516	276	0.5898	0.5726	0.5898	0.7680
No log	4.4839	278	0.5955	0.5726	0.5955	0.7717
No log	4.5161	280	0.6390	0.6099	0.6390	0.7994
No log	4.5484	282	0.6019	0.6207	0.6019	0.7758
No log	4.5806	284	0.6100	0.6833	0.6100	0.7810
No log	4.6129	286	0.6525	0.5771	0.6525	0.8078
No log	4.6452	288	0.7405	0.5035	0.7405	0.8605
No log	4.6774	290	0.7378	0.5152	0.7378	0.8589
No log	4.7097	292	0.6640	0.5962	0.6640	0.8148
No log	4.7419	294	0.6576	0.5846	0.6576	0.8109
No log	4.7742	296	0.6011	0.6528	0.6011	0.7753
No log	4.8065	298	0.6298	0.5774	0.6298	0.7936
No log	4.8387	300	0.6333	0.5949	0.6333	0.7958
No log	4.8710	302	0.6386	0.5931	0.6386	0.7992
No log	4.9032	304	0.6511	0.5455	0.6511	0.8069
No log	4.9355	306	0.6431	0.5931	0.6431	0.8019
No log	4.9677	308	0.6335	0.5810	0.6335	0.7959
No log	5.0	310	0.6416	0.5359	0.6416	0.8010
No log	5.0323	312	0.7017	0.5754	0.7017	0.8377
No log	5.0645	314	0.7092	0.5754	0.7092	0.8421
No log	5.0968	316	0.6137	0.5575	0.6137	0.7834
No log	5.1290	318	0.5996	0.6569	0.5996	0.7744
No log	5.1613	320	0.6178	0.6286	0.6178	0.7860
No log	5.1935	322	0.6371	0.5902	0.6371	0.7982
No log	5.2258	324	0.6486	0.5902	0.6486	0.8054
No log	5.2581	326	0.6775	0.5319	0.6775	0.8231
No log	5.2903	328	0.7779	0.5143	0.7779	0.8820
No log	5.3226	330	0.7927	0.4666	0.7927	0.8904
No log	5.3548	332	0.7368	0.4048	0.7368	0.8584
No log	5.3871	334	0.7194	0.4966	0.7194	0.8482
No log	5.4194	336	0.7265	0.4621	0.7265	0.8523
No log	5.4516	338	0.6932	0.4888	0.6932	0.8326
No log	5.4839	340	0.6416	0.5692	0.6416	0.8010
No log	5.5161	342	0.6467	0.6518	0.6467	0.8042
No log	5.5484	344	0.6882	0.5894	0.6882	0.8296
No log	5.5806	346	0.6695	0.6241	0.6695	0.8182
No log	5.6129	348	0.6373	0.6117	0.6373	0.7983
No log	5.6452	350	0.6271	0.6032	0.6271	0.7919
No log	5.6774	352	0.6086	0.6117	0.6086	0.7801
No log	5.7097	354	0.6134	0.6548	0.6134	0.7832
No log	5.7419	356	0.6028	0.6510	0.6028	0.7764
No log	5.7742	358	0.5897	0.6117	0.5897	0.7679
No log	5.8065	360	0.5986	0.5771	0.5986	0.7737
No log	5.8387	362	0.6181	0.5771	0.6181	0.7862
No log	5.8710	364	0.6164	0.6198	0.6164	0.7851
No log	5.9032	366	0.5848	0.6528	0.5848	0.7647
No log	5.9355	368	0.5560	0.6958	0.5560	0.7457
No log	5.9677	370	0.5392	0.6911	0.5392	0.7343
No log	6.0	372	0.5523	0.6980	0.5523	0.7431
No log	6.0323	374	0.5629	0.6664	0.5629	0.7503
No log	6.0645	376	0.5513	0.7034	0.5513	0.7425
No log	6.0968	378	0.5656	0.6625	0.5656	0.7520
No log	6.1290	380	0.6046	0.6217	0.6046	0.7776
No log	6.1613	382	0.6053	0.6217	0.6053	0.7780
No log	6.1935	384	0.5888	0.6919	0.5888	0.7673
No log	6.2258	386	0.6380	0.6670	0.6380	0.7988
No log	6.2581	388	0.6537	0.6630	0.6537	0.8085
No log	6.2903	390	0.5998	0.6511	0.5998	0.7745
No log	6.3226	392	0.5433	0.6958	0.5433	0.7371
No log	6.3548	394	0.5776	0.5988	0.5776	0.7600
No log	6.3871	396	0.5694	0.6327	0.5694	0.7546
No log	6.4194	398	0.5544	0.6958	0.5544	0.7446
No log	6.4516	400	0.6106	0.6315	0.6106	0.7814
No log	6.4839	402	0.6561	0.6413	0.6561	0.8100
No log	6.5161	404	0.6256	0.6538	0.6256	0.7909
No log	6.5484	406	0.6141	0.6502	0.6141	0.7836
No log	6.5806	408	0.5793	0.7133	0.5793	0.7611
No log	6.6129	410	0.5290	0.6924	0.5290	0.7273
No log	6.6452	412	0.5335	0.6958	0.5335	0.7304
No log	6.6774	414	0.5372	0.6958	0.5372	0.7329
No log	6.7097	416	0.5463	0.6850	0.5463	0.7391
No log	6.7419	418	0.5680	0.6517	0.5680	0.7537
No log	6.7742	420	0.6134	0.5491	0.6134	0.7832
No log	6.8065	422	0.5987	0.5343	0.5987	0.7738
No log	6.8387	424	0.5934	0.5226	0.5934	0.7703
No log	6.8710	426	0.5699	0.6150	0.5699	0.7549
No log	6.9032	428	0.5805	0.6833	0.5805	0.7619
No log	6.9355	430	0.6374	0.6043	0.6374	0.7984
No log	6.9677	432	0.6925	0.5676	0.6925	0.8322
No log	7.0	434	0.7041	0.5180	0.7041	0.8391
No log	7.0323	436	0.7214	0.5073	0.7214	0.8494
No log	7.0645	438	0.6626	0.5317	0.6626	0.8140
No log	7.0968	440	0.5973	0.6397	0.5973	0.7729
No log	7.1290	442	0.5699	0.6779	0.5699	0.7549
No log	7.1613	444	0.5442	0.6724	0.5442	0.7377
No log	7.1935	446	0.5325	0.6958	0.5325	0.7297
No log	7.2258	448	0.5228	0.6681	0.5228	0.7231
No log	7.2581	450	0.5921	0.6815	0.5921	0.7695
No log	7.2903	452	0.6621	0.6386	0.6621	0.8137
No log	7.3226	454	0.6212	0.6493	0.6212	0.7882
No log	7.3548	456	0.5456	0.6706	0.5456	0.7387
No log	7.3871	458	0.5411	0.6879	0.5411	0.7356
No log	7.4194	460	0.5536	0.6409	0.5536	0.7440
No log	7.4516	462	0.5901	0.6974	0.5901	0.7682
No log	7.4839	464	0.6634	0.5751	0.6634	0.8145
No log	7.5161	466	0.6780	0.6170	0.6780	0.8234
No log	7.5484	468	0.6311	0.6420	0.6311	0.7944
No log	7.5806	470	0.5876	0.6325	0.5876	0.7666
No log	7.6129	472	0.5782	0.6841	0.5782	0.7604
No log	7.6452	474	0.6303	0.6529	0.6303	0.7939
No log	7.6774	476	0.6582	0.6310	0.6582	0.8113
No log	7.7097	478	0.6093	0.6539	0.6093	0.7806
No log	7.7419	480	0.5771	0.6750	0.5771	0.7596
No log	7.7742	482	0.5753	0.6682	0.5753	0.7585
No log	7.8065	484	0.5703	0.6871	0.5703	0.7552
No log	7.8387	486	0.5960	0.7164	0.5960	0.7720
No log	7.8710	488	0.6051	0.6706	0.6051	0.7779
No log	7.9032	490	0.5780	0.6706	0.5780	0.7603
No log	7.9355	492	0.5800	0.6516	0.5800	0.7616
No log	7.9677	494	0.6046	0.5610	0.6046	0.7776
No log	8.0	496	0.5943	0.5950	0.5943	0.7709
No log	8.0323	498	0.5834	0.6013	0.5834	0.7638
0.3465	8.0645	500	0.6064	0.6548	0.6064	0.7787
0.3465	8.0968	502	0.6589	0.6082	0.6589	0.8118
0.3465	8.1290	504	0.6571	0.6082	0.6571	0.8106
0.3465	8.1613	506	0.6237	0.6518	0.6237	0.7898
0.3465	8.1935	508	0.6112	0.5316	0.6112	0.7818
0.3465	8.2258	510	0.6423	0.5346	0.6423	0.8014

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1