ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k4_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5640
• Qwk: 0.5432
• Mse: 0.5640
• Rmse: 0.7510

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	4.0542	0.0078	4.0542	2.0135
No log	0.1818	4	2.0206	0.0440	2.0206	1.4215
No log	0.2727	6	1.5408	0.0749	1.5408	1.2413
No log	0.3636	8	0.9954	0.2166	0.9954	0.9977
No log	0.4545	10	1.0336	0.2135	1.0336	1.0167
No log	0.5455	12	1.0682	0.1671	1.0682	1.0335
No log	0.6364	14	1.0556	0.0762	1.0556	1.0274
No log	0.7273	16	1.0259	0.1643	1.0259	1.0129
No log	0.8182	18	0.9539	0.2569	0.9539	0.9767
No log	0.9091	20	0.9330	0.2569	0.9330	0.9659
No log	1.0	22	0.9123	0.3153	0.9123	0.9551
No log	1.0909	24	0.8703	0.3243	0.8703	0.9329
No log	1.1818	26	0.9307	0.3770	0.9307	0.9647
No log	1.2727	28	0.8615	0.3184	0.8615	0.9281
No log	1.3636	30	0.8657	0.3184	0.8657	0.9305
No log	1.4545	32	0.8671	0.375	0.8671	0.9312
No log	1.5455	34	0.8604	0.3770	0.8604	0.9276
No log	1.6364	36	0.8395	0.3625	0.8395	0.9162
No log	1.7273	38	0.8610	0.4186	0.8610	0.9279
No log	1.8182	40	0.7947	0.4640	0.7947	0.8915
No log	1.9091	42	0.8034	0.4977	0.8034	0.8963
No log	2.0	44	0.8093	0.5567	0.8093	0.8996
No log	2.0909	46	0.8135	0.5201	0.8135	0.9020
No log	2.1818	48	0.9277	0.4503	0.9277	0.9632
No log	2.2727	50	0.8327	0.5828	0.8327	0.9125
No log	2.3636	52	0.8427	0.5447	0.8427	0.9180
No log	2.4545	54	0.8305	0.5545	0.8305	0.9113
No log	2.5455	56	0.9061	0.5030	0.9061	0.9519
No log	2.6364	58	0.9468	0.4681	0.9468	0.9730
No log	2.7273	60	0.8296	0.4734	0.8296	0.9108
No log	2.8182	62	0.7748	0.5770	0.7748	0.8802
No log	2.9091	64	1.1402	0.3832	1.1402	1.0678
No log	3.0	66	1.0122	0.4563	1.0122	1.0061
No log	3.0909	68	0.7187	0.5603	0.7187	0.8478
No log	3.1818	70	0.6953	0.5720	0.6953	0.8338
No log	3.2727	72	0.6889	0.5840	0.6889	0.8300
No log	3.3636	74	0.7659	0.5678	0.7659	0.8752
No log	3.4545	76	0.9696	0.5251	0.9696	0.9847
No log	3.5455	78	0.8731	0.5739	0.8731	0.9344
No log	3.6364	80	0.6493	0.5643	0.6493	0.8058
No log	3.7273	82	0.7888	0.5589	0.7888	0.8882
No log	3.8182	84	0.7647	0.5618	0.7647	0.8745
No log	3.9091	86	0.6353	0.6084	0.6353	0.7971
No log	4.0	88	0.6365	0.6259	0.6365	0.7978
No log	4.0909	90	0.6899	0.5566	0.6899	0.8306
No log	4.1818	92	0.7121	0.5566	0.7121	0.8439
No log	4.2727	94	0.6264	0.5879	0.6264	0.7915
No log	4.3636	96	0.6051	0.6154	0.6051	0.7779
No log	4.4545	98	0.6294	0.6070	0.6294	0.7934
No log	4.5455	100	0.6688	0.5665	0.6688	0.8178
No log	4.6364	102	0.6273	0.5830	0.6273	0.7920
No log	4.7273	104	0.6228	0.5985	0.6228	0.7892
No log	4.8182	106	0.6866	0.6595	0.6866	0.8286
No log	4.9091	108	0.7132	0.6763	0.7132	0.8445
No log	5.0	110	0.7425	0.6436	0.7425	0.8617
No log	5.0909	112	0.8576	0.6157	0.8576	0.9261
No log	5.1818	114	0.8464	0.5987	0.8464	0.9200
No log	5.2727	116	0.7242	0.6234	0.7242	0.8510
No log	5.3636	118	0.6827	0.5704	0.6827	0.8262
No log	5.4545	120	0.6630	0.5703	0.6630	0.8143
No log	5.5455	122	0.7535	0.5987	0.7535	0.8681
No log	5.6364	124	0.8999	0.5429	0.8999	0.9486
No log	5.7273	126	0.8332	0.5638	0.8332	0.9128
No log	5.8182	128	0.7711	0.6048	0.7711	0.8781
No log	5.9091	130	0.8154	0.5251	0.8154	0.9030
No log	6.0	132	0.7144	0.6225	0.7144	0.8452
No log	6.0909	134	0.6708	0.6110	0.6708	0.8190
No log	6.1818	136	0.8183	0.5484	0.8183	0.9046
No log	6.2727	138	0.7604	0.5655	0.7604	0.8720
No log	6.3636	140	0.6689	0.5724	0.6689	0.8179
No log	6.4545	142	0.6974	0.5771	0.6974	0.8351
No log	6.5455	144	0.6904	0.5428	0.6904	0.8309
No log	6.6364	146	0.6581	0.5274	0.6581	0.8113
No log	6.7273	148	0.6394	0.5856	0.6394	0.7996
No log	6.8182	150	0.7017	0.6411	0.7017	0.8377
No log	6.9091	152	0.9501	0.4982	0.9501	0.9748
No log	7.0	154	0.9431	0.5272	0.9431	0.9711
No log	7.0909	156	0.7464	0.5884	0.7464	0.8640
No log	7.1818	158	0.6130	0.6057	0.6130	0.7830
No log	7.2727	160	0.6480	0.5909	0.6480	0.8050
No log	7.3636	162	0.6156	0.5796	0.6156	0.7846
No log	7.4545	164	0.7281	0.6038	0.7281	0.8533
No log	7.5455	166	1.1709	0.4231	1.1709	1.0821
No log	7.6364	168	1.2234	0.3653	1.2234	1.1061
No log	7.7273	170	0.9619	0.5611	0.9619	0.9808
No log	7.8182	172	0.6430	0.6265	0.6430	0.8019
No log	7.9091	174	0.6315	0.6055	0.6315	0.7946
No log	8.0	176	0.6289	0.6084	0.6289	0.7930
No log	8.0909	178	0.6063	0.6526	0.6063	0.7786
No log	8.1818	180	0.7118	0.6038	0.7118	0.8437
No log	8.2727	182	0.9460	0.5517	0.9460	0.9726
No log	8.3636	184	0.9930	0.5517	0.9930	0.9965
No log	8.4545	186	0.8155	0.5635	0.8155	0.9031
No log	8.5455	188	0.6375	0.5982	0.6375	0.7984
No log	8.6364	190	0.6095	0.6195	0.6095	0.7807
No log	8.7273	192	0.6115	0.6195	0.6115	0.7820
No log	8.8182	194	0.6456	0.6010	0.6456	0.8035
No log	8.9091	196	0.6540	0.6010	0.6540	0.8087
No log	9.0	198	0.6405	0.6119	0.6405	0.8003
No log	9.0909	200	0.6826	0.6140	0.6826	0.8262
No log	9.1818	202	0.6559	0.5905	0.6559	0.8098
No log	9.2727	204	0.5964	0.5399	0.5964	0.7723
No log	9.3636	206	0.5999	0.5485	0.5999	0.7745
No log	9.4545	208	0.6139	0.4873	0.6139	0.7835
No log	9.5455	210	0.6158	0.5570	0.6158	0.7847
No log	9.6364	212	0.6168	0.5570	0.6168	0.7854
No log	9.7273	214	0.6118	0.5785	0.6118	0.7822
No log	9.8182	216	0.6087	0.5703	0.6087	0.7802
No log	9.9091	218	0.6084	0.5923	0.6084	0.7800
No log	10.0	220	0.6737	0.6411	0.6737	0.8208
No log	10.0909	222	0.8230	0.5791	0.8230	0.9072
No log	10.1818	224	0.8065	0.5422	0.8065	0.8980
No log	10.2727	226	0.7665	0.5791	0.7665	0.8755
No log	10.3636	228	0.6387	0.6298	0.6387	0.7992
No log	10.4545	230	0.6301	0.6205	0.6301	0.7938
No log	10.5455	232	0.6183	0.5879	0.6183	0.7863
No log	10.6364	234	0.6105	0.6089	0.6105	0.7814
No log	10.7273	236	0.6076	0.6461	0.6076	0.7795
No log	10.8182	238	0.6343	0.6176	0.6343	0.7964
No log	10.9091	240	0.6301	0.6242	0.6301	0.7938
No log	11.0	242	0.6110	0.6518	0.6110	0.7817
No log	11.0909	244	0.6008	0.6206	0.6008	0.7751
No log	11.1818	246	0.6060	0.5961	0.6060	0.7784
No log	11.2727	248	0.6150	0.5961	0.6150	0.7842
No log	11.3636	250	0.6149	0.5386	0.6149	0.7841
No log	11.4545	252	0.6181	0.5748	0.6181	0.7862
No log	11.5455	254	0.6860	0.6386	0.6860	0.8283
No log	11.6364	256	0.7534	0.5978	0.7534	0.8680
No log	11.7273	258	0.6710	0.6253	0.6710	0.8192
No log	11.8182	260	0.6092	0.5736	0.6092	0.7805
No log	11.9091	262	0.6093	0.5618	0.6093	0.7806
No log	12.0	264	0.6288	0.5630	0.6288	0.7930
No log	12.0909	266	0.7358	0.6061	0.7358	0.8578
No log	12.1818	268	0.8072	0.5961	0.8072	0.8984
No log	12.2727	270	0.8758	0.5781	0.8758	0.9358
No log	12.3636	272	0.7615	0.6116	0.7615	0.8726
No log	12.4545	274	0.6245	0.6488	0.6245	0.7902
No log	12.5455	276	0.6005	0.6089	0.6005	0.7749
No log	12.6364	278	0.5923	0.5630	0.5923	0.7696
No log	12.7273	280	0.6024	0.5630	0.6024	0.7762
No log	12.8182	282	0.6483	0.6438	0.6483	0.8052
No log	12.9091	284	0.6654	0.6050	0.6654	0.8157
No log	13.0	286	0.6691	0.6438	0.6691	0.8180
No log	13.0909	288	0.6198	0.6322	0.6198	0.7873
No log	13.1818	290	0.5997	0.6246	0.5997	0.7744
No log	13.2727	292	0.6258	0.6402	0.6258	0.7911
No log	13.3636	294	0.6983	0.6021	0.6983	0.8357
No log	13.4545	296	0.7106	0.5940	0.7106	0.8430
No log	13.5455	298	0.6371	0.5672	0.6371	0.7982
No log	13.6364	300	0.6308	0.5168	0.6308	0.7942
No log	13.7273	302	0.6422	0.5138	0.6422	0.8014
No log	13.8182	304	0.6421	0.5018	0.6421	0.8013
No log	13.9091	306	0.6533	0.5459	0.6533	0.8083
No log	14.0	308	0.7054	0.5731	0.7054	0.8399
No log	14.0909	310	0.7316	0.5610	0.7316	0.8553
No log	14.1818	312	0.6997	0.5924	0.6997	0.8365
No log	14.2727	314	0.6337	0.6010	0.6337	0.7960
No log	14.3636	316	0.5833	0.6057	0.5833	0.7637
No log	14.4545	318	0.5767	0.6057	0.5767	0.7594
No log	14.5455	320	0.5677	0.5748	0.5677	0.7534
No log	14.6364	322	0.6079	0.6438	0.6079	0.7796
No log	14.7273	324	0.6504	0.6032	0.6504	0.8064
No log	14.8182	326	0.6533	0.6032	0.6533	0.8083
No log	14.9091	328	0.6151	0.6021	0.6151	0.7843
No log	15.0	330	0.5797	0.5606	0.5797	0.7614
No log	15.0909	332	0.6098	0.5698	0.6098	0.7809
No log	15.1818	334	0.6058	0.5597	0.6058	0.7783
No log	15.2727	336	0.5899	0.6123	0.5899	0.7681
No log	15.3636	338	0.5750	0.6095	0.5750	0.7583
No log	15.4545	340	0.5743	0.6206	0.5743	0.7578
No log	15.5455	342	0.5829	0.6426	0.5829	0.7635
No log	15.6364	344	0.5785	0.6461	0.5785	0.7606
No log	15.7273	346	0.5667	0.6461	0.5667	0.7528
No log	15.8182	348	0.5968	0.6516	0.5968	0.7725
No log	15.9091	350	0.5706	0.6620	0.5706	0.7554
No log	16.0	352	0.5672	0.6620	0.5672	0.7531
No log	16.0909	354	0.5397	0.6536	0.5397	0.7346
No log	16.1818	356	0.5297	0.6813	0.5297	0.7278
No log	16.2727	358	0.5383	0.6620	0.5383	0.7337
No log	16.3636	360	0.6892	0.5816	0.6892	0.8302
No log	16.4545	362	0.7794	0.5672	0.7794	0.8828
No log	16.5455	364	0.6634	0.6236	0.6634	0.8145
No log	16.6364	366	0.5324	0.6383	0.5324	0.7296
No log	16.7273	368	0.5715	0.6704	0.5715	0.7560
No log	16.8182	370	0.6001	0.6849	0.6001	0.7746
No log	16.9091	372	0.5661	0.6658	0.5661	0.7524
No log	17.0	374	0.5803	0.6089	0.5803	0.7618
No log	17.0909	376	0.6439	0.6214	0.6439	0.8024
No log	17.1818	378	0.6213	0.5977	0.6213	0.7882
No log	17.2727	380	0.5889	0.6667	0.5889	0.7674
No log	17.3636	382	0.5953	0.6339	0.5953	0.7716
No log	17.4545	384	0.5893	0.6667	0.5893	0.7677
No log	17.5455	386	0.6060	0.6516	0.6060	0.7785
No log	17.6364	388	0.6156	0.6275	0.6156	0.7846
No log	17.7273	390	0.6353	0.6101	0.6353	0.7970
No log	17.8182	392	0.6083	0.5966	0.6083	0.7799
No log	17.9091	394	0.6049	0.6164	0.6049	0.7777
No log	18.0	396	0.5987	0.6729	0.5987	0.7738
No log	18.0909	398	0.5652	0.6564	0.5652	0.7518
No log	18.1818	400	0.5561	0.6461	0.5561	0.7457
No log	18.2727	402	0.5559	0.6572	0.5559	0.7456
No log	18.3636	404	0.5480	0.6572	0.5480	0.7403
No log	18.4545	406	0.5736	0.6215	0.5736	0.7573
No log	18.5455	408	0.6198	0.6332	0.6198	0.7873
No log	18.6364	410	0.6968	0.5920	0.6968	0.8347
No log	18.7273	412	0.7326	0.6437	0.7326	0.8559
No log	18.8182	414	0.7032	0.6380	0.7032	0.8386
No log	18.9091	416	0.6426	0.6506	0.6426	0.8016
No log	19.0	418	0.5687	0.6099	0.5687	0.7541
No log	19.0909	420	0.5520	0.6259	0.5520	0.7429
No log	19.1818	422	0.5782	0.6681	0.5782	0.7604
No log	19.2727	424	0.5807	0.6681	0.5807	0.7620
No log	19.3636	426	0.5649	0.5868	0.5649	0.7516
No log	19.4545	428	0.6051	0.5940	0.6051	0.7779
No log	19.5455	430	0.6209	0.6150	0.6209	0.7880
No log	19.6364	432	0.5977	0.6140	0.5977	0.7731
No log	19.7273	434	0.5597	0.5971	0.5597	0.7481
No log	19.8182	436	0.5453	0.6409	0.5453	0.7385
No log	19.9091	438	0.5545	0.6078	0.5545	0.7446
No log	20.0	440	0.5807	0.5902	0.5807	0.7620
No log	20.0909	442	0.5862	0.5902	0.5862	0.7656
No log	20.1818	444	0.5719	0.6006	0.5719	0.7563
No log	20.2727	446	0.5740	0.6006	0.5740	0.7576
No log	20.3636	448	0.5738	0.6017	0.5738	0.7575
No log	20.4545	450	0.5808	0.6010	0.5808	0.7621
No log	20.5455	452	0.5874	0.5902	0.5874	0.7664
No log	20.6364	454	0.5837	0.6298	0.5837	0.7640
No log	20.7273	456	0.5905	0.6109	0.5905	0.7684
No log	20.8182	458	0.5776	0.6099	0.5776	0.7600
No log	20.9091	460	0.5774	0.6097	0.5774	0.7598
No log	21.0	462	0.5786	0.6196	0.5786	0.7606
No log	21.0909	464	0.5763	0.6292	0.5763	0.7591
No log	21.1818	466	0.5975	0.6099	0.5975	0.7730
No log	21.2727	468	0.6453	0.6226	0.6453	0.8033
No log	21.3636	470	0.6833	0.5845	0.6833	0.8266
No log	21.4545	472	0.6629	0.5739	0.6629	0.8142
No log	21.5455	474	0.6260	0.6163	0.6260	0.7912
No log	21.6364	476	0.6002	0.6308	0.6002	0.7748
No log	21.7273	478	0.5681	0.5982	0.5681	0.7537
No log	21.8182	480	0.5606	0.5971	0.5606	0.7487
No log	21.9091	482	0.5677	0.5890	0.5677	0.7534
No log	22.0	484	0.6059	0.5940	0.6059	0.7784
No log	22.0909	486	0.6971	0.5720	0.6971	0.8349
No log	22.1818	488	0.6713	0.5829	0.6713	0.8193
No log	22.2727	490	0.5803	0.6215	0.5803	0.7618
No log	22.3636	492	0.5375	0.6846	0.5375	0.7331
No log	22.4545	494	0.5350	0.6838	0.5350	0.7315
No log	22.5455	496	0.5371	0.6854	0.5371	0.7328
No log	22.6364	498	0.5459	0.6470	0.5459	0.7389
0.2454	22.7273	500	0.5689	0.6215	0.5689	0.7543
0.2454	22.8182	502	0.6091	0.6717	0.6091	0.7804
0.2454	22.9091	504	0.6270	0.5940	0.6270	0.7918
0.2454	23.0	506	0.6153	0.5940	0.6153	0.7844
0.2454	23.0909	508	0.5847	0.5818	0.5847	0.7647
0.2454	23.1818	510	0.5783	0.5575	0.5783	0.7605
0.2454	23.2727	512	0.5640	0.5432	0.5640	0.7510

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1