ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5416
• Qwk: 0.6557
• Mse: 0.5416
• Rmse: 0.7359

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0260	2	4.1637	0.0125	4.1637	2.0405
No log	0.0519	4	2.2931	0.0943	2.2931	1.5143
No log	0.0779	6	1.6572	0.0639	1.6572	1.2873
No log	0.1039	8	1.1761	0.1471	1.1761	1.0845
No log	0.1299	10	1.0906	0.2291	1.0906	1.0443
No log	0.1558	12	1.2331	0.0670	1.2331	1.1104
No log	0.1818	14	1.5440	-0.0402	1.5440	1.2426
No log	0.2078	16	1.2177	0.1644	1.2177	1.1035
No log	0.2338	18	1.1341	0.1465	1.1341	1.0650
No log	0.2597	20	1.0868	0.1629	1.0868	1.0425
No log	0.2857	22	1.0385	0.2291	1.0385	1.0191
No log	0.3117	24	1.2292	0.1433	1.2292	1.1087
No log	0.3377	26	1.1974	0.2294	1.1974	1.0943
No log	0.3636	28	1.2084	0.2750	1.2084	1.0993
No log	0.3896	30	0.8918	0.4755	0.8918	0.9444
No log	0.4156	32	0.9120	0.4389	0.9120	0.9550
No log	0.4416	34	1.0755	0.2843	1.0755	1.0370
No log	0.4675	36	0.8523	0.4739	0.8523	0.9232
No log	0.4935	38	0.7961	0.4313	0.7961	0.8923
No log	0.5195	40	0.7842	0.3950	0.7842	0.8856
No log	0.5455	42	0.8053	0.4456	0.8053	0.8974
No log	0.5714	44	0.9135	0.3734	0.9135	0.9558
No log	0.5974	46	1.0655	0.1576	1.0655	1.0323
No log	0.6234	48	0.8986	0.3734	0.8986	0.9479
No log	0.6494	50	0.7321	0.5509	0.7321	0.8556
No log	0.6753	52	0.8618	0.3939	0.8618	0.9283
No log	0.7013	54	0.7439	0.5317	0.7439	0.8625
No log	0.7273	56	0.7832	0.4330	0.7832	0.8850
No log	0.7532	58	0.9274	0.3526	0.9274	0.9630
No log	0.7792	60	0.8096	0.3695	0.8096	0.8998
No log	0.8052	62	0.8019	0.4727	0.8019	0.8955
No log	0.8312	64	1.3618	0.3519	1.3618	1.1670
No log	0.8571	66	1.4334	0.2884	1.4334	1.1973
No log	0.8831	68	0.9860	0.4361	0.9860	0.9930
No log	0.9091	70	0.7336	0.5046	0.7336	0.8565
No log	0.9351	72	0.8242	0.3577	0.8242	0.9078
No log	0.9610	74	0.7693	0.4592	0.7693	0.8771
No log	0.9870	76	0.7209	0.5978	0.7209	0.8490
No log	1.0130	78	0.8235	0.4444	0.8235	0.9075
No log	1.0390	80	0.8958	0.4558	0.8958	0.9465
No log	1.0649	82	0.8709	0.3954	0.8709	0.9332
No log	1.0909	84	0.7641	0.5088	0.7641	0.8741
No log	1.1169	86	0.7208	0.5288	0.7208	0.8490
No log	1.1429	88	0.7127	0.5259	0.7127	0.8442
No log	1.1688	90	0.7706	0.4613	0.7706	0.8778
No log	1.1948	92	0.8103	0.5368	0.8103	0.9002
No log	1.2208	94	0.7678	0.5477	0.7678	0.8762
No log	1.2468	96	0.7764	0.5746	0.7764	0.8811
No log	1.2727	98	0.9399	0.5190	0.9399	0.9695
No log	1.2987	100	0.9730	0.5374	0.9730	0.9864
No log	1.3247	102	0.7337	0.5510	0.7337	0.8566
No log	1.3506	104	0.7062	0.5726	0.7062	0.8404
No log	1.3766	106	0.6796	0.6247	0.6796	0.8244
No log	1.4026	108	0.7126	0.5482	0.7126	0.8441
No log	1.4286	110	0.6556	0.5626	0.6556	0.8097
No log	1.4545	112	0.6651	0.6097	0.6651	0.8155
No log	1.4805	114	0.7616	0.5825	0.7616	0.8727
No log	1.5065	116	0.7772	0.5922	0.7772	0.8816
No log	1.5325	118	0.6605	0.5949	0.6605	0.8127
No log	1.5584	120	0.9077	0.5150	0.9077	0.9527
No log	1.5844	122	1.1878	0.4647	1.1878	1.0898
No log	1.6104	124	1.1292	0.4646	1.1292	1.0627
No log	1.6364	126	0.8334	0.4889	0.8334	0.9129
No log	1.6623	128	0.7018	0.5221	0.7018	0.8377
No log	1.6883	130	0.6888	0.5221	0.6888	0.8300
No log	1.7143	132	0.6916	0.5223	0.6916	0.8317
No log	1.7403	134	0.7614	0.5647	0.7614	0.8726
No log	1.7662	136	0.9773	0.4382	0.9773	0.9886
No log	1.7922	138	1.1301	0.4425	1.1301	1.0630
No log	1.8182	140	1.0724	0.3884	1.0724	1.0356
No log	1.8442	142	0.9280	0.4257	0.9280	0.9634
No log	1.8701	144	0.7360	0.4168	0.7360	0.8579
No log	1.8961	146	0.6808	0.4898	0.6808	0.8251
No log	1.9221	148	0.6933	0.5835	0.6933	0.8327
No log	1.9481	150	0.7998	0.5119	0.7998	0.8943
No log	1.9740	152	1.1913	0.4308	1.1913	1.0915
No log	2.0	154	1.4965	0.3766	1.4965	1.2233
No log	2.0260	156	1.4824	0.3707	1.4824	1.2175
No log	2.0519	158	1.1939	0.3686	1.1939	1.0926
No log	2.0779	160	0.8713	0.5213	0.8713	0.9335
No log	2.1039	162	0.7837	0.5301	0.7837	0.8852
No log	2.1299	164	0.7998	0.5925	0.7998	0.8943
No log	2.1558	166	0.7681	0.5738	0.7681	0.8764
No log	2.1818	168	0.7655	0.5363	0.7655	0.8749
No log	2.2078	170	0.8817	0.5676	0.8817	0.9390
No log	2.2338	172	1.0552	0.4866	1.0552	1.0273
No log	2.2597	174	1.0561	0.4435	1.0561	1.0277
No log	2.2857	176	1.0174	0.4444	1.0174	1.0086
No log	2.3117	178	0.8988	0.4987	0.8988	0.9481
No log	2.3377	180	0.8061	0.5219	0.8061	0.8978
No log	2.3636	182	0.7544	0.5728	0.7544	0.8685
No log	2.3896	184	0.7900	0.5655	0.7900	0.8888
No log	2.4156	186	0.9636	0.4384	0.9636	0.9816
No log	2.4416	188	1.2372	0.4320	1.2372	1.1123
No log	2.4675	190	1.2532	0.4147	1.2532	1.1195
No log	2.4935	192	1.0626	0.4007	1.0626	1.0308
No log	2.5195	194	0.8382	0.5014	0.8382	0.9155
No log	2.5455	196	0.7165	0.4952	0.7165	0.8465
No log	2.5714	198	0.6947	0.5565	0.6947	0.8335
No log	2.5974	200	0.6795	0.5688	0.6795	0.8243
No log	2.6234	202	0.6162	0.6407	0.6162	0.7850
No log	2.6494	204	0.6005	0.6658	0.6005	0.7749
No log	2.6753	206	0.5961	0.6667	0.5961	0.7721
No log	2.7013	208	0.6041	0.6368	0.6041	0.7773
No log	2.7273	210	0.6297	0.6368	0.6297	0.7935
No log	2.7532	212	0.7004	0.5813	0.7004	0.8369
No log	2.7792	214	0.7842	0.5342	0.7842	0.8855
No log	2.8052	216	0.7095	0.6012	0.7095	0.8423
No log	2.8312	218	0.6331	0.7021	0.6331	0.7957
No log	2.8571	220	0.6689	0.6911	0.6689	0.8178
No log	2.8831	222	0.6284	0.7061	0.6284	0.7927
No log	2.9091	224	0.7235	0.5739	0.7235	0.8506
No log	2.9351	226	0.8296	0.5666	0.8296	0.9108
No log	2.9610	228	0.7643	0.5664	0.7643	0.8743
No log	2.9870	230	0.6361	0.5335	0.6361	0.7976
No log	3.0130	232	0.5839	0.6451	0.5839	0.7641
No log	3.0390	234	0.7415	0.5756	0.7415	0.8611
No log	3.0649	236	0.8862	0.5307	0.8862	0.9414
No log	3.0909	238	0.8771	0.5307	0.8771	0.9366
No log	3.1169	240	0.7310	0.5318	0.7310	0.8550
No log	3.1429	242	0.6150	0.5833	0.6150	0.7842
No log	3.1688	244	0.7181	0.5212	0.7181	0.8474
No log	3.1948	246	0.7632	0.5357	0.7632	0.8736
No log	3.2208	248	0.6973	0.5327	0.6973	0.8350
No log	3.2468	250	0.6342	0.5650	0.6342	0.7964
No log	3.2727	252	0.6340	0.6196	0.6340	0.7963
No log	3.2987	254	0.6405	0.6341	0.6405	0.8003
No log	3.3247	256	0.6462	0.6442	0.6462	0.8039
No log	3.3506	258	0.6530	0.5939	0.6530	0.8081
No log	3.3766	260	0.6606	0.5943	0.6606	0.8127
No log	3.4026	262	0.6726	0.5669	0.6726	0.8201
No log	3.4286	264	0.6714	0.6249	0.6714	0.8194
No log	3.4545	266	0.6762	0.5646	0.6762	0.8223
No log	3.4805	268	0.6863	0.5752	0.6863	0.8284
No log	3.5065	270	0.6975	0.5700	0.6975	0.8352
No log	3.5325	272	0.6904	0.5712	0.6904	0.8309
No log	3.5584	274	0.6863	0.5656	0.6863	0.8285
No log	3.5844	276	0.6672	0.6456	0.6672	0.8168
No log	3.6104	278	0.6519	0.6321	0.6519	0.8074
No log	3.6364	280	0.6173	0.6711	0.6173	0.7857
No log	3.6623	282	0.6118	0.6618	0.6118	0.7822
No log	3.6883	284	0.6433	0.6029	0.6433	0.8020
No log	3.7143	286	0.6075	0.7117	0.6075	0.7794
No log	3.7403	288	0.6054	0.6288	0.6054	0.7781
No log	3.7662	290	0.6111	0.6094	0.6111	0.7817
No log	3.7922	292	0.6127	0.6652	0.6127	0.7827
No log	3.8182	294	0.6255	0.6652	0.6255	0.7909
No log	3.8442	296	0.6050	0.6787	0.6050	0.7778
No log	3.8701	298	0.6032	0.7056	0.6032	0.7767
No log	3.8961	300	0.6126	0.6721	0.6126	0.7827
No log	3.9221	302	0.6491	0.6175	0.6491	0.8057
No log	3.9481	304	0.6219	0.6780	0.6219	0.7886
No log	3.9740	306	0.6112	0.6840	0.6112	0.7818
No log	4.0	308	0.7059	0.5809	0.7059	0.8402
No log	4.0260	310	0.7759	0.5490	0.7759	0.8808
No log	4.0519	312	0.7547	0.5157	0.7547	0.8687
No log	4.0779	314	0.6701	0.4626	0.6701	0.8186
No log	4.1039	316	0.6448	0.5195	0.6448	0.8030
No log	4.1299	318	0.6487	0.4951	0.6487	0.8054
No log	4.1558	320	0.6364	0.5171	0.6364	0.7978
No log	4.1818	322	0.6577	0.6655	0.6577	0.8110
No log	4.2078	324	0.7127	0.5610	0.7127	0.8442
No log	4.2338	326	0.7133	0.5728	0.7133	0.8446
No log	4.2597	328	0.6873	0.5605	0.6873	0.8291
No log	4.2857	330	0.6750	0.6280	0.6750	0.8216
No log	4.3117	332	0.6663	0.6209	0.6663	0.8163
No log	4.3377	334	0.6620	0.6736	0.6620	0.8136
No log	4.3636	336	0.6775	0.6198	0.6775	0.8231
No log	4.3896	338	0.6660	0.5959	0.6660	0.8161
No log	4.4156	340	0.6502	0.6445	0.6502	0.8063
No log	4.4416	342	0.6616	0.6241	0.6616	0.8134
No log	4.4675	344	0.6646	0.6349	0.6646	0.8152
No log	4.4935	346	0.6534	0.5796	0.6534	0.8084
No log	4.5195	348	0.6597	0.6389	0.6597	0.8122
No log	4.5455	350	0.6859	0.5766	0.6859	0.8282
No log	4.5714	352	0.7800	0.5398	0.7800	0.8832
No log	4.5974	354	0.8758	0.5567	0.8758	0.9358
No log	4.6234	356	0.8928	0.4889	0.8928	0.9449
No log	4.6494	358	0.8898	0.4916	0.8898	0.9433
No log	4.6753	360	0.8660	0.4898	0.8660	0.9306
No log	4.7013	362	0.8497	0.5094	0.8497	0.9218
No log	4.7273	364	0.7547	0.5543	0.7547	0.8687
No log	4.7532	366	0.6929	0.6251	0.6929	0.8324
No log	4.7792	368	0.6893	0.5713	0.6893	0.8303
No log	4.8052	370	0.7003	0.6642	0.7003	0.8368
No log	4.8312	372	0.7128	0.6208	0.7128	0.8443
No log	4.8571	374	0.6977	0.5798	0.6977	0.8353
No log	4.8831	376	0.6671	0.5722	0.6671	0.8168
No log	4.9091	378	0.6798	0.5506	0.6798	0.8245
No log	4.9351	380	0.7477	0.5698	0.7477	0.8647
No log	4.9610	382	0.7643	0.5671	0.7643	0.8742
No log	4.9870	384	0.7362	0.5483	0.7362	0.8580
No log	5.0130	386	0.7093	0.5641	0.7093	0.8422
No log	5.0390	388	0.6854	0.5991	0.6854	0.8279
No log	5.0649	390	0.6850	0.6371	0.6850	0.8277
No log	5.0909	392	0.6812	0.5610	0.6812	0.8254
No log	5.1169	394	0.6818	0.5503	0.6818	0.8257
No log	5.1429	396	0.7087	0.6282	0.7087	0.8418
No log	5.1688	398	0.7257	0.6118	0.7257	0.8519
No log	5.1948	400	0.7094	0.5766	0.7094	0.8423
No log	5.2208	402	0.7165	0.4743	0.7165	0.8465
No log	5.2468	404	0.7177	0.4743	0.7177	0.8472
No log	5.2727	406	0.7160	0.5149	0.7160	0.8462
No log	5.2987	408	0.7404	0.6014	0.7404	0.8605
No log	5.3247	410	0.8036	0.5380	0.8036	0.8964
No log	5.3506	412	0.7895	0.5380	0.7895	0.8886
No log	5.3766	414	0.7425	0.5933	0.7425	0.8617
No log	5.4026	416	0.7048	0.6039	0.7048	0.8395
No log	5.4286	418	0.7276	0.4408	0.7276	0.8530
No log	5.4545	420	0.7573	0.4907	0.7573	0.8702
No log	5.4805	422	0.7434	0.5011	0.7434	0.8622
No log	5.5065	424	0.7079	0.5403	0.7079	0.8414
No log	5.5325	426	0.7130	0.6041	0.7130	0.8444
No log	5.5584	428	0.7369	0.6002	0.7369	0.8584
No log	5.5844	430	0.7429	0.5776	0.7429	0.8619
No log	5.6104	432	0.6834	0.6207	0.6834	0.8267
No log	5.6364	434	0.6699	0.5807	0.6699	0.8185
No log	5.6623	436	0.8066	0.3672	0.8066	0.8981
No log	5.6883	438	0.9216	0.4570	0.9216	0.9600
No log	5.7143	440	0.9238	0.4556	0.9238	0.9612
No log	5.7403	442	0.8125	0.5359	0.8125	0.9014
No log	5.7662	444	0.7110	0.5432	0.7110	0.8432
No log	5.7922	446	0.6176	0.6553	0.6176	0.7859
No log	5.8182	448	0.6194	0.6838	0.6194	0.7870
No log	5.8442	450	0.6145	0.6838	0.6145	0.7839
No log	5.8701	452	0.6053	0.6374	0.6053	0.7780
No log	5.8961	454	0.6031	0.6011	0.6031	0.7766
No log	5.9221	456	0.6151	0.6383	0.6151	0.7843
No log	5.9481	458	0.6185	0.5895	0.6185	0.7864
No log	5.9740	460	0.6237	0.5752	0.6237	0.7897
No log	6.0	462	0.6286	0.5954	0.6286	0.7929
No log	6.0260	464	0.6327	0.5262	0.6327	0.7954
No log	6.0519	466	0.6409	0.5275	0.6409	0.8006
No log	6.0779	468	0.6353	0.5455	0.6353	0.7971
No log	6.1039	470	0.6328	0.5651	0.6328	0.7955
No log	6.1299	472	0.6242	0.5505	0.6242	0.7901
No log	6.1558	474	0.6223	0.5466	0.6223	0.7889
No log	6.1818	476	0.6377	0.6638	0.6377	0.7986
No log	6.2078	478	0.6445	0.6609	0.6445	0.8028
No log	6.2338	480	0.6461	0.6780	0.6461	0.8038
No log	6.2597	482	0.6486	0.6951	0.6486	0.8054
No log	6.2857	484	0.6479	0.6830	0.6479	0.8049
No log	6.3117	486	0.6478	0.6392	0.6478	0.8049
No log	6.3377	488	0.6661	0.5951	0.6661	0.8162
No log	6.3636	490	0.7063	0.5345	0.7063	0.8404
No log	6.3896	492	0.7082	0.5345	0.7082	0.8416
No log	6.4156	494	0.6509	0.5582	0.6509	0.8068
No log	6.4416	496	0.6247	0.6359	0.6247	0.7904
No log	6.4675	498	0.6329	0.6758	0.6329	0.7956
0.3421	6.4935	500	0.6551	0.6874	0.6551	0.8094
0.3421	6.5195	502	0.6589	0.6142	0.6589	0.8117
0.3421	6.5455	504	0.6558	0.6008	0.6558	0.8098
0.3421	6.5714	506	0.6152	0.5002	0.6152	0.7843
0.3421	6.5974	508	0.5638	0.5631	0.5638	0.7509
0.3421	6.6234	510	0.5416	0.6557	0.5416	0.7359

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1