ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6448
• Qwk: 0.5153
• Mse: 0.6448
• Rmse: 0.8030

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.2473	-0.0048	4.2473	2.0609
No log	0.0976	4	2.6434	-0.0600	2.6434	1.6258
No log	0.1463	6	1.8355	0.0412	1.8355	1.3548
No log	0.1951	8	1.1401	0.2639	1.1401	1.0678
No log	0.2439	10	1.2133	0.1644	1.2133	1.1015
No log	0.2927	12	1.1034	0.1321	1.1034	1.0504
No log	0.3415	14	1.1207	0.0699	1.1207	1.0586
No log	0.3902	16	1.3980	-0.0695	1.3980	1.1824
No log	0.4390	18	1.6648	-0.0514	1.6648	1.2903
No log	0.4878	20	1.2630	0.0431	1.2630	1.1239
No log	0.5366	22	1.0714	0.1837	1.0714	1.0351
No log	0.5854	24	1.0766	0.2166	1.0766	1.0376
No log	0.6341	26	1.1647	0.1028	1.1647	1.0792
No log	0.6829	28	1.2560	-0.0148	1.2560	1.1207
No log	0.7317	30	1.1729	0.0466	1.1729	1.0830
No log	0.7805	32	1.0746	0.2513	1.0746	1.0366
No log	0.8293	34	1.0675	0.2903	1.0675	1.0332
No log	0.8780	36	1.1190	0.0613	1.1190	1.0578
No log	0.9268	38	1.1104	0.0466	1.1104	1.0537
No log	0.9756	40	1.0465	0.3521	1.0465	1.0230
No log	1.0244	42	1.0216	0.4002	1.0216	1.0107
No log	1.0732	44	0.9895	0.3876	0.9895	0.9947
No log	1.1220	46	0.8945	0.2721	0.8945	0.9458
No log	1.1707	48	0.9009	0.3083	0.9009	0.9491
No log	1.2195	50	0.9393	0.3863	0.9393	0.9692
No log	1.2683	52	0.9111	0.3897	0.9111	0.9545
No log	1.3171	54	0.9723	0.3915	0.9723	0.9861
No log	1.3659	56	0.9607	0.4073	0.9607	0.9801
No log	1.4146	58	0.9624	0.3960	0.9624	0.9810
No log	1.4634	60	0.9829	0.4093	0.9829	0.9914
No log	1.5122	62	0.8727	0.5094	0.8727	0.9342
No log	1.5610	64	0.8821	0.4460	0.8821	0.9392
No log	1.6098	66	0.8302	0.4676	0.8302	0.9112
No log	1.6585	68	0.8204	0.4946	0.8204	0.9057
No log	1.7073	70	0.7978	0.5056	0.7978	0.8932
No log	1.7561	72	0.7837	0.4675	0.7837	0.8853
No log	1.8049	74	1.0204	0.4011	1.0204	1.0101
No log	1.8537	76	0.9708	0.4011	0.9708	0.9853
No log	1.9024	78	0.7390	0.4537	0.7390	0.8597
No log	1.9512	80	0.7212	0.5273	0.7212	0.8493
No log	2.0	82	0.7383	0.4778	0.7383	0.8592
No log	2.0488	84	0.7564	0.4935	0.7564	0.8697
No log	2.0976	86	0.7959	0.5073	0.7959	0.8921
No log	2.1463	88	0.7686	0.5795	0.7686	0.8767
No log	2.1951	90	0.7053	0.5771	0.7053	0.8398
No log	2.2439	92	0.7022	0.5455	0.7022	0.8380
No log	2.2927	94	0.7007	0.5010	0.7007	0.8371
No log	2.3415	96	0.7254	0.5301	0.7254	0.8517
No log	2.3902	98	0.8535	0.4903	0.8535	0.9239
No log	2.4390	100	0.7840	0.3915	0.7840	0.8854
No log	2.4878	102	0.7848	0.4180	0.7848	0.8859
No log	2.5366	104	0.7950	0.4180	0.7950	0.8916
No log	2.5854	106	0.7800	0.4285	0.7800	0.8832
No log	2.6341	108	1.1376	0.2727	1.1376	1.0666
No log	2.6829	110	1.3287	0.2229	1.3287	1.1527
No log	2.7317	112	1.0631	0.3519	1.0631	1.0311
No log	2.7805	114	0.6715	0.5529	0.6715	0.8194
No log	2.8293	116	0.8103	0.4318	0.8103	0.9002
No log	2.8780	118	0.9122	0.4216	0.9122	0.9551
No log	2.9268	120	0.7602	0.4801	0.7602	0.8719
No log	2.9756	122	0.6663	0.5631	0.6663	0.8163
No log	3.0244	124	0.8639	0.4608	0.8639	0.9294
No log	3.0732	126	0.8768	0.4201	0.8768	0.9364
No log	3.1220	128	0.7204	0.5214	0.7204	0.8487
No log	3.1707	130	0.7273	0.5521	0.7273	0.8528
No log	3.2195	132	0.9175	0.4476	0.9175	0.9579
No log	3.2683	134	0.8889	0.4681	0.8889	0.9428
No log	3.3171	136	0.7619	0.5279	0.7619	0.8729
No log	3.3659	138	0.6911	0.5883	0.6911	0.8313
No log	3.4146	140	0.6559	0.6133	0.6559	0.8099
No log	3.4634	142	0.6723	0.5992	0.6723	0.8199
No log	3.5122	144	0.6977	0.5651	0.6977	0.8353
No log	3.5610	146	0.6791	0.5775	0.6791	0.8240
No log	3.6098	148	0.6422	0.6219	0.6422	0.8014
No log	3.6585	150	0.7588	0.4563	0.7588	0.8711
No log	3.7073	152	0.6725	0.5548	0.6725	0.8201
No log	3.7561	154	0.6423	0.6014	0.6423	0.8014
No log	3.8049	156	0.7399	0.6230	0.7399	0.8601
No log	3.8537	158	0.7295	0.6209	0.7295	0.8541
No log	3.9024	160	0.6612	0.6828	0.6612	0.8131
No log	3.9512	162	0.7206	0.4906	0.7206	0.8489
No log	4.0	164	0.7663	0.5030	0.7663	0.8754
No log	4.0488	166	0.6747	0.6392	0.6747	0.8214
No log	4.0976	168	0.7135	0.5718	0.7135	0.8447
No log	4.1463	170	0.7171	0.5964	0.7171	0.8468
No log	4.1951	172	0.6825	0.5388	0.6825	0.8261
No log	4.2439	174	0.7304	0.5111	0.7304	0.8546
No log	4.2927	176	0.8987	0.5160	0.8987	0.9480
No log	4.3415	178	0.8351	0.5030	0.8351	0.9139
No log	4.3902	180	0.6824	0.5759	0.6824	0.8261
No log	4.4390	182	0.6930	0.5751	0.6930	0.8324
No log	4.4878	184	0.7568	0.5610	0.7568	0.8700
No log	4.5366	186	0.7125	0.5610	0.7125	0.8441
No log	4.5854	188	0.6277	0.5986	0.6277	0.7922
No log	4.6341	190	0.6293	0.5672	0.6293	0.7933
No log	4.6829	192	0.7750	0.5614	0.7750	0.8803
No log	4.7317	194	0.8214	0.5283	0.8214	0.9063
No log	4.7805	196	0.7239	0.5123	0.7239	0.8508
No log	4.8293	198	0.6487	0.5644	0.6487	0.8054
No log	4.8780	200	0.6630	0.5909	0.6630	0.8143
No log	4.9268	202	0.6840	0.6112	0.6840	0.8271
No log	4.9756	204	0.6936	0.5992	0.6936	0.8328
No log	5.0244	206	0.6683	0.5149	0.6683	0.8175
No log	5.0732	208	0.6819	0.5149	0.6819	0.8258
No log	5.1220	210	0.7037	0.5017	0.7037	0.8389
No log	5.1707	212	0.7275	0.4862	0.7275	0.8529
No log	5.2195	214	0.7276	0.4903	0.7276	0.8530
No log	5.2683	216	0.7169	0.4903	0.7169	0.8467
No log	5.3171	218	0.7152	0.5937	0.7152	0.8457
No log	5.3659	220	0.6975	0.6340	0.6975	0.8352
No log	5.4146	222	0.6477	0.6424	0.6477	0.8048
No log	5.4634	224	0.6852	0.5430	0.6852	0.8278
No log	5.5122	226	0.6991	0.4998	0.6991	0.8362
No log	5.5610	228	0.6782	0.5069	0.6782	0.8235
No log	5.6098	230	0.6659	0.5168	0.6659	0.8160
No log	5.6585	232	0.6721	0.6508	0.6721	0.8198
No log	5.7073	234	0.6565	0.6262	0.6565	0.8102
No log	5.7561	236	0.6564	0.5492	0.6564	0.8102
No log	5.8049	238	0.6950	0.5690	0.6950	0.8337
No log	5.8537	240	0.7092	0.5974	0.7092	0.8421
No log	5.9024	242	0.8103	0.5447	0.8103	0.9002
No log	5.9512	244	0.7568	0.5547	0.7568	0.8699
No log	6.0	246	0.7026	0.5333	0.7026	0.8382
No log	6.0488	248	0.7143	0.5333	0.7143	0.8452
No log	6.0976	250	0.7207	0.5333	0.7207	0.8490
No log	6.1463	252	0.6714	0.5908	0.6714	0.8194
No log	6.1951	254	0.6361	0.5783	0.6361	0.7976
No log	6.2439	256	0.6294	0.5302	0.6294	0.7934
No log	6.2927	258	0.6445	0.5316	0.6445	0.8028
No log	6.3415	260	0.7406	0.5243	0.7406	0.8606
No log	6.3902	262	0.9098	0.4871	0.9098	0.9538
No log	6.4390	264	1.0444	0.4354	1.0444	1.0219
No log	6.4878	266	0.9116	0.4994	0.9116	0.9548
No log	6.5366	268	0.7141	0.5103	0.7141	0.8450
No log	6.5854	270	0.6410	0.5316	0.6410	0.8006
No log	6.6341	272	0.6469	0.5302	0.6469	0.8043
No log	6.6829	274	0.6596	0.5033	0.6596	0.8122
No log	6.7317	276	0.6893	0.4919	0.6893	0.8303
No log	6.7805	278	0.6826	0.4781	0.6826	0.8262
No log	6.8293	280	0.6628	0.5033	0.6628	0.8141
No log	6.8780	282	0.6556	0.5722	0.6556	0.8097
No log	6.9268	284	0.7072	0.5642	0.7072	0.8409
No log	6.9756	286	0.7521	0.5385	0.7521	0.8672
No log	7.0244	288	0.7062	0.5565	0.7062	0.8404
No log	7.0732	290	0.6788	0.5618	0.6788	0.8239
No log	7.1220	292	0.6689	0.5302	0.6689	0.8179
No log	7.1707	294	0.6493	0.5316	0.6493	0.8058
No log	7.2195	296	0.6300	0.6150	0.6300	0.7938
No log	7.2683	298	0.6073	0.6262	0.6073	0.7793
No log	7.3171	300	0.6395	0.5858	0.6395	0.7997
No log	7.3659	302	0.6335	0.5975	0.6335	0.7959
No log	7.4146	304	0.6460	0.6082	0.6460	0.8037
No log	7.4634	306	0.6378	0.5740	0.6378	0.7986
No log	7.5122	308	0.5932	0.6054	0.5932	0.7702
No log	7.5610	310	0.6193	0.5914	0.6193	0.7870
No log	7.6098	312	0.6477	0.5067	0.6477	0.8048
No log	7.6585	314	0.6560	0.4303	0.6560	0.8099
No log	7.7073	316	0.7114	0.4273	0.7114	0.8435
No log	7.7561	318	0.7569	0.5192	0.7569	0.8700
No log	7.8049	320	0.7159	0.5701	0.7159	0.8461
No log	7.8537	322	0.6247	0.6525	0.6247	0.7904
No log	7.9024	324	0.5653	0.7184	0.5653	0.7519
No log	7.9512	326	0.5608	0.6973	0.5608	0.7489
No log	8.0	328	0.5686	0.6675	0.5686	0.7541
No log	8.0488	330	0.6008	0.5230	0.6008	0.7751
No log	8.0976	332	0.6060	0.5230	0.6060	0.7785
No log	8.1463	334	0.5974	0.4983	0.5974	0.7729
No log	8.1951	336	0.5884	0.6087	0.5884	0.7670
No log	8.2439	338	0.5908	0.6087	0.5908	0.7686
No log	8.2927	340	0.5977	0.6417	0.5977	0.7731
No log	8.3415	342	0.6252	0.5932	0.6252	0.7907
No log	8.3902	344	0.6827	0.5992	0.6827	0.8263
No log	8.4390	346	0.7141	0.5872	0.7141	0.8450
No log	8.4878	348	0.6440	0.5698	0.6440	0.8025
No log	8.5366	350	0.6023	0.6186	0.6023	0.7761
No log	8.5854	352	0.5988	0.6175	0.5988	0.7738
No log	8.6341	354	0.5936	0.6175	0.5936	0.7705
No log	8.6829	356	0.5874	0.6175	0.5874	0.7664
No log	8.7317	358	0.5995	0.6133	0.5995	0.7743
No log	8.7805	360	0.5958	0.6133	0.5958	0.7719
No log	8.8293	362	0.5936	0.5898	0.5936	0.7704
No log	8.8780	364	0.6073	0.4951	0.6073	0.7793
No log	8.9268	366	0.6216	0.4781	0.6216	0.7884
No log	8.9756	368	0.6471	0.5391	0.6471	0.8044
No log	9.0244	370	0.6576	0.5937	0.6576	0.8109
No log	9.0732	372	0.6434	0.6209	0.6434	0.8021
No log	9.1220	374	0.5985	0.6519	0.5985	0.7736
No log	9.1707	376	0.5900	0.6275	0.5900	0.7681
No log	9.2195	378	0.6410	0.6204	0.6410	0.8006
No log	9.2683	380	0.6093	0.5917	0.6093	0.7806
No log	9.3171	382	0.6233	0.5588	0.6233	0.7895
No log	9.3659	384	0.6053	0.5704	0.6053	0.7780
No log	9.4146	386	0.6187	0.5588	0.6187	0.7866
No log	9.4634	388	0.6460	0.5588	0.6460	0.8037
No log	9.5122	390	0.6530	0.5588	0.6530	0.8081
No log	9.5610	392	0.6591	0.5588	0.6591	0.8119
No log	9.6098	394	0.6370	0.4953	0.6370	0.7982
No log	9.6585	396	0.6399	0.6154	0.6399	0.8000
No log	9.7073	398	0.6686	0.5787	0.6686	0.8177
No log	9.7561	400	0.6420	0.6252	0.6420	0.8013
No log	9.8049	402	0.6570	0.6090	0.6570	0.8106
No log	9.8537	404	0.7136	0.5443	0.7136	0.8447
No log	9.9024	406	0.6747	0.5759	0.6747	0.8214
No log	9.9512	408	0.6210	0.6417	0.6210	0.7881
No log	10.0	410	0.6275	0.6370	0.6275	0.7922
No log	10.0488	412	0.6288	0.6479	0.6288	0.7930
No log	10.0976	414	0.6260	0.6209	0.6260	0.7912
No log	10.1463	416	0.6832	0.5005	0.6832	0.8265
No log	10.1951	418	0.7395	0.5151	0.7395	0.8600
No log	10.2439	420	0.7006	0.5368	0.7006	0.8370
No log	10.2927	422	0.6450	0.5794	0.6450	0.8031
No log	10.3415	424	0.6080	0.6209	0.6080	0.7798
No log	10.3902	426	0.6193	0.6276	0.6193	0.7870
No log	10.4390	428	0.6113	0.6322	0.6113	0.7819
No log	10.4878	430	0.6016	0.6322	0.6016	0.7757
No log	10.5366	432	0.5905	0.6456	0.5905	0.7684
No log	10.5854	434	0.5863	0.5898	0.5863	0.7657
No log	10.6341	436	0.5806	0.5898	0.5806	0.7619
No log	10.6829	438	0.5822	0.6332	0.5822	0.7630
No log	10.7317	440	0.5968	0.6322	0.5968	0.7725
No log	10.7805	442	0.6005	0.6322	0.6005	0.7749
No log	10.8293	444	0.6180	0.6165	0.6180	0.7861
No log	10.8780	446	0.5963	0.6096	0.5963	0.7722
No log	10.9268	448	0.6012	0.6517	0.6012	0.7753
No log	10.9756	450	0.6090	0.6593	0.6090	0.7804
No log	11.0244	452	0.6186	0.6133	0.6186	0.7865
No log	11.0732	454	0.6254	0.6239	0.6254	0.7908
No log	11.1220	456	0.6265	0.6272	0.6265	0.7915
No log	11.1707	458	0.6270	0.5644	0.6270	0.7918
No log	11.2195	460	0.6270	0.5408	0.6270	0.7918
No log	11.2683	462	0.6252	0.5640	0.6252	0.7907
No log	11.3171	464	0.6121	0.5640	0.6121	0.7824
No log	11.3659	466	0.5975	0.5666	0.5975	0.7730
No log	11.4146	468	0.6690	0.6092	0.6690	0.8179
No log	11.4634	470	0.7243	0.5743	0.7243	0.8510
No log	11.5122	472	0.6587	0.6485	0.6587	0.8116
No log	11.5610	474	0.5851	0.5910	0.5851	0.7649
No log	11.6098	476	0.5928	0.6286	0.5928	0.7699
No log	11.6585	478	0.6032	0.6286	0.6032	0.7766
No log	11.7073	480	0.5980	0.5631	0.5980	0.7733
No log	11.7561	482	0.6236	0.6108	0.6236	0.7897
No log	11.8049	484	0.6882	0.5565	0.6882	0.8295
No log	11.8537	486	0.6681	0.6248	0.6681	0.8174
No log	11.9024	488	0.6160	0.5562	0.6160	0.7849
No log	11.9512	490	0.6090	0.5735	0.6090	0.7804
No log	12.0	492	0.6081	0.6065	0.6081	0.7798
No log	12.0488	494	0.6134	0.6070	0.6134	0.7832
No log	12.0976	496	0.6281	0.6275	0.6281	0.7925
No log	12.1463	498	0.6286	0.5999	0.6286	0.7929
0.3149	12.1951	500	0.6260	0.5549	0.6260	0.7912
0.3149	12.2439	502	0.6152	0.5402	0.6152	0.7844
0.3149	12.2927	504	0.6034	0.6175	0.6034	0.7768
0.3149	12.3415	506	0.5999	0.7018	0.5999	0.7745
0.3149	12.3902	508	0.5997	0.7047	0.5997	0.7744
0.3149	12.4390	510	0.6027	0.6675	0.6027	0.7764
0.3149	12.4878	512	0.6097	0.6838	0.6097	0.7808
0.3149	12.5366	514	0.6176	0.6262	0.6176	0.7859
0.3149	12.5854	516	0.6289	0.5405	0.6289	0.7930
0.3149	12.6341	518	0.6340	0.5536	0.6340	0.7962
0.3149	12.6829	520	0.6427	0.5926	0.6427	0.8017
0.3149	12.7317	522	0.6461	0.5938	0.6461	0.8038
0.3149	12.7805	524	0.6385	0.5690	0.6385	0.7991
0.3149	12.8293	526	0.6324	0.5288	0.6324	0.7953
0.3149	12.8780	528	0.6345	0.5274	0.6345	0.7965
0.3149	12.9268	530	0.6471	0.5490	0.6471	0.8044
0.3149	12.9756	532	0.6559	0.5288	0.6559	0.8099
0.3149	13.0244	534	0.6814	0.5703	0.6814	0.8255
0.3149	13.0732	536	0.6860	0.5703	0.6860	0.8282
0.3149	13.1220	538	0.6652	0.5168	0.6652	0.8156
0.3149	13.1707	540	0.6581	0.5168	0.6581	0.8112
0.3149	13.2195	542	0.6575	0.5926	0.6575	0.8109
0.3149	13.2683	544	0.6481	0.5419	0.6481	0.8051
0.3149	13.3171	546	0.6610	0.5698	0.6610	0.8130
0.3149	13.3659	548	0.7093	0.5070	0.7093	0.8422
0.3149	13.4146	550	0.7042	0.5070	0.7042	0.8392
0.3149	13.4634	552	0.6539	0.6165	0.6539	0.8086
0.3149	13.5122	554	0.6462	0.5409	0.6462	0.8039
0.3149	13.5610	556	0.7141	0.5997	0.7141	0.8450
0.3149	13.6098	558	0.7308	0.5547	0.7308	0.8549
0.3149	13.6585	560	0.6648	0.6298	0.6648	0.8154
0.3149	13.7073	562	0.6142	0.6307	0.6142	0.7837
0.3149	13.7561	564	0.6097	0.6165	0.6097	0.7808
0.3149	13.8049	566	0.6202	0.5894	0.6202	0.7875
0.3149	13.8537	568	0.6168	0.5798	0.6168	0.7854
0.3149	13.9024	570	0.5903	0.6165	0.5903	0.7683
0.3149	13.9512	572	0.5758	0.6054	0.5758	0.7588
0.3149	14.0	574	0.5736	0.6579	0.5736	0.7574
0.3149	14.0488	576	0.5675	0.6822	0.5675	0.7533
0.3149	14.0976	578	0.5519	0.6658	0.5519	0.7429
0.3149	14.1463	580	0.5533	0.6415	0.5533	0.7438
0.3149	14.1951	582	0.5548	0.6680	0.5548	0.7449
0.3149	14.2439	584	0.5621	0.6846	0.5621	0.7497
0.3149	14.2927	586	0.5600	0.6431	0.5600	0.7483
0.3149	14.3415	588	0.5803	0.6721	0.5803	0.7618
0.3149	14.3902	590	0.6073	0.6461	0.6073	0.7793
0.3149	14.4390	592	0.5969	0.6275	0.5969	0.7726
0.3149	14.4878	594	0.6077	0.6275	0.6077	0.7796
0.3149	14.5366	596	0.6145	0.6275	0.6145	0.7839
0.3149	14.5854	598	0.5878	0.6275	0.5878	0.7667
0.3149	14.6341	600	0.5841	0.6275	0.5841	0.7642
0.3149	14.6829	602	0.6060	0.6072	0.6060	0.7785
0.3149	14.7317	604	0.6085	0.5971	0.6085	0.7800
0.3149	14.7805	606	0.6240	0.5981	0.6240	0.7899
0.3149	14.8293	608	0.6680	0.5595	0.6680	0.8173
0.3149	14.8780	610	0.6524	0.5841	0.6524	0.8077
0.3149	14.9268	612	0.6379	0.6043	0.6379	0.7987
0.3149	14.9756	614	0.5969	0.6545	0.5969	0.7726
0.3149	15.0244	616	0.5847	0.6275	0.5847	0.7647
0.3149	15.0732	618	0.5895	0.6234	0.5895	0.7678
0.3149	15.1220	620	0.5894	0.6606	0.5894	0.7677
0.3149	15.1707	622	0.6157	0.6509	0.6157	0.7846
0.3149	15.2195	624	0.6407	0.6537	0.6407	0.8005
0.3149	15.2683	626	0.6256	0.5966	0.6256	0.7910
0.3149	15.3171	628	0.6270	0.5665	0.6270	0.7918
0.3149	15.3659	630	0.6583	0.5451	0.6583	0.8114
0.3149	15.4146	632	0.6558	0.5553	0.6558	0.8098
0.3149	15.4634	634	0.6328	0.5807	0.6328	0.7955
0.3149	15.5122	636	0.6475	0.5138	0.6475	0.8047
0.3149	15.5610	638	0.6971	0.4336	0.6971	0.8349
0.3149	15.6098	640	0.7309	0.3802	0.7309	0.8549
0.3149	15.6585	642	0.7049	0.4473	0.7049	0.8396
0.3149	15.7073	644	0.6448	0.5153	0.6448	0.8030

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1