ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run999_AugV5_k5_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9175
• Qwk: 0.6190
• Mse: 0.9175
• Rmse: 0.9579

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	6.5289	0.0308	6.5289	2.5552
No log	0.1429	4	4.1544	0.0667	4.1544	2.0382
No log	0.2143	6	2.6134	0.0764	2.6134	1.6166
No log	0.2857	8	2.0155	0.2256	2.0155	1.4197
No log	0.3571	10	1.8277	0.1739	1.8277	1.3519
No log	0.4286	12	1.7749	0.1818	1.7749	1.3322
No log	0.5	14	1.6704	0.1880	1.6704	1.2924
No log	0.5714	16	1.5500	0.1754	1.5500	1.2450
No log	0.6429	18	1.4566	0.2478	1.4566	1.2069
No log	0.7143	20	1.3816	0.3393	1.3816	1.1754
No log	0.7857	22	1.3895	0.3009	1.3895	1.1788
No log	0.8571	24	1.6522	0.1709	1.6522	1.2854
No log	0.9286	26	1.6859	0.1695	1.6859	1.2984
No log	1.0	28	1.7543	0.2276	1.7543	1.3245
No log	1.0714	30	1.3961	0.3710	1.3961	1.1816
No log	1.1429	32	1.0705	0.5410	1.0705	1.0346
No log	1.2143	34	1.1683	0.5082	1.1683	1.0809
No log	1.2857	36	1.0557	0.5669	1.0557	1.0274
No log	1.3571	38	1.1428	0.5564	1.1428	1.0690
No log	1.4286	40	1.1911	0.5344	1.1911	1.0914
No log	1.5	42	1.1420	0.5538	1.1420	1.0687
No log	1.5714	44	1.1656	0.5238	1.1656	1.0797
No log	1.6429	46	1.2379	0.4882	1.2379	1.1126
No log	1.7143	48	1.2183	0.5271	1.2183	1.1038
No log	1.7857	50	1.1556	0.5781	1.1556	1.0750
No log	1.8571	52	1.0573	0.6202	1.0573	1.0283
No log	1.9286	54	1.0669	0.5714	1.0669	1.0329
No log	2.0	56	1.1210	0.4628	1.1210	1.0588
No log	2.0714	58	1.0871	0.4538	1.0871	1.0426
No log	2.1429	60	1.1773	0.4769	1.1773	1.0850
No log	2.2143	62	1.2126	0.4885	1.2126	1.1012
No log	2.2857	64	1.0706	0.5303	1.0706	1.0347
No log	2.3571	66	1.0455	0.6074	1.0455	1.0225
No log	2.4286	68	1.2198	0.4769	1.2198	1.1045
No log	2.5	70	1.4009	0.4478	1.4009	1.1836
No log	2.5714	72	1.3412	0.4580	1.3412	1.1581
No log	2.6429	74	1.2918	0.4882	1.2918	1.1366
No log	2.7143	76	1.5506	0.3307	1.5506	1.2452
No log	2.7857	78	1.4550	0.3089	1.4550	1.2062
No log	2.8571	80	1.1575	0.5760	1.1575	1.0759
No log	2.9286	82	1.0608	0.6016	1.0608	1.0300
No log	3.0	84	1.1827	0.5496	1.1827	1.0875
No log	3.0714	86	1.2996	0.4091	1.2996	1.1400
No log	3.1429	88	1.0599	0.5082	1.0599	1.0295
No log	3.2143	90	1.0583	0.496	1.0583	1.0287
No log	3.2857	92	1.1000	0.5385	1.1000	1.0488
No log	3.3571	94	1.0539	0.5512	1.0539	1.0266
No log	3.4286	96	1.0682	0.6047	1.0682	1.0335
No log	3.5	98	1.0665	0.5891	1.0665	1.0327
No log	3.5714	100	1.0826	0.5846	1.0826	1.0405
No log	3.6429	102	1.0244	0.6	1.0244	1.0121
No log	3.7143	104	1.0101	0.5760	1.0101	1.0050
No log	3.7857	106	1.0431	0.4667	1.0431	1.0213
No log	3.8571	108	1.0587	0.4370	1.0587	1.0289
No log	3.9286	110	0.9903	0.5691	0.9903	0.9951
No log	4.0	112	1.0563	0.6	1.0563	1.0278
No log	4.0714	114	1.1169	0.5692	1.1169	1.0568
No log	4.1429	116	1.0868	0.5846	1.0868	1.0425
No log	4.2143	118	1.1008	0.5231	1.1008	1.0492
No log	4.2857	120	1.0023	0.5606	1.0023	1.0012
No log	4.3571	122	0.9146	0.6418	0.9146	0.9563
No log	4.4286	124	0.8526	0.6565	0.8526	0.9233
No log	4.5	126	0.8120	0.6519	0.8120	0.9011
No log	4.5714	128	0.8377	0.6074	0.8377	0.9152
No log	4.6429	130	0.8758	0.5538	0.8758	0.9358
No log	4.7143	132	0.9033	0.6615	0.9033	0.9504
No log	4.7857	134	0.9333	0.6615	0.9333	0.9661
No log	4.8571	136	0.9227	0.6308	0.9227	0.9606
No log	4.9286	138	0.9168	0.6260	0.9168	0.9575
No log	5.0	140	0.9623	0.6047	0.9623	0.9810
No log	5.0714	142	0.9516	0.5938	0.9516	0.9755
No log	5.1429	144	0.8633	0.6917	0.8633	0.9291
No log	5.2143	146	0.7241	0.7111	0.7241	0.8509
No log	5.2857	148	0.6730	0.7324	0.6730	0.8204
No log	5.3571	150	0.6469	0.7042	0.6469	0.8043
No log	5.4286	152	0.6362	0.7660	0.6362	0.7976
No log	5.5	154	0.6595	0.7429	0.6595	0.8121
No log	5.5714	156	0.6621	0.7101	0.6621	0.8137
No log	5.6429	158	0.7130	0.7143	0.7130	0.8444
No log	5.7143	160	0.7756	0.6763	0.7756	0.8807
No log	5.7857	162	0.9225	0.6525	0.9225	0.9604
No log	5.8571	164	1.1063	0.5753	1.1063	1.0518
No log	5.9286	166	0.9905	0.6324	0.9905	0.9953
No log	6.0	168	0.8482	0.6308	0.8482	0.9210
No log	6.0714	170	0.7995	0.6519	0.7995	0.8942
No log	6.1429	172	0.8121	0.6716	0.8121	0.9012
No log	6.2143	174	0.8826	0.6569	0.8826	0.9395
No log	6.2857	176	0.8503	0.6667	0.8503	0.9221
No log	6.3571	178	0.8367	0.6324	0.8367	0.9147
No log	6.4286	180	0.9219	0.6418	0.9219	0.9601
No log	6.5	182	0.9259	0.6165	0.9259	0.9622
No log	6.5714	184	0.8731	0.6212	0.8731	0.9344
No log	6.6429	186	0.8186	0.6615	0.8186	0.9048
No log	6.7143	188	0.8082	0.6412	0.8082	0.8990
No log	6.7857	190	0.8354	0.6466	0.8354	0.9140
No log	6.8571	192	0.8120	0.6567	0.8120	0.9011
No log	6.9286	194	0.8021	0.6567	0.8021	0.8956
No log	7.0	196	0.7989	0.6466	0.7989	0.8938
No log	7.0714	198	0.8053	0.7050	0.8053	0.8974
No log	7.1429	200	0.8461	0.6906	0.8461	0.9199
No log	7.2143	202	0.8323	0.6767	0.8323	0.9123
No log	7.2857	204	0.8134	0.6462	0.8134	0.9019
No log	7.3571	206	0.7933	0.6565	0.7933	0.8907
No log	7.4286	208	0.7703	0.6515	0.7703	0.8777
No log	7.5	210	0.7642	0.6515	0.7642	0.8742
No log	7.5714	212	0.7839	0.6667	0.7839	0.8854
No log	7.6429	214	0.7783	0.6667	0.7783	0.8822
No log	7.7143	216	0.8187	0.6912	0.8187	0.9048
No log	7.7857	218	0.8565	0.6667	0.8565	0.9255
No log	7.8571	220	0.8354	0.6462	0.8354	0.9140
No log	7.9286	222	0.8444	0.6822	0.8444	0.9189
No log	8.0	224	0.8641	0.6190	0.8641	0.9296
No log	8.0714	226	0.9041	0.5891	0.9041	0.9508
No log	8.1429	228	0.9171	0.6061	0.9171	0.9576
No log	8.2143	230	0.9795	0.5926	0.9795	0.9897
No log	8.2857	232	0.9123	0.6525	0.9123	0.9551
No log	8.3571	234	0.7838	0.6763	0.7838	0.8853
No log	8.4286	236	0.7655	0.7092	0.7655	0.8749
No log	8.5	238	0.7393	0.7092	0.7393	0.8598
No log	8.5714	240	0.7310	0.7234	0.7310	0.8550
No log	8.6429	242	0.7271	0.7092	0.7271	0.8527
No log	8.7143	244	0.7217	0.7092	0.7217	0.8495
No log	8.7857	246	0.7240	0.7143	0.7240	0.8509
No log	8.8571	248	0.7309	0.7376	0.7309	0.8549
No log	8.9286	250	0.7322	0.7376	0.7322	0.8557
No log	9.0	252	0.7349	0.7391	0.7349	0.8572
No log	9.0714	254	0.7769	0.7111	0.7769	0.8814
No log	9.1429	256	0.8253	0.7153	0.8253	0.9085
No log	9.2143	258	0.8157	0.6957	0.8157	0.9031
No log	9.2857	260	0.8252	0.6715	0.8252	0.9084
No log	9.3571	262	0.9176	0.6471	0.9176	0.9579
No log	9.4286	264	0.8947	0.6715	0.8947	0.9459
No log	9.5	266	0.7797	0.6957	0.7797	0.8830
No log	9.5714	268	0.7687	0.6866	0.7687	0.8767
No log	9.6429	270	0.7884	0.6866	0.7884	0.8879
No log	9.7143	272	0.7829	0.6769	0.7829	0.8848
No log	9.7857	274	0.7801	0.7121	0.7801	0.8832
No log	9.8571	276	0.8066	0.7121	0.8066	0.8981
No log	9.9286	278	0.8190	0.6667	0.8190	0.9050
No log	10.0	280	0.8586	0.6094	0.8586	0.9266
No log	10.0714	282	0.8808	0.6094	0.8808	0.9385
No log	10.1429	284	0.8515	0.6202	0.8515	0.9228
No log	10.2143	286	0.8515	0.6357	0.8515	0.9228
No log	10.2857	288	0.8410	0.6462	0.8410	0.9170
No log	10.3571	290	0.9141	0.6364	0.9141	0.9561
No log	10.4286	292	1.0622	0.5758	1.0622	1.0306
No log	10.5	294	1.1393	0.5758	1.1393	1.0674
No log	10.5714	296	1.1792	0.5564	1.1792	1.0859
No log	10.6429	298	1.0968	0.5846	1.0968	1.0473
No log	10.7143	300	1.0128	0.6094	1.0128	1.0064
No log	10.7857	302	0.9958	0.6357	0.9958	0.9979
No log	10.8571	304	1.0221	0.5846	1.0221	1.0110
No log	10.9286	306	1.0383	0.5846	1.0383	1.0190
No log	11.0	308	1.0223	0.5692	1.0223	1.0111
No log	11.0714	310	1.0224	0.5692	1.0224	1.0111
No log	11.1429	312	0.9440	0.5938	0.9440	0.9716
No log	11.2143	314	0.8969	0.6154	0.8969	0.9470
No log	11.2857	316	0.8977	0.6222	0.8977	0.9475
No log	11.3571	318	0.9305	0.6074	0.9305	0.9646
No log	11.4286	320	0.8978	0.6260	0.8978	0.9475
No log	11.5	322	0.8148	0.6818	0.8148	0.9027
No log	11.5714	324	0.8085	0.6667	0.8085	0.8992
No log	11.6429	326	0.8076	0.6718	0.8076	0.8987
No log	11.7143	328	0.8112	0.6412	0.8112	0.9007
No log	11.7857	330	0.8211	0.6515	0.8211	0.9062
No log	11.8571	332	0.8213	0.6667	0.8213	0.9063
No log	11.9286	334	0.8816	0.6438	0.8816	0.9389
No log	12.0	336	0.9401	0.6225	0.9401	0.9696
No log	12.0714	338	0.9259	0.6861	0.9259	0.9622
No log	12.1429	340	0.9523	0.6512	0.9523	0.9759
No log	12.2143	342	0.9888	0.6142	0.9888	0.9944
No log	12.2857	344	1.0564	0.5873	1.0564	1.0278
No log	12.3571	346	1.1595	0.5692	1.1595	1.0768
No log	12.4286	348	1.2126	0.5496	1.2126	1.1012
No log	12.5	350	1.0917	0.5891	1.0917	1.0448
No log	12.5714	352	0.9340	0.5984	0.9340	0.9665
No log	12.6429	354	0.8919	0.6406	0.8919	0.9444
No log	12.7143	356	0.8759	0.6406	0.8759	0.9359
No log	12.7857	358	0.8718	0.6357	0.8718	0.9337
No log	12.8571	360	0.9515	0.6061	0.9515	0.9755
No log	12.9286	362	0.9943	0.5899	0.9943	0.9971
No log	13.0	364	0.9023	0.6131	0.9023	0.9499
No log	13.0714	366	0.8159	0.6861	0.8159	0.9033
No log	13.1429	368	0.7702	0.7222	0.7702	0.8776
No log	13.2143	370	0.7634	0.7075	0.7634	0.8737
No log	13.2857	372	0.8542	0.6569	0.8542	0.9242
No log	13.3571	374	0.9519	0.6107	0.9519	0.9756
No log	13.4286	376	1.0001	0.5938	1.0001	1.0000
No log	13.5	378	1.0401	0.5781	1.0401	1.0198
No log	13.5714	380	1.0399	0.5781	1.0399	1.0197
No log	13.6429	382	1.0198	0.6047	1.0198	1.0099
No log	13.7143	384	1.0373	0.5781	1.0373	1.0185
No log	13.7857	386	1.0972	0.5354	1.0972	1.0475
No log	13.8571	388	1.1460	0.5354	1.1460	1.0705
No log	13.9286	390	1.1157	0.5397	1.1157	1.0563
No log	14.0	392	1.0490	0.528	1.0490	1.0242
No log	14.0714	394	1.0009	0.5645	1.0009	1.0004
No log	14.1429	396	0.9830	0.5203	0.9830	0.9915
No log	14.2143	398	0.9386	0.576	0.9386	0.9688
No log	14.2857	400	0.9064	0.6567	0.9064	0.9521
No log	14.3571	402	0.9939	0.6165	0.9939	0.9970
No log	14.4286	404	1.0387	0.6316	1.0387	1.0192
No log	14.5	406	1.0340	0.6107	1.0340	1.0169
No log	14.5714	408	1.0433	0.6	1.0433	1.0214
No log	14.6429	410	0.9720	0.6154	0.9720	0.9859
No log	14.7143	412	0.9154	0.6357	0.9154	0.9567
No log	14.7857	414	0.8868	0.6462	0.8868	0.9417
No log	14.8571	416	0.8879	0.6718	0.8879	0.9423
No log	14.9286	418	0.9159	0.6462	0.9159	0.9570
No log	15.0	420	0.9539	0.6260	0.9539	0.9767
No log	15.0714	422	0.9338	0.6260	0.9338	0.9663
No log	15.1429	424	0.8520	0.6769	0.8520	0.9230
No log	15.2143	426	0.8220	0.6667	0.8220	0.9067
No log	15.2857	428	0.8040	0.6299	0.8040	0.8967
No log	15.3571	430	0.7528	0.6870	0.7528	0.8676
No log	15.4286	432	0.7808	0.6515	0.7808	0.8836
No log	15.5	434	0.8098	0.6761	0.8098	0.8999
No log	15.5714	436	0.7996	0.6667	0.7996	0.8942
No log	15.6429	438	0.8414	0.6815	0.8414	0.9173
No log	15.7143	440	0.9154	0.5954	0.9154	0.9568
No log	15.7857	442	0.9577	0.5984	0.9577	0.9786
No log	15.8571	444	0.9363	0.6190	0.9363	0.9676
No log	15.9286	446	0.9084	0.6299	0.9084	0.9531
No log	16.0	448	0.9426	0.5984	0.9426	0.9709
No log	16.0714	450	0.9957	0.6094	0.9957	0.9979
No log	16.1429	452	0.9823	0.6202	0.9823	0.9911
No log	16.2143	454	0.9482	0.6299	0.9482	0.9738
No log	16.2857	456	0.9429	0.5891	0.9429	0.9710
No log	16.3571	458	0.9620	0.5846	0.9620	0.9808
No log	16.4286	460	0.9177	0.5954	0.9177	0.9580
No log	16.5	462	0.8469	0.6308	0.8469	0.9203
No log	16.5714	464	0.8262	0.6565	0.8262	0.9090
No log	16.6429	466	0.7940	0.6462	0.7940	0.8911
No log	16.7143	468	0.7470	0.6970	0.7470	0.8643
No log	16.7857	470	0.7355	0.7111	0.7355	0.8576
No log	16.8571	472	0.7266	0.7111	0.7266	0.8524
No log	16.9286	474	0.7538	0.6970	0.7538	0.8682
No log	17.0	476	0.7914	0.6565	0.7914	0.8896
No log	17.0714	478	0.8429	0.6308	0.8429	0.9181
No log	17.1429	480	0.8647	0.6308	0.8647	0.9299
No log	17.2143	482	0.9007	0.6107	0.9007	0.9491
No log	17.2857	484	0.9078	0.6	0.9078	0.9528
No log	17.3571	486	0.9011	0.6107	0.9011	0.9493
No log	17.4286	488	0.8969	0.6202	0.8969	0.9470
No log	17.5	490	0.9213	0.6	0.9213	0.9599
No log	17.5714	492	0.9372	0.6	0.9372	0.9681
No log	17.6429	494	0.9087	0.6202	0.9087	0.9533
No log	17.7143	496	0.8717	0.6357	0.8717	0.9337
No log	17.7857	498	0.8360	0.6923	0.8360	0.9143
0.2947	17.8571	500	0.8148	0.6667	0.8148	0.9027
0.2947	17.9286	502	0.7973	0.6462	0.7973	0.8929
0.2947	18.0	504	0.7710	0.6917	0.7710	0.8781
0.2947	18.0714	506	0.7311	0.6870	0.7311	0.8550
0.2947	18.1429	508	0.7461	0.7007	0.7461	0.8637
0.2947	18.2143	510	0.7870	0.6525	0.7870	0.8871
0.2947	18.2857	512	0.7841	0.6767	0.7841	0.8855
0.2947	18.3571	514	0.7727	0.6615	0.7727	0.8790
0.2947	18.4286	516	0.8492	0.6032	0.8492	0.9215
0.2947	18.5	518	0.8906	0.5528	0.8906	0.9437
0.2947	18.5714	520	0.9130	0.5484	0.9130	0.9555
0.2947	18.6429	522	0.9175	0.6190	0.9175	0.9579

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1