ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6012
• Qwk: 0.4304
• Mse: 0.6012
• Rmse: 0.7754

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	4.1776	-0.0086	4.1776	2.0439
No log	0.1176	4	2.0640	0.0475	2.0640	1.4366
No log	0.1765	6	1.2156	0.0258	1.2156	1.1025
No log	0.2353	8	0.8662	0.0795	0.8662	0.9307
No log	0.2941	10	0.7985	0.3097	0.7985	0.8936
No log	0.3529	12	1.3170	-0.0067	1.3170	1.1476
No log	0.4118	14	2.3156	0.0320	2.3156	1.5217
No log	0.4706	16	1.8959	0.0553	1.8959	1.3769
No log	0.5294	18	1.1325	0.0553	1.1325	1.0642
No log	0.5882	20	0.8725	0.1284	0.8725	0.9341
No log	0.6471	22	0.8625	0.0917	0.8625	0.9287
No log	0.7059	24	0.8813	0.0501	0.8813	0.9388
No log	0.7647	26	0.9604	0.1016	0.9604	0.9800
No log	0.8235	28	0.8803	0.0852	0.8803	0.9382
No log	0.8824	30	0.8688	0.0967	0.8688	0.9321
No log	0.9412	32	0.8510	0.0736	0.8510	0.9225
No log	1.0	34	0.9197	0.1698	0.9197	0.9590
No log	1.0588	36	0.8707	0.1252	0.8707	0.9331
No log	1.1176	38	0.7870	0.1445	0.7870	0.8871
No log	1.1765	40	0.7996	0.1733	0.7996	0.8942
No log	1.2353	42	1.0060	0.1566	1.0060	1.0030
No log	1.2941	44	1.0013	0.1623	1.0013	1.0006
No log	1.3529	46	0.7722	0.1751	0.7722	0.8787
No log	1.4118	48	0.7574	0.3080	0.7574	0.8703
No log	1.4706	50	0.7627	0.3016	0.7627	0.8733
No log	1.5294	52	0.7027	0.2993	0.7027	0.8383
No log	1.5882	54	0.6729	0.3077	0.6729	0.8203
No log	1.6471	56	0.7279	0.2863	0.7279	0.8532
No log	1.7059	58	0.7117	0.4102	0.7117	0.8436
No log	1.7647	60	0.6943	0.4798	0.6943	0.8332
No log	1.8235	62	0.7370	0.4980	0.7370	0.8585
No log	1.8824	64	0.9082	0.4139	0.9082	0.9530
No log	1.9412	66	1.1647	0.3582	1.1647	1.0792
No log	2.0	68	1.2327	0.2875	1.2327	1.1103
No log	2.0588	70	1.0740	0.3297	1.0740	1.0363
No log	2.1176	72	0.7949	0.3249	0.7949	0.8916
No log	2.1765	74	0.7076	0.4651	0.7076	0.8412
No log	2.2353	76	0.6656	0.4639	0.6656	0.8159
No log	2.2941	78	0.6692	0.4614	0.6692	0.8180
No log	2.3529	80	0.7122	0.3553	0.7122	0.8439
No log	2.4118	82	0.6502	0.4605	0.6502	0.8063
No log	2.4706	84	0.6661	0.4744	0.6661	0.8162
No log	2.5294	86	0.7151	0.5226	0.7151	0.8456
No log	2.5882	88	0.6608	0.5005	0.6608	0.8129
No log	2.6471	90	0.8668	0.3806	0.8668	0.9310
No log	2.7059	92	0.8871	0.3651	0.8871	0.9418
No log	2.7647	94	0.7316	0.4698	0.7316	0.8554
No log	2.8235	96	0.7071	0.5054	0.7071	0.8409
No log	2.8824	98	0.6895	0.5123	0.6895	0.8303
No log	2.9412	100	0.6690	0.5075	0.6690	0.8179
No log	3.0	102	0.6807	0.5062	0.6807	0.8250
No log	3.0588	104	0.7328	0.4786	0.7328	0.8560
No log	3.1176	106	0.6807	0.5458	0.6807	0.8250
No log	3.1765	108	0.7082	0.5464	0.7082	0.8415
No log	3.2353	110	0.6832	0.5244	0.6832	0.8266
No log	3.2941	112	0.7716	0.5206	0.7716	0.8784
No log	3.3529	114	0.8697	0.4812	0.8697	0.9326
No log	3.4118	116	0.7077	0.5716	0.7077	0.8412
No log	3.4706	118	0.6656	0.5641	0.6656	0.8159
No log	3.5294	120	0.6927	0.5189	0.6927	0.8323
No log	3.5882	122	0.9228	0.4218	0.9228	0.9606
No log	3.6471	124	1.0237	0.3922	1.0237	1.0118
No log	3.7059	126	0.9119	0.4254	0.9119	0.9549
No log	3.7647	128	0.7191	0.5044	0.7191	0.8480
No log	3.8235	130	0.7166	0.4976	0.7166	0.8465
No log	3.8824	132	0.7405	0.5510	0.7405	0.8605
No log	3.9412	134	0.7579	0.5136	0.7579	0.8706
No log	4.0	136	0.7172	0.5102	0.7172	0.8469
No log	4.0588	138	0.7788	0.4393	0.7788	0.8825
No log	4.1176	140	0.7455	0.4199	0.7455	0.8634
No log	4.1765	142	0.6445	0.4123	0.6445	0.8028
No log	4.2353	144	0.7654	0.4278	0.7654	0.8748
No log	4.2941	146	0.8728	0.4279	0.8728	0.9343
No log	4.3529	148	0.7021	0.4441	0.7021	0.8379
No log	4.4118	150	0.7068	0.4355	0.7068	0.8407
No log	4.4706	152	0.8110	0.4807	0.8110	0.9005
No log	4.5294	154	0.7197	0.4815	0.7197	0.8484
No log	4.5882	156	0.6333	0.4692	0.6333	0.7958
No log	4.6471	158	0.6374	0.4686	0.6374	0.7984
No log	4.7059	160	0.6447	0.4840	0.6447	0.8029
No log	4.7647	162	0.6854	0.4479	0.6854	0.8279
No log	4.8235	164	0.7676	0.4818	0.7676	0.8761
No log	4.8824	166	0.7119	0.5076	0.7119	0.8437
No log	4.9412	168	0.7509	0.5365	0.7509	0.8666
No log	5.0	170	1.2404	0.3947	1.2404	1.1137
No log	5.0588	172	1.4635	0.3442	1.4635	1.2097
No log	5.1176	174	1.2429	0.4115	1.2429	1.1149
No log	5.1765	176	0.8451	0.5090	0.8451	0.9193
No log	5.2353	178	0.7432	0.5847	0.7432	0.8621
No log	5.2941	180	0.7644	0.4885	0.7644	0.8743
No log	5.3529	182	0.8169	0.4655	0.8169	0.9038
No log	5.4118	184	0.7150	0.4689	0.7150	0.8456
No log	5.4706	186	0.6139	0.4373	0.6139	0.7835
No log	5.5294	188	0.6540	0.4594	0.6540	0.8087
No log	5.5882	190	0.6858	0.4626	0.6858	0.8281
No log	5.6471	192	0.6583	0.4536	0.6583	0.8114
No log	5.7059	194	0.6435	0.4033	0.6435	0.8022
No log	5.7647	196	0.6481	0.4031	0.6481	0.8051
No log	5.8235	198	0.6663	0.4965	0.6663	0.8163
No log	5.8824	200	0.7655	0.5009	0.7655	0.8749
No log	5.9412	202	0.8198	0.4778	0.8198	0.9054
No log	6.0	204	0.7833	0.4883	0.7833	0.8850
No log	6.0588	206	0.7010	0.4686	0.7010	0.8372
No log	6.1176	208	0.6853	0.3938	0.6853	0.8278
No log	6.1765	210	0.6719	0.3945	0.6719	0.8197
No log	6.2353	212	0.6863	0.4112	0.6863	0.8284
No log	6.2941	214	0.7325	0.4166	0.7325	0.8559
No log	6.3529	216	0.7214	0.4008	0.7214	0.8494
No log	6.4118	218	0.6653	0.3928	0.6653	0.8156
No log	6.4706	220	0.6575	0.4467	0.6575	0.8109
No log	6.5294	222	0.6928	0.4259	0.6928	0.8323
No log	6.5882	224	0.6854	0.4266	0.6854	0.8279
No log	6.6471	226	0.6724	0.4247	0.6724	0.8200
No log	6.7059	228	0.6948	0.4984	0.6948	0.8336
No log	6.7647	230	0.6559	0.4282	0.6559	0.8098
No log	6.8235	232	0.6413	0.4151	0.6413	0.8008
No log	6.8824	234	0.7003	0.4907	0.7003	0.8369
No log	6.9412	236	0.7268	0.4671	0.7268	0.8525
No log	7.0	238	0.6587	0.4966	0.6587	0.8116
No log	7.0588	240	0.6321	0.4336	0.6321	0.7951
No log	7.1176	242	0.6748	0.4864	0.6748	0.8215
No log	7.1765	244	0.6522	0.4865	0.6522	0.8076
No log	7.2353	246	0.6493	0.4901	0.6493	0.8058
No log	7.2941	248	0.6258	0.4783	0.6258	0.7911
No log	7.3529	250	0.6501	0.4751	0.6501	0.8063
No log	7.4118	252	0.6403	0.4336	0.6403	0.8002
No log	7.4706	254	0.6088	0.4770	0.6088	0.7802
No log	7.5294	256	0.6730	0.5057	0.6730	0.8204
No log	7.5882	258	0.6831	0.4901	0.6831	0.8265
No log	7.6471	260	0.6599	0.4736	0.6599	0.8123
No log	7.7059	262	0.6474	0.4986	0.6474	0.8046
No log	7.7647	264	0.6569	0.5258	0.6569	0.8105
No log	7.8235	266	0.6549	0.4878	0.6549	0.8092
No log	7.8824	268	0.7270	0.4858	0.7270	0.8526
No log	7.9412	270	0.7459	0.4734	0.7459	0.8636
No log	8.0	272	0.7468	0.5055	0.7468	0.8642
No log	8.0588	274	0.7319	0.4874	0.7319	0.8555
No log	8.1176	276	0.6962	0.5046	0.6962	0.8344
No log	8.1765	278	0.7035	0.4996	0.7035	0.8388
No log	8.2353	280	0.6507	0.4895	0.6507	0.8067
No log	8.2941	282	0.6457	0.4879	0.6457	0.8036
No log	8.3529	284	0.7050	0.4556	0.7050	0.8396
No log	8.4118	286	0.7167	0.4525	0.7167	0.8466
No log	8.4706	288	0.6698	0.4751	0.6698	0.8184
No log	8.5294	290	0.6494	0.5476	0.6494	0.8058
No log	8.5882	292	0.6813	0.5218	0.6813	0.8254
No log	8.6471	294	0.6960	0.5194	0.6960	0.8343
No log	8.7059	296	0.6991	0.5102	0.6991	0.8361
No log	8.7647	298	0.7370	0.4988	0.7370	0.8585
No log	8.8235	300	0.7621	0.5256	0.7621	0.8730
No log	8.8824	302	0.7202	0.5152	0.7202	0.8487
No log	8.9412	304	0.6767	0.4870	0.6767	0.8226
No log	9.0	306	0.6579	0.4902	0.6579	0.8111
No log	9.0588	308	0.6510	0.4096	0.6510	0.8068
No log	9.1176	310	0.6249	0.4654	0.6249	0.7905
No log	9.1765	312	0.6357	0.5018	0.6357	0.7973
No log	9.2353	314	0.6273	0.5080	0.6273	0.7920
No log	9.2941	316	0.6206	0.4301	0.6206	0.7878
No log	9.3529	318	0.6271	0.4350	0.6271	0.7919
No log	9.4118	320	0.6325	0.4621	0.6325	0.7953
No log	9.4706	322	0.6726	0.5114	0.6726	0.8201
No log	9.5294	324	0.6673	0.5253	0.6673	0.8169
No log	9.5882	326	0.6694	0.4949	0.6694	0.8181
No log	9.6471	328	0.6633	0.4692	0.6633	0.8144
No log	9.7059	330	0.6710	0.4817	0.6710	0.8192
No log	9.7647	332	0.6573	0.4985	0.6573	0.8107
No log	9.8235	334	0.6376	0.4483	0.6376	0.7985
No log	9.8824	336	0.6408	0.4288	0.6408	0.8005
No log	9.9412	338	0.6375	0.4350	0.6375	0.7984
No log	10.0	340	0.6376	0.4727	0.6376	0.7985
No log	10.0588	342	0.6316	0.4788	0.6316	0.7947
No log	10.1176	344	0.6426	0.4327	0.6426	0.8016
No log	10.1765	346	0.6791	0.4564	0.6791	0.8240
No log	10.2353	348	0.6366	0.4654	0.6366	0.7978
No log	10.2941	350	0.6094	0.4949	0.6094	0.7806
No log	10.3529	352	0.6911	0.5014	0.6911	0.8313
No log	10.4118	354	0.7392	0.4984	0.7392	0.8598
No log	10.4706	356	0.6953	0.5550	0.6953	0.8338
No log	10.5294	358	0.6849	0.5318	0.6849	0.8276
No log	10.5882	360	0.7354	0.4439	0.7354	0.8576
No log	10.6471	362	0.7143	0.4439	0.7143	0.8452
No log	10.7059	364	0.6691	0.4945	0.6691	0.8180
No log	10.7647	366	0.6448	0.5041	0.6448	0.8030
No log	10.8235	368	0.6382	0.4731	0.6382	0.7989
No log	10.8824	370	0.6250	0.5114	0.6250	0.7906
No log	10.9412	372	0.6375	0.5101	0.6375	0.7985
No log	11.0	374	0.6250	0.5169	0.6250	0.7905
No log	11.0588	376	0.6292	0.5188	0.6292	0.7932
No log	11.1176	378	0.6915	0.52	0.6915	0.8316
No log	11.1765	380	0.6526	0.4975	0.6526	0.8079
No log	11.2353	382	0.6096	0.5178	0.6096	0.7808
No log	11.2941	384	0.6620	0.4899	0.6620	0.8136
No log	11.3529	386	0.6389	0.4619	0.6389	0.7993
No log	11.4118	388	0.5795	0.4916	0.5795	0.7612
No log	11.4706	390	0.5896	0.4691	0.5896	0.7678
No log	11.5294	392	0.5931	0.4754	0.5931	0.7701
No log	11.5882	394	0.5703	0.4683	0.5703	0.7552
No log	11.6471	396	0.6127	0.4532	0.6127	0.7828
No log	11.7059	398	0.7289	0.4651	0.7289	0.8538
No log	11.7647	400	0.7296	0.4651	0.7296	0.8541
No log	11.8235	402	0.6351	0.4622	0.6351	0.7969
No log	11.8824	404	0.5952	0.5031	0.5952	0.7715
No log	11.9412	406	0.6011	0.4235	0.6011	0.7753
No log	12.0	408	0.6435	0.4617	0.6435	0.8022
No log	12.0588	410	0.6787	0.5214	0.6787	0.8238
No log	12.1176	412	0.6681	0.4828	0.6681	0.8174
No log	12.1765	414	0.6851	0.5204	0.6851	0.8277
No log	12.2353	416	0.6944	0.5197	0.6944	0.8333
No log	12.2941	418	0.6480	0.4658	0.6480	0.8050
No log	12.3529	420	0.6326	0.4288	0.6326	0.7954
No log	12.4118	422	0.6631	0.4476	0.6631	0.8143
No log	12.4706	424	0.6426	0.4179	0.6426	0.8016
No log	12.5294	426	0.6048	0.3715	0.6048	0.7777
No log	12.5882	428	0.6072	0.3770	0.6072	0.7792
No log	12.6471	430	0.6075	0.3950	0.6075	0.7794
No log	12.7059	432	0.6127	0.4543	0.6127	0.7827
No log	12.7647	434	0.6174	0.4819	0.6174	0.7858
No log	12.8235	436	0.6433	0.5110	0.6433	0.8021
No log	12.8824	438	0.6502	0.5060	0.6502	0.8063
No log	12.9412	440	0.6622	0.4964	0.6622	0.8138
No log	13.0	442	0.6519	0.5015	0.6519	0.8074
No log	13.0588	444	0.6269	0.4763	0.6269	0.7918
No log	13.1176	446	0.6174	0.4356	0.6174	0.7858
No log	13.1765	448	0.6363	0.4550	0.6363	0.7977
No log	13.2353	450	0.6288	0.4302	0.6288	0.7930
No log	13.2941	452	0.6136	0.4367	0.6136	0.7833
No log	13.3529	454	0.6147	0.4601	0.6147	0.7840
No log	13.4118	456	0.6344	0.4773	0.6344	0.7965
No log	13.4706	458	0.6431	0.4949	0.6431	0.8019
No log	13.5294	460	0.6332	0.4891	0.6332	0.7957
No log	13.5882	462	0.6166	0.3949	0.6166	0.7852
No log	13.6471	464	0.6207	0.4222	0.6207	0.7879
No log	13.7059	466	0.6297	0.4377	0.6297	0.7935
No log	13.7647	468	0.6171	0.3756	0.6171	0.7855
No log	13.8235	470	0.6051	0.3859	0.6051	0.7779
No log	13.8824	472	0.5902	0.4465	0.5902	0.7683
No log	13.9412	474	0.5911	0.4440	0.5911	0.7688
No log	14.0	476	0.5921	0.4473	0.5921	0.7694
No log	14.0588	478	0.6007	0.4664	0.6007	0.7751
No log	14.1176	480	0.6040	0.4762	0.6040	0.7772
No log	14.1765	482	0.5975	0.4505	0.5975	0.7730
No log	14.2353	484	0.6123	0.5279	0.6123	0.7825
No log	14.2941	486	0.6311	0.5073	0.6311	0.7944
No log	14.3529	488	0.6397	0.5005	0.6397	0.7998
No log	14.4118	490	0.6378	0.4804	0.6378	0.7986
No log	14.4706	492	0.6735	0.5288	0.6735	0.8207
No log	14.5294	494	0.7709	0.5238	0.7709	0.8780
No log	14.5882	496	0.7486	0.5284	0.7486	0.8652
No log	14.6471	498	0.6481	0.5165	0.6481	0.8051
0.3472	14.7059	500	0.6135	0.4558	0.6135	0.7833
0.3472	14.7647	502	0.6497	0.4507	0.6497	0.8060
0.3472	14.8235	504	0.6732	0.4814	0.6732	0.8205
0.3472	14.8824	506	0.6388	0.4554	0.6388	0.7993
0.3472	14.9412	508	0.5919	0.4372	0.5919	0.7694
0.3472	15.0	510	0.5992	0.5241	0.5992	0.7741
0.3472	15.0588	512	0.6707	0.5201	0.6707	0.8189
0.3472	15.1176	514	0.7506	0.4754	0.7506	0.8663
0.3472	15.1765	516	0.7398	0.4871	0.7398	0.8601
0.3472	15.2353	518	0.6702	0.5496	0.6702	0.8187
0.3472	15.2941	520	0.6259	0.5177	0.6259	0.7911
0.3472	15.3529	522	0.6421	0.4414	0.6421	0.8013
0.3472	15.4118	524	0.6260	0.4667	0.6260	0.7912
0.3472	15.4706	526	0.6078	0.5141	0.6078	0.7796
0.3472	15.5294	528	0.6003	0.5145	0.6003	0.7748
0.3472	15.5882	530	0.6007	0.4351	0.6007	0.7750
0.3472	15.6471	532	0.5991	0.3782	0.5991	0.7740
0.3472	15.7059	534	0.5926	0.4497	0.5926	0.7698
0.3472	15.7647	536	0.5982	0.5035	0.5982	0.7734
0.3472	15.8235	538	0.6154	0.48	0.6154	0.7845
0.3472	15.8824	540	0.6232	0.5025	0.6232	0.7894
0.3472	15.9412	542	0.6033	0.4903	0.6033	0.7767
0.3472	16.0	544	0.5986	0.4951	0.5986	0.7737
0.3472	16.0588	546	0.6025	0.4428	0.6025	0.7762
0.3472	16.1176	548	0.5921	0.4349	0.5921	0.7695
0.3472	16.1765	550	0.5922	0.5027	0.5922	0.7695
0.3472	16.2353	552	0.5904	0.4284	0.5904	0.7684
0.3472	16.2941	554	0.5926	0.4284	0.5926	0.7698
0.3472	16.3529	556	0.5969	0.3970	0.5969	0.7726
0.3472	16.4118	558	0.5993	0.4173	0.5993	0.7741
0.3472	16.4706	560	0.6012	0.4304	0.6012	0.7754

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1