ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0717
• Qwk: 0.5210
• Mse: 1.0717
• Rmse: 1.0352

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0645	2	5.4878	-0.0073	5.4878	2.3426
No log	0.1290	4	3.2883	0.0619	3.2883	1.8134
No log	0.1935	6	2.6796	-0.0394	2.6796	1.6369
No log	0.2581	8	1.7153	0.0885	1.7153	1.3097
No log	0.3226	10	1.2091	0.2000	1.2091	1.0996
No log	0.3871	12	1.2137	0.1813	1.2137	1.1017
No log	0.4516	14	1.2229	0.1792	1.2229	1.1058
No log	0.5161	16	1.1990	0.1497	1.1990	1.0950
No log	0.5806	18	1.1663	0.1707	1.1663	1.0800
No log	0.6452	20	1.2046	0.3516	1.2046	1.0975
No log	0.7097	22	1.3029	0.1405	1.3029	1.1414
No log	0.7742	24	1.3323	0.1242	1.3323	1.1542
No log	0.8387	26	1.2171	0.3439	1.2171	1.1032
No log	0.9032	28	1.1684	0.2875	1.1684	1.0809
No log	0.9677	30	1.1166	0.2856	1.1166	1.0567
No log	1.0323	32	1.1178	0.1621	1.1178	1.0573
No log	1.0968	34	1.1983	0.1411	1.1983	1.0946
No log	1.1613	36	1.2365	0.1217	1.2365	1.1120
No log	1.2258	38	1.2202	0.1344	1.2202	1.1046
No log	1.2903	40	1.2041	0.1706	1.2041	1.0973
No log	1.3548	42	1.2860	0.2611	1.2860	1.1340
No log	1.4194	44	1.3961	0.2275	1.3961	1.1816
No log	1.4839	46	1.3779	0.2381	1.3779	1.1738
No log	1.5484	48	1.2382	0.2102	1.2382	1.1127
No log	1.6129	50	1.0767	0.2818	1.0767	1.0376
No log	1.6774	52	1.0450	0.3698	1.0450	1.0223
No log	1.7419	54	1.1364	0.2287	1.1364	1.0660
No log	1.8065	56	1.1958	0.1896	1.1958	1.0935
No log	1.8710	58	1.1323	0.2363	1.1323	1.0641
No log	1.9355	60	0.9889	0.4073	0.9889	0.9944
No log	2.0	62	0.9717	0.3772	0.9717	0.9857
No log	2.0645	64	1.1862	0.2687	1.1862	1.0891
No log	2.1290	66	1.4989	0.0758	1.4989	1.2243
No log	2.1935	68	1.6998	0.0866	1.6998	1.3038
No log	2.2581	70	1.5593	0.0691	1.5593	1.2487
No log	2.3226	72	1.0946	0.2860	1.0946	1.0462
No log	2.3871	74	0.9872	0.3654	0.9872	0.9936
No log	2.4516	76	0.9629	0.4061	0.9629	0.9813
No log	2.5161	78	1.0026	0.3873	1.0026	1.0013
No log	2.5806	80	1.1688	0.3629	1.1688	1.0811
No log	2.6452	82	1.2914	0.3321	1.2914	1.1364
No log	2.7097	84	1.2285	0.3745	1.2285	1.1084
No log	2.7742	86	1.1038	0.4361	1.1038	1.0506
No log	2.8387	88	0.9409	0.4194	0.9409	0.9700
No log	2.9032	90	0.8542	0.4062	0.8542	0.9242
No log	2.9677	92	0.8368	0.4522	0.8368	0.9148
No log	3.0323	94	0.8371	0.4812	0.8371	0.9149
No log	3.0968	96	0.8007	0.4844	0.8007	0.8948
No log	3.1613	98	0.7897	0.4986	0.7897	0.8886
No log	3.2258	100	0.9089	0.4374	0.9089	0.9533
No log	3.2903	102	1.0062	0.4339	1.0062	1.0031
No log	3.3548	104	1.0108	0.4403	1.0108	1.0054
No log	3.4194	106	0.9825	0.4874	0.9825	0.9912
No log	3.4839	108	0.8907	0.4968	0.8907	0.9438
No log	3.5484	110	0.8488	0.4965	0.8488	0.9213
No log	3.6129	112	0.8457	0.5571	0.8457	0.9196
No log	3.6774	114	0.9283	0.4983	0.9283	0.9635
No log	3.7419	116	1.1184	0.4645	1.1184	1.0575
No log	3.8065	118	1.2237	0.4732	1.2237	1.1062
No log	3.8710	120	1.1600	0.4885	1.1600	1.0770
No log	3.9355	122	1.0223	0.5076	1.0223	1.0111
No log	4.0	124	0.9022	0.5261	0.9022	0.9498
No log	4.0645	126	0.8183	0.5631	0.8183	0.9046
No log	4.1290	128	0.8635	0.5617	0.8635	0.9293
No log	4.1935	130	0.8729	0.5546	0.8729	0.9343
No log	4.2581	132	0.9242	0.5094	0.9242	0.9614
No log	4.3226	134	0.9707	0.4924	0.9707	0.9852
No log	4.3871	136	1.0126	0.4896	1.0126	1.0063
No log	4.4516	138	0.9239	0.4867	0.9239	0.9612
No log	4.5161	140	0.8999	0.4769	0.8999	0.9486
No log	4.5806	142	0.8627	0.5106	0.8627	0.9288
No log	4.6452	144	0.8458	0.5152	0.8458	0.9197
No log	4.7097	146	0.8543	0.5659	0.8543	0.9243
No log	4.7742	148	0.9049	0.5452	0.9049	0.9512
No log	4.8387	150	0.9913	0.5280	0.9913	0.9957
No log	4.9032	152	1.0190	0.5054	1.0190	1.0094
No log	4.9677	154	0.9733	0.5347	0.9733	0.9866
No log	5.0323	156	0.9989	0.5547	0.9989	0.9994
No log	5.0968	158	0.9333	0.5824	0.9333	0.9661
No log	5.1613	160	0.9604	0.5311	0.9604	0.9800
No log	5.2258	162	1.0075	0.5293	1.0075	1.0037
No log	5.2903	164	0.9964	0.5100	0.9964	0.9982
No log	5.3548	166	0.9366	0.5411	0.9366	0.9678
No log	5.4194	168	0.7955	0.5714	0.7955	0.8919
No log	5.4839	170	0.7352	0.6124	0.7352	0.8575
No log	5.5484	172	0.7105	0.5784	0.7105	0.8429
No log	5.6129	174	0.7249	0.5858	0.7249	0.8514
No log	5.6774	176	0.7241	0.5971	0.7241	0.8510
No log	5.7419	178	0.7458	0.5849	0.7458	0.8636
No log	5.8065	180	0.8045	0.5699	0.8045	0.8969
No log	5.8710	182	0.8857	0.5730	0.8857	0.9411
No log	5.9355	184	0.9461	0.5288	0.9461	0.9727
No log	6.0	186	1.0612	0.5405	1.0612	1.0302
No log	6.0645	188	1.1569	0.5511	1.1569	1.0756
No log	6.1290	190	1.0730	0.5134	1.0730	1.0358
No log	6.1935	192	0.9088	0.5321	0.9088	0.9533
No log	6.2581	194	0.8937	0.5428	0.8937	0.9454
No log	6.3226	196	0.8966	0.5362	0.8966	0.9469
No log	6.3871	198	0.9494	0.5337	0.9494	0.9744
No log	6.4516	200	0.9730	0.5227	0.9730	0.9864
No log	6.5161	202	0.9174	0.5564	0.9174	0.9578
No log	6.5806	204	0.9357	0.5344	0.9357	0.9673
No log	6.6452	206	1.0088	0.5426	1.0088	1.0044
No log	6.7097	208	1.0004	0.5302	1.0004	1.0002
No log	6.7742	210	0.9406	0.5467	0.9406	0.9698
No log	6.8387	212	0.9208	0.5823	0.9208	0.9596
No log	6.9032	214	1.0069	0.5492	1.0069	1.0034
No log	6.9677	216	1.0548	0.5279	1.0548	1.0270
No log	7.0323	218	1.0300	0.5369	1.0300	1.0149
No log	7.0968	220	0.9344	0.5104	0.9344	0.9666
No log	7.1613	222	0.8723	0.4443	0.8723	0.9340
No log	7.2258	224	0.8386	0.4838	0.8386	0.9157
No log	7.2903	226	0.8423	0.5640	0.8423	0.9178
No log	7.3548	228	0.8649	0.5874	0.8649	0.9300
No log	7.4194	230	0.8475	0.5493	0.8475	0.9206
No log	7.4839	232	0.8234	0.5622	0.8234	0.9074
No log	7.5484	234	0.8356	0.5667	0.8356	0.9141
No log	7.6129	236	0.9230	0.5240	0.9230	0.9608
No log	7.6774	238	1.1467	0.4814	1.1467	1.0708
No log	7.7419	240	1.1990	0.4989	1.1990	1.0950
No log	7.8065	242	0.9952	0.5321	0.9952	0.9976
No log	7.8710	244	0.7831	0.6274	0.7831	0.8849
No log	7.9355	246	0.6877	0.6311	0.6877	0.8293
No log	8.0	248	0.6841	0.6385	0.6841	0.8271
No log	8.0645	250	0.7016	0.6394	0.7016	0.8376
No log	8.1290	252	0.7418	0.6641	0.7418	0.8613
No log	8.1935	254	0.8539	0.5811	0.8539	0.9241
No log	8.2581	256	1.0331	0.5266	1.0331	1.0164
No log	8.3226	258	1.1504	0.4929	1.1504	1.0726
No log	8.3871	260	1.1977	0.4557	1.1977	1.0944
No log	8.4516	262	1.0761	0.5260	1.0761	1.0373
No log	8.5161	264	0.9649	0.5380	0.9649	0.9823
No log	8.5806	266	0.8572	0.5584	0.8572	0.9258
No log	8.6452	268	0.8349	0.4999	0.8349	0.9137
No log	8.7097	270	0.8044	0.5568	0.8044	0.8969
No log	8.7742	272	0.8041	0.6067	0.8041	0.8967
No log	8.8387	274	0.8570	0.5956	0.8570	0.9257
No log	8.9032	276	0.9123	0.5693	0.9123	0.9551
No log	8.9677	278	0.8667	0.5903	0.8667	0.9310
No log	9.0323	280	0.8471	0.5772	0.8471	0.9204
No log	9.0968	282	0.8699	0.5811	0.8699	0.9327
No log	9.1613	284	0.8758	0.5952	0.8758	0.9359
No log	9.2258	286	0.7969	0.6412	0.7969	0.8927
No log	9.2903	288	0.7731	0.6163	0.7731	0.8793
No log	9.3548	290	0.8166	0.5931	0.8166	0.9037
No log	9.4194	292	0.9220	0.5718	0.9220	0.9602
No log	9.4839	294	1.0252	0.5351	1.0252	1.0125
No log	9.5484	296	1.0595	0.5156	1.0595	1.0293
No log	9.6129	298	0.9954	0.5633	0.9954	0.9977
No log	9.6774	300	0.8702	0.6287	0.8702	0.9329
No log	9.7419	302	0.7884	0.6180	0.7884	0.8879
No log	9.8065	304	0.7947	0.6082	0.7947	0.8914
No log	9.8710	306	0.8648	0.6183	0.8648	0.9299
No log	9.9355	308	1.0149	0.5586	1.0149	1.0074
No log	10.0	310	1.2217	0.4996	1.2217	1.1053
No log	10.0645	312	1.2480	0.5222	1.2480	1.1171
No log	10.1290	314	1.1043	0.5244	1.1043	1.0509
No log	10.1935	316	0.9393	0.5615	0.9393	0.9692
No log	10.2581	318	0.9310	0.5614	0.9310	0.9649
No log	10.3226	320	0.9685	0.5356	0.9685	0.9841
No log	10.3871	322	1.0994	0.5239	1.0994	1.0485
No log	10.4516	324	1.0896	0.5253	1.0896	1.0438
No log	10.5161	326	0.9809	0.5436	0.9809	0.9904
No log	10.5806	328	0.8740	0.5677	0.8740	0.9349
No log	10.6452	330	0.8130	0.5955	0.8130	0.9017
No log	10.7097	332	0.8128	0.6003	0.8128	0.9016
No log	10.7742	334	0.8928	0.5849	0.8928	0.9449
No log	10.8387	336	0.9324	0.5832	0.9324	0.9656
No log	10.9032	338	0.8823	0.6059	0.8823	0.9393
No log	10.9677	340	0.8197	0.6225	0.8197	0.9053
No log	11.0323	342	0.8270	0.6112	0.8270	0.9094
No log	11.0968	344	0.8771	0.5607	0.8771	0.9365
No log	11.1613	346	0.8931	0.5607	0.8931	0.9450
No log	11.2258	348	0.9069	0.5744	0.9069	0.9523
No log	11.2903	350	0.8908	0.5744	0.8908	0.9438
No log	11.3548	352	0.8778	0.5894	0.8778	0.9369
No log	11.4194	354	0.9778	0.5602	0.9778	0.9888
No log	11.4839	356	1.0783	0.5203	1.0783	1.0384
No log	11.5484	358	1.0105	0.5606	1.0105	1.0052
No log	11.6129	360	0.9094	0.5932	0.9094	0.9536
No log	11.6774	362	0.8010	0.6109	0.8010	0.8950
No log	11.7419	364	0.7705	0.5944	0.7705	0.8778
No log	11.8065	366	0.8210	0.5899	0.8210	0.9061
No log	11.8710	368	0.9712	0.5840	0.9712	0.9855
No log	11.9355	370	1.0708	0.5177	1.0708	1.0348
No log	12.0	372	1.0695	0.5495	1.0695	1.0342
No log	12.0645	374	0.9846	0.6000	0.9846	0.9923
No log	12.1290	376	0.9426	0.6000	0.9426	0.9709
No log	12.1935	378	0.9589	0.5840	0.9589	0.9792
No log	12.2581	380	0.9857	0.5571	0.9857	0.9928
No log	12.3226	382	0.9326	0.5555	0.9326	0.9657
No log	12.3871	384	0.8546	0.5559	0.8546	0.9245
No log	12.4516	386	0.8255	0.6062	0.8255	0.9086
No log	12.5161	388	0.8255	0.6089	0.8255	0.9086
No log	12.5806	390	0.8885	0.6080	0.8885	0.9426
No log	12.6452	392	0.9863	0.5654	0.9863	0.9931
No log	12.7097	394	1.0113	0.5456	1.0113	1.0056
No log	12.7742	396	0.9059	0.5534	0.9059	0.9518
No log	12.8387	398	0.7944	0.5771	0.7944	0.8913
No log	12.9032	400	0.7515	0.5574	0.7515	0.8669
No log	12.9677	402	0.7524	0.5922	0.7524	0.8674
No log	13.0323	404	0.7863	0.6169	0.7863	0.8867
No log	13.0968	406	0.9169	0.5950	0.9169	0.9575
No log	13.1613	408	1.1658	0.5360	1.1658	1.0797
No log	13.2258	410	1.3745	0.5360	1.3745	1.1724
No log	13.2903	412	1.6134	0.4656	1.6134	1.2702
No log	13.3548	414	1.6416	0.4469	1.6416	1.2812
No log	13.4194	416	1.4253	0.4547	1.4253	1.1938
No log	13.4839	418	1.1519	0.5109	1.1519	1.0733
No log	13.5484	420	1.0055	0.5469	1.0055	1.0028
No log	13.6129	422	0.9269	0.5795	0.9269	0.9628
No log	13.6774	424	0.8795	0.5966	0.8795	0.9378
No log	13.7419	426	0.8791	0.5832	0.8791	0.9376
No log	13.8065	428	0.9165	0.5661	0.9165	0.9573
No log	13.8710	430	0.9988	0.5228	0.9988	0.9994
No log	13.9355	432	1.1214	0.4883	1.1214	1.0590
No log	14.0	434	1.2434	0.4560	1.2434	1.1151
No log	14.0645	436	1.2273	0.4411	1.2273	1.1078
No log	14.1290	438	1.1408	0.5218	1.1408	1.0681
No log	14.1935	440	1.0965	0.5241	1.0965	1.0471
No log	14.2581	442	0.9759	0.5372	0.9759	0.9879
No log	14.3226	444	0.8903	0.5798	0.8903	0.9435
No log	14.3871	446	0.8160	0.6321	0.8160	0.9033
No log	14.4516	448	0.7688	0.6422	0.7688	0.8768
No log	14.5161	450	0.7902	0.6368	0.7902	0.8889
No log	14.5806	452	0.8702	0.6378	0.8702	0.9329
No log	14.6452	454	0.9572	0.6098	0.9572	0.9784
No log	14.7097	456	0.8996	0.6052	0.8996	0.9485
No log	14.7742	458	0.8038	0.6189	0.8038	0.8966
No log	14.8387	460	0.7390	0.6468	0.7390	0.8597
No log	14.9032	462	0.7483	0.5988	0.7483	0.8651
No log	14.9677	464	0.7761	0.6030	0.7761	0.8809
No log	15.0323	466	0.8686	0.6039	0.8686	0.9320
No log	15.0968	468	0.9278	0.6006	0.9278	0.9632
No log	15.1613	470	0.9083	0.6006	0.9083	0.9530
No log	15.2258	472	0.7902	0.6291	0.7902	0.8889
No log	15.2903	474	0.7104	0.6098	0.7104	0.8429
No log	15.3548	476	0.7122	0.6191	0.7122	0.8439
No log	15.4194	478	0.7855	0.6160	0.7855	0.8863
No log	15.4839	480	0.9298	0.6186	0.9298	0.9643
No log	15.5484	482	1.0844	0.5941	1.0844	1.0414
No log	15.6129	484	1.0826	0.5875	1.0826	1.0405
No log	15.6774	486	0.9655	0.5695	0.9655	0.9826
No log	15.7419	488	0.8430	0.5981	0.8430	0.9181
No log	15.8065	490	0.7720	0.5855	0.7720	0.8786
No log	15.8710	492	0.7562	0.56	0.7562	0.8696
No log	15.9355	494	0.7764	0.5630	0.7764	0.8811
No log	16.0	496	0.8591	0.5785	0.8591	0.9269
No log	16.0645	498	0.9595	0.5333	0.9595	0.9795
0.4303	16.1290	500	0.9994	0.5221	0.9994	0.9997
0.4303	16.1935	502	1.0395	0.4970	1.0395	1.0196
0.4303	16.2581	504	1.0211	0.4917	1.0211	1.0105
0.4303	16.3226	506	0.9750	0.5168	0.9750	0.9874
0.4303	16.3871	508	0.9158	0.5435	0.9158	0.9570
0.4303	16.4516	510	0.8893	0.5399	0.8893	0.9430
0.4303	16.5161	512	0.8627	0.5662	0.8627	0.9288
0.4303	16.5806	514	0.8353	0.5867	0.8353	0.9140
0.4303	16.6452	516	0.8611	0.5849	0.8611	0.9280
0.4303	16.7097	518	0.9113	0.5845	0.9113	0.9546
0.4303	16.7742	520	1.0035	0.5613	1.0035	1.0017
0.4303	16.8387	522	1.0736	0.5629	1.0736	1.0361
0.4303	16.9032	524	1.0638	0.5604	1.0638	1.0314
0.4303	16.9677	526	1.0240	0.5732	1.0240	1.0119
0.4303	17.0323	528	0.9063	0.5921	0.9063	0.9520
0.4303	17.0968	530	0.8424	0.5785	0.8424	0.9178
0.4303	17.1613	532	0.8014	0.5962	0.8014	0.8952
0.4303	17.2258	534	0.7877	0.5853	0.7877	0.8875
0.4303	17.2903	536	0.8181	0.5825	0.8181	0.9045
0.4303	17.3548	538	0.8974	0.5884	0.8974	0.9473
0.4303	17.4194	540	0.9445	0.5731	0.9445	0.9718
0.4303	17.4839	542	0.9875	0.5556	0.9875	0.9937
0.4303	17.5484	544	0.9694	0.5528	0.9694	0.9846
0.4303	17.6129	546	0.8771	0.5664	0.8771	0.9366
0.4303	17.6774	548	0.7888	0.55	0.7888	0.8881
0.4303	17.7419	550	0.7748	0.55	0.7748	0.8802
0.4303	17.8065	552	0.7930	0.5644	0.7930	0.8905
0.4303	17.8710	554	0.8690	0.6045	0.8690	0.9322
0.4303	17.9355	556	0.9118	0.5910	0.9118	0.9549
0.4303	18.0	558	0.9810	0.5718	0.9810	0.9904
0.4303	18.0645	560	0.9896	0.5524	0.9896	0.9948
0.4303	18.1290	562	0.9705	0.5705	0.9705	0.9851
0.4303	18.1935	564	0.8917	0.5971	0.8917	0.9443
0.4303	18.2581	566	0.8401	0.5728	0.8401	0.9166
0.4303	18.3226	568	0.8446	0.5518	0.8446	0.9190
0.4303	18.3871	570	0.8835	0.5225	0.8835	0.9400
0.4303	18.4516	572	0.9539	0.5625	0.9539	0.9767
0.4303	18.5161	574	0.9916	0.5412	0.9916	0.9958
0.4303	18.5806	576	0.9598	0.5397	0.9598	0.9797
0.4303	18.6452	578	0.8706	0.6222	0.8706	0.9331
0.4303	18.7097	580	0.8283	0.6202	0.8283	0.9101
0.4303	18.7742	582	0.8258	0.6260	0.8258	0.9088
0.4303	18.8387	584	0.8523	0.5911	0.8523	0.9232
0.4303	18.9032	586	0.9221	0.5873	0.9221	0.9603
0.4303	18.9677	588	1.0363	0.5220	1.0363	1.0180
0.4303	19.0323	590	1.1833	0.4995	1.1833	1.0878
0.4303	19.0968	592	1.1971	0.5018	1.1971	1.0941
0.4303	19.1613	594	1.0941	0.5176	1.0941	1.0460
0.4303	19.2258	596	0.9694	0.5719	0.9694	0.9846
0.4303	19.2903	598	0.8833	0.5824	0.8833	0.9399
0.4303	19.3548	600	0.8424	0.5550	0.8424	0.9178
0.4303	19.4194	602	0.8489	0.5617	0.8489	0.9214
0.4303	19.4839	604	0.9053	0.5810	0.9053	0.9515
0.4303	19.5484	606	1.0141	0.5307	1.0141	1.0070
0.4303	19.6129	608	1.1657	0.5031	1.1657	1.0797
0.4303	19.6774	610	1.2611	0.4836	1.2611	1.1230
0.4303	19.7419	612	1.2093	0.5094	1.2093	1.0997
0.4303	19.8065	614	1.0689	0.5493	1.0689	1.0339
0.4303	19.8710	616	0.8874	0.5838	0.8874	0.9420
0.4303	19.9355	618	0.7762	0.5626	0.7762	0.8810
0.4303	20.0	620	0.7514	0.5770	0.7514	0.8668
0.4303	20.0645	622	0.7808	0.5870	0.7808	0.8836
0.4303	20.1290	624	0.8680	0.5887	0.8680	0.9317
0.4303	20.1935	626	0.9938	0.5555	0.9938	0.9969
0.4303	20.2581	628	1.1028	0.5038	1.1028	1.0501
0.4303	20.3226	630	1.1877	0.4850	1.1877	1.0898
0.4303	20.3871	632	1.1581	0.5031	1.1581	1.0761
0.4303	20.4516	634	1.1278	0.4903	1.1278	1.0620
0.4303	20.5161	636	1.0717	0.5210	1.0717	1.0352

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1