ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3533
• Qwk: 0.4994
• Mse: 1.3533
• Rmse: 1.1633

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0339	2	5.2326	-0.0147	5.2326	2.2875
No log	0.0678	4	3.0918	0.0659	3.0918	1.7583
No log	0.1017	6	2.4627	-0.1058	2.4627	1.5693
No log	0.1356	8	2.0271	0.0071	2.0271	1.4238
No log	0.1695	10	1.9128	-0.0444	1.9128	1.3830
No log	0.2034	12	1.3670	0.0857	1.3670	1.1692
No log	0.2373	14	1.1954	0.1322	1.1954	1.0934
No log	0.2712	16	1.4155	0.0526	1.4155	1.1897
No log	0.3051	18	2.4510	0.0750	2.4510	1.5656
No log	0.3390	20	2.7358	0.0585	2.7358	1.6540
No log	0.3729	22	2.3245	0.1344	2.3245	1.5246
No log	0.4068	24	1.8033	0.0263	1.8033	1.3429
No log	0.4407	26	1.4287	0.0156	1.4287	1.1953
No log	0.4746	28	1.3149	0.1685	1.3149	1.1467
No log	0.5085	30	1.2827	0.1994	1.2827	1.1326
No log	0.5424	32	1.2721	0.0465	1.2721	1.1279
No log	0.5763	34	1.2778	0.0233	1.2778	1.1304
No log	0.6102	36	1.2601	0.1310	1.2601	1.1226
No log	0.6441	38	1.2539	0.2661	1.2539	1.1198
No log	0.6780	40	1.2549	0.2150	1.2549	1.1202
No log	0.7119	42	1.2313	0.2469	1.2313	1.1097
No log	0.7458	44	1.2203	0.2959	1.2203	1.1047
No log	0.7797	46	1.1737	0.2926	1.1737	1.0834
No log	0.8136	48	1.1391	0.2386	1.1391	1.0673
No log	0.8475	50	1.1253	0.2825	1.1253	1.0608
No log	0.8814	52	1.1648	0.3280	1.1648	1.0793
No log	0.9153	54	1.2075	0.2656	1.2075	1.0989
No log	0.9492	56	1.2158	0.2824	1.2158	1.1026
No log	0.9831	58	1.1895	0.2650	1.1895	1.0906
No log	1.0169	60	1.1239	0.3510	1.1239	1.0601
No log	1.0508	62	1.0536	0.3482	1.0536	1.0265
No log	1.0847	64	1.0377	0.3362	1.0377	1.0187
No log	1.1186	66	0.9938	0.3643	0.9938	0.9969
No log	1.1525	68	0.9772	0.3072	0.9772	0.9885
No log	1.1864	70	0.9987	0.3768	0.9987	0.9994
No log	1.2203	72	1.1554	0.3505	1.1554	1.0749
No log	1.2542	74	1.2927	0.3705	1.2927	1.1370
No log	1.2881	76	1.2559	0.3594	1.2559	1.1207
No log	1.3220	78	1.1512	0.3263	1.1512	1.0729
No log	1.3559	80	1.0645	0.2888	1.0645	1.0317
No log	1.3898	82	0.9866	0.3947	0.9866	0.9933
No log	1.4237	84	0.9347	0.4527	0.9347	0.9668
No log	1.4576	86	1.0407	0.4996	1.0407	1.0201
No log	1.4915	88	1.2276	0.3877	1.2276	1.1080
No log	1.5254	90	1.0849	0.4955	1.0849	1.0416
No log	1.5593	92	1.0418	0.5037	1.0418	1.0207
No log	1.5932	94	1.1110	0.4608	1.1110	1.0540
No log	1.6271	96	1.1195	0.4824	1.1195	1.0580
No log	1.6610	98	0.9967	0.5192	0.9967	0.9983
No log	1.6949	100	0.8643	0.5799	0.8643	0.9297
No log	1.7288	102	0.7471	0.5938	0.7471	0.8644
No log	1.7627	104	0.7118	0.6162	0.7118	0.8437
No log	1.7966	106	0.6998	0.6146	0.6998	0.8366
No log	1.8305	108	0.7321	0.5963	0.7321	0.8556
No log	1.8644	110	0.6843	0.6421	0.6843	0.8272
No log	1.8983	112	0.6819	0.6480	0.6819	0.8258
No log	1.9322	114	0.6649	0.6137	0.6649	0.8154
No log	1.9661	116	0.7138	0.6076	0.7138	0.8449
No log	2.0	118	0.7279	0.6101	0.7279	0.8532
No log	2.0339	120	0.7895	0.6224	0.7895	0.8885
No log	2.0678	122	0.8907	0.6020	0.8907	0.9437
No log	2.1017	124	1.0111	0.5447	1.0111	1.0055
No log	2.1356	126	0.9999	0.5398	0.9999	1.0000
No log	2.1695	128	0.8570	0.5584	0.8570	0.9257
No log	2.2034	130	0.8484	0.5023	0.8484	0.9211
No log	2.2373	132	0.8472	0.5471	0.8472	0.9204
No log	2.2712	134	0.9018	0.5437	0.9018	0.9496
No log	2.3051	136	1.0905	0.4883	1.0905	1.0443
No log	2.3390	138	1.2307	0.4575	1.2307	1.1094
No log	2.3729	140	1.0871	0.4967	1.0871	1.0427
No log	2.4068	142	0.8962	0.5050	0.8962	0.9467
No log	2.4407	144	0.8625	0.4744	0.8625	0.9287
No log	2.4746	146	0.8391	0.4638	0.8391	0.9160
No log	2.5085	148	0.8404	0.5155	0.8404	0.9167
No log	2.5424	150	0.9194	0.5656	0.9194	0.9589
No log	2.5763	152	0.9775	0.5541	0.9775	0.9887
No log	2.6102	154	0.9574	0.5602	0.9574	0.9785
No log	2.6441	156	0.9934	0.5693	0.9934	0.9967
No log	2.6780	158	1.0635	0.5274	1.0635	1.0312
No log	2.7119	160	1.0222	0.5323	1.0222	1.0110
No log	2.7458	162	0.9513	0.6077	0.9513	0.9754
No log	2.7797	164	0.8758	0.6193	0.8758	0.9358
No log	2.8136	166	0.8201	0.5976	0.8201	0.9056
No log	2.8475	168	0.7956	0.5932	0.7956	0.8920
No log	2.8814	170	0.7916	0.5723	0.7916	0.8897
No log	2.9153	172	0.7597	0.5851	0.7597	0.8716
No log	2.9492	174	0.7548	0.6137	0.7548	0.8688
No log	2.9831	176	0.8655	0.5998	0.8655	0.9303
No log	3.0169	178	1.0912	0.5226	1.0912	1.0446
No log	3.0508	180	1.1332	0.5253	1.1332	1.0645
No log	3.0847	182	0.9159	0.6073	0.9159	0.9570
No log	3.1186	184	0.7585	0.5995	0.7585	0.8709
No log	3.1525	186	0.7375	0.5604	0.7375	0.8588
No log	3.1864	188	0.7337	0.5526	0.7337	0.8566
No log	3.2203	190	0.7394	0.6207	0.7394	0.8599
No log	3.2542	192	0.8575	0.5920	0.8575	0.9260
No log	3.2881	194	0.9043	0.5822	0.9043	0.9510
No log	3.3220	196	0.8174	0.5898	0.8174	0.9041
No log	3.3559	198	0.7357	0.5533	0.7357	0.8578
No log	3.3898	200	0.7184	0.5921	0.7184	0.8476
No log	3.4237	202	0.6931	0.6319	0.6931	0.8325
No log	3.4576	204	0.7384	0.6675	0.7384	0.8593
No log	3.4915	206	0.9353	0.5792	0.9353	0.9671
No log	3.5254	208	1.0921	0.5191	1.0921	1.0450
No log	3.5593	210	1.0679	0.5624	1.0679	1.0334
No log	3.5932	212	0.9482	0.6050	0.9482	0.9737
No log	3.6271	214	0.7858	0.6844	0.7858	0.8864
No log	3.6610	216	0.7436	0.6514	0.7436	0.8623
No log	3.6949	218	0.7686	0.6300	0.7686	0.8767
No log	3.7288	220	0.8142	0.6384	0.8142	0.9023
No log	3.7627	222	0.8311	0.6332	0.8311	0.9116
No log	3.7966	224	0.7496	0.5969	0.7496	0.8658
No log	3.8305	226	0.7514	0.5986	0.7514	0.8668
No log	3.8644	228	0.8103	0.6098	0.8103	0.9002
No log	3.8983	230	0.8208	0.6162	0.8208	0.9060
No log	3.9322	232	0.7613	0.6229	0.7613	0.8725
No log	3.9661	234	0.7530	0.6215	0.7530	0.8678
No log	4.0	236	0.7838	0.6195	0.7838	0.8853
No log	4.0339	238	0.8719	0.6227	0.8719	0.9337
No log	4.0678	240	0.8539	0.6267	0.8539	0.9241
No log	4.1017	242	0.8869	0.6312	0.8869	0.9418
No log	4.1356	244	0.8307	0.6505	0.8307	0.9114
No log	4.1695	246	0.7398	0.6633	0.7398	0.8601
No log	4.2034	248	0.7217	0.6710	0.7217	0.8495
No log	4.2373	250	0.7496	0.6704	0.7496	0.8658
No log	4.2712	252	0.8076	0.6307	0.8076	0.8987
No log	4.3051	254	0.8013	0.6350	0.8013	0.8952
No log	4.3390	256	0.7255	0.6725	0.7255	0.8518
No log	4.3729	258	0.7005	0.6235	0.7005	0.8370
No log	4.4068	260	0.7172	0.6214	0.7172	0.8469
No log	4.4407	262	0.7207	0.6111	0.7207	0.8489
No log	4.4746	264	0.8105	0.6333	0.8105	0.9003
No log	4.5085	266	1.0328	0.5268	1.0328	1.0163
No log	4.5424	268	1.1226	0.5185	1.1226	1.0595
No log	4.5763	270	1.0033	0.5335	1.0033	1.0017
No log	4.6102	272	0.8425	0.6025	0.8425	0.9179
No log	4.6441	274	0.7666	0.5604	0.7666	0.8756
No log	4.6780	276	0.7531	0.5882	0.7531	0.8678
No log	4.7119	278	0.8029	0.6406	0.8029	0.8960
No log	4.7458	280	1.0236	0.5319	1.0236	1.0117
No log	4.7797	282	1.1917	0.4962	1.1917	1.0916
No log	4.8136	284	1.1454	0.4845	1.1454	1.0702
No log	4.8475	286	0.9368	0.5818	0.9368	0.9679
No log	4.8814	288	0.7226	0.6777	0.7226	0.8501
No log	4.9153	290	0.6657	0.6858	0.6657	0.8159
No log	4.9492	292	0.6551	0.6809	0.6551	0.8094
No log	4.9831	294	0.6645	0.6969	0.6645	0.8152
No log	5.0169	296	0.7636	0.6374	0.7636	0.8738
No log	5.0508	298	0.8928	0.6052	0.8928	0.9449
No log	5.0847	300	0.8827	0.6017	0.8827	0.9395
No log	5.1186	302	0.7671	0.6665	0.7671	0.8758
No log	5.1525	304	0.6953	0.6155	0.6953	0.8339
No log	5.1864	306	0.7296	0.5442	0.7296	0.8542
No log	5.2203	308	0.7471	0.5183	0.7471	0.8643
No log	5.2542	310	0.7404	0.5945	0.7404	0.8605
No log	5.2881	312	0.7457	0.5723	0.7457	0.8635
No log	5.3220	314	0.7696	0.6589	0.7696	0.8773
No log	5.3559	316	0.8541	0.6245	0.8541	0.9242
No log	5.3898	318	0.8793	0.6319	0.8793	0.9377
No log	5.4237	320	0.8540	0.6203	0.8540	0.9241
No log	5.4576	322	0.7791	0.6459	0.7791	0.8827
No log	5.4915	324	0.7434	0.6654	0.7434	0.8622
No log	5.5254	326	0.7294	0.6521	0.7294	0.8540
No log	5.5593	328	0.7407	0.6367	0.7407	0.8607
No log	5.5932	330	0.7346	0.6568	0.7346	0.8571
No log	5.6271	332	0.7452	0.6433	0.7452	0.8632
No log	5.6610	334	0.7915	0.6543	0.7915	0.8897
No log	5.6949	336	0.7956	0.6695	0.7956	0.8920
No log	5.7288	338	0.7685	0.6920	0.7685	0.8766
No log	5.7627	340	0.6977	0.6825	0.6977	0.8353
No log	5.7966	342	0.6851	0.6415	0.6851	0.8277
No log	5.8305	344	0.7068	0.6765	0.7068	0.8407
No log	5.8644	346	0.7387	0.6785	0.7387	0.8595
No log	5.8983	348	0.7980	0.6826	0.7980	0.8933
No log	5.9322	350	0.8203	0.6609	0.8203	0.9057
No log	5.9661	352	0.8561	0.6219	0.8561	0.9252
No log	6.0	354	0.8034	0.6755	0.8034	0.8963
No log	6.0339	356	0.7811	0.6874	0.7811	0.8838
No log	6.0678	358	0.8333	0.6444	0.8333	0.9128
No log	6.1017	360	0.9172	0.5819	0.9172	0.9577
No log	6.1356	362	0.9230	0.5809	0.9230	0.9607
No log	6.1695	364	0.8503	0.6226	0.8503	0.9221
No log	6.2034	366	0.8185	0.6297	0.8185	0.9047
No log	6.2373	368	0.7849	0.6386	0.7849	0.8859
No log	6.2712	370	0.8160	0.6437	0.8160	0.9033
No log	6.3051	372	0.9034	0.6088	0.9034	0.9505
No log	6.3390	374	0.9649	0.5583	0.9649	0.9823
No log	6.3729	376	0.9947	0.5623	0.9947	0.9973
No log	6.4068	378	0.9462	0.5798	0.9462	0.9727
No log	6.4407	380	0.8874	0.6112	0.8874	0.9420
No log	6.4746	382	0.8684	0.5986	0.8684	0.9319
No log	6.5085	384	0.8550	0.5445	0.8550	0.9247
No log	6.5424	386	0.8549	0.5104	0.8549	0.9246
No log	6.5763	388	0.8312	0.4540	0.8312	0.9117
No log	6.6102	390	0.7816	0.4937	0.7816	0.8841
No log	6.6441	392	0.7360	0.5324	0.7360	0.8579
No log	6.6780	394	0.7305	0.6030	0.7305	0.8547
No log	6.7119	396	0.7757	0.6	0.7757	0.8807
No log	6.7458	398	0.8796	0.6003	0.8796	0.9379
No log	6.7797	400	0.8580	0.6074	0.8580	0.9263
No log	6.8136	402	0.7511	0.5868	0.7511	0.8666
No log	6.8475	404	0.6907	0.5974	0.6907	0.8311
No log	6.8814	406	0.7052	0.5691	0.7052	0.8398
No log	6.9153	408	0.7252	0.5378	0.7252	0.8516
No log	6.9492	410	0.7871	0.5728	0.7871	0.8872
No log	6.9831	412	0.9056	0.5476	0.9056	0.9516
No log	7.0169	414	1.0406	0.5392	1.0406	1.0201
No log	7.0508	416	1.0582	0.5571	1.0582	1.0287
No log	7.0847	418	0.9600	0.5512	0.9600	0.9798
No log	7.1186	420	0.8494	0.5942	0.8494	0.9216
No log	7.1525	422	0.7704	0.6266	0.7704	0.8777
No log	7.1864	424	0.7514	0.6543	0.7514	0.8668
No log	7.2203	426	0.7274	0.6330	0.7274	0.8529
No log	7.2542	428	0.7339	0.6228	0.7339	0.8567
No log	7.2881	430	0.7723	0.6323	0.7723	0.8788
No log	7.3220	432	0.7801	0.5980	0.7801	0.8832
No log	7.3559	434	0.7592	0.6289	0.7592	0.8713
No log	7.3898	436	0.7543	0.6317	0.7543	0.8685
No log	7.4237	438	0.8010	0.6158	0.8010	0.8950
No log	7.4576	440	0.8788	0.6160	0.8788	0.9374
No log	7.4915	442	0.8544	0.6002	0.8544	0.9244
No log	7.5254	444	0.7888	0.5971	0.7888	0.8882
No log	7.5593	446	0.7867	0.5971	0.7867	0.8870
No log	7.5932	448	0.8292	0.5946	0.8292	0.9106
No log	7.6271	450	0.9172	0.5937	0.9172	0.9577
No log	7.6610	452	0.9516	0.5981	0.9516	0.9755
No log	7.6949	454	0.9682	0.5799	0.9682	0.9840
No log	7.7288	456	0.9420	0.5942	0.9420	0.9705
No log	7.7627	458	0.9277	0.5956	0.9277	0.9632
No log	7.7966	460	0.9635	0.5915	0.9635	0.9816
No log	7.8305	462	0.9946	0.5717	0.9946	0.9973
No log	7.8644	464	1.0544	0.5119	1.0544	1.0268
No log	7.8983	466	1.0009	0.5675	1.0009	1.0005
No log	7.9322	468	0.9438	0.5570	0.9438	0.9715
No log	7.9661	470	0.8792	0.5812	0.8792	0.9377
No log	8.0	472	0.8514	0.5954	0.8514	0.9227
No log	8.0339	474	0.8425	0.6017	0.8425	0.9179
No log	8.0678	476	0.8217	0.6021	0.8217	0.9065
No log	8.1017	478	0.8350	0.6095	0.8350	0.9138
No log	8.1356	480	0.8045	0.6098	0.8045	0.8970
No log	8.1695	482	0.7717	0.6226	0.7717	0.8784
No log	8.2034	484	0.7725	0.6120	0.7725	0.8789
No log	8.2373	486	0.8224	0.6040	0.8224	0.9069
No log	8.2712	488	0.9037	0.5990	0.9037	0.9507
No log	8.3051	490	0.9182	0.5990	0.9182	0.9582
No log	8.3390	492	0.8335	0.6060	0.8335	0.9130
No log	8.3729	494	0.8203	0.6060	0.8203	0.9057
No log	8.4068	496	0.8741	0.6080	0.8741	0.9349
No log	8.4407	498	0.9514	0.5567	0.9514	0.9754
0.5073	8.4746	500	0.9649	0.5579	0.9649	0.9823
0.5073	8.5085	502	0.8908	0.5729	0.8908	0.9438
0.5073	8.5424	504	0.7939	0.6261	0.7939	0.8910
0.5073	8.5763	506	0.7669	0.6453	0.7669	0.8757
0.5073	8.6102	508	0.7451	0.6703	0.7451	0.8632
0.5073	8.6441	510	0.7391	0.6175	0.7391	0.8597
0.5073	8.6780	512	0.7481	0.6235	0.7481	0.8649
0.5073	8.7119	514	0.8162	0.6228	0.8162	0.9034
0.5073	8.7458	516	0.8396	0.6145	0.8396	0.9163
0.5073	8.7797	518	0.7708	0.6435	0.7708	0.8780
0.5073	8.8136	520	0.7446	0.6241	0.7446	0.8629
0.5073	8.8475	522	0.7275	0.5820	0.7275	0.8530
0.5073	8.8814	524	0.7233	0.6783	0.7233	0.8505
0.5073	8.9153	526	0.8076	0.6553	0.8076	0.8987
0.5073	8.9492	528	0.9194	0.6402	0.9194	0.9589
0.5073	8.9831	530	0.9439	0.6238	0.9439	0.9716
0.5073	9.0169	532	0.8468	0.6441	0.8468	0.9202
0.5073	9.0508	534	0.7121	0.7126	0.7121	0.8439
0.5073	9.0847	536	0.6567	0.6994	0.6567	0.8104
0.5073	9.1186	538	0.6611	0.6445	0.6611	0.8131
0.5073	9.1525	540	0.6639	0.6489	0.6639	0.8148
0.5073	9.1864	542	0.6635	0.6501	0.6635	0.8146
0.5073	9.2203	544	0.7041	0.6805	0.7041	0.8391
0.5073	9.2542	546	0.7290	0.6922	0.7290	0.8538
0.5073	9.2881	548	0.7201	0.7019	0.7201	0.8486
0.5073	9.3220	550	0.6924	0.6843	0.6924	0.8321
0.5073	9.3559	552	0.7054	0.6870	0.7054	0.8399
0.5073	9.3898	554	0.7166	0.6827	0.7166	0.8465
0.5073	9.4237	556	0.7056	0.6841	0.7056	0.8400
0.5073	9.4576	558	0.6920	0.6751	0.6920	0.8319
0.5073	9.4915	560	0.7406	0.6574	0.7406	0.8606
0.5073	9.5254	562	0.8105	0.6067	0.8105	0.9003
0.5073	9.5593	564	0.8721	0.5756	0.8721	0.9339
0.5073	9.5932	566	0.8614	0.5808	0.8614	0.9281
0.5073	9.6271	568	0.7901	0.6209	0.7901	0.8889
0.5073	9.6610	570	0.7808	0.6606	0.7808	0.8837
0.5073	9.6949	572	0.8100	0.6647	0.8100	0.9000
0.5073	9.7288	574	0.7918	0.6773	0.7918	0.8899
0.5073	9.7627	576	0.7780	0.6709	0.7780	0.8820
0.5073	9.7966	578	0.7888	0.6617	0.7888	0.8882
0.5073	9.8305	580	0.8302	0.6477	0.8302	0.9112
0.5073	9.8644	582	0.9089	0.5852	0.9089	0.9534
0.5073	9.8983	584	1.0341	0.5588	1.0341	1.0169
0.5073	9.9322	586	0.9908	0.5575	0.9908	0.9954
0.5073	9.9661	588	0.9107	0.5875	0.9107	0.9543
0.5073	10.0	590	0.9844	0.5548	0.9844	0.9922
0.5073	10.0339	592	1.1530	0.5356	1.1530	1.0738
0.5073	10.0678	594	1.3079	0.5063	1.3079	1.1436
0.5073	10.1017	596	1.4076	0.4876	1.4076	1.1864
0.5073	10.1356	598	1.3533	0.4994	1.3533	1.1633

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1