ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7433
• Qwk: 0.6414
• Mse: 0.7433
• Rmse: 0.8622

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.05	2	5.3093	-0.0048	5.3093	2.3042
No log	0.1	4	3.3393	0.0717	3.3393	1.8274
No log	0.15	6	1.9803	0.0610	1.9803	1.4072
No log	0.2	8	2.1148	-0.0570	2.1148	1.4542
No log	0.25	10	2.1254	-0.0604	2.1254	1.4579
No log	0.3	12	1.6723	0.0749	1.6723	1.2932
No log	0.35	14	1.2289	0.3029	1.2289	1.1086
No log	0.4	16	1.2509	0.2213	1.2509	1.1185
No log	0.45	18	1.2301	0.2456	1.2301	1.1091
No log	0.5	20	1.1841	0.1459	1.1841	1.0882
No log	0.55	22	1.1446	0.1944	1.1446	1.0699
No log	0.6	24	1.1379	0.2162	1.1379	1.0667
No log	0.65	26	1.0581	0.2329	1.0581	1.0286
No log	0.7	28	1.0266	0.2832	1.0266	1.0132
No log	0.75	30	1.0299	0.3146	1.0299	1.0148
No log	0.8	32	1.0353	0.4354	1.0353	1.0175
No log	0.85	34	1.0801	0.3549	1.0801	1.0393
No log	0.9	36	1.2891	0.3439	1.2891	1.1354
No log	0.95	38	1.1609	0.3710	1.1609	1.0775
No log	1.0	40	1.0463	0.3567	1.0463	1.0229
No log	1.05	42	1.0276	0.3439	1.0276	1.0137
No log	1.1	44	1.0169	0.3771	1.0169	1.0084
No log	1.15	46	1.0062	0.3539	1.0062	1.0031
No log	1.2	48	0.9512	0.3755	0.9512	0.9753
No log	1.25	50	0.9303	0.4260	0.9303	0.9645
No log	1.3	52	0.8897	0.4534	0.8897	0.9432
No log	1.35	54	0.9312	0.4223	0.9312	0.9650
No log	1.4	56	0.9692	0.4496	0.9692	0.9845
No log	1.45	58	1.1877	0.3512	1.1877	1.0898
No log	1.5	60	1.1685	0.3466	1.1685	1.0810
No log	1.55	62	1.0504	0.4129	1.0504	1.0249
No log	1.6	64	1.2365	0.4235	1.2365	1.1120
No log	1.65	66	1.3358	0.3630	1.3358	1.1558
No log	1.7	68	1.1892	0.4140	1.1892	1.0905
No log	1.75	70	0.9996	0.5115	0.9996	0.9998
No log	1.8	72	0.9163	0.5065	0.9163	0.9572
No log	1.85	74	0.8668	0.5311	0.8668	0.9310
No log	1.9	76	0.9109	0.4725	0.9109	0.9544
No log	1.95	78	1.2661	0.3017	1.2661	1.1252
No log	2.0	80	1.2615	0.2753	1.2615	1.1232
No log	2.05	82	0.9553	0.4844	0.9553	0.9774
No log	2.1	84	0.7788	0.6090	0.7788	0.8825
No log	2.15	86	0.8159	0.5954	0.8159	0.9033
No log	2.2	88	0.7650	0.5689	0.7650	0.8746
No log	2.25	90	0.8340	0.5925	0.8340	0.9133
No log	2.3	92	0.9598	0.5146	0.9598	0.9797
No log	2.35	94	0.8627	0.5673	0.8627	0.9288
No log	2.4	96	0.7666	0.6270	0.7666	0.8755
No log	2.45	98	0.7970	0.5322	0.7970	0.8928
No log	2.5	100	0.7894	0.6280	0.7894	0.8885
No log	2.55	102	0.8811	0.5844	0.8811	0.9387
No log	2.6	104	1.0247	0.5670	1.0247	1.0123
No log	2.65	106	1.0435	0.5483	1.0435	1.0215
No log	2.7	108	1.0624	0.5436	1.0624	1.0307
No log	2.75	110	0.9892	0.5358	0.9892	0.9946
No log	2.8	112	0.8622	0.5987	0.8622	0.9285
No log	2.85	114	0.8676	0.4737	0.8676	0.9314
No log	2.9	116	0.8735	0.5018	0.8735	0.9346
No log	2.95	118	0.8377	0.5121	0.8377	0.9153
No log	3.0	120	0.8257	0.5344	0.8257	0.9087
No log	3.05	122	0.7960	0.6283	0.7960	0.8922
No log	3.1	124	0.7849	0.6404	0.7849	0.8859
No log	3.15	126	0.7971	0.6522	0.7971	0.8928
No log	3.2	128	0.7617	0.6394	0.7617	0.8728
No log	3.25	130	0.7599	0.6612	0.7599	0.8717
No log	3.3	132	0.7558	0.6697	0.7558	0.8694
No log	3.35	134	0.7423	0.6683	0.7423	0.8616
No log	3.4	136	0.8422	0.6149	0.8422	0.9177
No log	3.45	138	0.7634	0.6313	0.7634	0.8737
No log	3.5	140	0.6681	0.6892	0.6681	0.8174
No log	3.55	142	0.6479	0.7306	0.6479	0.8049
No log	3.6	144	0.6487	0.7178	0.6487	0.8054
No log	3.65	146	0.6645	0.6944	0.6645	0.8152
No log	3.7	148	0.6633	0.7000	0.6633	0.8144
No log	3.75	150	0.9932	0.5564	0.9932	0.9966
No log	3.8	152	1.2699	0.4726	1.2699	1.1269
No log	3.85	154	1.1248	0.5140	1.1248	1.0606
No log	3.9	156	0.8198	0.6381	0.8198	0.9054
No log	3.95	158	0.7745	0.6401	0.7745	0.8801
No log	4.0	160	0.8297	0.6534	0.8297	0.9109
No log	4.05	162	1.0112	0.5356	1.0112	1.0056
No log	4.1	164	1.2240	0.4803	1.2240	1.1064
No log	4.15	166	1.3635	0.4264	1.3635	1.1677
No log	4.2	168	1.1869	0.4856	1.1869	1.0894
No log	4.25	170	0.8136	0.6337	0.8136	0.9020
No log	4.3	172	0.6810	0.6638	0.6810	0.8252
No log	4.35	174	0.7050	0.6301	0.7050	0.8396
No log	4.4	176	0.6824	0.6241	0.6824	0.8261
No log	4.45	178	0.7119	0.6518	0.7119	0.8437
No log	4.5	180	0.8794	0.5651	0.8794	0.9378
No log	4.55	182	0.8896	0.5484	0.8896	0.9432
No log	4.6	184	0.7480	0.5993	0.7480	0.8649
No log	4.65	186	0.6629	0.5638	0.6629	0.8142
No log	4.7	188	0.6981	0.5991	0.6981	0.8355
No log	4.75	190	0.6494	0.6250	0.6494	0.8059
No log	4.8	192	0.6125	0.6876	0.6125	0.7826
No log	4.85	194	0.6275	0.6857	0.6275	0.7922
No log	4.9	196	0.6461	0.6880	0.6461	0.8038
No log	4.95	198	0.6285	0.7065	0.6285	0.7928
No log	5.0	200	0.8037	0.6409	0.8037	0.8965
No log	5.05	202	0.9765	0.5765	0.9765	0.9882
No log	5.1	204	0.8682	0.5812	0.8682	0.9318
No log	5.15	206	0.6831	0.6262	0.6831	0.8265
No log	5.2	208	0.6971	0.6253	0.6971	0.8349
No log	5.25	210	0.7923	0.5878	0.7923	0.8901
No log	5.3	212	0.7459	0.6318	0.7459	0.8637
No log	5.35	214	0.6498	0.6496	0.6498	0.8061
No log	5.4	216	0.6665	0.6446	0.6665	0.8164
No log	5.45	218	0.7351	0.6157	0.7351	0.8574
No log	5.5	220	0.6912	0.6222	0.6912	0.8314
No log	5.55	222	0.6838	0.6325	0.6838	0.8270
No log	5.6	224	0.7527	0.5949	0.7527	0.8676
No log	5.65	226	0.8891	0.5321	0.8891	0.9429
No log	5.7	228	0.8616	0.5892	0.8616	0.9282
No log	5.75	230	0.8042	0.6103	0.8042	0.8968
No log	5.8	232	0.7024	0.6408	0.7024	0.8381
No log	5.85	234	0.6751	0.6848	0.6751	0.8216
No log	5.9	236	0.7047	0.6599	0.7047	0.8395
No log	5.95	238	0.8664	0.5527	0.8664	0.9308
No log	6.0	240	1.0439	0.5202	1.0439	1.0217
No log	6.05	242	1.0672	0.4961	1.0672	1.0331
No log	6.1	244	0.9200	0.5304	0.9200	0.9592
No log	6.15	246	0.7649	0.5354	0.7649	0.8746
No log	6.2	248	0.7029	0.5997	0.7029	0.8384
No log	6.25	250	0.6871	0.6442	0.6871	0.8289
No log	6.3	252	0.6810	0.6786	0.6810	0.8252
No log	6.35	254	0.7515	0.6567	0.7515	0.8669
No log	6.4	256	0.9095	0.6325	0.9095	0.9537
No log	6.45	258	1.0333	0.5767	1.0333	1.0165
No log	6.5	260	0.9687	0.5995	0.9687	0.9842
No log	6.55	262	0.8272	0.6293	0.8272	0.9095
No log	6.6	264	0.8018	0.6212	0.8018	0.8954
No log	6.65	266	0.9089	0.5586	0.9089	0.9533
No log	6.7	268	0.9979	0.5444	0.9979	0.9989
No log	6.75	270	0.9284	0.5383	0.9284	0.9635
No log	6.8	272	0.7912	0.5887	0.7912	0.8895
No log	6.85	274	0.7408	0.6158	0.7408	0.8607
No log	6.9	276	0.7127	0.6674	0.7127	0.8442
No log	6.95	278	0.7684	0.6480	0.7684	0.8766
No log	7.0	280	0.9166	0.6382	0.9166	0.9574
No log	7.05	282	0.9120	0.6415	0.9120	0.9550
No log	7.1	284	0.7902	0.6573	0.7902	0.8889
No log	7.15	286	0.7037	0.6655	0.7037	0.8389
No log	7.2	288	0.6519	0.7070	0.6519	0.8074
No log	7.25	290	0.6367	0.6754	0.6367	0.7979
No log	7.3	292	0.6392	0.6448	0.6392	0.7995
No log	7.35	294	0.6698	0.6220	0.6698	0.8184
No log	7.4	296	0.7109	0.5449	0.7109	0.8432
No log	7.45	298	0.7040	0.5653	0.7040	0.8390
No log	7.5	300	0.6900	0.5907	0.6900	0.8307
No log	7.55	302	0.6800	0.6075	0.6800	0.8246
No log	7.6	304	0.6567	0.5985	0.6567	0.8104
No log	7.65	306	0.6508	0.6289	0.6508	0.8067
No log	7.7	308	0.6273	0.6614	0.6273	0.7920
No log	7.75	310	0.6745	0.7134	0.6745	0.8213
No log	7.8	312	0.7694	0.6948	0.7694	0.8772
No log	7.85	314	0.8234	0.6694	0.8234	0.9074
No log	7.9	316	0.8535	0.6566	0.8535	0.9238
No log	7.95	318	0.8092	0.6223	0.8092	0.8996
No log	8.0	320	0.8672	0.6137	0.8672	0.9313
No log	8.05	322	0.8754	0.6078	0.8754	0.9356
No log	8.1	324	0.7996	0.6431	0.7996	0.8942
No log	8.15	326	0.7357	0.6702	0.7357	0.8577
No log	8.2	328	0.7310	0.6866	0.7310	0.8550
No log	8.25	330	0.8043	0.6358	0.8043	0.8968
No log	8.3	332	1.0789	0.5809	1.0789	1.0387
No log	8.35	334	1.2814	0.5355	1.2814	1.1320
No log	8.4	336	1.4798	0.5028	1.4798	1.2165
No log	8.45	338	1.4360	0.5006	1.4360	1.1983
No log	8.5	340	1.1284	0.5852	1.1284	1.0622
No log	8.55	342	0.8023	0.6723	0.8023	0.8957
No log	8.6	344	0.7345	0.6363	0.7345	0.8570
No log	8.65	346	0.7367	0.6244	0.7367	0.8583
No log	8.7	348	0.7655	0.6154	0.7655	0.8749
No log	8.75	350	0.8110	0.6040	0.8110	0.9005
No log	8.8	352	0.7813	0.6075	0.7813	0.8839
No log	8.85	354	0.7468	0.6150	0.7468	0.8642
No log	8.9	356	0.7486	0.6173	0.7486	0.8652
No log	8.95	358	0.7662	0.6157	0.7662	0.8753
No log	9.0	360	0.7626	0.6139	0.7626	0.8733
No log	9.05	362	0.7606	0.6065	0.7606	0.8721
No log	9.1	364	0.7166	0.6251	0.7166	0.8465
No log	9.15	366	0.6999	0.6703	0.6999	0.8366
No log	9.2	368	0.7545	0.6496	0.7545	0.8686
No log	9.25	370	0.8571	0.6223	0.8571	0.9258
No log	9.3	372	0.8462	0.6486	0.8462	0.9199
No log	9.35	374	0.7590	0.6645	0.7590	0.8712
No log	9.4	376	0.6853	0.6663	0.6853	0.8278
No log	9.45	378	0.6691	0.6467	0.6691	0.8180
No log	9.5	380	0.6680	0.6298	0.6680	0.8173
No log	9.55	382	0.6979	0.6470	0.6979	0.8354
No log	9.6	384	0.7900	0.6244	0.7900	0.8888
No log	9.65	386	0.8184	0.6222	0.8184	0.9047
No log	9.7	388	0.8047	0.6578	0.8047	0.8971
No log	9.75	390	0.8275	0.6386	0.8275	0.9097
No log	9.8	392	0.8435	0.6285	0.8435	0.9184
No log	9.85	394	0.7967	0.6511	0.7967	0.8926
No log	9.9	396	0.7469	0.6452	0.7469	0.8643
No log	9.95	398	0.7331	0.6038	0.7331	0.8562
No log	10.0	400	0.7368	0.6055	0.7368	0.8584
No log	10.05	402	0.6896	0.5753	0.6896	0.8304
No log	10.1	404	0.6893	0.6442	0.6893	0.8302
No log	10.15	406	0.6857	0.6213	0.6857	0.8281
No log	10.2	408	0.6940	0.5647	0.6940	0.8331
No log	10.25	410	0.7622	0.6130	0.7622	0.8730
No log	10.3	412	0.7947	0.6171	0.7947	0.8915
No log	10.35	414	0.7684	0.6218	0.7684	0.8766
No log	10.4	416	0.7654	0.6218	0.7654	0.8749
No log	10.45	418	0.7646	0.6098	0.7646	0.8744
No log	10.5	420	0.7345	0.5617	0.7345	0.8570
No log	10.55	422	0.7074	0.5738	0.7074	0.8411
No log	10.6	424	0.7102	0.5921	0.7102	0.8427
No log	10.65	426	0.7145	0.5647	0.7145	0.8453
No log	10.7	428	0.7685	0.6176	0.7685	0.8766
No log	10.75	430	0.8032	0.5985	0.8032	0.8962
No log	10.8	432	0.7285	0.6725	0.7285	0.8535
No log	10.85	434	0.7079	0.6900	0.7079	0.8414
No log	10.9	436	0.7200	0.6888	0.7200	0.8485
No log	10.95	438	0.7391	0.6745	0.7391	0.8597
No log	11.0	440	0.7216	0.6510	0.7216	0.8495
No log	11.05	442	0.7427	0.6091	0.7427	0.8618
No log	11.1	444	0.7077	0.6224	0.7077	0.8412
No log	11.15	446	0.6556	0.6294	0.6556	0.8097
No log	11.2	448	0.6513	0.6348	0.6513	0.8070
No log	11.25	450	0.6602	0.6155	0.6602	0.8125
No log	11.3	452	0.6832	0.6160	0.6832	0.8265
No log	11.35	454	0.7054	0.6420	0.7054	0.8399
No log	11.4	456	0.7510	0.6077	0.7510	0.8666
No log	11.45	458	0.7923	0.6139	0.7923	0.8901
No log	11.5	460	0.9164	0.6097	0.9164	0.9573
No log	11.55	462	0.9065	0.6097	0.9065	0.9521
No log	11.6	464	0.8144	0.6147	0.8144	0.9024
No log	11.65	466	0.7853	0.6144	0.7853	0.8862
No log	11.7	468	0.7711	0.6273	0.7711	0.8781
No log	11.75	470	0.7887	0.6026	0.7887	0.8881
No log	11.8	472	0.7591	0.6188	0.7591	0.8712
No log	11.85	474	0.7188	0.6621	0.7188	0.8478
No log	11.9	476	0.7364	0.6590	0.7364	0.8581
No log	11.95	478	0.7715	0.6062	0.7715	0.8784
No log	12.0	480	0.7012	0.6545	0.7012	0.8374
No log	12.05	482	0.6388	0.6485	0.6388	0.7993
No log	12.1	484	0.6329	0.6561	0.6329	0.7955
No log	12.15	486	0.6561	0.6220	0.6561	0.8100
No log	12.2	488	0.7594	0.6100	0.7594	0.8714
No log	12.25	490	0.8086	0.5924	0.8086	0.8992
No log	12.3	492	0.8251	0.5731	0.8251	0.9084
No log	12.35	494	0.7962	0.6028	0.7962	0.8923
No log	12.4	496	0.7641	0.6113	0.7641	0.8741
No log	12.45	498	0.7044	0.6247	0.7044	0.8393
0.4067	12.5	500	0.6987	0.6507	0.6987	0.8359
0.4067	12.55	502	0.7639	0.6685	0.7639	0.8740
0.4067	12.6	504	0.7429	0.6734	0.7429	0.8619
0.4067	12.65	506	0.7014	0.6860	0.7014	0.8375
0.4067	12.7	508	0.7327	0.6665	0.7327	0.8560
0.4067	12.75	510	0.8654	0.5898	0.8654	0.9303
0.4067	12.8	512	0.9902	0.5656	0.9902	0.9951
0.4067	12.85	514	0.9849	0.5707	0.9849	0.9924
0.4067	12.9	516	0.8380	0.6097	0.8380	0.9154
0.4067	12.95	518	0.7433	0.6414	0.7433	0.8622

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1