ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5821
• Qwk: 0.6979
• Mse: 0.5821
• Rmse: 0.7629

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0253	2	5.2205	0.0236	5.2205	2.2848
No log	0.0506	4	3.1785	0.0989	3.1785	1.7828
No log	0.0759	6	2.1988	0.0399	2.1988	1.4828
No log	0.1013	8	1.6400	0.0717	1.6400	1.2806
No log	0.1266	10	1.4880	0.1429	1.4880	1.2198
No log	0.1519	12	1.2509	0.2447	1.2509	1.1184
No log	0.1772	14	1.1199	0.2265	1.1199	1.0583
No log	0.2025	16	1.1238	0.3653	1.1238	1.0601
No log	0.2278	18	1.4970	0.2184	1.4970	1.2235
No log	0.2532	20	1.3520	0.3274	1.3520	1.1627
No log	0.2785	22	1.2757	0.3614	1.2757	1.1295
No log	0.3038	24	1.0407	0.4093	1.0407	1.0202
No log	0.3291	26	0.9251	0.3953	0.9251	0.9618
No log	0.3544	28	0.9261	0.4421	0.9261	0.9623
No log	0.3797	30	0.8958	0.3978	0.8958	0.9465
No log	0.4051	32	0.8744	0.4494	0.8744	0.9351
No log	0.4304	34	0.9787	0.4620	0.9787	0.9893
No log	0.4557	36	1.1873	0.4419	1.1873	1.0897
No log	0.4810	38	1.1891	0.4395	1.1891	1.0904
No log	0.5063	40	0.9556	0.4686	0.9556	0.9775
No log	0.5316	42	0.9628	0.4463	0.9628	0.9812
No log	0.5570	44	0.9570	0.4976	0.9570	0.9783
No log	0.5823	46	0.8179	0.4954	0.8179	0.9044
No log	0.6076	48	0.8647	0.4492	0.8647	0.9299
No log	0.6329	50	0.8858	0.4323	0.8858	0.9412
No log	0.6582	52	0.7615	0.5385	0.7615	0.8726
No log	0.6835	54	0.6810	0.6550	0.6810	0.8252
No log	0.7089	56	0.6640	0.6807	0.6640	0.8149
No log	0.7342	58	0.7315	0.6399	0.7315	0.8553
No log	0.7595	60	0.8014	0.5932	0.8014	0.8952
No log	0.7848	62	0.7172	0.6636	0.7172	0.8469
No log	0.8101	64	0.6391	0.6610	0.6391	0.7995
No log	0.8354	66	0.7450	0.6094	0.7450	0.8632
No log	0.8608	68	0.8106	0.5801	0.8106	0.9003
No log	0.8861	70	0.7049	0.6534	0.7049	0.8396
No log	0.9114	72	0.7782	0.6347	0.7782	0.8821
No log	0.9367	74	0.8015	0.6377	0.8015	0.8952
No log	0.9620	76	0.8178	0.6169	0.8178	0.9043
No log	0.9873	78	0.9366	0.5650	0.9366	0.9678
No log	1.0127	80	0.8428	0.6455	0.8428	0.9180
No log	1.0380	82	0.7598	0.6334	0.7598	0.8717
No log	1.0633	84	0.7479	0.6449	0.7479	0.8648
No log	1.0886	86	0.7339	0.6722	0.7339	0.8567
No log	1.1139	88	0.7658	0.6503	0.7658	0.8751
No log	1.1392	90	0.8242	0.6114	0.8242	0.9078
No log	1.1646	92	0.6923	0.6867	0.6923	0.8321
No log	1.1899	94	0.6828	0.6657	0.6828	0.8263
No log	1.2152	96	0.6608	0.7190	0.6608	0.8129
No log	1.2405	98	0.7406	0.6665	0.7406	0.8606
No log	1.2658	100	0.6705	0.7100	0.6705	0.8188
No log	1.2911	102	0.6945	0.6622	0.6945	0.8334
No log	1.3165	104	0.8122	0.6760	0.8122	0.9012
No log	1.3418	106	0.9056	0.6946	0.9056	0.9516
No log	1.3671	108	0.7862	0.6865	0.7862	0.8867
No log	1.3924	110	0.6542	0.7022	0.6542	0.8088
No log	1.4177	112	0.6390	0.7151	0.6390	0.7994
No log	1.4430	114	0.7779	0.6084	0.7779	0.8820
No log	1.4684	116	0.9348	0.5944	0.9348	0.9669
No log	1.4937	118	0.9147	0.5744	0.9147	0.9564
No log	1.5190	120	0.7569	0.6006	0.7569	0.8700
No log	1.5443	122	0.6401	0.6964	0.6401	0.8001
No log	1.5696	124	0.6535	0.6777	0.6535	0.8084
No log	1.5949	126	0.6980	0.7021	0.6980	0.8354
No log	1.6203	128	0.7105	0.7018	0.7105	0.8429
No log	1.6456	130	0.6880	0.6956	0.6880	0.8295
No log	1.6709	132	0.6492	0.6920	0.6492	0.8058
No log	1.6962	134	0.6640	0.6758	0.6640	0.8149
No log	1.7215	136	0.7179	0.6397	0.7179	0.8473
No log	1.7468	138	0.7549	0.6149	0.7549	0.8689
No log	1.7722	140	0.8028	0.6278	0.8028	0.8960
No log	1.7975	142	0.7360	0.6268	0.7360	0.8579
No log	1.8228	144	0.7244	0.6113	0.7244	0.8511
No log	1.8481	146	0.7586	0.6141	0.7586	0.8709
No log	1.8734	148	0.8355	0.6115	0.8355	0.9141
No log	1.8987	150	0.8288	0.6050	0.8288	0.9104
No log	1.9241	152	0.7591	0.5047	0.7591	0.8712
No log	1.9494	154	0.9754	0.5508	0.9754	0.9876
No log	1.9747	156	0.9920	0.5468	0.9920	0.9960
No log	2.0	158	0.7839	0.5338	0.7839	0.8854
No log	2.0253	160	0.8950	0.6007	0.8950	0.9460
No log	2.0506	162	1.4854	0.3713	1.4854	1.2188
No log	2.0759	164	1.6826	0.3544	1.6826	1.2971
No log	2.1013	166	1.3402	0.4702	1.3402	1.1577
No log	2.1266	168	0.9919	0.6166	0.9919	0.9960
No log	2.1519	170	0.9683	0.6166	0.9683	0.9840
No log	2.1772	172	1.0002	0.5649	1.0002	1.0001
No log	2.2025	174	0.8990	0.6305	0.8990	0.9482
No log	2.2278	176	0.7741	0.6876	0.7741	0.8798
No log	2.2532	178	0.7449	0.6884	0.7449	0.8631
No log	2.2785	180	0.7312	0.6867	0.7312	0.8551
No log	2.3038	182	0.7694	0.6865	0.7694	0.8772
No log	2.3291	184	0.8819	0.6363	0.8819	0.9391
No log	2.3544	186	0.9747	0.6266	0.9747	0.9873
No log	2.3797	188	0.7830	0.6486	0.7830	0.8849
No log	2.4051	190	0.6618	0.6940	0.6618	0.8135
No log	2.4304	192	0.7038	0.6866	0.7038	0.8389
No log	2.4557	194	0.6791	0.6636	0.6791	0.8241
No log	2.4810	196	0.7309	0.6067	0.7309	0.8549
No log	2.5063	198	0.7911	0.6325	0.7911	0.8894
No log	2.5316	200	0.7075	0.6056	0.7075	0.8411
No log	2.5570	202	0.6987	0.6262	0.6987	0.8359
No log	2.5823	204	0.8407	0.5843	0.8407	0.9169
No log	2.6076	206	0.7696	0.6228	0.7696	0.8773
No log	2.6329	208	0.6292	0.7315	0.6292	0.7932
No log	2.6582	210	0.8088	0.6494	0.8088	0.8993
No log	2.6835	212	0.9805	0.6280	0.9805	0.9902
No log	2.7089	214	0.8340	0.6666	0.8340	0.9133
No log	2.7342	216	0.6852	0.6783	0.6852	0.8278
No log	2.7595	218	0.6646	0.7130	0.6646	0.8152
No log	2.7848	220	0.7174	0.6455	0.7174	0.8470
No log	2.8101	222	0.8468	0.5730	0.8468	0.9202
No log	2.8354	224	0.8304	0.5574	0.8304	0.9113
No log	2.8608	226	0.7337	0.6639	0.7337	0.8566
No log	2.8861	228	0.6847	0.6380	0.6847	0.8275
No log	2.9114	230	0.6839	0.6893	0.6839	0.8270
No log	2.9367	232	0.7546	0.6674	0.7546	0.8687
No log	2.9620	234	0.8780	0.6251	0.8780	0.9370
No log	2.9873	236	0.9072	0.6036	0.9072	0.9525
No log	3.0127	238	0.9721	0.5890	0.9721	0.9859
No log	3.0380	240	0.8878	0.6084	0.8878	0.9423
No log	3.0633	242	0.7749	0.6405	0.7749	0.8803
No log	3.0886	244	0.7188	0.6835	0.7188	0.8478
No log	3.1139	246	0.6935	0.6561	0.6935	0.8328
No log	3.1392	248	0.7232	0.6573	0.7232	0.8504
No log	3.1646	250	0.7749	0.5931	0.7749	0.8803
No log	3.1899	252	0.7832	0.5843	0.7832	0.8850
No log	3.2152	254	0.7547	0.6470	0.7547	0.8688
No log	3.2405	256	0.7138	0.6848	0.7138	0.8449
No log	3.2658	258	0.7124	0.7055	0.7124	0.8441
No log	3.2911	260	0.7262	0.6904	0.7262	0.8522
No log	3.3165	262	0.7163	0.6768	0.7163	0.8463
No log	3.3418	264	0.6630	0.7077	0.6630	0.8142
No log	3.3671	266	0.7011	0.6787	0.7011	0.8373
No log	3.3924	268	0.7259	0.6582	0.7259	0.8520
No log	3.4177	270	0.6954	0.7038	0.6954	0.8339
No log	3.4430	272	0.7445	0.6727	0.7445	0.8628
No log	3.4684	274	0.8135	0.6594	0.8135	0.9019
No log	3.4937	276	0.7904	0.6630	0.7904	0.8891
No log	3.5190	278	0.8883	0.6313	0.8883	0.9425
No log	3.5443	280	0.8899	0.5951	0.8899	0.9433
No log	3.5696	282	0.7520	0.6486	0.7520	0.8672
No log	3.5949	284	0.6472	0.6843	0.6472	0.8045
No log	3.6203	286	0.5872	0.7401	0.5872	0.7663
No log	3.6456	288	0.5846	0.7575	0.5846	0.7646
No log	3.6709	290	0.5751	0.7389	0.5751	0.7584
No log	3.6962	292	0.5816	0.7400	0.5816	0.7627
No log	3.7215	294	0.6171	0.6948	0.6171	0.7855
No log	3.7468	296	0.5849	0.7219	0.5849	0.7648
No log	3.7722	298	0.6479	0.6600	0.6479	0.8049
No log	3.7975	300	0.7422	0.6225	0.7422	0.8615
No log	3.8228	302	0.6838	0.6684	0.6838	0.8269
No log	3.8481	304	0.6094	0.7259	0.6094	0.7806
No log	3.8734	306	0.7829	0.6245	0.7829	0.8848
No log	3.8987	308	0.8515	0.6136	0.8515	0.9228
No log	3.9241	310	0.7851	0.6542	0.7851	0.8861
No log	3.9494	312	0.7116	0.6807	0.7116	0.8435
No log	3.9747	314	0.7191	0.6876	0.7191	0.8480
No log	4.0	316	0.7655	0.6912	0.7655	0.8749
No log	4.0253	318	0.7544	0.6859	0.7544	0.8686
No log	4.0506	320	0.7379	0.6938	0.7379	0.8590
No log	4.0759	322	0.7124	0.6066	0.7124	0.8440
No log	4.1013	324	0.7112	0.5955	0.7112	0.8433
No log	4.1266	326	0.7074	0.6610	0.7074	0.8411
No log	4.1519	328	0.7407	0.6818	0.7407	0.8606
No log	4.1772	330	0.7568	0.7002	0.7568	0.8699
No log	4.2025	332	0.7636	0.7002	0.7636	0.8738
No log	4.2278	334	0.7540	0.6879	0.7540	0.8683
No log	4.2532	336	0.7330	0.6875	0.7330	0.8562
No log	4.2785	338	0.7500	0.6969	0.7500	0.8660
No log	4.3038	340	0.7479	0.6436	0.7479	0.8648
No log	4.3291	342	0.7402	0.6010	0.7402	0.8603
No log	4.3544	344	0.7514	0.6118	0.7514	0.8668
No log	4.3797	346	0.7827	0.6797	0.7827	0.8847
No log	4.4051	348	0.7899	0.6605	0.7899	0.8888
No log	4.4304	350	0.7344	0.6904	0.7344	0.8569
No log	4.4557	352	0.6790	0.6947	0.6790	0.8240
No log	4.4810	354	0.7193	0.6852	0.7193	0.8481
No log	4.5063	356	0.6974	0.6993	0.6974	0.8351
No log	4.5316	358	0.6567	0.7202	0.6567	0.8103
No log	4.5570	360	0.6256	0.7310	0.6256	0.7909
No log	4.5823	362	0.6327	0.7615	0.6327	0.7954
No log	4.6076	364	0.6286	0.7396	0.6286	0.7928
No log	4.6329	366	0.6006	0.7460	0.6006	0.7750
No log	4.6582	368	0.6340	0.7109	0.6340	0.7963
No log	4.6835	370	0.6632	0.7217	0.6632	0.8144
No log	4.7089	372	0.6407	0.7079	0.6407	0.8004
No log	4.7342	374	0.6001	0.7321	0.6001	0.7746
No log	4.7595	376	0.6157	0.7360	0.6157	0.7847
No log	4.7848	378	0.7092	0.6793	0.7092	0.8422
No log	4.8101	380	0.7360	0.6593	0.7360	0.8579
No log	4.8354	382	0.6895	0.6897	0.6895	0.8304
No log	4.8608	384	0.6710	0.6837	0.6710	0.8192
No log	4.8861	386	0.6583	0.6989	0.6583	0.8113
No log	4.9114	388	0.6535	0.7026	0.6535	0.8084
No log	4.9367	390	0.6952	0.6757	0.6952	0.8338
No log	4.9620	392	0.6822	0.6593	0.6822	0.8260
No log	4.9873	394	0.6763	0.6108	0.6763	0.8224
No log	5.0127	396	0.6821	0.6108	0.6821	0.8259
No log	5.0380	398	0.6665	0.6527	0.6665	0.8164
No log	5.0633	400	0.6521	0.6563	0.6521	0.8075
No log	5.0886	402	0.6240	0.7040	0.6240	0.7899
No log	5.1139	404	0.6201	0.7121	0.6201	0.7875
No log	5.1392	406	0.6432	0.6888	0.6432	0.8020
No log	5.1646	408	0.6835	0.6791	0.6835	0.8267
No log	5.1899	410	0.6828	0.6577	0.6828	0.8263
No log	5.2152	412	0.6774	0.6934	0.6774	0.8230
No log	5.2405	414	0.7045	0.6646	0.7045	0.8393
No log	5.2658	416	0.7562	0.6619	0.7562	0.8696
No log	5.2911	418	0.7161	0.6709	0.7161	0.8462
No log	5.3165	420	0.6708	0.6945	0.6708	0.8190
No log	5.3418	422	0.6734	0.7169	0.6734	0.8206
No log	5.3671	424	0.6545	0.6767	0.6545	0.8090
No log	5.3924	426	0.6487	0.6652	0.6487	0.8054
No log	5.4177	428	0.6430	0.6691	0.6430	0.8019
No log	5.4430	430	0.6106	0.6972	0.6106	0.7814
No log	5.4684	432	0.5960	0.7379	0.5960	0.7720
No log	5.4937	434	0.6191	0.7140	0.6191	0.7868
No log	5.5190	436	0.6096	0.6968	0.6096	0.7808
No log	5.5443	438	0.6157	0.6887	0.6157	0.7846
No log	5.5696	440	0.6215	0.6410	0.6215	0.7883
No log	5.5949	442	0.6188	0.6606	0.6188	0.7866
No log	5.6203	444	0.6224	0.6732	0.6224	0.7889
No log	5.6456	446	0.6737	0.6888	0.6737	0.8208
No log	5.6709	448	0.6612	0.6857	0.6612	0.8131
No log	5.6962	450	0.6149	0.6779	0.6149	0.7842
No log	5.7215	452	0.6148	0.6572	0.6148	0.7841
No log	5.7468	454	0.6249	0.6954	0.6249	0.7905
No log	5.7722	456	0.6670	0.6792	0.6670	0.8167
No log	5.7975	458	0.6774	0.6812	0.6774	0.8230
No log	5.8228	460	0.6696	0.6821	0.6696	0.8183
No log	5.8481	462	0.6541	0.6966	0.6541	0.8088
No log	5.8734	464	0.6706	0.6772	0.6706	0.8189
No log	5.8987	466	0.6925	0.6518	0.6925	0.8322
No log	5.9241	468	0.6861	0.6704	0.6861	0.8283
No log	5.9494	470	0.6654	0.6865	0.6654	0.8157
No log	5.9747	472	0.6830	0.6884	0.6830	0.8264
No log	6.0	474	0.7238	0.6405	0.7238	0.8508
No log	6.0253	476	0.7257	0.6557	0.7257	0.8519
No log	6.0506	478	0.6732	0.6933	0.6732	0.8205
No log	6.0759	480	0.6497	0.6526	0.6497	0.8060
No log	6.1013	482	0.6570	0.6630	0.6570	0.8106
No log	6.1266	484	0.7222	0.6496	0.7222	0.8498
No log	6.1519	486	0.7737	0.6403	0.7737	0.8796
No log	6.1772	488	0.7475	0.6296	0.7475	0.8646
No log	6.2025	490	0.6866	0.6174	0.6866	0.8286
No log	6.2278	492	0.6464	0.6462	0.6464	0.8040
No log	6.2532	494	0.6169	0.6698	0.6169	0.7854
No log	6.2785	496	0.6070	0.7088	0.6070	0.7791
No log	6.3038	498	0.6184	0.7021	0.6184	0.7864
0.3897	6.3291	500	0.6005	0.7231	0.6005	0.7749
0.3897	6.3544	502	0.5945	0.7533	0.5945	0.7710
0.3897	6.3797	504	0.6097	0.7428	0.6097	0.7808
0.3897	6.4051	506	0.5588	0.7455	0.5588	0.7475
0.3897	6.4304	508	0.5591	0.7012	0.5591	0.7477
0.3897	6.4557	510	0.6002	0.7038	0.6002	0.7747
0.3897	6.4810	512	0.6018	0.6819	0.6018	0.7758
0.3897	6.5063	514	0.5936	0.6808	0.5936	0.7705
0.3897	6.5316	516	0.5821	0.6979	0.5821	0.7629

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1