ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k3_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5917
• Qwk: 0.7190
• Mse: 0.5917
• Rmse: 0.7692

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1176	2	5.3270	-0.0047	5.3270	2.3080
No log	0.2353	4	3.5251	0.0363	3.5251	1.8775
No log	0.3529	6	2.0604	0.1392	2.0604	1.4354
No log	0.4706	8	1.6467	0.0773	1.6467	1.2832
No log	0.5882	10	1.2859	0.2249	1.2859	1.1340
No log	0.7059	12	1.1705	0.1534	1.1705	1.0819
No log	0.8235	14	1.3908	0.1644	1.3908	1.1793
No log	0.9412	16	1.9204	0.0957	1.9204	1.3858
No log	1.0588	18	1.9100	0.1241	1.9100	1.3820
No log	1.1765	20	1.4961	0.0273	1.4961	1.2232
No log	1.2941	22	1.1311	0.2505	1.1311	1.0635
No log	1.4118	24	1.1068	0.2011	1.1068	1.0520
No log	1.5294	26	1.1352	0.1415	1.1352	1.0655
No log	1.6471	28	1.1448	0.1245	1.1448	1.0700
No log	1.7647	30	1.1381	0.1334	1.1381	1.0668
No log	1.8824	32	1.1255	0.2939	1.1255	1.0609
No log	2.0	34	1.2701	0.2136	1.2701	1.1270
No log	2.1176	36	1.3473	0.1513	1.3473	1.1608
No log	2.2353	38	1.2308	0.2376	1.2308	1.1094
No log	2.3529	40	1.0136	0.3120	1.0136	1.0068
No log	2.4706	42	0.8593	0.4632	0.8593	0.9270
No log	2.5882	44	0.8453	0.5158	0.8453	0.9194
No log	2.7059	46	0.7932	0.5404	0.7932	0.8906
No log	2.8235	48	0.7896	0.5429	0.7896	0.8886
No log	2.9412	50	0.9338	0.4516	0.9338	0.9663
No log	3.0588	52	1.0719	0.4071	1.0719	1.0353
No log	3.1765	54	0.9273	0.4235	0.9273	0.9630
No log	3.2941	56	0.7320	0.6015	0.7320	0.8555
No log	3.4118	58	0.8219	0.5996	0.8219	0.9066
No log	3.5294	60	0.8175	0.6231	0.8175	0.9041
No log	3.6471	62	0.7373	0.5915	0.7373	0.8587
No log	3.7647	64	0.7559	0.5714	0.7559	0.8694
No log	3.8824	66	0.8965	0.4699	0.8965	0.9468
No log	4.0	68	0.7976	0.5055	0.7976	0.8931
No log	4.1176	70	0.6772	0.6456	0.6772	0.8229
No log	4.2353	72	0.8834	0.5903	0.8834	0.9399
No log	4.3529	74	0.9769	0.5418	0.9769	0.9884
No log	4.4706	76	0.7632	0.6717	0.7632	0.8736
No log	4.5882	78	0.6793	0.6985	0.6793	0.8242
No log	4.7059	80	0.6816	0.6700	0.6816	0.8256
No log	4.8235	82	0.6840	0.7002	0.6840	0.8271
No log	4.9412	84	0.6690	0.7120	0.6690	0.8179
No log	5.0588	86	0.6768	0.6800	0.6768	0.8227
No log	5.1765	88	0.6658	0.6820	0.6658	0.8159
No log	5.2941	90	0.7415	0.6784	0.7415	0.8611
No log	5.4118	92	0.6259	0.6889	0.6259	0.7912
No log	5.5294	94	0.7190	0.6887	0.7190	0.8479
No log	5.6471	96	0.8874	0.6094	0.8874	0.9420
No log	5.7647	98	0.6916	0.7045	0.6916	0.8316
No log	5.8824	100	0.6029	0.7159	0.6029	0.7765
No log	6.0	102	0.6562	0.7094	0.6562	0.8101
No log	6.1176	104	0.6629	0.6984	0.6629	0.8142
No log	6.2353	106	0.6454	0.6522	0.6454	0.8034
No log	6.3529	108	0.7245	0.6724	0.7245	0.8512
No log	6.4706	110	0.6716	0.6711	0.6716	0.8195
No log	6.5882	112	0.6023	0.7420	0.6023	0.7761
No log	6.7059	114	0.8204	0.6869	0.8204	0.9057
No log	6.8235	116	0.7684	0.6943	0.7684	0.8766
No log	6.9412	118	0.6457	0.7410	0.6457	0.8036
No log	7.0588	120	0.6261	0.7259	0.6261	0.7913
No log	7.1765	122	0.6140	0.7438	0.6140	0.7836
No log	7.2941	124	0.6531	0.7270	0.6531	0.8081
No log	7.4118	126	0.6493	0.7357	0.6493	0.8058
No log	7.5294	128	0.6302	0.7014	0.6302	0.7939
No log	7.6471	130	0.6451	0.7191	0.6451	0.8032
No log	7.7647	132	0.6212	0.7166	0.6212	0.7881
No log	7.8824	134	0.6460	0.6934	0.6460	0.8038
No log	8.0	136	0.6722	0.6655	0.6722	0.8199
No log	8.1176	138	0.6486	0.6840	0.6486	0.8053
No log	8.2353	140	0.5924	0.6973	0.5924	0.7697
No log	8.3529	142	0.5920	0.7516	0.5920	0.7694
No log	8.4706	144	0.5834	0.7401	0.5834	0.7638
No log	8.5882	146	0.6178	0.7239	0.6178	0.7860
No log	8.7059	148	0.7101	0.6966	0.7101	0.8427
No log	8.8235	150	0.7622	0.7018	0.7622	0.8731
No log	8.9412	152	0.7786	0.6980	0.7786	0.8824
No log	9.0588	154	0.7147	0.7229	0.7147	0.8454
No log	9.1765	156	0.6069	0.7486	0.6069	0.7790
No log	9.2941	158	0.5881	0.7565	0.5881	0.7669
No log	9.4118	160	0.5764	0.7387	0.5764	0.7592
No log	9.5294	162	0.5803	0.7548	0.5803	0.7618
No log	9.6471	164	0.6060	0.7378	0.6060	0.7784
No log	9.7647	166	0.6444	0.6969	0.6444	0.8027
No log	9.8824	168	0.6212	0.7197	0.6212	0.7881
No log	10.0	170	0.6618	0.6734	0.6618	0.8135
No log	10.1176	172	0.8880	0.6373	0.8880	0.9423
No log	10.2353	174	0.8638	0.6370	0.8638	0.9294
No log	10.3529	176	0.6954	0.6665	0.6954	0.8339
No log	10.4706	178	0.6193	0.7092	0.6193	0.7870
No log	10.5882	180	0.6905	0.6541	0.6905	0.8310
No log	10.7059	182	0.6614	0.6580	0.6614	0.8133
No log	10.8235	184	0.5958	0.6975	0.5958	0.7719
No log	10.9412	186	0.6151	0.6965	0.6151	0.7843
No log	11.0588	188	0.6873	0.6646	0.6873	0.8291
No log	11.1765	190	0.6093	0.7032	0.6093	0.7806
No log	11.2941	192	0.5767	0.7488	0.5767	0.7594
No log	11.4118	194	0.6043	0.7176	0.6043	0.7774
No log	11.5294	196	0.5893	0.7281	0.5893	0.7676
No log	11.6471	198	0.5751	0.7408	0.5751	0.7583
No log	11.7647	200	0.5709	0.7478	0.5709	0.7556
No log	11.8824	202	0.5583	0.7355	0.5583	0.7472
No log	12.0	204	0.6502	0.6724	0.6502	0.8064
No log	12.1176	206	0.7062	0.6785	0.7062	0.8404
No log	12.2353	208	0.6229	0.6951	0.6229	0.7893
No log	12.3529	210	0.5649	0.7185	0.5649	0.7516
No log	12.4706	212	0.6919	0.6647	0.6919	0.8318
No log	12.5882	214	0.6962	0.6625	0.6962	0.8344
No log	12.7059	216	0.5835	0.7145	0.5835	0.7638
No log	12.8235	218	0.6219	0.7075	0.6219	0.7886
No log	12.9412	220	0.6799	0.6490	0.6799	0.8246
No log	13.0588	222	0.6431	0.7097	0.6431	0.8019
No log	13.1765	224	0.6379	0.6617	0.6379	0.7987
No log	13.2941	226	0.8014	0.6245	0.8014	0.8952
No log	13.4118	228	0.9827	0.5479	0.9827	0.9913
No log	13.5294	230	1.0132	0.5677	1.0132	1.0066
No log	13.6471	232	0.8633	0.6279	0.8633	0.9291
No log	13.7647	234	0.7213	0.7291	0.7213	0.8493
No log	13.8824	236	0.6905	0.6924	0.6905	0.8310
No log	14.0	238	0.6751	0.6900	0.6751	0.8217
No log	14.1176	240	0.6447	0.7135	0.6447	0.8030
No log	14.2353	242	0.6210	0.7008	0.6210	0.7881
No log	14.3529	244	0.6535	0.6887	0.6535	0.8084
No log	14.4706	246	0.6780	0.6480	0.6780	0.8234
No log	14.5882	248	0.6347	0.6866	0.6347	0.7967
No log	14.7059	250	0.6056	0.7083	0.6056	0.7782
No log	14.8235	252	0.5951	0.7418	0.5951	0.7715
No log	14.9412	254	0.5909	0.7241	0.5909	0.7687
No log	15.0588	256	0.5862	0.7258	0.5862	0.7657
No log	15.1765	258	0.5848	0.7210	0.5848	0.7647
No log	15.2941	260	0.5716	0.7398	0.5716	0.7561
No log	15.4118	262	0.5727	0.7354	0.5727	0.7567
No log	15.5294	264	0.5971	0.7322	0.5971	0.7727
No log	15.6471	266	0.6149	0.7323	0.6149	0.7841
No log	15.7647	268	0.6045	0.7409	0.6045	0.7775
No log	15.8824	270	0.5708	0.7361	0.5708	0.7555
No log	16.0	272	0.5672	0.7316	0.5672	0.7531
No log	16.1176	274	0.5899	0.6997	0.5899	0.7681
No log	16.2353	276	0.6700	0.6418	0.6700	0.8186
No log	16.3529	278	0.8267	0.6236	0.8267	0.9093
No log	16.4706	280	0.8757	0.6241	0.8757	0.9358
No log	16.5882	282	0.7855	0.6322	0.7855	0.8863
No log	16.7059	284	0.6543	0.6447	0.6543	0.8089
No log	16.8235	286	0.6003	0.6923	0.6003	0.7748
No log	16.9412	288	0.5978	0.7339	0.5978	0.7732
No log	17.0588	290	0.5917	0.7488	0.5917	0.7692
No log	17.1765	292	0.6147	0.7247	0.6147	0.7841
No log	17.2941	294	0.6603	0.6956	0.6603	0.8126
No log	17.4118	296	0.6509	0.6892	0.6509	0.8068
No log	17.5294	298	0.6447	0.6852	0.6447	0.8029
No log	17.6471	300	0.6216	0.6925	0.6216	0.7884
No log	17.7647	302	0.6047	0.7069	0.6047	0.7776
No log	17.8824	304	0.5934	0.7107	0.5934	0.7704
No log	18.0	306	0.5887	0.7355	0.5887	0.7673
No log	18.1176	308	0.6104	0.7270	0.6104	0.7813
No log	18.2353	310	0.5969	0.7331	0.5969	0.7726
No log	18.3529	312	0.5898	0.7278	0.5898	0.7680
No log	18.4706	314	0.5650	0.7220	0.5650	0.7516
No log	18.5882	316	0.5900	0.7024	0.5900	0.7681
No log	18.7059	318	0.6238	0.7105	0.6238	0.7898
No log	18.8235	320	0.5986	0.6996	0.5986	0.7737
No log	18.9412	322	0.5858	0.6879	0.5858	0.7654
No log	19.0588	324	0.6332	0.6684	0.6332	0.7957
No log	19.1765	326	0.6917	0.6457	0.6917	0.8317
No log	19.2941	328	0.7169	0.6761	0.7169	0.8467
No log	19.4118	330	0.7115	0.6778	0.7115	0.8435
No log	19.5294	332	0.6733	0.6943	0.6733	0.8205
No log	19.6471	334	0.6378	0.7254	0.6378	0.7987
No log	19.7647	336	0.6090	0.7550	0.6090	0.7804
No log	19.8824	338	0.5967	0.7462	0.5967	0.7725
No log	20.0	340	0.5764	0.7347	0.5764	0.7592
No log	20.1176	342	0.5711	0.7408	0.5711	0.7557
No log	20.2353	344	0.5715	0.7408	0.5715	0.7560
No log	20.3529	346	0.5904	0.7345	0.5904	0.7684
No log	20.4706	348	0.6279	0.7346	0.6279	0.7924
No log	20.5882	350	0.6177	0.7285	0.6177	0.7859
No log	20.7059	352	0.5865	0.7496	0.5865	0.7658
No log	20.8235	354	0.5757	0.7566	0.5757	0.7587
No log	20.9412	356	0.5746	0.7387	0.5746	0.7580
No log	21.0588	358	0.5920	0.7269	0.5920	0.7694
No log	21.1765	360	0.6315	0.6859	0.6315	0.7947
No log	21.2941	362	0.6922	0.7028	0.6922	0.8320
No log	21.4118	364	0.7042	0.7023	0.7042	0.8392
No log	21.5294	366	0.6678	0.7106	0.6678	0.8172
No log	21.6471	368	0.5911	0.7336	0.5911	0.7688
No log	21.7647	370	0.5850	0.7758	0.5850	0.7648
No log	21.8824	372	0.5982	0.7414	0.5982	0.7735
No log	22.0	374	0.5881	0.7576	0.5881	0.7669
No log	22.1176	376	0.5833	0.6870	0.5833	0.7638
No log	22.2353	378	0.6118	0.6962	0.6118	0.7822
No log	22.3529	380	0.5956	0.6939	0.5956	0.7717
No log	22.4706	382	0.5770	0.6968	0.5770	0.7596
No log	22.5882	384	0.5839	0.6929	0.5839	0.7641
No log	22.7059	386	0.6248	0.6843	0.6248	0.7904
No log	22.8235	388	0.6195	0.6843	0.6195	0.7871
No log	22.9412	390	0.5796	0.7221	0.5796	0.7613
No log	23.0588	392	0.5680	0.7499	0.5680	0.7537
No log	23.1765	394	0.5708	0.7547	0.5708	0.7555
No log	23.2941	396	0.5786	0.7707	0.5786	0.7606
No log	23.4118	398	0.6241	0.7394	0.6241	0.7900
No log	23.5294	400	0.6372	0.7089	0.6372	0.7982
No log	23.6471	402	0.6159	0.7204	0.6159	0.7848
No log	23.7647	404	0.5654	0.7521	0.5654	0.7520
No log	23.8824	406	0.5591	0.7609	0.5591	0.7478
No log	24.0	408	0.5990	0.7225	0.5990	0.7739
No log	24.1176	410	0.6174	0.7287	0.6174	0.7857
No log	24.2353	412	0.5816	0.7555	0.5816	0.7626
No log	24.3529	414	0.5813	0.7738	0.5813	0.7624
No log	24.4706	416	0.6765	0.7191	0.6765	0.8225
No log	24.5882	418	0.6879	0.7074	0.6879	0.8294
No log	24.7059	420	0.6674	0.6647	0.6674	0.8170
No log	24.8235	422	0.6025	0.6633	0.6025	0.7762
No log	24.9412	424	0.5752	0.7170	0.5752	0.7584
No log	25.0588	426	0.5654	0.7206	0.5654	0.7520
No log	25.1765	428	0.5552	0.7409	0.5552	0.7451
No log	25.2941	430	0.5481	0.7459	0.5481	0.7403
No log	25.4118	432	0.5562	0.7610	0.5562	0.7458
No log	25.5294	434	0.5604	0.7531	0.5604	0.7486
No log	25.6471	436	0.5570	0.7495	0.5570	0.7463
No log	25.7647	438	0.5593	0.7524	0.5593	0.7478
No log	25.8824	440	0.5599	0.7543	0.5599	0.7482
No log	26.0	442	0.5592	0.7375	0.5592	0.7478
No log	26.1176	444	0.5815	0.7088	0.5815	0.7626
No log	26.2353	446	0.6445	0.6916	0.6445	0.8028
No log	26.3529	448	0.6564	0.6916	0.6564	0.8102
No log	26.4706	450	0.6266	0.7294	0.6266	0.7916
No log	26.5882	452	0.6198	0.7585	0.6198	0.7873
No log	26.7059	454	0.6116	0.7517	0.6116	0.7820
No log	26.8235	456	0.6285	0.7531	0.6285	0.7928
No log	26.9412	458	0.6801	0.7172	0.6801	0.8247
No log	27.0588	460	0.7148	0.7179	0.7148	0.8454
No log	27.1765	462	0.6872	0.7049	0.6872	0.8290
No log	27.2941	464	0.6200	0.7361	0.6200	0.7874
No log	27.4118	466	0.5957	0.7299	0.5957	0.7718
No log	27.5294	468	0.6024	0.7199	0.6024	0.7762
No log	27.6471	470	0.6021	0.7300	0.6021	0.7759
No log	27.7647	472	0.5982	0.7228	0.5982	0.7734
No log	27.8824	474	0.6247	0.7025	0.6247	0.7904
No log	28.0	476	0.6248	0.7074	0.6248	0.7905
No log	28.1176	478	0.6038	0.7085	0.6038	0.7770
No log	28.2353	480	0.6048	0.7118	0.6048	0.7777
No log	28.3529	482	0.6242	0.7032	0.6242	0.7901
No log	28.4706	484	0.6427	0.7001	0.6427	0.8017
No log	28.5882	486	0.6316	0.7107	0.6316	0.7947
No log	28.7059	488	0.6456	0.7006	0.6456	0.8035
No log	28.8235	490	0.7025	0.6868	0.7025	0.8381
No log	28.9412	492	0.7715	0.6647	0.7715	0.8783
No log	29.0588	494	0.8460	0.6414	0.8460	0.9198
No log	29.1765	496	0.8278	0.6621	0.8278	0.9098
No log	29.2941	498	0.7778	0.6705	0.7778	0.8819
0.3823	29.4118	500	0.6641	0.7225	0.6641	0.8149
0.3823	29.5294	502	0.5957	0.7491	0.5957	0.7718
0.3823	29.6471	504	0.6236	0.6872	0.6236	0.7897
0.3823	29.7647	506	0.6491	0.6765	0.6491	0.8057
0.3823	29.8824	508	0.6221	0.6865	0.6221	0.7887
0.3823	30.0	510	0.5892	0.7457	0.5892	0.7676
0.3823	30.1176	512	0.6230	0.6837	0.6230	0.7893
0.3823	30.2353	514	0.6618	0.6754	0.6618	0.8135
0.3823	30.3529	516	0.6866	0.6596	0.6866	0.8286
0.3823	30.4706	518	0.6429	0.6962	0.6429	0.8018
0.3823	30.5882	520	0.5917	0.7190	0.5917	0.7692

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1