ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6893
• Qwk: 0.3409
• Mse: 0.6893
• Rmse: 0.8302

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0196	2	2.6755	-0.1017	2.6755	1.6357
No log	0.0392	4	1.2863	0.0982	1.2863	1.1342
No log	0.0588	6	1.1708	-0.1849	1.1708	1.0820
No log	0.0784	8	1.0367	-0.0469	1.0367	1.0182
No log	0.0980	10	1.0781	0.0354	1.0781	1.0383
No log	0.1176	12	0.9435	0.0120	0.9435	0.9713
No log	0.1373	14	0.8647	-0.0860	0.8647	0.9299
No log	0.1569	16	0.8951	-0.0860	0.8951	0.9461
No log	0.1765	18	1.0246	-0.0112	1.0246	1.0122
No log	0.1961	20	0.9252	-0.0860	0.9252	0.9619
No log	0.2157	22	0.9502	-0.0851	0.9502	0.9748
No log	0.2353	24	1.0014	-0.0841	1.0014	1.0007
No log	0.2549	26	1.0112	-0.0841	1.0112	1.0056
No log	0.2745	28	1.1851	-0.0774	1.1851	1.0886
No log	0.2941	30	1.3698	-0.0964	1.3698	1.1704
No log	0.3137	32	1.4108	-0.0734	1.4108	1.1878
No log	0.3333	34	1.4328	-0.0632	1.4328	1.1970
No log	0.3529	36	1.1445	-0.0299	1.1445	1.0698
No log	0.3725	38	0.9596	0.2085	0.9596	0.9796
No log	0.3922	40	0.9539	0.1598	0.9539	0.9767
No log	0.4118	42	1.0856	0.2119	1.0856	1.0419
No log	0.4314	44	1.1639	0.0324	1.1639	1.0788
No log	0.4510	46	1.1842	0.0175	1.1842	1.0882
No log	0.4706	48	1.1189	-0.0299	1.1189	1.0578
No log	0.4902	50	1.0156	-0.0548	1.0156	1.0078
No log	0.5098	52	0.9371	-0.0073	0.9371	0.9681
No log	0.5294	54	0.8550	0.0	0.8550	0.9247
No log	0.5490	56	0.8070	0.0	0.8070	0.8983
No log	0.5686	58	0.8063	0.0927	0.8063	0.8979
No log	0.5882	60	0.9165	0.2116	0.9165	0.9573
No log	0.6078	62	0.9360	0.2275	0.9360	0.9675
No log	0.6275	64	0.9025	0.1815	0.9025	0.9500
No log	0.6471	66	0.8446	0.1268	0.8446	0.9190
No log	0.6667	68	0.8391	0.0573	0.8391	0.9160
No log	0.6863	70	0.8278	-0.0149	0.8278	0.9098
No log	0.7059	72	0.8667	0.0851	0.8667	0.9310
No log	0.7255	74	1.0173	0.1217	1.0173	1.0086
No log	0.7451	76	1.0188	0.1628	1.0188	1.0094
No log	0.7647	78	0.8935	0.0781	0.8935	0.9452
No log	0.7843	80	0.9120	0.1142	0.9120	0.9550
No log	0.8039	82	0.9117	0.1142	0.9117	0.9548
No log	0.8235	84	0.9510	0.1866	0.9510	0.9752
No log	0.8431	86	0.9762	0.1930	0.9762	0.9880
No log	0.8627	88	0.9103	0.2285	0.9103	0.9541
No log	0.8824	90	0.8633	0.1598	0.8633	0.9291
No log	0.9020	92	0.8495	0.2285	0.8495	0.9217
No log	0.9216	94	0.8218	0.2345	0.8218	0.9065
No log	0.9412	96	0.8390	0.1972	0.8390	0.9160
No log	0.9608	98	0.8677	0.2471	0.8677	0.9315
No log	0.9804	100	0.8556	0.1807	0.8556	0.9250
No log	1.0	102	0.8222	0.1863	0.8222	0.9068
No log	1.0196	104	0.7975	0.1863	0.7975	0.8931
No log	1.0392	106	0.8106	0.1972	0.8106	0.9003
No log	1.0588	108	0.8856	0.2297	0.8856	0.9411
No log	1.0784	110	0.8766	0.3032	0.8766	0.9363
No log	1.0980	112	0.8261	0.3032	0.8261	0.9089
No log	1.1176	114	0.7432	0.2227	0.7432	0.8621
No log	1.1373	116	0.7315	0.2227	0.7315	0.8553
No log	1.1569	118	0.7717	0.2871	0.7717	0.8785
No log	1.1765	120	0.7653	0.2547	0.7653	0.8748
No log	1.1961	122	0.7303	0.2817	0.7303	0.8546
No log	1.2157	124	0.7063	0.3041	0.7063	0.8404
No log	1.2353	126	0.7321	0.2527	0.7321	0.8556
No log	1.2549	128	0.7371	0.3127	0.7371	0.8586
No log	1.2745	130	0.7226	0.2590	0.7226	0.8501
No log	1.2941	132	0.7458	0.3088	0.7458	0.8636
No log	1.3137	134	0.8547	0.3280	0.8547	0.9245
No log	1.3333	136	0.8588	0.2415	0.8588	0.9267
No log	1.3529	138	0.8032	0.2988	0.8032	0.8962
No log	1.3725	140	0.7809	0.2319	0.7809	0.8837
No log	1.3922	142	0.7818	0.2558	0.7818	0.8842
No log	1.4118	144	0.7588	0.2558	0.7588	0.8711
No log	1.4314	146	0.7675	0.2558	0.7675	0.8761
No log	1.4510	148	0.7383	0.2877	0.7383	0.8593
No log	1.4706	150	0.7299	0.3296	0.7299	0.8544
No log	1.4902	152	0.7318	0.3970	0.7318	0.8555
No log	1.5098	154	0.7441	0.2877	0.7441	0.8626
No log	1.5294	156	0.7518	0.3146	0.7518	0.8670
No log	1.5490	158	0.7618	0.3769	0.7618	0.8728
No log	1.5686	160	0.8066	0.3775	0.8066	0.8981
No log	1.5882	162	0.8556	0.3292	0.8556	0.9250
No log	1.6078	164	0.8067	0.3548	0.8067	0.8982
No log	1.6275	166	0.7425	0.3331	0.7425	0.8617
No log	1.6471	168	0.7874	0.4327	0.7874	0.8874
No log	1.6667	170	0.7244	0.3761	0.7244	0.8511
No log	1.6863	172	0.7520	0.3656	0.7520	0.8672
No log	1.7059	174	1.0541	0.2807	1.0541	1.0267
No log	1.7255	176	1.2111	0.2554	1.2111	1.1005
No log	1.7451	178	1.1042	0.2807	1.1042	1.0508
No log	1.7647	180	0.8647	0.3060	0.8647	0.9299
No log	1.7843	182	0.7204	0.2907	0.7204	0.8488
No log	1.8039	184	0.7323	0.2502	0.7323	0.8557
No log	1.8235	186	0.8580	0.3918	0.8580	0.9263
No log	1.8431	188	1.1043	0.2507	1.1043	1.0509
No log	1.8627	190	1.1367	0.2730	1.1367	1.0662
No log	1.8824	192	0.9607	0.3913	0.9607	0.9802
No log	1.9020	194	0.7356	0.3966	0.7356	0.8577
No log	1.9216	196	0.6372	0.3738	0.6372	0.7983
No log	1.9412	198	0.6198	0.3910	0.6198	0.7873
No log	1.9608	200	0.6246	0.3910	0.6246	0.7903
No log	1.9804	202	0.6834	0.4260	0.6834	0.8267
No log	2.0	204	0.8160	0.3802	0.8160	0.9033
No log	2.0196	206	0.8816	0.4614	0.8816	0.9389
No log	2.0392	208	0.9449	0.3887	0.9449	0.9720
No log	2.0588	210	0.8021	0.4476	0.8021	0.8956
No log	2.0784	212	0.6693	0.4135	0.6693	0.8181
No log	2.0980	214	0.6162	0.5494	0.6162	0.7850
No log	2.1176	216	0.6347	0.5561	0.6347	0.7967
No log	2.1373	218	0.6498	0.5252	0.6498	0.8061
No log	2.1569	220	0.6758	0.5205	0.6758	0.8221
No log	2.1765	222	0.6610	0.5442	0.6610	0.8130
No log	2.1961	224	0.6315	0.5683	0.6315	0.7947
No log	2.2157	226	0.6097	0.5563	0.6097	0.7808
No log	2.2353	228	0.5848	0.5634	0.5848	0.7647
No log	2.2549	230	0.5776	0.5184	0.5776	0.7600
No log	2.2745	232	0.5803	0.4535	0.5803	0.7618
No log	2.2941	234	0.6222	0.4081	0.6222	0.7888
No log	2.3137	236	0.7195	0.3590	0.7195	0.8482
No log	2.3333	238	0.7243	0.3590	0.7243	0.8511
No log	2.3529	240	0.6592	0.3590	0.6592	0.8119
No log	2.3725	242	0.6234	0.3665	0.6234	0.7896
No log	2.3922	244	0.6238	0.3762	0.6238	0.7898
No log	2.4118	246	0.6631	0.3817	0.6631	0.8143
No log	2.4314	248	0.8573	0.3709	0.8573	0.9259
No log	2.4510	250	0.9697	0.3643	0.9697	0.9847
No log	2.4706	252	0.9270	0.3538	0.9270	0.9628
No log	2.4902	254	0.7964	0.3042	0.7964	0.8924
No log	2.5098	256	0.6454	0.3590	0.6454	0.8034
No log	2.5294	258	0.6065	0.3754	0.6065	0.7788
No log	2.5490	260	0.6115	0.4136	0.6115	0.7820
No log	2.5686	262	0.6108	0.3809	0.6108	0.7815
No log	2.5882	264	0.6638	0.3287	0.6638	0.8148
No log	2.6078	266	0.9375	0.3251	0.9375	0.9682
No log	2.6275	268	1.1947	0.3250	1.1947	1.0930
No log	2.6471	270	1.2018	0.3250	1.2018	1.0963
No log	2.6667	272	1.0088	0.2677	1.0088	1.0044
No log	2.6863	274	0.9172	0.3433	0.9172	0.9577
No log	2.7059	276	0.8875	0.3564	0.8875	0.9421
No log	2.7255	278	0.8523	0.3032	0.8523	0.9232
No log	2.7451	280	0.8582	0.3032	0.8582	0.9264
No log	2.7647	282	0.9135	0.2697	0.9135	0.9558
No log	2.7843	284	0.8777	0.2871	0.8777	0.9369
No log	2.8039	286	0.8193	0.2440	0.8193	0.9051
No log	2.8235	288	0.7970	0.2204	0.7970	0.8927
No log	2.8431	290	0.8276	0.3157	0.8276	0.9097
No log	2.8627	292	0.8506	0.3157	0.8506	0.9223
No log	2.8824	294	0.9151	0.3297	0.9151	0.9566
No log	2.9020	296	1.1029	0.2547	1.1029	1.0502
No log	2.9216	298	1.1262	0.2524	1.1262	1.0612
No log	2.9412	300	0.9641	0.2803	0.9641	0.9819
No log	2.9608	302	0.7894	0.2527	0.7894	0.8885
No log	2.9804	304	0.7477	0.1587	0.7477	0.8647
No log	3.0	306	0.7349	0.1264	0.7349	0.8573
No log	3.0196	308	0.7565	0.2335	0.7565	0.8698
No log	3.0392	310	0.8174	0.3544	0.8174	0.9041
No log	3.0588	312	0.8442	0.3183	0.8442	0.9188
No log	3.0784	314	0.8675	0.3582	0.8675	0.9314
No log	3.0980	316	0.8084	0.3710	0.8084	0.8991
No log	3.1176	318	0.7121	0.3183	0.7121	0.8439
No log	3.1373	320	0.6862	0.3781	0.6862	0.8284
No log	3.1569	322	0.6652	0.2717	0.6652	0.8156
No log	3.1765	324	0.6868	0.3662	0.6868	0.8288
No log	3.1961	326	0.8827	0.3913	0.8827	0.9395
No log	3.2157	328	1.0347	0.3481	1.0347	1.0172
No log	3.2353	330	1.0483	0.3481	1.0483	1.0238
No log	3.2549	332	0.8915	0.4030	0.8915	0.9442
No log	3.2745	334	0.7087	0.2722	0.7087	0.8419
No log	3.2941	336	0.6702	0.2558	0.6702	0.8187
No log	3.3137	338	0.6763	0.2558	0.6763	0.8224
No log	3.3333	340	0.7066	0.2995	0.7066	0.8406
No log	3.3529	342	0.8540	0.4123	0.8540	0.9241
No log	3.3725	344	1.0572	0.3105	1.0572	1.0282
No log	3.3922	346	1.0668	0.2779	1.0668	1.0329
No log	3.4118	348	0.9262	0.3544	0.9262	0.9624
No log	3.4314	350	0.7554	0.3329	0.7554	0.8691
No log	3.4510	352	0.6744	0.3572	0.6744	0.8212
No log	3.4706	354	0.6592	0.4067	0.6592	0.8119
No log	3.4902	356	0.6536	0.4419	0.6536	0.8084
No log	3.5098	358	0.6468	0.3787	0.6468	0.8042
No log	3.5294	360	0.6672	0.4314	0.6672	0.8169
No log	3.5490	362	0.7073	0.3500	0.7073	0.8410
No log	3.5686	364	0.6841	0.3966	0.6841	0.8271
No log	3.5882	366	0.6645	0.3665	0.6645	0.8152
No log	3.6078	368	0.6608	0.3382	0.6608	0.8129
No log	3.6275	370	0.6846	0.3966	0.6846	0.8274
No log	3.6471	372	0.7057	0.3500	0.7057	0.8401
No log	3.6667	374	0.6904	0.3688	0.6904	0.8309
No log	3.6863	376	0.6910	0.3817	0.6910	0.8313
No log	3.7059	378	0.6819	0.3688	0.6819	0.8258
No log	3.7255	380	0.6471	0.4375	0.6471	0.8044
No log	3.7451	382	0.6301	0.4036	0.6301	0.7938
No log	3.7647	384	0.6514	0.3225	0.6514	0.8071
No log	3.7843	386	0.6691	0.3504	0.6691	0.8180
No log	3.8039	388	0.7355	0.3355	0.7355	0.8576
No log	3.8235	390	0.7928	0.2662	0.7928	0.8904
No log	3.8431	392	0.8044	0.2662	0.8044	0.8969
No log	3.8627	394	0.8403	0.2932	0.8403	0.9167
No log	3.8824	396	0.8799	0.3417	0.8799	0.9380
No log	3.9020	398	0.8649	0.2912	0.8649	0.9300
No log	3.9216	400	0.7828	0.2953	0.7828	0.8848
No log	3.9412	402	0.7728	0.2953	0.7728	0.8791
No log	3.9608	404	0.8378	0.3754	0.8378	0.9153
No log	3.9804	406	0.8416	0.3125	0.8416	0.9174
No log	4.0	408	0.7679	0.3976	0.7679	0.8763
No log	4.0196	410	0.6997	0.4473	0.6997	0.8365
No log	4.0392	412	0.6733	0.3144	0.6733	0.8206
No log	4.0588	414	0.6662	0.4505	0.6662	0.8162
No log	4.0784	416	0.6775	0.4480	0.6775	0.8231
No log	4.0980	418	0.7045	0.4230	0.7045	0.8394
No log	4.1176	420	0.7148	0.4210	0.7148	0.8454
No log	4.1373	422	0.6775	0.4595	0.6775	0.8231
No log	4.1569	424	0.6732	0.3590	0.6732	0.8205
No log	4.1765	426	0.7471	0.4002	0.7471	0.8644
No log	4.1961	428	0.8261	0.3521	0.8261	0.9089
No log	4.2157	430	0.8704	0.3847	0.8704	0.9329
No log	4.2353	432	0.7841	0.3940	0.7841	0.8855
No log	4.2549	434	0.6599	0.3590	0.6599	0.8123
No log	4.2745	436	0.6276	0.3976	0.6276	0.7922
No log	4.2941	438	0.6260	0.3976	0.6260	0.7912
No log	4.3137	440	0.6382	0.4592	0.6382	0.7989
No log	4.3333	442	0.6824	0.3653	0.6824	0.8261
No log	4.3529	444	0.7002	0.3776	0.7002	0.8368
No log	4.3725	446	0.7172	0.3776	0.7172	0.8469
No log	4.3922	448	0.8259	0.3239	0.8259	0.9088
No log	4.4118	450	0.9374	0.3618	0.9374	0.9682
No log	4.4314	452	0.8987	0.3678	0.8987	0.9480
No log	4.4510	454	0.8214	0.3239	0.8214	0.9063
No log	4.4706	456	0.7637	0.3653	0.7637	0.8739
No log	4.4902	458	0.7362	0.3409	0.7362	0.8580
No log	4.5098	460	0.6809	0.3590	0.6809	0.8251
No log	4.5294	462	0.6609	0.3329	0.6609	0.8129
No log	4.5490	464	0.7072	0.3329	0.7072	0.8410
No log	4.5686	466	0.8049	0.3034	0.8049	0.8972
No log	4.5882	468	0.8647	0.2917	0.8647	0.9299
No log	4.6078	470	0.8834	0.3159	0.8834	0.9399
No log	4.6275	472	0.8257	0.3520	0.8257	0.9087
No log	4.6471	474	0.6999	0.3409	0.6999	0.8366
No log	4.6667	476	0.6174	0.4124	0.6174	0.7858
No log	4.6863	478	0.6148	0.4729	0.6148	0.7841
No log	4.7059	480	0.6284	0.3919	0.6284	0.7927
No log	4.7255	482	0.7193	0.3590	0.7193	0.8481
No log	4.7451	484	0.8508	0.3688	0.8508	0.9224
No log	4.7647	486	0.8456	0.3740	0.8456	0.9196
No log	4.7843	488	0.7311	0.3261	0.7311	0.8550
No log	4.8039	490	0.6588	0.3545	0.6588	0.8116
No log	4.8235	492	0.6708	0.3023	0.6708	0.8190
No log	4.8431	494	0.7035	0.3060	0.7035	0.8388
No log	4.8627	496	0.7664	0.2995	0.7664	0.8754
No log	4.8824	498	0.8454	0.3409	0.8454	0.9195
0.3693	4.9020	500	0.7705	0.3590	0.7705	0.8778
0.3693	4.9216	502	0.7521	0.3329	0.7521	0.8672
0.3693	4.9412	504	0.7211	0.3355	0.7211	0.8492
0.3693	4.9608	506	0.7138	0.3615	0.7138	0.8449
0.3693	4.9804	508	0.7104	0.3867	0.7104	0.8428
0.3693	5.0	510	0.7641	0.3677	0.7641	0.8741
0.3693	5.0196	512	0.9042	0.4081	0.9042	0.9509
0.3693	5.0392	514	0.8909	0.4081	0.8909	0.9439
0.3693	5.0588	516	0.7274	0.3891	0.7274	0.8529
0.3693	5.0784	518	0.6531	0.3867	0.6531	0.8081
0.3693	5.0980	520	0.6582	0.3519	0.6582	0.8113
0.3693	5.1176	522	0.6680	0.3770	0.6680	0.8173
0.3693	5.1373	524	0.6909	0.3770	0.6909	0.8312
0.3693	5.1569	526	0.6508	0.4513	0.6508	0.8067
0.3693	5.1765	528	0.6255	0.4270	0.6255	0.7909
0.3693	5.1961	530	0.6347	0.4270	0.6347	0.7967
0.3693	5.2157	532	0.6196	0.4270	0.6196	0.7871
0.3693	5.2353	534	0.5908	0.4534	0.5908	0.7686
0.3693	5.2549	536	0.5981	0.4270	0.5981	0.7734
0.3693	5.2745	538	0.6159	0.3996	0.6159	0.7848
0.3693	5.2941	540	0.6316	0.3996	0.6316	0.7947
0.3693	5.3137	542	0.6217	0.3996	0.6217	0.7885
0.3693	5.3333	544	0.6445	0.3996	0.6445	0.8028
0.3693	5.3529	546	0.6389	0.3996	0.6389	0.7993
0.3693	5.3725	548	0.6182	0.3996	0.6182	0.7863
0.3693	5.3922	550	0.5807	0.3996	0.5807	0.7621
0.3693	5.4118	552	0.5603	0.4437	0.5603	0.7485
0.3693	5.4314	554	0.5654	0.4270	0.5654	0.7520
0.3693	5.4510	556	0.6218	0.3996	0.6218	0.7885
0.3693	5.4706	558	0.6516	0.3590	0.6516	0.8072
0.3693	5.4902	560	0.6435	0.3590	0.6435	0.8022
0.3693	5.5098	562	0.6039	0.3996	0.6039	0.7771
0.3693	5.5294	564	0.5680	0.4270	0.5680	0.7536
0.3693	5.5490	566	0.5307	0.5150	0.5307	0.7285
0.3693	5.5686	568	0.5146	0.5722	0.5146	0.7173
0.3693	5.5882	570	0.5166	0.5649	0.5166	0.7187
0.3693	5.6078	572	0.5327	0.5405	0.5327	0.7299
0.3693	5.6275	574	0.5887	0.5047	0.5887	0.7673
0.3693	5.6471	576	0.6121	0.4464	0.6121	0.7823
0.3693	5.6667	578	0.5741	0.5201	0.5741	0.7577
0.3693	5.6863	580	0.5335	0.5797	0.5335	0.7304
0.3693	5.7059	582	0.5391	0.6101	0.5391	0.7342
0.3693	5.7255	584	0.5329	0.5797	0.5329	0.7300
0.3693	5.7451	586	0.5310	0.5430	0.5310	0.7287
0.3693	5.7647	588	0.5943	0.4270	0.5943	0.7709
0.3693	5.7843	590	0.6513	0.3843	0.6513	0.8070
0.3693	5.8039	592	0.6209	0.3590	0.6209	0.7880
0.3693	5.8235	594	0.5768	0.3919	0.5768	0.7595
0.3693	5.8431	596	0.5663	0.3919	0.5663	0.7525
0.3693	5.8627	598	0.5484	0.5521	0.5484	0.7405
0.3693	5.8824	600	0.5537	0.4829	0.5537	0.7441
0.3693	5.9020	602	0.5513	0.5286	0.5513	0.7425
0.3693	5.9216	604	0.5548	0.4482	0.5548	0.7448
0.3693	5.9412	606	0.6060	0.3737	0.6060	0.7784
0.3693	5.9608	608	0.6252	0.3662	0.6252	0.7907
0.3693	5.9804	610	0.5659	0.4705	0.5659	0.7523
0.3693	6.0	612	0.5396	0.5267	0.5396	0.7345
0.3693	6.0196	614	0.5348	0.5267	0.5348	0.7313
0.3693	6.0392	616	0.5574	0.4437	0.5574	0.7466
0.3693	6.0588	618	0.6064	0.4437	0.6064	0.7787
0.3693	6.0784	620	0.6756	0.3653	0.6756	0.8219
0.3693	6.0980	622	0.6581	0.3590	0.6581	0.8113
0.3693	6.1176	624	0.6927	0.3653	0.6927	0.8323
0.3693	6.1373	626	0.7470	0.3653	0.7470	0.8643
0.3693	6.1569	628	0.7427	0.3409	0.7427	0.8618
0.3693	6.1765	630	0.7657	0.2975	0.7657	0.8751
0.3693	6.1961	632	0.7304	0.3590	0.7304	0.8546
0.3693	6.2157	634	0.6914	0.3590	0.6914	0.8315
0.3693	6.2353	636	0.6893	0.3409	0.6893	0.8302

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1