ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k7_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7908
• Qwk: 0.3569
• Mse: 0.7908
• Rmse: 0.8893

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1176	2	2.5757	-0.0924	2.5757	1.6049
No log	0.2353	4	1.3587	0.0994	1.3587	1.1656
No log	0.3529	6	1.1844	-0.2292	1.1844	1.0883
No log	0.4706	8	0.9977	-0.0426	0.9977	0.9988
No log	0.5882	10	0.9364	0.1007	0.9364	0.9677
No log	0.7059	12	0.8715	0.1648	0.8715	0.9335
No log	0.8235	14	0.8307	-0.0103	0.8307	0.9114
No log	0.9412	16	0.8269	-0.0483	0.8269	0.9094
No log	1.0588	18	0.9256	0.0495	0.9256	0.9621
No log	1.1765	20	0.9539	-0.0700	0.9539	0.9767
No log	1.2941	22	0.8720	0.0027	0.8720	0.9338
No log	1.4118	24	0.8314	0.0	0.8314	0.9118
No log	1.5294	26	0.8248	0.0	0.8248	0.9082
No log	1.6471	28	0.8307	0.1236	0.8307	0.9114
No log	1.7647	30	0.7798	0.0	0.7798	0.8831
No log	1.8824	32	0.7549	0.0	0.7549	0.8688
No log	2.0	34	0.7683	0.0	0.7683	0.8765
No log	2.1176	36	0.8061	0.0481	0.8061	0.8978
No log	2.2353	38	0.9177	0.2526	0.9177	0.9579
No log	2.3529	40	0.9241	0.3444	0.9241	0.9613
No log	2.4706	42	0.8782	0.3173	0.8782	0.9371
No log	2.5882	44	0.7992	0.1372	0.7992	0.8940
No log	2.7059	46	0.7477	0.0937	0.7477	0.8647
No log	2.8235	48	0.7057	0.0428	0.7057	0.8400
No log	2.9412	50	0.7487	0.3243	0.7487	0.8653
No log	3.0588	52	0.8144	0.1648	0.8144	0.9025
No log	3.1765	54	0.8334	0.1699	0.8334	0.9129
No log	3.2941	56	0.8386	0.1094	0.8386	0.9158
No log	3.4118	58	0.8747	-0.0027	0.8747	0.9353
No log	3.5294	60	0.9345	-0.1275	0.9345	0.9667
No log	3.6471	62	0.8859	-0.0444	0.8859	0.9412
No log	3.7647	64	0.7937	0.0	0.7937	0.8909
No log	3.8824	66	0.7158	0.0889	0.7158	0.8460
No log	4.0	68	0.7009	0.0393	0.7009	0.8372
No log	4.1176	70	0.7320	0.0359	0.7320	0.8556
No log	4.2353	72	0.7951	-0.0051	0.7951	0.8917
No log	4.3529	74	0.8104	0.0265	0.8104	0.9002
No log	4.4706	76	0.8378	0.0927	0.8378	0.9153
No log	4.5882	78	0.8915	0.0966	0.8915	0.9442
No log	4.7059	80	0.9184	0.1699	0.9184	0.9583
No log	4.8235	82	0.9273	0.2171	0.9273	0.9630
No log	4.9412	84	0.9054	0.1972	0.9054	0.9515
No log	5.0588	86	0.9133	0.0245	0.9133	0.9556
No log	5.1765	88	0.8966	0.0968	0.8966	0.9469
No log	5.2941	90	0.9316	0.1303	0.9316	0.9652
No log	5.4118	92	0.9620	0.2063	0.9620	0.9808
No log	5.5294	94	0.9344	0.2632	0.9344	0.9667
No log	5.6471	96	0.8432	0.3238	0.8432	0.9183
No log	5.7647	98	0.8240	0.2007	0.8240	0.9078
No log	5.8824	100	0.8275	-0.0070	0.8275	0.9097
No log	6.0	102	0.8621	0.0362	0.8621	0.9285
No log	6.1176	104	0.8318	0.0697	0.8318	0.9120
No log	6.2353	106	0.8264	0.2345	0.8264	0.9091
No log	6.3529	108	0.8756	0.2604	0.8756	0.9357
No log	6.4706	110	0.8394	0.2171	0.8394	0.9162
No log	6.5882	112	0.8389	0.2063	0.8389	0.9159
No log	6.7059	114	0.8408	0.0	0.8408	0.9169
No log	6.8235	116	0.7237	0.1829	0.7237	0.8507
No log	6.9412	118	0.6559	0.2819	0.6559	0.8099
No log	7.0588	120	0.6882	0.3950	0.6882	0.8296
No log	7.1765	122	0.8565	0.3499	0.8565	0.9255
No log	7.2941	124	0.9869	0.2921	0.9869	0.9934
No log	7.4118	126	0.9986	0.2464	0.9986	0.9993
No log	7.5294	128	1.0639	0.1354	1.0639	1.0315
No log	7.6471	130	1.5344	0.1007	1.5344	1.2387
No log	7.7647	132	1.5739	0.0790	1.5739	1.2545
No log	7.8824	134	1.2405	0.1332	1.2405	1.1138
No log	8.0	136	0.9822	0.0801	0.9822	0.9911
No log	8.1176	138	0.9364	0.2832	0.9364	0.9677
No log	8.2353	140	0.8927	0.3183	0.8927	0.9448
No log	8.3529	142	0.8516	0.3221	0.8516	0.9228
No log	8.4706	144	0.8220	0.2414	0.8220	0.9066
No log	8.5882	146	0.8005	0.2813	0.8005	0.8947
No log	8.7059	148	0.7958	0.2784	0.7958	0.8921
No log	8.8235	150	0.8072	0.3372	0.8072	0.8984
No log	8.9412	152	0.8401	0.3699	0.8401	0.9166
No log	9.0588	154	0.7969	0.3637	0.7969	0.8927
No log	9.1765	156	0.7616	0.3099	0.7616	0.8727
No log	9.2941	158	0.7264	0.1699	0.7264	0.8523
No log	9.4118	160	0.7207	0.1268	0.7207	0.8490
No log	9.5294	162	0.7408	0.1268	0.7408	0.8607
No log	9.6471	164	0.7870	0.2171	0.7870	0.8871
No log	9.7647	166	0.8375	0.2328	0.8375	0.9152
No log	9.8824	168	0.8349	0.1995	0.8349	0.9137
No log	10.0	170	0.8021	0.2589	0.8021	0.8956
No log	10.1176	172	0.8164	0.0652	0.8164	0.9035
No log	10.2353	174	0.8227	0.0652	0.8227	0.9070
No log	10.3529	176	0.7995	0.2027	0.7995	0.8941
No log	10.4706	178	0.8027	0.3372	0.8027	0.8959
No log	10.5882	180	0.7890	0.3564	0.7890	0.8883
No log	10.7059	182	0.7029	0.3302	0.7029	0.8384
No log	10.8235	184	0.6770	0.3425	0.6770	0.8228
No log	10.9412	186	0.7091	0.3127	0.7091	0.8421
No log	11.0588	188	0.7806	0.3372	0.7806	0.8835
No log	11.1765	190	0.8809	0.3847	0.8809	0.9386
No log	11.2941	192	0.8496	0.4251	0.8496	0.9217
No log	11.4118	194	0.7584	0.2784	0.7584	0.8708
No log	11.5294	196	0.7448	0.2683	0.7448	0.8630
No log	11.6471	198	0.7497	0.2360	0.7497	0.8658
No log	11.7647	200	0.7541	0.2319	0.7541	0.8684
No log	11.8824	202	0.8366	0.4089	0.8366	0.9147
No log	12.0	204	0.8499	0.3843	0.8499	0.9219
No log	12.1176	206	0.8151	0.1598	0.8151	0.9028
No log	12.2353	208	0.8159	0.1010	0.8159	0.9033
No log	12.3529	210	0.8342	0.1051	0.8342	0.9134
No log	12.4706	212	0.8018	0.1051	0.8018	0.8954
No log	12.5882	214	0.7516	0.2685	0.7516	0.8669
No log	12.7059	216	0.7893	0.3637	0.7893	0.8884
No log	12.8235	218	0.8175	0.3562	0.8175	0.9042
No log	12.9412	220	0.7565	0.4307	0.7565	0.8698
No log	13.0588	222	0.7153	0.4052	0.7153	0.8458
No log	13.1765	224	0.6842	0.3416	0.6842	0.8272
No log	13.2941	226	0.7053	0.2751	0.7053	0.8398
No log	13.4118	228	0.7584	0.2950	0.7584	0.8708
No log	13.5294	230	0.8312	0.3444	0.8312	0.9117
No log	13.6471	232	0.8638	0.3590	0.8638	0.9294
No log	13.7647	234	0.8389	0.3590	0.8389	0.9159
No log	13.8824	236	0.8055	0.3867	0.8055	0.8975
No log	14.0	238	0.7891	0.3867	0.7891	0.8883
No log	14.1176	240	0.7527	0.3444	0.7527	0.8676
No log	14.2353	242	0.7427	0.3868	0.7427	0.8618
No log	14.3529	244	0.7761	0.3712	0.7761	0.8810
No log	14.4706	246	0.8075	0.3302	0.8075	0.8986
No log	14.5882	248	0.8696	0.4014	0.8696	0.9325
No log	14.7059	250	0.8632	0.4014	0.8632	0.9291
No log	14.8235	252	0.8591	0.4272	0.8591	0.9269
No log	14.9412	254	0.8180	0.4272	0.8180	0.9044
No log	15.0588	256	0.7631	0.3713	0.7631	0.8735
No log	15.1765	258	0.7455	0.3002	0.7455	0.8634
No log	15.2941	260	0.7269	0.3701	0.7269	0.8526
No log	15.4118	262	0.7434	0.3737	0.7434	0.8622
No log	15.5294	264	0.7715	0.4052	0.7715	0.8784
No log	15.6471	266	0.7737	0.3789	0.7737	0.8796
No log	15.7647	268	0.7645	0.3894	0.7645	0.8743
No log	15.8824	270	0.7803	0.3615	0.7803	0.8834
No log	16.0	272	0.7595	0.4020	0.7595	0.8715
No log	16.1176	274	0.7336	0.3050	0.7336	0.8565
No log	16.2353	276	0.7305	0.3050	0.7305	0.8547
No log	16.3529	278	0.7383	0.3050	0.7383	0.8592
No log	16.4706	280	0.7855	0.3471	0.7855	0.8863
No log	16.5882	282	0.8291	0.3918	0.8291	0.9106
No log	16.7059	284	0.8088	0.3918	0.8088	0.8993
No log	16.8235	286	0.8076	0.3662	0.8076	0.8987
No log	16.9412	288	0.7819	0.2847	0.7819	0.8843
No log	17.0588	290	0.7737	0.2981	0.7737	0.8796
No log	17.1765	292	0.7968	0.3471	0.7968	0.8926
No log	17.2941	294	0.7921	0.2847	0.7921	0.8900
No log	17.4118	296	0.7699	0.3416	0.7699	0.8775
No log	17.5294	298	0.7647	0.2936	0.7647	0.8745
No log	17.6471	300	0.7670	0.3728	0.7670	0.8758
No log	17.7647	302	0.7891	0.3471	0.7891	0.8883
No log	17.8824	304	0.7950	0.4036	0.7950	0.8916
No log	18.0	306	0.7760	0.3976	0.7760	0.8809
No log	18.1176	308	0.7654	0.3002	0.7654	0.8749
No log	18.2353	310	0.7442	0.3081	0.7442	0.8627
No log	18.3529	312	0.7661	0.4112	0.7661	0.8753
No log	18.4706	314	0.8108	0.3844	0.8108	0.9004
No log	18.5882	316	0.7881	0.4112	0.7881	0.8877
No log	18.7059	318	0.7498	0.4684	0.7498	0.8659
No log	18.8235	320	0.7137	0.3123	0.7137	0.8448
No log	18.9412	322	0.7252	0.3416	0.7252	0.8516
No log	19.0588	324	0.7436	0.3894	0.7436	0.8623
No log	19.1765	326	0.7471	0.3894	0.7471	0.8643
No log	19.2941	328	0.7405	0.3296	0.7405	0.8606
No log	19.4118	330	0.7631	0.3296	0.7631	0.8736
No log	19.5294	332	0.8026	0.4270	0.8026	0.8959
No log	19.6471	334	0.8304	0.3567	0.8304	0.9112
No log	19.7647	336	0.8076	0.4270	0.8076	0.8987
No log	19.8824	338	0.7807	0.2413	0.7807	0.8836
No log	20.0	340	0.7764	0.2078	0.7764	0.8811
No log	20.1176	342	0.7706	0.1051	0.7706	0.8779
No log	20.2353	344	0.7641	0.3123	0.7641	0.8741
No log	20.3529	346	0.7630	0.3196	0.7630	0.8735
No log	20.4706	348	0.8047	0.3737	0.8047	0.8970
No log	20.5882	350	0.8117	0.3737	0.8117	0.9009
No log	20.7059	352	0.8185	0.3196	0.8185	0.9047
No log	20.8235	354	0.8002	0.2913	0.8002	0.8946
No log	20.9412	356	0.7847	0.3471	0.7847	0.8858
No log	21.0588	358	0.7736	0.3737	0.7736	0.8795
No log	21.1765	360	0.7313	0.3996	0.7313	0.8552
No log	21.2941	362	0.7085	0.4414	0.7085	0.8417
No log	21.4118	364	0.6956	0.4592	0.6956	0.8340
No log	21.5294	366	0.6846	0.4592	0.6846	0.8274
No log	21.6471	368	0.6888	0.4592	0.6888	0.8299
No log	21.7647	370	0.6960	0.4592	0.6960	0.8342
No log	21.8824	372	0.6785	0.4614	0.6785	0.8237
No log	22.0	374	0.6779	0.3728	0.6779	0.8234
No log	22.1176	376	0.6959	0.4614	0.6959	0.8342
No log	22.2353	378	0.7528	0.4112	0.7528	0.8676
No log	22.3529	380	0.8408	0.3844	0.8408	0.9170
No log	22.4706	382	0.8988	0.3659	0.8988	0.9480
No log	22.5882	384	0.8679	0.3844	0.8679	0.9316
No log	22.7059	386	0.7938	0.3996	0.7938	0.8910
No log	22.8235	388	0.7241	0.4330	0.7241	0.8509
No log	22.9412	390	0.7065	0.2819	0.7065	0.8405
No log	23.0588	392	0.7027	0.2819	0.7027	0.8383
No log	23.1765	394	0.7178	0.3494	0.7178	0.8472
No log	23.2941	396	0.7411	0.4592	0.7411	0.8609
No log	23.4118	398	0.7584	0.4158	0.7584	0.8709
No log	23.5294	400	0.7543	0.3737	0.7543	0.8685
No log	23.6471	402	0.7719	0.3996	0.7719	0.8786
No log	23.7647	404	0.7807	0.3996	0.7807	0.8836
No log	23.8824	406	0.7697	0.4270	0.7697	0.8773
No log	24.0	408	0.7574	0.4684	0.7574	0.8703
No log	24.1176	410	0.7561	0.4597	0.7561	0.8696
No log	24.2353	412	0.7588	0.4330	0.7588	0.8711
No log	24.3529	414	0.7753	0.3843	0.7753	0.8805
No log	24.4706	416	0.7643	0.4247	0.7643	0.8742
No log	24.5882	418	0.7168	0.4060	0.7168	0.8466
No log	24.7059	420	0.6841	0.3728	0.6841	0.8271
No log	24.8235	422	0.6793	0.3728	0.6793	0.8242
No log	24.9412	424	0.6840	0.3728	0.6840	0.8271
No log	25.0588	426	0.7032	0.4267	0.7032	0.8386
No log	25.1765	428	0.7224	0.4753	0.7224	0.8499
No log	25.2941	430	0.7685	0.4272	0.7685	0.8766
No log	25.4118	432	0.7673	0.4089	0.7673	0.8760
No log	25.5294	434	0.7680	0.4089	0.7680	0.8763
No log	25.6471	436	0.7164	0.4330	0.7164	0.8464
No log	25.7647	438	0.7018	0.4753	0.7018	0.8377
No log	25.8824	440	0.7261	0.4330	0.7261	0.8521
No log	26.0	442	0.7670	0.4014	0.7670	0.8758
No log	26.1176	444	0.7560	0.3843	0.7560	0.8695
No log	26.2353	446	0.7298	0.4076	0.7298	0.8543
No log	26.3529	448	0.7185	0.3976	0.7185	0.8477
No log	26.4706	450	0.7200	0.3701	0.7200	0.8485
No log	26.5882	452	0.7220	0.3976	0.7220	0.8497
No log	26.7059	454	0.7396	0.4158	0.7396	0.8600
No log	26.8235	456	0.7372	0.4502	0.7372	0.8586
No log	26.9412	458	0.7067	0.4330	0.7067	0.8407
No log	27.0588	460	0.6954	0.3701	0.6954	0.8339
No log	27.1765	462	0.7056	0.4330	0.7056	0.8400
No log	27.2941	464	0.7283	0.4502	0.7283	0.8534
No log	27.4118	466	0.7336	0.4753	0.7336	0.8565
No log	27.5294	468	0.7169	0.4592	0.7169	0.8467
No log	27.6471	470	0.7105	0.4502	0.7105	0.8429
No log	27.7647	472	0.7018	0.4502	0.7018	0.8377
No log	27.8824	474	0.6927	0.4502	0.6927	0.8323
No log	28.0	476	0.6883	0.4502	0.6883	0.8296
No log	28.1176	478	0.6726	0.3976	0.6726	0.8201
No log	28.2353	480	0.6599	0.4060	0.6599	0.8123
No log	28.3529	482	0.6531	0.3976	0.6531	0.8082
No log	28.4706	484	0.6648	0.4524	0.6648	0.8154
No log	28.5882	486	0.6635	0.4795	0.6635	0.8145
No log	28.7059	488	0.6750	0.4888	0.6750	0.8216
No log	28.8235	490	0.7021	0.4875	0.7021	0.8379
No log	28.9412	492	0.7389	0.4782	0.7389	0.8596
No log	29.0588	494	0.7653	0.3985	0.7653	0.8748
No log	29.1765	496	0.7867	0.3723	0.7867	0.8870
No log	29.2941	498	0.7760	0.3996	0.7760	0.8809
0.3112	29.4118	500	0.7745	0.3996	0.7745	0.8801
0.3112	29.5294	502	0.7469	0.4158	0.7469	0.8643
0.3112	29.6471	504	0.6944	0.4086	0.6944	0.8333
0.3112	29.7647	506	0.6638	0.3754	0.6638	0.8147
0.3112	29.8824	508	0.6626	0.3754	0.6626	0.8140
0.3112	30.0	510	0.6772	0.3352	0.6772	0.8229
0.3112	30.1176	512	0.7105	0.4397	0.7105	0.8429
0.3112	30.2353	514	0.7689	0.3842	0.7689	0.8769
0.3112	30.3529	516	0.8444	0.3781	0.8444	0.9189
0.3112	30.4706	518	0.8689	0.3333	0.8689	0.9321
0.3112	30.5882	520	0.8336	0.3776	0.8336	0.9130
0.3112	30.7059	522	0.7908	0.3569	0.7908	0.8893

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1