ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k5_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8682
• Qwk: 0.4429
• Mse: 0.8682
• Rmse: 0.9318

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	4.3561	-0.0313	4.3561	2.0871
No log	0.1429	4	2.2835	0.0422	2.2835	1.5111
No log	0.2143	6	1.2072	0.0258	1.2072	1.0987
No log	0.2857	8	0.9900	-0.0754	0.9900	0.9950
No log	0.3571	10	0.8561	0.1196	0.8561	0.9252
No log	0.4286	12	0.8675	0.1844	0.8675	0.9314
No log	0.5	14	0.9227	-0.0165	0.9227	0.9606
No log	0.5714	16	0.9060	0.0609	0.9060	0.9519
No log	0.6429	18	0.8795	0.1511	0.8795	0.9378
No log	0.7143	20	0.9012	0.0979	0.9012	0.9493
No log	0.7857	22	0.9323	0.0156	0.9323	0.9655
No log	0.8571	24	0.9130	0.0674	0.9130	0.9555
No log	0.9286	26	1.0451	-0.0585	1.0451	1.0223
No log	1.0	28	1.1950	0.0067	1.1950	1.0932
No log	1.0714	30	1.0873	0.0255	1.0873	1.0427
No log	1.1429	32	0.9096	0.0689	0.9096	0.9537
No log	1.2143	34	0.8289	0.1337	0.8289	0.9105
No log	1.2857	36	0.9709	0.0595	0.9709	0.9853
No log	1.3571	38	1.3169	0.0522	1.3169	1.1475
No log	1.4286	40	1.4461	0.1394	1.4461	1.2025
No log	1.5	42	1.5820	0.0274	1.5820	1.2578
No log	1.5714	44	1.1416	0.0456	1.1416	1.0684
No log	1.6429	46	0.8418	0.1045	0.8418	0.9175
No log	1.7143	48	0.7849	0.2197	0.7849	0.8859
No log	1.7857	50	0.7578	0.2524	0.7578	0.8705
No log	1.8571	52	0.7795	0.2505	0.7795	0.8829
No log	1.9286	54	0.7588	0.3000	0.7588	0.8711
No log	2.0	56	0.7730	0.2245	0.7730	0.8792
No log	2.0714	58	0.7991	0.1643	0.7991	0.8939
No log	2.1429	60	0.7925	0.1405	0.7925	0.8902
No log	2.2143	62	0.7623	0.1833	0.7623	0.8731
No log	2.2857	64	0.7730	0.2451	0.7730	0.8792
No log	2.3571	66	0.7894	0.1570	0.7894	0.8885
No log	2.4286	68	0.7962	0.2014	0.7962	0.8923
No log	2.5	70	0.8175	0.2049	0.8175	0.9042
No log	2.5714	72	0.8677	0.1886	0.8677	0.9315
No log	2.6429	74	0.8572	0.1782	0.8572	0.9259
No log	2.7143	76	0.7931	0.2932	0.7931	0.8906
No log	2.7857	78	0.7671	0.3047	0.7671	0.8759
No log	2.8571	80	0.7509	0.2390	0.7509	0.8666
No log	2.9286	82	0.7251	0.2892	0.7251	0.8515
No log	3.0	84	0.7134	0.2669	0.7134	0.8446
No log	3.0714	86	0.7964	0.2098	0.7964	0.8924
No log	3.1429	88	0.8927	0.2834	0.8927	0.9448
No log	3.2143	90	0.8192	0.3006	0.8192	0.9051
No log	3.2857	92	0.7411	0.3270	0.7411	0.8609
No log	3.3571	94	0.7265	0.3633	0.7265	0.8523
No log	3.4286	96	0.7038	0.3861	0.7038	0.8389
No log	3.5	98	0.6985	0.3378	0.6985	0.8358
No log	3.5714	100	0.7020	0.3834	0.7020	0.8379
No log	3.6429	102	0.7398	0.4198	0.7398	0.8601
No log	3.7143	104	0.8627	0.4182	0.8627	0.9288
No log	3.7857	106	0.9523	0.3551	0.9523	0.9759
No log	3.8571	108	0.8830	0.3296	0.8830	0.9397
No log	3.9286	110	0.7732	0.3973	0.7732	0.8793
No log	4.0	112	0.8207	0.3102	0.8207	0.9059
No log	4.0714	114	1.0289	0.2949	1.0289	1.0143
No log	4.1429	116	1.1022	0.2776	1.1022	1.0499
No log	4.2143	118	0.9618	0.3410	0.9618	0.9807
No log	4.2857	120	0.6942	0.3529	0.6942	0.8332
No log	4.3571	122	0.6145	0.4446	0.6145	0.7839
No log	4.4286	124	0.6774	0.4476	0.6774	0.8230
No log	4.5	126	0.7093	0.4457	0.7093	0.8422
No log	4.5714	128	0.6591	0.3694	0.6591	0.8118
No log	4.6429	130	0.6505	0.3833	0.6505	0.8065
No log	4.7143	132	0.6358	0.4370	0.6358	0.7974
No log	4.7857	134	0.6519	0.4656	0.6519	0.8074
No log	4.8571	136	0.6921	0.4638	0.6921	0.8319
No log	4.9286	138	0.6835	0.4425	0.6835	0.8268
No log	5.0	140	0.6814	0.4544	0.6814	0.8255
No log	5.0714	142	0.6816	0.4586	0.6816	0.8256
No log	5.1429	144	0.6678	0.4936	0.6678	0.8172
No log	5.2143	146	0.6770	0.4930	0.6770	0.8228
No log	5.2857	148	0.7249	0.4207	0.7249	0.8514
No log	5.3571	150	0.6947	0.4674	0.6947	0.8335
No log	5.4286	152	0.6895	0.4591	0.6895	0.8304
No log	5.5	154	0.6967	0.4903	0.6967	0.8347
No log	5.5714	156	0.7253	0.4639	0.7253	0.8516
No log	5.6429	158	0.7792	0.4537	0.7792	0.8827
No log	5.7143	160	0.9270	0.3787	0.9270	0.9628
No log	5.7857	162	1.0672	0.2562	1.0672	1.0330
No log	5.8571	164	0.9596	0.2627	0.9596	0.9796
No log	5.9286	166	0.7237	0.4346	0.7237	0.8507
No log	6.0	168	0.7292	0.4402	0.7292	0.8539
No log	6.0714	170	0.7459	0.4924	0.7459	0.8637
No log	6.1429	172	0.6947	0.4800	0.6947	0.8335
No log	6.2143	174	0.6714	0.4094	0.6714	0.8194
No log	6.2857	176	0.6601	0.3823	0.6601	0.8124
No log	6.3571	178	0.6925	0.3875	0.6925	0.8321
No log	6.4286	180	0.7018	0.3776	0.7018	0.8377
No log	6.5	182	0.7039	0.3841	0.7039	0.8390
No log	6.5714	184	0.7000	0.4168	0.7000	0.8367
No log	6.6429	186	0.7091	0.5150	0.7091	0.8421
No log	6.7143	188	0.7839	0.4398	0.7839	0.8854
No log	6.7857	190	0.8339	0.4392	0.8339	0.9132
No log	6.8571	192	0.7722	0.4226	0.7722	0.8788
No log	6.9286	194	0.7436	0.4528	0.7436	0.8623
No log	7.0	196	0.7811	0.4680	0.7811	0.8838
No log	7.0714	198	0.7603	0.4535	0.7603	0.8720
No log	7.1429	200	0.7138	0.4749	0.7138	0.8449
No log	7.2143	202	0.6740	0.4289	0.6740	0.8210
No log	7.2857	204	0.7171	0.4149	0.7171	0.8468
No log	7.3571	206	0.7330	0.4178	0.7330	0.8562
No log	7.4286	208	0.7111	0.4168	0.7111	0.8433
No log	7.5	210	0.7167	0.4205	0.7167	0.8466
No log	7.5714	212	0.7510	0.4238	0.7510	0.8666
No log	7.6429	214	0.7296	0.4377	0.7296	0.8542
No log	7.7143	216	0.6956	0.4649	0.6956	0.8340
No log	7.7857	218	0.7144	0.4175	0.7144	0.8452
No log	7.8571	220	0.7740	0.4319	0.7740	0.8797
No log	7.9286	222	0.7286	0.4327	0.7286	0.8536
No log	8.0	224	0.7399	0.4679	0.7399	0.8602
No log	8.0714	226	0.7530	0.4807	0.7530	0.8677
No log	8.1429	228	0.7327	0.4823	0.7327	0.8560
No log	8.2143	230	0.7240	0.4809	0.7240	0.8509
No log	8.2857	232	0.7881	0.4134	0.7881	0.8878
No log	8.3571	234	0.8534	0.4095	0.8534	0.9238
No log	8.4286	236	0.8166	0.3861	0.8166	0.9036
No log	8.5	238	0.7528	0.4300	0.7528	0.8676
No log	8.5714	240	0.7846	0.4834	0.7846	0.8858
No log	8.6429	242	0.8137	0.4975	0.8137	0.9020
No log	8.7143	244	0.8495	0.4461	0.8495	0.9217
No log	8.7857	246	0.7928	0.4539	0.7928	0.8904
No log	8.8571	248	0.7621	0.4928	0.7621	0.8730
No log	8.9286	250	0.7626	0.4718	0.7626	0.8733
No log	9.0	252	0.7473	0.4699	0.7473	0.8645
No log	9.0714	254	0.7148	0.4636	0.7148	0.8455
No log	9.1429	256	0.7029	0.4284	0.7029	0.8384
No log	9.2143	258	0.6760	0.4344	0.6760	0.8222
No log	9.2857	260	0.7024	0.4814	0.7024	0.8381
No log	9.3571	262	0.7918	0.4136	0.7918	0.8899
No log	9.4286	264	0.7422	0.4567	0.7422	0.8615
No log	9.5	266	0.6522	0.4556	0.6522	0.8076
No log	9.5714	268	0.6164	0.5422	0.6164	0.7851
No log	9.6429	270	0.6199	0.5363	0.6199	0.7873
No log	9.7143	272	0.6459	0.4910	0.6459	0.8037
No log	9.7857	274	0.6753	0.4807	0.6753	0.8217
No log	9.8571	276	0.6880	0.4980	0.6880	0.8295
No log	9.9286	278	0.7219	0.5145	0.7219	0.8496
No log	10.0	280	0.7203	0.4467	0.7203	0.8487
No log	10.0714	282	0.7073	0.4759	0.7073	0.8410
No log	10.1429	284	0.6659	0.5159	0.6659	0.8160
No log	10.2143	286	0.6468	0.5124	0.6468	0.8042
No log	10.2857	288	0.6262	0.5079	0.6262	0.7913
No log	10.3571	290	0.6386	0.5149	0.6386	0.7991
No log	10.4286	292	0.6477	0.4764	0.6477	0.8048
No log	10.5	294	0.6752	0.4188	0.6752	0.8217
No log	10.5714	296	0.6969	0.4484	0.6969	0.8348
No log	10.6429	298	0.7108	0.5042	0.7108	0.8431
No log	10.7143	300	0.7222	0.4873	0.7222	0.8498
No log	10.7857	302	0.6926	0.4865	0.6926	0.8322
No log	10.8571	304	0.6635	0.4608	0.6635	0.8145
No log	10.9286	306	0.6673	0.4104	0.6673	0.8169
No log	11.0	308	0.6576	0.4096	0.6576	0.8110
No log	11.0714	310	0.6626	0.4834	0.6626	0.8140
No log	11.1429	312	0.6995	0.4471	0.6995	0.8364
No log	11.2143	314	0.7187	0.4413	0.7187	0.8477
No log	11.2857	316	0.7172	0.4795	0.7172	0.8469
No log	11.3571	318	0.7003	0.4795	0.7003	0.8368
No log	11.4286	320	0.6897	0.4688	0.6897	0.8305
No log	11.5	322	0.6910	0.4430	0.6910	0.8312
No log	11.5714	324	0.6717	0.4847	0.6717	0.8196
No log	11.6429	326	0.6897	0.4812	0.6897	0.8305
No log	11.7143	328	0.7318	0.5050	0.7318	0.8555
No log	11.7857	330	0.7310	0.5006	0.7310	0.8550
No log	11.8571	332	0.7245	0.5093	0.7245	0.8512
No log	11.9286	334	0.6923	0.5061	0.6923	0.8320
No log	12.0	336	0.6476	0.4963	0.6476	0.8048
No log	12.0714	338	0.6427	0.4963	0.6427	0.8017
No log	12.1429	340	0.6833	0.5079	0.6833	0.8266
No log	12.2143	342	0.7075	0.4688	0.7075	0.8411
No log	12.2857	344	0.7298	0.4708	0.7298	0.8543
No log	12.3571	346	0.7484	0.4317	0.7484	0.8651
No log	12.4286	348	0.7504	0.4078	0.7504	0.8663
No log	12.5	350	0.7303	0.4051	0.7303	0.8546
No log	12.5714	352	0.6901	0.4156	0.6901	0.8307
No log	12.6429	354	0.6975	0.4690	0.6975	0.8352
No log	12.7143	356	0.7879	0.4215	0.7879	0.8877
No log	12.7857	358	0.8256	0.4414	0.8256	0.9087
No log	12.8571	360	0.7472	0.5178	0.7472	0.8644
No log	12.9286	362	0.6781	0.4591	0.6781	0.8235
No log	13.0	364	0.6633	0.4451	0.6633	0.8144
No log	13.0714	366	0.6688	0.4365	0.6688	0.8178
No log	13.1429	368	0.6404	0.4712	0.6404	0.8002
No log	13.2143	370	0.6725	0.4881	0.6725	0.8201
No log	13.2857	372	0.7242	0.4937	0.7242	0.8510
No log	13.3571	374	0.7884	0.4829	0.7884	0.8879
No log	13.4286	376	0.7678	0.4785	0.7678	0.8762
No log	13.5	378	0.6970	0.4893	0.6970	0.8349
No log	13.5714	380	0.6535	0.4753	0.6535	0.8084
No log	13.6429	382	0.6420	0.4491	0.6420	0.8012
No log	13.7143	384	0.6842	0.5210	0.6842	0.8272
No log	13.7857	386	0.8188	0.4008	0.8188	0.9049
No log	13.8571	388	0.8598	0.4263	0.8598	0.9273
No log	13.9286	390	0.8046	0.4136	0.8046	0.8970
No log	14.0	392	0.7321	0.4313	0.7321	0.8556
No log	14.0714	394	0.6676	0.5019	0.6676	0.8171
No log	14.1429	396	0.6419	0.5025	0.6419	0.8012
No log	14.2143	398	0.6748	0.4258	0.6748	0.8214
No log	14.2857	400	0.7050	0.4284	0.7050	0.8397
No log	14.3571	402	0.6692	0.4899	0.6692	0.8181
No log	14.4286	404	0.6816	0.5006	0.6816	0.8256
No log	14.5	406	0.7161	0.4698	0.7161	0.8462
No log	14.5714	408	0.7601	0.4032	0.7601	0.8718
No log	14.6429	410	0.7636	0.4146	0.7636	0.8739
No log	14.7143	412	0.7277	0.3867	0.7277	0.8531
No log	14.7857	414	0.7187	0.4147	0.7187	0.8478
No log	14.8571	416	0.6720	0.5341	0.6720	0.8198
No log	14.9286	418	0.6435	0.4955	0.6435	0.8022
No log	15.0	420	0.7004	0.4454	0.7004	0.8369
No log	15.0714	422	0.7196	0.4559	0.7196	0.8483
No log	15.1429	424	0.6855	0.5186	0.6855	0.8280
No log	15.2143	426	0.7107	0.5126	0.7107	0.8430
No log	15.2857	428	0.8059	0.5218	0.8059	0.8977
No log	15.3571	430	0.8064	0.5380	0.8064	0.8980
No log	15.4286	432	0.7141	0.5059	0.7141	0.8450
No log	15.5	434	0.6339	0.4910	0.6339	0.7962
No log	15.5714	436	0.6204	0.4948	0.6204	0.7877
No log	15.6429	438	0.6253	0.4948	0.6253	0.7907
No log	15.7143	440	0.6471	0.5032	0.6471	0.8044
No log	15.7857	442	0.6622	0.5112	0.6622	0.8138
No log	15.8571	444	0.6630	0.5289	0.6630	0.8143
No log	15.9286	446	0.6565	0.5189	0.6565	0.8102
No log	16.0	448	0.6521	0.5294	0.6521	0.8075
No log	16.0714	450	0.6595	0.5115	0.6595	0.8121
No log	16.1429	452	0.6763	0.4945	0.6763	0.8224
No log	16.2143	454	0.6801	0.4945	0.6801	0.8247
No log	16.2857	456	0.6866	0.5382	0.6866	0.8286
No log	16.3571	458	0.6643	0.4942	0.6643	0.8150
No log	16.4286	460	0.6422	0.4940	0.6422	0.8014
No log	16.5	462	0.6357	0.4483	0.6357	0.7973
No log	16.5714	464	0.6290	0.4467	0.6290	0.7931
No log	16.6429	466	0.6235	0.4467	0.6235	0.7896
No log	16.7143	468	0.6200	0.4467	0.6200	0.7874
No log	16.7857	470	0.6313	0.5203	0.6313	0.7946
No log	16.8571	472	0.6522	0.5165	0.6522	0.8076
No log	16.9286	474	0.6533	0.4469	0.6533	0.8083
No log	17.0	476	0.6601	0.4998	0.6601	0.8124
No log	17.0714	478	0.6694	0.5102	0.6694	0.8182
No log	17.1429	480	0.6539	0.4771	0.6539	0.8086
No log	17.2143	482	0.6533	0.5130	0.6533	0.8083
No log	17.2857	484	0.7002	0.4388	0.7002	0.8368
No log	17.3571	486	0.7411	0.4349	0.7411	0.8609
No log	17.4286	488	0.7236	0.4244	0.7236	0.8506
No log	17.5	490	0.6853	0.5160	0.6853	0.8278
No log	17.5714	492	0.6892	0.4814	0.6892	0.8302
No log	17.6429	494	0.7161	0.4491	0.7161	0.8463
No log	17.7143	496	0.7144	0.4588	0.7144	0.8452
No log	17.7857	498	0.6936	0.4905	0.6936	0.8328
0.3742	17.8571	500	0.6909	0.5109	0.6909	0.8312
0.3742	17.9286	502	0.7423	0.4840	0.7423	0.8616
0.3742	18.0	504	0.7985	0.4554	0.7985	0.8936
0.3742	18.0714	506	0.8610	0.4176	0.8610	0.9279
0.3742	18.1429	508	0.8884	0.4298	0.8884	0.9426
0.3742	18.2143	510	0.8682	0.4429	0.8682	0.9318

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1