ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7373
• Qwk: 0.4573
• Mse: 0.7373
• Rmse: 0.8587

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.2527	-0.0240	4.2527	2.0622
No log	0.2222	4	2.3113	0.0558	2.3113	1.5203
No log	0.3333	6	1.4892	0.0912	1.4892	1.2203
No log	0.4444	8	1.0816	0.0088	1.0816	1.0400
No log	0.5556	10	0.7889	0.2763	0.7889	0.8882
No log	0.6667	12	0.8011	0.2469	0.8011	0.8951
No log	0.7778	14	0.9161	0.1029	0.9161	0.9572
No log	0.8889	16	1.2859	0.0396	1.2859	1.1340
No log	1.0	18	1.9144	0.1059	1.9144	1.3836
No log	1.1111	20	1.8316	0.0897	1.8316	1.3534
No log	1.2222	22	1.5614	0.0890	1.5614	1.2496
No log	1.3333	24	1.1088	0.0522	1.1088	1.0530
No log	1.4444	26	0.7605	0.2763	0.7605	0.8721
No log	1.5556	28	0.7773	0.1754	0.7773	0.8816
No log	1.6667	30	0.7855	0.2115	0.7855	0.8863
No log	1.7778	32	0.7260	0.2965	0.7260	0.8521
No log	1.8889	34	0.8167	0.1564	0.8167	0.9037
No log	2.0	36	1.1375	0.0992	1.1375	1.0665
No log	2.1111	38	1.3262	0.0262	1.3262	1.1516
No log	2.2222	40	1.2642	0.0262	1.2642	1.1244
No log	2.3333	42	1.1884	0.0514	1.1884	1.0901
No log	2.4444	44	1.1394	0.0769	1.1394	1.0674
No log	2.5556	46	1.0055	0.1929	1.0055	1.0028
No log	2.6667	48	0.8720	0.2582	0.8720	0.9338
No log	2.7778	50	0.8674	0.2446	0.8674	0.9313
No log	2.8889	52	0.7936	0.2263	0.7936	0.8908
No log	3.0	54	0.7661	0.1900	0.7661	0.8753
No log	3.1111	56	0.8493	0.2284	0.8493	0.9216
No log	3.2222	58	0.9143	0.2704	0.9143	0.9562
No log	3.3333	60	0.8889	0.2748	0.8889	0.9428
No log	3.4444	62	0.7823	0.2436	0.7823	0.8845
No log	3.5556	64	0.6995	0.2227	0.6995	0.8364
No log	3.6667	66	0.6953	0.3261	0.6953	0.8338
No log	3.7778	68	0.7110	0.3456	0.7110	0.8432
No log	3.8889	70	0.7115	0.4047	0.7115	0.8435
No log	4.0	72	0.7024	0.4453	0.7024	0.8381
No log	4.1111	74	0.7064	0.4359	0.7064	0.8405
No log	4.2222	76	0.7047	0.4578	0.7047	0.8395
No log	4.3333	78	0.6962	0.4407	0.6962	0.8344
No log	4.4444	80	0.7355	0.4032	0.7355	0.8576
No log	4.5556	82	0.8077	0.3747	0.8077	0.8987
No log	4.6667	84	0.7731	0.4352	0.7731	0.8792
No log	4.7778	86	0.7402	0.4769	0.7402	0.8604
No log	4.8889	88	0.7065	0.4773	0.7065	0.8405
No log	5.0	90	0.7231	0.5091	0.7231	0.8503
No log	5.1111	92	0.7035	0.4855	0.7035	0.8388
No log	5.2222	94	0.7206	0.4917	0.7206	0.8489
No log	5.3333	96	0.7306	0.4320	0.7306	0.8548
No log	5.4444	98	0.7176	0.4802	0.7176	0.8471
No log	5.5556	100	0.7120	0.4958	0.7120	0.8438
No log	5.6667	102	0.7240	0.4798	0.7240	0.8509
No log	5.7778	104	0.8072	0.4897	0.8072	0.8985
No log	5.8889	106	0.7651	0.5044	0.7651	0.8747
No log	6.0	108	0.7238	0.5353	0.7238	0.8508
No log	6.1111	110	0.7369	0.5240	0.7369	0.8584
No log	6.2222	112	0.8074	0.4681	0.8074	0.8986
No log	6.3333	114	0.7951	0.5248	0.7951	0.8917
No log	6.4444	116	0.8432	0.5423	0.8432	0.9183
No log	6.5556	118	0.9089	0.4879	0.9089	0.9534
No log	6.6667	120	0.9104	0.4852	0.9104	0.9541
No log	6.7778	122	0.9159	0.4766	0.9159	0.9570
No log	6.8889	124	0.8324	0.4677	0.8324	0.9123
No log	7.0	126	0.7921	0.4689	0.7921	0.8900
No log	7.1111	128	0.7711	0.4728	0.7711	0.8781
No log	7.2222	130	0.7814	0.4998	0.7814	0.8840
No log	7.3333	132	0.8006	0.4800	0.8006	0.8948
No log	7.4444	134	0.7608	0.5562	0.7608	0.8722
No log	7.5556	136	0.7375	0.4808	0.7375	0.8588
No log	7.6667	138	0.7186	0.5501	0.7186	0.8477
No log	7.7778	140	0.7281	0.5414	0.7281	0.8533
No log	7.8889	142	0.7148	0.4878	0.7148	0.8455
No log	8.0	144	0.8449	0.4768	0.8449	0.9192
No log	8.1111	146	0.9698	0.4706	0.9698	0.9848
No log	8.2222	148	0.8809	0.4711	0.8809	0.9386
No log	8.3333	150	0.7329	0.5288	0.7329	0.8561
No log	8.4444	152	0.7774	0.4649	0.7774	0.8817
No log	8.5556	154	0.7874	0.4358	0.7874	0.8874
No log	8.6667	156	0.7091	0.4904	0.7091	0.8421
No log	8.7778	158	0.6714	0.4855	0.6714	0.8194
No log	8.8889	160	0.6808	0.4899	0.6808	0.8251
No log	9.0	162	0.7064	0.5847	0.7064	0.8405
No log	9.1111	164	0.7601	0.5217	0.7601	0.8718
No log	9.2222	166	0.8144	0.5027	0.8144	0.9024
No log	9.3333	168	0.8143	0.4962	0.8143	0.9024
No log	9.4444	170	0.7948	0.4962	0.7948	0.8915
No log	9.5556	172	0.7403	0.5516	0.7403	0.8604
No log	9.6667	174	0.7011	0.5341	0.7011	0.8373
No log	9.7778	176	0.6644	0.4945	0.6644	0.8151
No log	9.8889	178	0.6493	0.4222	0.6493	0.8058
No log	10.0	180	0.6972	0.4596	0.6972	0.8350
No log	10.1111	182	0.7525	0.4488	0.7525	0.8675
No log	10.2222	184	0.7193	0.4748	0.7193	0.8481
No log	10.3333	186	0.6848	0.5362	0.6848	0.8275
No log	10.4444	188	0.7027	0.5445	0.7027	0.8383
No log	10.5556	190	0.7117	0.5764	0.7117	0.8436
No log	10.6667	192	0.7280	0.5949	0.7280	0.8532
No log	10.7778	194	0.7370	0.5881	0.7370	0.8585
No log	10.8889	196	0.7145	0.5425	0.7145	0.8453
No log	11.0	198	0.7173	0.5498	0.7173	0.8470
No log	11.1111	200	0.7293	0.5430	0.7293	0.8540
No log	11.2222	202	0.7860	0.5015	0.7859	0.8865
No log	11.3333	204	0.7574	0.5179	0.7574	0.8703
No log	11.4444	206	0.7486	0.5652	0.7486	0.8652
No log	11.5556	208	0.7899	0.5575	0.7899	0.8888
No log	11.6667	210	0.7814	0.5175	0.7814	0.8840
No log	11.7778	212	0.7618	0.4962	0.7618	0.8728
No log	11.8889	214	0.7777	0.4784	0.7777	0.8819
No log	12.0	216	0.7566	0.4674	0.7566	0.8698
No log	12.1111	218	0.6806	0.5065	0.6806	0.8250
No log	12.2222	220	0.6213	0.4343	0.6213	0.7882
No log	12.3333	222	0.6169	0.3959	0.6169	0.7854
No log	12.4444	224	0.6285	0.4582	0.6285	0.7928
No log	12.5556	226	0.6565	0.4137	0.6565	0.8102
No log	12.6667	228	0.6836	0.4419	0.6836	0.8268
No log	12.7778	230	0.7072	0.4255	0.7072	0.8410
No log	12.8889	232	0.6977	0.4137	0.6977	0.8353
No log	13.0	234	0.6943	0.4857	0.6943	0.8333
No log	13.1111	236	0.7019	0.4961	0.7019	0.8378
No log	13.2222	238	0.6988	0.5058	0.6988	0.8359
No log	13.3333	240	0.6658	0.4986	0.6658	0.8160
No log	13.4444	242	0.6906	0.4329	0.6906	0.8310
No log	13.5556	244	0.6747	0.4776	0.6747	0.8214
No log	13.6667	246	0.7009	0.4938	0.7009	0.8372
No log	13.7778	248	0.7781	0.5116	0.7781	0.8821
No log	13.8889	250	0.8481	0.4937	0.8481	0.9209
No log	14.0	252	0.8553	0.4920	0.8553	0.9248
No log	14.1111	254	0.8575	0.4641	0.8575	0.9260
No log	14.2222	256	0.8189	0.4657	0.8189	0.9049
No log	14.3333	258	0.7851	0.4991	0.7851	0.8860
No log	14.4444	260	0.7347	0.5025	0.7347	0.8572
No log	14.5556	262	0.7299	0.4789	0.7299	0.8543
No log	14.6667	264	0.7342	0.5239	0.7342	0.8569
No log	14.7778	266	0.7150	0.5386	0.7150	0.8456
No log	14.8889	268	0.7145	0.5373	0.7145	0.8453
No log	15.0	270	0.6792	0.5214	0.6792	0.8241
No log	15.1111	272	0.6568	0.4826	0.6568	0.8104
No log	15.2222	274	0.6644	0.4633	0.6644	0.8151
No log	15.3333	276	0.7192	0.4595	0.7192	0.8481
No log	15.4444	278	0.6973	0.4710	0.6973	0.8350
No log	15.5556	280	0.6698	0.5035	0.6698	0.8184
No log	15.6667	282	0.6763	0.4985	0.6763	0.8224
No log	15.7778	284	0.6829	0.4985	0.6829	0.8264
No log	15.8889	286	0.6752	0.5141	0.6752	0.8217
No log	16.0	288	0.7241	0.4953	0.7241	0.8510
No log	16.1111	290	0.7590	0.4561	0.7590	0.8712
No log	16.2222	292	0.7205	0.4965	0.7205	0.8488
No log	16.3333	294	0.7026	0.4930	0.7026	0.8382
No log	16.4444	296	0.6705	0.5345	0.6705	0.8188
No log	16.5556	298	0.7011	0.5724	0.7011	0.8373
No log	16.6667	300	0.7890	0.5286	0.7890	0.8883
No log	16.7778	302	0.8258	0.5160	0.8258	0.9088
No log	16.8889	304	0.8131	0.5283	0.8131	0.9017
No log	17.0	306	0.7987	0.5865	0.7987	0.8937
No log	17.1111	308	0.8335	0.5467	0.8335	0.9130
No log	17.2222	310	0.8367	0.4845	0.8367	0.9147
No log	17.3333	312	0.7999	0.5303	0.7999	0.8944
No log	17.4444	314	0.7880	0.5303	0.7880	0.8877
No log	17.5556	316	0.8112	0.5517	0.8112	0.9006
No log	17.6667	318	0.8560	0.5506	0.8560	0.9252
No log	17.7778	320	0.8605	0.5142	0.8605	0.9276
No log	17.8889	322	0.8044	0.5034	0.8044	0.8969
No log	18.0	324	0.7620	0.5430	0.7620	0.8729
No log	18.1111	326	0.7288	0.5609	0.7288	0.8537
No log	18.2222	328	0.7114	0.5325	0.7114	0.8435
No log	18.3333	330	0.7622	0.5570	0.7622	0.8730
No log	18.4444	332	0.8158	0.5135	0.8158	0.9032
No log	18.5556	334	0.7973	0.5236	0.7973	0.8929
No log	18.6667	336	0.7634	0.5028	0.7634	0.8738
No log	18.7778	338	0.7144	0.5115	0.7144	0.8452
No log	18.8889	340	0.6896	0.5121	0.6896	0.8304
No log	19.0	342	0.6543	0.4972	0.6543	0.8089
No log	19.1111	344	0.6444	0.5535	0.6444	0.8027
No log	19.2222	346	0.6622	0.5296	0.6622	0.8138
No log	19.3333	348	0.6750	0.4954	0.6750	0.8216
No log	19.4444	350	0.6575	0.4681	0.6575	0.8109
No log	19.5556	352	0.6430	0.4825	0.6430	0.8019
No log	19.6667	354	0.6874	0.4976	0.6874	0.8291
No log	19.7778	356	0.7206	0.4762	0.7206	0.8489
No log	19.8889	358	0.7340	0.4842	0.7340	0.8567
No log	20.0	360	0.7356	0.5040	0.7356	0.8577
No log	20.1111	362	0.6858	0.4944	0.6858	0.8282
No log	20.2222	364	0.6520	0.5565	0.6520	0.8075
No log	20.3333	366	0.6613	0.5454	0.6613	0.8132
No log	20.4444	368	0.7056	0.5248	0.7056	0.8400
No log	20.5556	370	0.7293	0.5570	0.7293	0.8540
No log	20.6667	372	0.7226	0.5306	0.7226	0.8500
No log	20.7778	374	0.7122	0.5645	0.7122	0.8439
No log	20.8889	376	0.7355	0.5330	0.7355	0.8576
No log	21.0	378	0.8150	0.5363	0.8150	0.9028
No log	21.1111	380	0.8327	0.5481	0.8327	0.9125
No log	21.2222	382	0.8225	0.5188	0.8225	0.9069
No log	21.3333	384	0.8319	0.5304	0.8319	0.9121
No log	21.4444	386	0.8440	0.5176	0.8440	0.9187
No log	21.5556	388	0.7883	0.5330	0.7883	0.8878
No log	21.6667	390	0.7563	0.5358	0.7563	0.8696
No log	21.7778	392	0.7415	0.5578	0.7415	0.8611
No log	21.8889	394	0.7100	0.5365	0.7100	0.8426
No log	22.0	396	0.6968	0.5451	0.6968	0.8347
No log	22.1111	398	0.7031	0.4926	0.7031	0.8385
No log	22.2222	400	0.7433	0.4753	0.7433	0.8621
No log	22.3333	402	0.7324	0.5281	0.7324	0.8558
No log	22.4444	404	0.6951	0.5869	0.6951	0.8337
No log	22.5556	406	0.6776	0.5777	0.6776	0.8232
No log	22.6667	408	0.6644	0.5382	0.6644	0.8151
No log	22.7778	410	0.6449	0.5665	0.6449	0.8031
No log	22.8889	412	0.6657	0.5421	0.6657	0.8159
No log	23.0	414	0.6816	0.5384	0.6816	0.8256
No log	23.1111	416	0.6666	0.5554	0.6666	0.8164
No log	23.2222	418	0.6697	0.5663	0.6697	0.8183
No log	23.3333	420	0.6830	0.5682	0.6830	0.8264
No log	23.4444	422	0.6883	0.5375	0.6883	0.8296
No log	23.5556	424	0.6910	0.5652	0.6910	0.8313
No log	23.6667	426	0.6821	0.5581	0.6821	0.8259
No log	23.7778	428	0.6645	0.5635	0.6645	0.8152
No log	23.8889	430	0.6549	0.5795	0.6549	0.8093
No log	24.0	432	0.6445	0.5666	0.6445	0.8028
No log	24.1111	434	0.6823	0.5431	0.6823	0.8260
No log	24.2222	436	0.7067	0.5326	0.7067	0.8406
No log	24.3333	438	0.6732	0.5386	0.6732	0.8205
No log	24.4444	440	0.6584	0.5618	0.6584	0.8114
No log	24.5556	442	0.7236	0.4958	0.7236	0.8507
No log	24.6667	444	0.7699	0.4621	0.7699	0.8775
No log	24.7778	446	0.7586	0.4611	0.7586	0.8710
No log	24.8889	448	0.7021	0.5176	0.7021	0.8379
No log	25.0	450	0.6810	0.5096	0.6810	0.8252
No log	25.1111	452	0.6582	0.4949	0.6582	0.8113
No log	25.2222	454	0.6445	0.5307	0.6445	0.8028
No log	25.3333	456	0.6655	0.5465	0.6655	0.8158
No log	25.4444	458	0.7051	0.5438	0.7051	0.8397
No log	25.5556	460	0.7086	0.5247	0.7086	0.8418
No log	25.6667	462	0.7086	0.5437	0.7086	0.8418
No log	25.7778	464	0.7099	0.5437	0.7099	0.8426
No log	25.8889	466	0.7384	0.5401	0.7384	0.8593
No log	26.0	468	0.7914	0.5204	0.7914	0.8896
No log	26.1111	470	0.8493	0.5236	0.8493	0.9216
No log	26.2222	472	0.8592	0.5419	0.8592	0.9269
No log	26.3333	474	0.8088	0.5324	0.8088	0.8993
No log	26.4444	476	0.7510	0.5335	0.7510	0.8666
No log	26.5556	478	0.7097	0.5491	0.7097	0.8424
No log	26.6667	480	0.6878	0.5119	0.6878	0.8294
No log	26.7778	482	0.6948	0.5039	0.6948	0.8336
No log	26.8889	484	0.7029	0.5051	0.7029	0.8384
No log	27.0	486	0.6910	0.5181	0.6910	0.8312
No log	27.1111	488	0.7164	0.5340	0.7164	0.8464
No log	27.2222	490	0.7555	0.5363	0.7555	0.8692
No log	27.3333	492	0.7774	0.5502	0.7774	0.8817
No log	27.4444	494	0.7811	0.5381	0.7811	0.8838
No log	27.5556	496	0.7786	0.5185	0.7786	0.8824
No log	27.6667	498	0.7796	0.4830	0.7796	0.8830
0.3467	27.7778	500	0.7529	0.4704	0.7529	0.8677
0.3467	27.8889	502	0.7153	0.4992	0.7153	0.8458
0.3467	28.0	504	0.7013	0.5711	0.7013	0.8374
0.3467	28.1111	506	0.7578	0.5300	0.7578	0.8705
0.3467	28.2222	508	0.7817	0.4592	0.7817	0.8841
0.3467	28.3333	510	0.7376	0.5083	0.7376	0.8589
0.3467	28.4444	512	0.6645	0.5490	0.6645	0.8151
0.3467	28.5556	514	0.6163	0.5774	0.6163	0.7850
0.3467	28.6667	516	0.6139	0.5464	0.6139	0.7835
0.3467	28.7778	518	0.6284	0.5861	0.6284	0.7927
0.3467	28.8889	520	0.6362	0.5922	0.6362	0.7976
0.3467	29.0	522	0.6349	0.5901	0.6349	0.7968
0.3467	29.1111	524	0.6307	0.5800	0.6307	0.7942
0.3467	29.2222	526	0.6246	0.5757	0.6246	0.7903
0.3467	29.3333	528	0.6468	0.5198	0.6468	0.8043
0.3467	29.4444	530	0.7389	0.4547	0.7389	0.8596
0.3467	29.5556	532	0.8211	0.4435	0.8211	0.9061
0.3467	29.6667	534	0.8245	0.4435	0.8245	0.9080
0.3467	29.7778	536	0.7741	0.4559	0.7741	0.8798
0.3467	29.8889	538	0.6985	0.4887	0.6985	0.8357
0.3467	30.0	540	0.6688	0.5032	0.6688	0.8178
0.3467	30.1111	542	0.6684	0.4961	0.6684	0.8176
0.3467	30.2222	544	0.7066	0.4815	0.7066	0.8406
0.3467	30.3333	546	0.7801	0.4378	0.7801	0.8832
0.3467	30.4444	548	0.8198	0.4545	0.8198	0.9054
0.3467	30.5556	550	0.7880	0.4347	0.7880	0.8877
0.3467	30.6667	552	0.7489	0.4536	0.7489	0.8654
0.3467	30.7778	554	0.7373	0.4573	0.7373	0.8587

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1