ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5329
• Qwk: 0.3552
• Mse: 0.5329
• Rmse: 0.7300

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0308	2	2.4589	-0.0262	2.4589	1.5681
No log	0.0615	4	1.1359	0.1797	1.1359	1.0658
No log	0.0923	6	0.7977	0.1321	0.7977	0.8931
No log	0.1231	8	0.6967	0.3060	0.6967	0.8347
No log	0.1538	10	0.6734	0.2374	0.6734	0.8206
No log	0.1846	12	0.7335	0.1308	0.7335	0.8564
No log	0.2154	14	0.8273	0.1714	0.8273	0.9096
No log	0.2462	16	0.8329	0.1739	0.8329	0.9126
No log	0.2769	18	0.7346	0.0889	0.7346	0.8571
No log	0.3077	20	0.7371	0.1739	0.7371	0.8586
No log	0.3385	22	0.8032	0.3825	0.8032	0.8962
No log	0.3692	24	0.6980	0.3354	0.6980	0.8355
No log	0.4	26	0.5409	0.2418	0.5409	0.7355
No log	0.4308	28	0.4923	0.5623	0.4923	0.7017
No log	0.4615	30	0.5472	0.5486	0.5472	0.7397
No log	0.4923	32	0.6976	0.4502	0.6976	0.8352
No log	0.5231	34	0.5234	0.6042	0.5234	0.7235
No log	0.5538	36	0.4486	0.5213	0.4486	0.6698
No log	0.5846	38	0.4644	0.5999	0.4644	0.6814
No log	0.6154	40	0.5176	0.5543	0.5176	0.7194
No log	0.6462	42	0.6728	0.5108	0.6728	0.8202
No log	0.6769	44	0.5820	0.4687	0.5820	0.7629
No log	0.7077	46	0.4767	0.5300	0.4767	0.6904
No log	0.7385	48	0.5007	0.4713	0.5007	0.7076
No log	0.7692	50	0.4554	0.6467	0.4554	0.6749
No log	0.8	52	0.4550	0.6518	0.4550	0.6746
No log	0.8308	54	0.4393	0.6426	0.4393	0.6628
No log	0.8615	56	0.5002	0.5748	0.5002	0.7073
No log	0.8923	58	0.6849	0.4113	0.6849	0.8276
No log	0.9231	60	0.5236	0.5748	0.5236	0.7236
No log	0.9538	62	0.4449	0.6243	0.4449	0.6670
No log	0.9846	64	0.4571	0.5781	0.4571	0.6761
No log	1.0154	66	0.5636	0.5178	0.5636	0.7507
No log	1.0462	68	0.8576	0.3477	0.8576	0.9261
No log	1.0769	70	0.7398	0.4528	0.7398	0.8601
No log	1.1077	72	0.5430	0.5429	0.5430	0.7369
No log	1.1385	74	0.5170	0.6672	0.5170	0.7191
No log	1.1692	76	0.5329	0.5852	0.5329	0.7300
No log	1.2	78	0.5427	0.5368	0.5427	0.7367
No log	1.2308	80	0.5640	0.5880	0.5640	0.7510
No log	1.2615	82	0.5685	0.5497	0.5685	0.7540
No log	1.2923	84	0.5494	0.5748	0.5494	0.7412
No log	1.3231	86	0.5647	0.5700	0.5647	0.7515
No log	1.3538	88	0.5465	0.5299	0.5465	0.7393
No log	1.3846	90	0.7370	0.4056	0.7370	0.8585
No log	1.4154	92	0.7295	0.4098	0.7295	0.8541
No log	1.4462	94	0.5582	0.5095	0.5582	0.7471
No log	1.4769	96	0.5551	0.5323	0.5551	0.7451
No log	1.5077	98	0.6508	0.4874	0.6508	0.8067
No log	1.5385	100	0.5281	0.4933	0.5281	0.7267
No log	1.5692	102	0.5082	0.6027	0.5082	0.7129
No log	1.6	104	0.5596	0.5445	0.5596	0.7480
No log	1.6308	106	0.5118	0.6235	0.5118	0.7154
No log	1.6615	108	0.5084	0.6593	0.5084	0.7130
No log	1.6923	110	0.5227	0.6438	0.5227	0.7230
No log	1.7231	112	0.5244	0.6616	0.5244	0.7241
No log	1.7538	114	0.5203	0.6537	0.5203	0.7213
No log	1.7846	116	0.4655	0.6479	0.4655	0.6823
No log	1.8154	118	0.5116	0.5705	0.5116	0.7152
No log	1.8462	120	0.4625	0.5662	0.4625	0.6801
No log	1.8769	122	0.4494	0.6154	0.4494	0.6704
No log	1.9077	124	0.4720	0.6383	0.4720	0.6870
No log	1.9385	126	0.4816	0.6577	0.4816	0.6940
No log	1.9692	128	0.5226	0.5514	0.5226	0.7229
No log	2.0	130	0.6758	0.4727	0.6758	0.8221
No log	2.0308	132	0.8061	0.4929	0.8061	0.8978
No log	2.0615	134	0.5951	0.5321	0.5951	0.7714
No log	2.0923	136	0.5208	0.6068	0.5208	0.7217
No log	2.1231	138	0.5235	0.6295	0.5235	0.7235
No log	2.1538	140	0.5296	0.5373	0.5296	0.7277
No log	2.1846	142	0.5611	0.4883	0.5611	0.7491
No log	2.2154	144	0.5530	0.5753	0.5530	0.7437
No log	2.2462	146	0.5471	0.5213	0.5471	0.7397
No log	2.2769	148	0.5578	0.4829	0.5578	0.7469
No log	2.3077	150	0.5915	0.4808	0.5915	0.7691
No log	2.3385	152	0.5732	0.4634	0.5732	0.7571
No log	2.3692	154	0.5903	0.4938	0.5903	0.7683
No log	2.4	156	0.5687	0.4656	0.5687	0.7541
No log	2.4308	158	0.6091	0.4478	0.6091	0.7804
No log	2.4615	160	0.7199	0.4369	0.7199	0.8484
No log	2.4923	162	0.6975	0.4284	0.6975	0.8351
No log	2.5231	164	0.5706	0.5455	0.5706	0.7554
No log	2.5538	166	0.5543	0.6215	0.5543	0.7445
No log	2.5846	168	0.5539	0.5457	0.5539	0.7443
No log	2.6154	170	0.5717	0.4808	0.5717	0.7561
No log	2.6462	172	0.6910	0.3776	0.6910	0.8313
No log	2.6769	174	0.6740	0.4218	0.6740	0.8210
No log	2.7077	176	0.5611	0.3677	0.5611	0.7490
No log	2.7385	178	0.5603	0.3677	0.5603	0.7485
No log	2.7692	180	0.5663	0.4338	0.5663	0.7526
No log	2.8	182	0.5991	0.4925	0.5991	0.7740
No log	2.8308	184	0.7275	0.3955	0.7275	0.8529
No log	2.8615	186	0.6226	0.4835	0.6226	0.7890
No log	2.8923	188	0.5337	0.4847	0.5337	0.7306
No log	2.9231	190	0.6996	0.4448	0.6996	0.8364
No log	2.9538	192	0.9341	0.2873	0.9341	0.9665
No log	2.9846	194	0.8004	0.3953	0.8004	0.8946
No log	3.0154	196	0.5613	0.4150	0.5613	0.7492
No log	3.0462	198	0.6137	0.4089	0.6137	0.7834
No log	3.0769	200	0.6643	0.4329	0.6643	0.8150
No log	3.1077	202	0.5849	0.4112	0.5849	0.7648
No log	3.1385	204	0.5205	0.4402	0.5205	0.7215
No log	3.1692	206	0.5494	0.5373	0.5494	0.7412
No log	3.2	208	0.5647	0.5300	0.5647	0.7515
No log	3.2308	210	0.5652	0.5230	0.5652	0.7518
No log	3.2615	212	0.5526	0.4958	0.5526	0.7434
No log	3.2923	214	0.5375	0.5227	0.5375	0.7331
No log	3.3231	216	0.5573	0.4875	0.5573	0.7465
No log	3.3538	218	0.6147	0.3609	0.6147	0.7840
No log	3.3846	220	0.6572	0.3609	0.6572	0.8107
No log	3.4154	222	0.5758	0.4437	0.5758	0.7588
No log	3.4462	224	0.5820	0.4139	0.5820	0.7629
No log	3.4769	226	0.6709	0.4967	0.6709	0.8191
No log	3.5077	228	0.7157	0.4783	0.7157	0.8460
No log	3.5385	230	0.6407	0.5384	0.6407	0.8004
No log	3.5692	232	0.5857	0.4562	0.5857	0.7653
No log	3.6	234	0.6690	0.4556	0.6690	0.8179
No log	3.6308	236	0.7382	0.36	0.7382	0.8592
No log	3.6615	238	0.6252	0.4513	0.6252	0.7907
No log	3.6923	240	0.5749	0.5209	0.5749	0.7582
No log	3.7231	242	0.5394	0.4788	0.5394	0.7344
No log	3.7538	244	0.5338	0.4632	0.5338	0.7306
No log	3.7846	246	0.5225	0.5339	0.5225	0.7228
No log	3.8154	248	0.5167	0.5339	0.5167	0.7188
No log	3.8462	250	0.5153	0.5718	0.5153	0.7179
No log	3.8769	252	0.5003	0.6082	0.5003	0.7073
No log	3.9077	254	0.4869	0.6477	0.4869	0.6978
No log	3.9385	256	0.4864	0.6282	0.4864	0.6974
No log	3.9692	258	0.4775	0.6357	0.4775	0.6910
No log	4.0	260	0.4799	0.5633	0.4799	0.6928
No log	4.0308	262	0.4947	0.5495	0.4947	0.7034
No log	4.0615	264	0.4975	0.5495	0.4975	0.7053
No log	4.0923	266	0.5011	0.5479	0.5011	0.7079
No log	4.1231	268	0.5664	0.5672	0.5664	0.7526
No log	4.1538	270	0.5694	0.5672	0.5694	0.7546
No log	4.1846	272	0.5033	0.4849	0.5033	0.7094
No log	4.2154	274	0.5403	0.5111	0.5403	0.7350
No log	4.2462	276	0.5706	0.4294	0.5706	0.7554
No log	4.2769	278	0.5062	0.5533	0.5062	0.7115
No log	4.3077	280	0.4900	0.5571	0.4900	0.7000
No log	4.3385	282	0.5506	0.5455	0.5506	0.7421
No log	4.3692	284	0.5148	0.5230	0.5148	0.7175
No log	4.4	286	0.4775	0.6351	0.4775	0.6910
No log	4.4308	288	0.5253	0.4644	0.5253	0.7248
No log	4.4615	290	0.5080	0.5034	0.5080	0.7127
No log	4.4923	292	0.4817	0.6344	0.4817	0.6941
No log	4.5231	294	0.4856	0.5846	0.4856	0.6968
No log	4.5538	296	0.4897	0.5784	0.4897	0.6998
No log	4.5846	298	0.4877	0.5079	0.4877	0.6984
No log	4.6154	300	0.5021	0.5178	0.5021	0.7086
No log	4.6462	302	0.5328	0.5422	0.5328	0.7299
No log	4.6769	304	0.5146	0.5422	0.5146	0.7174
No log	4.7077	306	0.4932	0.5061	0.4932	0.7023
No log	4.7385	308	0.5170	0.5214	0.5170	0.7190
No log	4.7692	310	0.4962	0.5232	0.4962	0.7044
No log	4.8	312	0.4898	0.5999	0.4898	0.6999
No log	4.8308	314	0.5247	0.5599	0.5247	0.7244
No log	4.8615	316	0.5471	0.5599	0.5471	0.7397
No log	4.8923	318	0.4969	0.6013	0.4969	0.7049
No log	4.9231	320	0.4940	0.5970	0.4940	0.7028
No log	4.9538	322	0.5515	0.4315	0.5515	0.7426
No log	4.9846	324	0.5378	0.5036	0.5378	0.7333
No log	5.0154	326	0.5037	0.5003	0.5037	0.7097
No log	5.0462	328	0.5046	0.4632	0.5046	0.7104
No log	5.0769	330	0.5097	0.5046	0.5097	0.7139
No log	5.1077	332	0.5105	0.5518	0.5105	0.7145
No log	5.1385	334	0.5821	0.5091	0.5821	0.7630
No log	5.1692	336	0.6051	0.5076	0.6051	0.7779
No log	5.2	338	0.5359	0.5184	0.5359	0.7320
No log	5.2308	340	0.5087	0.5098	0.5087	0.7132
No log	5.2615	342	0.5105	0.5117	0.5105	0.7145
No log	5.2923	344	0.5094	0.3677	0.5094	0.7137
No log	5.3231	346	0.5545	0.5039	0.5545	0.7446
No log	5.3538	348	0.6166	0.4444	0.6166	0.7853
No log	5.3846	350	0.6338	0.4883	0.6338	0.7961
No log	5.4154	352	0.5739	0.5161	0.5739	0.7576
No log	5.4462	354	0.5155	0.6549	0.5155	0.7180
No log	5.4769	356	0.5104	0.6311	0.5104	0.7144
No log	5.5077	358	0.4950	0.6088	0.4950	0.7036
No log	5.5385	360	0.4798	0.6027	0.4798	0.6927
No log	5.5692	362	0.4944	0.5307	0.4944	0.7031
No log	5.6	364	0.5094	0.5228	0.5094	0.7138
No log	5.6308	366	0.4909	0.5503	0.4909	0.7006
No log	5.6615	368	0.4854	0.6068	0.4854	0.6967
No log	5.6923	370	0.4951	0.5495	0.4951	0.7037
No log	5.7231	372	0.4886	0.5397	0.4886	0.6990
No log	5.7538	374	0.4954	0.4752	0.4954	0.7038
No log	5.7846	376	0.5408	0.5551	0.5408	0.7354
No log	5.8154	378	0.5936	0.4531	0.5936	0.7704
No log	5.8462	380	0.5654	0.4576	0.5654	0.7519
No log	5.8769	382	0.5003	0.5329	0.5003	0.7073
No log	5.9077	384	0.4830	0.4918	0.4830	0.6950
No log	5.9385	386	0.4900	0.4938	0.4900	0.7000
No log	5.9692	388	0.4823	0.4918	0.4823	0.6945
No log	6.0	390	0.4794	0.5915	0.4794	0.6924
No log	6.0308	392	0.4808	0.6435	0.4808	0.6934
No log	6.0615	394	0.4826	0.5915	0.4826	0.6947
No log	6.0923	396	0.4866	0.5397	0.4866	0.6975
No log	6.1231	398	0.4818	0.6435	0.4818	0.6941
No log	6.1538	400	0.4976	0.5289	0.4976	0.7054
No log	6.1846	402	0.5037	0.5472	0.5037	0.7097
No log	6.2154	404	0.5395	0.4534	0.5395	0.7345
No log	6.2462	406	0.5923	0.4597	0.5923	0.7696
No log	6.2769	408	0.5924	0.4597	0.5924	0.7697
No log	6.3077	410	0.5381	0.5036	0.5381	0.7336
No log	6.3385	412	0.5092	0.4101	0.5092	0.7136
No log	6.3692	414	0.5044	0.4918	0.5044	0.7102
No log	6.4	416	0.5075	0.5455	0.5075	0.7124
No log	6.4308	418	0.5035	0.5687	0.5035	0.7096
No log	6.4615	420	0.4983	0.6339	0.4983	0.7059
No log	6.4923	422	0.5115	0.5250	0.5115	0.7152
No log	6.5231	424	0.5166	0.5767	0.5166	0.7187
No log	6.5538	426	0.5344	0.5936	0.5344	0.7310
No log	6.5846	428	0.5911	0.4592	0.5911	0.7688
No log	6.6154	430	0.5810	0.4721	0.5810	0.7623
No log	6.6462	432	0.5100	0.4660	0.5100	0.7141
No log	6.6769	434	0.5001	0.4938	0.5001	0.7072
No log	6.7077	436	0.5037	0.5189	0.5037	0.7097
No log	6.7385	438	0.5009	0.5189	0.5009	0.7078
No log	6.7692	440	0.4977	0.4918	0.4977	0.7055
No log	6.8	442	0.5009	0.5042	0.5009	0.7078
No log	6.8308	444	0.5215	0.5173	0.5215	0.7222
No log	6.8615	446	0.5169	0.6003	0.5169	0.7189
No log	6.8923	448	0.5069	0.5611	0.5069	0.7119
No log	6.9231	450	0.5411	0.5599	0.5411	0.7356
No log	6.9538	452	0.5257	0.5603	0.5257	0.7250
No log	6.9846	454	0.5000	0.4126	0.5000	0.7071
No log	7.0154	456	0.5213	0.4780	0.5213	0.7220
No log	7.0462	458	0.5411	0.4941	0.5411	0.7356
No log	7.0769	460	0.5329	0.4780	0.5329	0.7300
No log	7.1077	462	0.5221	0.5161	0.5221	0.7226
No log	7.1385	464	0.4889	0.4407	0.4889	0.6992
No log	7.1692	466	0.4857	0.5189	0.4857	0.6969
No log	7.2	468	0.5012	0.5892	0.5012	0.7080
No log	7.2308	470	0.5125	0.5733	0.5125	0.7159
No log	7.2615	472	0.5248	0.5794	0.5248	0.7244
No log	7.2923	474	0.5023	0.5855	0.5023	0.7087
No log	7.3231	476	0.4891	0.6013	0.4891	0.6994
No log	7.3538	478	0.4990	0.6013	0.4990	0.7064
No log	7.3846	480	0.5227	0.5733	0.5227	0.7230
No log	7.4154	482	0.5414	0.5599	0.5414	0.7358
No log	7.4462	484	0.5203	0.5599	0.5203	0.7214
No log	7.4769	486	0.4814	0.6096	0.4814	0.6939
No log	7.5077	488	0.4832	0.5941	0.4832	0.6951
No log	7.5385	490	0.4847	0.5941	0.4847	0.6962
No log	7.5692	492	0.4781	0.5379	0.4781	0.6915
No log	7.6	494	0.4789	0.5171	0.4789	0.6921
No log	7.6308	496	0.4809	0.5495	0.4809	0.6935
No log	7.6615	498	0.4762	0.5915	0.4762	0.6901
0.2777	7.6923	500	0.5153	0.5104	0.5153	0.7179
0.2777	7.7231	502	0.5679	0.4464	0.5679	0.7536
0.2777	7.7538	504	0.5257	0.4704	0.5257	0.7251
0.2777	7.7846	506	0.4584	0.6747	0.4584	0.6771
0.2777	7.8154	508	0.4684	0.6127	0.4684	0.6844
0.2777	7.8462	510	0.4807	0.5970	0.4807	0.6933
0.2777	7.8769	512	0.4665	0.6127	0.4665	0.6830
0.2777	7.9077	514	0.4542	0.6747	0.4542	0.6739
0.2777	7.9385	516	0.4629	0.6632	0.4629	0.6804
0.2777	7.9692	518	0.4556	0.6747	0.4556	0.6750
0.2777	8.0	520	0.4822	0.5970	0.4822	0.6944
0.2777	8.0308	522	0.5726	0.6010	0.5726	0.7567
0.2777	8.0615	524	0.5979	0.6010	0.5979	0.7732
0.2777	8.0923	526	0.5211	0.5794	0.5211	0.7219
0.2777	8.1231	528	0.4792	0.6364	0.4792	0.6923
0.2777	8.1538	530	0.5018	0.5289	0.5018	0.7084
0.2777	8.1846	532	0.5204	0.5184	0.5204	0.7214
0.2777	8.2154	534	0.4990	0.5550	0.4990	0.7064
0.2777	8.2462	536	0.4882	0.6242	0.4882	0.6987
0.2777	8.2769	538	0.5024	0.5765	0.5024	0.7088
0.2777	8.3077	540	0.5345	0.5584	0.5345	0.7311
0.2777	8.3385	542	0.5497	0.5584	0.5497	0.7414
0.2777	8.3692	544	0.5443	0.5584	0.5443	0.7378
0.2777	8.4	546	0.5297	0.5438	0.5297	0.7278
0.2777	8.4308	548	0.5030	0.5463	0.5030	0.7092
0.2777	8.4615	550	0.5029	0.4726	0.5029	0.7091
0.2777	8.4923	552	0.5345	0.4835	0.5345	0.7311
0.2777	8.5231	554	0.5472	0.4835	0.5472	0.7397
0.2777	8.5538	556	0.4963	0.5289	0.4963	0.7045
0.2777	8.5846	558	0.4847	0.5503	0.4847	0.6962
0.2777	8.6154	560	0.4853	0.5267	0.4853	0.6966
0.2777	8.6462	562	0.4787	0.5503	0.4787	0.6919
0.2777	8.6769	564	0.4714	0.6060	0.4714	0.6866
0.2777	8.7077	566	0.4688	0.6370	0.4688	0.6847
0.2777	8.7385	568	0.4815	0.5796	0.4815	0.6939
0.2777	8.7692	570	0.5153	0.5599	0.5153	0.7178
0.2777	8.8	572	0.5346	0.5599	0.5346	0.7312
0.2777	8.8308	574	0.5098	0.5300	0.5098	0.7140
0.2777	8.8615	576	0.4820	0.5796	0.4820	0.6942
0.2777	8.8923	578	0.4791	0.5877	0.4791	0.6922
0.2777	8.9231	580	0.4768	0.4384	0.4768	0.6905
0.2777	8.9538	582	0.4901	0.5675	0.4901	0.7001
0.2777	8.9846	584	0.4972	0.5675	0.4972	0.7051
0.2777	9.0154	586	0.4925	0.5367	0.4925	0.7018
0.2777	9.0462	588	0.4918	0.4384	0.4918	0.7012
0.2777	9.0769	590	0.4954	0.5587	0.4954	0.7038
0.2777	9.1077	592	0.5089	0.4962	0.5089	0.7134
0.2777	9.1385	594	0.5241	0.4774	0.5241	0.7240
0.2777	9.1692	596	0.5136	0.4291	0.5136	0.7166
0.2777	9.2	598	0.5236	0.3552	0.5236	0.7236
0.2777	9.2308	600	0.5329	0.3552	0.5329	0.7300

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1