ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6269
• Qwk: 0.5676
• Mse: 0.6269
• Rmse: 0.7917

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.0527	0.0086	4.0527	2.0131
No log	0.0769	4	2.2908	0.0189	2.2908	1.5135
No log	0.1154	6	1.3549	0.1224	1.3549	1.1640
No log	0.1538	8	1.0994	0.3251	1.0994	1.0485
No log	0.1923	10	1.0404	0.1532	1.0404	1.0200
No log	0.2308	12	1.0960	0.1981	1.0960	1.0469
No log	0.2692	14	1.1421	0.1071	1.1421	1.0687
No log	0.3077	16	1.3480	-0.0777	1.3480	1.1610
No log	0.3462	18	1.2919	-0.0812	1.2919	1.1366
No log	0.3846	20	1.0777	0.1071	1.0777	1.0381
No log	0.4231	22	1.0724	0.1447	1.0724	1.0356
No log	0.4615	24	1.0686	0.2490	1.0686	1.0337
No log	0.5	26	1.1097	0.2171	1.1097	1.0534
No log	0.5385	28	1.0741	0.2023	1.0741	1.0364
No log	0.5769	30	1.0559	0.1821	1.0559	1.0275
No log	0.6154	32	1.0168	0.2316	1.0168	1.0084
No log	0.6538	34	1.0784	0.1953	1.0784	1.0385
No log	0.6923	36	1.0446	0.2246	1.0446	1.0221
No log	0.7308	38	0.9220	0.2690	0.9220	0.9602
No log	0.7692	40	0.8865	0.2933	0.8865	0.9416
No log	0.8077	42	0.8473	0.4030	0.8473	0.9205
No log	0.8462	44	0.8602	0.4295	0.8602	0.9275
No log	0.8846	46	1.1973	0.1576	1.1973	1.0942
No log	0.9231	48	1.2979	0.1085	1.2979	1.1393
No log	0.9615	50	1.1258	0.1471	1.1258	1.0610
No log	1.0	52	0.8725	0.4288	0.8725	0.9341
No log	1.0385	54	0.9518	0.4	0.9518	0.9756
No log	1.0769	56	1.1405	0.3782	1.1405	1.0679
No log	1.1154	58	0.9880	0.3881	0.9880	0.9940
No log	1.1538	60	0.9954	0.3881	0.9954	0.9977
No log	1.1923	62	1.0043	0.3538	1.0043	1.0021
No log	1.2308	64	1.0583	0.3023	1.0583	1.0287
No log	1.2692	66	1.3114	0.2947	1.3114	1.1452
No log	1.3077	68	1.1730	0.3373	1.1730	1.0831
No log	1.3462	70	1.3135	0.1817	1.3135	1.1461
No log	1.3846	72	1.4177	0.1648	1.4177	1.1907
No log	1.4231	74	1.3016	0.3304	1.3016	1.1409
No log	1.4615	76	1.0708	0.4226	1.0708	1.0348
No log	1.5	78	1.1216	0.3782	1.1216	1.0591
No log	1.5385	80	1.4958	0.2857	1.4958	1.2230
No log	1.5769	82	1.4174	0.2823	1.4174	1.1906
No log	1.6154	84	0.9588	0.3782	0.9588	0.9792
No log	1.6538	86	0.8755	0.3979	0.8755	0.9357
No log	1.6923	88	0.8890	0.4097	0.8890	0.9429
No log	1.7308	90	1.2594	0.3544	1.2594	1.1222
No log	1.7692	92	1.5814	0.1279	1.5814	1.2575
No log	1.8077	94	1.4207	0.2070	1.4207	1.1919
No log	1.8462	96	0.9785	0.4081	0.9785	0.9892
No log	1.8846	98	0.7846	0.4035	0.7846	0.8858
No log	1.9231	100	0.8830	0.3045	0.8830	0.9397
No log	1.9615	102	0.9008	0.3187	0.9008	0.9491
No log	2.0	104	0.7830	0.4427	0.7830	0.8849
No log	2.0385	106	0.8796	0.4293	0.8796	0.9379
No log	2.0769	108	1.0976	0.3744	1.0976	1.0476
No log	2.1154	110	0.9954	0.3378	0.9954	0.9977
No log	2.1538	112	0.7961	0.6075	0.7961	0.8923
No log	2.1923	114	0.7956	0.5732	0.7956	0.8919
No log	2.2308	116	0.8261	0.5746	0.8261	0.9089
No log	2.2692	118	0.9025	0.4476	0.9025	0.9500
No log	2.3077	120	1.0146	0.4062	1.0146	1.0073
No log	2.3462	122	1.0819	0.4084	1.0819	1.0401
No log	2.3846	124	0.9638	0.4279	0.9638	0.9817
No log	2.4231	126	0.8939	0.5210	0.8939	0.9454
No log	2.4615	128	1.0126	0.4467	1.0126	1.0063
No log	2.5	130	1.2907	0.3338	1.2907	1.1361
No log	2.5385	132	1.3260	0.3264	1.3260	1.1515
No log	2.5769	134	1.1356	0.3388	1.1356	1.0656
No log	2.6154	136	0.9063	0.3810	0.9063	0.9520
No log	2.6538	138	0.7886	0.4980	0.7886	0.8880
No log	2.6923	140	0.7695	0.5123	0.7695	0.8772
No log	2.7308	142	0.7518	0.4807	0.7518	0.8670
No log	2.7692	144	0.7486	0.4707	0.7486	0.8652
No log	2.8077	146	0.7636	0.5327	0.7636	0.8738
No log	2.8462	148	0.7812	0.5434	0.7812	0.8838
No log	2.8846	150	0.7579	0.5434	0.7579	0.8706
No log	2.9231	152	0.6993	0.6282	0.6993	0.8363
No log	2.9615	154	0.6990	0.6390	0.6990	0.8361
No log	3.0	156	0.7508	0.5121	0.7508	0.8665
No log	3.0385	158	0.7736	0.4903	0.7736	0.8795
No log	3.0769	160	0.7386	0.4737	0.7386	0.8594
No log	3.1154	162	0.7297	0.5315	0.7297	0.8542
No log	3.1538	164	0.7287	0.5523	0.7287	0.8536
No log	3.1923	166	0.7356	0.4974	0.7356	0.8577
No log	3.2308	168	0.7366	0.5093	0.7366	0.8583
No log	3.2692	170	0.7205	0.5088	0.7205	0.8488
No log	3.3077	172	0.7070	0.5088	0.7070	0.8408
No log	3.3462	174	0.8234	0.5020	0.8234	0.9074
No log	3.3846	176	0.8877	0.3863	0.8877	0.9422
No log	3.4231	178	0.7852	0.4911	0.7852	0.8861
No log	3.4615	180	0.6643	0.6094	0.6643	0.8151
No log	3.5	182	0.6459	0.6374	0.6459	0.8037
No log	3.5385	184	0.6523	0.6470	0.6523	0.8077
No log	3.5769	186	0.7416	0.5446	0.7416	0.8612
No log	3.6154	188	0.8891	0.4222	0.8891	0.9429
No log	3.6538	190	1.0074	0.3982	1.0074	1.0037
No log	3.6923	192	0.9345	0.3780	0.9345	0.9667
No log	3.7308	194	0.8207	0.5025	0.8207	0.9059
No log	3.7692	196	0.6983	0.6032	0.6983	0.8356
No log	3.8077	198	0.6888	0.6555	0.6888	0.8299
No log	3.8462	200	0.6907	0.5950	0.6907	0.8311
No log	3.8846	202	0.7169	0.5113	0.7169	0.8467
No log	3.9231	204	0.7337	0.4828	0.7337	0.8566
No log	3.9615	206	0.6848	0.5103	0.6848	0.8275
No log	4.0	208	0.6598	0.5647	0.6598	0.8123
No log	4.0385	210	0.6551	0.5771	0.6551	0.8094
No log	4.0769	212	0.6758	0.5586	0.6758	0.8221
No log	4.1154	214	0.7008	0.6043	0.7008	0.8371
No log	4.1538	216	0.6293	0.6205	0.6293	0.7933
No log	4.1923	218	0.6512	0.6209	0.6512	0.8070
No log	4.2308	220	0.7852	0.5243	0.7852	0.8861
No log	4.2692	222	0.7750	0.5380	0.7750	0.8803
No log	4.3077	224	0.6626	0.5928	0.6626	0.8140
No log	4.3462	226	0.6837	0.5770	0.6837	0.8269
No log	4.3846	228	0.8246	0.5382	0.8246	0.9081
No log	4.4231	230	0.7745	0.5491	0.7745	0.8800
No log	4.4615	232	0.6677	0.5554	0.6677	0.8171
No log	4.5	234	0.6800	0.5610	0.6800	0.8246
No log	4.5385	236	0.9793	0.4154	0.9793	0.9896
No log	4.5769	238	1.2565	0.3641	1.2565	1.1209
No log	4.6154	240	1.2034	0.3776	1.2034	1.0970
No log	4.6538	242	0.9344	0.4123	0.9344	0.9667
No log	4.6923	244	0.7494	0.5051	0.7494	0.8657
No log	4.7308	246	0.7378	0.5074	0.7378	0.8589
No log	4.7692	248	0.7624	0.5074	0.7624	0.8731
No log	4.8077	250	0.7046	0.5319	0.7046	0.8394
No log	4.8462	252	0.6644	0.5482	0.6644	0.8151
No log	4.8846	254	0.6898	0.5292	0.6898	0.8305
No log	4.9231	256	0.8068	0.5330	0.8068	0.8982
No log	4.9615	258	0.9417	0.4860	0.9417	0.9704
No log	5.0	260	0.8787	0.4667	0.8787	0.9374
No log	5.0385	262	0.6928	0.5463	0.6928	0.8323
No log	5.0769	264	0.6731	0.5357	0.6731	0.8204
No log	5.1154	266	0.6915	0.5123	0.6915	0.8316
No log	5.1538	268	0.6547	0.6230	0.6547	0.8091
No log	5.1923	270	0.6761	0.6008	0.6761	0.8222
No log	5.2308	272	0.7372	0.5098	0.7372	0.8586
No log	5.2692	274	0.7219	0.5552	0.7219	0.8497
No log	5.3077	276	0.6330	0.6537	0.6330	0.7956
No log	5.3462	278	0.6893	0.5442	0.6893	0.8303
No log	5.3846	280	0.7986	0.4752	0.7986	0.8936
No log	5.4231	282	0.7286	0.5805	0.7286	0.8536
No log	5.4615	284	0.6239	0.6546	0.6239	0.7899
No log	5.5	286	0.6861	0.5883	0.6861	0.8283
No log	5.5385	288	0.6934	0.5883	0.6934	0.8327
No log	5.5769	290	0.6450	0.5758	0.6450	0.8031
No log	5.6154	292	0.6959	0.5123	0.6959	0.8342
No log	5.6538	294	0.7533	0.5158	0.7533	0.8679
No log	5.6923	296	0.7104	0.5493	0.7104	0.8429
No log	5.7308	298	0.6634	0.6010	0.6634	0.8145
No log	5.7692	300	0.7042	0.5697	0.7042	0.8392
No log	5.8077	302	0.7591	0.5920	0.7591	0.8712
No log	5.8462	304	0.7081	0.6150	0.7081	0.8415
No log	5.8846	306	0.6471	0.5771	0.6471	0.8044
No log	5.9231	308	0.6773	0.4507	0.6773	0.8230
No log	5.9615	310	0.6914	0.4223	0.6914	0.8315
No log	6.0	312	0.6680	0.4878	0.6680	0.8173
No log	6.0385	314	0.6669	0.5522	0.6669	0.8166
No log	6.0769	316	0.6755	0.5847	0.6755	0.8219
No log	6.1154	318	0.6758	0.5822	0.6758	0.8220
No log	6.1538	320	0.7147	0.5079	0.7147	0.8454
No log	6.1923	322	0.7652	0.4565	0.7652	0.8748
No log	6.2308	324	0.7621	0.4439	0.7621	0.8730
No log	6.2692	326	0.7164	0.4327	0.7164	0.8464
No log	6.3077	328	0.6537	0.5647	0.6537	0.8085
No log	6.3462	330	0.6699	0.6228	0.6699	0.8185
No log	6.3846	332	0.6901	0.5902	0.6901	0.8307
No log	6.4231	334	0.6569	0.5659	0.6569	0.8105
No log	6.4615	336	0.6539	0.5647	0.6539	0.8087
No log	6.5	338	0.6557	0.5644	0.6557	0.8098
No log	6.5385	340	0.6695	0.5259	0.6695	0.8183
No log	6.5769	342	0.6652	0.5408	0.6652	0.8156
No log	6.6154	344	0.6521	0.5415	0.6521	0.8075
No log	6.6538	346	0.6431	0.5644	0.6431	0.8019
No log	6.6923	348	0.6593	0.5605	0.6593	0.8120
No log	6.7308	350	0.7149	0.5425	0.7149	0.8455
No log	6.7692	352	0.7052	0.5634	0.7052	0.8397
No log	6.8077	354	0.6642	0.5220	0.6642	0.8150
No log	6.8462	356	0.6457	0.5597	0.6457	0.8036
No log	6.8846	358	0.6463	0.5503	0.6463	0.8039
No log	6.9231	360	0.6437	0.5503	0.6437	0.8023
No log	6.9615	362	0.6199	0.5966	0.6199	0.7873
No log	7.0	364	0.5944	0.6584	0.5944	0.7710
No log	7.0385	366	0.5847	0.6546	0.5847	0.7647
No log	7.0769	368	0.5730	0.6720	0.5730	0.7570
No log	7.1154	370	0.5676	0.6584	0.5676	0.7534
No log	7.1538	372	0.5691	0.6292	0.5691	0.7544
No log	7.1923	374	0.5697	0.6649	0.5697	0.7548
No log	7.2308	376	0.5689	0.6649	0.5689	0.7543
No log	7.2692	378	0.5668	0.6699	0.5668	0.7529
No log	7.3077	380	0.5886	0.5999	0.5886	0.7672
No log	7.3462	382	0.6174	0.6298	0.6174	0.7857
No log	7.3846	384	0.6023	0.6288	0.6023	0.7761
No log	7.4231	386	0.5978	0.6479	0.5978	0.7732
No log	7.4615	388	0.6045	0.6320	0.6045	0.7775
No log	7.5	390	0.5912	0.6593	0.5912	0.7689
No log	7.5385	392	0.5924	0.6185	0.5924	0.7697
No log	7.5769	394	0.5961	0.6185	0.5961	0.7721
No log	7.6154	396	0.5906	0.6078	0.5906	0.7685
No log	7.6538	398	0.5941	0.6078	0.5941	0.7708
No log	7.6923	400	0.5902	0.6302	0.5902	0.7682
No log	7.7308	402	0.5910	0.6657	0.5910	0.7688
No log	7.7692	404	0.6180	0.5734	0.6180	0.7861
No log	7.8077	406	0.6246	0.5509	0.6246	0.7903
No log	7.8462	408	0.6356	0.5509	0.6356	0.7973
No log	7.8846	410	0.6320	0.5710	0.6320	0.7950
No log	7.9231	412	0.6419	0.5710	0.6419	0.8012
No log	7.9615	414	0.6927	0.5084	0.6927	0.8323
No log	8.0	416	0.7934	0.5124	0.7934	0.8907
No log	8.0385	418	0.8125	0.5252	0.8125	0.9014
No log	8.0769	420	0.7377	0.4697	0.7377	0.8589
No log	8.1154	422	0.6654	0.5093	0.6654	0.8157
No log	8.1538	424	0.6303	0.5894	0.6303	0.7939
No log	8.1923	426	0.6127	0.6360	0.6127	0.7827
No log	8.2308	428	0.6146	0.6154	0.6146	0.7840
No log	8.2692	430	0.5973	0.6105	0.5973	0.7728
No log	8.3077	432	0.6123	0.6139	0.6123	0.7825
No log	8.3462	434	0.6239	0.6139	0.6239	0.7899
No log	8.3846	436	0.6129	0.6139	0.6129	0.7828
No log	8.4231	438	0.5995	0.5570	0.5995	0.7743
No log	8.4615	440	0.6017	0.6217	0.6017	0.7757
No log	8.5	442	0.5807	0.6584	0.5807	0.7620
No log	8.5385	444	0.5811	0.6584	0.5811	0.7623
No log	8.5769	446	0.5809	0.6354	0.5809	0.7622
No log	8.6154	448	0.5812	0.6364	0.5812	0.7624
No log	8.6538	450	0.5886	0.6593	0.5886	0.7672
No log	8.6923	452	0.5830	0.6364	0.5830	0.7636
No log	8.7308	454	0.6334	0.6063	0.6334	0.7959
No log	8.7692	456	0.6988	0.5858	0.6988	0.8359
No log	8.8077	458	0.6825	0.6063	0.6825	0.8261
No log	8.8462	460	0.6316	0.6269	0.6316	0.7947
No log	8.8846	462	0.6124	0.6167	0.6124	0.7826
No log	8.9231	464	0.6480	0.6269	0.6480	0.8050
No log	8.9615	466	0.6994	0.5510	0.6994	0.8363
No log	9.0	468	0.7556	0.5540	0.7556	0.8692
No log	9.0385	470	0.7360	0.4478	0.7360	0.8579
No log	9.0769	472	0.6807	0.4610	0.6807	0.8251
No log	9.1154	474	0.6428	0.4893	0.6428	0.8018
No log	9.1538	476	0.6304	0.5605	0.6304	0.7940
No log	9.1923	478	0.6280	0.5605	0.6280	0.7924
No log	9.2308	480	0.6335	0.5734	0.6335	0.7959
No log	9.2692	482	0.6368	0.6105	0.6368	0.7980
No log	9.3077	484	0.6748	0.5318	0.6748	0.8215
No log	9.3462	486	0.7007	0.5088	0.7007	0.8371
No log	9.3846	488	0.7027	0.5088	0.7027	0.8383
No log	9.4231	490	0.6643	0.5721	0.6643	0.8150
No log	9.4615	492	0.6377	0.5663	0.6377	0.7985
No log	9.5	494	0.6499	0.5570	0.6499	0.8062
No log	9.5385	496	0.7108	0.5968	0.7108	0.8431
No log	9.5769	498	0.6922	0.6081	0.6922	0.8320
0.3296	9.6154	500	0.6279	0.5819	0.6279	0.7924
0.3296	9.6538	502	0.5750	0.6370	0.5750	0.7583
0.3296	9.6923	504	0.5980	0.6695	0.5980	0.7733
0.3296	9.7308	506	0.5884	0.6491	0.5884	0.7671
0.3296	9.7692	508	0.5683	0.6354	0.5683	0.7538
0.3296	9.8077	510	0.5700	0.6546	0.5700	0.7550
0.3296	9.8462	512	0.5902	0.5868	0.5902	0.7683
0.3296	9.8846	514	0.6138	0.5428	0.6138	0.7834
0.3296	9.9231	516	0.6136	0.5523	0.6136	0.7833
0.3296	9.9615	518	0.5991	0.5939	0.5991	0.7740
0.3296	10.0	520	0.5905	0.6658	0.5905	0.7684
0.3296	10.0385	522	0.5847	0.6955	0.5847	0.7647
0.3296	10.0769	524	0.6065	0.6607	0.6065	0.7788
0.3296	10.1154	526	0.6659	0.6111	0.6659	0.8160
0.3296	10.1538	528	0.6436	0.6130	0.6436	0.8023
0.3296	10.1923	530	0.5991	0.6554	0.5991	0.7740
0.3296	10.2308	532	0.5810	0.5871	0.5810	0.7623
0.3296	10.2692	534	0.5786	0.6380	0.5786	0.7607
0.3296	10.3077	536	0.5734	0.6575	0.5734	0.7572
0.3296	10.3462	538	0.5722	0.6778	0.5722	0.7564
0.3296	10.3846	540	0.5988	0.6803	0.5988	0.7738
0.3296	10.4231	542	0.5866	0.6684	0.5866	0.7659
0.3296	10.4615	544	0.5825	0.6667	0.5825	0.7632
0.3296	10.5	546	0.6107	0.5422	0.6107	0.7815
0.3296	10.5385	548	0.6425	0.4909	0.6425	0.8015
0.3296	10.5769	550	0.6447	0.5288	0.6447	0.8029
0.3296	10.6154	552	0.6296	0.6094	0.6296	0.7935
0.3296	10.6538	554	0.6078	0.6032	0.6078	0.7796
0.3296	10.6923	556	0.5841	0.5921	0.5841	0.7643
0.3296	10.7308	558	0.5888	0.5921	0.5888	0.7673
0.3296	10.7692	560	0.6197	0.5676	0.6197	0.7872
0.3296	10.8077	562	0.6472	0.5318	0.6472	0.8045
0.3296	10.8462	564	0.6429	0.5676	0.6429	0.8018
0.3296	10.8846	566	0.6346	0.5676	0.6346	0.7966
0.3296	10.9231	568	0.6269	0.5676	0.6269	0.7917

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1