ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7956
• Qwk: 0.6078
• Mse: 0.7956
• Rmse: 0.8920

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0308	2	3.9905	0.0125	3.9905	1.9976
No log	0.0615	4	1.9575	0.0741	1.9575	1.3991
No log	0.0923	6	1.5258	-0.0351	1.5258	1.2352
No log	0.1231	8	1.1084	0.1989	1.1084	1.0528
No log	0.1538	10	1.0609	0.0762	1.0609	1.0300
No log	0.1846	12	1.0265	0.0604	1.0265	1.0132
No log	0.2154	14	0.9711	0.3153	0.9711	0.9855
No log	0.2462	16	0.9796	0.4547	0.9796	0.9897
No log	0.2769	18	1.0053	0.3048	1.0053	1.0027
No log	0.3077	20	1.0201	0.3189	1.0201	1.0100
No log	0.3385	22	0.8672	0.4347	0.8672	0.9313
No log	0.3692	24	0.7984	0.4398	0.7984	0.8935
No log	0.4	26	0.7578	0.3838	0.7578	0.8705
No log	0.4308	28	0.7175	0.5316	0.7175	0.8471
No log	0.4615	30	0.7118	0.6006	0.7118	0.8437
No log	0.4923	32	0.9010	0.4847	0.9010	0.9492
No log	0.5231	34	1.2655	0.3816	1.2655	1.1249
No log	0.5538	36	0.8938	0.5928	0.8938	0.9454
No log	0.5846	38	0.7357	0.6162	0.7357	0.8577
No log	0.6154	40	0.8522	0.5214	0.8522	0.9231
No log	0.6462	42	0.7935	0.5522	0.7935	0.8908
No log	0.6769	44	0.7638	0.6070	0.7638	0.8739
No log	0.7077	46	0.7844	0.5905	0.7844	0.8857
No log	0.7385	48	0.8084	0.5718	0.8084	0.8991
No log	0.7692	50	0.7151	0.6636	0.7151	0.8457
No log	0.8	52	0.7085	0.6097	0.7085	0.8417
No log	0.8308	54	0.7122	0.5839	0.7122	0.8439
No log	0.8615	56	0.7169	0.6551	0.7169	0.8467
No log	0.8923	58	0.8514	0.6026	0.8514	0.9227
No log	0.9231	60	1.1080	0.5572	1.1080	1.0526
No log	0.9538	62	1.0528	0.5909	1.0528	1.0261
No log	0.9846	64	0.8693	0.5974	0.8693	0.9324
No log	1.0154	66	0.8076	0.6389	0.8076	0.8987
No log	1.0462	68	0.7357	0.6214	0.7357	0.8577
No log	1.0769	70	0.7658	0.6116	0.7658	0.8751
No log	1.1077	72	0.8051	0.5498	0.8051	0.8973
No log	1.1385	74	0.7117	0.6721	0.7117	0.8436
No log	1.1692	76	0.6661	0.6302	0.6661	0.8161
No log	1.2	78	0.7573	0.5051	0.7573	0.8702
No log	1.2308	80	0.6786	0.6516	0.6786	0.8237
No log	1.2615	82	0.6470	0.6772	0.6470	0.8043
No log	1.2923	84	0.6492	0.7049	0.6492	0.8057
No log	1.3231	86	0.6912	0.6953	0.6912	0.8314
No log	1.3538	88	0.7530	0.6439	0.7530	0.8677
No log	1.3846	90	0.7127	0.6879	0.7127	0.8442
No log	1.4154	92	0.6519	0.6932	0.6519	0.8074
No log	1.4462	94	0.7384	0.5504	0.7384	0.8593
No log	1.4769	96	0.8220	0.4681	0.8220	0.9066
No log	1.5077	98	0.7300	0.5175	0.7300	0.8544
No log	1.5385	100	0.6640	0.6650	0.6640	0.8149
No log	1.5692	102	0.6889	0.6748	0.6889	0.8300
No log	1.6	104	0.7087	0.6879	0.7087	0.8419
No log	1.6308	106	0.7033	0.6294	0.7033	0.8386
No log	1.6615	108	0.7235	0.6335	0.7235	0.8506
No log	1.6923	110	0.7744	0.5953	0.7744	0.8800
No log	1.7231	112	0.7938	0.5966	0.7938	0.8910
No log	1.7538	114	0.7209	0.6468	0.7209	0.8491
No log	1.7846	116	0.6867	0.6864	0.6867	0.8287
No log	1.8154	118	0.6828	0.6711	0.6828	0.8263
No log	1.8462	120	0.6787	0.6148	0.6787	0.8238
No log	1.8769	122	0.6971	0.6102	0.6971	0.8350
No log	1.9077	124	0.7899	0.5865	0.7899	0.8888
No log	1.9385	126	0.8722	0.5741	0.8722	0.9339
No log	1.9692	128	0.7508	0.6552	0.7508	0.8665
No log	2.0	130	0.6514	0.6952	0.6514	0.8071
No log	2.0308	132	0.6298	0.6686	0.6298	0.7936
No log	2.0615	134	0.6223	0.6835	0.6223	0.7889
No log	2.0923	136	0.6194	0.7203	0.6194	0.7870
No log	2.1231	138	0.6207	0.6207	0.6207	0.7878
No log	2.1538	140	0.6041	0.6641	0.6041	0.7773
No log	2.1846	142	0.5975	0.6185	0.5975	0.7730
No log	2.2154	144	0.5751	0.6330	0.5751	0.7583
No log	2.2462	146	0.6205	0.6766	0.6205	0.7877
No log	2.2769	148	0.7797	0.5686	0.7797	0.8830
No log	2.3077	150	0.6904	0.6035	0.6904	0.8309
No log	2.3385	152	0.5744	0.7177	0.5744	0.7579
No log	2.3692	154	0.6020	0.7073	0.6020	0.7759
No log	2.4	156	0.6259	0.6965	0.6259	0.7912
No log	2.4308	158	0.6190	0.7083	0.6190	0.7868
No log	2.4615	160	0.6764	0.6850	0.6764	0.8224
No log	2.4923	162	0.8098	0.5478	0.8098	0.8999
No log	2.5231	164	0.9098	0.5442	0.9098	0.9538
No log	2.5538	166	0.9757	0.5069	0.9757	0.9878
No log	2.5846	168	0.7934	0.5381	0.7934	0.8907
No log	2.6154	170	0.7011	0.6768	0.7011	0.8373
No log	2.6462	172	0.6470	0.6187	0.6470	0.8043
No log	2.6769	174	0.6555	0.6289	0.6555	0.8097
No log	2.7077	176	0.6829	0.6195	0.6829	0.8264
No log	2.7385	178	0.6773	0.5501	0.6773	0.8230
No log	2.7692	180	0.6799	0.6080	0.6799	0.8246
No log	2.8	182	0.6846	0.6160	0.6846	0.8274
No log	2.8308	184	0.7034	0.6274	0.7034	0.8387
No log	2.8615	186	0.6720	0.6186	0.6720	0.8198
No log	2.8923	188	0.7000	0.6780	0.7000	0.8367
No log	2.9231	190	0.6718	0.6277	0.6718	0.8197
No log	2.9538	192	0.7084	0.6142	0.7084	0.8416
No log	2.9846	194	0.7027	0.6147	0.7027	0.8383
No log	3.0154	196	0.6792	0.6230	0.6792	0.8241
No log	3.0462	198	0.6482	0.6147	0.6482	0.8051
No log	3.0769	200	0.6485	0.5838	0.6485	0.8053
No log	3.1077	202	0.6279	0.6659	0.6279	0.7924
No log	3.1385	204	0.6320	0.6486	0.6320	0.7950
No log	3.1692	206	0.6364	0.6558	0.6364	0.7977
No log	3.2	208	0.6262	0.6605	0.6262	0.7913
No log	3.2308	210	0.6703	0.5911	0.6703	0.8187
No log	3.2615	212	0.6938	0.5735	0.6938	0.8329
No log	3.2923	214	0.7352	0.5628	0.7352	0.8574
No log	3.3231	216	0.6756	0.5924	0.6756	0.8219
No log	3.3538	218	0.6022	0.6916	0.6022	0.7760
No log	3.3846	220	0.5890	0.6659	0.5890	0.7674
No log	3.4154	222	0.6190	0.6575	0.6190	0.7868
No log	3.4462	224	0.6533	0.5630	0.6533	0.8082
No log	3.4769	226	0.6255	0.5945	0.6255	0.7909
No log	3.5077	228	0.6305	0.5430	0.6305	0.7940
No log	3.5385	230	0.6286	0.5312	0.6286	0.7928
No log	3.5692	232	0.6328	0.5810	0.6328	0.7955
No log	3.6	234	0.6823	0.6167	0.6823	0.8260
No log	3.6308	236	0.6489	0.6199	0.6489	0.8056
No log	3.6615	238	0.6047	0.5865	0.6047	0.7776
No log	3.6923	240	0.6386	0.5645	0.6386	0.7991
No log	3.7231	242	0.6312	0.5645	0.6312	0.7945
No log	3.7538	244	0.6149	0.6070	0.6149	0.7841
No log	3.7846	246	0.6078	0.7049	0.6078	0.7796
No log	3.8154	248	0.6504	0.6217	0.6504	0.8065
No log	3.8462	250	0.6212	0.6921	0.6212	0.7882
No log	3.8769	252	0.5916	0.7246	0.5916	0.7692
No log	3.9077	254	0.5956	0.6391	0.5956	0.7717
No log	3.9385	256	0.5963	0.6391	0.5963	0.7722
No log	3.9692	258	0.5916	0.6284	0.5916	0.7691
No log	4.0	260	0.5952	0.6115	0.5952	0.7715
No log	4.0308	262	0.5751	0.6364	0.5751	0.7584
No log	4.0615	264	0.5797	0.7599	0.5797	0.7614
No log	4.0923	266	0.6448	0.6871	0.6448	0.8030
No log	4.1231	268	0.6238	0.7036	0.6238	0.7898
No log	4.1538	270	0.5622	0.7213	0.5622	0.7498
No log	4.1846	272	0.5478	0.6733	0.5478	0.7401
No log	4.2154	274	0.5474	0.6683	0.5474	0.7399
No log	4.2462	276	0.5413	0.6959	0.5413	0.7357
No log	4.2769	278	0.5474	0.7354	0.5474	0.7399
No log	4.3077	280	0.5290	0.6970	0.5290	0.7273
No log	4.3385	282	0.5377	0.6858	0.5377	0.7333
No log	4.3692	284	0.5338	0.6507	0.5338	0.7306
No log	4.4	286	0.5528	0.6620	0.5528	0.7435
No log	4.4308	288	0.6836	0.5867	0.6836	0.8268
No log	4.4615	290	0.7531	0.5695	0.7531	0.8678
No log	4.4923	292	0.7179	0.5636	0.7179	0.8473
No log	4.5231	294	0.6023	0.6815	0.6023	0.7761
No log	4.5538	296	0.5707	0.6560	0.5707	0.7554
No log	4.5846	298	0.5951	0.6558	0.5951	0.7714
No log	4.6154	300	0.6622	0.6552	0.6622	0.8138
No log	4.6462	302	0.7211	0.5966	0.7211	0.8491
No log	4.6769	304	0.6524	0.6402	0.6524	0.8077
No log	4.7077	306	0.5908	0.6846	0.5908	0.7686
No log	4.7385	308	0.5895	0.6804	0.5895	0.7678
No log	4.7692	310	0.5952	0.6694	0.5952	0.7715
No log	4.8	312	0.6421	0.6867	0.6421	0.8013
No log	4.8308	314	0.7204	0.5587	0.7204	0.8488
No log	4.8615	316	0.7743	0.5086	0.7743	0.8799
No log	4.8923	318	0.7324	0.5318	0.7324	0.8558
No log	4.9231	320	0.6953	0.5628	0.6953	0.8338
No log	4.9538	322	0.6451	0.6415	0.6451	0.8032
No log	4.9846	324	0.6507	0.6311	0.6507	0.8066
No log	5.0154	326	0.6783	0.5654	0.6783	0.8236
No log	5.0462	328	0.7106	0.5356	0.7106	0.8430
No log	5.0769	330	0.7427	0.5131	0.7427	0.8618
No log	5.1077	332	0.6969	0.6109	0.6969	0.8348
No log	5.1385	334	0.6510	0.6421	0.6510	0.8068
No log	5.1692	336	0.6279	0.6341	0.6279	0.7924
No log	5.2	338	0.6384	0.6310	0.6384	0.7990
No log	5.2308	340	0.6554	0.6160	0.6554	0.8096
No log	5.2615	342	0.6841	0.5751	0.6841	0.8271
No log	5.2923	344	0.6595	0.5988	0.6595	0.8121
No log	5.3231	346	0.6156	0.6972	0.6156	0.7846
No log	5.3538	348	0.5945	0.6811	0.5945	0.7710
No log	5.3846	350	0.6147	0.6756	0.6147	0.7840
No log	5.4154	352	0.6139	0.6879	0.6139	0.7835
No log	5.4462	354	0.6006	0.6847	0.6006	0.7750
No log	5.4769	356	0.6153	0.7085	0.6153	0.7844
No log	5.5077	358	0.5992	0.6833	0.5992	0.7741
No log	5.5385	360	0.5584	0.6725	0.5584	0.7472
No log	5.5692	362	0.5465	0.6667	0.5465	0.7393
No log	5.6	364	0.5433	0.6667	0.5433	0.7371
No log	5.6308	366	0.5434	0.6667	0.5434	0.7372
No log	5.6615	368	0.5420	0.6619	0.5420	0.7362
No log	5.6923	370	0.5584	0.6288	0.5584	0.7473
No log	5.7231	372	0.5887	0.6764	0.5887	0.7672
No log	5.7538	374	0.5895	0.6528	0.5895	0.7678
No log	5.7846	376	0.5908	0.6555	0.5908	0.7686
No log	5.8154	378	0.6329	0.6334	0.6329	0.7956
No log	5.8462	380	0.6343	0.6482	0.6343	0.7964
No log	5.8769	382	0.6439	0.6626	0.6439	0.8025
No log	5.9077	384	0.6651	0.6484	0.6651	0.8155
No log	5.9385	386	0.6356	0.6628	0.6356	0.7972
No log	5.9692	388	0.5996	0.6781	0.5996	0.7744
No log	6.0	390	0.5996	0.7020	0.5996	0.7743
No log	6.0308	392	0.5639	0.6553	0.5639	0.7510
No log	6.0615	394	0.5479	0.6526	0.5479	0.7402
No log	6.0923	396	0.5718	0.5865	0.5718	0.7562
No log	6.1231	398	0.5790	0.6377	0.5790	0.7609
No log	6.1538	400	0.5572	0.6919	0.5572	0.7465
No log	6.1846	402	0.5595	0.7018	0.5595	0.7480
No log	6.2154	404	0.5609	0.6675	0.5609	0.7489
No log	6.2462	406	0.5756	0.7034	0.5756	0.7587
No log	6.2769	408	0.6068	0.6691	0.6068	0.7790
No log	6.3077	410	0.6171	0.6826	0.6171	0.7855
No log	6.3385	412	0.6097	0.6920	0.6097	0.7808
No log	6.3692	414	0.5868	0.7122	0.5868	0.7660
No log	6.4	416	0.5891	0.6846	0.5891	0.7675
No log	6.4308	418	0.5800	0.7168	0.5800	0.7616
No log	6.4615	420	0.5776	0.7308	0.5776	0.7600
No log	6.4923	422	0.5938	0.7028	0.5938	0.7706
No log	6.5231	424	0.6481	0.6371	0.6481	0.8051
No log	6.5538	426	0.6690	0.6292	0.6690	0.8179
No log	6.5846	428	0.6236	0.6137	0.6236	0.7897
No log	6.6154	430	0.6144	0.5847	0.6144	0.7838
No log	6.6462	432	0.6419	0.5197	0.6419	0.8012
No log	6.6769	434	0.6465	0.5197	0.6465	0.8040
No log	6.7077	436	0.6289	0.5874	0.6289	0.7931
No log	6.7385	438	0.6459	0.5869	0.6459	0.8037
No log	6.7692	440	0.6298	0.6337	0.6298	0.7936
No log	6.8	442	0.6316	0.6511	0.6316	0.7947
No log	6.8308	444	0.6038	0.6405	0.6038	0.7771
No log	6.8615	446	0.5791	0.6390	0.5791	0.7610
No log	6.8923	448	0.5923	0.5747	0.5923	0.7696
No log	6.9231	450	0.6056	0.5542	0.6056	0.7782
No log	6.9538	452	0.6165	0.5316	0.6165	0.7852
No log	6.9846	454	0.6101	0.5555	0.6101	0.7811
No log	7.0154	456	0.6041	0.5926	0.6041	0.7772
No log	7.0462	458	0.5754	0.6578	0.5754	0.7586
No log	7.0769	460	0.5503	0.6543	0.5503	0.7418
No log	7.1077	462	0.5400	0.6509	0.5400	0.7348
No log	7.1385	464	0.5599	0.6726	0.5599	0.7483
No log	7.1692	466	0.5800	0.6449	0.5800	0.7615
No log	7.2	468	0.6216	0.6357	0.6216	0.7884
No log	7.2308	470	0.5866	0.6214	0.5866	0.7659
No log	7.2615	472	0.5581	0.6409	0.5581	0.7470
No log	7.2923	474	0.5609	0.6196	0.5609	0.7490
No log	7.3231	476	0.5674	0.6648	0.5674	0.7533
No log	7.3538	478	0.5903	0.6771	0.5903	0.7683
No log	7.3846	480	0.6075	0.6735	0.6075	0.7794
No log	7.4154	482	0.5635	0.6954	0.5635	0.7507
No log	7.4462	484	0.5477	0.6846	0.5477	0.7401
No log	7.4769	486	0.5908	0.5940	0.5908	0.7686
No log	7.5077	488	0.6050	0.5645	0.6050	0.7778
No log	7.5385	490	0.5815	0.5783	0.5815	0.7625
No log	7.5692	492	0.5590	0.6507	0.5590	0.7477
No log	7.6	494	0.5672	0.6296	0.5672	0.7531
No log	7.6308	496	0.6338	0.6112	0.6338	0.7961
No log	7.6615	498	0.7095	0.6300	0.7095	0.8423
0.2727	7.6923	500	0.7101	0.6178	0.7101	0.8427
0.2727	7.7231	502	0.6558	0.6132	0.6558	0.8098
0.2727	7.7538	504	0.6067	0.6435	0.6067	0.7789
0.2727	7.7846	506	0.5858	0.7017	0.5858	0.7654
0.2727	7.8154	508	0.5739	0.6195	0.5739	0.7576
0.2727	7.8462	510	0.6115	0.6299	0.6115	0.7820
0.2727	7.8769	512	0.5980	0.6465	0.5980	0.7733
0.2727	7.9077	514	0.5638	0.6302	0.5638	0.7508
0.2727	7.9385	516	0.5543	0.6748	0.5543	0.7445
0.2727	7.9692	518	0.5817	0.6695	0.5817	0.7627
0.2727	8.0	520	0.5810	0.6380	0.5810	0.7622
0.2727	8.0308	522	0.5768	0.6380	0.5768	0.7595
0.2727	8.0615	524	0.5842	0.6564	0.5842	0.7643
0.2727	8.0923	526	0.6023	0.6695	0.6023	0.7761
0.2727	8.1231	528	0.6118	0.6965	0.6118	0.7822
0.2727	8.1538	530	0.5957	0.6900	0.5957	0.7718
0.2727	8.1846	532	0.5856	0.6728	0.5856	0.7652
0.2727	8.2154	534	0.5866	0.6841	0.5866	0.7659
0.2727	8.2462	536	0.5906	0.6841	0.5906	0.7685
0.2727	8.2769	538	0.5878	0.7019	0.5878	0.7667
0.2727	8.3077	540	0.5773	0.6537	0.5773	0.7598
0.2727	8.3385	542	0.5885	0.6461	0.5885	0.7672
0.2727	8.3692	544	0.5885	0.6292	0.5885	0.7671
0.2727	8.4	546	0.5725	0.6507	0.5725	0.7566
0.2727	8.4308	548	0.5792	0.5996	0.5792	0.7611
0.2727	8.4615	550	0.6381	0.7124	0.6381	0.7988
0.2727	8.4923	552	0.6692	0.6738	0.6692	0.8180
0.2727	8.5231	554	0.6339	0.6799	0.6339	0.7962
0.2727	8.5538	556	0.5885	0.6276	0.5885	0.7672
0.2727	8.5846	558	0.5936	0.5644	0.5936	0.7704
0.2727	8.6154	560	0.6015	0.5656	0.6015	0.7756
0.2727	8.6462	562	0.5982	0.5631	0.5982	0.7735
0.2727	8.6769	564	0.6165	0.6276	0.6165	0.7852
0.2727	8.7077	566	0.6416	0.6464	0.6416	0.8010
0.2727	8.7385	568	0.6309	0.6677	0.6309	0.7943
0.2727	8.7692	570	0.6175	0.6728	0.6175	0.7858
0.2727	8.8	572	0.6110	0.6605	0.6110	0.7816
0.2727	8.8308	574	0.5915	0.6320	0.5915	0.7691
0.2727	8.8615	576	0.5850	0.6296	0.5850	0.7648
0.2727	8.8923	578	0.5902	0.5631	0.5902	0.7682
0.2727	8.9231	580	0.5990	0.5989	0.5990	0.7740
0.2727	8.9538	582	0.6039	0.5631	0.6039	0.7771
0.2727	8.9846	584	0.6078	0.6084	0.6078	0.7796
0.2727	9.0154	586	0.6131	0.6325	0.6131	0.7830
0.2727	9.0462	588	0.6262	0.6473	0.6262	0.7913
0.2727	9.0769	590	0.6292	0.6291	0.6292	0.7932
0.2727	9.1077	592	0.6215	0.6082	0.6215	0.7884
0.2727	9.1385	594	0.6386	0.5602	0.6386	0.7991
0.2727	9.1692	596	0.6450	0.5787	0.6450	0.8031
0.2727	9.2	598	0.6436	0.6311	0.6436	0.8023
0.2727	9.2308	600	0.6420	0.5989	0.6420	0.8013
0.2727	9.2615	602	0.6510	0.4935	0.6510	0.8068
0.2727	9.2923	604	0.6436	0.5644	0.6436	0.8023
0.2727	9.3231	606	0.6350	0.6272	0.6350	0.7969
0.2727	9.3538	608	0.6292	0.6239	0.6292	0.7932
0.2727	9.3846	610	0.6140	0.6239	0.6140	0.7836
0.2727	9.4154	612	0.6068	0.6272	0.6068	0.7790
0.2727	9.4462	614	0.6142	0.6065	0.6142	0.7837
0.2727	9.4769	616	0.6570	0.6092	0.6570	0.8106
0.2727	9.5077	618	0.7137	0.5572	0.7137	0.8448
0.2727	9.5385	620	0.7880	0.5800	0.7880	0.8877
0.2727	9.5692	622	0.7956	0.6078	0.7956	0.8920

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1