ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k4_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1437
• Qwk: 0.5781
• Mse: 1.1437
• Rmse: 1.0695

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	7.0147	0.0	7.0147	2.6485
No log	0.2222	4	4.5426	0.0723	4.5426	2.1313
No log	0.3333	6	3.5124	0.0111	3.5124	1.8741
No log	0.4444	8	3.5038	-0.0109	3.5038	1.8718
No log	0.5556	10	3.1050	0.0503	3.1050	1.7621
No log	0.6667	12	2.0658	0.1429	2.0658	1.4373
No log	0.7778	14	2.1219	0.1562	2.1219	1.4567
No log	0.8889	16	2.2636	0.1714	2.2636	1.5045
No log	1.0	18	1.8889	0.3030	1.8889	1.3744
No log	1.1111	20	2.0708	0.1955	2.0708	1.4390
No log	1.2222	22	2.4341	0.0411	2.4341	1.5601
No log	1.3333	24	2.8292	0.0	2.8292	1.6820
No log	1.4444	26	2.8440	0.0	2.8440	1.6864
No log	1.5556	28	2.5422	0.0134	2.5422	1.5944
No log	1.6667	30	2.1027	0.2044	2.1027	1.4501
No log	1.7778	32	1.7810	0.2632	1.7810	1.3346
No log	1.8889	34	1.5940	0.2545	1.5940	1.2625
No log	2.0	36	1.4821	0.2264	1.4821	1.2174
No log	2.1111	38	1.3557	0.2617	1.3557	1.1644
No log	2.2222	40	1.4420	0.3559	1.4420	1.2008
No log	2.3333	42	2.0300	0.1857	2.0300	1.4248
No log	2.4444	44	2.2971	0.1111	2.2971	1.5156
No log	2.5556	46	2.0832	0.1135	2.0832	1.4433
No log	2.6667	48	1.8248	0.3443	1.8248	1.3508
No log	2.7778	50	1.6516	0.3419	1.6516	1.2852
No log	2.8889	52	1.5577	0.3667	1.5577	1.2481
No log	3.0	54	1.5187	0.3667	1.5187	1.2324
No log	3.1111	56	1.5036	0.3276	1.5036	1.2262
No log	3.2222	58	1.4656	0.2883	1.4656	1.2106
No log	3.3333	60	1.4202	0.3009	1.4202	1.1917
No log	3.4444	62	1.3426	0.2727	1.3426	1.1587
No log	3.5556	64	1.2515	0.2727	1.2515	1.1187
No log	3.6667	66	1.2097	0.4174	1.2097	1.0999
No log	3.7778	68	1.0582	0.5484	1.0582	1.0287
No log	3.8889	70	1.0482	0.5401	1.0482	1.0238
No log	4.0	72	1.0583	0.4962	1.0583	1.0287
No log	4.1111	74	1.0277	0.5781	1.0277	1.0138
No log	4.2222	76	1.0892	0.5231	1.0892	1.0436
No log	4.3333	78	1.1130	0.5426	1.1130	1.0550
No log	4.4444	80	1.0573	0.5778	1.0573	1.0283
No log	4.5556	82	1.0874	0.5672	1.0874	1.0428
No log	4.6667	84	1.2269	0.4961	1.2269	1.1077
No log	4.7778	86	1.3473	0.4885	1.3473	1.1607
No log	4.8889	88	1.1255	0.5588	1.1255	1.0609
No log	5.0	90	1.0595	0.5882	1.0595	1.0293
No log	5.1111	92	1.1802	0.5588	1.1802	1.0864
No log	5.2222	94	1.5855	0.3692	1.5855	1.2592
No log	5.3333	96	1.5980	0.3307	1.5980	1.2641
No log	5.4444	98	1.1889	0.4531	1.1889	1.0904
No log	5.5556	100	1.0008	0.6418	1.0008	1.0004
No log	5.6667	102	1.0187	0.6316	1.0187	1.0093
No log	5.7778	104	1.1339	0.5238	1.1339	1.0648
No log	5.8889	106	1.3655	0.4480	1.3655	1.1685
No log	6.0	108	1.3132	0.4409	1.3132	1.1460
No log	6.1111	110	1.0893	0.5231	1.0893	1.0437
No log	6.2222	112	0.8846	0.6950	0.8846	0.9405
No log	6.3333	114	0.8236	0.7248	0.8236	0.9075
No log	6.4444	116	0.8390	0.7162	0.8390	0.9159
No log	6.5556	118	1.0523	0.5942	1.0523	1.0258
No log	6.6667	120	1.0572	0.6087	1.0572	1.0282
No log	6.7778	122	0.9229	0.6232	0.9229	0.9607
No log	6.8889	124	0.9735	0.5985	0.9735	0.9867
No log	7.0	126	1.1242	0.5882	1.1242	1.0603
No log	7.1111	128	1.0553	0.5882	1.0553	1.0273
No log	7.2222	130	1.0728	0.5882	1.0728	1.0358
No log	7.3333	132	0.9947	0.6222	0.9947	0.9973
No log	7.4444	134	1.0292	0.5985	1.0292	1.0145
No log	7.5556	136	1.0743	0.5797	1.0743	1.0365
No log	7.6667	138	1.1805	0.5714	1.1805	1.0865
No log	7.7778	140	1.3217	0.5180	1.3217	1.1497
No log	7.8889	142	1.5177	0.4397	1.5177	1.2319
No log	8.0	144	1.4805	0.4672	1.4805	1.2168
No log	8.1111	146	1.3042	0.5401	1.3042	1.1420
No log	8.2222	148	1.0696	0.6061	1.0696	1.0342
No log	8.3333	150	0.9791	0.6462	0.9791	0.9895
No log	8.4444	152	1.0487	0.6190	1.0487	1.0241
No log	8.5556	154	1.1775	0.5	1.1775	1.0851
No log	8.6667	156	1.3897	0.3937	1.3897	1.1788
No log	8.7778	158	1.4173	0.3780	1.4173	1.1905
No log	8.8889	160	1.3238	0.4580	1.3238	1.1506
No log	9.0	162	1.4298	0.4122	1.4298	1.1957
No log	9.1111	164	1.5792	0.3358	1.5792	1.2567
No log	9.2222	166	1.7627	0.3358	1.7627	1.3277
No log	9.3333	168	1.5818	0.3972	1.5818	1.2577
No log	9.4444	170	1.4230	0.4783	1.4230	1.1929
No log	9.5556	172	1.2997	0.4889	1.2997	1.1400
No log	9.6667	174	1.1461	0.5373	1.1461	1.0705
No log	9.7778	176	1.1345	0.5736	1.1345	1.0651
No log	9.8889	178	1.2769	0.5312	1.2769	1.1300
No log	10.0	180	1.3862	0.4355	1.3862	1.1774
No log	10.1111	182	1.4341	0.384	1.4341	1.1975
No log	10.2222	184	1.2902	0.5116	1.2902	1.1359
No log	10.3333	186	1.0802	0.6308	1.0802	1.0393
No log	10.4444	188	0.9981	0.6667	0.9981	0.9990
No log	10.5556	190	1.0675	0.6119	1.0675	1.0332
No log	10.6667	192	1.3553	0.4928	1.3553	1.1642
No log	10.7778	194	1.5425	0.4493	1.5425	1.2420
No log	10.8889	196	1.3516	0.5109	1.3516	1.1626
No log	11.0	198	1.0885	0.5373	1.0885	1.0433
No log	11.1111	200	1.0937	0.5373	1.0937	1.0458
No log	11.2222	202	1.3268	0.5109	1.3268	1.1519
No log	11.3333	204	1.3618	0.4925	1.3618	1.1669
No log	11.4444	206	1.3230	0.5414	1.3230	1.1502
No log	11.5556	208	1.1577	0.5802	1.1577	1.0760
No log	11.6667	210	1.0618	0.5082	1.0618	1.0304
No log	11.7778	212	1.0892	0.5082	1.0892	1.0437
No log	11.8889	214	1.1077	0.6047	1.1077	1.0525
No log	12.0	216	1.2659	0.5373	1.2659	1.1251
No log	12.1111	218	1.3072	0.5373	1.3072	1.1433
No log	12.2222	220	1.1069	0.5606	1.1069	1.0521
No log	12.3333	222	0.9657	0.6515	0.9657	0.9827
No log	12.4444	224	0.9802	0.6222	0.9802	0.9901
No log	12.5556	226	0.9671	0.6716	0.9671	0.9834
No log	12.6667	228	1.0680	0.5714	1.0680	1.0334
No log	12.7778	230	1.3285	0.4776	1.3285	1.1526
No log	12.8889	232	1.5189	0.4091	1.5189	1.2325
No log	13.0	234	1.4677	0.4186	1.4677	1.2115
No log	13.1111	236	1.2543	0.5354	1.2543	1.1200
No log	13.2222	238	1.1726	0.5669	1.1726	1.0829
No log	13.3333	240	1.2035	0.5	1.2035	1.0970
No log	13.4444	242	1.2278	0.4715	1.2278	1.1081
No log	13.5556	244	1.2865	0.512	1.2865	1.1342
No log	13.6667	246	1.1787	0.5354	1.1787	1.0857
No log	13.7778	248	1.0913	0.5846	1.0913	1.0446
No log	13.8889	250	1.1092	0.5481	1.1092	1.0532
No log	14.0	252	1.2372	0.5373	1.2372	1.1123
No log	14.1111	254	1.3535	0.4928	1.3535	1.1634
No log	14.2222	256	1.2705	0.5037	1.2705	1.1272
No log	14.3333	258	1.0604	0.5909	1.0604	1.0297
No log	14.4444	260	1.0092	0.6047	1.0092	1.0046
No log	14.5556	262	1.0478	0.6107	1.0478	1.0236
No log	14.6667	264	1.1458	0.5455	1.1458	1.0704
No log	14.7778	266	1.2350	0.5113	1.2350	1.1113
No log	14.8889	268	1.2237	0.5147	1.2237	1.1062
No log	15.0	270	1.3072	0.4783	1.3072	1.1433
No log	15.1111	272	1.5169	0.4113	1.5169	1.2316
No log	15.2222	274	1.5157	0.4173	1.5157	1.2311
No log	15.3333	276	1.3856	0.4317	1.3856	1.1771
No log	15.4444	278	1.4268	0.4173	1.4268	1.1945
No log	15.5556	280	1.6400	0.3478	1.6400	1.2806
No log	15.6667	282	1.6372	0.3158	1.6372	1.2795
No log	15.7778	284	1.5656	0.4154	1.5656	1.2512
No log	15.8889	286	1.4059	0.4724	1.4059	1.1857
No log	16.0	288	1.2605	0.5323	1.2605	1.1227
No log	16.1111	290	1.2433	0.5323	1.2433	1.1150
No log	16.2222	292	1.3298	0.5469	1.3298	1.1532
No log	16.3333	294	1.4369	0.4308	1.4369	1.1987
No log	16.4444	296	1.5899	0.3852	1.5899	1.2609
No log	16.5556	298	1.5403	0.4317	1.5403	1.2411
No log	16.6667	300	1.2663	0.4812	1.2663	1.1253
No log	16.7778	302	1.0936	0.6202	1.0936	1.0458
No log	16.8889	304	1.0967	0.6094	1.0967	1.0472
No log	17.0	306	1.1960	0.5469	1.1960	1.0936
No log	17.1111	308	1.3697	0.5	1.3697	1.1704
No log	17.2222	310	1.5733	0.3459	1.5733	1.2543
No log	17.3333	312	1.6013	0.3359	1.6013	1.2654
No log	17.4444	314	1.4207	0.4252	1.4207	1.1919
No log	17.5556	316	1.2070	0.5197	1.2070	1.0986
No log	17.6667	318	1.0722	0.5984	1.0722	1.0355
No log	17.7778	320	1.0155	0.6047	1.0155	1.0077
No log	17.8889	322	1.0425	0.6107	1.0425	1.0210
No log	18.0	324	1.1892	0.5113	1.1892	1.0905
No log	18.1111	326	1.3759	0.5147	1.3759	1.1730
No log	18.2222	328	1.4439	0.4148	1.4439	1.2016
No log	18.3333	330	1.3112	0.4733	1.3112	1.1451
No log	18.4444	332	1.1403	0.5469	1.1403	1.0679
No log	18.5556	334	1.1414	0.5556	1.1414	1.0684
No log	18.6667	336	1.2711	0.5197	1.2711	1.1274
No log	18.7778	338	1.4587	0.4375	1.4587	1.2078
No log	18.8889	340	1.4318	0.4094	1.4318	1.1966
No log	19.0	342	1.2625	0.512	1.2625	1.1236
No log	19.1111	344	1.1232	0.5484	1.1232	1.0598
No log	19.2222	346	1.0958	0.5082	1.0958	1.0468
No log	19.3333	348	1.1252	0.56	1.1252	1.0608
No log	19.4444	350	1.2117	0.5469	1.2117	1.1008
No log	19.5556	352	1.2739	0.4844	1.2739	1.1287
No log	19.6667	354	1.2360	0.4923	1.2360	1.1118
No log	19.7778	356	1.3057	0.4923	1.3057	1.1427
No log	19.8889	358	1.3751	0.4394	1.3751	1.1727
No log	20.0	360	1.3647	0.4308	1.3647	1.1682
No log	20.1111	362	1.3076	0.5197	1.3076	1.1435
No log	20.2222	364	1.2170	0.5484	1.2170	1.1032
No log	20.3333	366	1.2279	0.5167	1.2279	1.1081
No log	20.4444	368	1.2533	0.5528	1.2533	1.1195
No log	20.5556	370	1.3271	0.5238	1.3271	1.1520
No log	20.6667	372	1.4889	0.4179	1.4889	1.2202
No log	20.7778	374	1.5457	0.4380	1.5457	1.2433
No log	20.8889	376	1.4354	0.4444	1.4354	1.1981
No log	21.0	378	1.2806	0.5	1.2806	1.1317
No log	21.1111	380	1.1138	0.5496	1.1138	1.0554
No log	21.2222	382	1.0767	0.5984	1.0767	1.0376
No log	21.3333	384	1.1593	0.5556	1.1593	1.0767
No log	21.4444	386	1.3100	0.5037	1.3100	1.1445
No log	21.5556	388	1.3230	0.5	1.3230	1.1502
No log	21.6667	390	1.2251	0.5191	1.2251	1.1068
No log	21.7778	392	1.2367	0.5191	1.2367	1.1121
No log	21.8889	394	1.2861	0.5191	1.2861	1.1341
No log	22.0	396	1.2184	0.5385	1.2184	1.1038
No log	22.1111	398	1.1299	0.5469	1.1299	1.0630
No log	22.2222	400	1.1028	0.5625	1.1028	1.0502
No log	22.3333	402	1.1196	0.5385	1.1196	1.0581
No log	22.4444	404	1.2633	0.5191	1.2633	1.1240
No log	22.5556	406	1.4268	0.4627	1.4268	1.1945
No log	22.6667	408	1.3661	0.4662	1.3661	1.1688
No log	22.7778	410	1.2591	0.5191	1.2591	1.1221
No log	22.8889	412	1.0547	0.5909	1.0547	1.0270
No log	23.0	414	0.9088	0.6094	0.9088	0.9533
No log	23.1111	416	0.8946	0.5760	0.8946	0.9458
No log	23.2222	418	0.8981	0.6299	0.8981	0.9477
No log	23.3333	420	0.9883	0.5909	0.9883	0.9941
No log	23.4444	422	1.2213	0.5191	1.2213	1.1051
No log	23.5556	424	1.3897	0.4627	1.3897	1.1789
No log	23.6667	426	1.3480	0.4812	1.3480	1.1610
No log	23.7778	428	1.1635	0.5469	1.1635	1.0787
No log	23.8889	430	1.0517	0.5806	1.0517	1.0255
No log	24.0	432	1.0547	0.5806	1.0547	1.0270
No log	24.1111	434	1.1040	0.5528	1.1040	1.0507
No log	24.2222	436	1.2110	0.5469	1.2110	1.1004
No log	24.3333	438	1.2586	0.5469	1.2586	1.1219
No log	24.4444	440	1.2427	0.5469	1.2427	1.1148
No log	24.5556	442	1.2275	0.5238	1.2275	1.1079
No log	24.6667	444	1.2316	0.5238	1.2316	1.1098
No log	24.7778	446	1.2292	0.5354	1.2292	1.1087
No log	24.8889	448	1.2520	0.5469	1.2520	1.1189
No log	25.0	450	1.2636	0.5469	1.2636	1.1241
No log	25.1111	452	1.2438	0.5397	1.2438	1.1152
No log	25.2222	454	1.2030	0.5806	1.2030	1.0968
No log	25.3333	456	1.1910	0.5806	1.1910	1.0914
No log	25.4444	458	1.1731	0.5574	1.1731	1.0831
No log	25.5556	460	1.1549	0.5645	1.1549	1.0746
No log	25.6667	462	1.1585	0.5873	1.1585	1.0763
No log	25.7778	464	1.1987	0.5469	1.1987	1.0948
No log	25.8889	466	1.1823	0.5873	1.1823	1.0873
No log	26.0	468	1.1618	0.5873	1.1618	1.0779
No log	26.1111	470	1.1145	0.5920	1.1145	1.0557
No log	26.2222	472	1.0824	0.5873	1.0824	1.0404
No log	26.3333	474	1.0849	0.6047	1.0849	1.0416
No log	26.4444	476	1.1183	0.5669	1.1183	1.0575
No log	26.5556	478	1.1575	0.5669	1.1575	1.0759
No log	26.6667	480	1.1652	0.5669	1.1652	1.0795
No log	26.7778	482	1.1724	0.5873	1.1724	1.0828
No log	26.8889	484	1.1873	0.5645	1.1873	1.0896
No log	27.0	486	1.2117	0.5397	1.2117	1.1008
No log	27.1111	488	1.1782	0.5781	1.1782	1.0855
No log	27.2222	490	1.0971	0.5669	1.0971	1.0474
No log	27.3333	492	1.0937	0.5669	1.0937	1.0458
No log	27.4444	494	1.1794	0.5538	1.1794	1.0860
No log	27.5556	496	1.2241	0.5802	1.2241	1.1064
No log	27.6667	498	1.1600	0.5736	1.1600	1.0770
0.3788	27.7778	500	1.0858	0.5873	1.0858	1.0420
0.3788	27.8889	502	1.0947	0.5873	1.0947	1.0463
0.3788	28.0	504	1.1756	0.6	1.1756	1.0843
0.3788	28.1111	506	1.2324	0.5538	1.2324	1.1101
0.3788	28.2222	508	1.1922	0.6	1.1922	1.0919
0.3788	28.3333	510	1.1062	0.5873	1.1062	1.0517
0.3788	28.4444	512	1.0646	0.5873	1.0646	1.0318
0.3788	28.5556	514	1.0435	0.5738	1.0435	1.0215
0.3788	28.6667	516	1.0599	0.5620	1.0599	1.0295
0.3788	28.7778	518	1.1437	0.5781	1.1437	1.0695

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1