ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1162
• Qwk: 0.5312
• Mse: 1.1162
• Rmse: 1.0565

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0211	2	6.9449	0.0057	6.9449	2.6353
No log	0.0421	4	4.8759	0.0444	4.8759	2.2081
No log	0.0632	6	3.2474	0.0230	3.2474	1.8021
No log	0.0842	8	2.6678	0.0784	2.6678	1.6333
No log	0.1053	10	2.4309	0.1135	2.4309	1.5591
No log	0.1263	12	1.9755	0.1429	1.9755	1.4055
No log	0.1474	14	2.0236	0.2712	2.0236	1.4225
No log	0.1684	16	2.1648	0.0800	2.1648	1.4713
No log	0.1895	18	2.5209	-0.0274	2.5209	1.5877
No log	0.2105	20	2.7427	0.0	2.7427	1.6561
No log	0.2316	22	2.8033	0.0261	2.8033	1.6743
No log	0.2526	24	2.4394	-0.0411	2.4394	1.5618
No log	0.2737	26	2.0386	0.1982	2.0386	1.4278
No log	0.2947	28	1.6990	0.1346	1.6990	1.3034
No log	0.3158	30	1.6204	0.1165	1.6204	1.2730
No log	0.3368	32	1.6694	0.1714	1.6694	1.2920
No log	0.3579	34	1.8966	0.1786	1.8966	1.3772
No log	0.3789	36	2.0468	0.1705	2.0468	1.4307
No log	0.4	38	2.2903	0.2041	2.2903	1.5134
No log	0.4211	40	2.0739	0.2609	2.0739	1.4401
No log	0.4421	42	1.7624	0.1947	1.7624	1.3275
No log	0.4632	44	1.6988	0.3000	1.6988	1.3034
No log	0.4842	46	1.6739	0.2787	1.6739	1.2938
No log	0.5053	48	1.8201	0.3077	1.8201	1.3491
No log	0.5263	50	2.0744	0.2000	2.0744	1.4403
No log	0.5474	52	2.2049	0.1259	2.2049	1.4849
No log	0.5684	54	2.3371	0.0822	2.3371	1.5288
No log	0.5895	56	2.1877	0.1418	2.1877	1.4791
No log	0.6105	58	1.8270	0.3810	1.8270	1.3517
No log	0.6316	60	1.7507	0.3934	1.7507	1.3232
No log	0.6526	62	1.6000	0.3934	1.6000	1.2649
No log	0.6737	64	1.5096	0.4065	1.5096	1.2287
No log	0.6947	66	1.3362	0.3636	1.3362	1.1560
No log	0.7158	68	1.3380	0.2957	1.3380	1.1567
No log	0.7368	70	1.5725	0.2037	1.5725	1.2540
No log	0.7579	72	1.7247	0.1651	1.7247	1.3133
No log	0.7789	74	1.4989	0.3036	1.4989	1.2243
No log	0.8	76	1.2228	0.4615	1.2228	1.1058
No log	0.8211	78	1.2696	0.5441	1.2696	1.1268
No log	0.8421	80	1.1361	0.5758	1.1361	1.0659
No log	0.8632	82	1.1180	0.5606	1.1180	1.0573
No log	0.8842	84	1.1811	0.4844	1.1811	1.0868
No log	0.9053	86	1.0789	0.5581	1.0789	1.0387
No log	0.9263	88	1.1031	0.5116	1.1031	1.0503
No log	0.9474	90	1.1040	0.5312	1.1040	1.0507
No log	0.9684	92	1.1701	0.5426	1.1701	1.0817
No log	0.9895	94	1.1116	0.5079	1.1116	1.0543
No log	1.0105	96	1.0633	0.528	1.0633	1.0312
No log	1.0316	98	1.0323	0.5238	1.0323	1.0160
No log	1.0526	100	1.0651	0.5669	1.0651	1.0320
No log	1.0737	102	1.1884	0.5161	1.1884	1.0901
No log	1.0947	104	1.6611	0.2131	1.6611	1.2888
No log	1.1158	106	1.4685	0.4068	1.4685	1.2118
No log	1.1368	108	1.2080	0.4874	1.2080	1.0991
No log	1.1579	110	1.1245	0.4754	1.1245	1.0604
No log	1.1789	112	1.1727	0.5246	1.1727	1.0829
No log	1.2	114	1.4141	0.4186	1.4141	1.1892
No log	1.2211	116	1.5034	0.4265	1.5034	1.2261
No log	1.2421	118	1.4698	0.4148	1.4698	1.2124
No log	1.2632	120	1.3373	0.4580	1.3373	1.1564
No log	1.2842	122	1.1893	0.4844	1.1893	1.0906
No log	1.3053	124	1.1049	0.5	1.1049	1.0511
No log	1.3263	126	1.1883	0.5238	1.1883	1.0901
No log	1.3474	128	1.4602	0.4545	1.4602	1.2084
No log	1.3684	130	1.3751	0.4545	1.3751	1.1727
No log	1.3895	132	1.1158	0.5538	1.1158	1.0563
No log	1.4105	134	1.1629	0.5152	1.1629	1.0784
No log	1.4316	136	1.5188	0.4122	1.5188	1.2324
No log	1.4526	138	1.5989	0.2857	1.5989	1.2645
No log	1.4737	140	1.2755	0.5397	1.2755	1.1294
No log	1.4947	142	1.0834	0.5625	1.0834	1.0409
No log	1.5158	144	1.0584	0.5625	1.0584	1.0288
No log	1.5368	146	1.2700	0.5161	1.2700	1.1269
No log	1.5579	148	1.5613	0.375	1.5613	1.2495
No log	1.5789	150	1.4976	0.4341	1.4976	1.2238
No log	1.6	152	1.2231	0.5760	1.2231	1.1059
No log	1.6211	154	0.9787	0.4959	0.9787	0.9893
No log	1.6421	156	1.0281	0.6269	1.0281	1.0140
No log	1.6632	158	0.9708	0.6212	0.9708	0.9853
No log	1.6842	160	0.8983	0.5873	0.8983	0.9478
No log	1.7053	162	1.1599	0.5625	1.1599	1.0770
No log	1.7263	164	1.1776	0.5625	1.1776	1.0852
No log	1.7474	166	0.9430	0.5984	0.9430	0.9711
No log	1.7684	168	0.9670	0.6142	0.9670	0.9833
No log	1.7895	170	1.1987	0.4839	1.1987	1.0948
No log	1.8105	172	1.2407	0.4878	1.2407	1.1138
No log	1.8316	174	1.2663	0.4463	1.2663	1.1253
No log	1.8526	176	1.3508	0.4426	1.3508	1.1623
No log	1.8737	178	1.3552	0.4677	1.3552	1.1641
No log	1.8947	180	1.1988	0.5271	1.1988	1.0949
No log	1.9158	182	1.2009	0.4925	1.2009	1.0959
No log	1.9368	184	1.4379	0.4265	1.4379	1.1991
No log	1.9579	186	1.6515	0.3824	1.6515	1.2851
No log	1.9789	188	1.2951	0.4776	1.2951	1.1380
No log	2.0	190	1.0105	0.5692	1.0105	1.0053
No log	2.0211	192	1.0431	0.5238	1.0431	1.0213
No log	2.0421	194	1.1759	0.5041	1.1759	1.0844
No log	2.0632	196	1.3133	0.4793	1.3133	1.1460
No log	2.0842	198	1.4646	0.3967	1.4646	1.2102
No log	2.1053	200	1.4808	0.4160	1.4808	1.2169
No log	2.1263	202	1.4767	0.4094	1.4767	1.2152
No log	2.1474	204	1.2687	0.4590	1.2687	1.1264
No log	2.1684	206	1.1273	0.4833	1.1273	1.0618
No log	2.1895	208	1.0926	0.4754	1.0926	1.0453
No log	2.2105	210	1.2977	0.4567	1.2977	1.1392
No log	2.2316	212	1.5530	0.4242	1.5530	1.2462
No log	2.2526	214	1.4272	0.4615	1.4272	1.1946
No log	2.2737	216	1.1272	0.4878	1.1272	1.0617
No log	2.2947	218	1.0159	0.5469	1.0159	1.0079
No log	2.3158	220	0.9891	0.5581	0.9891	0.9945
No log	2.3368	222	1.0131	0.512	1.0131	1.0065
No log	2.3579	224	1.3361	0.4724	1.3361	1.1559
No log	2.3789	226	1.6954	0.3125	1.6954	1.3021
No log	2.4	228	1.6322	0.3206	1.6322	1.2776
No log	2.4211	230	1.3717	0.4885	1.3717	1.1712
No log	2.4421	232	1.0496	0.544	1.0496	1.0245
No log	2.4632	234	0.9631	0.5528	0.9631	0.9814
No log	2.4842	236	0.9670	0.5806	0.9670	0.9833
No log	2.5053	238	1.0121	0.5246	1.0121	1.0060
No log	2.5263	240	1.1039	0.4878	1.1039	1.0506
No log	2.5474	242	1.2384	0.5197	1.2384	1.1128
No log	2.5684	244	1.2196	0.5238	1.2196	1.1044
No log	2.5895	246	1.1723	0.5238	1.1724	1.0828
No log	2.6105	248	1.1873	0.5238	1.1873	1.0897
No log	2.6316	250	1.2984	0.4615	1.2984	1.1395
No log	2.6526	252	1.3000	0.4651	1.3000	1.1402
No log	2.6737	254	1.1989	0.5354	1.1989	1.0950
No log	2.6947	256	1.0576	0.5556	1.0576	1.0284
No log	2.7158	258	1.0063	0.5161	1.0063	1.0031
No log	2.7368	260	0.9612	0.6308	0.9612	0.9804
No log	2.7579	262	1.0141	0.512	1.0141	1.0070
No log	2.7789	264	1.0847	0.5238	1.0847	1.0415
No log	2.8	266	1.2756	0.4961	1.2756	1.1294
No log	2.8211	268	1.3620	0.4496	1.3620	1.1671
No log	2.8421	270	1.3332	0.4769	1.3332	1.1546
No log	2.8632	272	1.2365	0.5077	1.2365	1.1120
No log	2.8842	274	1.1870	0.5344	1.1870	1.0895
No log	2.9053	276	1.1431	0.5385	1.1431	1.0691
No log	2.9263	278	1.1345	0.5271	1.1345	1.0651
No log	2.9474	280	1.3034	0.4923	1.3034	1.1416
No log	2.9684	282	1.3547	0.4651	1.3547	1.1639
No log	2.9895	284	1.2165	0.5	1.2165	1.1029
No log	3.0105	286	1.0016	0.6032	1.0016	1.0008
No log	3.0316	288	0.8837	0.5528	0.8837	0.9401
No log	3.0526	290	0.8502	0.608	0.8502	0.9221
No log	3.0737	292	0.8881	0.6562	0.8881	0.9424
No log	3.0947	294	1.1239	0.5271	1.1239	1.0601
No log	3.1158	296	1.3810	0.4733	1.3810	1.1752
No log	3.1368	298	1.3657	0.4733	1.3657	1.1686
No log	3.1579	300	1.1237	0.5231	1.1237	1.0601
No log	3.1789	302	0.9338	0.5736	0.9338	0.9664
No log	3.2	304	0.8485	0.6406	0.8485	0.9212
No log	3.2211	306	0.9043	0.5938	0.9043	0.9510
No log	3.2421	308	1.1263	0.5271	1.1263	1.0613
No log	3.2632	310	1.3183	0.4733	1.3183	1.1482
No log	3.2842	312	1.3147	0.4733	1.3147	1.1466
No log	3.3053	314	1.1285	0.5271	1.1285	1.0623
No log	3.3263	316	1.0400	0.4959	1.0400	1.0198
No log	3.3474	318	1.0575	0.4959	1.0575	1.0283
No log	3.3684	320	1.0940	0.4833	1.0940	1.0460
No log	3.3895	322	1.1815	0.5397	1.1815	1.0870
No log	3.4105	324	1.3325	0.4688	1.3325	1.1543
No log	3.4316	326	1.3708	0.4496	1.3708	1.1708
No log	3.4526	328	1.2609	0.4724	1.2609	1.1229
No log	3.4737	330	1.2248	0.5039	1.2248	1.1067
No log	3.4947	332	1.2135	0.5039	1.2135	1.1016
No log	3.5158	334	1.2215	0.5039	1.2215	1.1052
No log	3.5368	336	1.3253	0.4769	1.3253	1.1512
No log	3.5579	338	1.2711	0.4961	1.2711	1.1274
No log	3.5789	340	1.2333	0.5039	1.2333	1.1105
No log	3.6	342	1.2455	0.5238	1.2455	1.1160
No log	3.6211	344	1.3392	0.5	1.3392	1.1572
No log	3.6421	346	1.3145	0.5197	1.3145	1.1465
No log	3.6632	348	1.1963	0.528	1.1963	1.0937
No log	3.6842	350	1.0790	0.5484	1.0790	1.0388
No log	3.7053	352	1.0975	0.528	1.0975	1.0476
No log	3.7263	354	1.2120	0.5	1.2120	1.1009
No log	3.7474	356	1.3799	0.4375	1.3799	1.1747
No log	3.7684	358	1.3974	0.4375	1.3974	1.1821
No log	3.7895	360	1.3585	0.4409	1.3585	1.1656
No log	3.8105	362	1.1965	0.5	1.1965	1.0938
No log	3.8316	364	1.0650	0.5397	1.0650	1.0320
No log	3.8526	366	1.0873	0.5397	1.0873	1.0427
No log	3.8737	368	1.1826	0.5079	1.1826	1.0875
No log	3.8947	370	1.2647	0.4961	1.2647	1.1246
No log	3.9158	372	1.1311	0.5079	1.1311	1.0635
No log	3.9368	374	1.0312	0.5760	1.0312	1.0155
No log	3.9579	376	0.9724	0.5760	0.9724	0.9861
No log	3.9789	378	0.9547	0.5645	0.9547	0.9771
No log	4.0	380	0.9871	0.5760	0.9871	0.9935
No log	4.0211	382	1.1112	0.5312	1.1112	1.0541
No log	4.0421	384	1.1397	0.5271	1.1397	1.0676
No log	4.0632	386	1.0942	0.5354	1.0942	1.0460
No log	4.0842	388	1.0584	0.5354	1.0584	1.0288
No log	4.1053	390	0.9973	0.5354	0.9973	0.9987
No log	4.1263	392	1.0631	0.5079	1.0631	1.0311
No log	4.1474	394	1.1461	0.5	1.1461	1.0705
No log	4.1684	396	1.2955	0.4769	1.2955	1.1382
No log	4.1895	398	1.3361	0.4769	1.3361	1.1559
No log	4.2105	400	1.2775	0.4769	1.2775	1.1303
No log	4.2316	402	1.1898	0.5039	1.1898	1.0908
No log	4.2526	404	1.1277	0.5079	1.1277	1.0619
No log	4.2737	406	1.1278	0.5079	1.1278	1.0620
No log	4.2947	408	1.0898	0.5079	1.0898	1.0439
No log	4.3158	410	1.0365	0.5079	1.0365	1.0181
No log	4.3368	412	1.0317	0.496	1.0317	1.0157
No log	4.3579	414	1.0913	0.5039	1.0913	1.0447
No log	4.3789	416	1.1967	0.5	1.1967	1.0940
No log	4.4	418	1.3004	0.4697	1.3004	1.1404
No log	4.4211	420	1.2072	0.4923	1.2072	1.0987
No log	4.4421	422	1.0124	0.5312	1.0124	1.0062
No log	4.4632	424	0.9729	0.5891	0.9729	0.9864
No log	4.4842	426	1.0949	0.5312	1.0949	1.0464
No log	4.5053	428	1.3161	0.4961	1.3161	1.1472
No log	4.5263	430	1.4731	0.4328	1.4731	1.2137
No log	4.5474	432	1.4122	0.4769	1.4122	1.1884
No log	4.5684	434	1.3243	0.5039	1.3243	1.1508
No log	4.5895	436	1.1414	0.496	1.1414	1.0683
No log	4.6105	438	1.0739	0.5041	1.0739	1.0363
No log	4.6316	440	1.0517	0.496	1.0517	1.0255
No log	4.6526	442	1.1375	0.5039	1.1375	1.0665
No log	4.6737	444	1.1626	0.5039	1.1626	1.0782
No log	4.6947	446	1.0723	0.5197	1.0723	1.0355
No log	4.7158	448	1.0262	0.5238	1.0262	1.0130
No log	4.7368	450	1.0643	0.5645	1.0643	1.0317
No log	4.7579	452	1.1431	0.5161	1.1431	1.0692
No log	4.7789	454	1.2657	0.5	1.2657	1.1250
No log	4.8	456	1.3246	0.4724	1.3246	1.1509
No log	4.8211	458	1.2584	0.5197	1.2584	1.1218
No log	4.8421	460	1.1256	0.5528	1.1256	1.0609
No log	4.8632	462	1.0508	0.5528	1.0508	1.0251
No log	4.8842	464	1.0949	0.544	1.0949	1.0464
No log	4.9053	466	1.2911	0.5191	1.2911	1.1362
No log	4.9263	468	1.4334	0.4275	1.4334	1.1972
No log	4.9474	470	1.3905	0.4651	1.3905	1.1792
No log	4.9684	472	1.2563	0.544	1.2563	1.1209
No log	4.9895	474	1.1836	0.5645	1.1836	1.0879
No log	5.0105	476	1.0836	0.4310	1.0836	1.0410
No log	5.0316	478	1.0687	0.4	1.0687	1.0338
No log	5.0526	480	1.0810	0.5042	1.0810	1.0397
No log	5.0737	482	1.1142	0.5	1.1142	1.0556
No log	5.0947	484	1.1602	0.5161	1.1602	1.0771
No log	5.1158	486	1.1878	0.5079	1.1878	1.0899
No log	5.1368	488	1.3196	0.4496	1.3196	1.1487
No log	5.1579	490	1.4243	0.4275	1.4243	1.1934
No log	5.1789	492	1.3995	0.4462	1.3995	1.1830
No log	5.2	494	1.3153	0.5191	1.3153	1.1469
No log	5.2211	496	1.2142	0.5312	1.2142	1.1019
No log	5.2421	498	1.1536	0.5197	1.1536	1.0740
0.4177	5.2632	500	1.1649	0.5312	1.1649	1.0793
0.4177	5.2842	502	1.2438	0.5271	1.2438	1.1152
0.4177	5.3053	504	1.2495	0.5231	1.2495	1.1178
0.4177	5.3263	506	1.1724	0.5312	1.1724	1.0828
0.4177	5.3474	508	1.1030	0.5312	1.1030	1.0502
0.4177	5.3684	510	1.1162	0.5312	1.1162	1.0565

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1