ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4486
• Qwk: 0.4545
• Mse: 1.4486
• Rmse: 1.2036

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	7.2452	-0.0164	7.2452	2.6917
No log	0.0755	4	4.4478	0.0779	4.4478	2.1090
No log	0.1132	6	3.2774	0.0345	3.2774	1.8104
No log	0.1509	8	2.4948	0.0784	2.4948	1.5795
No log	0.1887	10	2.2891	0.0305	2.2891	1.5130
No log	0.2264	12	1.9058	0.0702	1.9058	1.3805
No log	0.2642	14	1.9093	0.1121	1.9093	1.3818
No log	0.3019	16	1.7630	0.2056	1.7630	1.3278
No log	0.3396	18	1.6494	0.2037	1.6494	1.2843
No log	0.3774	20	1.7013	0.3077	1.7013	1.3043
No log	0.4151	22	1.8868	0.3281	1.8868	1.3736
No log	0.4528	24	1.8547	0.3193	1.8547	1.3619
No log	0.4906	26	1.9024	0.125	1.9024	1.3793
No log	0.5283	28	1.8153	0.1509	1.8153	1.3473
No log	0.5660	30	1.6430	0.1714	1.6430	1.2818
No log	0.6038	32	1.5387	0.1852	1.5387	1.2405
No log	0.6415	34	1.5532	0.2435	1.5532	1.2463
No log	0.6792	36	1.4851	0.3167	1.4851	1.2187
No log	0.7170	38	1.3888	0.4127	1.3888	1.1785
No log	0.7547	40	1.2854	0.5161	1.2854	1.1337
No log	0.7925	42	1.4759	0.3833	1.4759	1.2149
No log	0.8302	44	1.3330	0.4553	1.3330	1.1545
No log	0.8679	46	1.0658	0.6324	1.0658	1.0324
No log	0.9057	48	1.1050	0.5241	1.1050	1.0512
No log	0.9434	50	1.0846	0.5616	1.0846	1.0414
No log	0.9811	52	0.9964	0.6131	0.9964	0.9982
No log	1.0189	54	1.1662	0.5606	1.1662	1.0799
No log	1.0566	56	1.3963	0.4848	1.3963	1.1817
No log	1.0943	58	1.2882	0.5385	1.2882	1.1350
No log	1.1321	60	1.0537	0.6269	1.0537	1.0265
No log	1.1698	62	1.1237	0.6222	1.1237	1.0601
No log	1.2075	64	1.1594	0.5414	1.1594	1.0768
No log	1.2453	66	1.0715	0.5649	1.0715	1.0351
No log	1.2830	68	1.1776	0.5736	1.1776	1.0852
No log	1.3208	70	1.4010	0.3193	1.4010	1.1836
No log	1.3585	72	1.4710	0.2906	1.4710	1.2129
No log	1.3962	74	1.2226	0.512	1.2226	1.1057
No log	1.4340	76	1.0009	0.6099	1.0009	1.0004
No log	1.4717	78	1.0936	0.5734	1.0936	1.0457
No log	1.5094	80	1.1651	0.5147	1.1651	1.0794
No log	1.5472	82	0.9908	0.6029	0.9908	0.9954
No log	1.5849	84	0.9870	0.6232	0.9870	0.9935
No log	1.6226	86	1.2891	0.5693	1.2891	1.1354
No log	1.6604	88	1.3546	0.5693	1.3546	1.1639
No log	1.6981	90	1.2743	0.5441	1.2743	1.1288
No log	1.7358	92	1.0930	0.6197	1.0930	1.0455
No log	1.7736	94	0.9797	0.6806	0.9797	0.9898
No log	1.8113	96	1.0255	0.6713	1.0255	1.0127
No log	1.8491	98	1.3278	0.5224	1.3278	1.1523
No log	1.8868	100	1.9734	0.0794	1.9734	1.4048
No log	1.9245	102	2.3256	-0.0331	2.3256	1.5250
No log	1.9623	104	2.2011	0.0	2.2011	1.4836
No log	2.0	106	1.5876	0.2975	1.5876	1.2600
No log	2.0377	108	1.1726	0.5865	1.1726	1.0829
No log	2.0755	110	0.9985	0.6331	0.9985	0.9993
No log	2.1132	112	0.9320	0.6713	0.9320	0.9654
No log	2.1509	114	0.9343	0.6667	0.9343	0.9666
No log	2.1887	116	1.1347	0.5857	1.1347	1.0652
No log	2.2264	118	1.4268	0.4748	1.4268	1.1945
No log	2.2642	120	1.4223	0.4672	1.4223	1.1926
No log	2.3019	122	1.1419	0.5672	1.1419	1.0686
No log	2.3396	124	0.9903	0.592	0.9903	0.9951
No log	2.3774	126	0.9799	0.592	0.9799	0.9899
No log	2.4151	128	1.0636	0.6094	1.0636	1.0313
No log	2.4528	130	1.3206	0.5970	1.3206	1.1492
No log	2.4906	132	1.6371	0.2969	1.6371	1.2795
No log	2.5283	134	1.7209	0.2439	1.7209	1.3118
No log	2.5660	136	1.7204	0.1951	1.7204	1.3116
No log	2.6038	138	1.7121	0.2698	1.7121	1.3085
No log	2.6415	140	1.6037	0.3939	1.6037	1.2664
No log	2.6792	142	1.5537	0.4148	1.5537	1.2465
No log	2.7170	144	1.3877	0.4148	1.3877	1.1780
No log	2.7547	146	1.2654	0.5038	1.2654	1.1249
No log	2.7925	148	1.0871	0.5581	1.0871	1.0427
No log	2.8302	150	1.0236	0.6165	1.0236	1.0117
No log	2.8679	152	1.0617	0.5672	1.0617	1.0304
No log	2.9057	154	1.1752	0.5324	1.1752	1.0841
No log	2.9434	156	1.1769	0.5493	1.1769	1.0849
No log	2.9811	158	1.0959	0.5674	1.0959	1.0469
No log	3.0189	160	0.9665	0.6525	0.9665	0.9831
No log	3.0566	162	0.9299	0.6423	0.9299	0.9643
No log	3.0943	164	0.9659	0.6277	0.9659	0.9828
No log	3.1321	166	1.1007	0.5942	1.1007	1.0491
No log	3.1698	168	1.1415	0.5735	1.1415	1.0684
No log	3.2075	170	1.1438	0.5821	1.1438	1.0695
No log	3.2453	172	1.1113	0.6074	1.1113	1.0542
No log	3.2830	174	1.0130	0.5954	1.0130	1.0065
No log	3.3208	176	0.9453	0.6212	0.9453	0.9723
No log	3.3585	178	0.9172	0.6119	0.9172	0.9577
No log	3.3962	180	1.0396	0.6029	1.0396	1.0196
No log	3.4340	182	1.1508	0.5797	1.1508	1.0727
No log	3.4717	184	1.0523	0.6143	1.0523	1.0258
No log	3.5094	186	0.9769	0.6286	0.9769	0.9884
No log	3.5472	188	0.9885	0.6131	0.9885	0.9942
No log	3.5849	190	0.9828	0.6107	0.9828	0.9914
No log	3.6226	192	1.0489	0.5827	1.0489	1.0241
No log	3.6604	194	1.1099	0.5625	1.1099	1.0535
No log	3.6981	196	1.1639	0.5303	1.1639	1.0789
No log	3.7358	198	1.2182	0.5224	1.2182	1.1037
No log	3.7736	200	1.4688	0.4317	1.4688	1.2120
No log	3.8113	202	1.7232	0.3916	1.7232	1.3127
No log	3.8491	204	1.7512	0.4110	1.7512	1.3233
No log	3.8868	206	1.9926	0.3822	1.9926	1.4116
No log	3.9245	208	2.2392	0.3171	2.2392	1.4964
No log	3.9623	210	2.3476	0.2345	2.3476	1.5322
No log	4.0	212	2.2554	0.2083	2.2554	1.5018
No log	4.0377	214	1.7901	0.3636	1.7901	1.3379
No log	4.0755	216	1.3684	0.4604	1.3684	1.1698
No log	4.1132	218	1.1376	0.5390	1.1376	1.0666
No log	4.1509	220	1.1123	0.5390	1.1123	1.0547
No log	4.1887	222	1.2253	0.5278	1.2253	1.1070
No log	4.2264	224	1.4282	0.4493	1.4282	1.1951
No log	4.2642	226	1.7016	0.3830	1.7016	1.3044
No log	4.3019	228	1.8256	0.3286	1.8256	1.3512
No log	4.3396	230	1.6258	0.3623	1.6258	1.2751
No log	4.3774	232	1.2862	0.4889	1.2862	1.1341
No log	4.4151	234	1.0755	0.5203	1.0755	1.0370
No log	4.4528	236	1.0236	0.544	1.0236	1.0117
No log	4.4906	238	1.0088	0.5736	1.0088	1.0044
No log	4.5283	240	1.1437	0.5	1.1437	1.0694
No log	4.5660	242	1.3863	0.4526	1.3863	1.1774
No log	4.6038	244	1.4175	0.4265	1.4175	1.1906
No log	4.6415	246	1.2848	0.4853	1.2848	1.1335
No log	4.6792	248	1.0906	0.5781	1.0906	1.0443
No log	4.7170	250	1.0443	0.5846	1.0443	1.0219
No log	4.7547	252	1.1268	0.5714	1.1268	1.0615
No log	4.7925	254	1.3038	0.5113	1.3038	1.1418
No log	4.8302	256	1.3917	0.4526	1.3917	1.1797
No log	4.8679	258	1.3393	0.4593	1.3393	1.1573
No log	4.9057	260	1.3102	0.5113	1.3102	1.1446
No log	4.9434	262	1.2577	0.512	1.2577	1.1215
No log	4.9811	264	1.2314	0.4	1.2314	1.1097
No log	5.0189	266	1.2106	0.2778	1.2106	1.1003
No log	5.0566	268	1.1759	0.3455	1.1759	1.0844
No log	5.0943	270	1.1799	0.4628	1.1799	1.0862
No log	5.1321	272	1.3536	0.4478	1.3536	1.1634
No log	5.1698	274	1.6151	0.3885	1.6151	1.2709
No log	5.2075	276	1.6375	0.3885	1.6375	1.2797
No log	5.2453	278	1.4696	0.4088	1.4696	1.2123
No log	5.2830	280	1.2138	0.4962	1.2138	1.1017
No log	5.3208	282	1.0606	0.6462	1.0606	1.0298
No log	5.3585	284	1.0615	0.6406	1.0615	1.0303
No log	5.3962	286	1.1265	0.5669	1.1265	1.0613
No log	5.4340	288	1.2537	0.5038	1.2537	1.1197
No log	5.4717	290	1.3497	0.4662	1.3497	1.1617
No log	5.5094	292	1.2898	0.4962	1.2898	1.1357
No log	5.5472	294	1.1283	0.5344	1.1283	1.0622
No log	5.5849	296	1.0730	0.5426	1.0730	1.0359
No log	5.6226	298	1.1741	0.5303	1.1741	1.0836
No log	5.6604	300	1.3875	0.4741	1.3875	1.1779
No log	5.6981	302	1.5152	0.4265	1.5152	1.2309
No log	5.7358	304	1.4650	0.4265	1.4650	1.2104
No log	5.7736	306	1.2909	0.4776	1.2909	1.1362
No log	5.8113	308	1.1077	0.5271	1.1077	1.0525
No log	5.8491	310	1.0126	0.5714	1.0126	1.0063
No log	5.8868	312	0.9995	0.5920	0.9995	0.9998
No log	5.9245	314	1.0197	0.5645	1.0197	1.0098
No log	5.9623	316	1.1122	0.5385	1.1122	1.0546
No log	6.0	318	1.1478	0.5344	1.1478	1.0714
No log	6.0377	320	1.2148	0.5303	1.2148	1.1022
No log	6.0755	322	1.1683	0.5344	1.1683	1.0809
No log	6.1132	324	1.0393	0.5344	1.0393	1.0194
No log	6.1509	326	0.9952	0.5758	0.9952	0.9976
No log	6.1887	328	1.0220	0.5736	1.0220	1.0109
No log	6.2264	330	1.1545	0.5303	1.1545	1.0745
No log	6.2642	332	1.2976	0.4662	1.2976	1.1391
No log	6.3019	334	1.2652	0.4925	1.2652	1.1248
No log	6.3396	336	1.1380	0.5827	1.1380	1.0668
No log	6.3774	338	1.0911	0.56	1.0911	1.0446
No log	6.4151	340	1.1160	0.5714	1.1160	1.0564
No log	6.4528	342	1.0795	0.5397	1.0795	1.0390
No log	6.4906	344	1.0114	0.56	1.0114	1.0057
No log	6.5283	346	1.0485	0.5271	1.0485	1.0239
No log	6.5660	348	1.2283	0.5109	1.2283	1.1083
No log	6.6038	350	1.5633	0.4234	1.5633	1.2503
No log	6.6415	352	1.7722	0.3309	1.7722	1.3312
No log	6.6792	354	1.6637	0.4148	1.6637	1.2898
No log	6.7170	356	1.3280	0.4741	1.3280	1.1524
No log	6.7547	358	1.1512	0.4962	1.1512	1.0730
No log	6.7925	360	1.0859	0.5354	1.0859	1.0421
No log	6.8302	362	1.0634	0.5556	1.0634	1.0312
No log	6.8679	364	1.0905	0.5556	1.0905	1.0442
No log	6.9057	366	1.1058	0.5271	1.1058	1.0516
No log	6.9434	368	1.0856	0.5385	1.0856	1.0419
No log	6.9811	370	1.0427	0.5538	1.0427	1.0211
No log	7.0189	372	0.9402	0.5846	0.9402	0.9697
No log	7.0566	374	0.9182	0.5846	0.9182	0.9582
No log	7.0943	376	1.0254	0.5714	1.0254	1.0126
No log	7.1321	378	1.2279	0.5634	1.2279	1.1081
No log	7.1698	380	1.2509	0.5263	1.2509	1.1184
No log	7.2075	382	1.1690	0.5538	1.1690	1.0812
No log	7.2453	384	1.1717	0.5538	1.1717	1.0825
No log	7.2830	386	1.1912	0.5538	1.1912	1.0914
No log	7.3208	388	1.2205	0.5581	1.2205	1.1048
No log	7.3585	390	1.1814	0.5581	1.1814	1.0869
No log	7.3962	392	1.1535	0.5581	1.1535	1.0740
No log	7.4340	394	1.0824	0.5581	1.0824	1.0404
No log	7.4717	396	1.1038	0.5581	1.1038	1.0506
No log	7.5094	398	1.0616	0.5846	1.0616	1.0303
No log	7.5472	400	0.9904	0.5891	0.9904	0.9952
No log	7.5849	402	0.9902	0.5846	0.9902	0.9951
No log	7.6226	404	1.0069	0.5846	1.0069	1.0034
No log	7.6604	406	1.0973	0.5581	1.0973	1.0475
No log	7.6981	408	1.1233	0.5581	1.1233	1.0599
No log	7.7358	410	1.0729	0.5625	1.0729	1.0358
No log	7.7736	412	1.0124	0.5891	1.0124	1.0062
No log	7.8113	414	0.9329	0.6562	0.9329	0.9659
No log	7.8491	416	0.9183	0.6667	0.9183	0.9583
No log	7.8868	418	0.9721	0.6047	0.9721	0.9859
No log	7.9245	420	1.1770	0.5075	1.1770	1.0849
No log	7.9623	422	1.3137	0.4812	1.3137	1.1462
No log	8.0	424	1.2743	0.4812	1.2743	1.1289
No log	8.0377	426	1.2692	0.4812	1.2692	1.1266
No log	8.0755	428	1.2974	0.4848	1.2974	1.1390
No log	8.1132	430	1.2799	0.4923	1.2799	1.1313
No log	8.1509	432	1.2442	0.4961	1.2442	1.1154
No log	8.1887	434	1.2907	0.4923	1.2907	1.1361
No log	8.2264	436	1.3486	0.4885	1.3486	1.1613
No log	8.2642	438	1.3997	0.4776	1.3997	1.1831
No log	8.3019	440	1.3822	0.4812	1.3822	1.1757
No log	8.3396	442	1.3051	0.4923	1.3051	1.1424
No log	8.3774	444	1.2867	0.4923	1.2867	1.1343
No log	8.4151	446	1.3107	0.4923	1.3107	1.1449
No log	8.4528	448	1.2619	0.4923	1.2619	1.1233
No log	8.4906	450	1.2568	0.4923	1.2568	1.1211
No log	8.5283	452	1.2413	0.4923	1.2413	1.1141
No log	8.5660	454	1.2189	0.4923	1.2189	1.1041
No log	8.6038	456	1.1736	0.4923	1.1736	1.0833
No log	8.6415	458	1.1286	0.5303	1.1286	1.0624
No log	8.6792	460	1.2039	0.5	1.2039	1.0972
No log	8.7170	462	1.4363	0.4444	1.4363	1.1985
No log	8.7547	464	1.5659	0.4412	1.5659	1.2514
No log	8.7925	466	1.6469	0.3704	1.6469	1.2833
No log	8.8302	468	1.5721	0.4179	1.5721	1.2539
No log	8.8679	470	1.4413	0.4511	1.4413	1.2005
No log	8.9057	472	1.3668	0.4769	1.3668	1.1691
No log	8.9434	474	1.3189	0.4769	1.3189	1.1484
No log	8.9811	476	1.3094	0.4885	1.3094	1.1443
No log	9.0189	478	1.2757	0.4885	1.2757	1.1295
No log	9.0566	480	1.2677	0.5113	1.2677	1.1259
No log	9.0943	482	1.3086	0.5075	1.3086	1.1439
No log	9.1321	484	1.4561	0.4179	1.4561	1.2067
No log	9.1698	486	1.4755	0.4179	1.4755	1.2147
No log	9.2075	488	1.3720	0.4511	1.3720	1.1713
No log	9.2453	490	1.2544	0.4885	1.2544	1.1200
No log	9.2830	492	1.2535	0.5152	1.2535	1.1196
No log	9.3208	494	1.2946	0.5152	1.2946	1.1378
No log	9.3585	496	1.3484	0.4812	1.3484	1.1612
No log	9.3962	498	1.3819	0.4545	1.3819	1.1756
0.3938	9.4340	500	1.3461	0.4580	1.3461	1.1602
0.3938	9.4717	502	1.2650	0.5271	1.2650	1.1247
0.3938	9.5094	504	1.2400	0.5197	1.2400	1.1135
0.3938	9.5472	506	1.2314	0.5354	1.2314	1.1097
0.3938	9.5849	508	1.2717	0.5197	1.2717	1.1277
0.3938	9.6226	510	1.2502	0.5354	1.2502	1.1181
0.3938	9.6604	512	1.2060	0.5469	1.2060	1.0982
0.3938	9.6981	514	1.1846	0.5538	1.1846	1.0884
0.3938	9.7358	516	1.3206	0.4848	1.3206	1.1492
0.3938	9.7736	518	1.4057	0.4478	1.4057	1.1856
0.3938	9.8113	520	1.3269	0.4741	1.3269	1.1519
0.3938	9.8491	522	1.1770	0.5564	1.1770	1.0849
0.3938	9.8868	524	0.9996	0.6015	0.9996	0.9998
0.3938	9.9245	526	0.9346	0.6154	0.9346	0.9667
0.3938	9.9623	528	0.9206	0.6202	0.9206	0.9595
0.3938	10.0	530	0.9962	0.5909	0.9962	0.9981
0.3938	10.0377	532	1.1792	0.5564	1.1792	1.0859
0.3938	10.0755	534	1.2983	0.5075	1.2983	1.1394
0.3938	10.1132	536	1.3351	0.5075	1.3351	1.1555
0.3938	10.1509	538	1.2735	0.5075	1.2735	1.1285
0.3938	10.1887	540	1.2744	0.5303	1.2744	1.1289
0.3938	10.2264	542	1.3133	0.5496	1.3133	1.1460
0.3938	10.2642	544	1.2510	0.5846	1.2510	1.1185
0.3938	10.3019	546	1.2213	0.6094	1.2213	1.1051
0.3938	10.3396	548	1.2314	0.5984	1.2314	1.1097
0.3938	10.3774	550	1.2176	0.5920	1.2176	1.1035
0.3938	10.4151	552	1.1819	0.5691	1.1819	1.0871
0.3938	10.4528	554	1.1220	0.5806	1.1220	1.0593
0.3938	10.4906	556	1.0396	0.5781	1.0396	1.0196
0.3938	10.5283	558	1.0005	0.5781	1.0005	1.0003
0.3938	10.5660	560	0.9632	0.5854	0.9632	0.9814
0.3938	10.6038	562	0.9668	0.5455	0.9668	0.9832
0.3938	10.6415	564	0.9766	0.5968	0.9766	0.9882
0.3938	10.6792	566	1.0340	0.5512	1.0340	1.0168
0.3938	10.7170	568	1.1883	0.5271	1.1883	1.0901
0.3938	10.7547	570	1.3216	0.4923	1.3216	1.1496
0.3938	10.7925	572	1.3518	0.4812	1.3518	1.1626
0.3938	10.8302	574	1.2519	0.5271	1.2519	1.1189
0.3938	10.8679	576	1.2375	0.5312	1.2375	1.1124
0.3938	10.9057	578	1.2997	0.5039	1.2997	1.1401
0.3938	10.9434	580	1.3107	0.4567	1.3107	1.1448
0.3938	10.9811	582	1.2986	0.4567	1.2986	1.1396
0.3938	11.0189	584	1.2599	0.5116	1.2599	1.1225
0.3938	11.0566	586	1.2547	0.5116	1.2547	1.1202
0.3938	11.0943	588	1.2394	0.5116	1.2394	1.1133
0.3938	11.1321	590	1.1719	0.5385	1.1719	1.0826
0.3938	11.1698	592	1.1764	0.5385	1.1764	1.0846
0.3938	11.2075	594	1.2120	0.4724	1.2120	1.1009
0.3938	11.2453	596	1.2673	0.4444	1.2673	1.1257
0.3938	11.2830	598	1.2857	0.4444	1.2857	1.1339
0.3938	11.3208	600	1.2571	0.4444	1.2571	1.1212
0.3938	11.3585	602	1.3101	0.4651	1.3101	1.1446
0.3938	11.3962	604	1.3842	0.4580	1.3842	1.1765
0.3938	11.4340	606	1.4610	0.4275	1.4610	1.2087
0.3938	11.4717	608	1.5474	0.4242	1.5474	1.2439
0.3938	11.5094	610	1.5065	0.4242	1.5065	1.2274
0.3938	11.5472	612	1.4486	0.4545	1.4486	1.2036

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1