ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2275
• Qwk: 0.1048
• Mse: 1.2275
• Rmse: 1.1079

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0215	2	4.7828	0.0010	4.7828	2.1870
No log	0.0430	4	2.6540	-0.0030	2.6540	1.6291
No log	0.0645	6	1.7503	0.0062	1.7503	1.3230
No log	0.0860	8	1.3511	-0.0536	1.3511	1.1624
No log	0.1075	10	1.8006	0.0694	1.8006	1.3419
No log	0.1290	12	1.4901	-0.0590	1.4901	1.2207
No log	0.1505	14	1.3828	0.0010	1.3828	1.1759
No log	0.1720	16	1.2735	0.1733	1.2735	1.1285
No log	0.1935	18	1.3927	0.0077	1.3927	1.1801
No log	0.2151	20	1.6503	0.0647	1.6503	1.2846
No log	0.2366	22	1.6220	0.0838	1.6220	1.2736
No log	0.2581	24	1.4636	0.0189	1.4636	1.2098
No log	0.2796	26	1.3391	0.0057	1.3391	1.1572
No log	0.3011	28	1.3137	0.1397	1.3137	1.1462
No log	0.3226	30	1.3320	0.1242	1.3320	1.1541
No log	0.3441	32	1.4389	0.0472	1.4389	1.1995
No log	0.3656	34	1.3290	0.0741	1.3290	1.1528
No log	0.3871	36	1.2764	0.0863	1.2764	1.1298
No log	0.4086	38	1.3127	0.2409	1.3127	1.1457
No log	0.4301	40	1.3413	0.2458	1.3413	1.1581
No log	0.4516	42	1.3250	0.1546	1.3250	1.1511
No log	0.4731	44	1.3148	0.2122	1.3148	1.1466
No log	0.4946	46	1.3655	0.2122	1.3655	1.1685
No log	0.5161	48	1.4655	0.1241	1.4655	1.2106
No log	0.5376	50	1.7480	0.0950	1.7480	1.3221
No log	0.5591	52	2.0691	0.1037	2.0691	1.4384
No log	0.5806	54	1.8410	0.1647	1.8410	1.3568
No log	0.6022	56	1.3757	0.1894	1.3757	1.1729
No log	0.6237	58	1.4108	0.1257	1.4108	1.1878
No log	0.6452	60	1.3759	0.1957	1.3759	1.1730
No log	0.6667	62	1.3509	0.2752	1.3509	1.1623
No log	0.6882	64	1.6263	0.1787	1.6263	1.2753
No log	0.7097	66	1.7018	0.1325	1.7018	1.3045
No log	0.7312	68	1.4769	0.1580	1.4769	1.2153
No log	0.7527	70	1.2977	0.2597	1.2977	1.1392
No log	0.7742	72	1.3133	0.2638	1.3133	1.1460
No log	0.7957	74	1.4679	0.1597	1.4679	1.2116
No log	0.8172	76	1.5307	0.1207	1.5307	1.2372
No log	0.8387	78	1.3804	0.2622	1.3804	1.1749
No log	0.8602	80	1.2794	0.2431	1.2794	1.1311
No log	0.8817	82	1.3074	0.1794	1.3074	1.1434
No log	0.9032	84	1.4246	0.2235	1.4246	1.1936
No log	0.9247	86	1.3780	0.2466	1.3780	1.1739
No log	0.9462	88	1.3481	0.2466	1.3481	1.1611
No log	0.9677	90	1.3723	0.2300	1.3723	1.1715
No log	0.9892	92	1.4776	0.2724	1.4776	1.2156
No log	1.0108	94	1.7262	0.2689	1.7262	1.3138
No log	1.0323	96	1.8850	0.1748	1.8850	1.3729
No log	1.0538	98	1.7580	0.2241	1.7580	1.3259
No log	1.0753	100	1.4780	0.3754	1.4780	1.2157
No log	1.0968	102	1.5895	0.2824	1.5895	1.2608
No log	1.1183	104	1.6459	0.2927	1.6459	1.2829
No log	1.1398	106	1.4662	0.3299	1.4662	1.2109
No log	1.1613	108	1.1835	0.3418	1.1835	1.0879
No log	1.1828	110	1.1531	0.3043	1.1531	1.0738
No log	1.2043	112	1.2804	0.3332	1.2804	1.1315
No log	1.2258	114	1.2317	0.2791	1.2317	1.1098
No log	1.2473	116	1.3164	0.3127	1.3164	1.1474
No log	1.2688	118	1.3345	0.3108	1.3345	1.1552
No log	1.2903	120	1.4176	0.3959	1.4176	1.1906
No log	1.3118	122	1.3972	0.3959	1.3972	1.1821
No log	1.3333	124	1.2736	0.3271	1.2736	1.1286
No log	1.3548	126	1.4105	0.4075	1.4105	1.1876
No log	1.3763	128	1.6129	0.3116	1.6129	1.2700
No log	1.3978	130	1.5007	0.3634	1.5007	1.2250
No log	1.4194	132	1.2178	0.3220	1.2178	1.1036
No log	1.4409	134	1.1306	0.1819	1.1306	1.0633
No log	1.4624	136	1.2147	0.3478	1.2147	1.1022
No log	1.4839	138	1.4113	0.3845	1.4113	1.1880
No log	1.5054	140	1.5773	0.3531	1.5773	1.2559
No log	1.5269	142	1.4407	0.3325	1.4407	1.2003
No log	1.5484	144	1.3638	0.4025	1.3638	1.1678
No log	1.5699	146	1.3486	0.3826	1.3486	1.1613
No log	1.5914	148	1.4410	0.375	1.4410	1.2004
No log	1.6129	150	1.5113	0.2647	1.5113	1.2294
No log	1.6344	152	1.6152	0.2436	1.6152	1.2709
No log	1.6559	154	1.6155	0.2343	1.6155	1.2710
No log	1.6774	156	1.5196	0.1989	1.5196	1.2327
No log	1.6989	158	1.5297	0.1713	1.5297	1.2368
No log	1.7204	160	1.6514	0.2206	1.6514	1.2851
No log	1.7419	162	1.7846	0.1745	1.7846	1.3359
No log	1.7634	164	1.7370	0.2066	1.7370	1.3180
No log	1.7849	166	1.6412	0.2406	1.6412	1.2811
No log	1.8065	168	1.5651	0.1891	1.5651	1.2510
No log	1.8280	170	1.4156	0.1020	1.4156	1.1898
No log	1.8495	172	1.4360	0.125	1.4360	1.1983
No log	1.8710	174	1.5300	0.1989	1.5300	1.2369
No log	1.8925	176	1.7738	0.2463	1.7738	1.3318
No log	1.9140	178	1.9958	0.1395	1.9958	1.4127
No log	1.9355	180	2.0574	0.1580	2.0574	1.4344
No log	1.9570	182	1.9004	0.1561	1.9004	1.3785
No log	1.9785	184	1.6222	0.2759	1.6222	1.2737
No log	2.0	186	1.5086	0.1935	1.5086	1.2282
No log	2.0215	188	1.4856	0.1046	1.4856	1.2188
No log	2.0430	190	1.5363	0.1051	1.5363	1.2395
No log	2.0645	192	1.6044	0.2009	1.6044	1.2667
No log	2.0860	194	1.5505	0.1886	1.5505	1.2452
No log	2.1075	196	1.5825	0.2181	1.5825	1.2580
No log	2.1290	198	1.6573	0.2908	1.6573	1.2873
No log	2.1505	200	1.7667	0.1672	1.7667	1.3292
No log	2.1720	202	1.9064	0.1071	1.9064	1.3807
No log	2.1935	204	1.8195	0.1416	1.8195	1.3489
No log	2.2151	206	1.6064	0.1515	1.6064	1.2674
No log	2.2366	208	1.4529	0.1004	1.4529	1.2053
No log	2.2581	210	1.4594	0.0964	1.4594	1.2080
No log	2.2796	212	1.4770	0.1254	1.4770	1.2153
No log	2.3011	214	1.4105	0.1313	1.4105	1.1877
No log	2.3226	216	1.3954	0.1313	1.3954	1.1813
No log	2.3441	218	1.3604	0.1313	1.3604	1.1664
No log	2.3656	220	1.3766	0.1462	1.3766	1.1733
No log	2.3871	222	1.5070	0.2550	1.5070	1.2276
No log	2.4086	224	1.5061	0.1886	1.5061	1.2272
No log	2.4301	226	1.3688	0.1850	1.3688	1.1699
No log	2.4516	228	1.3261	0.1667	1.3261	1.1516
No log	2.4731	230	1.3719	0.1850	1.3719	1.1713
No log	2.4946	232	1.3720	0.1188	1.3720	1.1713
No log	2.5161	234	1.3721	0.0887	1.3721	1.1714
No log	2.5376	236	1.4633	0.1345	1.4633	1.2097
No log	2.5591	238	1.5079	0.1698	1.5079	1.2279
No log	2.5806	240	1.3845	0.1698	1.3845	1.1767
No log	2.6022	242	1.2482	0.0789	1.2482	1.1172
No log	2.6237	244	1.2590	0.0789	1.2590	1.1221
No log	2.6452	246	1.4164	0.3025	1.4164	1.1901
No log	2.6667	248	1.6933	0.2644	1.6933	1.3013
No log	2.6882	250	1.7428	0.2620	1.7428	1.3201
No log	2.7097	252	1.5009	0.2806	1.5009	1.2251
No log	2.7312	254	1.2861	0.2485	1.2861	1.1341
No log	2.7527	256	1.2032	0.1920	1.2032	1.0969
No log	2.7742	258	1.2074	0.2015	1.2074	1.0988
No log	2.7957	260	1.3519	0.1801	1.3519	1.1627
No log	2.8172	262	1.5805	0.2009	1.5805	1.2572
No log	2.8387	264	1.7085	0.2032	1.7085	1.3071
No log	2.8602	266	1.6483	0.2569	1.6483	1.2838
No log	2.8817	268	1.4621	0.1929	1.4621	1.2092
No log	2.9032	270	1.3400	0.2032	1.3400	1.1576
No log	2.9247	272	1.2713	0.1703	1.2713	1.1275
No log	2.9462	274	1.3076	0.1646	1.3076	1.1435
No log	2.9677	276	1.3606	0.1646	1.3606	1.1664
No log	2.9892	278	1.3419	0.1646	1.3419	1.1584
No log	3.0108	280	1.3001	0.1980	1.3001	1.1402
No log	3.0323	282	1.2518	0.2074	1.2518	1.1188
No log	3.0538	284	1.2396	0.2371	1.2396	1.1134
No log	3.0753	286	1.2920	0.2925	1.2920	1.1367
No log	3.0968	288	1.3183	0.2806	1.3183	1.1482
No log	3.1183	290	1.2852	0.2964	1.2852	1.1337
No log	3.1398	292	1.1908	0.2914	1.1908	1.0913
No log	3.1613	294	1.2027	0.2664	1.2027	1.0967
No log	3.1828	296	1.2848	0.2457	1.2848	1.1335
No log	3.2043	298	1.3550	0.2918	1.3550	1.1640
No log	3.2258	300	1.3499	0.1554	1.3499	1.1619
No log	3.2473	302	1.4189	0.1646	1.4189	1.1912
No log	3.2688	304	1.4295	0.1345	1.4295	1.1956
No log	3.2903	306	1.3760	0.1698	1.3760	1.1730
No log	3.3118	308	1.3657	0.1698	1.3657	1.1686
No log	3.3333	310	1.3200	0.1608	1.3200	1.1489
No log	3.3548	312	1.3386	0.2704	1.3386	1.1570
No log	3.3763	314	1.4596	0.2863	1.4596	1.2082
No log	3.3978	316	1.5886	0.3105	1.5886	1.2604
No log	3.4194	318	1.5481	0.3086	1.5481	1.2442
No log	3.4409	320	1.4109	0.2604	1.4109	1.1878
No log	3.4624	322	1.2790	0.1252	1.2790	1.1309
No log	3.4839	324	1.2383	0.0769	1.2383	1.1128
No log	3.5054	326	1.3388	0.1646	1.3388	1.1570
No log	3.5269	328	1.4856	0.2839	1.4856	1.2188
No log	3.5484	330	1.4550	0.2839	1.4550	1.2062
No log	3.5699	332	1.2819	0.2212	1.2819	1.1322
No log	3.5914	334	1.1963	0.2103	1.1963	1.0937
No log	3.6129	336	1.1750	0.1874	1.1750	1.0840
No log	3.6344	338	1.2584	0.2275	1.2584	1.1218
No log	3.6559	340	1.4644	0.2604	1.4644	1.2101
No log	3.6774	342	1.5402	0.2659	1.5402	1.2410
No log	3.6989	344	1.4460	0.2736	1.4460	1.2025
No log	3.7204	346	1.2692	0.2141	1.2692	1.1266
No log	3.7419	348	1.2319	0.2250	1.2319	1.1099
No log	3.7634	350	1.2475	0.2725	1.2475	1.1169
No log	3.7849	352	1.1883	0.2780	1.1883	1.0901
No log	3.8065	354	1.1449	0.1541	1.1449	1.0700
No log	3.8280	356	1.2423	0.3372	1.2423	1.1146
No log	3.8495	358	1.4964	0.3521	1.4964	1.2233
No log	3.8710	360	1.4889	0.3317	1.4889	1.2202
No log	3.8925	362	1.3331	0.3574	1.3331	1.1546
No log	3.9140	364	1.2361	0.3513	1.2361	1.1118
No log	3.9355	366	1.2942	0.3324	1.2942	1.1376
No log	3.9570	368	1.3725	0.3624	1.3725	1.1715
No log	3.9785	370	1.3812	0.3624	1.3812	1.1753
No log	4.0	372	1.2123	0.3487	1.2123	1.1010
No log	4.0215	374	1.0892	0.1541	1.0892	1.0436
No log	4.0430	376	1.0926	0.1379	1.0926	1.0453
No log	4.0645	378	1.1936	0.2278	1.1936	1.0925
No log	4.0860	380	1.2827	0.2707	1.2827	1.1326
No log	4.1075	382	1.3391	0.2763	1.3391	1.1572
No log	4.1290	384	1.3644	0.3238	1.3644	1.1681
No log	4.1505	386	1.3126	0.3113	1.3126	1.1457
No log	4.1720	388	1.3583	0.3238	1.3583	1.1655
No log	4.1935	390	1.3875	0.3238	1.3875	1.1779
No log	4.2151	392	1.3916	0.3462	1.3916	1.1797
No log	4.2366	394	1.4212	0.3317	1.4212	1.1921
No log	4.2581	396	1.4421	0.3642	1.4421	1.2009
No log	4.2796	398	1.5431	0.3345	1.5431	1.2422
No log	4.3011	400	1.5089	0.3317	1.5089	1.2284
No log	4.3226	402	1.4551	0.1935	1.4551	1.2063
No log	4.3441	404	1.3768	0.1592	1.3768	1.1734
No log	4.3656	406	1.3559	0.1592	1.3559	1.1644
No log	4.3871	408	1.3831	0.2479	1.3831	1.1760
No log	4.4086	410	1.3578	0.3238	1.3578	1.1652
No log	4.4301	412	1.4112	0.3687	1.4112	1.1880
No log	4.4516	414	1.4258	0.3317	1.4258	1.1941
No log	4.4731	416	1.3125	0.3570	1.3125	1.1457
No log	4.4946	418	1.2523	0.3792	1.2523	1.1191
No log	4.5161	420	1.3899	0.3862	1.3899	1.1790
No log	4.5376	422	1.6164	0.3008	1.6164	1.2714
No log	4.5591	424	1.6248	0.2826	1.6248	1.2747
No log	4.5806	426	1.4946	0.3254	1.4946	1.2225
No log	4.6022	428	1.3045	0.1637	1.3045	1.1421
No log	4.6237	430	1.1703	0.1214	1.1703	1.0818
No log	4.6452	432	1.1149	0.1180	1.1149	1.0559
No log	4.6667	434	1.1713	0.1807	1.1713	1.0823
No log	4.6882	436	1.2641	0.3093	1.2641	1.1243
No log	4.7097	438	1.3604	0.3798	1.3604	1.1664
No log	4.7312	440	1.3513	0.3798	1.3513	1.1624
No log	4.7527	442	1.3343	0.2736	1.3343	1.1551
No log	4.7742	444	1.2723	0.1844	1.2723	1.1280
No log	4.7957	446	1.2969	0.1795	1.2969	1.1388
No log	4.8172	448	1.4158	0.2982	1.4158	1.1899
No log	4.8387	450	1.4823	0.3254	1.4823	1.2175
No log	4.8602	452	1.5328	0.3317	1.5328	1.2381
No log	4.8817	454	1.5575	0.3317	1.5575	1.2480
No log	4.9032	456	1.4246	0.3475	1.4246	1.1936
No log	4.9247	458	1.2320	0.1989	1.2320	1.1100
No log	4.9462	460	1.1992	0.1903	1.1992	1.0951
No log	4.9677	462	1.2928	0.2445	1.2928	1.1370
No log	4.9892	464	1.4616	0.3475	1.4616	1.2090
No log	5.0108	466	1.5216	0.3687	1.5216	1.2335
No log	5.0323	468	1.4048	0.3254	1.4048	1.1853
No log	5.0538	470	1.2453	0.2403	1.2453	1.1159
No log	5.0753	472	1.2393	0.2542	1.2393	1.1132
No log	5.0968	474	1.3110	0.2676	1.3110	1.1450
No log	5.1183	476	1.3397	0.3005	1.3397	1.1575
No log	5.1398	478	1.3353	0.2895	1.3353	1.1555
No log	5.1613	480	1.2614	0.2438	1.2614	1.1231
No log	5.1828	482	1.1953	0.1807	1.1953	1.0933
No log	5.2043	484	1.2062	0.1857	1.2062	1.0983
No log	5.2258	486	1.2832	0.2527	1.2832	1.1328
No log	5.2473	488	1.4659	0.3317	1.4659	1.2108
No log	5.2688	490	1.4977	0.3317	1.4977	1.2238
No log	5.2903	492	1.3998	0.2325	1.3998	1.1831
No log	5.3118	494	1.3965	0.2512	1.3965	1.1817
No log	5.3333	496	1.4088	0.1929	1.4088	1.1869
No log	5.3548	498	1.3746	0.2017	1.3746	1.1724
0.3321	5.3763	500	1.3205	0.2826	1.3205	1.1491
0.3321	5.3978	502	1.3296	0.3068	1.3296	1.1531
0.3321	5.4194	504	1.3756	0.2716	1.3756	1.1729
0.3321	5.4409	506	1.3901	0.2983	1.3901	1.1790
0.3321	5.4624	508	1.3166	0.2693	1.3166	1.1475
0.3321	5.4839	510	1.3167	0.2367	1.3167	1.1475
0.3321	5.5054	512	1.2746	0.1596	1.2746	1.1290
0.3321	5.5269	514	1.2400	0.0880	1.2400	1.1136
0.3321	5.5484	516	1.2275	0.1048	1.2275	1.1079

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1