ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3777
• Qwk: 0.1498
• Mse: 1.3777
• Rmse: 1.1737

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	4.5887	0.0010	4.5886	2.1421
No log	0.1538	4	2.5948	-0.0076	2.5948	1.6108
No log	0.2308	6	1.9632	-0.0575	1.9632	1.4011
No log	0.3077	8	1.4715	-0.0056	1.4715	1.2130
No log	0.3846	10	1.2843	0.0693	1.2843	1.1333
No log	0.4615	12	1.2648	0.0613	1.2648	1.1246
No log	0.5385	14	1.2493	0.0750	1.2493	1.1177
No log	0.6154	16	1.1945	0.1918	1.1945	1.0929
No log	0.6923	18	1.2436	0.1893	1.2436	1.1152
No log	0.7692	20	1.2397	0.1076	1.2397	1.1134
No log	0.8462	22	1.2230	0.1773	1.2230	1.1059
No log	0.9231	24	1.2207	0.2624	1.2207	1.1049
No log	1.0	26	1.2411	0.1675	1.2411	1.1141
No log	1.0769	28	1.2804	0.1379	1.2804	1.1316
No log	1.1538	30	1.2993	0.1106	1.2993	1.1399
No log	1.2308	32	1.3888	0.0124	1.3888	1.1785
No log	1.3077	34	1.3637	0.0275	1.3637	1.1678
No log	1.3846	36	1.2650	0.1346	1.2650	1.1247
No log	1.4615	38	1.1651	0.2439	1.1651	1.0794
No log	1.5385	40	1.1585	0.2735	1.1585	1.0763
No log	1.6154	42	1.1483	0.2733	1.1483	1.0716
No log	1.6923	44	1.1623	0.2678	1.1623	1.0781
No log	1.7692	46	1.1645	0.2689	1.1645	1.0791
No log	1.8462	48	1.1957	0.1344	1.1957	1.0935
No log	1.9231	50	1.2121	0.1654	1.2121	1.1009
No log	2.0	52	1.2172	0.1881	1.2172	1.1033
No log	2.0769	54	1.2121	0.1750	1.2121	1.1009
No log	2.1538	56	1.2095	0.0692	1.2095	1.0998
No log	2.2308	58	1.2980	0.1846	1.2980	1.1393
No log	2.3077	60	1.2635	0.1148	1.2635	1.1241
No log	2.3846	62	1.1922	0.1546	1.1922	1.0919
No log	2.4615	64	1.2251	0.1148	1.2251	1.1069
No log	2.5385	66	1.3312	0.1599	1.3312	1.1538
No log	2.6154	68	1.3696	0.1903	1.3696	1.1703
No log	2.6923	70	1.2670	0.2141	1.2670	1.1256
No log	2.7692	72	1.0982	0.2721	1.0982	1.0480
No log	2.8462	74	1.0791	0.2850	1.0791	1.0388
No log	2.9231	76	1.1381	0.3778	1.1381	1.0668
No log	3.0	78	1.1115	0.3211	1.1115	1.0543
No log	3.0769	80	1.2055	0.3197	1.2055	1.0980
No log	3.1538	82	1.3945	0.2903	1.3945	1.1809
No log	3.2308	84	1.4352	0.3125	1.4352	1.1980
No log	3.3077	86	1.2652	0.3047	1.2652	1.1248
No log	3.3846	88	1.2930	0.2773	1.2930	1.1371
No log	3.4615	90	1.3353	0.2846	1.3353	1.1556
No log	3.5385	92	1.7222	0.2156	1.7222	1.3123
No log	3.6154	94	2.0619	0.1187	2.0619	1.4359
No log	3.6923	96	2.1225	0.1299	2.1225	1.4569
No log	3.7692	98	1.9805	0.1077	1.9805	1.4073
No log	3.8462	100	1.6519	0.1884	1.6519	1.2853
No log	3.9231	102	1.3766	0.2518	1.3766	1.1733
No log	4.0	104	1.3743	0.2568	1.3743	1.1723
No log	4.0769	106	1.5087	0.2240	1.5087	1.2283
No log	4.1538	108	1.6044	0.1886	1.6044	1.2666
No log	4.2308	110	1.6458	0.2303	1.6458	1.2829
No log	4.3077	112	1.6020	0.2147	1.6020	1.2657
No log	4.3846	114	1.5496	0.2501	1.5496	1.2448
No log	4.4615	116	1.7381	0.1779	1.7381	1.3184
No log	4.5385	118	1.8970	0.1500	1.8970	1.3773
No log	4.6154	120	1.9301	0.1639	1.9301	1.3893
No log	4.6923	122	1.7034	0.2171	1.7034	1.3051
No log	4.7692	124	1.5664	0.1889	1.5664	1.2516
No log	4.8462	126	1.7663	0.1779	1.7663	1.3290
No log	4.9231	128	1.9570	0.1523	1.9570	1.3989
No log	5.0	130	1.8479	0.1914	1.8479	1.3594
No log	5.0769	132	1.7482	0.2156	1.7482	1.3222
No log	5.1538	134	1.4846	0.2197	1.4846	1.2184
No log	5.2308	136	1.2588	0.1899	1.2588	1.1220
No log	5.3077	138	1.3021	0.1557	1.3021	1.1411
No log	5.3846	140	1.5180	0.2163	1.5180	1.2321
No log	5.4615	142	1.7320	0.1466	1.7320	1.3160
No log	5.5385	144	1.7873	0.1473	1.7873	1.3369
No log	5.6154	146	1.6708	0.2710	1.6708	1.2926
No log	5.6923	148	1.5975	0.2201	1.5975	1.2639
No log	5.7692	150	1.5227	0.2092	1.5227	1.2340
No log	5.8462	152	1.4977	0.1935	1.4977	1.2238
No log	5.9231	154	1.4349	0.1892	1.4349	1.1979
No log	6.0	156	1.3404	0.1899	1.3404	1.1577
No log	6.0769	158	1.3940	0.1674	1.3940	1.1807
No log	6.1538	160	1.6309	0.1924	1.6309	1.2771
No log	6.2308	162	1.7864	0.2185	1.7864	1.3366
No log	6.3077	164	1.7633	0.2479	1.7633	1.3279
No log	6.3846	166	1.6749	0.2657	1.6749	1.2942
No log	6.4615	168	1.6235	0.2634	1.6235	1.2741
No log	6.5385	170	1.7230	0.2185	1.7230	1.3126
No log	6.6154	172	1.7147	0.1952	1.7147	1.3095
No log	6.6923	174	1.6239	0.2343	1.6239	1.2743
No log	6.7692	176	1.3912	0.1621	1.3912	1.1795
No log	6.8462	178	1.3126	0.1535	1.3126	1.1457
No log	6.9231	180	1.4586	0.2020	1.4586	1.2077
No log	7.0	182	1.4848	0.2020	1.4848	1.2185
No log	7.0769	184	1.3616	0.2115	1.3616	1.1669
No log	7.1538	186	1.3400	0.1621	1.3400	1.1576
No log	7.2308	188	1.2890	0.1252	1.2890	1.1353
No log	7.3077	190	1.2466	0.1674	1.2466	1.1165
No log	7.3846	192	1.4061	0.2074	1.4061	1.1858
No log	7.4615	194	1.5739	0.2550	1.5739	1.2546
No log	7.5385	196	1.5741	0.2782	1.5741	1.2546
No log	7.6154	198	1.5687	0.3026	1.5687	1.2525
No log	7.6923	200	1.4413	0.2822	1.4413	1.2005
No log	7.7692	202	1.5090	0.2873	1.5090	1.2284
No log	7.8462	204	1.5170	0.2759	1.5170	1.2317
No log	7.9231	206	1.3871	0.3210	1.3871	1.1777
No log	8.0	208	1.3685	0.3537	1.3685	1.1698
No log	8.0769	210	1.4672	0.2633	1.4672	1.2113
No log	8.1538	212	1.5034	0.2633	1.5034	1.2261
No log	8.2308	214	1.5267	0.2658	1.5267	1.2356
No log	8.3077	216	1.6145	0.2407	1.6145	1.2706
No log	8.3846	218	1.6522	0.2435	1.6522	1.2854
No log	8.4615	220	1.8166	0.1914	1.8166	1.3478
No log	8.5385	222	1.8397	0.1946	1.8397	1.3563
No log	8.6154	224	1.7656	0.1914	1.7656	1.3288
No log	8.6923	226	1.5750	0.2220	1.5750	1.2550
No log	8.7692	228	1.5380	0.2285	1.5380	1.2401
No log	8.8462	230	1.6212	0.2950	1.6212	1.2733
No log	8.9231	232	1.6321	0.2735	1.6321	1.2775
No log	9.0	234	1.6314	0.2285	1.6314	1.2773
No log	9.0769	236	1.6454	0.2435	1.6454	1.2827
No log	9.1538	238	1.7949	0.1745	1.7949	1.3397
No log	9.2308	240	2.0525	0.1358	2.0525	1.4326
No log	9.3077	242	2.0377	0.1697	2.0377	1.4275
No log	9.3846	244	1.8124	0.1780	1.8124	1.3463
No log	9.4615	246	1.7250	0.1914	1.7250	1.3134
No log	9.5385	248	1.6182	0.1697	1.6182	1.2721
No log	9.6154	250	1.4427	0.2289	1.4427	1.2011
No log	9.6923	252	1.2982	0.2291	1.2982	1.1394
No log	9.7692	254	1.2749	0.25	1.2749	1.1291
No log	9.8462	256	1.4195	0.1980	1.4195	1.1914
No log	9.9231	258	1.5742	0.2863	1.5742	1.2547
No log	10.0	260	1.6419	0.2220	1.6419	1.2814
No log	10.0769	262	1.6564	0.2220	1.6564	1.2870
No log	10.1538	264	1.6351	0.2285	1.6351	1.2787
No log	10.2308	266	1.6584	0.2317	1.6584	1.2878
No log	10.3077	268	1.5136	0.2289	1.5136	1.2303
No log	10.3846	270	1.3428	0.1371	1.3428	1.1588
No log	10.4615	272	1.2723	0.1750	1.2723	1.1280
No log	10.5385	274	1.2942	0.0789	1.2942	1.1376
No log	10.6154	276	1.3430	0.1889	1.3430	1.1589
No log	10.6923	278	1.3970	0.1516	1.3970	1.1819
No log	10.7692	280	1.4264	0.2359	1.4264	1.1943
No log	10.8462	282	1.4079	0.2457	1.4079	1.1865
No log	10.9231	284	1.3570	0.1801	1.3570	1.1649
No log	11.0	286	1.3468	0.1753	1.3468	1.1605
No log	11.0769	288	1.3889	0.1891	1.3889	1.1785
No log	11.1538	290	1.4630	0.1568	1.4630	1.2095
No log	11.2308	292	1.4129	0.2173	1.4129	1.1886
No log	11.3077	294	1.3466	0.1031	1.3466	1.1604
No log	11.3846	296	1.2839	0.1188	1.2839	1.1331
No log	11.4615	298	1.2168	0.1217	1.2168	1.1031
No log	11.5385	300	1.2801	0.1053	1.2801	1.1314
No log	11.6154	302	1.4342	0.1568	1.4342	1.1976
No log	11.6923	304	1.5613	0.2217	1.5613	1.2495
No log	11.7692	306	1.6791	0.2240	1.6791	1.2958
No log	11.8462	308	1.6538	0.2363	1.6538	1.2860
No log	11.9231	310	1.6090	0.2240	1.6090	1.2685
No log	12.0	312	1.5913	0.2659	1.5913	1.2615
No log	12.0769	314	1.4766	0.1796	1.4766	1.2151
No log	12.1538	316	1.3763	0.1440	1.3763	1.1732
No log	12.2308	318	1.3780	0.1252	1.3780	1.1739
No log	12.3077	320	1.5454	0.2632	1.5454	1.2431
No log	12.3846	322	1.6451	0.2542	1.6451	1.2826
No log	12.4615	324	1.6413	0.2708	1.6413	1.2811
No log	12.5385	326	1.5297	0.2829	1.5297	1.2368
No log	12.6154	328	1.4921	0.2964	1.4921	1.2215
No log	12.6923	330	1.5306	0.2782	1.5306	1.2372
No log	12.7692	332	1.5109	0.2217	1.5109	1.2292
No log	12.8462	334	1.5258	0.2217	1.5258	1.2352
No log	12.9231	336	1.5937	0.2685	1.5937	1.2624
No log	13.0	338	1.6246	0.2348	1.6246	1.2746
No log	13.0769	340	1.5522	0.2685	1.5522	1.2459
No log	13.1538	342	1.3517	0.2224	1.3517	1.1626
No log	13.2308	344	1.2649	0.1538	1.2649	1.1247
No log	13.3077	346	1.2914	0.1896	1.2914	1.1364
No log	13.3846	348	1.4016	0.1935	1.4016	1.1839
No log	13.4615	350	1.5660	0.2424	1.5660	1.2514
No log	13.5385	352	1.6603	0.2950	1.6603	1.2885
No log	13.6154	354	1.6047	0.3123	1.6047	1.2668
No log	13.6923	356	1.4986	0.2839	1.4986	1.2242
No log	13.7692	358	1.4350	0.2105	1.4350	1.1979
No log	13.8462	360	1.5050	0.2839	1.5050	1.2268
No log	13.9231	362	1.5036	0.2659	1.5036	1.2262
No log	14.0	364	1.4858	0.2839	1.4858	1.2189
No log	14.0769	366	1.4294	0.2105	1.4294	1.1956
No log	14.1538	368	1.4022	0.1796	1.4022	1.1842
No log	14.2308	370	1.4699	0.2065	1.4699	1.2124
No log	14.3077	372	1.5729	0.2359	1.5729	1.2541
No log	14.3846	374	1.5314	0.2065	1.5314	1.2375
No log	14.4615	376	1.4228	0.1283	1.4228	1.1928
No log	14.5385	378	1.3003	0.0887	1.3003	1.1403
No log	14.6154	380	1.3375	0.1252	1.3375	1.1565
No log	14.6923	382	1.5088	0.1386	1.5088	1.2283
No log	14.7692	384	1.6137	0.1997	1.6137	1.2703
No log	14.8462	386	1.6032	0.2120	1.6032	1.2662
No log	14.9231	388	1.5479	0.2047	1.5479	1.2442
No log	15.0	390	1.5591	0.1758	1.5591	1.2486
No log	15.0769	392	1.6332	0.1843	1.6332	1.2780
No log	15.1538	394	1.6675	0.1923	1.6675	1.2913
No log	15.2308	396	1.6915	0.1997	1.6915	1.3006
No log	15.3077	398	1.6798	0.2826	1.6798	1.2961
No log	15.3846	400	1.6007	0.2595	1.6007	1.2652
No log	15.4615	402	1.5853	0.2569	1.5853	1.2591
No log	15.5385	404	1.6168	0.2908	1.6168	1.2715
No log	15.6154	406	1.7131	0.1918	1.7131	1.3088
No log	15.6923	408	1.7150	0.2569	1.7150	1.3096
No log	15.7692	410	1.6522	0.2863	1.6522	1.2854
No log	15.8462	412	1.5249	0.2065	1.5249	1.2349
No log	15.9231	414	1.4301	0.1313	1.4301	1.1959
No log	16.0	416	1.3694	0.1844	1.3694	1.1702
No log	16.0769	418	1.4344	0.2457	1.4344	1.1977
No log	16.1538	420	1.5818	0.2317	1.5818	1.2577
No log	16.2308	422	1.6207	0.2154	1.6207	1.2731
No log	16.3077	424	1.6574	0.2066	1.6574	1.2874
No log	16.3846	426	1.7549	0.2310	1.7549	1.3247
No log	16.4615	428	1.7121	0.2281	1.7121	1.3085
No log	16.5385	430	1.5590	0.2317	1.5590	1.2486
No log	16.6154	432	1.4503	0.3171	1.4503	1.2043
No log	16.6923	434	1.4866	0.2436	1.4866	1.2193
No log	16.7692	436	1.6547	0.2348	1.6547	1.2864
No log	16.8462	438	1.7529	0.1914	1.7529	1.3240
No log	16.9231	440	1.6855	0.2595	1.6855	1.2983
No log	17.0	442	1.5490	0.2485	1.5490	1.2446
No log	17.0769	444	1.4623	0.2736	1.4623	1.2092
No log	17.1538	446	1.5179	0.2574	1.5179	1.2320
No log	17.2308	448	1.5465	0.2604	1.5465	1.2436
No log	17.3077	450	1.5356	0.2604	1.5356	1.2392
No log	17.3846	452	1.5074	0.1340	1.5074	1.2278
No log	17.4615	454	1.5372	0.2604	1.5372	1.2398
No log	17.5385	456	1.5450	0.2839	1.5450	1.2430
No log	17.6154	458	1.5265	0.2485	1.5265	1.2355
No log	17.6923	460	1.4945	0.2606	1.4945	1.2225
No log	17.7692	462	1.4683	0.2578	1.4683	1.2117
No log	17.8462	464	1.5251	0.2711	1.5251	1.2349
No log	17.9231	466	1.6601	0.2463	1.6601	1.2884
No log	18.0	468	1.7768	0.2170	1.7768	1.3330
No log	18.0769	470	1.8327	0.2038	1.8327	1.3538
No log	18.1538	472	1.8294	0.2038	1.8294	1.3525
No log	18.2308	474	1.7284	0.2132	1.7284	1.3147
No log	18.3077	476	1.5587	0.2455	1.5587	1.2485
No log	18.3846	478	1.4166	0.1538	1.4166	1.1902
No log	18.4615	480	1.3594	0.1217	1.3594	1.1659
No log	18.5385	482	1.3406	0.0887	1.3406	1.1579
No log	18.6154	484	1.4046	0.0887	1.4046	1.1852
No log	18.6923	486	1.4351	0.1219	1.4351	1.1980
No log	18.7692	488	1.5088	0.1536	1.5088	1.2283
No log	18.8462	490	1.5536	0.1283	1.5536	1.2464
No log	18.9231	492	1.5353	0.1796	1.5353	1.2391
No log	19.0	494	1.5141	0.2144	1.5141	1.2305
No log	19.0769	496	1.5101	0.2217	1.5101	1.2289
No log	19.1538	498	1.4314	0.1979	1.4314	1.1964
0.2826	19.2308	500	1.4330	0.1516	1.4330	1.1971
0.2826	19.3077	502	1.4441	0.0987	1.4441	1.2017
0.2826	19.3846	504	1.4876	0.1345	1.4876	1.2197
0.2826	19.4615	506	1.5210	0.1404	1.5210	1.2333
0.2826	19.5385	508	1.4537	0.1345	1.4537	1.2057
0.2826	19.6154	510	1.3777	0.1498	1.3777	1.1737

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1