ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3881
• Qwk: 0.0778
• Mse: 1.3881
• Rmse: 1.1782

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	4.6913	0.0010	4.6913	2.1660
No log	0.4444	4	2.6838	-0.0030	2.6838	1.6382
No log	0.6667	6	2.1220	-0.0575	2.1220	1.4567
No log	0.8889	8	2.5649	-0.0821	2.5649	1.6015
No log	1.1111	10	1.9641	-0.0213	1.9641	1.4015
No log	1.3333	12	1.4317	-0.0422	1.4317	1.1966
No log	1.5556	14	1.3325	0.1171	1.3325	1.1544
No log	1.7778	16	1.4383	0.0038	1.4383	1.1993
No log	2.0	18	1.7189	0.0169	1.7189	1.3111
No log	2.2222	20	1.6416	0.0169	1.6416	1.2813
No log	2.4444	22	1.3121	0.0984	1.3121	1.1455
No log	2.6667	24	1.4323	0.0613	1.4323	1.1968
No log	2.8889	26	1.8864	0.0058	1.8864	1.3734
No log	3.1111	28	2.0988	0.0644	2.0988	1.4487
No log	3.3333	30	1.5234	-0.0412	1.5234	1.2342
No log	3.5556	32	1.2694	0.1507	1.2694	1.1267
No log	3.7778	34	1.2699	0.1307	1.2699	1.1269
No log	4.0	36	1.2946	0.1335	1.2946	1.1378
No log	4.2222	38	1.3284	0.0314	1.3284	1.1526
No log	4.4444	40	1.3314	0.0777	1.3314	1.1539
No log	4.6667	42	1.3096	0.2085	1.3096	1.1444
No log	4.8889	44	1.2818	0.1880	1.2818	1.1322
No log	5.1111	46	1.2388	0.0855	1.2388	1.1130
No log	5.3333	48	1.2334	0.1113	1.2334	1.1106
No log	5.5556	50	1.2317	0.1628	1.2317	1.1098
No log	5.7778	52	1.2726	0.0653	1.2726	1.1281
No log	6.0	54	1.2779	0.0682	1.2779	1.1304
No log	6.2222	56	1.2487	0.1048	1.2487	1.1175
No log	6.4444	58	1.2548	0.1048	1.2548	1.1202
No log	6.6667	60	1.2400	0.0983	1.2400	1.1135
No log	6.8889	62	1.2250	0.1370	1.2250	1.1068
No log	7.1111	64	1.2236	0.1530	1.2236	1.1062
No log	7.3333	66	1.2368	0.0556	1.2368	1.1121
No log	7.5556	68	1.3680	0.1745	1.3680	1.1696
No log	7.7778	70	1.3954	0.1440	1.3954	1.1813
No log	8.0	72	1.3188	0.1807	1.3188	1.1484
No log	8.2222	74	1.2438	0.1727	1.2438	1.1153
No log	8.4444	76	1.4020	0.2180	1.4020	1.1841
No log	8.6667	78	1.3385	0.2222	1.3385	1.1569
No log	8.8889	80	1.2214	0.1406	1.2214	1.1052
No log	9.1111	82	1.2813	0.1559	1.2813	1.1320
No log	9.3333	84	1.3271	0.1857	1.3271	1.1520
No log	9.5556	86	1.2904	0.1429	1.2904	1.1360
No log	9.7778	88	1.2330	0.1935	1.2330	1.1104
No log	10.0	90	1.3491	0.2247	1.3491	1.1615
No log	10.2222	92	1.3207	0.2290	1.3207	1.1492
No log	10.4444	94	1.3248	0.1063	1.3248	1.1510
No log	10.6667	96	1.5875	0.2039	1.5875	1.2600
No log	10.8889	98	1.7183	0.1391	1.7183	1.3108
No log	11.1111	100	1.6054	0.1765	1.6054	1.2670
No log	11.3333	102	1.4658	0.1678	1.4658	1.2107
No log	11.5556	104	1.4368	0.1395	1.4368	1.1987
No log	11.7778	106	1.4373	0.1395	1.4373	1.1989
No log	12.0	108	1.4585	0.1395	1.4585	1.2077
No log	12.2222	110	1.4872	0.1628	1.4872	1.2195
No log	12.4444	112	1.4857	0.0952	1.4857	1.2189
No log	12.6667	114	1.5361	0.1685	1.5361	1.2394
No log	12.8889	116	1.6140	0.1255	1.6140	1.2704
No log	13.1111	118	1.5155	0.0732	1.5155	1.2311
No log	13.3333	120	1.4932	0.0564	1.4932	1.2220
No log	13.5556	122	1.5456	0.1418	1.5456	1.2432
No log	13.7778	124	1.6817	0.1024	1.6817	1.2968
No log	14.0	126	1.5840	0.1901	1.5840	1.2586
No log	14.2222	128	1.4521	0.0399	1.4521	1.2050
No log	14.4444	130	1.2964	0.0620	1.2964	1.1386
No log	14.6667	132	1.2627	0.0964	1.2627	1.1237
No log	14.8889	134	1.3176	0.1058	1.3176	1.1478
No log	15.1111	136	1.4591	0.1427	1.4591	1.2080
No log	15.3333	138	1.4809	0.2503	1.4809	1.2169
No log	15.5556	140	1.4970	0.2069	1.4970	1.2235
No log	15.7778	142	1.4098	0.2163	1.4098	1.1873
No log	16.0	144	1.3594	0.2518	1.3594	1.1659
No log	16.2222	146	1.3768	0.2549	1.3768	1.1734
No log	16.4444	148	1.5441	0.2055	1.5441	1.2426
No log	16.6667	150	1.7106	0.2597	1.7106	1.3079
No log	16.8889	152	1.7345	0.2310	1.7345	1.3170
No log	17.1111	154	1.6246	0.2120	1.6246	1.2746
No log	17.3333	156	1.4426	0.2498	1.4426	1.2011
No log	17.5556	158	1.3576	0.2791	1.3576	1.1651
No log	17.7778	160	1.4650	0.2172	1.4650	1.2104
No log	18.0	162	1.7179	0.2564	1.7179	1.3107
No log	18.2222	164	1.8133	0.2305	1.8133	1.3466
No log	18.4444	166	1.7037	0.1709	1.7037	1.3053
No log	18.6667	168	1.5203	0.2632	1.5203	1.2330
No log	18.8889	170	1.3859	0.1461	1.3859	1.1772
No log	19.1111	172	1.3810	0.1461	1.3810	1.1751
No log	19.3333	174	1.4772	0.2359	1.4772	1.2154
No log	19.5556	176	1.5232	0.1929	1.5232	1.2342
No log	19.7778	178	1.5604	0.1802	1.5604	1.2492
No log	20.0	180	1.5549	0.2144	1.5549	1.2469
No log	20.2222	182	1.4556	0.0603	1.4556	1.2065
No log	20.4444	184	1.3643	0.0811	1.3643	1.1681
No log	20.6667	186	1.3470	0.1152	1.3470	1.1606
No log	20.8889	188	1.3902	0.1219	1.3902	1.1791
No log	21.1111	190	1.5215	0.2275	1.5215	1.2335
No log	21.3333	192	1.5509	0.1756	1.5509	1.2453
No log	21.5556	194	1.5099	0.1935	1.5099	1.2288
No log	21.7778	196	1.4755	0.2115	1.4755	1.2147
No log	22.0	198	1.3991	0.2250	1.3991	1.1828
No log	22.2222	200	1.4444	0.2115	1.4444	1.2018
No log	22.4444	202	1.4596	0.2424	1.4596	1.2081
No log	22.6667	204	1.5850	0.2084	1.5850	1.2590
No log	22.8889	206	1.7487	0.2222	1.7487	1.3224
No log	23.1111	208	1.7558	0.2419	1.7558	1.3251
No log	23.3333	210	1.6073	0.1997	1.6073	1.2678
No log	23.5556	212	1.3976	0.2337	1.3976	1.1822
No log	23.7778	214	1.3441	0.2074	1.3441	1.1594
No log	24.0	216	1.4277	0.2065	1.4277	1.1949
No log	24.2222	218	1.5280	0.2424	1.5280	1.2361
No log	24.4444	220	1.5234	0.2424	1.5234	1.2343
No log	24.6667	222	1.6493	0.1657	1.6493	1.2843
No log	24.8889	224	1.6764	0.1987	1.6764	1.2947
No log	25.1111	226	1.4989	0.2685	1.4989	1.2243
No log	25.3333	228	1.3925	0.2676	1.3925	1.1801
No log	25.5556	230	1.3883	0.2676	1.3883	1.1783
No log	25.7778	232	1.4261	0.2574	1.4261	1.1942
No log	26.0	234	1.4796	0.3026	1.4796	1.2164
No log	26.2222	236	1.4183	0.2574	1.4183	1.1909
No log	26.4444	238	1.3403	0.1935	1.3403	1.1577
No log	26.6667	240	1.2377	0.0658	1.2377	1.1125
No log	26.8889	242	1.2332	0.1063	1.2332	1.1105
No log	27.1111	244	1.3240	0.2074	1.3240	1.1507
No log	27.3333	246	1.5909	0.3317	1.5909	1.2613
No log	27.5556	248	1.8867	0.1720	1.8867	1.3736
No log	27.7778	250	1.9066	0.1439	1.9066	1.3808
No log	28.0	252	1.7520	0.1672	1.7520	1.3236
No log	28.2222	254	1.5182	0.2099	1.5182	1.2321
No log	28.4444	256	1.4195	0.2173	1.4195	1.1914
No log	28.6667	258	1.4374	0.2559	1.4374	1.1989
No log	28.8889	260	1.5502	0.2099	1.5502	1.2451
No log	29.1111	262	1.6829	0.1810	1.6829	1.2973
No log	29.3333	264	1.6797	0.1736	1.6797	1.2960
No log	29.5556	266	1.6126	0.2964	1.6126	1.2699
No log	29.7778	268	1.4812	0.1844	1.4812	1.2170
No log	30.0	270	1.3825	0.1989	1.3825	1.1758
No log	30.2222	272	1.3801	0.1989	1.3801	1.1748
No log	30.4444	274	1.4677	0.2122	1.4677	1.2115
No log	30.6667	276	1.5411	0.2918	1.5411	1.2414
No log	30.8889	278	1.6007	0.2964	1.6007	1.2652
No log	31.1111	280	1.5653	0.2918	1.5653	1.2511
No log	31.3333	282	1.4383	0.2032	1.4383	1.1993
No log	31.5556	284	1.3667	0.1519	1.3667	1.1691
No log	31.7778	286	1.3888	0.1519	1.3888	1.1785
No log	32.0	288	1.4584	0.1844	1.4584	1.2076
No log	32.2222	290	1.5980	0.1758	1.5980	1.2641
No log	32.4444	292	1.6654	0.2455	1.6654	1.2905
No log	32.6667	294	1.6607	0.2455	1.6607	1.2887
No log	32.8889	296	1.5454	0.2065	1.5454	1.2431
No log	33.1111	298	1.4872	0.1516	1.4872	1.2195
No log	33.3333	300	1.4363	0.1801	1.4363	1.1984
No log	33.5556	302	1.4558	0.2065	1.4558	1.2066
No log	33.7778	304	1.5746	0.3254	1.5746	1.2548
No log	34.0	306	1.7723	0.2419	1.7723	1.3313
No log	34.2222	308	1.8357	0.1978	1.8357	1.3549
No log	34.4444	310	1.7247	0.2366	1.7247	1.3133
No log	34.6667	312	1.5535	0.1547	1.5535	1.2464
No log	34.8889	314	1.4963	0.2065	1.4963	1.2232
No log	35.1111	316	1.5132	0.2144	1.5132	1.2301
No log	35.3333	318	1.5148	0.2325	1.5148	1.2308
No log	35.5556	320	1.5816	0.2863	1.5816	1.2576
No log	35.7778	322	1.5933	0.3086	1.5933	1.2623
No log	36.0	324	1.5491	0.2839	1.5491	1.2446
No log	36.2222	326	1.4705	0.2359	1.4705	1.2126
No log	36.4444	328	1.3751	0.2065	1.3751	1.1727
No log	36.6667	330	1.3513	0.2065	1.3513	1.1624
No log	36.8889	332	1.3766	0.2065	1.3766	1.1733
No log	37.1111	334	1.4952	0.2839	1.4952	1.2228
No log	37.3333	336	1.6003	0.3123	1.6003	1.2650
No log	37.5556	338	1.6047	0.2759	1.6047	1.2667
No log	37.7778	340	1.5229	0.3067	1.5229	1.2341
No log	38.0	342	1.4905	0.2839	1.4905	1.2208
No log	38.2222	344	1.3976	0.2604	1.3976	1.1822
No log	38.4444	346	1.3491	0.2424	1.3491	1.1615
No log	38.6667	348	1.3073	0.2173	1.3073	1.1434
No log	38.8889	350	1.3607	0.2201	1.3607	1.1665
No log	39.1111	352	1.3786	0.2544	1.3786	1.1741
No log	39.3333	354	1.4132	0.2544	1.4132	1.1888
No log	39.5556	356	1.4661	0.2789	1.4661	1.2108
No log	39.7778	358	1.4776	0.2789	1.4776	1.2156
No log	40.0	360	1.4552	0.2544	1.4552	1.2063
No log	40.2222	362	1.4458	0.1748	1.4458	1.2024
No log	40.4444	364	1.4271	0.1748	1.4271	1.1946
No log	40.6667	366	1.4364	0.1748	1.4364	1.1985
No log	40.8889	368	1.4365	0.1748	1.4365	1.1986
No log	41.1111	370	1.4272	0.2289	1.4272	1.1947
No log	41.3333	372	1.3878	0.1748	1.3878	1.1781
No log	41.5556	374	1.3771	0.2024	1.3771	1.1735
No log	41.7778	376	1.4012	0.2325	1.4012	1.1837
No log	42.0	378	1.5256	0.2908	1.5256	1.2352
No log	42.2222	380	1.6559	0.2989	1.6559	1.2868
No log	42.4444	382	1.6783	0.2989	1.6783	1.2955
No log	42.6667	384	1.6973	0.2644	1.6973	1.3028
No log	42.8889	386	1.5955	0.2970	1.5955	1.2631
No log	43.1111	388	1.5525	0.2514	1.5525	1.2460
No log	43.3333	390	1.5592	0.2659	1.5592	1.2487
No log	43.5556	392	1.6173	0.2514	1.6173	1.2717
No log	43.7778	394	1.6718	0.1845	1.6718	1.2930
No log	44.0	396	1.7267	0.2564	1.7267	1.3140
No log	44.2222	398	1.6969	0.2310	1.6969	1.3026
No log	44.4444	400	1.6040	0.2485	1.6040	1.2665
No log	44.6667	402	1.5061	0.2512	1.5061	1.2272
No log	44.8889	404	1.4033	0.1748	1.4033	1.1846
No log	45.1111	406	1.3226	0.1573	1.3226	1.1500
No log	45.3333	408	1.3352	0.1573	1.3352	1.1555
No log	45.5556	410	1.4051	0.1748	1.4051	1.1854
No log	45.7778	412	1.5634	0.2604	1.5634	1.2504
No log	46.0	414	1.7668	0.2540	1.7668	1.3292
No log	46.2222	416	1.8249	0.2393	1.8249	1.3509
No log	46.4444	418	1.7281	0.2515	1.7281	1.3146
No log	46.6667	420	1.5668	0.2359	1.5668	1.2517
No log	46.8889	422	1.4492	0.2024	1.4492	1.2038
No log	47.1111	424	1.3979	0.1748	1.3979	1.1823
No log	47.3333	426	1.4018	0.2024	1.4018	1.1840
No log	47.5556	428	1.4649	0.2024	1.4649	1.2104
No log	47.7778	430	1.5496	0.2839	1.5496	1.2448
No log	48.0	432	1.5563	0.2574	1.5563	1.2475
No log	48.2222	434	1.5055	0.2024	1.5055	1.2270
No log	48.4444	436	1.4955	0.1461	1.4955	1.2229
No log	48.6667	438	1.5165	0.1748	1.5165	1.2315
No log	48.8889	440	1.5400	0.2574	1.5400	1.2410
No log	49.1111	442	1.5646	0.2574	1.5646	1.2508
No log	49.3333	444	1.5571	0.2574	1.5571	1.2478
No log	49.5556	446	1.5316	0.2065	1.5316	1.2376
No log	49.7778	448	1.4959	0.1980	1.4959	1.2231
No log	50.0	450	1.4261	0.1098	1.4261	1.1942
No log	50.2222	452	1.4346	0.1098	1.4346	1.1977
No log	50.4444	454	1.4861	0.1162	1.4861	1.2191
No log	50.6667	456	1.5299	0.1929	1.5299	1.2369
No log	50.8889	458	1.5832	0.2009	1.5832	1.2582
No log	51.1111	460	1.5846	0.2084	1.5846	1.2588
No log	51.3333	462	1.5972	0.2514	1.5972	1.2638
No log	51.5556	464	1.5360	0.2084	1.5360	1.2394
No log	51.7778	466	1.4720	0.2009	1.4720	1.2132
No log	52.0	468	1.4068	0.2512	1.4068	1.1861
No log	52.2222	470	1.4362	0.2359	1.4362	1.1984
No log	52.4444	472	1.5381	0.2711	1.5381	1.2402
No log	52.6667	474	1.5849	0.2908	1.5849	1.2589
No log	52.8889	476	1.5475	0.2908	1.5475	1.2440
No log	53.1111	478	1.4518	0.2815	1.4518	1.2049
No log	53.3333	480	1.4307	0.2789	1.4307	1.1961
No log	53.5556	482	1.4092	0.2201	1.4092	1.1871
No log	53.7778	484	1.3392	0.2163	1.3392	1.1573
No log	54.0	486	1.3172	0.2163	1.3172	1.1477
No log	54.2222	488	1.3211	0.2213	1.3211	1.1494
No log	54.4444	490	1.3422	0.2024	1.3422	1.1585
No log	54.6667	492	1.3916	0.2024	1.3916	1.1797
No log	54.8889	494	1.4750	0.2024	1.4750	1.2145
No log	55.1111	496	1.5324	0.2325	1.5324	1.2379
No log	55.3333	498	1.5251	0.2392	1.5251	1.2349
0.2839	55.5556	500	1.4964	0.1667	1.4964	1.2233
0.2839	55.7778	502	1.4416	0.2024	1.4416	1.2007
0.2839	56.0	504	1.3622	0.0759	1.3622	1.1672
0.2839	56.2222	506	1.3219	0.0090	1.3219	1.1497
0.2839	56.4444	508	1.3233	0.0090	1.3233	1.1503
0.2839	56.6667	510	1.3622	0.0668	1.3622	1.1671
0.2839	56.8889	512	1.4177	0.1848	1.4177	1.1907
0.2839	57.1111	514	1.4492	0.1848	1.4492	1.2038
0.2839	57.3333	516	1.4285	0.1570	1.4285	1.1952
0.2839	57.5556	518	1.4329	0.1570	1.4329	1.1970
0.2839	57.7778	520	1.4556	0.1570	1.4556	1.2065
0.2839	58.0	522	1.4726	0.1848	1.4726	1.2135
0.2839	58.2222	524	1.5164	0.1935	1.5164	1.2314
0.2839	58.4444	526	1.5648	0.1667	1.5648	1.2509
0.2839	58.6667	528	1.5589	0.1667	1.5589	1.2486
0.2839	58.8889	530	1.5081	0.2024	1.5081	1.2281
0.2839	59.1111	532	1.4455	0.2024	1.4455	1.2023
0.2839	59.3333	534	1.4460	0.1748	1.4460	1.2025
0.2839	59.5556	536	1.4697	0.2024	1.4697	1.2123
0.2839	59.7778	538	1.5117	0.2024	1.5117	1.2295
0.2839	60.0	540	1.5251	0.2024	1.5251	1.2350
0.2839	60.2222	542	1.5390	0.1842	1.5390	1.2406
0.2839	60.4444	544	1.5768	0.1336	1.5768	1.2557
0.2839	60.6667	546	1.5724	0.1713	1.5724	1.2540
0.2839	60.8889	548	1.5402	0.1447	1.5402	1.2410
0.2839	61.1111	550	1.4506	0.1646	1.4506	1.2044
0.2839	61.3333	552	1.3735	0.0778	1.3735	1.1720
0.2839	61.5556	554	1.3617	0.0778	1.3617	1.1669
0.2839	61.7778	556	1.3881	0.0778	1.3881	1.1782

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1