ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2789
• Qwk: 0.0904
• Mse: 1.2789
• Rmse: 1.1309

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.6577	-0.0020	4.6577	2.1582
No log	0.0769	4	2.5107	0.0643	2.5107	1.5845
No log	0.1154	6	2.0064	0.0290	2.0064	1.4165
No log	0.1538	8	1.4312	0.0586	1.4312	1.1963
No log	0.1923	10	1.3063	0.0500	1.3063	1.1429
No log	0.2308	12	1.2142	0.2632	1.2142	1.1019
No log	0.2692	14	1.1716	0.1814	1.1716	1.0824
No log	0.3077	16	1.2162	0.2369	1.2162	1.1028
No log	0.3462	18	1.4062	0.0497	1.4062	1.1858
No log	0.3846	20	1.4840	-0.0534	1.4840	1.2182
No log	0.4231	22	1.4912	0.0169	1.4912	1.2212
No log	0.4615	24	1.4124	0.0104	1.4124	1.1884
No log	0.5	26	1.5030	0.0019	1.5030	1.2260
No log	0.5385	28	1.5546	0.0	1.5546	1.2468
No log	0.5769	30	1.6351	0.0	1.6351	1.2787
No log	0.6154	32	1.5016	0.0	1.5016	1.2254
No log	0.6538	34	1.4104	0.0	1.4104	1.1876
No log	0.6923	36	1.3316	0.1106	1.3316	1.1540
No log	0.7308	38	1.1993	0.1753	1.1993	1.0951
No log	0.7692	40	1.1671	0.1935	1.1671	1.0803
No log	0.8077	42	1.1501	0.1875	1.1501	1.0724
No log	0.8462	44	1.1864	0.1852	1.1864	1.0892
No log	0.8846	46	1.4136	0.0587	1.4136	1.1889
No log	0.9231	48	1.6892	-0.0129	1.6892	1.2997
No log	0.9615	50	1.6810	0.0185	1.6810	1.2965
No log	1.0	52	1.8495	0.0161	1.8495	1.3600
No log	1.0385	54	1.7822	0.0915	1.7822	1.3350
No log	1.0769	56	1.6778	0.0878	1.6778	1.2953
No log	1.1154	58	1.4419	0.0714	1.4419	1.2008
No log	1.1538	60	1.3523	0.0342	1.3523	1.1629
No log	1.1923	62	1.2687	0.1927	1.2687	1.1264
No log	1.2308	64	1.2671	0.1927	1.2671	1.1257
No log	1.2692	66	1.2716	0.1634	1.2716	1.1276
No log	1.3077	68	1.2841	0.1523	1.2841	1.1332
No log	1.3462	70	1.2541	0.1995	1.2541	1.1199
No log	1.3846	72	1.4342	0.1761	1.4342	1.1976
No log	1.4231	74	1.5475	0.1765	1.5475	1.2440
No log	1.4615	76	1.3893	0.1395	1.3893	1.1787
No log	1.5	78	1.2010	0.2579	1.2010	1.0959
No log	1.5385	80	1.1795	0.2577	1.1795	1.0861
No log	1.5769	82	1.2296	0.2143	1.2296	1.1089
No log	1.6154	84	1.1804	0.2942	1.1804	1.0865
No log	1.6538	86	1.1540	0.3083	1.1540	1.0742
No log	1.6923	88	1.2274	0.2444	1.2274	1.1079
No log	1.7308	90	1.1914	0.2282	1.1914	1.0915
No log	1.7692	92	1.1667	0.2653	1.1667	1.0802
No log	1.8077	94	1.2373	0.3166	1.2373	1.1123
No log	1.8462	96	1.3391	0.3163	1.3391	1.1572
No log	1.8846	98	1.3547	0.2868	1.3547	1.1639
No log	1.9231	100	1.2748	0.2733	1.2748	1.1291
No log	1.9615	102	1.3531	0.1983	1.3531	1.1632
No log	2.0	104	1.3728	0.2236	1.3728	1.1717
No log	2.0385	106	1.4548	0.2516	1.4548	1.2061
No log	2.0769	108	1.5958	0.2370	1.5958	1.2632
No log	2.1154	110	1.8070	0.1920	1.8070	1.3442
No log	2.1538	112	1.7736	0.2944	1.7736	1.3318
No log	2.1923	114	1.1955	0.3932	1.1955	1.0934
No log	2.2308	116	1.0597	0.3017	1.0597	1.0294
No log	2.2692	118	1.0731	0.2306	1.0731	1.0359
No log	2.3077	120	1.3914	0.3559	1.3914	1.1796
No log	2.3462	122	1.9337	0.1686	1.9337	1.3906
No log	2.3846	124	1.7470	0.2156	1.7470	1.3217
No log	2.4231	126	1.5553	0.3082	1.5553	1.2471
No log	2.4615	128	1.1217	0.2978	1.1217	1.0591
No log	2.5	130	1.0500	0.3069	1.0500	1.0247
No log	2.5385	132	1.0916	0.2195	1.0916	1.0448
No log	2.5769	134	1.0005	0.3018	1.0005	1.0002
No log	2.6154	136	0.9769	0.3237	0.9769	0.9884
No log	2.6538	138	1.0228	0.2496	1.0228	1.0113
No log	2.6923	140	1.3363	0.3631	1.3363	1.1560
No log	2.7308	142	1.4966	0.3835	1.4966	1.2234
No log	2.7692	144	1.6284	0.3396	1.6284	1.2761
No log	2.8077	146	1.5230	0.4019	1.5230	1.2341
No log	2.8462	148	1.2347	0.2212	1.2347	1.1112
No log	2.8846	150	1.0788	0.1775	1.0788	1.0387
No log	2.9231	152	1.0880	0.1920	1.0880	1.0431
No log	2.9615	154	1.2442	0.2958	1.2442	1.1155
No log	3.0	156	1.3502	0.3377	1.3502	1.1620
No log	3.0385	158	1.2891	0.3215	1.2891	1.1354
No log	3.0769	160	1.3196	0.3215	1.3196	1.1488
No log	3.1154	162	1.2836	0.3109	1.2836	1.1330
No log	3.1538	164	1.2267	0.2466	1.2267	1.1076
No log	3.1923	166	1.2401	0.2525	1.2401	1.1136
No log	3.2308	168	1.3588	0.3284	1.3588	1.1657
No log	3.2692	170	1.4245	0.3243	1.4245	1.1935
No log	3.3077	172	1.4135	0.2956	1.4135	1.1889
No log	3.3462	174	1.3270	0.2381	1.3270	1.1520
No log	3.3846	176	1.2882	0.1058	1.2882	1.1350
No log	3.4231	178	1.3316	0.2650	1.3316	1.1540
No log	3.4615	180	1.3596	0.2772	1.3596	1.1660
No log	3.5	182	1.4175	0.3243	1.4175	1.1906
No log	3.5385	184	1.3444	0.3243	1.3444	1.1595
No log	3.5769	186	1.2354	0.2799	1.2354	1.1115
No log	3.6154	188	1.1155	0.2650	1.1155	1.0562
No log	3.6538	190	1.0867	0.2381	1.0867	1.0424
No log	3.6923	192	1.2376	0.2895	1.2376	1.1125
No log	3.7308	194	1.3818	0.3487	1.3818	1.1755
No log	3.7692	196	1.5242	0.3358	1.5242	1.2346
No log	3.8077	198	1.3760	0.3026	1.3760	1.1730
No log	3.8462	200	1.1052	0.1557	1.1052	1.0513
No log	3.8846	202	0.9886	0.2673	0.9886	0.9943
No log	3.9231	204	0.9989	0.2947	0.9989	0.9995
No log	3.9615	206	1.2790	0.3559	1.2790	1.1309
No log	4.0	208	2.0378	0.1209	2.0378	1.4275
No log	4.0385	210	2.3205	0.0672	2.3205	1.5233
No log	4.0769	212	2.1642	0.0942	2.1642	1.4711
No log	4.1154	214	1.8181	0.2960	1.8181	1.3484
No log	4.1538	216	1.2739	0.3384	1.2739	1.1287
No log	4.1923	218	1.0418	0.3924	1.0418	1.0207
No log	4.2308	220	1.0354	0.3225	1.0354	1.0175
No log	4.2692	222	1.1240	0.3261	1.1240	1.0602
No log	4.3077	224	1.3552	0.3375	1.3552	1.1641
No log	4.3462	226	1.5743	0.2847	1.5743	1.2547
No log	4.3846	228	1.4377	0.2815	1.4377	1.1991
No log	4.4231	230	1.2151	0.2634	1.2151	1.1023
No log	4.4615	232	1.1626	0.2743	1.1626	1.0782
No log	4.5	234	1.2057	0.3001	1.2057	1.0980
No log	4.5385	236	1.2580	0.3372	1.2580	1.1216
No log	4.5769	238	1.2355	0.3341	1.2355	1.1115
No log	4.6154	240	1.1980	0.3094	1.1980	1.0945
No log	4.6538	242	1.0878	0.2154	1.0878	1.0430
No log	4.6923	244	1.0697	0.2654	1.0697	1.0343
No log	4.7308	246	1.1388	0.2978	1.1388	1.0671
No log	4.7692	248	1.3252	0.3402	1.3252	1.1512
No log	4.8077	250	1.5906	0.3829	1.5906	1.2612
No log	4.8462	252	1.5476	0.3418	1.5476	1.2440
No log	4.8846	254	1.3812	0.3261	1.3812	1.1753
No log	4.9231	256	1.2965	0.3357	1.2965	1.1387
No log	4.9615	258	1.2659	0.3357	1.2659	1.1251
No log	5.0	260	1.3059	0.3357	1.3059	1.1428
No log	5.0385	262	1.2814	0.3357	1.2814	1.1320
No log	5.0769	264	1.2195	0.2864	1.2195	1.1043
No log	5.1154	266	1.1839	0.2864	1.1839	1.0881
No log	5.1538	268	1.2549	0.3115	1.2549	1.1202
No log	5.1923	270	1.3743	0.3357	1.3743	1.1723
No log	5.2308	272	1.3353	0.3115	1.3353	1.1556
No log	5.2692	274	1.2700	0.2367	1.2700	1.1269
No log	5.3077	276	1.1989	0.2535	1.1989	1.0949
No log	5.3462	278	1.1819	0.2152	1.1819	1.0872
No log	5.3846	280	1.2113	0.2250	1.2113	1.1006
No log	5.4231	282	1.2619	0.2424	1.2619	1.1234
No log	5.4615	284	1.2544	0.2424	1.2544	1.1200
No log	5.5	286	1.2897	0.2980	1.2897	1.1357
No log	5.5385	288	1.2291	0.3024	1.2291	1.1086
No log	5.5769	290	1.1682	0.2791	1.1682	1.0809
No log	5.6154	292	1.2319	0.3158	1.2319	1.1099
No log	5.6538	294	1.3126	0.3225	1.3126	1.1457
No log	5.6923	296	1.3985	0.3225	1.3985	1.1826
No log	5.7308	298	1.3571	0.3093	1.3571	1.1649
No log	5.7692	300	1.2409	0.2184	1.2409	1.1140
No log	5.8077	302	1.2296	0.1596	1.2296	1.1089
No log	5.8462	304	1.2615	0.1596	1.2615	1.1231
No log	5.8846	306	1.2840	0.2037	1.2840	1.1331
No log	5.9231	308	1.3539	0.3071	1.3539	1.1636
No log	5.9615	310	1.3454	0.3243	1.3454	1.1599
No log	6.0	312	1.3085	0.3003	1.3085	1.1439
No log	6.0385	314	1.2379	0.2958	1.2379	1.1126
No log	6.0769	316	1.2112	0.3068	1.2112	1.1005
No log	6.1154	318	1.3347	0.3277	1.3347	1.1553
No log	6.1538	320	1.3699	0.2895	1.3699	1.1704
No log	6.1923	322	1.2147	0.2696	1.2147	1.1021
No log	6.2308	324	1.1164	0.2152	1.1164	1.0566
No log	6.2692	326	1.1214	0.2535	1.1214	1.0590
No log	6.3077	328	1.2323	0.2037	1.2323	1.1101
No log	6.3462	330	1.4560	0.2512	1.4560	1.2066
No log	6.3846	332	1.5850	0.3185	1.5850	1.2590
No log	6.4231	334	1.5504	0.3185	1.5504	1.2451
No log	6.4615	336	1.4920	0.3487	1.4920	1.2215
No log	6.5	338	1.3253	0.2895	1.3253	1.1512
No log	6.5385	340	1.2143	0.3115	1.2143	1.1019
No log	6.5769	342	1.1467	0.2978	1.1467	1.0708
No log	6.6154	344	1.1358	0.2978	1.1358	1.0657
No log	6.6538	346	1.1796	0.2837	1.1796	1.0861
No log	6.6923	348	1.3063	0.2173	1.3063	1.1429
No log	6.7308	350	1.3856	0.1345	1.3856	1.1771
No log	6.7692	352	1.3495	0.1031	1.3495	1.1617
No log	6.8077	354	1.2181	0.1538	1.2181	1.1037
No log	6.8462	356	1.0919	0.1541	1.0919	1.0449
No log	6.8846	358	1.0426	0.1662	1.0426	1.0211
No log	6.9231	360	1.0279	0.1820	1.0279	1.0138
No log	6.9615	362	1.0528	0.1911	1.0528	1.0261
No log	7.0	364	1.1604	0.2837	1.1604	1.0772
No log	7.0385	366	1.2286	0.3357	1.2286	1.1084
No log	7.0769	368	1.3072	0.2676	1.3072	1.1433
No log	7.1154	370	1.1962	0.2696	1.1962	1.0937
No log	7.1538	372	1.0886	0.2009	1.0886	1.0434
No log	7.1923	374	1.0800	0.1701	1.0800	1.0392
No log	7.2308	376	1.1260	0.2152	1.1260	1.0611
No log	7.2692	378	1.2307	0.2184	1.2307	1.1094
No log	7.3077	380	1.2698	0.2696	1.2698	1.1269
No log	7.3462	382	1.2545	0.2696	1.2545	1.1200
No log	7.3846	384	1.1776	0.2837	1.1776	1.0852
No log	7.4231	386	1.1576	0.2884	1.1576	1.0759
No log	7.4615	388	1.2056	0.3024	1.2056	1.0980
No log	7.5	390	1.2460	0.2693	1.2460	1.1162
No log	7.5385	392	1.3173	0.2833	1.3173	1.1477
No log	7.5769	394	1.2687	0.1943	1.2687	1.1263
No log	7.6154	396	1.1473	0.2152	1.1473	1.0711
No log	7.6538	398	1.0654	0.1814	1.0654	1.0322
No log	7.6923	400	1.0656	0.1919	1.0656	1.0323
No log	7.7308	402	1.1491	0.1795	1.1491	1.0720
No log	7.7692	404	1.3100	0.2173	1.3100	1.1445
No log	7.8077	406	1.3569	0.2736	1.3569	1.1649
No log	7.8462	408	1.3224	0.2736	1.3224	1.1500
No log	7.8846	410	1.1726	0.2463	1.1726	1.0829
No log	7.9231	412	1.1089	0.2377	1.1089	1.0531
No log	7.9615	414	1.1531	0.2220	1.1531	1.0738
No log	8.0	416	1.3199	0.2817	1.3199	1.1489
No log	8.0385	418	1.5057	0.2815	1.5057	1.2271
No log	8.0769	420	1.4827	0.2289	1.4827	1.2176
No log	8.1154	422	1.3491	0.2087	1.3491	1.1615
No log	8.1538	424	1.2046	0.1316	1.2046	1.0975
No log	8.1923	426	1.1425	0.1048	1.1425	1.0689
No log	8.2308	428	1.1389	0.0948	1.1389	1.0672
No log	8.2692	430	1.1758	0.0880	1.1758	1.0844
No log	8.3077	432	1.2748	0.1637	1.2748	1.1291
No log	8.3462	434	1.3727	0.2484	1.3727	1.1716
No log	8.3846	436	1.3723	0.2484	1.3723	1.1715
No log	8.4231	438	1.3574	0.2761	1.3574	1.1651
No log	8.4615	440	1.3244	0.2761	1.3244	1.1508
No log	8.5	442	1.2957	0.2238	1.2957	1.1383
No log	8.5385	444	1.3438	0.2761	1.3438	1.1592
No log	8.5769	446	1.4323	0.2512	1.4323	1.1968
No log	8.6154	448	1.3717	0.2373	1.3717	1.1712
No log	8.6538	450	1.2708	0.2484	1.2708	1.1273
No log	8.6923	452	1.2603	0.2484	1.2603	1.1226
No log	8.7308	454	1.2535	0.2761	1.2535	1.1196
No log	8.7692	456	1.3324	0.2910	1.3324	1.1543
No log	8.8077	458	1.3134	0.3093	1.3134	1.1461
No log	8.8462	460	1.3261	0.3093	1.3261	1.1516
No log	8.8846	462	1.3299	0.2844	1.3299	1.1532
No log	8.9231	464	1.3301	0.2817	1.3301	1.1533
No log	8.9615	466	1.2945	0.2484	1.2945	1.1378
No log	9.0	468	1.2298	0.0980	1.2298	1.1090
No log	9.0385	470	1.2370	0.0980	1.2370	1.1122
No log	9.0769	472	1.2716	0.1894	1.2716	1.1277
No log	9.1154	474	1.2891	0.2278	1.2891	1.1354
No log	9.1538	476	1.2799	0.2553	1.2799	1.1313
No log	9.1923	478	1.1983	0.2348	1.1983	1.0947
No log	9.2308	480	1.1807	0.1148	1.1807	1.0866
No log	9.2692	482	1.2594	0.2278	1.2594	1.1222
No log	9.3077	484	1.4357	0.2704	1.4357	1.1982
No log	9.3462	486	1.4763	0.2941	1.4763	1.2150
No log	9.3846	488	1.3935	0.2870	1.3935	1.1805
No log	9.4231	490	1.4116	0.2201	1.4116	1.1881
No log	9.4615	492	1.4288	0.1708	1.4288	1.1953
No log	9.5	494	1.4067	0.2201	1.4067	1.1861
No log	9.5385	496	1.4281	0.2457	1.4281	1.1950
No log	9.5769	498	1.3919	0.2489	1.3919	1.1798
0.381	9.6154	500	1.3379	0.3363	1.3379	1.1567
0.381	9.6538	502	1.2957	0.2870	1.2957	1.1383
0.381	9.6923	504	1.4281	0.2964	1.4281	1.1950
0.381	9.7308	506	1.5195	0.2731	1.5195	1.2327
0.381	9.7692	508	1.4301	0.1844	1.4301	1.1959
0.381	9.8077	510	1.2789	0.0904	1.2789	1.1309

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1