ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3181
• Qwk: 0.0541
• Mse: 1.3181
• Rmse: 1.1481

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.6960	-0.0020	4.6960	2.1670
No log	0.0769	4	2.7224	0.0066	2.7224	1.6500
No log	0.1154	6	2.2119	0.0143	2.2119	1.4873
No log	0.1538	8	1.4216	0.0672	1.4216	1.1923
No log	0.1923	10	1.2522	0.1111	1.2522	1.1190
No log	0.2308	12	1.1852	0.2464	1.1852	1.0887
No log	0.2692	14	1.2144	0.1278	1.2144	1.1020
No log	0.3077	16	1.3346	0.0506	1.3346	1.1552
No log	0.3462	18	1.6382	-0.0368	1.6382	1.2799
No log	0.3846	20	1.6307	-0.0534	1.6307	1.2770
No log	0.4231	22	1.4529	0.0104	1.4529	1.2054
No log	0.4615	24	1.3436	0.0803	1.3436	1.1591
No log	0.5	26	1.4716	0.0426	1.4716	1.2131
No log	0.5385	28	1.6848	0.0	1.6848	1.2980
No log	0.5769	30	1.9563	0.0	1.9563	1.3987
No log	0.6154	32	1.8004	0.0	1.8004	1.3418
No log	0.6538	34	1.5166	0.0	1.5166	1.2315
No log	0.6923	36	1.3847	0.0317	1.3847	1.1767
No log	0.7308	38	1.2401	0.1696	1.2401	1.1136
No log	0.7692	40	1.2002	0.2223	1.2002	1.0955
No log	0.8077	42	1.1798	0.2678	1.1798	1.0862
No log	0.8462	44	1.2369	0.1927	1.2369	1.1121
No log	0.8846	46	1.5320	0.0987	1.5320	1.2377
No log	0.9231	48	1.7679	0.0477	1.7679	1.3296
No log	0.9615	50	1.7088	0.0331	1.7088	1.3072
No log	1.0	52	1.7000	0.0750	1.7000	1.3038
No log	1.0385	54	1.5727	0.0625	1.5727	1.2541
No log	1.0769	56	1.5488	0.1076	1.5488	1.2445
No log	1.1154	58	1.3969	0.0926	1.3969	1.1819
No log	1.1538	60	1.3417	0.1076	1.3417	1.1583
No log	1.1923	62	1.1827	0.2439	1.1827	1.0875
No log	1.2308	64	1.1212	0.2636	1.1212	1.0589
No log	1.2692	66	1.1221	0.2678	1.1221	1.0593
No log	1.3077	68	1.1301	0.2097	1.1301	1.0631
No log	1.3462	70	1.1782	0.1444	1.1782	1.0854
No log	1.3846	72	1.1583	0.1278	1.1583	1.0762
No log	1.4231	74	1.1163	0.1767	1.1163	1.0566
No log	1.4615	76	1.0995	0.2843	1.0995	1.0486
No log	1.5	78	1.1165	0.1817	1.1165	1.0566
No log	1.5385	80	1.1059	0.1609	1.1059	1.0516
No log	1.5769	82	1.1660	0.2976	1.1660	1.0798
No log	1.6154	84	1.5473	0.2489	1.5473	1.2439
No log	1.6538	86	1.4952	0.2210	1.4952	1.2228
No log	1.6923	88	1.1919	0.3285	1.1919	1.0917
No log	1.7308	90	1.1883	0.2993	1.1883	1.0901
No log	1.7692	92	1.1887	0.2630	1.1887	1.0903
No log	1.8077	94	1.1561	0.3200	1.1561	1.0752
No log	1.8462	96	1.4132	0.2095	1.4132	1.1888
No log	1.8846	98	1.4309	0.2673	1.4309	1.1962
No log	1.9231	100	1.3135	0.1857	1.3135	1.1461
No log	1.9615	102	1.2244	0.2235	1.2244	1.1065
No log	2.0	104	1.2187	0.2195	1.2187	1.1040
No log	2.0385	106	1.2383	0.2235	1.2383	1.1128
No log	2.0769	108	1.3406	0.2503	1.3406	1.1578
No log	2.1154	110	1.4715	0.2328	1.4715	1.2131
No log	2.1538	112	1.6235	0.2100	1.6235	1.2742
No log	2.1923	114	1.4191	0.2191	1.4191	1.1913
No log	2.2308	116	1.2959	0.2830	1.2959	1.1384
No log	2.2692	118	1.3940	0.1151	1.3940	1.1807
No log	2.3077	120	1.3756	0.2125	1.3756	1.1728
No log	2.3462	122	1.6451	0.1670	1.6451	1.2826
No log	2.3846	124	1.9225	0.1561	1.9225	1.3865
No log	2.4231	126	1.8529	0.1914	1.8529	1.3612
No log	2.4615	128	1.5191	0.1929	1.5191	1.2325
No log	2.5	130	1.2784	0.1525	1.2784	1.1307
No log	2.5385	132	1.2331	0.1212	1.2331	1.1104
No log	2.5769	134	1.2731	0.1183	1.2731	1.1283
No log	2.6154	136	1.2987	0.1379	1.2987	1.1396
No log	2.6538	138	1.2285	0.1405	1.2285	1.1084
No log	2.6923	140	1.2249	0.1405	1.2249	1.1067
No log	2.7308	142	1.2821	0.3024	1.2821	1.1323
No log	2.7692	144	1.5576	0.0948	1.5576	1.2481
No log	2.8077	146	1.8567	0.1176	1.8567	1.3626
No log	2.8462	148	1.7607	0.2112	1.7607	1.3269
No log	2.8846	150	1.4882	0.3238	1.4882	1.2199
No log	2.9231	152	1.2959	0.2889	1.2959	1.1384
No log	2.9615	154	1.1947	0.1379	1.1947	1.0930
No log	3.0	156	1.1998	0.1582	1.1998	1.0954
No log	3.0385	158	1.2345	0.1379	1.2345	1.1111
No log	3.0769	160	1.2498	0.1281	1.2498	1.1179
No log	3.1154	162	1.2242	0.1053	1.2242	1.1064
No log	3.1538	164	1.2155	0.1406	1.2155	1.1025
No log	3.1923	166	1.2368	0.1149	1.2368	1.1121
No log	3.2308	168	1.2490	0.0827	1.2490	1.1176
No log	3.2692	170	1.3060	0.1903	1.3060	1.1428
No log	3.3077	172	1.3491	0.2236	1.3491	1.1615
No log	3.3462	174	1.3010	0.2143	1.3010	1.1406
No log	3.3846	176	1.2601	0.1920	1.2601	1.1225
No log	3.4231	178	1.3111	0.2525	1.3111	1.1450
No log	3.4615	180	1.4481	0.2593	1.4481	1.2034
No log	3.5	182	1.3553	0.1995	1.3553	1.1642
No log	3.5385	184	1.2319	0.2165	1.2319	1.1099
No log	3.5769	186	1.1862	0.2079	1.1862	1.0891
No log	3.6154	188	1.2172	0.2260	1.2172	1.1033
No log	3.6538	190	1.4405	0.2775	1.4405	1.2002
No log	3.6923	192	1.4908	0.2759	1.4908	1.2210
No log	3.7308	194	1.3166	0.2330	1.3166	1.1474
No log	3.7692	196	1.1400	0.2231	1.1400	1.0677
No log	3.8077	198	1.1396	0.1845	1.1396	1.0675
No log	3.8462	200	1.1351	0.1307	1.1351	1.0654
No log	3.8846	202	1.1587	0.1801	1.1587	1.0764
No log	3.9231	204	1.2094	0.1596	1.2094	1.0997
No log	3.9615	206	1.2264	0.1596	1.2264	1.1074
No log	4.0	208	1.2240	0.1500	1.2240	1.1063
No log	4.0385	210	1.2415	0.1903	1.2415	1.1142
No log	4.0769	212	1.2259	0.2015	1.2259	1.1072
No log	4.1154	214	1.2485	0.1920	1.2485	1.1174
No log	4.1538	216	1.2666	0.2206	1.2666	1.1254
No log	4.1923	218	1.3402	0.1995	1.3402	1.1577
No log	4.2308	220	1.4369	0.2886	1.4369	1.1987
No log	4.2692	222	1.5147	0.3123	1.5147	1.2307
No log	4.3077	224	1.4450	0.2886	1.4450	1.2021
No log	4.3462	226	1.3656	0.0920	1.3656	1.1686
No log	4.3846	228	1.3093	0.1903	1.3093	1.1442
No log	4.4231	230	1.2892	0.1026	1.2892	1.1354
No log	4.4615	232	1.3307	0.1031	1.3307	1.1536
No log	4.5	234	1.3426	0.1031	1.3426	1.1587
No log	4.5385	236	1.2985	0.0702	1.2985	1.1395
No log	4.5769	238	1.2822	0.0702	1.2822	1.1324
No log	4.6154	240	1.2623	0.1020	1.2623	1.1235
No log	4.6538	242	1.2784	0.1282	1.2784	1.1307
No log	4.6923	244	1.3207	0.1031	1.3207	1.1492
No log	4.7308	246	1.3099	0.1896	1.3099	1.1445
No log	4.7692	248	1.2541	0.2195	1.2541	1.1199
No log	4.8077	250	1.1715	0.1959	1.1715	1.0824
No log	4.8462	252	1.1264	0.1864	1.1264	1.0613
No log	4.8846	254	1.1321	0.1959	1.1321	1.0640
No log	4.9231	256	1.2210	0.3167	1.2210	1.1050
No log	4.9615	258	1.2771	0.3183	1.2771	1.1301
No log	5.0	260	1.2569	0.2678	1.2569	1.1211
No log	5.0385	262	1.2014	0.1440	1.2014	1.0961
No log	5.0769	264	1.2103	0.2519	1.2103	1.1001
No log	5.1154	266	1.2797	0.3183	1.2797	1.1312
No log	5.1538	268	1.3293	0.2815	1.3293	1.1529
No log	5.1923	270	1.2648	0.2935	1.2648	1.1246
No log	5.2308	272	1.1681	0.2000	1.1681	1.0808
No log	5.2692	274	1.1705	0.2000	1.1705	1.0819
No log	5.3077	276	1.1664	0.2207	1.1664	1.0800
No log	5.3462	278	1.1996	0.1219	1.1996	1.0953
No log	5.3846	280	1.2310	0.1219	1.2310	1.1095
No log	5.4231	282	1.2135	0.1696	1.2135	1.1016
No log	5.4615	284	1.1576	0.2164	1.1576	1.0759
No log	5.5	286	1.1669	0.2164	1.1669	1.0802
No log	5.5385	288	1.2222	0.2195	1.2222	1.1055
No log	5.5769	290	1.3383	0.3174	1.3383	1.1568
No log	5.6154	292	1.4167	0.3105	1.4167	1.1902
No log	5.6538	294	1.5574	0.2620	1.5574	1.2480
No log	5.6923	296	1.6012	0.2847	1.6012	1.2654
No log	5.7308	298	1.4365	0.2863	1.4365	1.1985
No log	5.7692	300	1.2449	0.1889	1.2449	1.1158
No log	5.8077	302	1.1571	0.2207	1.1571	1.0757
No log	5.8462	304	1.1473	0.1582	1.1473	1.0711
No log	5.8846	306	1.1639	0.1902	1.1639	1.0789
No log	5.9231	308	1.2150	0.1219	1.2150	1.1023
No log	5.9615	310	1.2579	0.1219	1.2579	1.1216
No log	6.0	312	1.2688	0.2051	1.2688	1.1264
No log	6.0385	314	1.2766	0.2108	1.2766	1.1299
No log	6.0769	316	1.2787	0.1903	1.2787	1.1308
No log	6.1154	318	1.2998	0.2000	1.2998	1.1401
No log	6.1538	320	1.2988	0.2343	1.2988	1.1397
No log	6.1923	322	1.3642	0.2074	1.3642	1.1680
No log	6.2308	324	1.4108	0.1708	1.4108	1.1878
No log	6.2692	326	1.3766	0.2553	1.3766	1.1733
No log	6.3077	328	1.2711	0.1747	1.2711	1.1274
No log	6.3462	330	1.2665	0.1747	1.2665	1.1254
No log	6.3846	332	1.2396	0.1747	1.2396	1.1134
No log	6.4231	334	1.2549	0.1747	1.2549	1.1202
No log	6.4615	336	1.3732	0.1592	1.3732	1.1718
No log	6.5	338	1.4868	0.2424	1.4868	1.2193
No log	6.5385	340	1.4258	0.2763	1.4258	1.1941
No log	6.5769	342	1.2867	0.1991	1.2867	1.1343
No log	6.6154	344	1.2190	0.1316	1.2190	1.1041
No log	6.6538	346	1.1719	0.0980	1.1719	1.0825
No log	6.6923	348	1.1661	0.0904	1.1661	1.0799
No log	6.7308	350	1.1719	0.0980	1.1719	1.0825
No log	6.7692	352	1.1654	0.1148	1.1654	1.0796
No log	6.8077	354	1.1451	0.1747	1.1451	1.0701
No log	6.8462	356	1.1264	0.1747	1.1264	1.0613
No log	6.8846	358	1.1280	0.1645	1.1280	1.0621
No log	6.9231	360	1.1401	0.1645	1.1401	1.0677
No log	6.9615	362	1.1719	0.1961	1.1719	1.0826
No log	7.0	364	1.2231	0.1795	1.2231	1.1060
No log	7.0385	366	1.2052	0.2207	1.2052	1.0978
No log	7.0769	368	1.1610	0.2263	1.1610	1.0775
No log	7.1154	370	1.1585	0.2263	1.1585	1.0763
No log	7.1538	372	1.1962	0.1795	1.1962	1.0937
No log	7.1923	374	1.2334	0.2278	1.2334	1.1106
No log	7.2308	376	1.2238	0.2278	1.2238	1.1063
No log	7.2692	378	1.1872	0.2152	1.1872	1.0896
No log	7.3077	380	1.1758	0.2363	1.1758	1.0843
No log	7.3462	382	1.1793	0.2152	1.1793	1.0860
No log	7.3846	384	1.1735	0.2152	1.1735	1.0833
No log	7.4231	386	1.1802	0.2152	1.1802	1.0864
No log	7.4615	388	1.2104	0.2275	1.2104	1.1002
No log	7.5	390	1.2253	0.2424	1.2253	1.1069
No log	7.5385	392	1.1566	0.2363	1.1566	1.0754
No log	7.5769	394	1.1126	0.1645	1.1126	1.0548
No log	7.6154	396	1.1181	0.1747	1.1181	1.0574
No log	7.6538	398	1.1230	0.1747	1.1230	1.0597
No log	7.6923	400	1.1565	0.1582	1.1565	1.0754
No log	7.7308	402	1.2294	0.0541	1.2294	1.1088
No log	7.7692	404	1.2619	0.0454	1.2619	1.1233
No log	7.8077	406	1.2467	0.0454	1.2467	1.1165
No log	7.8462	408	1.1826	0.1521	1.1826	1.0875
No log	7.8846	410	1.1664	0.1689	1.1664	1.0800
No log	7.9231	412	1.1976	0.1521	1.1976	1.0943
No log	7.9615	414	1.2411	0.0980	1.2411	1.1140
No log	8.0	416	1.2755	0.0541	1.2755	1.1294
No log	8.0385	418	1.2910	0.0541	1.2910	1.1362
No log	8.0769	420	1.2362	0.0904	1.2362	1.1119
No log	8.1154	422	1.1793	0.1689	1.1793	1.0860
No log	8.1538	424	1.1600	0.1242	1.1600	1.0771
No log	8.1923	426	1.1546	0.1706	1.1546	1.0745
No log	8.2308	428	1.2175	0.2330	1.2175	1.1034
No log	8.2692	430	1.2707	0.1427	1.2707	1.1273
No log	8.3077	432	1.2391	0.1427	1.2391	1.1131
No log	8.3462	434	1.2053	0.2046	1.2053	1.0979
No log	8.3846	436	1.1677	0.2108	1.1677	1.0806
No log	8.4231	438	1.1787	0.2108	1.1787	1.0857
No log	8.4615	440	1.1933	0.1536	1.1933	1.0924
No log	8.5	442	1.2030	0.1536	1.2030	1.0968
No log	8.5385	444	1.2471	0.1536	1.2471	1.1167
No log	8.5769	446	1.2677	0.1536	1.2677	1.1259
No log	8.6154	448	1.2423	0.1536	1.2423	1.1146
No log	8.6538	450	1.2422	0.1536	1.2422	1.1146
No log	8.6923	452	1.2723	0.1536	1.2723	1.1280
No log	8.7308	454	1.2962	0.1536	1.2962	1.1385
No log	8.7692	456	1.3136	0.0887	1.3136	1.1461
No log	8.8077	458	1.2890	0.0887	1.2890	1.1353
No log	8.8462	460	1.2648	0.0887	1.2648	1.1246
No log	8.8846	462	1.2333	0.1316	1.2333	1.1105
No log	8.9231	464	1.2539	0.1219	1.2539	1.1198
No log	8.9615	466	1.2904	0.1098	1.2904	1.1359
No log	9.0	468	1.3439	0.1516	1.3439	1.1593
No log	9.0385	470	1.2949	0.1098	1.2949	1.1379
No log	9.0769	472	1.2042	0.1637	1.2042	1.0973
No log	9.1154	474	1.1674	0.1582	1.1674	1.0804
No log	9.1538	476	1.1542	0.1645	1.1542	1.0743
No log	9.1923	478	1.1543	0.1582	1.1543	1.0744
No log	9.2308	480	1.1541	0.1582	1.1541	1.0743
No log	9.2692	482	1.1703	0.1582	1.1703	1.0818
No log	9.3077	484	1.1835	0.1582	1.1835	1.0879
No log	9.3462	486	1.1873	0.1148	1.1873	1.0896
No log	9.3846	488	1.2046	0.0980	1.2046	1.0976
No log	9.4231	490	1.2208	0.0980	1.2208	1.1049
No log	9.4615	492	1.2465	0.0541	1.2465	1.1165
No log	9.5	494	1.2998	0.1219	1.2998	1.1401
No log	9.5385	496	1.3415	0.1098	1.3415	1.1582
No log	9.5769	498	1.3012	0.1536	1.3012	1.1407
0.3665	9.6154	500	1.2226	0.0880	1.2226	1.1057
0.3665	9.6538	502	1.2013	0.1801	1.2013	1.0961
0.3665	9.6923	504	1.2667	0.1498	1.2667	1.1255
0.3665	9.7308	506	1.4684	0.2632	1.4684	1.2118
0.3665	9.7692	508	1.6877	0.2804	1.6877	1.2991
0.3665	9.8077	510	1.6689	0.2804	1.6689	1.2918
0.3665	9.8462	512	1.4716	0.2325	1.4716	1.2131
0.3665	9.8846	514	1.2834	0.0887	1.2834	1.1329
0.3665	9.9231	516	1.1882	0.1315	1.1882	1.0900
0.3665	9.9615	518	1.1755	0.1417	1.1755	1.0842
0.3665	10.0	520	1.1997	0.0802	1.1997	1.0953
0.3665	10.0385	522	1.2489	0.0541	1.2489	1.1175
0.3665	10.0769	524	1.2755	0.0541	1.2755	1.1294
0.3665	10.1154	526	1.2879	0.0541	1.2879	1.1349
0.3665	10.1538	528	1.3181	0.0541	1.3181	1.1481

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1