ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3320
• Qwk: 0.1001
• Mse: 1.3320
• Rmse: 1.1541

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	2.6272	-0.0593	2.6272	1.6209
No log	0.1053	4	1.3533	0.0412	1.3533	1.1633
No log	0.1579	6	1.1248	-0.1866	1.1248	1.0606
No log	0.2105	8	1.2809	-0.2576	1.2809	1.1317
No log	0.2632	10	1.1955	-0.0609	1.1955	1.0934
No log	0.3158	12	1.2034	-0.1027	1.2034	1.0970
No log	0.3684	14	1.1322	0.0868	1.1322	1.0641
No log	0.4211	16	1.0782	0.0943	1.0782	1.0384
No log	0.4737	18	1.0863	0.0391	1.0863	1.0423
No log	0.5263	20	1.1633	-0.1081	1.1633	1.0786
No log	0.5789	22	1.0268	0.0419	1.0268	1.0133
No log	0.6316	24	0.9608	-0.0054	0.9608	0.9802
No log	0.6842	26	0.9309	-0.0103	0.9309	0.9648
No log	0.7368	28	0.9532	0.0208	0.9532	0.9763
No log	0.7895	30	0.9817	0.1268	0.9817	0.9908
No log	0.8421	32	1.0772	0.0958	1.0772	1.0379
No log	0.8947	34	1.0455	0.1103	1.0455	1.0225
No log	0.9474	36	1.0125	-0.0472	1.0125	1.0062
No log	1.0	38	1.3162	-0.0624	1.3162	1.1473
No log	1.0526	40	1.5613	-0.0844	1.5613	1.2495
No log	1.1053	42	1.4443	-0.0219	1.4443	1.2018
No log	1.1579	44	1.1554	-0.0579	1.1554	1.0749
No log	1.2105	46	0.9541	-0.0915	0.9541	0.9768
No log	1.2632	48	1.0257	0.1028	1.0257	1.0128
No log	1.3158	50	1.1605	-0.0201	1.1605	1.0773
No log	1.3684	52	1.2818	-0.0529	1.2818	1.1322
No log	1.4211	54	1.1967	-0.0753	1.1967	1.0939
No log	1.4737	56	1.0339	-0.0569	1.0339	1.0168
No log	1.5263	58	1.1166	-0.1355	1.1166	1.0567
No log	1.5789	60	1.0974	-0.1120	1.0974	1.0476
No log	1.6316	62	1.1324	-0.1389	1.1324	1.0641
No log	1.6842	64	1.4684	-0.1344	1.4684	1.2118
No log	1.7368	66	1.6105	-0.1020	1.6105	1.2691
No log	1.7895	68	1.4591	-0.1956	1.4591	1.2079
No log	1.8421	70	1.3797	-0.2625	1.3797	1.1746
No log	1.8947	72	1.3951	-0.1445	1.3951	1.1812
No log	1.9474	74	1.4090	-0.1745	1.4090	1.1870
No log	2.0	76	1.4591	-0.1263	1.4591	1.2079
No log	2.0526	78	1.6217	-0.0934	1.6217	1.2735
No log	2.1053	80	1.6124	-0.0973	1.6124	1.2698
No log	2.1579	82	1.4721	-0.0703	1.4721	1.2133
No log	2.2105	84	1.3865	-0.0980	1.3865	1.1775
No log	2.2632	86	1.3088	-0.0693	1.3088	1.1440
No log	2.3158	88	1.1973	0.0012	1.1973	1.0942
No log	2.3684	90	1.1401	0.0184	1.1401	1.0678
No log	2.4211	92	1.1139	0.0162	1.1139	1.0554
No log	2.4737	94	1.1471	-0.0358	1.1471	1.0710
No log	2.5263	96	1.1660	0.0445	1.1660	1.0798
No log	2.5789	98	1.1249	-0.0274	1.1249	1.0606
No log	2.6316	100	1.1856	-0.0077	1.1856	1.0889
No log	2.6842	102	1.3301	0.1004	1.3301	1.1533
No log	2.7368	104	1.4542	0.0633	1.4542	1.2059
No log	2.7895	106	1.2951	0.1479	1.2951	1.1380
No log	2.8421	108	1.0957	0.0378	1.0957	1.0468
No log	2.8947	110	1.1456	0.0327	1.1456	1.0703
No log	2.9474	112	1.3363	0.0900	1.3363	1.1560
No log	3.0	114	1.4209	0.1093	1.4209	1.1920
No log	3.0526	116	1.3002	0.0849	1.3002	1.1403
No log	3.1053	118	1.2707	-0.0670	1.2707	1.1272
No log	3.1579	120	1.2686	0.0155	1.2686	1.1263
No log	3.2105	122	1.3567	0.0802	1.3567	1.1648
No log	3.2632	124	1.4959	0.1244	1.4959	1.2231
No log	3.3158	126	1.4456	0.0881	1.4456	1.2023
No log	3.3684	128	1.3504	0.0979	1.3504	1.1621
No log	3.4211	130	1.2982	0.1031	1.2982	1.1394
No log	3.4737	132	1.1884	-0.0025	1.1884	1.0901
No log	3.5263	134	1.1406	-0.0025	1.1406	1.0680
No log	3.5789	136	1.1312	-0.0347	1.1312	1.0636
No log	3.6316	138	1.1819	0.0445	1.1819	1.0872
No log	3.6842	140	1.3570	0.1145	1.3570	1.1649
No log	3.7368	142	1.4555	0.0791	1.4555	1.2064
No log	3.7895	144	1.2284	0.0122	1.2284	1.1083
No log	3.8421	146	1.1816	0.0184	1.1816	1.0870
No log	3.8947	148	1.2713	-0.0557	1.2713	1.1275
No log	3.9474	150	1.5083	0.1044	1.5083	1.2281
No log	4.0	152	1.7622	0.1336	1.7622	1.3275
No log	4.0526	154	1.6803	0.0240	1.6803	1.2963
No log	4.1053	156	1.3439	0.1146	1.3439	1.1593
No log	4.1579	158	1.0602	-0.0619	1.0602	1.0297
No log	4.2105	160	1.0328	-0.0826	1.0328	1.0163
No log	4.2632	162	1.0056	0.0255	1.0056	1.0028
No log	4.3158	164	1.0871	0.0653	1.0871	1.0427
No log	4.3684	166	1.3048	-0.0391	1.3048	1.1423
No log	4.4211	168	1.3958	-0.0391	1.3958	1.1815
No log	4.4737	170	1.3018	-0.0027	1.3018	1.1410
No log	4.5263	172	1.2037	0.0218	1.2037	1.0971
No log	4.5789	174	1.2561	-0.0137	1.2561	1.1208
No log	4.6316	176	1.4058	0.0736	1.4058	1.1856
No log	4.6842	178	1.4793	0.0399	1.4793	1.2163
No log	4.7368	180	1.5743	-0.0149	1.5743	1.2547
No log	4.7895	182	1.5509	-0.0149	1.5509	1.2454
No log	4.8421	184	1.5264	0.0353	1.5264	1.2355
No log	4.8947	186	1.3541	0.0838	1.3541	1.1637
No log	4.9474	188	1.2256	-0.0383	1.2256	1.1071
No log	5.0	190	1.1887	-0.0383	1.1887	1.0903
No log	5.0526	192	1.2135	0.0829	1.2135	1.1016
No log	5.1053	194	1.3819	0.1568	1.3819	1.1755
No log	5.1579	196	1.4520	0.1272	1.4520	1.2050
No log	5.2105	198	1.3716	0.0727	1.3716	1.1712
No log	5.2632	200	1.3325	0.0347	1.3325	1.1543
No log	5.3158	202	1.4383	0.1093	1.4383	1.1993
No log	5.3684	204	1.4776	0.0995	1.4776	1.2155
No log	5.4211	206	1.5165	0.1364	1.5165	1.2315
No log	5.4737	208	1.3261	0.1591	1.3261	1.1516
No log	5.5263	210	1.2516	0.1422	1.2516	1.1188
No log	5.5789	212	1.3070	0.1115	1.3070	1.1432
No log	5.6316	214	1.4062	0.0704	1.4062	1.1858
No log	5.6842	216	1.5987	0.0971	1.5987	1.2644
No log	5.7368	218	1.5846	0.0784	1.5846	1.2588
No log	5.7895	220	1.3652	0.0648	1.3652	1.1684
No log	5.8421	222	1.0989	0.0683	1.0989	1.0483
No log	5.8947	224	1.0070	-0.0548	1.0070	1.0035
No log	5.9474	226	0.9901	-0.0232	0.9901	0.9950
No log	6.0	228	1.0537	0.0683	1.0537	1.0265
No log	6.0526	230	1.2363	0.1356	1.2363	1.1119
No log	6.1053	232	1.3184	0.0676	1.3184	1.1482
No log	6.1579	234	1.2031	0.1557	1.2031	1.0969
No log	6.2105	236	1.1048	0.0293	1.1048	1.0511
No log	6.2632	238	1.0699	-0.0566	1.0699	1.0343
No log	6.3158	240	1.0953	0.0332	1.0953	1.0466
No log	6.3684	242	1.1938	0.1557	1.1938	1.0926
No log	6.4211	244	1.1167	0.1623	1.1167	1.0567
No log	6.4737	246	1.0038	0.1285	1.0038	1.0019
No log	6.5263	248	1.0385	0.2358	1.0385	1.0191
No log	6.5789	250	1.2463	0.1260	1.2463	1.1164
No log	6.6316	252	1.3341	0.0852	1.3341	1.1550
No log	6.6842	254	1.2654	0.1262	1.2654	1.1249
No log	6.7368	256	1.1416	0.2358	1.1416	1.0685
No log	6.7895	258	1.1697	0.1422	1.1697	1.0815
No log	6.8421	260	1.2146	-0.0280	1.2146	1.1021
No log	6.8947	262	1.2985	0.0784	1.2985	1.1395
No log	6.9474	264	1.3877	0.0553	1.3877	1.1780
No log	7.0	266	1.4555	0.0468	1.4555	1.2064
No log	7.0526	268	1.5085	0.0380	1.5085	1.2282
No log	7.1053	270	1.4206	0.0250	1.4206	1.1919
No log	7.1579	272	1.3622	0.0250	1.3622	1.1671
No log	7.2105	274	1.3214	0.1389	1.3214	1.1495
No log	7.2632	276	1.3251	0.1583	1.3251	1.1511
No log	7.3158	278	1.2972	0.1457	1.2972	1.1390
No log	7.3684	280	1.3482	0.1417	1.3482	1.1611
No log	7.4211	282	1.3706	0.0778	1.3706	1.1707
No log	7.4737	284	1.3768	0.0547	1.3768	1.1734
No log	7.5263	286	1.4180	0.0484	1.4180	1.1908
No log	7.5789	288	1.3911	0.0561	1.3911	1.1794
No log	7.6316	290	1.4432	0.0709	1.4432	1.2013
No log	7.6842	292	1.6881	0.1075	1.6881	1.2993
No log	7.7368	294	1.8291	-0.0000	1.8291	1.3524
No log	7.7895	296	1.8516	0.0225	1.8516	1.3607
No log	7.8421	298	1.5830	0.0472	1.5830	1.2582
No log	7.8947	300	1.3361	0.1704	1.3361	1.1559
No log	7.9474	302	1.2760	0.1451	1.2760	1.1296
No log	8.0	304	1.2937	0.1485	1.2937	1.1374
No log	8.0526	306	1.3282	0.1348	1.3282	1.1525
No log	8.1053	308	1.4202	0.1018	1.4202	1.1917
No log	8.1579	310	1.4717	0.0971	1.4717	1.2131
No log	8.2105	312	1.3796	0.0898	1.3796	1.1746
No log	8.2632	314	1.2494	0.1528	1.2494	1.1178
No log	8.3158	316	1.1962	0.1632	1.1962	1.0937
No log	8.3684	318	1.2004	0.2287	1.2004	1.0956
No log	8.4211	320	1.3356	0.0977	1.3356	1.1557
No log	8.4737	322	1.4248	0.0835	1.4248	1.1936
No log	8.5263	324	1.3761	0.1383	1.3761	1.1731
No log	8.5789	326	1.3142	0.1352	1.3142	1.1464
No log	8.6316	328	1.3028	0.1689	1.3028	1.1414
No log	8.6842	330	1.3180	0.1317	1.3180	1.1481
No log	8.7368	332	1.2313	0.1803	1.2313	1.1096
No log	8.7895	334	1.1812	0.1843	1.1812	1.0869
No log	8.8421	336	1.1368	0.1897	1.1368	1.0662
No log	8.8947	338	1.2016	0.2437	1.2016	1.0962
No log	8.9474	340	1.2842	0.1646	1.2842	1.1332
No log	9.0	342	1.2743	0.1646	1.2743	1.1288
No log	9.0526	344	1.1670	0.2075	1.1670	1.0803
No log	9.1053	346	1.1515	0.2297	1.1515	1.0731
No log	9.1579	348	1.2459	0.1896	1.2459	1.1162
No log	9.2105	350	1.4506	0.1823	1.4506	1.2044
No log	9.2632	352	1.7308	0.1500	1.7308	1.3156
No log	9.3158	354	1.6680	0.1233	1.6680	1.2915
No log	9.3684	356	1.4124	0.1814	1.4124	1.1885
No log	9.4211	358	1.2230	0.2252	1.2230	1.1059
No log	9.4737	360	1.1022	0.1077	1.1022	1.0499
No log	9.5263	362	1.0707	0.1501	1.0707	1.0348
No log	9.5789	364	1.1843	0.2075	1.1843	1.0882
No log	9.6316	366	1.3572	0.1205	1.3572	1.1650
No log	9.6842	368	1.4103	0.1367	1.4103	1.1876
No log	9.7368	370	1.3123	0.2079	1.3123	1.1456
No log	9.7895	372	1.1896	0.1374	1.1896	1.0907
No log	9.8421	374	1.1201	0.0034	1.1201	1.0583
No log	9.8947	376	1.1561	0.1178	1.1561	1.0752
No log	9.9474	378	1.2647	0.1356	1.2647	1.1246
No log	10.0	380	1.3433	0.1646	1.3433	1.1590
No log	10.0526	382	1.3745	0.1367	1.3745	1.1724
No log	10.1053	384	1.3031	0.1427	1.3031	1.1415
No log	10.1579	386	1.2048	0.2316	1.2048	1.0976
No log	10.2105	388	1.1644	0.1612	1.1644	1.0791
No log	10.2632	390	1.1378	0.1110	1.1378	1.0667
No log	10.3158	392	1.1937	0.2059	1.1937	1.0926
No log	10.3684	394	1.3514	0.1275	1.3514	1.1625
No log	10.4211	396	1.5207	0.0655	1.5207	1.2332
No log	10.4737	398	1.4900	0.0501	1.4900	1.2207
No log	10.5263	400	1.3108	0.1367	1.3108	1.1449
No log	10.5789	402	1.1344	0.2308	1.1344	1.0651
No log	10.6316	404	1.0589	0.1777	1.0589	1.0290
No log	10.6842	406	1.0670	0.2046	1.0670	1.0330
No log	10.7368	408	1.1435	0.1869	1.1435	1.0693
No log	10.7895	410	1.2825	0.1453	1.2825	1.1325
No log	10.8421	412	1.4768	0.0655	1.4768	1.2152
No log	10.8947	414	1.5056	0.0886	1.5056	1.2270
No log	10.9474	416	1.3408	0.1144	1.3408	1.1579
No log	11.0	418	1.1903	0.1268	1.1903	1.0910
No log	11.0526	420	1.1302	0.1214	1.1302	1.0631
No log	11.1053	422	1.1357	0.1214	1.1357	1.0657
No log	11.1579	424	1.0860	0.0993	1.0860	1.0421
No log	11.2105	426	1.0449	0.1065	1.0449	1.0222
No log	11.2632	428	1.0439	0.0958	1.0439	1.0217
No log	11.3158	430	1.1372	0.2000	1.1372	1.0664
No log	11.3684	432	1.2060	0.2141	1.2060	1.0982
No log	11.4211	434	1.1978	0.2141	1.1978	1.0944
No log	11.4737	436	1.1344	0.1911	1.1344	1.0651
No log	11.5263	438	1.1100	0.1461	1.1100	1.0536
No log	11.5789	440	1.1852	0.1238	1.1852	1.0887
No log	11.6316	442	1.3966	0.1441	1.3966	1.1818
No log	11.6842	444	1.5455	0.1517	1.5455	1.2432
No log	11.7368	446	1.5357	0.1517	1.5357	1.2392
No log	11.7895	448	1.3559	0.1525	1.3559	1.1644
No log	11.8421	450	1.2280	0.0957	1.2280	1.1081
No log	11.8947	452	1.2340	0.1204	1.2340	1.1109
No log	11.9474	454	1.3519	0.2006	1.3519	1.1627
No log	12.0	456	1.3965	0.1679	1.3965	1.1817
No log	12.0526	458	1.2843	0.1795	1.2843	1.1333
No log	12.1053	460	1.1061	0.1312	1.1061	1.0517
No log	12.1579	462	1.0343	0.1493	1.0343	1.0170
No log	12.2105	464	1.0546	0.1144	1.0546	1.0269
No log	12.2632	466	1.1759	0.1348	1.1759	1.0844
No log	12.3158	468	1.4243	0.1679	1.4243	1.1934
No log	12.3684	470	1.6264	0.0811	1.6264	1.2753
No log	12.4211	472	1.6161	0.0777	1.6161	1.2713
No log	12.4737	474	1.4058	0.2264	1.4058	1.1857
No log	12.5263	476	1.4428	0.2177	1.4428	1.2012
No log	12.5789	478	1.4091	0.2177	1.4092	1.1871
No log	12.6316	480	1.3918	0.2177	1.3918	1.1797
No log	12.6842	482	1.3376	0.1739	1.3376	1.1566
No log	12.7368	484	1.1680	0.1110	1.1680	1.0807
No log	12.7895	486	1.1449	0.0829	1.1449	1.0700
No log	12.8421	488	1.2148	0.1827	1.2148	1.1022
No log	12.8947	490	1.4670	0.0849	1.4670	1.2112
No log	12.9474	492	1.7159	0.0632	1.7159	1.3099
No log	13.0	494	1.6942	0.0465	1.6942	1.3016
No log	13.0526	496	1.5254	0.0551	1.5254	1.2351
No log	13.1053	498	1.3035	0.1499	1.3035	1.1417
0.3298	13.1579	500	1.2206	0.1348	1.2206	1.1048
0.3298	13.2105	502	1.2353	0.1348	1.2353	1.1114
0.3298	13.2632	504	1.2842	0.1737	1.2842	1.1332
0.3298	13.3158	506	1.4575	0.0770	1.4575	1.2073
0.3298	13.3684	508	1.5466	0.0888	1.5466	1.2436
0.3298	13.4211	510	1.4426	0.0770	1.4426	1.2011
0.3298	13.4737	512	1.2684	0.1352	1.2684	1.1262
0.3298	13.5263	514	1.2151	0.1940	1.2151	1.1023
0.3298	13.5789	516	1.2254	0.1557	1.2254	1.1070
0.3298	13.6316	518	1.2575	0.2437	1.2575	1.1214
0.3298	13.6842	520	1.3222	0.1784	1.3222	1.1499
0.3298	13.7368	522	1.2983	0.1784	1.2983	1.1394
0.3298	13.7895	524	1.3175	0.1784	1.3175	1.1478
0.3298	13.8421	526	1.3509	0.1490	1.3509	1.1623
0.3298	13.8947	528	1.3431	0.1490	1.3431	1.1589
0.3298	13.9474	530	1.2071	0.2032	1.2071	1.0987
0.3298	14.0	532	1.1503	0.2119	1.1503	1.0725
0.3298	14.0526	534	1.2271	0.1949	1.2271	1.1078
0.3298	14.1053	536	1.4104	0.0826	1.4104	1.1876
0.3298	14.1579	538	1.6051	0.0267	1.6051	1.2669
0.3298	14.2105	540	1.5884	0.0290	1.5884	1.2603
0.3298	14.2632	542	1.4778	0.0803	1.4778	1.2157
0.3298	14.3158	544	1.2949	0.1530	1.2949	1.1379
0.3298	14.3684	546	1.1395	0.2411	1.1395	1.0675
0.3298	14.4211	548	1.1483	0.2164	1.1483	1.0716
0.3298	14.4737	550	1.2543	0.2529	1.2543	1.1199
0.3298	14.5263	552	1.4011	0.1119	1.4011	1.1837
0.3298	14.5789	554	1.4843	0.1019	1.4843	1.2183
0.3298	14.6316	556	1.4385	0.0855	1.4385	1.1994
0.3298	14.6842	558	1.3741	0.1203	1.3741	1.1722
0.3298	14.7368	560	1.3320	0.1001	1.3320	1.1541

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1