ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4608
• Qwk: 0.0564
• Mse: 1.4608
• Rmse: 1.2086

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	4.5342	0.0010	4.5342	2.1294
No log	0.1905	4	2.5551	0.0514	2.5551	1.5985
No log	0.2857	6	2.2937	-0.0173	2.2937	1.5145
No log	0.3810	8	1.6292	-0.0970	1.6292	1.2764
No log	0.4762	10	1.4234	-0.0753	1.4234	1.1931
No log	0.5714	12	1.3155	0.1432	1.3155	1.1469
No log	0.6667	14	1.3959	0.0385	1.3959	1.1815
No log	0.7619	16	1.2973	0.1507	1.2973	1.1390
No log	0.8571	18	1.2514	0.1546	1.2514	1.1187
No log	0.9524	20	1.2700	0.0682	1.2700	1.1269
No log	1.0476	22	1.2150	0.1043	1.2150	1.1023
No log	1.1429	24	1.1815	0.2257	1.1815	1.0870
No log	1.2381	26	1.2165	0.1483	1.2165	1.1029
No log	1.3333	28	1.2657	0.0561	1.2657	1.1250
No log	1.4286	30	1.2475	0.1168	1.2475	1.1169
No log	1.5238	32	1.2354	0.1601	1.2354	1.1115
No log	1.6190	34	1.2527	-0.0010	1.2527	1.1193
No log	1.7143	36	1.2296	0.1107	1.2296	1.1089
No log	1.8095	38	1.2188	0.1852	1.2188	1.1040
No log	1.9048	40	1.2132	0.1671	1.2132	1.1014
No log	2.0	42	1.2244	0.1242	1.2244	1.1065
No log	2.0952	44	1.2619	0.1834	1.2619	1.1233
No log	2.1905	46	1.2881	0.1271	1.2881	1.1350
No log	2.2857	48	1.2412	0.1671	1.2412	1.1141
No log	2.3810	50	1.2320	0.1671	1.2320	1.1099
No log	2.4762	52	1.2739	0.1271	1.2739	1.1287
No log	2.5714	54	1.2907	0.0722	1.2907	1.1361
No log	2.6667	56	1.3877	0.1107	1.3877	1.1780
No log	2.7619	58	1.2879	0.0817	1.2879	1.1349
No log	2.8571	60	1.1940	0.1343	1.1940	1.0927
No log	2.9524	62	1.2098	0.1176	1.2098	1.0999
No log	3.0476	64	1.2083	0.0427	1.2083	1.0992
No log	3.1429	66	1.1702	0.1379	1.1702	1.0817
No log	3.2381	68	1.1681	0.1546	1.1681	1.0808
No log	3.3333	70	1.1718	0.1379	1.1718	1.0825
No log	3.4286	72	1.2112	0.0599	1.2112	1.1005
No log	3.5238	74	1.1886	0.1546	1.1886	1.0902
No log	3.6190	76	1.2060	0.1379	1.2060	1.0982
No log	3.7143	78	1.2312	0.1211	1.2312	1.1096
No log	3.8095	80	1.1808	0.1767	1.1808	1.0866
No log	3.9048	82	1.2513	0.1457	1.2513	1.1186
No log	4.0	84	1.2323	0.1271	1.2323	1.1101
No log	4.0952	86	1.2262	0.1443	1.2262	1.1074
No log	4.1905	88	1.3031	0.1910	1.3031	1.1415
No log	4.2857	90	1.3161	0.1764	1.3161	1.1472
No log	4.3810	92	1.2797	0.1335	1.2797	1.1313
No log	4.4762	94	1.3543	0.1018	1.3543	1.1637
No log	4.5714	96	1.2782	0.1239	1.2782	1.1306
No log	4.6667	98	1.2810	0.1093	1.2810	1.1318
No log	4.7619	100	1.2686	0.1089	1.2686	1.1263
No log	4.8571	102	1.2734	0.1590	1.2734	1.1285
No log	4.9524	104	1.2660	0.2043	1.2660	1.1252
No log	5.0476	106	1.3297	0.2894	1.3297	1.1531
No log	5.1429	108	1.3725	0.3044	1.3725	1.1715
No log	5.2381	110	1.3416	0.3308	1.3416	1.1583
No log	5.3333	112	1.3318	0.1430	1.3318	1.1540
No log	5.4286	114	1.3143	0.2154	1.3143	1.1464
No log	5.5238	116	1.2854	0.1952	1.2854	1.1338
No log	5.6190	118	1.3049	0.1952	1.3049	1.1423
No log	5.7143	120	1.2981	0.1814	1.2981	1.1394
No log	5.8095	122	1.3118	0.2060	1.3118	1.1453
No log	5.9048	124	1.3962	0.2738	1.3962	1.1816
No log	6.0	126	1.4922	0.2238	1.4922	1.2215
No log	6.0952	128	1.5503	0.1967	1.5503	1.2451
No log	6.1905	130	1.4965	0.1893	1.4965	1.2233
No log	6.2857	132	1.3908	0.1753	1.3908	1.1793
No log	6.3810	134	1.4531	0.1000	1.4531	1.2055
No log	6.4762	136	1.3697	0.2417	1.3697	1.1703
No log	6.5714	138	1.5553	0.2301	1.5553	1.2471
No log	6.6667	140	1.6126	0.2270	1.6126	1.2699
No log	6.7619	142	1.4748	0.2595	1.4748	1.2144
No log	6.8571	144	1.3108	0.1541	1.3108	1.1449
No log	6.9524	146	1.4708	0.0827	1.4708	1.2128
No log	7.0476	148	1.4793	0.0758	1.4793	1.2163
No log	7.1429	150	1.3097	0.1081	1.3097	1.1444
No log	7.2381	152	1.3101	0.1903	1.3101	1.1446
No log	7.3333	154	1.4358	0.1554	1.4358	1.1983
No log	7.4286	156	1.4875	0.1162	1.4875	1.2196
No log	7.5238	158	1.4650	0.1608	1.4650	1.2104
No log	7.6190	160	1.3215	0.1576	1.3215	1.1496
No log	7.7143	162	1.2469	0.2522	1.2469	1.1167
No log	7.8095	164	1.2657	0.1874	1.2657	1.1250
No log	7.9048	166	1.3619	0.2045	1.3619	1.1670
No log	8.0	168	1.5608	0.2374	1.5608	1.2493
No log	8.0952	170	1.6331	0.1918	1.6331	1.2779
No log	8.1905	172	1.5213	0.1968	1.5213	1.2334
No log	8.2857	174	1.3800	0.1712	1.3800	1.1747
No log	8.3810	176	1.4612	0.1063	1.4612	1.2088
No log	8.4762	178	1.5328	0.0750	1.5328	1.2380
No log	8.5714	180	1.4414	0.0308	1.4414	1.2006
No log	8.6667	182	1.4286	0.0778	1.4286	1.1952
No log	8.7619	184	1.5092	0.2313	1.5092	1.2285
No log	8.8571	186	1.6159	0.1771	1.6159	1.2712
No log	8.9524	188	1.5781	0.0961	1.5781	1.2562
No log	9.0476	190	1.5424	0.0416	1.5424	1.2419
No log	9.1429	192	1.5804	0.0330	1.5804	1.2571
No log	9.2381	194	1.6189	0.0741	1.6189	1.2724
No log	9.3333	196	1.6119	0.1129	1.6119	1.2696
No log	9.4286	198	1.5405	0.1851	1.5405	1.2412
No log	9.5238	200	1.5027	0.3093	1.5027	1.2258
No log	9.6190	202	1.4844	0.2844	1.4844	1.2184
No log	9.7143	204	1.3982	0.1654	1.3982	1.1825
No log	9.8095	206	1.3635	0.1431	1.3635	1.1677
No log	9.9048	208	1.3807	0.1712	1.3807	1.1750
No log	10.0	210	1.4666	0.2494	1.4666	1.2110
No log	10.0952	212	1.5953	0.2172	1.5953	1.2631
No log	10.1905	214	1.5525	0.2468	1.5525	1.2460
No log	10.2857	216	1.4527	0.2028	1.4527	1.2053
No log	10.3810	218	1.4037	0.2438	1.4037	1.1848
No log	10.4762	220	1.4827	0.2020	1.4827	1.2177
No log	10.5714	222	1.6613	0.1135	1.6613	1.2889
No log	10.6667	224	1.7173	0.1095	1.7173	1.3105
No log	10.7619	226	1.6003	0.1843	1.6003	1.2650
No log	10.8571	228	1.5284	0.1886	1.5284	1.2363
No log	10.9524	230	1.5034	0.2213	1.5034	1.2261
No log	11.0476	232	1.5379	0.2065	1.5379	1.2401
No log	11.1429	234	1.4964	0.1935	1.4964	1.2233
No log	11.2381	236	1.5318	0.1801	1.5318	1.2377
No log	11.3333	238	1.6668	0.1386	1.6668	1.2910
No log	11.4286	240	1.8672	0.1686	1.8672	1.3665
No log	11.5238	242	1.8373	0.1026	1.8373	1.3555
No log	11.6190	244	1.6561	0.1683	1.6561	1.2869
No log	11.7143	246	1.4900	0.1427	1.4900	1.2206
No log	11.8095	248	1.4727	0.0898	1.4727	1.2135
No log	11.9048	250	1.5427	0.2201	1.5427	1.2420
No log	12.0	252	1.6971	0.1425	1.6971	1.3027
No log	12.0952	254	1.7899	0.0805	1.7899	1.3379
No log	12.1905	256	1.6693	0.1373	1.6693	1.2920
No log	12.2857	258	1.5379	0.1901	1.5379	1.2401
No log	12.3810	260	1.5078	0.1553	1.5078	1.2279
No log	12.4762	262	1.5367	0.1807	1.5367	1.2396
No log	12.5714	264	1.5051	0.2275	1.5051	1.2268
No log	12.6667	266	1.4952	0.2704	1.4952	1.2228
No log	12.7619	268	1.5062	0.2574	1.5062	1.2273
No log	12.8571	270	1.5254	0.2757	1.5254	1.2351
No log	12.9524	272	1.4858	0.2881	1.4858	1.2189
No log	13.0476	274	1.4316	0.2313	1.4316	1.1965
No log	13.1429	276	1.3771	0.2195	1.3771	1.1735
No log	13.2381	278	1.3761	0.2288	1.3761	1.1731
No log	13.3333	280	1.4941	0.2647	1.4941	1.2223
No log	13.4286	282	1.6667	0.1697	1.6667	1.2910
No log	13.5238	284	1.6538	0.1697	1.6538	1.2860
No log	13.6190	286	1.5121	0.2217	1.5121	1.2297
No log	13.7143	288	1.4515	0.2301	1.4515	1.2048
No log	13.8095	290	1.4209	0.2403	1.4209	1.1920
No log	13.9048	292	1.4246	0.2132	1.4246	1.1936
No log	14.0	294	1.4459	0.1226	1.4459	1.2025
No log	14.0952	296	1.5256	0.0987	1.5256	1.2351
No log	14.1905	298	1.5108	0.0987	1.5108	1.2292
No log	14.2857	300	1.4112	0.2195	1.4112	1.1879
No log	14.3810	302	1.3862	0.1903	1.3862	1.1774
No log	14.4762	304	1.4559	0.2574	1.4559	1.2066
No log	14.5714	306	1.5190	0.1254	1.5190	1.2325
No log	14.6667	308	1.4931	0.1334	1.4931	1.2219
No log	14.7619	310	1.5414	0.1152	1.5414	1.2415
No log	14.8571	312	1.5260	0.1583	1.5260	1.2353
No log	14.9524	314	1.4578	0.1535	1.4578	1.2074
No log	15.0476	316	1.3683	0.1654	1.3683	1.1697
No log	15.1429	318	1.3774	0.1658	1.3774	1.1736
No log	15.2381	320	1.4197	0.2195	1.4197	1.1915
No log	15.3333	322	1.5227	0.1585	1.5227	1.2340
No log	15.4286	324	1.6537	0.1884	1.6537	1.2860
No log	15.5238	326	1.6634	0.1726	1.6634	1.2897
No log	15.6190	328	1.6071	0.1935	1.6071	1.2677
No log	15.7143	330	1.5227	0.1022	1.5227	1.2340
No log	15.8095	332	1.5399	0.1364	1.5399	1.2409
No log	15.9048	334	1.5806	0.1143	1.5806	1.2572
No log	16.0	336	1.7106	0.1811	1.7106	1.3079
No log	16.0952	338	1.8116	0.1810	1.8115	1.3459
No log	16.1905	340	1.8145	0.1604	1.8145	1.3470
No log	16.2857	342	1.7247	0.1917	1.7247	1.3133
No log	16.3810	344	1.5879	0.2371	1.5879	1.2601
No log	16.4762	346	1.4569	0.2090	1.4569	1.2070
No log	16.5714	348	1.4183	0.0722	1.4183	1.1909
No log	16.6667	350	1.4134	0.0625	1.4134	1.1889
No log	16.7619	352	1.4054	0.0664	1.4054	1.1855
No log	16.8571	354	1.4941	0.1761	1.4941	1.2223
No log	16.9524	356	1.5856	0.0907	1.5856	1.2592
No log	17.0476	358	1.5800	0.1041	1.5800	1.2570
No log	17.1429	360	1.5024	0.1084	1.5024	1.2257
No log	17.2381	362	1.4799	0.0257	1.4799	1.2165
No log	17.3333	364	1.5007	-0.0097	1.5007	1.2250
No log	17.4286	366	1.4781	0.0099	1.4781	1.2158
No log	17.5238	368	1.4527	0.1465	1.4527	1.2053
No log	17.6190	370	1.4439	0.1857	1.4439	1.2016
No log	17.7143	372	1.4378	0.1559	1.4378	1.1991
No log	17.8095	374	1.4441	0.1559	1.4441	1.2017
No log	17.9048	376	1.4380	0.0827	1.4380	1.1992
No log	18.0	378	1.4484	0.0263	1.4484	1.2035
No log	18.0952	380	1.4526	0.1405	1.4526	1.2052
No log	18.1905	382	1.5105	0.1766	1.5105	1.2290
No log	18.2857	384	1.6219	0.1205	1.6219	1.2735
No log	18.3810	386	1.6567	0.1305	1.6567	1.2871
No log	18.4762	388	1.5985	0.0323	1.5985	1.2643
No log	18.5714	390	1.5924	0.0323	1.5924	1.2619
No log	18.6667	392	1.6999	0.1161	1.6999	1.3038
No log	18.7619	394	1.7840	0.1123	1.7840	1.3357
No log	18.8571	396	1.7110	0.1399	1.7110	1.3080
No log	18.9524	398	1.6018	0.1455	1.6018	1.2656
No log	19.0476	400	1.5271	0.1334	1.5271	1.2358
No log	19.1429	402	1.4571	0.2184	1.4571	1.2071
No log	19.2381	404	1.4432	0.2381	1.4432	1.2013
No log	19.3333	406	1.4439	0.2100	1.4439	1.2016
No log	19.4286	408	1.4259	0.1463	1.4259	1.1941
No log	19.5238	410	1.4489	0.1850	1.4489	1.2037
No log	19.6190	412	1.4914	0.1517	1.4914	1.2212
No log	19.7143	414	1.5853	0.1631	1.5853	1.2591
No log	19.8095	416	1.7272	0.1306	1.7272	1.3142
No log	19.9048	418	1.7417	0.1353	1.7417	1.3197
No log	20.0	420	1.6923	0.0807	1.6923	1.3009
No log	20.0952	422	1.6401	0.0679	1.6401	1.2806
No log	20.1905	424	1.5981	0.0707	1.5981	1.2642
No log	20.2857	426	1.6159	0.0303	1.6159	1.2712
No log	20.3810	428	1.6519	0.1060	1.6519	1.2853
No log	20.4762	430	1.7116	0.1280	1.7116	1.3083
No log	20.5714	432	1.6689	0.0961	1.6689	1.2919
No log	20.6667	434	1.6211	0.0685	1.6211	1.2732
No log	20.7619	436	1.5962	0.0618	1.5962	1.2634
No log	20.8571	438	1.5939	0.0478	1.5939	1.2625
No log	20.9524	440	1.5683	0.0999	1.5683	1.2523
No log	21.0476	442	1.4807	0.1248	1.4807	1.2168
No log	21.1429	444	1.4622	0.0731	1.4622	1.2092
No log	21.2381	446	1.4642	0.1559	1.4642	1.2100
No log	21.3333	448	1.5198	0.1280	1.5198	1.2328
No log	21.4286	450	1.6475	0.1331	1.6475	1.2835
No log	21.5238	452	1.6658	0.1575	1.6658	1.2906
No log	21.6190	454	1.5940	0.1770	1.5940	1.2625
No log	21.7143	456	1.4907	0.1140	1.4907	1.2209
No log	21.8095	458	1.4462	0.1190	1.4462	1.2026
No log	21.9048	460	1.4527	0.1484	1.4527	1.2053
No log	22.0	462	1.5333	0.1549	1.5333	1.2383
No log	22.0952	464	1.6085	0.1256	1.6085	1.2683
No log	22.1905	466	1.5671	0.1713	1.5671	1.2519
No log	22.2857	468	1.4803	0.1135	1.4803	1.2167
No log	22.3810	470	1.4049	0.1312	1.4049	1.1853
No log	22.4762	472	1.3771	0.1248	1.3771	1.1735
No log	22.5714	474	1.3631	0.1153	1.3631	1.1675
No log	22.6667	476	1.3641	0.1654	1.3641	1.1680
No log	22.7619	478	1.3874	0.1557	1.3874	1.1779
No log	22.8571	480	1.4618	0.1608	1.4618	1.2090
No log	22.9524	482	1.4706	0.1659	1.4706	1.2127
No log	23.0476	484	1.4149	0.1745	1.4149	1.1895
No log	23.1429	486	1.3523	0.2291	1.3523	1.1629
No log	23.2381	488	1.3206	0.2291	1.3206	1.1492
No log	23.3333	490	1.3409	0.2291	1.3409	1.1580
No log	23.4286	492	1.4088	0.1517	1.4088	1.1869
No log	23.5238	494	1.4599	0.1196	1.4599	1.2083
No log	23.6190	496	1.4476	0.1517	1.4476	1.2032
No log	23.7143	498	1.4094	0.2000	1.4094	1.1872
0.3427	23.8095	500	1.4477	0.1428	1.4477	1.2032
0.3427	23.9048	502	1.4993	0.1570	1.4993	1.2244
0.3427	24.0	504	1.5861	0.1149	1.5861	1.2594
0.3427	24.0952	506	1.6975	0.1953	1.6975	1.3029
0.3427	24.1905	508	1.7348	0.2232	1.7348	1.3171
0.3427	24.2857	510	1.7229	0.2232	1.7229	1.3126
0.3427	24.3810	512	1.6204	0.1483	1.6204	1.2730
0.3427	24.4762	514	1.5725	0.1687	1.5725	1.2540
0.3427	24.5714	516	1.5060	0.0921	1.5060	1.2272
0.3427	24.6667	518	1.4808	0.0707	1.4808	1.2169
0.3427	24.7619	520	1.5043	0.0858	1.5043	1.2265
0.3427	24.8571	522	1.4767	0.0169	1.4767	1.2152
0.3427	24.9524	524	1.4608	0.0564	1.4608	1.2086

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1