ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4493
• Qwk: 0.2377
• Mse: 1.4493
• Rmse: 1.2039

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	4.7362	-0.0132	4.7362	2.1763
No log	0.0727	4	2.7587	-0.0504	2.7587	1.6609
No log	0.1091	6	2.1359	-0.0303	2.1359	1.4615
No log	0.1455	8	1.7857	0.0062	1.7857	1.3363
No log	0.1818	10	1.3796	-0.0859	1.3796	1.1745
No log	0.2182	12	1.2968	0.0561	1.2968	1.1388
No log	0.2545	14	1.3282	0.0473	1.3282	1.1525
No log	0.2909	16	1.2802	0.1294	1.2802	1.1315
No log	0.3273	18	1.2725	0.1417	1.2725	1.1281
No log	0.3636	20	1.3465	0.1214	1.3465	1.1604
No log	0.4	22	1.4469	0.0682	1.4469	1.2029
No log	0.4364	24	1.4799	0.0222	1.4799	1.2165
No log	0.4727	26	1.6109	-0.1071	1.6109	1.2692
No log	0.5091	28	1.6112	-0.0422	1.6112	1.2693
No log	0.5455	30	1.5626	0.0113	1.5626	1.2501
No log	0.5818	32	1.5454	0.1110	1.5454	1.2431
No log	0.6182	34	1.4062	0.0687	1.4062	1.1858
No log	0.6545	36	1.3784	0.0464	1.3784	1.1740
No log	0.6909	38	1.5209	-0.0152	1.5209	1.2333
No log	0.7273	40	1.8292	-0.1477	1.8292	1.3525
No log	0.7636	42	1.8945	-0.1916	1.8945	1.3764
No log	0.8	44	1.5116	-0.0650	1.5116	1.2295
No log	0.8364	46	1.2776	0.1109	1.2776	1.1303
No log	0.8727	48	1.3221	0.0687	1.3221	1.1498
No log	0.9091	50	1.3400	0.0839	1.3400	1.1576
No log	0.9455	52	1.3155	0.0777	1.3155	1.1470
No log	0.9818	54	1.2506	0.2364	1.2506	1.1183
No log	1.0182	56	1.3888	0.1005	1.3888	1.1785
No log	1.0545	58	1.6298	0.0207	1.6298	1.2766
No log	1.0909	60	1.5199	0.0419	1.5199	1.2329
No log	1.1273	62	1.2762	0.2273	1.2762	1.1297
No log	1.1636	64	1.2824	0.1647	1.2824	1.1324
No log	1.2	66	1.2773	0.1557	1.2773	1.1302
No log	1.2364	68	1.1809	0.2802	1.1809	1.0867
No log	1.2727	70	1.3838	0.2239	1.3838	1.1764
No log	1.3091	72	1.5473	0.1845	1.5473	1.2439
No log	1.3455	74	1.4262	0.2375	1.4262	1.1943
No log	1.3818	76	1.4206	0.1807	1.4206	1.1919
No log	1.4182	78	1.5003	0.0927	1.5003	1.2249
No log	1.4545	80	1.9273	-0.0452	1.9273	1.3883
No log	1.4909	82	2.1565	-0.3145	2.1565	1.4685
No log	1.5273	84	1.8569	-0.1108	1.8569	1.3627
No log	1.5636	86	1.4337	0.0566	1.4337	1.1974
No log	1.6	88	1.0637	0.2944	1.0637	1.0314
No log	1.6364	90	1.0464	0.3522	1.0464	1.0229
No log	1.6727	92	1.2304	0.2894	1.2304	1.1092
No log	1.7091	94	1.5963	0.1604	1.5963	1.2635
No log	1.7455	96	1.6322	0.2461	1.6322	1.2776
No log	1.7818	98	1.3149	0.3454	1.3149	1.1467
No log	1.8182	100	1.0993	0.3400	1.0993	1.0485
No log	1.8545	102	1.2068	0.3129	1.2068	1.0985
No log	1.8909	104	1.6127	0.2471	1.6127	1.2699
No log	1.9273	106	1.7864	0.2381	1.7864	1.3366
No log	1.9636	108	2.0952	0.1817	2.0952	1.4475
No log	2.0	110	1.9297	0.2429	1.9297	1.3891
No log	2.0364	112	1.6382	0.2713	1.6382	1.2799
No log	2.0727	114	1.5187	0.2120	1.5187	1.2324
No log	2.1091	116	1.3553	0.1667	1.3553	1.1642
No log	2.1455	118	1.5099	0.2154	1.5099	1.2288
No log	2.1818	120	1.7296	0.2469	1.7296	1.3152
No log	2.2182	122	1.8330	0.2538	1.8330	1.3539
No log	2.2545	124	1.6385	0.2220	1.6385	1.2800
No log	2.2909	126	1.4692	0.2479	1.4692	1.2121
No log	2.3273	128	1.3558	0.1345	1.3558	1.1644
No log	2.3636	130	1.1748	0.1345	1.1748	1.0839
No log	2.4	132	1.1255	0.2108	1.1255	1.0609
No log	2.4364	134	1.2411	0.1440	1.2411	1.1140
No log	2.4727	136	1.3969	0.2479	1.3969	1.1819
No log	2.5091	138	1.4931	0.2285	1.4931	1.2219
No log	2.5455	140	1.4077	0.1886	1.4077	1.1865
No log	2.5818	142	1.2747	0.1844	1.2747	1.1290
No log	2.6182	144	1.3434	0.1708	1.3434	1.1590
No log	2.6545	146	1.5446	0.2463	1.5446	1.2428
No log	2.6909	148	1.7112	0.2776	1.7112	1.3081
No log	2.7273	150	1.6814	0.2776	1.6814	1.2967
No log	2.7636	152	1.5209	0.2062	1.5209	1.2332
No log	2.8	154	1.3862	0.2055	1.3862	1.1774
No log	2.8364	156	1.2270	0.2772	1.2270	1.1077
No log	2.8727	158	1.1721	0.2152	1.1721	1.0826
No log	2.9091	160	1.3162	0.2173	1.3162	1.1473
No log	2.9455	162	1.4739	0.2392	1.4739	1.2140
No log	2.9818	164	1.4929	0.2659	1.4929	1.2218
No log	3.0182	166	1.3216	0.2317	1.3216	1.1496
No log	3.0545	168	1.2290	0.2402	1.2290	1.1086
No log	3.0909	170	1.2899	0.2330	1.2899	1.1357
No log	3.1273	172	1.4652	0.2392	1.4652	1.2105
No log	3.1636	174	1.5177	0.2359	1.5177	1.2320
No log	3.2	176	1.4768	0.2105	1.4768	1.2152
No log	3.2364	178	1.3520	0.1592	1.3520	1.1628
No log	3.2727	180	1.3219	0.1889	1.3219	1.1497
No log	3.3091	182	1.3486	0.2479	1.3486	1.1613
No log	3.3455	184	1.4233	0.2424	1.4233	1.1930
No log	3.3818	186	1.5364	0.2929	1.5364	1.2395
No log	3.4182	188	1.6434	0.2535	1.6434	1.2819
No log	3.4545	190	1.5589	0.2592	1.5589	1.2486
No log	3.4909	192	1.5108	0.2564	1.5108	1.2291
No log	3.5273	194	1.3309	0.2252	1.3309	1.1536
No log	3.5636	196	1.2955	0.1345	1.2955	1.1382
No log	3.6	198	1.4044	0.1191	1.4044	1.1851
No log	3.6364	200	1.4340	0.0619	1.4340	1.1975
No log	3.6727	202	1.3750	0.0619	1.3750	1.1726
No log	3.7091	204	1.3605	0.0798	1.3605	1.1664
No log	3.7455	206	1.2918	0.0887	1.2918	1.1366
No log	3.7818	208	1.3513	0.1219	1.3513	1.1625
No log	3.8182	210	1.5236	0.1790	1.5236	1.2344
No log	3.8545	212	1.5423	0.1790	1.5423	1.2419
No log	3.8909	214	1.5581	0.1790	1.5581	1.2482
No log	3.9273	216	1.5102	0.1790	1.5102	1.2289
No log	3.9636	218	1.5505	0.2325	1.5505	1.2452
No log	4.0	220	1.4775	0.2325	1.4775	1.2155
No log	4.0364	222	1.5059	0.2325	1.5059	1.2271
No log	4.0727	224	1.6504	0.1971	1.6504	1.2847
No log	4.1091	226	1.6387	0.1497	1.6387	1.2801
No log	4.1455	228	1.5262	-0.0074	1.5262	1.2354
No log	4.1818	230	1.4027	0.0541	1.4027	1.1844
No log	4.2182	232	1.4340	0.0541	1.4340	1.1975
No log	4.2545	234	1.4650	0.1592	1.4650	1.2104
No log	4.2909	236	1.5802	0.1704	1.5802	1.2571
No log	4.3273	238	1.6338	0.2298	1.6338	1.2782
No log	4.3636	240	1.5347	0.1704	1.5347	1.2388
No log	4.4	242	1.4048	0.1497	1.4048	1.1852
No log	4.4364	244	1.3847	0.1497	1.3847	1.1767
No log	4.4727	246	1.5075	0.1796	1.5075	1.2278
No log	4.5091	248	1.6265	0.3026	1.6265	1.2753
No log	4.5455	250	1.5318	0.1840	1.5318	1.2377
No log	4.5818	252	1.4605	0.1618	1.4605	1.2085
No log	4.6182	254	1.4786	0.1886	1.4786	1.2160
No log	4.6545	256	1.6040	0.2262	1.6040	1.2665
No log	4.6909	258	1.8029	0.2938	1.8029	1.3427
No log	4.7273	260	1.8108	0.2938	1.8108	1.3457
No log	4.7636	262	1.6882	0.3233	1.6882	1.2993
No log	4.8	264	1.5255	0.1935	1.5255	1.2351
No log	4.8364	266	1.4831	0.1935	1.4831	1.2178
No log	4.8727	268	1.4187	0.1935	1.4187	1.1911
No log	4.9091	270	1.3895	0.1980	1.3895	1.1788
No log	4.9455	272	1.3687	0.2589	1.3687	1.1699
No log	4.9818	274	1.4676	0.2632	1.4676	1.2115
No log	5.0182	276	1.5040	0.2065	1.5040	1.2264
No log	5.0545	278	1.4151	0.0961	1.4151	1.1896
No log	5.0909	280	1.3075	0.1596	1.3075	1.1435
No log	5.1273	282	1.2453	0.2000	1.2453	1.1159
No log	5.1636	284	1.3106	0.2494	1.3106	1.1448
No log	5.2	286	1.4718	0.2632	1.4718	1.2132
No log	5.2364	288	1.5877	0.3140	1.5877	1.2600
No log	5.2727	290	1.5443	0.2929	1.5443	1.2427
No log	5.3091	292	1.5000	0.2659	1.5000	1.2247
No log	5.3455	294	1.4748	0.2359	1.4748	1.2144
No log	5.3818	296	1.5069	0.2325	1.5069	1.2276
No log	5.4182	298	1.5073	0.1283	1.5073	1.2277
No log	5.4545	300	1.4759	0.1283	1.4759	1.2149
No log	5.4909	302	1.4080	0.1283	1.4080	1.1866
No log	5.5273	304	1.3213	0.0961	1.3213	1.1495
No log	5.5636	306	1.3571	0.1283	1.3571	1.1650
No log	5.6	308	1.5248	0.2359	1.5248	1.2348
No log	5.6364	310	1.5604	0.2908	1.5604	1.2492
No log	5.6727	312	1.4161	0.1842	1.4161	1.1900
No log	5.7091	314	1.3804	0.1842	1.3804	1.1749
No log	5.7455	316	1.4796	0.2144	1.4796	1.2164
No log	5.7818	318	1.7065	0.3233	1.7065	1.3063
No log	5.8182	320	1.7522	0.3098	1.7522	1.3237
No log	5.8545	322	1.5484	0.3331	1.5484	1.2443
No log	5.8909	324	1.3837	0.1568	1.3837	1.1763
No log	5.9273	326	1.3706	0.2024	1.3706	1.1707
No log	5.9636	328	1.4505	0.2659	1.4505	1.2043
No log	6.0	330	1.5607	0.3433	1.5607	1.2493
No log	6.0364	332	1.5265	0.3233	1.5265	1.2355
No log	6.0727	334	1.4859	0.3532	1.4859	1.2190
No log	6.1091	336	1.4973	0.3433	1.4973	1.2236
No log	6.1455	338	1.6304	0.3114	1.6304	1.2769
No log	6.1818	340	1.6078	0.3081	1.6078	1.2680
No log	6.2182	342	1.3807	0.2789	1.3807	1.1750
No log	6.2545	344	1.3284	0.2544	1.3284	1.1526
No log	6.2909	346	1.3678	0.2544	1.3678	1.1695
No log	6.3273	348	1.3634	0.2512	1.3634	1.1676
No log	6.3636	350	1.2782	0.1592	1.2782	1.1306
No log	6.4	352	1.2380	0.1477	1.2380	1.1126
No log	6.4364	354	1.2642	0.1477	1.2642	1.1244
No log	6.4727	356	1.2810	0.1477	1.2810	1.1318
No log	6.5091	358	1.3322	0.1058	1.3322	1.1542
No log	6.5455	360	1.4572	0.1497	1.4572	1.2072
No log	6.5818	362	1.5187	0.2228	1.5187	1.2323
No log	6.6182	364	1.6639	0.2899	1.6639	1.2899
No log	6.6545	366	1.5966	0.2789	1.5966	1.2636
No log	6.6909	368	1.4017	0.2228	1.4017	1.1839
No log	6.7273	370	1.3460	0.1889	1.3460	1.1602
No log	6.7636	372	1.4403	0.1191	1.4403	1.2001
No log	6.8	374	1.4642	0.0872	1.4642	1.2100
No log	6.8364	376	1.3793	0.0640	1.3793	1.1744
No log	6.8727	378	1.3306	0.0454	1.3306	1.1535
No log	6.9091	380	1.2932	0.0628	1.2932	1.1372
No log	6.9455	382	1.3007	0.1637	1.3007	1.1405
No log	6.9818	384	1.4410	0.1497	1.4410	1.2004
No log	7.0182	386	1.6910	0.2293	1.6910	1.3004
No log	7.0545	388	1.8054	0.2975	1.8054	1.3437
No log	7.0909	390	1.7106	0.2508	1.7106	1.3079
No log	7.1273	392	1.5020	0.1790	1.5020	1.2255
No log	7.1636	394	1.3680	0.1477	1.3680	1.1696
No log	7.2	396	1.3247	0.1477	1.3247	1.1510
No log	7.2364	398	1.3289	0.1789	1.3289	1.1528
No log	7.2727	400	1.3480	0.1592	1.3480	1.1610
No log	7.3091	402	1.3583	0.1789	1.3583	1.1655
No log	7.3455	404	1.3530	0.1477	1.3530	1.1632
No log	7.3818	406	1.3362	0.0887	1.3362	1.1560
No log	7.4182	408	1.3689	0.0887	1.3689	1.1700
No log	7.4545	410	1.3786	0.1789	1.3786	1.1741
No log	7.4909	412	1.3133	0.1944	1.3133	1.1460
No log	7.5273	414	1.3557	0.1889	1.3557	1.1644
No log	7.5636	416	1.4589	0.2982	1.4589	1.2078
No log	7.6	418	1.4732	0.2341	1.4732	1.2138
No log	7.6364	420	1.4644	0.1497	1.4644	1.2101
No log	7.6727	422	1.3384	0.1592	1.3384	1.1569
No log	7.7091	424	1.1859	0.0887	1.1859	1.0890
No log	7.7455	426	1.0674	0.1211	1.0674	1.0331
No log	7.7818	428	1.0491	0.1649	1.0491	1.0243
No log	7.8182	430	1.1383	0.0954	1.1383	1.0669
No log	7.8545	432	1.3201	0.1789	1.3201	1.1490
No log	7.8909	434	1.3938	0.2112	1.3938	1.1806
No log	7.9273	436	1.2805	0.2373	1.2805	1.1316
No log	7.9636	438	1.1648	0.2000	1.1648	1.0792
No log	8.0	440	1.1154	0.1761	1.1154	1.0561
No log	8.0364	442	1.1508	0.1118	1.1508	1.0728
No log	8.0727	444	1.1946	0.1053	1.1946	1.0930
No log	8.1091	446	1.2266	0.1053	1.2266	1.1075
No log	8.1455	448	1.2752	0.0456	1.2752	1.1293
No log	8.1818	450	1.3446	0.0798	1.3446	1.1596
No log	8.2182	452	1.3812	0.0798	1.3812	1.1752
No log	8.2545	454	1.3760	0.0798	1.3760	1.1730
No log	8.2909	456	1.3089	0.0798	1.3089	1.1441
No log	8.3273	458	1.2733	0.1944	1.2733	1.1284
No log	8.3636	460	1.3484	0.1884	1.3484	1.1612
No log	8.4	462	1.5144	0.2052	1.5144	1.2306
No log	8.4364	464	1.6176	0.2394	1.6176	1.2719
No log	8.4727	466	1.5508	0.1751	1.5508	1.2453
No log	8.5091	468	1.3959	0.1191	1.3959	1.1815
No log	8.5455	470	1.2818	0.1053	1.2818	1.1322
No log	8.5818	472	1.2644	0.0980	1.2644	1.1244
No log	8.6182	474	1.2996	0.0887	1.2996	1.1400
No log	8.6545	476	1.3544	0.0798	1.3544	1.1638
No log	8.6909	478	1.4167	0.1191	1.4167	1.1903
No log	8.7273	480	1.4236	0.1191	1.4236	1.1932
No log	8.7636	482	1.4376	0.1838	1.4376	1.1990
No log	8.8	484	1.3969	0.1497	1.3969	1.1819
No log	8.8364	486	1.3772	0.1058	1.3772	1.1736
No log	8.8727	488	1.4004	0.1687	1.4004	1.1834
No log	8.9091	490	1.3999	0.1740	1.3999	1.1832
No log	8.9455	492	1.4069	0.1740	1.4069	1.1861
No log	8.9818	494	1.4605	0.2411	1.4605	1.2085
No log	9.0182	496	1.5319	0.2740	1.5319	1.2377
No log	9.0545	498	1.5931	0.2644	1.5931	1.2622
0.3275	9.0909	500	1.5097	0.2740	1.5097	1.2287
0.3275	9.1273	502	1.3451	0.1790	1.3451	1.1598
0.3275	9.1636	504	1.2389	0.1058	1.2389	1.1131
0.3275	9.2	506	1.2359	0.1379	1.2359	1.1117
0.3275	9.2364	508	1.3209	0.1740	1.3209	1.1493
0.3275	9.2727	510	1.4493	0.2377	1.4493	1.2039

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1