ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2005
• Qwk: 0.1696
• Mse: 1.2005
• Rmse: 1.0957

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.6577	-0.0020	4.6577	2.1582
No log	0.0769	4	2.5107	0.0643	2.5107	1.5845
No log	0.1154	6	2.0064	0.0290	2.0064	1.4165
No log	0.1538	8	1.4312	0.0586	1.4312	1.1963
No log	0.1923	10	1.3063	0.0500	1.3063	1.1429
No log	0.2308	12	1.2142	0.2632	1.2142	1.1019
No log	0.2692	14	1.1716	0.1814	1.1716	1.0824
No log	0.3077	16	1.2162	0.2369	1.2162	1.1028
No log	0.3462	18	1.4062	0.0497	1.4062	1.1858
No log	0.3846	20	1.4840	-0.0534	1.4840	1.2182
No log	0.4231	22	1.4912	0.0169	1.4912	1.2212
No log	0.4615	24	1.4124	0.0104	1.4124	1.1884
No log	0.5	26	1.5030	0.0019	1.5030	1.2260
No log	0.5385	28	1.5546	0.0	1.5546	1.2468
No log	0.5769	30	1.6351	0.0	1.6351	1.2787
No log	0.6154	32	1.5016	0.0	1.5016	1.2254
No log	0.6538	34	1.4104	0.0	1.4104	1.1876
No log	0.6923	36	1.3316	0.1106	1.3316	1.1540
No log	0.7308	38	1.1993	0.1753	1.1993	1.0951
No log	0.7692	40	1.1671	0.1935	1.1671	1.0803
No log	0.8077	42	1.1501	0.1875	1.1501	1.0724
No log	0.8462	44	1.1864	0.1852	1.1864	1.0892
No log	0.8846	46	1.4136	0.0587	1.4136	1.1889
No log	0.9231	48	1.6892	-0.0129	1.6892	1.2997
No log	0.9615	50	1.6811	0.0185	1.6811	1.2966
No log	1.0	52	1.8495	0.0161	1.8495	1.3600
No log	1.0385	54	1.7822	0.0915	1.7822	1.3350
No log	1.0769	56	1.6778	0.0878	1.6778	1.2953
No log	1.1154	58	1.4419	0.0714	1.4419	1.2008
No log	1.1538	60	1.3523	0.0342	1.3523	1.1629
No log	1.1923	62	1.2687	0.1927	1.2687	1.1264
No log	1.2308	64	1.2672	0.1927	1.2672	1.1257
No log	1.2692	66	1.2716	0.1634	1.2716	1.1276
No log	1.3077	68	1.2841	0.1523	1.2841	1.1332
No log	1.3462	70	1.2541	0.1995	1.2541	1.1199
No log	1.3846	72	1.4342	0.1761	1.4342	1.1976
No log	1.4231	74	1.5476	0.1765	1.5476	1.2440
No log	1.4615	76	1.3894	0.1395	1.3894	1.1787
No log	1.5	78	1.2010	0.2579	1.2010	1.0959
No log	1.5385	80	1.1795	0.2577	1.1795	1.0861
No log	1.5769	82	1.2296	0.2143	1.2296	1.1089
No log	1.6154	84	1.1804	0.2942	1.1804	1.0865
No log	1.6538	86	1.1540	0.3083	1.1540	1.0742
No log	1.6923	88	1.2274	0.2444	1.2274	1.1079
No log	1.7308	90	1.1914	0.2282	1.1914	1.0915
No log	1.7692	92	1.1667	0.2653	1.1667	1.0802
No log	1.8077	94	1.2373	0.3166	1.2373	1.1123
No log	1.8462	96	1.3391	0.3163	1.3391	1.1572
No log	1.8846	98	1.3547	0.2868	1.3547	1.1639
No log	1.9231	100	1.2748	0.2733	1.2748	1.1291
No log	1.9615	102	1.3531	0.1983	1.3531	1.1632
No log	2.0	104	1.3728	0.2236	1.3728	1.1717
No log	2.0385	106	1.4548	0.2516	1.4548	1.2061
No log	2.0769	108	1.5958	0.2370	1.5958	1.2632
No log	2.1154	110	1.8070	0.1920	1.8070	1.3442
No log	2.1538	112	1.7736	0.2944	1.7736	1.3318
No log	2.1923	114	1.1956	0.3932	1.1956	1.0934
No log	2.2308	116	1.0597	0.3017	1.0597	1.0294
No log	2.2692	118	1.0732	0.2306	1.0732	1.0359
No log	2.3077	120	1.3915	0.3559	1.3915	1.1796
No log	2.3462	122	1.9336	0.1686	1.9336	1.3905
No log	2.3846	124	1.7467	0.2156	1.7467	1.3216
No log	2.4231	126	1.5550	0.3082	1.5550	1.2470
No log	2.4615	128	1.1216	0.2978	1.1216	1.0591
No log	2.5	130	1.0501	0.3069	1.0501	1.0247
No log	2.5385	132	1.0917	0.2195	1.0917	1.0449
No log	2.5769	134	1.0006	0.3018	1.0006	1.0003
No log	2.6154	136	0.9770	0.3237	0.9770	0.9884
No log	2.6538	138	1.0228	0.2496	1.0228	1.0113
No log	2.6923	140	1.3361	0.3631	1.3361	1.1559
No log	2.7308	142	1.4962	0.3835	1.4962	1.2232
No log	2.7692	144	1.6282	0.3396	1.6282	1.2760
No log	2.8077	146	1.5230	0.4019	1.5230	1.2341
No log	2.8462	148	1.2347	0.2212	1.2347	1.1112
No log	2.8846	150	1.0788	0.1775	1.0788	1.0386
No log	2.9231	152	1.0879	0.1920	1.0879	1.0430
No log	2.9615	154	1.2443	0.2958	1.2443	1.1155
No log	3.0	156	1.3502	0.3377	1.3502	1.1620
No log	3.0385	158	1.2888	0.3215	1.2888	1.1353
No log	3.0769	160	1.3193	0.3215	1.3193	1.1486
No log	3.1154	162	1.2833	0.3109	1.2833	1.1328
No log	3.1538	164	1.2266	0.2466	1.2266	1.1075
No log	3.1923	166	1.2401	0.2525	1.2401	1.1136
No log	3.2308	168	1.3588	0.3284	1.3588	1.1657
No log	3.2692	170	1.4244	0.3243	1.4244	1.1935
No log	3.3077	172	1.4134	0.2956	1.4134	1.1889
No log	3.3462	174	1.3269	0.2381	1.3269	1.1519
No log	3.3846	176	1.2881	0.1058	1.2881	1.1349
No log	3.4231	178	1.3315	0.2650	1.3315	1.1539
No log	3.4615	180	1.3595	0.2772	1.3595	1.1660
No log	3.5	182	1.4173	0.3243	1.4173	1.1905
No log	3.5385	184	1.3443	0.3243	1.3443	1.1594
No log	3.5769	186	1.2351	0.2799	1.2351	1.1114
No log	3.6154	188	1.1152	0.2650	1.1152	1.0560
No log	3.6538	190	1.0863	0.2381	1.0863	1.0423
No log	3.6923	192	1.2374	0.2895	1.2374	1.1124
No log	3.7308	194	1.3813	0.3487	1.3813	1.1753
No log	3.7692	196	1.5238	0.3358	1.5238	1.2344
No log	3.8077	198	1.3756	0.3026	1.3756	1.1729
No log	3.8462	200	1.1049	0.1557	1.1049	1.0512
No log	3.8846	202	0.9888	0.2673	0.9888	0.9944
No log	3.9231	204	1.0000	0.2947	1.0000	1.0000
No log	3.9615	206	1.2846	0.3559	1.2846	1.1334
No log	4.0	208	2.0435	0.1209	2.0435	1.4295
No log	4.0385	210	2.3231	0.0672	2.3231	1.5242
No log	4.0769	212	2.1661	0.0835	2.1661	1.4718
No log	4.1154	214	1.8149	0.2960	1.8149	1.3472
No log	4.1538	216	1.2857	0.3466	1.2857	1.1339
No log	4.1923	218	1.0512	0.3177	1.0512	1.0253
No log	4.2308	220	1.0472	0.3043	1.0472	1.0233
No log	4.2692	222	1.1658	0.3552	1.1658	1.0797
No log	4.3077	224	1.3931	0.3738	1.3931	1.1803
No log	4.3462	226	1.5454	0.2989	1.5454	1.2431
No log	4.3846	228	1.3713	0.2815	1.3713	1.1710
No log	4.4231	230	1.1784	0.2772	1.1784	1.0856
No log	4.4615	232	1.1622	0.2884	1.1622	1.0781
No log	4.5	234	1.2333	0.3115	1.2333	1.1105
No log	4.5385	236	1.2844	0.3243	1.2844	1.1333
No log	4.5769	238	1.2447	0.3372	1.2447	1.1157
No log	4.6154	240	1.1885	0.2837	1.1885	1.0902
No log	4.6538	242	1.0812	0.2654	1.0812	1.0398
No log	4.6923	244	1.0715	0.2772	1.0715	1.0351
No log	4.7308	246	1.1228	0.2619	1.1228	1.0596
No log	4.7692	248	1.3300	0.3402	1.3300	1.1533
No log	4.8077	250	1.6580	0.3835	1.6580	1.2876
No log	4.8462	252	1.6494	0.3478	1.6494	1.2843
No log	4.8846	254	1.4646	0.3363	1.4646	1.2102
No log	4.9231	256	1.2879	0.3115	1.2879	1.1349
No log	4.9615	258	1.1917	0.2046	1.1917	1.0917
No log	5.0	260	1.1869	0.2046	1.1869	1.0894
No log	5.0385	262	1.1688	0.2046	1.1688	1.0811
No log	5.0769	264	1.1510	0.2195	1.1510	1.0729
No log	5.1154	266	1.1701	0.3249	1.1701	1.0817
No log	5.1538	268	1.2862	0.3357	1.2862	1.1341
No log	5.1923	270	1.4836	0.3478	1.4836	1.2180
No log	5.2308	272	1.4941	0.3490	1.4941	1.2223
No log	5.2692	274	1.3402	0.3136	1.3402	1.1577
No log	5.3077	276	1.1677	0.2100	1.1677	1.0806
No log	5.3462	278	1.1269	0.1505	1.1269	1.0616
No log	5.3846	280	1.1534	0.1114	1.1534	1.0740
No log	5.4231	282	1.2600	0.2535	1.2600	1.1225
No log	5.4615	284	1.3225	0.2424	1.3225	1.1500
No log	5.5	286	1.3480	0.2224	1.3480	1.1610
No log	5.5385	288	1.2696	0.2864	1.2696	1.1268
No log	5.5769	290	1.1960	0.2909	1.1960	1.0936
No log	5.6154	292	1.2140	0.3158	1.2140	1.1018
No log	5.6538	294	1.2497	0.3024	1.2497	1.1179
No log	5.6923	296	1.4158	0.2833	1.4158	1.1899
No log	5.7308	298	1.4849	0.2704	1.4849	1.2186
No log	5.7692	300	1.3922	0.2696	1.3922	1.1799
No log	5.8077	302	1.3026	0.2184	1.3026	1.1413
No log	5.8462	304	1.2895	0.1896	1.2895	1.1356
No log	5.8846	306	1.2656	0.2097	1.2656	1.1250
No log	5.9231	308	1.3008	0.1896	1.3008	1.1405
No log	5.9615	310	1.2936	0.2956	1.2936	1.1374
No log	6.0	312	1.3374	0.2619	1.3374	1.1565
No log	6.0385	314	1.3912	0.3243	1.3912	1.1795
No log	6.0769	316	1.4472	0.3366	1.4472	1.2030
No log	6.1154	318	1.5548	0.3254	1.5548	1.2469
No log	6.1538	320	1.4590	0.4122	1.4590	1.2079
No log	6.1923	322	1.2425	0.2953	1.2425	1.1147
No log	6.2308	324	1.1945	0.2586	1.1945	1.0929
No log	6.2692	326	1.2571	0.2809	1.2571	1.1212
No log	6.3077	328	1.3712	0.3171	1.3712	1.1710
No log	6.3462	330	1.5545	0.3317	1.5545	1.2468
No log	6.3846	332	1.5963	0.3542	1.5963	1.2634
No log	6.4231	334	1.4971	0.3105	1.4971	1.2236
No log	6.4615	336	1.4145	0.3418	1.4145	1.1893
No log	6.5	338	1.3793	0.3324	1.3793	1.1745
No log	6.5385	340	1.3777	0.3523	1.3777	1.1737
No log	6.5769	342	1.2902	0.2693	1.2902	1.1359
No log	6.6154	344	1.2204	0.1952	1.2204	1.1047
No log	6.6538	346	1.1734	0.1641	1.1734	1.0832
No log	6.6923	348	1.1869	0.1641	1.1869	1.0895
No log	6.7308	350	1.2182	0.1479	1.2182	1.1037
No log	6.7692	352	1.1923	0.1315	1.1923	1.0919
No log	6.8077	354	1.1807	0.1480	1.1807	1.0866
No log	6.8462	356	1.1888	0.1801	1.1888	1.0903
No log	6.8846	358	1.2703	0.2799	1.2703	1.1271
No log	6.9231	360	1.4383	0.3339	1.4383	1.1993
No log	6.9615	362	1.5900	0.3659	1.5900	1.2610
No log	7.0	364	1.7409	0.2590	1.7409	1.3194
No log	7.0385	366	1.6388	0.3324	1.6388	1.2801
No log	7.0769	368	1.3982	0.3339	1.3982	1.1824
No log	7.1154	370	1.2993	0.2822	1.2993	1.1399
No log	7.1538	372	1.2592	0.2589	1.2592	1.1221
No log	7.1923	374	1.3465	0.2857	1.3465	1.1604
No log	7.2308	376	1.4974	0.3392	1.4974	1.2237
No log	7.2692	378	1.5371	0.3067	1.5371	1.2398
No log	7.3077	380	1.4527	0.2632	1.4527	1.2053
No log	7.3462	382	1.2366	0.2387	1.2366	1.1120
No log	7.3846	384	1.0921	0.1919	1.0921	1.0450
No log	7.4231	386	1.0771	0.2076	1.0771	1.0378
No log	7.4615	388	1.1125	0.2009	1.1125	1.0548
No log	7.5	390	1.2487	0.2097	1.2487	1.1174
No log	7.5385	392	1.3948	0.2065	1.3948	1.1810
No log	7.5769	394	1.4308	0.2359	1.4308	1.1962
No log	7.6154	396	1.3465	0.2707	1.3465	1.1604
No log	7.6538	398	1.1805	0.2009	1.1805	1.0865
No log	7.6923	400	1.1302	0.2009	1.1302	1.0631
No log	7.7308	402	1.1908	0.1952	1.1908	1.0912
No log	7.7692	404	1.3662	0.2105	1.3662	1.1688
No log	7.8077	406	1.5120	0.2604	1.5120	1.2296
No log	7.8462	408	1.5146	0.2604	1.5146	1.2307
No log	7.8846	410	1.3814	0.2457	1.3814	1.1753
No log	7.9231	412	1.2057	0.2000	1.2057	1.0980
No log	7.9615	414	1.1464	0.2152	1.1464	1.0707
No log	8.0	416	1.1693	0.2152	1.1693	1.0813
No log	8.0385	418	1.2856	0.1944	1.2856	1.1338
No log	8.0769	420	1.4147	0.1698	1.4147	1.1894
No log	8.1154	422	1.4458	0.2252	1.4458	1.2024
No log	8.1538	424	1.3851	0.2617	1.3851	1.1769
No log	8.1923	426	1.2582	0.1944	1.2582	1.1217
No log	8.2308	428	1.1743	0.2000	1.1743	1.0837
No log	8.2692	430	1.1416	0.2152	1.1416	1.0684
No log	8.3077	432	1.1713	0.2000	1.1713	1.0823
No log	8.3462	434	1.3140	0.2817	1.3140	1.1463
No log	8.3846	436	1.4033	0.2918	1.4033	1.1846
No log	8.4231	438	1.3840	0.2918	1.3840	1.1765
No log	8.4615	440	1.2602	0.3047	1.2602	1.1226
No log	8.5	442	1.1693	0.2864	1.1693	1.0813
No log	8.5385	444	1.1896	0.2696	1.1896	1.0907
No log	8.5769	446	1.2468	0.2037	1.2468	1.1166
No log	8.6154	448	1.2076	0.1944	1.2076	1.0989
No log	8.6538	450	1.1543	0.1952	1.1543	1.0744
No log	8.6923	452	1.1599	0.2250	1.1599	1.0770
No log	8.7308	454	1.2176	0.2905	1.2176	1.1035
No log	8.7692	456	1.3508	0.2918	1.3508	1.1622
No log	8.8077	458	1.3417	0.3171	1.3417	1.1583
No log	8.8462	460	1.3213	0.4316	1.3213	1.1495
No log	8.8846	462	1.2449	0.4038	1.2449	1.1157
No log	8.9231	464	1.2944	0.4316	1.2944	1.1377
No log	8.9615	466	1.4036	0.3939	1.4036	1.1847
No log	9.0	468	1.3966	0.4314	1.3966	1.1818
No log	9.0385	470	1.3739	0.4122	1.3739	1.1721
No log	9.0769	472	1.2650	0.2696	1.2650	1.1247
No log	9.1154	474	1.1461	0.2056	1.1461	1.0706
No log	9.1538	476	1.1255	0.1442	1.1255	1.0609
No log	9.1923	478	1.1371	0.1755	1.1371	1.0664
No log	9.2308	480	1.1951	0.3212	1.1951	1.0932
No log	9.2692	482	1.2717	0.2817	1.2717	1.1277
No log	9.3077	484	1.2756	0.2956	1.2756	1.1294
No log	9.3462	486	1.2450	0.3001	1.2450	1.1158
No log	9.3846	488	1.2112	0.2152	1.2112	1.1006
No log	9.4231	490	1.2535	0.2152	1.2535	1.1196
No log	9.4615	492	1.2866	0.2152	1.2866	1.1343
No log	9.5	494	1.3525	0.2238	1.3525	1.1630
No log	9.5385	496	1.4015	0.2238	1.4015	1.1838
No log	9.5769	498	1.3853	0.2553	1.3853	1.1770
0.3832	9.6154	500	1.2786	0.2475	1.2786	1.1308
0.3832	9.6538	502	1.2490	0.2743	1.2490	1.1176
0.3832	9.6923	504	1.3228	0.3094	1.3228	1.1501
0.3832	9.7308	506	1.4041	0.2870	1.4041	1.1850
0.3832	9.7692	508	1.3864	0.3113	1.3864	1.1775
0.3832	9.8077	510	1.2731	0.2633	1.2731	1.1283
0.3832	9.8462	512	1.1922	0.1696	1.1922	1.0919
0.3832	9.8846	514	1.1672	0.1214	1.1672	1.0804
0.3832	9.9231	516	1.1328	0.1180	1.1328	1.0643
0.3832	9.9615	518	1.1586	0.1379	1.1586	1.0764
0.3832	10.0	520	1.2005	0.1696	1.2005	1.0957

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1