ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2576
• Qwk: 0.1727
• Mse: 1.2576
• Rmse: 1.1214

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1053	2	3.9176	-0.0150	3.9176	1.9793
No log	0.2105	4	2.3266	0.0014	2.3266	1.5253
No log	0.3158	6	1.4976	-0.0219	1.4976	1.2238
No log	0.4211	8	1.3063	0.0683	1.3063	1.1429
No log	0.5263	10	1.1381	0.1864	1.1381	1.0668
No log	0.6316	12	1.1502	0.1521	1.1502	1.0725
No log	0.7368	14	1.1766	0.1361	1.1766	1.0847
No log	0.8421	16	1.1754	0.1268	1.1754	1.0842
No log	0.9474	18	1.0866	0.2042	1.0866	1.0424
No log	1.0526	20	1.0508	0.2140	1.0508	1.0251
No log	1.1579	22	1.0410	0.2140	1.0410	1.0203
No log	1.2632	24	1.0478	0.2391	1.0478	1.0236
No log	1.3684	26	1.0752	0.1196	1.0752	1.0369
No log	1.4737	28	1.0536	0.2239	1.0536	1.0264
No log	1.5789	30	1.0848	0.2061	1.0848	1.0416
No log	1.6842	32	1.3580	0.0169	1.3580	1.1653
No log	1.7895	34	1.5793	0.0178	1.5793	1.2567
No log	1.8947	36	1.2727	0.0202	1.2727	1.1281
No log	2.0	38	1.1210	0.3478	1.1210	1.0588
No log	2.1053	40	1.2585	0.1745	1.2585	1.1218
No log	2.2105	42	1.1723	0.2594	1.1723	1.0827
No log	2.3158	44	1.2669	0.1131	1.2669	1.1256
No log	2.4211	46	1.6367	-0.2230	1.6367	1.2793
No log	2.5263	48	1.6755	-0.2645	1.6755	1.2944
No log	2.6316	50	1.3141	-0.0393	1.3141	1.1464
No log	2.7368	52	1.1324	0.1408	1.1324	1.0641
No log	2.8421	54	1.1472	0.1489	1.1472	1.0711
No log	2.9474	56	1.4208	0.1914	1.4208	1.1920
No log	3.0526	58	1.8329	0.1078	1.8329	1.3538
No log	3.1579	60	1.8597	0.1020	1.8597	1.3637
No log	3.2632	62	1.5590	0.1627	1.5590	1.2486
No log	3.3684	64	1.3824	0.2062	1.3824	1.1758
No log	3.4737	66	1.5354	0.1322	1.5354	1.2391
No log	3.5789	68	1.8041	0.1283	1.8041	1.3432
No log	3.6842	70	1.9207	-0.0056	1.9207	1.3859
No log	3.7895	72	1.9470	0.0018	1.9470	1.3953
No log	3.8947	74	1.9005	-0.0283	1.9005	1.3786
No log	4.0	76	1.8293	0.0477	1.8293	1.3525
No log	4.1053	78	1.6410	0.0484	1.6410	1.2810
No log	4.2105	80	1.5210	0.1081	1.5210	1.2333
No log	4.3158	82	1.4128	0.0033	1.4128	1.1886
No log	4.4211	84	1.3978	0.0691	1.3978	1.1823
No log	4.5263	86	1.4478	0.1081	1.4478	1.2032
No log	4.6316	88	1.5616	0.1328	1.5616	1.2496
No log	4.7368	90	1.7871	0.1207	1.7871	1.3368
No log	4.8421	92	1.9847	0.1252	1.9847	1.4088
No log	4.9474	94	1.9684	0.1176	1.9684	1.4030
No log	5.0526	96	1.6582	0.1353	1.6582	1.2877
No log	5.1579	98	1.6566	0.1353	1.6566	1.2871
No log	5.2632	100	1.9027	0.1409	1.9027	1.3794
No log	5.3684	102	2.3246	0.0950	2.3246	1.5247
No log	5.4737	104	2.2937	0.0900	2.2937	1.5145
No log	5.5789	106	2.0357	0.1368	2.0357	1.4268
No log	5.6842	108	1.6459	0.1071	1.6459	1.2829
No log	5.7895	110	1.4526	0.1751	1.4526	1.2052
No log	5.8947	112	1.4925	0.1630	1.4925	1.2217
No log	6.0	114	1.6254	0.1000	1.6254	1.2749
No log	6.1053	116	1.6562	0.1000	1.6562	1.2869
No log	6.2105	118	1.6339	0.1365	1.6339	1.2782
No log	6.3158	120	1.5847	0.2129	1.5847	1.2588
No log	6.4211	122	1.6998	0.1183	1.6998	1.3038
No log	6.5263	124	1.8697	0.1140	1.8697	1.3674
No log	6.6316	126	2.0163	0.1258	2.0163	1.4200
No log	6.7368	128	1.8876	0.1505	1.8876	1.3739
No log	6.8421	130	1.5074	0.1562	1.5074	1.2278
No log	6.9474	132	1.2349	0.0987	1.2349	1.1112
No log	7.0526	134	1.2134	0.1141	1.2134	1.1015
No log	7.1579	136	1.3453	0.0931	1.3453	1.1599
No log	7.2632	138	1.6169	0.1509	1.6169	1.2716
No log	7.3684	140	1.6776	0.1487	1.6776	1.2952
No log	7.4737	142	1.5720	0.1729	1.5720	1.2538
No log	7.5789	144	1.5050	0.1832	1.5050	1.2268
No log	7.6842	146	1.5236	0.2117	1.5236	1.2344
No log	7.7895	148	1.6316	0.1344	1.6316	1.2773
No log	7.8947	150	1.6265	0.1467	1.6265	1.2753
No log	8.0	152	1.5042	0.2221	1.5042	1.2265
No log	8.1053	154	1.4140	0.2117	1.4140	1.1891
No log	8.2105	156	1.4277	0.2117	1.4277	1.1949
No log	8.3158	158	1.3340	0.1958	1.3340	1.1550
No log	8.4211	160	1.3011	0.1904	1.3011	1.1407
No log	8.5263	162	1.3779	0.1832	1.3779	1.1738
No log	8.6316	164	1.5340	0.2170	1.5340	1.2386
No log	8.7368	166	1.5985	0.1635	1.5985	1.2643
No log	8.8421	168	1.6468	0.1694	1.6468	1.2833
No log	8.9474	170	1.6180	0.1694	1.6180	1.2720
No log	9.0526	172	1.4764	0.1595	1.4764	1.2151
No log	9.1579	174	1.4013	0.0760	1.4013	1.1838
No log	9.2632	176	1.3915	0.0	1.3915	1.1796
No log	9.3684	178	1.4553	0.1814	1.4553	1.2064
No log	9.4737	180	1.4647	0.2126	1.4647	1.2102
No log	9.5789	182	1.4300	0.2126	1.4300	1.1958
No log	9.6842	184	1.3483	0.0401	1.3483	1.1611
No log	9.7895	186	1.2226	-0.0091	1.2226	1.1057
No log	9.8947	188	1.2123	0.1198	1.2123	1.1010
No log	10.0	190	1.3346	0.1980	1.3346	1.1552
No log	10.1053	192	1.5156	0.2005	1.5156	1.2311
No log	10.2105	194	1.5091	0.2058	1.5091	1.2284
No log	10.3158	196	1.4360	0.1950	1.4360	1.1984
No log	10.4211	198	1.2549	0.0691	1.2549	1.1202
No log	10.5263	200	1.2047	-0.0216	1.2047	1.0976
No log	10.6316	202	1.3060	0.1728	1.3060	1.1428
No log	10.7368	204	1.4387	0.2005	1.4387	1.1994
No log	10.8421	206	1.5347	0.2005	1.5347	1.2388
No log	10.9474	208	1.4749	0.2005	1.4749	1.2144
No log	11.0526	210	1.3497	0.1832	1.3497	1.1618
No log	11.1579	212	1.1838	0.1170	1.1838	1.0880
No log	11.2632	214	1.1582	0.0811	1.1582	1.0762
No log	11.3684	216	1.2644	0.1880	1.2644	1.1245
No log	11.4737	218	1.4375	0.1950	1.4375	1.1990
No log	11.5789	220	1.5114	0.1950	1.5114	1.2294
No log	11.6842	222	1.6426	0.1344	1.6426	1.2816
No log	11.7895	224	1.7073	0.1663	1.7073	1.3066
No log	11.8947	226	1.6150	0.1279	1.6150	1.2708
No log	12.0	228	1.4748	0.1943	1.4748	1.2144
No log	12.1053	230	1.4182	0.2065	1.4182	1.1909
No log	12.2105	232	1.4542	0.2065	1.4542	1.2059
No log	12.3158	234	1.5582	0.1573	1.5582	1.2483
No log	12.4211	236	1.6654	0.1007	1.6654	1.2905
No log	12.5263	238	1.7155	0.1014	1.7155	1.3098
No log	12.6316	240	1.5630	0.2110	1.5630	1.2502
No log	12.7368	242	1.3691	0.1751	1.3691	1.1701
No log	12.8421	244	1.3465	0.1751	1.3465	1.1604
No log	12.9474	246	1.5056	0.2058	1.5056	1.2270
No log	13.0526	248	1.5367	0.2058	1.5367	1.2396
No log	13.1579	250	1.5288	0.2005	1.5288	1.2364
No log	13.2632	252	1.4272	0.1562	1.4272	1.1946
No log	13.3684	254	1.3997	0.0781	1.3997	1.1831
No log	13.4737	256	1.4326	0.0781	1.4326	1.1969
No log	13.5789	258	1.4056	0.0390	1.4056	1.1856
No log	13.6842	260	1.4711	0.1032	1.4711	1.2129
No log	13.7895	262	1.5718	0.2005	1.5718	1.2537
No log	13.8947	264	1.6196	0.1694	1.6196	1.2726
No log	14.0	266	1.6067	0.1635	1.6067	1.2676
No log	14.1053	268	1.4812	0.1950	1.4812	1.2171
No log	14.2105	270	1.4407	0.1950	1.4407	1.2003
No log	14.3158	272	1.4133	0.1950	1.4133	1.1888
No log	14.4211	274	1.4751	0.1950	1.4751	1.2145
No log	14.5263	276	1.4878	0.1950	1.4878	1.2198
No log	14.6316	278	1.4498	0.2117	1.4498	1.2041
No log	14.7368	280	1.3721	0.2292	1.3721	1.1714
No log	14.8421	282	1.3313	0.2084	1.3313	1.1538
No log	14.9474	284	1.4384	0.2170	1.4384	1.1993
No log	15.0526	286	1.4810	0.2342	1.4810	1.2170
No log	15.1579	288	1.4927	0.1943	1.4927	1.2217
No log	15.2632	290	1.5083	0.1943	1.5083	1.2281
No log	15.3684	292	1.5456	0.2062	1.5456	1.2432
No log	15.4737	294	1.5499	0.2117	1.5499	1.2450
No log	15.5789	296	1.5157	0.2117	1.5157	1.2311
No log	15.6842	298	1.4273	0.2117	1.4273	1.1947
No log	15.7895	300	1.4342	0.1950	1.4342	1.1976
No log	15.8947	302	1.4540	0.1950	1.4540	1.2058
No log	16.0	304	1.3503	0.1790	1.3503	1.1620
No log	16.1053	306	1.3156	0.1790	1.3156	1.1470
No log	16.2105	308	1.4009	0.1950	1.4009	1.1836
No log	16.3158	310	1.4128	0.1950	1.4128	1.1886
No log	16.4211	312	1.4051	0.1950	1.4051	1.1854
No log	16.5263	314	1.2677	0.2211	1.2677	1.1259
No log	16.6316	316	1.2217	0.2112	1.2217	1.1053
No log	16.7368	318	1.3630	0.2144	1.3630	1.1675
No log	16.8421	320	1.3979	0.2144	1.3979	1.1823
No log	16.9474	322	1.4235	0.1810	1.4235	1.1931
No log	17.0526	324	1.3596	0.1980	1.3596	1.1660
No log	17.1579	326	1.3495	0.1854	1.3495	1.1617
No log	17.2632	328	1.3606	0.2184	1.3606	1.1664
No log	17.3684	330	1.3182	0.2372	1.3182	1.1481
No log	17.4737	332	1.2991	0.2203	1.2991	1.1398
No log	17.5789	334	1.3225	0.2315	1.3225	1.1500
No log	17.6842	336	1.3133	0.2315	1.3133	1.1460
No log	17.7895	338	1.4054	0.2187	1.4054	1.1855
No log	17.8947	340	1.5551	0.1902	1.5551	1.2471
No log	18.0	342	1.7049	0.2457	1.7049	1.3057
No log	18.1053	344	1.7269	0.2457	1.7269	1.3141
No log	18.2105	346	1.6023	0.2448	1.6023	1.2658
No log	18.3158	348	1.4209	0.1914	1.4209	1.1920
No log	18.4211	350	1.2933	0.1316	1.2933	1.1372
No log	18.5263	352	1.2627	0.0310	1.2627	1.1237
No log	18.6316	354	1.2832	0.0961	1.2832	1.1328
No log	18.7368	356	1.3197	0.1512	1.3197	1.1488
No log	18.8421	358	1.3969	0.2417	1.3969	1.1819
No log	18.9474	360	1.4939	0.2005	1.4939	1.2223
No log	19.0526	362	1.5347	0.1635	1.5347	1.2388
No log	19.1579	364	1.4856	0.2005	1.4856	1.2189
No log	19.2632	366	1.3601	0.2240	1.3601	1.1662
No log	19.3684	368	1.2618	0.2126	1.2618	1.1233
No log	19.4737	370	1.2974	0.2126	1.2974	1.1391
No log	19.5789	372	1.3120	0.2126	1.3120	1.1454
No log	19.6842	374	1.2432	0.2126	1.2432	1.1150
No log	19.7895	376	1.2422	0.2126	1.2422	1.1145
No log	19.8947	378	1.3295	0.2292	1.3295	1.1530
No log	20.0	380	1.4918	0.2117	1.4918	1.2214
No log	20.1053	382	1.4861	0.1630	1.4861	1.2191
No log	20.2105	384	1.4523	0.1872	1.4523	1.2051
No log	20.3158	386	1.4816	0.1630	1.4816	1.2172
No log	20.4211	388	1.4997	0.2062	1.4997	1.2246
No log	20.5263	390	1.4411	0.2239	1.4411	1.2005
No log	20.6316	392	1.3935	0.1703	1.3935	1.1805
No log	20.7368	394	1.3043	0.1247	1.3043	1.1420
No log	20.8421	396	1.2171	0.0840	1.2171	1.1032
No log	20.9474	398	1.2390	0.1581	1.2390	1.1131
No log	21.0526	400	1.4146	0.1810	1.4146	1.1894
No log	21.1579	402	1.5781	0.2448	1.5781	1.2562
No log	21.2632	404	1.6014	0.2338	1.6014	1.2655
No log	21.3684	406	1.4729	0.2005	1.4729	1.2136
No log	21.4737	408	1.3256	0.2239	1.3256	1.1514
No log	21.5789	410	1.2341	0.1486	1.2341	1.1109
No log	21.6842	412	1.2260	0.1486	1.2260	1.1073
No log	21.7895	414	1.2750	0.1486	1.2750	1.1292
No log	21.8947	416	1.3338	0.2065	1.3338	1.1549
No log	22.0	418	1.3900	0.2474	1.3900	1.1790
No log	22.1053	420	1.3781	0.2417	1.3781	1.1739
No log	22.2105	422	1.3538	0.2417	1.3538	1.1635
No log	22.3158	424	1.4548	0.2292	1.4548	1.2062
No log	22.4211	426	1.5958	0.1847	1.5958	1.2633
No log	22.5263	428	1.6211	0.1729	1.6211	1.2732
No log	22.6316	430	1.5029	0.2126	1.5029	1.2259
No log	22.7368	432	1.3322	0.0401	1.3322	1.1542
No log	22.8421	434	1.2148	-0.0091	1.2148	1.1022
No log	22.9474	436	1.2069	-0.0091	1.2069	1.0986
No log	23.0526	438	1.2844	0.0	1.2844	1.1333
No log	23.1579	440	1.4172	0.0401	1.4172	1.1905
No log	23.2632	442	1.5379	0.2126	1.5379	1.2401
No log	23.3684	444	1.5846	0.1943	1.5846	1.2588
No log	23.4737	446	1.5384	0.1943	1.5384	1.2403
No log	23.5789	448	1.4588	0.2126	1.4588	1.2078
No log	23.6842	450	1.4205	0.1562	1.4205	1.1919
No log	23.7895	452	1.4199	0.1486	1.4199	1.1916
No log	23.8947	454	1.4445	0.1486	1.4445	1.2019
No log	24.0	456	1.4344	0.1486	1.4344	1.1977
No log	24.1053	458	1.4670	0.1486	1.4670	1.2112
No log	24.2105	460	1.4660	0.1142	1.4660	1.2108
No log	24.3158	462	1.4204	0.1142	1.4204	1.1918
No log	24.4211	464	1.3417	0.0	1.3417	1.1583
No log	24.5263	466	1.3004	0.0	1.3004	1.1404
No log	24.6316	468	1.3303	0.0781	1.3303	1.1534
No log	24.7368	470	1.4213	0.2126	1.4213	1.1922
No log	24.8421	472	1.5387	0.2170	1.5387	1.2405
No log	24.9474	474	1.6522	0.2363	1.6522	1.2854
No log	25.0526	476	1.7189	0.2296	1.7189	1.3111
No log	25.1579	478	1.7088	0.2363	1.7088	1.3072
No log	25.2632	480	1.6519	0.1950	1.6519	1.2853
No log	25.3684	482	1.5744	0.2292	1.5744	1.2548
No log	25.4737	484	1.5190	0.2292	1.5190	1.2325
No log	25.5789	486	1.4771	0.2292	1.4771	1.2154
No log	25.6842	488	1.4749	0.2292	1.4749	1.2145
No log	25.7895	490	1.4797	0.2292	1.4797	1.2164
No log	25.8947	492	1.4899	0.2292	1.4899	1.2206
No log	26.0	494	1.4702	0.2065	1.4702	1.2125
No log	26.1053	496	1.4526	0.1486	1.4526	1.2053
No log	26.2105	498	1.4703	0.2065	1.4703	1.2126
0.2187	26.3158	500	1.4753	0.2184	1.4753	1.2146
0.2187	26.4211	502	1.4874	0.2292	1.4874	1.2196
0.2187	26.5263	504	1.5010	0.2292	1.5010	1.2252
0.2187	26.6316	506	1.5358	0.2117	1.5358	1.2393
0.2187	26.7368	508	1.4807	0.2239	1.4807	1.2168
0.2187	26.8421	510	1.3879	0.2555	1.3879	1.1781
0.2187	26.9474	512	1.3383	0.1288	1.3383	1.1569
0.2187	27.0526	514	1.2672	0.0931	1.2672	1.1257
0.2187	27.1579	516	1.2519	0.1255	1.2519	1.1189
0.2187	27.2632	518	1.2594	0.1727	1.2594	1.1222
0.2187	27.3684	520	1.2576	0.1727	1.2576	1.1214

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1