ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3971
• Qwk: 0.1748
• Mse: 1.3971
• Rmse: 1.1820

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.8935	-0.0104	4.8935	2.2121
No log	0.1143	4	2.9891	-0.0584	2.9891	1.7289
No log	0.1714	6	2.1426	-0.0233	2.1426	1.4638
No log	0.2286	8	2.0645	0.0023	2.0645	1.4368
No log	0.2857	10	2.2710	-0.0173	2.2710	1.5070
No log	0.3429	12	2.0945	0.0414	2.0945	1.4473
No log	0.4	14	1.7067	0.0372	1.7067	1.3064
No log	0.4571	16	1.6592	0.0317	1.6592	1.2881
No log	0.5143	18	1.3772	-0.0199	1.3772	1.1735
No log	0.5714	20	1.1791	0.1417	1.1791	1.0859
No log	0.6286	22	1.2019	0.1521	1.2019	1.0963
No log	0.6857	24	1.2224	0.0802	1.2224	1.1056
No log	0.7429	26	1.2269	0.0628	1.2269	1.1076
No log	0.8	28	1.2182	0.0974	1.2182	1.1037
No log	0.8571	30	1.2244	0.0711	1.2244	1.1065
No log	0.9143	32	1.2090	0.1176	1.2090	1.0995
No log	0.9714	34	1.2176	0.0974	1.2176	1.1034
No log	1.0286	36	1.2090	0.0974	1.2090	1.0995
No log	1.0857	38	1.2097	0.0872	1.2097	1.0999
No log	1.1429	40	1.2278	0.1507	1.2278	1.1081
No log	1.2	42	1.2339	0.1671	1.2339	1.1108
No log	1.2571	44	1.2211	0.1979	1.2211	1.1050
No log	1.3143	46	1.2229	0.1834	1.2229	1.1059
No log	1.3714	48	1.2223	0.1911	1.2223	1.1056
No log	1.4286	50	1.2681	0.1076	1.2681	1.1261
No log	1.4857	52	1.1833	0.2268	1.1833	1.0878
No log	1.5429	54	1.1911	0.1875	1.1911	1.0914
No log	1.6	56	1.2758	0.0948	1.2758	1.1295
No log	1.6571	58	1.3798	0.0625	1.3798	1.1747
No log	1.7143	60	1.3720	0.0625	1.3720	1.1713
No log	1.7714	62	1.2233	0.1142	1.2233	1.1060
No log	1.8286	64	1.2041	0.1482	1.2041	1.0973
No log	1.8857	66	1.2156	0.1875	1.2156	1.1025
No log	1.9429	68	1.2260	0.2097	1.2260	1.1072
No log	2.0	70	1.2703	0.2469	1.2703	1.1271
No log	2.0571	72	1.2302	0.2864	1.2302	1.1091
No log	2.1143	74	1.1910	0.3045	1.1910	1.0913
No log	2.1714	76	1.2040	0.1379	1.2040	1.0972
No log	2.2286	78	1.3573	0.0488	1.3573	1.1650
No log	2.2857	80	1.4149	0.0977	1.4149	1.1895
No log	2.3429	82	1.3308	0.0977	1.3308	1.1536
No log	2.4	84	1.2460	0.1778	1.2460	1.1163
No log	2.4571	86	1.1977	0.3204	1.1977	1.0944
No log	2.5143	88	1.2411	0.2981	1.2411	1.1141
No log	2.5714	90	1.1350	0.3410	1.1350	1.0654
No log	2.6286	92	1.2013	0.2863	1.2013	1.0960
No log	2.6857	94	1.2949	0.3137	1.2949	1.1379
No log	2.7429	96	1.4164	0.2841	1.4164	1.1901
No log	2.8	98	1.3482	0.2582	1.3482	1.1611
No log	2.8571	100	1.0711	0.2976	1.0711	1.0349
No log	2.9143	102	1.0055	0.2424	1.0055	1.0027
No log	2.9714	104	1.1920	0.3398	1.1920	1.0918
No log	3.0286	106	1.5555	0.2912	1.5555	1.2472
No log	3.0857	108	1.7531	0.1814	1.7531	1.3240
No log	3.1429	110	1.5486	0.2929	1.5486	1.2444
No log	3.2	112	1.4180	0.1596	1.4180	1.1908
No log	3.2571	114	1.2393	0.0974	1.2393	1.1132
No log	3.3143	116	1.0958	0.1808	1.0958	1.0468
No log	3.3714	118	1.0895	0.2921	1.0895	1.0438
No log	3.4286	120	1.1604	0.2470	1.1604	1.0772
No log	3.4857	122	1.3164	0.2143	1.3164	1.1473
No log	3.5429	124	1.4132	0.1685	1.4132	1.1888
No log	3.6	126	1.5529	0.2081	1.5529	1.2462
No log	3.6571	128	1.5266	0.2043	1.5266	1.2355
No log	3.7143	130	1.7931	0.2004	1.7931	1.3391
No log	3.7714	132	1.8929	0.1790	1.8929	1.3758
No log	3.8286	134	1.8149	0.1790	1.8149	1.3472
No log	3.8857	136	1.6178	0.2221	1.6178	1.2719
No log	3.9429	138	1.7114	0.2035	1.7114	1.3082
No log	4.0	140	1.8120	0.2135	1.8120	1.3461
No log	4.0571	142	1.7097	0.1606	1.7097	1.3075
No log	4.1143	144	1.5338	0.1886	1.5338	1.2385
No log	4.1714	146	1.3969	0.2619	1.3969	1.1819
No log	4.2286	148	1.4737	0.2798	1.4737	1.2140
No log	4.2857	150	1.7234	0.2135	1.7234	1.3128
No log	4.3429	152	1.8675	0.1997	1.8675	1.3665
No log	4.4	154	1.7279	0.2560	1.7279	1.3145
No log	4.4571	156	1.6105	0.3355	1.6105	1.2691
No log	4.5143	158	1.9162	0.2087	1.9162	1.3843
No log	4.5714	160	2.1514	0.1575	2.1514	1.4668
No log	4.6286	162	1.8509	0.1789	1.8509	1.3605
No log	4.6857	164	1.6651	0.2576	1.6651	1.2904
No log	4.7429	166	1.7019	0.2185	1.7019	1.3046
No log	4.8	168	1.7540	0.1176	1.7540	1.3244
No log	4.8571	170	1.5833	0.1308	1.5833	1.2583
No log	4.9143	172	1.3877	0.2000	1.3877	1.1780
No log	4.9714	174	1.3308	0.2743	1.3308	1.1536
No log	5.0286	176	1.3581	0.2330	1.3581	1.1654
No log	5.0857	178	1.4642	0.1005	1.4642	1.2101
No log	5.1429	180	1.4805	0.0512	1.4805	1.2168
No log	5.2	182	1.3591	0.1795	1.3591	1.1658
No log	5.2571	184	1.2892	0.1479	1.2892	1.1354
No log	5.3143	186	1.3392	0.1148	1.3392	1.1572
No log	5.3714	188	1.3206	0.1479	1.3206	1.1492
No log	5.4286	190	1.3352	0.1345	1.3352	1.1555
No log	5.4857	192	1.3196	0.1596	1.3196	1.1487
No log	5.5429	194	1.2516	0.1479	1.2516	1.1187
No log	5.6	196	1.2862	0.1345	1.2862	1.1341
No log	5.6571	198	1.3891	0.1498	1.3891	1.1786
No log	5.7143	200	1.2948	0.2046	1.2948	1.1379
No log	5.7714	202	1.2752	0.1795	1.2752	1.1293
No log	5.8286	204	1.2550	0.1637	1.2550	1.1203
No log	5.8857	206	1.3533	0.1345	1.3533	1.1633
No log	5.9429	208	1.4102	0.2479	1.4102	1.1875
No log	6.0	210	1.3847	0.2479	1.3847	1.1767
No log	6.0571	212	1.2729	0.2725	1.2729	1.1282
No log	6.1143	214	1.4216	0.2520	1.4216	1.1923
No log	6.1714	216	1.6001	0.3489	1.6001	1.2650
No log	6.2286	218	1.7883	0.2067	1.7883	1.3373
No log	6.2857	220	1.6505	0.2847	1.6505	1.2847
No log	6.3429	222	1.4664	0.2647	1.4664	1.2110
No log	6.4	224	1.2948	0.1405	1.2948	1.1379
No log	6.4571	226	1.2112	0.0954	1.2112	1.1006
No log	6.5143	228	1.3118	0.1094	1.3118	1.1453
No log	6.5714	230	1.5807	0.1677	1.5807	1.2573
No log	6.6286	232	1.7025	0.2188	1.7025	1.3048
No log	6.6857	234	1.6865	0.2132	1.6865	1.2986
No log	6.7429	236	1.5776	0.2798	1.5776	1.2560
No log	6.8	238	1.5789	0.2328	1.5789	1.2566
No log	6.8571	240	1.5103	0.1849	1.5103	1.2289
No log	6.9143	242	1.3112	0.2000	1.3112	1.1451
No log	6.9714	244	1.3238	0.1557	1.3238	1.1506
No log	7.0286	246	1.4431	0.1892	1.4431	1.2013
No log	7.0857	248	1.5925	0.1332	1.5925	1.2619
No log	7.1429	250	1.5223	0.2262	1.5223	1.2338
No log	7.2	252	1.4697	0.2227	1.4697	1.2123
No log	7.2571	254	1.2885	0.1703	1.2885	1.1351
No log	7.3143	256	1.3461	0.2371	1.3461	1.1602
No log	7.3714	258	1.4434	0.2726	1.4434	1.2014
No log	7.4286	260	1.4567	0.2582	1.4567	1.2069
No log	7.4857	262	1.2609	0.2494	1.2609	1.1229
No log	7.5429	264	1.2103	0.2387	1.2103	1.1001
No log	7.6	266	1.3018	0.2725	1.3018	1.1410
No log	7.6571	268	1.6661	0.1845	1.6661	1.2908
No log	7.7143	270	1.8289	0.2095	1.8289	1.3524
No log	7.7714	272	1.6113	0.2363	1.6113	1.2694
No log	7.8286	274	1.2786	0.2619	1.2786	1.1308
No log	7.8857	276	1.2565	0.1801	1.2565	1.1209
No log	7.9429	278	1.4362	0.2647	1.4362	1.1984
No log	8.0	280	1.4931	0.2468	1.4931	1.2219
No log	8.0571	282	1.4998	0.2099	1.4998	1.2247
No log	8.1143	284	1.4390	0.2424	1.4390	1.1996
No log	8.1714	286	1.3675	0.2141	1.3675	1.1694
No log	8.2286	288	1.4011	0.1745	1.4011	1.1837
No log	8.2857	290	1.4444	0.1745	1.4444	1.2018
No log	8.3429	292	1.5836	0.0586	1.5836	1.2584
No log	8.4	294	1.5717	0.1283	1.5717	1.2537
No log	8.4571	296	1.4142	0.1519	1.4142	1.1892
No log	8.5143	298	1.2876	0.1953	1.2876	1.1347
No log	8.5714	300	1.1463	0.1857	1.1463	1.0706
No log	8.6286	302	1.1205	0.1857	1.1205	1.0585
No log	8.6857	304	1.2360	0.2424	1.2360	1.1118
No log	8.7429	306	1.5941	0.2006	1.5941	1.2626
No log	8.8	308	1.8457	0.1817	1.8457	1.3586
No log	8.8571	310	1.7838	0.1448	1.7838	1.3356
No log	8.9143	312	1.5192	0.1254	1.5192	1.2326
No log	8.9714	314	1.3299	0.2195	1.3299	1.1532
No log	9.0286	316	1.3029	0.2195	1.3029	1.1414
No log	9.0857	318	1.3342	0.2195	1.3342	1.1551
No log	9.1429	320	1.4297	0.1840	1.4297	1.1957
No log	9.2	322	1.5389	0.1228	1.5389	1.2405
No log	9.2571	324	1.4366	0.1219	1.4366	1.1986
No log	9.3143	326	1.3387	0.1219	1.3387	1.1570
No log	9.3714	328	1.2389	0.1741	1.2389	1.1131
No log	9.4286	330	1.1965	0.2207	1.1965	1.0939
No log	9.4857	332	1.1913	0.2207	1.1913	1.0915
No log	9.5429	334	1.3454	0.2184	1.3454	1.1599
No log	9.6	336	1.5757	0.1683	1.5757	1.2553
No log	9.6571	338	1.5900	0.1726	1.5900	1.2610
No log	9.7143	340	1.3826	0.2184	1.3826	1.1758
No log	9.7714	342	1.2602	0.2308	1.2602	1.1226
No log	9.8286	344	1.2915	0.2308	1.2915	1.1364
No log	9.8857	346	1.3595	0.2184	1.3595	1.1660
No log	9.9429	348	1.3246	0.2141	1.3246	1.1509
No log	10.0	350	1.2946	0.2184	1.2946	1.1378
No log	10.0571	352	1.2777	0.2184	1.2777	1.1303
No log	10.1143	354	1.2917	0.2330	1.2917	1.1365
No log	10.1714	356	1.3173	0.2224	1.3173	1.1477
No log	10.2286	358	1.4402	0.2275	1.4402	1.2001
No log	10.2857	360	1.4376	0.2024	1.4376	1.1990
No log	10.3429	362	1.3047	0.2291	1.3047	1.1422
No log	10.4	364	1.2647	0.275	1.2647	1.1246
No log	10.4571	366	1.3042	0.2184	1.3042	1.1420
No log	10.5143	368	1.4332	0.1935	1.4332	1.1972
No log	10.5714	370	1.5141	0.1618	1.5141	1.2305
No log	10.6286	372	1.4137	0.1224	1.4137	1.1890
No log	10.6857	374	1.3241	0.1345	1.3241	1.1507
No log	10.7429	376	1.2798	0.2599	1.2798	1.1313
No log	10.8	378	1.3249	0.1345	1.3249	1.1510
No log	10.8571	380	1.4390	0.1224	1.4390	1.1996
No log	10.9143	382	1.5521	0.2455	1.5521	1.2458
No log	10.9714	384	1.4897	0.2392	1.4897	1.2205
No log	11.0286	386	1.4633	0.2757	1.4633	1.2097
No log	11.0857	388	1.5339	0.2285	1.5339	1.2385
No log	11.1429	390	1.7435	0.2305	1.7435	1.3204
No log	11.2	392	1.7716	0.2197	1.7716	1.3310
No log	11.2571	394	1.5786	0.1923	1.5786	1.2564
No log	11.3143	396	1.3381	0.1943	1.3381	1.1568
No log	11.3714	398	1.2942	0.2599	1.2942	1.1376
No log	11.4286	400	1.3740	0.1592	1.3740	1.1722
No log	11.4857	402	1.3960	0.1219	1.3960	1.1815
No log	11.5429	404	1.3190	0.0454	1.3190	1.1485
No log	11.6	406	1.2004	0.1351	1.2004	1.0956
No log	11.6571	408	1.1807	0.1351	1.1807	1.0866
No log	11.7143	410	1.2265	0.1351	1.2265	1.1075
No log	11.7714	412	1.3093	0.2087	1.3093	1.1443
No log	11.8286	414	1.3585	0.1568	1.3585	1.1655
No log	11.8857	416	1.3281	0.2392	1.3281	1.1524
No log	11.9429	418	1.3805	0.3238	1.3805	1.1750
No log	12.0	420	1.2946	0.3210	1.2946	1.1378
No log	12.0571	422	1.3561	0.2726	1.3561	1.1645
No log	12.1143	424	1.5808	0.3093	1.5808	1.2573
No log	12.1714	426	1.6443	0.3093	1.6443	1.2823
No log	12.2286	428	1.4438	0.3189	1.4438	1.2016
No log	12.2857	430	1.3719	0.3177	1.3719	1.1713
No log	12.3429	432	1.3163	0.3309	1.3163	1.1473
No log	12.4	434	1.4159	0.2569	1.4159	1.1899
No log	12.4571	436	1.3477	0.2757	1.3477	1.1609
No log	12.5143	438	1.2414	0.2224	1.2414	1.1142
No log	12.5714	440	1.2522	0.2224	1.2522	1.1190
No log	12.6286	442	1.2373	0.2184	1.2373	1.1123
No log	12.6857	444	1.3087	0.1989	1.3087	1.1440
No log	12.7429	446	1.2724	0.2090	1.2724	1.1280
No log	12.8	448	1.2860	0.2291	1.2860	1.1340
No log	12.8571	450	1.3462	0.1703	1.3462	1.1603
No log	12.9143	452	1.3624	0.1745	1.3624	1.1672
No log	12.9714	454	1.3615	0.1745	1.3615	1.1669
No log	13.0286	456	1.2812	0.2291	1.2812	1.1319
No log	13.0857	458	1.2515	0.2439	1.2515	1.1187
No log	13.1429	460	1.2357	0.2439	1.2357	1.1116
No log	13.2	462	1.2404	0.2439	1.2404	1.1137
No log	13.2571	464	1.2333	0.275	1.2333	1.1105
No log	13.3143	466	1.3502	0.1745	1.3502	1.1620
No log	13.3714	468	1.3968	0.1345	1.3968	1.1818
No log	13.4286	470	1.3011	0.2151	1.3011	1.1407
No log	13.4857	472	1.2067	0.1689	1.2067	1.0985
No log	13.5429	474	1.1974	0.1689	1.1974	1.0943
No log	13.6	476	1.2702	0.1217	1.2702	1.1270
No log	13.6571	478	1.4463	0.1748	1.4463	1.2026
No log	13.7143	480	1.5049	0.2105	1.5049	1.2268
No log	13.7714	482	1.5141	0.2886	1.5141	1.2305
No log	13.8286	484	1.4298	0.2578	1.4298	1.1958
No log	13.8857	486	1.3487	0.2201	1.3487	1.1613
No log	13.9429	488	1.4284	0.2485	1.4284	1.1952
No log	14.0	490	1.6301	0.2668	1.6301	1.2768
No log	14.0571	492	1.6952	0.2735	1.6952	1.3020
No log	14.1143	494	1.5748	0.2989	1.5748	1.2549
No log	14.1714	496	1.3510	0.1345	1.3510	1.1623
No log	14.2286	498	1.1853	0.1846	1.1853	1.0887
0.3756	14.2857	500	1.1742	0.1846	1.1742	1.0836
0.3756	14.3429	502	1.2781	0.1745	1.2781	1.1305
0.3756	14.4	504	1.4175	0.1698	1.4175	1.1906
0.3756	14.4571	506	1.5235	0.2839	1.5235	1.2343
0.3756	14.5143	508	1.4954	0.2359	1.4954	1.2229
0.3756	14.5714	510	1.3422	0.1345	1.3422	1.1586
0.3756	14.6286	512	1.2657	0.1745	1.2657	1.1250
0.3756	14.6857	514	1.3026	0.1745	1.3026	1.1413
0.3756	14.7429	516	1.4169	0.1796	1.4169	1.1904
0.3756	14.8	518	1.3971	0.1748	1.3971	1.1820

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1