ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2255
• Qwk: 0.1871
• Mse: 1.2255
• Rmse: 1.1070

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	4.7023	0.0010	4.7023	2.1685
No log	0.0645	4	2.6504	0.0248	2.6504	1.6280
No log	0.0968	6	1.8126	-0.0303	1.8126	1.3463
No log	0.1290	8	1.8695	-0.0563	1.8695	1.3673
No log	0.1613	10	2.5897	-0.0991	2.5897	1.6093
No log	0.1935	12	2.1324	-0.0374	2.1324	1.4603
No log	0.2258	14	1.4706	-0.0783	1.4706	1.2127
No log	0.2581	16	1.3258	0.0454	1.3258	1.1514
No log	0.2903	18	1.3144	0.0454	1.3144	1.1465
No log	0.3226	20	1.2722	0.1794	1.2722	1.1279
No log	0.3548	22	1.2945	0.0573	1.2945	1.1378
No log	0.3871	24	1.3123	-0.0040	1.3123	1.1456
No log	0.4194	26	1.3296	0.0796	1.3296	1.1531
No log	0.4516	28	1.3635	-0.0817	1.3635	1.1677
No log	0.4839	30	1.3871	-0.0368	1.3871	1.1778
No log	0.5161	32	1.3277	0.0297	1.3277	1.1522
No log	0.5484	34	1.2773	0.1433	1.2773	1.1302
No log	0.5806	36	1.2648	0.0420	1.2648	1.1246
No log	0.6129	38	1.3114	0.1579	1.3114	1.1452
No log	0.6452	40	1.4891	-0.0492	1.4891	1.2203
No log	0.6774	42	1.6209	-0.0839	1.6209	1.2731
No log	0.7097	44	1.4720	0.0750	1.4720	1.2133
No log	0.7419	46	1.4094	0.0512	1.4094	1.1872
No log	0.7742	48	1.3574	0.0165	1.3574	1.1651
No log	0.8065	50	1.2869	0.0324	1.2869	1.1344
No log	0.8387	52	1.3010	0.1211	1.3010	1.1406
No log	0.8710	54	1.3310	0.0353	1.3310	1.1537
No log	0.9032	56	1.3199	0.1042	1.3199	1.1489
No log	0.9355	58	1.2813	0.0872	1.2813	1.1319
No log	0.9677	60	1.2644	0.0941	1.2644	1.1244
No log	1.0	62	1.2616	0.0941	1.2616	1.1232
No log	1.0323	64	1.2750	0.0527	1.2750	1.1291
No log	1.0645	66	1.2965	0.0077	1.2965	1.1387
No log	1.0968	68	1.2809	0.1009	1.2809	1.1317
No log	1.1290	70	1.3312	-0.0432	1.3312	1.1538
No log	1.1613	72	1.3572	-0.0432	1.3572	1.1650
No log	1.1935	74	1.3179	0.0921	1.3179	1.1480
No log	1.2258	76	1.3854	0.1755	1.3854	1.1770
No log	1.2581	78	1.3855	0.1755	1.3855	1.1771
No log	1.2903	80	1.3355	0.1344	1.3355	1.1556
No log	1.3226	82	1.3001	0.1742	1.3001	1.1402
No log	1.3548	84	1.3728	0.0030	1.3728	1.1717
No log	1.3871	86	1.3974	0.0165	1.3974	1.1821
No log	1.4194	88	1.3558	0.0587	1.3558	1.1644
No log	1.4516	90	1.2217	0.1616	1.2217	1.1053
No log	1.4839	92	1.1783	0.2068	1.1783	1.0855
No log	1.5161	94	1.1754	0.2378	1.1754	1.0841
No log	1.5484	96	1.1421	0.1567	1.1421	1.0687
No log	1.5806	98	1.2537	0.1795	1.2537	1.1197
No log	1.6129	100	1.4360	0.1646	1.4360	1.1983
No log	1.6452	102	1.3940	0.1536	1.3940	1.1807
No log	1.6774	104	1.2177	0.2363	1.2177	1.1035
No log	1.7097	106	1.1984	0.2028	1.1984	1.0947
No log	1.7419	108	1.2524	0.2800	1.2524	1.1191
No log	1.7742	110	1.4305	0.1796	1.4305	1.1960
No log	1.8065	112	1.3974	0.1748	1.3974	1.1821
No log	1.8387	114	1.2924	0.2604	1.2924	1.1369
No log	1.8710	116	1.2970	0.2454	1.2970	1.1388
No log	1.9032	118	1.3440	0.2250	1.3440	1.1593
No log	1.9355	120	1.3643	0.1853	1.3643	1.1680
No log	1.9677	122	1.3089	0.1853	1.3089	1.1441
No log	2.0	124	1.2213	0.1396	1.2213	1.1051
No log	2.0323	126	1.2545	0.1206	1.2545	1.1200
No log	2.0645	128	1.2119	0.1793	1.2119	1.1008
No log	2.0968	130	1.2447	0.2343	1.2447	1.1157
No log	2.1290	132	1.3582	0.2143	1.3582	1.1654
No log	2.1613	134	1.3171	0.2343	1.3171	1.1476
No log	2.1935	136	1.2407	0.1983	1.2407	1.1139
No log	2.2258	138	1.2355	0.2271	1.2355	1.1115
No log	2.2581	140	1.2639	0.1966	1.2639	1.1242
No log	2.2903	142	1.3566	0.2077	1.3566	1.1647
No log	2.3226	144	1.3027	0.1771	1.3027	1.1414
No log	2.3548	146	1.2357	0.1787	1.2357	1.1116
No log	2.3871	148	1.2327	0.1787	1.2327	1.1103
No log	2.4194	150	1.3186	0.2738	1.3186	1.1483
No log	2.4516	152	1.5142	0.2359	1.5142	1.2305
No log	2.4839	154	1.4967	0.2698	1.4967	1.2234
No log	2.5161	156	1.3350	0.2117	1.3350	1.1554
No log	2.5484	158	1.2373	0.1776	1.2373	1.1123
No log	2.5806	160	1.2067	0.2165	1.2067	1.0985
No log	2.6129	162	1.2261	0.1578	1.2261	1.1073
No log	2.6452	164	1.3643	0.2772	1.3643	1.1680
No log	2.6774	166	1.4555	0.2693	1.4555	1.2064
No log	2.7097	168	1.3348	0.2236	1.3348	1.1553
No log	2.7419	170	1.2282	0.1243	1.2282	1.1082
No log	2.7742	172	1.2540	0.1642	1.2540	1.1198
No log	2.8065	174	1.3261	0.1686	1.3261	1.1515
No log	2.8387	176	1.3878	0.2339	1.3878	1.1780
No log	2.8710	178	1.4793	0.2634	1.4793	1.2163
No log	2.9032	180	1.4450	0.2826	1.4450	1.2021
No log	2.9355	182	1.3910	0.2525	1.3910	1.1794
No log	2.9677	184	1.3696	0.2248	1.3696	1.1703
No log	3.0	186	1.3109	0.2762	1.3109	1.1449
No log	3.0323	188	1.2670	0.2352	1.2670	1.1256
No log	3.0645	190	1.2584	0.2352	1.2584	1.1218
No log	3.0968	192	1.3250	0.3068	1.3250	1.1511
No log	3.1290	194	1.4460	0.2025	1.4460	1.2025
No log	3.1613	196	1.3608	0.2799	1.3608	1.1665
No log	3.1935	198	1.2511	0.1959	1.2511	1.1185
No log	3.2258	200	1.1704	0.1919	1.1704	1.0818
No log	3.2581	202	1.1537	0.1893	1.1537	1.0741
No log	3.2903	204	1.1509	0.1570	1.1509	1.0728
No log	3.3226	206	1.2038	0.1314	1.2038	1.0972
No log	3.3548	208	1.3775	0.1801	1.3775	1.1737
No log	3.3871	210	1.4283	0.2321	1.4283	1.1951
No log	3.4194	212	1.3341	0.2403	1.3341	1.1550
No log	3.4516	214	1.2011	0.1864	1.2011	1.0960
No log	3.4839	216	1.1889	0.1546	1.1889	1.0904
No log	3.5161	218	1.2205	0.1920	1.2205	1.1048
No log	3.5484	220	1.3567	0.2772	1.3567	1.1648
No log	3.5806	222	1.4722	0.2503	1.4722	1.2133
No log	3.6129	224	1.4447	0.2438	1.4447	1.2020
No log	3.6452	226	1.3703	0.2143	1.3703	1.1706
No log	3.6774	228	1.3522	0.2006	1.3522	1.1628
No log	3.7097	230	1.3450	0.2206	1.3450	1.1597
No log	3.7419	232	1.3284	0.1245	1.3284	1.1526
No log	3.7742	234	1.3055	0.0842	1.3055	1.1426
No log	3.8065	236	1.3191	0.1544	1.3191	1.1485
No log	3.8387	238	1.4393	0.2438	1.4393	1.1997
No log	3.8710	240	1.5042	0.2055	1.5042	1.2265
No log	3.9032	242	1.4277	0.2313	1.4277	1.1949
No log	3.9355	244	1.3194	0.1727	1.3194	1.1486
No log	3.9677	246	1.2834	0.0609	1.2834	1.1329
No log	4.0	248	1.2672	0.0675	1.2672	1.1257
No log	4.0323	250	1.2648	0.0958	1.2648	1.1246
No log	4.0645	252	1.3216	0.1807	1.3216	1.1496
No log	4.0968	254	1.4168	0.1596	1.4168	1.1903
No log	4.1290	256	1.3892	0.1596	1.3892	1.1786
No log	4.1613	258	1.3059	0.1020	1.3059	1.1428
No log	4.1935	260	1.2548	0.0693	1.2548	1.1202
No log	4.2258	262	1.2882	0.1108	1.2882	1.1350
No log	4.2581	264	1.3365	0.1638	1.3365	1.1561
No log	4.2903	266	1.2771	0.1266	1.2771	1.1301
No log	4.3226	268	1.2193	0.1507	1.2193	1.1042
No log	4.3548	270	1.3017	0.1020	1.3017	1.1409
No log	4.3871	272	1.4484	0.2589	1.4484	1.2035
No log	4.4194	274	1.4687	0.2191	1.4687	1.2119
No log	4.4516	276	1.3655	0.2301	1.3655	1.1686
No log	4.4839	278	1.3072	0.1654	1.3072	1.1433
No log	4.5161	280	1.2793	0.1465	1.2793	1.1311
No log	4.5484	282	1.3089	0.1807	1.3089	1.1441
No log	4.5806	284	1.3688	0.1951	1.3688	1.1700
No log	4.6129	286	1.3512	0.1020	1.3512	1.1624
No log	4.6452	288	1.3861	0.1500	1.3861	1.1773
No log	4.6774	290	1.4016	0.1596	1.4016	1.1839
No log	4.7097	292	1.3418	0.0954	1.3418	1.1584
No log	4.7419	294	1.2228	0.1279	1.2228	1.1058
No log	4.7742	296	1.1896	0.1567	1.1896	1.0907
No log	4.8065	298	1.1894	0.1927	1.1894	1.0906
No log	4.8387	300	1.2302	0.1214	1.2302	1.1091
No log	4.8710	302	1.2956	0.1148	1.2956	1.1383
No log	4.9032	304	1.3365	0.1148	1.3365	1.1561
No log	4.9355	306	1.2794	0.1148	1.2794	1.1311
No log	4.9677	308	1.1947	0.1114	1.1947	1.0930
No log	5.0	310	1.1617	0.2346	1.1617	1.0778
No log	5.0323	312	1.1617	0.1927	1.1617	1.0778
No log	5.0645	314	1.2207	0.2164	1.2207	1.1048
No log	5.0968	316	1.2890	0.2236	1.2890	1.1353
No log	5.1290	318	1.2962	0.2236	1.2962	1.1385
No log	5.1613	320	1.3257	0.2275	1.3257	1.1514
No log	5.1935	322	1.3395	0.2275	1.3395	1.1574
No log	5.2258	324	1.3456	0.2236	1.3456	1.1600
No log	5.2581	326	1.3130	0.2381	1.3130	1.1458
No log	5.2903	328	1.2798	0.2248	1.2798	1.1313
No log	5.3226	330	1.3008	0.2100	1.3008	1.1405
No log	5.3548	332	1.2864	0.1502	1.2864	1.1342
No log	5.3871	334	1.2531	0.1085	1.2531	1.1194
No log	5.4194	336	1.2378	0.1567	1.2378	1.1125
No log	5.4516	338	1.2423	0.1567	1.2423	1.1146
No log	5.4839	340	1.2815	0.0731	1.2815	1.1320
No log	5.5161	342	1.4082	0.1943	1.4082	1.1867
No log	5.5484	344	1.4313	0.1585	1.4313	1.1964
No log	5.5806	346	1.3829	0.2275	1.3829	1.1760
No log	5.6129	348	1.2842	0.1951	1.2842	1.1332
No log	5.6452	350	1.2151	0.1820	1.2151	1.1023
No log	5.6774	352	1.1978	0.1505	1.1978	1.0944
No log	5.7097	354	1.1759	0.1567	1.1759	1.0844
No log	5.7419	356	1.1994	0.1820	1.1994	1.0952
No log	5.7742	358	1.2857	0.1951	1.2857	1.1339
No log	5.8065	360	1.3206	0.2236	1.3206	1.1492
No log	5.8387	362	1.2544	0.2343	1.2544	1.1200
No log	5.8710	364	1.2092	0.2604	1.2092	1.0997
No log	5.9032	366	1.1856	0.2317	1.1856	1.0888
No log	5.9355	368	1.2572	0.1951	1.2572	1.1213
No log	5.9677	370	1.3927	0.2527	1.3927	1.1801
No log	6.0	372	1.4902	0.1843	1.4902	1.2207
No log	6.0323	374	1.4961	0.2047	1.4961	1.2231
No log	6.0645	376	1.3598	0.2559	1.3598	1.1661
No log	6.0968	378	1.2288	0.2046	1.2288	1.1085
No log	6.1290	380	1.1675	0.1310	1.1675	1.0805
No log	6.1613	382	1.1759	0.1405	1.1759	1.0844
No log	6.1935	384	1.1897	0.1712	1.1897	1.0907
No log	6.2258	386	1.2345	0.1903	1.2345	1.1111
No log	6.2581	388	1.2484	0.1903	1.2484	1.1173
No log	6.2903	390	1.3241	0.2173	1.3241	1.1507
No log	6.3226	392	1.3489	0.2559	1.3489	1.1614
No log	6.3548	394	1.2791	0.1463	1.2791	1.1310
No log	6.3871	396	1.2282	0.1502	1.2282	1.1082
No log	6.4194	398	1.2018	0.1344	1.2018	1.0963
No log	6.4516	400	1.2189	0.1502	1.2189	1.1040
No log	6.4839	402	1.3196	0.2664	1.3196	1.1487
No log	6.5161	404	1.3871	0.2559	1.3871	1.1777
No log	6.5484	406	1.3598	0.2559	1.3598	1.1661
No log	6.5806	408	1.3094	0.2738	1.3094	1.1443
No log	6.6129	410	1.1735	0.1807	1.1735	1.0833
No log	6.6452	412	1.1201	0.2587	1.1201	1.0583
No log	6.6774	414	1.1303	0.2019	1.1303	1.0632
No log	6.7097	416	1.2335	0.2619	1.2335	1.1106
No log	6.7419	418	1.3590	0.2721	1.3590	1.1658
No log	6.7742	420	1.4451	0.2498	1.4451	1.2021
No log	6.8065	422	1.3797	0.2747	1.3797	1.1746
No log	6.8387	424	1.2898	0.2738	1.2898	1.1357
No log	6.8710	426	1.1764	0.2762	1.1764	1.0846
No log	6.9032	428	1.1329	0.2260	1.1329	1.0644
No log	6.9355	430	1.1390	0.2065	1.1390	1.0672
No log	6.9677	432	1.1605	0.1502	1.1605	1.0773
No log	7.0	434	1.1930	0.1807	1.1930	1.0923
No log	7.0323	436	1.2576	0.1663	1.2576	1.1214
No log	7.0645	438	1.3203	0.2527	1.3203	1.1490
No log	7.0968	440	1.3023	0.2574	1.3023	1.1412
No log	7.1290	442	1.2978	0.3001	1.2978	1.1392
No log	7.1613	444	1.3007	0.3001	1.3007	1.1405
No log	7.1935	446	1.2829	0.2367	1.2829	1.1327
No log	7.2258	448	1.2431	0.1654	1.2431	1.1150
No log	7.2581	450	1.2457	0.1500	1.2457	1.1161
No log	7.2903	452	1.2104	0.1853	1.2104	1.1002
No log	7.3226	454	1.1769	0.1180	1.1769	1.0849
No log	7.3548	456	1.1699	0.1180	1.1699	1.0816
No log	7.3871	458	1.1824	0.1114	1.1824	1.0874
No log	7.4194	460	1.2578	0.1795	1.2578	1.1215
No log	7.4516	462	1.3292	0.1596	1.3292	1.1529
No log	7.4839	464	1.3154	0.1596	1.3154	1.1469
No log	7.5161	466	1.2342	0.1479	1.2342	1.1109
No log	7.5484	468	1.1681	0.1701	1.1681	1.0808
No log	7.5806	470	1.1532	0.1701	1.1532	1.0739
No log	7.6129	472	1.1809	0.1807	1.1809	1.0867
No log	7.6452	474	1.2079	0.2100	1.2079	1.0990
No log	7.6774	476	1.2883	0.2527	1.2883	1.1350
No log	7.7097	478	1.3524	0.2807	1.3524	1.1629
No log	7.7419	480	1.2879	0.2527	1.2879	1.1348
No log	7.7742	482	1.2163	0.1903	1.2163	1.1029
No log	7.8065	484	1.2325	0.1903	1.2325	1.1102
No log	7.8387	486	1.2935	0.1159	1.2935	1.1373
No log	7.8710	488	1.3681	0.2032	1.3681	1.1696
No log	7.9032	490	1.3527	0.2032	1.3527	1.1630
No log	7.9355	492	1.2935	0.2032	1.2935	1.1373
No log	7.9677	494	1.2239	0.1807	1.2239	1.1063
No log	8.0	496	1.2318	0.1807	1.2318	1.1098
No log	8.0323	498	1.3126	0.2826	1.3126	1.1457
0.3883	8.0645	500	1.4125	0.2559	1.4125	1.1885
0.3883	8.0968	502	1.4380	0.2676	1.4380	1.1991
0.3883	8.1290	504	1.3874	0.2527	1.3874	1.1779
0.3883	8.1613	506	1.3114	0.2330	1.3114	1.1452
0.3883	8.1935	508	1.2476	0.2009	1.2476	1.1170
0.3883	8.2258	510	1.2073	0.1667	1.2073	1.0988
0.3883	8.2581	512	1.2255	0.1871	1.2255	1.1070

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1