ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3017
• Qwk: 0.1407
• Mse: 1.3017
• Rmse: 1.1409

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	3.9365	-0.0232	3.9365	1.9841
No log	0.0870	4	2.7213	-0.0305	2.7213	1.6496
No log	0.1304	6	2.3416	-0.0372	2.3416	1.5302
No log	0.1739	8	1.4991	0.0854	1.4991	1.2244
No log	0.2174	10	1.1113	0.2268	1.1113	1.0542
No log	0.2609	12	1.1950	0.0731	1.1950	1.0932
No log	0.3043	14	1.1082	0.2094	1.1082	1.0527
No log	0.3478	16	1.2264	0.0884	1.2264	1.1074
No log	0.3913	18	1.6641	-0.0661	1.6641	1.2900
No log	0.4348	20	1.5899	-0.1122	1.5899	1.2609
No log	0.4783	22	1.3669	0.0519	1.3669	1.1692
No log	0.5217	24	1.3565	-0.0417	1.3565	1.1647
No log	0.5652	26	1.3698	-0.0032	1.3698	1.1704
No log	0.6087	28	1.3109	-0.0497	1.3109	1.1450
No log	0.6522	30	1.0949	0.1589	1.0949	1.0464
No log	0.6957	32	1.0503	0.2114	1.0503	1.0248
No log	0.7391	34	1.1274	0.1160	1.1274	1.0618
No log	0.7826	36	1.4414	-0.0881	1.4414	1.2006
No log	0.8261	38	1.6338	-0.1445	1.6338	1.2782
No log	0.8696	40	1.2646	0.0622	1.2646	1.1245
No log	0.9130	42	1.0736	0.1864	1.0736	1.0361
No log	0.9565	44	1.0625	0.2911	1.0625	1.0308
No log	1.0	46	1.1263	0.2647	1.1263	1.0613
No log	1.0435	48	1.3547	-0.0249	1.3547	1.1639
No log	1.0870	50	1.6222	-0.1135	1.6222	1.2737
No log	1.1304	52	1.4905	-0.0623	1.4905	1.2209
No log	1.1739	54	1.2550	0.0911	1.2550	1.1203
No log	1.2174	56	1.0641	0.1857	1.0641	1.0315
No log	1.2609	58	1.0561	0.2179	1.0561	1.0277
No log	1.3043	60	1.1070	0.1761	1.1070	1.0522
No log	1.3478	62	1.2148	0.2021	1.2148	1.1022
No log	1.3913	64	1.3043	0.1489	1.3043	1.1421
No log	1.4348	66	1.2530	0.1609	1.2530	1.1194
No log	1.4783	68	1.1703	0.2312	1.1703	1.0818
No log	1.5217	70	1.1920	0.1801	1.1920	1.0918
No log	1.5652	72	1.2234	0.1370	1.2234	1.1061
No log	1.6087	74	1.4115	0.0939	1.4115	1.1881
No log	1.6522	76	1.5486	0.1111	1.5486	1.2444
No log	1.6957	78	1.4303	0.0861	1.4303	1.1960
No log	1.7391	80	1.2315	0.1500	1.2315	1.1097
No log	1.7826	82	1.0416	0.2226	1.0416	1.0206
No log	1.8261	84	0.9985	0.2818	0.9985	0.9993
No log	1.8696	86	1.0136	0.2251	1.0136	1.0068
No log	1.9130	88	1.1890	0.0961	1.1890	1.0904
No log	1.9565	90	1.3523	0.0541	1.3523	1.1629
No log	2.0	92	1.3807	0.0541	1.3807	1.1750
No log	2.0435	94	1.2957	0.1170	1.2957	1.1383
No log	2.0870	96	1.2446	0.2577	1.2446	1.1156
No log	2.1304	98	1.2931	0.2934	1.2931	1.1372
No log	2.1739	100	1.3752	0.2647	1.3752	1.1727
No log	2.2174	102	1.5603	0.2239	1.5603	1.2491
No log	2.2609	104	1.5673	0.1943	1.5673	1.2519
No log	2.3043	106	1.3581	0.1880	1.3581	1.1654
No log	2.3478	108	1.2639	0.2203	1.2639	1.1242
No log	2.3913	110	1.3721	0.1744	1.3721	1.1714
No log	2.4348	112	1.3829	0.1744	1.3829	1.1760
No log	2.4783	114	1.3706	0.0931	1.3706	1.1707
No log	2.5217	116	1.3150	0.0278	1.3150	1.1467
No log	2.5652	118	1.3244	0.0278	1.3243	1.1508
No log	2.6087	120	1.3610	0.0571	1.3610	1.1666
No log	2.6522	122	1.4380	0.1438	1.4380	1.1992
No log	2.6957	124	1.5829	0.2084	1.5829	1.2581
No log	2.7391	126	1.6933	0.1630	1.6933	1.3013
No log	2.7826	128	1.7564	0.1565	1.7564	1.3253
No log	2.8261	130	1.6754	0.1531	1.6754	1.2944
No log	2.8696	132	1.5731	0.2084	1.5731	1.2542
No log	2.9130	134	1.3438	0.1935	1.3438	1.1592
No log	2.9565	136	1.1706	0.3322	1.1706	1.0819
No log	3.0	138	1.1863	0.2986	1.1863	1.0892
No log	3.0435	140	1.3843	0.1727	1.3843	1.1766
No log	3.0870	142	1.3961	0.2026	1.3961	1.1816
No log	3.1304	144	1.2523	0.1750	1.2523	1.1190
No log	3.1739	146	1.0364	0.2836	1.0364	1.0181
No log	3.2174	148	1.0040	0.2814	1.0040	1.0020
No log	3.2609	150	1.0200	0.2747	1.0200	1.0099
No log	3.3043	152	1.1610	0.1751	1.1610	1.0775
No log	3.3478	154	1.2712	0.2241	1.2712	1.1275
No log	3.3913	156	1.3278	0.2026	1.3278	1.1523
No log	3.4348	158	1.3717	0.2015	1.3717	1.1712
No log	3.4783	160	1.4298	0.2126	1.4298	1.1957
No log	3.5217	162	1.3525	0.1744	1.3525	1.1630
No log	3.5652	164	1.2405	0.1052	1.2405	1.1138
No log	3.6087	166	1.2213	0.1052	1.2213	1.1051
No log	3.6522	168	1.2550	0.1407	1.2550	1.1203
No log	3.6957	170	1.3342	0.1744	1.3342	1.1551
No log	3.7391	172	1.3147	0.1407	1.3147	1.1466
No log	3.7826	174	1.2438	0.1407	1.2438	1.1153
No log	3.8261	176	1.1960	0.1744	1.1960	1.0936
No log	3.8696	178	1.1791	0.1838	1.1791	1.0859
No log	3.9130	180	1.2132	0.2372	1.2132	1.1015
No log	3.9565	182	1.2588	0.1952	1.2588	1.1219
No log	4.0	184	1.2959	0.1288	1.2959	1.1384
No log	4.0435	186	1.2517	0.1952	1.2517	1.1188
No log	4.0870	188	1.0788	0.1628	1.0788	1.0386
No log	4.1304	190	0.9857	0.0990	0.9857	0.9928
No log	4.1739	192	1.0274	0.1654	1.0274	1.0136
No log	4.2174	194	1.2044	0.1943	1.2044	1.0974
No log	4.2609	196	1.4818	0.2733	1.4818	1.2173
No log	4.3043	198	1.6197	0.2733	1.6197	1.2727
No log	4.3478	200	1.5808	0.2568	1.5808	1.2573
No log	4.3913	202	1.4309	0.2089	1.4309	1.1962
No log	4.4348	204	1.2446	0.1654	1.2446	1.1156
No log	4.4783	206	1.1575	0.1226	1.1575	1.0759
No log	4.5217	208	1.2394	-0.0929	1.2394	1.1133
No log	4.5652	210	1.3669	-0.0263	1.3669	1.1692
No log	4.6087	212	1.4567	0.0935	1.4567	1.2069
No log	4.6522	214	1.6541	0.1565	1.6541	1.2861
No log	4.6957	216	1.7426	0.1630	1.7426	1.3201
No log	4.7391	218	1.6686	0.1540	1.6686	1.2917
No log	4.7826	220	1.4300	0.2062	1.4300	1.1958
No log	4.8261	222	1.2014	0.2038	1.2014	1.0961
No log	4.8696	224	1.1368	0.1976	1.1368	1.0662
No log	4.9130	226	1.1853	0.2126	1.1853	1.0887
No log	4.9565	228	1.3017	0.2126	1.3017	1.1409
No log	5.0	230	1.4541	0.2342	1.4541	1.2059
No log	5.0435	232	1.5230	0.2694	1.5230	1.2341
No log	5.0870	234	1.5715	0.2940	1.5715	1.2536
No log	5.1304	236	1.5879	0.2940	1.5879	1.2601
No log	5.1739	238	1.6163	0.2974	1.6163	1.2713
No log	5.2174	240	1.6416	0.2974	1.6416	1.2813
No log	5.2609	242	1.5124	0.2694	1.5124	1.2298
No log	5.3043	244	1.3814	0.2170	1.3814	1.1753
No log	5.3478	246	1.2922	0.2123	1.2922	1.1368
No log	5.3913	248	1.2558	0.1850	1.2558	1.1206
No log	5.4348	250	1.2536	0.2170	1.2536	1.1197
No log	5.4783	252	1.2772	0.2117	1.2772	1.1301
No log	5.5217	254	1.3543	0.2117	1.3543	1.1638
No log	5.5652	256	1.4065	0.2391	1.4065	1.1860
No log	5.6087	258	1.3442	0.2117	1.3442	1.1594
No log	5.6522	260	1.2262	0.2170	1.2262	1.1074
No log	5.6957	262	1.2713	0.2170	1.2713	1.1275
No log	5.7391	264	1.4719	0.2653	1.4719	1.2132
No log	5.7826	266	1.5603	0.2391	1.5603	1.2491
No log	5.8261	268	1.5712	0.2117	1.5712	1.2535
No log	5.8696	270	1.4485	0.2239	1.4485	1.2035
No log	5.9130	272	1.2462	0.1407	1.2462	1.1163
No log	5.9565	274	1.1625	0.0401	1.1625	1.0782
No log	6.0	276	1.1418	0.0401	1.1418	1.0686
No log	6.0435	278	1.1306	0.0	1.1306	1.0633
No log	6.0870	280	1.2284	0.0390	1.2284	1.1083
No log	6.1304	282	1.4489	0.1814	1.4489	1.2037
No log	6.1739	284	1.6047	0.2694	1.6047	1.2668
No log	6.2174	286	1.6028	0.2315	1.6028	1.2660
No log	6.2609	288	1.5736	0.2555	1.5736	1.2544
No log	6.3043	290	1.4503	0.1850	1.4503	1.2043
No log	6.3478	292	1.3713	0.1700	1.3713	1.1710
No log	6.3913	294	1.2483	0.0	1.2483	1.1173
No log	6.4348	296	1.2038	0.0033	1.2038	1.0972
No log	6.4783	298	1.2213	0.0	1.2213	1.1051
No log	6.5217	300	1.2195	0.0033	1.2195	1.1043
No log	6.5652	302	1.2489	0.0342	1.2489	1.1175
No log	6.6087	304	1.3493	0.1053	1.3493	1.1616
No log	6.6522	306	1.5235	0.1700	1.5235	1.2343
No log	6.6957	308	1.6310	0.2391	1.6310	1.2771
No log	6.7391	310	1.5521	0.2126	1.5521	1.2458
No log	6.7826	312	1.4246	0.1113	1.4246	1.1936
No log	6.8261	314	1.3444	0.0	1.3444	1.1595
No log	6.8696	316	1.4029	0.0	1.4029	1.1844
No log	6.9130	318	1.4469	0.0	1.4468	1.2029
No log	6.9565	320	1.5172	0.0661	1.5172	1.2318
No log	7.0	322	1.5764	0.1052	1.5764	1.2556
No log	7.0435	324	1.6108	0.1310	1.6108	1.2692
No log	7.0870	326	1.6321	0.0760	1.6321	1.2775
No log	7.1304	328	1.6243	0.2132	1.6243	1.2745
No log	7.1739	330	1.6303	0.1908	1.6303	1.2768
No log	7.2174	332	1.7224	0.1808	1.7224	1.3124
No log	7.2609	334	1.8301	0.1183	1.8301	1.3528
No log	7.3043	336	1.7786	0.1317	1.7786	1.3337
No log	7.3478	338	1.7605	0.1607	1.7605	1.3268
No log	7.3913	340	1.6368	0.1892	1.6368	1.2794
No log	7.4348	342	1.4578	0.1744	1.4578	1.2074
No log	7.4783	344	1.3176	0.0401	1.3176	1.1479
No log	7.5217	346	1.3217	0.0401	1.3217	1.1496
No log	7.5652	348	1.3654	0.0401	1.3654	1.1685
No log	7.6087	350	1.4647	0.1744	1.4647	1.2103
No log	7.6522	352	1.5287	0.1744	1.5287	1.2364
No log	7.6957	354	1.5984	0.2221	1.5984	1.2643
No log	7.7391	356	1.5656	0.2342	1.5656	1.2512
No log	7.7826	358	1.4182	0.1512	1.4182	1.1909
No log	7.8261	360	1.2561	0.0935	1.2561	1.1208
No log	7.8696	362	1.2361	0.0571	1.2361	1.1118
No log	7.9130	364	1.3294	0.1052	1.3294	1.1530
No log	7.9565	366	1.4223	0.1744	1.4223	1.1926
No log	8.0	368	1.4388	0.1744	1.4388	1.1995
No log	8.0435	370	1.3590	0.1370	1.3590	1.1657
No log	8.0870	372	1.2384	0.1705	1.2384	1.1128
No log	8.1304	374	1.2230	0.1705	1.2230	1.1059
No log	8.1739	376	1.2979	0.1167	1.2979	1.1393
No log	8.2174	378	1.4444	0.1744	1.4444	1.2018
No log	8.2609	380	1.4763	0.0931	1.4763	1.2150
No log	8.3043	382	1.5562	0.0781	1.5562	1.2475
No log	8.3478	384	1.6654	0.1634	1.6654	1.2905
No log	8.3913	386	1.6748	0.2391	1.6748	1.2941
No log	8.4348	388	1.6046	0.2424	1.6046	1.2667
No log	8.4783	390	1.5172	0.1744	1.5172	1.2318
No log	8.5217	392	1.4127	0.0781	1.4127	1.1886
No log	8.5652	394	1.4040	0.0781	1.4040	1.1849
No log	8.6087	396	1.4553	0.0781	1.4553	1.2063
No log	8.6522	398	1.5226	0.1744	1.5226	1.2339
No log	8.6957	400	1.6355	0.2611	1.6355	1.2789
No log	8.7391	402	1.5460	0.2694	1.5460	1.2434
No log	8.7826	404	1.4971	0.2694	1.4971	1.2236
No log	8.8261	406	1.5429	0.2694	1.5429	1.2421
No log	8.8696	408	1.5582	0.2694	1.5582	1.2483
No log	8.9130	410	1.5205	0.2474	1.5205	1.2331
No log	8.9565	412	1.4330	0.1814	1.4330	1.1971
No log	9.0	414	1.3315	0.1814	1.3315	1.1539
No log	9.0435	416	1.3550	0.1814	1.3550	1.1640
No log	9.0870	418	1.4720	0.2568	1.4720	1.2133
No log	9.1304	420	1.5513	0.2694	1.5513	1.2455
No log	9.1739	422	1.4624	0.2339	1.4624	1.2093
No log	9.2174	424	1.4436	0.2339	1.4436	1.2015
No log	9.2609	426	1.4416	0.2465	1.4416	1.2007
No log	9.3043	428	1.5096	0.2653	1.5096	1.2287
No log	9.3478	430	1.4785	0.1943	1.4785	1.2160
No log	9.3913	432	1.3792	0.1486	1.3792	1.1744
No log	9.4348	434	1.2704	0.0781	1.2704	1.1271
No log	9.4783	436	1.2178	0.1486	1.2178	1.1035
No log	9.5217	438	1.2726	0.1943	1.2726	1.1281
No log	9.5652	440	1.3852	0.2482	1.3852	1.1769
No log	9.6087	442	1.3733	0.2653	1.3733	1.1719
No log	9.6522	444	1.3084	0.2522	1.3084	1.1439
No log	9.6957	446	1.2734	0.1486	1.2734	1.1285
No log	9.7391	448	1.2775	0.1486	1.2775	1.1303
No log	9.7826	450	1.3019	0.1407	1.3019	1.1410
No log	9.8261	452	1.3078	0.0781	1.3078	1.1436
No log	9.8696	454	1.3096	0.1407	1.3096	1.1444
No log	9.9130	456	1.3516	0.1486	1.3516	1.1626
No log	9.9565	458	1.3188	0.1814	1.3188	1.1484
No log	10.0	460	1.2446	0.1486	1.2446	1.1156
No log	10.0435	462	1.2017	0.1486	1.2017	1.0962
No log	10.0870	464	1.2594	0.2126	1.2594	1.1222
No log	10.1304	466	1.4063	0.2653	1.4063	1.1859
No log	10.1739	468	1.4576	0.2733	1.4576	1.2073
No log	10.2174	470	1.3466	0.2611	1.3466	1.1604
No log	10.2609	472	1.2606	0.2555	1.2606	1.1228
No log	10.3043	474	1.2992	0.2602	1.2992	1.1398
No log	10.3478	476	1.3003	0.2506	1.3003	1.1403
No log	10.3913	478	1.3102	0.2372	1.3102	1.1446
No log	10.4348	480	1.3934	0.2065	1.3934	1.1804
No log	10.4783	482	1.3668	0.2065	1.3668	1.1691
No log	10.5217	484	1.4287	0.2065	1.4287	1.1953
No log	10.5652	486	1.6009	0.1880	1.6009	1.2653
No log	10.6087	488	1.6369	0.2342	1.6369	1.2794
No log	10.6522	490	1.5462	0.2694	1.5462	1.2434
No log	10.6957	492	1.4127	0.2290	1.4127	1.1886
No log	10.7391	494	1.3308	0.2574	1.3308	1.1536
No log	10.7826	496	1.3379	0.2611	1.3379	1.1567
No log	10.8261	498	1.3246	0.2793	1.3246	1.1509
0.2599	10.8696	500	1.2372	0.1744	1.2372	1.1123
0.2599	10.9130	502	1.1882	0.1407	1.1882	1.0901
0.2599	10.9565	504	1.2477	0.2126	1.2477	1.1170
0.2599	11.0	506	1.2748	0.2522	1.2748	1.1291
0.2599	11.0435	508	1.2402	0.2522	1.2402	1.1136
0.2599	11.0870	510	1.2367	0.2522	1.2367	1.1121
0.2599	11.1304	512	1.1865	0.1880	1.1865	1.0893
0.2599	11.1739	514	1.2051	0.1880	1.2051	1.0978
0.2599	11.2174	516	1.2600	0.1880	1.2600	1.1225
0.2599	11.2609	518	1.3715	0.2752	1.3715	1.1711
0.2599	11.3043	520	1.3921	0.2793	1.3921	1.1799
0.2599	11.3478	522	1.3862	0.2793	1.3862	1.1774
0.2599	11.3913	524	1.3326	0.2752	1.3326	1.1544
0.2599	11.4348	526	1.2189	0.1814	1.2189	1.1040
0.2599	11.4783	528	1.1856	0.1961	1.1856	1.0889
0.2599	11.5217	530	1.2013	0.1935	1.2013	1.0960
0.2599	11.5652	532	1.3006	0.2752	1.3006	1.1404
0.2599	11.6087	534	1.3334	0.2372	1.3334	1.1547
0.2599	11.6522	536	1.3523	0.2065	1.3523	1.1629
0.2599	11.6957	538	1.3473	0.2065	1.3473	1.1607
0.2599	11.7391	540	1.3603	0.2372	1.3603	1.1663
0.2599	11.7826	542	1.3395	0.2793	1.3395	1.1574
0.2599	11.8261	544	1.2427	0.2172	1.2427	1.1148
0.2599	11.8696	546	1.1504	0.2076	1.1504	1.0726
0.2599	11.9130	548	1.1808	0.2172	1.1808	1.0866
0.2599	11.9565	550	1.1985	0.1658	1.1985	1.0947
0.2599	12.0	552	1.1504	0.1725	1.1504	1.0726
0.2599	12.0435	554	1.0693	0.2192	1.0693	1.0341
0.2599	12.0870	556	1.1251	0.1795	1.1251	1.0607
0.2599	12.1304	558	1.0854	0.1724	1.0854	1.0418
0.2599	12.1739	560	1.0101	0.2077	1.0101	1.0050
0.2599	12.2174	562	0.9901	0.1601	0.9901	0.9950
0.2599	12.2609	564	1.0392	0.1292	1.0392	1.0194
0.2599	12.3043	566	1.1432	0.1379	1.1432	1.0692
0.2599	12.3478	568	1.2855	0.1407	1.2855	1.1338
0.2599	12.3913	570	1.4193	0.2752	1.4193	1.1914
0.2599	12.4348	572	1.5028	0.2793	1.5028	1.2259
0.2599	12.4783	574	1.4893	0.2793	1.4893	1.2204
0.2599	12.5217	576	1.4409	0.2465	1.4409	1.2004
0.2599	12.5652	578	1.3707	0.2417	1.3707	1.1708
0.2599	12.6087	580	1.2798	0.1512	1.2798	1.1313
0.2599	12.6522	582	1.2416	0.0961	1.2416	1.1143
0.2599	12.6957	584	1.2784	0.0390	1.2784	1.1307
0.2599	12.7391	586	1.2956	0.0781	1.2956	1.1382
0.2599	12.7826	588	1.3017	0.1407	1.3017	1.1409

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1