ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1966
• Qwk: 0.1896
• Mse: 1.1966
• Rmse: 1.0939

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.8838	-0.0104	4.8838	2.2099
No log	0.1143	4	2.8157	0.0537	2.8157	1.6780
No log	0.1714	6	2.0922	-0.0102	2.0922	1.4464
No log	0.2286	8	2.0388	-0.0370	2.0388	1.4279
No log	0.2857	10	2.1018	-0.0690	2.1018	1.4498
No log	0.3429	12	1.8533	0.0372	1.8533	1.3614
No log	0.4	14	1.7694	0.1060	1.7694	1.3302
No log	0.4571	16	1.6398	0.0691	1.6398	1.2806
No log	0.5143	18	1.2587	0.0230	1.2587	1.1219
No log	0.5714	20	1.1692	0.1689	1.1692	1.0813
No log	0.6286	22	1.1803	0.1247	1.1803	1.0864
No log	0.6857	24	1.1890	0.1689	1.1890	1.0904
No log	0.7429	26	1.2154	0.1247	1.2154	1.1024
No log	0.8	28	1.2148	0.1144	1.2148	1.1022
No log	0.8571	30	1.2261	0.1423	1.2261	1.1073
No log	0.9143	32	1.2372	0.1733	1.2372	1.1123
No log	0.9714	34	1.2094	0.1605	1.2094	1.0997
No log	1.0286	36	1.2322	0.0612	1.2322	1.1101
No log	1.0857	38	1.3038	0.0442	1.3038	1.1418
No log	1.1429	40	1.3008	0.0253	1.3008	1.1405
No log	1.2	42	1.3142	-0.0218	1.3142	1.1464
No log	1.2571	44	1.3672	-0.0160	1.3672	1.1693
No log	1.3143	46	1.3535	-0.0735	1.3535	1.1634
No log	1.3714	48	1.2179	0.2108	1.2179	1.1036
No log	1.4286	50	1.5845	0.1135	1.5845	1.2588
No log	1.4857	52	1.8123	0.0084	1.8123	1.3462
No log	1.5429	54	1.6616	0.0	1.6616	1.2890
No log	1.6	56	1.4471	0.0488	1.4471	1.2030
No log	1.6571	58	1.2318	0.1165	1.2318	1.1099
No log	1.7143	60	1.1165	0.2886	1.1165	1.0567
No log	1.7714	62	1.1385	0.0974	1.1385	1.0670
No log	1.8286	64	1.2224	0.0527	1.2224	1.1056
No log	1.8857	66	1.2259	0.1755	1.2259	1.1072
No log	1.9429	68	1.2245	0.1904	1.2245	1.1066
No log	2.0	70	1.2431	0.2047	1.2431	1.1150
No log	2.0571	72	1.4059	0.1685	1.4059	1.1857
No log	2.1143	74	1.9472	0.1385	1.9472	1.3954
No log	2.1714	76	1.9430	0.1261	1.9430	1.3939
No log	2.2286	78	1.9315	0.0402	1.9315	1.3898
No log	2.2857	80	1.5243	0.2172	1.5243	1.2346
No log	2.3429	82	1.3276	0.1837	1.3276	1.1522
No log	2.4	84	1.2958	0.1795	1.2958	1.1383
No log	2.4571	86	1.4342	0.2662	1.4342	1.1976
No log	2.5143	88	1.3181	0.3525	1.3181	1.1481
No log	2.5714	90	1.2749	0.3303	1.2749	1.1291
No log	2.6286	92	1.2242	0.3148	1.2242	1.1065
No log	2.6857	94	1.1955	0.3370	1.1955	1.0934
No log	2.7429	96	1.2694	0.2742	1.2694	1.1267
No log	2.8	98	1.2052	0.2605	1.2052	1.0978
No log	2.8571	100	1.0223	0.3943	1.0223	1.0111
No log	2.9143	102	1.0015	0.4397	1.0015	1.0007
No log	2.9714	104	1.0535	0.3173	1.0535	1.0264
No log	3.0286	106	1.6196	0.3541	1.6196	1.2726
No log	3.0857	108	1.6288	0.3620	1.6288	1.2763
No log	3.1429	110	1.2490	0.3554	1.2490	1.1176
No log	3.2	112	1.1545	0.3614	1.1545	1.0745
No log	3.2571	114	1.0684	0.3516	1.0684	1.0336
No log	3.3143	116	1.2602	0.3523	1.2602	1.1226
No log	3.3714	118	1.2396	0.3478	1.2396	1.1134
No log	3.4286	120	1.3250	0.3580	1.3250	1.1511
No log	3.4857	122	1.3307	0.3467	1.3307	1.1536
No log	3.5429	124	1.0653	0.3923	1.0653	1.0321
No log	3.6	126	1.0294	0.3664	1.0294	1.0146
No log	3.6571	128	1.1726	0.3398	1.1726	1.0829
No log	3.7143	130	1.5670	0.2804	1.5670	1.2518
No log	3.7714	132	1.6877	0.2644	1.6877	1.2991
No log	3.8286	134	1.5590	0.2804	1.5590	1.2486
No log	3.8857	136	1.2499	0.3101	1.2499	1.1180
No log	3.9429	138	1.1321	0.3201	1.1321	1.0640
No log	4.0	140	1.1269	0.3505	1.1269	1.0616
No log	4.0571	142	1.2400	0.3346	1.2400	1.1135
No log	4.1143	144	1.6438	0.2770	1.6438	1.2821
No log	4.1714	146	1.8916	0.1686	1.8916	1.3753
No log	4.2286	148	1.8197	0.1880	1.8197	1.3489
No log	4.2857	150	1.5855	0.2950	1.5855	1.2591
No log	4.3429	152	1.2339	0.2511	1.2339	1.1108
No log	4.4	154	1.0946	0.2857	1.0946	1.0463
No log	4.4571	156	1.1236	0.2766	1.1236	1.0600
No log	4.5143	158	1.2831	0.3163	1.2831	1.1327
No log	4.5714	160	1.3369	0.3045	1.3369	1.1563
No log	4.6286	162	1.2462	0.2471	1.2462	1.1163
No log	4.6857	164	1.1804	0.2046	1.1804	1.0865
No log	4.7429	166	1.2052	0.2914	1.2052	1.0978
No log	4.8	168	1.2623	0.3004	1.2623	1.1235
No log	4.8571	170	1.1121	0.3182	1.1121	1.0546
No log	4.9143	172	1.0841	0.2930	1.0841	1.0412
No log	4.9714	174	1.1414	0.3755	1.1414	1.0684
No log	5.0286	176	1.3431	0.2582	1.3431	1.1589
No log	5.0857	178	1.4522	0.3082	1.4522	1.2051
No log	5.1429	180	1.3480	0.2698	1.3480	1.1611
No log	5.2	182	1.2284	0.3361	1.2284	1.1083
No log	5.2571	184	1.3249	0.2633	1.3249	1.1510
No log	5.3143	186	1.4649	0.3283	1.4649	1.2103
No log	5.3714	188	1.3095	0.2060	1.3095	1.1443
No log	5.4286	190	1.1565	0.1750	1.1565	1.0754
No log	5.4857	192	1.1163	0.1442	1.1163	1.0566
No log	5.5429	194	1.1795	0.1750	1.1795	1.0861
No log	5.6	196	1.3297	0.3006	1.3297	1.1531
No log	5.6571	198	1.3635	0.3006	1.3635	1.1677
No log	5.7143	200	1.2002	0.1637	1.2002	1.0955
No log	5.7714	202	1.0516	0.1961	1.0516	1.0255
No log	5.8286	204	1.0089	0.1927	1.0089	1.0044
No log	5.8857	206	1.0085	0.2086	1.0085	1.0042
No log	5.9429	208	1.0855	0.2586	1.0855	1.0419
No log	6.0	210	1.2482	0.2555	1.2482	1.1172
No log	6.0571	212	1.3839	0.3416	1.3839	1.1764
No log	6.1143	214	1.2975	0.3224	1.2975	1.1391
No log	6.1714	216	1.2061	0.2262	1.2061	1.0982
No log	6.2286	218	1.0805	0.2304	1.0805	1.0395
No log	6.2857	220	1.1230	0.1596	1.1230	1.0597
No log	6.3429	222	1.1618	0.1596	1.1618	1.0779
No log	6.4	224	1.1193	0.1596	1.1193	1.0580
No log	6.4571	226	1.0601	0.1801	1.0601	1.0296
No log	6.5143	228	1.0575	0.2019	1.0575	1.0283
No log	6.5714	230	1.0958	0.1502	1.0958	1.0468
No log	6.6286	232	1.2427	0.3003	1.2427	1.1148
No log	6.6857	234	1.5836	0.3478	1.5836	1.2584
No log	6.7429	236	1.7810	0.2756	1.7810	1.3346
No log	6.8	238	1.6687	0.3116	1.6687	1.2918
No log	6.8571	240	1.3664	0.2965	1.3664	1.1689
No log	6.9143	242	1.1930	0.2006	1.1930	1.0923
No log	6.9714	244	1.1702	0.1562	1.1702	1.0818
No log	7.0286	246	1.1788	0.1085	1.1788	1.0857
No log	7.0857	248	1.2067	0.0948	1.2067	1.0985
No log	7.1429	250	1.2517	0.1379	1.2517	1.1188
No log	7.2	252	1.2539	0.1599	1.2539	1.1198
No log	7.2571	254	1.2336	0.1599	1.2336	1.1107
No log	7.3143	256	1.1929	0.1502	1.1929	1.0922
No log	7.3714	258	1.2378	0.2041	1.2378	1.1126
No log	7.4286	260	1.3943	0.2985	1.3943	1.1808
No log	7.4857	262	1.3636	0.3500	1.3636	1.1677
No log	7.5429	264	1.2452	0.2894	1.2452	1.1159
No log	7.6	266	1.1897	0.1712	1.1897	1.0907
No log	7.6571	268	1.2408	0.1991	1.2408	1.1139
No log	7.7143	270	1.3358	0.2844	1.3358	1.1558
No log	7.7714	272	1.4005	0.2144	1.4005	1.1834
No log	7.8286	274	1.3150	0.2844	1.3150	1.1467
No log	7.8857	276	1.1582	0.2195	1.1582	1.0762
No log	7.9429	278	1.0954	0.2591	1.0954	1.0466
No log	8.0	280	1.0966	0.2206	1.0966	1.0472
No log	8.0571	282	1.1156	0.2431	1.1156	1.0562
No log	8.1143	284	1.1845	0.3357	1.1845	1.0883
No log	8.1714	286	1.2573	0.3047	1.2573	1.1213
No log	8.2286	288	1.3057	0.3047	1.3057	1.1427
No log	8.2857	290	1.2903	0.3025	1.2903	1.1359
No log	8.3429	292	1.1711	0.2381	1.1711	1.0822
No log	8.4	294	1.0714	0.2970	1.0714	1.0351
No log	8.4571	296	1.0593	0.2970	1.0593	1.0292
No log	8.5143	298	1.1153	0.1559	1.1153	1.0561
No log	8.5714	300	1.2645	0.2956	1.2645	1.1245
No log	8.6286	302	1.4142	0.2550	1.4142	1.1892
No log	8.6857	304	1.4938	0.3026	1.4938	1.2222
No log	8.7429	306	1.4039	0.2806	1.4039	1.1848
No log	8.8	308	1.2033	0.2570	1.2033	1.0970
No log	8.8571	310	1.1174	0.2110	1.1174	1.0570
No log	8.9143	312	1.1246	0.2110	1.1246	1.0605
No log	8.9714	314	1.2688	0.2494	1.2688	1.1264
No log	9.0286	316	1.4422	0.2806	1.4422	1.2009
No log	9.0857	318	1.4237	0.2144	1.4237	1.1932
No log	9.1429	320	1.2899	0.2238	1.2899	1.1357
No log	9.2	322	1.1687	0.1344	1.1687	1.0811
No log	9.2571	324	1.1328	0.1761	1.1328	1.0644
No log	9.3143	326	1.1580	0.1654	1.1580	1.0761
No log	9.3714	328	1.3097	0.2141	1.3097	1.1444
No log	9.4286	330	1.3779	0.2489	1.3779	1.1738
No log	9.4857	332	1.3082	0.2424	1.3082	1.1438
No log	9.5429	334	1.1873	0.1654	1.1873	1.0897
No log	9.6	336	1.1770	0.1654	1.1770	1.0849
No log	9.6571	338	1.2251	0.1654	1.2251	1.1068
No log	9.7143	340	1.3634	0.1891	1.3634	1.1676
No log	9.7714	342	1.4055	0.2163	1.4055	1.1855
No log	9.8286	344	1.3649	0.1608	1.3649	1.1683
No log	9.8857	346	1.3511	0.1891	1.3511	1.1624
No log	9.9429	348	1.2875	0.2132	1.2875	1.1347
No log	10.0	350	1.2975	0.1943	1.2975	1.1391
No log	10.0571	352	1.3344	0.2471	1.3344	1.1552
No log	10.1143	354	1.4386	0.2564	1.4386	1.1994
No log	10.1714	356	1.5029	0.2701	1.5029	1.2259
No log	10.2286	358	1.6506	0.2954	1.6506	1.2848
No log	10.2857	360	1.5642	0.2829	1.5642	1.2507
No log	10.3429	362	1.5015	0.1970	1.5015	1.2254
No log	10.4	364	1.4074	0.1592	1.4074	1.1863
No log	10.4571	366	1.3173	0.1316	1.3173	1.1478
No log	10.5143	368	1.2974	0.0980	1.2974	1.1390
No log	10.5714	370	1.2999	0.1316	1.2999	1.1401
No log	10.6286	372	1.2398	0.1048	1.2398	1.1135
No log	10.6857	374	1.1754	0.1015	1.1754	1.0841
No log	10.7429	376	1.1687	0.1015	1.1687	1.0811
No log	10.8	378	1.1904	0.1281	1.1904	1.0910
No log	10.8571	380	1.2722	0.1846	1.2722	1.1279
No log	10.9143	382	1.4064	0.1708	1.4064	1.1859
No log	10.9714	384	1.3880	0.1708	1.3880	1.1781
No log	11.0286	386	1.3233	0.2647	1.3233	1.1504
No log	11.0857	388	1.1834	0.1750	1.1834	1.0878
No log	11.1429	390	1.1215	0.1767	1.1215	1.0590
No log	11.2	392	1.1099	0.1767	1.1099	1.0535
No log	11.2571	394	1.1193	0.1015	1.1193	1.0580
No log	11.3143	396	1.2001	0.1692	1.2001	1.0955
No log	11.3714	398	1.2800	0.2790	1.2800	1.1314
No log	11.4286	400	1.3354	0.2489	1.3354	1.1556
No log	11.4857	402	1.2770	0.2807	1.2770	1.1300
No log	11.5429	404	1.1212	0.2248	1.1212	1.0589
No log	11.6	406	1.0567	0.3217	1.0567	1.0280
No log	11.6571	408	1.0576	0.3018	1.0576	1.0284
No log	11.7143	410	1.0802	0.2692	1.0802	1.0393
No log	11.7714	412	1.1482	0.1814	1.1482	1.0716
No log	11.8286	414	1.2507	0.1750	1.2507	1.1183
No log	11.8857	416	1.2870	0.2046	1.2870	1.1345
No log	11.9429	418	1.2545	0.1750	1.2545	1.1200
No log	12.0	420	1.1805	0.1379	1.1805	1.0865
No log	12.0571	422	1.1231	0.1820	1.1231	1.0598
No log	12.1143	424	1.1214	0.1820	1.1214	1.0590
No log	12.1714	426	1.1743	0.1344	1.1743	1.0836
No log	12.2286	428	1.2594	0.1596	1.2594	1.1222
No log	12.2857	430	1.2659	0.1991	1.2659	1.1251
No log	12.3429	432	1.2423	0.1991	1.2423	1.1146
No log	12.4	434	1.1926	0.2046	1.1926	1.0921
No log	12.4571	436	1.1467	0.1379	1.1467	1.0708
No log	12.5143	438	1.1421	0.1379	1.1421	1.0687
No log	12.5714	440	1.1750	0.1316	1.1750	1.0840
No log	12.6286	442	1.2403	0.1944	1.2403	1.1137
No log	12.6857	444	1.3626	0.3047	1.3626	1.1673
No log	12.7429	446	1.4472	0.3105	1.4472	1.2030
No log	12.8	448	1.4459	0.3254	1.4459	1.2024
No log	12.8571	450	1.3017	0.2731	1.3017	1.1409
No log	12.9143	452	1.2107	0.2807	1.2107	1.1003
No log	12.9714	454	1.2221	0.3047	1.2221	1.1055
No log	13.0286	456	1.2294	0.2857	1.2294	1.1088
No log	13.0857	458	1.2847	0.2731	1.2847	1.1334
No log	13.1429	460	1.2746	0.2489	1.2746	1.1290
No log	13.2	462	1.1818	0.2238	1.1818	1.0871
No log	13.2571	464	1.1543	0.1741	1.1543	1.0744
No log	13.3143	466	1.1481	0.1741	1.1481	1.0715
No log	13.3714	468	1.1686	0.1316	1.1686	1.0810
No log	13.4286	470	1.1689	0.1316	1.1689	1.0811
No log	13.4857	472	1.1311	0.1315	1.1311	1.0635
No log	13.5429	474	1.0944	0.1649	1.0944	1.0461
No log	13.6	476	1.0812	0.1767	1.0812	1.0398
No log	13.6571	478	1.1082	0.2019	1.1082	1.0527
No log	13.7143	480	1.1836	0.1896	1.1836	1.0879
No log	13.7714	482	1.2371	0.2519	1.2371	1.1122
No log	13.8286	484	1.3384	0.2844	1.3384	1.1569
No log	13.8857	486	1.2938	0.2844	1.2938	1.1375
No log	13.9429	488	1.1591	0.1911	1.1591	1.0766
No log	14.0	490	1.0817	0.2076	1.0817	1.0400
No log	14.0571	492	1.0758	0.2346	1.0758	1.0372
No log	14.1143	494	1.1248	0.2076	1.1248	1.0606
No log	14.1714	496	1.2493	0.2754	1.2493	1.1177
No log	14.2286	498	1.3560	0.3093	1.3560	1.1645
0.3577	14.2857	500	1.3286	0.3093	1.3286	1.1526
0.3577	14.3429	502	1.2280	0.2754	1.2280	1.1081
0.3577	14.4	504	1.1436	0.1807	1.1436	1.0694
0.3577	14.4571	506	1.1017	0.2317	1.1017	1.0496
0.3577	14.5143	508	1.1186	0.2263	1.1186	1.0576
0.3577	14.5714	510	1.1966	0.1896	1.1966	1.0939

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1