ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3062
• Qwk: 0.1789
• Mse: 1.3062
• Rmse: 1.1429

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	4.8322	-0.0104	4.8322	2.1982
No log	0.6667	4	2.9490	-0.0434	2.9490	1.7173
No log	1.0	6	1.6493	0.0504	1.6493	1.2843
No log	1.3333	8	1.6144	0.0372	1.6144	1.2706
No log	1.6667	10	1.6107	-0.0146	1.6107	1.2691
No log	2.0	12	1.4117	-0.0359	1.4117	1.1882
No log	2.3333	14	1.2585	0.2095	1.2585	1.1218
No log	2.6667	16	1.2138	0.0979	1.2138	1.1017
No log	3.0	18	1.2825	0.0865	1.2825	1.1325
No log	3.3333	20	1.5319	0.0	1.5319	1.2377
No log	3.6667	22	1.5811	0.0	1.5811	1.2574
No log	4.0	24	1.5866	0.0	1.5866	1.2596
No log	4.3333	26	1.2705	0.1735	1.2705	1.1272
No log	4.6667	28	1.2414	0.1904	1.2414	1.1142
No log	5.0	30	1.3685	0.0575	1.3685	1.1698
No log	5.3333	32	1.2534	0.1809	1.2534	1.1195
No log	5.6667	34	1.1732	0.2212	1.1732	1.0831
No log	6.0	36	1.2000	0.1830	1.2000	1.0954
No log	6.3333	38	1.2358	0.1014	1.2358	1.1117
No log	6.6667	40	1.2172	0.1260	1.2172	1.1033
No log	7.0	42	1.2801	0.0894	1.2801	1.1314
No log	7.3333	44	1.1954	0.1601	1.1954	1.0934
No log	7.6667	46	1.1430	0.2188	1.1430	1.0691
No log	8.0	48	1.1747	0.1546	1.1747	1.0838
No log	8.3333	50	1.1355	0.1654	1.1355	1.0656
No log	8.6667	52	1.1752	0.1565	1.1752	1.0841
No log	9.0	54	1.1521	0.1713	1.1521	1.0734
No log	9.3333	56	1.1911	0.0945	1.1911	1.0914
No log	9.6667	58	1.1215	0.1278	1.1215	1.0590
No log	10.0	60	1.0667	0.1814	1.0667	1.0328
No log	10.3333	62	1.0701	0.2624	1.0701	1.0345
No log	10.6667	64	1.1085	0.1649	1.1085	1.0529
No log	11.0	66	1.1548	0.1969	1.1548	1.0746
No log	11.3333	68	1.0936	0.2175	1.0936	1.0458
No log	11.6667	70	1.2569	0.1803	1.2569	1.1211
No log	12.0	72	1.1837	0.2315	1.1837	1.0880
No log	12.3333	74	1.1357	0.2432	1.1357	1.0657
No log	12.6667	76	1.3680	0.1163	1.3680	1.1696
No log	13.0	78	1.3922	0.1395	1.3922	1.1799
No log	13.3333	80	1.1933	0.1654	1.1933	1.0924
No log	13.6667	82	1.1311	0.2942	1.1311	1.0636
No log	14.0	84	1.1045	0.3318	1.1045	1.0510
No log	14.3333	86	1.1198	0.1343	1.1198	1.0582
No log	14.6667	88	1.4005	0.1142	1.4005	1.1834
No log	15.0	90	1.4140	0.0598	1.4140	1.1891
No log	15.3333	92	1.2041	0.1176	1.2041	1.0973
No log	15.6667	94	1.1072	0.2835	1.1072	1.0522
No log	16.0	96	1.0880	0.2835	1.0880	1.0431
No log	16.3333	98	1.1478	0.2083	1.1478	1.0714
No log	16.6667	100	1.2164	0.1752	1.2164	1.1029
No log	17.0	102	1.2180	0.1910	1.2180	1.1037
No log	17.3333	104	1.0853	0.2164	1.0853	1.0418
No log	17.6667	106	1.0640	0.2121	1.0640	1.0315
No log	18.0	108	1.1701	0.2330	1.1701	1.0817
No log	18.3333	110	1.3452	0.2589	1.3452	1.1598
No log	18.6667	112	1.2814	0.2889	1.2814	1.1320
No log	19.0	114	1.1075	0.1482	1.1075	1.0524
No log	19.3333	116	1.0569	0.2835	1.0569	1.0280
No log	19.6667	118	1.0705	0.2257	1.0705	1.0346
No log	20.0	120	1.1457	0.1585	1.1457	1.0704
No log	20.3333	122	1.3550	0.1188	1.3550	1.1640
No log	20.6667	124	1.5117	0.2806	1.5117	1.2295
No log	21.0	126	1.4030	0.3113	1.4030	1.1845
No log	21.3333	128	1.2203	0.2702	1.2203	1.1047
No log	21.6667	130	1.1696	0.2899	1.1696	1.0815
No log	22.0	132	1.2207	0.2322	1.2207	1.1049
No log	22.3333	134	1.3004	0.2108	1.3004	1.1403
No log	22.6667	136	1.2861	0.1903	1.2861	1.1341
No log	23.0	138	1.1769	0.2894	1.1769	1.0849
No log	23.3333	140	1.1658	0.1546	1.1658	1.0797
No log	23.6667	142	1.2770	0.25	1.2770	1.1300
No log	24.0	144	1.4752	0.2941	1.4752	1.2146
No log	24.3333	146	1.4747	0.2941	1.4747	1.2144
No log	24.6667	148	1.3126	0.2317	1.3126	1.1457
No log	25.0	150	1.1679	0.1801	1.1679	1.0807
No log	25.3333	152	1.1265	0.2689	1.1265	1.0614
No log	25.6667	154	1.1547	0.2263	1.1547	1.0746
No log	26.0	156	1.2800	0.2424	1.2800	1.1314
No log	26.3333	158	1.3455	0.2105	1.3455	1.1600
No log	26.6667	160	1.2710	0.1840	1.2710	1.1274
No log	27.0	162	1.1561	0.2220	1.1561	1.0752
No log	27.3333	164	1.1029	0.2119	1.1029	1.0502
No log	27.6667	166	1.1006	0.1585	1.1006	1.0491
No log	28.0	168	1.1765	0.0904	1.1765	1.0847
No log	28.3333	170	1.1932	0.1249	1.1932	1.0923
No log	28.6667	172	1.1344	0.1541	1.1344	1.0651
No log	29.0	174	1.0939	0.2276	1.0939	1.0459
No log	29.3333	176	1.0918	0.2276	1.0918	1.0449
No log	29.6667	178	1.1369	0.2402	1.1369	1.0662
No log	30.0	180	1.2904	0.2238	1.2904	1.1359
No log	30.3333	182	1.4967	0.2711	1.4967	1.2234
No log	30.6667	184	1.5148	0.2465	1.5148	1.2308
No log	31.0	186	1.3902	0.2704	1.3902	1.1791
No log	31.3333	188	1.1777	0.2238	1.1777	1.0852
No log	31.6667	190	1.0891	0.2056	1.0891	1.0436
No log	32.0	192	1.0941	0.2152	1.0941	1.0460
No log	32.3333	194	1.1387	0.2633	1.1387	1.0671
No log	32.6667	196	1.2643	0.2087	1.2643	1.1244
No log	33.0	198	1.4065	0.2789	1.4065	1.1860
No log	33.3333	200	1.4517	0.2455	1.4517	1.2049
No log	33.6667	202	1.3831	0.2789	1.3831	1.1761
No log	34.0	204	1.2568	0.2087	1.2568	1.1210
No log	34.3333	206	1.1418	0.2599	1.1418	1.0686
No log	34.6667	208	1.1438	0.2651	1.1438	1.0695
No log	35.0	210	1.1973	0.2570	1.1973	1.0942
No log	35.3333	212	1.2531	0.1789	1.2531	1.1194
No log	35.6667	214	1.3362	0.1840	1.3362	1.1559
No log	36.0	216	1.2940	0.1789	1.2940	1.1375
No log	36.3333	218	1.1975	0.25	1.1975	1.0943
No log	36.6667	220	1.1760	0.2108	1.1760	1.0845
No log	37.0	222	1.1727	0.1952	1.1727	1.0829
No log	37.3333	224	1.1682	0.1217	1.1682	1.0808
No log	37.6667	226	1.1675	0.1316	1.1675	1.0805
No log	38.0	228	1.1597	0.0904	1.1597	1.0769
No log	38.3333	230	1.1766	0.0904	1.1766	1.0847
No log	38.6667	232	1.2105	0.0811	1.2105	1.1002
No log	39.0	234	1.2027	0.1283	1.2027	1.0967
No log	39.3333	236	1.1760	0.1692	1.1760	1.0844
No log	39.6667	238	1.1531	0.2291	1.1531	1.0738
No log	40.0	240	1.1780	0.2097	1.1780	1.0854
No log	40.3333	242	1.1533	0.2046	1.1533	1.0739
No log	40.6667	244	1.1218	0.2330	1.1218	1.0591
No log	41.0	246	1.1318	0.2291	1.1318	1.0638
No log	41.3333	248	1.1551	0.2207	1.1551	1.0748
No log	41.6667	250	1.1566	0.1316	1.1566	1.0754
No log	42.0	252	1.1560	0.1952	1.1560	1.0752
No log	42.3333	254	1.1621	0.1952	1.1621	1.0780
No log	42.6667	256	1.1900	0.1316	1.1900	1.0909
No log	43.0	258	1.2114	0.0887	1.2114	1.1006
No log	43.3333	260	1.2108	0.0887	1.2108	1.1004
No log	43.6667	262	1.2010	0.0887	1.2010	1.0959
No log	44.0	264	1.2260	0.0887	1.2260	1.1073
No log	44.3333	266	1.2283	0.0789	1.2283	1.1083
No log	44.6667	268	1.2811	0.1789	1.2811	1.1319
No log	45.0	270	1.3052	0.1789	1.3052	1.1424
No log	45.3333	272	1.2989	0.1122	1.2989	1.1397
No log	45.6667	274	1.2671	0.0789	1.2671	1.1257
No log	46.0	276	1.3299	0.1122	1.3299	1.1532
No log	46.3333	278	1.3716	0.1692	1.3716	1.1711
No log	46.6667	280	1.3461	0.1219	1.3461	1.1602
No log	47.0	282	1.3157	0.0887	1.3157	1.1471
No log	47.3333	284	1.2238	0.0789	1.2238	1.1063
No log	47.6667	286	1.1699	0.1480	1.1699	1.0816
No log	48.0	288	1.1552	0.1480	1.1552	1.0748
No log	48.3333	290	1.1721	0.0442	1.1721	1.0827
No log	48.6667	292	1.2117	0.0541	1.2117	1.1008
No log	49.0	294	1.2364	0.0541	1.2364	1.1119
No log	49.3333	296	1.2068	0.0541	1.2068	1.0985
No log	49.6667	298	1.1734	0.1217	1.1734	1.0833
No log	50.0	300	1.1928	0.0789	1.1928	1.0921
No log	50.3333	302	1.2715	0.1031	1.2715	1.1276
No log	50.6667	304	1.3467	0.1889	1.3467	1.1605
No log	51.0	306	1.3817	0.1889	1.3817	1.1755
No log	51.3333	308	1.3509	0.1889	1.3509	1.1623
No log	51.6667	310	1.3363	0.1889	1.3363	1.1560
No log	52.0	312	1.2502	0.0937	1.2502	1.1181
No log	52.3333	314	1.2131	0.0937	1.2131	1.1014
No log	52.6667	316	1.2230	0.1031	1.2230	1.1059
No log	53.0	318	1.2562	0.1031	1.2562	1.1208
No log	53.3333	320	1.3301	0.1889	1.3301	1.1533
No log	53.6667	322	1.3893	0.1889	1.3893	1.1787
No log	54.0	324	1.4174	0.1889	1.4174	1.1905
No log	54.3333	326	1.4747	0.1796	1.4747	1.2144
No log	54.6667	328	1.4439	0.2213	1.4439	1.2016
No log	55.0	330	1.3398	0.1592	1.3398	1.1575
No log	55.3333	332	1.2739	0.1345	1.2739	1.1287
No log	55.6667	334	1.2065	0.1217	1.2065	1.0984
No log	56.0	336	1.1642	0.1217	1.1642	1.0790
No log	56.3333	338	1.1245	0.0802	1.1245	1.0604
No log	56.6667	340	1.1217	0.0802	1.1217	1.0591
No log	57.0	342	1.1447	0.0904	1.1447	1.0699
No log	57.3333	344	1.2034	0.0541	1.2034	1.0970
No log	57.6667	346	1.2809	0.0887	1.2809	1.1318
No log	58.0	348	1.3207	0.1592	1.3207	1.1492
No log	58.3333	350	1.3373	0.1889	1.3373	1.1564
No log	58.6667	352	1.3460	0.1935	1.3460	1.1602
No log	59.0	354	1.3023	0.1935	1.3023	1.1412
No log	59.3333	356	1.2380	0.1943	1.2380	1.1127
No log	59.6667	358	1.2090	0.1896	1.2090	1.0995
No log	60.0	360	1.1898	0.1345	1.1898	1.0908
No log	60.3333	362	1.1591	0.1538	1.1591	1.0766
No log	60.6667	364	1.1576	0.1538	1.1576	1.0759
No log	61.0	366	1.1918	0.2097	1.1918	1.0917
No log	61.3333	368	1.2121	0.2097	1.2121	1.1009
No log	61.6667	370	1.2605	0.1592	1.2605	1.1227
No log	62.0	372	1.3285	0.1889	1.3285	1.1526
No log	62.3333	374	1.3844	0.1461	1.3844	1.1766
No log	62.6667	376	1.4073	0.1461	1.4073	1.1863
No log	63.0	378	1.3977	0.1461	1.3977	1.1823
No log	63.3333	380	1.3554	0.1889	1.3554	1.1642
No log	63.6667	382	1.2894	0.1592	1.2894	1.1355
No log	64.0	384	1.2473	0.1031	1.2473	1.1168
No log	64.3333	386	1.2499	0.0937	1.2499	1.1180
No log	64.6667	388	1.2656	0.1592	1.2656	1.1250
No log	65.0	390	1.2647	0.1498	1.2647	1.1246
No log	65.3333	392	1.2951	0.1592	1.2951	1.1380
No log	65.6667	394	1.3443	0.1889	1.3443	1.1594
No log	66.0	396	1.3752	0.1889	1.3752	1.1727
No log	66.3333	398	1.3604	0.1889	1.3604	1.1664
No log	66.6667	400	1.3125	0.1789	1.3125	1.1456
No log	67.0	402	1.2766	0.1789	1.2766	1.1298
No log	67.3333	404	1.2724	0.1692	1.2724	1.1280
No log	67.6667	406	1.2939	0.1692	1.2939	1.1375
No log	68.0	408	1.2776	0.1692	1.2776	1.1303
No log	68.3333	410	1.2847	0.1692	1.2847	1.1334
No log	68.6667	412	1.2972	0.1692	1.2972	1.1390
No log	69.0	414	1.3529	0.2087	1.3529	1.1631
No log	69.3333	416	1.3876	0.2087	1.3876	1.1780
No log	69.6667	418	1.4218	0.1646	1.4218	1.1924
No log	70.0	420	1.4264	0.1646	1.4264	1.1943
No log	70.3333	422	1.3980	0.2087	1.3980	1.1824
No log	70.6667	424	1.3615	0.1789	1.3615	1.1668
No log	71.0	426	1.3058	0.1789	1.3058	1.1427
No log	71.3333	428	1.2639	0.1379	1.2639	1.1242
No log	71.6667	430	1.2532	0.1379	1.2532	1.1195
No log	72.0	432	1.2538	0.1477	1.2538	1.1197
No log	72.3333	434	1.2414	0.0887	1.2414	1.1142
No log	72.6667	436	1.2540	0.1789	1.2540	1.1198
No log	73.0	438	1.2888	0.1789	1.2888	1.1352
No log	73.3333	440	1.3416	0.2087	1.3416	1.1583
No log	73.6667	442	1.4158	0.2087	1.4158	1.1899
No log	74.0	444	1.4499	0.2373	1.4499	1.2041
No log	74.3333	446	1.4506	0.2373	1.4506	1.2044
No log	74.6667	448	1.4076	0.2087	1.4076	1.1864
No log	75.0	450	1.3613	0.1789	1.3613	1.1668
No log	75.3333	452	1.3148	0.1789	1.3148	1.1467
No log	75.6667	454	1.2701	0.1219	1.2701	1.1270
No log	76.0	456	1.2409	0.1219	1.2409	1.1139
No log	76.3333	458	1.2303	0.1637	1.2303	1.1092
No log	76.6667	460	1.2377	0.1637	1.2377	1.1125
No log	77.0	462	1.2560	0.1219	1.2560	1.1207
No log	77.3333	464	1.2746	0.1219	1.2746	1.1290
No log	77.6667	466	1.3003	0.1219	1.3003	1.1403
No log	78.0	468	1.3095	0.1789	1.3095	1.1443
No log	78.3333	470	1.3229	0.1789	1.3229	1.1502
No log	78.6667	472	1.3439	0.2087	1.3439	1.1593
No log	79.0	474	1.3697	0.2087	1.3697	1.1703
No log	79.3333	476	1.3718	0.2087	1.3718	1.1713
No log	79.6667	478	1.3495	0.2087	1.3495	1.1617
No log	80.0	480	1.3092	0.1219	1.3092	1.1442
No log	80.3333	482	1.2860	0.1219	1.2860	1.1340
No log	80.6667	484	1.2774	0.1219	1.2774	1.1302
No log	81.0	486	1.2673	0.1219	1.2673	1.1258
No log	81.3333	488	1.2701	0.1219	1.2701	1.1270
No log	81.6667	490	1.2717	0.1219	1.2717	1.1277
No log	82.0	492	1.2786	0.1219	1.2786	1.1307
No log	82.3333	494	1.2932	0.1219	1.2932	1.1372
No log	82.6667	496	1.3002	0.1219	1.3002	1.1403
No log	83.0	498	1.3076	0.1789	1.3076	1.1435
0.2791	83.3333	500	1.3168	0.1789	1.3168	1.1475
0.2791	83.6667	502	1.3124	0.1789	1.3124	1.1456
0.2791	84.0	504	1.2951	0.1219	1.2951	1.1380
0.2791	84.3333	506	1.2884	0.1219	1.2884	1.1351
0.2791	84.6667	508	1.2928	0.1219	1.2928	1.1370
0.2791	85.0	510	1.3062	0.1789	1.3062	1.1429

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1