ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k9_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2554
• Qwk: 0.1120
• Mse: 1.2554
• Rmse: 1.1204

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	2.5035	-0.0449	2.5035	1.5823
No log	0.1818	4	1.3059	0.1573	1.3059	1.1428
No log	0.2727	6	1.0969	-0.0970	1.0969	1.0473
No log	0.3636	8	1.0872	0.0094	1.0872	1.0427
No log	0.4545	10	1.0467	-0.0152	1.0467	1.0231
No log	0.5455	12	0.8598	0.0053	0.8598	0.9273
No log	0.6364	14	0.9718	0.1304	0.9718	0.9858
No log	0.7273	16	1.0077	0.0974	1.0077	1.0038
No log	0.8182	18	0.9163	0.1786	0.9163	0.9572
No log	0.9091	20	0.9129	-0.0426	0.9129	0.9555
No log	1.0	22	0.9207	-0.0426	0.9207	0.9595
No log	1.0909	24	0.9107	-0.0426	0.9107	0.9543
No log	1.1818	26	0.8756	0.0265	0.8756	0.9357
No log	1.2727	28	0.9505	0.1332	0.9505	0.9749
No log	1.3636	30	0.9610	0.1914	0.9610	0.9803
No log	1.4545	32	0.7881	0.2857	0.7881	0.8878
No log	1.5455	34	0.7092	0.0798	0.7092	0.8422
No log	1.6364	36	0.7086	0.0798	0.7086	0.8418
No log	1.7273	38	0.7196	0.1617	0.7196	0.8483
No log	1.8182	40	0.7432	0.2145	0.7432	0.8621
No log	1.9091	42	0.7259	0.1807	0.7259	0.8520
No log	2.0	44	0.7070	0.1094	0.7070	0.8408
No log	2.0909	46	0.7258	0.2718	0.7258	0.8519
No log	2.1818	48	0.8341	0.3234	0.8341	0.9133
No log	2.2727	50	0.9924	0.1178	0.9924	0.9962
No log	2.3636	52	1.0168	0.0927	1.0168	1.0084
No log	2.4545	54	0.8923	0.2173	0.8923	0.9446
No log	2.5455	56	0.9708	0.2810	0.9708	0.9853
No log	2.6364	58	1.0901	0.1591	1.0901	1.0441
No log	2.7273	60	1.3464	0.1337	1.3464	1.1603
No log	2.8182	62	1.2341	0.1042	1.2341	1.1109
No log	2.9091	64	0.9269	0.1914	0.9269	0.9628
No log	3.0	66	0.8231	0.0643	0.8231	0.9073
No log	3.0909	68	0.7981	0.1648	0.7981	0.8933
No log	3.1818	70	0.8476	0.2409	0.8476	0.9207
No log	3.2727	72	0.9477	0.1243	0.9477	0.9735
No log	3.3636	74	1.0474	0.1662	1.0474	1.0234
No log	3.4545	76	1.1098	0.1233	1.1098	1.0535
No log	3.5455	78	1.2129	0.1849	1.2129	1.1013
No log	3.6364	80	1.3270	0.2353	1.3270	1.1520
No log	3.7273	82	1.1299	0.2075	1.1299	1.0630
No log	3.8182	84	1.0404	0.1277	1.0404	1.0200
No log	3.9091	86	1.2516	0.1896	1.2516	1.1188
No log	4.0	88	1.5765	0.1237	1.5765	1.2556
No log	4.0909	90	1.6269	0.0770	1.6269	1.2755
No log	4.1818	92	1.5276	0.1212	1.5276	1.2360
No log	4.2727	94	1.4326	0.0905	1.4326	1.1969
No log	4.3636	96	1.3276	0.1222	1.3276	1.1522
No log	4.4545	98	1.3370	0.1196	1.3370	1.1563
No log	4.5455	100	1.4098	0.0475	1.4098	1.1873
No log	4.6364	102	1.3358	0.0766	1.3358	1.1558
No log	4.7273	104	1.2986	0.1018	1.2986	1.1396
No log	4.8182	106	1.4525	0.0613	1.4525	1.2052
No log	4.9091	108	1.6480	0.0911	1.6480	1.2837
No log	5.0	110	1.6027	0.0396	1.6027	1.2660
No log	5.0909	112	1.6372	0.0396	1.6372	1.2795
No log	5.1818	114	1.4903	0.0531	1.4903	1.2208
No log	5.2727	116	1.4961	0.0325	1.4961	1.2231
No log	5.3636	118	1.6483	0.0748	1.6483	1.2838
No log	5.4545	120	1.7109	0.1022	1.7109	1.3080
No log	5.5455	122	1.6003	0.0909	1.6003	1.2650
No log	5.6364	124	1.4329	0.0041	1.4329	1.1970
No log	5.7273	126	1.2848	0.0947	1.2848	1.1335
No log	5.8182	128	1.3032	0.1147	1.3032	1.1416
No log	5.9091	130	1.3512	0.1648	1.3512	1.1624
No log	6.0	132	1.4722	0.1099	1.4722	1.2134
No log	6.0909	134	1.7682	0.0909	1.7682	1.3297
No log	6.1818	136	1.7927	0.0909	1.7927	1.3389
No log	6.2727	138	1.6123	0.0613	1.6123	1.2698
No log	6.3636	140	1.5364	0.0457	1.5364	1.2395
No log	6.4545	142	1.5725	0.0578	1.5725	1.2540
No log	6.5455	144	1.5517	0.0839	1.5517	1.2457
No log	6.6364	146	1.4608	0.0903	1.4608	1.2086
No log	6.7273	148	1.3917	0.1067	1.3917	1.1797
No log	6.8182	150	1.3745	0.1018	1.3745	1.1724
No log	6.9091	152	1.3981	0.1018	1.3981	1.1824
No log	7.0	154	1.3188	0.1172	1.3188	1.1484
No log	7.0909	156	1.2671	0.1200	1.2671	1.1256
No log	7.1818	158	1.2137	0.0750	1.2137	1.1017
No log	7.2727	160	1.1986	0.1058	1.1986	1.0948
No log	7.3636	162	1.1637	0.0719	1.1637	1.0787
No log	7.4545	164	1.2490	0.0842	1.2490	1.1176
No log	7.5455	166	1.3956	0.0855	1.3956	1.1813
No log	7.6364	168	1.4344	0.1196	1.4344	1.1977
No log	7.7273	170	1.2645	0.1599	1.2645	1.1245
No log	7.8182	172	1.1516	0.1356	1.1516	1.0731
No log	7.9091	174	1.1347	0.1626	1.1347	1.0652
No log	8.0	176	1.1774	0.1638	1.1774	1.0851
No log	8.0909	178	1.2464	0.1805	1.2464	1.1164
No log	8.1818	180	1.2922	0.0994	1.2922	1.1368
No log	8.2727	182	1.4231	0.1147	1.4231	1.1929
No log	8.3636	184	1.3878	0.1198	1.3878	1.1781
No log	8.4545	186	1.3497	0.1251	1.3497	1.1618
No log	8.5455	188	1.4178	0.0993	1.4178	1.1907
No log	8.6364	190	1.4671	0.1368	1.4671	1.2112
No log	8.7273	192	1.4486	0.1368	1.4486	1.2036
No log	8.8182	194	1.3084	0.1422	1.3084	1.1439
No log	8.9091	196	1.2217	0.0923	1.2217	1.1053
No log	9.0	198	1.1101	-0.0103	1.1101	1.0536
No log	9.0909	200	1.0237	0.0313	1.0237	1.0118
No log	9.1818	202	1.0122	0.0566	1.0122	1.0061
No log	9.2727	204	1.1369	0.0660	1.1369	1.0663
No log	9.3636	206	1.2988	0.0611	1.2988	1.1397
No log	9.4545	208	1.4147	0.0994	1.4147	1.1894
No log	9.5455	210	1.4411	0.0327	1.4411	1.2004
No log	9.6364	212	1.3982	-0.0082	1.3982	1.1824
No log	9.7273	214	1.3734	0.0362	1.3734	1.1719
No log	9.8182	216	1.2593	0.0287	1.2593	1.1222
No log	9.9091	218	1.1962	-0.0210	1.1962	1.0937
No log	10.0	220	1.1554	-0.0769	1.1554	1.0749
No log	10.0909	222	1.1320	-0.0449	1.1320	1.0640
No log	10.1818	224	1.2629	0.0237	1.2629	1.1238
No log	10.2727	226	1.4122	0.0184	1.4122	1.1883
No log	10.3636	228	1.4121	0.0184	1.4121	1.1883
No log	10.4545	230	1.3873	0.0184	1.3873	1.1778
No log	10.5455	232	1.2986	-0.0545	1.2986	1.1396
No log	10.6364	234	1.2238	0.0021	1.2238	1.1062
No log	10.7273	236	1.2223	-0.0011	1.2223	1.1056
No log	10.8182	238	1.2223	0.0480	1.2223	1.1056
No log	10.9091	240	1.2812	0.0694	1.2812	1.1319
No log	11.0	242	1.2304	0.0741	1.2304	1.1092
No log	11.0909	244	1.1539	0.0741	1.1539	1.0742
No log	11.1818	246	1.1447	0.0276	1.1447	1.0699
No log	11.2727	248	1.1633	0.0510	1.1633	1.0786
No log	11.3636	250	1.1747	0.0510	1.1747	1.0838
No log	11.4545	252	1.2985	0.0660	1.2985	1.1395
No log	11.5455	254	1.5408	0.0447	1.5408	1.2413
No log	11.6364	256	1.6089	0.0664	1.6089	1.2684
No log	11.7273	258	1.4711	0.0784	1.4711	1.2129
No log	11.8182	260	1.2292	-0.0529	1.2292	1.1087
No log	11.9091	262	1.1645	-0.1385	1.1645	1.0791
No log	12.0	264	1.2012	-0.0761	1.2012	1.0960
No log	12.0909	266	1.2428	-0.0814	1.2428	1.1148
No log	12.1818	268	1.3337	-0.0846	1.3337	1.1549
No log	12.2727	270	1.4927	0.0310	1.4927	1.2217
No log	12.3636	272	1.4638	0.0766	1.4638	1.2099
No log	12.4545	274	1.3691	0.1042	1.3691	1.1701
No log	12.5455	276	1.3033	0.1067	1.3033	1.1416
No log	12.6364	278	1.1786	0.0717	1.1786	1.0856
No log	12.7273	280	1.1132	0.0866	1.1132	1.0551
No log	12.8182	282	1.1119	0.0894	1.1119	1.0545
No log	12.9091	284	1.1117	0.0922	1.1117	1.0544
No log	13.0	286	1.1656	0.0838	1.1656	1.0796
No log	13.0909	288	1.3011	0.1458	1.3011	1.1406
No log	13.1818	290	1.3654	0.1067	1.3654	1.1685
No log	13.2727	292	1.2293	0.1392	1.2293	1.1088
No log	13.3636	294	1.1073	0.1709	1.1073	1.0523
No log	13.4545	296	1.0276	0.1013	1.0276	1.0137
No log	13.5455	298	0.9681	0.1110	0.9681	0.9839
No log	13.6364	300	1.0350	0.1243	1.0350	1.0174
No log	13.7273	302	1.1748	0.1748	1.1748	1.0839
No log	13.8182	304	1.2423	0.1146	1.2423	1.1146
No log	13.9091	306	1.2563	0.1397	1.2563	1.1208
No log	14.0	308	1.3470	0.1367	1.3470	1.1606
No log	14.0909	310	1.4038	0.1042	1.4038	1.1848
No log	14.1818	312	1.4067	0.1196	1.4067	1.1861
No log	14.2727	314	1.2759	0.1772	1.2759	1.1296
No log	14.3636	316	1.0765	0.1356	1.0765	1.0376
No log	14.4545	318	1.0089	0.2323	1.0089	1.0044
No log	14.5455	320	0.9872	0.2389	0.9872	0.9936
No log	14.6364	322	1.1197	0.1293	1.1197	1.0582
No log	14.7273	324	1.3482	0.0826	1.3482	1.1611
No log	14.8182	326	1.5162	0.0307	1.5162	1.2313
No log	14.9091	328	1.6480	0.0042	1.6480	1.2837
No log	15.0	330	1.6327	-0.0182	1.6327	1.2778
No log	15.0909	332	1.6127	0.0486	1.6127	1.2699
No log	15.1818	334	1.5407	0.0860	1.5407	1.2413
No log	15.2727	336	1.3727	0.0968	1.3727	1.1716
No log	15.3636	338	1.2475	0.1094	1.2475	1.1169
No log	15.4545	340	1.1050	0.1086	1.1050	1.0512
No log	15.5455	342	0.9609	0.1984	0.9609	0.9803
No log	15.6364	344	0.9036	0.2547	0.9036	0.9506
No log	15.7273	346	1.0006	0.1955	1.0006	1.0003
No log	15.8182	348	1.1764	0.1490	1.1764	1.0846
No log	15.9091	350	1.4448	0.0758	1.4448	1.2020
No log	16.0	352	1.5511	0.0758	1.5511	1.2454
No log	16.0909	354	1.4351	0.0307	1.4351	1.1980
No log	16.1818	356	1.2607	0.0471	1.2607	1.1228
No log	16.2727	358	1.2106	0.0973	1.2106	1.1003
No log	16.3636	360	1.1831	0.0973	1.1831	1.0877
No log	16.4545	362	1.3353	0.0537	1.3353	1.1556
No log	16.5455	364	1.4244	0.0537	1.4244	1.1935
No log	16.6364	366	1.6469	0.0205	1.6469	1.2833
No log	16.7273	368	1.7614	0.0329	1.7614	1.3272
No log	16.8182	370	1.7940	0.0685	1.7940	1.3394
No log	16.9091	372	1.5111	0.0042	1.5111	1.2293
No log	17.0	374	1.3899	-0.0153	1.3899	1.1790
No log	17.0909	376	1.4657	-0.0412	1.4657	1.2107
No log	17.1818	378	1.6199	0.0235	1.6199	1.2728
No log	17.2727	380	1.5620	0.0736	1.5620	1.2498
No log	17.3636	382	1.3537	0.1017	1.3537	1.1635
No log	17.4545	384	1.2557	0.1067	1.2557	1.1206
No log	17.5455	386	1.1817	0.1397	1.1817	1.0871
No log	17.6364	388	1.2468	0.1042	1.2468	1.1166
No log	17.7273	390	1.2873	0.1280	1.2873	1.1346
No log	17.8182	392	1.4055	0.0758	1.4055	1.1855
No log	17.9091	394	1.4988	0.0493	1.4988	1.2243
No log	18.0	396	1.6641	0.0689	1.6641	1.2900
No log	18.0909	398	1.8020	0.0311	1.8020	1.3424
No log	18.1818	400	1.7861	0.0175	1.7861	1.3365
No log	18.2727	402	1.6078	0.0626	1.6078	1.2680
No log	18.3636	404	1.3781	0.0968	1.3781	1.1739
No log	18.4545	406	1.1832	0.1121	1.1832	1.0877
No log	18.5455	408	1.1380	0.1265	1.1380	1.0668
No log	18.6364	410	1.1476	0.1265	1.1476	1.0713
No log	18.7273	412	1.1346	0.1265	1.1346	1.0652
No log	18.8182	414	1.2326	0.1401	1.2326	1.1102
No log	18.9091	416	1.3475	0.0849	1.3475	1.1608
No log	19.0	418	1.3941	0.0849	1.3941	1.1807
No log	19.0909	420	1.4031	0.1093	1.4031	1.1845
No log	19.1818	422	1.2818	-0.0042	1.2818	1.1322
No log	19.2727	424	1.2008	0.0480	1.2008	1.0958
No log	19.3636	426	1.1279	0.0894	1.1279	1.0620
No log	19.4545	428	1.1097	0.1147	1.1097	1.0534
No log	19.5455	430	1.1162	0.1147	1.1162	1.0565
No log	19.6364	432	1.1781	0.1293	1.1781	1.0854
No log	19.7273	434	1.2070	0.1392	1.2070	1.0986
No log	19.8182	436	1.1992	0.1202	1.1992	1.0951
No log	19.9091	438	1.2531	0.0676	1.2531	1.1194
No log	20.0	440	1.3059	0.1147	1.3059	1.1428
No log	20.0909	442	1.3084	0.1147	1.3084	1.1438
No log	20.1818	444	1.3350	0.0852	1.3350	1.1554
No log	20.2727	446	1.4154	0.0577	1.4154	1.1897
No log	20.3636	448	1.3595	0.1093	1.3595	1.1660
No log	20.4545	450	1.2920	0.1305	1.2920	1.1367
No log	20.5455	452	1.2616	0.1093	1.2616	1.1232
No log	20.6364	454	1.2556	0.1305	1.2556	1.1205
No log	20.7273	456	1.2412	0.1093	1.2412	1.1141
No log	20.8182	458	1.2226	0.1397	1.2226	1.1057
No log	20.9091	460	1.1725	0.1458	1.1725	1.0828
No log	21.0	462	1.1354	0.1360	1.1354	1.0655
No log	21.0909	464	1.1296	0.1557	1.1296	1.0628
No log	21.1818	466	1.1985	0.1262	1.1985	1.0947
No log	21.2727	468	1.2917	0.1646	1.2917	1.1365
No log	21.3636	470	1.3963	0.1550	1.3963	1.1817
No log	21.4545	472	1.3376	0.1367	1.3376	1.1565
No log	21.5455	474	1.3140	0.1367	1.3140	1.1463
No log	21.6364	476	1.2722	0.1679	1.2722	1.1279
No log	21.7273	478	1.2643	0.1613	1.2643	1.1244
No log	21.8182	480	1.2145	0.1895	1.2145	1.1020
No log	21.9091	482	1.0926	0.1976	1.0926	1.0453
No log	22.0	484	1.0011	0.2287	1.0011	1.0006
No log	22.0909	486	1.0252	0.1603	1.0252	1.0125
No log	22.1818	488	1.1508	0.2348	1.1508	1.0727
No log	22.2727	490	1.3292	0.1717	1.3292	1.1529
No log	22.3636	492	1.3901	0.1395	1.3901	1.1790
No log	22.4545	494	1.2539	0.1147	1.2539	1.1198
No log	22.5455	496	1.0705	0.1827	1.0705	1.0346
No log	22.6364	498	0.9976	0.1777	0.9976	0.9988
0.2768	22.7273	500	1.0768	0.1499	1.0768	1.0377
0.2768	22.8182	502	1.2034	0.1147	1.2034	1.0970
0.2768	22.9091	504	1.3450	0.1253	1.3450	1.1598
0.2768	23.0	506	1.3468	0.1253	1.3468	1.1605
0.2768	23.0909	508	1.3140	0.1253	1.3140	1.1463
0.2768	23.1818	510	1.2554	0.1120	1.2554	1.1204

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1