ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k9_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3001
• Qwk: 0.0766
• Mse: 1.3001
• Rmse: 1.1402

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	2.7494	0.0761	2.7494	1.6581
No log	0.1818	4	1.7283	-0.1199	1.7283	1.3147
No log	0.2727	6	1.6211	-0.2977	1.6211	1.2732
No log	0.3636	8	1.5290	-0.2129	1.5290	1.2365
No log	0.4545	10	1.6487	-0.4348	1.6487	1.2840
No log	0.5455	12	1.5285	-0.4601	1.5285	1.2363
No log	0.6364	14	1.4101	-0.3765	1.4101	1.1875
No log	0.7273	16	1.1772	0.0623	1.1772	1.0850
No log	0.8182	18	0.8844	0.1777	0.8844	0.9404
No log	0.9091	20	0.7280	0.2449	0.7280	0.8532
No log	1.0	22	0.7509	0.3173	0.7509	0.8665
No log	1.0909	24	0.6567	0.2522	0.6567	0.8104
No log	1.1818	26	0.7445	0.2007	0.7445	0.8628
No log	1.2727	28	0.9096	0.0573	0.9096	0.9537
No log	1.3636	30	0.9108	-0.0500	0.9108	0.9544
No log	1.4545	32	0.8777	-0.0500	0.8777	0.9368
No log	1.5455	34	0.8498	0.0717	0.8498	0.9218
No log	1.6364	36	0.9051	0.2012	0.9051	0.9514
No log	1.7273	38	0.9115	0.1914	0.9115	0.9547
No log	1.8182	40	0.8761	0.1359	0.8761	0.9360
No log	1.9091	42	0.8180	-0.0027	0.8180	0.9045
No log	2.0	44	0.7614	0.0	0.7614	0.8726
No log	2.0909	46	0.7229	0.0	0.7229	0.8502
No log	2.1818	48	0.7271	0.1786	0.7271	0.8527
No log	2.2727	50	0.7149	0.2142	0.7149	0.8455
No log	2.3636	52	0.7073	0.1699	0.7073	0.8410
No log	2.4545	54	0.9125	0.2810	0.9125	0.9552
No log	2.5455	56	1.0816	-0.0047	1.0816	1.0400
No log	2.6364	58	1.1241	-0.0382	1.1241	1.0603
No log	2.7273	60	1.1968	-0.0449	1.1968	1.0940
No log	2.8182	62	1.1816	-0.0744	1.1816	1.0870
No log	2.9091	64	1.1364	-0.0336	1.1364	1.0660
No log	3.0	66	1.1755	-0.0963	1.1755	1.0842
No log	3.0909	68	1.2048	-0.0870	1.2048	1.0976
No log	3.1818	70	1.1442	0.0448	1.1442	1.0697
No log	3.2727	72	1.1629	-0.0216	1.1629	1.0784
No log	3.3636	74	1.2910	0.1341	1.2910	1.1362
No log	3.4545	76	1.1987	0.1621	1.1987	1.0949
No log	3.5455	78	1.0201	0.2141	1.0201	1.0100
No log	3.6364	80	0.8514	0.1718	0.8514	0.9227
No log	3.7273	82	0.9388	-0.1170	0.9388	0.9689
No log	3.8182	84	1.2028	-0.2298	1.2028	1.0967
No log	3.9091	86	1.2205	-0.2760	1.2205	1.1047
No log	4.0	88	1.1116	-0.2167	1.1116	1.0543
No log	4.0909	90	1.0714	0.0513	1.0714	1.0351
No log	4.1818	92	1.1577	0.1394	1.1577	1.0760
No log	4.2727	94	1.3597	0.1621	1.3597	1.1661
No log	4.3636	96	1.5099	0.1200	1.5099	1.2288
No log	4.4545	98	1.5212	0.0736	1.5212	1.2334
No log	4.5455	100	1.3727	0.0557	1.3727	1.1716
No log	4.6364	102	1.2072	0.0736	1.2072	1.0987
No log	4.7273	104	1.1340	-0.0703	1.1340	1.0649
No log	4.8182	106	1.1183	0.0405	1.1183	1.0575
No log	4.9091	108	1.1296	0.2000	1.1296	1.0628
No log	5.0	110	1.1817	0.2141	1.1817	1.0871
No log	5.0909	112	1.1927	0.2045	1.1927	1.0921
No log	5.1818	114	1.0936	0.2392	1.0936	1.0457
No log	5.2727	116	1.1196	0.1935	1.1196	1.0581
No log	5.3636	118	1.1656	0.2032	1.1656	1.0796
No log	5.4545	120	1.2094	0.0553	1.2094	1.0997
No log	5.5455	122	1.1308	0.1277	1.1308	1.0634
No log	5.6364	124	1.1378	0.1086	1.1378	1.0667
No log	5.7273	126	1.1728	0.1530	1.1728	1.0830
No log	5.8182	128	1.2614	0.1120	1.2614	1.1231
No log	5.9091	130	1.3745	0.0948	1.3745	1.1724
No log	6.0	132	1.2651	0.0975	1.2651	1.1248
No log	6.0909	134	1.4311	0.1479	1.4311	1.1963
No log	6.1818	136	1.6462	0.0990	1.6462	1.2831
No log	6.2727	138	1.7929	0.1289	1.7929	1.3390
No log	6.3636	140	1.7328	0.1695	1.7328	1.3164
No log	6.4545	142	1.4171	0.0745	1.4171	1.1904
No log	6.5455	144	1.1528	0.2059	1.1528	1.0737
No log	6.6364	146	0.9464	0.3294	0.9464	0.9728
No log	6.7273	148	0.8959	0.3169	0.8959	0.9465
No log	6.8182	150	0.9153	0.3425	0.9153	0.9567
No log	6.9091	152	1.0224	0.2601	1.0224	1.0111
No log	7.0	154	1.0550	0.2601	1.0550	1.0271
No log	7.0909	156	0.9665	0.3294	0.9665	0.9831
No log	7.1818	158	0.9940	0.2105	0.9940	0.9970
No log	7.2727	160	1.1529	0.1896	1.1529	1.0737
No log	7.3636	162	1.3341	0.1093	1.3341	1.1550
No log	7.4545	164	1.4984	0.0055	1.4984	1.2241
No log	7.5455	166	1.4011	0.0570	1.4011	1.1837
No log	7.6364	168	1.1385	0.1591	1.1385	1.0670
No log	7.7273	170	1.0604	0.2323	1.0604	1.0297
No log	7.8182	172	1.0948	0.2278	1.0948	1.0463
No log	7.9091	174	1.0645	0.2278	1.0645	1.0318
No log	8.0	176	1.0284	0.2651	1.0284	1.0141
No log	8.0909	178	1.0563	0.2086	1.0563	1.0278
No log	8.1818	180	1.1959	0.1146	1.1959	1.0936
No log	8.2727	182	1.4195	0.0293	1.4195	1.1914
No log	8.3636	184	1.4573	0.0054	1.4573	1.2072
No log	8.4545	186	1.3217	0.0570	1.3217	1.1496
No log	8.5455	188	1.1753	0.1671	1.1753	1.0841
No log	8.6364	190	1.2249	0.1392	1.2249	1.1067
No log	8.7273	192	1.3701	0.0570	1.3701	1.1705
No log	8.8182	194	1.6773	0.0632	1.6773	1.2951
No log	8.9091	196	1.8189	0.0719	1.8189	1.3487
No log	9.0	198	1.6964	0.0842	1.6964	1.3025
No log	9.0909	200	1.4296	0.0806	1.4296	1.1956
No log	9.1818	202	1.2814	0.1453	1.2814	1.1320
No log	9.2727	204	1.2658	0.0746	1.2658	1.1251
No log	9.3636	206	1.3701	0.0829	1.3701	1.1705
No log	9.4545	208	1.4182	0.0531	1.4182	1.1909
No log	9.5455	210	1.4962	0.0493	1.4962	1.2232
No log	9.6364	212	1.5903	0.0664	1.5903	1.2611
No log	9.7273	214	1.4762	0.0475	1.4762	1.2150
No log	9.8182	216	1.3171	0.1121	1.3171	1.1477
No log	9.9091	218	1.1493	0.1497	1.1493	1.0720
No log	10.0	220	1.0590	0.2141	1.0590	1.0291
No log	10.0909	222	0.9487	0.2995	0.9487	0.9740
No log	10.1818	224	0.9971	0.3170	0.9971	0.9986
No log	10.2727	226	0.9974	0.2939	0.9974	0.9987
No log	10.3636	228	1.0539	0.2392	1.0539	1.0266
No log	10.4545	230	1.1042	0.1490	1.1042	1.0508
No log	10.5455	232	1.2232	0.1363	1.2232	1.1060
No log	10.6364	234	1.2338	0.1363	1.2338	1.1108
No log	10.7273	236	1.1849	0.1427	1.1849	1.0885
No log	10.8182	238	1.0787	0.1784	1.0787	1.0386
No log	10.9091	240	1.0813	0.2141	1.0813	1.0398
No log	11.0	242	1.0887	0.2306	1.0887	1.0434
No log	11.0909	244	0.9250	0.3516	0.9250	0.9618
No log	11.1818	246	0.8000	0.3972	0.8000	0.8944
No log	11.2727	248	0.8085	0.3712	0.8085	0.8992
No log	11.3636	250	0.9372	0.3347	0.9372	0.9681
No log	11.4545	252	1.1135	0.1599	1.1135	1.0552
No log	11.5455	254	1.1907	0.1599	1.1907	1.0912
No log	11.6364	256	1.2079	0.1422	1.2079	1.0990
No log	11.7273	258	1.1042	0.1993	1.1042	1.0508
No log	11.8182	260	1.0691	0.1699	1.0691	1.0340
No log	11.9091	262	1.1401	0.1591	1.1401	1.0677
No log	12.0	264	1.2329	0.1146	1.2329	1.1103
No log	12.0909	266	1.3505	0.0591	1.3505	1.1621
No log	12.1818	268	1.4194	0.0300	1.4194	1.1914
No log	12.2727	270	1.3718	0.0627	1.3718	1.1712
No log	12.3636	272	1.2856	0.0898	1.2856	1.1338
No log	12.4545	274	1.3107	0.0852	1.3107	1.1448
No log	12.5455	276	1.2669	0.0995	1.2669	1.1256
No log	12.6364	278	1.1473	0.1784	1.1473	1.0711
No log	12.7273	280	1.1866	0.1599	1.1866	1.0893
No log	12.8182	282	1.1424	0.1873	1.1424	1.0688
No log	12.9091	284	1.0103	0.2730	1.0103	1.0051
No log	13.0	286	1.0348	0.2437	1.0348	1.0173
No log	13.0909	288	1.1503	0.1704	1.1503	1.0725
No log	13.1818	290	1.3693	0.0728	1.3693	1.1702
No log	13.2727	292	1.4371	0.0728	1.4371	1.1988
No log	13.3636	294	1.5419	0.0637	1.5419	1.2417
No log	13.4545	296	1.6514	0.0948	1.6514	1.2851
No log	13.5455	298	1.5160	0.0493	1.5160	1.2312
No log	13.6364	300	1.2508	0.1205	1.2508	1.1184
No log	13.7273	302	1.0832	0.2141	1.0832	1.0408
No log	13.8182	304	1.0939	0.1832	1.0939	1.0459
No log	13.9091	306	1.1799	0.1497	1.1799	1.0862
No log	14.0	308	1.2442	0.1148	1.2442	1.1155
No log	14.0909	310	1.3234	0.1148	1.3234	1.1504
No log	14.1818	312	1.2760	0.1148	1.2760	1.1296
No log	14.2727	314	1.1740	0.1795	1.1740	1.0835
No log	14.3636	316	1.0644	0.2782	1.0644	1.0317
No log	14.4545	318	1.0476	0.2601	1.0476	1.0235
No log	14.5455	320	1.1283	0.1832	1.1283	1.0622
No log	14.6364	322	1.2493	0.0611	1.2493	1.1177
No log	14.7273	324	1.3754	0.0027	1.3754	1.1728
No log	14.8182	326	1.3807	0.0715	1.3807	1.1750
No log	14.9091	328	1.2441	0.0870	1.2441	1.1154
No log	15.0	330	1.0774	0.1530	1.0774	1.0380
No log	15.0909	332	0.9907	0.2703	0.9907	0.9953
No log	15.1818	334	0.9502	0.2615	0.9502	0.9748
No log	15.2727	336	0.9830	0.2164	0.9830	0.9914
No log	15.3636	338	1.0659	0.2552	1.0659	1.0324
No log	15.4545	340	1.1463	0.1530	1.1463	1.0707
No log	15.5455	342	1.1128	0.1832	1.1128	1.0549
No log	15.6364	344	1.0720	0.2141	1.0720	1.0354
No log	15.7273	346	1.1263	0.1832	1.1263	1.0613
No log	15.8182	348	1.1593	0.1530	1.1593	1.0767
No log	15.9091	350	1.1074	0.1116	1.1074	1.0523
No log	16.0	352	1.0500	0.1787	1.0500	1.0247
No log	16.0909	354	1.0366	0.1573	1.0366	1.0181
No log	16.1818	356	1.1347	0.1870	1.1347	1.0652
No log	16.2727	358	1.2650	0.1175	1.2650	1.1247
No log	16.3636	360	1.3396	0.0605	1.3396	1.1574
No log	16.4545	362	1.2932	0.0873	1.2932	1.1372
No log	16.5455	364	1.2261	0.1795	1.2261	1.1073
No log	16.6364	366	1.1565	0.1795	1.1565	1.0754
No log	16.7273	368	1.1256	0.1832	1.1256	1.0609
No log	16.8182	370	1.2098	0.1427	1.2098	1.0999
No log	16.9091	372	1.3658	0.0806	1.3658	1.1687
No log	17.0	374	1.4407	0.0948	1.4407	1.2003
No log	17.0909	376	1.5045	0.0669	1.5045	1.2266
No log	17.1818	378	1.3347	0.0806	1.3347	1.1553
No log	17.2727	380	1.0597	0.2183	1.0597	1.0294
No log	17.3636	382	1.0221	0.2183	1.0221	1.0110
No log	17.4545	384	1.0769	0.2183	1.0769	1.0377
No log	17.5455	386	1.2035	0.1401	1.2035	1.0970
No log	17.6364	388	1.2084	0.1371	1.2084	1.0993
No log	17.7273	390	1.1152	0.2282	1.1152	1.0560
No log	17.8182	392	0.9951	0.2782	0.9951	0.9975
No log	17.9091	394	0.8459	0.3991	0.8459	0.9197
No log	18.0	396	0.7750	0.3387	0.7750	0.8803
No log	18.0909	398	0.7714	0.3673	0.7714	0.8783
No log	18.1818	400	0.8248	0.4067	0.8248	0.9082
No log	18.2727	402	0.9589	0.2504	0.9589	0.9792
No log	18.3636	404	1.1727	0.1401	1.1727	1.0829
No log	18.4545	406	1.3140	0.1094	1.3140	1.1463
No log	18.5455	408	1.3300	0.1067	1.3300	1.1533
No log	18.6364	410	1.3236	0.1121	1.3236	1.1505
No log	18.7273	412	1.2350	0.1205	1.2350	1.1113
No log	18.8182	414	1.1126	0.2100	1.1126	1.0548
No log	18.9091	416	1.0774	0.2271	1.0774	1.0380
No log	19.0	418	1.0834	0.1116	1.0834	1.0409
No log	19.0909	420	1.1018	0.1147	1.1018	1.0496
No log	19.1818	422	1.2065	0.1530	1.2065	1.0984
No log	19.2727	424	1.4043	0.0283	1.4043	1.1851
No log	19.3636	426	1.5391	0.0027	1.5391	1.2406
No log	19.4545	428	1.5296	0.0027	1.5296	1.2368
No log	19.5455	430	1.4630	0.0027	1.4630	1.2096
No log	19.6364	432	1.3479	0.0544	1.3479	1.1610
No log	19.7273	434	1.2016	0.1205	1.2016	1.0962
No log	19.8182	436	1.1239	0.2227	1.1239	1.0602
No log	19.9091	438	1.1266	0.2552	1.1266	1.0614
No log	20.0	440	1.1907	0.1497	1.1907	1.0912
No log	20.0909	442	1.3201	0.0283	1.3201	1.1489
No log	20.1818	444	1.3934	0.0267	1.3934	1.1804
No log	20.2727	446	1.3605	0.0267	1.3605	1.1664
No log	20.3636	448	1.2566	0.1093	1.2566	1.1210
No log	20.4545	450	1.2544	0.0829	1.2544	1.1200
No log	20.5455	452	1.2554	0.0873	1.2554	1.1205
No log	20.6364	454	1.2274	0.0973	1.2274	1.1079
No log	20.7273	456	1.1965	0.0973	1.1965	1.0938
No log	20.8182	458	1.2096	0.0973	1.2096	1.0998
No log	20.9091	460	1.1750	0.1328	1.1750	1.0840
No log	21.0	462	1.1349	0.1635	1.1349	1.0653
No log	21.0909	464	1.1322	0.1635	1.1322	1.0640
No log	21.1818	466	1.1055	0.1671	1.1055	1.0514
No log	21.2727	468	1.1318	0.1360	1.1318	1.0639
No log	21.3636	470	1.2224	0.1001	1.2224	1.1056
No log	21.4545	472	1.3327	0.0822	1.3327	1.1544
No log	21.5455	474	1.3945	0.0754	1.3945	1.1809
No log	21.6364	476	1.3734	0.0776	1.3734	1.1719
No log	21.7273	478	1.2528	0.1205	1.2528	1.1193
No log	21.8182	480	1.1016	0.1949	1.1016	1.0496
No log	21.9091	482	1.0359	0.3051	1.0359	1.0178
No log	22.0	484	1.0321	0.3110	1.0321	1.0159
No log	22.0909	486	1.1003	0.2271	1.1003	1.0490
No log	22.1818	488	1.1728	0.1599	1.1728	1.0830
No log	22.2727	490	1.2849	0.1367	1.2849	1.1335
No log	22.3636	492	1.3351	0.1018	1.3351	1.1555
No log	22.4545	494	1.3587	0.0766	1.3587	1.1656
No log	22.5455	496	1.2877	0.1018	1.2877	1.1348
No log	22.6364	498	1.1274	0.1497	1.1274	1.0618
0.3383	22.7273	500	1.0010	0.3051	1.0010	1.0005
0.3383	22.8182	502	0.9378	0.3105	0.9378	0.9684
0.3383	22.9091	504	0.9557	0.2866	0.9557	0.9776
0.3383	23.0	506	1.0203	0.2651	1.0203	1.0101
0.3383	23.0909	508	1.1389	0.2006	1.1389	1.0672
0.3383	23.1818	510	1.2558	0.1018	1.2558	1.1206
0.3383	23.2727	512	1.3001	0.0766	1.3001	1.1402

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1