ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k18_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5233
• Qwk: 0.0413
• Mse: 1.5233
• Rmse: 1.2342

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	2.6285	-0.0407	2.6285	1.6213
No log	0.0930	4	1.3633	0.0745	1.3633	1.1676
No log	0.1395	6	1.1048	-0.1355	1.1048	1.0511
No log	0.1860	8	1.0158	0.0826	1.0158	1.0079
No log	0.2326	10	1.0283	0.1584	1.0283	1.0140
No log	0.2791	12	0.9754	0.0888	0.9754	0.9876
No log	0.3256	14	0.9090	0.0359	0.9090	0.9534
No log	0.3721	16	0.9072	0.0	0.9072	0.9525
No log	0.4186	18	0.8771	0.0	0.8771	0.9365
No log	0.4651	20	0.8262	0.0	0.8262	0.9090
No log	0.5116	22	0.7842	0.0	0.7842	0.8856
No log	0.5581	24	0.7594	0.0	0.7594	0.8714
No log	0.6047	26	0.6931	0.1617	0.6931	0.8325
No log	0.6512	28	0.7831	0.1699	0.7831	0.8849
No log	0.6977	30	0.8161	0.0573	0.8161	0.9034
No log	0.7442	32	0.7901	0.0208	0.7901	0.8889
No log	0.7907	34	0.7525	0.2652	0.7525	0.8675
No log	0.8372	36	0.7478	0.2027	0.7478	0.8648
No log	0.8837	38	0.7608	0.1359	0.7608	0.8723
No log	0.9302	40	0.7575	0.0643	0.7575	0.8703
No log	0.9767	42	0.7585	0.0840	0.7585	0.8709
No log	1.0233	44	0.7843	0.0	0.7843	0.8856
No log	1.0698	46	0.7821	0.0481	0.7821	0.8844
No log	1.1163	48	0.7659	0.1287	0.7659	0.8751
No log	1.1628	50	0.7468	0.1094	0.7468	0.8642
No log	1.2093	52	0.7781	0.1918	0.7781	0.8821
No log	1.2558	54	0.8128	0.3099	0.8128	0.9015
No log	1.3023	56	0.8234	0.3746	0.8234	0.9074
No log	1.3488	58	0.8361	0.3473	0.8361	0.9144
No log	1.3953	60	0.9360	0.2460	0.9360	0.9675
No log	1.4419	62	0.9949	0.1909	0.9949	0.9975
No log	1.4884	64	1.0230	0.2141	1.0230	1.0114
No log	1.5349	66	0.9934	0.3170	0.9934	0.9967
No log	1.5814	68	0.9049	0.2995	0.9049	0.9513
No log	1.6279	70	0.8477	0.2866	0.8477	0.9207
No log	1.6744	72	0.8171	0.2904	0.8171	0.9040
No log	1.7209	74	0.7811	0.2227	0.7811	0.8838
No log	1.7674	76	0.7629	0.2171	0.7629	0.8734
No log	1.8140	78	0.8267	0.2297	0.8267	0.9092
No log	1.8605	80	0.9433	0.2046	0.9433	0.9712
No log	1.9070	82	1.0377	0.1747	1.0377	1.0187
No log	1.9535	84	1.0808	0.1909	1.0808	1.0396
No log	2.0	86	1.0458	0.2601	1.0458	1.0226
No log	2.0465	88	1.0289	0.2886	1.0289	1.0143
No log	2.0930	90	1.1032	0.2504	1.1032	1.0503
No log	2.1395	92	1.2014	0.1758	1.2014	1.0961
No log	2.1860	94	1.1184	-0.0352	1.1184	1.0576
No log	2.2326	96	1.0794	0.0105	1.0794	1.0389
No log	2.2791	98	1.1007	0.1243	1.1007	1.0492
No log	2.3256	100	1.1319	0.2504	1.1319	1.0639
No log	2.3721	102	1.1574	0.1832	1.1574	1.0758
No log	2.4186	104	1.0962	0.2651	1.0962	1.0470
No log	2.4651	106	1.0332	0.2308	1.0332	1.0164
No log	2.5116	108	0.9631	0.1672	0.9631	0.9814
No log	2.5581	110	0.9540	0.1254	0.9540	0.9767
No log	2.6047	112	1.0091	0.1013	1.0091	1.0045
No log	2.6512	114	1.1813	0.1116	1.1813	1.0869
No log	2.6977	116	1.3674	0.0417	1.3674	1.1694
No log	2.7442	118	1.4978	-0.0570	1.4978	1.2238
No log	2.7907	120	1.5624	-0.0586	1.5624	1.2500
No log	2.8372	122	1.6008	-0.0602	1.6008	1.2652
No log	2.8837	124	1.6810	-0.1050	1.6810	1.2965
No log	2.9302	126	1.6763	0.0948	1.6763	1.2947
No log	2.9767	128	1.5824	0.0842	1.5824	1.2579
No log	3.0233	130	1.4754	0.0293	1.4754	1.2147
No log	3.0698	132	1.1926	-0.0116	1.1926	1.0921
No log	3.1163	134	1.1144	0.0283	1.1144	1.0556
No log	3.1628	136	1.0478	0.0652	1.0478	1.0236
No log	3.2093	138	1.0360	0.2094	1.0360	1.0178
No log	3.2558	140	1.1790	0.1557	1.1790	1.0858
No log	3.3023	142	1.2533	0.1401	1.2533	1.1195
No log	3.3488	144	1.1797	0.2324	1.1797	1.0862
No log	3.3953	146	1.0882	0.2457	1.0882	1.0432
No log	3.4419	148	1.0265	0.1955	1.0265	1.0132
No log	3.4884	150	1.0777	0.1955	1.0777	1.0381
No log	3.5349	152	1.1513	0.1671	1.1513	1.0730
No log	3.5814	154	1.2964	0.1176	1.2964	1.1386
No log	3.6279	156	1.3398	0.0486	1.3398	1.1575
No log	3.6744	158	1.2677	0.1283	1.2677	1.1259
No log	3.7209	160	1.2315	0.1588	1.2315	1.1097
No log	3.7674	162	1.0951	0.2903	1.0951	1.0465
No log	3.8140	164	1.1141	0.2903	1.1141	1.0555
No log	3.8605	166	1.1894	0.2579	1.1894	1.0906
No log	3.9070	168	1.1853	0.1985	1.1853	1.0887
No log	3.9535	170	1.1970	0.2258	1.1970	1.0941
No log	4.0	172	1.1435	0.1795	1.1435	1.0693
No log	4.0465	174	1.2041	0.1606	1.2041	1.0973
No log	4.0930	176	1.3574	0.2053	1.3574	1.1651
No log	4.1395	178	1.5924	0.1030	1.5924	1.2619
No log	4.1860	180	1.5334	0.0736	1.5334	1.2383
No log	4.2326	182	1.4965	0.0923	1.4965	1.2233
No log	4.2791	184	1.3392	0.1917	1.3392	1.1572
No log	4.3256	186	1.1332	0.2059	1.1332	1.0645
No log	4.3721	188	1.0355	0.2651	1.0355	1.0176
No log	4.4186	190	1.0550	0.2651	1.0550	1.0272
No log	4.4651	192	1.1351	0.2020	1.1351	1.0654
No log	4.5116	194	1.2097	0.1067	1.2097	1.0999
No log	4.5581	196	1.2084	0.1312	1.2084	1.0993
No log	4.6047	198	1.1512	0.1654	1.1512	1.0729
No log	4.6512	200	1.1183	0.1646	1.1183	1.0575
No log	4.6977	202	1.0858	0.2567	1.0858	1.0420
No log	4.7442	204	1.0192	0.3193	1.0192	1.0096
No log	4.7907	206	0.9724	0.2697	0.9724	0.9861
No log	4.8372	208	0.9297	0.3302	0.9297	0.9642
No log	4.8837	210	0.9688	0.2756	0.9688	0.9843
No log	4.9302	212	1.0786	0.1944	1.0786	1.0385
No log	4.9767	214	1.1819	0.1836	1.1819	1.0872
No log	5.0233	216	1.1796	0.1836	1.1796	1.0861
No log	5.0698	218	1.1633	0.1871	1.1633	1.0786
No log	5.1163	220	1.1703	0.2579	1.1703	1.0818
No log	5.1628	222	1.1394	0.2799	1.1394	1.0674
No log	5.2093	224	1.2338	0.1641	1.2338	1.1108
No log	5.2558	226	1.3103	0.1611	1.3103	1.1447
No log	5.3023	228	1.3958	0.1364	1.3958	1.1814
No log	5.3488	230	1.4060	0.1522	1.4060	1.1858
No log	5.3953	232	1.3775	0.1122	1.3775	1.1737
No log	5.4419	234	1.1768	0.1939	1.1768	1.0848
No log	5.4884	236	1.0043	0.3395	1.0043	1.0021
No log	5.5349	238	0.9719	0.3347	0.9719	0.9858
No log	5.5814	240	1.0463	0.2459	1.0463	1.0229
No log	5.6279	242	1.1802	0.2008	1.1802	1.0864
No log	5.6744	244	1.1928	0.2079	1.1928	1.0921
No log	5.7209	246	1.0588	0.2288	1.0588	1.0290
No log	5.7674	248	0.9241	0.2632	0.9241	0.9613
No log	5.8140	250	0.9964	0.1815	0.9964	0.9982
No log	5.8605	252	1.0910	0.2125	1.0910	1.0445
No log	5.9070	254	1.1545	0.1919	1.1545	1.0745
No log	5.9535	256	1.1583	0.1748	1.1583	1.0762
No log	6.0	258	1.2332	0.1119	1.2332	1.1105
No log	6.0465	260	1.2979	0.0728	1.2979	1.1393
No log	6.0930	262	1.4225	0.1075	1.4225	1.1927
No log	6.1395	264	1.5497	0.0929	1.5497	1.2449
No log	6.1860	266	1.5252	0.0752	1.5252	1.2350
No log	6.2326	268	1.5816	0.0752	1.5816	1.2576
No log	6.2791	270	1.5094	0.0637	1.5094	1.2286
No log	6.3256	272	1.3820	-0.0343	1.3820	1.1756
No log	6.3721	274	1.3788	-0.0343	1.3788	1.1742
No log	6.4186	276	1.4741	0.0421	1.4741	1.2141
No log	6.4651	278	1.5171	0.0595	1.5171	1.2317
No log	6.5116	280	1.5019	0.0413	1.5019	1.2255
No log	6.5581	282	1.3582	0.0505	1.3582	1.1654
No log	6.6047	284	1.2748	0.0780	1.2748	1.1291
No log	6.6512	286	1.2376	0.0409	1.2376	1.1125
No log	6.6977	288	1.3029	0.0171	1.3029	1.1414
No log	6.7442	290	1.4803	0.0277	1.4803	1.2167
No log	6.7907	292	1.6517	-0.0232	1.6517	1.2852
No log	6.8372	294	1.6966	0.0168	1.6966	1.3025
No log	6.8837	296	1.4238	0.0430	1.4238	1.1932
No log	6.9302	298	1.2453	0.1895	1.2453	1.1159
No log	6.9767	300	1.2021	0.1490	1.2021	1.0964
No log	7.0233	302	1.1819	0.1458	1.1819	1.0871
No log	7.0698	304	1.2439	0.0806	1.2439	1.1153
No log	7.1163	306	1.4454	0.0	1.4454	1.2023
No log	7.1628	308	1.5979	0.0465	1.5979	1.2641
No log	7.2093	310	1.4895	0.0317	1.4895	1.2205
No log	7.2558	312	1.2930	0.0694	1.2930	1.1371
No log	7.3023	314	1.2476	0.0717	1.2476	1.1169
No log	7.3488	316	1.2078	0.0459	1.2078	1.0990
No log	7.3953	318	1.2465	0.0627	1.2465	1.1165
No log	7.4419	320	1.3040	0.0551	1.3040	1.1419
No log	7.4884	322	1.2683	0.0849	1.2683	1.1262
No log	7.5349	324	1.3191	0.0605	1.3191	1.1485
No log	7.5814	326	1.2728	0.0648	1.2728	1.1282
No log	7.6279	328	1.2466	0.0648	1.2466	1.1165
No log	7.6744	330	1.3795	0.0307	1.3795	1.1745
No log	7.7209	332	1.3861	0.0923	1.3861	1.1773
No log	7.7674	334	1.3356	0.0923	1.3356	1.1557
No log	7.8140	336	1.3042	0.1226	1.3042	1.1420
No log	7.8605	338	1.3368	0.0968	1.3368	1.1562
No log	7.9070	340	1.2989	0.1042	1.2989	1.1397
No log	7.9535	342	1.3336	0.0343	1.3336	1.1548
No log	8.0	344	1.4576	0.0267	1.4576	1.2073
No log	8.0465	346	1.4739	-0.0186	1.4739	1.2140
No log	8.0930	348	1.5301	-0.0013	1.5301	1.2370
No log	8.1395	350	1.6422	0.0522	1.6422	1.2815
No log	8.1860	352	1.5332	0.0948	1.5332	1.2382
No log	8.2326	354	1.3194	0.0483	1.3194	1.1487
No log	8.2791	356	1.0953	0.2504	1.0953	1.0466
No log	8.3256	358	1.0146	0.3231	1.0146	1.0073
No log	8.3721	360	1.0959	0.2437	1.0959	1.0469
No log	8.4186	362	1.3103	0.0780	1.3103	1.1447
No log	8.4651	364	1.6191	-0.0209	1.6191	1.2724
No log	8.5116	366	1.8451	0.0497	1.8451	1.3583
No log	8.5581	368	1.7926	0.0329	1.7926	1.3389
No log	8.6047	370	1.5383	0.0027	1.5383	1.2403
No log	8.6512	372	1.3239	0.0055	1.3239	1.1506
No log	8.6977	374	1.3077	0.0512	1.3077	1.1435
No log	8.7442	376	1.4575	0.0438	1.4575	1.2073
No log	8.7907	378	1.6838	-0.0049	1.6838	1.2976
No log	8.8372	380	1.8800	0.0315	1.8800	1.3711
No log	8.8837	382	1.9179	0.0138	1.9179	1.3849
No log	8.9302	384	1.8001	0.0685	1.8001	1.3417
No log	8.9767	386	1.6504	0.0013	1.6504	1.2847
No log	9.0233	388	1.6754	-0.0025	1.6754	1.2944
No log	9.0698	390	1.6346	-0.0049	1.6346	1.2785
No log	9.1163	392	1.5265	0.0220	1.5265	1.2355
No log	9.1628	394	1.3024	0.0992	1.3024	1.1412
No log	9.2093	396	1.2319	0.1280	1.2319	1.1099
No log	9.2558	398	1.3073	0.0969	1.3073	1.1434
No log	9.3023	400	1.5353	-0.0025	1.5353	1.2391
No log	9.3488	402	1.6950	-0.0247	1.6950	1.3019
No log	9.3953	404	1.6535	-0.0247	1.6535	1.2859
No log	9.4419	406	1.7145	-0.0247	1.7145	1.3094
No log	9.4884	408	1.6421	-0.0236	1.6421	1.2814
No log	9.5349	410	1.4785	0.0220	1.4785	1.2159
No log	9.5814	412	1.5043	0.0220	1.5043	1.2265
No log	9.6279	414	1.6888	-0.0236	1.6888	1.2995
No log	9.6744	416	1.8625	-0.0049	1.8625	1.3648
No log	9.7209	418	1.9340	0.0138	1.9340	1.3907
No log	9.7674	420	1.8531	-0.0049	1.8531	1.3613
No log	9.8140	422	1.7146	0.0182	1.7146	1.3094
No log	9.8605	424	1.7476	-0.0247	1.7476	1.3220
No log	9.9070	426	1.9025	0.0295	1.9025	1.3793
No log	9.9535	428	2.1452	0.0790	2.1452	1.4647
No log	10.0	430	2.2171	0.0839	2.2171	1.4890
No log	10.0465	432	2.0451	0.0656	2.0451	1.4301
No log	10.0930	434	1.7166	0.0566	1.7166	1.3102
No log	10.1395	436	1.3882	0.0720	1.3882	1.1782
No log	10.1860	438	1.2786	0.1017	1.2786	1.1307
No log	10.2326	440	1.3666	0.0699	1.3666	1.1690
No log	10.2791	442	1.5380	0.0215	1.5380	1.2401
No log	10.3256	444	1.7362	0.0389	1.7362	1.3176
No log	10.3721	446	1.8615	-0.0049	1.8615	1.3644
No log	10.4186	448	1.7801	-0.0049	1.7801	1.3342
No log	10.4651	450	1.5452	0.0205	1.5452	1.2431
No log	10.5116	452	1.3717	0.0699	1.3717	1.1712
No log	10.5581	454	1.3310	0.0946	1.3310	1.1537
No log	10.6047	456	1.3983	0.0457	1.3983	1.1825
No log	10.6512	458	1.5094	0.0205	1.5094	1.2286
No log	10.6977	460	1.6437	-0.0026	1.6437	1.2821
No log	10.7442	462	1.5397	-0.0026	1.5397	1.2409
No log	10.7907	464	1.3576	0.0564	1.3576	1.1652
No log	10.8372	466	1.3500	0.0564	1.3500	1.1619
No log	10.8837	468	1.4581	0.0505	1.4581	1.2075
No log	10.9302	470	1.6105	-0.0013	1.6105	1.2690
No log	10.9767	472	1.6606	-0.0013	1.6606	1.2886
No log	11.0233	474	1.6803	0.0190	1.6803	1.2963
No log	11.0698	476	1.5633	0.0440	1.5633	1.2503
No log	11.1163	478	1.3693	0.0736	1.3693	1.1702
No log	11.1628	480	1.2996	0.0776	1.2996	1.1400
No log	11.2093	482	1.3693	0.0736	1.3693	1.1702
No log	11.2558	484	1.4983	0.0190	1.4983	1.2240
No log	11.3023	486	1.5203	0.0190	1.5203	1.2330
No log	11.3488	488	1.5728	0.0190	1.5728	1.2541
No log	11.3953	490	1.5434	0.0190	1.5434	1.2423
No log	11.4419	492	1.5355	0.0422	1.5355	1.2392
No log	11.4884	494	1.4722	0.0679	1.4722	1.2134
No log	11.5349	496	1.3041	0.0992	1.3041	1.1420
No log	11.5814	498	1.2546	0.1041	1.2546	1.1201
0.344	11.6279	500	1.3706	0.1172	1.3706	1.1707
0.344	11.6744	502	1.5193	0.0679	1.5193	1.2326
0.344	11.7209	504	1.5560	0.0430	1.5560	1.2474
0.344	11.7674	506	1.5411	0.0430	1.5411	1.2414
0.344	11.8140	508	1.4718	0.0679	1.4718	1.2132
0.344	11.8605	510	1.5233	0.0413	1.5233	1.2342

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1