ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k9_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4226
• Qwk: 0.0691
• Mse: 1.4226
• Rmse: 1.1927

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	3.8577	-0.0047	3.8577	1.9641
No log	0.1818	4	2.4174	-0.0538	2.4174	1.5548
No log	0.2727	6	1.9711	-0.0082	1.9711	1.4040
No log	0.3636	8	1.4740	0.1171	1.4740	1.2141
No log	0.4545	10	1.3140	0.0792	1.3140	1.1463
No log	0.5455	12	1.4709	-0.1530	1.4709	1.2128
No log	0.6364	14	1.7501	-0.1134	1.7501	1.3229
No log	0.7273	16	1.5860	-0.1114	1.5860	1.2594
No log	0.8182	18	1.4651	-0.0963	1.4651	1.2104
No log	0.9091	20	1.3267	-0.0681	1.3267	1.1518
No log	1.0	22	1.2524	0.0639	1.2524	1.1191
No log	1.0909	24	1.2227	0.0169	1.2227	1.1057
No log	1.1818	26	1.2145	0.0299	1.2145	1.1020
No log	1.2727	28	1.2651	-0.1727	1.2651	1.1248
No log	1.3636	30	1.3680	-0.0560	1.3680	1.1696
No log	1.4545	32	1.5051	0.0	1.5051	1.2268
No log	1.5455	34	1.5090	0.0	1.5090	1.2284
No log	1.6364	36	1.3755	-0.0560	1.3755	1.1728
No log	1.7273	38	1.2367	0.0107	1.2367	1.1121
No log	1.8182	40	1.1707	0.1218	1.1707	1.0820
No log	1.9091	42	1.1763	0.0576	1.1763	1.0846
No log	2.0	44	1.1843	0.1313	1.1843	1.0883
No log	2.0909	46	1.1982	0.1426	1.1982	1.0946
No log	2.1818	48	1.2043	0.1671	1.2043	1.0974
No log	2.2727	50	1.2119	0.1341	1.2119	1.1009
No log	2.3636	52	1.2121	0.1341	1.2121	1.1010
No log	2.4545	54	1.2229	0.0576	1.2229	1.1058
No log	2.5455	56	1.2208	0.0422	1.2208	1.1049
No log	2.6364	58	1.1979	0.0884	1.1979	1.0945
No log	2.7273	60	1.1926	0.1033	1.1926	1.0921
No log	2.8182	62	1.1949	0.1509	1.1949	1.0931
No log	2.9091	64	1.2078	0.1805	1.2078	1.0990
No log	3.0	66	1.1759	0.1779	1.1759	1.0844
No log	3.0909	68	1.1438	0.1671	1.1438	1.0695
No log	3.1818	70	1.2285	0.0352	1.2285	1.1084
No log	3.2727	72	1.2876	0.0319	1.2876	1.1347
No log	3.3636	74	1.2109	0.0542	1.2109	1.1004
No log	3.4545	76	1.2677	0.0667	1.2677	1.1259
No log	3.5455	78	1.5604	0.0349	1.5604	1.2492
No log	3.6364	80	1.8439	-0.0422	1.8439	1.3579
No log	3.7273	82	1.6650	0.1357	1.6650	1.2903
No log	3.8182	84	1.2174	0.2179	1.2174	1.1034
No log	3.9091	86	1.3186	0.1638	1.3186	1.1483
No log	4.0	88	1.7941	0.1140	1.7941	1.3394
No log	4.0909	90	1.8819	0.0883	1.8819	1.3718
No log	4.1818	92	1.5697	0.1789	1.5697	1.2529
No log	4.2727	94	1.3038	0.1820	1.3038	1.1418
No log	4.3636	96	1.0988	0.2015	1.0988	1.0483
No log	4.4545	98	1.1148	0.2042	1.1148	1.0558
No log	4.5455	100	1.1953	0.1107	1.1953	1.0933
No log	4.6364	102	1.5664	0.0496	1.5664	1.2516
No log	4.7273	104	1.7072	0.0900	1.7072	1.3066
No log	4.8182	106	1.7191	0.1039	1.7191	1.3111
No log	4.9091	108	1.4001	0.1512	1.4001	1.1833
No log	5.0	110	1.2464	0.2539	1.2464	1.1164
No log	5.0909	112	1.3020	0.0609	1.3020	1.1411
No log	5.1818	114	1.5059	0.1595	1.5059	1.2272
No log	5.2727	116	1.6878	0.1497	1.6878	1.2992
No log	5.3636	118	1.6819	0.1317	1.6819	1.2969
No log	5.4545	120	1.6739	0.1557	1.6739	1.2938
No log	5.5455	122	1.5390	0.0643	1.5390	1.2406
No log	5.6364	124	1.4377	-0.0251	1.4377	1.1991
No log	5.7273	126	1.3850	-0.0251	1.3850	1.1768
No log	5.8182	128	1.3567	-0.0251	1.3567	1.1648
No log	5.9091	130	1.3838	-0.0251	1.3838	1.1764
No log	6.0	132	1.3638	0.0160	1.3638	1.1678
No log	6.0909	134	1.2804	0.0618	1.2804	1.1315
No log	6.1818	136	1.4337	0.0855	1.4337	1.1974
No log	6.2727	138	1.7015	0.1950	1.7015	1.3044
No log	6.3636	140	1.8030	0.2221	1.8030	1.3428
No log	6.4545	142	1.7477	0.2342	1.7477	1.3220
No log	6.5455	144	1.5368	0.1769	1.5368	1.2397
No log	6.6364	146	1.3835	0.0961	1.3835	1.1762
No log	6.7273	148	1.3574	0.0433	1.3574	1.1651
No log	6.8182	150	1.3670	0.0556	1.3670	1.1692
No log	6.9091	152	1.4416	0.0401	1.4416	1.2007
No log	7.0	154	1.3021	0.0961	1.3021	1.1411
No log	7.0909	156	1.1890	0.1680	1.1890	1.0904
No log	7.1818	158	1.1812	0.1530	1.1812	1.0868
No log	7.2727	160	1.3864	0.0661	1.3864	1.1775
No log	7.3636	162	1.4962	0.1769	1.4962	1.2232
No log	7.4545	164	1.3435	0.0643	1.3435	1.1591
No log	7.5455	166	1.2032	0.1315	1.2032	1.0969
No log	7.6364	168	1.1832	0.1729	1.1832	1.0878
No log	7.7273	170	1.2865	0.0270	1.2865	1.1343
No log	7.8182	172	1.4896	0.0500	1.4896	1.2205
No log	7.9091	174	1.5302	0.0500	1.5302	1.2370
No log	8.0	176	1.4804	0.1088	1.4804	1.2167
No log	8.0909	178	1.3916	0.0323	1.3916	1.1797
No log	8.1818	180	1.4797	0.1088	1.4797	1.2164
No log	8.2727	182	1.6003	0.1441	1.6003	1.2650
No log	8.3636	184	1.6441	0.1562	1.6441	1.2822
No log	8.4545	186	1.5250	0.0401	1.5250	1.2349
No log	8.5455	188	1.2988	0.0160	1.2988	1.1397
No log	8.6364	190	1.1135	0.1727	1.1135	1.0552
No log	8.7273	192	1.1155	0.1841	1.1155	1.0562
No log	8.8182	194	1.1305	0.1720	1.1305	1.0632
No log	8.9091	196	1.1498	0.2161	1.1498	1.0723
No log	9.0	198	1.3286	0.0	1.3286	1.1527
No log	9.0909	200	1.4868	-0.0060	1.4868	1.2194
No log	9.1818	202	1.4162	0.0	1.4162	1.1901
No log	9.2727	204	1.2910	0.0721	1.2910	1.1362
No log	9.3636	206	1.3041	0.0155	1.3041	1.1420
No log	9.4545	208	1.3057	0.0155	1.3057	1.1427
No log	9.5455	210	1.2755	0.0587	1.2755	1.1294
No log	9.6364	212	1.1973	0.0919	1.1973	1.0942
No log	9.7273	214	1.2214	0.0841	1.2214	1.1052
No log	9.8182	216	1.3928	0.1247	1.3928	1.1802
No log	9.9091	218	1.3605	0.1557	1.3605	1.1664
No log	10.0	220	1.1480	0.1500	1.1480	1.0715
No log	10.0909	222	1.0526	0.2724	1.0526	1.0260
No log	10.1818	224	1.0959	0.1722	1.0959	1.0469
No log	10.2727	226	1.2203	0.0833	1.2203	1.1047
No log	10.3636	228	1.2682	0.0401	1.2682	1.1261
No log	10.4545	230	1.2951	0.0401	1.2951	1.1380
No log	10.5455	232	1.4644	0.1142	1.4644	1.2101
No log	10.6364	234	1.5146	0.1634	1.5146	1.2307
No log	10.7273	236	1.6215	0.1717	1.6215	1.2734
No log	10.8182	238	1.8308	0.1971	1.8308	1.3531
No log	10.9091	240	1.8396	0.1738	1.8396	1.3563
No log	11.0	242	1.7779	0.1044	1.7779	1.3334
No log	11.0909	244	1.6708	0.0263	1.6708	1.2926
No log	11.1818	246	1.5348	0.1473	1.5348	1.2389
No log	11.2727	248	1.3885	0.1579	1.3885	1.1783
No log	11.3636	250	1.3881	0.1303	1.3881	1.1782
No log	11.4545	252	1.4984	0.2241	1.4984	1.2241
No log	11.5455	254	1.6038	0.2174	1.6038	1.2664
No log	11.6364	256	1.7390	0.2016	1.7390	1.3187
No log	11.7273	258	1.6662	0.2270	1.6662	1.2908
No log	11.8182	260	1.4222	0.0694	1.4222	1.1926
No log	11.9091	262	1.2915	0.0931	1.2915	1.1364
No log	12.0	264	1.2461	0.0931	1.2461	1.1163
No log	12.0909	266	1.3033	0.0445	1.3033	1.1416
No log	12.1818	268	1.4936	0.0122	1.4936	1.2221
No log	12.2727	270	1.5965	0.1142	1.5965	1.2635
No log	12.3636	272	1.5426	0.1142	1.5426	1.2420
No log	12.4545	274	1.4342	0.0510	1.4342	1.1976
No log	12.5455	276	1.3127	0.1288	1.3127	1.1457
No log	12.6364	278	1.3117	0.1288	1.3117	1.1453
No log	12.7273	280	1.4400	0.1498	1.4400	1.2000
No log	12.8182	282	1.6343	0.1955	1.6343	1.2784
No log	12.9091	284	1.6917	0.1860	1.6917	1.3006
No log	13.0	286	1.5534	0.1410	1.5534	1.2463
No log	13.0909	288	1.3954	0.1473	1.3954	1.1813
No log	13.1818	290	1.3541	0.0833	1.3541	1.1637
No log	13.2727	292	1.4493	0.1473	1.4493	1.2039
No log	13.3636	294	1.5663	0.1523	1.5663	1.2515
No log	13.4545	296	1.6771	0.2116	1.6771	1.2950
No log	13.5455	298	1.6596	0.2163	1.6596	1.2882
No log	13.6364	300	1.6655	0.2163	1.6655	1.2905
No log	13.7273	302	1.5590	0.1565	1.5590	1.2486
No log	13.8182	304	1.4796	0.1552	1.4796	1.2164
No log	13.9091	306	1.4968	0.1552	1.4968	1.2235
No log	14.0	308	1.5538	0.1700	1.5538	1.2465
No log	14.0909	310	1.6230	0.0958	1.6230	1.2740
No log	14.1818	312	1.6717	0.1879	1.6717	1.2930
No log	14.2727	314	1.6920	0.2121	1.6920	1.3008
No log	14.3636	316	1.6261	0.1736	1.6261	1.2752
No log	14.4545	318	1.6213	0.1808	1.6213	1.2733
No log	14.5455	320	1.6011	0.0958	1.6011	1.2653
No log	14.6364	322	1.5717	0.1114	1.5717	1.2537
No log	14.7273	324	1.5543	0.0958	1.5543	1.2467
No log	14.8182	326	1.4875	0.1432	1.4875	1.2196
No log	14.9091	328	1.2950	0.1423	1.2950	1.1380
No log	15.0	330	1.2194	0.1139	1.2194	1.1043
No log	15.0909	332	1.2927	0.1081	1.2927	1.1369
No log	15.1818	334	1.3653	0.0861	1.3653	1.1684
No log	15.2727	336	1.4804	0.1914	1.4804	1.2167
No log	15.3636	338	1.5632	0.2290	1.5632	1.2503
No log	15.4545	340	1.5961	0.1975	1.5961	1.2634
No log	15.5455	342	1.6186	0.1922	1.6186	1.2722
No log	15.6364	344	1.6695	0.1341	1.6695	1.2921
No log	15.7273	346	1.5665	0.1473	1.5665	1.2516
No log	15.8182	348	1.4305	0.0987	1.4305	1.1960
No log	15.9091	350	1.4189	0.0987	1.4189	1.1912
No log	16.0	352	1.4819	0.1579	1.4819	1.2174
No log	16.0909	354	1.5547	0.1292	1.5547	1.2469
No log	16.1818	356	1.5220	0.1452	1.5220	1.2337
No log	16.2727	358	1.4780	0.1303	1.4780	1.2157
No log	16.3636	360	1.4630	0.0380	1.4630	1.2095
No log	16.4545	362	1.4947	0.1552	1.4947	1.2226
No log	16.5455	364	1.4461	0.0931	1.4461	1.2025
No log	16.6364	366	1.4493	0.0833	1.4493	1.2039
No log	16.7273	368	1.4911	0.1473	1.4911	1.2211
No log	16.8182	370	1.4694	0.0484	1.4694	1.2122
No log	16.9091	372	1.4113	0.0834	1.4113	1.1880
No log	17.0	374	1.3847	0.0677	1.3847	1.1767
No log	17.0909	376	1.4911	0.1395	1.4911	1.2211
No log	17.1818	378	1.6378	0.2339	1.6378	1.2798
No log	17.2727	380	1.6467	0.2339	1.6467	1.2832
No log	17.3636	382	1.5590	0.1565	1.5590	1.2486
No log	17.4545	384	1.6430	0.2386	1.6430	1.2818
No log	17.5455	386	1.5749	0.2070	1.5749	1.2549
No log	17.6364	388	1.4005	0.0331	1.4005	1.1834
No log	17.7273	390	1.2888	0.0032	1.2888	1.1352
No log	17.8182	392	1.3291	0.0	1.3291	1.1528
No log	17.9091	394	1.5033	0.0496	1.5033	1.2261
No log	18.0	396	1.6308	0.1278	1.6308	1.2770
No log	18.0909	398	1.6395	0.1114	1.6395	1.2804
No log	18.1818	400	1.6112	0.1197	1.6112	1.2693
No log	18.2727	402	1.5655	0.0390	1.5655	1.2512
No log	18.3636	404	1.5540	0.0390	1.5540	1.2466
No log	18.4545	406	1.5753	0.0496	1.5753	1.2551
No log	18.5455	408	1.5842	0.0598	1.5842	1.2586
No log	18.6364	410	1.6227	0.1032	1.6227	1.2738
No log	18.7273	412	1.5780	0.0834	1.5780	1.2562
No log	18.8182	414	1.6238	0.1114	1.6238	1.2743
No log	18.9091	416	1.6618	0.1428	1.6618	1.2891
No log	19.0	418	1.6673	0.1428	1.6673	1.2912
No log	19.0909	420	1.6300	0.2291	1.6300	1.2767
No log	19.1818	422	1.5808	0.2291	1.5808	1.2573
No log	19.2727	424	1.6225	0.2386	1.6225	1.2738
No log	19.3636	426	1.5894	0.2386	1.5894	1.2607
No log	19.4545	428	1.5101	0.2026	1.5101	1.2289
No log	19.5455	430	1.4848	0.1032	1.4848	1.2185
No log	19.6364	432	1.5345	0.1523	1.5345	1.2387
No log	19.7273	434	1.5434	0.1523	1.5434	1.2423
No log	19.8182	436	1.4893	0.0598	1.4893	1.2204
No log	19.9091	438	1.4328	0.0496	1.4328	1.1970
No log	20.0	440	1.3428	0.0811	1.3428	1.1588
No log	20.0909	442	1.2567	0.0478	1.2567	1.1210
No log	20.1818	444	1.2656	0.0478	1.2656	1.1250
No log	20.2727	446	1.3919	0.0907	1.3919	1.1798
No log	20.3636	448	1.5045	0.1413	1.5045	1.2266
No log	20.4545	450	1.5501	0.1413	1.5501	1.2450
No log	20.5455	452	1.6078	0.1557	1.6078	1.2680
No log	20.6364	454	1.5883	0.1548	1.5883	1.2603
No log	20.7273	456	1.4641	0.0627	1.4641	1.2100
No log	20.8182	458	1.3947	0.1053	1.3947	1.1810
No log	20.9091	460	1.4290	0.0627	1.4290	1.1954
No log	21.0	462	1.5334	0.1413	1.5334	1.2383
No log	21.0909	464	1.6801	0.1729	1.6801	1.2962
No log	21.1818	466	1.6939	0.1729	1.6939	1.3015
No log	21.2727	468	1.5994	0.1601	1.5994	1.2647
No log	21.3636	470	1.4207	0.0583	1.4207	1.1919
No log	21.4545	472	1.2680	0.0587	1.2680	1.1261
No log	21.5455	474	1.2038	0.0478	1.2038	1.0972
No log	21.6364	476	1.2766	0.0587	1.2766	1.1299
No log	21.7273	478	1.4200	0.0722	1.4200	1.1916
No log	21.8182	480	1.5458	0.1971	1.5458	1.2433
No log	21.9091	482	1.6369	0.1963	1.6369	1.2794
No log	22.0	484	1.6040	0.1663	1.6040	1.2665
No log	22.0909	486	1.4818	0.1081	1.4818	1.2173
No log	22.1818	488	1.3688	0.0478	1.3688	1.1700
No log	22.2727	490	1.3000	0.0478	1.3000	1.1402
No log	22.3636	492	1.3080	0.0478	1.3080	1.1437
No log	22.4545	494	1.3845	0.0478	1.3845	1.1766
No log	22.5455	496	1.5276	0.1255	1.5276	1.2359
No log	22.6364	498	1.6722	0.1630	1.6722	1.2931
0.3327	22.7273	500	1.7895	0.1663	1.7895	1.3377
0.3327	22.8182	502	1.8287	0.1582	1.8287	1.3523
0.3327	22.9091	504	1.7431	0.2116	1.7431	1.3203
0.3327	23.0	506	1.6035	0.2129	1.6035	1.2663
0.3327	23.0909	508	1.4400	0.0110	1.4400	1.2000
0.3327	23.1818	510	1.4181	0.0147	1.4181	1.1908
0.3327	23.2727	512	1.4304	0.0691	1.4304	1.1960
0.3327	23.3636	514	1.4257	0.0710	1.4257	1.1940
0.3327	23.4545	516	1.4226	0.0691	1.4226	1.1927

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1