ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1100
• Qwk: 0.1443
• Mse: 1.1100
• Rmse: 1.0536

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	4.8604	0.0064	4.8604	2.2046
No log	0.0727	4	3.1813	-0.0005	3.1813	1.7836
No log	0.1091	6	1.9554	0.0198	1.9554	1.3984
No log	0.1455	8	1.8958	0.0062	1.8958	1.3769
No log	0.1818	10	1.5990	-0.0426	1.5990	1.2645
No log	0.2182	12	1.3116	-0.0059	1.3116	1.1452
No log	0.2545	14	1.3296	0.0275	1.3296	1.1531
No log	0.2909	16	1.2906	0.0688	1.2906	1.1360
No log	0.3273	18	1.2118	0.1713	1.2118	1.1008
No log	0.3636	20	1.2652	0.0831	1.2652	1.1248
No log	0.4	22	1.2671	0.1045	1.2671	1.1257
No log	0.4364	24	1.2617	0.0704	1.2617	1.1233
No log	0.4727	26	1.2292	0.2053	1.2292	1.1087
No log	0.5091	28	1.2634	0.0952	1.2634	1.1240
No log	0.5455	30	1.3154	0.0385	1.3154	1.1469
No log	0.5818	32	1.3314	0.0776	1.3314	1.1539
No log	0.6182	34	1.2502	0.1076	1.2502	1.1181
No log	0.6545	36	1.1947	0.1772	1.1947	1.0930
No log	0.6909	38	1.1897	0.1968	1.1897	1.0908
No log	0.7273	40	1.1835	0.1519	1.1835	1.0879
No log	0.7636	42	1.1549	0.2887	1.1549	1.0747
No log	0.8	44	1.1482	0.1689	1.1482	1.0715
No log	0.8364	46	1.1330	0.1689	1.1330	1.0644
No log	0.8727	48	1.0764	0.2628	1.0764	1.0375
No log	0.9091	50	1.0578	0.2733	1.0578	1.0285
No log	0.9455	52	1.0146	0.3451	1.0146	1.0073
No log	0.9818	54	0.9676	0.3462	0.9676	0.9837
No log	1.0182	56	1.0352	0.2513	1.0352	1.0175
No log	1.0545	58	1.4035	-0.0141	1.4035	1.1847
No log	1.0909	60	1.4643	-0.0870	1.4643	1.2101
No log	1.1273	62	1.0903	0.1995	1.0903	1.0442
No log	1.1636	64	1.1852	0.2040	1.1852	1.0887
No log	1.2	66	1.1841	0.2577	1.1841	1.0882
No log	1.2364	68	1.1445	0.3885	1.1445	1.0698
No log	1.2727	70	1.1863	0.3019	1.1863	1.0892
No log	1.3091	72	1.2237	0.2500	1.2237	1.1062
No log	1.3455	74	1.3037	0.2531	1.3037	1.1418
No log	1.3818	76	1.3307	0.2966	1.3307	1.1535
No log	1.4182	78	1.2838	0.2857	1.2838	1.1330
No log	1.4545	80	1.2545	0.2558	1.2545	1.1201
No log	1.4909	82	1.3181	0.3061	1.3181	1.1481
No log	1.5273	84	1.4532	0.2862	1.4532	1.2055
No log	1.5636	86	1.6475	0.2177	1.6475	1.2835
No log	1.6	88	1.4416	0.3042	1.4416	1.2007
No log	1.6364	90	1.2791	0.1876	1.2791	1.1310
No log	1.6727	92	1.2608	0.1883	1.2608	1.1229
No log	1.7091	94	1.3144	0.1892	1.3144	1.1465
No log	1.7455	96	1.5345	0.2046	1.5345	1.2388
No log	1.7818	98	1.5826	0.2487	1.5826	1.2580
No log	1.8182	100	1.5814	0.2461	1.5814	1.2576
No log	1.8545	102	1.7338	0.2473	1.7338	1.3167
No log	1.8909	104	1.5784	0.2397	1.5784	1.2563
No log	1.9273	106	1.3144	0.1859	1.3144	1.1465
No log	1.9636	108	1.2440	0.2199	1.2440	1.1153
No log	2.0	110	1.2307	0.1919	1.2307	1.1093
No log	2.0364	112	1.5141	0.2272	1.5141	1.2305
No log	2.0727	114	1.5983	0.2797	1.5983	1.2642
No log	2.1091	116	1.3046	0.1807	1.3046	1.1422
No log	2.1455	118	1.1315	0.2199	1.1315	1.0637
No log	2.1818	120	1.1526	0.2424	1.1526	1.0736
No log	2.2182	122	1.1116	0.2492	1.1116	1.0543
No log	2.2545	124	1.2546	0.2367	1.2546	1.1201
No log	2.2909	126	1.4242	0.3222	1.4242	1.1934
No log	2.3273	128	1.2737	0.2693	1.2737	1.1286
No log	2.3636	130	1.1553	0.2752	1.1553	1.0749
No log	2.4	132	1.1532	0.2801	1.1532	1.0739
No log	2.4364	134	1.1766	0.2409	1.1766	1.0847
No log	2.4727	136	1.3613	0.2564	1.3613	1.1668
No log	2.5091	138	1.4161	0.1847	1.4161	1.1900
No log	2.5455	140	1.3882	0.1597	1.3882	1.1782
No log	2.5818	142	1.3235	0.2345	1.3235	1.1504
No log	2.6182	144	1.5430	0.1999	1.5430	1.2422
No log	2.6545	146	1.9393	0.1941	1.9393	1.3926
No log	2.6909	148	1.7797	0.2876	1.7797	1.3341
No log	2.7273	150	1.3435	0.2518	1.3435	1.1591
No log	2.7636	152	1.1877	0.2973	1.1877	1.0898
No log	2.8	154	1.1886	0.2973	1.1886	1.0902
No log	2.8364	156	1.3045	0.1758	1.3045	1.1422
No log	2.8727	158	1.4612	0.1891	1.4612	1.2088
No log	2.9091	160	1.3771	0.1858	1.3771	1.1735
No log	2.9455	162	1.2888	0.3069	1.2888	1.1352
No log	2.9818	164	1.2970	0.2792	1.2970	1.1388
No log	3.0182	166	1.3134	0.2444	1.3134	1.1460
No log	3.0545	168	1.4034	0.2846	1.4034	1.1846
No log	3.0909	170	1.4092	0.3064	1.4092	1.1871
No log	3.1273	172	1.4270	0.2967	1.4270	1.1946
No log	3.1636	174	1.3260	0.2263	1.3260	1.1515
No log	3.2	176	1.1965	0.2164	1.1965	1.0939
No log	3.2364	178	1.1536	0.2219	1.1536	1.0741
No log	3.2727	180	1.2170	0.2955	1.2170	1.1032
No log	3.3091	182	1.3662	0.2775	1.3662	1.1688
No log	3.3455	184	1.4254	0.2987	1.4254	1.1939
No log	3.3818	186	1.2869	0.3434	1.2869	1.1344
No log	3.4182	188	1.1873	0.2883	1.1873	1.0896
No log	3.4545	190	1.2010	0.2773	1.2010	1.0959
No log	3.4909	192	1.2918	0.3222	1.2918	1.1366
No log	3.5273	194	1.4360	0.2782	1.4360	1.1983
No log	3.5636	196	1.3538	0.2685	1.3538	1.1635
No log	3.6	198	1.2040	0.3000	1.2040	1.0973
No log	3.6364	200	1.1210	0.2346	1.1210	1.0588
No log	3.6727	202	1.1147	0.2813	1.1147	1.0558
No log	3.7091	204	1.1590	0.2921	1.1590	1.0765
No log	3.7455	206	1.4379	0.2295	1.4379	1.1991
No log	3.7818	208	1.5376	0.2071	1.5376	1.2400
No log	3.8182	210	1.3129	0.2696	1.3129	1.1458
No log	3.8545	212	1.1471	0.2346	1.1471	1.0710
No log	3.8909	214	1.1441	0.2711	1.1441	1.0696
No log	3.9273	216	1.1568	0.1927	1.1568	1.0755
No log	3.9636	218	1.2837	0.2000	1.2837	1.1330
No log	4.0	220	1.4014	0.2479	1.4014	1.1838
No log	4.0364	222	1.4632	0.2065	1.4632	1.2096
No log	4.0727	224	1.3457	0.1801	1.3457	1.1600
No log	4.1091	226	1.1850	0.1767	1.1850	1.0886
No log	4.1455	228	1.1436	0.2086	1.1436	1.0694
No log	4.1818	230	1.2114	0.1808	1.2114	1.1006
No log	4.2182	232	1.3578	0.1889	1.3578	1.1653
No log	4.2545	234	1.3230	0.1477	1.3230	1.1502
No log	4.2909	236	1.1903	0.1808	1.1903	1.0910
No log	4.3273	238	1.1704	0.1969	1.1704	1.0819
No log	4.3636	240	1.2890	0.2367	1.2890	1.1353
No log	4.4	242	1.3477	0.2213	1.3477	1.1609
No log	4.4364	244	1.3255	0.3115	1.3255	1.1513
No log	4.4727	246	1.2533	0.2818	1.2533	1.1195
No log	4.5091	248	1.2042	0.2999	1.2042	1.0974
No log	4.5455	250	1.2150	0.3022	1.2150	1.1023
No log	4.5818	252	1.2895	0.2981	1.2895	1.1356
No log	4.6182	254	1.3416	0.2275	1.3416	1.1583
No log	4.6545	256	1.3814	0.1961	1.3814	1.1753
No log	4.6909	258	1.2621	0.2679	1.2621	1.1234
No log	4.7273	260	1.2538	0.2679	1.2538	1.1197
No log	4.7636	262	1.3804	0.2006	1.3804	1.1749
No log	4.8	264	1.3754	0.2272	1.3754	1.1728
No log	4.8364	266	1.3016	0.2983	1.3016	1.1409
No log	4.8727	268	1.2177	0.2918	1.2177	1.1035
No log	4.9091	270	1.1878	0.2894	1.1878	1.0899
No log	4.9455	272	1.2372	0.3232	1.2372	1.1123
No log	4.9818	274	1.3845	0.3970	1.3845	1.1766
No log	5.0182	276	1.4106	0.3371	1.4106	1.1877
No log	5.0545	278	1.2063	0.3094	1.2063	1.0983
No log	5.0909	280	1.0463	0.2317	1.0463	1.0229
No log	5.1273	282	1.0155	0.3045	1.0155	1.0077
No log	5.1636	284	1.0230	0.3045	1.0230	1.0114
No log	5.2	286	1.1014	0.2417	1.1014	1.0495
No log	5.2364	288	1.2535	0.3341	1.2535	1.1196
No log	5.2727	290	1.2668	0.3578	1.2668	1.1255
No log	5.3091	292	1.1796	0.3117	1.1796	1.0861
No log	5.3455	294	1.0103	0.4611	1.0103	1.0051
No log	5.3818	296	0.9784	0.3337	0.9784	0.9892
No log	5.4182	298	0.9657	0.3890	0.9657	0.9827
No log	5.4545	300	1.0282	0.4568	1.0282	1.0140
No log	5.4909	302	1.1713	0.3596	1.1713	1.0822
No log	5.5273	304	1.2122	0.3690	1.2122	1.1010
No log	5.5636	306	1.2083	0.3212	1.2083	1.0992
No log	5.6	308	1.1616	0.2953	1.1616	1.0778
No log	5.6364	310	1.1309	0.2857	1.1309	1.0634
No log	5.6727	312	1.0747	0.2857	1.0747	1.0367
No log	5.7091	314	1.1303	0.3618	1.1303	1.0632
No log	5.7455	316	1.1722	0.3658	1.1722	1.0827
No log	5.7818	318	1.3653	0.3898	1.3653	1.1685
No log	5.8182	320	1.4153	0.3797	1.4153	1.1896
No log	5.8545	322	1.2066	0.3215	1.2066	1.0985
No log	5.8909	324	1.0271	0.3122	1.0271	1.0135
No log	5.9273	326	1.0032	0.2995	1.0032	1.0016
No log	5.9636	328	1.0706	0.2119	1.0706	1.0347
No log	6.0	330	1.2585	0.2725	1.2585	1.1218
No log	6.0364	332	1.4196	0.2714	1.4196	1.1915
No log	6.0727	334	1.3802	0.2982	1.3802	1.1748
No log	6.1091	336	1.2070	0.2439	1.2070	1.0986
No log	6.1455	338	1.1249	0.2207	1.1249	1.0606
No log	6.1818	340	1.1240	0.2207	1.1240	1.0602
No log	6.2182	342	1.1678	0.2152	1.1678	1.0806
No log	6.2545	344	1.2679	0.3001	1.2679	1.1260
No log	6.2909	346	1.3703	0.2191	1.3703	1.1706
No log	6.3273	348	1.3180	0.2982	1.3180	1.1481
No log	6.3636	350	1.2347	0.3474	1.2347	1.1112
No log	6.4	352	1.2298	0.3474	1.2298	1.1090
No log	6.4364	354	1.2904	0.2959	1.2904	1.1359
No log	6.4727	356	1.2808	0.3316	1.2808	1.1317
No log	6.5091	358	1.1835	0.3001	1.1835	1.0879
No log	6.5455	360	1.0972	0.1860	1.0972	1.0475
No log	6.5818	362	1.0561	0.1667	1.0561	1.0277
No log	6.6182	364	1.0635	0.1605	1.0635	1.0313
No log	6.6545	366	1.1308	0.2651	1.1308	1.0634
No log	6.6909	368	1.3175	0.2982	1.3175	1.1478
No log	6.7273	370	1.4266	0.3167	1.4266	1.1944
No log	6.7636	372	1.3456	0.2982	1.3456	1.1600
No log	6.8	374	1.1722	0.2683	1.1722	1.0827
No log	6.8364	376	1.0608	0.1860	1.0608	1.0299
No log	6.8727	378	1.0178	0.1860	1.0178	1.0089
No log	6.9091	380	1.0743	0.2791	1.0743	1.0365
No log	6.9455	382	1.2643	0.3726	1.2643	1.1244
No log	6.9818	384	1.3839	0.3778	1.3839	1.1764
No log	7.0182	386	1.4700	0.3684	1.4700	1.2124
No log	7.0545	388	1.4137	0.3959	1.4137	1.1890
No log	7.0909	390	1.3735	0.3525	1.3735	1.1720
No log	7.1273	392	1.2395	0.2714	1.2395	1.1133
No log	7.1636	394	1.1883	0.2304	1.1883	1.0901
No log	7.2	396	1.2525	0.3001	1.2525	1.1191
No log	7.2364	398	1.3430	0.3447	1.3430	1.1589
No log	7.2727	400	1.3087	0.3718	1.3087	1.1440
No log	7.3091	402	1.2797	0.3488	1.2797	1.1312
No log	7.3455	404	1.2972	0.3718	1.2972	1.1389
No log	7.3818	406	1.2426	0.3001	1.2426	1.1147
No log	7.4182	408	1.1433	0.2978	1.1433	1.0693
No log	7.4545	410	1.0668	0.2317	1.0668	1.0329
No log	7.4909	412	1.0487	0.2076	1.0487	1.0240
No log	7.5273	414	1.0803	0.2219	1.0803	1.0394
No log	7.5636	416	1.1680	0.2714	1.1680	1.0808
No log	7.6	418	1.3058	0.1838	1.3058	1.1427
No log	7.6364	420	1.3638	0.1884	1.3638	1.1678
No log	7.6727	422	1.3522	0.1884	1.3522	1.1628
No log	7.7091	424	1.2610	0.2224	1.2610	1.1229
No log	7.7455	426	1.1691	0.2343	1.1691	1.0813
No log	7.7818	428	1.1390	0.2009	1.1390	1.0673
No log	7.8182	430	1.1727	0.1500	1.1727	1.0829
No log	7.8545	432	1.2116	0.2330	1.2116	1.1007
No log	7.8909	434	1.2057	0.2046	1.2057	1.0980
No log	7.9273	436	1.1551	0.2056	1.1551	1.0748
No log	7.9636	438	1.1460	0.1701	1.1460	1.0705
No log	8.0	440	1.1359	0.1860	1.1359	1.0658
No log	8.0364	442	1.1100	0.1543	1.1100	1.0536
No log	8.0727	444	1.1338	0.1860	1.1338	1.0648
No log	8.1091	446	1.1978	0.2439	1.1978	1.0944
No log	8.1455	448	1.2311	0.2141	1.2311	1.1096
No log	8.1818	450	1.2503	0.1596	1.2503	1.1182
No log	8.2182	452	1.2171	0.1801	1.2171	1.1032
No log	8.2545	454	1.1579	0.1480	1.1579	1.0761
No log	8.2909	456	1.1379	0.1480	1.1379	1.0667
No log	8.3273	458	1.1322	0.1961	1.1322	1.0641
No log	8.3636	460	1.2133	0.2714	1.2133	1.1015
No log	8.4	462	1.3010	0.2602	1.3010	1.1406
No log	8.4364	464	1.3185	0.2634	1.3185	1.1483
No log	8.4727	466	1.2095	0.2978	1.2095	1.0998
No log	8.5091	468	1.0511	0.2076	1.0511	1.0253
No log	8.5455	470	0.9961	0.2729	0.9961	0.9980
No log	8.5818	472	1.0149	0.2142	1.0149	1.0074
No log	8.6182	474	1.0848	0.1860	1.0848	1.0416
No log	8.6545	476	1.1665	0.1902	1.1665	1.0800
No log	8.6909	478	1.1825	0.1741	1.1825	1.0874
No log	8.7273	480	1.1390	0.1582	1.1390	1.0673
No log	8.7636	482	1.0966	0.1379	1.0966	1.0472
No log	8.8	484	1.0764	0.1546	1.0764	1.0375
No log	8.8364	486	1.0779	0.1443	1.0779	1.0382
No log	8.8727	488	1.1237	0.1761	1.1237	1.0601
No log	8.9091	490	1.1500	0.2009	1.1500	1.0724
No log	8.9455	492	1.1027	0.1864	1.1027	1.0501
No log	8.9818	494	1.0977	0.1864	1.0977	1.0477
No log	9.0182	496	1.1253	0.2395	1.1253	1.0608
No log	9.0545	498	1.2225	0.3001	1.2225	1.1057
0.3434	9.0909	500	1.2014	0.2439	1.2014	1.0961
0.3434	9.1273	502	1.1035	0.1961	1.1035	1.0505
0.3434	9.1636	504	1.0257	0.1711	1.0257	1.0128
0.3434	9.2	506	1.0056	0.2304	1.0056	1.0028
0.3434	9.2364	508	1.0134	0.1767	1.0134	1.0067
0.3434	9.2727	510	1.1088	0.2454	1.1088	1.0530
0.3434	9.3091	512	1.2443	0.3024	1.2443	1.1155
0.3434	9.3455	514	1.2559	0.3046	1.2559	1.1207
0.3434	9.3818	516	1.1333	0.2395	1.1333	1.0646
0.3434	9.4182	518	1.0380	0.2231	1.0380	1.0188
0.3434	9.4545	520	1.0192	0.1927	1.0192	1.0096
0.3434	9.4909	522	1.0432	0.1927	1.0432	1.0213
0.3434	9.5273	524	1.1100	0.1443	1.1100	1.0536

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1