ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1052
• Qwk: 0.1538
• Mse: 1.1052
• Rmse: 1.0513

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	4.6484	0.0010	4.6484	2.1560
No log	0.1538	4	2.6778	0.0239	2.6778	1.6364
No log	0.2308	6	2.1725	-0.0796	2.1725	1.4739
No log	0.3077	8	1.4659	0.0141	1.4659	1.2107
No log	0.3846	10	1.2731	0.0810	1.2731	1.1283
No log	0.4615	12	1.6080	0.0473	1.6080	1.2681
No log	0.5385	14	1.7515	-0.0190	1.7515	1.3235
No log	0.6154	16	1.5315	0.0587	1.5315	1.2375
No log	0.6923	18	1.4129	0.0161	1.4129	1.1887
No log	0.7692	20	1.3814	0.0872	1.3814	1.1753
No log	0.8462	22	1.4931	0.0353	1.4931	1.2219
No log	0.9231	24	1.4087	0.0527	1.4087	1.1869
No log	1.0	26	1.3098	0.0810	1.3098	1.1445
No log	1.0769	28	1.3086	-0.0684	1.3086	1.1440
No log	1.1538	30	1.3616	0.1320	1.3616	1.1669
No log	1.2308	32	1.5880	0.0438	1.5880	1.2602
No log	1.3077	34	1.7481	0.1280	1.7481	1.3222
No log	1.3846	36	1.6741	0.1280	1.6741	1.2939
No log	1.4615	38	1.5608	0.0610	1.5608	1.2493
No log	1.5385	40	1.4635	0.1136	1.4635	1.2098
No log	1.6154	42	1.3878	0.1136	1.3878	1.1781
No log	1.6923	44	1.2685	0.0704	1.2685	1.1263
No log	1.7692	46	1.1963	0.1076	1.1963	1.0937
No log	1.8462	48	1.1378	0.1812	1.1378	1.0667
No log	1.9231	50	1.1189	0.3414	1.1189	1.0578
No log	2.0	52	1.1196	0.2408	1.1196	1.0581
No log	2.0769	54	1.1178	0.2834	1.1178	1.0573
No log	2.1538	56	1.2939	0.0750	1.2939	1.1375
No log	2.2308	58	1.4542	0.0628	1.4542	1.2059
No log	2.3077	60	1.3979	0.0784	1.3979	1.1823
No log	2.3846	62	1.2395	0.1237	1.2395	1.1133
No log	2.4615	64	1.2498	0.1076	1.2498	1.1180
No log	2.5385	66	1.5171	0.0376	1.5171	1.2317
No log	2.6154	68	1.7769	0.0725	1.7769	1.3330
No log	2.6923	70	1.6120	0.1282	1.6120	1.2696
No log	2.7692	72	1.4384	0.1364	1.4384	1.1993
No log	2.8462	74	1.5442	0.2275	1.5442	1.2426
No log	2.9231	76	1.5646	0.2275	1.5646	1.2508
No log	3.0	78	1.3533	0.1663	1.3533	1.1633
No log	3.0769	80	1.4447	0.0878	1.4447	1.2020
No log	3.1538	82	1.7611	-0.0369	1.7611	1.3271
No log	3.2308	84	1.7901	-0.0452	1.7901	1.3379
No log	3.3077	86	1.5859	0.1570	1.5859	1.2593
No log	3.3846	88	1.2993	0.1525	1.2993	1.1399
No log	3.4615	90	1.2359	0.2471	1.2359	1.1117
No log	3.5385	92	1.2836	0.2658	1.2836	1.1330
No log	3.6154	94	1.4254	0.0325	1.4254	1.1939
No log	3.6923	96	1.5244	0.0958	1.5244	1.2347
No log	3.7692	98	1.4296	0.0412	1.4296	1.1957
No log	3.8462	100	1.2083	0.2286	1.2083	1.0992
No log	3.9231	102	1.1279	0.2503	1.1279	1.0620
No log	4.0	104	1.1965	0.1562	1.1965	1.0938
No log	4.0769	106	1.2478	0.0750	1.2478	1.1171
No log	4.1538	108	1.2449	0.1156	1.2449	1.1158
No log	4.2308	110	1.2939	0.1000	1.2939	1.1375
No log	4.3077	112	1.2732	0.1000	1.2732	1.1284
No log	4.3846	114	1.2577	0.0760	1.2577	1.1215
No log	4.4615	116	1.2869	0.0566	1.2869	1.1344
No log	4.5385	118	1.3443	0.0233	1.3443	1.1594
No log	4.6154	120	1.2795	0.2097	1.2795	1.1311
No log	4.6923	122	1.2184	0.2520	1.2184	1.1038
No log	4.7692	124	1.2362	0.2200	1.2362	1.1119
No log	4.8462	126	1.4932	-0.0117	1.4932	1.2220
No log	4.9231	128	1.5509	-0.0117	1.5509	1.2454
No log	5.0	130	1.3487	0.0628	1.3487	1.1613
No log	5.0769	132	1.1355	0.2188	1.1355	1.0656
No log	5.1538	134	1.0768	0.3250	1.0768	1.0377
No log	5.2308	136	1.0763	0.3570	1.0763	1.0375
No log	5.3077	138	1.1238	0.1314	1.1238	1.0601
No log	5.3846	140	1.2913	0.1316	1.2913	1.1364
No log	5.4615	142	1.2830	0.1282	1.2830	1.1327
No log	5.5385	144	1.1301	0.2371	1.1301	1.0631
No log	5.6154	146	1.1305	0.2801	1.1305	1.0633
No log	5.6923	148	1.3146	0.2321	1.3146	1.1465
No log	5.7692	150	1.3529	0.2191	1.3529	1.1632
No log	5.8462	152	1.1466	0.2317	1.1466	1.0708
No log	5.9231	154	1.0977	0.2689	1.0977	1.0477
No log	6.0	156	1.2118	0.1282	1.2118	1.1008
No log	6.0769	158	1.1862	0.1316	1.1862	1.0891
No log	6.1538	160	1.1033	0.1417	1.1033	1.0504
No log	6.2308	162	1.0355	0.2781	1.0355	1.0176
No log	6.3077	164	0.9933	0.3769	0.9933	0.9966
No log	6.3846	166	0.9887	0.3616	0.9887	0.9943
No log	6.4615	168	1.0788	0.2276	1.0788	1.0387
No log	6.5385	170	1.2221	0.1379	1.2221	1.1055
No log	6.6154	172	1.3295	0.1005	1.3295	1.1530
No log	6.6923	174	1.2861	0.1579	1.2861	1.1341
No log	6.7692	176	1.1273	0.1585	1.1273	1.0617
No log	6.8462	178	1.0843	0.2083	1.0843	1.0413
No log	6.9231	180	1.1909	0.1144	1.1909	1.0913
No log	7.0	182	1.2396	0.1416	1.2396	1.1134
No log	7.0769	184	1.2099	0.1795	1.2099	1.1000
No log	7.1538	186	1.2403	0.1944	1.2403	1.1137
No log	7.2308	188	1.2124	0.0980	1.2124	1.1011
No log	7.3077	190	1.1744	0.0802	1.1744	1.0837
No log	7.3846	192	1.1965	0.0628	1.1965	1.0939
No log	7.4615	194	1.2757	0.1219	1.2757	1.1294
No log	7.5385	196	1.3125	0.2173	1.3125	1.1457
No log	7.6154	198	1.2198	0.2781	1.2198	1.1045
No log	7.6923	200	1.1712	0.2799	1.1712	1.0822
No log	7.7692	202	1.2920	0.2153	1.2920	1.1367
No log	7.8462	204	1.2456	0.1891	1.2456	1.1161
No log	7.9231	206	1.1769	0.1405	1.1769	1.0848
No log	8.0	208	1.1895	0.1440	1.1895	1.0907
No log	8.0769	210	1.1510	0.1282	1.1510	1.0728
No log	8.1538	212	1.1061	0.1442	1.1061	1.0517
No log	8.2308	214	1.1525	0.1281	1.1525	1.0736
No log	8.3077	216	1.1997	0.1053	1.1997	1.0953
No log	8.3846	218	1.2128	0.0887	1.2128	1.1013
No log	8.4615	220	1.2461	0.0887	1.2461	1.1163
No log	8.5385	222	1.2390	0.0887	1.2390	1.1131
No log	8.6154	224	1.1454	0.1860	1.1454	1.0702
No log	8.6923	226	1.1007	0.1773	1.1007	1.0492
No log	8.7692	228	1.1145	0.1379	1.1145	1.0557
No log	8.8462	230	1.2139	0.1053	1.2139	1.1018
No log	8.9231	232	1.3173	0.1536	1.3173	1.1478
No log	9.0	234	1.2776	0.1053	1.2776	1.1303
No log	9.0769	236	1.2772	0.1692	1.2772	1.1301
No log	9.1538	238	1.2798	0.0980	1.2798	1.1313
No log	9.2308	240	1.3257	0.0628	1.3257	1.1514
No log	9.3077	242	1.3089	0.0628	1.3089	1.1441
No log	9.3846	244	1.3339	0.0628	1.3339	1.1550
No log	9.4615	246	1.3421	0.0628	1.3421	1.1585
No log	9.5385	248	1.3827	0.0628	1.3827	1.1759
No log	9.6154	250	1.3271	0.0628	1.3271	1.1520
No log	9.6923	252	1.3135	0.0628	1.3135	1.1461
No log	9.7692	254	1.2366	0.0628	1.2366	1.1120
No log	9.8462	256	1.1856	0.0628	1.1856	1.0889
No log	9.9231	258	1.2020	0.0628	1.2020	1.0964
No log	10.0	260	1.2665	0.0628	1.2665	1.1254
No log	10.0769	262	1.2656	0.0628	1.2656	1.1250
No log	10.1538	264	1.2978	0.0628	1.2978	1.1392
No log	10.2308	266	1.3300	0.0628	1.3300	1.1533
No log	10.3077	268	1.3266	0.1188	1.3266	1.1518
No log	10.3846	270	1.2631	0.0980	1.2631	1.1239
No log	10.4615	272	1.3006	0.0980	1.3006	1.1404
No log	10.5385	274	1.4398	0.0619	1.4398	1.1999
No log	10.6154	276	1.4656	0.0619	1.4656	1.2106
No log	10.6923	278	1.3822	0.0961	1.3822	1.1757
No log	10.7692	280	1.2424	0.0628	1.2424	1.1146
No log	10.8462	282	1.1823	0.0711	1.1823	1.0873
No log	10.9231	284	1.1289	0.1217	1.1289	1.0625
No log	11.0	286	1.0974	0.1641	1.0974	1.0476
No log	11.0769	288	1.1198	0.1692	1.1198	1.0582
No log	11.1538	290	1.1692	0.1991	1.1692	1.0813
No log	11.2308	292	1.1489	0.1896	1.1489	1.0719
No log	11.3077	294	1.0872	0.1541	1.0872	1.0427
No log	11.3846	296	1.0928	0.1541	1.0928	1.0454
No log	11.4615	298	1.1389	0.0954	1.1389	1.0672
No log	11.5385	300	1.1876	0.1053	1.1876	1.0898
No log	11.6154	302	1.3061	0.1283	1.3061	1.1429
No log	11.6923	304	1.4156	0.1516	1.4156	1.1898
No log	11.7692	306	1.3619	0.1568	1.3619	1.1670
No log	11.8462	308	1.1674	0.2141	1.1674	1.0804
No log	11.9231	310	1.0626	0.1645	1.0626	1.0308
No log	12.0	312	1.0996	0.1247	1.0996	1.0486
No log	12.0769	314	1.1934	0.1217	1.1934	1.0924
No log	12.1538	316	1.2085	0.1217	1.2085	1.0993
No log	12.2308	318	1.2114	0.1053	1.2114	1.1006
No log	12.3077	320	1.1830	0.1053	1.1830	1.0877
No log	12.3846	322	1.1438	0.0802	1.1438	1.0695
No log	12.4615	324	1.1192	0.1148	1.1192	1.0579
No log	12.5385	326	1.0850	0.1541	1.0850	1.0416
No log	12.6154	328	1.1442	0.1846	1.1442	1.0697
No log	12.6923	330	1.1805	0.2141	1.1805	1.0865
No log	12.7692	332	1.0912	0.2439	1.0912	1.0446
No log	12.8462	334	1.0101	0.3478	1.0101	1.0050
No log	12.9231	336	1.0126	0.3169	1.0126	1.0063
No log	13.0	338	1.0982	0.1846	1.0982	1.0480
No log	13.0769	340	1.2410	0.1795	1.2410	1.1140
No log	13.1538	342	1.2347	0.1991	1.2347	1.1112
No log	13.2308	344	1.1507	0.1379	1.1507	1.0727
No log	13.3077	346	1.1060	0.1538	1.1060	1.0517
No log	13.3846	348	1.0491	0.1689	1.0491	1.0242
No log	13.4615	350	1.0424	0.1689	1.0424	1.0210
No log	13.5385	352	1.0616	0.1247	1.0616	1.0303
No log	13.6154	354	1.1068	0.1538	1.1068	1.0520
No log	13.6923	356	1.0876	0.2250	1.0876	1.0429
No log	13.7692	358	1.0866	0.2250	1.0866	1.0424
No log	13.8462	360	1.1584	0.2141	1.1584	1.0763
No log	13.9231	362	1.1186	0.1846	1.1186	1.0576
No log	14.0	364	1.0636	0.2250	1.0636	1.0313
No log	14.0769	366	1.0150	0.2336	1.0150	1.0075
No log	14.1538	368	1.0111	0.2674	1.0111	1.0055
No log	14.2308	370	1.0293	0.2781	1.0293	1.0146
No log	14.3077	372	1.0681	0.2336	1.0681	1.0335
No log	14.3846	374	1.1334	0.1282	1.1334	1.0646
No log	14.4615	376	1.1716	0.1896	1.1716	1.0824
No log	14.5385	378	1.1668	0.1896	1.1668	1.0802
No log	14.6154	380	1.1373	0.2439	1.1373	1.0665
No log	14.6923	382	1.1170	0.2263	1.1170	1.0569
No log	14.7692	384	1.1368	0.2108	1.1368	1.0662
No log	14.8462	386	1.2142	0.1896	1.2142	1.1019
No log	14.9231	388	1.2144	0.2046	1.2144	1.1020
No log	15.0	390	1.1815	0.2046	1.1815	1.0870
No log	15.0769	392	1.2097	0.2224	1.2097	1.0998
No log	15.1538	394	1.1333	0.2743	1.1333	1.0646
No log	15.2308	396	1.0415	0.3022	1.0415	1.0205
No log	15.3077	398	1.0095	0.3786	1.0095	1.0048
No log	15.3846	400	1.0359	0.2878	1.0359	1.0178
No log	15.4615	402	1.1577	0.2141	1.1577	1.0760
No log	15.5385	404	1.2803	0.1991	1.2803	1.1315
No log	15.6154	406	1.2558	0.1379	1.2558	1.1206
No log	15.6923	408	1.2025	0.0628	1.2025	1.0966
No log	15.7692	410	1.1570	0.0802	1.1570	1.0756
No log	15.8462	412	1.1081	0.0802	1.1081	1.0526
No log	15.9231	414	1.0763	0.1247	1.0763	1.0374
No log	16.0	416	1.1086	0.0802	1.1086	1.0529
No log	16.0769	418	1.2283	0.1538	1.2283	1.1083
No log	16.1538	420	1.4018	0.1991	1.4018	1.1840
No log	16.2308	422	1.4314	0.1790	1.4314	1.1964
No log	16.3077	424	1.3280	0.1692	1.3280	1.1524
No log	16.3846	426	1.1973	0.0880	1.1973	1.0942
No log	16.4615	428	1.1484	0.0802	1.1484	1.0716
No log	16.5385	430	1.1158	0.0802	1.1158	1.0563
No log	16.6154	432	1.1494	0.0880	1.1494	1.0721
No log	16.6923	434	1.2186	0.1217	1.2186	1.1039
No log	16.7692	436	1.2199	0.1217	1.2199	1.1045
No log	16.8462	438	1.1422	0.0880	1.1422	1.0687
No log	16.9231	440	1.0471	0.1211	1.0471	1.0233
No log	17.0	442	1.0410	0.1110	1.0410	1.0203
No log	17.0769	444	1.0448	0.1211	1.0448	1.0221
No log	17.1538	446	1.0957	0.1144	1.0957	1.0468
No log	17.2308	448	1.1340	0.0802	1.1340	1.0649
No log	17.3077	450	1.1954	0.0628	1.1954	1.0933
No log	17.3846	452	1.1850	0.0628	1.1850	1.0886
No log	17.4615	454	1.1402	0.0628	1.1402	1.0678
No log	17.5385	456	1.1183	0.0628	1.1183	1.0575
No log	17.6154	458	1.0877	0.1247	1.0877	1.0429
No log	17.6923	460	1.0930	0.1247	1.0930	1.0454
No log	17.7692	462	1.0750	0.1042	1.0750	1.0368
No log	17.8462	464	1.0547	0.1649	1.0547	1.0270
No log	17.9231	466	1.0388	0.2513	1.0388	1.0192
No log	18.0	468	1.0614	0.1706	1.0614	1.0302
No log	18.0769	470	1.1164	0.1217	1.1164	1.0566
No log	18.1538	472	1.1324	0.1846	1.1324	1.0642
No log	18.2308	474	1.1470	0.1692	1.1470	1.0710
No log	18.3077	476	1.1052	0.1217	1.1052	1.0513
No log	18.3846	478	1.0714	0.2119	1.0714	1.0351
No log	18.4615	480	1.0583	0.1752	1.0583	1.0288
No log	18.5385	482	1.0800	0.1480	1.0800	1.0392
No log	18.6154	484	1.1516	0.1379	1.1516	1.0731
No log	18.6923	486	1.1979	0.1692	1.1979	1.0945
No log	18.7692	488	1.2265	0.2278	1.2265	1.1075
No log	18.8462	490	1.2398	0.2080	1.2398	1.1135
No log	18.9231	492	1.1969	0.2278	1.1969	1.0940
No log	19.0	494	1.1035	0.2141	1.1035	1.0505
No log	19.0769	496	1.0624	0.1846	1.0624	1.0307
No log	19.1538	498	1.0540	0.1846	1.0540	1.0267
0.2993	19.2308	500	1.0915	0.2141	1.0915	1.0448
0.2993	19.3077	502	1.0914	0.2141	1.0914	1.0447
0.2993	19.3846	504	1.0703	0.1538	1.0703	1.0345
0.2993	19.4615	506	1.0513	0.1538	1.0513	1.0253
0.2993	19.5385	508	1.0926	0.1538	1.0926	1.0453
0.2993	19.6154	510	1.1052	0.1538	1.1052	1.0513

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1