ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0097
• Qwk: 0.2010
• Mse: 1.0097
• Rmse: 1.0049

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	2.5880	-0.0262	2.5880	1.6087
No log	0.1538	4	1.3290	0.0511	1.3290	1.1528
No log	0.2308	6	1.0293	-0.1255	1.0293	1.0145
No log	0.3077	8	0.9372	0.0	0.9372	0.9681
No log	0.3846	10	0.9429	-0.0425	0.9429	0.9710
No log	0.4615	12	0.9954	-0.0392	0.9954	0.9977
No log	0.5385	14	0.9280	-0.0070	0.9280	0.9633
No log	0.6154	16	0.9033	0.1504	0.9033	0.9504
No log	0.6923	18	0.9861	0.1962	0.9861	0.9930
No log	0.7692	20	1.0962	-0.0128	1.0962	1.0470
No log	0.8462	22	1.1395	-0.0281	1.1395	1.0675
No log	0.9231	24	1.1856	-0.2126	1.1856	1.0889
No log	1.0	26	1.0757	-0.0472	1.0757	1.0372
No log	1.0769	28	1.0227	0.1217	1.0227	1.0113
No log	1.1538	30	1.0181	0.0982	1.0181	1.0090
No log	1.2308	32	0.9611	0.1542	0.9611	0.9804
No log	1.3077	34	0.9876	0.1918	0.9876	0.9938
No log	1.3846	36	1.0594	-0.0634	1.0594	1.0293
No log	1.4615	38	1.0132	-0.0479	1.0132	1.0066
No log	1.5385	40	0.9048	0.0966	0.9048	0.9512
No log	1.6154	42	0.8778	0.2171	0.8778	0.9369
No log	1.6923	44	0.8321	0.1972	0.8321	0.9122
No log	1.7692	46	0.7792	0.1407	0.7792	0.8827
No log	1.8462	48	0.7523	0.1508	0.7523	0.8673
No log	1.9231	50	0.7500	0.1236	0.7500	0.8661
No log	2.0	52	0.7803	0.0	0.7803	0.8833
No log	2.0769	54	0.8039	0.0	0.8039	0.8966
No log	2.1538	56	0.8265	0.0359	0.8265	0.9091
No log	2.2308	58	0.8628	0.1094	0.8628	0.9288
No log	2.3077	60	0.9631	0.1504	0.9631	0.9814
No log	2.3846	62	1.1027	0.0487	1.1027	1.0501
No log	2.4615	64	1.1507	-0.0103	1.1507	1.0727
No log	2.5385	66	1.1129	0.1183	1.1129	1.0550
No log	2.6154	68	1.0895	0.0573	1.0895	1.0438
No log	2.6923	70	1.1576	-0.1665	1.1576	1.0759
No log	2.7692	72	1.1794	-0.0345	1.1794	1.0860
No log	2.8462	74	1.0468	-0.0960	1.0468	1.0232
No log	2.9231	76	0.9014	0.1737	0.9014	0.9494
No log	3.0	78	0.8860	0.1313	0.8860	0.9413
No log	3.0769	80	0.9551	0.1268	0.9551	0.9773
No log	3.1538	82	1.0243	0.0933	1.0243	1.0121
No log	3.2308	84	1.0979	-0.0197	1.0979	1.0478
No log	3.3077	86	1.1818	0.0236	1.1818	1.0871
No log	3.3846	88	1.1977	0.0563	1.1977	1.0944
No log	3.4615	90	1.1962	-0.0160	1.1962	1.0937
No log	3.5385	92	1.1861	-0.0358	1.1861	1.0891
No log	3.6154	94	1.1991	0.1348	1.1991	1.0950
No log	3.6923	96	1.1996	0.1384	1.1996	1.0952
No log	3.7692	98	1.1144	0.0205	1.1144	1.0556
No log	3.8462	100	1.0679	0.0880	1.0679	1.0334
No log	3.9231	102	1.0352	0.0839	1.0352	1.0174
No log	4.0	104	1.0267	0.0134	1.0267	1.0133
No log	4.0769	106	1.0912	0.1781	1.0912	1.0446
No log	4.1538	108	1.0991	0.1113	1.0991	1.0484
No log	4.2308	110	0.9769	0.0112	0.9769	0.9884
No log	4.3077	112	0.9873	0.1672	0.9873	0.9936
No log	4.3846	114	1.0436	0.1209	1.0436	1.0216
No log	4.4615	116	1.0371	0.1201	1.0371	1.0184
No log	4.5385	118	0.8985	0.1733	0.8985	0.9479
No log	4.6154	120	0.8914	0.1835	0.8914	0.9441
No log	4.6923	122	1.0718	0.1550	1.0718	1.0353
No log	4.7692	124	1.1169	0.1058	1.1169	1.0568
No log	4.8462	126	1.0090	0.1065	1.0090	1.0045
No log	4.9231	128	0.9941	0.1091	0.9941	0.9971
No log	5.0	130	1.1078	0.1814	1.1078	1.0525
No log	5.0769	132	1.0847	0.0753	1.0847	1.0415
No log	5.1538	134	1.0654	0.0682	1.0654	1.0322
No log	5.2308	136	1.1579	0.0904	1.1579	1.0761
No log	5.3077	138	1.1153	0.0784	1.1153	1.0561
No log	5.3846	140	1.0326	0.0379	1.0326	1.0162
No log	5.4615	142	1.0182	0.1500	1.0182	1.0090
No log	5.5385	144	1.0498	0.1528	1.0498	1.0246
No log	5.6154	146	0.9958	0.0748	0.9958	0.9979
No log	5.6923	148	1.0215	0.0031	1.0215	1.0107
No log	5.7692	150	1.0553	0.0600	1.0553	1.0273
No log	5.8462	152	1.0690	0.0934	1.0690	1.0339
No log	5.9231	154	1.0580	0.0934	1.0580	1.0286
No log	6.0	156	0.9976	0.0442	0.9976	0.9988
No log	6.0769	158	1.0277	0.0934	1.0277	1.0137
No log	6.1538	160	1.0270	0.1205	1.0270	1.0134
No log	6.2308	162	1.1108	0.1770	1.1108	1.0540
No log	6.3077	164	1.2049	0.0981	1.2049	1.0977
No log	6.3846	166	1.1724	0.0421	1.1724	1.0828
No log	6.4615	168	1.1042	0.1267	1.1042	1.0508
No log	6.5385	170	1.0496	0.0787	1.0496	1.0245
No log	6.6154	172	1.0370	0.1033	1.0370	1.0183
No log	6.6923	174	1.0327	0.0696	1.0327	1.0162
No log	6.7692	176	1.0037	0.0724	1.0037	1.0018
No log	6.8462	178	0.9832	0.0696	0.9832	0.9916
No log	6.9231	180	0.9401	0.0839	0.9401	0.9696
No log	7.0	182	0.9211	0.1216	0.9211	0.9598
No log	7.0769	184	0.9510	0.1031	0.9510	0.9752
No log	7.1538	186	0.9791	0.1031	0.9791	0.9895
No log	7.2308	188	1.0083	0.0968	1.0083	1.0042
No log	7.3077	190	1.0939	0.1859	1.0939	1.0459
No log	7.3846	192	1.0788	0.1615	1.0788	1.0387
No log	7.4615	194	1.0122	0.2026	1.0122	1.0061
No log	7.5385	196	1.0159	0.2274	1.0159	1.0079
No log	7.6154	198	1.0565	0.2274	1.0565	1.0279
No log	7.6923	200	1.1899	0.1310	1.1899	1.0908
No log	7.7692	202	1.2607	0.1462	1.2606	1.1228
No log	7.8462	204	1.2599	0.1587	1.2599	1.1225
No log	7.9231	206	1.2324	0.1230	1.2324	1.1101
No log	8.0	208	1.1566	0.0816	1.1566	1.0755
No log	8.0769	210	1.2020	0.1370	1.2020	1.0963
No log	8.1538	212	1.2181	0.1143	1.2181	1.1037
No log	8.2308	214	1.0737	0.2285	1.0737	1.0362
No log	8.3077	216	0.9272	0.2857	0.9272	0.9629
No log	8.3846	218	0.9017	0.3023	0.9017	0.9496
No log	8.4615	220	0.9177	0.3131	0.9177	0.9580
No log	8.5385	222	0.9841	0.2781	0.9841	0.9920
No log	8.6154	224	1.0694	0.2220	1.0694	1.0341
No log	8.6923	226	1.0335	0.2364	1.0335	1.0166
No log	8.7692	228	1.0381	0.1859	1.0381	1.0189
No log	8.8462	230	1.0463	0.2310	1.0463	1.0229
No log	8.9231	232	1.0518	0.2014	1.0518	1.0256
No log	9.0	234	0.9950	0.2055	0.9950	0.9975
No log	9.0769	236	0.9331	0.2348	0.9331	0.9660
No log	9.1538	238	0.9629	0.2210	0.9629	0.9813
No log	9.2308	240	1.0380	0.2097	1.0380	1.0188
No log	9.3077	242	1.0647	0.1935	1.0647	1.0319
No log	9.3846	244	0.9556	0.2633	0.9556	0.9776
No log	9.4615	246	0.8847	0.2270	0.8847	0.9406
No log	9.5385	248	0.8577	0.2078	0.8577	0.9261
No log	9.6154	250	0.8874	0.2270	0.8874	0.9420
No log	9.6923	252	1.0843	0.1860	1.0843	1.0413
No log	9.7692	254	1.2236	0.1117	1.2236	1.1062
No log	9.8462	256	1.0847	0.1434	1.0847	1.0415
No log	9.9231	258	0.9375	0.2749	0.9375	0.9682
No log	10.0	260	0.9235	0.3133	0.9235	0.9610
No log	10.0769	262	0.9330	0.2633	0.9330	0.9659
No log	10.1538	264	0.9932	0.1360	0.9932	0.9966
No log	10.2308	266	1.1015	0.1340	1.1015	1.0495
No log	10.3077	268	1.0769	0.1814	1.0769	1.0377
No log	10.3846	270	0.9423	0.2212	0.9423	0.9707
No log	10.4615	272	0.9350	0.2212	0.9350	0.9670
No log	10.5385	274	0.9736	0.2134	0.9736	0.9867
No log	10.6154	276	1.0312	0.2014	1.0312	1.0155
No log	10.6923	278	1.1068	0.1814	1.1068	1.0520
No log	10.7692	280	1.0791	0.1297	1.0791	1.0388
No log	10.8462	282	1.0086	0.1242	1.0086	1.0043
No log	10.9231	284	1.0696	0.1472	1.0696	1.0342
No log	11.0	286	1.2291	0.1224	1.2291	1.1087
No log	11.0769	288	1.1945	0.1281	1.1945	1.0929
No log	11.1538	290	1.0409	0.1826	1.0409	1.0203
No log	11.2308	292	0.9113	0.1592	0.9113	0.9546
No log	11.3077	294	0.8814	0.1253	0.8814	0.9388
No log	11.3846	296	0.9480	0.2359	0.9480	0.9736
No log	11.4615	298	1.1029	0.2260	1.1029	1.0502
No log	11.5385	300	1.1366	0.1789	1.1366	1.0661
No log	11.6154	302	1.0830	0.1578	1.0830	1.0407
No log	11.6923	304	1.1003	0.12	1.1003	1.0490
No log	11.7692	306	1.0554	0.1643	1.0554	1.0273
No log	11.8462	308	1.0458	0.1521	1.0458	1.0226
No log	11.9231	310	0.9745	0.2173	0.9745	0.9871
No log	12.0	312	1.0050	0.1541	1.0050	1.0025
No log	12.0769	314	1.0273	0.2166	1.0273	1.0135
No log	12.1538	316	1.0605	0.1697	1.0605	1.0298
No log	12.2308	318	1.0040	0.2274	1.0040	1.0020
No log	12.3077	320	0.9469	0.3060	0.9469	0.9731
No log	12.3846	322	0.9435	0.2808	0.9435	0.9714
No log	12.4615	324	0.9795	0.2443	0.9795	0.9897
No log	12.5385	326	1.1435	0.1504	1.1435	1.0694
No log	12.6154	328	1.2338	0.1351	1.2338	1.1108
No log	12.6923	330	1.1411	0.1233	1.1411	1.0682
No log	12.7692	332	1.0558	0.1107	1.0558	1.0275
No log	12.8462	334	1.1041	0.1112	1.1041	1.0507
No log	12.9231	336	1.1019	0.1281	1.1019	1.0497
No log	13.0	338	1.1769	0.0954	1.1769	1.0848
No log	13.0769	340	1.3153	0.1042	1.3153	1.1469
No log	13.1538	342	1.3293	0.1544	1.3293	1.1529
No log	13.2308	344	1.2305	0.0881	1.2305	1.1093
No log	13.3077	346	1.0605	0.1898	1.0605	1.0298
No log	13.3846	348	1.0336	0.1760	1.0336	1.0167
No log	13.4615	350	1.0844	0.1643	1.0844	1.0413
No log	13.5385	352	1.2253	0.1169	1.2253	1.1069
No log	13.6154	354	1.2686	0.0861	1.2686	1.1263
No log	13.6923	356	1.2865	0.0838	1.2865	1.1342
No log	13.7692	358	1.1673	0.0909	1.1673	1.0804
No log	13.8462	360	1.0572	0.1503	1.0572	1.0282
No log	13.9231	362	1.0106	0.1992	1.0106	1.0053
No log	14.0	364	1.0273	0.1720	1.0273	1.0136
No log	14.0769	366	1.1960	0.1252	1.1960	1.0936
No log	14.1538	368	1.4702	0.1867	1.4702	1.2125
No log	14.2308	370	1.5247	0.0789	1.5247	1.2348
No log	14.3077	372	1.4049	0.1075	1.4049	1.1853
No log	14.3846	374	1.2305	0.1655	1.2305	1.1093
No log	14.4615	376	1.0369	0.2354	1.0369	1.0183
No log	14.5385	378	0.9408	0.2389	0.9408	0.9700
No log	14.6154	380	0.9340	0.2109	0.9340	0.9665
No log	14.6923	382	0.9929	0.1771	0.9929	0.9964
No log	14.7692	384	1.1476	0.1835	1.1476	1.0713
No log	14.8462	386	1.2618	0.1299	1.2618	1.1233
No log	14.9231	388	1.2086	0.1383	1.2086	1.0993
No log	15.0	390	1.1131	0.1860	1.1131	1.0550
No log	15.0769	392	1.0517	0.2442	1.0517	1.0255
No log	15.1538	394	1.0799	0.2444	1.0799	1.0392
No log	15.2308	396	1.0567	0.2329	1.0567	1.0280
No log	15.3077	398	1.0605	0.2658	1.0605	1.0298
No log	15.3846	400	1.0252	0.2533	1.0252	1.0125
No log	15.4615	402	1.0748	0.2444	1.0748	1.0367
No log	15.5385	404	1.1733	0.1745	1.1733	1.0832
No log	15.6154	406	1.1405	0.2028	1.1405	1.0679
No log	15.6923	408	1.0389	0.2444	1.0389	1.0193
No log	15.7692	410	0.9540	0.3409	0.9540	0.9767
No log	15.8462	412	0.9785	0.3456	0.9785	0.9892
No log	15.9231	414	1.1188	0.1711	1.1188	1.0577
No log	16.0	416	1.3100	0.1019	1.3100	1.1445
No log	16.0769	418	1.2947	0.1272	1.2947	1.1378
No log	16.1538	420	1.1372	0.1720	1.1372	1.0664
No log	16.2308	422	1.0445	0.2958	1.0445	1.0220
No log	16.3077	424	0.9654	0.2917	0.9654	0.9826
No log	16.3846	426	0.9621	0.2917	0.9621	0.9809
No log	16.4615	428	0.9968	0.3100	0.9968	0.9984
No log	16.5385	430	1.0840	0.3022	1.0840	1.0411
No log	16.6154	432	1.0851	0.2853	1.0851	1.0417
No log	16.6923	434	1.0579	0.2329	1.0579	1.0286
No log	16.7692	436	1.0208	0.2374	1.0208	1.0104
No log	16.8462	438	1.0663	0.2627	1.0663	1.0326
No log	16.9231	440	1.1630	0.1789	1.1630	1.0784
No log	17.0	442	1.1734	0.1569	1.1734	1.0832
No log	17.0769	444	1.0889	0.2070	1.0889	1.0435
No log	17.1538	446	1.0287	0.2917	1.0287	1.0142
No log	17.2308	448	1.0631	0.2807	1.0631	1.0311
No log	17.3077	450	1.1701	0.1645	1.1701	1.0817
No log	17.3846	452	1.2903	0.0810	1.2903	1.1359
No log	17.4615	454	1.2838	0.1067	1.2838	1.1331
No log	17.5385	456	1.1800	0.2080	1.1800	1.0863
No log	17.6154	458	1.1129	0.2260	1.1129	1.0549
No log	17.6923	460	1.0943	0.2303	1.0943	1.0461
No log	17.7692	462	1.0818	0.1988	1.0818	1.0401
No log	17.8462	464	1.1121	0.1716	1.1121	1.0546
No log	17.9231	466	1.1349	0.1716	1.1349	1.0653
No log	18.0	468	1.0707	0.1819	1.0707	1.0347
No log	18.0769	470	0.9646	0.2375	0.9646	0.9821
No log	18.1538	472	0.9053	0.2342	0.9053	0.9515
No log	18.2308	474	0.8909	0.2605	0.8909	0.9439
No log	18.3077	476	0.9064	0.3051	0.9064	0.9521
No log	18.3846	478	0.9326	0.2348	0.9326	0.9657
No log	18.4615	480	0.9321	0.2778	0.9321	0.9655
No log	18.5385	482	0.9053	0.2551	0.9053	0.9515
No log	18.6154	484	0.9325	0.2778	0.9325	0.9657
No log	18.6923	486	1.0103	0.3068	1.0103	1.0051
No log	18.7692	488	1.0640	0.2394	1.0640	1.0315
No log	18.8462	490	1.0341	0.2727	1.0341	1.0169
No log	18.9231	492	0.9847	0.2054	0.9847	0.9923
No log	19.0	494	0.9631	0.1843	0.9631	0.9814
No log	19.0769	496	1.0043	0.2301	1.0043	1.0022
No log	19.1538	498	1.1057	0.2183	1.1057	1.0515
0.3145	19.2308	500	1.1468	0.2028	1.1468	1.0709
0.3145	19.3077	502	1.0784	0.2934	1.0784	1.0384
0.3145	19.3846	504	0.9842	0.3069	0.9842	0.9921
0.3145	19.4615	506	0.9177	0.2995	0.9177	0.9580
0.3145	19.5385	508	0.9067	0.2335	0.9067	0.9522
0.3145	19.6154	510	0.9288	0.2523	0.9288	0.9638
0.3145	19.6923	512	0.9852	0.2590	0.9852	0.9926
0.3145	19.7692	514	1.0303	0.2807	1.0303	1.0151
0.3145	19.8462	516	1.0799	0.1743	1.0799	1.0392
0.3145	19.9231	518	1.1502	0.1340	1.1502	1.0725
0.3145	20.0	520	1.1570	0.1340	1.1570	1.0757
0.3145	20.0769	522	1.0532	0.1259	1.0532	1.0262
0.3145	20.1538	524	1.0097	0.2010	1.0097	1.0049

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1