ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4783
• Qwk: 0.0942
• Mse: 1.4783
• Rmse: 1.2158

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0278	2	4.3908	0.0018	4.3908	2.0954
No log	0.0556	4	2.4684	0.0163	2.4684	1.5711
No log	0.0833	6	1.8910	0.0062	1.8910	1.3751
No log	0.1111	8	1.4190	0.0784	1.4190	1.1912
No log	0.1389	10	1.2558	0.0499	1.2558	1.1206
No log	0.1667	12	1.2964	0.0904	1.2964	1.1386
No log	0.1944	14	1.3326	0.0904	1.3326	1.1544
No log	0.2222	16	1.2447	0.0904	1.2447	1.1157
No log	0.25	18	1.2347	0.1343	1.2347	1.1112
No log	0.2778	20	1.2280	0.1773	1.2280	1.1082
No log	0.3056	22	1.2518	0.1870	1.2518	1.1188
No log	0.3333	24	1.2334	0.2424	1.2334	1.1106
No log	0.3611	26	1.1877	0.2142	1.1877	1.0898
No log	0.3889	28	1.1751	0.2939	1.1751	1.0840
No log	0.4167	30	1.3100	0.1266	1.3100	1.1445
No log	0.4444	32	1.2866	0.1203	1.2866	1.1343
No log	0.4722	34	1.2285	0.1793	1.2285	1.1084
No log	0.5	36	1.2166	0.1793	1.2166	1.1030
No log	0.5278	38	1.1990	0.2304	1.1990	1.0950
No log	0.5556	40	1.2417	0.0527	1.2417	1.1143
No log	0.5833	42	1.2153	0.0671	1.2153	1.1024
No log	0.6111	44	1.1962	0.2257	1.1962	1.0937
No log	0.6389	46	1.2540	0.1519	1.2540	1.1198
No log	0.6667	48	1.4859	0.0385	1.4859	1.2190
No log	0.6944	50	1.7331	-0.0149	1.7331	1.3165
No log	0.7222	52	1.9043	0.0527	1.9043	1.3800
No log	0.75	54	2.3084	0.0692	2.3084	1.5193
No log	0.7778	56	2.0933	0.0971	2.0933	1.4468
No log	0.8056	58	1.9252	0.0	1.9252	1.3875
No log	0.8333	60	1.6539	0.0	1.6539	1.2860
No log	0.8611	62	1.3286	0.0189	1.3286	1.1527
No log	0.8889	64	1.1943	0.2574	1.1943	1.0929
No log	0.9167	66	1.1838	0.2351	1.1838	1.0880
No log	0.9444	68	1.1985	0.2834	1.1985	1.0948
No log	0.9722	70	1.2564	0.0494	1.2564	1.1209
No log	1.0	72	1.4554	-0.0057	1.4554	1.2064
No log	1.0278	74	1.5507	-0.0170	1.5507	1.2453
No log	1.0556	76	1.3413	0.0687	1.3413	1.1581
No log	1.0833	78	1.3099	0.0896	1.3099	1.1445
No log	1.1111	80	1.3275	0.0958	1.3275	1.1522
No log	1.1389	82	1.3039	0.0948	1.3039	1.1419
No log	1.1667	84	1.2896	0.1370	1.2896	1.1356
No log	1.1944	86	1.3087	0.1085	1.3087	1.1440
No log	1.2222	88	1.2936	0.1706	1.2936	1.1374
No log	1.25	90	1.3511	0.1112	1.3511	1.1624
No log	1.2778	92	1.5552	0.0972	1.5552	1.2471
No log	1.3056	94	1.4761	0.0835	1.4761	1.2149
No log	1.3333	96	1.5272	0.0986	1.5272	1.2358
No log	1.3611	98	1.5402	0.0676	1.5402	1.2411
No log	1.3889	100	1.5763	0.0748	1.5763	1.2555
No log	1.4167	102	1.5962	0.1171	1.5962	1.2634
No log	1.4444	104	1.4926	0.0436	1.4926	1.2217
No log	1.4722	106	1.3399	0.0253	1.3399	1.1576
No log	1.5	108	1.3434	0.1044	1.3434	1.1591
No log	1.5278	110	1.7306	-0.0538	1.7306	1.3155
No log	1.5556	112	1.7733	-0.0462	1.7733	1.3316
No log	1.5833	114	1.4248	0.0389	1.4248	1.1937
No log	1.6111	116	1.3030	0.0571	1.3030	1.1415
No log	1.6389	118	1.3709	0.0711	1.3709	1.1709
No log	1.6667	120	1.3963	0.0541	1.3963	1.1816
No log	1.6944	122	1.4351	-0.0072	1.4351	1.1979
No log	1.7222	124	1.4204	0.0442	1.4204	1.1918
No log	1.75	126	1.4773	-0.0438	1.4773	1.2154
No log	1.7778	128	1.6016	-0.0060	1.6016	1.2655
No log	1.8056	130	1.7061	0.0170	1.7061	1.3062
No log	1.8333	132	1.7540	0.0039	1.7540	1.3244
No log	1.8611	134	1.8960	0.0562	1.8960	1.3770
No log	1.8889	136	1.7839	0.0078	1.7839	1.3356
No log	1.9167	138	1.7995	0.0235	1.7995	1.3414
No log	1.9444	140	1.8029	-0.0023	1.8029	1.3427
No log	1.9722	142	1.8423	0.0475	1.8423	1.3573
No log	2.0	144	2.0453	-0.1564	2.0453	1.4301
No log	2.0278	146	1.9214	-0.1329	1.9214	1.3861
No log	2.0556	148	1.6678	-0.0708	1.6678	1.2914
No log	2.0833	150	1.6755	-0.0137	1.6755	1.2944
No log	2.1111	152	1.6419	0.0398	1.6419	1.2814
No log	2.1389	154	1.6394	0.0207	1.6394	1.2804
No log	2.1667	156	1.6628	0.0608	1.6628	1.2895
No log	2.1944	158	1.7102	0.0449	1.7102	1.3077
No log	2.2222	160	1.6743	0.0733	1.6743	1.2939
No log	2.25	162	1.6715	0.1079	1.6715	1.2929
No log	2.2778	164	1.7017	0.0449	1.7017	1.3045
No log	2.3056	166	1.8287	0.0334	1.8287	1.3523
No log	2.3333	168	1.8776	0.1555	1.8776	1.3702
No log	2.3611	170	1.6171	-0.0027	1.6171	1.2717
No log	2.3889	172	1.3943	0.0789	1.3943	1.1808
No log	2.4167	174	1.3739	0.0472	1.3739	1.1722
No log	2.4444	176	1.3862	0.0741	1.3862	1.1774
No log	2.4722	178	1.4410	0.0596	1.4410	1.2004
No log	2.5	180	1.6134	-0.0393	1.6134	1.2702
No log	2.5278	182	1.7460	0.0396	1.7460	1.3214
No log	2.5556	184	1.6180	-0.0465	1.6180	1.2720
No log	2.5833	186	1.6388	0.0515	1.6388	1.2802
No log	2.6111	188	1.8448	0.0310	1.8448	1.3582
No log	2.6389	190	2.1639	0.1395	2.1639	1.4710
No log	2.6667	192	2.0278	0.1653	2.0278	1.4240
No log	2.6944	194	1.7109	0.0194	1.7109	1.3080
No log	2.7222	196	1.5241	0.0878	1.5241	1.2345
No log	2.75	198	1.5178	0.1371	1.5178	1.2320
No log	2.7778	200	1.5625	0.0453	1.5625	1.2500
No log	2.8056	202	1.7833	0.1257	1.7833	1.3354
No log	2.8333	204	2.0563	0.1476	2.0563	1.4340
No log	2.8611	206	2.0022	0.1524	2.0022	1.4150
No log	2.8889	208	1.7258	0.0534	1.7258	1.3137
No log	2.9167	210	1.5927	-0.0888	1.5927	1.2620
No log	2.9444	212	1.5300	0.0138	1.5300	1.2369
No log	2.9722	214	1.5205	0.1564	1.5205	1.2331
No log	3.0	216	1.4998	0.0568	1.4998	1.2247
No log	3.0278	218	1.5497	0.0	1.5497	1.2449
No log	3.0556	220	1.6096	-0.0202	1.6096	1.2687
No log	3.0833	222	1.6129	-0.0202	1.6129	1.2700
No log	3.1111	224	1.6368	0.0657	1.6368	1.2794
No log	3.1389	226	1.6984	0.0271	1.6984	1.3032
No log	3.1667	228	1.8088	0.0770	1.8088	1.3449
No log	3.1944	230	1.9363	0.1653	1.9363	1.3915
No log	3.2222	232	1.8870	0.1577	1.8870	1.3737
No log	3.25	234	1.7260	0.0894	1.7260	1.3138
No log	3.2778	236	1.6076	0.0338	1.6076	1.2679
No log	3.3056	238	1.4783	-0.0183	1.4783	1.2159
No log	3.3333	240	1.5074	0.0613	1.5074	1.2277
No log	3.3611	242	1.5532	0.0586	1.5532	1.2463
No log	3.3889	244	1.5473	-0.0469	1.5473	1.2439
No log	3.4167	246	1.6608	0.0479	1.6608	1.2887
No log	3.4444	248	1.8463	0.0838	1.8463	1.3588
No log	3.4722	250	1.8613	0.0064	1.8613	1.3643
No log	3.5	252	1.7990	0.0222	1.7990	1.3413
No log	3.5278	254	1.8177	-0.0156	1.8177	1.3482
No log	3.5556	256	1.8382	0.0033	1.8382	1.3558
No log	3.5833	258	1.9061	0.0875	1.9061	1.3806
No log	3.6111	260	1.9296	0.1367	1.9296	1.3891
No log	3.6389	262	1.7995	0.1075	1.7995	1.3415
No log	3.6667	264	1.5736	-0.0277	1.5736	1.2544
No log	3.6944	266	1.4933	0.0327	1.4933	1.2220
No log	3.7222	268	1.4773	0.0571	1.4773	1.2155
No log	3.75	270	1.5044	-0.0043	1.5044	1.2265
No log	3.7778	272	1.5844	-0.0462	1.5844	1.2587
No log	3.8056	274	1.7438	0.0066	1.7438	1.3205
No log	3.8333	276	1.7531	0.0470	1.7531	1.3241
No log	3.8611	278	1.6838	-0.0043	1.6838	1.2976
No log	3.8889	280	1.6424	-0.0346	1.6424	1.2816
No log	3.9167	282	1.6533	-0.0293	1.6533	1.2858
No log	3.9444	284	1.6947	-0.0163	1.6947	1.3018
No log	3.9722	286	1.7148	-0.0452	1.7148	1.3095
No log	4.0	288	1.7771	0.0108	1.7771	1.3331
No log	4.0278	290	1.7063	-0.0374	1.7063	1.3063
No log	4.0556	292	1.6665	-0.0316	1.6665	1.2909
No log	4.0833	294	1.6763	-0.0316	1.6763	1.2947
No log	4.1111	296	1.7826	0.0017	1.7826	1.3351
No log	4.1389	298	1.9592	-0.0130	1.9592	1.3997
No log	4.1667	300	2.0569	0.0665	2.0569	1.4342
No log	4.1944	302	1.9460	0.0267	1.9460	1.3950
No log	4.2222	304	1.7347	-0.0336	1.7347	1.3171
No log	4.25	306	1.7109	-0.0377	1.7109	1.3080
No log	4.2778	308	1.7351	-0.0544	1.7351	1.3172
No log	4.3056	310	1.7682	-0.0475	1.7682	1.3297
No log	4.3333	312	1.7750	-0.0490	1.7750	1.3323
No log	4.3611	314	1.8296	-0.0153	1.8296	1.3526
No log	4.3889	316	1.9519	0.0327	1.9519	1.3971
No log	4.4167	318	1.9059	0.0643	1.9059	1.3805
No log	4.4444	320	1.7882	0.0441	1.7882	1.3372
No log	4.4722	322	1.6162	-0.0192	1.6162	1.2713
No log	4.5	324	1.6141	-0.0316	1.6141	1.2705
No log	4.5278	326	1.6037	0.0206	1.6037	1.2664
No log	4.5556	328	1.6305	0.0169	1.6305	1.2769
No log	4.5833	330	1.7795	0.0673	1.7795	1.3340
No log	4.6111	332	1.9452	0.1634	1.9452	1.3947
No log	4.6389	334	1.9325	0.1433	1.9325	1.3902
No log	4.6667	336	1.7774	0.0842	1.7774	1.3332
No log	4.6944	338	1.6904	0.0667	1.6904	1.3001
No log	4.7222	340	1.6976	0.0643	1.6976	1.3029
No log	4.75	342	1.6880	0.0297	1.6880	1.2992
No log	4.7778	344	1.6321	0.0774	1.6321	1.2775
No log	4.8056	346	1.5955	0.0618	1.5955	1.2631
No log	4.8333	348	1.5545	0.0774	1.5545	1.2468
No log	4.8611	350	1.4817	0.0159	1.4817	1.2172
No log	4.8889	352	1.4483	0.0159	1.4483	1.2034
No log	4.9167	354	1.4751	0.0177	1.4751	1.2145
No log	4.9444	356	1.5550	0.1027	1.5550	1.2470
No log	4.9722	358	1.5540	0.0732	1.5540	1.2466
No log	5.0	360	1.4568	0.0415	1.4568	1.2070
No log	5.0278	362	1.4346	0.0222	1.4346	1.1977
No log	5.0556	364	1.4950	-0.0602	1.4950	1.2227
No log	5.0833	366	1.6808	0.0587	1.6808	1.2965
No log	5.1111	368	1.8208	0.1675	1.8208	1.3494
No log	5.1389	370	1.7587	0.1139	1.7587	1.3262
No log	5.1667	372	1.5895	0.1522	1.5895	1.2608
No log	5.1944	374	1.5090	0.0669	1.5090	1.2284
No log	5.2222	376	1.4882	0.1452	1.4882	1.2199
No log	5.25	378	1.4928	0.0595	1.4928	1.2218
No log	5.2778	380	1.4942	0.1387	1.4942	1.2224
No log	5.3056	382	1.5519	0.1132	1.5519	1.2458
No log	5.3333	384	1.4782	0.0549	1.4782	1.2158
No log	5.3611	386	1.3654	0.1027	1.3654	1.1685
No log	5.3889	388	1.3137	0.1279	1.3137	1.1462
No log	5.4167	390	1.3961	0.0266	1.3961	1.1816
No log	5.4444	392	1.7273	0.1443	1.7273	1.3143
No log	5.4722	394	1.9781	0.2008	1.9781	1.4065
No log	5.5	396	1.9302	0.1814	1.9302	1.3893
No log	5.5278	398	1.6593	0.1113	1.6593	1.2881
No log	5.5556	400	1.4817	0.0476	1.4817	1.2173
No log	5.5833	402	1.4839	0.0539	1.4839	1.2182
No log	5.6111	404	1.5411	0.0084	1.5411	1.2414
No log	5.6389	406	1.6166	0.0268	1.6166	1.2715
No log	5.6667	408	1.6759	0.1040	1.6759	1.2946
No log	5.6944	410	1.7155	0.1282	1.7155	1.3098
No log	5.7222	412	1.5840	0.0560	1.5840	1.2586
No log	5.75	414	1.4812	-0.0088	1.4812	1.2171
No log	5.7778	416	1.4502	0.0542	1.4502	1.2043
No log	5.8056	418	1.4523	0.0120	1.4523	1.2051
No log	5.8333	420	1.5046	0.0578	1.5046	1.2266
No log	5.8611	422	1.6303	0.1230	1.6303	1.2768
No log	5.8889	424	1.6661	0.1407	1.6661	1.2908
No log	5.9167	426	1.6109	0.1562	1.6109	1.2692
No log	5.9444	428	1.5508	0.1597	1.5508	1.2453
No log	5.9722	430	1.5330	0.1763	1.5330	1.2382
No log	6.0	432	1.4522	0.0647	1.4522	1.2051
No log	6.0278	434	1.3670	0.1405	1.3670	1.1692
No log	6.0556	436	1.3098	0.0916	1.3098	1.1445
No log	6.0833	438	1.3019	0.0556	1.3019	1.1410
No log	6.1111	440	1.3161	0.0916	1.3161	1.1472
No log	6.1389	442	1.4048	0.0741	1.4048	1.1853
No log	6.1667	444	1.4405	0.0426	1.4405	1.2002
No log	6.1944	446	1.4197	0.0339	1.4197	1.1915
No log	6.2222	448	1.4177	0.0412	1.4177	1.1907
No log	6.25	450	1.4915	0.1226	1.4915	1.2213
No log	6.2778	452	1.5652	0.1040	1.5652	1.2511
No log	6.3056	454	1.5836	0.1280	1.5836	1.2584
No log	6.3333	456	1.6084	0.1445	1.6084	1.2682
No log	6.3611	458	1.6110	0.1621	1.6110	1.2692
No log	6.3889	460	1.6264	0.1850	1.6264	1.2753
No log	6.4167	462	1.6416	0.1850	1.6416	1.2813
No log	6.4444	464	1.5420	0.1041	1.5420	1.2418
No log	6.4722	466	1.4671	0.0723	1.4671	1.2112
No log	6.5	468	1.4591	0.0260	1.4591	1.2079
No log	6.5278	470	1.4976	0.0575	1.4976	1.2238
No log	6.5556	472	1.6001	0.1687	1.6001	1.2649
No log	6.5833	474	1.5693	0.1436	1.5693	1.2527
No log	6.6111	476	1.4444	0.0876	1.4444	1.2018
No log	6.6389	478	1.4022	0.1396	1.4022	1.1841
No log	6.6667	480	1.4127	0.1363	1.4127	1.1886
No log	6.6944	482	1.4735	0.0796	1.4735	1.2139
No log	6.7222	484	1.7272	0.1675	1.7272	1.3142
No log	6.75	486	2.1160	0.1672	2.1160	1.4546
No log	6.7778	488	2.2333	0.1064	2.2333	1.4944
No log	6.8056	490	2.0500	0.1439	2.0500	1.4318
No log	6.8333	492	1.7347	0.1848	1.7347	1.3171
No log	6.8611	494	1.4386	0.1071	1.4386	1.1994
No log	6.8889	496	1.3194	0.0415	1.3194	1.1486
No log	6.9167	498	1.3173	0.1505	1.3173	1.1477
0.4337	6.9444	500	1.3551	0.1015	1.3551	1.1641
0.4337	6.9722	502	1.4226	0.0822	1.4226	1.1927
0.4337	7.0	504	1.5548	0.1282	1.5548	1.2469
0.4337	7.0278	506	1.6336	0.1436	1.6336	1.2781
0.4337	7.0556	508	1.5623	0.1549	1.5623	1.2499
0.4337	7.0833	510	1.4634	0.0575	1.4634	1.2097
0.4337	7.1111	512	1.4433	0.0668	1.4433	1.2014
0.4337	7.1389	514	1.4810	0.0942	1.4810	1.2169
0.4337	7.1667	516	1.4692	0.0942	1.4692	1.2121
0.4337	7.1944	518	1.4783	0.0942	1.4783	1.2158

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1