ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0617
• Qwk: 0.1406
• Mse: 1.0617
• Rmse: 1.0304

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.8823	-0.0104	4.8823	2.2096
No log	0.0870	4	3.0637	-0.0729	3.0637	1.7503
No log	0.1304	6	2.4830	-0.0340	2.4830	1.5757
No log	0.1739	8	1.8587	0.0397	1.8587	1.3633
No log	0.2174	10	1.5384	0.0398	1.5384	1.2403
No log	0.2609	12	1.3876	0.0485	1.3876	1.1780
No log	0.3043	14	1.3398	0.0389	1.3398	1.1575
No log	0.3478	16	1.3436	0.0522	1.3436	1.1591
No log	0.3913	18	1.3637	-0.0029	1.3637	1.1678
No log	0.4348	20	1.4835	0.0019	1.4835	1.2180
No log	0.4783	22	1.5273	0.0019	1.5273	1.2358
No log	0.5217	24	1.4323	0.0838	1.4323	1.1968
No log	0.5652	26	1.3511	0.0803	1.3511	1.1624
No log	0.6087	28	1.2622	0.1483	1.2622	1.1235
No log	0.6522	30	1.2476	0.1470	1.2476	1.1170
No log	0.6957	32	1.2979	0.0880	1.2979	1.1393
No log	0.7391	34	1.2941	0.1185	1.2941	1.1376
No log	0.7826	36	1.2643	0.2358	1.2643	1.1244
No log	0.8261	38	1.3332	0.0961	1.3332	1.1546
No log	0.8696	40	1.2188	0.2697	1.2188	1.1040
No log	0.9130	42	1.2264	0.2011	1.2264	1.1074
No log	0.9565	44	1.4547	0.3140	1.4547	1.2061
No log	1.0	46	1.4473	0.3345	1.4473	1.2031
No log	1.0435	48	1.1903	0.2563	1.1903	1.0910
No log	1.0870	50	1.1060	0.3671	1.1060	1.0516
No log	1.1304	52	1.2921	0.1875	1.2921	1.1367
No log	1.1739	54	1.2332	0.1730	1.2332	1.1105
No log	1.2174	56	1.0220	0.4726	1.0220	1.0109
No log	1.2609	58	1.0164	0.3157	1.0164	1.0082
No log	1.3043	60	1.3631	0.3821	1.3631	1.1675
No log	1.3478	62	1.4058	0.3067	1.4058	1.1857
No log	1.3913	64	1.0978	0.1679	1.0978	1.0478
No log	1.4348	66	1.0070	0.3970	1.0070	1.0035
No log	1.4783	68	1.0706	0.3394	1.0706	1.0347
No log	1.5217	70	1.0281	0.3970	1.0281	1.0139
No log	1.5652	72	1.0016	0.2993	1.0016	1.0008
No log	1.6087	74	1.0069	0.3392	1.0069	1.0034
No log	1.6522	76	1.0068	0.3139	1.0068	1.0034
No log	1.6957	78	1.1462	0.3106	1.1462	1.0706
No log	1.7391	80	1.2566	0.3411	1.2566	1.1210
No log	1.7826	82	1.2903	0.3544	1.2903	1.1359
No log	1.8261	84	1.1655	0.2981	1.1655	1.0796
No log	1.8696	86	1.0460	0.4409	1.0460	1.0228
No log	1.9130	88	1.0082	0.4409	1.0082	1.0041
No log	1.9565	90	1.0379	0.3106	1.0379	1.0188
No log	2.0	92	1.1715	0.3805	1.1715	1.0824
No log	2.0435	94	1.2905	0.3856	1.2905	1.1360
No log	2.0870	96	1.2584	0.3523	1.2584	1.1218
No log	2.1304	98	1.0562	0.3064	1.0562	1.0277
No log	2.1739	100	0.9202	0.3890	0.9202	0.9593
No log	2.2174	102	0.9831	0.4587	0.9831	0.9915
No log	2.2609	104	0.9483	0.4158	0.9483	0.9738
No log	2.3043	106	0.9764	0.4200	0.9764	0.9881
No log	2.3478	108	1.3043	0.3929	1.3043	1.1421
No log	2.3913	110	1.4216	0.3706	1.4216	1.1923
No log	2.4348	112	1.3848	0.3839	1.3848	1.1768
No log	2.4783	114	1.2693	0.3567	1.2693	1.1266
No log	2.5217	116	1.1945	0.3665	1.1945	1.0929
No log	2.5652	118	1.2862	0.3448	1.2862	1.1341
No log	2.6087	120	1.3747	0.3943	1.3747	1.1725
No log	2.6522	122	1.2619	0.3862	1.2619	1.1234
No log	2.6957	124	1.0532	0.3294	1.0532	1.0263
No log	2.7391	126	0.9787	0.3449	0.9787	0.9893
No log	2.7826	128	0.9634	0.2947	0.9634	0.9815
No log	2.8261	130	0.9808	0.3449	0.9808	0.9904
No log	2.8696	132	1.0371	0.3842	1.0371	1.0184
No log	2.9130	134	1.0070	0.3836	1.0070	1.0035
No log	2.9565	136	0.9508	0.4241	0.9508	0.9751
No log	3.0	138	0.9912	0.3511	0.9912	0.9956
No log	3.0435	140	0.9795	0.3896	0.9795	0.9897
No log	3.0870	142	1.0559	0.3830	1.0559	1.0276
No log	3.1304	144	1.3058	0.3872	1.3058	1.1427
No log	3.1739	146	1.2716	0.3963	1.2716	1.1277
No log	3.2174	148	1.0938	0.3317	1.0938	1.0458
No log	3.2609	150	0.9926	0.3890	0.9926	0.9963
No log	3.3043	152	0.9950	0.3483	0.9950	0.9975
No log	3.3478	154	0.9993	0.3890	0.9993	0.9996
No log	3.3913	156	1.1318	0.2704	1.1318	1.0639
No log	3.4348	158	1.3315	0.3474	1.3315	1.1539
No log	3.4783	160	1.3752	0.3357	1.3752	1.1727
No log	3.5217	162	1.2454	0.3136	1.2454	1.1160
No log	3.5652	164	1.0399	0.3136	1.0399	1.0197
No log	3.6087	166	0.9877	0.3896	0.9877	0.9939
No log	3.6522	168	0.9882	0.3641	0.9882	0.9941
No log	3.6957	170	0.9769	0.3641	0.9769	0.9884
No log	3.7391	172	0.9690	0.3641	0.9690	0.9844
No log	3.7826	174	0.9850	0.4611	0.9850	0.9925
No log	3.8261	176	1.1241	0.3888	1.1241	1.0602
No log	3.8696	178	1.1779	0.3907	1.1779	1.0853
No log	3.9130	180	1.0656	0.4113	1.0656	1.0323
No log	3.9565	182	0.9884	0.4409	0.9884	0.9942
No log	4.0	184	0.9821	0.3948	0.9821	0.9910
No log	4.0435	186	1.0230	0.4237	1.0230	1.0114
No log	4.0870	188	1.1355	0.4275	1.1355	1.0656
No log	4.1304	190	1.1555	0.3987	1.1555	1.0749
No log	4.1739	192	1.1098	0.3469	1.1098	1.0535
No log	4.2174	194	1.0228	0.3455	1.0228	1.0113
No log	4.2609	196	1.0071	0.4218	1.0071	1.0035
No log	4.3043	198	1.0079	0.4316	1.0079	1.0040
No log	4.3478	200	1.0225	0.3219	1.0225	1.0112
No log	4.3913	202	1.2521	0.4078	1.2521	1.1190
No log	4.4348	204	1.4298	0.4129	1.4298	1.1957
No log	4.4783	206	1.2871	0.4039	1.2871	1.1345
No log	4.5217	208	1.0344	0.4028	1.0344	1.0170
No log	4.5652	210	1.0014	0.4349	1.0014	1.0007
No log	4.6087	212	1.0149	0.4358	1.0149	1.0074
No log	4.6522	214	0.9794	0.3864	0.9794	0.9897
No log	4.6957	216	1.0385	0.3430	1.0385	1.0191
No log	4.7391	218	1.2198	0.3478	1.2198	1.1044
No log	4.7826	220	1.2440	0.3487	1.2440	1.1154
No log	4.8261	222	1.1206	0.1860	1.1206	1.0586
No log	4.8696	224	1.0129	0.2286	1.0129	1.0064
No log	4.9130	226	0.9956	0.3938	0.9956	0.9978
No log	4.9565	228	0.9974	0.4321	0.9974	0.9987
No log	5.0	230	1.0451	0.2929	1.0451	1.0223
No log	5.0435	232	1.0707	0.3196	1.0707	1.0348
No log	5.0870	234	1.0317	0.3914	1.0317	1.0157
No log	5.1304	236	1.0489	0.3632	1.0489	1.0241
No log	5.1739	238	1.1728	0.2723	1.1728	1.0830
No log	5.2174	240	1.1975	0.3001	1.1975	1.0943
No log	5.2609	242	1.1299	0.2999	1.1299	1.0630
No log	5.3043	244	1.0615	0.2883	1.0615	1.0303
No log	5.3478	246	1.0069	0.3335	1.0069	1.0034
No log	5.3913	248	0.9739	0.3018	0.9739	0.9869
No log	5.4348	250	0.9781	0.3363	0.9781	0.9890
No log	5.4783	252	0.9870	0.3380	0.9870	0.9935
No log	5.5217	254	1.0871	0.3390	1.0871	1.0426
No log	5.5652	256	1.1326	0.3516	1.1326	1.0642
No log	5.6087	258	1.1564	0.3539	1.1564	1.0754
No log	5.6522	260	1.2517	0.3481	1.2517	1.1188
No log	5.6957	262	1.3302	0.3708	1.3302	1.1534
No log	5.7391	264	1.2273	0.3064	1.2273	1.1078
No log	5.7826	266	1.0957	0.2515	1.0957	1.0468
No log	5.8261	268	1.0110	0.3621	1.0110	1.0055
No log	5.8696	270	1.0071	0.4002	1.0071	1.0036
No log	5.9130	272	1.0858	0.2165	1.0858	1.0420
No log	5.9565	274	1.2126	0.2535	1.2126	1.1012
No log	6.0	276	1.3133	0.2956	1.3133	1.1460
No log	6.0435	278	1.3050	0.2980	1.3050	1.1424
No log	6.0870	280	1.1577	0.2362	1.1577	1.0760
No log	6.1304	282	1.0110	0.3826	1.0110	1.0055
No log	6.1739	284	0.9986	0.3617	0.9986	0.9993
No log	6.2174	286	1.0220	0.3579	1.0220	1.0109
No log	6.2609	288	0.9813	0.3789	0.9813	0.9906
No log	6.3043	290	1.0090	0.3468	1.0090	1.0045
No log	6.3478	292	1.1490	0.2532	1.1490	1.0719
No log	6.3913	294	1.2198	0.2894	1.2198	1.1044
No log	6.4348	296	1.1919	0.1764	1.1919	1.0918
No log	6.4783	298	1.1114	0.1246	1.1114	1.0542
No log	6.5217	300	1.0127	0.2843	1.0127	1.0063
No log	6.5652	302	0.9649	0.3914	0.9649	0.9823
No log	6.6087	304	0.9829	0.4197	0.9829	0.9914
No log	6.6522	306	0.9693	0.3979	0.9693	0.9845
No log	6.6957	308	1.0700	0.3518	1.0700	1.0344
No log	6.7391	310	1.1479	0.3278	1.1479	1.0714
No log	6.7826	312	1.1378	0.3278	1.1378	1.0667
No log	6.8261	314	1.0733	0.3285	1.0733	1.0360
No log	6.8696	316	1.0695	0.2258	1.0695	1.0342
No log	6.9130	318	1.1616	0.2864	1.1616	1.0778
No log	6.9565	320	1.1845	0.2727	1.1845	1.0883
No log	7.0	322	1.1101	0.2060	1.1101	1.0536
No log	7.0435	324	1.0524	0.1467	1.0524	1.0259
No log	7.0870	326	1.0367	0.1624	1.0367	1.0182
No log	7.1304	328	1.0306	0.1624	1.0306	1.0152
No log	7.1739	330	1.0590	0.2623	1.0590	1.0291
No log	7.2174	332	1.1033	0.2339	1.1033	1.0504
No log	7.2609	334	1.0631	0.2623	1.0631	1.0311
No log	7.3043	336	1.1197	0.3365	1.1197	1.0582
No log	7.3478	338	1.0997	0.3365	1.0997	1.0487
No log	7.3913	340	1.0092	0.2857	1.0092	1.0046
No log	7.4348	342	1.0377	0.2864	1.0377	1.0187
No log	7.4783	344	1.1196	0.3138	1.1196	1.0581
No log	7.5217	346	1.1968	0.3629	1.1968	1.0940
No log	7.5652	348	1.1300	0.3398	1.1300	1.0630
No log	7.6087	350	0.9847	0.3069	0.9847	0.9923
No log	7.6522	352	0.9331	0.2556	0.9331	0.9660
No log	7.6957	354	0.9429	0.3404	0.9429	0.9711
No log	7.7391	356	0.9371	0.2843	0.9371	0.9680
No log	7.7826	358	0.9843	0.2951	0.9843	0.9921
No log	7.8261	360	1.0695	0.3255	1.0695	1.0342
No log	7.8696	362	1.0681	0.3722	1.0681	1.0335
No log	7.9130	364	0.9929	0.3359	0.9929	0.9964
No log	7.9565	366	0.9520	0.3237	0.9520	0.9757
No log	8.0	368	0.9512	0.2723	0.9512	0.9753
No log	8.0435	370	0.9816	0.2024	0.9816	0.9907
No log	8.0870	372	1.0441	0.3206	1.0441	1.0218
No log	8.1304	374	1.0589	0.3294	1.0589	1.0290
No log	8.1739	376	1.0304	0.3528	1.0304	1.0151
No log	8.2174	378	0.9801	0.3713	0.9801	0.9900
No log	8.2609	380	0.9286	0.4429	0.9286	0.9636
No log	8.3043	382	0.8944	0.4476	0.8944	0.9457
No log	8.3478	384	0.9172	0.4340	0.9172	0.9577
No log	8.3913	386	0.9253	0.4340	0.9253	0.9619
No log	8.4348	388	1.0226	0.3317	1.0226	1.0112
No log	8.4783	390	1.1041	0.2762	1.1041	1.0508
No log	8.5217	392	1.0761	0.2300	1.0761	1.0373
No log	8.5652	394	0.9648	0.2947	0.9648	0.9822
No log	8.6087	396	0.8915	0.3374	0.8915	0.9442
No log	8.6522	398	0.8817	0.3641	0.8817	0.9390
No log	8.6957	400	0.9032	0.4002	0.9032	0.9504
No log	8.7391	402	0.9700	0.4334	0.9700	0.9849
No log	8.7826	404	1.1504	0.3860	1.1504	1.0726
No log	8.8261	406	1.1895	0.3525	1.1895	1.0907
No log	8.8696	408	1.1686	0.2558	1.1686	1.0810
No log	8.9130	410	1.1302	0.2195	1.1302	1.0631
No log	8.9565	412	1.0718	0.2481	1.0718	1.0353
No log	9.0	414	1.0071	0.3093	1.0071	1.0035
No log	9.0435	416	0.9911	0.2970	0.9911	0.9955
No log	9.0870	418	1.0145	0.3449	1.0145	1.0072
No log	9.1304	420	1.0596	0.2339	1.0596	1.0293
No log	9.1739	422	1.0502	0.2481	1.0502	1.0248
No log	9.2174	424	1.0084	0.2515	1.0084	1.0042
No log	9.2609	426	1.0155	0.2800	1.0155	1.0077
No log	9.3043	428	1.1277	0.3380	1.1277	1.0619
No log	9.3478	430	1.1641	0.3355	1.1641	1.0789
No log	9.3913	432	1.0605	0.2574	1.0605	1.0298
No log	9.4348	434	0.9428	0.2813	0.9428	0.9710
No log	9.4783	436	0.9219	0.2939	0.9219	0.9602
No log	9.5217	438	0.9466	0.2360	0.9466	0.9729
No log	9.5652	440	1.0545	0.1769	1.0545	1.0269
No log	9.6087	442	1.2600	0.2909	1.2600	1.1225
No log	9.6522	444	1.3683	0.3068	1.3683	1.1698
No log	9.6957	446	1.3104	0.2844	1.3104	1.1447
No log	9.7391	448	1.3051	0.2727	1.3051	1.1424
No log	9.7826	450	1.3044	0.2443	1.3044	1.1421
No log	9.8261	452	1.3306	0.2945	1.3306	1.1535
No log	9.8696	454	1.2471	0.3098	1.2471	1.1167
No log	9.9130	456	1.2204	0.2739	1.2204	1.1047
No log	9.9565	458	1.1937	0.1920	1.1937	1.0926
No log	10.0	460	1.1401	0.2496	1.1401	1.0678
No log	10.0435	462	1.0531	0.3282	1.0531	1.0262
No log	10.0870	464	0.9764	0.3663	0.9764	0.9881
No log	10.1304	466	0.9556	0.3309	0.9556	0.9775
No log	10.1739	468	0.9653	0.3309	0.9653	0.9825
No log	10.2174	470	1.0022	0.2477	1.0022	1.0011
No log	10.2609	472	1.0489	0.2947	1.0489	1.0242
No log	10.3043	474	1.0929	0.2541	1.0929	1.0454
No log	10.3478	476	1.1723	0.2934	1.1723	1.0827
No log	10.3913	478	1.1864	0.2909	1.1864	1.0892
No log	10.4348	480	1.1108	0.2837	1.1108	1.0539
No log	10.4783	482	1.0367	0.2704	1.0367	1.0182
No log	10.5217	484	0.9904	0.2970	0.9904	0.9952
No log	10.5652	486	1.0078	0.2970	1.0078	1.0039
No log	10.6087	488	1.0715	0.2218	1.0715	1.0352
No log	10.6522	490	1.0710	0.2496	1.0710	1.0349
No log	10.6957	492	1.0289	0.2640	1.0289	1.0143
No log	10.7391	494	1.0365	0.2640	1.0365	1.0181
No log	10.7826	496	1.0805	0.1966	1.0805	1.0395
No log	10.8261	498	1.0660	0.1966	1.0660	1.0325
0.3593	10.8696	500	0.9901	0.2574	0.9901	0.9950
0.3593	10.9130	502	0.9743	0.2970	0.9743	0.9871
0.3593	10.9565	504	1.0040	0.3464	1.0040	1.0020
0.3593	11.0	506	1.1060	0.2844	1.1060	1.0517
0.3593	11.0435	508	1.2074	0.3166	1.2074	1.0988
0.3593	11.0870	510	1.2192	0.3148	1.2192	1.1042
0.3593	11.1304	512	1.1350	0.2558	1.1350	1.0653
0.3593	11.1739	514	1.0846	0.1959	1.0846	1.0415
0.3593	11.2174	516	1.0839	0.1085	1.0839	1.0411
0.3593	11.2609	518	1.0707	0.1343	1.0707	1.0347
0.3593	11.3043	520	1.0617	0.1406	1.0617	1.0304

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1