ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0099
• Qwk: 0.2012
• Mse: 1.0099
• Rmse: 1.0049

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0222	2	4.1290	-0.0270	4.1290	2.0320
No log	0.0444	4	2.8112	-0.0863	2.8112	1.6767
No log	0.0667	6	2.0799	0.0247	2.0799	1.4422
No log	0.0889	8	1.1733	0.1549	1.1733	1.0832
No log	0.1111	10	1.0820	0.2114	1.0820	1.0402
No log	0.1333	12	1.2257	0.0850	1.2257	1.1071
No log	0.1556	14	1.2298	0.0462	1.2298	1.1089
No log	0.1778	16	1.0251	0.2944	1.0251	1.0125
No log	0.2	18	1.0431	0.2849	1.0431	1.0213
No log	0.2222	20	1.0585	0.1727	1.0585	1.0288
No log	0.2444	22	0.9898	0.2667	0.9898	0.9949
No log	0.2667	24	1.0143	0.2023	1.0143	1.0071
No log	0.2889	26	1.0357	0.2023	1.0357	1.0177
No log	0.3111	28	1.0523	0.1509	1.0523	1.0258
No log	0.3333	30	1.0077	0.1997	1.0077	1.0039
No log	0.3556	32	0.9828	0.2944	0.9828	0.9914
No log	0.3778	34	1.0560	0.2651	1.0560	1.0276
No log	0.4	36	1.1591	0.2392	1.1591	1.0766
No log	0.4222	38	1.2321	0.1842	1.2321	1.1100
No log	0.4444	40	1.0046	0.2963	1.0046	1.0023
No log	0.4667	42	0.9513	0.3236	0.9513	0.9753
No log	0.4889	44	0.9632	0.2671	0.9632	0.9814
No log	0.5111	46	1.1460	0.1900	1.1460	1.0705
No log	0.5333	48	1.2516	-0.0305	1.2516	1.1187
No log	0.5556	50	1.2277	0.0293	1.2277	1.1080
No log	0.5778	52	1.2600	0.0078	1.2600	1.1225
No log	0.6	54	1.2581	0.0111	1.2581	1.1217
No log	0.6222	56	1.2417	0.0548	1.2417	1.1143
No log	0.6444	58	1.3799	0.0970	1.3799	1.1747
No log	0.6667	60	1.5285	0.0318	1.5285	1.2363
No log	0.6889	62	1.8463	-0.1320	1.8463	1.3588
No log	0.7111	64	1.3625	0.0610	1.3625	1.1673
No log	0.7333	66	0.9870	0.2265	0.9870	0.9935
No log	0.7556	68	0.9646	0.2746	0.9646	0.9822
No log	0.7778	70	1.0827	0.2149	1.0827	1.0406
No log	0.8	72	1.3162	0.0160	1.3162	1.1472
No log	0.8222	74	1.3918	-0.0411	1.3918	1.1797
No log	0.8444	76	1.3022	0.0160	1.3022	1.1411
No log	0.8667	78	1.0325	0.2873	1.0325	1.0161
No log	0.8889	80	0.9519	0.2841	0.9519	0.9757
No log	0.9111	82	0.9479	0.2935	0.9479	0.9736
No log	0.9333	84	0.9162	0.3370	0.9162	0.9572
No log	0.9556	86	0.9663	0.2467	0.9663	0.9830
No log	0.9778	88	1.1519	0.1643	1.1519	1.0733
No log	1.0	90	1.3160	-0.0251	1.3160	1.1472
No log	1.0222	92	1.2856	0.0811	1.2856	1.1338
No log	1.0444	94	1.1539	0.1649	1.1539	1.0742
No log	1.0667	96	0.9741	0.2569	0.9741	0.9870
No log	1.0889	98	0.9555	0.2594	0.9555	0.9775
No log	1.1111	100	0.9936	0.2161	0.9936	0.9968
No log	1.1333	102	1.0537	0.2569	1.0537	1.0265
No log	1.1556	104	1.0818	0.3623	1.0818	1.0401
No log	1.1778	106	1.1417	0.25	1.1417	1.0685
No log	1.2	108	1.1369	0.3344	1.1369	1.0663
No log	1.2222	110	1.0476	0.4020	1.0476	1.0235
No log	1.2444	112	1.0303	0.3743	1.0303	1.0150
No log	1.2667	114	1.0893	0.3920	1.0893	1.0437
No log	1.2889	116	1.1393	0.3415	1.1393	1.0674
No log	1.3111	118	1.2605	0.2686	1.2605	1.1227
No log	1.3333	120	1.4101	0.2391	1.4101	1.1875
No log	1.3556	122	1.4384	0.1789	1.4384	1.1993
No log	1.3778	124	1.3751	0.2004	1.3751	1.1727
No log	1.4	126	1.2648	0.2455	1.2648	1.1246
No log	1.4222	128	1.0918	0.2175	1.0918	1.0449
No log	1.4444	130	1.0016	0.0761	1.0016	1.0008
No log	1.4667	132	1.1184	0.2834	1.1184	1.0576
No log	1.4889	134	1.1741	0.2925	1.1741	1.0835
No log	1.5111	136	1.1324	0.2834	1.1324	1.0642
No log	1.5333	138	0.9953	0.1007	0.9953	0.9976
No log	1.5556	140	1.0820	0.2820	1.0820	1.0402
No log	1.5778	142	1.2463	0.2506	1.2463	1.1164
No log	1.6	144	1.2535	0.2816	1.2535	1.1196
No log	1.6222	146	1.2268	0.2417	1.2268	1.1076
No log	1.6444	148	1.3267	0.2896	1.3267	1.1518
No log	1.6667	150	1.4088	0.2417	1.4088	1.1869
No log	1.6889	152	1.2591	0.1512	1.2591	1.1221
No log	1.7111	154	1.0998	0.1944	1.0998	1.0487
No log	1.7333	156	0.9882	0.2077	0.9882	0.9941
No log	1.7556	158	1.0201	0.2384	1.0201	1.0100
No log	1.7778	160	1.1423	0.2130	1.1423	1.0688
No log	1.8	162	1.2926	0.1700	1.2926	1.1369
No log	1.8222	164	1.3521	0.1370	1.3521	1.1628
No log	1.8444	166	1.2616	0.0741	1.2616	1.1232
No log	1.8667	168	1.1987	0.0227	1.1987	1.0948
No log	1.8889	170	1.1011	0.0981	1.1011	1.0493
No log	1.9111	172	1.1084	0.0824	1.1084	1.0528
No log	1.9333	174	1.1873	0.0574	1.1873	1.0896
No log	1.9556	176	1.2443	0.0227	1.2443	1.1155
No log	1.9778	178	1.2610	0.0961	1.2610	1.1230
No log	2.0	180	1.1504	0.2392	1.1504	1.0726
No log	2.0222	182	1.0506	0.2651	1.0506	1.0250
No log	2.0444	184	1.0271	0.1873	1.0271	1.0134
No log	2.0667	186	1.0558	0.1826	1.0558	1.0275
No log	2.0889	188	1.0839	0.1101	1.0839	1.0411
No log	2.1111	190	1.1794	0.1370	1.1794	1.0860
No log	2.1333	192	1.1296	0.1521	1.1296	1.0628
No log	2.1556	194	1.0013	0.1341	1.0013	1.0007
No log	2.1778	196	0.9204	0.1493	0.9204	0.9594
No log	2.2	198	0.9040	0.2888	0.9040	0.9508
No log	2.2222	200	0.9380	0.2114	0.9380	0.9685
No log	2.2444	202	0.9857	0.2314	0.9857	0.9928
No log	2.2667	204	1.1354	0.2012	1.1354	1.0656
No log	2.2889	206	1.2989	0.2542	1.2989	1.1397
No log	2.3111	208	1.3309	0.2313	1.3309	1.1536
No log	2.3333	210	1.2086	0.2750	1.2086	1.0993
No log	2.3556	212	1.1061	0.3039	1.1061	1.0517
No log	2.3778	214	1.0689	0.2981	1.0689	1.0339
No log	2.4	216	1.0828	0.2066	1.0828	1.0406
No log	2.4222	218	1.1047	0.1671	1.1047	1.0511
No log	2.4444	220	1.1335	0.1918	1.1335	1.0647
No log	2.4667	222	1.1408	0.1976	1.1408	1.0681
No log	2.4889	224	1.1138	0.2843	1.1138	1.0554
No log	2.5111	226	1.1272	0.25	1.1272	1.0617
No log	2.5333	228	1.1426	0.1570	1.1426	1.0689
No log	2.5556	230	1.1120	0.1799	1.1120	1.0545
No log	2.5778	232	1.1030	0.1954	1.1030	1.0502
No log	2.6	234	1.0795	0.2024	1.0795	1.0390
No log	2.6222	236	1.0465	0.2325	1.0465	1.0230
No log	2.6444	238	1.0980	0.2416	1.0980	1.0479
No log	2.6667	240	1.1217	0.2359	1.1217	1.0591
No log	2.6889	242	1.0617	0.2365	1.0617	1.0304
No log	2.7111	244	1.0615	0.2013	1.0615	1.0303
No log	2.7333	246	0.9745	0.1893	0.9745	0.9872
No log	2.7556	248	0.9061	0.3094	0.9061	0.9519
No log	2.7778	250	0.9271	0.3464	0.9271	0.9629
No log	2.8	252	0.9515	0.3021	0.9515	0.9754
No log	2.8222	254	0.9109	0.2647	0.9109	0.9544
No log	2.8444	256	0.9106	0.2523	0.9106	0.9543
No log	2.8667	258	0.9108	0.2647	0.9108	0.9543
No log	2.8889	260	0.9235	0.2647	0.9235	0.9610
No log	2.9111	262	0.9021	0.2647	0.9021	0.9498
No log	2.9333	264	0.8774	0.3067	0.8774	0.9367
No log	2.9556	266	0.8825	0.3485	0.8825	0.9394
No log	2.9778	268	0.8661	0.3221	0.8661	0.9307
No log	3.0	270	0.8638	0.3519	0.8638	0.9294
No log	3.0222	272	0.8623	0.3625	0.8623	0.9286
No log	3.0444	274	0.8988	0.3780	0.8988	0.9480
No log	3.0667	276	0.9299	0.4174	0.9299	0.9643
No log	3.0889	278	0.8840	0.3760	0.8840	0.9402
No log	3.1111	280	0.8807	0.3902	0.8807	0.9385
No log	3.1333	282	0.9087	0.3085	0.9087	0.9533
No log	3.1556	284	0.9028	0.3494	0.9028	0.9502
No log	3.1778	286	0.9130	0.3085	0.9130	0.9555
No log	3.2	288	0.9066	0.3902	0.9066	0.9522
No log	3.2222	290	0.8840	0.4048	0.8840	0.9402
No log	3.2444	292	0.9080	0.3652	0.9080	0.9529
No log	3.2667	294	0.9530	0.3506	0.9530	0.9762
No log	3.2889	296	1.0353	0.1462	1.0353	1.0175
No log	3.3111	298	1.0564	0.1676	1.0564	1.0278
No log	3.3333	300	0.9863	0.2864	0.9863	0.9931
No log	3.3556	302	0.8807	0.4327	0.8807	0.9385
No log	3.3778	304	0.8643	0.3922	0.8643	0.9297
No log	3.4	306	0.8979	0.3819	0.8979	0.9476
No log	3.4222	308	0.8750	0.3569	0.8750	0.9354
No log	3.4444	310	0.8517	0.4241	0.8517	0.9229
No log	3.4667	312	0.8287	0.3757	0.8287	0.9103
No log	3.4889	314	0.8104	0.3776	0.8104	0.9002
No log	3.5111	316	0.7775	0.4557	0.7775	0.8817
No log	3.5333	318	0.7993	0.4862	0.7993	0.8940
No log	3.5556	320	0.8930	0.4812	0.8930	0.9450
No log	3.5778	322	0.9016	0.4681	0.9016	0.9496
No log	3.6	324	0.8805	0.4310	0.8805	0.9383
No log	3.6222	326	0.8131	0.4216	0.8131	0.9017
No log	3.6444	328	0.7994	0.4980	0.7994	0.8941
No log	3.6667	330	0.8839	0.4565	0.8839	0.9401
No log	3.6889	332	1.1199	0.3400	1.1199	1.0583
No log	3.7111	334	1.2877	0.1872	1.2877	1.1347
No log	3.7333	336	1.2939	0.2906	1.2939	1.1375
No log	3.7556	338	1.1593	0.2572	1.1593	1.0767
No log	3.7778	340	1.0668	0.2102	1.0668	1.0328
No log	3.8	342	1.0106	0.2577	1.0106	1.0053
No log	3.8222	344	1.0058	0.3444	1.0058	1.0029
No log	3.8444	346	1.0351	0.3717	1.0351	1.0174
No log	3.8667	348	1.0610	0.3436	1.0610	1.0300
No log	3.8889	350	1.0650	0.3409	1.0650	1.0320
No log	3.9111	352	1.0292	0.3699	1.0292	1.0145
No log	3.9333	354	0.9508	0.4174	0.9508	0.9751
No log	3.9556	356	0.9942	0.4169	0.9942	0.9971
No log	3.9778	358	1.0799	0.3171	1.0799	1.0392
No log	4.0	360	1.0856	0.2927	1.0856	1.0419
No log	4.0222	362	1.0431	0.3021	1.0431	1.0213
No log	4.0444	364	0.9844	0.4054	0.9844	0.9922
No log	4.0667	366	1.0450	0.3021	1.0450	1.0222
No log	4.0889	368	1.1139	0.2794	1.1139	1.0554
No log	4.1111	370	1.1721	0.1935	1.1721	1.0826
No log	4.1333	372	1.0652	0.2794	1.0652	1.0321
No log	4.1556	374	0.9036	0.3902	0.9036	0.9506
No log	4.1778	376	0.8431	0.3382	0.8431	0.9182
No log	4.2	378	0.8586	0.3528	0.8586	0.9266
No log	4.2222	380	0.8920	0.4327	0.8920	0.9444
No log	4.2444	382	0.9441	0.4697	0.9441	0.9717
No log	4.2667	384	1.0610	0.3316	1.0610	1.0301
No log	4.2889	386	1.0683	0.3139	1.0683	1.0336
No log	4.3111	388	0.9479	0.3954	0.9479	0.9736
No log	4.3333	390	0.8661	0.4057	0.8661	0.9306
No log	4.3556	392	0.8442	0.4062	0.8442	0.9188
No log	4.3778	394	0.8682	0.4232	0.8682	0.9318
No log	4.4	396	0.8805	0.3289	0.8805	0.9383
No log	4.4222	398	0.8797	0.3665	0.8797	0.9379
No log	4.4444	400	0.8098	0.4249	0.8098	0.8999
No log	4.4667	402	0.7773	0.4124	0.7773	0.8816
No log	4.4889	404	0.8179	0.4593	0.8179	0.9044
No log	4.5111	406	0.9462	0.3424	0.9462	0.9727
No log	4.5333	408	1.0410	0.2772	1.0410	1.0203
No log	4.5556	410	1.1013	0.3434	1.1013	1.0494
No log	4.5778	412	1.0585	0.2440	1.0585	1.0288
No log	4.6	414	1.0551	0.2117	1.0551	1.0272
No log	4.6222	416	1.1480	0.2155	1.1480	1.0714
No log	4.6444	418	1.2670	0.125	1.2670	1.1256
No log	4.6667	420	1.3160	0.1033	1.3160	1.1472
No log	4.6889	422	1.3233	0.2845	1.3233	1.1503
No log	4.7111	424	1.2643	0.3107	1.2643	1.1244
No log	4.7333	426	1.2569	0.2812	1.2569	1.1211
No log	4.7556	428	1.2791	0.2870	1.2791	1.1310
No log	4.7778	430	1.2055	0.2750	1.2055	1.0980
No log	4.8	432	1.1071	0.2610	1.1071	1.0522
No log	4.8222	434	1.0737	0.2559	1.0737	1.0362
No log	4.8444	436	1.1108	0.1820	1.1108	1.0539
No log	4.8667	438	1.1885	0.1793	1.1885	1.0902
No log	4.8889	440	1.2850	0.1920	1.2850	1.1336
No log	4.9111	442	1.2998	0.2283	1.2998	1.1401
No log	4.9333	444	1.2230	0.2071	1.2230	1.1059
No log	4.9556	446	1.1533	0.2664	1.1533	1.0739
No log	4.9778	448	1.1526	0.2252	1.1526	1.0736
No log	5.0	450	1.1779	0.2143	1.1779	1.0853
No log	5.0222	452	1.2077	0.1272	1.2077	1.0989
No log	5.0444	454	1.2342	0.1876	1.2342	1.1109
No log	5.0667	456	1.2048	0.1282	1.2048	1.0976
No log	5.0889	458	1.1188	0.2238	1.1188	1.0577
No log	5.1111	460	1.0577	0.2263	1.0577	1.0285
No log	5.1333	462	1.0083	0.2795	1.0083	1.0041
No log	5.1556	464	0.9991	0.2050	0.9991	0.9996
No log	5.1778	466	1.0604	0.1944	1.0604	1.0297
No log	5.2	468	1.0828	0.1944	1.0828	1.0406
No log	5.2222	470	1.0513	0.2238	1.0513	1.0253
No log	5.2444	472	1.0241	0.2238	1.0241	1.0120
No log	5.2667	474	1.0389	0.2651	1.0389	1.0192
No log	5.2889	476	1.0565	0.2179	1.0565	1.0278
No log	5.3111	478	1.1087	0.2704	1.1087	1.0530
No log	5.3333	480	1.1694	0.3237	1.1694	1.0814
No log	5.3556	482	1.2402	0.2172	1.2402	1.1136
No log	5.3778	484	1.3391	0.1432	1.3391	1.1572
No log	5.4	486	1.3869	0.1773	1.3869	1.1777
No log	5.4222	488	1.3907	0.1395	1.3907	1.1793
No log	5.4444	490	1.2756	0.1863	1.2756	1.1294
No log	5.4667	492	1.1317	0.1750	1.1317	1.0638
No log	5.4889	494	0.9896	0.2796	0.9896	0.9948
No log	5.5111	496	0.9512	0.2674	0.9512	0.9753
No log	5.5333	498	0.9439	0.3005	0.9439	0.9715
0.3477	5.5556	500	0.9721	0.3161	0.9721	0.9859
0.3477	5.5778	502	1.0308	0.3099	1.0308	1.0153
0.3477	5.6	504	1.0220	0.3472	1.0220	1.0109
0.3477	5.6222	506	1.0002	0.3045	1.0002	1.0001
0.3477	5.6444	508	0.9566	0.3202	0.9566	0.9780
0.3477	5.6667	510	0.9347	0.3590	0.9347	0.9668
0.3477	5.6889	512	0.9432	0.3682	0.9432	0.9712
0.3477	5.7111	514	0.9896	0.3124	0.9896	0.9948
0.3477	5.7333	516	1.0037	0.3243	1.0037	1.0019
0.3477	5.7556	518	0.9797	0.3278	0.9797	0.9898
0.3477	5.7778	520	0.9721	0.3414	0.9721	0.9860
0.3477	5.8	522	0.9775	0.3414	0.9775	0.9887
0.3477	5.8222	524	0.9983	0.3210	0.9983	0.9992
0.3477	5.8444	526	0.9710	0.3472	0.9710	0.9854
0.3477	5.8667	528	0.9322	0.4203	0.9322	0.9655
0.3477	5.8889	530	0.9413	0.4071	0.9413	0.9702
0.3477	5.9111	532	0.9034	0.4958	0.9034	0.9505
0.3477	5.9333	534	0.9130	0.4958	0.9130	0.9555
0.3477	5.9556	536	0.9121	0.4958	0.9121	0.9551
0.3477	5.9778	538	0.9287	0.4326	0.9287	0.9637
0.3477	6.0	540	1.0583	0.3568	1.0583	1.0287
0.3477	6.0222	542	1.1316	0.3227	1.1316	1.0638
0.3477	6.0444	544	1.0494	0.3864	1.0494	1.0244
0.3477	6.0667	546	0.9340	0.4169	0.9340	0.9664
0.3477	6.0889	548	0.8571	0.4327	0.8571	0.9258
0.3477	6.1111	550	0.8438	0.4468	0.8438	0.9186
0.3477	6.1333	552	0.8969	0.4456	0.8969	0.9470
0.3477	6.1556	554	0.9656	0.3577	0.9656	0.9826
0.3477	6.1778	556	0.9555	0.4335	0.9555	0.9775
0.3477	6.2	558	0.9146	0.4335	0.9146	0.9564
0.3477	6.2222	560	0.8643	0.4309	0.8643	0.9297
0.3477	6.2444	562	0.8666	0.4309	0.8666	0.9309
0.3477	6.2667	564	0.8874	0.4309	0.8874	0.9420
0.3477	6.2889	566	0.8765	0.4168	0.8765	0.9362
0.3477	6.3111	568	0.8486	0.4063	0.8486	0.9212
0.3477	6.3333	570	0.8518	0.4078	0.8518	0.9229
0.3477	6.3556	572	0.9077	0.4343	0.9077	0.9527
0.3477	6.3778	574	0.9420	0.4334	0.9420	0.9706
0.3477	6.4	576	0.9171	0.4335	0.9171	0.9576
0.3477	6.4222	578	0.9378	0.4097	0.9378	0.9684
0.3477	6.4444	580	0.9651	0.4368	0.9651	0.9824
0.3477	6.4667	582	0.9772	0.4224	0.9772	0.9886
0.3477	6.4889	584	1.0378	0.4040	1.0378	1.0187
0.3477	6.5111	586	1.0256	0.4258	1.0255	1.0127
0.3477	6.5333	588	0.9996	0.4785	0.9996	0.9998
0.3477	6.5556	590	0.9784	0.4326	0.9784	0.9891
0.3477	6.5778	592	0.8991	0.3494	0.8991	0.9482
0.3477	6.6	594	0.8855	0.3485	0.8855	0.9410
0.3477	6.6222	596	0.9082	0.3304	0.9082	0.9530
0.3477	6.6444	598	0.9128	0.3153	0.9128	0.9554
0.3477	6.6667	600	0.9585	0.3474	0.9585	0.9791
0.3477	6.6889	602	1.0055	0.2012	1.0055	1.0027
0.3477	6.7111	604	1.0062	0.2012	1.0062	1.0031
0.3477	6.7333	606	1.0396	0.2012	1.0396	1.0196
0.3477	6.7556	608	1.0516	0.2076	1.0516	1.0255
0.3477	6.7778	610	1.0099	0.2012	1.0099	1.0049

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1