ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k15_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9421
• Qwk: 0.2142
• Mse: 0.9421
• Rmse: 0.9706

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	2.6546	-0.0593	2.6546	1.6293
No log	0.1111	4	1.2753	0.0997	1.2753	1.1293
No log	0.1667	6	0.9133	0.0535	0.9133	0.9556
No log	0.2222	8	0.8322	0.0771	0.8322	0.9123
No log	0.2778	10	0.7834	0.0410	0.7834	0.8851
No log	0.3333	12	0.8037	0.1321	0.8037	0.8965
No log	0.3889	14	0.7549	0.1184	0.7549	0.8688
No log	0.4444	16	0.7330	0.1184	0.7330	0.8562
No log	0.5	18	0.7192	0.0804	0.7192	0.8480
No log	0.5556	20	0.7348	0.1786	0.7348	0.8572
No log	0.6111	22	0.7275	0.1786	0.7275	0.8529
No log	0.6667	24	0.7219	0.0937	0.7219	0.8497
No log	0.7222	26	0.7166	0.0428	0.7166	0.8465
No log	0.7778	28	0.7286	0.0295	0.7286	0.8536
No log	0.8333	30	0.7940	0.1142	0.7940	0.8911
No log	0.8889	32	0.8344	-0.0269	0.8344	0.9135
No log	0.9444	34	0.8587	-0.0269	0.8587	0.9267
No log	1.0	36	0.8241	0.0129	0.8241	0.9078
No log	1.0556	38	0.7394	0.0393	0.7394	0.8599
No log	1.1111	40	0.7009	0.1327	0.7009	0.8372
No log	1.1667	42	0.7203	0.0846	0.7203	0.8487
No log	1.2222	44	0.7328	0.0376	0.7328	0.8560
No log	1.2778	46	0.7769	0.1400	0.7769	0.8814
No log	1.3333	48	0.7690	0.1400	0.7690	0.8769
No log	1.3889	50	0.7785	0.2751	0.7785	0.8823
No log	1.4444	52	0.7155	0.2413	0.7155	0.8459
No log	1.5	54	0.9690	0.2643	0.9690	0.9844
No log	1.5556	56	0.9173	0.2697	0.9173	0.9577
No log	1.6111	58	0.6743	0.3408	0.6743	0.8212
No log	1.6667	60	0.7050	0.3665	0.7050	0.8396
No log	1.7222	62	0.8149	0.3305	0.8149	0.9027
No log	1.7778	64	1.0671	0.2999	1.0671	1.0330
No log	1.8333	66	1.1267	0.1935	1.1267	1.0614
No log	1.8889	68	1.2371	0.1002	1.2371	1.1123
No log	1.9444	70	1.4000	0.1401	1.4000	1.1832
No log	2.0	72	1.0699	0.2554	1.0699	1.0344
No log	2.0556	74	0.8151	0.2953	0.8151	0.9028
No log	2.1111	76	0.7686	0.3031	0.7686	0.8767
No log	2.1667	78	0.7795	0.3408	0.7795	0.8829
No log	2.2222	80	1.0362	0.2643	1.0362	1.0180
No log	2.2778	82	1.2021	0.1109	1.2021	1.0964
No log	2.3333	84	1.3732	-0.0991	1.3732	1.1719
No log	2.3889	86	1.3007	-0.0257	1.3007	1.1405
No log	2.4444	88	0.9696	0.1766	0.9696	0.9847
No log	2.5	90	0.7767	0.0930	0.7767	0.8813
No log	2.5556	92	0.7665	0.2116	0.7665	0.8755
No log	2.6111	94	0.6899	0.2327	0.6899	0.8306
No log	2.6667	96	0.7055	0.3155	0.7055	0.8400
No log	2.7222	98	0.8247	0.3371	0.8247	0.9082
No log	2.7778	100	0.8312	0.3371	0.8312	0.9117
No log	2.8333	102	0.7184	0.4165	0.7184	0.8476
No log	2.8889	104	0.6760	0.3581	0.6760	0.8222
No log	2.9444	106	0.6782	0.3556	0.6782	0.8235
No log	3.0	108	0.8701	0.3623	0.8701	0.9328
No log	3.0556	110	1.1766	0.2115	1.1766	1.0847
No log	3.1111	112	1.0801	0.2682	1.0801	1.0393
No log	3.1667	114	0.7772	0.3630	0.7772	0.8816
No log	3.2222	116	0.7059	0.2994	0.7059	0.8402
No log	3.2778	118	0.7861	0.3505	0.7861	0.8866
No log	3.3333	120	0.7452	0.3316	0.7452	0.8633
No log	3.3889	122	0.6979	0.2684	0.6979	0.8354
No log	3.4444	124	0.7901	0.3564	0.7901	0.8889
No log	3.5	126	0.8911	0.3938	0.8911	0.9440
No log	3.5556	128	0.9006	0.3938	0.9006	0.9490
No log	3.6111	130	0.7964	0.3630	0.7964	0.8924
No log	3.6667	132	0.7308	0.3060	0.7308	0.8549
No log	3.7222	134	0.7263	0.3116	0.7263	0.8522
No log	3.7778	136	0.7919	0.2812	0.7919	0.8899
No log	3.8333	138	0.9654	0.3439	0.9654	0.9826
No log	3.8889	140	1.0089	0.2948	1.0089	1.0044
No log	3.9444	142	0.8781	0.3008	0.8781	0.9371
No log	4.0	144	0.7780	0.2784	0.7780	0.8821
No log	4.0556	146	0.7882	0.2784	0.7882	0.8878
No log	4.1111	148	0.9037	0.2726	0.9037	0.9506
No log	4.1667	150	1.0446	0.3029	1.0446	1.0221
No log	4.2222	152	1.0160	0.2806	1.0160	1.0080
No log	4.2778	154	0.8930	0.2297	0.8930	0.9450
No log	4.3333	156	0.8393	0.2109	0.8393	0.9161
No log	4.3889	158	0.8415	0.3504	0.8415	0.9174
No log	4.4444	160	0.8754	0.2808	0.8754	0.9356
No log	4.5	162	0.9575	0.2626	0.9575	0.9785
No log	4.5556	164	1.0390	0.3082	1.0390	1.0193
No log	4.6111	166	0.9984	0.3082	0.9984	0.9992
No log	4.6667	168	0.9033	0.2923	0.9033	0.9504
No log	4.7222	170	0.7896	0.2815	0.7896	0.8886
No log	4.7778	172	0.7980	0.3243	0.7980	0.8933
No log	4.8333	174	0.7847	0.2916	0.7847	0.8858
No log	4.8889	176	0.7937	0.2319	0.7937	0.8909
No log	4.9444	178	0.8449	0.2063	0.8449	0.9192
No log	5.0	180	0.8981	0.1867	0.8981	0.9477
No log	5.0556	182	0.9089	0.1867	0.9089	0.9534
No log	5.1111	184	0.8617	0.1718	0.8617	0.9283
No log	5.1667	186	0.8315	0.1866	0.8315	0.9118
No log	5.2222	188	0.9007	0.2142	0.9007	0.9491
No log	5.2778	190	0.9414	0.2358	0.9414	0.9703
No log	5.3333	192	1.0604	0.2119	1.0604	1.0298
No log	5.3889	194	1.0560	0.2119	1.0560	1.0276
No log	5.4444	196	0.9433	0.2358	0.9433	0.9712
No log	5.5	198	0.8834	0.2244	0.8834	0.9399
No log	5.5556	200	0.9139	0.2142	0.9139	0.9560
No log	5.6111	202	1.0765	0.2810	1.0765	1.0376
No log	5.6667	204	1.2505	0.2084	1.2505	1.1183
No log	5.7222	206	1.3327	0.1458	1.3327	1.1544
No log	5.7778	208	1.2173	0.2392	1.2173	1.1033
No log	5.8333	210	1.1305	0.2075	1.1305	1.0632
No log	5.8889	212	1.0223	0.2460	1.0223	1.0111
No log	5.9444	214	0.9795	0.2810	0.9795	0.9897
No log	6.0	216	0.9587	0.2810	0.9587	0.9791
No log	6.0556	218	1.0160	0.2460	1.0160	1.0080
No log	6.1111	220	1.1107	0.2833	1.1107	1.0539
No log	6.1667	222	1.0751	0.2833	1.0751	1.0369
No log	6.2222	224	0.9714	0.3347	0.9714	0.9856
No log	6.2778	226	0.9409	0.2810	0.9409	0.9700
No log	6.3333	228	0.9419	0.2670	0.9419	0.9705
No log	6.3889	230	0.9301	0.1962	0.9301	0.9644
No log	6.4444	232	1.0135	0.2142	1.0135	1.0067
No log	6.5	234	1.2194	0.1428	1.2194	1.1043
No log	6.5556	236	1.4698	0.0969	1.4698	1.2123
No log	6.6111	238	1.4532	0.0993	1.4532	1.2055
No log	6.6667	240	1.2133	0.1535	1.2133	1.1015
No log	6.7222	242	0.9763	0.2142	0.9763	0.9881
No log	6.7778	244	0.9462	0.2193	0.9462	0.9727
No log	6.8333	246	1.0575	0.1869	1.0575	1.0283
No log	6.8889	248	1.1696	0.1909	1.1696	1.0815
No log	6.9444	250	1.1722	0.2412	1.1722	1.0827
No log	7.0	252	1.2360	0.1427	1.2360	1.1118
No log	7.0556	254	1.1427	0.2482	1.1427	1.0690
No log	7.1111	256	0.9511	0.2029	0.9511	0.9752
No log	7.1667	258	0.7764	0.2027	0.7764	0.8812
No log	7.2222	260	0.7367	0.1922	0.7367	0.8583
No log	7.2778	262	0.7652	0.2085	0.7652	0.8748
No log	7.3333	264	0.9347	0.1962	0.9347	0.9668
No log	7.3889	266	1.1855	0.2501	1.1855	1.0888
No log	7.4444	268	1.2475	0.1638	1.2475	1.1169
No log	7.5	270	1.1362	0.3337	1.1362	1.0659
No log	7.5556	272	0.9768	0.2193	0.9768	0.9883
No log	7.6111	274	0.9424	0.2193	0.9424	0.9708
No log	7.6667	276	0.9901	0.2142	0.9901	0.9950
No log	7.7222	278	0.9731	0.2726	0.9731	0.9864
No log	7.7778	280	0.9958	0.3473	0.9958	0.9979
No log	7.8333	282	1.0205	0.3516	1.0205	1.0102
No log	7.8889	284	0.9906	0.3287	0.9906	0.9953
No log	7.9444	286	0.9651	0.2670	0.9651	0.9824
No log	8.0	288	0.9302	0.2574	0.9302	0.9644
No log	8.0556	290	0.9631	0.2574	0.9631	0.9814
No log	8.1111	292	1.0314	0.1651	1.0314	1.0156
No log	8.1667	294	1.2062	0.2324	1.2062	1.0983
No log	8.2222	296	1.3715	0.0992	1.3715	1.1711
No log	8.2778	298	1.3692	0.1041	1.3692	1.1701
No log	8.3333	300	1.1533	0.2324	1.1533	1.0739
No log	8.3889	302	0.9137	0.2244	0.9137	0.9559
No log	8.4444	304	0.7914	0.2652	0.7914	0.8896
No log	8.5	306	0.7674	0.2471	0.7674	0.8760
No log	8.5556	308	0.7855	0.2652	0.7855	0.8863
No log	8.6111	310	0.8061	0.2817	0.8061	0.8978
No log	8.6667	312	0.9109	0.2632	0.9109	0.9544
No log	8.7222	314	1.0052	0.1348	1.0052	1.0026
No log	8.7778	316	1.0422	0.1348	1.0422	1.0209
No log	8.8333	318	1.0638	0.1535	1.0638	1.0314
No log	8.8889	320	1.1402	0.2589	1.1402	1.0678
No log	8.9444	322	1.0583	0.2412	1.0583	1.0287
No log	9.0	324	1.0260	0.1147	1.0260	1.0129
No log	9.0556	326	1.0482	0.1178	1.0482	1.0238
No log	9.1111	328	1.0507	0.1277	1.0507	1.0251
No log	9.1667	330	0.9564	0.2193	0.9564	0.9779
No log	9.2222	332	1.0069	0.2193	1.0069	1.0034
No log	9.2778	334	0.9754	0.2244	0.9754	0.9876
No log	9.3333	336	0.9653	0.2244	0.9653	0.9825
No log	9.3889	338	0.9550	0.2632	0.9550	0.9772
No log	9.4444	340	0.9267	0.2632	0.9267	0.9627
No log	9.5	342	0.9638	0.2244	0.9638	0.9817
No log	9.5556	344	1.0600	0.1243	1.0600	1.0296
No log	9.6111	346	1.1122	0.1428	1.1122	1.0546
No log	9.6667	348	1.0652	0.1573	1.0652	1.0321
No log	9.7222	350	1.1433	0.1428	1.1433	1.0693
No log	9.7778	352	1.1895	0.1394	1.1895	1.0907
No log	9.8333	354	1.2146	0.1262	1.2146	1.1021
No log	9.8889	356	1.1250	0.1428	1.1250	1.0607
No log	9.9444	358	0.9058	0.2843	0.9058	0.9517
No log	10.0	360	0.7739	0.3312	0.7739	0.8797
No log	10.0556	362	0.7425	0.2787	0.7425	0.8617
No log	10.1111	364	0.7543	0.3092	0.7543	0.8685
No log	10.1667	366	0.8357	0.2632	0.8357	0.9141
No log	10.2222	368	1.0053	0.2460	1.0053	1.0027
No log	10.2778	370	1.0861	0.2119	1.0861	1.0422
No log	10.3333	372	0.9997	0.1955	0.9997	0.9999
No log	10.3889	374	0.9571	0.1416	0.9571	0.9783
No log	10.4444	376	0.9877	0.1379	0.9877	0.9938
No log	10.5	378	1.0900	0.1445	1.0900	1.0440
No log	10.5556	380	1.0997	0.2175	1.0997	1.0487
No log	10.6111	382	1.0478	0.1565	1.0478	1.0236
No log	10.6667	384	0.9071	0.2574	0.9071	0.9524
No log	10.7222	386	0.8261	0.2754	0.8261	0.9089
No log	10.7778	388	0.8130	0.2883	0.8130	0.9017
No log	10.8333	390	0.8004	0.2652	0.8004	0.8947
No log	10.8889	392	0.8215	0.3167	0.8215	0.9064
No log	10.9444	394	0.8592	0.2574	0.8592	0.9270
No log	11.0	396	0.9394	0.2410	0.9394	0.9692
No log	11.0556	398	0.9935	0.2728	0.9935	0.9968
No log	11.1111	400	1.0336	0.2389	1.0336	1.0166
No log	11.1667	402	0.9504	0.2670	0.9504	0.9749
No log	11.2222	404	0.8110	0.2950	0.8110	0.9006
No log	11.2778	406	0.7583	0.2787	0.7583	0.8708
No log	11.3333	408	0.7581	0.3092	0.7581	0.8707
No log	11.3889	410	0.8312	0.2467	0.8312	0.9117
No log	11.4444	412	0.9724	0.2308	0.9724	0.9861
No log	11.5	414	1.1835	0.2166	1.1835	1.0879
No log	11.5556	416	1.3204	0.1392	1.3204	1.1491
No log	11.6111	418	1.2727	0.2031	1.2727	1.1281
No log	11.6667	420	1.1090	0.1143	1.1090	1.0531
No log	11.7222	422	1.0319	0.1884	1.0319	1.0158
No log	11.7778	424	0.9524	0.2193	0.9524	0.9759
No log	11.8333	426	0.9027	0.2352	0.9027	0.9501
No log	11.8889	428	0.9208	0.2574	0.9208	0.9596
No log	11.9444	430	0.9788	0.2142	0.9788	0.9893
No log	12.0	432	0.9518	0.2142	0.9518	0.9756
No log	12.0556	434	0.9466	0.2387	0.9466	0.9729
No log	12.1111	436	0.9266	0.2193	0.9266	0.9626
No log	12.1667	438	0.9744	0.2046	0.9744	0.9871
No log	12.2222	440	1.0439	0.1827	1.0439	1.0217
No log	12.2778	442	1.1711	0.2183	1.1711	1.0822
No log	12.3333	444	1.1440	0.1949	1.1440	1.0696
No log	12.3889	446	1.0690	0.2271	1.0690	1.0339
No log	12.4444	448	0.8967	0.2843	0.8967	0.9469
No log	12.5	450	0.7445	0.2787	0.7445	0.8628
No log	12.5556	452	0.7155	0.2857	0.7155	0.8459
No log	12.6111	454	0.7574	0.2787	0.7574	0.8703
No log	12.6667	456	0.8836	0.2784	0.8836	0.9400
No log	12.7222	458	1.1029	0.2412	1.1029	1.0502
No log	12.7778	460	1.3176	0.1621	1.3176	1.1479
No log	12.8333	462	1.3960	0.1253	1.3960	1.1815
No log	12.8889	464	1.3073	0.1688	1.3073	1.1434
No log	12.9444	466	1.1196	0.2601	1.1196	1.0581
No log	13.0	468	0.9037	0.2518	0.9037	0.9507
No log	13.0556	470	0.7478	0.2407	0.7478	0.8648
No log	13.1111	472	0.7135	0.2930	0.7135	0.8447
No log	13.1667	474	0.7317	0.2857	0.7317	0.8554
No log	13.2222	476	0.8313	0.2116	0.8313	0.9118
No log	13.2778	478	1.0105	0.2000	1.0105	1.0052
No log	13.3333	480	1.2165	0.2166	1.2165	1.1030
No log	13.3889	482	1.3328	0.1895	1.3328	1.1545
No log	13.4444	484	1.2623	0.2020	1.2623	1.1235
No log	13.5	486	1.1675	0.2271	1.1675	1.0805
No log	13.5556	488	1.0702	0.2075	1.0702	1.0345
No log	13.6111	490	0.9636	0.2211	0.9636	0.9816
No log	13.6667	492	0.9344	0.2562	0.9344	0.9666
No log	13.7222	494	0.8955	0.2094	0.8955	0.9463
No log	13.7778	496	0.8774	0.2142	0.8774	0.9367
No log	13.8333	498	0.8753	0.2142	0.8753	0.9356
0.2793	13.8889	500	0.8657	0.2574	0.8657	0.9304
0.2793	13.9444	502	0.8819	0.2726	0.8819	0.9391
0.2793	14.0	504	0.8736	0.2726	0.8736	0.9347
0.2793	14.0556	506	0.8840	0.2726	0.8840	0.9402
0.2793	14.1111	508	0.8931	0.2670	0.8931	0.9450
0.2793	14.1667	510	0.9337	0.2562	0.9337	0.9663
0.2793	14.2222	512	0.9810	0.2756	0.9810	0.9904
0.2793	14.2778	514	0.9718	0.2756	0.9718	0.9858
0.2793	14.3333	516	0.9206	0.2358	0.9206	0.9595
0.2793	14.3889	518	0.8603	0.2244	0.8603	0.9275
0.2793	14.4444	520	0.7991	0.2950	0.7991	0.8939
0.2793	14.5	522	0.8120	0.2754	0.8120	0.9011
0.2793	14.5556	524	0.8060	0.2692	0.8060	0.8978
0.2793	14.6111	526	0.8455	0.2142	0.8455	0.9195
0.2793	14.6667	528	0.8964	0.2615	0.8964	0.9468
0.2793	14.7222	530	0.9502	0.2756	0.9502	0.9748
0.2793	14.7778	532	1.0226	0.2482	1.0226	1.0113
0.2793	14.8333	534	0.9653	0.2626	0.9653	0.9825
0.2793	14.8889	536	0.9088	0.2756	0.9088	0.9533
0.2793	14.9444	538	0.8668	0.2923	0.8668	0.9310
0.2793	15.0	540	0.8612	0.2923	0.8612	0.9280
0.2793	15.0556	542	0.8823	0.2562	0.8823	0.9393
0.2793	15.1111	544	0.9417	0.2756	0.9417	0.9704
0.2793	15.1667	546	0.9193	0.2562	0.9193	0.9588
0.2793	15.2222	548	0.9447	0.2000	0.9447	0.9720
0.2793	15.2778	550	0.8810	0.2574	0.8810	0.9386
0.2793	15.3333	552	0.8334	0.2692	0.8334	0.9129
0.2793	15.3889	554	0.7517	0.2950	0.7517	0.8670
0.2793	15.4444	556	0.6926	0.2857	0.6926	0.8322
0.2793	15.5	558	0.6878	0.2270	0.6878	0.8293
0.2793	15.5556	560	0.7086	0.2606	0.7086	0.8418
0.2793	15.6111	562	0.7571	0.2652	0.7571	0.8701
0.2793	15.6667	564	0.8731	0.2574	0.8731	0.9344
0.2793	15.7222	566	1.0610	0.2756	1.0610	1.0301
0.2793	15.7778	568	1.1563	0.2567	1.1563	1.0753
0.2793	15.8333	570	1.1194	0.2392	1.1194	1.0580
0.2793	15.8889	572	1.0360	0.2626	1.0360	1.0178
0.2793	15.9444	574	0.8873	0.2518	0.8873	0.9420
0.2793	16.0	576	0.8127	0.2692	0.8127	0.9015
0.2793	16.0556	578	0.7714	0.3167	0.7714	0.8783
0.2793	16.1111	580	0.7690	0.2754	0.7690	0.8769
0.2793	16.1667	582	0.7974	0.2692	0.7974	0.8930
0.2793	16.2222	584	0.8985	0.2574	0.8985	0.9479
0.2793	16.2778	586	1.0334	0.1651	1.0334	1.0166
0.2793	16.3333	588	1.0613	0.1210	1.0613	1.0302
0.2793	16.3889	590	0.9897	0.2094	0.9897	0.9948
0.2793	16.4444	592	0.9421	0.2142	0.9421	0.9706

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1