ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3600
• Qwk: 0.2512
• Mse: 1.3600
• Rmse: 1.1662

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.6087	0.0010	4.6087	2.1468
No log	0.0909	4	2.5724	-0.0019	2.5724	1.6039
No log	0.1364	6	1.9306	-0.0233	1.9306	1.3895
No log	0.1818	8	1.4330	0.0049	1.4330	1.1971
No log	0.2273	10	1.2337	0.1482	1.2337	1.1107
No log	0.2727	12	1.1956	0.2053	1.1956	1.0934
No log	0.3182	14	1.4167	0.0376	1.4167	1.1902
No log	0.3636	16	1.3460	0.0408	1.3460	1.1602
No log	0.4091	18	1.2523	0.0759	1.2523	1.1191
No log	0.4545	20	1.2759	0.1335	1.2759	1.1295
No log	0.5	22	1.3487	0.1671	1.3487	1.1613
No log	0.5455	24	1.4324	0.0934	1.4324	1.1968
No log	0.5909	26	1.4241	0.0731	1.4241	1.1934
No log	0.6364	28	1.3913	0.0639	1.3913	1.1795
No log	0.6818	30	1.5502	0.0758	1.5502	1.2451
No log	0.7273	32	1.6269	0.0858	1.6269	1.2755
No log	0.7727	34	1.4851	0.0865	1.4851	1.2186
No log	0.8182	36	1.3097	0.1168	1.3097	1.1444
No log	0.8636	38	1.2071	0.1753	1.2071	1.0987
No log	0.9091	40	1.1943	0.1979	1.1943	1.0928
No log	0.9545	42	1.1832	0.2188	1.1832	1.0878
No log	1.0	44	1.1670	0.2647	1.1670	1.0803
No log	1.0455	46	1.1723	0.2319	1.1723	1.0827
No log	1.0909	48	1.1501	0.2970	1.1501	1.0724
No log	1.1364	50	1.2479	0.125	1.2479	1.1171
No log	1.1818	52	1.2770	0.1046	1.2770	1.1301
No log	1.2273	54	1.1574	0.2343	1.1574	1.0758
No log	1.2727	56	1.0510	0.3804	1.0510	1.0252
No log	1.3182	58	1.0362	0.3596	1.0362	1.0179
No log	1.3636	60	1.0793	0.2995	1.0793	1.0389
No log	1.4091	62	1.1671	0.0970	1.1671	1.0803
No log	1.4545	64	1.1132	0.1780	1.1132	1.0551
No log	1.5	66	1.0441	0.3374	1.0441	1.0218
No log	1.5455	68	1.0681	0.3584	1.0681	1.0335
No log	1.5909	70	1.0868	0.3443	1.0868	1.0425
No log	1.6364	72	1.2061	0.3382	1.2061	1.0982
No log	1.6818	74	1.4195	0.2738	1.4195	1.1914
No log	1.7273	76	1.3714	0.2367	1.3714	1.1711
No log	1.7727	78	1.0364	0.2230	1.0364	1.0181
No log	1.8182	80	0.9803	0.4461	0.9803	0.9901
No log	1.8636	82	0.9838	0.4221	0.9838	0.9919
No log	1.9091	84	1.0472	0.2200	1.0472	1.0234
No log	1.9545	86	1.1750	0.1379	1.1750	1.0840
No log	2.0	88	1.3117	0.0692	1.3117	1.1453
No log	2.0455	90	1.4091	0.2032	1.4091	1.1871
No log	2.0909	92	1.2563	0.3413	1.2563	1.1209
No log	2.1364	94	0.9750	0.4142	0.9750	0.9874
No log	2.1818	96	0.9517	0.4599	0.9517	0.9756
No log	2.2273	98	0.9494	0.4120	0.9494	0.9744
No log	2.2727	100	1.1648	0.3949	1.1648	1.0793
No log	2.3182	102	1.6720	0.2479	1.6720	1.2931
No log	2.3636	104	1.6659	0.2891	1.6659	1.2907
No log	2.4091	106	1.3175	0.3694	1.3175	1.1478
No log	2.4545	108	1.0047	0.3953	1.0047	1.0023
No log	2.5	110	1.0098	0.3369	1.0098	1.0049
No log	2.5455	112	1.0537	0.1490	1.0537	1.0265
No log	2.5909	114	1.1725	0.2015	1.1725	1.0828
No log	2.6364	116	1.4222	0.0153	1.4222	1.1925
No log	2.6818	118	1.4652	0.0253	1.4652	1.2105
No log	2.7273	120	1.3337	0.1122	1.3337	1.1549
No log	2.7727	122	1.1054	0.1722	1.1054	1.0514
No log	2.8182	124	1.0963	0.3145	1.0963	1.0470
No log	2.8636	126	1.1056	0.2360	1.1056	1.0515
No log	2.9091	128	1.1990	0.1371	1.1990	1.0950
No log	2.9545	130	1.3150	0.2050	1.3150	1.1467
No log	3.0	132	1.3408	0.2222	1.3408	1.1579
No log	3.0455	134	1.3246	0.2221	1.3246	1.1509
No log	3.0909	136	1.3812	0.3162	1.3812	1.1752
No log	3.1364	138	1.4487	0.3525	1.4487	1.2036
No log	3.1818	140	1.3958	0.3159	1.3958	1.1814
No log	3.2273	142	1.3396	0.2863	1.3396	1.1574
No log	3.2727	144	1.2894	0.2611	1.2894	1.1355
No log	3.3182	146	1.2037	0.2671	1.2037	1.0971
No log	3.3636	148	1.1662	0.2925	1.1662	1.0799
No log	3.4091	150	1.1828	0.2246	1.1828	1.0876
No log	3.4545	152	1.2831	0.2606	1.2831	1.1328
No log	3.5	154	1.2796	0.3131	1.2796	1.1312
No log	3.5455	156	1.1948	0.3415	1.1948	1.0931
No log	3.5909	158	1.3320	0.3413	1.3320	1.1541
No log	3.6364	160	1.5762	0.2128	1.5762	1.2555
No log	3.6818	162	1.5817	0.1631	1.5817	1.2577
No log	3.7273	164	1.3896	0.3398	1.3896	1.1788
No log	3.7727	166	1.1470	0.3232	1.1470	1.0710
No log	3.8182	168	1.1249	0.2514	1.1249	1.0606
No log	3.8636	170	1.1028	0.2508	1.1028	1.0501
No log	3.9091	172	1.2112	0.2100	1.2112	1.1006
No log	3.9545	174	1.3822	0.1943	1.3822	1.1757
No log	4.0	176	1.6497	0.1559	1.6497	1.2844
No log	4.0455	178	1.8516	0.1525	1.8516	1.3607
No log	4.0909	180	1.8475	0.1775	1.8475	1.3592
No log	4.1364	182	1.5660	0.3283	1.5660	1.2514
No log	4.1818	184	1.2111	0.3540	1.2111	1.1005
No log	4.2273	186	1.0918	0.2997	1.0918	1.0449
No log	4.2727	188	1.1859	0.3540	1.1859	1.0890
No log	4.3182	190	1.3747	0.3590	1.3747	1.1725
No log	4.3636	192	1.5118	0.2619	1.5118	1.2295
No log	4.4091	194	1.4330	0.3814	1.4330	1.1971
No log	4.4545	196	1.1726	0.3540	1.1726	1.0828
No log	4.5	198	0.9560	0.4217	0.9560	0.9777
No log	4.5455	200	0.9405	0.4781	0.9405	0.9698
No log	4.5909	202	0.9498	0.4658	0.9498	0.9746
No log	4.6364	204	1.0526	0.3917	1.0526	1.0260
No log	4.6818	206	1.3722	0.3723	1.3722	1.1714
No log	4.7273	208	1.6918	0.1951	1.6918	1.3007
No log	4.7727	210	1.7217	0.1183	1.7217	1.3121
No log	4.8182	212	1.5589	0.1896	1.5589	1.2486
No log	4.8636	214	1.3771	0.2207	1.3771	1.1735
No log	4.9091	216	1.1631	0.1910	1.1631	1.0785
No log	4.9545	218	1.0251	0.1935	1.0251	1.0125
No log	5.0	220	1.0098	0.2939	1.0098	1.0049
No log	5.0455	222	1.0472	0.2327	1.0472	1.0233
No log	5.0909	224	1.2090	0.3308	1.2090	1.0995
No log	5.1364	226	1.3271	0.3502	1.3271	1.1520
No log	5.1818	228	1.3733	0.3364	1.3733	1.1719
No log	5.2273	230	1.4623	0.3423	1.4623	1.2093
No log	5.2727	232	1.4685	0.375	1.4685	1.2118
No log	5.3182	234	1.3277	0.3233	1.3277	1.1523
No log	5.3636	236	1.2552	0.3398	1.2552	1.1203
No log	5.4091	238	1.2543	0.3398	1.2543	1.1200
No log	5.4545	240	1.1595	0.3770	1.1595	1.0768
No log	5.5	242	1.1682	0.3770	1.1682	1.0808
No log	5.5455	244	1.2929	0.3474	1.2929	1.1370
No log	5.5909	246	1.3528	0.3207	1.3528	1.1631
No log	5.6364	248	1.3325	0.3146	1.3325	1.1543
No log	5.6818	250	1.3440	0.3146	1.3440	1.1593
No log	5.7273	252	1.3895	0.2931	1.3895	1.1788
No log	5.7727	254	1.3586	0.3554	1.3586	1.1656
No log	5.8182	256	1.3094	0.3089	1.3094	1.1443
No log	5.8636	258	1.2254	0.2883	1.2254	1.1070
No log	5.9091	260	1.2430	0.2826	1.2430	1.1149
No log	5.9545	262	1.3089	0.3303	1.3089	1.1441
No log	6.0	264	1.4166	0.3227	1.4166	1.1902
No log	6.0455	266	1.3950	0.3416	1.3950	1.1811
No log	6.0909	268	1.2629	0.2755	1.2629	1.1238
No log	6.1364	270	1.2140	0.2930	1.2140	1.1018
No log	6.1818	272	1.2128	0.3046	1.2128	1.1013
No log	6.2273	274	1.1759	0.2878	1.1759	1.0844
No log	6.2727	276	1.1725	0.2878	1.1725	1.0828
No log	6.3182	278	1.1498	0.2878	1.1498	1.0723
No log	6.3636	280	1.2508	0.3563	1.2508	1.1184
No log	6.4091	282	1.5574	0.2958	1.5574	1.2480
No log	6.4545	284	1.8120	0.1970	1.8120	1.3461
No log	6.5	286	1.8212	0.1664	1.8212	1.3495
No log	6.5455	288	1.6247	0.2975	1.6247	1.2746
No log	6.5909	290	1.5249	0.2872	1.5249	1.2349
No log	6.6364	292	1.4684	0.3024	1.4684	1.2118
No log	6.6818	294	1.3563	0.3025	1.3563	1.1646
No log	6.7273	296	1.2582	0.3433	1.2582	1.1217
No log	6.7727	298	1.1327	0.2317	1.1327	1.0643
No log	6.8182	300	1.0572	0.2121	1.0572	1.0282
No log	6.8636	302	1.0727	0.2317	1.0727	1.0357
No log	6.9091	304	1.1679	0.3776	1.1679	1.0807
No log	6.9545	306	1.2331	0.3821	1.2331	1.1104
No log	7.0	308	1.2618	0.3658	1.2618	1.1233
No log	7.0455	310	1.2120	0.3897	1.2120	1.1009
No log	7.0909	312	1.1346	0.4345	1.1346	1.0652
No log	7.1364	314	1.1381	0.4348	1.1381	1.0668
No log	7.1818	316	1.2817	0.3742	1.2817	1.1321
No log	7.2273	318	1.3133	0.3718	1.3133	1.1460
No log	7.2727	320	1.2169	0.2402	1.2169	1.1031
No log	7.3182	322	1.1142	0.2621	1.1142	1.0556
No log	7.3636	324	1.0655	0.2822	1.0655	1.0322
No log	7.4091	326	1.0808	0.2801	1.0808	1.0396
No log	7.4545	328	1.2400	0.4440	1.2400	1.1136
No log	7.5	330	1.3479	0.2961	1.3479	1.1610
No log	7.5455	332	1.2840	0.3718	1.2840	1.1332
No log	7.5909	334	1.1418	0.2522	1.1418	1.0686
No log	7.6364	336	1.1117	0.2673	1.1117	1.0544
No log	7.6818	338	1.1292	0.2522	1.1292	1.0627
No log	7.7273	340	1.1863	0.2263	1.1863	1.0892
No log	7.7727	342	1.2349	0.2108	1.2349	1.1113
No log	7.8182	344	1.2816	0.3699	1.2816	1.1321
No log	7.8636	346	1.2652	0.3934	1.2652	1.1248
No log	7.9091	348	1.1548	0.3023	1.1548	1.0746
No log	7.9545	350	1.0523	0.2723	1.0523	1.0258
No log	8.0	352	1.0454	0.2813	1.0454	1.0224
No log	8.0455	354	1.0797	0.2290	1.0797	1.0391
No log	8.0909	356	1.1609	0.1902	1.1609	1.0774
No log	8.1364	358	1.2727	0.1379	1.2727	1.1282
No log	8.1818	360	1.2731	0.1219	1.2731	1.1283
No log	8.2273	362	1.1886	0.1053	1.1886	1.0902
No log	8.2727	364	1.1033	0.2322	1.1033	1.0504
No log	8.3182	366	1.0218	0.2503	1.0218	1.0108
No log	8.3636	368	1.0061	0.2822	1.0061	1.0030
No log	8.4091	370	1.0581	0.3281	1.0581	1.0286
No log	8.4545	372	1.2784	0.3922	1.2784	1.1307
No log	8.5	374	1.4279	0.2804	1.4279	1.1950
No log	8.5455	376	1.4146	0.2804	1.4146	1.1894
No log	8.5909	378	1.2631	0.3943	1.2631	1.1239
No log	8.6364	380	1.0828	0.3667	1.0828	1.0406
No log	8.6818	382	0.9903	0.2843	0.9903	0.9952
No log	8.7273	384	0.9955	0.2967	0.9955	0.9977
No log	8.7727	386	1.0411	0.2640	1.0411	1.0203
No log	8.8182	388	1.1229	0.2219	1.1229	1.0597
No log	8.8636	390	1.2489	0.2714	1.2489	1.1175
No log	8.9091	392	1.3214	0.2956	1.3214	1.1495
No log	8.9545	394	1.2793	0.2927	1.2793	1.1310
No log	9.0	396	1.2529	0.2108	1.2529	1.1193
No log	9.0455	398	1.2296	0.2108	1.2296	1.1089
No log	9.0909	400	1.1887	0.2164	1.1887	1.0903
No log	9.1364	402	1.2012	0.2164	1.2012	1.0960
No log	9.1818	404	1.2618	0.2108	1.2618	1.1233
No log	9.2273	406	1.3252	0.2418	1.3252	1.1512
No log	9.2727	408	1.3381	0.2481	1.3381	1.1567
No log	9.3182	410	1.2707	0.1995	1.2707	1.1272
No log	9.3636	412	1.2172	0.2357	1.2172	1.1033
No log	9.4091	414	1.1558	0.2371	1.1558	1.0751
No log	9.4545	416	1.1843	0.2654	1.1843	1.0883
No log	9.5	418	1.2697	0.1995	1.2697	1.1268
No log	9.5455	420	1.3431	0.2354	1.3431	1.1589
No log	9.5909	422	1.3237	0.2173	1.3237	1.1505
No log	9.6364	424	1.2632	0.1795	1.2632	1.1239
No log	9.6818	426	1.1981	0.1048	1.1981	1.0946
No log	9.7273	428	1.1816	0.1048	1.1816	1.0870
No log	9.7727	430	1.2086	0.1795	1.2086	1.0994
No log	9.8182	432	1.2701	0.2761	1.2701	1.1270
No log	9.8636	434	1.2642	0.2980	1.2642	1.1244
No log	9.9091	436	1.2842	0.3697	1.2842	1.1332
No log	9.9545	438	1.2658	0.3679	1.2658	1.1251
No log	10.0	440	1.1812	0.2696	1.1812	1.0868
No log	10.0455	442	1.0917	0.2164	1.0917	1.0449
No log	10.0909	444	1.0852	0.2164	1.0852	1.0417
No log	10.1364	446	1.1238	0.2164	1.1238	1.0601
No log	10.1818	448	1.1499	0.3072	1.1499	1.0723
No log	10.2273	450	1.1550	0.2683	1.1550	1.0747
No log	10.2727	452	1.2222	0.2424	1.2222	1.1055
No log	10.3182	454	1.2358	0.2931	1.2358	1.1116
No log	10.3636	456	1.1878	0.2837	1.1878	1.0899
No log	10.4091	458	1.1895	0.3115	1.1895	1.0906
No log	10.4545	460	1.2119	0.3243	1.2119	1.1009
No log	10.5	462	1.1768	0.3187	1.1768	1.0848
No log	10.5455	464	1.1467	0.3072	1.1467	1.0709
No log	10.5909	466	1.2149	0.3087	1.2149	1.1022
No log	10.6364	468	1.2360	0.3339	1.2360	1.1118
No log	10.6818	470	1.1328	0.4151	1.1328	1.0644
No log	10.7273	472	1.0941	0.3669	1.0941	1.0460
No log	10.7727	474	1.0845	0.3171	1.0845	1.0414
No log	10.8182	476	1.1109	0.3669	1.1109	1.0540
No log	10.8636	478	1.1158	0.3446	1.1158	1.0563
No log	10.9091	480	1.0927	0.3446	1.0927	1.0453
No log	10.9545	482	1.1411	0.3446	1.1411	1.0682
No log	11.0	484	1.1288	0.3446	1.1288	1.0624
No log	11.0455	486	1.0518	0.3545	1.0518	1.0256
No log	11.0909	488	0.9946	0.2276	0.9946	0.9973
No log	11.1364	490	0.9266	0.2503	0.9266	0.9626
No log	11.1818	492	0.9132	0.2658	0.9132	0.9556
No log	11.2273	494	0.9430	0.2708	0.9430	0.9711
No log	11.2727	496	1.0370	0.3343	1.0370	1.0183
No log	11.3182	498	1.1959	0.3324	1.1959	1.0936
0.3558	11.3636	500	1.3612	0.3730	1.3612	1.1667
0.3558	11.4091	502	1.3702	0.3730	1.3702	1.1705
0.3558	11.4545	504	1.2471	0.3501	1.2471	1.1167
0.3558	11.5	506	1.1223	0.3908	1.1223	1.0594
0.3558	11.5455	508	1.0821	0.3809	1.0821	1.0403
0.3558	11.5909	510	1.0787	0.3289	1.0787	1.0386
0.3558	11.6364	512	1.1539	0.2558	1.1539	1.0742
0.3558	11.6818	514	1.2801	0.3488	1.2801	1.1314
0.3558	11.7273	516	1.3869	0.2512	1.3869	1.1776
0.3558	11.7727	518	1.3600	0.2512	1.3600	1.1662

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1