ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4338
• Qwk: 0.1407
• Mse: 1.4338
• Rmse: 1.1974

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	4.2347	0.0178	4.2347	2.0578
No log	0.1111	4	2.3514	0.0462	2.3514	1.5334
No log	0.1667	6	1.8930	-0.0082	1.8930	1.3759
No log	0.2222	8	1.1959	0.1979	1.1959	1.0935
No log	0.2778	10	1.2496	0.0701	1.2496	1.1178
No log	0.3333	12	1.3892	-0.0296	1.3892	1.1787
No log	0.3889	14	1.3074	-0.0858	1.3074	1.1434
No log	0.4444	16	1.1922	0.0850	1.1922	1.0919
No log	0.5	18	1.1243	0.1881	1.1243	1.0603
No log	0.5556	20	1.1225	0.0604	1.1225	1.0595
No log	0.6111	22	1.1062	0.0445	1.1062	1.0517
No log	0.6667	24	1.0935	0.1076	1.0935	1.0457
No log	0.7222	26	1.0925	0.2365	1.0925	1.0452
No log	0.7778	28	1.1041	0.1997	1.1041	1.0508
No log	0.8333	30	1.1243	0.2100	1.1243	1.0603
No log	0.8889	32	1.1332	0.1805	1.1332	1.0645
No log	0.9444	34	1.0906	0.2366	1.0906	1.0443
No log	1.0	36	1.0628	0.1935	1.0628	1.0309
No log	1.0556	38	1.0671	0.1447	1.0671	1.0330
No log	1.1111	40	1.0835	0.0385	1.0835	1.0409
No log	1.1667	42	1.0947	0.0574	1.0947	1.0463
No log	1.2222	44	1.1340	0.0111	1.1340	1.0649
No log	1.2778	46	1.1528	0.0884	1.1528	1.0737
No log	1.3333	48	1.0994	0.1101	1.0994	1.0485
No log	1.3889	50	1.0905	0.0293	1.0905	1.0443
No log	1.4444	52	1.1743	0.0160	1.1743	1.0837
No log	1.5	54	1.1934	0.1770	1.1934	1.0924
No log	1.5556	56	1.2113	0.1770	1.2113	1.1006
No log	1.6111	58	1.3160	0.2395	1.3160	1.1472
No log	1.6667	60	1.4909	0.1892	1.4909	1.2210
No log	1.7222	62	1.4066	0.2863	1.4066	1.1860
No log	1.7778	64	1.2915	0.2915	1.2915	1.1365
No log	1.8333	66	1.5801	0.1871	1.5801	1.2570
No log	1.8889	68	1.9347	0.1487	1.9347	1.3909
No log	1.9444	70	1.8137	0.1559	1.8137	1.3467
No log	2.0	72	1.5147	0.2488	1.5147	1.2307
No log	2.0556	74	1.3057	0.3277	1.3057	1.1427
No log	2.1111	76	1.4478	0.2406	1.4478	1.2032
No log	2.1667	78	1.6012	0.2606	1.6012	1.2654
No log	2.2222	80	1.5243	0.2117	1.5243	1.2346
No log	2.2778	82	1.4949	0.0981	1.4949	1.2227
No log	2.3333	84	1.4649	0.0694	1.4649	1.2103
No log	2.3889	86	1.3064	0.1407	1.3064	1.1430
No log	2.4444	88	1.1106	0.1265	1.1106	1.0539
No log	2.5	90	1.0747	0.0987	1.0747	1.0367
No log	2.5556	92	1.2048	0.2065	1.2048	1.0976
No log	2.6111	94	1.5209	0.2391	1.5209	1.2332
No log	2.6667	96	1.6984	0.2317	1.6984	1.3032
No log	2.7222	98	1.7303	0.1871	1.7303	1.3154
No log	2.7778	100	1.7487	0.2007	1.7487	1.3224
No log	2.8333	102	1.6528	0.2338	1.6528	1.2856
No log	2.8889	104	1.7132	0.2007	1.7132	1.3089
No log	2.9444	106	1.6951	0.2007	1.6951	1.3020
No log	3.0	108	1.8916	0.1925	1.8916	1.3754
No log	3.0556	110	1.8488	0.1964	1.8488	1.3597
No log	3.1111	112	1.4253	0.2117	1.4253	1.1939
No log	3.1667	114	1.2688	0.2132	1.2688	1.1264
No log	3.2222	116	1.4535	0.2117	1.4535	1.2056
No log	3.2778	118	1.6753	0.2566	1.6753	1.2943
No log	3.3333	120	1.6257	0.2525	1.6257	1.2750
No log	3.3889	122	1.3507	0.1744	1.3507	1.1622
No log	3.4444	124	1.1826	0.0	1.1826	1.0875
No log	3.5	126	1.1363	0.0	1.1363	1.0660
No log	3.5556	128	1.2473	0.1407	1.2473	1.1168
No log	3.6111	130	1.5015	0.2221	1.5015	1.2254
No log	3.6667	132	1.6331	0.2644	1.6331	1.2779
No log	3.7222	134	1.8261	0.2236	1.8261	1.3513
No log	3.7778	136	1.7425	0.2296	1.7425	1.3200
No log	3.8333	138	1.4253	0.1892	1.4253	1.1939
No log	3.8889	140	1.2619	0.2184	1.2619	1.1233
No log	3.9444	142	1.3420	0.2239	1.3420	1.1584
No log	4.0	144	1.4342	0.2292	1.4342	1.1976
No log	4.0556	146	1.4565	0.1892	1.4565	1.2069
No log	4.1111	148	1.5531	0.1950	1.5531	1.2462
No log	4.1667	150	1.5806	0.2005	1.5806	1.2572
No log	4.2222	152	1.4628	0.1898	1.4628	1.2095
No log	4.2778	154	1.4614	0.2184	1.4614	1.2089
No log	4.3333	156	1.5824	0.2239	1.5824	1.2579
No log	4.3889	158	1.5636	0.2342	1.5636	1.2505
No log	4.4444	160	1.4505	0.1958	1.4505	1.2044
No log	4.5	162	1.4458	0.2239	1.4458	1.2024
No log	4.5556	164	1.4421	0.2239	1.4421	1.2009
No log	4.6111	166	1.6281	0.2110	1.6281	1.2760
No log	4.6667	168	1.8027	0.2007	1.8027	1.3427
No log	4.7222	170	1.7373	0.2053	1.7373	1.3181
No log	4.7778	172	1.7492	0.2419	1.7492	1.3226
No log	4.8333	174	1.7968	0.2494	1.7968	1.3404
No log	4.8889	176	2.0079	0.1659	2.0079	1.4170
No log	4.9444	178	2.0598	0.1442	2.0598	1.4352
No log	5.0	180	1.8513	0.2299	1.8513	1.3606
No log	5.0556	182	1.5844	0.2906	1.5844	1.2587
No log	5.1111	184	1.5016	0.2806	1.5016	1.2254
No log	5.1667	186	1.6439	0.2806	1.6439	1.2822
No log	5.2222	188	1.5594	0.2221	1.5594	1.2488
No log	5.2778	190	1.4173	0.1703	1.4173	1.1905
No log	5.3333	192	1.3046	0.1486	1.3046	1.1422
No log	5.3889	194	1.2783	0.1407	1.2783	1.1306
No log	5.4444	196	1.3306	0.1486	1.3306	1.1535
No log	5.5	198	1.5593	0.2170	1.5593	1.2487
No log	5.5556	200	1.8312	0.2565	1.8312	1.3532
No log	5.6111	202	1.9089	0.2393	1.9089	1.3816
No log	5.6667	204	1.7819	0.2784	1.7819	1.3349
No log	5.7222	206	1.5077	0.3177	1.5077	1.2279
No log	5.7778	208	1.4461	0.2974	1.4461	1.2025
No log	5.8333	210	1.6450	0.3123	1.6450	1.2826
No log	5.8889	212	1.6084	0.3066	1.6084	1.2682
No log	5.9444	214	1.3897	0.2568	1.3897	1.1789
No log	6.0	216	1.2638	0.2372	1.2638	1.1242
No log	6.0556	218	1.3236	0.2372	1.3236	1.1505
No log	6.1111	220	1.3813	0.2184	1.3813	1.1753
No log	6.1667	222	1.4092	0.2522	1.4092	1.1871
No log	6.2222	224	1.4686	0.2611	1.4686	1.2119
No log	6.2778	226	1.5736	0.3117	1.5736	1.2544
No log	6.3333	228	1.8111	0.2670	1.8111	1.3458
No log	6.3889	230	1.9114	0.1683	1.9114	1.3825
No log	6.4444	232	1.7806	0.2840	1.7806	1.3344
No log	6.5	234	1.4746	0.1814	1.4746	1.2143
No log	6.5556	236	1.2489	0.0	1.2489	1.1176
No log	6.6111	238	1.1995	0.0	1.1995	1.0952
No log	6.6667	240	1.2345	0.0	1.2345	1.1111
No log	6.7222	242	1.2150	0.0	1.2150	1.1023
No log	6.7778	244	1.3135	0.2065	1.3135	1.1461
No log	6.8333	246	1.5091	0.2117	1.5091	1.2284
No log	6.8889	248	1.5654	0.2270	1.5654	1.2512
No log	6.9444	250	1.3947	0.2709	1.3947	1.1810
No log	7.0	252	1.2791	0.2495	1.2791	1.1310
No log	7.0556	254	1.2384	0.2389	1.2384	1.1128
No log	7.1111	256	1.3840	0.2869	1.3840	1.1764
No log	7.1667	258	1.6584	0.2874	1.6584	1.2878
No log	7.2222	260	1.7382	0.2906	1.7382	1.3184
No log	7.2778	262	1.5983	0.2644	1.5983	1.2642
No log	7.3333	264	1.4023	0.2239	1.4023	1.1842
No log	7.3889	266	1.3412	0.2424	1.3412	1.1581
No log	7.4444	268	1.3747	0.2424	1.3747	1.1725
No log	7.5	270	1.4738	0.2611	1.4738	1.2140
No log	7.5556	272	1.6279	0.2644	1.6279	1.2759
No log	7.6111	274	1.6068	0.2770	1.6068	1.2676
No log	7.6667	276	1.4648	0.2482	1.4648	1.2103
No log	7.7222	278	1.3638	0.2793	1.3638	1.1678
No log	7.7778	280	1.3899	0.2653	1.3899	1.1789
No log	7.8333	282	1.4576	0.2525	1.4576	1.2073
No log	7.8889	284	1.7008	0.3036	1.7008	1.3042
No log	7.9444	286	1.9389	0.1420	1.9389	1.3924
No log	8.0	288	2.0394	0.0981	2.0394	1.4281
No log	8.0556	290	1.9639	0.1252	1.9639	1.4014
No log	8.1111	292	1.7180	0.2527	1.7180	1.3107
No log	8.1667	294	1.5325	0.2752	1.5325	1.2379
No log	8.2222	296	1.3887	0.1880	1.3887	1.1784
No log	8.2778	298	1.2904	0.2424	1.2904	1.1359
No log	8.3333	300	1.3053	0.2424	1.3053	1.1425
No log	8.3889	302	1.4056	0.3018	1.4056	1.1856
No log	8.4444	304	1.5655	0.2974	1.5655	1.2512
No log	8.5	306	1.7234	0.2784	1.7234	1.3128
No log	8.5556	308	1.6934	0.3259	1.6934	1.3013
No log	8.6111	310	1.4712	0.2940	1.4712	1.2129
No log	8.6667	312	1.2270	0.2424	1.2270	1.1077
No log	8.7222	314	1.1237	0.1449	1.1237	1.0601
No log	8.7778	316	1.1308	0.0781	1.1308	1.0634
No log	8.8333	318	1.2158	0.1814	1.2158	1.1026
No log	8.8889	320	1.3418	0.2474	1.3417	1.1583
No log	8.9444	322	1.5461	0.2733	1.5461	1.2434
No log	9.0	324	1.7828	0.2670	1.7828	1.3352
No log	9.0556	326	1.9138	0.2222	1.9138	1.3834
No log	9.1111	328	1.8038	0.2098	1.8038	1.3430
No log	9.1667	330	1.5777	0.2437	1.5777	1.2561
No log	9.2222	332	1.4269	0.2065	1.4269	1.1945
No log	9.2778	334	1.3409	0.1407	1.3409	1.1580
No log	9.3333	336	1.3035	0.1052	1.3035	1.1417
No log	9.3889	338	1.3304	0.0401	1.3304	1.1534
No log	9.4444	340	1.3333	0.0401	1.3333	1.1547
No log	9.5	342	1.3511	0.1052	1.3511	1.1624
No log	9.5556	344	1.3450	0.1814	1.3450	1.1597
No log	9.6111	346	1.3515	0.2184	1.3515	1.1625
No log	9.6667	348	1.5354	0.2653	1.5354	1.2391
No log	9.7222	350	1.7959	0.2717	1.7959	1.3401
No log	9.7778	352	1.8505	0.2816	1.8505	1.3603
No log	9.8333	354	1.7686	0.3284	1.7686	1.3299
No log	9.8889	356	1.7566	0.3309	1.7566	1.3254
No log	9.9444	358	1.7083	0.2974	1.7083	1.3070
No log	10.0	360	1.5910	0.2126	1.5910	1.2613
No log	10.0556	362	1.4215	0.1052	1.4215	1.1923
No log	10.1111	364	1.3287	0.0	1.3287	1.1527
No log	10.1667	366	1.3199	0.0	1.3199	1.1489
No log	10.2222	368	1.3901	0.1052	1.3901	1.1790
No log	10.2778	370	1.5663	0.2184	1.5663	1.2515
No log	10.3333	372	1.7267	0.2363	1.7267	1.3140
No log	10.3889	374	1.7065	0.2270	1.7065	1.3063
No log	10.4444	376	1.5726	0.2568	1.5726	1.2540
No log	10.5	378	1.4141	0.1562	1.4141	1.1892
No log	10.5556	380	1.3266	0.1052	1.3266	1.1518
No log	10.6111	382	1.3091	0.0679	1.3091	1.1441
No log	10.6667	384	1.3555	0.1052	1.3555	1.1643
No log	10.7222	386	1.4573	0.1744	1.4573	1.2072
No log	10.7778	388	1.5453	0.2474	1.5453	1.2431
No log	10.8333	390	1.5448	0.2474	1.5448	1.2429
No log	10.8889	392	1.4990	0.2292	1.4990	1.2244
No log	10.9444	394	1.5266	0.2437	1.5266	1.2356
No log	11.0	396	1.4911	0.2611	1.4911	1.2211
No log	11.0556	398	1.5302	0.2869	1.5302	1.2370
No log	11.1111	400	1.6689	0.2770	1.6689	1.2918
No log	11.1667	402	1.7086	0.2806	1.7086	1.3071
No log	11.2222	404	1.6347	0.2568	1.6347	1.2786
No log	11.2778	406	1.4820	0.2184	1.4820	1.2174
No log	11.3333	408	1.3129	0.0781	1.3129	1.1458
No log	11.3889	410	1.2508	0.0	1.2508	1.1184
No log	11.4444	412	1.2049	0.0	1.2049	1.0977
No log	11.5	414	1.2299	0.0	1.2299	1.1090
No log	11.5556	416	1.2278	0.0	1.2278	1.1081
No log	11.6111	418	1.2097	0.0	1.2097	1.0999
No log	11.6667	420	1.2653	0.0781	1.2653	1.1249
No log	11.7222	422	1.3328	0.1407	1.3328	1.1545
No log	11.7778	424	1.3230	0.1814	1.3230	1.1502
No log	11.8333	426	1.2793	0.1744	1.2793	1.1311
No log	11.8889	428	1.3069	0.1744	1.3069	1.1432
No log	11.9444	430	1.4076	0.2126	1.4076	1.1864
No log	12.0	432	1.4343	0.1407	1.4343	1.1976
No log	12.0556	434	1.4305	0.1744	1.4305	1.1960
No log	12.1111	436	1.4026	0.1744	1.4026	1.1843
No log	12.1667	438	1.3833	0.1407	1.3833	1.1761
No log	12.2222	440	1.3730	0.0401	1.3730	1.1718
No log	12.2778	442	1.3782	0.0	1.3782	1.1740
No log	12.3333	444	1.3518	0.0	1.3518	1.1627
No log	12.3889	446	1.3621	0.0	1.3621	1.1671
No log	12.4444	448	1.2894	0.1744	1.2894	1.1355
No log	12.5	450	1.2946	0.2126	1.2946	1.1378
No log	12.5556	452	1.3665	0.2474	1.3665	1.1690
No log	12.6111	454	1.4512	0.2793	1.4512	1.2047
No log	12.6667	456	1.3614	0.2869	1.3614	1.1668
No log	12.7222	458	1.2498	0.2568	1.2498	1.1179
No log	12.7778	460	1.2321	0.2752	1.2321	1.1100
No log	12.8333	462	1.2901	0.2568	1.2901	1.1358
No log	12.8889	464	1.3909	0.2611	1.3909	1.1794
No log	12.9444	466	1.4337	0.2474	1.4337	1.1974
No log	13.0	468	1.5358	0.2391	1.5358	1.2393
No log	13.0556	470	1.4771	0.2752	1.4771	1.2154
No log	13.1111	472	1.4266	0.2126	1.4266	1.1944
No log	13.1667	474	1.3860	0.1052	1.3860	1.1773
No log	13.2222	476	1.2820	0.0	1.2820	1.1322
No log	13.2778	478	1.1700	0.0	1.1700	1.0817
No log	13.3333	480	1.1263	0.0	1.1263	1.0613
No log	13.3889	482	1.1415	0.0	1.1415	1.0684
No log	13.4444	484	1.2601	0.1744	1.2601	1.1225
No log	13.5	486	1.4116	0.2184	1.4116	1.1881
No log	13.5556	488	1.6040	0.3006	1.6040	1.2665
No log	13.6111	490	1.6677	0.3515	1.6677	1.2914
No log	13.6667	492	1.5320	0.3259	1.5320	1.2378
No log	13.7222	494	1.3286	0.2793	1.3286	1.1527
No log	13.7778	496	1.1642	0.2184	1.1642	1.0790
No log	13.8333	498	1.1672	0.2065	1.1672	1.0804
0.2539	13.8889	500	1.2138	0.2184	1.2138	1.1017
0.2539	13.9444	502	1.3358	0.2184	1.3358	1.1558
0.2539	14.0	504	1.5348	0.2733	1.5348	1.2389
0.2539	14.0556	506	1.6473	0.2974	1.6473	1.2835
0.2539	14.1111	508	1.6229	0.2869	1.6229	1.2739
0.2539	14.1667	510	1.5070	0.2424	1.5070	1.2276
0.2539	14.2222	512	1.3901	0.2065	1.3901	1.1790
0.2539	14.2778	514	1.3364	0.1052	1.3364	1.1560
0.2539	14.3333	516	1.3317	0.1052	1.3317	1.1540
0.2539	14.3889	518	1.3678	0.1052	1.3678	1.1695
0.2539	14.4444	520	1.4338	0.1407	1.4338	1.1974

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1