ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5899
• Qwk: -0.0132
• Mse: 1.5899
• Rmse: 1.2609

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0215	2	4.7667	0.0010	4.7667	2.1833
No log	0.0430	4	2.6952	-0.0135	2.6952	1.6417
No log	0.0645	6	1.9198	-0.0575	1.9198	1.3856
No log	0.0860	8	1.4856	-0.0722	1.4856	1.2188
No log	0.1075	10	1.4717	-0.0426	1.4717	1.2131
No log	0.1290	12	1.3609	0.0509	1.3609	1.1666
No log	0.1505	14	1.3364	-0.0228	1.3364	1.1560
No log	0.1720	16	1.2632	0.2016	1.2632	1.1239
No log	0.1935	18	1.2896	0.1493	1.2896	1.1356
No log	0.2151	20	1.4982	-0.0798	1.4982	1.2240
No log	0.2366	22	1.3869	0.0116	1.3869	1.1777
No log	0.2581	24	1.2881	0.0711	1.2881	1.1349
No log	0.2796	26	1.2881	0.0543	1.2881	1.1349
No log	0.3011	28	1.3005	0.0682	1.3005	1.1404
No log	0.3226	30	1.3243	0.0516	1.3243	1.1508
No log	0.3441	32	1.4012	-0.0825	1.4012	1.1837
No log	0.3656	34	1.4852	-0.0535	1.4852	1.2187
No log	0.3871	36	1.4837	-0.0772	1.4837	1.2181
No log	0.4086	38	1.3974	0.0229	1.3974	1.1821
No log	0.4301	40	1.3933	0.0586	1.3933	1.1804
No log	0.4516	42	1.3982	0.0613	1.3982	1.1825
No log	0.4731	44	1.4019	0.0395	1.4019	1.1840
No log	0.4946	46	1.4116	0.0891	1.4116	1.1881
No log	0.5161	48	1.4386	0.0693	1.4386	1.1994
No log	0.5376	50	1.4940	0.0500	1.4940	1.2223
No log	0.5591	52	1.5730	0.1371	1.5730	1.2542
No log	0.5806	54	1.6067	0.1280	1.6068	1.2676
No log	0.6022	56	1.5127	0.0223	1.5127	1.2299
No log	0.6237	58	1.5603	-0.0667	1.5603	1.2491
No log	0.6452	60	1.5406	-0.0654	1.5406	1.2412
No log	0.6667	62	1.5242	0.0821	1.5242	1.2346
No log	0.6882	64	1.5712	0.0303	1.5712	1.2535
No log	0.7097	66	1.5192	0.0598	1.5192	1.2325
No log	0.7312	68	1.4336	0.1475	1.4336	1.1973
No log	0.7527	70	1.3980	0.2073	1.3980	1.1824
No log	0.7742	72	1.4228	0.1141	1.4228	1.1928
No log	0.7957	74	1.4706	0.1807	1.4706	1.2127
No log	0.8172	76	1.4140	0.0994	1.4140	1.1891
No log	0.8387	78	1.3984	0.1503	1.3984	1.1825
No log	0.8602	80	1.3845	0.2000	1.3845	1.1767
No log	0.8817	82	1.3507	0.2579	1.3507	1.1622
No log	0.9032	84	1.3770	0.2227	1.3770	1.1735
No log	0.9247	86	1.4093	0.2188	1.4093	1.1871
No log	0.9462	88	1.4805	0.1795	1.4805	1.2168
No log	0.9677	90	1.5692	0.1326	1.5692	1.2527
No log	0.9892	92	1.6348	0.1935	1.6348	1.2786
No log	1.0108	94	1.5970	0.1863	1.5970	1.2637
No log	1.0323	96	1.8090	0.2268	1.8090	1.3450
No log	1.0538	98	1.9526	0.1408	1.9526	1.3974
No log	1.0753	100	1.8347	0.1513	1.8347	1.3545
No log	1.0968	102	1.7497	0.1236	1.7497	1.3228
No log	1.1183	104	1.6957	0.1514	1.6957	1.3022
No log	1.1398	106	1.5969	0.1886	1.5969	1.2637
No log	1.1613	108	1.5717	0.1886	1.5717	1.2537
No log	1.1828	110	1.6553	0.1280	1.6553	1.2866
No log	1.2043	112	1.7472	0.0470	1.7472	1.3218
No log	1.2258	114	1.7258	0.0813	1.7258	1.3137
No log	1.2473	116	1.4318	0.0467	1.4318	1.1966
No log	1.2688	118	1.3424	0.0367	1.3424	1.1586
No log	1.2903	120	1.4174	0.0317	1.4174	1.1905
No log	1.3118	122	1.5229	0.0126	1.5229	1.2341
No log	1.3333	124	1.5454	0.0807	1.5454	1.2432
No log	1.3548	126	1.5079	0.1132	1.5079	1.2280
No log	1.3763	128	1.4610	0.1942	1.4610	1.2087
No log	1.3978	130	1.5402	0.1484	1.5402	1.2411
No log	1.4194	132	1.6653	0.2107	1.6653	1.2905
No log	1.4409	134	1.6233	0.1749	1.6233	1.2741
No log	1.4624	136	1.5047	0.2394	1.5047	1.2267
No log	1.4839	138	1.5292	0.1903	1.5292	1.2366
No log	1.5054	140	1.6534	0.1688	1.6534	1.2859
No log	1.5269	142	1.6402	0.1688	1.6402	1.2807
No log	1.5484	144	1.5633	0.2004	1.5633	1.2503
No log	1.5699	146	1.4596	0.2917	1.4596	1.2082
No log	1.5914	148	1.5246	0.1734	1.5246	1.2347
No log	1.6129	150	1.6157	0.1923	1.6157	1.2711
No log	1.6344	152	1.7747	0.2294	1.7747	1.3322
No log	1.6559	154	1.7954	0.2017	1.7954	1.3399
No log	1.6774	156	1.7266	0.1234	1.7266	1.3140
No log	1.6989	158	1.7625	0.1373	1.7625	1.3276
No log	1.7204	160	1.9385	0.1551	1.9385	1.3923
No log	1.7419	162	2.0288	0.1318	2.0288	1.4244
No log	1.7634	164	1.9256	0.1720	1.9256	1.3876
No log	1.7849	166	1.6410	0.1771	1.6410	1.2810
No log	1.8065	168	1.4363	0.1048	1.4363	1.1984
No log	1.8280	170	1.3909	0.0693	1.3909	1.1793
No log	1.8495	172	1.3931	0.1244	1.3931	1.1803
No log	1.8710	174	1.4452	0.0244	1.4452	1.2022
No log	1.8925	176	1.5771	0.1254	1.5771	1.2558
No log	1.9140	178	1.8331	0.1884	1.8331	1.3539
No log	1.9355	180	2.0664	0.1639	2.0664	1.4375
No log	1.9570	182	2.0488	0.1417	2.0488	1.4314
No log	1.9785	184	1.7867	0.1528	1.7867	1.3367
No log	2.0	186	1.7109	0.1853	1.7109	1.3080
No log	2.0215	188	1.8025	0.1391	1.8025	1.3426
No log	2.0430	190	1.9165	0.0950	1.9165	1.3844
No log	2.0645	192	1.7715	0.0663	1.7715	1.3310
No log	2.0860	194	1.5872	0.1226	1.5872	1.2598
No log	2.1075	196	1.4472	0.0803	1.4472	1.2030
No log	2.1290	198	1.4371	0.0437	1.4371	1.1988
No log	2.1505	200	1.4629	0.0217	1.4629	1.2095
No log	2.1720	202	1.5953	0.0478	1.5953	1.2631
No log	2.1935	204	1.6834	0.0947	1.6834	1.2974
No log	2.2151	206	1.8402	0.1513	1.8402	1.3565
No log	2.2366	208	1.9311	0.1463	1.9311	1.3897
No log	2.2581	210	1.8888	0.0741	1.8888	1.3743
No log	2.2796	212	1.6506	0.0711	1.6506	1.2847
No log	2.3011	214	1.6228	0.1331	1.6228	1.2739
No log	2.3226	216	1.5954	0.1657	1.5954	1.2631
No log	2.3441	218	1.5758	0.2021	1.5758	1.2553
No log	2.3656	220	1.8152	0.0979	1.8152	1.3473
No log	2.3871	222	2.0568	0.1282	2.0568	1.4342
No log	2.4086	224	1.8836	0.1500	1.8836	1.3725
No log	2.4301	226	1.6843	0.0902	1.6843	1.2978
No log	2.4516	228	1.7152	0.1259	1.7152	1.3097
No log	2.4731	230	1.7362	0.1409	1.7362	1.3176
No log	2.4946	232	1.5233	0.1152	1.5233	1.2342
No log	2.5161	234	1.4940	0.1199	1.4940	1.2223
No log	2.5376	236	1.6831	0.1092	1.6831	1.2973
No log	2.5591	238	1.8491	0.1368	1.8491	1.3598
No log	2.5806	240	1.7842	0.1328	1.7842	1.3357
No log	2.6022	242	1.6471	0.1007	1.6471	1.2834
No log	2.6237	244	1.5645	0.1364	1.5645	1.2508
No log	2.6452	246	1.5245	0.1364	1.5245	1.2347
No log	2.6667	248	1.4439	0.1067	1.4439	1.2016
No log	2.6882	250	1.5875	0.1101	1.5875	1.2599
No log	2.7097	252	1.7020	0.1543	1.7020	1.3046
No log	2.7312	254	1.8793	0.1751	1.8793	1.3709
No log	2.7527	256	2.0351	0.1453	2.0351	1.4266
No log	2.7742	258	1.8807	0.1219	1.8807	1.3714
No log	2.7957	260	1.7402	0.1281	1.7402	1.3192
No log	2.8172	262	1.8233	0.1385	1.8233	1.3503
No log	2.8387	264	2.1558	0.1052	2.1558	1.4682
No log	2.8602	266	2.1646	0.0918	2.1646	1.4712
No log	2.8817	268	1.8553	0.1325	1.8553	1.3621
No log	2.9032	270	1.4871	0.0513	1.4871	1.2195
No log	2.9247	272	1.3531	0.0951	1.3531	1.1632
No log	2.9462	274	1.3487	0.0983	1.3487	1.1613
No log	2.9677	276	1.4141	0.0334	1.4141	1.1892
No log	2.9892	278	1.5746	0.1659	1.5746	1.2548
No log	3.0108	280	1.5826	0.1935	1.5826	1.2580
No log	3.0323	282	1.5369	0.1135	1.5369	1.2397
No log	3.0538	284	1.5244	0.1708	1.5244	1.2347
No log	3.0753	286	1.6730	0.2079	1.6730	1.2934
No log	3.0968	288	1.9834	0.1785	1.9834	1.4083
No log	3.1183	290	2.0459	0.2163	2.0459	1.4303
No log	3.1398	292	1.8653	0.2017	1.8653	1.3658
No log	3.1613	294	1.5959	0.1687	1.5959	1.2633
No log	3.1828	296	1.5074	0.1468	1.5074	1.2278
No log	3.2043	298	1.5223	0.1468	1.5223	1.2338
No log	3.2258	300	1.4839	0.1851	1.4839	1.2182
No log	3.2473	302	1.5377	0.1468	1.5377	1.2400
No log	3.2688	304	1.6710	0.1040	1.6710	1.2927
No log	3.2903	306	1.7805	0.1884	1.7805	1.3344
No log	3.3118	308	1.7238	0.1586	1.7238	1.3129
No log	3.3333	310	1.6804	0.1183	1.6804	1.2963
No log	3.3548	312	1.7371	0.1627	1.7371	1.3180
No log	3.3763	314	1.7682	0.1627	1.7682	1.3297
No log	3.3978	316	1.9727	0.1814	1.9727	1.4045
No log	3.4194	318	1.9847	0.1847	1.9847	1.4088
No log	3.4409	320	1.7832	0.1848	1.7832	1.3354
No log	3.4624	322	1.6347	0.1575	1.6347	1.2786
No log	3.4839	324	1.6159	0.2092	1.6159	1.2712
No log	3.5054	326	1.6904	0.1886	1.6904	1.3002
No log	3.5269	328	1.6279	0.1639	1.6279	1.2759
No log	3.5484	330	1.4667	0.1516	1.4667	1.2111
No log	3.5699	332	1.3587	0.1071	1.3587	1.1656
No log	3.5914	334	1.3402	0.1071	1.3402	1.1577
No log	3.6129	336	1.3960	0.1071	1.3960	1.1815
No log	3.6344	338	1.6142	0.2206	1.6142	1.2705
No log	3.6559	340	1.7153	0.1882	1.7153	1.3097
No log	3.6774	342	1.6560	0.1692	1.6560	1.2869
No log	3.6989	344	1.5186	0.1448	1.5186	1.2323
No log	3.7204	346	1.4816	0.1364	1.4816	1.2172
No log	3.7419	348	1.5626	0.1549	1.5626	1.2501
No log	3.7634	350	1.7450	0.1806	1.7450	1.3210
No log	3.7849	352	1.7280	0.1806	1.7280	1.3146
No log	3.8065	354	1.6601	0.1806	1.6601	1.2885
No log	3.8280	356	1.6495	0.1207	1.6495	1.2843
No log	3.8495	358	1.6217	0.1407	1.6217	1.2735
No log	3.8710	360	1.7225	0.0937	1.7225	1.3124
No log	3.8925	362	1.9691	0.1946	1.9691	1.4033
No log	3.9140	364	2.0956	0.1282	2.0956	1.4476
No log	3.9355	366	2.0107	0.0504	2.0107	1.4180
No log	3.9570	368	1.7984	0.1144	1.7984	1.3411
No log	3.9785	370	1.5820	0.0818	1.5820	1.2578
No log	4.0	372	1.4182	0.0668	1.4182	1.1909
No log	4.0215	374	1.3958	0.0668	1.3958	1.1814
No log	4.0430	376	1.4626	0.1005	1.4626	1.2094
No log	4.0645	378	1.6278	0.2009	1.6278	1.2758
No log	4.0860	380	1.7460	0.1513	1.7460	1.3214
No log	4.1075	382	1.7200	0.1657	1.7200	1.3115
No log	4.1290	384	1.6393	0.1573	1.6393	1.2804
No log	4.1505	386	1.5894	0.2009	1.5894	1.2607
No log	4.1720	388	1.5725	0.2359	1.5725	1.2540
No log	4.1935	390	1.5675	0.2359	1.5675	1.2520
No log	4.2151	392	1.5012	0.1844	1.5012	1.2252
No log	4.2366	394	1.4192	0.1163	1.4192	1.1913
No log	4.2581	396	1.4176	0.1830	1.4176	1.1906
No log	4.2796	398	1.4906	0.2086	1.4906	1.2209
No log	4.3011	400	1.6223	0.1280	1.6223	1.2737
No log	4.3226	402	1.8199	0.1551	1.8199	1.3490
No log	4.3441	404	1.8368	0.1614	1.8368	1.3553
No log	4.3656	406	1.7600	0.2163	1.7600	1.3266
No log	4.3871	408	1.5978	0.2658	1.5978	1.2640
No log	4.4086	410	1.4044	0.1670	1.4044	1.1851
No log	4.4301	412	1.3704	0.1848	1.3704	1.1706
No log	4.4516	414	1.3958	0.1848	1.3958	1.1814
No log	4.4731	416	1.3599	0.1570	1.3599	1.1661
No log	4.4946	418	1.4275	0.1763	1.4275	1.1948
No log	4.5161	420	1.5667	0.2658	1.5667	1.2517
No log	4.5376	422	1.7235	0.2132	1.7235	1.3128
No log	4.5591	424	1.6801	0.2100	1.6801	1.2962
No log	4.5806	426	1.6066	0.2521	1.6066	1.2675
No log	4.6022	428	1.6890	0.2179	1.6890	1.2996
No log	4.6237	430	1.5553	0.2436	1.5553	1.2471
No log	4.6452	432	1.3701	0.1713	1.3701	1.1705
No log	4.6667	434	1.3696	0.1850	1.3696	1.1703
No log	4.6882	436	1.4417	0.1535	1.4417	1.2007
No log	4.7097	438	1.5528	0.2191	1.5528	1.2461
No log	4.7312	440	1.6106	0.2406	1.6106	1.2691
No log	4.7527	442	1.5425	0.2343	1.5425	1.2420
No log	4.7742	444	1.4085	0.1986	1.4085	1.1868
No log	4.7957	446	1.3925	0.1986	1.3925	1.1800
No log	4.8172	448	1.5434	0.1562	1.5434	1.2423
No log	4.8387	450	1.7249	0.2547	1.7249	1.3134
No log	4.8602	452	1.8922	0.1978	1.8922	1.3756
No log	4.8817	454	1.8676	0.1978	1.8676	1.3666
No log	4.9032	456	1.7437	0.2547	1.7437	1.3205
No log	4.9247	458	1.5007	0.1935	1.5007	1.2250
No log	4.9462	460	1.3726	0.2452	1.3726	1.1716
No log	4.9677	462	1.4084	0.1986	1.4084	1.1868
No log	4.9892	464	1.5724	0.2099	1.5724	1.2540
No log	5.0108	466	1.6986	0.1843	1.6986	1.3033
No log	5.0323	468	1.6644	0.1713	1.6644	1.2901
No log	5.0538	470	1.5383	0.1051	1.5383	1.2403
No log	5.0753	472	1.4101	0.1000	1.4101	1.1875
No log	5.0968	474	1.3714	0.1090	1.3714	1.1711
No log	5.1183	476	1.4220	0.1483	1.4220	1.1925
No log	5.1398	478	1.5616	0.1387	1.5616	1.2497
No log	5.1613	480	1.6447	0.1407	1.6447	1.2825
No log	5.1828	482	1.6691	0.2272	1.6691	1.2919
No log	5.2043	484	1.6535	0.1730	1.6535	1.2859
No log	5.2258	486	1.5654	0.1436	1.5654	1.2512
No log	5.2473	488	1.6565	0.1562	1.6565	1.2871
No log	5.2688	490	1.8148	0.2310	1.8148	1.3471
No log	5.2903	492	1.7311	0.2378	1.7311	1.3157
No log	5.3118	494	1.5703	0.1202	1.5703	1.2531
No log	5.3333	496	1.5023	0.1448	1.5023	1.2257
No log	5.3548	498	1.4352	0.1405	1.4352	1.1980
0.4043	5.3763	500	1.4765	0.1339	1.4765	1.2151
0.4043	5.3978	502	1.6419	0.1176	1.6419	1.2813
0.4043	5.4194	504	1.7419	0.1155	1.7419	1.3198
0.4043	5.4409	506	1.7009	0.0693	1.7009	1.3042
0.4043	5.4624	508	1.6295	0.0263	1.6295	1.2765
0.4043	5.4839	510	1.5899	-0.0132	1.5899	1.2609

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1