ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2617
• Qwk: 0.2097
• Mse: 1.2617
• Rmse: 1.1233

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	4.7017	0.0042	4.7017	2.1683
No log	0.0816	4	2.8824	-0.0519	2.8824	1.6978
No log	0.1224	6	1.9469	0.0749	1.9469	1.3953
No log	0.1633	8	1.5525	0.0372	1.5525	1.2460
No log	0.2041	10	1.3767	0.0610	1.3767	1.1733
No log	0.2449	12	1.3049	0.1437	1.3049	1.1423
No log	0.2857	14	1.3996	0.0362	1.3996	1.1830
No log	0.3265	16	1.6257	0.0317	1.6257	1.2750
No log	0.3673	18	1.7006	0.0	1.7006	1.3041
No log	0.4082	20	1.5162	0.0317	1.5162	1.2313
No log	0.4490	22	1.3128	0.0104	1.3128	1.1458
No log	0.4898	24	1.1863	0.1995	1.1863	1.0892
No log	0.5306	26	1.2184	0.0628	1.2184	1.1038
No log	0.5714	28	1.2259	0.0741	1.2259	1.1072
No log	0.6122	30	1.2755	0.1791	1.2755	1.1294
No log	0.6531	32	1.4401	0.0254	1.4401	1.2001
No log	0.6939	34	1.4013	0.0169	1.4013	1.1838
No log	0.7347	36	1.4128	0.0403	1.4128	1.1886
No log	0.7755	38	1.3240	0.0449	1.3240	1.1507
No log	0.8163	40	1.2825	0.1288	1.2825	1.1325
No log	0.8571	42	1.2477	0.0952	1.2476	1.1170
No log	0.8980	44	1.2423	0.0573	1.2423	1.1146
No log	0.9388	46	1.1937	0.1144	1.1937	1.0926
No log	0.9796	48	1.2469	0.0454	1.2469	1.1166
No log	1.0204	50	1.2204	0.0454	1.2204	1.1047
No log	1.0612	52	1.1873	0.1632	1.1873	1.0896
No log	1.1020	54	1.3156	0.0362	1.3156	1.1470
No log	1.1429	56	1.5859	0.0317	1.5859	1.2593
No log	1.1837	58	1.5362	0.0317	1.5362	1.2394
No log	1.2245	60	1.3450	0.0426	1.3450	1.1597
No log	1.2653	62	1.2522	0.1753	1.2522	1.1190
No log	1.3061	64	1.1942	0.2360	1.1942	1.0928
No log	1.3469	66	1.1778	0.1444	1.1778	1.0853
No log	1.3878	68	1.2066	0.1214	1.2066	1.0985
No log	1.4286	70	1.1795	0.1504	1.1795	1.0861
No log	1.4694	72	1.1682	0.1814	1.1682	1.0808
No log	1.5102	74	1.1139	0.2132	1.1139	1.0554
No log	1.5510	76	1.1126	0.3427	1.1126	1.0548
No log	1.5918	78	1.1326	0.2417	1.1326	1.0643
No log	1.6327	80	1.0988	0.3502	1.0988	1.0483
No log	1.6735	82	1.0800	0.2025	1.0800	1.0392
No log	1.7143	84	1.0357	0.4039	1.0357	1.0177
No log	1.7551	86	0.9950	0.3463	0.9950	0.9975
No log	1.7959	88	0.9969	0.2947	0.9969	0.9984
No log	1.8367	90	1.0521	0.2409	1.0521	1.0257
No log	1.8776	92	1.1286	0.2056	1.1286	1.0624
No log	1.9184	94	1.1776	0.1903	1.1776	1.0852
No log	1.9592	96	1.2441	0.1611	1.2441	1.1154
No log	2.0	98	1.2146	0.1517	1.2146	1.1021
No log	2.0408	100	1.1371	0.2525	1.1371	1.0663
No log	2.0816	102	1.1781	0.1997	1.1781	1.0854
No log	2.1224	104	1.1327	0.2381	1.1327	1.0643
No log	2.1633	106	1.0367	0.3042	1.0367	1.0182
No log	2.2041	108	1.0282	0.3565	1.0282	1.0140
No log	2.2449	110	1.0682	0.2015	1.0682	1.0335
No log	2.2857	112	1.2783	0.3347	1.2783	1.1306
No log	2.3265	114	1.5494	0.2797	1.5494	1.2447
No log	2.3673	116	1.5319	0.2471	1.5319	1.2377
No log	2.4082	118	1.3354	0.3738	1.3354	1.1556
No log	2.4490	120	1.1922	0.3317	1.1922	1.0919
No log	2.4898	122	1.0635	0.3113	1.0635	1.0313
No log	2.5306	124	1.0580	0.2933	1.0580	1.0286
No log	2.5714	126	1.1831	0.3658	1.1831	1.0877
No log	2.6122	128	1.4778	0.3311	1.4778	1.2156
No log	2.6531	130	1.6250	0.2545	1.6250	1.2748
No log	2.6939	132	1.5104	0.3118	1.5104	1.2290
No log	2.7347	134	1.3627	0.3375	1.3627	1.1673
No log	2.7755	136	1.4661	0.3331	1.4661	1.2108
No log	2.8163	138	1.4523	0.3449	1.4523	1.2051
No log	2.8571	140	1.4589	0.3229	1.4589	1.2079
No log	2.8980	142	1.3706	0.3185	1.3706	1.1707
No log	2.9388	144	1.3575	0.3228	1.3575	1.1651
No log	2.9796	146	1.5072	0.3110	1.5072	1.2277
No log	3.0204	148	1.7746	0.2731	1.7746	1.3321
No log	3.0612	150	1.7490	0.2731	1.7490	1.3225
No log	3.1020	152	1.4442	0.2925	1.4442	1.2017
No log	3.1429	154	1.1881	0.3398	1.1881	1.0900
No log	3.1837	156	1.2320	0.3192	1.2320	1.1100
No log	3.2245	158	1.4469	0.3118	1.4469	1.2029
No log	3.2653	160	1.7231	0.3009	1.7231	1.3127
No log	3.3061	162	1.7126	0.2689	1.7126	1.3087
No log	3.3469	164	1.5643	0.3132	1.5643	1.2507
No log	3.3878	166	1.3715	0.3641	1.3715	1.1711
No log	3.4286	168	1.3396	0.2716	1.3396	1.1574
No log	3.4694	170	1.5363	0.3118	1.5363	1.2395
No log	3.5102	172	1.8852	0.1753	1.8852	1.3730
No log	3.5510	174	1.8502	0.2038	1.8502	1.3602
No log	3.5918	176	1.5904	0.2419	1.5904	1.2611
No log	3.6327	178	1.4727	0.2006	1.4727	1.2136
No log	3.6735	180	1.5742	0.2210	1.5742	1.2547
No log	3.7143	182	1.6909	0.2471	1.6909	1.3003
No log	3.7551	184	1.5777	0.2229	1.5777	1.2561
No log	3.7959	186	1.3492	0.2384	1.3492	1.1616
No log	3.8367	188	1.2973	0.2223	1.2973	1.1390
No log	3.8776	190	1.3748	0.2503	1.3748	1.1725
No log	3.9184	192	1.4261	0.2503	1.4261	1.1942
No log	3.9592	194	1.3818	0.2503	1.3818	1.1755
No log	4.0	196	1.2534	0.2978	1.2534	1.1195
No log	4.0408	198	1.2837	0.2889	1.2837	1.1330
No log	4.0816	200	1.4773	0.2985	1.4773	1.2154
No log	4.1224	202	1.6113	0.2597	1.6113	1.2694
No log	4.1633	204	1.5714	0.2391	1.5714	1.2536
No log	4.2041	206	1.3742	0.3087	1.3742	1.1723
No log	4.2449	208	1.3649	0.2620	1.3649	1.1683
No log	4.2857	210	1.2941	0.2503	1.2941	1.1376
No log	4.3265	212	1.2685	0.2090	1.2685	1.1263
No log	4.3673	214	1.1963	0.2552	1.1963	1.0938
No log	4.4082	216	1.2557	0.2084	1.2557	1.1206
No log	4.4490	218	1.4470	0.2701	1.4470	1.2029
No log	4.4898	220	1.7237	0.2564	1.7237	1.3129
No log	4.5306	222	1.7940	0.2141	1.7940	1.3394
No log	4.5714	224	1.7491	0.2141	1.7491	1.3225
No log	4.6122	226	1.6817	0.2419	1.6817	1.2968
No log	4.6531	228	1.4911	0.2140	1.4911	1.2211
No log	4.6939	230	1.4330	0.2560	1.4330	1.1971
No log	4.7347	232	1.4478	0.2862	1.4478	1.2032
No log	4.7755	234	1.4330	0.3576	1.4330	1.1971
No log	4.8163	236	1.6199	0.3008	1.6199	1.2727
No log	4.8571	238	1.7765	0.2568	1.7765	1.3328
No log	4.8980	240	1.7364	0.3025	1.7364	1.3177
No log	4.9388	242	1.4324	0.3269	1.4324	1.1968
No log	4.9796	244	1.2201	0.2914	1.2201	1.1046
No log	5.0204	246	1.2167	0.2826	1.2167	1.1030
No log	5.0612	248	1.3556	0.2726	1.3556	1.1643
No log	5.1020	250	1.5004	0.2895	1.5004	1.2249
No log	5.1429	252	1.4354	0.2606	1.4354	1.1981
No log	5.1837	254	1.2630	0.2494	1.2630	1.1238
No log	5.2245	256	1.1849	0.2586	1.1849	1.0885
No log	5.2653	258	1.2278	0.2542	1.2278	1.1081
No log	5.3061	260	1.4014	0.2701	1.4014	1.1838
No log	5.3469	262	1.5465	0.2391	1.5465	1.2436
No log	5.3878	264	1.4975	0.2608	1.4975	1.2237
No log	5.4286	266	1.3281	0.2981	1.3281	1.1524
No log	5.4694	268	1.2422	0.1635	1.2422	1.1145
No log	5.5102	270	1.2376	0.1337	1.2376	1.1125
No log	5.5510	272	1.2993	0.2889	1.2993	1.1399
No log	5.5918	274	1.4988	0.3026	1.4988	1.2243
No log	5.6327	276	1.5856	0.2731	1.5856	1.2592
No log	5.6735	278	1.5946	0.2954	1.5946	1.2628
No log	5.7143	280	1.3916	0.3067	1.3915	1.1796
No log	5.7551	282	1.3469	0.2807	1.3469	1.1606
No log	5.7959	284	1.3123	0.2956	1.3123	1.1456
No log	5.8367	286	1.3308	0.2956	1.3308	1.1536
No log	5.8776	288	1.3101	0.2696	1.3101	1.1446
No log	5.9184	290	1.2358	0.2051	1.2358	1.1117
No log	5.9592	292	1.1664	0.1214	1.1664	1.0800
No log	6.0	294	1.1922	0.2780	1.1922	1.0919
No log	6.0408	296	1.3409	0.3243	1.3409	1.1580
No log	6.0816	298	1.4747	0.3512	1.4747	1.2144
No log	6.1224	300	1.3913	0.3087	1.3913	1.1795
No log	6.1633	302	1.2977	0.3115	1.2977	1.1391
No log	6.2041	304	1.1880	0.2927	1.1880	1.0899
No log	6.2449	306	1.1765	0.2927	1.1765	1.0846
No log	6.2857	308	1.2827	0.3387	1.2827	1.1326
No log	6.3265	310	1.3927	0.3723	1.3927	1.1801
No log	6.3673	312	1.3413	0.3723	1.3413	1.1581
No log	6.4082	314	1.2757	0.4239	1.2757	1.1295
No log	6.4490	316	1.1665	0.2837	1.1665	1.0800
No log	6.4898	318	1.0514	0.2009	1.0514	1.0254
No log	6.5306	320	0.9968	0.2076	0.9968	0.9984
No log	6.5714	322	1.0205	0.2175	1.0205	1.0102
No log	6.6122	324	1.1525	0.2809	1.1525	1.0735
No log	6.6531	326	1.2993	0.3584	1.2993	1.1399
No log	6.6939	328	1.4424	0.3222	1.4424	1.2010
No log	6.7347	330	1.4706	0.3431	1.4706	1.2127
No log	6.7755	332	1.4299	0.3605	1.4299	1.1958
No log	6.8163	334	1.3078	0.3475	1.3078	1.1436
No log	6.8571	336	1.2584	0.3601	1.2584	1.1218
No log	6.8980	338	1.3017	0.3475	1.3017	1.1409
No log	6.9388	340	1.3898	0.3222	1.3898	1.1789
No log	6.9796	342	1.3552	0.3188	1.3552	1.1641
No log	7.0204	344	1.2198	0.3094	1.2198	1.1045
No log	7.0612	346	1.1134	0.2060	1.1134	1.0552
No log	7.1020	348	1.1724	0.0797	1.1724	1.0828
No log	7.1429	350	1.1934	0.0704	1.1934	1.0924
No log	7.1837	352	1.1605	0.0460	1.1605	1.0773
No log	7.2245	354	1.2078	0.2439	1.2078	1.0990
No log	7.2653	356	1.3608	0.3113	1.3608	1.1665
No log	7.3061	358	1.4612	0.2964	1.4612	1.2088
No log	7.3469	360	1.4505	0.2964	1.4505	1.2044
No log	7.3878	362	1.3783	0.2941	1.3783	1.1740
No log	7.4286	364	1.3148	0.3348	1.3148	1.1466
No log	7.4694	366	1.1855	0.2978	1.1855	1.0888
No log	7.5102	368	1.1054	0.2791	1.1054	1.0514
No log	7.5510	370	1.1176	0.2978	1.1176	1.0572
No log	7.5918	372	1.2100	0.3814	1.2100	1.1000
No log	7.6327	374	1.3430	0.3188	1.3430	1.1589
No log	7.6735	376	1.3233	0.3584	1.3233	1.1504
No log	7.7143	378	1.1815	0.3225	1.1815	1.0870
No log	7.7551	380	1.0438	0.2152	1.0438	1.0216
No log	7.7959	382	1.0116	0.1717	1.0116	1.0058
No log	7.8367	384	1.0422	0.2110	1.0422	1.0209
No log	7.8776	386	1.1429	0.3212	1.1429	1.0690
No log	7.9184	388	1.3756	0.3188	1.3756	1.1728
No log	7.9592	390	1.5696	0.3132	1.5696	1.2529
No log	8.0	392	1.5323	0.3099	1.5323	1.2379
No log	8.0408	394	1.3186	0.3087	1.3186	1.1483
No log	8.0816	396	1.1727	0.25	1.1727	1.0829
No log	8.1224	398	1.1525	0.1853	1.1525	1.0735
No log	8.1633	400	1.2054	0.2809	1.2054	1.0979
No log	8.2041	402	1.3789	0.2985	1.3789	1.1743
No log	8.2449	404	1.4778	0.3006	1.4778	1.2156
No log	8.2857	406	1.4004	0.3006	1.4004	1.1834
No log	8.3265	408	1.2188	0.2772	1.2188	1.1040
No log	8.3673	410	1.1770	0.2743	1.1770	1.0849
No log	8.4082	412	1.2503	0.2851	1.2503	1.1181
No log	8.4490	414	1.3995	0.3143	1.3995	1.1830
No log	8.4898	416	1.4454	0.3545	1.4454	1.2022
No log	8.5306	418	1.5044	0.3829	1.5044	1.2266
No log	8.5714	420	1.4113	0.3125	1.4113	1.1880
No log	8.6122	422	1.2556	0.2664	1.2556	1.1205
No log	8.6531	424	1.1426	0.2291	1.1426	1.0689
No log	8.6939	426	1.1166	0.1343	1.1166	1.0567
No log	8.7347	428	1.1385	0.1214	1.1385	1.0670
No log	8.7755	430	1.2070	0.2250	1.2070	1.0986
No log	8.8163	432	1.2607	0.2291	1.2607	1.1228
No log	8.8571	434	1.2538	0.2250	1.2538	1.1197
No log	8.8980	436	1.2366	0.2250	1.2366	1.1120
No log	8.9388	438	1.2280	0.2152	1.2280	1.1082
No log	8.9796	440	1.2105	0.2506	1.2105	1.1002
No log	9.0204	442	1.2352	0.2304	1.2352	1.1114
No log	9.0612	444	1.3068	0.2132	1.3068	1.1432
No log	9.1020	446	1.4357	0.3106	1.4357	1.1982
No log	9.1429	448	1.4941	0.2985	1.4941	1.2223
No log	9.1837	450	1.3925	0.2619	1.3925	1.1800
No log	9.2245	452	1.2581	0.1850	1.2581	1.1216
No log	9.2653	454	1.2000	0.2152	1.2000	1.0954
No log	9.3061	456	1.1560	0.1853	1.1560	1.0752
No log	9.3469	458	1.1457	0.1541	1.1457	1.0704
No log	9.3878	460	1.1711	0.2250	1.1711	1.0822
No log	9.4286	462	1.2541	0.2291	1.2541	1.1199
No log	9.4694	464	1.3183	0.1703	1.3183	1.1482
No log	9.5102	466	1.2909	0.1850	1.2909	1.1362
No log	9.5510	468	1.2002	0.1952	1.2002	1.0955
No log	9.5918	470	1.1639	0.1214	1.1639	1.0788
No log	9.6327	472	1.1660	0.1406	1.1660	1.0798
No log	9.6735	474	1.1915	0.2056	1.1915	1.0916
No log	9.7143	476	1.2902	0.1850	1.2902	1.1359
No log	9.7551	478	1.4923	0.3125	1.4923	1.2216
No log	9.7959	480	1.5777	0.2798	1.5777	1.2561
No log	9.8367	482	1.5114	0.3125	1.5114	1.2294
No log	9.8776	484	1.4250	0.2857	1.4250	1.1937
No log	9.9184	486	1.2850	0.1850	1.2850	1.1336
No log	9.9592	488	1.1842	0.1905	1.1842	1.0882
No log	10.0	490	1.1432	0.1048	1.1432	1.0692
No log	10.0408	492	1.1355	0.1016	1.1355	1.0656
No log	10.0816	494	1.1315	0.1722	1.1315	1.0637
No log	10.1224	496	1.1814	0.1903	1.1814	1.0869
No log	10.1633	498	1.3141	0.3047	1.3141	1.1463
0.3944	10.2041	500	1.4134	0.3125	1.4134	1.1889
0.3944	10.2449	502	1.3978	0.3125	1.3978	1.1823
0.3944	10.2857	504	1.3264	0.2337	1.3264	1.1517
0.3944	10.3265	506	1.2375	0.2141	1.2375	1.1124
0.3944	10.3673	508	1.2247	0.2250	1.2247	1.1067
0.3944	10.4082	510	1.2617	0.2097	1.2617	1.1233

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1