ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3142
• Qwk: 0.1118
• Mse: 1.3142
• Rmse: 1.1464

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0206	2	4.9637	0.0010	4.9637	2.2279
No log	0.0412	4	3.1314	-0.0934	3.1314	1.7696
No log	0.0619	6	2.6973	-0.0903	2.6973	1.6424
No log	0.0825	8	2.1223	-0.0818	2.1223	1.4568
No log	0.1031	10	1.3743	-0.0783	1.3743	1.1723
No log	0.1237	12	1.2273	0.0682	1.2273	1.1078
No log	0.1443	14	1.2393	0.1601	1.2393	1.1133
No log	0.1649	16	1.4466	0.0339	1.4466	1.2028
No log	0.1856	18	1.5402	0.0393	1.5402	1.2410
No log	0.2062	20	1.4795	0.0339	1.4795	1.2164
No log	0.2268	22	1.3533	0.0210	1.3533	1.1633
No log	0.2474	24	1.4212	0.0210	1.4212	1.1922
No log	0.2680	26	1.4004	0.0253	1.4004	1.1834
No log	0.2887	28	1.3856	0.0370	1.3856	1.1771
No log	0.3093	30	1.3733	0.1142	1.3733	1.1719
No log	0.3299	32	1.3648	0.0532	1.3648	1.1683
No log	0.3505	34	1.4921	-0.0422	1.4921	1.2215
No log	0.3711	36	1.7118	0.0082	1.7118	1.3084
No log	0.3918	38	2.1394	0.0094	2.1394	1.4627
No log	0.4124	40	2.1312	0.0407	2.1312	1.4599
No log	0.4330	42	1.8260	0.0504	1.8260	1.3513
No log	0.4536	44	1.4316	0.0682	1.4316	1.1965
No log	0.4742	46	1.2042	0.2203	1.2042	1.0974
No log	0.4948	48	1.1687	0.1470	1.1687	1.0811
No log	0.5155	50	1.2459	0.0771	1.2459	1.1162
No log	0.5361	52	1.2908	0.0253	1.2908	1.1361
No log	0.5567	54	1.3320	0.0628	1.3320	1.1541
No log	0.5773	56	1.3109	0.0054	1.3109	1.1450
No log	0.5979	58	1.2914	0.0571	1.2914	1.1364
No log	0.6186	60	1.2817	0.0909	1.2817	1.1321
No log	0.6392	62	1.2793	0.1242	1.2793	1.1311
No log	0.6598	64	1.2692	0.0909	1.2692	1.1266
No log	0.6804	66	1.2585	0.2314	1.2585	1.1218
No log	0.7010	68	1.2990	0.0522	1.2990	1.1397
No log	0.7216	70	1.3682	0.0319	1.3682	1.1697
No log	0.7423	72	1.4123	0.0449	1.4123	1.1884
No log	0.7629	74	1.2881	0.0704	1.2881	1.1350
No log	0.7835	76	1.2355	0.1870	1.2355	1.1115
No log	0.8041	78	1.1982	0.2048	1.1982	1.0946
No log	0.8247	80	1.2376	0.1430	1.2376	1.1125
No log	0.8454	82	1.3251	0.1764	1.3251	1.1511
No log	0.8660	84	1.2585	0.1278	1.2585	1.1218
No log	0.8866	86	1.2104	0.1584	1.2104	1.1002
No log	0.9072	88	1.2041	0.1983	1.2041	1.0973
No log	0.9278	90	1.3156	0.1707	1.3156	1.1470
No log	0.9485	92	1.4935	0.1447	1.4935	1.2221
No log	0.9691	94	1.5198	0.1447	1.5198	1.2328
No log	0.9897	96	1.2988	0.1312	1.2988	1.1397
No log	1.0103	98	1.2609	0.1205	1.2609	1.1229
No log	1.0309	100	1.4995	-0.0096	1.4995	1.2245
No log	1.0515	102	1.5661	0.0362	1.5661	1.2514
No log	1.0722	104	1.4660	-0.0096	1.4660	1.2108
No log	1.0928	106	1.2937	0.0587	1.2937	1.1374
No log	1.1134	108	1.2590	0.1662	1.2590	1.1220
No log	1.1340	110	1.4388	0.0526	1.4388	1.1995
No log	1.1546	112	1.5065	0.0186	1.5065	1.2274
No log	1.1753	114	1.3663	0.0612	1.3663	1.1689
No log	1.1959	116	1.3110	0.0817	1.3110	1.1450
No log	1.2165	118	1.4994	-0.0182	1.4994	1.2245
No log	1.2371	120	1.6039	-0.0352	1.6039	1.2664
No log	1.2577	122	1.4516	-0.0096	1.4516	1.2048
No log	1.2784	124	1.2921	0.0780	1.2921	1.1367
No log	1.2990	126	1.5667	0.1713	1.5667	1.2517
No log	1.3196	128	1.8994	0.0995	1.8994	1.3782
No log	1.3402	130	1.7857	0.1458	1.7857	1.3363
No log	1.3608	132	1.3380	0.2003	1.3380	1.1567
No log	1.3814	134	1.4887	0.0186	1.4887	1.2201
No log	1.4021	136	1.4735	0.0299	1.4735	1.2139
No log	1.4227	138	1.3787	0.1490	1.3787	1.1742
No log	1.4433	140	1.5052	0.1518	1.5052	1.2268
No log	1.4639	142	1.6212	0.1436	1.6212	1.2733
No log	1.4845	144	1.6546	0.1530	1.6546	1.2863
No log	1.5052	146	1.6003	0.2055	1.6003	1.2650
No log	1.5258	148	1.5632	0.2017	1.5632	1.2503
No log	1.5464	150	1.6565	0.2260	1.6565	1.2871
No log	1.5670	152	1.7669	0.2078	1.7669	1.3292
No log	1.5876	154	1.7768	0.1588	1.7768	1.3330
No log	1.6082	156	1.5908	0.1891	1.5908	1.2613
No log	1.6289	158	1.4909	0.1091	1.4909	1.2210
No log	1.6495	160	1.5198	0.1503	1.5198	1.2328
No log	1.6701	162	1.5823	0.1646	1.5823	1.2579
No log	1.6907	164	1.5560	0.1648	1.5560	1.2474
No log	1.7113	166	1.6089	0.1508	1.6089	1.2684
No log	1.7320	168	1.7434	0.1787	1.7434	1.3204
No log	1.7526	170	1.8444	0.1303	1.8444	1.3581
No log	1.7732	172	1.8347	0.1239	1.8347	1.3545
No log	1.7938	174	1.6946	0.2164	1.6946	1.3018
No log	1.8144	176	1.5831	0.2248	1.5831	1.2582
No log	1.8351	178	1.5778	0.1942	1.5778	1.2561
No log	1.8557	180	1.7596	0.0902	1.7596	1.3265
No log	1.8763	182	1.7947	0.1557	1.7947	1.3397
No log	1.8969	184	1.5084	0.2025	1.5084	1.2282
No log	1.9175	186	1.3841	0.1406	1.3841	1.1765
No log	1.9381	188	1.3960	0.1564	1.3960	1.1815
No log	1.9588	190	1.5271	0.1674	1.5271	1.2358
No log	1.9794	192	1.6192	0.2025	1.6192	1.2725
No log	2.0	194	1.5659	0.1674	1.5659	1.2513
No log	2.0206	196	1.5861	0.1768	1.5861	1.2594
No log	2.0412	198	1.6687	0.2468	1.6687	1.2918
No log	2.0619	200	1.6510	0.2457	1.6510	1.2849
No log	2.0825	202	1.6360	0.2108	1.6360	1.2790
No log	2.1031	204	1.5282	0.0487	1.5282	1.2362
No log	2.1237	206	1.5183	0.0554	1.5183	1.2322
No log	2.1443	208	1.6439	0.2321	1.6439	1.2821
No log	2.1649	210	1.9605	0.1281	1.9605	1.4002
No log	2.1856	212	1.9620	0.1401	1.9620	1.4007
No log	2.2062	214	1.6401	0.0525	1.6401	1.2807
No log	2.2268	216	1.5096	0.0240	1.5096	1.2286
No log	2.2474	218	1.4609	0.0171	1.4609	1.2087
No log	2.2680	220	1.5185	0.1663	1.5185	1.2323
No log	2.2887	222	1.9838	0.0924	1.9838	1.4085
No log	2.3093	224	2.1953	0.0433	2.1953	1.4817
No log	2.3299	226	2.0482	0.0546	2.0482	1.4311
No log	2.3505	228	1.6957	0.1923	1.6957	1.3022
No log	2.3711	230	1.3780	0.0675	1.3780	1.1739
No log	2.3918	232	1.3124	0.0415	1.3124	1.1456
No log	2.4124	234	1.3148	0.0857	1.3148	1.1467
No log	2.4330	236	1.4182	0.1991	1.4182	1.1909
No log	2.4536	238	1.6158	0.2359	1.6158	1.2711
No log	2.4742	240	1.6777	0.2359	1.6777	1.2953
No log	2.4948	242	1.6005	0.2181	1.6005	1.2651
No log	2.5155	244	1.5359	0.2289	1.5359	1.2393
No log	2.5361	246	1.4621	0.1891	1.4621	1.2092
No log	2.5567	248	1.4988	0.2337	1.4988	1.2242
No log	2.5773	250	1.6028	0.1849	1.6028	1.2660
No log	2.5979	252	1.5513	0.1634	1.5513	1.2455
No log	2.6186	254	1.5116	0.1428	1.5116	1.2295
No log	2.6392	256	1.5426	0.1022	1.5426	1.2420
No log	2.6598	258	1.6218	0.1364	1.6218	1.2735
No log	2.6804	260	1.6999	0.1230	1.6999	1.3038
No log	2.7010	262	1.7478	0.1547	1.7478	1.3220
No log	2.7216	264	1.6331	0.1670	1.6331	1.2779
No log	2.7423	266	1.4958	0.1850	1.4958	1.2230
No log	2.7629	268	1.3992	0.0760	1.3992	1.1829
No log	2.7835	270	1.3911	0.1090	1.3911	1.1795
No log	2.8041	272	1.4836	0.1850	1.4836	1.2180
No log	2.8247	274	1.7863	0.1186	1.7863	1.3365
No log	2.8454	276	2.0064	0.1184	2.0064	1.4165
No log	2.8660	278	2.0055	0.1026	2.0055	1.4161
No log	2.8866	280	1.8780	0.1650	1.8780	1.3704
No log	2.9072	282	1.6609	0.1713	1.6609	1.2887
No log	2.9278	284	1.4863	0.1801	1.4863	1.2191
No log	2.9485	286	1.4104	0.1753	1.4104	1.1876
No log	2.9691	288	1.3685	0.1896	1.3685	1.1698
No log	2.9897	290	1.3870	0.2080	1.3870	1.1777
No log	3.0103	292	1.4134	0.2173	1.4134	1.1889
No log	3.0309	294	1.4002	0.2460	1.4002	1.1833
No log	3.0515	296	1.4351	0.2132	1.4351	1.1980
No log	3.0722	298	1.5185	0.2028	1.5185	1.2323
No log	3.0928	300	1.6726	0.2047	1.6726	1.2933
No log	3.1134	302	1.7883	0.2595	1.7883	1.3373
No log	3.1340	304	1.6852	0.2084	1.6852	1.2981
No log	3.1546	306	1.4864	0.1713	1.4864	1.2192
No log	3.1753	308	1.4262	0.2132	1.4262	1.1942
No log	3.1959	310	1.4558	0.2224	1.4558	1.2066
No log	3.2165	312	1.4885	0.2725	1.4885	1.2200
No log	3.2371	314	1.3971	0.2224	1.3971	1.1820
No log	3.2577	316	1.2949	0.1118	1.2949	1.1380
No log	3.2784	318	1.2886	0.1696	1.2886	1.1352
No log	3.2990	320	1.3765	0.1891	1.3765	1.1733
No log	3.3196	322	1.5452	0.2485	1.5452	1.2431
No log	3.3402	324	1.5247	0.2863	1.5247	1.2348
No log	3.3608	326	1.3627	0.2032	1.3627	1.1674
No log	3.3814	328	1.2294	0.1658	1.2294	1.1088
No log	3.4021	330	1.2294	0.1658	1.2294	1.1088
No log	3.4227	332	1.3157	0.2132	1.3157	1.1470
No log	3.4433	334	1.3630	0.2301	1.3630	1.1675
No log	3.4639	336	1.3335	0.1943	1.3335	1.1548
No log	3.4845	338	1.4607	0.2017	1.4607	1.2086
No log	3.5052	340	1.5258	0.1929	1.5258	1.2352
No log	3.5258	342	1.4323	0.2559	1.4323	1.1968
No log	3.5464	344	1.3754	0.1650	1.3754	1.1728
No log	3.5670	346	1.3247	0.1650	1.3247	1.1510
No log	3.5876	348	1.3610	0.1795	1.3610	1.1666
No log	3.6082	350	1.4606	0.2574	1.4606	1.2085
No log	3.6289	352	1.4665	0.2704	1.4665	1.2110
No log	3.6495	354	1.3666	0.1703	1.3666	1.1690
No log	3.6701	356	1.4150	0.2494	1.4150	1.1895
No log	3.6907	358	1.5207	0.2144	1.5207	1.2332
No log	3.7113	360	1.6052	0.2424	1.6052	1.2670
No log	3.7320	362	1.5166	0.1646	1.5166	1.2315
No log	3.7526	364	1.4502	0.1283	1.4502	1.2042
No log	3.7732	366	1.3675	0.0937	1.3675	1.1694
No log	3.7938	368	1.3750	0.0937	1.3750	1.1726
No log	3.8144	370	1.3688	0.1122	1.3688	1.1700
No log	3.8351	372	1.4893	0.2410	1.4893	1.2204
No log	3.8557	374	1.5589	0.2410	1.5589	1.2486
No log	3.8763	376	1.5110	0.2080	1.5110	1.2292
No log	3.8969	378	1.4041	0.1903	1.4041	1.1850
No log	3.9175	380	1.4281	0.2207	1.4281	1.1950
No log	3.9381	382	1.5214	0.1943	1.5214	1.2335
No log	3.9588	384	1.5740	0.1254	1.5740	1.2546
No log	3.9794	386	1.5505	0.1585	1.5505	1.2452
No log	4.0	388	1.5203	0.1417	1.5203	1.2330
No log	4.0206	390	1.4812	0.1535	1.4812	1.2171
No log	4.0412	392	1.4207	0.1312	1.4207	1.1919
No log	4.0619	394	1.3943	0.1159	1.3943	1.1808
No log	4.0825	396	1.3609	0.0857	1.3609	1.1666
No log	4.1031	398	1.3253	0.0857	1.3253	1.1512
No log	4.1237	400	1.3171	0.0857	1.3171	1.1477
No log	4.1443	402	1.3258	0.1185	1.3258	1.1515
No log	4.1649	404	1.3555	0.1159	1.3555	1.1643
No log	4.1856	406	1.4039	0.1570	1.4039	1.1849
No log	4.2062	408	1.4160	0.1570	1.4160	1.1900
No log	4.2268	410	1.4376	0.2252	1.4376	1.1990
No log	4.2474	412	1.4052	0.2410	1.4052	1.1854
No log	4.2680	414	1.4098	0.2410	1.4098	1.1874
No log	4.2887	416	1.3968	0.1980	1.3968	1.1819
No log	4.3093	418	1.4320	0.2115	1.4320	1.1966
No log	4.3299	420	1.3944	0.1848	1.3944	1.1809
No log	4.3505	422	1.3910	0.2212	1.3910	1.1794
No log	4.3711	424	1.4243	0.2250	1.4243	1.1934
No log	4.3918	426	1.4979	0.1643	1.4979	1.2239
No log	4.4124	428	1.5571	0.1643	1.5571	1.2479
No log	4.4330	430	1.5233	0.1643	1.5233	1.2342
No log	4.4536	432	1.5370	0.1643	1.5370	1.2397
No log	4.4742	434	1.4275	0.2250	1.4275	1.1948
No log	4.4948	436	1.3668	0.2664	1.3668	1.1691
No log	4.5155	438	1.4128	0.2250	1.4128	1.1886
No log	4.5361	440	1.5340	0.2009	1.5340	1.2386
No log	4.5567	442	1.7324	0.2220	1.7324	1.3162
No log	4.5773	444	1.7580	0.1997	1.7580	1.3259
No log	4.5979	446	1.5450	0.2789	1.5450	1.2430
No log	4.6186	448	1.3142	0.125	1.3142	1.1464
No log	4.6392	450	1.2575	0.1599	1.2575	1.1214
No log	4.6598	452	1.2770	0.1441	1.2770	1.1301
No log	4.6804	454	1.3814	0.2278	1.3814	1.1753
No log	4.7010	456	1.4196	0.2278	1.4196	1.1915
No log	4.7216	458	1.4256	0.2278	1.4256	1.1940
No log	4.7423	460	1.3310	0.1637	1.3310	1.1537
No log	4.7629	462	1.2369	0.0857	1.2369	1.1122
No log	4.7835	464	1.2192	0.0857	1.2192	1.1042
No log	4.8041	466	1.2490	0.1637	1.2490	1.1176
No log	4.8247	468	1.2403	0.1637	1.2403	1.1137
No log	4.8454	470	1.2449	0.1637	1.2449	1.1158
No log	4.8660	472	1.3107	0.2553	1.3107	1.1449
No log	4.8866	474	1.3161	0.2553	1.3161	1.1472
No log	4.9072	476	1.3745	0.2586	1.3745	1.1724
No log	4.9278	478	1.3580	0.2460	1.3580	1.1653
No log	4.9485	480	1.2988	0.2132	1.2988	1.1396
No log	4.9691	482	1.3177	0.2132	1.3177	1.1479
No log	4.9897	484	1.3638	0.2460	1.3638	1.1678
No log	5.0103	486	1.3783	0.2586	1.3783	1.1740
No log	5.0309	488	1.3812	0.1713	1.3812	1.1753
No log	5.0515	490	1.3938	0.1801	1.3938	1.1806
No log	5.0722	492	1.3506	0.2046	1.3506	1.1622
No log	5.0928	494	1.3948	0.1848	1.3948	1.1810
No log	5.1134	496	1.3626	0.1989	1.3626	1.1673
No log	5.1340	498	1.3874	0.2032	1.3874	1.1779
0.4296	5.1546	500	1.3124	0.1750	1.3124	1.1456
0.4296	5.1753	502	1.2515	0.2009	1.2515	1.1187
0.4296	5.1959	504	1.2797	0.1599	1.2797	1.1312
0.4296	5.2165	506	1.4291	0.2224	1.4291	1.1955
0.4296	5.2371	508	1.6606	0.1802	1.6606	1.2887
0.4296	5.2577	510	1.6735	0.1516	1.6735	1.2936
0.4296	5.2784	512	1.5595	0.0623	1.5595	1.2488
0.4296	5.2990	514	1.5073	0.1283	1.5073	1.2277
0.4296	5.3196	516	1.5402	0.2131	1.5402	1.2411
0.4296	5.3402	518	1.6729	0.2359	1.6729	1.2934
0.4296	5.3608	520	1.7373	0.2162	1.7373	1.3181
0.4296	5.3814	522	1.6440	0.2251	1.6440	1.2822
0.4296	5.4021	524	1.4578	0.2790	1.4578	1.2074
0.4296	5.4227	526	1.3779	0.1692	1.3779	1.1738
0.4296	5.4433	528	1.3957	0.1692	1.3957	1.1814
0.4296	5.4639	530	1.4469	0.1889	1.4469	1.2029
0.4296	5.4845	532	1.4049	0.1889	1.4049	1.1853
0.4296	5.5052	534	1.3483	0.2278	1.3483	1.1612
0.4296	5.5258	536	1.2618	0.1538	1.2618	1.1233
0.4296	5.5464	538	1.2630	0.1846	1.2630	1.1238
0.4296	5.5670	540	1.3098	0.1943	1.3098	1.1445
0.4296	5.5876	542	1.3429	0.2460	1.3429	1.1588
0.4296	5.6082	544	1.2780	0.1943	1.2780	1.1305
0.4296	5.6289	546	1.2003	0.1538	1.2003	1.0956
0.4296	5.6495	548	1.1998	0.1538	1.1998	1.0954
0.4296	5.6701	550	1.2791	0.1650	1.2791	1.1310
0.4296	5.6907	552	1.3807	0.2725	1.3807	1.1750
0.4296	5.7113	554	1.3937	0.2460	1.3937	1.1805
0.4296	5.7320	556	1.3210	0.1707	1.3210	1.1493
0.4296	5.7526	558	1.3110	0.0786	1.3110	1.1450
0.4296	5.7732	560	1.3599	0.1279	1.3599	1.1661
0.4296	5.7938	562	1.4467	0.2367	1.4467	1.2028
0.4296	5.8144	564	1.4599	0.2367	1.4599	1.2083
0.4296	5.8351	566	1.4438	0.2460	1.4438	1.2016
0.4296	5.8557	568	1.3589	0.1650	1.3589	1.1657
0.4296	5.8763	570	1.3082	0.1345	1.3082	1.1438
0.4296	5.8969	572	1.2891	0.1217	1.2891	1.1354
0.4296	5.9175	574	1.2829	0.0513	1.2829	1.1327
0.4296	5.9381	576	1.3142	0.1118	1.3142	1.1464

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1