ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2557
• Qwk: 0.0887
• Mse: 1.2557
• Rmse: 1.1206

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	4.4938	0.0010	4.4938	2.1199
No log	0.0690	4	2.5075	0.0239	2.5075	1.5835
No log	0.1034	6	1.9866	-0.0093	1.9866	1.4095
No log	0.1379	8	1.5474	0.0165	1.5474	1.2439
No log	0.1724	10	1.3142	-0.0318	1.3142	1.1464
No log	0.2069	12	1.4397	-0.1066	1.4397	1.1999
No log	0.2414	14	1.4755	-0.0984	1.4755	1.2147
No log	0.2759	16	1.2749	0.1076	1.2749	1.1291
No log	0.3103	18	1.2901	0.0904	1.2901	1.1358
No log	0.3448	20	1.2936	0.0904	1.2936	1.1374
No log	0.3793	22	1.3108	0.0253	1.3108	1.1449
No log	0.4138	24	1.5835	-0.0911	1.5835	1.2584
No log	0.4483	26	1.7028	-0.0589	1.7028	1.3049
No log	0.4828	28	1.7944	0.0222	1.7944	1.3395
No log	0.5172	30	1.9283	0.0652	1.9283	1.3886
No log	0.5517	32	1.6470	-0.0211	1.6470	1.2833
No log	0.5862	34	1.4210	0.0804	1.4210	1.1920
No log	0.6207	36	1.7444	-0.1962	1.7444	1.3207
No log	0.6552	38	1.5841	-0.1412	1.5841	1.2586
No log	0.6897	40	1.3474	0.0353	1.3474	1.1608
No log	0.7241	42	1.3004	0.0880	1.3004	1.1404
No log	0.7586	44	1.2118	0.1470	1.2118	1.1008
No log	0.7931	46	1.2535	0.1519	1.2535	1.1196
No log	0.8276	48	1.2233	0.1786	1.2233	1.1061
No log	0.8621	50	1.3324	0.1345	1.3324	1.1543
No log	0.8966	52	1.3552	0.1462	1.3552	1.1641
No log	0.9310	54	1.4352	0.2163	1.4352	1.1980
No log	0.9655	56	1.2360	0.2339	1.2360	1.1117
No log	1.0	58	1.3380	0.2074	1.3380	1.1567
No log	1.0345	60	1.5698	0.1845	1.5698	1.2529
No log	1.0690	62	1.9875	0.1184	1.9875	1.4098
No log	1.1034	64	1.8836	0.1302	1.8836	1.3724
No log	1.1379	66	1.3730	0.2314	1.3730	1.1718
No log	1.1724	68	1.3854	0.2112	1.3854	1.1770
No log	1.2069	70	1.8658	0.1561	1.8658	1.3659
No log	1.2414	72	2.0296	0.0741	2.0296	1.4247
No log	1.2759	74	1.6429	0.2670	1.6429	1.2818
No log	1.3103	76	1.4436	0.2830	1.4436	1.2015
No log	1.3448	78	1.7118	0.1958	1.7118	1.3084
No log	1.3793	80	2.1056	0.0650	2.1056	1.4511
No log	1.4138	82	1.8518	0.1135	1.8518	1.3608
No log	1.4483	84	1.4165	0.2663	1.4165	1.1902
No log	1.4828	86	1.2318	0.2258	1.2318	1.1098
No log	1.5172	88	1.2763	0.2955	1.2763	1.1297
No log	1.5517	90	1.3216	0.3292	1.3216	1.1496
No log	1.5862	92	1.2066	0.2015	1.2066	1.0985
No log	1.6207	94	1.2135	0.1966	1.2135	1.1016
No log	1.6552	96	1.5066	0.3171	1.5066	1.2274
No log	1.6897	98	1.7677	0.1917	1.7677	1.3295
No log	1.7241	100	1.7284	0.1953	1.7284	1.3147
No log	1.7586	102	1.4050	0.2559	1.4050	1.1853
No log	1.7931	104	1.3270	0.25	1.3270	1.1519
No log	1.8276	106	1.4319	0.2679	1.4319	1.1966
No log	1.8621	108	1.5378	0.2418	1.5378	1.2401
No log	1.8966	110	1.7639	0.1484	1.7639	1.3281
No log	1.9310	112	1.6002	0.2685	1.6002	1.2650
No log	1.9655	114	1.1927	0.1737	1.1927	1.0921
No log	2.0	116	1.1585	0.2242	1.1585	1.0764
No log	2.0345	118	1.2717	0.1502	1.2717	1.1277
No log	2.0690	120	1.4712	-0.0074	1.4712	1.2129
No log	2.1034	122	1.4375	0.0098	1.4375	1.1990
No log	2.1379	124	1.2808	0.1217	1.2808	1.1317
No log	2.1724	126	1.1961	0.1602	1.1961	1.0937
No log	2.2069	128	1.3623	0.1703	1.3623	1.1672
No log	2.2414	130	1.5725	0.1999	1.5725	1.2540
No log	2.2759	132	1.4624	0.3113	1.4624	1.2093
No log	2.3103	134	1.3241	0.1650	1.3241	1.1507
No log	2.3448	136	1.3976	0.2553	1.3976	1.1822
No log	2.3793	138	1.4856	0.2252	1.4856	1.2188
No log	2.4138	140	1.3825	0.1162	1.3825	1.1758
No log	2.4483	142	1.2172	0.1316	1.2172	1.1033
No log	2.4828	144	1.1320	0.2416	1.1320	1.0639
No log	2.5172	146	1.1242	0.2043	1.1242	1.0603
No log	2.5517	148	1.1963	0.1281	1.1963	1.0937
No log	2.5862	150	1.4757	0.2359	1.4757	1.2148
No log	2.6207	152	1.5706	0.2455	1.5706	1.2532
No log	2.6552	154	1.3350	0.3024	1.3350	1.1554
No log	2.6897	156	1.1240	0.2024	1.1240	1.0602
No log	2.7241	158	1.1599	0.1405	1.1599	1.0770
No log	2.7586	160	1.4194	0.2553	1.4194	1.1914
No log	2.7931	162	1.5541	0.2341	1.5541	1.2466
No log	2.8276	164	1.5142	0.2071	1.5142	1.2305
No log	2.8621	166	1.4005	0.0778	1.4005	1.1834
No log	2.8966	168	1.1315	0.1442	1.1315	1.0637
No log	2.9310	170	1.0634	0.1886	1.0634	1.0312
No log	2.9655	172	1.1185	0.1344	1.1185	1.0576
No log	3.0	174	1.2562	0.1379	1.2562	1.1208
No log	3.0345	176	1.3177	0.1252	1.3177	1.1479
No log	3.0690	178	1.3156	0.1252	1.3156	1.1470
No log	3.1034	180	1.3050	0.1188	1.3050	1.1424
No log	3.1379	182	1.4453	0.1935	1.4453	1.2022
No log	3.1724	184	1.4520	0.0778	1.4520	1.2050
No log	3.2069	186	1.4671	0.1098	1.4671	1.2112
No log	3.2414	188	1.5108	0.1011	1.5108	1.2291
No log	3.2759	190	1.3723	0.0702	1.3723	1.1715
No log	3.3103	192	1.1959	0.1148	1.1959	1.0936
No log	3.3448	194	1.1678	0.1114	1.1678	1.0807
No log	3.3793	196	1.2750	0.1122	1.2750	1.1291
No log	3.4138	198	1.4288	0.2317	1.4288	1.1953
No log	3.4483	200	1.4338	0.3332	1.4338	1.1974
No log	3.4828	202	1.2418	0.2050	1.2418	1.1144
No log	3.5172	204	1.0847	0.2176	1.0847	1.0415
No log	3.5517	206	1.0929	0.1337	1.0929	1.0454
No log	3.5862	208	1.2027	0.1997	1.2027	1.0967
No log	3.6207	210	1.1802	0.1707	1.1802	1.0864
No log	3.6552	212	1.2298	0.1345	1.2298	1.1090
No log	3.6897	214	1.0905	0.1541	1.0905	1.0443
No log	3.7241	216	0.9847	0.2346	0.9847	0.9923
No log	3.7586	218	1.0424	0.1379	1.0424	1.0210
No log	3.7931	220	1.2807	0.0887	1.2807	1.1317
No log	3.8276	222	1.4060	0.0702	1.4060	1.1857
No log	3.8621	224	1.3649	0.0887	1.3649	1.1683
No log	3.8966	226	1.3649	0.0702	1.3649	1.1683
No log	3.9310	228	1.4048	0.0887	1.4048	1.1852
No log	3.9655	230	1.4071	0.0887	1.4071	1.1862
No log	4.0	232	1.3022	0.0887	1.3022	1.1411
No log	4.0345	234	1.1727	0.1479	1.1727	1.0829
No log	4.0690	236	1.1345	0.1541	1.1345	1.0651
No log	4.1034	238	1.1529	0.1479	1.1529	1.0737
No log	4.1379	240	1.2172	0.0887	1.2172	1.1033
No log	4.1724	242	1.2042	0.0887	1.2042	1.0973
No log	4.2069	244	1.1161	0.2097	1.1161	1.0565
No log	4.2414	246	1.0402	0.2164	1.0402	1.0199
No log	4.2759	248	1.0114	0.2164	1.0114	1.0057
No log	4.3103	250	1.1532	0.2725	1.1532	1.0739
No log	4.3448	252	1.4486	0.3302	1.4486	1.2036
No log	4.3793	254	1.3734	0.3462	1.3734	1.1719
No log	4.4138	256	1.1086	0.1479	1.1086	1.0529
No log	4.4483	258	1.0451	0.1417	1.0451	1.0223
No log	4.4828	260	1.0969	0.1641	1.0969	1.0473
No log	4.5172	262	1.2620	0.2037	1.2620	1.1234
No log	4.5517	264	1.3012	0.2224	1.3012	1.1407
No log	4.5862	266	1.2329	0.2224	1.2329	1.1104
No log	4.6207	268	1.0113	0.2592	1.0113	1.0056
No log	4.6552	270	0.9956	0.2592	0.9956	0.9978
No log	4.6897	272	1.1358	0.1479	1.1358	1.0658
No log	4.7241	274	1.4280	0.1592	1.4280	1.1950
No log	4.7586	276	1.6442	0.2228	1.6442	1.2823
No log	4.7931	278	1.6516	0.1971	1.6516	1.2851
No log	4.8276	280	1.5230	0.1698	1.5230	1.2341
No log	4.8621	282	1.3121	0.0887	1.3121	1.1455
No log	4.8966	284	1.0793	0.2086	1.0793	1.0389
No log	4.9310	286	1.0967	0.3179	1.0967	1.0473
No log	4.9655	288	1.1876	0.2937	1.1876	1.0898
No log	5.0	290	1.0802	0.3179	1.0802	1.0393
No log	5.0345	292	1.0688	0.2086	1.0688	1.0338
No log	5.0690	294	1.2651	0.0711	1.2651	1.1248
No log	5.1034	296	1.4655	0.1404	1.4655	1.2106
No log	5.1379	298	1.5282	0.2736	1.5282	1.2362
No log	5.1724	300	1.5178	0.1646	1.5178	1.2320
No log	5.2069	302	1.4089	0.0778	1.4089	1.1870
No log	5.2414	304	1.2691	0.1053	1.2691	1.1265
No log	5.2759	306	1.1916	0.1148	1.1916	1.0916
No log	5.3103	308	1.2281	0.1148	1.2281	1.1082
No log	5.3448	310	1.2690	0.0541	1.2690	1.1265
No log	5.3793	312	1.3369	0.0702	1.3369	1.1562
No log	5.4138	314	1.3256	0.0702	1.3256	1.1514
No log	5.4483	316	1.2320	0.1282	1.2320	1.1100
No log	5.4828	318	1.1386	0.1582	1.1386	1.0670
No log	5.5172	320	1.0971	0.1747	1.0971	1.0474
No log	5.5517	322	1.1661	0.1282	1.1661	1.0799
No log	5.5862	324	1.3115	0.1596	1.3115	1.1452
No log	5.6207	326	1.3421	0.2184	1.3421	1.1585
No log	5.6552	328	1.2291	0.1345	1.2291	1.1087
No log	5.6897	330	1.1432	0.1952	1.1432	1.0692
No log	5.7241	332	1.1815	0.1345	1.1815	1.0870
No log	5.7586	334	1.3332	0.3447	1.3332	1.1546
No log	5.7931	336	1.2816	0.2725	1.2816	1.1321
No log	5.8276	338	1.1155	0.2439	1.1155	1.0562
No log	5.8621	340	0.9799	0.2539	0.9799	0.9899
No log	5.8966	342	0.9760	0.2539	0.9760	0.9879
No log	5.9310	344	1.0943	0.2108	1.0943	1.0461
No log	5.9655	346	1.3049	0.1745	1.3049	1.1423
No log	6.0	348	1.5070	0.2410	1.5070	1.2276
No log	6.0345	350	1.5334	0.2410	1.5334	1.2383
No log	6.0690	352	1.4178	0.1345	1.4178	1.1907
No log	6.1034	354	1.1777	0.1282	1.1777	1.0852
No log	6.1379	356	0.9809	0.1767	0.9809	0.9904
No log	6.1724	358	0.9409	0.2967	0.9409	0.9700
No log	6.2069	360	0.9660	0.2188	0.9660	0.9829
No log	6.2414	362	1.1093	0.1696	1.1093	1.0532
No log	6.2759	364	1.2953	0.1440	1.2953	1.1381
No log	6.3103	366	1.3150	0.1440	1.3150	1.1467
No log	6.3448	368	1.2514	0.1122	1.2514	1.1187
No log	6.3793	370	1.1473	0.1148	1.1473	1.0711
No log	6.4138	372	1.1004	0.1379	1.1004	1.0490
No log	6.4483	374	1.2134	0.1440	1.2134	1.1015
No log	6.4828	376	1.2929	0.1440	1.2929	1.1371
No log	6.5172	378	1.2378	0.1122	1.2378	1.1126
No log	6.5517	380	1.2543	0.1122	1.2543	1.1199
No log	6.5862	382	1.3197	0.1440	1.3197	1.1488
No log	6.6207	384	1.3552	0.1404	1.3552	1.1641
No log	6.6552	386	1.4887	0.2959	1.4887	1.2201
No log	6.6897	388	1.5115	0.2707	1.5115	1.2294
No log	6.7241	390	1.4277	0.3071	1.4277	1.1949
No log	6.7586	392	1.2246	0.1026	1.2246	1.1066
No log	6.7931	394	1.0432	0.1919	1.0432	1.0214
No log	6.8276	396	1.0280	0.2331	1.0280	1.0139
No log	6.8621	398	1.1171	0.1379	1.1171	1.0570
No log	6.8966	400	1.3092	0.1188	1.3092	1.1442
No log	6.9310	402	1.4046	0.1098	1.4046	1.1851
No log	6.9655	404	1.3315	0.0961	1.3315	1.1539
No log	7.0	406	1.2271	0.1316	1.2271	1.1078
No log	7.0345	408	1.1417	0.1379	1.1417	1.0685
No log	7.0690	410	1.1027	0.1650	1.1027	1.0501
No log	7.1034	412	1.1873	0.3133	1.1873	1.0896
No log	7.1379	414	1.2439	0.4005	1.2439	1.1153
No log	7.1724	416	1.2791	0.4002	1.2791	1.1310
No log	7.2069	418	1.3960	0.4002	1.3960	1.1815
No log	7.2414	420	1.3474	0.1592	1.3474	1.1608
No log	7.2759	422	1.3085	0.0887	1.3085	1.1439
No log	7.3103	424	1.2120	0.0980	1.2120	1.1009
No log	7.3448	426	1.1520	0.0980	1.1520	1.0733
No log	7.3793	428	1.1889	0.0980	1.1889	1.0904
No log	7.4138	430	1.4080	0.1345	1.4080	1.1866
No log	7.4483	432	1.6814	0.2644	1.6814	1.2967
No log	7.4828	434	1.7547	0.2975	1.7547	1.3247
No log	7.5172	436	1.5938	0.3026	1.5938	1.2625
No log	7.5517	438	1.4786	0.3339	1.4786	1.2160
No log	7.5862	440	1.3420	0.2445	1.3420	1.1584
No log	7.6207	442	1.1921	0.1316	1.1921	1.0918
No log	7.6552	444	1.1778	0.1316	1.1778	1.0853
No log	7.6897	446	1.1758	0.0980	1.1758	1.0843
No log	7.7241	448	1.2573	0.0887	1.2573	1.1213
No log	7.7586	450	1.4316	0.1283	1.4316	1.1965
No log	7.7931	452	1.5170	0.2410	1.5170	1.2317
No log	7.8276	454	1.5345	0.2410	1.5345	1.2388
No log	7.8621	456	1.4697	0.1283	1.4697	1.2123
No log	7.8966	458	1.3764	0.0702	1.3764	1.1732
No log	7.9310	460	1.2367	0.1122	1.2367	1.1121
No log	7.9655	462	1.2493	0.1122	1.2493	1.1177
No log	8.0	464	1.3724	0.1283	1.3724	1.1715
No log	8.0345	466	1.5083	0.2410	1.5083	1.2281
No log	8.0690	468	1.5334	0.2707	1.5334	1.2383
No log	8.1034	470	1.4675	0.2445	1.4675	1.2114
No log	8.1379	472	1.3560	0.2334	1.3560	1.1645
No log	8.1724	474	1.2342	0.0454	1.2342	1.1110
No log	8.2069	476	1.1479	0.0904	1.1479	1.0714
No log	8.2414	478	1.1378	0.0980	1.1378	1.0667
No log	8.2759	480	1.1839	0.1894	1.1839	1.0881
No log	8.3103	482	1.2531	0.2087	1.2531	1.1194
No log	8.3448	484	1.3042	0.2173	1.3042	1.1420
No log	8.3793	486	1.3086	0.2173	1.3086	1.1439
No log	8.4138	488	1.2295	0.1477	1.2295	1.1088
No log	8.4483	490	1.1450	0.0980	1.1450	1.0700
No log	8.4828	492	1.1449	0.0904	1.1449	1.0700
No log	8.5172	494	1.1477	0.0904	1.1477	1.0713
No log	8.5517	496	1.2106	0.0904	1.2106	1.1003
No log	8.5862	498	1.3388	0.0541	1.3388	1.1571
0.3584	8.6207	500	1.4382	0.0887	1.4382	1.1993
0.3584	8.6552	502	1.5457	0.1618	1.5457	1.2433
0.3584	8.6897	504	1.6143	0.2759	1.6143	1.2706
0.3584	8.7241	506	1.5511	0.3157	1.5511	1.2454
0.3584	8.7586	508	1.3789	0.3624	1.3789	1.1742
0.3584	8.7931	510	1.3693	0.2964	1.3693	1.1702
0.3584	8.8276	512	1.3698	0.2964	1.3698	1.1704
0.3584	8.8621	514	1.5008	0.3105	1.5008	1.2251
0.3584	8.8966	516	1.4927	0.2740	1.4927	1.2218
0.3584	8.9310	518	1.4479	0.3302	1.4479	1.2033
0.3584	8.9655	520	1.3890	0.2763	1.3890	1.1786
0.3584	9.0	522	1.3589	0.2479	1.3589	1.1657
0.3584	9.0345	524	1.3257	0.2479	1.3257	1.1514
0.3584	9.0690	526	1.2977	0.2844	1.2977	1.1392
0.3584	9.1034	528	1.2322	0.2844	1.2322	1.1100
0.3584	9.1379	530	1.2248	0.2844	1.2248	1.1067
0.3584	9.1724	532	1.1949	0.2870	1.1949	1.0931
0.3584	9.2069	534	1.1858	0.2870	1.1858	1.0890
0.3584	9.2414	536	1.1967	0.2586	1.1967	1.0939
0.3584	9.2759	538	1.2794	0.2586	1.2794	1.1311
0.3584	9.3103	540	1.3683	0.2213	1.3683	1.1697
0.3584	9.3448	542	1.3876	0.2479	1.3876	1.1780
0.3584	9.3793	544	1.3073	0.2761	1.3073	1.1434
0.3584	9.4138	546	1.2471	0.2238	1.2471	1.1167
0.3584	9.4483	548	1.2878	0.2844	1.2878	1.1348
0.3584	9.4828	550	1.4045	0.3332	1.4045	1.1851
0.3584	9.5172	552	1.3713	0.2844	1.3713	1.1710
0.3584	9.5517	554	1.3111	0.2037	1.3111	1.1450
0.3584	9.5862	556	1.3122	0.2195	1.3122	1.1455
0.3584	9.6207	558	1.3122	0.1789	1.3122	1.1455
0.3584	9.6552	560	1.3267	0.0798	1.3267	1.1518
0.3584	9.6897	562	1.3096	0.0887	1.3096	1.1444
0.3584	9.7241	564	1.2713	0.0454	1.2713	1.1275
0.3584	9.7586	566	1.2616	0.0541	1.2616	1.1232
0.3584	9.7931	568	1.2557	0.0887	1.2557	1.1206

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1