ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3461
• Qwk: 0.2549
• Mse: 1.3461
• Rmse: 1.1602

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0625	2	4.5646	-0.0132	4.5646	2.1365
No log	0.125	4	2.6677	-0.0474	2.6677	1.6333
No log	0.1875	6	1.8341	-0.0233	1.8341	1.3543
No log	0.25	8	1.4589	0.0182	1.4589	1.2079
No log	0.3125	10	1.7415	-0.1739	1.7415	1.3197
No log	0.375	12	1.5282	-0.1940	1.5282	1.2362
No log	0.4375	14	1.4982	-0.1452	1.4982	1.2240
No log	0.5	16	1.5714	-0.0921	1.5714	1.2536
No log	0.5625	18	1.5374	-0.0534	1.5374	1.2399
No log	0.625	20	1.3688	0.0688	1.3688	1.1699
No log	0.6875	22	1.2661	0.1200	1.2661	1.1252
No log	0.75	24	1.2010	0.1834	1.2010	1.0959
No log	0.8125	26	1.1585	0.2584	1.1585	1.0763
No log	0.875	28	1.3234	0.0488	1.3234	1.1504
No log	0.9375	30	1.4941	0.0	1.4941	1.2223
No log	1.0	32	1.3229	0.0811	1.3229	1.1502
No log	1.0625	34	1.1779	0.3041	1.1779	1.0853
No log	1.125	36	1.2733	0.1423	1.2733	1.1284
No log	1.1875	38	1.3423	0.1168	1.3423	1.1586
No log	1.25	40	1.3823	0.1379	1.3823	1.1757
No log	1.3125	42	1.4153	0.0865	1.4153	1.1897
No log	1.375	44	1.3253	0.1107	1.3253	1.1512
No log	1.4375	46	1.3456	0.0299	1.3456	1.1600
No log	1.5	48	1.3272	0.1300	1.3272	1.1521
No log	1.5625	50	1.3970	-0.0040	1.3970	1.1820
No log	1.625	52	1.5790	0.0600	1.5790	1.2566
No log	1.6875	54	1.7355	0.0321	1.7355	1.3174
No log	1.75	56	1.4999	0.0600	1.4999	1.2247
No log	1.8125	58	1.3044	0.0389	1.3044	1.1421
No log	1.875	60	1.2737	0.1468	1.2737	1.1286
No log	1.9375	62	1.2558	0.1016	1.2558	1.1206
No log	2.0	64	1.2853	0.1542	1.2853	1.1337
No log	2.0625	66	1.3538	0.0894	1.3538	1.1635
No log	2.125	68	1.3238	0.1507	1.3238	1.1506
No log	2.1875	70	1.2521	0.2025	1.2521	1.1190
No log	2.25	72	1.1948	0.1140	1.1948	1.0931
No log	2.3125	74	1.2090	0.1870	1.2090	1.0996
No log	2.375	76	1.1667	0.2001	1.1667	1.0801
No log	2.4375	78	1.1874	0.2230	1.1874	1.0897
No log	2.5	80	1.2141	0.3568	1.2141	1.1019
No log	2.5625	82	1.2142	0.2368	1.2142	1.1019
No log	2.625	84	1.2964	0.1974	1.2964	1.1386
No log	2.6875	86	1.2428	0.2785	1.2428	1.1148
No log	2.75	88	1.2538	0.3674	1.2538	1.1197
No log	2.8125	90	1.2765	0.3779	1.2765	1.1298
No log	2.875	92	1.2274	0.2660	1.2274	1.1079
No log	2.9375	94	1.2429	0.2098	1.2429	1.1149
No log	3.0	96	1.2761	0.1466	1.2761	1.1296
No log	3.0625	98	1.3424	0.2361	1.3424	1.1586
No log	3.125	100	1.2404	0.3498	1.2404	1.1137
No log	3.1875	102	1.3798	0.3058	1.3798	1.1746
No log	3.25	104	1.5985	0.2266	1.5985	1.2643
No log	3.3125	106	1.4149	0.2857	1.4149	1.1895
No log	3.375	108	1.1984	0.3606	1.1984	1.0947
No log	3.4375	110	1.1991	0.4114	1.1991	1.0950
No log	3.5	112	1.1807	0.4379	1.1807	1.0866
No log	3.5625	114	1.1413	0.4126	1.1413	1.0683
No log	3.625	116	1.1676	0.4066	1.1676	1.0806
No log	3.6875	118	1.1999	0.3673	1.1999	1.0954
No log	3.75	120	1.1292	0.3522	1.1292	1.0626
No log	3.8125	122	1.1346	0.3690	1.1346	1.0652
No log	3.875	124	1.1313	0.3152	1.1313	1.0636
No log	3.9375	126	1.1762	0.3086	1.1762	1.0845
No log	4.0	128	1.2359	0.3504	1.2359	1.1117
No log	4.0625	130	1.2804	0.3227	1.2804	1.1315
No log	4.125	132	1.2852	0.3144	1.2852	1.1337
No log	4.1875	134	1.2360	0.3485	1.2360	1.1118
No log	4.25	136	1.2503	0.2898	1.2503	1.1182
No log	4.3125	138	1.4046	0.2928	1.4046	1.1851
No log	4.375	140	1.4460	0.2948	1.4460	1.2025
No log	4.4375	142	1.3986	0.3192	1.3986	1.1826
No log	4.5	144	1.3045	0.3767	1.3045	1.1421
No log	4.5625	146	1.3107	0.3926	1.3107	1.1449
No log	4.625	148	1.4301	0.2661	1.4301	1.1959
No log	4.6875	150	1.4308	0.2430	1.4308	1.1962
No log	4.75	152	1.2848	0.3281	1.2848	1.1335
No log	4.8125	154	1.4638	0.1942	1.4638	1.2099
No log	4.875	156	1.5962	0.1415	1.5962	1.2634
No log	4.9375	158	1.3443	0.1379	1.3443	1.1594
No log	5.0	160	1.4284	0.2840	1.4284	1.1951
No log	5.0625	162	1.5728	0.1660	1.5728	1.2541
No log	5.125	164	1.4609	0.2733	1.4609	1.2087
No log	5.1875	166	1.3869	0.1043	1.3869	1.1777
No log	5.25	168	1.5723	0.1527	1.5723	1.2539
No log	5.3125	170	1.4625	0.1434	1.4625	1.2093
No log	5.375	172	1.3713	0.1912	1.3713	1.1710
No log	5.4375	174	1.4521	0.2237	1.4521	1.2051
No log	5.5	176	1.4820	0.2101	1.4820	1.2174
No log	5.5625	178	1.3845	0.1983	1.3845	1.1767
No log	5.625	180	1.2908	0.2624	1.2908	1.1361
No log	5.6875	182	1.2632	0.2812	1.2632	1.1239
No log	5.75	184	1.2532	0.2997	1.2532	1.1195
No log	5.8125	186	1.2586	0.2037	1.2586	1.1219
No log	5.875	188	1.2277	0.2686	1.2277	1.1080
No log	5.9375	190	1.2107	0.2313	1.2107	1.1003
No log	6.0	192	1.2113	0.2079	1.2113	1.1006
No log	6.0625	194	1.2684	0.2136	1.2684	1.1262
No log	6.125	196	1.3222	0.2411	1.3222	1.1499
No log	6.1875	198	1.3530	0.2461	1.3530	1.1632
No log	6.25	200	1.2677	0.2126	1.2677	1.1259
No log	6.3125	202	1.2465	0.2801	1.2465	1.1165
No log	6.375	204	1.2619	0.2714	1.2619	1.1233
No log	6.4375	206	1.3290	0.3377	1.3290	1.1528
No log	6.5	208	1.4853	0.2196	1.4853	1.2187
No log	6.5625	210	1.5954	0.2156	1.5954	1.2631
No log	6.625	212	1.4404	0.2401	1.4404	1.2002
No log	6.6875	214	1.2775	0.3590	1.2775	1.1303
No log	6.75	216	1.3083	0.3222	1.3083	1.1438
No log	6.8125	218	1.4378	0.2623	1.4378	1.1991
No log	6.875	220	1.5040	0.2368	1.5040	1.2264
No log	6.9375	222	1.4100	0.3504	1.4100	1.1874
No log	7.0	224	1.2561	0.4098	1.2561	1.1207
No log	7.0625	226	1.2277	0.3489	1.2277	1.1080
No log	7.125	228	1.2214	0.3579	1.2214	1.1052
No log	7.1875	230	1.3796	0.2686	1.3796	1.1745
No log	7.25	232	1.4170	0.2647	1.4170	1.1904
No log	7.3125	234	1.2758	0.3848	1.2758	1.1295
No log	7.375	236	1.1893	0.2820	1.1893	1.0906
No log	7.4375	238	1.2842	0.1206	1.2842	1.1332
No log	7.5	240	1.2617	0.2103	1.2617	1.1233
No log	7.5625	242	1.2493	0.3973	1.2493	1.1177
No log	7.625	244	1.5433	0.2210	1.5433	1.2423
No log	7.6875	246	1.7772	0.1793	1.7772	1.3331
No log	7.75	248	1.6705	0.1753	1.6705	1.2925
No log	7.8125	250	1.3930	0.2716	1.3930	1.1802
No log	7.875	252	1.2103	0.2972	1.2103	1.1001
No log	7.9375	254	1.2431	0.1292	1.2431	1.1149
No log	8.0	256	1.2124	0.1294	1.2124	1.1011
No log	8.0625	258	1.1847	0.3874	1.1847	1.0884
No log	8.125	260	1.1931	0.2782	1.1931	1.0923
No log	8.1875	262	1.2766	0.1995	1.2766	1.1299
No log	8.25	264	1.3544	0.2634	1.3544	1.1638
No log	8.3125	266	1.3488	0.2634	1.3488	1.1614
No log	8.375	268	1.2572	0.3111	1.2572	1.1212
No log	8.4375	270	1.2182	0.3089	1.2182	1.1037
No log	8.5	272	1.2358	0.3089	1.2358	1.1117
No log	8.5625	274	1.2481	0.2424	1.2480	1.1172
No log	8.625	276	1.3431	0.3044	1.3431	1.1589
No log	8.6875	278	1.4352	0.2481	1.4352	1.1980
No log	8.75	280	1.4745	0.2742	1.4745	1.2143
No log	8.8125	282	1.4332	0.2806	1.4332	1.1972
No log	8.875	284	1.4170	0.3002	1.4170	1.1904
No log	8.9375	286	1.4370	0.3021	1.4370	1.1987
No log	9.0	288	1.4273	0.3205	1.4273	1.1947
No log	9.0625	290	1.4336	0.2418	1.4336	1.1973
No log	9.125	292	1.5054	0.2092	1.5054	1.2269
No log	9.1875	294	1.4187	0.2564	1.4187	1.1911
No log	9.25	296	1.3551	0.2463	1.3551	1.1641
No log	9.3125	298	1.4078	0.2063	1.4078	1.1865
No log	9.375	300	1.3688	0.2072	1.3688	1.1700
No log	9.4375	302	1.2455	0.3632	1.2455	1.1160
No log	9.5	304	1.2322	0.3674	1.2322	1.1100
No log	9.5625	306	1.2456	0.3654	1.2456	1.1160
No log	9.625	308	1.2438	0.3219	1.2438	1.1153
No log	9.6875	310	1.2810	0.3750	1.2810	1.1318
No log	9.75	312	1.3203	0.3647	1.3203	1.1490
No log	9.8125	314	1.3392	0.2880	1.3392	1.1572
No log	9.875	316	1.3079	0.2880	1.3079	1.1437
No log	9.9375	318	1.1936	0.3738	1.1936	1.0925
No log	10.0	320	1.2062	0.2198	1.2062	1.0983
No log	10.0625	322	1.1977	0.2474	1.1977	1.0944
No log	10.125	324	1.2250	0.4034	1.2250	1.1068
No log	10.1875	326	1.2887	0.3237	1.2887	1.1352
No log	10.25	328	1.2917	0.3129	1.2917	1.1365
No log	10.3125	330	1.2918	0.3129	1.2918	1.1366
No log	10.375	332	1.1738	0.3449	1.1738	1.0834
No log	10.4375	334	1.1588	0.3496	1.1588	1.0765
No log	10.5	336	1.1763	0.3361	1.1763	1.0846
No log	10.5625	338	1.2002	0.3367	1.2002	1.0955
No log	10.625	340	1.2298	0.3912	1.2298	1.1090
No log	10.6875	342	1.2687	0.3842	1.2687	1.1264
No log	10.75	344	1.3146	0.3064	1.3146	1.1465
No log	10.8125	346	1.2620	0.3340	1.2620	1.1234
No log	10.875	348	1.1578	0.3268	1.1578	1.0760
No log	10.9375	350	1.1376	0.3250	1.1376	1.0666
No log	11.0	352	1.1546	0.3311	1.1546	1.0745
No log	11.0625	354	1.1909	0.3237	1.1909	1.0913
No log	11.125	356	1.3684	0.2448	1.3684	1.1698
No log	11.1875	358	1.4384	0.2698	1.4384	1.1994
No log	11.25	360	1.3370	0.2798	1.3370	1.1563
No log	11.3125	362	1.2155	0.2438	1.2155	1.1025
No log	11.375	364	1.1382	0.2636	1.1382	1.0669
No log	11.4375	366	1.1319	0.2164	1.1319	1.0639
No log	11.5	368	1.1776	0.2090	1.1776	1.0852
No log	11.5625	370	1.2418	0.1943	1.2418	1.1143
No log	11.625	372	1.2465	0.2173	1.2465	1.1165
No log	11.6875	374	1.1843	0.2574	1.1843	1.0882
No log	11.75	376	1.1788	0.2686	1.1788	1.0857
No log	11.8125	378	1.2228	0.2574	1.2228	1.1058
No log	11.875	380	1.3576	0.2481	1.3576	1.1652
No log	11.9375	382	1.4126	0.2773	1.4126	1.1885
No log	12.0	384	1.3469	0.3174	1.3469	1.1606
No log	12.0625	386	1.2319	0.1854	1.2319	1.1099
No log	12.125	388	1.1821	0.2951	1.1821	1.0873
No log	12.1875	390	1.1868	0.3091	1.1868	1.0894
No log	12.25	392	1.2402	0.3001	1.2402	1.1136
No log	12.3125	394	1.3816	0.2511	1.3816	1.1754
No log	12.375	396	1.4284	0.2822	1.4284	1.1951
No log	12.4375	398	1.3762	0.3192	1.3762	1.1731
No log	12.5	400	1.2440	0.2261	1.2440	1.1154
No log	12.5625	402	1.1973	0.2574	1.1973	1.0942
No log	12.625	404	1.2034	0.3430	1.2034	1.0970
No log	12.6875	406	1.2082	0.3430	1.2082	1.0992
No log	12.75	408	1.1964	0.2686	1.1964	1.0938
No log	12.8125	410	1.2103	0.2930	1.2103	1.1001
No log	12.875	412	1.2204	0.2930	1.2204	1.1047
No log	12.9375	414	1.1999	0.2951	1.1999	1.0954
No log	13.0	416	1.1807	0.3464	1.1807	1.0866
No log	13.0625	418	1.1919	0.2668	1.1919	1.0917
No log	13.125	420	1.3095	0.2605	1.3095	1.1443
No log	13.1875	422	1.4512	0.2857	1.4512	1.2047
No log	13.25	424	1.4371	0.2731	1.4371	1.1988
No log	13.3125	426	1.3089	0.2403	1.3089	1.1441
No log	13.375	428	1.1859	0.1911	1.1859	1.0890
No log	13.4375	430	1.1474	0.2300	1.1474	1.0712
No log	13.5	432	1.1725	0.1866	1.1725	1.0828
No log	13.5625	434	1.1824	0.2822	1.1824	1.0874
No log	13.625	436	1.2668	0.3465	1.2668	1.1255
No log	13.6875	438	1.4316	0.2622	1.4316	1.1965
No log	13.75	440	1.5761	0.2841	1.5761	1.2554
No log	13.8125	442	1.5387	0.2841	1.5387	1.2404
No log	13.875	444	1.3709	0.2922	1.3709	1.1709
No log	13.9375	446	1.1886	0.2525	1.1886	1.0902
No log	14.0	448	1.1203	0.3045	1.1203	1.0585
No log	14.0625	450	1.1173	0.3144	1.1173	1.0570
No log	14.125	452	1.1774	0.3162	1.1774	1.0851
No log	14.1875	454	1.2909	0.2578	1.2909	1.1362
No log	14.25	456	1.3581	0.2688	1.3581	1.1654
No log	14.3125	458	1.3742	0.2985	1.3742	1.1722
No log	14.375	460	1.4253	0.2698	1.4253	1.1939
No log	14.4375	462	1.4248	0.2868	1.4248	1.1937
No log	14.5	464	1.3248	0.2108	1.3248	1.1510
No log	14.5625	466	1.2196	0.2743	1.2196	1.1043
No log	14.625	468	1.2184	0.2743	1.2184	1.1038
No log	14.6875	470	1.2571	0.2602	1.2571	1.1212
No log	14.75	472	1.3002	0.2602	1.3002	1.1403
No log	14.8125	474	1.2873	0.2602	1.2873	1.1346
No log	14.875	476	1.3030	0.2438	1.3030	1.1415
No log	14.9375	478	1.3838	0.2822	1.3838	1.1764
No log	15.0	480	1.4985	0.3118	1.4985	1.2242
No log	15.0625	482	1.4683	0.2890	1.4683	1.2117
No log	15.125	484	1.4973	0.2951	1.4973	1.2236
No log	15.1875	486	1.4452	0.2698	1.4452	1.2022
No log	15.25	488	1.3657	0.2822	1.3657	1.1686
No log	15.3125	490	1.2407	0.3001	1.2407	1.1139
No log	15.375	492	1.1728	0.2395	1.1728	1.0829
No log	15.4375	494	1.1578	0.2899	1.1578	1.0760
No log	15.5	496	1.2004	0.2143	1.2004	1.0956
No log	15.5625	498	1.3034	0.2721	1.3034	1.1416
0.368	15.625	500	1.4670	0.2608	1.4670	1.2112
0.368	15.6875	502	1.5282	0.2820	1.5282	1.2362
0.368	15.75	504	1.4618	0.2527	1.4618	1.2091
0.368	15.8125	506	1.3175	0.2721	1.3175	1.1478
0.368	15.875	508	1.2206	0.1995	1.2206	1.1048
0.368	15.9375	510	1.1977	0.2782	1.1977	1.0944
0.368	16.0	512	1.2259	0.2288	1.2259	1.1072
0.368	16.0625	514	1.3020	0.2518	1.3020	1.1411
0.368	16.125	516	1.4100	0.1894	1.4100	1.1875
0.368	16.1875	518	1.4029	0.1894	1.4029	1.1844
0.368	16.25	520	1.3461	0.2549	1.3461	1.1602

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1