ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k20_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4350
• Qwk: 0.1024
• Mse: 1.4350
• Rmse: 1.1979

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	3.9490	0.0070	3.9490	1.9872
No log	0.0833	4	2.2582	0.0868	2.2582	1.5027
No log	0.125	6	1.8695	0.0429	1.8695	1.3673
No log	0.1667	8	1.9632	0.1105	1.9632	1.4012
No log	0.2083	10	1.2313	0.0380	1.2313	1.1096
No log	0.25	12	1.1038	0.2416	1.1038	1.0506
No log	0.2917	14	1.0947	0.0513	1.0947	1.0463
No log	0.3333	16	1.1337	0.1101	1.1337	1.0647
No log	0.375	18	1.1972	0.1482	1.1972	1.0942
No log	0.4167	20	1.2059	0.1119	1.2059	1.0982
No log	0.4583	22	1.1303	0.1408	1.1303	1.0632
No log	0.5	24	1.1634	0.0636	1.1634	1.0786
No log	0.5417	26	1.2656	0.0833	1.2656	1.1250
No log	0.5833	28	1.2853	0.0445	1.2853	1.1337
No log	0.625	30	1.1011	0.0824	1.1011	1.0493
No log	0.6667	32	1.0461	0.1891	1.0461	1.0228
No log	0.7083	34	1.0293	0.3037	1.0293	1.0146
No log	0.75	36	1.0284	0.3645	1.0284	1.0141
No log	0.7917	38	1.0520	0.2465	1.0520	1.0257
No log	0.8333	40	1.0528	0.3104	1.0528	1.0261
No log	0.875	42	1.1237	0.1725	1.1237	1.0600
No log	0.9167	44	1.3334	-0.0870	1.3334	1.1547
No log	0.9583	46	1.3682	-0.1174	1.3682	1.1697
No log	1.0	48	1.3354	-0.0753	1.3354	1.1556
No log	1.0417	50	1.4686	0.0246	1.4686	1.2119
No log	1.0833	52	1.9367	-0.1020	1.9367	1.3917
No log	1.125	54	2.0907	-0.1605	2.0907	1.4459
No log	1.1667	56	1.7538	-0.0048	1.7538	1.3243
No log	1.2083	58	1.5461	0.2035	1.5461	1.2434
No log	1.25	60	1.3724	0.2537	1.3724	1.1715
No log	1.2917	62	1.2395	0.3391	1.2395	1.1133
No log	1.3333	64	1.1379	0.3043	1.1379	1.0667
No log	1.375	66	1.3067	0.3056	1.3067	1.1431
No log	1.4167	68	1.5203	0.1663	1.5203	1.2330
No log	1.4583	70	1.5465	0.1193	1.5465	1.2436
No log	1.5	72	1.4394	0.1197	1.4394	1.1998
No log	1.5417	74	1.2798	0.2137	1.2798	1.1313
No log	1.5833	76	1.4591	0.1619	1.4591	1.2079
No log	1.625	78	1.4845	0.1648	1.4845	1.2184
No log	1.6667	80	1.2810	0.2831	1.2810	1.1318
No log	1.7083	82	1.1935	0.3352	1.1935	1.0925
No log	1.75	84	1.3142	0.2857	1.3142	1.1464
No log	1.7917	86	1.7798	0.0643	1.7798	1.3341
No log	1.8333	88	1.8940	0.0669	1.8940	1.3762
No log	1.875	90	1.6893	0.0969	1.6893	1.2997
No log	1.9167	92	1.5018	0.1197	1.5018	1.2255
No log	1.9583	94	1.3513	0.0741	1.3513	1.1625
No log	2.0	96	1.2873	0.0811	1.2873	1.1346
No log	2.0417	98	1.4565	0.1202	1.4565	1.2069
No log	2.0833	100	1.5882	0.0613	1.5882	1.2602
No log	2.125	102	1.5904	-0.1157	1.5904	1.2611
No log	2.1667	104	1.4434	-0.0091	1.4434	1.2014
No log	2.2083	106	1.2679	0.1379	1.2679	1.1260
No log	2.25	108	1.2972	0.1863	1.2972	1.1389
No log	2.2917	110	1.6374	0.1465	1.6374	1.2796
No log	2.3333	112	1.7660	0.1328	1.7660	1.3289
No log	2.375	114	1.6926	0.1350	1.6926	1.3010
No log	2.4167	116	1.6313	0.1812	1.6313	1.2772
No log	2.4583	118	1.3781	0.2563	1.3781	1.1739
No log	2.5	120	1.4120	0.2389	1.4120	1.1883
No log	2.5417	122	1.5713	0.0922	1.5713	1.2535
No log	2.5833	124	1.5728	0.0922	1.5728	1.2541
No log	2.625	126	1.5164	0.1081	1.5164	1.2314
No log	2.6667	128	1.4681	0.1473	1.4681	1.2116
No log	2.7083	130	1.3443	0.0833	1.3443	1.1594
No log	2.75	132	1.2547	0.1230	1.2547	1.1201
No log	2.7917	134	1.1556	0.1230	1.1556	1.0750
No log	2.8333	136	1.2266	0.2089	1.2266	1.1075
No log	2.875	138	1.5129	0.2070	1.5129	1.2300
No log	2.9167	140	1.9370	0.0957	1.9370	1.3918
No log	2.9583	142	1.9546	0.0397	1.9546	1.3981
No log	3.0	144	1.6866	0.1268	1.6866	1.2987
No log	3.0417	146	1.3305	0.2098	1.3305	1.1535
No log	3.0833	148	1.3283	0.2251	1.3283	1.1525
No log	3.125	150	1.3597	0.2389	1.3597	1.1661
No log	3.1667	152	1.3935	0.1727	1.3935	1.1805
No log	3.2083	154	1.4632	0.1904	1.4632	1.2096
No log	3.25	156	1.5979	0.0340	1.5979	1.2641
No log	3.2917	158	1.5867	0.1058	1.5867	1.2596
No log	3.3333	160	1.4975	0.1024	1.4975	1.2237
No log	3.375	162	1.3442	0.0661	1.3442	1.1594
No log	3.4167	164	1.2249	0.0811	1.2249	1.1068
No log	3.4583	166	1.2060	0.1512	1.2060	1.0982
No log	3.5	168	1.3612	0.2084	1.3612	1.1667
No log	3.5417	170	1.4741	0.2465	1.4741	1.2141
No log	3.5833	172	1.3075	0.1966	1.3075	1.1435
No log	3.625	174	1.2155	0.1255	1.2155	1.1025
No log	3.6667	176	1.2016	0.1255	1.2016	1.0962
No log	3.7083	178	1.1939	0.1170	1.1939	1.0927
No log	3.75	180	1.1990	0.0811	1.1990	1.0950
No log	3.7917	182	1.0731	-0.0091	1.0731	1.0359
No log	3.8333	184	1.0691	-0.0091	1.0691	1.0340
No log	3.875	186	1.2021	0.0661	1.2021	1.0964
No log	3.9167	188	1.3056	0.1407	1.3056	1.1426
No log	3.9583	190	1.2245	0.1370	1.2245	1.1066
No log	4.0	192	1.1535	0.1654	1.1535	1.0740
No log	4.0417	194	1.2570	0.2155	1.2570	1.1212
No log	4.0833	196	1.3778	0.2311	1.3778	1.1738
No log	4.125	198	1.4270	0.2574	1.4270	1.1946
No log	4.1667	200	1.7037	0.2441	1.7037	1.3053
No log	4.2083	202	1.6629	0.2359	1.6629	1.2895
No log	4.25	204	1.3467	0.2015	1.3467	1.1605
No log	4.2917	206	1.0634	0.1676	1.0634	1.0312
No log	4.3333	208	1.0305	0.2599	1.0305	1.0151
No log	4.375	210	1.1554	0.2283	1.1555	1.0749
No log	4.4167	212	1.2349	0.2389	1.2349	1.1113
No log	4.4583	214	1.3312	0.2531	1.3312	1.1538
No log	4.5	216	1.4452	0.2465	1.4452	1.2022
No log	4.5417	218	1.3255	0.2132	1.3255	1.1513
No log	4.5833	220	1.1667	0.2661	1.1667	1.0801
No log	4.625	222	1.1759	0.2661	1.1759	1.0844
No log	4.6667	224	1.3241	0.2132	1.3241	1.1507
No log	4.7083	226	1.4609	0.2132	1.4609	1.2087
No log	4.75	228	1.4381	0.2132	1.4381	1.1992
No log	4.7917	230	1.3236	0.2261	1.3236	1.1505
No log	4.8333	232	1.2726	0.1838	1.2726	1.1281
No log	4.875	234	1.2454	0.1170	1.2454	1.1160
No log	4.9167	236	1.2700	0.0278	1.2700	1.1269
No log	4.9583	238	1.2466	0.0278	1.2466	1.1165
No log	5.0	240	1.2964	0.0661	1.2964	1.1386
No log	5.0417	242	1.3904	0.2015	1.3904	1.1791
No log	5.0833	244	1.5668	0.2187	1.5668	1.2517
No log	5.125	246	1.5400	0.1971	1.5400	1.2410
No log	5.1667	248	1.5111	0.1854	1.5111	1.2293
No log	5.2083	250	1.5531	0.1850	1.5531	1.2462
No log	5.25	252	1.5845	0.1850	1.5845	1.2588
No log	5.2917	254	1.4430	0.1850	1.4430	1.2013
No log	5.3333	256	1.2612	0.2337	1.2612	1.1230
No log	5.375	258	1.2542	0.2337	1.2542	1.1199
No log	5.4167	260	1.4090	0.2511	1.4090	1.1870
No log	5.4583	262	1.6089	0.2515	1.6089	1.2684
No log	5.5	264	1.5402	0.2809	1.5402	1.2411
No log	5.5417	266	1.3026	0.2389	1.3026	1.1413
No log	5.5833	268	1.1411	0.2051	1.1411	1.0682
No log	5.625	270	1.1273	0.2051	1.1273	1.0617
No log	5.6667	272	1.2259	0.1512	1.2259	1.1072
No log	5.7083	274	1.3768	0.2367	1.3768	1.1734
No log	5.75	276	1.5466	0.2359	1.5466	1.2436
No log	5.7917	278	1.5330	0.1863	1.5330	1.2382
No log	5.8333	280	1.3546	0.2240	1.3546	1.1639
No log	5.875	282	1.2223	0.2389	1.2223	1.1056
No log	5.9167	284	1.2409	0.2792	1.2409	1.1139
No log	5.9583	286	1.4121	0.2079	1.4121	1.1883
No log	6.0	288	1.6159	0.2481	1.6159	1.2712
No log	6.0417	290	1.6886	0.2590	1.6886	1.2995
No log	6.0833	292	1.4676	0.2223	1.4676	1.2115
No log	6.125	294	1.1950	0.2206	1.1950	1.0931
No log	6.1667	296	1.1211	0.2283	1.1211	1.0588
No log	6.2083	298	1.1940	0.2206	1.1940	1.0927
No log	6.25	300	1.3041	0.2075	1.3041	1.1420
No log	6.2917	302	1.4198	0.2132	1.4198	1.1916
No log	6.3333	304	1.4857	0.2731	1.4857	1.2189
No log	6.375	306	1.3934	0.2015	1.3934	1.1804
No log	6.4167	308	1.2557	0.1512	1.2557	1.1206
No log	6.4583	310	1.2233	0.1512	1.2233	1.1060
No log	6.5	312	1.2315	0.1512	1.2315	1.1097
No log	6.5417	314	1.2851	0.2707	1.2851	1.1336
No log	6.5833	316	1.3915	0.2485	1.3915	1.1796
No log	6.625	318	1.4288	0.2672	1.4288	1.1953
No log	6.6667	320	1.4669	0.2223	1.4669	1.2111
No log	6.7083	322	1.4478	0.2465	1.4478	1.2032
No log	6.75	324	1.2974	0.2075	1.2974	1.1391
No log	6.7917	326	1.2141	0.2015	1.2141	1.1019
No log	6.8333	328	1.2992	0.2075	1.2992	1.1398
No log	6.875	330	1.4094	0.2075	1.4094	1.1872
No log	6.9167	332	1.5991	0.2597	1.5991	1.2646
No log	6.9583	334	1.7181	0.3006	1.7181	1.3108
No log	7.0	336	1.5651	0.2793	1.5651	1.2510
No log	7.0417	338	1.3282	0.1700	1.3282	1.1525
No log	7.0833	340	1.2299	0.1024	1.2299	1.1090
No log	7.125	342	1.3405	0.2075	1.3405	1.1578
No log	7.1667	344	1.5501	0.2568	1.5501	1.2450
No log	7.2083	346	1.6237	0.2793	1.6237	1.2742
No log	7.25	348	1.6144	0.2752	1.6144	1.2706
No log	7.2917	350	1.5134	0.2315	1.5134	1.2302
No log	7.3333	352	1.4281	0.2075	1.4281	1.1950
No log	7.375	354	1.4773	0.1898	1.4773	1.2154
No log	7.4167	356	1.6070	0.2869	1.6070	1.2677
No log	7.4583	358	1.6198	0.2611	1.6198	1.2727
No log	7.5	360	1.5001	0.2709	1.5001	1.2248
No log	7.5417	362	1.3963	0.2065	1.3963	1.1817
No log	7.5833	364	1.2585	0.1700	1.2585	1.1218
No log	7.625	366	1.2159	0.2015	1.2159	1.1027
No log	7.6667	368	1.1837	0.1024	1.1837	1.0880
No log	7.7083	370	1.1621	0.0661	1.1621	1.0780
No log	7.75	372	1.2456	0.1052	1.2456	1.1161
No log	7.7917	374	1.4738	0.2474	1.4738	1.2140
No log	7.8333	376	1.6475	0.2058	1.6475	1.2835
No log	7.875	378	1.6487	0.2005	1.6487	1.2840
No log	7.9167	380	1.4409	0.2015	1.4409	1.2004
No log	7.9583	382	1.3083	0.1898	1.3083	1.1438
No log	8.0	384	1.2782	0.1700	1.2782	1.1306
No log	8.0417	386	1.3149	0.1700	1.3149	1.1467
No log	8.0833	388	1.4182	0.2132	1.4182	1.1909
No log	8.125	390	1.3887	0.1958	1.3887	1.1784
No log	8.1667	392	1.2593	0.2389	1.2593	1.1222
No log	8.2083	394	1.0030	0.3415	1.0030	1.0015
No log	8.25	396	0.8563	0.4301	0.8563	0.9254
No log	8.2917	398	0.8940	0.4549	0.8940	0.9455
No log	8.3333	400	1.0527	0.3415	1.0527	1.0260
No log	8.375	402	1.1508	0.2468	1.1508	1.0728
No log	8.4167	404	1.1685	0.2516	1.1685	1.0810
No log	8.4583	406	1.0832	0.3415	1.0832	1.0408
No log	8.5	408	1.1822	0.2149	1.1822	1.0873
No log	8.5417	410	1.3516	0.2149	1.3516	1.1626
No log	8.5833	412	1.3085	0.1170	1.3085	1.1439
No log	8.625	414	1.2688	0.0587	1.2688	1.1264
No log	8.6667	416	1.2661	0.1230	1.2661	1.1252
No log	8.7083	418	1.2902	0.2528	1.2902	1.1359
No log	8.75	420	1.3352	0.2389	1.3352	1.1555
No log	8.7917	422	1.5856	0.2715	1.5856	1.2592
No log	8.8333	424	1.7010	0.2565	1.7010	1.3042
No log	8.875	426	1.6159	0.2677	1.6159	1.2712
No log	8.9167	428	1.4073	0.2315	1.4073	1.1863
No log	8.9583	430	1.2736	0.0433	1.2736	1.1286
No log	9.0	432	1.2533	0.0433	1.2533	1.1195
No log	9.0417	434	1.3156	0.0	1.3156	1.1470
No log	9.0833	436	1.4589	0.1744	1.4589	1.2079
No log	9.125	438	1.5845	0.2709	1.5845	1.2588
No log	9.1667	440	1.6059	0.2690	1.6059	1.2672
No log	9.2083	442	1.5754	0.3071	1.5754	1.2552
No log	9.25	444	1.5208	0.3037	1.5208	1.2332
No log	9.2917	446	1.4687	0.3001	1.4687	1.2119
No log	9.3333	448	1.4430	0.2686	1.4430	1.2012
No log	9.375	450	1.4174	0.2395	1.4174	1.1906
No log	9.4167	452	1.3436	0.0811	1.3436	1.1591
No log	9.4583	454	1.2732	0.0587	1.2732	1.1284
No log	9.5	456	1.2998	0.0587	1.2998	1.1401
No log	9.5417	458	1.4008	0.2816	1.4008	1.1836
No log	9.5833	460	1.5508	0.2712	1.5508	1.2453
No log	9.625	462	1.5176	0.2411	1.5176	1.2319
No log	9.6667	464	1.4809	0.2611	1.4809	1.2169
No log	9.7083	466	1.3373	0.2837	1.3373	1.1564
No log	9.75	468	1.1923	0.1911	1.1923	1.0919
No log	9.7917	470	1.1927	0.2227	1.1927	1.0921
No log	9.8333	472	1.3380	0.2367	1.3380	1.1567
No log	9.875	474	1.5420	0.2465	1.5420	1.2418
No log	9.9167	476	1.5457	0.2465	1.5457	1.2432
No log	9.9583	478	1.3788	0.2089	1.3788	1.1742
No log	10.0	480	1.2881	0.1770	1.2881	1.1349
No log	10.0417	482	1.2916	0.1434	1.2916	1.1365
No log	10.0833	484	1.3666	0.1770	1.3666	1.1690
No log	10.125	486	1.4936	0.2709	1.4936	1.2221
No log	10.1667	488	1.5590	0.2832	1.5590	1.2486
No log	10.2083	490	1.5490	0.2832	1.5490	1.2446
No log	10.25	492	1.4769	0.2372	1.4769	1.2153
No log	10.2917	494	1.3415	0.1407	1.3415	1.1582
No log	10.3333	496	1.2395	0.0811	1.2395	1.1133
No log	10.375	498	1.2390	0.0811	1.2390	1.1131
0.2841	10.4167	500	1.3512	0.1434	1.3512	1.1624
0.2841	10.4583	502	1.5456	0.2709	1.5456	1.2432
0.2841	10.5	504	1.6114	0.2292	1.6114	1.2694
0.2841	10.5417	506	1.5498	0.0878	1.5498	1.2449
0.2841	10.5833	508	1.6332	0.2062	1.6332	1.2780
0.2841	10.625	510	1.6665	0.2568	1.6665	1.2909
0.2841	10.6667	512	1.6789	0.2522	1.6789	1.2957
0.2841	10.7083	514	1.5657	0.1449	1.5657	1.2513
0.2841	10.75	516	1.4300	0.0	1.4300	1.1958
0.2841	10.7917	518	1.3771	0.0	1.3771	1.1735
0.2841	10.8333	520	1.3877	0.0	1.3877	1.1780
0.2841	10.875	522	1.3984	0.0390	1.3984	1.1826
0.2841	10.9167	524	1.4882	0.2075	1.4882	1.2199
0.2841	10.9583	526	1.5491	0.2731	1.5491	1.2446
0.2841	11.0	528	1.6888	0.2406	1.6888	1.2995
0.2841	11.0417	530	1.8221	0.2236	1.8221	1.3499
0.2841	11.0833	532	1.7328	0.2406	1.7328	1.3164
0.2841	11.125	534	1.5901	0.2611	1.5901	1.2610
0.2841	11.1667	536	1.4512	0.1700	1.4512	1.2047
0.2841	11.2083	538	1.4409	0.1486	1.4409	1.2004
0.2841	11.25	540	1.4321	0.1486	1.4321	1.1967
0.2841	11.2917	542	1.3759	0.1113	1.3759	1.1730
0.2841	11.3333	544	1.2778	0.0155	1.2778	1.1304
0.2841	11.375	546	1.2185	0.0155	1.2185	1.1039
0.2841	11.4167	548	1.2370	0.1230	1.2370	1.1122
0.2841	11.4583	550	1.3208	0.1579	1.3208	1.1493
0.2841	11.5	552	1.4329	0.2206	1.4329	1.1971
0.2841	11.5417	554	1.4997	0.2187	1.4997	1.2246
0.2841	11.5833	556	1.4773	0.2187	1.4773	1.2155
0.2841	11.625	558	1.3140	0.1024	1.3140	1.1463
0.2841	11.6667	560	1.2276	0.0	1.2276	1.1080
0.2841	11.7083	562	1.2768	0.1052	1.2768	1.1300
0.2841	11.75	564	1.3133	0.1052	1.3133	1.1460
0.2841	11.7917	566	1.3818	0.2372	1.3818	1.1755
0.2841	11.8333	568	1.3905	0.2709	1.3905	1.1792
0.2841	11.875	570	1.2853	0.2075	1.2853	1.1337
0.2841	11.9167	572	1.2175	0.2577	1.2175	1.1034
0.2841	11.9583	574	1.1961	0.2528	1.1961	1.0936
0.2841	12.0	576	1.1848	0.2528	1.1848	1.0885
0.2841	12.0417	578	1.2756	0.2206	1.2756	1.1294
0.2841	12.0833	580	1.4517	0.2367	1.4517	1.2049
0.2841	12.125	582	1.6607	0.2653	1.6607	1.2887
0.2841	12.1667	584	1.6912	0.2832	1.6912	1.3005
0.2841	12.2083	586	1.6272	0.2752	1.6272	1.2756
0.2841	12.25	588	1.5041	0.2372	1.5041	1.2264
0.2841	12.2917	590	1.3905	0.1407	1.3905	1.1792
0.2841	12.3333	592	1.3347	0.0781	1.3347	1.1553
0.2841	12.375	594	1.3402	0.0781	1.3402	1.1577
0.2841	12.4167	596	1.3880	0.1407	1.3880	1.1781
0.2841	12.4583	598	1.4048	0.2372	1.4048	1.1852
0.2841	12.5	600	1.4062	0.2417	1.4062	1.1858
0.2841	12.5417	602	1.2966	0.2389	1.2966	1.1387
0.2841	12.5833	604	1.1174	0.2683	1.1174	1.0570
0.2841	12.625	606	1.0972	0.2489	1.0972	1.0475
0.2841	12.6667	608	1.1832	0.2334	1.1832	1.0877
0.2841	12.7083	610	1.3754	0.2987	1.3754	1.1728
0.2841	12.75	612	1.5342	0.2644	1.5342	1.2386
0.2841	12.7917	614	1.5642	0.2770	1.5642	1.2507
0.2841	12.8333	616	1.4294	0.2647	1.4294	1.1956
0.2841	12.875	618	1.2794	0.2260	1.2794	1.1311
0.2841	12.9167	620	1.1902	0.0587	1.1902	1.0910
0.2841	12.9583	622	1.2065	0.0587	1.2065	1.0984
0.2841	13.0	624	1.2954	0.1579	1.2954	1.1382
0.2841	13.0417	626	1.3871	0.1024	1.3871	1.1778
0.2841	13.0833	628	1.4218	0.1024	1.4218	1.1924
0.2841	13.125	630	1.4676	0.1700	1.4676	1.2115
0.2841	13.1667	632	1.4334	0.1024	1.4334	1.1972
0.2841	13.2083	634	1.3939	0.1024	1.3939	1.1806
0.2841	13.25	636	1.4196	0.1024	1.4196	1.1915
0.2841	13.2917	638	1.4161	0.1024	1.4161	1.1900
0.2841	13.3333	640	1.4350	0.1024	1.4350	1.1979

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1