ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2680
• Qwk: 0.1637
• Mse: 1.2680
• Rmse: 1.1261

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.5670	0.0010	4.5670	2.1370
No log	0.0769	4	2.4718	0.0397	2.4718	1.5722
No log	0.1154	6	1.8310	0.0372	1.8310	1.3532
No log	0.1538	8	1.4476	0.0538	1.4476	1.2031
No log	0.1923	10	1.2829	0.1694	1.2829	1.1327
No log	0.2308	12	1.2937	0.0077	1.2937	1.1374
No log	0.2692	14	1.2675	0.0030	1.2675	1.1258
No log	0.3077	16	1.1710	0.2408	1.1710	1.0821
No log	0.3462	18	1.1548	0.1076	1.1548	1.0746
No log	0.3846	20	1.1784	0.1076	1.1784	1.0855
No log	0.4231	22	1.2315	0.1343	1.2315	1.1097
No log	0.4615	24	1.2248	0.1011	1.2248	1.1067
No log	0.5	26	1.1926	0.2681	1.1926	1.0921
No log	0.5385	28	1.4911	0.0189	1.4911	1.2211
No log	0.5769	30	1.7120	0.0403	1.7120	1.3084
No log	0.6154	32	1.5396	0.0575	1.5396	1.2408
No log	0.6538	34	1.3780	0.0189	1.3780	1.1739
No log	0.6923	36	1.2183	0.2289	1.2183	1.1038
No log	0.7308	38	1.1863	0.1144	1.1863	1.0892
No log	0.7692	40	1.3229	0.0077	1.3229	1.1502
No log	0.8077	42	1.4049	0.0711	1.4049	1.1853
No log	0.8462	44	1.2749	0.0343	1.2749	1.1291
No log	0.8846	46	1.3374	0.0831	1.3374	1.1565
No log	0.9231	48	1.6354	0.0750	1.6354	1.2788
No log	0.9615	50	1.5907	0.0723	1.5907	1.2612
No log	1.0	52	1.5206	0.0723	1.5206	1.2331
No log	1.0385	54	1.3490	0.1224	1.3490	1.1614
No log	1.0769	56	1.1606	0.2485	1.1606	1.0773
No log	1.1154	58	1.1921	0.0253	1.1921	1.0919
No log	1.1538	60	1.3209	0.0	1.3209	1.1493
No log	1.1923	62	1.3594	0.0	1.3594	1.1659
No log	1.2308	64	1.2992	-0.0100	1.2992	1.1398
No log	1.2692	66	1.2469	0.0682	1.2469	1.1166
No log	1.3077	68	1.2503	0.0721	1.2503	1.1182
No log	1.3462	70	1.2842	0.0666	1.2842	1.1332
No log	1.3846	72	1.2975	0.1483	1.2975	1.1391
No log	1.4231	74	1.2924	0.2124	1.2924	1.1368
No log	1.4615	76	1.2654	0.0206	1.2654	1.1249
No log	1.5	78	1.2582	0.0586	1.2582	1.1217
No log	1.5385	80	1.2579	0.1875	1.2579	1.1216
No log	1.5769	82	1.2784	0.2792	1.2784	1.1306
No log	1.6154	84	1.3411	0.1308	1.3411	1.1581
No log	1.6538	86	1.4590	0.0927	1.4590	1.2079
No log	1.6923	88	1.4838	0.1650	1.4838	1.2181
No log	1.7308	90	1.3604	0.2086	1.3604	1.1664
No log	1.7692	92	1.3701	0.2206	1.3701	1.1705
No log	1.8077	94	1.3408	0.2813	1.3408	1.1579
No log	1.8462	96	1.2246	0.2309	1.2246	1.1066
No log	1.8846	98	1.2812	0.2829	1.2812	1.1319
No log	1.9231	100	1.2015	0.3001	1.2015	1.0961
No log	1.9615	102	1.1632	0.2884	1.1632	1.0785
No log	2.0	104	1.1200	0.2586	1.1200	1.0583
No log	2.0385	106	1.1441	0.2046	1.1441	1.0696
No log	2.0769	108	1.1116	0.1853	1.1116	1.0543
No log	2.1154	110	1.0221	0.3098	1.0221	1.0110
No log	2.1538	112	1.0806	0.2837	1.0806	1.0395
No log	2.1923	114	1.4342	0.1890	1.4342	1.1976
No log	2.2308	116	1.8076	0.2062	1.8076	1.3445
No log	2.2692	118	1.9460	0.2156	1.9460	1.3950
No log	2.3077	120	1.5679	0.2749	1.5679	1.2522
No log	2.3462	122	1.3338	0.2713	1.3338	1.1549
No log	2.3846	124	1.3295	0.2928	1.3295	1.1530
No log	2.4231	126	1.5399	0.2457	1.5399	1.2409
No log	2.4615	128	1.7571	0.2298	1.7571	1.3256
No log	2.5	130	1.9011	0.1914	1.9011	1.3788
No log	2.5385	132	1.7000	0.2749	1.7000	1.3038
No log	2.5769	134	1.6399	0.2749	1.6399	1.2806
No log	2.6154	136	1.5257	0.2812	1.5257	1.2352
No log	2.6538	138	1.5115	0.3111	1.5115	1.2294
No log	2.6923	140	1.8290	0.1401	1.8290	1.3524
No log	2.7308	142	1.8950	0.1261	1.8950	1.3766
No log	2.7692	144	1.6822	0.2094	1.6822	1.2970
No log	2.8077	146	1.5016	0.2020	1.5016	1.2254
No log	2.8462	148	1.4190	0.2817	1.4190	1.1912
No log	2.8846	150	1.3449	0.1159	1.3449	1.1597
No log	2.9231	152	1.3986	0.1659	1.3986	1.1826
No log	2.9615	154	1.4802	0.2619	1.4802	1.2166
No log	3.0	156	1.5631	0.2172	1.5631	1.2502
No log	3.0385	158	1.7362	0.1416	1.7362	1.3177
No log	3.0769	160	1.5918	0.1726	1.5918	1.2617
No log	3.1154	162	1.4568	0.1247	1.4568	1.2070
No log	3.1538	164	1.5010	0.1305	1.5010	1.2252
No log	3.1923	166	1.8547	0.2014	1.8547	1.3619
No log	3.2308	168	1.7128	0.2023	1.7128	1.3088
No log	3.2692	170	1.5144	0.3310	1.5144	1.2306
No log	3.3077	172	1.4152	0.2662	1.4152	1.1896
No log	3.3462	174	1.5329	0.2878	1.5329	1.2381
No log	3.3846	176	1.5299	0.3118	1.5299	1.2369
No log	3.4231	178	1.7679	0.2521	1.7679	1.3296
No log	3.4615	180	1.7479	0.2241	1.7479	1.3221
No log	3.5	182	1.6481	0.2776	1.6481	1.2838
No log	3.5385	184	1.4065	0.3429	1.4065	1.1859
No log	3.5769	186	1.3139	0.2384	1.3139	1.1462
No log	3.6154	188	1.4342	0.2343	1.4342	1.1976
No log	3.6538	190	1.5009	0.3026	1.5009	1.2251
No log	3.6923	192	1.6187	0.3132	1.6187	1.2723
No log	3.7308	194	2.0208	0.1613	2.0208	1.4216
No log	3.7692	196	2.1006	0.1282	2.1006	1.4493
No log	3.8077	198	1.6598	0.3008	1.6598	1.2883
No log	3.8462	200	1.4529	0.3259	1.4529	1.2054
No log	3.8846	202	1.6095	0.2973	1.6095	1.2687
No log	3.9231	204	1.8510	0.1940	1.8510	1.3605
No log	3.9615	206	1.7728	0.2224	1.7728	1.3315
No log	4.0	208	1.7434	0.2493	1.7434	1.3204
No log	4.0385	210	1.3815	0.3442	1.3815	1.1754
No log	4.0769	212	1.2737	0.3004	1.2737	1.1286
No log	4.1154	214	1.4024	0.4048	1.4024	1.1842
No log	4.1538	216	1.6192	0.2925	1.6192	1.2725
No log	4.1923	218	1.5539	0.2847	1.5539	1.2466
No log	4.2308	220	1.4176	0.4156	1.4176	1.1906
No log	4.2692	222	1.4563	0.3791	1.4563	1.2068
No log	4.3077	224	1.5483	0.3659	1.5483	1.2443
No log	4.3462	226	1.7593	0.2095	1.7593	1.3264
No log	4.3846	228	1.7293	0.2493	1.7293	1.3150
No log	4.4231	230	1.4025	0.2619	1.4025	1.1843
No log	4.4615	232	1.3043	0.2384	1.3043	1.1421
No log	4.5	234	1.2502	0.2417	1.2502	1.1181
No log	4.5385	236	1.4562	0.2354	1.4562	1.2067
No log	4.5769	238	1.7358	0.1814	1.7358	1.3175
No log	4.6154	240	1.8247	0.1814	1.8247	1.3508
No log	4.6538	242	1.6414	0.2132	1.6414	1.2812
No log	4.6923	244	1.4601	0.1753	1.4601	1.2083
No log	4.7308	246	1.2786	0.1696	1.2786	1.1307
No log	4.7692	248	1.2932	0.1846	1.2932	1.1372
No log	4.8077	250	1.4200	0.2060	1.4200	1.1917
No log	4.8462	252	1.4839	0.2806	1.4839	1.2182
No log	4.8846	254	1.4021	0.2498	1.4021	1.1841
No log	4.9231	256	1.5271	0.2798	1.5271	1.2358
No log	4.9615	258	1.7323	0.2925	1.7323	1.3162
No log	5.0	260	1.8042	0.2610	1.8042	1.3432
No log	5.0385	262	1.7591	0.2610	1.7591	1.3263
No log	5.0769	264	1.4473	0.2798	1.4473	1.2030
No log	5.1154	266	1.3154	0.2589	1.3154	1.1469
No log	5.1538	268	1.3815	0.2833	1.3815	1.1754
No log	5.1923	270	1.7730	0.2610	1.7730	1.3315
No log	5.2308	272	2.0079	0.1301	2.0079	1.4170
No log	5.2692	274	1.8307	0.2493	1.8307	1.3530
No log	5.3077	276	1.4994	0.2829	1.4994	1.2245
No log	5.3462	278	1.3001	0.1801	1.3001	1.1402
No log	5.3846	280	1.2809	0.1405	1.2809	1.1318
No log	5.4231	282	1.4479	0.2065	1.4479	1.2033
No log	5.4615	284	1.7069	0.2463	1.7069	1.3065
No log	5.5	286	1.7685	0.2019	1.7685	1.3299
No log	5.5385	288	1.5320	0.2240	1.5320	1.2377
No log	5.5769	290	1.2491	0.2000	1.2491	1.1176
No log	5.6154	292	1.2379	0.2207	1.2379	1.1126
No log	5.6538	294	1.4186	0.1196	1.4186	1.1910
No log	5.6923	296	1.7254	0.1702	1.7254	1.3135
No log	5.7308	298	1.8262	0.2205	1.8262	1.3514
No log	5.7692	300	1.7021	0.2461	1.7021	1.3047
No log	5.8077	302	1.4543	0.3067	1.4543	1.2060
No log	5.8462	304	1.4456	0.2839	1.4456	1.2023
No log	5.8846	306	1.4266	0.2289	1.4266	1.1944
No log	5.9231	308	1.5612	0.3086	1.5612	1.2495
No log	5.9615	310	1.6637	0.2804	1.6637	1.2898
No log	6.0	312	1.6812	0.2804	1.6812	1.2966
No log	6.0385	314	1.5745	0.2839	1.5745	1.2548
No log	6.0769	316	1.3974	0.1283	1.3974	1.1821
No log	6.1154	318	1.3718	0.1345	1.3718	1.1712
No log	6.1538	320	1.5212	0.3005	1.5212	1.2334
No log	6.1923	322	1.6663	0.3219	1.6663	1.2909
No log	6.2308	324	1.8452	0.1690	1.8452	1.3584
No log	6.2692	326	1.7445	0.2925	1.7445	1.3208
No log	6.3077	328	1.4683	0.3123	1.4683	1.2117
No log	6.3462	330	1.4114	0.3005	1.4114	1.1880
No log	6.3846	332	1.4989	0.2325	1.4989	1.2243
No log	6.4231	334	1.5740	0.2181	1.5740	1.2546
No log	6.4615	336	1.7186	0.1634	1.7186	1.3109
No log	6.5	338	1.6793	0.1918	1.6793	1.2959
No log	6.5385	340	1.6079	0.2620	1.6079	1.2680
No log	6.5769	342	1.5177	0.2685	1.5177	1.2319
No log	6.6154	344	1.5262	0.2863	1.5262	1.2354
No log	6.6538	346	1.4679	0.2574	1.4679	1.2116
No log	6.6923	348	1.4334	0.2024	1.4334	1.1973
No log	6.7308	350	1.5757	0.3086	1.5757	1.2553
No log	6.7692	352	1.5696	0.3086	1.5696	1.2528
No log	6.8077	354	1.3530	0.1891	1.3530	1.1632
No log	6.8462	356	1.2917	0.1753	1.2917	1.1365
No log	6.8846	358	1.4114	0.3392	1.4114	1.1880
No log	6.9231	360	1.6789	0.3060	1.6789	1.2957
No log	6.9615	362	1.9185	0.1817	1.9185	1.3851
No log	7.0	364	1.8987	0.1631	1.8987	1.3779
No log	7.0385	366	1.6665	0.2867	1.6665	1.2909
No log	7.0769	368	1.3225	0.1345	1.3225	1.1500
No log	7.1154	370	1.1993	0.2348	1.1993	1.0951
No log	7.1538	372	1.2543	0.2195	1.2543	1.1200
No log	7.1923	374	1.4580	0.2289	1.4580	1.2075
No log	7.2308	376	1.6235	0.3542	1.6235	1.2742
No log	7.2692	378	1.6327	0.3552	1.6327	1.2778
No log	7.3077	380	1.3803	0.2457	1.3803	1.1749
No log	7.3462	382	1.2658	0.2337	1.2658	1.1251
No log	7.3846	384	1.3206	0.2589	1.3206	1.1492
No log	7.4231	386	1.4822	0.3418	1.4822	1.2174
No log	7.4615	388	1.4170	0.3188	1.4170	1.1904
No log	7.5	390	1.2315	0.2278	1.2315	1.1097
No log	7.5385	392	1.1371	0.1902	1.1371	1.0664
No log	7.5769	394	1.1474	0.1902	1.1474	1.0712
No log	7.6154	396	1.2719	0.2195	1.2719	1.1278
No log	7.6538	398	1.4498	0.2632	1.4498	1.2041
No log	7.6923	400	1.4266	0.3188	1.4266	1.1944
No log	7.7308	402	1.3591	0.3309	1.3591	1.1658
No log	7.7692	404	1.2229	0.2173	1.2229	1.1059
No log	7.8077	406	1.2564	0.2438	1.2564	1.1209
No log	7.8462	408	1.5289	0.3829	1.5289	1.2365
No log	7.8846	410	1.7716	0.2675	1.7716	1.3310
No log	7.9231	412	1.7815	0.2675	1.7815	1.3347
No log	7.9615	414	1.6823	0.2796	1.6823	1.2970
No log	8.0	416	1.5571	0.3345	1.5571	1.2478
No log	8.0385	418	1.3910	0.2065	1.3910	1.1794
No log	8.0769	420	1.3876	0.2065	1.3876	1.1780
No log	8.1154	422	1.4934	0.2424	1.4934	1.2220
No log	8.1538	424	1.4463	0.2325	1.4463	1.2026
No log	8.1923	426	1.4514	0.2359	1.4514	1.2047
No log	8.2308	428	1.6087	0.3331	1.6087	1.2683
No log	8.2692	430	1.6389	0.2826	1.6389	1.2802
No log	8.3077	432	1.5893	0.3345	1.5893	1.2607
No log	8.3462	434	1.6989	0.2540	1.6989	1.3034
No log	8.3846	436	1.5639	0.2782	1.5639	1.2506
No log	8.4231	438	1.2895	0.2424	1.2895	1.1356
No log	8.4615	440	1.1499	0.2061	1.1499	1.0723
No log	8.5	442	1.1499	0.2061	1.1499	1.0723
No log	8.5385	444	1.2333	0.1902	1.2333	1.1105
No log	8.5769	446	1.4366	0.2024	1.4366	1.1986
No log	8.6154	448	1.7109	0.2515	1.7109	1.3080
No log	8.6538	450	1.7249	0.2366	1.7249	1.3134
No log	8.6923	452	1.4976	0.2375	1.4976	1.2238
No log	8.7308	454	1.1887	0.2195	1.1887	1.0903
No log	8.7692	456	1.1037	0.1767	1.1037	1.0506
No log	8.8077	458	1.1118	0.1961	1.1118	1.0544
No log	8.8462	460	1.2242	0.3094	1.2242	1.1065
No log	8.8846	462	1.5120	0.2217	1.5120	1.2297
No log	8.9231	464	1.6083	0.2685	1.6083	1.2682
No log	8.9615	466	1.5203	0.1929	1.5203	1.2330
No log	9.0	468	1.4427	0.1796	1.4427	1.2011
No log	9.0385	470	1.3994	0.2163	1.3994	1.1830
No log	9.0769	472	1.4155	0.2424	1.4155	1.1897
No log	9.1154	474	1.4564	0.1886	1.4564	1.2068
No log	9.1538	476	1.4230	0.2163	1.4230	1.1929
No log	9.1923	478	1.3376	0.2586	1.3376	1.1565
No log	9.2308	480	1.2084	0.1991	1.2084	1.0993
No log	9.2692	482	1.1361	0.1952	1.1361	1.0659
No log	9.3077	484	1.1309	0.2291	1.1309	1.0634
No log	9.3462	486	1.2731	0.2586	1.2731	1.1283
No log	9.3846	488	1.4885	0.3634	1.4885	1.2201
No log	9.4231	490	1.6715	0.3248	1.6715	1.2929
No log	9.4615	492	1.7728	0.2493	1.7728	1.3315
No log	9.5	494	1.6725	0.3234	1.6725	1.2932
No log	9.5385	496	1.4685	0.2550	1.4685	1.2118
No log	9.5769	498	1.3466	0.2348	1.3466	1.1604
0.3719	9.6154	500	1.3300	0.2348	1.3300	1.1533
0.3719	9.6538	502	1.4211	0.2761	1.4211	1.1921
0.3719	9.6923	504	1.5783	0.1843	1.5783	1.2563
0.3719	9.7308	506	1.7198	0.2515	1.7198	1.3114
0.3719	9.7692	508	1.7220	0.1987	1.7220	1.3122
0.3719	9.8077	510	1.5891	0.2009	1.5891	1.2606
0.3719	9.8462	512	1.3866	0.1219	1.3866	1.1776
0.3719	9.8846	514	1.2741	0.1637	1.2741	1.1288
0.3719	9.9231	516	1.2680	0.1637	1.2680	1.1261

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1