ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4686
• Qwk: 0.1031
• Mse: 1.4686
• Rmse: 1.2118

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0263	2	4.8851	-0.0132	4.8851	2.2102
No log	0.0526	4	2.9907	-0.0148	2.9907	1.7294
No log	0.0789	6	2.0072	-0.0575	2.0072	1.4168
No log	0.1053	8	2.0721	-0.0271	2.0721	1.4395
No log	0.1316	10	2.4183	-0.0943	2.4183	1.5551
No log	0.1579	12	2.1304	-0.0299	2.1304	1.4596
No log	0.1842	14	2.0012	-0.0828	2.0012	1.4147
No log	0.2105	16	1.7733	-0.0027	1.7733	1.3316
No log	0.2368	18	1.9093	-0.0289	1.9093	1.3818
No log	0.2632	20	2.2124	-0.0031	2.2124	1.4874
No log	0.2895	22	2.0784	-0.0364	2.0784	1.4417
No log	0.3158	24	1.7599	-0.0441	1.7599	1.3266
No log	0.3421	26	1.5603	-0.1535	1.5603	1.2491
No log	0.3684	28	1.3814	0.1173	1.3814	1.1753
No log	0.3947	30	1.3457	0.0277	1.3457	1.1600
No log	0.4211	32	1.3427	0.0153	1.3427	1.1588
No log	0.4474	34	1.3263	0.0527	1.3263	1.1517
No log	0.4737	36	1.2942	0.1009	1.2942	1.1377
No log	0.5	38	1.4005	0.0389	1.4005	1.1834
No log	0.5263	40	1.6672	-0.0686	1.6672	1.2912
No log	0.5526	42	1.7183	-0.0300	1.7183	1.3109
No log	0.5789	44	1.4596	-0.0407	1.4596	1.2081
No log	0.6053	46	1.3488	0.0490	1.3488	1.1614
No log	0.6316	48	1.3599	0.0020	1.3599	1.1662
No log	0.6579	50	1.3950	-0.0288	1.3950	1.1811
No log	0.6842	52	1.3506	-0.0684	1.3506	1.1622
No log	0.7105	54	1.3231	0.0847	1.3231	1.1503
No log	0.7368	56	1.2950	0.0374	1.2950	1.1380
No log	0.7632	58	1.2976	0.0454	1.2976	1.1391
No log	0.7895	60	1.3856	0.0454	1.3856	1.1771
No log	0.8158	62	1.4290	0.0454	1.4290	1.1954
No log	0.8421	64	1.3852	0.0454	1.3852	1.1770
No log	0.8684	66	1.3719	0.0454	1.3719	1.1713
No log	0.8947	68	1.3373	0.0077	1.3373	1.1564
No log	0.9211	70	1.3130	0.0085	1.3130	1.1459
No log	0.9474	72	1.3769	0.0389	1.3769	1.1734
No log	0.9737	74	1.5559	-0.0422	1.5559	1.2473
No log	1.0	76	1.7012	0.0124	1.7012	1.3043
No log	1.0263	78	1.6587	-0.0267	1.6587	1.2879
No log	1.0526	80	1.4116	0.0889	1.4116	1.1881
No log	1.0789	82	1.3755	0.0889	1.3755	1.1728
No log	1.1053	84	1.2906	0.1016	1.2906	1.1360
No log	1.1316	86	1.3066	0.1085	1.3066	1.1431
No log	1.1579	88	1.2667	0.0751	1.2667	1.1255
No log	1.1842	90	1.2047	0.1180	1.2047	1.0976
No log	1.2105	92	1.1765	0.1180	1.1765	1.0847
No log	1.2368	94	1.1556	0.1180	1.1556	1.0750
No log	1.2632	96	1.1572	0.1180	1.1572	1.0757
No log	1.2895	98	1.1547	0.1180	1.1547	1.0746
No log	1.3158	100	1.1378	0.2043	1.1378	1.0667
No log	1.3421	102	1.1700	0.3038	1.1700	1.0816
No log	1.3684	104	1.1941	0.2234	1.1941	1.0928
No log	1.3947	106	1.1281	0.2551	1.1281	1.0621
No log	1.4211	108	1.1819	0.2481	1.1819	1.0872
No log	1.4474	110	1.2418	0.2808	1.2418	1.1144
No log	1.4737	112	1.2675	0.2808	1.2675	1.1258
No log	1.5	114	1.1728	0.2889	1.1728	1.0830
No log	1.5263	116	1.2325	0.2765	1.2325	1.1102
No log	1.5526	118	1.3276	0.2798	1.3276	1.1522
No log	1.5789	120	1.3217	0.2354	1.3217	1.1497
No log	1.6053	122	1.4303	0.2226	1.4303	1.1959
No log	1.6316	124	1.2930	0.2270	1.2930	1.1371
No log	1.6579	126	1.2189	0.2076	1.2189	1.1040
No log	1.6842	128	1.2026	0.1565	1.2026	1.0966
No log	1.7105	130	1.1998	0.2232	1.1998	1.0953
No log	1.7368	132	1.3598	0.2885	1.3598	1.1661
No log	1.7632	134	1.5421	0.2932	1.5421	1.2418
No log	1.7895	136	1.7672	0.2259	1.7672	1.3294
No log	1.8158	138	1.4601	0.2595	1.4601	1.2084
No log	1.8421	140	1.3453	0.3084	1.3453	1.1599
No log	1.8684	142	1.5221	0.2430	1.5221	1.2337
No log	1.8947	144	1.4859	0.2647	1.4859	1.2190
No log	1.9211	146	1.3292	0.2829	1.3292	1.1529
No log	1.9474	148	1.4269	0.2713	1.4269	1.1945
No log	1.9737	150	1.4588	0.2767	1.4588	1.2078
No log	2.0	152	1.6991	0.1667	1.6991	1.3035
No log	2.0263	154	1.7800	0.1567	1.7800	1.3342
No log	2.0526	156	1.6132	0.2039	1.6132	1.2701
No log	2.0789	158	1.4558	0.1873	1.4558	1.2066
No log	2.1053	160	1.4521	0.1624	1.4521	1.2050
No log	2.1316	162	1.5739	0.2047	1.5739	1.2545
No log	2.1579	164	1.8498	0.0855	1.8498	1.3601
No log	2.1842	166	1.8233	0.1368	1.8233	1.3503
No log	2.2105	168	1.5664	0.1436	1.5664	1.2516
No log	2.2368	170	1.5659	0.1386	1.5659	1.2514
No log	2.2632	172	1.4610	0.1851	1.4610	1.2087
No log	2.2895	174	1.4177	0.1913	1.4177	1.1907
No log	2.3158	176	1.5003	0.1901	1.5003	1.2249
No log	2.3421	178	1.4856	0.0679	1.4856	1.2188
No log	2.3684	180	1.4972	0.0503	1.4972	1.2236
No log	2.3947	182	1.5497	0.0317	1.5497	1.2449
No log	2.4211	184	1.6870	0.2107	1.6870	1.2988
No log	2.4474	186	1.5058	0.2593	1.5058	1.2271
No log	2.4737	188	1.3189	0.1836	1.3189	1.1484
No log	2.5	190	1.3236	0.1965	1.3236	1.1505
No log	2.5263	192	1.5233	0.2647	1.5233	1.2342
No log	2.5526	194	1.8789	0.0903	1.8789	1.3707
No log	2.5789	196	1.8834	0.1197	1.8834	1.3724
No log	2.6053	198	1.7051	0.1882	1.7051	1.3058
No log	2.6316	200	1.4349	0.2798	1.4349	1.1979
No log	2.6579	202	1.3301	0.2173	1.3301	1.1533
No log	2.6842	204	1.4547	0.2589	1.4547	1.2061
No log	2.7105	206	1.8077	0.0978	1.8077	1.3445
No log	2.7368	208	1.9071	0.1439	1.9071	1.3810
No log	2.7632	210	1.7514	0.2132	1.7514	1.3234
No log	2.7895	212	1.3947	0.2172	1.3947	1.1810
No log	2.8158	214	1.3388	0.2895	1.3388	1.1571
No log	2.8421	216	1.5498	0.2521	1.5498	1.2449
No log	2.8684	218	1.6440	0.2435	1.6440	1.2822
No log	2.8947	220	1.6830	0.1987	1.6830	1.2973
No log	2.9211	222	1.6749	0.2310	1.6749	1.2942
No log	2.9474	224	1.7501	0.2644	1.7501	1.3229
No log	2.9737	226	1.5647	0.2047	1.5647	1.2509
No log	3.0	228	1.2637	0.1943	1.2637	1.1242
No log	3.0263	230	1.1896	0.1248	1.1896	1.0907
No log	3.0526	232	1.2066	0.1479	1.2066	1.0985
No log	3.0789	234	1.3473	0.0702	1.3473	1.1607
No log	3.1053	236	1.4450	0.1112	1.4450	1.2021
No log	3.1316	238	1.4481	0.1224	1.4481	1.2034
No log	3.1579	240	1.3795	0.1224	1.3795	1.1745
No log	3.1842	242	1.3726	0.1844	1.3726	1.1716
No log	3.2105	244	1.4714	0.1929	1.4714	1.2130
No log	3.2368	246	1.6233	0.2154	1.6233	1.2741
No log	3.2632	248	1.6507	0.1806	1.6507	1.2848
No log	3.2895	250	1.5341	0.2206	1.5341	1.2386
No log	3.3158	252	1.6395	0.1573	1.6395	1.2804
No log	3.3421	254	1.8683	0.1753	1.8683	1.3669
No log	3.3684	256	1.8419	0.1720	1.8419	1.3572
No log	3.3947	258	1.6424	0.1806	1.6424	1.2816
No log	3.4211	260	1.4208	0.3047	1.4208	1.1920
No log	3.4474	262	1.3073	0.2224	1.3073	1.1434
No log	3.4737	264	1.3487	0.2263	1.3487	1.1613
No log	3.5	266	1.5169	0.2903	1.5169	1.2316
No log	3.5263	268	1.7666	0.1880	1.7666	1.3291
No log	3.5526	270	1.8226	0.1745	1.8226	1.3501
No log	3.5789	272	1.7463	0.1918	1.7463	1.3215
No log	3.6053	274	1.6378	0.2303	1.6378	1.2798
No log	3.6316	276	1.4503	0.2437	1.4503	1.2043
No log	3.6579	278	1.4598	0.2437	1.4598	1.2082
No log	3.6842	280	1.5351	0.2659	1.5351	1.2390
No log	3.7105	282	1.4417	0.2604	1.4417	1.2007
No log	3.7368	284	1.3990	0.2489	1.3990	1.1828
No log	3.7632	286	1.3679	0.2371	1.3679	1.1696
No log	3.7895	288	1.3620	0.2371	1.3620	1.1670
No log	3.8158	290	1.3962	0.3067	1.3962	1.1816
No log	3.8421	292	1.5256	0.2498	1.5256	1.2352
No log	3.8684	294	1.6657	0.2281	1.6657	1.2906
No log	3.8947	296	1.6549	0.2595	1.6549	1.2864
No log	3.9211	298	1.7272	0.2489	1.7272	1.3142
No log	3.9474	300	1.7091	0.2489	1.7091	1.3073
No log	3.9737	302	1.6146	0.2407	1.6146	1.2707
No log	4.0	304	1.6270	0.2348	1.6270	1.2755
No log	4.0263	306	1.4648	0.1112	1.4648	1.2103
No log	4.0526	308	1.3640	0.1943	1.3640	1.1679
No log	4.0789	310	1.4060	0.1892	1.4060	1.1858
No log	4.1053	312	1.6395	0.1960	1.6395	1.2804
No log	4.1316	314	1.6752	0.2220	1.6752	1.2943
No log	4.1579	316	1.5563	0.2009	1.5563	1.2475
No log	4.1842	318	1.4583	0.1667	1.4583	1.2076
No log	4.2105	320	1.3684	0.1517	1.3684	1.1698
No log	4.2368	322	1.4607	0.2020	1.4607	1.2086
No log	4.2632	324	1.7223	0.1987	1.7223	1.3124
No log	4.2895	326	2.0518	0.1282	2.0518	1.4324
No log	4.3158	328	2.1204	0.1282	2.1204	1.4562
No log	4.3421	330	1.9043	0.1363	1.9043	1.3800
No log	4.3684	332	1.5264	0.1667	1.5264	1.2355
No log	4.3947	334	1.3028	0.2051	1.3028	1.1414
No log	4.4211	336	1.2239	0.1541	1.2239	1.1063
No log	4.4474	338	1.2601	0.2108	1.2601	1.1226
No log	4.4737	340	1.4314	0.1670	1.4314	1.1964
No log	4.5	342	1.6757	0.1513	1.6757	1.2945
No log	4.5263	344	1.6963	0.1513	1.6963	1.3024
No log	4.5526	346	1.5997	0.1425	1.5997	1.2648
No log	4.5789	348	1.6011	0.1726	1.6011	1.2654
No log	4.6053	350	1.4858	0.2506	1.4858	1.2189
No log	4.6316	352	1.3162	0.3301	1.3162	1.1472
No log	4.6579	354	1.2322	0.3488	1.2322	1.1101
No log	4.6842	356	1.2758	0.2922	1.2758	1.1295
No log	4.7105	358	1.5321	0.2798	1.5321	1.2378
No log	4.7368	360	1.8383	0.2305	1.8383	1.3558
No log	4.7632	362	1.8182	0.2419	1.8182	1.3484
No log	4.7895	364	1.5644	0.2389	1.5644	1.2508
No log	4.8158	366	1.3859	0.2589	1.3859	1.1772
No log	4.8421	368	1.3680	0.2503	1.3680	1.1696
No log	4.8684	370	1.5570	0.2039	1.5570	1.2478
No log	4.8947	372	1.7779	0.1672	1.7779	1.3334
No log	4.9211	374	1.8266	0.1538	1.8266	1.3515
No log	4.9474	376	1.8625	0.1408	1.8625	1.3647
No log	4.9737	378	1.8944	0.1282	1.8944	1.3764
No log	5.0	380	1.7882	0.0930	1.7882	1.3372
No log	5.0263	382	1.7219	0.1349	1.7219	1.3122
No log	5.0526	384	1.5982	0.2406	1.5982	1.2642
No log	5.0789	386	1.4384	0.2371	1.4384	1.1993
No log	5.1053	388	1.4673	0.2136	1.4673	1.2113
No log	5.1316	390	1.6884	0.1918	1.6884	1.2994
No log	5.1579	392	1.8666	0.1487	1.8666	1.3662
No log	5.1842	394	1.8954	0.2224	1.8954	1.3767
No log	5.2105	396	1.6893	0.1774	1.6893	1.2997
No log	5.2368	398	1.3581	0.2099	1.3581	1.1654
No log	5.2632	400	1.1440	0.2714	1.1440	1.0696
No log	5.2895	402	1.1401	0.2152	1.1401	1.0677
No log	5.3158	404	1.2592	0.2844	1.2592	1.1221
No log	5.3421	406	1.4665	0.2309	1.4665	1.2110
No log	5.3684	408	1.4733	0.2309	1.4733	1.2138
No log	5.3947	410	1.3466	0.2457	1.3466	1.1604
No log	5.4211	412	1.2693	0.2424	1.2693	1.1266
No log	5.4474	414	1.2120	0.1692	1.2120	1.1009
No log	5.4737	416	1.3097	0.2424	1.3097	1.1444
No log	5.5	418	1.3001	0.2122	1.3001	1.1402
No log	5.5263	420	1.3119	0.2844	1.3119	1.1454
No log	5.5526	422	1.4726	0.1802	1.4726	1.2135
No log	5.5789	424	1.6691	0.2051	1.6691	1.2920
No log	5.6053	426	1.8111	0.2469	1.8111	1.3458
No log	5.6316	428	1.6887	0.1810	1.6887	1.2995
No log	5.6579	430	1.4668	0.2213	1.4668	1.2111
No log	5.6842	432	1.3784	0.1889	1.3784	1.1740
No log	5.7105	434	1.3777	0.2278	1.3777	1.1737
No log	5.7368	436	1.5098	0.1171	1.5098	1.2287
No log	5.7632	438	1.6841	0.1953	1.6841	1.2977
No log	5.7895	440	1.6191	0.2220	1.6191	1.2725
No log	5.8158	442	1.4413	0.2115	1.4413	1.2005
No log	5.8421	444	1.2677	0.1943	1.2677	1.1259
No log	5.8684	446	1.2244	0.1479	1.2244	1.1065
No log	5.8947	448	1.2951	0.2097	1.2951	1.1380
No log	5.9211	450	1.4016	0.1517	1.4016	1.1839
No log	5.9474	452	1.5170	0.2751	1.5170	1.2316
No log	5.9737	454	1.6205	0.2682	1.6205	1.2730
No log	6.0	456	1.4929	0.2582	1.4929	1.2219
No log	6.0263	458	1.4541	0.2701	1.4541	1.2058
No log	6.0526	460	1.4679	0.2527	1.4679	1.2115
No log	6.0789	462	1.5391	0.2582	1.5391	1.2406
No log	6.1053	464	1.6035	0.2474	1.6035	1.2663
No log	6.1316	466	1.4821	0.2153	1.4821	1.2174
No log	6.1579	468	1.4110	0.1989	1.4110	1.1879
No log	6.1842	470	1.4389	0.2263	1.4389	1.1996
No log	6.2105	472	1.5165	0.1892	1.5165	1.2315
No log	6.2368	474	1.5246	0.1977	1.5246	1.2348
No log	6.2632	476	1.4924	0.2191	1.4924	1.2217
No log	6.2895	478	1.4428	0.2153	1.4428	1.2011
No log	6.3158	480	1.5600	0.1890	1.5600	1.2490
No log	6.3421	482	1.8269	0.2270	1.8269	1.3516
No log	6.3684	484	1.9170	0.1720	1.9170	1.3845
No log	6.3947	486	1.7239	0.2363	1.7239	1.3130
No log	6.4211	488	1.4413	0.2153	1.4413	1.2005
No log	6.4474	490	1.3406	0.1570	1.3406	1.1579
No log	6.4737	492	1.3547	0.2224	1.3547	1.1639
No log	6.5	494	1.4330	0.2263	1.4330	1.1971
No log	6.5263	496	1.4895	0.1667	1.4895	1.2205
No log	6.5526	498	1.5426	0.2047	1.5426	1.2420
0.3993	6.5789	500	1.4227	0.1935	1.4227	1.1928
0.3993	6.6053	502	1.3660	0.2122	1.3660	1.1687
0.3993	6.6316	504	1.2868	0.2224	1.2868	1.1344
0.3993	6.6579	506	1.3046	0.2224	1.3046	1.1422
0.3993	6.6842	508	1.3489	0.2494	1.3489	1.1614
0.3993	6.7105	510	1.5202	0.2555	1.5202	1.2330
0.3993	6.7368	512	1.6821	0.1845	1.6821	1.2969
0.3993	6.7632	514	1.6585	0.1806	1.6585	1.2878
0.3993	6.7895	516	1.5031	0.1568	1.5031	1.2260
0.3993	6.8158	518	1.4716	0.1031	1.4716	1.2131
0.3993	6.8421	520	1.4686	0.1031	1.4686	1.2118

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1