ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2250
• Qwk: 0.1744
• Mse: 1.2250
• Rmse: 1.1068

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	4.2347	0.0178	4.2347	2.0578
No log	0.1111	4	2.3514	0.0462	2.3514	1.5334
No log	0.1667	6	1.8930	-0.0082	1.8930	1.3759
No log	0.2222	8	1.1959	0.1979	1.1959	1.0935
No log	0.2778	10	1.2496	0.0701	1.2496	1.1178
No log	0.3333	12	1.3892	-0.0296	1.3892	1.1787
No log	0.3889	14	1.3074	-0.0858	1.3074	1.1434
No log	0.4444	16	1.1922	0.0850	1.1922	1.0919
No log	0.5	18	1.1243	0.1881	1.1243	1.0603
No log	0.5556	20	1.1225	0.0604	1.1225	1.0595
No log	0.6111	22	1.1062	0.0445	1.1062	1.0517
No log	0.6667	24	1.0935	0.1076	1.0935	1.0457
No log	0.7222	26	1.0925	0.2365	1.0925	1.0452
No log	0.7778	28	1.1041	0.1997	1.1041	1.0508
No log	0.8333	30	1.1243	0.2100	1.1243	1.0603
No log	0.8889	32	1.1332	0.1805	1.1332	1.0645
No log	0.9444	34	1.0906	0.2366	1.0906	1.0443
No log	1.0	36	1.0628	0.1935	1.0628	1.0309
No log	1.0556	38	1.0671	0.1447	1.0671	1.0330
No log	1.1111	40	1.0835	0.0385	1.0835	1.0409
No log	1.1667	42	1.0947	0.0574	1.0947	1.0463
No log	1.2222	44	1.1340	0.0111	1.1340	1.0649
No log	1.2778	46	1.1528	0.0884	1.1528	1.0737
No log	1.3333	48	1.0994	0.1101	1.0994	1.0485
No log	1.3889	50	1.0905	0.0293	1.0905	1.0443
No log	1.4444	52	1.1743	0.0160	1.1743	1.0837
No log	1.5	54	1.1934	0.1770	1.1934	1.0924
No log	1.5556	56	1.2113	0.1770	1.2113	1.1006
No log	1.6111	58	1.3160	0.2395	1.3160	1.1472
No log	1.6667	60	1.4909	0.1892	1.4909	1.2210
No log	1.7222	62	1.4066	0.2863	1.4066	1.1860
No log	1.7778	64	1.2915	0.2915	1.2915	1.1365
No log	1.8333	66	1.5801	0.1871	1.5801	1.2570
No log	1.8889	68	1.9347	0.1487	1.9347	1.3909
No log	1.9444	70	1.8137	0.1559	1.8137	1.3467
No log	2.0	72	1.5147	0.2488	1.5147	1.2307
No log	2.0556	74	1.3057	0.3277	1.3057	1.1427
No log	2.1111	76	1.4478	0.2406	1.4478	1.2032
No log	2.1667	78	1.6012	0.2606	1.6012	1.2654
No log	2.2222	80	1.5243	0.2117	1.5243	1.2346
No log	2.2778	82	1.4949	0.0981	1.4949	1.2227
No log	2.3333	84	1.4649	0.0694	1.4649	1.2103
No log	2.3889	86	1.3065	0.1407	1.3065	1.1430
No log	2.4444	88	1.1106	0.1265	1.1106	1.0539
No log	2.5	90	1.0748	0.0987	1.0748	1.0367
No log	2.5556	92	1.2048	0.2065	1.2048	1.0976
No log	2.6111	94	1.5209	0.2391	1.5209	1.2332
No log	2.6667	96	1.6984	0.2317	1.6984	1.3032
No log	2.7222	98	1.7303	0.1871	1.7303	1.3154
No log	2.7778	100	1.7487	0.2007	1.7487	1.3224
No log	2.8333	102	1.6528	0.2338	1.6528	1.2856
No log	2.8889	104	1.7133	0.2007	1.7133	1.3089
No log	2.9444	106	1.6951	0.2007	1.6951	1.3020
No log	3.0	108	1.8916	0.1925	1.8916	1.3754
No log	3.0556	110	1.8488	0.1964	1.8488	1.3597
No log	3.1111	112	1.4253	0.2117	1.4253	1.1939
No log	3.1667	114	1.2688	0.2132	1.2688	1.1264
No log	3.2222	116	1.4534	0.2117	1.4534	1.2056
No log	3.2778	118	1.6753	0.2566	1.6753	1.2943
No log	3.3333	120	1.6257	0.2525	1.6257	1.2750
No log	3.3889	122	1.3507	0.1744	1.3507	1.1622
No log	3.4444	124	1.1826	0.0	1.1826	1.0875
No log	3.5	126	1.1362	0.0	1.1362	1.0659
No log	3.5556	128	1.2472	0.1407	1.2472	1.1168
No log	3.6111	130	1.5014	0.2221	1.5014	1.2253
No log	3.6667	132	1.6331	0.2644	1.6331	1.2779
No log	3.7222	134	1.8263	0.2236	1.8263	1.3514
No log	3.7778	136	1.7427	0.2296	1.7427	1.3201
No log	3.8333	138	1.4255	0.1892	1.4255	1.1939
No log	3.8889	140	1.2617	0.2184	1.2617	1.1232
No log	3.9444	142	1.3416	0.2239	1.3416	1.1583
No log	4.0	144	1.4343	0.2292	1.4343	1.1976
No log	4.0556	146	1.4568	0.1892	1.4568	1.2070
No log	4.1111	148	1.5533	0.1950	1.5533	1.2463
No log	4.1667	150	1.5806	0.2005	1.5806	1.2572
No log	4.2222	152	1.4626	0.1898	1.4626	1.2094
No log	4.2778	154	1.4611	0.2184	1.4611	1.2087
No log	4.3333	156	1.5823	0.2239	1.5823	1.2579
No log	4.3889	158	1.5639	0.2170	1.5639	1.2506
No log	4.4444	160	1.4504	0.1958	1.4504	1.2043
No log	4.5	162	1.4448	0.2239	1.4448	1.2020
No log	4.5556	164	1.4404	0.2239	1.4404	1.2001
No log	4.6111	166	1.6256	0.2110	1.6256	1.2750
No log	4.6667	168	1.8001	0.2007	1.8001	1.3417
No log	4.7222	170	1.7353	0.2053	1.7353	1.3173
No log	4.7778	172	1.7464	0.2565	1.7464	1.3215
No log	4.8333	174	1.7941	0.2494	1.7941	1.3394
No log	4.8889	176	2.0076	0.1659	2.0076	1.4169
No log	4.9444	178	2.0607	0.1442	2.0607	1.4355
No log	5.0	180	1.8517	0.2299	1.8517	1.3608
No log	5.0556	182	1.5860	0.2906	1.5860	1.2594
No log	5.1111	184	1.4997	0.2806	1.4997	1.2246
No log	5.1667	186	1.6398	0.2806	1.6398	1.2805
No log	5.2222	188	1.5548	0.2221	1.5548	1.2469
No log	5.2778	190	1.4138	0.1703	1.4138	1.1890
No log	5.3333	192	1.3033	0.1486	1.3033	1.1416
No log	5.3889	194	1.2795	0.1407	1.2795	1.1311
No log	5.4444	196	1.3314	0.1486	1.3314	1.1539
No log	5.5	198	1.5591	0.2170	1.5591	1.2486
No log	5.5556	200	1.8320	0.2565	1.8320	1.3535
No log	5.6111	202	1.9113	0.2393	1.9113	1.3825
No log	5.6667	204	1.7855	0.2784	1.7855	1.3362
No log	5.7222	206	1.5078	0.3177	1.5078	1.2279
No log	5.7778	208	1.4427	0.2974	1.4427	1.2011
No log	5.8333	210	1.6385	0.3123	1.6385	1.2801
No log	5.8889	212	1.5998	0.3066	1.5998	1.2648
No log	5.9444	214	1.3835	0.2568	1.3835	1.1762
No log	6.0	216	1.2610	0.2372	1.2610	1.1229
No log	6.0556	218	1.3240	0.2372	1.3240	1.1506
No log	6.1111	220	1.3802	0.2184	1.3802	1.1748
No log	6.1667	222	1.4040	0.2522	1.4040	1.1849
No log	6.2222	224	1.4605	0.2611	1.4605	1.2085
No log	6.2778	226	1.5742	0.3355	1.5742	1.2547
No log	6.3333	228	1.8262	0.2530	1.8262	1.3514
No log	6.3889	230	1.9274	0.1683	1.9274	1.3883
No log	6.4444	232	1.8019	0.2488	1.8019	1.3424
No log	6.5	234	1.5010	0.1814	1.5010	1.2251
No log	6.5556	236	1.2624	0.0	1.2624	1.1235
No log	6.6111	238	1.1931	0.0	1.1931	1.0923
No log	6.6667	240	1.2121	0.0	1.2121	1.1010
No log	6.7222	242	1.1919	0.0	1.1919	1.0917
No log	6.7778	244	1.2925	0.2065	1.2925	1.1369
No log	6.8333	246	1.4918	0.2292	1.4918	1.2214
No log	6.8889	248	1.5433	0.2270	1.5433	1.2423
No log	6.9444	250	1.3716	0.2709	1.3716	1.1711
No log	7.0	252	1.2533	0.2149	1.2533	1.1195
No log	7.0556	254	1.2235	0.2229	1.2235	1.1061
No log	7.1111	256	1.3716	0.2568	1.3716	1.1712
No log	7.1667	258	1.6389	0.2906	1.6389	1.2802
No log	7.2222	260	1.6949	0.2906	1.6949	1.3019
No log	7.2778	262	1.5127	0.2611	1.5127	1.2299
No log	7.3333	264	1.3861	0.2474	1.3861	1.1773
No log	7.3889	266	1.4063	0.2752	1.4063	1.1859
No log	7.4444	268	1.4721	0.2752	1.4721	1.2133
No log	7.5	270	1.5586	0.3148	1.5586	1.2484
No log	7.5556	272	1.7267	0.3259	1.7267	1.3141
No log	7.6111	274	1.6993	0.3259	1.6993	1.3036
No log	7.6667	276	1.5230	0.2906	1.5230	1.2341
No log	7.7222	278	1.3963	0.2752	1.3963	1.1816
No log	7.7778	280	1.4041	0.2793	1.4041	1.1849
No log	7.8333	282	1.4696	0.2653	1.4696	1.2123
No log	7.8889	284	1.6358	0.2681	1.6358	1.2790
No log	7.9444	286	1.8184	0.2317	1.8184	1.3485
No log	8.0	288	1.9184	0.2093	1.9184	1.3851
No log	8.0556	290	1.7969	0.2457	1.7969	1.3405
No log	8.1111	292	1.5374	0.3273	1.5374	1.2399
No log	8.1667	294	1.3517	0.1814	1.3517	1.1626
No log	8.2222	296	1.2804	0.0	1.2804	1.1315
No log	8.2778	298	1.2074	0.0	1.2074	1.0988
No log	8.3333	300	1.2274	0.0781	1.2274	1.1079
No log	8.3889	302	1.3085	0.1486	1.3085	1.1439
No log	8.4444	304	1.4758	0.3018	1.4758	1.2148
No log	8.5	306	1.6443	0.2566	1.6443	1.2823
No log	8.5556	308	1.6170	0.2733	1.6170	1.2716
No log	8.6111	310	1.4916	0.2170	1.4916	1.2213
No log	8.6667	312	1.3154	0.1769	1.3154	1.1469
No log	8.7222	314	1.2469	0.1449	1.2469	1.1167
No log	8.7778	316	1.2785	0.1744	1.2785	1.1307
No log	8.8333	318	1.3461	0.1814	1.3461	1.1602
No log	8.8889	320	1.3557	0.2126	1.3557	1.1644
No log	8.9444	322	1.3837	0.2126	1.3837	1.1763
No log	9.0	324	1.4581	0.2793	1.4581	1.2075
No log	9.0556	326	1.6018	0.2644	1.6018	1.2656
No log	9.1111	328	1.6226	0.2644	1.6226	1.2738
No log	9.1667	330	1.5570	0.2733	1.5570	1.2478
No log	9.2222	332	1.4244	0.2062	1.4244	1.1935
No log	9.2778	334	1.3184	0.1703	1.3184	1.1482
No log	9.3333	336	1.2530	0.1142	1.2530	1.1194
No log	9.3889	338	1.2781	0.1142	1.2781	1.1305
No log	9.4444	340	1.2714	0.1744	1.2714	1.1276
No log	9.5	342	1.2905	0.2126	1.2905	1.1360
No log	9.5556	344	1.3631	0.2424	1.3631	1.1675
No log	9.6111	346	1.5162	0.3329	1.5162	1.2313
No log	9.6667	348	1.6879	0.2527	1.6879	1.2992
No log	9.7222	350	1.7054	0.2527	1.7054	1.3059
No log	9.7778	352	1.5825	0.3177	1.5825	1.2580
No log	9.8333	354	1.5308	0.3148	1.5308	1.2372
No log	9.8889	356	1.5537	0.3177	1.5537	1.2465
No log	9.9444	358	1.6063	0.3006	1.6063	1.2674
No log	10.0	360	1.5881	0.3086	1.5881	1.2602
No log	10.0556	362	1.5822	0.2611	1.5822	1.2579
No log	10.1111	364	1.6080	0.2611	1.6080	1.2681
No log	10.1667	366	1.5130	0.2474	1.5130	1.2300
No log	10.2222	368	1.3900	0.2126	1.3900	1.1790
No log	10.2778	370	1.3741	0.2752	1.3741	1.1722
No log	10.3333	372	1.4150	0.3052	1.4150	1.1895
No log	10.3889	374	1.4643	0.2869	1.4643	1.2101
No log	10.4444	376	1.5518	0.2806	1.5518	1.2457
No log	10.5	378	1.5725	0.2770	1.5725	1.2540
No log	10.5556	380	1.4998	0.2733	1.4998	1.2247
No log	10.6111	382	1.4022	0.2474	1.4022	1.1842
No log	10.6667	384	1.3710	0.2474	1.3710	1.1709
No log	10.7222	386	1.4385	0.2752	1.4385	1.1994
No log	10.7778	388	1.5656	0.2752	1.5656	1.2512
No log	10.8333	390	1.6074	0.2752	1.6074	1.2678
No log	10.8889	392	1.6603	0.3117	1.6603	1.2885
No log	10.9444	394	1.6436	0.2906	1.6436	1.2820
No log	11.0	396	1.4657	0.2832	1.4657	1.2107
No log	11.0556	398	1.4037	0.2611	1.4037	1.1848
No log	11.1111	400	1.4878	0.3177	1.4878	1.2198
No log	11.1667	402	1.6798	0.3259	1.6798	1.2961
No log	11.2222	404	1.8218	0.2703	1.8218	1.3498
No log	11.2778	406	1.7425	0.2379	1.7425	1.3200
No log	11.3333	408	1.5668	0.2522	1.5668	1.2517
No log	11.3889	410	1.5017	0.2424	1.5017	1.2254
No log	11.4444	412	1.4220	0.2372	1.4220	1.1925
No log	11.5	414	1.3755	0.2424	1.3755	1.1728
No log	11.5556	416	1.3567	0.2126	1.3567	1.1648
No log	11.6111	418	1.3633	0.2126	1.3633	1.1676
No log	11.6667	420	1.4167	0.2474	1.4167	1.1902
No log	11.7222	422	1.4811	0.2474	1.4811	1.2170
No log	11.7778	424	1.4536	0.2474	1.4536	1.2057
No log	11.8333	426	1.3991	0.2474	1.3991	1.1828
No log	11.8889	428	1.3759	0.2184	1.3759	1.1730
No log	11.9444	430	1.3766	0.2793	1.3766	1.1733
No log	12.0	432	1.3520	0.2752	1.3520	1.1628
No log	12.0556	434	1.3754	0.3018	1.3754	1.1728
No log	12.1111	436	1.4015	0.3052	1.4015	1.1838
No log	12.1667	438	1.3084	0.2474	1.3084	1.1439
No log	12.2222	440	1.2154	0.1744	1.2154	1.1025
No log	12.2778	442	1.1901	0.1407	1.1901	1.0909
No log	12.3333	444	1.2020	0.1407	1.2020	1.0964
No log	12.3889	446	1.3042	0.2424	1.3042	1.1420
No log	12.4444	448	1.3555	0.2752	1.3555	1.1643
No log	12.5	450	1.3855	0.2752	1.3855	1.1771
No log	12.5556	452	1.4128	0.2906	1.4128	1.1886
No log	12.6111	454	1.5439	0.3233	1.5439	1.2425
No log	12.6667	456	1.5905	0.3233	1.5905	1.2611
No log	12.7222	458	1.6415	0.2770	1.6415	1.2812
No log	12.7778	460	1.5969	0.2694	1.5969	1.2637
No log	12.8333	462	1.5242	0.3052	1.5242	1.2346
No log	12.8889	464	1.4712	0.3018	1.4712	1.2129
No log	12.9444	466	1.4476	0.3052	1.4476	1.2032
No log	13.0	468	1.6012	0.2448	1.6012	1.2654
No log	13.0556	470	1.6633	0.2527	1.6633	1.2897
No log	13.1111	472	1.5398	0.2406	1.5398	1.2409
No log	13.1667	474	1.4337	0.2391	1.4337	1.1974
No log	13.2222	476	1.3125	0.1744	1.3125	1.1456
No log	13.2778	478	1.2563	0.1142	1.2563	1.1208
No log	13.3333	480	1.2541	0.1142	1.2541	1.1198
No log	13.3889	482	1.2664	0.1370	1.2664	1.1254
No log	13.4444	484	1.3285	0.2522	1.3285	1.1526
No log	13.5	486	1.4267	0.3052	1.4267	1.1944
No log	13.5556	488	1.5504	0.3006	1.5504	1.2452
No log	13.6111	490	1.5665	0.3006	1.5665	1.2516
No log	13.6667	492	1.4979	0.2770	1.4979	1.2239
No log	13.7222	494	1.5061	0.3006	1.5061	1.2272
No log	13.7778	496	1.3849	0.2474	1.3849	1.1768
No log	13.8333	498	1.3469	0.2787	1.3469	1.1605
0.255	13.8889	500	1.2803	0.2656	1.2803	1.1315
0.255	13.9444	502	1.2420	0.2574	1.2420	1.1144
0.255	14.0	504	1.2970	0.2952	1.2970	1.1388
0.255	14.0556	506	1.3539	0.3140	1.3539	1.1636
0.255	14.1111	508	1.3830	0.2474	1.3830	1.1760
0.255	14.1667	510	1.4386	0.2752	1.4386	1.1994
0.255	14.2222	512	1.5021	0.3260	1.5021	1.2256
0.255	14.2778	514	1.5443	0.3084	1.5443	1.2427
0.255	14.3333	516	1.5529	0.3084	1.5529	1.2462
0.255	14.3889	518	1.4252	0.2845	1.4252	1.1938
0.255	14.4444	520	1.3692	0.2809	1.3692	1.1701
0.255	14.5	522	1.3602	0.2771	1.3602	1.1663
0.255	14.5556	524	1.4198	0.2987	1.4198	1.1916
0.255	14.6111	526	1.4141	0.2793	1.4141	1.1892
0.255	14.6667	528	1.4135	0.2793	1.4135	1.1889
0.255	14.7222	530	1.3679	0.2987	1.3679	1.1696
0.255	14.7778	532	1.3144	0.2987	1.3144	1.1465
0.255	14.8333	534	1.3224	0.2672	1.3224	1.1500
0.255	14.8889	536	1.3170	0.2672	1.3170	1.1476
0.255	14.9444	538	1.3568	0.3392	1.3568	1.1648
0.255	15.0	540	1.4357	0.3302	1.4357	1.1982
0.255	15.0556	542	1.4045	0.3018	1.4045	1.1851
0.255	15.1111	544	1.3011	0.1814	1.3011	1.1406
0.255	15.1667	546	1.2162	0.0	1.2162	1.1028
0.255	15.2222	548	1.1933	0.0	1.1933	1.0924
0.255	15.2778	550	1.2696	0.1407	1.2696	1.1268
0.255	15.3333	552	1.3961	0.2752	1.3961	1.1816
0.255	15.3889	554	1.4903	0.3052	1.4903	1.2208
0.255	15.4444	556	1.4804	0.3052	1.4804	1.2167
0.255	15.5	558	1.4294	0.2793	1.4294	1.1956
0.255	15.5556	560	1.3984	0.2793	1.3984	1.1826
0.255	15.6111	562	1.3260	0.2752	1.3260	1.1515
0.255	15.6667	564	1.4184	0.3052	1.4184	1.1910
0.255	15.7222	566	1.4908	0.3018	1.4908	1.2210
0.255	15.7778	568	1.4558	0.2752	1.4558	1.2065
0.255	15.8333	570	1.3599	0.1814	1.3599	1.1662
0.255	15.8889	572	1.2775	0.0401	1.2775	1.1303
0.255	15.9444	574	1.2149	0.0401	1.2149	1.1022
0.255	16.0	576	1.2120	0.0401	1.2120	1.1009
0.255	16.0556	578	1.2250	0.1744	1.2250	1.1068

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1