ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5741
• Qwk: 0.3788
• Mse: 1.5741
• Rmse: 1.2547

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0308	2	6.9911	-0.0056	6.9911	2.6441
No log	0.0615	4	4.7930	0.0658	4.7930	2.1893
No log	0.0923	6	4.0571	-0.0909	4.0571	2.0142
No log	0.1231	8	3.4218	0.0	3.4218	1.8498
No log	0.1538	10	3.1457	0.0252	3.1457	1.7736
No log	0.1846	12	2.5924	0.0403	2.5924	1.6101
No log	0.2154	14	2.0710	0.1955	2.0710	1.4391
No log	0.2462	16	1.8630	0.2264	1.8630	1.3649
No log	0.2769	18	1.7311	0.1538	1.7311	1.3157
No log	0.3077	20	1.7061	0.1165	1.7061	1.3062
No log	0.3385	22	1.6818	0.0784	1.6818	1.2968
No log	0.3692	24	1.5408	0.1165	1.5408	1.2413
No log	0.4	26	1.5833	0.1869	1.5833	1.2583
No log	0.4308	28	1.8492	0.368	1.8492	1.3598
No log	0.4615	30	2.0388	0.1805	2.0388	1.4279
No log	0.4923	32	2.0000	0.2290	2.0000	1.4142
No log	0.5231	34	1.8978	0.3651	1.8978	1.3776
No log	0.5538	36	1.6787	0.2807	1.6787	1.2956
No log	0.5846	38	1.6294	0.1887	1.6294	1.2765
No log	0.6154	40	1.6900	0.1165	1.6900	1.3000
No log	0.6462	42	1.5791	0.1165	1.5791	1.2566
No log	0.6769	44	1.5170	0.1524	1.5170	1.2317
No log	0.7077	46	1.5106	0.2982	1.5106	1.2291
No log	0.7385	48	1.5894	0.3361	1.5894	1.2607
No log	0.7692	50	1.6045	0.3167	1.6045	1.2667
No log	0.8	52	1.4928	0.1869	1.4928	1.2218
No log	0.8308	54	1.6439	0.0784	1.6439	1.2821
No log	0.8615	56	1.8296	0.1308	1.8296	1.3526
No log	0.8923	58	1.8437	0.1667	1.8437	1.3578
No log	0.9231	60	1.6771	0.2832	1.6771	1.2950
No log	0.9538	62	1.7865	0.3053	1.7865	1.3366
No log	0.9846	64	2.3387	0.2158	2.3387	1.5293
No log	1.0154	66	2.3813	0.1702	2.3813	1.5431
No log	1.0462	68	2.0785	0.2941	2.0785	1.4417
No log	1.0769	70	1.7083	0.3231	1.7083	1.3070
No log	1.1077	72	1.4835	0.2832	1.4835	1.2180
No log	1.1385	74	1.4220	0.2222	1.4220	1.1925
No log	1.1692	76	1.3939	0.2727	1.3939	1.1806
No log	1.2	78	1.4066	0.3509	1.4066	1.1860
No log	1.2308	80	1.5278	0.2857	1.5278	1.2361
No log	1.2615	82	1.5005	0.2564	1.5005	1.2250
No log	1.2923	84	1.4522	0.3761	1.4522	1.2051
No log	1.3231	86	1.4722	0.3729	1.4722	1.2134
No log	1.3538	88	1.4620	0.3729	1.4620	1.2091
No log	1.3846	90	1.4697	0.3761	1.4697	1.2123
No log	1.4154	92	1.4973	0.3220	1.4973	1.2236
No log	1.4462	94	1.5718	0.3000	1.5718	1.2537
No log	1.4769	96	1.5046	0.3471	1.5046	1.2266
No log	1.5077	98	1.3251	0.4	1.3251	1.1511
No log	1.5385	100	1.3286	0.2569	1.3286	1.1526
No log	1.5692	102	1.3279	0.3243	1.3279	1.1523
No log	1.6	104	1.3321	0.4138	1.3321	1.1542
No log	1.6308	106	1.3439	0.3363	1.3439	1.1593
No log	1.6615	108	1.3673	0.3243	1.3673	1.1693
No log	1.6923	110	1.4063	0.4068	1.4063	1.1859
No log	1.7231	112	1.5329	0.3158	1.5329	1.2381
No log	1.7538	114	1.6158	0.3802	1.6158	1.2712
No log	1.7846	116	1.6928	0.3306	1.6928	1.3011
No log	1.8154	118	1.6960	0.3306	1.6960	1.3023
No log	1.8462	120	1.8008	0.1681	1.8008	1.3420
No log	1.8769	122	1.9398	0.2812	1.9398	1.3928
No log	1.9077	124	1.8474	0.2791	1.8474	1.3592
No log	1.9385	126	1.7306	0.3622	1.7306	1.3155
No log	1.9692	128	1.4642	0.4132	1.4642	1.2100
No log	2.0	130	1.4595	0.3802	1.4595	1.2081
No log	2.0308	132	1.5279	0.3871	1.5279	1.2361
No log	2.0615	134	1.5417	0.3810	1.5417	1.2417
No log	2.0923	136	1.5469	0.352	1.5469	1.2438
No log	2.1231	138	1.5338	0.352	1.5338	1.2385
No log	2.1538	140	1.4579	0.3934	1.4579	1.2074
No log	2.1846	142	1.3569	0.4274	1.3569	1.1648
No log	2.2154	144	1.3401	0.3967	1.3401	1.1576
No log	2.2462	146	1.3806	0.3967	1.3806	1.1750
No log	2.2769	148	1.4314	0.3577	1.4314	1.1964
No log	2.3077	150	1.4840	0.3360	1.4840	1.2182
No log	2.3385	152	1.6146	0.352	1.6146	1.2707
No log	2.3692	154	1.7382	0.3175	1.7382	1.3184
No log	2.4	156	1.8406	0.2443	1.8406	1.3567
No log	2.4308	158	1.9044	0.2222	1.9044	1.3800
No log	2.4615	160	2.1044	0.1818	2.1044	1.4507
No log	2.4923	162	2.1041	0.1818	2.1041	1.4506
No log	2.5231	164	1.9128	0.2667	1.9128	1.3830
No log	2.5538	166	1.7024	0.3125	1.7024	1.3047
No log	2.5846	168	1.5860	0.3150	1.5860	1.2594
No log	2.6154	170	1.4725	0.3387	1.4725	1.2135
No log	2.6462	172	1.4006	0.3607	1.4006	1.1835
No log	2.6769	174	1.3883	0.4426	1.3883	1.1783
No log	2.7077	176	1.4108	0.4640	1.4108	1.1878
No log	2.7385	178	1.4418	0.3780	1.4418	1.2008
No log	2.7692	180	1.5324	0.3906	1.5324	1.2379
No log	2.8	182	1.6690	0.3359	1.6690	1.2919
No log	2.8308	184	1.7381	0.2815	1.7381	1.3184
No log	2.8615	186	1.7148	0.2815	1.7148	1.3095
No log	2.8923	188	1.6594	0.3030	1.6594	1.2882
No log	2.9231	190	1.6051	0.3256	1.6051	1.2669
No log	2.9538	192	1.4945	0.3967	1.4945	1.2225
No log	2.9846	194	1.4305	0.3636	1.4305	1.1960
No log	3.0154	196	1.4759	0.3802	1.4759	1.2148
No log	3.0462	198	1.6006	0.3438	1.6006	1.2651
No log	3.0769	200	1.7457	0.3433	1.7457	1.3213
No log	3.1077	202	1.7653	0.3066	1.7653	1.3286
No log	3.1385	204	1.6989	0.3759	1.6989	1.3034
No log	3.1692	206	1.6708	0.4	1.6708	1.2926
No log	3.2	208	1.7169	0.3759	1.7169	1.3103
No log	3.2308	210	1.6566	0.3817	1.6566	1.2871
No log	3.2615	212	1.5242	0.3906	1.5242	1.2346
No log	3.2923	214	1.3672	0.3937	1.3672	1.1693
No log	3.3231	216	1.3967	0.3968	1.3967	1.1818
No log	3.3538	218	1.4738	0.4154	1.4738	1.2140
No log	3.3846	220	1.5198	0.4462	1.5198	1.2328
No log	3.4154	222	1.6126	0.3817	1.6126	1.2699
No log	3.4462	224	1.7914	0.3165	1.7914	1.3384
No log	3.4769	226	2.0029	0.2098	2.0029	1.4152
No log	3.5077	228	2.0235	0.2098	2.0235	1.4225
No log	3.5385	230	1.8568	0.2667	1.8568	1.3627
No log	3.5692	232	1.7622	0.3125	1.7622	1.3275
No log	3.6	234	1.7527	0.3125	1.7527	1.3239
No log	3.6308	236	1.7391	0.2946	1.7391	1.3187
No log	3.6615	238	1.7297	0.3053	1.7297	1.3152
No log	3.6923	240	1.7475	0.2901	1.7475	1.3219
No log	3.7231	242	1.6894	0.2791	1.6894	1.2998
No log	3.7538	244	1.5758	0.3307	1.5758	1.2553
No log	3.7846	246	1.5699	0.3125	1.5699	1.2530
No log	3.8154	248	1.5404	0.3125	1.5404	1.2411
No log	3.8462	250	1.5002	0.3968	1.5002	1.2248
No log	3.8769	252	1.5487	0.3721	1.5487	1.2445
No log	3.9077	254	1.6082	0.3788	1.6082	1.2681
No log	3.9385	256	1.5981	0.3664	1.5981	1.2642
No log	3.9692	258	1.5500	0.4	1.5500	1.2450
No log	4.0	260	1.5687	0.3817	1.5687	1.2525
No log	4.0308	262	1.6276	0.3609	1.6276	1.2758
No log	4.0615	264	1.7296	0.2941	1.7296	1.3152
No log	4.0923	266	1.7251	0.2941	1.7251	1.3134
No log	4.1231	268	1.5813	0.3692	1.5813	1.2575
No log	4.1538	270	1.4818	0.4286	1.4818	1.2173
No log	4.1846	272	1.4302	0.4194	1.4302	1.1959
No log	4.2154	274	1.4080	0.4793	1.4080	1.1866
No log	4.2462	276	1.4195	0.4793	1.4195	1.1914
No log	4.2769	278	1.4908	0.4426	1.4908	1.2210
No log	4.3077	280	1.5737	0.4194	1.5737	1.2545
No log	4.3385	282	1.6990	0.3582	1.6990	1.3034
No log	4.3692	284	1.7458	0.3235	1.7458	1.3213
No log	4.4	286	1.6521	0.3308	1.6521	1.2854
No log	4.4308	288	1.6324	0.375	1.6324	1.2777
No log	4.4615	290	1.7254	0.3111	1.7254	1.3135
No log	4.4923	292	1.8048	0.2628	1.8048	1.3434
No log	4.5231	294	1.8557	0.2319	1.8557	1.3622
No log	4.5538	296	1.8748	0.2290	1.8748	1.3692
No log	4.5846	298	1.8964	0.1985	1.8964	1.3771
No log	4.6154	300	1.8797	0.1985	1.8797	1.3710
No log	4.6462	302	1.7169	0.2667	1.7169	1.3103
No log	4.6769	304	1.6016	0.3077	1.6016	1.2655
No log	4.7077	306	1.6141	0.35	1.6141	1.2705
No log	4.7385	308	1.6300	0.3415	1.6300	1.2767
No log	4.7692	310	1.5735	0.3667	1.5735	1.2544
No log	4.8	312	1.5265	0.4138	1.5265	1.2355
No log	4.8308	314	1.5390	0.3667	1.5390	1.2406
No log	4.8615	316	1.6332	0.352	1.6332	1.2780
No log	4.8923	318	1.7343	0.2707	1.7343	1.3169
No log	4.9231	320	1.7802	0.2687	1.7802	1.3342
No log	4.9538	322	1.7205	0.3134	1.7205	1.3117
No log	4.9846	324	1.6250	0.3333	1.6250	1.2748
No log	5.0154	326	1.5661	0.4062	1.5661	1.2515
No log	5.0462	328	1.5937	0.3846	1.5937	1.2624
No log	5.0769	330	1.6811	0.3664	1.6811	1.2966
No log	5.1077	332	1.6844	0.3846	1.6844	1.2978
No log	5.1385	334	1.6312	0.4031	1.6312	1.2772
No log	5.1692	336	1.6330	0.4031	1.6330	1.2779
No log	5.2	338	1.6358	0.4219	1.6358	1.2790
No log	5.2308	340	1.5870	0.384	1.5870	1.2597
No log	5.2615	342	1.5429	0.3934	1.5429	1.2421
No log	5.2923	344	1.5894	0.3740	1.5894	1.2607
No log	5.3231	346	1.5437	0.3740	1.5437	1.2425
No log	5.3538	348	1.4280	0.3559	1.4280	1.1950
No log	5.3846	350	1.4250	0.3898	1.4250	1.1938
No log	5.4154	352	1.4029	0.4167	1.4029	1.1844
No log	5.4462	354	1.4140	0.4298	1.4140	1.1891
No log	5.4769	356	1.4874	0.3906	1.4874	1.2196
No log	5.5077	358	1.5640	0.3910	1.5640	1.2506
No log	5.5385	360	1.6572	0.3582	1.6572	1.2873
No log	5.5692	362	1.5749	0.3817	1.5749	1.2549
No log	5.6	364	1.4435	0.4341	1.4435	1.2014
No log	5.6308	366	1.3996	0.4531	1.3996	1.1831
No log	5.6615	368	1.4523	0.4341	1.4523	1.2051
No log	5.6923	370	1.4869	0.4094	1.4869	1.2194
No log	5.7231	372	1.5254	0.3902	1.5254	1.2351
No log	5.7538	374	1.5170	0.3902	1.5170	1.2317
No log	5.7846	376	1.4903	0.3902	1.4903	1.2208
No log	5.8154	378	1.4185	0.4194	1.4185	1.1910
No log	5.8462	380	1.4053	0.4219	1.4053	1.1854
No log	5.8769	382	1.4021	0.4219	1.4021	1.1841
No log	5.9077	384	1.4914	0.4031	1.4914	1.2212
No log	5.9385	386	1.5838	0.3969	1.5838	1.2585
No log	5.9692	388	1.7536	0.3088	1.7536	1.3242
No log	6.0	390	1.8481	0.2590	1.8481	1.3594
No log	6.0308	392	1.8660	0.2714	1.8660	1.3660
No log	6.0615	394	1.7275	0.3504	1.7275	1.3143
No log	6.0923	396	1.6325	0.3529	1.6325	1.2777
No log	6.1231	398	1.5969	0.3556	1.5969	1.2637
No log	6.1538	400	1.6810	0.3529	1.6810	1.2965
No log	6.1846	402	1.6968	0.3043	1.6968	1.3026
No log	6.2154	404	1.5909	0.3556	1.5909	1.2613
No log	6.2462	406	1.4998	0.3609	1.4998	1.2247
No log	6.2769	408	1.4199	0.4062	1.4199	1.1916
No log	6.3077	410	1.4122	0.4062	1.4122	1.1883
No log	6.3385	412	1.4675	0.4154	1.4675	1.2114
No log	6.3692	414	1.4466	0.4031	1.4466	1.2028
No log	6.4	416	1.4094	0.4094	1.4094	1.1872
No log	6.4308	418	1.3921	0.4094	1.3921	1.1799
No log	6.4615	420	1.4500	0.4031	1.4500	1.2042
No log	6.4923	422	1.4172	0.4062	1.4172	1.1904
No log	6.5231	424	1.4554	0.4031	1.4554	1.2064
No log	6.5538	426	1.5018	0.4154	1.5018	1.2255
No log	6.5846	428	1.5963	0.3582	1.5963	1.2634
No log	6.6154	430	1.7532	0.2609	1.7532	1.3241
No log	6.6462	432	1.7010	0.2963	1.7010	1.3042
No log	6.6769	434	1.5723	0.3937	1.5723	1.2539
No log	6.7077	436	1.4813	0.3740	1.4813	1.2171
No log	6.7385	438	1.4991	0.4320	1.4991	1.2244
No log	6.7692	440	1.4721	0.4341	1.4721	1.2133
No log	6.8	442	1.4419	0.4062	1.4419	1.2008
No log	6.8308	444	1.4768	0.4186	1.4768	1.2152
No log	6.8615	446	1.5451	0.3721	1.5451	1.2430
No log	6.8923	448	1.5596	0.3721	1.5596	1.2488
No log	6.9231	450	1.5615	0.3721	1.5615	1.2496
No log	6.9538	452	1.5605	0.3636	1.5605	1.2492
No log	6.9846	454	1.4138	0.4062	1.4138	1.1890
No log	7.0154	456	1.2790	0.4793	1.2790	1.1309
No log	7.0462	458	1.2154	0.4754	1.2154	1.1025
No log	7.0769	460	1.2047	0.4715	1.2047	1.0976
No log	7.1077	462	1.2137	0.4754	1.2137	1.1017
No log	7.1385	464	1.2646	0.4878	1.2646	1.1245
No log	7.1692	466	1.4225	0.4219	1.4225	1.1927
No log	7.2	468	1.5033	0.3969	1.5033	1.2261
No log	7.2308	470	1.5749	0.3852	1.5749	1.2549
No log	7.2615	472	1.5078	0.3881	1.5078	1.2279
No log	7.2923	474	1.4485	0.4	1.4485	1.2035
No log	7.3231	476	1.4149	0.4375	1.4149	1.1895
No log	7.3538	478	1.3956	0.4444	1.3956	1.1813
No log	7.3846	480	1.5052	0.4154	1.5052	1.2268
No log	7.4154	482	1.6318	0.3259	1.6318	1.2774
No log	7.4462	484	1.6776	0.3529	1.6776	1.2952
No log	7.4769	486	1.5558	0.3910	1.5558	1.2473
No log	7.5077	488	1.3596	0.4762	1.3596	1.1660
No log	7.5385	490	1.3051	0.48	1.3051	1.1424
No log	7.5692	492	1.3225	0.4921	1.3225	1.1500
No log	7.6	494	1.4178	0.4122	1.4178	1.1907
No log	7.6308	496	1.4638	0.3939	1.4638	1.2099
No log	7.6615	498	1.4677	0.3939	1.4677	1.2115
0.4518	7.6923	500	1.4133	0.4308	1.4133	1.1888
0.4518	7.7231	502	1.4320	0.4496	1.4320	1.1967
0.4518	7.7538	504	1.4661	0.4496	1.4661	1.2108
0.4518	7.7846	506	1.4850	0.4496	1.4850	1.2186
0.4518	7.8154	508	1.5311	0.4308	1.5311	1.2374
0.4518	7.8462	510	1.6088	0.4060	1.6088	1.2684
0.4518	7.8769	512	1.6423	0.3852	1.6423	1.2815
0.4518	7.9077	514	1.6495	0.3731	1.6495	1.2843
0.4518	7.9385	516	1.5741	0.3788	1.5741	1.2547

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1