ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k4_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5360
• Qwk: 0.3529
• Mse: 1.5360
• Rmse: 1.2394

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	6.6577	0.0308	6.6577	2.5803
No log	0.2222	4	4.5455	0.0562	4.5455	2.1320
No log	0.3333	6	3.0902	0.0833	3.0902	1.7579
No log	0.4444	8	3.2855	0.0220	3.2855	1.8126
No log	0.5556	10	2.5432	0.1061	2.5432	1.5947
No log	0.6667	12	2.3329	0.0625	2.3329	1.5274
No log	0.7778	14	2.1798	0.1240	2.1798	1.4764
No log	0.8889	16	2.0296	0.2479	2.0296	1.4246
No log	1.0	18	2.0183	0.2881	2.0183	1.4207
No log	1.1111	20	1.9621	0.3158	1.9621	1.4007
No log	1.2222	22	1.8275	0.1887	1.8275	1.3519
No log	1.3333	24	1.7144	0.1165	1.7144	1.3093
No log	1.4444	26	1.6902	0.1538	1.6902	1.3001
No log	1.5556	28	1.6444	0.1538	1.6444	1.2823
No log	1.6667	30	1.5798	0.1346	1.5798	1.2569
No log	1.7778	32	1.5832	0.1538	1.5832	1.2582
No log	1.8889	34	1.6539	0.1786	1.6539	1.2860
No log	2.0	36	1.7905	0.2602	1.7905	1.3381
No log	2.1111	38	1.7612	0.2880	1.7612	1.3271
No log	2.2222	40	1.5963	0.2975	1.5963	1.2634
No log	2.3333	42	1.4216	0.3036	1.4216	1.1923
No log	2.4444	44	1.3797	0.2569	1.3797	1.1746
No log	2.5556	46	1.4616	0.2593	1.4616	1.2090
No log	2.6667	48	1.7423	0.3360	1.7423	1.3200
No log	2.7778	50	1.8388	0.2941	1.8388	1.3560
No log	2.8889	52	1.4030	0.3770	1.4030	1.1845
No log	3.0	54	1.1919	0.3684	1.1919	1.0917
No log	3.1111	56	1.2391	0.3826	1.2391	1.1132
No log	3.2222	58	1.2925	0.3684	1.2925	1.1369
No log	3.3333	60	1.3836	0.2632	1.3836	1.1762
No log	3.4444	62	1.3550	0.3276	1.3550	1.1640
No log	3.5556	64	1.2779	0.4138	1.2779	1.1304
No log	3.6667	66	1.2397	0.55	1.2397	1.1134
No log	3.7778	68	1.2313	0.6457	1.2313	1.1096
No log	3.8889	70	1.2267	0.6515	1.2267	1.1076
No log	4.0	72	1.1843	0.5625	1.1843	1.0882
No log	4.1111	74	1.0909	0.5909	1.0909	1.0445
No log	4.2222	76	1.1296	0.5191	1.1296	1.0628
No log	4.3333	78	1.3173	0.4627	1.3173	1.1477
No log	4.4444	80	1.4626	0.4429	1.4626	1.2094
No log	4.5556	82	1.3656	0.4526	1.3656	1.1686
No log	4.6667	84	1.2917	0.4526	1.2917	1.1366
No log	4.7778	86	1.2964	0.4412	1.2964	1.1386
No log	4.8889	88	1.3100	0.4769	1.3100	1.1445
No log	5.0	90	1.3523	0.5469	1.3523	1.1629
No log	5.1111	92	1.3518	0.5344	1.3518	1.1627
No log	5.2222	94	1.2918	0.5581	1.2918	1.1366
No log	5.3333	96	1.2889	0.528	1.2889	1.1353
No log	5.4444	98	1.2544	0.5512	1.2544	1.1200
No log	5.5556	100	1.2850	0.5271	1.2850	1.1336
No log	5.6667	102	1.4960	0.4296	1.4960	1.2231
No log	5.7778	104	1.6155	0.3333	1.6155	1.2710
No log	5.8889	106	1.6042	0.3741	1.6042	1.2666
No log	6.0	108	1.7766	0.3077	1.7766	1.3329
No log	6.1111	110	2.0329	0.2500	2.0329	1.4258
No log	6.2222	112	2.1220	0.2500	2.1220	1.4567
No log	6.3333	114	2.0203	0.2500	2.0203	1.4214
No log	6.4444	116	1.7542	0.3768	1.7542	1.3245
No log	6.5556	118	1.6121	0.4058	1.6121	1.2697
No log	6.6667	120	1.5925	0.4029	1.5925	1.2619
No log	6.7778	122	1.5137	0.4234	1.5137	1.2303
No log	6.8889	124	1.5097	0.4380	1.5097	1.2287
No log	7.0	126	1.5708	0.4030	1.5708	1.2533
No log	7.1111	128	1.6166	0.3692	1.6166	1.2714
No log	7.2222	130	1.5818	0.3788	1.5818	1.2577
No log	7.3333	132	1.3988	0.4812	1.3988	1.1827
No log	7.4444	134	1.2859	0.5077	1.2859	1.1340
No log	7.5556	136	1.1923	0.5649	1.1923	1.0919
No log	7.6667	138	1.2095	0.5649	1.2095	1.0998
No log	7.7778	140	1.3653	0.4412	1.3653	1.1685
No log	7.8889	142	1.4882	0.4412	1.4882	1.2199
No log	8.0	144	1.6692	0.2837	1.6692	1.2920
No log	8.1111	146	1.7447	0.2937	1.7447	1.3209
No log	8.2222	148	1.6748	0.3357	1.6748	1.2941
No log	8.3333	150	1.6939	0.2937	1.6939	1.3015
No log	8.4444	152	1.8039	0.2797	1.8039	1.3431
No log	8.5556	154	1.7836	0.2958	1.7836	1.3355
No log	8.6667	156	1.6911	0.3407	1.6911	1.3004
No log	8.7778	158	1.5889	0.3284	1.5889	1.2605
No log	8.8889	160	1.5431	0.3407	1.5431	1.2422
No log	9.0	162	1.4466	0.4154	1.4466	1.2028
No log	9.1111	164	1.4395	0.4031	1.4395	1.1998
No log	9.2222	166	1.4706	0.3969	1.4706	1.2127
No log	9.3333	168	1.5616	0.4148	1.5616	1.2497
No log	9.4444	170	1.5730	0.4511	1.5730	1.2542
No log	9.5556	172	1.4700	0.4925	1.4700	1.2124
No log	9.6667	174	1.4605	0.4662	1.4605	1.2085
No log	9.7778	176	1.5299	0.4545	1.5299	1.2369
No log	9.8889	178	1.5686	0.4296	1.5686	1.2525
No log	10.0	180	1.5141	0.4361	1.5141	1.2305
No log	10.1111	182	1.3392	0.5000	1.3392	1.1573
No log	10.2222	184	1.1590	0.6190	1.1590	1.0766
No log	10.3333	186	1.1190	0.6190	1.1190	1.0578
No log	10.4444	188	1.1858	0.5649	1.1858	1.0890
No log	10.5556	190	1.3691	0.5152	1.3691	1.1701
No log	10.6667	192	1.5831	0.3857	1.5831	1.2582
No log	10.7778	194	1.7572	0.2917	1.7572	1.3256
No log	10.8889	196	1.7520	0.2754	1.7520	1.3236
No log	11.0	198	1.7685	0.3077	1.7685	1.3299
No log	11.1111	200	1.7884	0.2917	1.7884	1.3373
No log	11.2222	202	1.6420	0.3357	1.6420	1.2814
No log	11.3333	204	1.4924	0.4507	1.4924	1.2216
No log	11.4444	206	1.3727	0.4928	1.3727	1.1716
No log	11.5556	208	1.3247	0.4928	1.3247	1.1510
No log	11.6667	210	1.3327	0.4928	1.3327	1.1544
No log	11.7778	212	1.4088	0.4559	1.4088	1.1869
No log	11.8889	214	1.5401	0.4296	1.5401	1.2410
No log	12.0	216	1.5846	0.3824	1.5846	1.2588
No log	12.1111	218	1.5125	0.4296	1.5125	1.2298
No log	12.2222	220	1.4026	0.4961	1.4026	1.1843
No log	12.3333	222	1.3256	0.5238	1.3256	1.1513
No log	12.4444	224	1.3122	0.56	1.3122	1.1455
No log	12.5556	226	1.3567	0.5556	1.3567	1.1648
No log	12.6667	228	1.4552	0.4179	1.4552	1.2063
No log	12.7778	230	1.5043	0.3768	1.5043	1.2265
No log	12.8889	232	1.4165	0.4148	1.4165	1.1901
No log	13.0	234	1.3664	0.4593	1.3664	1.1689
No log	13.1111	236	1.2778	0.5606	1.2778	1.1304
No log	13.2222	238	1.3418	0.5231	1.3418	1.1584
No log	13.3333	240	1.4303	0.4148	1.4303	1.1959
No log	13.4444	242	1.4836	0.3971	1.4836	1.2180
No log	13.5556	244	1.3981	0.4148	1.3981	1.1824
No log	13.6667	246	1.3169	0.5344	1.3169	1.1476
No log	13.7778	248	1.3056	0.5231	1.3056	1.1426
No log	13.8889	250	1.4224	0.4148	1.4224	1.1926
No log	14.0	252	1.4955	0.4118	1.4955	1.2229
No log	14.1111	254	1.3739	0.4361	1.3739	1.1721
No log	14.2222	256	1.2746	0.5231	1.2746	1.1290
No log	14.3333	258	1.2939	0.4961	1.2939	1.1375
No log	14.4444	260	1.4272	0.4580	1.4272	1.1947
No log	14.5556	262	1.5819	0.3942	1.5819	1.2578
No log	14.6667	264	1.6511	0.3768	1.6511	1.2849
No log	14.7778	266	1.6276	0.3768	1.6276	1.2758
No log	14.8889	268	1.4929	0.4118	1.4929	1.2218
No log	15.0	270	1.4875	0.4118	1.4875	1.2196
No log	15.1111	272	1.4435	0.4148	1.4435	1.2014
No log	15.2222	274	1.4630	0.4148	1.4630	1.2095
No log	15.3333	276	1.5241	0.3942	1.5241	1.2346
No log	15.4444	278	1.5793	0.3942	1.5793	1.2567
No log	15.5556	280	1.5026	0.3852	1.5026	1.2258
No log	15.6667	282	1.3778	0.4531	1.3778	1.1738
No log	15.7778	284	1.3300	0.4844	1.3300	1.1533
No log	15.8889	286	1.3695	0.5	1.3695	1.1702
No log	16.0	288	1.5167	0.3704	1.5167	1.2315
No log	16.1111	290	1.6444	0.3404	1.6444	1.2823
No log	16.2222	292	1.7010	0.3077	1.7010	1.3042
No log	16.3333	294	1.6857	0.3077	1.6857	1.2984
No log	16.4444	296	1.5850	0.3597	1.5850	1.2590
No log	16.5556	298	1.4995	0.3971	1.4995	1.2246
No log	16.6667	300	1.5093	0.3942	1.5093	1.2285
No log	16.7778	302	1.5877	0.3571	1.5877	1.2600
No log	16.8889	304	1.6502	0.3262	1.6502	1.2846
No log	17.0	306	1.5154	0.3942	1.5154	1.2310
No log	17.1111	308	1.4576	0.3971	1.4576	1.2073
No log	17.2222	310	1.4947	0.4148	1.4947	1.2226
No log	17.3333	312	1.6152	0.3676	1.6152	1.2709
No log	17.4444	314	1.6952	0.3504	1.6952	1.3020
No log	17.5556	316	1.6587	0.3676	1.6587	1.2879
No log	17.6667	318	1.5569	0.4030	1.5569	1.2478
No log	17.7778	320	1.4920	0.4030	1.4920	1.2215
No log	17.8889	322	1.4732	0.4412	1.4732	1.2138
No log	18.0	324	1.5216	0.3972	1.5216	1.2335
No log	18.1111	326	1.6381	0.3636	1.6381	1.2799
No log	18.2222	328	1.6774	0.3636	1.6774	1.2952
No log	18.3333	330	1.6946	0.3699	1.6946	1.3018
No log	18.4444	332	1.5467	0.4196	1.5467	1.2437
No log	18.5556	334	1.4122	0.4672	1.4122	1.1884
No log	18.6667	336	1.3625	0.4776	1.3625	1.1672
No log	18.7778	338	1.4027	0.4776	1.4027	1.1843
No log	18.8889	340	1.6102	0.3165	1.6102	1.2689
No log	19.0	342	1.8169	0.2676	1.8169	1.3479
No log	19.1111	344	1.8444	0.2676	1.8444	1.3581
No log	19.2222	346	1.6941	0.3000	1.6941	1.3016
No log	19.3333	348	1.4572	0.4	1.4572	1.2072
No log	19.4444	350	1.3112	0.5692	1.3112	1.1451
No log	19.5556	352	1.2375	0.5512	1.2375	1.1124
No log	19.6667	354	1.2267	0.6	1.2267	1.1076
No log	19.7778	356	1.3091	0.4848	1.3091	1.1441
No log	19.8889	358	1.4374	0.4361	1.4374	1.1989
No log	20.0	360	1.6421	0.3000	1.6421	1.2814
No log	20.1111	362	1.6915	0.3000	1.6915	1.3006
No log	20.2222	364	1.5792	0.3165	1.5792	1.2567
No log	20.3333	366	1.4727	0.4060	1.4727	1.2135
No log	20.4444	368	1.4556	0.4060	1.4556	1.2065
No log	20.5556	370	1.4607	0.3852	1.4607	1.2086
No log	20.6667	372	1.5086	0.3824	1.5086	1.2283
No log	20.7778	374	1.5519	0.3478	1.5519	1.2458
No log	20.8889	376	1.5093	0.3824	1.5093	1.2285
No log	21.0	378	1.4036	0.3852	1.4036	1.1847
No log	21.1111	380	1.3829	0.3852	1.3829	1.1760
No log	21.2222	382	1.3915	0.4179	1.3915	1.1796
No log	21.3333	384	1.4700	0.3852	1.4700	1.2124
No log	21.4444	386	1.5365	0.3504	1.5365	1.2396
No log	21.5556	388	1.5354	0.3504	1.5354	1.2391
No log	21.6667	390	1.4553	0.3676	1.4553	1.2064
No log	21.7778	392	1.3288	0.4412	1.3288	1.1527
No log	21.8889	394	1.3590	0.4148	1.3590	1.1658
No log	22.0	396	1.3847	0.4118	1.3847	1.1767
No log	22.1111	398	1.4584	0.3676	1.4584	1.2076
No log	22.2222	400	1.5307	0.3504	1.5307	1.2372
No log	22.3333	402	1.5147	0.3504	1.5147	1.2307
No log	22.4444	404	1.4706	0.3852	1.4706	1.2127
No log	22.5556	406	1.5134	0.3676	1.5134	1.2302
No log	22.6667	408	1.5241	0.4179	1.5241	1.2345
No log	22.7778	410	1.4882	0.4211	1.4882	1.2199
No log	22.8889	412	1.4783	0.4	1.4783	1.2158
No log	23.0	414	1.4198	0.4060	1.4198	1.1915
No log	23.1111	416	1.3676	0.4962	1.3676	1.1694
No log	23.2222	418	1.4083	0.3704	1.4083	1.1867
No log	23.3333	420	1.5749	0.2878	1.5749	1.2549
No log	23.4444	422	1.7990	0.2535	1.7990	1.3413
No log	23.5556	424	1.8132	0.2535	1.8132	1.3466
No log	23.6667	426	1.6574	0.2714	1.6574	1.2874
No log	23.7778	428	1.4395	0.4148	1.4395	1.1998
No log	23.8889	430	1.3406	0.4688	1.3406	1.1578
No log	24.0	432	1.3629	0.4688	1.3629	1.1674
No log	24.1111	434	1.4571	0.3759	1.4571	1.2071
No log	24.2222	436	1.5965	0.3358	1.5965	1.2635
No log	24.3333	438	1.6138	0.3188	1.6138	1.2704
No log	24.4444	440	1.5175	0.3676	1.5175	1.2319
No log	24.5556	442	1.4168	0.4412	1.4168	1.1903
No log	24.6667	444	1.3524	0.4444	1.3524	1.1629
No log	24.7778	446	1.3740	0.4412	1.3740	1.1722
No log	24.8889	448	1.4459	0.4234	1.4459	1.2024
No log	25.0	450	1.5221	0.3768	1.5221	1.2337
No log	25.1111	452	1.5871	0.3768	1.5871	1.2598
No log	25.2222	454	1.5547	0.3768	1.5547	1.2469
No log	25.3333	456	1.5372	0.4118	1.5372	1.2398
No log	25.4444	458	1.4824	0.4148	1.4824	1.2176
No log	25.5556	460	1.3951	0.4148	1.3951	1.1811
No log	25.6667	462	1.3621	0.4511	1.3621	1.1671
No log	25.7778	464	1.4048	0.3881	1.4048	1.1852
No log	25.8889	466	1.4256	0.3881	1.4256	1.1940
No log	26.0	468	1.4103	0.3881	1.4103	1.1876
No log	26.1111	470	1.3907	0.3910	1.3907	1.1793
No log	26.2222	472	1.3688	0.4511	1.3688	1.1700
No log	26.3333	474	1.4041	0.4179	1.4041	1.1850
No log	26.4444	476	1.4884	0.3881	1.4884	1.2200
No log	26.5556	478	1.5305	0.3676	1.5305	1.2372
No log	26.6667	480	1.4687	0.3881	1.4687	1.2119
No log	26.7778	482	1.3916	0.4242	1.3916	1.1797
No log	26.8889	484	1.3580	0.4697	1.3580	1.1653
No log	27.0	486	1.3952	0.4242	1.3952	1.1812
No log	27.1111	488	1.4597	0.3881	1.4597	1.2082
No log	27.2222	490	1.4931	0.3881	1.4931	1.2219
No log	27.3333	492	1.4936	0.3881	1.4936	1.2221
No log	27.4444	494	1.4863	0.3881	1.4863	1.2191
No log	27.5556	496	1.4943	0.3852	1.4943	1.2224
No log	27.6667	498	1.4684	0.3881	1.4684	1.2118
0.3654	27.7778	500	1.4379	0.3881	1.4379	1.1991
0.3654	27.8889	502	1.3540	0.4776	1.3540	1.1636
0.3654	28.0	504	1.2373	0.5581	1.2373	1.1124
0.3654	28.1111	506	1.1664	0.5873	1.1664	1.0800
0.3654	28.2222	508	1.1660	0.5873	1.1660	1.0798
0.3654	28.3333	510	1.2201	0.5781	1.2201	1.1046
0.3654	28.4444	512	1.3377	0.4328	1.3377	1.1566
0.3654	28.5556	514	1.4793	0.3704	1.4793	1.2163
0.3654	28.6667	516	1.5733	0.3529	1.5733	1.2543
0.3654	28.7778	518	1.5708	0.3529	1.5708	1.2533
0.3654	28.8889	520	1.4824	0.3796	1.4824	1.2175
0.3654	29.0	522	1.3837	0.4412	1.3837	1.1763
0.3654	29.1111	524	1.3090	0.4559	1.3090	1.1441
0.3654	29.2222	526	1.3018	0.4638	1.3018	1.1410
0.3654	29.3333	528	1.3379	0.4672	1.3379	1.1567
0.3654	29.4444	530	1.3993	0.4412	1.3993	1.1829
0.3654	29.5556	532	1.4902	0.4234	1.4902	1.2207
0.3654	29.6667	534	1.5609	0.3529	1.5609	1.2493
0.3654	29.7778	536	1.5770	0.3529	1.5770	1.2558
0.3654	29.8889	538	1.5203	0.3529	1.5203	1.2330
0.3654	30.0	540	1.4614	0.3971	1.4614	1.2089
0.3654	30.1111	542	1.4998	0.3796	1.4998	1.2247
0.3654	30.2222	544	1.4928	0.4234	1.4928	1.2218
0.3654	30.3333	546	1.5158	0.4234	1.5158	1.2312
0.3654	30.4444	548	1.5248	0.4058	1.5248	1.2348
0.3654	30.5556	550	1.5094	0.4234	1.5094	1.2286
0.3654	30.6667	552	1.4375	0.4234	1.4375	1.1990
0.3654	30.7778	554	1.4056	0.4265	1.4056	1.1856
0.3654	30.8889	556	1.4561	0.4234	1.4561	1.2067
0.3654	31.0	558	1.5657	0.3529	1.5657	1.2513
0.3654	31.1111	560	1.5692	0.3529	1.5692	1.2527
0.3654	31.2222	562	1.4934	0.3704	1.4934	1.2221
0.3654	31.3333	564	1.3938	0.4179	1.3938	1.1806
0.3654	31.4444	566	1.3174	0.4328	1.3174	1.1478
0.3654	31.5556	568	1.2993	0.4545	1.2993	1.1399
0.3654	31.6667	570	1.3635	0.4060	1.3635	1.1677
0.3654	31.7778	572	1.4364	0.3788	1.4364	1.1985
0.3654	31.8889	574	1.4388	0.3788	1.4388	1.1995
0.3654	32.0	576	1.4255	0.3788	1.4255	1.1940
0.3654	32.1111	578	1.4407	0.3788	1.4407	1.2003
0.3654	32.2222	580	1.4051	0.4122	1.4051	1.1854
0.3654	32.3333	582	1.4185	0.3788	1.4185	1.1910
0.3654	32.4444	584	1.3996	0.3788	1.3996	1.1831
0.3654	32.5556	586	1.3797	0.4308	1.3797	1.1746
0.3654	32.6667	588	1.4182	0.3609	1.4182	1.1909
0.3654	32.7778	590	1.4499	0.3731	1.4499	1.2041
0.3654	32.8889	592	1.4130	0.3881	1.4130	1.1887
0.3654	33.0	594	1.4279	0.3881	1.4279	1.1949
0.3654	33.1111	596	1.5360	0.3529	1.5360	1.2394

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1