ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.9150
• Qwk: 0.2302
• Mse: 1.9150
• Rmse: 1.3838

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	6.7402	0.0308	6.7402	2.5962
No log	0.0833	4	4.2156	0.0793	4.2156	2.0532
No log	0.125	6	2.9798	0.0606	2.9798	1.7262
No log	0.1667	8	2.4799	0.1429	2.4799	1.5748
No log	0.2083	10	2.0984	0.1985	2.0984	1.4486
No log	0.25	12	1.9574	0.35	1.9574	1.3991
No log	0.2917	14	2.2449	0.0444	2.2449	1.4983
No log	0.3333	16	2.1194	0.1395	2.1194	1.4558
No log	0.375	18	1.9630	0.2047	1.9630	1.4011
No log	0.4167	20	1.8996	0.2171	1.8996	1.3782
No log	0.4583	22	2.6190	0.0296	2.6190	1.6183
No log	0.5	24	2.3923	0.0465	2.3923	1.5467
No log	0.5417	26	1.6646	0.2087	1.6646	1.2902
No log	0.5833	28	1.5249	0.3697	1.5249	1.2349
No log	0.625	30	2.0494	0.2239	2.0494	1.4316
No log	0.6667	32	2.1650	0.2609	2.1650	1.4714
No log	0.7083	34	1.5830	0.3279	1.5830	1.2582
No log	0.75	36	1.3057	0.3652	1.3057	1.1427
No log	0.7917	38	1.4786	0.4103	1.4786	1.2160
No log	0.8333	40	1.9261	0.1538	1.9261	1.3879
No log	0.875	42	1.9112	0.0526	1.9112	1.3825
No log	0.9167	44	1.6005	0.1111	1.6005	1.2651
No log	0.9583	46	1.5324	0.2655	1.5324	1.2379
No log	1.0	48	1.5770	0.3248	1.5770	1.2558
No log	1.0417	50	1.5110	0.3130	1.5110	1.2292
No log	1.0833	52	1.4125	0.2679	1.4125	1.1885
No log	1.125	54	1.3381	0.3604	1.3381	1.1568
No log	1.1667	56	1.3537	0.4274	1.3537	1.1635
No log	1.2083	58	1.5169	0.3390	1.5169	1.2316
No log	1.25	60	1.6557	0.3667	1.6557	1.2868
No log	1.2917	62	1.4173	0.3770	1.4173	1.1905
No log	1.3333	64	1.1964	0.4746	1.1964	1.0938
No log	1.375	66	1.1354	0.5124	1.1354	1.0655
No log	1.4167	68	1.1735	0.5410	1.1735	1.0833
No log	1.4583	70	1.3439	0.4553	1.3439	1.1593
No log	1.5	72	1.3108	0.4839	1.3108	1.1449
No log	1.5417	74	1.2111	0.5289	1.2111	1.1005
No log	1.5833	76	1.1148	0.5424	1.1148	1.0558
No log	1.625	78	1.1120	0.5455	1.1120	1.0545
No log	1.6667	80	1.1033	0.5620	1.1033	1.0504
No log	1.7083	82	1.1083	0.5128	1.1083	1.0527
No log	1.75	84	1.1488	0.4915	1.1488	1.0718
No log	1.7917	86	1.2227	0.4706	1.2227	1.1058
No log	1.8333	88	1.2198	0.4706	1.2198	1.1044
No log	1.875	90	1.0928	0.4833	1.0928	1.0453
No log	1.9167	92	1.1096	0.4754	1.1096	1.0534
No log	1.9583	94	1.3373	0.4959	1.3373	1.1564
No log	2.0	96	1.7115	0.2080	1.7115	1.3083
No log	2.0417	98	1.7756	0.3040	1.7756	1.3325
No log	2.0833	100	1.7693	0.2105	1.7693	1.3301
No log	2.125	102	1.5356	0.3538	1.5356	1.2392
No log	2.1667	104	1.2824	0.4262	1.2824	1.1325
No log	2.2083	106	1.2393	0.4915	1.2393	1.1132
No log	2.25	108	1.3718	0.4793	1.3718	1.1712
No log	2.2917	110	1.5892	0.3710	1.5892	1.2606
No log	2.3333	112	1.8243	0.2439	1.8243	1.3506
No log	2.375	114	1.7659	0.3065	1.7659	1.3289
No log	2.4167	116	1.6206	0.2901	1.6206	1.2730
No log	2.4583	118	1.5727	0.3411	1.5727	1.2541
No log	2.5	120	1.6517	0.3030	1.6517	1.2852
No log	2.5417	122	1.6623	0.2857	1.6623	1.2893
No log	2.5833	124	1.5074	0.3582	1.5074	1.2278
No log	2.625	126	1.4667	0.3538	1.4667	1.2111
No log	2.6667	128	1.5399	0.3158	1.5399	1.2409
No log	2.7083	130	1.5652	0.3881	1.5652	1.2511
No log	2.75	132	1.4108	0.4211	1.4108	1.1878
No log	2.7917	134	1.2989	0.5238	1.2989	1.1397
No log	2.8333	136	1.2312	0.5161	1.2312	1.1096
No log	2.875	138	1.2364	0.5323	1.2364	1.1119
No log	2.9167	140	1.3212	0.5197	1.3212	1.1495
No log	2.9583	142	1.4446	0.3968	1.4446	1.2019
No log	3.0	144	1.4236	0.4228	1.4236	1.1932
No log	3.0417	146	1.3119	0.4553	1.3119	1.1454
No log	3.0833	148	1.2701	0.4640	1.2701	1.1270
No log	3.125	150	1.4280	0.4154	1.4280	1.1950
No log	3.1667	152	1.7646	0.1791	1.7646	1.3284
No log	3.2083	154	2.0626	0.1333	2.0626	1.4362
No log	3.25	156	2.0970	0.1618	2.0970	1.4481
No log	3.2917	158	1.8727	0.2105	1.8727	1.3685
No log	3.3333	160	1.6350	0.3609	1.6350	1.2787
No log	3.375	162	1.4792	0.4030	1.4792	1.2162
No log	3.4167	164	1.6379	0.3382	1.6379	1.2798
No log	3.4583	166	1.7109	0.2734	1.7109	1.3080
No log	3.5	168	1.9171	0.25	1.9171	1.3846
No log	3.5417	170	1.9959	0.25	1.9959	1.4128
No log	3.5833	172	1.7251	0.3404	1.7251	1.3134
No log	3.625	174	1.6880	0.3404	1.6880	1.2992
No log	3.6667	176	1.9337	0.2621	1.9337	1.3906
No log	3.7083	178	2.1435	0.1972	2.1435	1.4641
No log	3.75	180	1.9732	0.1857	1.9732	1.4047
No log	3.7917	182	1.7589	0.3101	1.7589	1.3262
No log	3.8333	184	1.6025	0.3667	1.6025	1.2659
No log	3.875	186	1.5218	0.3833	1.5218	1.2336
No log	3.9167	188	1.5290	0.4262	1.5290	1.2365
No log	3.9583	190	1.6663	0.3150	1.6663	1.2908
No log	4.0	192	1.8792	0.2319	1.8792	1.3708
No log	4.0417	194	1.9366	0.2174	1.9366	1.3916
No log	4.0833	196	1.7949	0.2667	1.7949	1.3397
No log	4.125	198	1.5281	0.3538	1.5281	1.2362
No log	4.1667	200	1.3727	0.4409	1.3727	1.1716
No log	4.2083	202	1.3971	0.4531	1.3971	1.1820
No log	4.25	204	1.5618	0.3206	1.5618	1.2497
No log	4.2917	206	1.7635	0.2647	1.7635	1.3280
No log	4.3333	208	1.7988	0.2878	1.7988	1.3412
No log	4.375	210	1.6036	0.3796	1.6036	1.2663
No log	4.4167	212	1.4987	0.4148	1.4987	1.2242
No log	4.4583	214	1.3675	0.4211	1.3675	1.1694
No log	4.5	216	1.4415	0.4148	1.4415	1.2006
No log	4.5417	218	1.7796	0.2917	1.7796	1.3340
No log	4.5833	220	2.0907	0.2069	2.0907	1.4459
No log	4.625	222	2.1941	0.1655	2.1941	1.4813
No log	4.6667	224	2.0371	0.1831	2.0371	1.4273
No log	4.7083	226	1.8354	0.25	1.8354	1.3548
No log	4.75	228	1.6637	0.3407	1.6637	1.2899
No log	4.7917	230	1.5574	0.3582	1.5574	1.2480
No log	4.8333	232	1.3914	0.4219	1.3914	1.1796
No log	4.875	234	1.2415	0.4959	1.2415	1.1142
No log	4.9167	236	1.2018	0.5167	1.2018	1.0963
No log	4.9583	238	1.2652	0.4959	1.2652	1.1248
No log	5.0	240	1.4052	0.3876	1.4052	1.1854
No log	5.0417	242	1.6220	0.3182	1.6220	1.2736
No log	5.0833	244	1.8147	0.2941	1.8147	1.3471
No log	5.125	246	1.8937	0.2695	1.8937	1.3761
No log	5.1667	248	1.8011	0.2958	1.8011	1.3420
No log	5.2083	250	1.5663	0.3889	1.5663	1.2515
No log	5.25	252	1.3488	0.4328	1.3488	1.1614
No log	5.2917	254	1.2978	0.5	1.2978	1.1392
No log	5.3333	256	1.3420	0.4375	1.3420	1.1584
No log	5.375	258	1.3852	0.4194	1.3852	1.1770
No log	5.4167	260	1.3757	0.4603	1.3757	1.1729
No log	5.4583	262	1.2854	0.4715	1.2854	1.1338
No log	5.5	264	1.3247	0.4603	1.3247	1.1509
No log	5.5417	266	1.4473	0.3906	1.4473	1.2030
No log	5.5833	268	1.4518	0.4308	1.4518	1.2049
No log	5.625	270	1.4504	0.4275	1.4504	1.2043
No log	5.6667	272	1.4703	0.4275	1.4703	1.2126
No log	5.7083	274	1.5289	0.3881	1.5289	1.2365
No log	5.75	276	1.5974	0.3731	1.5974	1.2639
No log	5.7917	278	1.7189	0.2985	1.7189	1.3111
No log	5.8333	280	1.8561	0.2647	1.8561	1.3624
No log	5.875	282	1.8216	0.2537	1.8216	1.3497
No log	5.9167	284	1.5910	0.3788	1.5910	1.2614
No log	5.9583	286	1.4114	0.4651	1.4114	1.1880
No log	6.0	288	1.3483	0.4806	1.3483	1.1612
No log	6.0417	290	1.3362	0.4286	1.3362	1.1560
No log	6.0833	292	1.4002	0.4651	1.4002	1.1833
No log	6.125	294	1.4915	0.3910	1.4915	1.2213
No log	6.1667	296	1.5726	0.3881	1.5726	1.2540
No log	6.2083	298	1.6589	0.3382	1.6589	1.2880
No log	6.25	300	1.6193	0.3382	1.6193	1.2725
No log	6.2917	302	1.4588	0.3788	1.4588	1.2078
No log	6.3333	304	1.3298	0.4262	1.3298	1.1532
No log	6.375	306	1.3123	0.4516	1.3123	1.1455
No log	6.4167	308	1.3657	0.3968	1.3657	1.1686
No log	6.4583	310	1.5657	0.3759	1.5657	1.2513
No log	6.5	312	1.8097	0.2647	1.8097	1.3453
No log	6.5417	314	1.9037	0.2190	1.9037	1.3798
No log	6.5833	316	1.8056	0.2815	1.8056	1.3437
No log	6.625	318	1.7085	0.3308	1.7085	1.3071
No log	6.6667	320	1.6209	0.3759	1.6209	1.2732
No log	6.7083	322	1.5263	0.375	1.5263	1.2354
No log	6.75	324	1.4580	0.4480	1.4580	1.2075
No log	6.7917	326	1.5412	0.3566	1.5412	1.2415
No log	6.8333	328	1.5871	0.3566	1.5871	1.2598
No log	6.875	330	1.6329	0.3566	1.6329	1.2779
No log	6.9167	332	1.5943	0.3465	1.5943	1.2627
No log	6.9583	334	1.5124	0.352	1.5124	1.2298
No log	7.0	336	1.4009	0.4228	1.4009	1.1836
No log	7.0417	338	1.4039	0.3937	1.4039	1.1849
No log	7.0833	340	1.4424	0.3817	1.4424	1.2010
No log	7.125	342	1.3725	0.4091	1.3725	1.1715
No log	7.1667	344	1.2922	0.4603	1.2922	1.1368
No log	7.2083	346	1.2869	0.4553	1.2869	1.1344
No log	7.25	348	1.3049	0.4167	1.3049	1.1423
No log	7.2917	350	1.3897	0.4516	1.3897	1.1788
No log	7.3333	352	1.5297	0.3817	1.5297	1.2368
No log	7.375	354	1.6200	0.3433	1.6200	1.2728
No log	7.4167	356	1.6071	0.3433	1.6071	1.2677
No log	7.4583	358	1.5236	0.3582	1.5236	1.2343
No log	7.5	360	1.5112	0.3939	1.5112	1.2293
No log	7.5417	362	1.5902	0.3382	1.5902	1.2610
No log	7.5833	364	1.6794	0.3212	1.6794	1.2959
No log	7.625	366	1.6663	0.3382	1.6663	1.2909
No log	7.6667	368	1.5364	0.4511	1.5364	1.2395
No log	7.7083	370	1.3788	0.4961	1.3788	1.1742
No log	7.75	372	1.2931	0.4844	1.2931	1.1371
No log	7.7917	374	1.2345	0.5161	1.2345	1.1111
No log	7.8333	376	1.2388	0.5161	1.2388	1.1130
No log	7.875	378	1.2379	0.5161	1.2379	1.1126
No log	7.9167	380	1.3338	0.4762	1.3338	1.1549
No log	7.9583	382	1.4697	0.4496	1.4697	1.2123
No log	8.0	384	1.5363	0.4242	1.5363	1.2395
No log	8.0417	386	1.5557	0.3582	1.5557	1.2473
No log	8.0833	388	1.5010	0.4030	1.5010	1.2252
No log	8.125	390	1.6037	0.3235	1.6037	1.2664
No log	8.1667	392	1.7557	0.3043	1.7557	1.3250
No log	8.2083	394	1.7983	0.25	1.7983	1.3410
No log	8.25	396	1.7419	0.2370	1.7419	1.3198
No log	8.2917	398	1.7476	0.2482	1.7476	1.3220
No log	8.3333	400	1.6988	0.2774	1.6988	1.3034
No log	8.375	402	1.5701	0.3256	1.5701	1.2530
No log	8.4167	404	1.4955	0.4127	1.4955	1.2229
No log	8.4583	406	1.5290	0.3465	1.5290	1.2365
No log	8.5	408	1.6384	0.3111	1.6384	1.2800
No log	8.5417	410	1.7099	0.2774	1.7099	1.3076
No log	8.5833	412	1.8215	0.2464	1.8215	1.3496
No log	8.625	414	1.9776	0.2464	1.9776	1.4063
No log	8.6667	416	1.9801	0.2464	1.9801	1.4071
No log	8.7083	418	1.8168	0.2190	1.8168	1.3479
No log	8.75	420	1.5866	0.3471	1.5866	1.2596
No log	8.7917	422	1.4430	0.3793	1.4430	1.2012
No log	8.8333	424	1.3637	0.4174	1.3637	1.1678
No log	8.875	426	1.3629	0.4754	1.3629	1.1674
No log	8.9167	428	1.4665	0.4341	1.4665	1.2110
No log	8.9583	430	1.6084	0.3459	1.6084	1.2682
No log	9.0	432	1.7272	0.3008	1.7272	1.3142
No log	9.0417	434	1.6504	0.2698	1.6504	1.2847
No log	9.0833	436	1.6025	0.3443	1.6025	1.2659
No log	9.125	438	1.4607	0.3871	1.4607	1.2086
No log	9.1667	440	1.4704	0.3969	1.4704	1.2126
No log	9.2083	442	1.4742	0.3939	1.4742	1.2142
No log	9.25	444	1.3995	0.4154	1.3995	1.1830
No log	9.2917	446	1.3929	0.4308	1.3929	1.1802
No log	9.3333	448	1.4722	0.3939	1.4722	1.2134
No log	9.375	450	1.5399	0.3582	1.5399	1.2409
No log	9.4167	452	1.7267	0.2647	1.7267	1.3140
No log	9.4583	454	1.8012	0.2647	1.8012	1.3421
No log	9.5	456	1.9024	0.2174	1.9024	1.3793
No log	9.5417	458	1.9140	0.2174	1.9140	1.3835
No log	9.5833	460	1.8172	0.2353	1.8172	1.3480
No log	9.625	462	1.7477	0.2754	1.7477	1.3220
No log	9.6667	464	1.7626	0.2754	1.7626	1.3276
No log	9.7083	466	1.8592	0.2571	1.8592	1.3635
No log	9.75	468	1.8607	0.2571	1.8607	1.3641
No log	9.7917	470	1.7871	0.2878	1.7871	1.3368
No log	9.8333	472	1.6717	0.3358	1.6717	1.2929
No log	9.875	474	1.6117	0.3582	1.6117	1.2695
No log	9.9167	476	1.4935	0.3759	1.4935	1.2221
No log	9.9583	478	1.4303	0.4091	1.4303	1.1960
No log	10.0	480	1.4252	0.3759	1.4252	1.1938
No log	10.0417	482	1.4241	0.3582	1.4241	1.1934
No log	10.0833	484	1.5125	0.4	1.5125	1.2298
No log	10.125	486	1.5529	0.4	1.5529	1.2461
No log	10.1667	488	1.7013	0.3378	1.7013	1.3043
No log	10.2083	490	1.7676	0.3378	1.7676	1.3295
No log	10.25	492	1.7118	0.2878	1.7118	1.3084
No log	10.2917	494	1.5172	0.3582	1.5172	1.2317
No log	10.3333	496	1.3237	0.48	1.3237	1.1505
No log	10.375	498	1.2779	0.4715	1.2779	1.1304
0.4167	10.4167	500	1.3089	0.4839	1.3089	1.1441
0.4167	10.4583	502	1.3897	0.4496	1.3897	1.1788
0.4167	10.5	504	1.5301	0.3582	1.5301	1.2370
0.4167	10.5417	506	1.6920	0.3259	1.6920	1.3008
0.4167	10.5833	508	1.8528	0.2302	1.8528	1.3612
0.4167	10.625	510	1.9150	0.2302	1.9150	1.3838

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1