ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4941
• Qwk: 0.4375
• Mse: 1.4941
• Rmse: 1.2223

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	7.0792	0.0057	7.0792	2.6607
No log	0.0976	4	4.3463	0.1083	4.3463	2.0848
No log	0.1463	6	3.6467	-0.0317	3.6467	1.9096
No log	0.1951	8	3.2546	0.0231	3.2546	1.8040
No log	0.2439	10	2.5003	0.1277	2.5003	1.5812
No log	0.2927	12	1.8412	0.2281	1.8412	1.3569
No log	0.3415	14	1.9260	0.2542	1.9260	1.3878
No log	0.3902	16	1.9334	0.25	1.9334	1.3905
No log	0.4390	18	1.7673	0.2281	1.7673	1.3294
No log	0.4878	20	1.7200	0.2017	1.7200	1.3115
No log	0.5366	22	1.6985	0.25	1.6985	1.3033
No log	0.5854	24	1.7075	0.2419	1.7075	1.3067
No log	0.6341	26	1.8668	0.2370	1.8668	1.3663
No log	0.6829	28	1.8623	0.25	1.8623	1.3646
No log	0.7317	30	1.9166	0.2774	1.9166	1.3844
No log	0.7805	32	1.9351	0.2963	1.9351	1.3911
No log	0.8293	34	1.8078	0.4553	1.8078	1.3446
No log	0.8780	36	1.7784	0.4132	1.7784	1.3336
No log	0.9268	38	2.0170	0.2336	2.0170	1.4202
No log	0.9756	40	2.0029	0.2270	2.0029	1.4153
No log	1.0244	42	2.1121	0.2254	2.1121	1.4533
No log	1.0732	44	2.1305	0.3151	2.1305	1.4596
No log	1.1220	46	2.0263	0.3067	2.0263	1.4235
No log	1.1707	48	1.4837	0.4580	1.4837	1.2181
No log	1.2195	50	1.2734	0.3966	1.2734	1.1285
No log	1.2683	52	1.7450	0.1593	1.7450	1.3210
No log	1.3171	54	1.9528	0.0396	1.9528	1.3974
No log	1.3659	56	1.9681	0.0784	1.9681	1.4029
No log	1.4146	58	1.9957	0.3333	1.9957	1.4127
No log	1.4634	60	2.0384	0.3780	2.0384	1.4277
No log	1.5122	62	1.9569	0.4127	1.9569	1.3989
No log	1.5610	64	1.9578	0.3008	1.9578	1.3992
No log	1.6098	66	1.9108	0.3511	1.9108	1.3823
No log	1.6585	68	1.7223	0.3802	1.7223	1.3124
No log	1.7073	70	1.6595	0.3063	1.6595	1.2882
No log	1.7561	72	1.6652	0.1538	1.6652	1.2904
No log	1.8049	74	1.7043	0.1538	1.7043	1.3055
No log	1.8537	76	1.7363	0.1165	1.7363	1.3177
No log	1.9024	78	1.7291	0.1165	1.7291	1.3150
No log	1.9512	80	1.6364	0.1165	1.6364	1.2792
No log	2.0	82	1.5805	0.1538	1.5805	1.2572
No log	2.0488	84	1.5328	0.1905	1.5328	1.2381
No log	2.0976	86	1.4873	0.2752	1.4873	1.2196
No log	2.1463	88	1.4065	0.2936	1.4065	1.1860
No log	2.1951	90	1.3343	0.3119	1.3343	1.1551
No log	2.2439	92	1.2778	0.3604	1.2778	1.1304
No log	2.2927	94	1.2229	0.3717	1.2229	1.1058
No log	2.3415	96	1.1862	0.4035	1.1862	1.0891
No log	2.3902	98	1.1530	0.4274	1.1530	1.0738
No log	2.4390	100	1.1260	0.4615	1.1260	1.0612
No log	2.4878	102	1.0862	0.55	1.0862	1.0422
No log	2.5366	104	1.0809	0.4915	1.0809	1.0397
No log	2.5854	106	1.1057	0.5714	1.1057	1.0515
No log	2.6341	108	1.1495	0.4706	1.1495	1.0721
No log	2.6829	110	1.2408	0.4167	1.2408	1.1139
No log	2.7317	112	1.3035	0.4167	1.3035	1.1417
No log	2.7805	114	1.2510	0.3393	1.2510	1.1185
No log	2.8293	116	1.3386	0.3571	1.3386	1.1570
No log	2.8780	118	1.3414	0.4035	1.3414	1.1582
No log	2.9268	120	1.2341	0.4	1.2341	1.1109
No log	2.9756	122	1.3385	0.4516	1.3385	1.1569
No log	3.0244	124	1.4147	0.4160	1.4147	1.1894
No log	3.0732	126	1.4823	0.4186	1.4823	1.2175
No log	3.1220	128	1.4533	0.3968	1.4533	1.2055
No log	3.1707	130	1.3943	0.3103	1.3943	1.1808
No log	3.2195	132	1.4321	0.3186	1.4321	1.1967
No log	3.2683	134	1.3713	0.4	1.3713	1.1710
No log	3.3171	136	1.2468	0.4034	1.2468	1.1166
No log	3.3659	138	1.2704	0.4878	1.2704	1.1271
No log	3.4146	140	1.3376	0.4320	1.3376	1.1565
No log	3.4634	142	1.4365	0.3937	1.4365	1.1986
No log	3.5122	144	1.5603	0.3692	1.5603	1.2491
No log	3.5610	146	1.6582	0.3692	1.6582	1.2877
No log	3.6098	148	1.5528	0.375	1.5528	1.2461
No log	3.6585	150	1.3791	0.4390	1.3791	1.1744
No log	3.7073	152	1.2805	0.4103	1.2805	1.1316
No log	3.7561	154	1.2727	0.4103	1.2727	1.1282
No log	3.8049	156	1.3513	0.4426	1.3513	1.1625
No log	3.8537	158	1.3754	0.4426	1.3754	1.1728
No log	3.9024	160	1.4085	0.4098	1.4085	1.1868
No log	3.9512	162	1.3880	0.3898	1.3880	1.1781
No log	4.0	164	1.4645	0.3304	1.4645	1.2102
No log	4.0488	166	1.5458	0.3652	1.5458	1.2433
No log	4.0976	168	1.6745	0.3051	1.6745	1.2940
No log	4.1463	170	1.8594	0.1905	1.8594	1.3636
No log	4.1951	172	1.8332	0.2419	1.8332	1.3539
No log	4.2439	174	1.6573	0.2957	1.6573	1.2874
No log	4.2927	176	1.5853	0.2364	1.5853	1.2591
No log	4.3415	178	1.5969	0.2778	1.5969	1.2637
No log	4.3902	180	1.5938	0.3363	1.5938	1.2625
No log	4.4390	182	1.6992	0.3390	1.6992	1.3035
No log	4.4878	184	1.7703	0.2016	1.7703	1.3305
No log	4.5366	186	1.7302	0.2727	1.7302	1.3154
No log	4.5854	188	1.5604	0.3333	1.5604	1.2492
No log	4.6341	190	1.4691	0.3390	1.4691	1.2121
No log	4.6829	192	1.4046	0.4194	1.4046	1.1852
No log	4.7317	194	1.3959	0.3390	1.3959	1.1815
No log	4.7805	196	1.3351	0.4786	1.3351	1.1555
No log	4.8293	198	1.3520	0.4786	1.3520	1.1628
No log	4.8780	200	1.4609	0.3667	1.4609	1.2087
No log	4.9268	202	1.5418	0.368	1.5418	1.2417
No log	4.9756	204	1.5488	0.3636	1.5488	1.2445
No log	5.0244	206	1.6063	0.3910	1.6063	1.2674
No log	5.0732	208	1.6185	0.3636	1.6185	1.2722
No log	5.1220	210	1.5225	0.2903	1.5225	1.2339
No log	5.1707	212	1.5494	0.2703	1.5494	1.2448
No log	5.2195	214	1.6771	0.2182	1.6771	1.2950
No log	5.2683	216	1.6719	0.2992	1.6719	1.2930
No log	5.3171	218	1.6574	0.3459	1.6574	1.2874
No log	5.3659	220	1.5679	0.3664	1.5679	1.2521
No log	5.4146	222	1.4189	0.4375	1.4189	1.1912
No log	5.4634	224	1.5024	0.4031	1.5024	1.2257
No log	5.5122	226	1.6269	0.3485	1.6269	1.2755
No log	5.5610	228	1.6677	0.3433	1.6677	1.2914
No log	5.6098	230	1.6287	0.3636	1.6287	1.2762
No log	5.6585	232	1.4571	0.4094	1.4571	1.2071
No log	5.7073	234	1.4152	0.4094	1.4152	1.1896
No log	5.7561	236	1.5238	0.4031	1.5238	1.2344
No log	5.8049	238	1.7272	0.3259	1.7272	1.3142
No log	5.8537	240	1.6897	0.2774	1.6897	1.2999
No log	5.9024	242	1.5226	0.4094	1.5226	1.2339
No log	5.9512	244	1.3967	0.4160	1.3967	1.1818
No log	6.0	246	1.4633	0.4094	1.4633	1.2097
No log	6.0488	248	1.6241	0.375	1.6241	1.2744
No log	6.0976	250	1.9276	0.2714	1.9276	1.3884
No log	6.1463	252	2.1050	0.2238	2.1050	1.4509
No log	6.1951	254	1.9762	0.2695	1.9762	1.4058
No log	6.2439	256	1.6999	0.3206	1.6999	1.3038
No log	6.2927	258	1.5849	0.3566	1.5849	1.2589
No log	6.3415	260	1.6458	0.3206	1.6458	1.2829
No log	6.3902	262	1.8073	0.3212	1.8073	1.3444
No log	6.4390	264	1.8003	0.3212	1.8003	1.3418
No log	6.4878	266	1.7236	0.3333	1.7236	1.3129
No log	6.5366	268	1.6065	0.3906	1.6065	1.2675
No log	6.5854	270	1.5675	0.4094	1.5675	1.2520
No log	6.6341	272	1.6762	0.3385	1.6762	1.2947
No log	6.6829	274	1.8443	0.3407	1.8443	1.3580
No log	6.7317	276	1.8469	0.3407	1.8469	1.3590
No log	6.7805	278	1.8223	0.3433	1.8223	1.3499
No log	6.8293	280	1.7694	0.3433	1.7694	1.3302
No log	6.8780	282	1.5745	0.4062	1.5745	1.2548
No log	6.9268	284	1.4232	0.3902	1.4232	1.1930
No log	6.9756	286	1.4526	0.3902	1.4526	1.2052
No log	7.0244	288	1.6088	0.4062	1.6088	1.2684
No log	7.0732	290	1.6719	0.3609	1.6719	1.2930
No log	7.1220	292	1.6536	0.3939	1.6536	1.2859
No log	7.1707	294	1.4695	0.3937	1.4695	1.2122
No log	7.2195	296	1.4262	0.4032	1.4262	1.1942
No log	7.2683	298	1.5675	0.4062	1.5675	1.2520
No log	7.3171	300	1.6583	0.4122	1.6583	1.2878
No log	7.3659	302	1.6448	0.4186	1.6448	1.2825
No log	7.4146	304	1.5718	0.3968	1.5718	1.2537
No log	7.4634	306	1.4554	0.368	1.4554	1.2064
No log	7.5122	308	1.4694	0.368	1.4694	1.2122
No log	7.5610	310	1.6531	0.375	1.6531	1.2857
No log	7.6098	312	2.0345	0.1831	2.0345	1.4263
No log	7.6585	314	2.1770	0.1678	2.1770	1.4755
No log	7.7073	316	2.0297	0.1831	2.0297	1.4247
No log	7.7561	318	1.7423	0.3788	1.7423	1.3199
No log	7.8049	320	1.4744	0.368	1.4744	1.2143
No log	7.8537	322	1.3643	0.3833	1.3643	1.1680
No log	7.9024	324	1.3559	0.3697	1.3559	1.1644
No log	7.9512	326	1.4303	0.4098	1.4303	1.1960
No log	8.0	328	1.5032	0.4094	1.5032	1.2260
No log	8.0488	330	1.5696	0.4094	1.5696	1.2529
No log	8.0976	332	1.5416	0.4094	1.5416	1.2416
No log	8.1463	334	1.4163	0.3968	1.4163	1.1901
No log	8.1951	336	1.3664	0.3968	1.3664	1.1689
No log	8.2439	338	1.3757	0.3968	1.3757	1.1729
No log	8.2927	340	1.4006	0.4094	1.4006	1.1835
No log	8.3415	342	1.4308	0.4094	1.4308	1.1962
No log	8.3902	344	1.4763	0.4094	1.4763	1.2150
No log	8.4390	346	1.5850	0.3906	1.5849	1.2589
No log	8.4878	348	1.6267	0.3906	1.6267	1.2754
No log	8.5366	350	1.6019	0.3906	1.6019	1.2656
No log	8.5854	352	1.5328	0.3968	1.5328	1.2381
No log	8.6341	354	1.5883	0.3780	1.5883	1.2603
No log	8.6829	356	1.5524	0.3968	1.5524	1.2460
No log	8.7317	358	1.5148	0.3968	1.5148	1.2308
No log	8.7805	360	1.5912	0.3968	1.5912	1.2614
No log	8.8293	362	1.5963	0.3968	1.5963	1.2634
No log	8.8780	364	1.6035	0.384	1.6035	1.2663
No log	8.9268	366	1.6008	0.3115	1.6008	1.2652
No log	8.9756	368	1.5933	0.3140	1.5933	1.2623
No log	9.0244	370	1.6069	0.3140	1.6069	1.2676
No log	9.0732	372	1.6702	0.368	1.6702	1.2924
No log	9.1220	374	1.6996	0.3968	1.6996	1.3037
No log	9.1707	376	1.6763	0.3968	1.6763	1.2947
No log	9.2195	378	1.5778	0.3968	1.5778	1.2561
No log	9.2683	380	1.4786	0.3968	1.4786	1.2160
No log	9.3171	382	1.4945	0.3968	1.4945	1.2225
No log	9.3659	384	1.5817	0.4094	1.5817	1.2577
No log	9.4146	386	1.6113	0.4094	1.6113	1.2694
No log	9.4634	388	1.5551	0.4094	1.5551	1.2470
No log	9.5122	390	1.5470	0.4094	1.5470	1.2438
No log	9.5610	392	1.6544	0.3817	1.6544	1.2862
No log	9.6098	394	1.6676	0.3636	1.6676	1.2914
No log	9.6585	396	1.5624	0.4031	1.5624	1.2500
No log	9.7073	398	1.4234	0.4286	1.4234	1.1931
No log	9.7561	400	1.3718	0.4286	1.3718	1.1712
No log	9.8049	402	1.4362	0.4219	1.4362	1.1984
No log	9.8537	404	1.5938	0.3433	1.5938	1.2625
No log	9.9024	406	1.8226	0.2899	1.8226	1.3500
No log	9.9512	408	1.8647	0.2590	1.8647	1.3655
No log	10.0	410	1.8401	0.2609	1.8401	1.3565
No log	10.0488	412	1.7767	0.3459	1.7767	1.3329
No log	10.0976	414	1.7056	0.3538	1.7056	1.3060
No log	10.1463	416	1.5598	0.3566	1.5598	1.2489
No log	10.1951	418	1.4869	0.384	1.4869	1.2194
No log	10.2439	420	1.5457	0.4031	1.5457	1.2433
No log	10.2927	422	1.6504	0.3664	1.6504	1.2847
No log	10.3415	424	1.7414	0.3158	1.7414	1.3196
No log	10.3902	426	1.7760	0.3284	1.7760	1.3327
No log	10.4390	428	1.6578	0.4	1.6578	1.2876
No log	10.4878	430	1.5069	0.3968	1.5069	1.2276
No log	10.5366	432	1.4753	0.3968	1.4753	1.2146
No log	10.5854	434	1.5465	0.4031	1.5465	1.2436
No log	10.6341	436	1.7328	0.2963	1.7328	1.3163
No log	10.6829	438	1.9095	0.2734	1.9095	1.3818
No log	10.7317	440	1.9300	0.2571	1.9300	1.3892
No log	10.7805	442	1.8070	0.3088	1.8070	1.3443
No log	10.8293	444	1.6238	0.4094	1.6238	1.2743
No log	10.8780	446	1.4422	0.3193	1.4422	1.2009
No log	10.9268	448	1.3442	0.3697	1.3442	1.1594
No log	10.9756	450	1.3337	0.3833	1.3337	1.1548
No log	11.0244	452	1.3896	0.3077	1.3896	1.1788
No log	11.0732	454	1.5809	0.4127	1.5809	1.2573
No log	11.1220	456	1.7419	0.3459	1.7419	1.3198
No log	11.1707	458	1.7541	0.3459	1.7541	1.3244
No log	11.2195	460	1.6609	0.3846	1.6609	1.2888
No log	11.2683	462	1.5505	0.3710	1.5505	1.2452
No log	11.3171	464	1.5115	0.4094	1.5115	1.2294
No log	11.3659	466	1.4841	0.4094	1.4841	1.2182
No log	11.4146	468	1.4723	0.4094	1.4723	1.2134
No log	11.4634	470	1.4735	0.4286	1.4735	1.2139
No log	11.5122	472	1.5840	0.4219	1.5840	1.2586
No log	11.5610	474	1.7687	0.3212	1.7687	1.3299
No log	11.6098	476	1.8589	0.2734	1.8589	1.3634
No log	11.6585	478	1.7734	0.2899	1.7734	1.3317
No log	11.7073	480	1.5534	0.4219	1.5534	1.2464
No log	11.7561	482	1.3375	0.4160	1.3375	1.1565
No log	11.8049	484	1.2729	0.4516	1.2729	1.1282
No log	11.8537	486	1.3077	0.4065	1.3077	1.1436
No log	11.9024	488	1.4328	0.4160	1.4328	1.1970
No log	11.9512	490	1.6551	0.3664	1.6551	1.2865
No log	12.0	492	1.7359	0.3609	1.7359	1.3175
No log	12.0488	494	1.6622	0.3609	1.6622	1.2893
No log	12.0976	496	1.5320	0.4186	1.5320	1.2377
No log	12.1463	498	1.4445	0.4409	1.4445	1.2019
0.4344	12.1951	500	1.4052	0.4409	1.4052	1.1854
0.4344	12.2439	502	1.4509	0.4375	1.4509	1.2045
0.4344	12.2927	504	1.5236	0.4122	1.5236	1.2343
0.4344	12.3415	506	1.4705	0.4375	1.4705	1.2126
0.4344	12.3902	508	1.4372	0.4375	1.4372	1.1988
0.4344	12.4390	510	1.4941	0.4375	1.4941	1.2223

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1