ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1071
• Qwk: 0.2143
• Mse: 2.1071
• Rmse: 1.4516

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0263	2	6.8196	0.0056	6.8196	2.6114
No log	0.0526	4	4.7801	0.0830	4.7801	2.1863
No log	0.0789	6	3.4740	-0.0104	3.4740	1.8639
No log	0.1053	8	2.6760	0.1192	2.6760	1.6358
No log	0.1316	10	1.9079	0.1391	1.9079	1.3812
No log	0.1579	12	2.0448	0.1774	2.0448	1.4300
No log	0.1842	14	1.9455	0.1368	1.9455	1.3948
No log	0.2105	16	1.9428	0.1217	1.9428	1.3939
No log	0.2368	18	2.2011	0.0630	2.2011	1.4836
No log	0.2632	20	2.2047	0.0625	2.2047	1.4848
No log	0.2895	22	1.9586	0.1600	1.9586	1.3995
No log	0.3158	24	1.6998	0.2373	1.6998	1.3038
No log	0.3421	26	1.7447	0.25	1.7447	1.3209
No log	0.3684	28	1.8945	0.125	1.8945	1.3764
No log	0.3947	30	1.8972	0.1593	1.8972	1.3774
No log	0.4211	32	1.5993	0.2162	1.5993	1.2646
No log	0.4474	34	1.7546	0.3279	1.7546	1.3246
No log	0.4737	36	1.9192	0.2812	1.9192	1.3853
No log	0.5	38	1.9077	0.3150	1.9077	1.3812
No log	0.5263	40	1.6974	0.2333	1.6974	1.3028
No log	0.5526	42	1.7436	0.3252	1.7436	1.3205
No log	0.5789	44	1.6121	0.3279	1.6121	1.2697
No log	0.6053	46	1.4530	0.2222	1.4530	1.2054
No log	0.6316	48	1.4467	0.2407	1.4467	1.2028
No log	0.6579	50	1.7978	0.2056	1.7978	1.3408
No log	0.6842	52	1.9418	0.0583	1.9418	1.3935
No log	0.7105	54	1.9114	0.0189	1.9114	1.3826
No log	0.7368	56	1.8915	0.0901	1.8915	1.3753
No log	0.7632	58	1.7835	0.125	1.7835	1.3355
No log	0.7895	60	1.7932	0.1379	1.7932	1.3391
No log	0.8158	62	1.7815	0.0926	1.7815	1.3347
No log	0.8421	64	1.9184	0.1273	1.9184	1.3851
No log	0.8684	66	2.0791	0.0877	2.0791	1.4419
No log	0.8947	68	2.0648	0.1034	2.0648	1.4370
No log	0.9211	70	1.7941	0.0901	1.7941	1.3394
No log	0.9474	72	1.6780	0.1296	1.6780	1.2954
No log	0.9737	74	1.8663	0.0909	1.8663	1.3661
No log	1.0	76	2.1379	0.0175	2.1379	1.4621
No log	1.0263	78	2.0169	0.1062	2.0169	1.4202
No log	1.0526	80	1.7422	0.2655	1.7422	1.3199
No log	1.0789	82	1.6826	0.2982	1.6826	1.2972
No log	1.1053	84	1.5448	0.3652	1.5448	1.2429
No log	1.1316	86	1.5423	0.4167	1.5423	1.2419
No log	1.1579	88	1.6582	0.3360	1.6582	1.2877
No log	1.1842	90	1.9182	0.1515	1.9182	1.3850
No log	1.2105	92	1.9734	0.1221	1.9734	1.4048
No log	1.2368	94	1.8181	0.3008	1.8181	1.3484
No log	1.2632	96	1.7243	0.3360	1.7243	1.3131
No log	1.2895	98	1.8837	0.1905	1.8837	1.3725
No log	1.3158	100	2.0623	0.0336	2.0623	1.4361
No log	1.3421	102	2.0881	0.0504	2.0881	1.4450
No log	1.3684	104	2.0590	0.0	2.0590	1.4349
No log	1.3947	106	1.9465	0.0526	1.9465	1.3952
No log	1.4211	108	2.0684	0.0360	2.0684	1.4382
No log	1.4474	110	2.2850	-0.0526	2.2850	1.5116
No log	1.4737	112	2.5206	-0.1709	2.5206	1.5876
No log	1.5	114	2.4672	-0.0877	2.4672	1.5707
No log	1.5263	116	2.1667	0.0504	2.1667	1.4720
No log	1.5526	118	2.0348	0.1138	2.0348	1.4265
No log	1.5789	120	2.0482	0.1085	2.0482	1.4312
No log	1.6053	122	2.1080	0.0775	2.1080	1.4519
No log	1.6316	124	2.1434	0.1493	2.1434	1.4640
No log	1.6579	126	1.9946	0.2014	1.9946	1.4123
No log	1.6842	128	1.7472	0.3077	1.7472	1.3218
No log	1.7105	130	1.7074	0.3256	1.7074	1.3067
No log	1.7368	132	1.8598	0.2429	1.8598	1.3637
No log	1.7632	134	2.0714	0.2190	2.0714	1.4392
No log	1.7895	136	2.0624	0.1926	2.0624	1.4361
No log	1.8158	138	1.9221	0.2239	1.9221	1.3864
No log	1.8421	140	1.7463	0.2769	1.7463	1.3215
No log	1.8684	142	1.7441	0.3231	1.7441	1.3207
No log	1.8947	144	1.7682	0.2857	1.7682	1.3297
No log	1.9211	146	1.7858	0.2443	1.7858	1.3363
No log	1.9474	148	1.8693	0.2031	1.8693	1.3672
No log	1.9737	150	1.8438	0.1732	1.8438	1.3579
No log	2.0	152	1.7163	0.2923	1.7163	1.3101
No log	2.0263	154	1.6210	0.3594	1.6210	1.2732
No log	2.0526	156	1.6032	0.3307	1.6032	1.2662
No log	2.0789	158	1.5673	0.3492	1.5673	1.2519
No log	2.1053	160	1.6143	0.3817	1.6143	1.2706
No log	2.1316	162	1.7159	0.3158	1.7159	1.3099
No log	2.1579	164	1.6967	0.3158	1.6967	1.3026
No log	2.1842	166	1.7604	0.3212	1.7604	1.3268
No log	2.2105	168	1.9201	0.2302	1.9201	1.3857
No log	2.2368	170	1.9777	0.2345	1.9777	1.4063
No log	2.2632	172	1.9438	0.2192	1.9438	1.3942
No log	2.2895	174	2.0614	0.2345	2.0614	1.4358
No log	2.3158	176	2.0409	0.2222	2.0409	1.4286
No log	2.3421	178	1.9025	0.2378	1.9025	1.3793
No log	2.3684	180	1.8467	0.2378	1.8467	1.3589
No log	2.3947	182	1.8455	0.25	1.8455	1.3585
No log	2.4211	184	1.8520	0.2985	1.8520	1.3609
No log	2.4474	186	1.8014	0.3182	1.8014	1.3422
No log	2.4737	188	1.8106	0.2464	1.8106	1.3456
No log	2.5	190	1.9857	0.1831	1.9857	1.4091
No log	2.5263	192	2.0927	0.1831	2.0927	1.4466
No log	2.5526	194	2.0812	0.1831	2.0812	1.4426
No log	2.5789	196	1.9276	0.2014	1.9276	1.3884
No log	2.6053	198	1.7843	0.2590	1.7843	1.3358
No log	2.6316	200	1.8172	0.2074	1.8172	1.3480
No log	2.6579	202	1.9412	0.2044	1.9412	1.3933
No log	2.6842	204	2.0210	0.2000	2.0210	1.4216
No log	2.7105	206	1.9150	0.2014	1.9150	1.3838
No log	2.7368	208	1.8468	0.2174	1.8468	1.3590
No log	2.7632	210	1.7350	0.2667	1.7350	1.3172
No log	2.7895	212	1.7655	0.2774	1.7655	1.3287
No log	2.8158	214	1.9856	0.1986	1.9856	1.4091
No log	2.8421	216	2.0947	0.1714	2.0947	1.4473
No log	2.8684	218	1.9898	0.1203	1.9898	1.4106
No log	2.8947	220	1.9185	0.0781	1.9185	1.3851
No log	2.9211	222	1.8450	0.1732	1.8450	1.3583
No log	2.9474	224	1.9333	0.1094	1.9333	1.3904
No log	2.9737	226	2.0743	0.0775	2.0743	1.4403
No log	3.0	228	2.0550	0.0758	2.0550	1.4335
No log	3.0263	230	1.9654	0.1884	1.9654	1.4019
No log	3.0526	232	2.0633	0.1871	2.0633	1.4364
No log	3.0789	234	2.2312	0.1460	2.2312	1.4937
No log	3.1053	236	2.3065	0.0611	2.3065	1.5187
No log	3.1316	238	2.1854	0.0645	2.1854	1.4783
No log	3.1579	240	1.9502	0.1452	1.9502	1.3965
No log	3.1842	242	1.7435	0.2615	1.7435	1.3204
No log	3.2105	244	1.6601	0.3721	1.6601	1.2885
No log	3.2368	246	1.6658	0.3459	1.6658	1.2907
No log	3.2632	248	1.8593	0.2857	1.8593	1.3636
No log	3.2895	250	2.0305	0.2286	2.0305	1.4249
No log	3.3158	252	2.0741	0.2394	2.0741	1.4402
No log	3.3421	254	1.9610	0.2695	1.9610	1.4003
No log	3.3684	256	1.9140	0.2695	1.9140	1.3835
No log	3.3947	258	1.8013	0.2878	1.8013	1.3421
No log	3.4211	260	1.7401	0.3359	1.7401	1.3191
No log	3.4474	262	1.7053	0.2880	1.7053	1.3059
No log	3.4737	264	1.6571	0.3279	1.6571	1.2873
No log	3.5	266	1.6504	0.3411	1.6504	1.2847
No log	3.5263	268	1.6730	0.3158	1.6730	1.2934
No log	3.5526	270	1.6623	0.3459	1.6623	1.2893
No log	3.5789	272	1.6973	0.3433	1.6973	1.3028
No log	3.6053	274	1.8444	0.2774	1.8444	1.3581
No log	3.6316	276	1.8426	0.2609	1.8426	1.3574
No log	3.6579	278	1.8712	0.2609	1.8712	1.3679
No log	3.6842	280	1.8311	0.2920	1.8311	1.3532
No log	3.7105	282	1.8030	0.2920	1.8030	1.3427
No log	3.7368	284	1.9191	0.2302	1.9191	1.3853
No log	3.7632	286	2.0126	0.1831	2.0126	1.4187
No log	3.7895	288	2.0704	0.1831	2.0704	1.4389
No log	3.8158	290	2.0098	0.1831	2.0098	1.4177
No log	3.8421	292	1.8144	0.3000	1.8144	1.3470
No log	3.8684	294	1.7803	0.3407	1.7803	1.3343
No log	3.8947	296	1.6754	0.4091	1.6754	1.2944
No log	3.9211	298	1.7555	0.3636	1.7555	1.3249
No log	3.9474	300	1.9008	0.2754	1.9008	1.3787
No log	3.9737	302	2.0750	0.2429	2.0750	1.4405
No log	4.0	304	1.9888	0.2590	1.9888	1.4102
No log	4.0263	306	1.9437	0.2878	1.9437	1.3942
No log	4.0526	308	1.8283	0.3000	1.8283	1.3522
No log	4.0789	310	1.7598	0.3556	1.7598	1.3266
No log	4.1053	312	1.8627	0.2899	1.8627	1.3648
No log	4.1316	314	2.0318	0.2571	2.0318	1.4254
No log	4.1579	316	2.0044	0.2482	2.0044	1.4158
No log	4.1842	318	1.8749	0.2556	1.8749	1.3693
No log	4.2105	320	1.8334	0.2656	1.8334	1.3540
No log	4.2368	322	1.9078	0.2290	1.9078	1.3812
No log	4.2632	324	1.9487	0.2336	1.9487	1.3960
No log	4.2895	326	1.9790	0.2158	1.9790	1.4068
No log	4.3158	328	2.0737	0.1986	2.0737	1.4400
No log	4.3421	330	2.1041	0.1986	2.1041	1.4505
No log	4.3684	332	2.2023	0.1831	2.2023	1.4840
No log	4.3947	334	2.0904	0.1986	2.0904	1.4458
No log	4.4211	336	1.8280	0.3134	1.8280	1.3520
No log	4.4474	338	1.7293	0.3308	1.7293	1.3150
No log	4.4737	340	1.7721	0.3182	1.7721	1.3312
No log	4.5	342	1.7829	0.3206	1.7829	1.3352
No log	4.5263	344	1.7778	0.3308	1.7778	1.3334
No log	4.5526	346	1.8091	0.3308	1.8091	1.3450
No log	4.5789	348	1.8887	0.2815	1.8887	1.3743
No log	4.6053	350	1.9700	0.2774	1.9700	1.4036
No log	4.6316	352	1.9824	0.2774	1.9824	1.4080
No log	4.6579	354	2.0100	0.2609	2.0100	1.4178
No log	4.6842	356	2.1061	0.1690	2.1061	1.4513
No log	4.7105	358	2.0968	0.1690	2.0968	1.4480
No log	4.7368	360	1.9348	0.2319	1.9348	1.3910
No log	4.7632	362	1.7568	0.3308	1.7568	1.3254
No log	4.7895	364	1.7399	0.3333	1.7399	1.3190
No log	4.8158	366	1.8435	0.2963	1.8435	1.3578
No log	4.8421	368	1.8957	0.2647	1.8957	1.3768
No log	4.8684	370	1.8493	0.2647	1.8493	1.3599
No log	4.8947	372	1.7288	0.3359	1.7288	1.3148
No log	4.9211	374	1.7291	0.3359	1.7291	1.3150
No log	4.9474	376	1.7653	0.2985	1.7653	1.3286
No log	4.9737	378	1.9215	0.2336	1.9215	1.3862
No log	5.0	380	1.9782	0.2158	1.9782	1.4065
No log	5.0263	382	2.0573	0.1831	2.0573	1.4343
No log	5.0526	384	2.0565	0.1831	2.0565	1.4340
No log	5.0789	386	2.0134	0.2000	2.0134	1.4189
No log	5.1053	388	1.7797	0.3433	1.7797	1.3341
No log	5.1316	390	1.5747	0.4032	1.5747	1.2549
No log	5.1579	392	1.5270	0.3248	1.5270	1.2357
No log	5.1842	394	1.6025	0.3934	1.6025	1.2659
No log	5.2105	396	1.7618	0.3692	1.7618	1.3273
No log	5.2368	398	1.8807	0.2647	1.8807	1.3714
No log	5.2632	400	1.8830	0.2464	1.8830	1.3722
No log	5.2895	402	1.9365	0.2286	1.9365	1.3916
No log	5.3158	404	1.8578	0.3088	1.8578	1.3630
No log	5.3421	406	1.8046	0.3259	1.8046	1.3433
No log	5.3684	408	1.8301	0.2647	1.8301	1.3528
No log	5.3947	410	1.7797	0.2815	1.7797	1.3341
No log	5.4211	412	1.6727	0.3077	1.6727	1.2933
No log	5.4474	414	1.6475	0.3609	1.6475	1.2835
No log	5.4737	416	1.6738	0.3609	1.6738	1.2937
No log	5.5	418	1.8249	0.2482	1.8249	1.3509
No log	5.5263	420	1.8335	0.2482	1.8335	1.3541
No log	5.5526	422	1.7855	0.2647	1.7855	1.3362
No log	5.5789	424	1.6901	0.3459	1.6901	1.3000
No log	5.6053	426	1.7065	0.3459	1.7065	1.3063
No log	5.6316	428	1.7519	0.2985	1.7519	1.3236
No log	5.6579	430	1.8480	0.2647	1.8480	1.3594
No log	5.6842	432	1.9070	0.2336	1.9070	1.3809
No log	5.7105	434	1.9594	0.2174	1.9594	1.3998
No log	5.7368	436	1.8925	0.2174	1.8925	1.3757
No log	5.7632	438	1.8102	0.3111	1.8102	1.3454
No log	5.7895	440	1.7511	0.3333	1.7511	1.3233
No log	5.8158	442	1.7056	0.3538	1.7056	1.3060
No log	5.8421	444	1.7592	0.3333	1.7592	1.3264
No log	5.8684	446	1.9508	0.2647	1.9508	1.3967
No log	5.8947	448	2.1567	0.1831	2.1567	1.4686
No log	5.9211	450	2.2811	0.1831	2.2811	1.5103
No log	5.9474	452	2.2007	0.1831	2.2007	1.4835
No log	5.9737	454	2.0485	0.1884	2.0485	1.4313
No log	6.0	456	2.0005	0.1481	2.0005	1.4144
No log	6.0263	458	2.0775	0.1324	2.0775	1.4414
No log	6.0526	460	2.1412	0.2113	2.1412	1.4633
No log	6.0789	462	2.1298	0.1831	2.1298	1.4594
No log	6.1053	464	1.9343	0.2482	1.9343	1.3908
No log	6.1316	466	1.6984	0.3206	1.6984	1.3032
No log	6.1579	468	1.6126	0.4186	1.6126	1.2699
No log	6.1842	470	1.6662	0.3538	1.6662	1.2908
No log	6.2105	472	1.8667	0.2482	1.8667	1.3663
No log	6.2368	474	2.0510	0.2128	2.0510	1.4321
No log	6.2632	476	2.0698	0.2128	2.0698	1.4387
No log	6.2895	478	1.9090	0.2482	1.9090	1.3817
No log	6.3158	480	1.6644	0.3664	1.6644	1.2901
No log	6.3421	482	1.5342	0.4031	1.5342	1.2386
No log	6.3684	484	1.4916	0.4409	1.4916	1.2213
No log	6.3947	486	1.5317	0.3906	1.5317	1.2376
No log	6.4211	488	1.6928	0.3407	1.6928	1.3011
No log	6.4474	490	1.8470	0.2920	1.8470	1.3591
No log	6.4737	492	2.0576	0.2128	2.0576	1.4344
No log	6.5	494	2.0963	0.2128	2.0963	1.4479
No log	6.5263	496	2.1878	0.2128	2.1878	1.4791
No log	6.5526	498	2.1201	0.2128	2.1201	1.4561
0.4045	6.5789	500	2.0043	0.2143	2.0043	1.4157
0.4045	6.6053	502	1.9518	0.2158	1.9518	1.3971
0.4045	6.6316	504	1.8142	0.3088	1.8142	1.3469
0.4045	6.6579	506	1.7409	0.3284	1.7409	1.3194
0.4045	6.6842	508	1.8583	0.2815	1.8583	1.3632
0.4045	6.7105	510	2.0448	0.2158	2.0448	1.4300
0.4045	6.7368	512	2.1556	0.2143	2.1556	1.4682
0.4045	6.7632	514	2.1745	0.2143	2.1745	1.4746
0.4045	6.7895	516	2.2529	0.1986	2.2529	1.5010
0.4045	6.8158	518	2.2030	0.1986	2.2030	1.4842
0.4045	6.8421	520	2.0158	0.2158	2.0158	1.4198
0.4045	6.8684	522	1.9452	0.2158	1.9452	1.3947
0.4045	6.8947	524	1.8086	0.3111	1.8086	1.3449
0.4045	6.9211	526	1.7695	0.3284	1.7695	1.3302
0.4045	6.9474	528	1.8371	0.2941	1.8371	1.3554
0.4045	6.9737	530	1.9929	0.2464	1.9929	1.4117
0.4045	7.0	532	2.2265	0.1986	2.2265	1.4921
0.4045	7.0263	534	2.3263	0.1831	2.3263	1.5252
0.4045	7.0526	536	2.2365	0.1831	2.2365	1.4955
0.4045	7.0789	538	2.1373	0.2143	2.1373	1.4620
0.4045	7.1053	540	2.1071	0.2143	2.1071	1.4516

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1