ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8245
• Qwk: 0.2464
• Mse: 1.8245
• Rmse: 1.3507

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0235	2	6.0595	-0.0067	6.0595	2.4616
No log	0.0471	4	4.6895	-0.0913	4.6895	2.1655
No log	0.0706	6	4.1982	-0.1128	4.1982	2.0490
No log	0.0941	8	3.3642	-0.1118	3.3642	1.8342
No log	0.1176	10	3.2791	-0.1242	3.2791	1.8108
No log	0.1412	12	3.4210	-0.0723	3.4210	1.8496
No log	0.1647	14	2.4236	0.0435	2.4236	1.5568
No log	0.1882	16	2.1826	0.1151	2.1826	1.4774
No log	0.2118	18	2.1228	0.1471	2.1228	1.4570
No log	0.2353	20	1.9820	0.2188	1.9820	1.4078
No log	0.2588	22	1.8264	0.2124	1.8264	1.3514
No log	0.2824	24	1.7348	0.1538	1.7348	1.3171
No log	0.3059	26	1.7425	0.0971	1.7425	1.3200
No log	0.3294	28	1.6427	0.0971	1.6427	1.2817
No log	0.3529	30	1.5369	0.1682	1.5369	1.2397
No log	0.3765	32	1.6510	0.3443	1.6510	1.2849
No log	0.4	34	1.9433	0.4060	1.9433	1.3940
No log	0.4235	36	1.9688	0.3259	1.9688	1.4031
No log	0.4471	38	2.0212	0.2857	2.0212	1.4217
No log	0.4706	40	2.2370	0.1314	2.2370	1.4957
No log	0.4941	42	2.0744	0.1000	2.0744	1.4403
No log	0.5176	44	1.6466	0.2182	1.6466	1.2832
No log	0.5412	46	1.5975	0.3360	1.5975	1.2639
No log	0.5647	48	1.6215	0.4062	1.6215	1.2734
No log	0.5882	50	1.3707	0.3667	1.3707	1.1708
No log	0.6118	52	1.5285	0.2689	1.5285	1.2363
No log	0.6353	54	1.6549	0.1622	1.6549	1.2864
No log	0.6588	56	1.5555	0.2927	1.5555	1.2472
No log	0.6824	58	1.3715	0.4724	1.3715	1.1711
No log	0.7059	60	1.3478	0.5797	1.3478	1.1610
No log	0.7294	62	1.4130	0.4427	1.4130	1.1887
No log	0.7529	64	1.4592	0.3651	1.4592	1.2080
No log	0.7765	66	1.3825	0.4853	1.3825	1.1758
No log	0.8	68	1.3385	0.4895	1.3385	1.1569
No log	0.8235	70	1.4430	0.4203	1.4430	1.2012
No log	0.8471	72	1.6924	0.2667	1.6924	1.3009
No log	0.8706	74	1.6277	0.2985	1.6277	1.2758
No log	0.8941	76	1.3996	0.4179	1.3996	1.1831
No log	0.9176	78	1.2580	0.5113	1.2580	1.1216
No log	0.9412	80	1.2213	0.6029	1.2213	1.1051
No log	0.9647	82	1.1152	0.6861	1.1152	1.0560
No log	0.9882	84	1.0335	0.6815	1.0335	1.0166
No log	1.0118	86	0.9553	0.6667	0.9553	0.9774
No log	1.0353	88	1.1060	0.6074	1.1060	1.0517
No log	1.0588	90	1.2136	0.5	1.2136	1.1016
No log	1.0824	92	1.4177	0.4	1.4177	1.1907
No log	1.1059	94	1.9275	0.2695	1.9275	1.3884
No log	1.1294	96	1.9138	0.3000	1.9138	1.3834
No log	1.1529	98	1.8541	0.2794	1.8541	1.3616
No log	1.1765	100	1.6242	0.3231	1.6242	1.2744
No log	1.2	102	1.4140	0.4370	1.4140	1.1891
No log	1.2235	104	1.3875	0.4833	1.3875	1.1779
No log	1.2471	106	1.3842	0.4833	1.3842	1.1765
No log	1.2706	108	1.3977	0.4921	1.3977	1.1822
No log	1.2941	110	1.4822	0.3731	1.4822	1.2175
No log	1.3176	112	1.5496	0.3676	1.5496	1.2448
No log	1.3412	114	1.5145	0.3704	1.5145	1.2306
No log	1.3647	116	1.4665	0.3731	1.4665	1.2110
No log	1.3882	118	1.4596	0.3731	1.4596	1.2081
No log	1.4118	120	1.5204	0.3676	1.5204	1.2331
No log	1.4353	122	1.4466	0.3650	1.4466	1.2027
No log	1.4588	124	1.4105	0.3433	1.4105	1.1877
No log	1.4824	126	1.3835	0.3910	1.3835	1.1762
No log	1.5059	128	1.3329	0.4444	1.3329	1.1545
No log	1.5294	130	1.3819	0.4143	1.3819	1.1756
No log	1.5529	132	1.4717	0.3623	1.4717	1.2131
No log	1.5765	134	1.5446	0.3714	1.5446	1.2428
No log	1.6	136	1.5676	0.3546	1.5676	1.2521
No log	1.6235	138	1.2658	0.4559	1.2658	1.1251
No log	1.6471	140	1.1639	0.5152	1.1639	1.0789
No log	1.6706	142	1.2372	0.4889	1.2372	1.1123
No log	1.6941	144	1.2677	0.4559	1.2677	1.1259
No log	1.7176	146	1.3538	0.4348	1.3538	1.1635
No log	1.7412	148	1.1899	0.5401	1.1899	1.0908
No log	1.7647	150	1.1737	0.5588	1.1737	1.0834
No log	1.7882	152	1.3367	0.4348	1.3367	1.1561
No log	1.8118	154	1.7045	0.3885	1.7045	1.3056
No log	1.8353	156	1.9910	0.0484	1.9910	1.4110
No log	1.8588	158	1.9931	0.0465	1.9931	1.4118
No log	1.8824	160	1.7481	0.2774	1.7481	1.3222
No log	1.9059	162	1.4046	0.4058	1.4046	1.1852
No log	1.9294	164	1.2801	0.4328	1.2801	1.1314
No log	1.9529	166	1.3664	0.4173	1.3664	1.1689
No log	1.9765	168	1.5102	0.3942	1.5102	1.2289
No log	2.0	170	1.7137	0.3235	1.7137	1.3091
No log	2.0235	172	1.8321	0.2899	1.8321	1.3535
No log	2.0471	174	1.6572	0.3235	1.6572	1.2873
No log	2.0706	176	1.4489	0.3942	1.4489	1.2037
No log	2.0941	178	1.4511	0.3942	1.4511	1.2046
No log	2.1176	180	1.4938	0.3942	1.4938	1.2222
No log	2.1412	182	1.8310	0.3490	1.8310	1.3532
No log	2.1647	184	2.1280	0.2649	2.1280	1.4588
No log	2.1882	186	2.2086	0.2041	2.2086	1.4861
No log	2.2118	188	2.0035	0.2394	2.0035	1.4154
No log	2.2353	190	1.7878	0.2734	1.7878	1.3371
No log	2.2588	192	1.5538	0.3407	1.5538	1.2465
No log	2.2824	194	1.3709	0.5116	1.3709	1.1709
No log	2.3059	196	1.3320	0.512	1.3320	1.1541
No log	2.3294	198	1.3971	0.4228	1.3971	1.1820
No log	2.3529	200	1.5369	0.4127	1.5369	1.2397
No log	2.3765	202	1.6947	0.3407	1.6947	1.3018
No log	2.4	204	1.7428	0.2590	1.7428	1.3202
No log	2.4235	206	1.6479	0.3022	1.6479	1.2837
No log	2.4471	208	1.6519	0.3022	1.6519	1.2853
No log	2.4706	210	1.7405	0.2857	1.7405	1.3193
No log	2.4941	212	1.8747	0.2571	1.8747	1.3692
No log	2.5176	214	1.8267	0.2571	1.8267	1.3515
No log	2.5412	216	1.7910	0.2590	1.7910	1.3383
No log	2.5647	218	1.8044	0.2590	1.8044	1.3433
No log	2.5882	220	1.8169	0.2571	1.8169	1.3479
No log	2.6118	222	1.6935	0.3008	1.6935	1.3014
No log	2.6353	224	1.5687	0.3485	1.5687	1.2525
No log	2.6588	226	1.6090	0.3333	1.6090	1.2684
No log	2.6824	228	1.5712	0.3504	1.5712	1.2535
No log	2.7059	230	1.7081	0.2857	1.7081	1.3069
No log	2.7294	232	1.9332	0.2571	1.9332	1.3904
No log	2.7529	234	2.0273	0.2098	2.0273	1.4238
No log	2.7765	236	1.8979	0.2571	1.8979	1.3776
No log	2.8	238	1.7540	0.2571	1.7540	1.3244
No log	2.8235	240	1.5871	0.3714	1.5871	1.2598
No log	2.8471	242	1.5554	0.3972	1.5554	1.2471
No log	2.8706	244	1.6656	0.3286	1.6656	1.2906
No log	2.8941	246	1.7247	0.3066	1.7247	1.3133
No log	2.9176	248	1.7010	0.3066	1.7010	1.3042
No log	2.9412	250	1.4814	0.3676	1.4814	1.2171
No log	2.9647	252	1.3735	0.4060	1.3735	1.1719
No log	2.9882	254	1.4750	0.3768	1.4750	1.2145
No log	3.0118	256	1.6713	0.3333	1.6713	1.2928
No log	3.0353	258	1.8854	0.2734	1.8854	1.3731
No log	3.0588	260	1.9857	0.2571	1.9857	1.4091
No log	3.0824	262	1.8666	0.2754	1.8666	1.3662
No log	3.1059	264	1.6191	0.3504	1.6191	1.2724
No log	3.1294	266	1.3779	0.4179	1.3779	1.1738
No log	3.1529	268	1.3410	0.4545	1.3410	1.1580
No log	3.1765	270	1.4976	0.3704	1.4976	1.2238
No log	3.2	272	1.7543	0.3066	1.7543	1.3245
No log	3.2235	274	1.8446	0.2754	1.8446	1.3582
No log	3.2471	276	1.8631	0.2754	1.8631	1.3649
No log	3.2706	278	1.8625	0.2958	1.8625	1.3647
No log	3.2941	280	1.7439	0.3066	1.7439	1.3206
No log	3.3176	282	1.5327	0.3676	1.5327	1.2380
No log	3.3412	284	1.3727	0.4122	1.3727	1.1716
No log	3.3647	286	1.3742	0.4567	1.3742	1.1723
No log	3.3882	288	1.4510	0.3876	1.4510	1.2046
No log	3.4118	290	1.5618	0.3459	1.5618	1.2497
No log	3.4353	292	1.6118	0.3504	1.6118	1.2696
No log	3.4588	294	1.5345	0.3852	1.5345	1.2388
No log	3.4824	296	1.7108	0.375	1.7108	1.3080
No log	3.5059	298	1.7202	0.375	1.7202	1.3116
No log	3.5294	300	1.7504	0.3043	1.7504	1.3230
No log	3.5529	302	1.6929	0.3043	1.6929	1.3011
No log	3.5765	304	1.6556	0.3235	1.6556	1.2867
No log	3.6	306	1.5591	0.3609	1.5591	1.2486
No log	3.6235	308	1.5128	0.4	1.5128	1.2299
No log	3.6471	310	1.6348	0.3235	1.6348	1.2786
No log	3.6706	312	1.6768	0.3066	1.6768	1.2949
No log	3.6941	314	1.7089	0.3066	1.7089	1.3073
No log	3.7176	316	1.6437	0.3066	1.6437	1.2821
No log	3.7412	318	1.6510	0.3066	1.6510	1.2849
No log	3.7647	320	1.7225	0.3066	1.7225	1.3124
No log	3.7882	322	1.7613	0.3066	1.7613	1.3271
No log	3.8118	324	1.6320	0.3235	1.6320	1.2775
No log	3.8353	326	1.4702	0.3158	1.4702	1.2125
No log	3.8588	328	1.4231	0.3333	1.4231	1.1929
No log	3.8824	330	1.4596	0.3284	1.4596	1.2081
No log	3.9059	332	1.5721	0.3235	1.5721	1.2538
No log	3.9294	334	1.6540	0.3662	1.6540	1.2861
No log	3.9529	336	1.4428	0.4	1.4428	1.2012
No log	3.9765	338	1.3806	0.4058	1.3806	1.1750
No log	4.0	340	1.5574	0.3407	1.5574	1.2480
No log	4.0235	342	1.8671	0.3378	1.8671	1.3664
No log	4.0471	344	1.8128	0.2754	1.8128	1.3464
No log	4.0706	346	1.5767	0.3485	1.5767	1.2557
No log	4.0941	348	1.4594	0.3385	1.4594	1.2081
No log	4.1176	350	1.3784	0.3810	1.3784	1.1741
No log	4.1412	352	1.4665	0.3284	1.4665	1.2110
No log	4.1647	354	1.6222	0.2941	1.6222	1.2737
No log	4.1882	356	1.6336	0.2941	1.6336	1.2781
No log	4.2118	358	1.5876	0.2941	1.5876	1.2600
No log	4.2353	360	1.6978	0.2899	1.6978	1.3030
No log	4.2588	362	1.6939	0.2899	1.6939	1.3015
No log	4.2824	364	1.6979	0.2899	1.6979	1.3030
No log	4.3059	366	1.7163	0.2590	1.7163	1.3101
No log	4.3294	368	1.7922	0.2590	1.7922	1.3387
No log	4.3529	370	1.8224	0.2336	1.8224	1.3500
No log	4.3765	372	1.8749	0.2336	1.8749	1.3693
No log	4.4	374	1.8765	0.2336	1.8765	1.3699
No log	4.4235	376	1.7768	0.2336	1.7768	1.3330
No log	4.4471	378	1.6549	0.2774	1.6549	1.2864
No log	4.4706	380	1.5800	0.3529	1.5800	1.2570
No log	4.4941	382	1.6623	0.2609	1.6623	1.2893
No log	4.5176	384	1.8770	0.2714	1.8770	1.3700
No log	4.5412	386	2.0512	0.2446	2.0512	1.4322
No log	4.5647	388	2.0616	0.2446	2.0616	1.4358
No log	4.5882	390	2.0489	0.2446	2.0489	1.4314
No log	4.6118	392	1.9033	0.2714	1.9033	1.3796
No log	4.6353	394	1.8329	0.2609	1.8329	1.3538
No log	4.6588	396	1.9276	0.2937	1.9276	1.3884
No log	4.6824	398	1.8753	0.2958	1.8753	1.3694
No log	4.7059	400	1.7753	0.2734	1.7753	1.3324
No log	4.7294	402	1.6412	0.3088	1.6412	1.2811
No log	4.7529	404	1.6605	0.3088	1.6605	1.2886
No log	4.7765	406	1.6176	0.3088	1.6176	1.2718
No log	4.8	408	1.6353	0.2774	1.6353	1.2788
No log	4.8235	410	1.7512	0.2899	1.7512	1.3233
No log	4.8471	412	1.9692	0.2571	1.9692	1.4033
No log	4.8706	414	2.1268	0.2933	2.1268	1.4584
No log	4.8941	416	2.0107	0.2797	2.0107	1.4180
No log	4.9176	418	1.9245	0.2571	1.9245	1.3873
No log	4.9412	420	1.8202	0.2464	1.8202	1.3491
No log	4.9647	422	1.8760	0.2464	1.8760	1.3697
No log	4.9882	424	1.8772	0.2464	1.8772	1.3701
No log	5.0118	426	1.8286	0.2336	1.8286	1.3523
No log	5.0353	428	1.8211	0.2336	1.8211	1.3495
No log	5.0588	430	1.8530	0.2590	1.8530	1.3613
No log	5.0824	432	1.8503	0.2857	1.8503	1.3603
No log	5.1059	434	1.7832	0.3000	1.7832	1.3354
No log	5.1294	436	1.7122	0.2878	1.7122	1.3085
No log	5.1529	438	1.6707	0.3043	1.6707	1.2926
No log	5.1765	440	1.6750	0.3043	1.6750	1.2942
No log	5.2	442	1.7525	0.2609	1.7525	1.3238
No log	5.2235	444	1.9219	0.2336	1.9219	1.3863
No log	5.2471	446	1.9817	0.2446	1.9817	1.4077
No log	5.2706	448	1.9089	0.2734	1.9089	1.3816
No log	5.2941	450	1.7812	0.3000	1.7812	1.3346
No log	5.3176	452	1.6688	0.3262	1.6688	1.2918
No log	5.3412	454	1.6698	0.3217	1.6698	1.2922
No log	5.3647	456	1.7000	0.3217	1.7000	1.3038
No log	5.3882	458	1.6177	0.3546	1.6177	1.2719
No log	5.4118	460	1.5097	0.4265	1.5097	1.2287
No log	5.4353	462	1.5468	0.4148	1.5468	1.2437
No log	5.4588	464	1.5411	0.4148	1.5411	1.2414
No log	5.4824	466	1.5714	0.3504	1.5714	1.2535
No log	5.5059	468	1.5540	0.3333	1.5540	1.2466
No log	5.5294	470	1.6445	0.3000	1.6445	1.2824
No log	5.5529	472	1.6774	0.3000	1.6774	1.2951
No log	5.5765	474	1.6860	0.3333	1.6860	1.2985
No log	5.6	476	1.7081	0.3333	1.7081	1.3069
No log	5.6235	478	1.7024	0.3333	1.7024	1.3048
No log	5.6471	480	1.7782	0.2958	1.7782	1.3335
No log	5.6706	482	1.8093	0.2734	1.8093	1.3451
No log	5.6941	484	1.9253	0.2734	1.9253	1.3875
No log	5.7176	486	2.0775	0.2270	2.0775	1.4414
No log	5.7412	488	2.0452	0.2143	2.0452	1.4301
No log	5.7647	490	1.9008	0.2464	1.9008	1.3787
No log	5.7882	492	1.7604	0.2609	1.7604	1.3268
No log	5.8118	494	1.7143	0.2609	1.7143	1.3093
No log	5.8353	496	1.6841	0.2609	1.6841	1.2977
No log	5.8588	498	1.7786	0.2734	1.7786	1.3336
0.4107	5.8824	500	1.7980	0.2734	1.7980	1.3409
0.4107	5.9059	502	1.8666	0.2734	1.8666	1.3662
0.4107	5.9294	504	1.9653	0.2270	1.9654	1.4019
0.4107	5.9529	506	1.9350	0.2446	1.9350	1.3910
0.4107	5.9765	508	1.8724	0.2446	1.8724	1.3684
0.4107	6.0	510	1.8245	0.2464	1.8245	1.3507

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1