ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6582
• Qwk: 0.3788
• Mse: 1.6582
• Rmse: 1.2877

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	6.9045	0.0179	6.9045	2.6276
No log	0.0656	4	4.7308	0.0821	4.7308	2.1751
No log	0.0984	6	3.5670	0.0106	3.5670	1.8887
No log	0.1311	8	2.5994	0.0946	2.5994	1.6123
No log	0.1639	10	2.0889	0.1440	2.0889	1.4453
No log	0.1967	12	1.9204	0.1964	1.9204	1.3858
No log	0.2295	14	1.9458	0.1622	1.9458	1.3949
No log	0.2623	16	2.0055	0.1964	2.0055	1.4161
No log	0.2951	18	2.1539	0.1345	2.1539	1.4676
No log	0.3279	20	2.1367	0.1197	2.1367	1.4618
No log	0.3607	22	2.1085	0.2326	2.1085	1.4521
No log	0.3934	24	2.7817	0.1026	2.7817	1.6679
No log	0.4262	26	2.9993	0.0602	2.9993	1.7318
No log	0.4590	28	2.0139	0.2406	2.0139	1.4191
No log	0.4918	30	1.6230	0.1667	1.6230	1.2740
No log	0.5246	32	1.6430	0.1869	1.6430	1.2818
No log	0.5574	34	1.6569	0.2018	1.6569	1.2872
No log	0.5902	36	1.5860	0.3902	1.5860	1.2594
No log	0.6230	38	1.7086	0.3721	1.7086	1.3071
No log	0.6557	40	1.7761	0.3284	1.7761	1.3327
No log	0.6885	42	1.6555	0.3664	1.6555	1.2867
No log	0.7213	44	1.5647	0.4122	1.5647	1.2509
No log	0.7541	46	1.5873	0.4	1.5873	1.2599
No log	0.7869	48	1.6085	0.3664	1.6085	1.2683
No log	0.8197	50	1.5448	0.3538	1.5448	1.2429
No log	0.8525	52	1.4727	0.3415	1.4727	1.2135
No log	0.8852	54	1.3439	0.3220	1.3439	1.1593
No log	0.9180	56	1.2570	0.3590	1.2570	1.1212
No log	0.9508	58	1.1435	0.5000	1.1435	1.0694
No log	0.9836	60	1.1378	0.5289	1.1378	1.0667
No log	1.0164	62	1.1635	0.4538	1.1635	1.0787
No log	1.0492	64	1.1847	0.4370	1.1847	1.0884
No log	1.0820	66	1.2784	0.5	1.2784	1.1307
No log	1.1148	68	1.2617	0.4390	1.2617	1.1233
No log	1.1475	70	1.2265	0.4262	1.2265	1.1075
No log	1.1803	72	1.2751	0.4426	1.2751	1.1292
No log	1.2131	74	1.4397	0.3684	1.4397	1.1999
No log	1.2459	76	1.6646	0.2364	1.6646	1.2902
No log	1.2787	78	1.6397	0.2364	1.6397	1.2805
No log	1.3115	80	1.3485	0.3826	1.3485	1.1612
No log	1.3443	82	1.1285	0.4667	1.1285	1.0623
No log	1.3770	84	1.0876	0.5323	1.0876	1.0429
No log	1.4098	86	1.1022	0.4959	1.1022	1.0499
No log	1.4426	88	1.3782	0.3509	1.3782	1.1740
No log	1.4754	90	1.7426	0.2883	1.7426	1.3201
No log	1.5082	92	2.0439	0.0526	2.0439	1.4297
No log	1.5410	94	2.0228	0.0862	2.0228	1.4222
No log	1.5738	96	1.4431	0.3363	1.4431	1.2013
No log	1.6066	98	1.2638	0.4615	1.2638	1.1242
No log	1.6393	100	1.2910	0.4202	1.2910	1.1362
No log	1.6721	102	1.3129	0.4677	1.3129	1.1458
No log	1.7049	104	1.3345	0.4252	1.3345	1.1552
No log	1.7377	106	1.4578	0.3937	1.4578	1.2074
No log	1.7705	108	1.5232	0.3622	1.5232	1.2342
No log	1.8033	110	1.5734	0.3459	1.5734	1.2544
No log	1.8361	112	1.5366	0.3433	1.5366	1.2396
No log	1.8689	114	1.6340	0.3407	1.6340	1.2783
No log	1.9016	116	1.7493	0.2791	1.7493	1.3226
No log	1.9344	118	1.6394	0.3359	1.6394	1.2804
No log	1.9672	120	1.3848	0.4031	1.3848	1.1768
No log	2.0	122	1.2960	0.4833	1.2960	1.1384
No log	2.0328	124	1.2718	0.4615	1.2718	1.1278
No log	2.0656	126	1.2468	0.5124	1.2468	1.1166
No log	2.0984	128	1.2841	0.5289	1.2841	1.1332
No log	2.1311	130	1.3311	0.5161	1.3311	1.1537
No log	2.1639	132	1.3971	0.4186	1.3971	1.1820
No log	2.1967	134	1.5211	0.3788	1.5211	1.2333
No log	2.2295	136	1.7091	0.2923	1.7091	1.3073
No log	2.2623	138	1.7274	0.2812	1.7274	1.3143
No log	2.2951	140	1.5976	0.3256	1.5976	1.2640
No log	2.3279	142	1.4291	0.4154	1.4291	1.1954
No log	2.3607	144	1.4722	0.3759	1.4722	1.2133
No log	2.3934	146	1.6263	0.3382	1.6263	1.2753
No log	2.4262	148	1.8716	0.2628	1.8716	1.3681
No log	2.4590	150	1.9830	0.2778	1.9830	1.4082
No log	2.4918	152	1.7986	0.3000	1.7986	1.3411
No log	2.5246	154	1.5456	0.3636	1.5456	1.2432
No log	2.5574	156	1.5037	0.3969	1.5037	1.2262
No log	2.5902	158	1.5745	0.3259	1.5745	1.2548
No log	2.6230	160	1.6800	0.3088	1.6800	1.2961
No log	2.6557	162	1.6483	0.3459	1.6483	1.2839
No log	2.6885	164	1.5715	0.3307	1.5715	1.2536
No log	2.7213	166	1.4777	0.3651	1.4777	1.2156
No log	2.7541	168	1.5218	0.3520	1.5218	1.2336
No log	2.7869	170	1.7444	0.2344	1.7444	1.3207
No log	2.8197	172	1.8455	0.2171	1.8455	1.3585
No log	2.8525	174	1.8160	0.2171	1.8160	1.3476
No log	2.8852	176	1.6155	0.3307	1.6155	1.2710
No log	2.9180	178	1.6134	0.2581	1.6134	1.2702
No log	2.9508	180	1.6300	0.272	1.6300	1.2767
No log	2.9836	182	1.6896	0.3231	1.6896	1.2998
No log	3.0164	184	1.8521	0.3008	1.8521	1.3609
No log	3.0492	186	1.8610	0.2707	1.8610	1.3642
No log	3.0820	188	1.7418	0.3008	1.7418	1.3198
No log	3.1148	190	1.6239	0.3504	1.6239	1.2743
No log	3.1475	192	1.7261	0.3235	1.7261	1.3138
No log	3.1803	194	1.8231	0.2963	1.8231	1.3502
No log	3.2131	196	1.9156	0.2707	1.9156	1.3841
No log	3.2459	198	1.7826	0.3359	1.7826	1.3351
No log	3.2787	200	1.6089	0.4062	1.6089	1.2684
No log	3.3115	202	1.5471	0.4032	1.5471	1.2438
No log	3.3443	204	1.5430	0.3934	1.5430	1.2422
No log	3.3770	206	1.7354	0.2992	1.7354	1.3173
No log	3.4098	208	1.8235	0.2344	1.8235	1.3504
No log	3.4426	210	1.8012	0.2769	1.8012	1.3421
No log	3.4754	212	1.7482	0.3053	1.7482	1.3222
No log	3.5082	214	1.8621	0.2462	1.8621	1.3646
No log	3.5410	216	1.9699	0.2205	1.9699	1.4035
No log	3.5738	218	2.0849	0.1600	2.0849	1.4439
No log	3.6066	220	2.1546	-0.0174	2.1546	1.4678
No log	3.6393	222	1.9152	0.1452	1.9152	1.3839
No log	3.6721	224	1.6226	0.3385	1.6226	1.2738
No log	3.7049	226	1.4015	0.4580	1.4015	1.1838
No log	3.7377	228	1.4279	0.3731	1.4279	1.1949
No log	3.7705	230	1.4971	0.3824	1.4971	1.2236
No log	3.8033	232	1.6686	0.3382	1.6686	1.2918
No log	3.8361	234	1.9141	0.2105	1.9141	1.3835
No log	3.8689	236	1.9726	0.1818	1.9726	1.4045
No log	3.9016	238	1.8920	0.2290	1.8920	1.3755
No log	3.9344	240	1.6564	0.2636	1.6564	1.2870
No log	3.9672	242	1.4332	0.3876	1.4332	1.1972
No log	4.0	244	1.3307	0.4715	1.3307	1.1536
No log	4.0328	246	1.3610	0.4426	1.3610	1.1666
No log	4.0656	248	1.5313	0.3910	1.5313	1.2375
No log	4.0984	250	1.8203	0.3333	1.8203	1.3492
No log	4.1311	252	2.0283	0.2128	2.0283	1.4242
No log	4.1639	254	2.1327	0.1119	2.1327	1.4604
No log	4.1967	256	2.0888	0.1304	2.0888	1.4453
No log	4.2295	258	1.9603	0.1746	1.9603	1.4001
No log	4.2623	260	1.8487	0.1818	1.8487	1.3597
No log	4.2951	262	1.7450	0.2982	1.7450	1.3210
No log	4.3279	264	1.6753	0.3276	1.6753	1.2943
No log	4.3607	266	1.6669	0.3898	1.6669	1.2911
No log	4.3934	268	1.7214	0.3866	1.7214	1.3120
No log	4.4262	270	1.8883	0.1985	1.8883	1.3741
No log	4.4590	272	2.1104	0.1630	2.1104	1.4527
No log	4.4918	274	2.2681	0.0580	2.2681	1.5060
No log	4.5246	276	2.2822	0.0310	2.2822	1.5107
No log	4.5574	278	2.1880	0.0	2.1880	1.4792
No log	4.5902	280	2.0074	0.1463	2.0074	1.4168
No log	4.6230	282	1.8814	0.1695	1.8814	1.3716
No log	4.6557	284	1.8298	0.2333	1.8298	1.3527
No log	4.6885	286	1.8432	0.1920	1.8432	1.3577
No log	4.7213	288	1.8589	0.2556	1.8589	1.3634
No log	4.7541	290	1.8437	0.3088	1.8437	1.3578
No log	4.7869	292	1.8626	0.3043	1.8626	1.3648
No log	4.8197	294	1.9446	0.2302	1.9446	1.3945
No log	4.8525	296	1.9275	0.2464	1.9275	1.3884
No log	4.8852	298	1.8574	0.3043	1.8574	1.3629
No log	4.9180	300	1.7239	0.3235	1.7239	1.3130
No log	4.9508	302	1.6010	0.4060	1.6010	1.2653
No log	4.9836	304	1.6468	0.4328	1.6468	1.2833
No log	5.0164	306	1.7866	0.3333	1.7866	1.3366
No log	5.0492	308	1.8655	0.3066	1.8655	1.3658
No log	5.0820	310	1.9520	0.2899	1.9520	1.3971
No log	5.1148	312	1.8790	0.2878	1.8790	1.3708
No log	5.1475	314	1.7288	0.3556	1.7288	1.3148
No log	5.1803	316	1.6327	0.3609	1.6327	1.2778
No log	5.2131	318	1.5979	0.3817	1.5979	1.2641
No log	5.2459	320	1.6429	0.3846	1.6429	1.2818
No log	5.2787	322	1.7164	0.3664	1.7164	1.3101
No log	5.3115	324	1.8091	0.3259	1.8091	1.3450
No log	5.3443	326	1.8813	0.3212	1.8813	1.3716
No log	5.3770	328	1.9186	0.3043	1.9186	1.3851
No log	5.4098	330	1.8341	0.2941	1.8341	1.3543
No log	5.4426	332	1.7440	0.3235	1.7440	1.3206
No log	5.4754	334	1.7463	0.3235	1.7463	1.3215
No log	5.5082	336	1.7874	0.2941	1.7874	1.3370
No log	5.5410	338	1.8700	0.3043	1.8700	1.3675
No log	5.5738	340	1.9646	0.2302	1.9646	1.4016
No log	5.6066	342	1.9047	0.2774	1.9047	1.3801
No log	5.6393	344	1.7464	0.3206	1.7464	1.3215
No log	5.6721	346	1.6323	0.4320	1.6323	1.2776
No log	5.7049	348	1.6295	0.3876	1.6295	1.2765
No log	5.7377	350	1.7014	0.3111	1.7014	1.3044
No log	5.7705	352	1.7891	0.2754	1.7891	1.3376
No log	5.8033	354	1.8725	0.2270	1.8725	1.3684
No log	5.8361	356	1.9163	0.2270	1.9163	1.3843
No log	5.8689	358	1.7899	0.2411	1.7899	1.3379
No log	5.9016	360	1.6905	0.3022	1.6905	1.3002
No log	5.9344	362	1.6173	0.3188	1.6173	1.2717
No log	5.9672	364	1.6481	0.3358	1.6481	1.2838
No log	6.0	366	1.6570	0.3609	1.6570	1.2872
No log	6.0328	368	1.6916	0.3664	1.6916	1.3006
No log	6.0656	370	1.6549	0.3664	1.6549	1.2864
No log	6.0984	372	1.6066	0.3910	1.6066	1.2675
No log	6.1311	374	1.4868	0.3910	1.4868	1.2193
No log	6.1639	376	1.4516	0.4179	1.4516	1.2048
No log	6.1967	378	1.6025	0.3796	1.6025	1.2659
No log	6.2295	380	1.6887	0.3796	1.6887	1.2995
No log	6.2623	382	1.8210	0.2535	1.8210	1.3494
No log	6.2951	384	1.8605	0.2734	1.8605	1.3640
No log	6.3279	386	1.7869	0.2707	1.7869	1.3368
No log	6.3607	388	1.6904	0.3206	1.6904	1.3002
No log	6.3934	390	1.6657	0.3333	1.6657	1.2906
No log	6.4262	392	1.6692	0.2857	1.6692	1.2920
No log	6.4590	394	1.6516	0.3158	1.6516	1.2852
No log	6.4918	396	1.6818	0.3281	1.6818	1.2968
No log	6.5246	398	1.7369	0.3125	1.7369	1.3179
No log	6.5574	400	1.7350	0.3385	1.7350	1.3172
No log	6.5902	402	1.6880	0.3175	1.6880	1.2992
No log	6.6230	404	1.5753	0.3770	1.5753	1.2551
No log	6.6557	406	1.4728	0.3967	1.4728	1.2136
No log	6.6885	408	1.3995	0.3934	1.3995	1.1830
No log	6.7213	410	1.3728	0.4228	1.3728	1.1717
No log	6.7541	412	1.3988	0.4355	1.3988	1.1827
No log	6.7869	414	1.4504	0.4127	1.4504	1.2043
No log	6.8197	416	1.5043	0.4094	1.5043	1.2265
No log	6.8525	418	1.6080	0.3307	1.6080	1.2681
No log	6.8852	420	1.6983	0.3308	1.6983	1.3032
No log	6.9180	422	1.6633	0.3609	1.6633	1.2897
No log	6.9508	424	1.5842	0.3636	1.5842	1.2586
No log	6.9836	426	1.5497	0.3817	1.5497	1.2449
No log	7.0164	428	1.6268	0.3281	1.6268	1.2755
No log	7.0492	430	1.7474	0.2769	1.7474	1.3219
No log	7.0820	432	1.8468	0.2519	1.8468	1.3590
No log	7.1148	434	1.8575	0.2519	1.8575	1.3629
No log	7.1475	436	1.7373	0.2946	1.7373	1.3181
No log	7.1803	438	1.5880	0.3465	1.5880	1.2602
No log	7.2131	440	1.4779	0.4320	1.4779	1.2157
No log	7.2459	442	1.4569	0.4390	1.4569	1.2070
No log	7.2787	444	1.5063	0.4320	1.5063	1.2273
No log	7.3115	446	1.6359	0.3492	1.6359	1.2790
No log	7.3443	448	1.7278	0.3200	1.7278	1.3145
No log	7.3770	450	1.7437	0.3065	1.7437	1.3205
No log	7.4098	452	1.7277	0.3115	1.7277	1.3144
No log	7.4426	454	1.6217	0.3115	1.6217	1.2734
No log	7.4754	456	1.5139	0.3471	1.5139	1.2304
No log	7.5082	458	1.5550	0.3252	1.5550	1.2470
No log	7.5410	460	1.7142	0.2880	1.7142	1.3093
No log	7.5738	462	1.9082	0.2326	1.9082	1.3814
No log	7.6066	464	2.0034	0.1692	2.0034	1.4154
No log	7.6393	466	1.9934	0.2031	1.9934	1.4119
No log	7.6721	468	1.9303	0.2656	1.9303	1.3894
No log	7.7049	470	1.8366	0.3125	1.8366	1.3552
No log	7.7377	472	1.8446	0.3411	1.8446	1.3582
No log	7.7705	474	1.8959	0.3206	1.8959	1.3769
No log	7.8033	476	1.8475	0.3333	1.8475	1.3592
No log	7.8361	478	1.8085	0.3459	1.8085	1.3448
No log	7.8689	480	1.8241	0.3182	1.8241	1.3506
No log	7.9016	482	1.7944	0.3459	1.7944	1.3396
No log	7.9344	484	1.7846	0.3259	1.7846	1.3359
No log	7.9672	486	1.7624	0.3529	1.7624	1.3275
No log	8.0	488	1.6909	0.3582	1.6909	1.3003
No log	8.0328	490	1.6941	0.3796	1.6941	1.3016
No log	8.0656	492	1.6905	0.3796	1.6905	1.3002
No log	8.0984	494	1.6932	0.3650	1.6932	1.3012
No log	8.1311	496	1.6130	0.3817	1.6130	1.2700
No log	8.1639	498	1.5177	0.4252	1.5177	1.2320
0.3978	8.1967	500	1.5858	0.4	1.5858	1.2593
0.3978	8.2295	502	1.7173	0.3333	1.7173	1.3105
0.3978	8.2623	504	1.7905	0.2941	1.7905	1.3381
0.3978	8.2951	506	1.7664	0.3284	1.7664	1.3291
0.3978	8.3279	508	1.7399	0.3433	1.7399	1.3191
0.3978	8.3607	510	1.6582	0.3788	1.6582	1.2877

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1