ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6800
• Qwk: 0.3704
• Mse: 1.6800
• Rmse: 1.2961

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0278	2	6.9639	0.0242	6.9639	2.6389
No log	0.0556	4	4.4640	0.1181	4.4640	2.1128
No log	0.0833	6	3.3817	0.0333	3.3817	1.8390
No log	0.1111	8	2.5383	0.1081	2.5383	1.5932
No log	0.1389	10	1.9293	0.2406	1.9293	1.3890
No log	0.1667	12	1.7415	0.3193	1.7415	1.3197
No log	0.1944	14	1.8987	0.2290	1.8987	1.3779
No log	0.2222	16	1.7604	0.3089	1.7604	1.3268
No log	0.25	18	1.8091	0.2481	1.8091	1.3450
No log	0.2778	20	2.0899	0.2044	2.0899	1.4457
No log	0.3056	22	1.9445	0.2273	1.9445	1.3944
No log	0.3333	24	1.7233	0.3025	1.7233	1.3128
No log	0.3611	26	1.4982	0.2727	1.4982	1.2240
No log	0.3889	28	1.4334	0.2752	1.4334	1.1972
No log	0.4167	30	1.4274	0.3243	1.4274	1.1947
No log	0.4444	32	1.4449	0.2936	1.4449	1.2021
No log	0.4722	34	1.5624	0.3063	1.5624	1.2499
No log	0.5	36	1.5832	0.3036	1.5832	1.2582
No log	0.5278	38	1.6077	0.3036	1.6077	1.2679
No log	0.5556	40	1.5183	0.3158	1.5183	1.2322
No log	0.5833	42	1.4798	0.3248	1.4798	1.2165
No log	0.6111	44	1.4048	0.3770	1.4048	1.1852
No log	0.6389	46	1.4772	0.4480	1.4772	1.2154
No log	0.6667	48	1.3930	0.4320	1.3930	1.1803
No log	0.6944	50	1.5038	0.4000	1.5038	1.2263
No log	0.7222	52	1.3684	0.4531	1.3684	1.1698
No log	0.75	54	1.2849	0.4812	1.2849	1.1335
No log	0.7778	56	1.2952	0.4	1.2952	1.1381
No log	0.8056	58	1.3919	0.4733	1.3919	1.1798
No log	0.8333	60	1.7321	0.2105	1.7321	1.3161
No log	0.8611	62	2.0088	0.1240	2.0088	1.4173
No log	0.8889	64	1.8816	0.2537	1.8816	1.3717
No log	0.9167	66	1.4827	0.3937	1.4827	1.2176
No log	0.9444	68	1.3893	0.4091	1.3893	1.1787
No log	0.9722	70	1.4349	0.4615	1.4349	1.1979
No log	1.0	72	1.4993	0.3175	1.4993	1.2245
No log	1.0278	74	1.7568	0.2836	1.7568	1.3255
No log	1.0556	76	1.6884	0.3158	1.6884	1.2994
No log	1.0833	78	1.5547	0.3175	1.5547	1.2469
No log	1.1111	80	1.5362	0.3360	1.5361	1.2394
No log	1.1389	82	1.5726	0.3226	1.5726	1.2540
No log	1.1667	84	1.7673	0.2636	1.7673	1.3294
No log	1.1944	86	1.8080	0.2636	1.8080	1.3446
No log	1.2222	88	1.6466	0.3016	1.6466	1.2832
No log	1.25	90	1.5228	0.4031	1.5228	1.2340
No log	1.2778	92	1.6536	0.3231	1.6536	1.2859
No log	1.3056	94	2.1778	0.1408	2.1778	1.4757
No log	1.3333	96	2.3545	0.0857	2.3545	1.5344
No log	1.3611	98	2.0863	0.1702	2.0863	1.4444
No log	1.3889	100	1.6724	0.3382	1.6724	1.2932
No log	1.4167	102	1.7498	0.2754	1.7498	1.3228
No log	1.4444	104	1.9741	0.1871	1.9741	1.4050
No log	1.4722	106	2.0422	0.1714	2.0422	1.4291
No log	1.5	108	2.0313	0.1702	2.0313	1.4253
No log	1.5278	110	1.7576	0.3182	1.7576	1.3258
No log	1.5556	112	1.6755	0.3511	1.6755	1.2944
No log	1.5833	114	1.9259	0.1831	1.9259	1.3878
No log	1.6111	116	2.1949	0.1429	2.1949	1.4815
No log	1.6389	118	2.4108	0.1185	2.4108	1.5527
No log	1.6667	120	2.3071	0.1168	2.3071	1.5189
No log	1.6944	122	1.8307	0.2667	1.8307	1.3530
No log	1.7222	124	1.5747	0.4394	1.5747	1.2549
No log	1.75	126	1.6391	0.4462	1.6391	1.2803
No log	1.7778	128	1.9721	0.1912	1.9721	1.4043
No log	1.8056	130	2.3627	0.0923	2.3627	1.5371
No log	1.8333	132	2.3184	0.0	2.3184	1.5226
No log	1.8611	134	1.9922	0.1860	1.9922	1.4114
No log	1.8889	136	1.6683	0.3840	1.6683	1.2916
No log	1.9167	138	1.4928	0.3680	1.4928	1.2218
No log	1.9444	140	1.5230	0.3548	1.5230	1.2341
No log	1.9722	142	1.6495	0.4031	1.6495	1.2843
No log	2.0	144	1.7591	0.4060	1.7591	1.3263
No log	2.0278	146	1.7553	0.4060	1.7553	1.3249
No log	2.0556	148	1.6560	0.4060	1.6560	1.2868
No log	2.0833	150	1.4737	0.3876	1.4737	1.2140
No log	2.1111	152	1.4858	0.3876	1.4858	1.2190
No log	2.1389	154	1.6723	0.3650	1.6723	1.2932
No log	2.1667	156	2.0272	0.2517	2.0272	1.4238
No log	2.1944	158	2.3926	0.1389	2.3926	1.5468
No log	2.2222	160	2.3865	0.1389	2.3865	1.5448
No log	2.25	162	2.0613	0.2128	2.0613	1.4357
No log	2.2778	164	1.5219	0.3636	1.5219	1.2336
No log	2.3056	166	1.2998	0.4651	1.2998	1.1401
No log	2.3333	168	1.2952	0.4603	1.2952	1.1381
No log	2.3611	170	1.4527	0.3937	1.4527	1.2053
No log	2.3889	172	1.7343	0.3309	1.7343	1.3169
No log	2.4167	174	1.9765	0.2754	1.9765	1.4059
No log	2.4444	176	1.9782	0.2206	1.9782	1.4065
No log	2.4722	178	1.8859	0.2370	1.8859	1.3733
No log	2.5	180	1.8118	0.2481	1.8118	1.3460
No log	2.5278	182	1.6567	0.3415	1.6567	1.2871
No log	2.5556	184	1.5188	0.3333	1.5188	1.2324
No log	2.5833	186	1.4379	0.3826	1.4379	1.1991
No log	2.6111	188	1.4403	0.3697	1.4403	1.2001
No log	2.6389	190	1.5237	0.3740	1.5237	1.2344
No log	2.6667	192	1.6999	0.3817	1.6999	1.3038
No log	2.6944	194	2.0262	0.1844	2.0262	1.4234
No log	2.7222	196	2.1887	0.1690	2.1887	1.4794
No log	2.75	198	1.9469	0.2302	1.9469	1.3953
No log	2.7778	200	1.6470	0.3939	1.6470	1.2834
No log	2.8056	202	1.4670	0.4286	1.4670	1.2112
No log	2.8333	204	1.3541	0.4	1.3541	1.1637
No log	2.8611	206	1.3870	0.4098	1.3870	1.1777
No log	2.8889	208	1.4951	0.4286	1.4951	1.2227
No log	2.9167	210	1.6005	0.3969	1.6005	1.2651
No log	2.9444	212	1.5999	0.4154	1.5999	1.2649
No log	2.9722	214	1.5288	0.4127	1.5288	1.2364
No log	3.0	216	1.5066	0.4320	1.5066	1.2274
No log	3.0278	218	1.5489	0.4160	1.5489	1.2445
No log	3.0556	220	1.6028	0.4186	1.6028	1.2660
No log	3.0833	222	1.6060	0.3968	1.6060	1.2673
No log	3.1111	224	1.7137	0.2901	1.7137	1.3091
No log	3.1389	226	1.6349	0.3231	1.6349	1.2786
No log	3.1667	228	1.5909	0.3359	1.5909	1.2613
No log	3.1944	230	1.5736	0.4154	1.5736	1.2544
No log	3.2222	232	1.4644	0.4603	1.4644	1.2101
No log	3.25	234	1.4453	0.4355	1.4453	1.2022
No log	3.2778	236	1.5711	0.4091	1.5711	1.2534
No log	3.3056	238	1.7812	0.3111	1.7812	1.3346
No log	3.3333	240	1.7996	0.3433	1.7996	1.3415
No log	3.3611	242	1.6817	0.3731	1.6817	1.2968
No log	3.3889	244	1.6195	0.4	1.6195	1.2726
No log	3.4167	246	1.7781	0.3053	1.7781	1.3334
No log	3.4444	248	2.1648	0.1667	2.1648	1.4713
No log	3.4722	250	2.1765	0.1314	2.1765	1.4753
No log	3.5	252	2.1822	0.1143	2.1822	1.4772
No log	3.5278	254	2.0616	0.2270	2.0616	1.4358
No log	3.5556	256	1.7813	0.3235	1.7813	1.3347
No log	3.5833	258	1.6702	0.3910	1.6702	1.2923
No log	3.6111	260	1.8057	0.3235	1.8057	1.3438
No log	3.6389	262	1.9764	0.2302	1.9764	1.4059
No log	3.6667	264	1.9479	0.2774	1.9479	1.3957
No log	3.6944	266	1.8312	0.3433	1.8312	1.3532
No log	3.7222	268	1.6756	0.4275	1.6756	1.2944
No log	3.75	270	1.5851	0.4219	1.5851	1.2590
No log	3.7778	272	1.6189	0.4275	1.6189	1.2724
No log	3.8056	274	1.8327	0.2899	1.8327	1.3538
No log	3.8333	276	1.8811	0.2899	1.8811	1.3715
No log	3.8611	278	1.7488	0.3731	1.7488	1.3224
No log	3.8889	280	1.6019	0.4545	1.6019	1.2657
No log	3.9167	282	1.6782	0.4275	1.6782	1.2955
No log	3.9444	284	1.8086	0.3259	1.8086	1.3448
No log	3.9722	286	1.8072	0.3212	1.8072	1.3443
No log	4.0	288	1.7586	0.3212	1.7586	1.3261
No log	4.0278	290	1.8196	0.3165	1.8196	1.3489
No log	4.0556	292	1.9021	0.2899	1.9021	1.3792
No log	4.0833	294	2.1136	0.2270	2.1136	1.4538
No log	4.1111	296	2.1441	0.1690	2.1441	1.4643
No log	4.1389	298	1.8361	0.3478	1.8361	1.3550
No log	4.1667	300	1.5591	0.4511	1.5591	1.2486
No log	4.1944	302	1.6197	0.4511	1.6197	1.2727
No log	4.2222	304	1.7739	0.3876	1.7739	1.3319
No log	4.25	306	1.6205	0.4186	1.6205	1.2730
No log	4.2778	308	1.5736	0.4496	1.5736	1.2544
No log	4.3056	310	1.5176	0.4580	1.5176	1.2319
No log	4.3333	312	1.4500	0.4688	1.4500	1.2042
No log	4.3611	314	1.5921	0.4545	1.5921	1.2618
No log	4.3889	316	1.8920	0.3165	1.8920	1.3755
No log	4.4167	318	2.0531	0.2143	2.0531	1.4329
No log	4.4444	320	1.9000	0.2695	1.9000	1.3784
No log	4.4722	322	1.6836	0.4179	1.6836	1.2975
No log	4.5	324	1.5701	0.4462	1.5701	1.2530
No log	4.5278	326	1.6482	0.4275	1.6482	1.2838
No log	4.5556	328	1.7803	0.3259	1.7803	1.3343
No log	4.5833	330	1.7476	0.3969	1.7476	1.3220
No log	4.6111	332	1.6254	0.4127	1.6254	1.2749
No log	4.6389	334	1.5528	0.4480	1.5528	1.2461
No log	4.6667	336	1.5197	0.4480	1.5197	1.2327
No log	4.6944	338	1.4817	0.4480	1.4817	1.2172
No log	4.7222	340	1.5066	0.4769	1.5066	1.2274
No log	4.75	342	1.6732	0.3852	1.6732	1.2935
No log	4.7778	344	1.8674	0.3165	1.8674	1.3665
No log	4.8056	346	1.8772	0.2941	1.8772	1.3701
No log	4.8333	348	1.6433	0.4060	1.6433	1.2819
No log	4.8611	350	1.4648	0.4651	1.4648	1.2103
No log	4.8889	352	1.4438	0.4651	1.4438	1.2016
No log	4.9167	354	1.5207	0.4615	1.5207	1.2332
No log	4.9444	356	1.6423	0.4060	1.6423	1.2815
No log	4.9722	358	1.6469	0.4030	1.6469	1.2833
No log	5.0	360	1.6424	0.4	1.6424	1.2816
No log	5.0278	362	1.4630	0.4580	1.4630	1.2095
No log	5.0556	364	1.3005	0.4603	1.3005	1.1404
No log	5.0833	366	1.3477	0.4262	1.3477	1.1609
No log	5.1111	368	1.5069	0.4567	1.5069	1.2276
No log	5.1389	370	1.5682	0.4462	1.5682	1.2523
No log	5.1667	372	1.5429	0.4394	1.5429	1.2421
No log	5.1944	374	1.4445	0.4651	1.4445	1.2019
No log	5.2222	376	1.4113	0.4769	1.4113	1.1880
No log	5.25	378	1.4718	0.4806	1.4718	1.2132
No log	5.2778	380	1.6077	0.4394	1.6077	1.2680
No log	5.3056	382	1.7243	0.3529	1.7243	1.3131
No log	5.3333	384	1.6893	0.4030	1.6893	1.2997
No log	5.3611	386	1.4786	0.4806	1.4786	1.2160
No log	5.3889	388	1.3624	0.4444	1.3624	1.1672
No log	5.4167	390	1.3991	0.4444	1.3991	1.1829
No log	5.4444	392	1.4770	0.4806	1.4770	1.2153
No log	5.4722	394	1.5866	0.4328	1.5866	1.2596
No log	5.5	396	1.7475	0.4030	1.7475	1.3219
No log	5.5278	398	1.8886	0.2774	1.8886	1.3743
No log	5.5556	400	1.7625	0.3212	1.7625	1.3276
No log	5.5833	402	1.5194	0.4361	1.5194	1.2326
No log	5.6111	404	1.3771	0.4806	1.3771	1.1735
No log	5.6389	406	1.3555	0.4567	1.3555	1.1643
No log	5.6667	408	1.4243	0.4806	1.4243	1.1935
No log	5.6944	410	1.5613	0.3969	1.5613	1.2495
No log	5.7222	412	1.6614	0.3636	1.6614	1.2890
No log	5.75	414	1.6328	0.3969	1.6328	1.2778
No log	5.7778	416	1.5103	0.4275	1.5103	1.2290
No log	5.8056	418	1.4129	0.4651	1.4129	1.1887
No log	5.8333	420	1.4426	0.4462	1.4426	1.2011
No log	5.8611	422	1.5984	0.4394	1.5984	1.2643
No log	5.8889	424	1.7833	0.3382	1.7833	1.3354
No log	5.9167	426	1.7967	0.3382	1.7967	1.3404
No log	5.9444	428	1.7376	0.3407	1.7376	1.3182
No log	5.9722	430	1.5923	0.4060	1.5923	1.2619
No log	6.0	432	1.5102	0.4394	1.5102	1.2289
No log	6.0278	434	1.4594	0.4580	1.4594	1.2081
No log	6.0556	436	1.6000	0.4091	1.6000	1.2649
No log	6.0833	438	1.7343	0.3788	1.7343	1.3169
No log	6.1111	440	1.8272	0.2946	1.8272	1.3517
No log	6.1389	442	1.7940	0.3053	1.7940	1.3394
No log	6.1667	444	1.7181	0.3556	1.7181	1.3108
No log	6.1944	446	1.6069	0.3759	1.6069	1.2676
No log	6.2222	448	1.5528	0.4275	1.5528	1.2461
No log	6.25	450	1.6964	0.3704	1.6964	1.3025
No log	6.2778	452	1.9853	0.2466	1.9853	1.4090
No log	6.3056	454	1.9903	0.1931	1.9903	1.4108
No log	6.3333	456	1.7731	0.3382	1.7731	1.3316
No log	6.3611	458	1.6434	0.4211	1.6434	1.2820
No log	6.3889	460	1.5846	0.4511	1.5846	1.2588
No log	6.4167	462	1.7339	0.3881	1.7339	1.3168
No log	6.4444	464	1.7807	0.3556	1.7807	1.3344
No log	6.4722	466	1.9273	0.2571	1.9273	1.3883
No log	6.5	468	1.9916	0.2571	1.9916	1.4113
No log	6.5278	470	2.0247	0.2571	2.0247	1.4229
No log	6.5556	472	1.9037	0.2774	1.9037	1.3798
No log	6.5833	474	1.8217	0.2899	1.8217	1.3497
No log	6.6111	476	1.7995	0.2920	1.7995	1.3415
No log	6.6389	478	1.9710	0.2571	1.9710	1.4039
No log	6.6667	480	2.0812	0.2411	2.0812	1.4426
No log	6.6944	482	2.1220	0.2254	2.1220	1.4567
No log	6.7222	484	1.8659	0.2899	1.8659	1.3660
No log	6.75	486	1.6579	0.3939	1.6579	1.2876
No log	6.7778	488	1.6376	0.3939	1.6376	1.2797
No log	6.8056	490	1.8663	0.2899	1.8663	1.3661
No log	6.8333	492	2.1497	0.1831	2.1497	1.4662
No log	6.8611	494	2.1259	0.1831	2.1259	1.4581
No log	6.8889	496	1.8128	0.3852	1.8128	1.3464
No log	6.9167	498	1.6508	0.4060	1.6508	1.2848
0.3574	6.9444	500	1.6639	0.4060	1.6639	1.2899
0.3574	6.9722	502	1.7880	0.3704	1.7880	1.3371
0.3574	7.0	504	1.9048	0.2609	1.9048	1.3801
0.3574	7.0278	506	1.8835	0.3088	1.8835	1.3724
0.3574	7.0556	508	1.8123	0.3704	1.8123	1.3462
0.3574	7.0833	510	1.6800	0.3704	1.6800	1.2961

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1