ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.2040
• Qwk: 0.2098
• Mse: 2.2040
• Rmse: 1.4846

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0270	2	6.9883	0.0239	6.9883	2.6435
No log	0.0541	4	4.4562	0.0653	4.4562	2.1110
No log	0.0811	6	3.3290	0.0791	3.3289	1.8245
No log	0.1081	8	2.5418	0.1125	2.5418	1.5943
No log	0.1351	10	2.4525	0.0927	2.4525	1.5660
No log	0.1622	12	2.0317	0.0968	2.0317	1.4254
No log	0.1892	14	1.6607	0.1887	1.6607	1.2887
No log	0.2162	16	2.4523	-0.1102	2.4523	1.5660
No log	0.2432	18	2.5952	-0.0758	2.5952	1.6110
No log	0.2703	20	2.2646	-0.0325	2.2646	1.5049
No log	0.2973	22	1.9402	0.125	1.9402	1.3929
No log	0.3243	24	1.7426	0.1154	1.7426	1.3201
No log	0.3514	26	1.6936	0.1154	1.6936	1.3014
No log	0.3784	28	1.8960	0.2439	1.8960	1.3769
No log	0.4054	30	2.1520	0.1007	2.1520	1.4670
No log	0.4324	32	2.1545	0.1014	2.1545	1.4678
No log	0.4595	34	2.2369	0.0567	2.2369	1.4956
No log	0.4865	36	2.0257	0.2276	2.0257	1.4233
No log	0.5135	38	1.8888	0.1682	1.8888	1.3743
No log	0.5405	40	1.9513	0.2931	1.9513	1.3969
No log	0.5676	42	1.9281	0.2807	1.9281	1.3886
No log	0.5946	44	1.8640	0.3036	1.8640	1.3653
No log	0.6216	46	1.7806	0.1698	1.7806	1.3344
No log	0.6486	48	1.7408	0.1698	1.7408	1.3194
No log	0.6757	50	1.8075	0.3193	1.8075	1.3444
No log	0.7027	52	1.8316	0.3810	1.8316	1.3534
No log	0.7297	54	1.9373	0.2857	1.9373	1.3919
No log	0.7568	56	1.9503	0.2222	1.9503	1.3965
No log	0.7838	58	1.8335	0.3538	1.8335	1.3541
No log	0.8108	60	1.6708	0.4	1.6708	1.2926
No log	0.8378	62	1.6292	0.3577	1.6292	1.2764
No log	0.8649	64	1.6670	0.3810	1.6670	1.2911
No log	0.8919	66	1.5254	0.35	1.5254	1.2351
No log	0.9189	68	1.4391	0.3186	1.4391	1.1996
No log	0.9459	70	1.4163	0.2569	1.4163	1.1901
No log	0.9730	72	1.4011	0.2883	1.4011	1.1837
No log	1.0	74	1.3882	0.2909	1.3882	1.1782
No log	1.0270	76	1.4170	0.2883	1.4170	1.1904
No log	1.0541	78	1.3852	0.2752	1.3852	1.1770
No log	1.0811	80	1.3621	0.2909	1.3621	1.1671
No log	1.1081	82	1.3137	0.3571	1.3137	1.1462
No log	1.1351	84	1.2847	0.3393	1.2847	1.1334
No log	1.1622	86	1.2919	0.4483	1.2919	1.1366
No log	1.1892	88	1.3855	0.4746	1.3855	1.1771
No log	1.2162	90	1.4068	0.4068	1.4068	1.1861
No log	1.2432	92	1.3598	0.4500	1.3598	1.1661
No log	1.2703	94	1.2467	0.4706	1.2467	1.1165
No log	1.2973	96	1.2634	0.5000	1.2634	1.1240
No log	1.3243	98	1.3347	0.4538	1.3347	1.1553
No log	1.3514	100	1.2690	0.4274	1.2690	1.1265
No log	1.3784	102	1.2452	0.4874	1.2452	1.1159
No log	1.4054	104	1.3357	0.5039	1.3357	1.1557
No log	1.4324	106	1.5295	0.3511	1.5295	1.2367
No log	1.4595	108	1.5461	0.2985	1.5461	1.2434
No log	1.4865	110	1.4572	0.4462	1.4572	1.2071
No log	1.5135	112	1.4841	0.4154	1.4841	1.2182
No log	1.5405	114	1.6338	0.3556	1.6338	1.2782
No log	1.5676	116	1.9788	0.2394	1.9788	1.4067
No log	1.5946	118	2.0592	0.1702	2.0592	1.4350
No log	1.6216	120	1.9899	0.1727	1.9899	1.4106
No log	1.6486	122	1.8812	0.1760	1.8812	1.3716
No log	1.6757	124	1.9571	0.1653	1.9571	1.3989
No log	1.7027	126	1.9000	0.1639	1.9000	1.3784
No log	1.7297	128	1.8495	0.25	1.8495	1.3600
No log	1.7568	130	1.8480	0.2537	1.8480	1.3594
No log	1.7838	132	1.9534	0.2857	1.9534	1.3976
No log	1.8108	134	1.9007	0.2837	1.9007	1.3786
No log	1.8378	136	1.8045	0.3165	1.8045	1.3433
No log	1.8649	138	1.6223	0.3478	1.6223	1.2737
No log	1.8919	140	1.6268	0.3165	1.6268	1.2755
No log	1.9189	142	1.7686	0.3000	1.7686	1.3299
No log	1.9459	144	2.1511	0.2345	2.1511	1.4667
No log	1.9730	146	2.3105	0.2338	2.3105	1.5200
No log	2.0	148	2.1803	0.1667	2.1803	1.4766
No log	2.0270	150	1.8495	0.2535	1.8495	1.3600
No log	2.0541	152	1.4951	0.3885	1.4951	1.2227
No log	2.0811	154	1.5013	0.4173	1.5013	1.2253
No log	2.1081	156	1.7577	0.3309	1.7577	1.3258
No log	2.1351	158	1.8982	0.2411	1.8982	1.3777
No log	2.1622	160	1.8627	0.2411	1.8627	1.3648
No log	2.1892	162	1.6482	0.3382	1.6482	1.2838
No log	2.2162	164	1.4051	0.5124	1.4051	1.1854
No log	2.2432	166	1.4201	0.4874	1.4201	1.1917
No log	2.2703	168	1.5484	0.3906	1.5484	1.2444
No log	2.2973	170	1.7598	0.3382	1.7598	1.3266
No log	2.3243	172	1.8308	0.3212	1.8308	1.3531
No log	2.3514	174	1.8087	0.3433	1.8087	1.3449
No log	2.3784	176	1.8149	0.3022	1.8149	1.3472
No log	2.4054	178	1.7358	0.2899	1.7358	1.3175
No log	2.4324	180	1.7034	0.2878	1.7034	1.3051
No log	2.4595	182	1.8032	0.2774	1.8032	1.3428
No log	2.4865	184	1.9439	0.2482	1.9439	1.3943
No log	2.5135	186	1.9955	0.2519	1.9955	1.4126
No log	2.5405	188	1.9456	0.2628	1.9456	1.3948
No log	2.5676	190	1.7663	0.2979	1.7663	1.3290
No log	2.5946	192	1.6443	0.2979	1.6443	1.2823
No log	2.6216	194	1.7277	0.2754	1.7277	1.3144
No log	2.6486	196	1.8815	0.2979	1.8815	1.3717
No log	2.6757	198	2.0334	0.2394	2.0334	1.4260
No log	2.7027	200	2.0639	0.2394	2.0639	1.4366
No log	2.7297	202	1.9464	0.2979	1.9464	1.3952
No log	2.7568	204	1.8665	0.2857	1.8665	1.3662
No log	2.7838	206	1.8755	0.2857	1.8755	1.3695
No log	2.8108	208	1.9158	0.2979	1.9158	1.3841
No log	2.8378	210	1.7861	0.2878	1.7861	1.3364
No log	2.8649	212	1.7126	0.2754	1.7126	1.3087
No log	2.8919	214	1.7574	0.2754	1.7574	1.3257
No log	2.9189	216	1.8473	0.2878	1.8473	1.3592
No log	2.9459	218	1.9975	0.2098	1.9975	1.4133
No log	2.9730	220	2.0404	0.2098	2.0404	1.4284
No log	3.0	222	2.0427	0.2361	2.0427	1.4292
No log	3.0270	224	2.0333	0.2361	2.0333	1.4259
No log	3.0541	226	1.8211	0.2878	1.8211	1.3495
No log	3.0811	228	1.6396	0.3066	1.6396	1.2805
No log	3.1081	230	1.7417	0.2878	1.7417	1.3197
No log	3.1351	232	1.8638	0.2609	1.8638	1.3652
No log	3.1622	234	1.7882	0.2878	1.7882	1.3372
No log	3.1892	236	1.7538	0.2754	1.7538	1.3243
No log	3.2162	238	1.8301	0.2754	1.8301	1.3528
No log	3.2432	240	2.0411	0.2254	2.0411	1.4287
No log	3.2703	242	2.0349	0.2113	2.0349	1.4265
No log	3.2973	244	1.8773	0.2985	1.8773	1.3701
No log	3.3243	246	1.7832	0.3030	1.7832	1.3354
No log	3.3514	248	1.8028	0.3030	1.8028	1.3427
No log	3.3784	250	1.9413	0.25	1.9413	1.3933
No log	3.4054	252	2.1455	0.1690	2.1455	1.4648
No log	3.4324	254	2.2338	0.1690	2.2338	1.4946
No log	3.4595	256	2.1566	0.1714	2.1566	1.4685
No log	3.4865	258	1.8693	0.2174	1.8693	1.3672
No log	3.5135	260	1.7910	0.2537	1.7910	1.3383
No log	3.5405	262	1.9823	0.2143	1.9823	1.4079
No log	3.5676	264	2.2422	0.1678	2.2422	1.4974
No log	3.5946	266	2.2103	0.1944	2.2103	1.4867
No log	3.6216	268	1.9734	0.2302	1.9734	1.4048
No log	3.6486	270	1.7864	0.2482	1.7864	1.3366
No log	3.6757	272	1.8265	0.2609	1.8265	1.3515
No log	3.7027	274	1.8573	0.2774	1.8573	1.3628
No log	3.7297	276	1.7874	0.2815	1.7874	1.3369
No log	3.7568	278	1.7760	0.2815	1.7760	1.3327
No log	3.7838	280	1.7117	0.3111	1.7117	1.3083
No log	3.8108	282	1.7418	0.2815	1.7418	1.3198
No log	3.8378	284	1.9134	0.2647	1.9134	1.3832
No log	3.8649	286	2.0974	0.2621	2.0974	1.4482
No log	3.8919	288	2.0303	0.2703	2.0303	1.4249
No log	3.9189	290	1.8752	0.2817	1.8752	1.3694
No log	3.9459	292	1.6580	0.3008	1.6580	1.2876
No log	3.9730	294	1.6059	0.3008	1.6059	1.2672
No log	4.0	296	1.7647	0.2482	1.7647	1.3284
No log	4.0270	298	1.9474	0.2590	1.9474	1.3955
No log	4.0541	300	1.9699	0.2590	1.9699	1.4035
No log	4.0811	302	1.8697	0.2482	1.8697	1.3674
No log	4.1081	304	1.9198	0.2609	1.9198	1.3856
No log	4.1351	306	2.1902	0.2621	2.1902	1.4799
No log	4.1622	308	2.3349	0.2252	2.3349	1.5280
No log	4.1892	310	2.3096	0.1793	2.3096	1.5197
No log	4.2162	312	2.1531	0.2394	2.1531	1.4673
No log	4.2432	314	2.0617	0.2394	2.0617	1.4358
No log	4.2703	316	1.9228	0.2714	1.9228	1.3867
No log	4.2973	318	1.7270	0.2609	1.7270	1.3142
No log	4.3243	320	1.7251	0.2609	1.7251	1.3134
No log	4.3514	322	1.8620	0.2734	1.8620	1.3646
No log	4.3784	324	1.9269	0.2734	1.9269	1.3881
No log	4.4054	326	1.9465	0.2734	1.9465	1.3952
No log	4.4324	328	1.8983	0.2734	1.8983	1.3778
No log	4.4595	330	1.7369	0.2609	1.7369	1.3179
No log	4.4865	332	1.6227	0.3284	1.6227	1.2739
No log	4.5135	334	1.5866	0.3846	1.5866	1.2596
No log	4.5405	336	1.6032	0.3511	1.6032	1.2662
No log	4.5676	338	1.6439	0.3333	1.6439	1.2822
No log	4.5946	340	1.5972	0.3158	1.5972	1.2638
No log	4.6216	342	1.5825	0.3158	1.5825	1.2580
No log	4.6486	344	1.6903	0.2482	1.6903	1.3001
No log	4.6757	346	1.9716	0.2254	1.9716	1.4041
No log	4.7027	348	2.1143	0.1806	2.1143	1.4540
No log	4.7297	350	2.0682	0.2254	2.0682	1.4381
No log	4.7568	352	1.8465	0.2590	1.8465	1.3588
No log	4.7838	354	1.7666	0.2963	1.7666	1.3291
No log	4.8108	356	1.8024	0.2794	1.8024	1.3425
No log	4.8378	358	1.8811	0.2590	1.8811	1.3715
No log	4.8649	360	1.9735	0.2254	1.9735	1.4048
No log	4.8919	362	1.9062	0.2254	1.9062	1.3807
No log	4.9189	364	1.7682	0.2899	1.7682	1.3297
No log	4.9459	366	1.7736	0.2899	1.7736	1.3318
No log	4.9730	368	1.7032	0.2963	1.7032	1.3051
No log	5.0	370	1.8279	0.3066	1.8279	1.3520
No log	5.0270	372	2.0331	0.2254	2.0331	1.4259
No log	5.0541	374	2.2837	0.1831	2.2837	1.5112
No log	5.0811	376	2.3069	0.1379	2.3069	1.5188
No log	5.1081	378	2.2027	0.2128	2.2027	1.4842
No log	5.1351	380	1.9915	0.2667	1.9915	1.4112
No log	5.1622	382	1.8314	0.1818	1.8314	1.3533
No log	5.1892	384	1.7599	0.1897	1.7599	1.3266
No log	5.2162	386	1.7788	0.2185	1.7788	1.3337
No log	5.2432	388	1.8833	0.3411	1.8833	1.3723
No log	5.2703	390	1.9847	0.2429	1.9847	1.4088
No log	5.2973	392	1.9955	0.2254	1.9955	1.4126
No log	5.3243	394	1.9373	0.2714	1.9373	1.3919
No log	5.3514	396	1.7429	0.2941	1.7429	1.3202
No log	5.3784	398	1.6554	0.2963	1.6554	1.2866
No log	5.4054	400	1.5895	0.2963	1.5895	1.2607
No log	5.4324	402	1.7660	0.2754	1.7660	1.3289
No log	5.4595	404	2.1363	0.2553	2.1363	1.4616
No log	5.4865	406	2.1949	0.2254	2.1949	1.4815
No log	5.5135	408	1.9866	0.2714	1.9866	1.4095
No log	5.5405	410	1.9326	0.2979	1.9326	1.3902
No log	5.5676	412	1.9945	0.2817	1.9945	1.4123
No log	5.5946	414	2.0724	0.2394	2.0724	1.4396
No log	5.6216	416	1.9263	0.2714	1.9263	1.3879
No log	5.6486	418	1.7014	0.2878	1.7014	1.3044
No log	5.6757	420	1.5177	0.3259	1.5177	1.2319
No log	5.7027	422	1.5063	0.3259	1.5063	1.2273
No log	5.7297	424	1.6314	0.3382	1.6314	1.2773
No log	5.7568	426	1.8022	0.3453	1.8022	1.3425
No log	5.7838	428	1.9244	0.2254	1.9244	1.3872
No log	5.8108	430	1.8755	0.2676	1.8755	1.3695
No log	5.8378	432	1.7319	0.3478	1.7319	1.3160
No log	5.8649	434	1.6770	0.3504	1.6770	1.2950
No log	5.8919	436	1.7993	0.2837	1.7993	1.3414
No log	5.9189	438	1.8899	0.2676	1.8899	1.3747
No log	5.9459	440	1.7661	0.2979	1.7661	1.3289
No log	5.9730	442	1.6950	0.3088	1.6950	1.3019
No log	6.0	444	1.7172	0.3066	1.7172	1.3104
No log	6.0270	446	1.6532	0.3259	1.6532	1.2858
No log	6.0541	448	1.7115	0.25	1.7115	1.3082
No log	6.0811	450	1.8878	0.2174	1.8878	1.3740
No log	6.1081	452	1.9836	0.2411	1.9836	1.4084
No log	6.1351	454	1.8767	0.2411	1.8767	1.3699
No log	6.1622	456	1.7264	0.2899	1.7264	1.3139
No log	6.1892	458	1.7670	0.2899	1.7670	1.3293
No log	6.2162	460	1.8334	0.2628	1.8334	1.3540
No log	6.2432	462	1.9221	0.2411	1.9221	1.3864
No log	6.2703	464	1.9809	0.2411	1.9809	1.4074
No log	6.2973	466	1.8851	0.2411	1.8851	1.3730
No log	6.3243	468	1.7893	0.2899	1.7893	1.3377
No log	6.3514	470	1.7290	0.3134	1.7290	1.3149
No log	6.3784	472	1.7840	0.2609	1.7840	1.3357
No log	6.4054	474	1.8275	0.2302	1.8275	1.3519
No log	6.4324	476	1.8759	0.2429	1.8759	1.3696
No log	6.4595	478	1.9465	0.2411	1.9465	1.3952
No log	6.4865	480	1.8828	0.2411	1.8828	1.3722
No log	6.5135	482	1.8356	0.2319	1.8356	1.3548
No log	6.5405	484	1.6674	0.25	1.6674	1.2913
No log	6.5676	486	1.5943	0.3008	1.5943	1.2626
No log	6.5946	488	1.7414	0.2319	1.7414	1.3196
No log	6.6216	490	1.8507	0.2429	1.8507	1.3604
No log	6.6486	492	1.9539	0.2411	1.9539	1.3978
No log	6.6757	494	1.8845	0.2411	1.8845	1.3728
No log	6.7027	496	1.7819	0.2628	1.7819	1.3349
No log	6.7297	498	1.8309	0.2286	1.8309	1.3531
0.4543	6.7568	500	2.0496	0.2254	2.0496	1.4316
0.4543	6.7838	502	2.1797	0.1958	2.1797	1.4764
0.4543	6.8108	504	2.0754	0.2254	2.0754	1.4406
0.4543	6.8378	506	1.8257	0.2609	1.8257	1.3512
0.4543	6.8649	508	1.7264	0.2519	1.7264	1.3139
0.4543	6.8919	510	1.7775	0.2609	1.7775	1.3332
0.4543	6.9189	512	1.7732	0.2609	1.7732	1.3316
0.4543	6.9459	514	1.7829	0.2628	1.7829	1.3353
0.4543	6.9730	516	1.8837	0.2429	1.8837	1.3725
0.4543	7.0	518	1.9301	0.2411	1.9301	1.3893
0.4543	7.0270	520	1.9084	0.2429	1.9084	1.3815
0.4543	7.0541	522	1.8196	0.2429	1.8196	1.3489
0.4543	7.0811	524	1.6461	0.3088	1.6461	1.2830
0.4543	7.1081	526	1.6623	0.3088	1.6623	1.2893
0.4543	7.1351	528	1.7713	0.2734	1.7713	1.3309
0.4543	7.1622	530	1.8193	0.2429	1.8193	1.3488
0.4543	7.1892	532	1.8739	0.2429	1.8739	1.3689
0.4543	7.2162	534	1.7898	0.3165	1.7898	1.3378
0.4543	7.2432	536	1.6566	0.3066	1.6566	1.2871
0.4543	7.2703	538	1.6437	0.3088	1.6437	1.2821
0.4543	7.2973	540	1.6763	0.3235	1.6763	1.2947
0.4543	7.3243	542	1.8502	0.2754	1.8502	1.3602
0.4543	7.3514	544	2.0574	0.2639	2.0574	1.4344
0.4543	7.3784	546	2.0786	0.2639	2.0786	1.4417
0.4543	7.4054	548	1.8897	0.2590	1.8897	1.3746
0.4543	7.4324	550	1.8427	0.2609	1.8427	1.3575
0.4543	7.4595	552	1.9422	0.2714	1.9422	1.3936
0.4543	7.4865	554	1.9045	0.2714	1.9045	1.3800
0.4543	7.5135	556	1.7994	0.2734	1.7994	1.3414
0.4543	7.5405	558	1.6922	0.3066	1.6922	1.3008
0.4543	7.5676	560	1.6775	0.3066	1.6775	1.2952
0.4543	7.5946	562	1.5743	0.3259	1.5743	1.2547
0.4543	7.6216	564	1.5298	0.3459	1.5298	1.2369
0.4543	7.6486	566	1.6426	0.3066	1.6426	1.2817
0.4543	7.6757	568	1.9248	0.2714	1.9248	1.3874
0.4543	7.7027	570	2.1274	0.2254	2.1274	1.4585
0.4543	7.7297	572	2.1039	0.2254	2.1039	1.4505
0.4543	7.7568	574	2.0240	0.2254	2.0240	1.4227
0.4543	7.7838	576	1.9208	0.2714	1.9208	1.3859
0.4543	7.8108	578	1.8489	0.2609	1.8489	1.3598
0.4543	7.8378	580	1.8612	0.2609	1.8612	1.3643
0.4543	7.8649	582	1.9167	0.2609	1.9167	1.3844
0.4543	7.8919	584	1.9133	0.2609	1.9133	1.3832
0.4543	7.9189	586	2.0553	0.2411	2.0553	1.4336
0.4543	7.9459	588	2.1161	0.2411	2.1161	1.4547
0.4543	7.9730	590	1.9772	0.2411	1.9772	1.4061
0.4543	8.0	592	1.9463	0.2411	1.9463	1.3951
0.4543	8.0270	594	1.9813	0.2411	1.9813	1.4076
0.4543	8.0541	596	2.0672	0.2254	2.0672	1.4378
0.4543	8.0811	598	2.0759	0.2254	2.0759	1.4408
0.4543	8.1081	600	2.0381	0.2254	2.0381	1.4276
0.4543	8.1351	602	2.0994	0.2254	2.0994	1.4489
0.4543	8.1622	604	2.2040	0.2098	2.2040	1.4846

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1