ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7165
• Qwk: 0.3284
• Mse: 1.7165
• Rmse: 1.3102

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0476	2	6.8153	0.0176	6.8153	2.6106
No log	0.0952	4	4.3902	0.0684	4.3902	2.0953
No log	0.1429	6	3.5864	-0.0432	3.5864	1.8938
No log	0.1905	8	3.4554	-0.0330	3.4554	1.8589
No log	0.2381	10	2.6890	0.0563	2.6890	1.6398
No log	0.2857	12	2.3474	0.0317	2.3474	1.5321
No log	0.3333	14	2.1628	0.0508	2.1628	1.4706
No log	0.3810	16	1.8922	0.1429	1.8922	1.3756
No log	0.4286	18	1.7231	0.1538	1.7231	1.3127
No log	0.4762	20	1.6766	0.1538	1.6766	1.2949
No log	0.5238	22	1.6986	0.1698	1.6986	1.3033
No log	0.5714	24	1.8059	0.2456	1.8059	1.3438
No log	0.6190	26	1.8169	0.2957	1.8169	1.3479
No log	0.6667	28	1.8349	0.3051	1.8349	1.3546
No log	0.7143	30	1.8722	0.4094	1.8722	1.3683
No log	0.7619	32	2.0348	0.2206	2.0348	1.4265
No log	0.8095	34	1.9592	0.2370	1.9592	1.3997
No log	0.8571	36	1.7929	0.4065	1.7929	1.3390
No log	0.9048	38	1.6229	0.3333	1.6229	1.2739
No log	0.9524	40	1.5176	0.1869	1.5176	1.2319
No log	1.0	42	1.4800	0.2075	1.4800	1.2165
No log	1.0476	44	1.5372	0.2056	1.5372	1.2398
No log	1.0952	46	1.6060	0.2783	1.6060	1.2673
No log	1.1429	48	1.6884	0.2203	1.6884	1.2994
No log	1.1905	50	1.4954	0.3220	1.4954	1.2229
No log	1.2381	52	1.4359	0.3363	1.4359	1.1983
No log	1.2857	54	1.5555	0.3333	1.5555	1.2472
No log	1.3333	56	1.8874	0.1739	1.8874	1.3738
No log	1.3810	58	2.1754	0.0496	2.1754	1.4749
No log	1.4286	60	2.5726	-0.0945	2.5726	1.6039
No log	1.4762	62	3.1598	-0.1727	3.1598	1.7776
No log	1.5238	64	3.1739	-0.1871	3.1739	1.7816
No log	1.5714	66	3.2977	-0.2014	3.2977	1.8160
No log	1.6190	68	3.7594	-0.2420	3.7594	1.9389
No log	1.6667	70	4.1955	-0.2454	4.1955	2.0483
No log	1.7143	72	3.1261	-0.0746	3.1261	1.7681
No log	1.7619	74	2.2752	0.0172	2.2752	1.5084
No log	1.8095	76	1.4031	0.4167	1.4031	1.1845
No log	1.8571	78	1.2164	0.4127	1.2164	1.1029
No log	1.9048	80	1.5300	0.3359	1.5300	1.2369
No log	1.9524	82	1.9031	0.1045	1.9031	1.3795
No log	2.0	84	1.6561	0.3731	1.6561	1.2869
No log	2.0476	86	1.1586	0.5333	1.1586	1.0764
No log	2.0952	88	1.0462	0.5564	1.0462	1.0228
No log	2.1429	90	1.2043	0.5373	1.2043	1.0974
No log	2.1905	92	1.8871	0.0763	1.8871	1.3737
No log	2.2381	94	2.4881	-0.0976	2.4881	1.5774
No log	2.2857	96	2.4655	-0.1290	2.4655	1.5702
No log	2.3333	98	1.8236	0.125	1.8236	1.3504
No log	2.3810	100	1.3833	0.4427	1.3833	1.1761
No log	2.4286	102	1.3588	0.3780	1.3588	1.1657
No log	2.4762	104	1.5530	0.3360	1.5530	1.2462
No log	2.5238	106	1.7438	0.2205	1.7438	1.3205
No log	2.5714	108	2.1689	-0.0472	2.1689	1.4727
No log	2.6190	110	2.0606	0.0303	2.0606	1.4355
No log	2.6667	112	1.6959	0.3043	1.6959	1.3023
No log	2.7143	114	1.5717	0.4118	1.5717	1.2537
No log	2.7619	116	1.6340	0.3597	1.6340	1.2783
No log	2.8095	118	1.5618	0.4234	1.5618	1.2497
No log	2.8571	120	1.6713	0.3429	1.6713	1.2928
No log	2.9048	122	1.6033	0.3913	1.6033	1.2662
No log	2.9524	124	1.6504	0.3741	1.6504	1.2847
No log	3.0	126	1.6349	0.3741	1.6349	1.2786
No log	3.0476	128	1.5900	0.4380	1.5900	1.2609
No log	3.0952	130	1.4519	0.4478	1.4519	1.2049
No log	3.1429	132	1.2286	0.5038	1.2286	1.1084
No log	3.1905	134	1.2428	0.4812	1.2428	1.1148
No log	3.2381	136	1.5086	0.4058	1.5086	1.2283
No log	3.2857	138	1.6923	0.4058	1.6923	1.3009
No log	3.3333	140	1.5389	0.4058	1.5389	1.2405
No log	3.3810	142	1.3735	0.4741	1.3735	1.1720
No log	3.4286	144	1.2920	0.4853	1.2920	1.1367
No log	3.4762	146	1.3922	0.4234	1.3922	1.1799
No log	3.5238	148	1.7950	0.2774	1.7950	1.3398
No log	3.5714	150	2.1787	0.0147	2.1787	1.4761
No log	3.6190	152	2.1400	0.0147	2.1400	1.4629
No log	3.6667	154	1.8292	0.2857	1.8292	1.3525
No log	3.7143	156	1.4309	0.4361	1.4309	1.1962
No log	3.7619	158	1.3490	0.4094	1.3490	1.1615
No log	3.8095	160	1.4545	0.4361	1.4545	1.2060
No log	3.8571	162	1.6975	0.3158	1.6975	1.3029
No log	3.9048	164	1.8110	0.2941	1.8110	1.3458
No log	3.9524	166	1.5966	0.3852	1.5966	1.2636
No log	4.0	168	1.3703	0.4545	1.3703	1.1706
No log	4.0476	170	1.3973	0.4394	1.3973	1.1821
No log	4.0952	172	1.6703	0.3824	1.6703	1.2924
No log	4.1429	174	1.7053	0.3824	1.7053	1.3059
No log	4.1905	176	1.6505	0.3824	1.6505	1.2847
No log	4.2381	178	1.3778	0.4662	1.3778	1.1738
No log	4.2857	180	1.3375	0.4923	1.3375	1.1565
No log	4.3333	182	1.3910	0.4394	1.3910	1.1794
No log	4.3810	184	1.7307	0.3429	1.7307	1.3156
No log	4.4286	186	2.1918	0.1831	2.1918	1.4805
No log	4.4762	188	2.1894	0.1286	2.1894	1.4797
No log	4.5238	190	1.8107	0.2270	1.8107	1.3456
No log	4.5714	192	1.5496	0.4444	1.5496	1.2448
No log	4.6190	194	1.3481	0.4627	1.3481	1.1611
No log	4.6667	196	1.3175	0.4662	1.3175	1.1478
No log	4.7143	198	1.3203	0.4848	1.3203	1.1490
No log	4.7619	200	1.2657	0.5077	1.2657	1.1250
No log	4.8095	202	1.3776	0.4545	1.3776	1.1737
No log	4.8571	204	1.5422	0.4118	1.5422	1.2418
No log	4.9048	206	1.7461	0.3309	1.7461	1.3214
No log	4.9524	208	1.6815	0.3309	1.6815	1.2967
No log	5.0	210	1.5516	0.3759	1.5516	1.2456
No log	5.0476	212	1.4413	0.4496	1.4413	1.2006
No log	5.0952	214	1.5279	0.4122	1.5279	1.2361
No log	5.1429	216	1.7778	0.3043	1.7778	1.3333
No log	5.1905	218	1.9573	0.2734	1.9573	1.3990
No log	5.2381	220	1.9261	0.2734	1.9261	1.3878
No log	5.2857	222	1.7694	0.3478	1.7694	1.3302
No log	5.3333	224	1.5975	0.4179	1.5975	1.2639
No log	5.3810	226	1.5314	0.4593	1.5314	1.2375
No log	5.4286	228	1.6536	0.4	1.6536	1.2859
No log	5.4762	230	1.8727	0.2734	1.8727	1.3685
No log	5.5238	232	1.7874	0.3309	1.7874	1.3369
No log	5.5714	234	1.5496	0.4593	1.5496	1.2448
No log	5.6190	236	1.4876	0.4697	1.4876	1.2197
No log	5.6667	238	1.4667	0.4341	1.4667	1.2111
No log	5.7143	240	1.5362	0.4328	1.5362	1.2394
No log	5.7619	242	1.6554	0.3597	1.6554	1.2866
No log	5.8095	244	1.6654	0.3429	1.6654	1.2905
No log	5.8571	246	1.5435	0.3796	1.5435	1.2424
No log	5.9048	248	1.4732	0.4394	1.4732	1.2137
No log	5.9524	250	1.6243	0.3650	1.6243	1.2745
No log	6.0	252	1.8665	0.3022	1.8665	1.3662
No log	6.0476	254	1.9145	0.2714	1.9145	1.3836
No log	6.0952	256	1.6716	0.3676	1.6716	1.2929
No log	6.1429	258	1.3970	0.4320	1.3970	1.1820
No log	6.1905	260	1.2973	0.4068	1.2973	1.1390
No log	6.2381	262	1.2775	0.4034	1.2775	1.1303
No log	6.2857	264	1.3599	0.4724	1.3599	1.1661
No log	6.3333	266	1.5283	0.4427	1.5283	1.2363
No log	6.3810	268	1.7222	0.3309	1.7222	1.3123
No log	6.4286	270	1.8930	0.2714	1.8930	1.3758
No log	6.4762	272	1.8480	0.2734	1.8480	1.3594
No log	6.5238	274	1.6034	0.3881	1.6034	1.2663
No log	6.5714	276	1.3258	0.5079	1.3258	1.1514
No log	6.6190	278	1.2561	0.5	1.2561	1.1208
No log	6.6667	280	1.3153	0.4762	1.3153	1.1469
No log	6.7143	282	1.4916	0.3939	1.4916	1.2213
No log	6.7619	284	1.6079	0.3704	1.6079	1.2680
No log	6.8095	286	1.7687	0.3043	1.7687	1.3299
No log	6.8571	288	1.7182	0.3212	1.7182	1.3108
No log	6.9048	290	1.5972	0.3676	1.5972	1.2638
No log	6.9524	292	1.5217	0.4058	1.5217	1.2336
No log	7.0	294	1.4804	0.4412	1.4804	1.2167
No log	7.0476	296	1.6073	0.3676	1.6073	1.2678
No log	7.0952	298	1.7811	0.3022	1.7811	1.3346
No log	7.1429	300	1.8249	0.3022	1.8249	1.3509
No log	7.1905	302	1.6226	0.3407	1.6226	1.2738
No log	7.2381	304	1.5026	0.3485	1.5026	1.2258
No log	7.2857	306	1.3926	0.3876	1.3926	1.1801
No log	7.3333	308	1.4054	0.3594	1.4054	1.1855
No log	7.3810	310	1.5171	0.3485	1.5171	1.2317
No log	7.4286	312	1.5650	0.3582	1.5650	1.2510
No log	7.4762	314	1.5549	0.3852	1.5549	1.2470
No log	7.5238	316	1.6407	0.3407	1.6407	1.2809
No log	7.5714	318	1.5898	0.3676	1.5898	1.2609
No log	7.6190	320	1.5472	0.3824	1.5472	1.2438
No log	7.6667	322	1.5443	0.4148	1.5443	1.2427
No log	7.7143	324	1.5231	0.3881	1.5231	1.2341
No log	7.7619	326	1.4602	0.4328	1.4602	1.2084
No log	7.8095	328	1.6444	0.3704	1.6444	1.2823
No log	7.8571	330	2.1218	0.2158	2.1218	1.4566
No log	7.9048	332	2.4063	0.1690	2.4063	1.5512
No log	7.9524	334	2.4750	0.2083	2.4750	1.5732
No log	8.0	336	2.2590	0.2222	2.2590	1.5030
No log	8.0476	338	1.8556	0.3243	1.8556	1.3622
No log	8.0952	340	1.5614	0.3881	1.5614	1.2496
No log	8.1429	342	1.4901	0.4091	1.4901	1.2207
No log	8.1905	344	1.4836	0.4122	1.4836	1.2180
No log	8.2381	346	1.6251	0.3529	1.6251	1.2748
No log	8.2857	348	1.7789	0.3043	1.7789	1.3338
No log	8.3333	350	1.7020	0.3529	1.7020	1.3046
No log	8.3810	352	1.5631	0.4122	1.5631	1.2502
No log	8.4286	354	1.5588	0.4122	1.5588	1.2485
No log	8.4762	356	1.5783	0.4211	1.5783	1.2563
No log	8.5238	358	1.6774	0.3358	1.6774	1.2952
No log	8.5714	360	1.7395	0.3309	1.7395	1.3189
No log	8.6190	362	1.6180	0.3852	1.6180	1.2720
No log	8.6667	364	1.5031	0.3969	1.5031	1.2260
No log	8.7143	366	1.4633	0.3969	1.4633	1.2097
No log	8.7619	368	1.4945	0.3969	1.4945	1.2225
No log	8.8095	370	1.6217	0.3881	1.6217	1.2734
No log	8.8571	372	1.6553	0.3609	1.6553	1.2866
No log	8.9048	374	1.7400	0.2920	1.7400	1.3191
No log	8.9524	376	1.7512	0.2920	1.7512	1.3233
No log	9.0	378	1.5874	0.3609	1.5874	1.2599
No log	9.0476	380	1.4478	0.4615	1.4478	1.2033
No log	9.0952	382	1.4393	0.4375	1.4393	1.1997
No log	9.1429	384	1.5548	0.4122	1.5548	1.2469
No log	9.1905	386	1.6009	0.3788	1.6009	1.2653
No log	9.2381	388	1.6004	0.3788	1.6005	1.2651
No log	9.2857	390	1.7129	0.3407	1.7129	1.3088
No log	9.3333	392	1.8705	0.2878	1.8705	1.3677
No log	9.3810	394	1.8703	0.2878	1.8703	1.3676
No log	9.4286	396	1.6980	0.3043	1.6980	1.3031
No log	9.4762	398	1.5683	0.4091	1.5683	1.2523
No log	9.5238	400	1.5882	0.3969	1.5882	1.2602
No log	9.5714	402	1.5827	0.3969	1.5827	1.2581
No log	9.6190	404	1.5721	0.3939	1.5721	1.2539
No log	9.6667	406	1.5058	0.4328	1.5058	1.2271
No log	9.7143	408	1.3790	0.4328	1.3790	1.1743
No log	9.7619	410	1.3542	0.4593	1.3542	1.1637
No log	9.8095	412	1.4748	0.4593	1.4748	1.2144
No log	9.8571	414	1.6764	0.3478	1.6764	1.2948
No log	9.9048	416	1.7859	0.3309	1.7859	1.3364
No log	9.9524	418	1.8725	0.2734	1.8725	1.3684
No log	10.0	420	1.7228	0.3478	1.7228	1.3125
No log	10.0476	422	1.5687	0.4148	1.5687	1.2525
No log	10.0952	424	1.5755	0.4148	1.5755	1.2552
No log	10.1429	426	1.5358	0.4148	1.5358	1.2393
No log	10.1905	428	1.6063	0.3650	1.6063	1.2674
No log	10.2381	430	1.5410	0.3650	1.5410	1.2414
No log	10.2857	432	1.3779	0.4361	1.3779	1.1738
No log	10.3333	434	1.4044	0.4361	1.4044	1.1851
No log	10.3810	436	1.5530	0.3650	1.5530	1.2462
No log	10.4286	438	1.7495	0.3382	1.7495	1.3227
No log	10.4762	440	1.8386	0.2774	1.8386	1.3560
No log	10.5238	442	1.8143	0.2941	1.8143	1.3469
No log	10.5714	444	1.7940	0.3212	1.7940	1.3394
No log	10.6190	446	1.8178	0.3212	1.8178	1.3483
No log	10.6667	448	1.8354	0.3212	1.8354	1.3548
No log	10.7143	450	1.8456	0.2899	1.8456	1.3585
No log	10.7619	452	1.9298	0.2158	1.9298	1.3892
No log	10.8095	454	1.8333	0.2628	1.8333	1.3540
No log	10.8571	456	1.7377	0.3259	1.7377	1.3182
No log	10.9048	458	1.6147	0.3759	1.6147	1.2707
No log	10.9524	460	1.6085	0.4030	1.6085	1.2683
No log	11.0	462	1.6248	0.4148	1.6248	1.2747
No log	11.0476	464	1.6879	0.3529	1.6879	1.2992
No log	11.0952	466	1.8491	0.2319	1.8491	1.3598
No log	11.1429	468	2.0770	0.1986	2.0770	1.4412
No log	11.1905	470	2.1604	0.1986	2.1604	1.4698
No log	11.2381	472	2.0176	0.2143	2.0176	1.4204
No log	11.2857	474	1.7859	0.3333	1.7859	1.3364
No log	11.3333	476	1.5774	0.3721	1.5774	1.2559
No log	11.3810	478	1.4542	0.4603	1.4542	1.2059
No log	11.4286	480	1.4568	0.4341	1.4568	1.2070
No log	11.4762	482	1.5215	0.3788	1.5215	1.2335
No log	11.5238	484	1.6725	0.3881	1.6725	1.2932
No log	11.5714	486	1.8786	0.2857	1.8786	1.3706
No log	11.6190	488	1.9784	0.2286	1.9784	1.4065
No log	11.6667	490	1.9275	0.2590	1.9275	1.3883
No log	11.7143	492	1.8429	0.2941	1.8429	1.3575
No log	11.7619	494	1.7531	0.3433	1.7531	1.3240
No log	11.8095	496	1.6677	0.3788	1.6677	1.2914
No log	11.8571	498	1.6918	0.3485	1.6918	1.3007
0.3622	11.9048	500	1.7616	0.3433	1.7616	1.3272
0.3622	11.9524	502	1.9218	0.2754	1.9218	1.3863
0.3622	12.0	504	2.0381	0.1986	2.0381	1.4276
0.3622	12.0476	506	2.0315	0.1986	2.0315	1.4253
0.3622	12.0952	508	1.8812	0.2754	1.8812	1.3716
0.3622	12.1429	510	1.6540	0.3876	1.6540	1.2861
0.3622	12.1905	512	1.5492	0.4094	1.5492	1.2447
0.3622	12.2381	514	1.5265	0.3810	1.5265	1.2355
0.3622	12.2857	516	1.5643	0.3810	1.5643	1.2507
0.3622	12.3333	518	1.6897	0.3538	1.6897	1.2999
0.3622	12.3810	520	1.8749	0.25	1.8749	1.3693
0.3622	12.4286	522	1.9546	0.2143	1.9546	1.3981
0.3622	12.4762	524	1.8734	0.2774	1.8734	1.3687
0.3622	12.5238	526	1.6573	0.3433	1.6573	1.2874
0.3622	12.5714	528	1.4388	0.4462	1.4388	1.1995
0.3622	12.6190	530	1.3347	0.4444	1.3347	1.1553
0.3622	12.6667	532	1.3400	0.4409	1.3400	1.1576
0.3622	12.7143	534	1.4196	0.4462	1.4196	1.1915
0.3622	12.7619	536	1.5586	0.4060	1.5586	1.2484
0.3622	12.8095	538	1.7493	0.3088	1.7493	1.3226
0.3622	12.8571	540	1.8168	0.2609	1.8168	1.3479
0.3622	12.9048	542	1.7561	0.3284	1.7561	1.3252
0.3622	12.9524	544	1.7259	0.3284	1.7259	1.3138
0.3622	13.0	546	1.6591	0.3788	1.6591	1.2881
0.3622	13.0476	548	1.6526	0.3788	1.6526	1.2855
0.3622	13.0952	550	1.5968	0.3969	1.5968	1.2636
0.3622	13.1429	552	1.6365	0.3788	1.6365	1.2792
0.3622	13.1905	554	1.7560	0.3259	1.7560	1.3251
0.3622	13.2381	556	1.8556	0.2628	1.8556	1.3622
0.3622	13.2857	558	1.8430	0.2628	1.8430	1.3576
0.3622	13.3333	560	1.7579	0.2985	1.7579	1.3258
0.3622	13.3810	562	1.7165	0.3284	1.7165	1.3102

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1