ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k7_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7068
• Qwk: 0.2963
• Mse: 1.7068
• Rmse: 1.3065

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	7.1947	0.0	7.1947	2.6823
No log	0.1212	4	4.8188	0.0758	4.8188	2.1952
No log	0.1818	6	3.6056	0.0108	3.6056	1.8988
No log	0.2424	8	2.7641	0.1096	2.7641	1.6626
No log	0.3030	10	2.0281	0.0968	2.0281	1.4241
No log	0.3636	12	1.6836	0.1538	1.6836	1.2976
No log	0.4242	14	1.6478	0.1714	1.6478	1.2837
No log	0.4848	16	1.6078	0.1538	1.6078	1.2680
No log	0.5455	18	1.7977	0.2703	1.7977	1.3408
No log	0.6061	20	2.2966	0.0567	2.2966	1.5155
No log	0.6667	22	2.5720	0.0411	2.5720	1.6037
No log	0.7273	24	2.4914	0.0411	2.4914	1.5784
No log	0.7879	26	2.2655	0.0857	2.2655	1.5051
No log	0.8485	28	1.9332	0.3193	1.9332	1.3904
No log	0.9091	30	1.7468	0.2056	1.7468	1.3217
No log	0.9697	32	1.7034	0.0971	1.7034	1.3051
No log	1.0303	34	1.8678	0.0762	1.8678	1.3667
No log	1.0909	36	2.1655	0.1833	2.1655	1.4716
No log	1.1515	38	2.3498	-0.0448	2.3498	1.5329
No log	1.2121	40	2.1479	0.1833	2.1479	1.4656
No log	1.2727	42	1.9532	0.0917	1.9532	1.3976
No log	1.3333	44	1.8055	0.1121	1.8055	1.3437
No log	1.3939	46	1.6560	0.1154	1.6560	1.2869
No log	1.4545	48	1.5572	0.1538	1.5572	1.2479
No log	1.5152	50	1.4753	0.1714	1.4753	1.2146
No log	1.5758	52	1.4392	0.1887	1.4392	1.1997
No log	1.6364	54	1.4913	0.3894	1.4913	1.2212
No log	1.6970	56	1.5011	0.3393	1.5011	1.2252
No log	1.7576	58	1.4965	0.3243	1.4965	1.2233
No log	1.8182	60	1.5096	0.2243	1.5096	1.2287
No log	1.8788	62	1.4581	0.2222	1.4581	1.2075
No log	1.9394	64	1.5133	0.2222	1.5133	1.2302
No log	2.0	66	1.7202	0.3226	1.7202	1.3116
No log	2.0606	68	1.7843	0.3594	1.7843	1.3358
No log	2.1212	70	1.5711	0.3729	1.5711	1.2535
No log	2.1818	72	1.3914	0.2545	1.3914	1.1796
No log	2.2424	74	1.3824	0.2407	1.3824	1.1758
No log	2.3030	76	1.4828	0.3455	1.4828	1.2177
No log	2.3636	78	1.5324	0.2593	1.5324	1.2379
No log	2.4242	80	1.5866	0.2385	1.5866	1.2596
No log	2.4848	82	1.6439	0.2703	1.6439	1.2821
No log	2.5455	84	1.6856	0.2523	1.6856	1.2983
No log	2.6061	86	1.8017	0.2703	1.8017	1.3423
No log	2.6667	88	1.9261	0.1982	1.9261	1.3878
No log	2.7273	90	2.1762	0.0164	2.1762	1.4752
No log	2.7879	92	1.9941	0.1880	1.9941	1.4121
No log	2.8485	94	1.7734	0.2326	1.7734	1.3317
No log	2.9091	96	1.6850	0.3411	1.6850	1.2981
No log	2.9697	98	1.7672	0.3053	1.7672	1.3294
No log	3.0303	100	1.9479	0.2206	1.9479	1.3957
No log	3.0909	102	1.9091	0.2388	1.9091	1.3817
No log	3.1515	104	1.7245	0.3248	1.7245	1.3132
No log	3.2121	106	1.8872	0.1322	1.8872	1.3737
No log	3.2727	108	1.7853	0.2373	1.7853	1.3362
No log	3.3333	110	1.7994	0.2698	1.7994	1.3414
No log	3.3939	112	1.8474	0.2667	1.8474	1.3592
No log	3.4545	114	1.8515	0.3158	1.8515	1.3607
No log	3.5152	116	1.8481	0.2482	1.8481	1.3594
No log	3.5758	118	1.7699	0.2647	1.7699	1.3304
No log	3.6364	120	1.7618	0.2707	1.7618	1.3273
No log	3.6970	122	1.7843	0.2556	1.7843	1.3358
No log	3.7576	124	1.7633	0.2556	1.7633	1.3279
No log	3.8182	126	1.8042	0.2464	1.8042	1.3432
No log	3.8788	128	1.8042	0.2464	1.8042	1.3432
No log	3.9394	130	1.8586	0.2190	1.8586	1.3633
No log	4.0	132	1.9356	0.1884	1.9356	1.3913
No log	4.0606	134	1.9259	0.2370	1.9259	1.3878
No log	4.1212	136	1.8784	0.2370	1.8784	1.3705
No log	4.1818	138	1.8366	0.2370	1.8366	1.3552
No log	4.2424	140	1.7381	0.2901	1.7381	1.3184
No log	4.3030	142	1.6363	0.3231	1.6363	1.2792
No log	4.3636	144	1.5966	0.3175	1.5966	1.2636
No log	4.4242	146	1.5795	0.3115	1.5795	1.2568
No log	4.4848	148	1.5456	0.3051	1.5456	1.2432
No log	4.5455	150	1.6037	0.3651	1.6037	1.2664
No log	4.6061	152	1.7357	0.2963	1.7357	1.3175
No log	4.6667	154	1.6721	0.3433	1.6721	1.2931
No log	4.7273	156	1.5488	0.3721	1.5488	1.2445
No log	4.7879	158	1.4853	0.368	1.4853	1.2187
No log	4.8485	160	1.5375	0.3101	1.5375	1.2400
No log	4.9091	162	1.7482	0.2963	1.7482	1.3222
No log	4.9697	164	1.7923	0.2963	1.7923	1.3388
No log	5.0303	166	1.7328	0.3008	1.7328	1.3164
No log	5.0909	168	1.6001	0.3459	1.6001	1.2649
No log	5.1515	170	1.5266	0.3511	1.5266	1.2355
No log	5.2121	172	1.5626	0.3134	1.5626	1.2500
No log	5.2727	174	1.6306	0.3259	1.6306	1.2770
No log	5.3333	176	1.7270	0.2985	1.7270	1.3141
No log	5.3939	178	1.7243	0.3134	1.7243	1.3131
No log	5.4545	180	1.7517	0.3066	1.7517	1.3235
No log	5.5152	182	1.9195	0.2609	1.9195	1.3855
No log	5.5758	184	1.9573	0.2920	1.9573	1.3990
No log	5.6364	186	1.9126	0.2609	1.9126	1.3830
No log	5.6970	188	1.7204	0.3360	1.7204	1.3117
No log	5.7576	190	1.6516	0.3140	1.6516	1.2852
No log	5.8182	192	1.6653	0.3780	1.6653	1.2904
No log	5.8788	194	1.8181	0.2206	1.8181	1.3484
No log	5.9394	196	1.9332	0.2464	1.9332	1.3904
No log	6.0	198	1.7680	0.2370	1.7680	1.3297
No log	6.0606	200	1.5388	0.3520	1.5388	1.2405
No log	6.1212	202	1.5134	0.3902	1.5134	1.2302
No log	6.1818	204	1.6656	0.3158	1.6656	1.2906
No log	6.2424	206	1.9706	0.2464	1.9706	1.4038
No log	6.3030	208	2.0101	0.2302	2.0101	1.4178
No log	6.3636	210	2.0160	0.2302	2.0160	1.4199
No log	6.4242	212	1.9011	0.3043	1.9011	1.3788
No log	6.4848	214	1.7404	0.2794	1.7404	1.3192
No log	6.5455	216	1.7202	0.2794	1.7202	1.3116
No log	6.6061	218	1.8361	0.3043	1.8361	1.3550
No log	6.6667	220	1.8843	0.2734	1.8843	1.3727
No log	6.7273	222	2.0334	0.2571	2.0334	1.4260
No log	6.7879	224	2.0080	0.2571	2.0080	1.4170
No log	6.8485	226	1.7690	0.3043	1.7690	1.3300
No log	6.9091	228	1.5849	0.3459	1.5849	1.2589
No log	6.9697	230	1.4827	0.3622	1.4827	1.2177
No log	7.0303	232	1.5021	0.3548	1.5021	1.2256
No log	7.0909	234	1.5497	0.3622	1.5497	1.2449
No log	7.1515	236	1.5710	0.3438	1.5710	1.2534
No log	7.2121	238	1.5282	0.3016	1.5282	1.2362
No log	7.2727	240	1.5584	0.3411	1.5584	1.2484
No log	7.3333	242	1.7973	0.2609	1.7973	1.3406
No log	7.3939	244	2.1203	0.2571	2.1203	1.4561
No log	7.4545	246	2.0886	0.2302	2.0886	1.4452
No log	7.5152	248	1.7938	0.2609	1.7938	1.3393
No log	7.5758	250	1.5384	0.3492	1.5384	1.2403
No log	7.6364	252	1.4913	0.3802	1.4913	1.2212
No log	7.6970	254	1.5576	0.3492	1.5576	1.2480
No log	7.7576	256	1.7180	0.25	1.7180	1.3107
No log	7.8182	258	1.9190	0.2344	1.9190	1.3853
No log	7.8788	260	2.0324	0.1926	2.0324	1.4256
No log	7.9394	262	1.9685	0.2464	1.9685	1.4030
No log	8.0	264	1.6444	0.3459	1.6444	1.2824
No log	8.0606	266	1.3754	0.4034	1.3754	1.1728
No log	8.1212	268	1.3458	0.3966	1.3458	1.1601
No log	8.1818	270	1.3990	0.4034	1.3990	1.1828
No log	8.2424	272	1.5776	0.4091	1.5776	1.2560
No log	8.3030	274	1.8652	0.2464	1.8652	1.3657
No log	8.3636	276	1.9243	0.2734	1.9243	1.3872
No log	8.4242	278	1.7612	0.3043	1.7612	1.3271
No log	8.4848	280	1.5628	0.4060	1.5628	1.2501
No log	8.5455	282	1.5088	0.3710	1.5088	1.2283
No log	8.6061	284	1.5276	0.4000	1.5276	1.2360
No log	8.6667	286	1.5864	0.3566	1.5864	1.2595
No log	8.7273	288	1.6609	0.2941	1.6609	1.2888
No log	8.7879	290	1.6365	0.3043	1.6365	1.2793
No log	8.8485	292	1.5615	0.3538	1.5615	1.2496
No log	8.9091	294	1.5225	0.3538	1.5225	1.2339
No log	8.9697	296	1.6027	0.3212	1.6027	1.2660
No log	9.0303	298	1.7507	0.3043	1.7507	1.3231
No log	9.0909	300	1.6590	0.3212	1.6590	1.2880
No log	9.1515	302	1.4928	0.3529	1.4928	1.2218
No log	9.2121	304	1.4470	0.3284	1.4470	1.2029
No log	9.2727	306	1.5647	0.3407	1.5647	1.2509
No log	9.3333	308	1.7155	0.3235	1.7155	1.3098
No log	9.3939	310	1.9221	0.2571	1.9221	1.3864
No log	9.4545	312	1.9787	0.2571	1.9787	1.4067
No log	9.5152	314	1.8703	0.3043	1.8703	1.3676
No log	9.5758	316	1.6693	0.3158	1.6693	1.2920
No log	9.6364	318	1.5395	0.3511	1.5395	1.2408
No log	9.6970	320	1.4897	0.3846	1.4897	1.2205
No log	9.7576	322	1.5723	0.3676	1.5723	1.2539
No log	9.8182	324	1.8181	0.3043	1.8181	1.3484
No log	9.8788	326	2.0522	0.2270	2.0522	1.4325
No log	9.9394	328	2.0928	0.2254	2.0928	1.4467
No log	10.0	330	1.9354	0.2734	1.9354	1.3912
No log	10.0606	332	1.6468	0.3846	1.6468	1.2833
No log	10.1212	334	1.5339	0.4194	1.5339	1.2385
No log	10.1818	336	1.4530	0.4516	1.4530	1.2054
No log	10.2424	338	1.4666	0.4688	1.4666	1.2110
No log	10.3030	340	1.6527	0.3333	1.6527	1.2856
No log	10.3636	342	1.8709	0.2817	1.8709	1.3678
No log	10.4242	344	1.9175	0.3243	1.9175	1.3847
No log	10.4848	346	1.6798	0.3143	1.6798	1.2961
No log	10.5455	348	1.3684	0.4925	1.3684	1.1698
No log	10.6061	350	1.2771	0.5271	1.2771	1.1301
No log	10.6667	352	1.3886	0.5116	1.3886	1.1784
No log	10.7273	354	1.5129	0.3939	1.5129	1.2300
No log	10.7879	356	1.6340	0.3382	1.6340	1.2783
No log	10.8485	358	1.5479	0.3382	1.5479	1.2441
No log	10.9091	360	1.3603	0.5	1.3603	1.1663
No log	10.9697	362	1.3114	0.5	1.3114	1.1452
No log	11.0303	364	1.3728	0.4412	1.3728	1.1717
No log	11.0909	366	1.5627	0.3382	1.5627	1.2501
No log	11.1515	368	1.7451	0.2899	1.7451	1.3210
No log	11.2121	370	1.8348	0.2734	1.8348	1.3545
No log	11.2727	372	1.7428	0.2941	1.7428	1.3202
No log	11.3333	374	1.5794	0.4094	1.5794	1.2567
No log	11.3939	376	1.4365	0.4500	1.4365	1.1985
No log	11.4545	378	1.4202	0.4500	1.4202	1.1917
No log	11.5152	380	1.5039	0.4094	1.5039	1.2264
No log	11.5758	382	1.6680	0.3259	1.6680	1.2915
No log	11.6364	384	1.9550	0.2000	1.9550	1.3982
No log	11.6970	386	2.0803	0.2000	2.0803	1.4423
No log	11.7576	388	2.0278	0.2000	2.0278	1.4240
No log	11.8182	390	1.7596	0.2899	1.7596	1.3265
No log	11.8788	392	1.6401	0.2941	1.6401	1.2807
No log	11.9394	394	1.6265	0.2941	1.6265	1.2753
No log	12.0	396	1.7523	0.3066	1.7523	1.3237
No log	12.0606	398	1.9215	0.2302	1.9215	1.3862
No log	12.1212	400	1.9391	0.2302	1.9391	1.3925
No log	12.1818	402	1.7770	0.3066	1.7770	1.3331
No log	12.2424	404	1.5616	0.3939	1.5616	1.2496
No log	12.3030	406	1.5224	0.4219	1.5224	1.2338
No log	12.3636	408	1.4826	0.4341	1.4826	1.2176
No log	12.4242	410	1.6180	0.3259	1.6180	1.2720
No log	12.4848	412	1.7410	0.3382	1.7410	1.3195
No log	12.5455	414	1.8147	0.2794	1.8147	1.3471
No log	12.6061	416	1.8792	0.2794	1.8792	1.3708
No log	12.6667	418	1.8590	0.3111	1.8590	1.3634
No log	12.7273	420	1.7510	0.3111	1.7510	1.3232
No log	12.7879	422	1.5940	0.3664	1.5940	1.2625
No log	12.8485	424	1.4981	0.4409	1.4981	1.2240
No log	12.9091	426	1.4648	0.4409	1.4648	1.2103
No log	12.9697	428	1.5511	0.3556	1.5511	1.2454
No log	13.0303	430	1.6838	0.3382	1.6838	1.2976
No log	13.0909	432	1.8161	0.2774	1.8161	1.3476
No log	13.1515	434	1.9907	0.2302	1.9907	1.4109
No log	13.2121	436	1.9049	0.2609	1.9049	1.3802
No log	13.2727	438	1.7255	0.3212	1.7255	1.3136
No log	13.3333	440	1.4713	0.3876	1.4713	1.2130
No log	13.3939	442	1.3939	0.4444	1.3939	1.1806
No log	13.4545	444	1.4259	0.4286	1.4259	1.1941
No log	13.5152	446	1.5040	0.4062	1.5040	1.2264
No log	13.5758	448	1.4926	0.4062	1.4926	1.2217
No log	13.6364	450	1.4311	0.4320	1.4311	1.1963
No log	13.6970	452	1.4032	0.4355	1.4032	1.1846
No log	13.7576	454	1.3921	0.4553	1.3921	1.1799
No log	13.8182	456	1.4664	0.4160	1.4664	1.2110
No log	13.8788	458	1.6024	0.375	1.6024	1.2659
No log	13.9394	460	1.7598	0.3284	1.7598	1.3266
No log	14.0	462	1.7604	0.3158	1.7604	1.3268
No log	14.0606	464	1.6166	0.3692	1.6166	1.2714
No log	14.1212	466	1.4339	0.4409	1.4339	1.1974
No log	14.1818	468	1.3192	0.4590	1.3192	1.1486
No log	14.2424	470	1.2869	0.4463	1.2869	1.1344
No log	14.3030	472	1.3316	0.4590	1.3316	1.1539
No log	14.3636	474	1.3917	0.4355	1.3917	1.1797
No log	14.4242	476	1.4755	0.4127	1.4755	1.2147
No log	14.4848	478	1.4865	0.4252	1.4865	1.2192
No log	14.5455	480	1.3736	0.4409	1.3736	1.1720
No log	14.6061	482	1.2787	0.4918	1.2787	1.1308
No log	14.6667	484	1.2980	0.4567	1.2980	1.1393
No log	14.7273	486	1.3660	0.4651	1.3660	1.1688
No log	14.7879	488	1.4478	0.4341	1.4478	1.2033
No log	14.8485	490	1.5422	0.4341	1.5422	1.2419
No log	14.9091	492	1.5716	0.3817	1.5716	1.2536
No log	14.9697	494	1.5515	0.4375	1.5515	1.2456
No log	15.0303	496	1.6007	0.4286	1.6007	1.2652
No log	15.0909	498	1.6466	0.3667	1.6466	1.2832
0.393	15.1515	500	1.6516	0.3667	1.6516	1.2851
0.393	15.2121	502	1.6291	0.4065	1.6291	1.2764
0.393	15.2727	504	1.6291	0.4062	1.6291	1.2764
0.393	15.3333	506	1.6278	0.3692	1.6278	1.2758
0.393	15.3939	508	1.5958	0.3692	1.5958	1.2633
0.393	15.4545	510	1.6164	0.3664	1.6164	1.2714
0.393	15.5152	512	1.6001	0.3485	1.6001	1.2649
0.393	15.5758	514	1.6073	0.3485	1.6073	1.2678
0.393	15.6364	516	1.6261	0.3407	1.6261	1.2752
0.393	15.6970	518	1.7068	0.2963	1.7068	1.3065

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1