ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6730
• Qwk: 0.3459
• Mse: 1.6730
• Rmse: 1.2934

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	7.1656	-0.0111	7.1656	2.6769
No log	0.0702	4	5.2078	0.0317	5.2078	2.2821
No log	0.1053	6	4.0542	-0.0505	4.0542	2.0135
No log	0.1404	8	3.5969	0.0	3.5969	1.8965
No log	0.1754	10	2.2338	0.0916	2.2338	1.4946
No log	0.2105	12	1.9909	0.3175	1.9909	1.4110
No log	0.2456	14	1.9942	0.2456	1.9942	1.4122
No log	0.2807	16	1.6888	0.1143	1.6888	1.2995
No log	0.3158	18	1.6572	0.1524	1.6572	1.2873
No log	0.3509	20	1.7644	0.1495	1.7644	1.3283
No log	0.3860	22	1.8865	0.0556	1.8865	1.3735
No log	0.4211	24	2.1008	0.1653	2.1008	1.4494
No log	0.4561	26	1.8636	0.1607	1.8636	1.3651
No log	0.4912	28	1.7322	0.2124	1.7322	1.3161
No log	0.5263	30	1.7815	0.2632	1.7815	1.3347
No log	0.5614	32	1.8061	0.2881	1.8061	1.3439
No log	0.5965	34	1.8749	0.2521	1.8749	1.3693
No log	0.6316	36	1.8082	0.2655	1.8082	1.3447
No log	0.6667	38	1.7142	0.2545	1.7142	1.3093
No log	0.7018	40	1.5987	0.1887	1.5987	1.2644
No log	0.7368	42	1.5046	0.1538	1.5046	1.2266
No log	0.7719	44	1.4256	0.2075	1.4256	1.1940
No log	0.8070	46	1.3747	0.375	1.3747	1.1725
No log	0.8421	48	1.2741	0.4786	1.2741	1.1288
No log	0.8772	50	1.2488	0.5378	1.2488	1.1175
No log	0.9123	52	1.2710	0.5424	1.2710	1.1274
No log	0.9474	54	1.5486	0.3932	1.5486	1.2444
No log	0.9825	56	1.5960	0.3621	1.5960	1.2633
No log	1.0175	58	1.5176	0.3509	1.5176	1.2319
No log	1.0526	60	1.4019	0.3684	1.4019	1.1840
No log	1.0877	62	1.4595	0.3826	1.4595	1.2081
No log	1.1228	64	1.4288	0.4138	1.4288	1.1953
No log	1.1579	66	1.4356	0.4138	1.4356	1.1982
No log	1.1930	68	1.6157	0.2385	1.6157	1.2711
No log	1.2281	70	1.9818	0.1101	1.9818	1.4078
No log	1.2632	72	1.9566	0.1008	1.9566	1.3988
No log	1.2982	74	1.6917	0.2097	1.6917	1.3007
No log	1.3333	76	1.3312	0.4496	1.3312	1.1538
No log	1.3684	78	1.2402	0.4769	1.2402	1.1136
No log	1.4035	80	1.2280	0.4961	1.2280	1.1082
No log	1.4386	82	1.4302	0.3433	1.4302	1.1959
No log	1.4737	84	1.8849	0.1832	1.8849	1.3729
No log	1.5088	86	2.0006	0.1935	2.0006	1.4144
No log	1.5439	88	1.9029	0.1356	1.9029	1.3795
No log	1.5789	90	1.4727	0.3761	1.4727	1.2136
No log	1.6140	92	1.2223	0.4833	1.2223	1.1056
No log	1.6491	94	1.2342	0.4793	1.2342	1.1109
No log	1.6842	96	1.3545	0.4333	1.3545	1.1639
No log	1.7193	98	1.5944	0.35	1.5944	1.2627
No log	1.7544	100	1.7411	0.25	1.7411	1.3195
No log	1.7895	102	1.9532	0.1864	1.9532	1.3976
No log	1.8246	104	1.9789	0.1207	1.9789	1.4067
No log	1.8596	106	1.7726	0.2276	1.7726	1.3314
No log	1.8947	108	1.7748	0.2276	1.7748	1.3322
No log	1.9298	110	1.7156	0.2969	1.7156	1.3098
No log	1.9649	112	1.8221	0.1846	1.8221	1.3498
No log	2.0	114	1.8419	0.2090	1.8419	1.3572
No log	2.0351	116	1.7618	0.2074	1.7618	1.3273
No log	2.0702	118	1.5521	0.4154	1.5521	1.2458
No log	2.1053	120	1.5515	0.3206	1.5515	1.2456
No log	2.1404	122	1.5652	0.3030	1.5652	1.2511
No log	2.1754	124	1.7857	0.1705	1.7857	1.3363
No log	2.2105	126	1.9729	0.1705	1.9729	1.4046
No log	2.2456	128	1.7244	0.2273	1.7244	1.3132
No log	2.2807	130	1.4132	0.4923	1.4132	1.1888
No log	2.3158	132	1.5175	0.4000	1.5175	1.2319
No log	2.3509	134	1.6247	0.3387	1.6247	1.2746
No log	2.3860	136	1.6099	0.3667	1.6099	1.2688
No log	2.4211	138	1.6107	0.3590	1.6107	1.2691
No log	2.4561	140	1.6142	0.2342	1.6142	1.2705
No log	2.4912	142	1.5877	0.3009	1.5877	1.2600
No log	2.5263	144	1.5745	0.4194	1.5745	1.2548
No log	2.5614	146	1.8193	0.2687	1.8193	1.3488
No log	2.5965	148	2.0962	0.1493	2.0962	1.4478
No log	2.6316	150	2.2043	0.0462	2.2043	1.4847
No log	2.6667	152	2.1553	0.1212	2.1553	1.4681
No log	2.7018	154	2.0562	0.1221	2.0562	1.4339
No log	2.7368	156	1.7683	0.2687	1.7683	1.3298
No log	2.7719	158	1.8377	0.2290	1.8377	1.3556
No log	2.8070	160	2.0288	0.1129	2.0288	1.4244
No log	2.8421	162	2.1257	0.0656	2.1257	1.4580
No log	2.8772	164	1.9964	0.0656	1.9964	1.4129
No log	2.9123	166	1.6488	0.2879	1.6488	1.2841
No log	2.9474	168	1.5220	0.3704	1.5220	1.2337
No log	2.9825	170	1.6297	0.3143	1.6297	1.2766
No log	3.0175	172	1.7113	0.2920	1.7113	1.3082
No log	3.0526	174	1.8244	0.2590	1.8244	1.3507
No log	3.0877	176	1.6765	0.2774	1.6765	1.2948
No log	3.1228	178	1.4473	0.4651	1.4473	1.2031
No log	3.1579	180	1.4866	0.4341	1.4866	1.2192
No log	3.1930	182	1.6339	0.2720	1.6339	1.2782
No log	3.2281	184	1.8532	0.1681	1.8532	1.3613
No log	3.2632	186	1.8332	0.1681	1.8332	1.3539
No log	3.2982	188	1.7520	0.2623	1.7520	1.3236
No log	3.3333	190	1.8377	0.2240	1.8377	1.3556
No log	3.3684	192	1.7665	0.2836	1.7665	1.3291
No log	3.4035	194	1.8296	0.2647	1.8296	1.3526
No log	3.4386	196	1.9473	0.2158	1.9473	1.3954
No log	3.4737	198	1.9256	0.2553	1.9256	1.3877
No log	3.5088	200	2.0162	0.2254	2.0162	1.4199
No log	3.5439	202	2.1554	0.1818	2.1554	1.4681
No log	3.5789	204	2.0882	0.1831	2.0882	1.4451
No log	3.6140	206	1.9131	0.2571	1.9131	1.3831
No log	3.6491	208	1.7099	0.3433	1.7099	1.3076
No log	3.6842	210	1.6425	0.3511	1.6425	1.2816
No log	3.7193	212	1.7971	0.2222	1.7971	1.3406
No log	3.7544	214	1.9052	0.1186	1.9052	1.3803
No log	3.7895	216	1.7341	0.2459	1.7341	1.3168
No log	3.8246	218	1.5703	0.3511	1.5703	1.2531
No log	3.8596	220	1.5408	0.3881	1.5408	1.2413
No log	3.8947	222	1.6016	0.3556	1.6016	1.2655
No log	3.9298	224	1.6465	0.3111	1.6465	1.2831
No log	3.9649	226	1.5591	0.4394	1.5591	1.2486
No log	4.0	228	1.5186	0.5156	1.5186	1.2323
No log	4.0351	230	1.4384	0.5039	1.4384	1.1993
No log	4.0702	232	1.5087	0.4961	1.5087	1.2283
No log	4.1053	234	1.6598	0.3382	1.6598	1.2883
No log	4.1404	236	1.6986	0.3382	1.6986	1.3033
No log	4.1754	238	1.7172	0.3259	1.7172	1.3104
No log	4.2105	240	1.6617	0.3692	1.6617	1.2891
No log	4.2456	242	1.5457	0.3651	1.5457	1.2433
No log	4.2807	244	1.4298	0.4463	1.4298	1.1958
No log	4.3158	246	1.3419	0.4355	1.3419	1.1584
No log	4.3509	248	1.3236	0.4480	1.3236	1.1505
No log	4.3860	250	1.4587	0.4186	1.4587	1.2078
No log	4.4211	252	1.7625	0.2899	1.7625	1.3276
No log	4.4561	254	1.8852	0.2553	1.8852	1.3730
No log	4.4912	256	1.7556	0.2899	1.7556	1.3250
No log	4.5263	258	1.4430	0.4375	1.4430	1.2012
No log	4.5614	260	1.3076	0.4160	1.3076	1.1435
No log	4.5965	262	1.3452	0.4444	1.3452	1.1598
No log	4.6316	264	1.5051	0.4409	1.5051	1.2268
No log	4.6667	266	1.7525	0.2774	1.7525	1.3238
No log	4.7018	268	1.8484	0.2734	1.8484	1.3595
No log	4.7368	270	1.7464	0.3043	1.7464	1.3215
No log	4.7719	272	1.6084	0.3478	1.6084	1.2682
No log	4.8070	274	1.5648	0.3650	1.5648	1.2509
No log	4.8421	276	1.6541	0.3262	1.6541	1.2861
No log	4.8772	278	1.8375	0.2857	1.8375	1.3555
No log	4.9123	280	1.8327	0.3165	1.8327	1.3538
No log	4.9474	282	1.7916	0.2941	1.7916	1.3385
No log	4.9825	284	1.6927	0.3158	1.6927	1.3010
No log	5.0175	286	1.7479	0.2857	1.7479	1.3221
No log	5.0526	288	1.7389	0.2815	1.7389	1.3187
No log	5.0877	290	1.6939	0.2920	1.6939	1.3015
No log	5.1228	292	1.7167	0.3188	1.7167	1.3102
No log	5.1579	294	1.7691	0.2878	1.7691	1.3301
No log	5.1930	296	1.8343	0.2411	1.8343	1.3543
No log	5.2281	298	1.9100	0.2254	1.9100	1.3820
No log	5.2632	300	1.8582	0.2270	1.8582	1.3631
No log	5.2982	302	1.8198	0.3043	1.8198	1.3490
No log	5.3333	304	1.6954	0.3459	1.6954	1.3021
No log	5.3684	306	1.7889	0.2985	1.7889	1.3375
No log	5.4035	308	2.0197	0.2254	2.0197	1.4212
No log	5.4386	310	2.0284	0.2254	2.0284	1.4242
No log	5.4737	312	2.1971	0.2378	2.1971	1.4823
No log	5.5088	314	2.2106	0.2378	2.2106	1.4868
No log	5.5439	316	2.1932	0.2378	2.1932	1.4809
No log	5.5789	318	1.9467	0.2378	1.9467	1.3952
No log	5.6140	320	1.5079	0.4328	1.5079	1.2280
No log	5.6491	322	1.2648	0.5	1.2648	1.1246
No log	5.6842	324	1.2711	0.4370	1.2711	1.1274
No log	5.7193	326	1.2917	0.4793	1.2917	1.1365
No log	5.7544	328	1.4218	0.4715	1.4218	1.1924
No log	5.7895	330	1.6638	0.3704	1.6638	1.2899
No log	5.8246	332	1.7581	0.2411	1.7581	1.3259
No log	5.8596	334	1.6258	0.3478	1.6258	1.2751
No log	5.8947	336	1.3874	0.4733	1.3874	1.1779
No log	5.9298	338	1.3226	0.5	1.3226	1.1501
No log	5.9649	340	1.4315	0.4697	1.4315	1.1965
No log	6.0	342	1.6153	0.3043	1.6153	1.2709
No log	6.0351	344	1.6644	0.3043	1.6644	1.2901
No log	6.0702	346	1.4903	0.4060	1.4903	1.2208
No log	6.1053	348	1.3628	0.4531	1.3628	1.1674
No log	6.1404	350	1.4644	0.4462	1.4644	1.2101
No log	6.1754	352	1.5520	0.3910	1.5520	1.2458
No log	6.2105	354	1.5397	0.4091	1.5397	1.2409
No log	6.2456	356	1.6438	0.3066	1.6438	1.2821
No log	6.2807	358	1.5826	0.4091	1.5826	1.2580
No log	6.3158	360	1.4358	0.4308	1.4358	1.1982
No log	6.3509	362	1.4802	0.3969	1.4802	1.2166
No log	6.3860	364	1.6895	0.2754	1.6895	1.2998
No log	6.4211	366	1.6832	0.2754	1.6832	1.2974
No log	6.4561	368	1.5267	0.3582	1.5267	1.2356
No log	6.4912	370	1.3844	0.4688	1.3844	1.1766
No log	6.5263	372	1.3139	0.4882	1.3139	1.1462
No log	6.5614	374	1.4330	0.4	1.4330	1.1971
No log	6.5965	376	1.6132	0.2920	1.6132	1.2701
No log	6.6316	378	1.5183	0.3939	1.5183	1.2322
No log	6.6667	380	1.3962	0.4603	1.3962	1.1816
No log	6.7018	382	1.3368	0.4603	1.3368	1.1562
No log	6.7368	384	1.3840	0.4688	1.3840	1.1764
No log	6.7719	386	1.7042	0.2920	1.7042	1.3055
No log	6.8070	388	1.9149	0.2113	1.9149	1.3838
No log	6.8421	390	1.7544	0.2754	1.7544	1.3245
No log	6.8772	392	1.3951	0.4341	1.3951	1.1812
No log	6.9123	394	1.2374	0.5	1.2374	1.1124
No log	6.9474	396	1.2323	0.5082	1.2323	1.1101
No log	6.9825	398	1.3684	0.4882	1.3684	1.1698
No log	7.0175	400	1.7870	0.2590	1.7870	1.3368
No log	7.0526	402	2.1219	0.1958	2.1219	1.4567
No log	7.0877	404	2.1321	0.2113	2.1321	1.4602
No log	7.1228	406	1.9027	0.2411	1.9027	1.3794
No log	7.1579	408	1.6980	0.3382	1.6980	1.3031
No log	7.1930	410	1.6715	0.3382	1.6715	1.2929
No log	7.2281	412	1.8341	0.2899	1.8341	1.3543
No log	7.2632	414	1.9539	0.2411	1.9539	1.3978
No log	7.2982	416	2.1668	0.2098	2.1668	1.4720
No log	7.3333	418	2.1902	0.2098	2.1902	1.4799
No log	7.3684	420	2.0283	0.2411	2.0283	1.4242
No log	7.4035	422	1.7872	0.3235	1.7872	1.3368
No log	7.4386	424	1.6173	0.3235	1.6173	1.2717
No log	7.4737	426	1.6930	0.3235	1.6930	1.3012
No log	7.5088	428	1.9523	0.2113	1.9523	1.3972
No log	7.5439	430	2.0840	0.2098	2.0840	1.4436
No log	7.5789	432	1.9617	0.2098	1.9617	1.4006
No log	7.6140	434	1.8551	0.2878	1.8551	1.3620
No log	7.6491	436	1.7229	0.3582	1.7229	1.3126
No log	7.6842	438	1.4631	0.4219	1.4631	1.2096
No log	7.7193	440	1.3535	0.4	1.3535	1.1634
No log	7.7544	442	1.3135	0.4390	1.3135	1.1461
No log	7.7895	444	1.4179	0.4341	1.4179	1.1908
No log	7.8246	446	1.7850	0.3262	1.7850	1.3360
No log	7.8596	448	2.0702	0.2098	2.0702	1.4388
No log	7.8947	450	2.0855	0.2098	2.0855	1.4441
No log	7.9298	452	1.8790	0.3165	1.8790	1.3708
No log	7.9649	454	1.5845	0.3852	1.5845	1.2588
No log	8.0	456	1.5054	0.3664	1.5054	1.2269
No log	8.0351	458	1.3631	0.4844	1.3631	1.1675
No log	8.0702	460	1.4471	0.4186	1.4471	1.2029
No log	8.1053	462	1.5704	0.3664	1.5704	1.2532
No log	8.1404	464	1.7039	0.3284	1.7039	1.3053
No log	8.1754	466	1.7876	0.3066	1.7876	1.3370
No log	8.2105	468	1.7256	0.2754	1.7256	1.3136
No log	8.2456	470	1.8392	0.2571	1.8392	1.3562
No log	8.2807	472	1.8705	0.2877	1.8705	1.3677
No log	8.3158	474	1.9754	0.2721	1.9754	1.4055
No log	8.3509	476	1.9271	0.25	1.9271	1.3882
No log	8.3860	478	1.6045	0.3582	1.6045	1.2667
No log	8.4211	480	1.3678	0.5197	1.3678	1.1695
No log	8.4561	482	1.3662	0.5197	1.3662	1.1689
No log	8.4912	484	1.5014	0.4154	1.5014	1.2253
No log	8.5263	486	1.7448	0.3259	1.7448	1.3209
No log	8.5614	488	1.8880	0.2571	1.8880	1.3741
No log	8.5965	490	1.8743	0.2571	1.8743	1.3691
No log	8.6316	492	1.7202	0.3259	1.7202	1.3116
No log	8.6667	494	1.5071	0.3939	1.5071	1.2277
No log	8.7018	496	1.2888	0.5197	1.2888	1.1353
No log	8.7368	498	1.2022	0.5	1.2022	1.0965
0.3938	8.7719	500	1.2728	0.5197	1.2728	1.1282
0.3938	8.8070	502	1.4734	0.3969	1.4734	1.2138
0.3938	8.8421	504	1.7115	0.3259	1.7115	1.3083
0.3938	8.8772	506	1.9202	0.2714	1.9202	1.3857
0.3938	8.9123	508	1.8762	0.2734	1.8762	1.3697
0.3938	8.9474	510	1.6730	0.3459	1.6730	1.2934

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1