ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6554
• Qwk: 0.3407
• Mse: 1.6554
• Rmse: 1.2866

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0235	2	6.7639	0.0242	6.7639	2.6007
No log	0.0471	4	4.3993	0.1074	4.3993	2.0974
No log	0.0706	6	3.7776	0.0	3.7776	1.9436
No log	0.0941	8	2.6710	0.0645	2.6710	1.6343
No log	0.1176	10	2.1941	0.0979	2.1941	1.4813
No log	0.1412	12	2.0863	0.1875	2.0863	1.4444
No log	0.1647	14	1.9030	0.2034	1.9030	1.3795
No log	0.1882	16	1.6838	0.1905	1.6838	1.2976
No log	0.2118	18	1.6188	0.1905	1.6188	1.2723
No log	0.2353	20	1.7015	0.1538	1.7015	1.3044
No log	0.2588	22	1.7806	0.0962	1.7806	1.3344
No log	0.2824	24	1.6662	0.1165	1.6662	1.2908
No log	0.3059	26	1.5738	0.1538	1.5738	1.2545
No log	0.3294	28	1.5226	0.2523	1.5226	1.2340
No log	0.3529	30	1.5857	0.2857	1.5857	1.2593
No log	0.3765	32	1.6401	0.2857	1.6401	1.2807
No log	0.4	34	1.6632	0.2679	1.6632	1.2897
No log	0.4235	36	1.5505	0.1524	1.5505	1.2452
No log	0.4471	38	1.5599	0.1333	1.5599	1.2490
No log	0.4706	40	1.5835	0.1346	1.5835	1.2584
No log	0.4941	42	1.5299	0.1698	1.5299	1.2369
No log	0.5176	44	1.5106	0.2037	1.5106	1.2290
No log	0.5412	46	1.4921	0.2037	1.4921	1.2215
No log	0.5647	48	1.5256	0.2202	1.5256	1.2351
No log	0.5882	50	1.4920	0.2202	1.4920	1.2215
No log	0.6118	52	1.5191	0.2364	1.5191	1.2325
No log	0.6353	54	1.5204	0.2703	1.5204	1.2330
No log	0.6588	56	1.6519	0.2807	1.6519	1.2853
No log	0.6824	58	1.6284	0.2957	1.6284	1.2761
No log	0.7059	60	1.4659	0.2385	1.4659	1.2107
No log	0.7294	62	1.5252	0.2385	1.5252	1.2350
No log	0.7529	64	1.6090	0.1852	1.6090	1.2685
No log	0.7765	66	1.6520	0.2523	1.6520	1.2853
No log	0.8	68	1.5172	0.3103	1.5172	1.2317
No log	0.8235	70	1.4500	0.3967	1.4500	1.2041
No log	0.8471	72	1.4402	0.4228	1.4402	1.2001
No log	0.8706	74	1.4248	0.4590	1.4248	1.1936
No log	0.8941	76	1.5604	0.2903	1.5604	1.2492
No log	0.9176	78	1.7363	0.2879	1.7363	1.3177
No log	0.9412	80	1.6933	0.3259	1.6933	1.3013
No log	0.9647	82	1.5574	0.2901	1.5574	1.2480
No log	0.9882	84	1.5435	0.2857	1.5435	1.2424
No log	1.0118	86	1.5829	0.3030	1.5829	1.2581
No log	1.0353	88	1.5854	0.3485	1.5854	1.2591
No log	1.0588	90	1.5977	0.3308	1.5977	1.2640
No log	1.0824	92	1.6683	0.3284	1.6683	1.2916
No log	1.1059	94	1.7043	0.2687	1.7043	1.3055
No log	1.1294	96	1.7026	0.2031	1.7026	1.3048
No log	1.1529	98	1.6868	0.3284	1.6868	1.2988
No log	1.1765	100	1.7228	0.3382	1.7228	1.3126
No log	1.2	102	1.8033	0.2519	1.8033	1.3429
No log	1.2235	104	1.9835	0.3088	1.9835	1.4084
No log	1.2471	106	1.9702	0.3088	1.9702	1.4037
No log	1.2706	108	1.7492	0.2171	1.7492	1.3226
No log	1.2941	110	1.6645	0.2353	1.6645	1.2902
No log	1.3176	112	1.6180	0.3016	1.6180	1.2720
No log	1.3412	114	1.6635	0.3382	1.6635	1.2897
No log	1.3647	116	1.8017	0.2774	1.8017	1.3423
No log	1.3882	118	1.8369	0.2519	1.8369	1.3553
No log	1.4118	120	1.7275	0.3359	1.7275	1.3144
No log	1.4353	122	1.7008	0.3407	1.7008	1.3041
No log	1.4588	124	1.7958	0.2794	1.7958	1.3401
No log	1.4824	126	1.8054	0.2576	1.8054	1.3436
No log	1.5059	128	1.7421	0.2326	1.7421	1.3199
No log	1.5294	130	1.7937	0.2985	1.7937	1.3393
No log	1.5529	132	1.9416	0.2695	1.9416	1.3934
No log	1.5765	134	2.0072	0.2695	2.0072	1.4167
No log	1.6	136	1.8837	0.3121	1.8837	1.3725
No log	1.6235	138	1.9858	0.2270	1.9858	1.4092
No log	1.6471	140	1.9926	0.2394	1.9926	1.4116
No log	1.6706	142	1.7886	0.3309	1.7886	1.3374
No log	1.6941	144	1.6845	0.3478	1.6845	1.2979
No log	1.7176	146	1.7799	0.3309	1.7799	1.3341
No log	1.7412	148	1.8521	0.3188	1.8521	1.3609
No log	1.7647	150	1.9159	0.2899	1.9159	1.3842
No log	1.7882	152	1.8382	0.3111	1.8382	1.3558
No log	1.8118	154	1.7202	0.2748	1.7202	1.3115
No log	1.8353	156	1.6054	0.3360	1.6054	1.2670
No log	1.8588	158	1.5186	0.352	1.5186	1.2323
No log	1.8824	160	1.5498	0.3704	1.5498	1.2449
No log	1.9059	162	1.7171	0.3358	1.7171	1.3104
No log	1.9294	164	1.8601	0.2734	1.8601	1.3639
No log	1.9529	166	1.9642	0.2446	1.9642	1.4015
No log	1.9765	168	1.9749	0.2446	1.9749	1.4053
No log	2.0	170	1.8440	0.3043	1.8440	1.3579
No log	2.0235	172	1.8399	0.3043	1.8399	1.3564
No log	2.0471	174	2.0909	0.1857	2.0909	1.4460
No log	2.0706	176	2.1531	0.1702	2.1531	1.4674
No log	2.0941	178	2.0037	0.2128	2.0037	1.4155
No log	2.1176	180	1.9725	0.2553	1.9725	1.4045
No log	2.1412	182	1.8122	0.3380	1.8122	1.3462
No log	2.1647	184	1.6727	0.3212	1.6727	1.2933
No log	2.1882	186	1.5278	0.3676	1.5278	1.2361
No log	2.2118	188	1.4734	0.4060	1.4734	1.2138
No log	2.2353	190	1.6826	0.3478	1.6826	1.2972
No log	2.2588	192	2.1595	0.1806	2.1595	1.4695
No log	2.2824	194	2.2219	0.1806	2.2219	1.4906
No log	2.3059	196	1.9518	0.3066	1.9518	1.3971
No log	2.3294	198	1.6083	0.3459	1.6083	1.2682
No log	2.3529	200	1.5219	0.3252	1.5219	1.2336
No log	2.3765	202	1.5611	0.3150	1.5611	1.2495
No log	2.4	204	1.6527	0.3231	1.6527	1.2856
No log	2.4235	206	1.8407	0.3485	1.8407	1.3567
No log	2.4471	208	2.0006	0.2748	2.0006	1.4144
No log	2.4706	210	1.9620	0.2923	1.9620	1.4007
No log	2.4941	212	1.7331	0.3485	1.7331	1.3165
No log	2.5176	214	1.5127	0.384	1.5127	1.2299
No log	2.5412	216	1.4825	0.384	1.4825	1.2176
No log	2.5647	218	1.5899	0.3876	1.5899	1.2609
No log	2.5882	220	1.8909	0.2920	1.8909	1.3751
No log	2.6118	222	2.0469	0.2590	2.0469	1.4307
No log	2.6353	224	2.0438	0.2590	2.0438	1.4296
No log	2.6588	226	1.9703	0.2590	1.9703	1.4037
No log	2.6824	228	1.9786	0.2590	1.9786	1.4066
No log	2.7059	230	1.7611	0.3111	1.7611	1.3271
No log	2.7294	232	1.6148	0.3664	1.6148	1.2707
No log	2.7529	234	1.5673	0.3438	1.5673	1.2519
No log	2.7765	236	1.5906	0.3651	1.5906	1.2612
No log	2.8	238	1.6316	0.3101	1.6316	1.2773
No log	2.8235	240	1.7738	0.3158	1.7738	1.3318
No log	2.8471	242	1.9933	0.2774	1.9933	1.4118
No log	2.8706	244	2.0029	0.2899	2.0029	1.4152
No log	2.8941	246	1.8535	0.2920	1.8535	1.3614
No log	2.9176	248	1.6775	0.3504	1.6775	1.2952
No log	2.9412	250	1.6123	0.3676	1.6123	1.2698
No log	2.9647	252	1.7519	0.3143	1.7519	1.3236
No log	2.9882	254	1.9578	0.2899	1.9578	1.3992
No log	3.0118	256	2.1277	0.2411	2.1277	1.4587
No log	3.0353	258	1.9359	0.3066	1.9359	1.3914
No log	3.0588	260	1.5879	0.3780	1.5879	1.2601
No log	3.0824	262	1.4521	0.3590	1.4521	1.2050
No log	3.1059	264	1.4623	0.3333	1.4623	1.2093
No log	3.1294	266	1.5233	0.3802	1.5233	1.2342
No log	3.1529	268	1.7169	0.3101	1.7169	1.3103
No log	3.1765	270	2.0474	0.2609	2.0474	1.4309
No log	3.2	272	2.2200	0.2254	2.2200	1.4900
No log	3.2235	274	2.1399	0.2270	2.1399	1.4628
No log	3.2471	276	2.0179	0.2628	2.0179	1.4205
No log	3.2706	278	1.9029	0.2571	1.9029	1.3795
No log	3.2941	280	1.8716	0.2571	1.8716	1.3681
No log	3.3176	282	1.9814	0.2734	1.9814	1.4076
No log	3.3412	284	2.0899	0.2695	2.0899	1.4456
No log	3.3647	286	1.9649	0.2609	1.9649	1.4018
No log	3.3882	288	1.7232	0.3158	1.7232	1.3127
No log	3.4118	290	1.5342	0.4	1.5342	1.2386
No log	3.4353	292	1.5189	0.4062	1.5189	1.2324
No log	3.4588	294	1.5364	0.3817	1.5364	1.2395
No log	3.4824	296	1.6101	0.3676	1.6101	1.2689
No log	3.5059	298	1.6917	0.2920	1.6917	1.3007
No log	3.5294	300	1.6771	0.3407	1.6771	1.2950
No log	3.5529	302	1.6882	0.3759	1.6882	1.2993
No log	3.5765	304	1.6241	0.3759	1.6241	1.2744
No log	3.6	306	1.5840	0.3881	1.5840	1.2586
No log	3.6235	308	1.5995	0.3704	1.5995	1.2647
No log	3.6471	310	1.5998	0.3704	1.5998	1.2648
No log	3.6706	312	1.7748	0.3043	1.7748	1.3322
No log	3.6941	314	2.1032	0.2128	2.1032	1.4502
No log	3.7176	316	2.1839	0.2113	2.1839	1.4778
No log	3.7412	318	1.9167	0.2920	1.9167	1.3845
No log	3.7647	320	1.5195	0.3704	1.5195	1.2327
No log	3.7882	322	1.2465	0.4923	1.2465	1.1165
No log	3.8118	324	1.1894	0.4839	1.1894	1.0906
No log	3.8353	326	1.2321	0.496	1.2321	1.1100
No log	3.8588	328	1.3843	0.4496	1.3843	1.1766
No log	3.8824	330	1.6472	0.3582	1.6472	1.2834
No log	3.9059	332	1.7915	0.3088	1.7915	1.3385
No log	3.9294	334	1.8024	0.3088	1.8024	1.3426
No log	3.9529	336	1.6864	0.3259	1.6864	1.2986
No log	3.9765	338	1.5096	0.3881	1.5096	1.2287
No log	4.0	340	1.3273	0.4194	1.3273	1.1521
No log	4.0235	342	1.2927	0.4754	1.2927	1.1370
No log	4.0471	344	1.3180	0.4463	1.3180	1.1480
No log	4.0706	346	1.4058	0.4032	1.4058	1.1857
No log	4.0941	348	1.5580	0.3664	1.5580	1.2482
No log	4.1176	350	1.7506	0.3259	1.7506	1.3231
No log	4.1412	352	1.8108	0.3259	1.8108	1.3457
No log	4.1647	354	1.7590	0.3259	1.7590	1.3263
No log	4.1882	356	1.5910	0.3852	1.5910	1.2613
No log	4.2118	358	1.5084	0.4265	1.5084	1.2282
No log	4.2353	360	1.5543	0.4265	1.5543	1.2467
No log	4.2588	362	1.7218	0.3382	1.7218	1.3122
No log	4.2824	364	2.0216	0.2628	2.0216	1.4218
No log	4.3059	366	2.1596	0.1884	2.1596	1.4696
No log	4.3294	368	2.0750	0.2353	2.0750	1.4405
No log	4.3529	370	1.7197	0.3704	1.7197	1.3114
No log	4.3765	372	1.4025	0.4091	1.4025	1.1843
No log	4.4	374	1.3256	0.4409	1.3256	1.1513
No log	4.4235	376	1.3571	0.4286	1.3571	1.1650
No log	4.4471	378	1.4326	0.4211	1.4326	1.1969
No log	4.4706	380	1.5561	0.3556	1.5561	1.2474
No log	4.4941	382	1.6401	0.3259	1.6401	1.2806
No log	4.5176	384	1.5490	0.3382	1.5490	1.2446
No log	4.5412	386	1.4868	0.3824	1.4868	1.2194
No log	4.5647	388	1.5929	0.3259	1.5929	1.2621
No log	4.5882	390	1.8636	0.3088	1.8636	1.3651
No log	4.6118	392	1.9299	0.2878	1.9299	1.3892
No log	4.6353	394	1.8029	0.2920	1.8029	1.3427
No log	4.6588	396	1.6960	0.2920	1.6960	1.3023
No log	4.6824	398	1.5678	0.3259	1.5678	1.2521
No log	4.7059	400	1.4990	0.4265	1.4990	1.2243
No log	4.7294	402	1.4548	0.4328	1.4548	1.2061
No log	4.7529	404	1.5374	0.4265	1.5374	1.2399
No log	4.7765	406	1.6780	0.2920	1.6780	1.2954
No log	4.8	408	1.7603	0.2920	1.7603	1.3268
No log	4.8235	410	1.6814	0.3088	1.6814	1.2967
No log	4.8471	412	1.5929	0.3759	1.5929	1.2621
No log	4.8706	414	1.5692	0.3759	1.5692	1.2527
No log	4.8941	416	1.6749	0.3212	1.6749	1.2942
No log	4.9176	418	1.7405	0.3333	1.7405	1.3193
No log	4.9412	420	1.7080	0.3504	1.7080	1.3069
No log	4.9647	422	1.6880	0.3504	1.6880	1.2992
No log	4.9882	424	1.7155	0.3382	1.7155	1.3098
No log	5.0118	426	1.7031	0.3382	1.7031	1.3050
No log	5.0353	428	1.8265	0.3022	1.8265	1.3515
No log	5.0588	430	1.8110	0.3022	1.8110	1.3457
No log	5.0824	432	1.6594	0.3556	1.6594	1.2882
No log	5.1059	434	1.5113	0.4211	1.5113	1.2293
No log	5.1294	436	1.3946	0.3750	1.3946	1.1809
No log	5.1529	438	1.4368	0.4186	1.4368	1.1987
No log	5.1765	440	1.6457	0.3556	1.6457	1.2829
No log	5.2	442	1.8795	0.2899	1.8795	1.3709
No log	5.2235	444	2.0894	0.2590	2.0894	1.4455
No log	5.2471	446	2.0391	0.2590	2.0391	1.4280
No log	5.2706	448	1.8321	0.2920	1.8321	1.3536
No log	5.2941	450	1.8018	0.2920	1.8018	1.3423
No log	5.3176	452	1.6978	0.3582	1.6978	1.3030
No log	5.3412	454	1.6481	0.3459	1.6481	1.2838
No log	5.3647	456	1.6012	0.4	1.6012	1.2654
No log	5.3882	458	1.6584	0.3788	1.6584	1.2878
No log	5.4118	460	1.7362	0.3259	1.7362	1.3176
No log	5.4353	462	1.8704	0.2920	1.8704	1.3676
No log	5.4588	464	1.8779	0.2899	1.8779	1.3704
No log	5.4824	466	1.7196	0.3235	1.7196	1.3113
No log	5.5059	468	1.6011	0.3704	1.6011	1.2653
No log	5.5294	470	1.6267	0.3529	1.6267	1.2754
No log	5.5529	472	1.7479	0.2920	1.7479	1.3221
No log	5.5765	474	1.8088	0.2920	1.8088	1.3449
No log	5.6	476	1.8721	0.2920	1.8721	1.3683
No log	5.6235	478	1.7942	0.2920	1.7942	1.3395
No log	5.6471	480	1.6027	0.4122	1.6027	1.2660
No log	5.6706	482	1.4474	0.4252	1.4474	1.2031
No log	5.6941	484	1.4092	0.4531	1.4092	1.1871
No log	5.7176	486	1.4679	0.4328	1.4679	1.2116
No log	5.7412	488	1.6654	0.3529	1.6654	1.2905
No log	5.7647	490	1.9103	0.2734	1.9103	1.3821
No log	5.7882	492	2.0428	0.2411	2.0428	1.4293
No log	5.8118	494	1.9643	0.2714	1.9643	1.4015
No log	5.8353	496	1.7270	0.3382	1.7270	1.3142
No log	5.8588	498	1.6239	0.3582	1.6239	1.2743
0.4106	5.8824	500	1.6016	0.3582	1.6016	1.2656
0.4106	5.9059	502	1.4867	0.3910	1.4867	1.2193
0.4106	5.9294	504	1.4562	0.4211	1.4562	1.2067
0.4106	5.9529	506	1.5011	0.4030	1.5011	1.2252
0.4106	5.9765	508	1.6149	0.3407	1.6149	1.2708
0.4106	6.0	510	1.6857	0.3088	1.6857	1.2984
0.4106	6.0235	512	1.6756	0.3088	1.6756	1.2944
0.4106	6.0471	514	1.7377	0.2920	1.7377	1.3182
0.4106	6.0706	516	1.6554	0.3407	1.6554	1.2866

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1