ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4342
• Qwk: 0.3759
• Mse: 1.4342
• Rmse: 1.1976

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	7.0357	0.0056	7.0357	2.6525
No log	0.1143	4	4.8288	0.0981	4.8288	2.1975
No log	0.1714	6	3.7473	-0.0212	3.7473	1.9358
No log	0.2286	8	2.6365	0.1088	2.6365	1.6237
No log	0.2857	10	2.2242	0.1890	2.2242	1.4914
No log	0.3429	12	2.1108	0.1732	2.1108	1.4529
No log	0.4	14	2.0823	0.1955	2.0823	1.4430
No log	0.4571	16	2.0472	0.2769	2.0472	1.4308
No log	0.5143	18	2.2778	0.1159	2.2778	1.5092
No log	0.5714	20	2.1290	0.1374	2.1290	1.4591
No log	0.6286	22	1.7775	0.2931	1.7775	1.3332
No log	0.6857	24	1.6277	0.3130	1.6277	1.2758
No log	0.7429	26	1.6504	0.3130	1.6504	1.2847
No log	0.8	28	1.7968	0.3000	1.7968	1.3404
No log	0.8571	30	1.8377	0.2787	1.8377	1.3556
No log	0.9143	32	1.6314	0.2857	1.6314	1.2773
No log	0.9714	34	1.6119	0.2883	1.6119	1.2696
No log	1.0286	36	1.6213	0.2857	1.6213	1.2733
No log	1.0857	38	1.7012	0.3186	1.7012	1.3043
No log	1.1429	40	1.7231	0.3276	1.7231	1.3127
No log	1.2	42	1.7960	0.4098	1.7960	1.3401
No log	1.2571	44	1.7026	0.4298	1.7026	1.3048
No log	1.3143	46	1.5183	0.2545	1.5183	1.2322
No log	1.3714	48	1.6428	0.2037	1.6428	1.2817
No log	1.4286	50	3.0260	-0.1560	3.0260	1.7395
No log	1.4857	52	3.9013	-0.1356	3.9013	1.9752
No log	1.5429	54	3.1242	-0.1000	3.1242	1.7675
No log	1.6	56	1.9909	0.0179	1.9909	1.4110
No log	1.6571	58	1.6377	0.1495	1.6377	1.2797
No log	1.7143	60	1.5037	0.1165	1.5037	1.2263
No log	1.7714	62	1.8266	0.1636	1.8266	1.3515
No log	1.8286	64	1.9619	0.1951	1.9619	1.4007
No log	1.8857	66	1.8709	0.2623	1.8709	1.3678
No log	1.9429	68	1.7696	0.25	1.7696	1.3303
No log	2.0	70	1.8168	0.2364	1.8168	1.3479
No log	2.0571	72	1.8325	0.1495	1.8325	1.3537
No log	2.1143	74	1.9211	0.2182	1.9211	1.3860
No log	2.1714	76	1.8402	0.2857	1.8402	1.3565
No log	2.2286	78	1.4924	0.2982	1.4924	1.2216
No log	2.2857	80	1.3032	0.3304	1.3032	1.1416
No log	2.3429	82	1.2723	0.3826	1.2723	1.1280
No log	2.4	84	1.3033	0.4	1.3033	1.1416
No log	2.4571	86	1.3151	0.4310	1.3151	1.1468
No log	2.5143	88	1.3559	0.4174	1.3559	1.1644
No log	2.5714	90	1.3338	0.4138	1.3338	1.1549
No log	2.6286	92	1.2395	0.4874	1.2395	1.1133
No log	2.6857	94	1.2107	0.4874	1.2107	1.1003
No log	2.7429	96	1.2861	0.4	1.2861	1.1340
No log	2.8	98	1.4839	0.4154	1.4839	1.2181
No log	2.8571	100	1.5901	0.3259	1.5901	1.2610
No log	2.9143	102	1.5632	0.3188	1.5632	1.2503
No log	2.9714	104	1.3949	0.4234	1.3949	1.1811
No log	3.0286	106	1.5362	0.3309	1.5362	1.2394
No log	3.0857	108	1.7264	0.2897	1.7264	1.3139
No log	3.1429	110	1.6021	0.3309	1.6021	1.2657
No log	3.2	112	1.5715	0.3309	1.5715	1.2536
No log	3.2571	114	1.4690	0.4296	1.4690	1.2120
No log	3.3143	116	1.4903	0.3824	1.4903	1.2208
No log	3.3714	118	1.5786	0.3478	1.5786	1.2564
No log	3.4286	120	1.7563	0.2394	1.7563	1.3253
No log	3.4857	122	1.7921	0.2394	1.7921	1.3387
No log	3.5429	124	1.8183	0.2113	1.8183	1.3484
No log	3.6	126	1.6225	0.3407	1.6225	1.2738
No log	3.6571	128	1.4199	0.4	1.4199	1.1916
No log	3.7143	130	1.4610	0.4	1.4610	1.2087
No log	3.7714	132	1.7090	0.2878	1.7090	1.3073
No log	3.8286	134	1.7760	0.2378	1.7760	1.3327
No log	3.8857	136	1.7433	0.2657	1.7433	1.3203
No log	3.9429	138	1.7100	0.2817	1.7100	1.3077
No log	4.0	140	1.6602	0.3043	1.6602	1.2885
No log	4.0571	142	1.6413	0.2609	1.6413	1.2811
No log	4.1143	144	1.5466	0.3788	1.5466	1.2436
No log	4.1714	146	1.6693	0.3453	1.6693	1.2920
No log	4.2286	148	1.6750	0.2878	1.6750	1.2942
No log	4.2857	150	1.7664	0.2676	1.7664	1.3291
No log	4.3429	152	1.8816	0.2657	1.8816	1.3717
No log	4.4	154	1.9498	0.2517	1.9498	1.3964
No log	4.4571	156	1.7337	0.2734	1.7337	1.3167
No log	4.5143	158	1.4854	0.4580	1.4854	1.2188
No log	4.5714	160	1.4942	0.4	1.4942	1.2224
No log	4.6286	162	1.6545	0.3881	1.6545	1.2863
No log	4.6857	164	1.8912	0.2517	1.8912	1.3752
No log	4.7429	166	1.9726	0.2500	1.9726	1.4045
No log	4.8	168	2.0531	0.1944	2.0531	1.4329
No log	4.8571	170	2.1868	0.1678	2.1868	1.4788
No log	4.9143	172	2.1989	0.1678	2.1989	1.4829
No log	4.9714	174	2.0400	0.1678	2.0400	1.4283
No log	5.0286	176	1.7409	0.2424	1.7409	1.3194
No log	5.0857	178	1.5796	0.2833	1.5796	1.2568
No log	5.1429	180	1.5619	0.3871	1.5619	1.2498
No log	5.2	182	1.6770	0.3088	1.6771	1.2950
No log	5.2571	184	1.7335	0.3309	1.7335	1.3166
No log	5.3143	186	1.7547	0.2837	1.7547	1.3247
No log	5.3714	188	1.6965	0.2817	1.6965	1.3025
No log	5.4286	190	1.7004	0.2817	1.7004	1.3040
No log	5.4857	192	1.8380	0.2817	1.8380	1.3557
No log	5.5429	194	1.7808	0.2817	1.7808	1.3345
No log	5.6	196	1.6560	0.3000	1.6560	1.2868
No log	5.6571	198	1.6619	0.3262	1.6619	1.2891
No log	5.7143	200	1.7219	0.2817	1.7219	1.3122
No log	5.7714	202	1.9072	0.2361	1.9072	1.3810
No log	5.8286	204	2.0256	0.2207	2.0256	1.4232
No log	5.8857	206	2.0131	0.1944	2.0131	1.4188
No log	5.9429	208	1.7853	0.2958	1.7853	1.3361
No log	6.0	210	1.5304	0.3212	1.5304	1.2371
No log	6.0571	212	1.5483	0.3453	1.5483	1.2443
No log	6.1143	214	1.7907	0.2958	1.7907	1.3382
No log	6.1714	216	2.1126	0.2177	2.1126	1.4535
No log	6.2286	218	2.1345	0.1944	2.1345	1.4610
No log	6.2857	220	1.8898	0.2676	1.8898	1.3747
No log	6.3429	222	1.6488	0.3597	1.6488	1.2841
No log	6.4	224	1.5048	0.4286	1.5048	1.2267
No log	6.4571	226	1.4846	0.3972	1.4846	1.2184
No log	6.5143	228	1.6222	0.3597	1.6222	1.2736
No log	6.5714	230	1.7230	0.3571	1.7230	1.3126
No log	6.6286	232	1.6988	0.3741	1.6988	1.3034
No log	6.6857	234	1.7145	0.3768	1.7145	1.3094
No log	6.7429	236	1.6499	0.3852	1.6499	1.2845
No log	6.8	238	1.5005	0.3876	1.5005	1.2250
No log	6.8571	240	1.3772	0.4167	1.3772	1.1736
No log	6.9143	242	1.3300	0.4167	1.3300	1.1532
No log	6.9714	244	1.3785	0.4844	1.3785	1.1741
No log	7.0286	246	1.4482	0.4234	1.4482	1.2034
No log	7.0857	248	1.5365	0.3885	1.5365	1.2395
No log	7.1429	250	1.5766	0.3571	1.5766	1.2556
No log	7.2	252	1.5790	0.3478	1.5790	1.2566
No log	7.2571	254	1.5496	0.3478	1.5496	1.2448
No log	7.3143	256	1.7034	0.3022	1.7034	1.3051
No log	7.3714	258	1.9002	0.2238	1.9002	1.3785
No log	7.4286	260	1.9685	0.1944	1.9685	1.4030
No log	7.4857	262	1.8947	0.2238	1.8947	1.3765
No log	7.5429	264	1.6845	0.3043	1.6845	1.2979
No log	7.6	266	1.5286	0.3235	1.5286	1.2364
No log	7.6571	268	1.4452	0.4	1.4452	1.2022
No log	7.7143	270	1.4989	0.3768	1.4989	1.2243
No log	7.7714	272	1.6468	0.3286	1.6468	1.2833
No log	7.8286	274	1.6787	0.4058	1.6787	1.2956
No log	7.8857	276	1.5701	0.3906	1.5701	1.2530
No log	7.9429	278	1.5689	0.4265	1.5689	1.2526
No log	8.0	280	1.5098	0.4148	1.5098	1.2287
No log	8.0571	282	1.5686	0.3429	1.5686	1.2524
No log	8.1143	284	1.5470	0.3597	1.5470	1.2438
No log	8.1714	286	1.4843	0.4118	1.4843	1.2183
No log	8.2286	288	1.3957	0.4060	1.3957	1.1814
No log	8.2857	290	1.3256	0.4394	1.3256	1.1514
No log	8.3429	292	1.2309	0.5736	1.2309	1.1094
No log	8.4	294	1.2805	0.5271	1.2805	1.1316
No log	8.4571	296	1.4501	0.3768	1.4501	1.2042
No log	8.5143	298	1.6611	0.3286	1.6611	1.2889
No log	8.5714	300	1.6824	0.3286	1.6824	1.2971
No log	8.6286	302	1.5531	0.3768	1.5531	1.2463
No log	8.6857	304	1.4197	0.4733	1.4197	1.1915
No log	8.7429	306	1.3908	0.4724	1.3908	1.1793
No log	8.8	308	1.4254	0.4848	1.4254	1.1939
No log	8.8571	310	1.4449	0.4265	1.4449	1.2020
No log	8.9143	312	1.4379	0.4444	1.4379	1.1991
No log	8.9714	314	1.4228	0.4265	1.4228	1.1928
No log	9.0286	316	1.4760	0.4088	1.4760	1.2149
No log	9.0857	318	1.5818	0.3453	1.5818	1.2577
No log	9.1429	320	1.4934	0.3768	1.4934	1.2221
No log	9.2	322	1.4073	0.4526	1.4073	1.1863
No log	9.2571	324	1.2912	0.5414	1.2912	1.1363
No log	9.3143	326	1.3109	0.5414	1.3109	1.1449
No log	9.3714	328	1.4311	0.4203	1.4311	1.1963
No log	9.4286	330	1.4410	0.4203	1.4410	1.2004
No log	9.4857	332	1.4214	0.4203	1.4214	1.1922
No log	9.5429	334	1.3972	0.4412	1.3972	1.1820
No log	9.6	336	1.5085	0.3913	1.5085	1.2282
No log	9.6571	338	1.6894	0.3143	1.6894	1.2998
No log	9.7143	340	1.7245	0.3357	1.7245	1.3132
No log	9.7714	342	1.6004	0.3662	1.6004	1.2651
No log	9.8286	344	1.4795	0.4173	1.4795	1.2163
No log	9.8857	346	1.3461	0.5	1.3461	1.1602
No log	9.9429	348	1.2641	0.5692	1.2641	1.1243
No log	10.0	350	1.2829	0.5197	1.2829	1.1327
No log	10.0571	352	1.3691	0.4921	1.3691	1.1701
No log	10.1143	354	1.4921	0.4662	1.4921	1.2215
No log	10.1714	356	1.5358	0.4412	1.5358	1.2393
No log	10.2286	358	1.5913	0.3571	1.5913	1.2615
No log	10.2857	360	1.6168	0.3143	1.6168	1.2715
No log	10.3429	362	1.5695	0.3913	1.5695	1.2528
No log	10.4	364	1.4919	0.4234	1.4919	1.2214
No log	10.4571	366	1.4138	0.4058	1.4138	1.1890
No log	10.5143	368	1.4481	0.3796	1.4481	1.2034
No log	10.5714	370	1.5826	0.3597	1.5826	1.2580
No log	10.6286	372	1.8501	0.2535	1.8501	1.3602
No log	10.6857	374	1.9281	0.2238	1.9281	1.3886
No log	10.7429	376	1.7741	0.2695	1.7741	1.3319
No log	10.8	378	1.4978	0.3971	1.4978	1.2238
No log	10.8571	380	1.3019	0.4462	1.3019	1.1410
No log	10.9143	382	1.3143	0.4427	1.3143	1.1464
No log	10.9714	384	1.3996	0.4234	1.3996	1.1831
No log	11.0286	386	1.5127	0.3885	1.5127	1.2299
No log	11.0857	388	1.6467	0.3623	1.6467	1.2833
No log	11.1429	390	1.8026	0.2837	1.8026	1.3426
No log	11.2	392	1.7354	0.2837	1.7354	1.3174
No log	11.2571	394	1.5798	0.3796	1.5798	1.2569
No log	11.3143	396	1.3877	0.3969	1.3877	1.1780
No log	11.3714	398	1.2615	0.4375	1.2615	1.1231
No log	11.4286	400	1.2623	0.4651	1.2623	1.1235
No log	11.4857	402	1.4272	0.4058	1.4272	1.1947
No log	11.5429	404	1.6907	0.3099	1.6907	1.3003
No log	11.6	406	1.8099	0.3099	1.8099	1.3453
No log	11.6571	408	1.8048	0.3099	1.8048	1.3434
No log	11.7143	410	1.7036	0.3099	1.7036	1.3052
No log	11.7714	412	1.5128	0.3942	1.5128	1.2300
No log	11.8286	414	1.3422	0.5312	1.3422	1.1585
No log	11.8857	416	1.3139	0.5512	1.3139	1.1462
No log	11.9429	418	1.3775	0.5426	1.3775	1.1737
No log	12.0	420	1.4497	0.5191	1.4497	1.2040
No log	12.0571	422	1.4632	0.3942	1.4632	1.2096
No log	12.1143	424	1.4562	0.3942	1.4562	1.2067
No log	12.1714	426	1.4223	0.3942	1.4223	1.1926
No log	12.2286	428	1.3958	0.4776	1.3958	1.1814
No log	12.2857	430	1.4527	0.4444	1.4527	1.2053
No log	12.3429	432	1.5951	0.3768	1.5951	1.2630
No log	12.4	434	1.6245	0.3741	1.6244	1.2745
No log	12.4571	436	1.5279	0.3504	1.5279	1.2361
No log	12.5143	438	1.4065	0.4	1.4065	1.1860
No log	12.5714	440	1.3996	0.4361	1.3996	1.1830
No log	12.6286	442	1.4813	0.3676	1.4813	1.2171
No log	12.6857	444	1.5002	0.3676	1.5002	1.2248
No log	12.7429	446	1.4261	0.4	1.4261	1.1942
No log	12.8	448	1.3294	0.4427	1.3294	1.1530
No log	12.8571	450	1.3079	0.4545	1.3079	1.1436
No log	12.9143	452	1.3624	0.4	1.3624	1.1672
No log	12.9714	454	1.3567	0.4444	1.3567	1.1648
No log	13.0286	456	1.3339	0.5152	1.3339	1.1549
No log	13.0857	458	1.2884	0.5303	1.2884	1.1351
No log	13.1429	460	1.3436	0.5037	1.3436	1.1591
No log	13.2	462	1.4279	0.4412	1.4279	1.1950
No log	13.2571	464	1.5229	0.3768	1.5229	1.2341
No log	13.3143	466	1.5891	0.3165	1.5891	1.2606
No log	13.3714	468	1.5158	0.3768	1.5158	1.2312
No log	13.4286	470	1.3849	0.4526	1.3849	1.1768
No log	13.4857	472	1.3622	0.5152	1.3622	1.1671
No log	13.5429	474	1.4202	0.5037	1.4202	1.1917
No log	13.6	476	1.5316	0.3504	1.5316	1.2376
No log	13.6571	478	1.6299	0.3165	1.6299	1.2767
No log	13.7143	480	1.6157	0.3165	1.6157	1.2711
No log	13.7714	482	1.5019	0.3768	1.5019	1.2255
No log	13.8286	484	1.3906	0.5191	1.3906	1.1792
No log	13.8857	486	1.3483	0.5077	1.3483	1.1612
No log	13.9429	488	1.3893	0.4296	1.3893	1.1787
No log	14.0	490	1.5052	0.4148	1.5052	1.2269
No log	14.0571	492	1.6774	0.3143	1.6774	1.2951
No log	14.1143	494	1.7964	0.2857	1.7964	1.3403
No log	14.1714	496	1.7911	0.2857	1.7911	1.3383
No log	14.2286	498	1.6311	0.3022	1.6311	1.2772
0.4187	14.2857	500	1.4848	0.4029	1.4848	1.2185
0.4187	14.3429	502	1.4426	0.3796	1.4426	1.2011
0.4187	14.4	504	1.3894	0.4148	1.3894	1.1787
0.4187	14.4571	506	1.4649	0.3529	1.4649	1.2103
0.4187	14.5143	508	1.5802	0.3333	1.5802	1.2571
0.4187	14.5714	510	1.6366	0.3022	1.6366	1.2793
0.4187	14.6286	512	1.5815	0.3358	1.5815	1.2576
0.4187	14.6857	514	1.4342	0.3759	1.4342	1.1976

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1