ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9500
• Qwk: 0.3474
• Mse: 0.9500
• Rmse: 0.9747

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	4.0244	-0.0019	4.0244	2.0061
No log	0.0606	4	2.2238	0.0631	2.2238	1.4913
No log	0.0909	6	1.5038	0.0154	1.5038	1.2263
No log	0.1212	8	1.2095	0.0652	1.2095	1.0998
No log	0.1515	10	1.2007	0.1361	1.2007	1.0958
No log	0.1818	12	1.2259	0.1767	1.2259	1.1072
No log	0.2121	14	1.1334	0.0589	1.1334	1.0646
No log	0.2424	16	1.1817	0.2113	1.1817	1.0870
No log	0.2727	18	1.1032	0.1228	1.1032	1.0504
No log	0.3030	20	1.0860	0.3291	1.0860	1.0421
No log	0.3333	22	1.0710	0.2998	1.0710	1.0349
No log	0.3636	24	1.0515	0.2008	1.0515	1.0254
No log	0.3939	26	1.0324	0.2088	1.0324	1.0161
No log	0.4242	28	1.0424	0.2042	1.0424	1.0210
No log	0.4545	30	1.0511	0.1944	1.0511	1.0252
No log	0.4848	32	1.0530	0.1671	1.0530	1.0262
No log	0.5152	34	1.0381	0.1189	1.0381	1.0189
No log	0.5455	36	1.0512	0.1629	1.0512	1.0253
No log	0.5758	38	1.0233	0.1589	1.0233	1.0116
No log	0.6061	40	1.0188	0.1131	1.0188	1.0094
No log	0.6364	42	1.0968	0.2226	1.0968	1.0473
No log	0.6667	44	1.2088	0.3119	1.2088	1.0994
No log	0.6970	46	1.4347	0.1773	1.4347	1.1978
No log	0.7273	48	1.3267	0.2404	1.3267	1.1518
No log	0.7576	50	1.0108	0.1885	1.0108	1.0054
No log	0.7879	52	1.0507	0.2376	1.0507	1.0250
No log	0.8182	54	0.9860	0.2744	0.9860	0.9930
No log	0.8485	56	1.0724	0.3341	1.0724	1.0356
No log	0.8788	58	1.3090	0.2896	1.3090	1.1441
No log	0.9091	60	1.3646	0.3484	1.3646	1.1682
No log	0.9394	62	1.0614	0.3759	1.0614	1.0303
No log	0.9697	64	1.0551	0.3759	1.0551	1.0272
No log	1.0	66	1.2547	0.3264	1.2547	1.1201
No log	1.0303	68	1.2702	0.3532	1.2702	1.1270
No log	1.0606	70	1.4495	0.2413	1.4495	1.2039
No log	1.0909	72	1.1920	0.3117	1.1920	1.0918
No log	1.1212	74	1.3587	0.2764	1.3587	1.1656
No log	1.1515	76	1.7172	0.2226	1.7172	1.3104
No log	1.1818	78	1.7625	0.2226	1.7625	1.3276
No log	1.2121	80	1.8920	0.1843	1.8920	1.3755
No log	1.2424	82	1.4061	0.3496	1.4061	1.1858
No log	1.2727	84	1.3464	0.3876	1.3464	1.1603
No log	1.3030	86	1.2515	0.3961	1.2515	1.1187
No log	1.3333	88	1.0768	0.3536	1.0768	1.0377
No log	1.3636	90	1.0698	0.3841	1.0698	1.0343
No log	1.3939	92	1.2533	0.3948	1.2533	1.1195
No log	1.4242	94	1.4623	0.3097	1.4623	1.2093
No log	1.4545	96	1.0615	0.4320	1.0615	1.0303
No log	1.4848	98	0.9662	0.4718	0.9662	0.9830
No log	1.5152	100	0.9509	0.4145	0.9509	0.9751
No log	1.5455	102	0.9459	0.4321	0.9459	0.9726
No log	1.5758	104	1.1376	0.4181	1.1376	1.0666
No log	1.6061	106	0.9906	0.4843	0.9906	0.9953
No log	1.6364	108	0.9791	0.4734	0.9791	0.9895
No log	1.6667	110	1.0772	0.4802	1.0772	1.0379
No log	1.6970	112	1.3101	0.3243	1.3101	1.1446
No log	1.7273	114	1.2861	0.4358	1.2861	1.1341
No log	1.7576	116	0.9025	0.4552	0.9025	0.9500
No log	1.7879	118	1.1742	0.4258	1.1742	1.0836
No log	1.8182	120	1.1841	0.3943	1.1841	1.0882
No log	1.8485	122	1.0132	0.3960	1.0132	1.0066
No log	1.8788	124	0.8632	0.3875	0.8632	0.9291
No log	1.9091	126	0.9136	0.4606	0.9136	0.9558
No log	1.9394	128	0.8946	0.2920	0.8946	0.9458
No log	1.9697	130	0.9034	0.2920	0.9034	0.9505
No log	2.0	132	0.9084	0.3296	0.9084	0.9531
No log	2.0303	134	1.0629	0.5618	1.0629	1.0310
No log	2.0606	136	1.2416	0.3712	1.2416	1.1143
No log	2.0909	138	1.0227	0.5516	1.0227	1.0113
No log	2.1212	140	0.9341	0.5323	0.9341	0.9665
No log	2.1515	142	0.9216	0.5337	0.9216	0.9600
No log	2.1818	144	0.9309	0.4735	0.9309	0.9648
No log	2.2121	146	1.1533	0.4463	1.1533	1.0739
No log	2.2424	148	1.1456	0.4243	1.1456	1.0703
No log	2.2727	150	0.9006	0.3621	0.9006	0.9490
No log	2.3030	152	0.8817	0.3621	0.8817	0.9390
No log	2.3333	154	0.9709	0.4123	0.9709	0.9853
No log	2.3636	156	1.1151	0.4353	1.1151	1.0560
No log	2.3939	158	1.1563	0.4365	1.1563	1.0753
No log	2.4242	160	1.6604	0.2382	1.6604	1.2886
No log	2.4545	162	1.8441	0.2032	1.8441	1.3580
No log	2.4848	164	1.4370	0.3229	1.4370	1.1988
No log	2.5152	166	0.9795	0.5294	0.9795	0.9897
No log	2.5455	168	0.8804	0.5745	0.8804	0.9383
No log	2.5758	170	1.0417	0.4096	1.0417	1.0206
No log	2.6061	172	1.1196	0.3866	1.1196	1.0581
No log	2.6364	174	0.9113	0.4881	0.9113	0.9546
No log	2.6667	176	0.7909	0.4208	0.7909	0.8893
No log	2.6970	178	0.8008	0.4690	0.8008	0.8949
No log	2.7273	180	0.9381	0.5106	0.9381	0.9685
No log	2.7576	182	1.3714	0.3098	1.3714	1.1711
No log	2.7879	184	1.3593	0.3068	1.3593	1.1659
No log	2.8182	186	1.0505	0.4977	1.0505	1.0249
No log	2.8485	188	0.8426	0.5580	0.8426	0.9179
No log	2.8788	190	0.8447	0.4732	0.8447	0.9191
No log	2.9091	192	0.8034	0.4550	0.8034	0.8963
No log	2.9394	194	0.9097	0.5007	0.9097	0.9538
No log	2.9697	196	1.0530	0.3848	1.0530	1.0261
No log	3.0	198	0.9380	0.5007	0.9380	0.9685
No log	3.0303	200	0.7815	0.4854	0.7815	0.8840
No log	3.0606	202	0.7527	0.4321	0.7527	0.8676
No log	3.0909	204	0.7292	0.4757	0.7292	0.8539
No log	3.1212	206	0.7197	0.5067	0.7197	0.8484
No log	3.1515	208	0.7574	0.6004	0.7574	0.8703
No log	3.1818	210	0.7540	0.5707	0.7540	0.8683
No log	3.2121	212	0.7494	0.3800	0.7494	0.8657
No log	3.2424	214	0.8258	0.4393	0.8258	0.9088
No log	3.2727	216	0.7815	0.3968	0.7815	0.8840
No log	3.3030	218	0.8011	0.5266	0.8011	0.8950
No log	3.3333	220	0.8225	0.4601	0.8225	0.9069
No log	3.3636	222	0.8378	0.3873	0.8378	0.9153
No log	3.3939	224	0.8771	0.4414	0.8771	0.9366
No log	3.4242	226	0.8047	0.4055	0.8047	0.8971
No log	3.4545	228	0.7975	0.5192	0.7975	0.8930
No log	3.4848	230	0.7908	0.4601	0.7908	0.8893
No log	3.5152	232	0.7849	0.4060	0.7849	0.8859
No log	3.5455	234	0.8196	0.3663	0.8196	0.9053
No log	3.5758	236	0.8160	0.3214	0.8160	0.9033
No log	3.6061	238	0.8457	0.3799	0.8457	0.9196
No log	3.6364	240	0.9465	0.3717	0.9465	0.9729
No log	3.6667	242	1.0394	0.4454	1.0394	1.0195
No log	3.6970	244	1.0833	0.4458	1.0833	1.0408
No log	3.7273	246	1.0674	0.4556	1.0674	1.0332
No log	3.7576	248	0.9754	0.3531	0.9754	0.9876
No log	3.7879	250	0.8859	0.2941	0.8859	0.9412
No log	3.8182	252	0.8493	0.2842	0.8493	0.9216
No log	3.8485	254	0.8725	0.4641	0.8725	0.9341
No log	3.8788	256	0.8974	0.4469	0.8974	0.9473
No log	3.9091	258	0.8938	0.4430	0.8938	0.9454
No log	3.9394	260	1.0542	0.4589	1.0542	1.0267
No log	3.9697	262	1.2098	0.3983	1.2098	1.0999
No log	4.0	264	1.0916	0.4568	1.0916	1.0448
No log	4.0303	266	0.9915	0.2769	0.9915	0.9958
No log	4.0606	268	0.9644	0.2229	0.9644	0.9821
No log	4.0909	270	0.9623	0.1255	0.9623	0.9810
No log	4.1212	272	0.9828	0.2102	0.9828	0.9914
No log	4.1515	274	1.0364	0.3453	1.0364	1.0180
No log	4.1818	276	1.0898	0.4241	1.0898	1.0439
No log	4.2121	278	1.0441	0.3913	1.0441	1.0218
No log	4.2424	280	0.9771	0.2387	0.9771	0.9885
No log	4.2727	282	0.9598	0.3544	0.9598	0.9797
No log	4.3030	284	1.0099	0.4338	1.0099	1.0050
No log	4.3333	286	0.9583	0.4204	0.9583	0.9789
No log	4.3636	288	0.9064	0.3571	0.9064	0.9520
No log	4.3939	290	0.9615	0.3876	0.9615	0.9806
No log	4.4242	292	1.0992	0.4910	1.0992	1.0484
No log	4.4545	294	1.3176	0.3217	1.3176	1.1479
No log	4.4848	296	1.3548	0.3475	1.3548	1.1640
No log	4.5152	298	1.1886	0.3731	1.1886	1.0902
No log	4.5455	300	1.0635	0.3124	1.0635	1.0313
No log	4.5758	302	1.0284	0.1969	1.0284	1.0141
No log	4.6061	304	0.9906	0.1625	0.9906	0.9953
No log	4.6364	306	0.9547	0.1625	0.9547	0.9771
No log	4.6667	308	0.9092	0.2061	0.9092	0.9535
No log	4.6970	310	0.9767	0.4769	0.9767	0.9883
No log	4.7273	312	1.1183	0.4011	1.1183	1.0575
No log	4.7576	314	1.0187	0.4686	1.0187	1.0093
No log	4.7879	316	0.8538	0.3915	0.8538	0.9240
No log	4.8182	318	0.8604	0.2818	0.8604	0.9276
No log	4.8485	320	0.9032	0.4139	0.9032	0.9504
No log	4.8788	322	0.8634	0.3728	0.8634	0.9292
No log	4.9091	324	0.8152	0.3896	0.8152	0.9029
No log	4.9394	326	0.8423	0.4590	0.8423	0.9178
No log	4.9697	328	0.8490	0.4069	0.8490	0.9214
No log	5.0	330	0.8867	0.3151	0.8867	0.9417
No log	5.0303	332	1.0384	0.3078	1.0384	1.0190
No log	5.0606	334	1.0963	0.3391	1.0963	1.0470
No log	5.0909	336	1.0347	0.3079	1.0347	1.0172
No log	5.1212	338	0.9305	0.3167	0.9305	0.9646
No log	5.1515	340	0.8930	0.3642	0.8930	0.9450
No log	5.1818	342	0.8926	0.3335	0.8926	0.9448
No log	5.2121	344	0.9333	0.2577	0.9333	0.9661
No log	5.2424	346	1.0365	0.3310	1.0365	1.0181
No log	5.2727	348	1.0581	0.3897	1.0581	1.0287
No log	5.3030	350	0.9981	0.4123	0.9981	0.9990
No log	5.3333	352	0.9449	0.4386	0.9449	0.9720
No log	5.3636	354	0.9717	0.4496	0.9717	0.9857
No log	5.3939	356	1.0150	0.4496	1.0150	1.0075
No log	5.4242	358	1.0643	0.4262	1.0643	1.0316
No log	5.4545	360	0.9916	0.4268	0.9916	0.9958
No log	5.4848	362	0.9088	0.4288	0.9088	0.9533
No log	5.5152	364	0.9040	0.3689	0.9040	0.9508
No log	5.5455	366	0.9252	0.3306	0.9252	0.9619
No log	5.5758	368	0.8891	0.3172	0.8891	0.9429
No log	5.6061	370	0.9051	0.2744	0.9051	0.9513
No log	5.6364	372	0.9258	0.3706	0.9258	0.9622
No log	5.6667	374	0.9157	0.3747	0.9157	0.9569
No log	5.6970	376	0.8886	0.4242	0.8886	0.9427
No log	5.7273	378	0.9939	0.3596	0.9939	0.9970
No log	5.7576	380	0.9680	0.4039	0.9680	0.9839
No log	5.7879	382	0.8484	0.3836	0.8484	0.9211
No log	5.8182	384	0.8652	0.4395	0.8652	0.9302
No log	5.8485	386	0.8495	0.4395	0.8495	0.9217
No log	5.8788	388	0.8454	0.4619	0.8454	0.9195
No log	5.9091	390	0.8298	0.5085	0.8298	0.9109
No log	5.9394	392	0.9005	0.5165	0.9005	0.9489
No log	5.9697	394	0.9272	0.5057	0.9272	0.9629
No log	6.0	396	0.8708	0.4912	0.8708	0.9332
No log	6.0303	398	0.8733	0.4465	0.8733	0.9345
No log	6.0606	400	0.9256	0.4507	0.9256	0.9621
No log	6.0909	402	1.0604	0.4341	1.0604	1.0298
No log	6.1212	404	1.1606	0.4100	1.1606	1.0773
No log	6.1515	406	1.0830	0.4103	1.0830	1.0407
No log	6.1818	408	0.9245	0.3551	0.9245	0.9615
No log	6.2121	410	0.8827	0.2744	0.8827	0.9395
No log	6.2424	412	0.8740	0.2744	0.8740	0.9349
No log	6.2727	414	0.8947	0.4143	0.8947	0.9459
No log	6.3030	416	0.9035	0.4465	0.9035	0.9505
No log	6.3333	418	0.9062	0.4575	0.9062	0.9519
No log	6.3636	420	0.9015	0.4575	0.9015	0.9495
No log	6.3939	422	0.8327	0.4476	0.8327	0.9125
No log	6.4242	424	0.7989	0.4759	0.7989	0.8938
No log	6.4545	426	0.8145	0.5221	0.8145	0.9025
No log	6.4848	428	0.8703	0.5067	0.8703	0.9329
No log	6.5152	430	0.9603	0.4255	0.9603	0.9799
No log	6.5455	432	1.0774	0.4241	1.0774	1.0380
No log	6.5758	434	1.0364	0.4222	1.0364	1.0180
No log	6.6061	436	0.8935	0.3285	0.8935	0.9452
No log	6.6364	438	0.8629	0.3129	0.8629	0.9289
No log	6.6667	440	0.8399	0.3403	0.8399	0.9165
No log	6.6970	442	0.8351	0.3071	0.8351	0.9138
No log	6.7273	444	0.8731	0.2842	0.8731	0.9344
No log	6.7576	446	0.9103	0.2287	0.9103	0.9541
No log	6.7879	448	0.8927	0.2721	0.8927	0.9448
No log	6.8182	450	0.8730	0.3878	0.8730	0.9343
No log	6.8485	452	0.8658	0.4062	0.8658	0.9305
No log	6.8788	454	0.8700	0.3878	0.8700	0.9327
No log	6.9091	456	0.8736	0.2865	0.8736	0.9347
No log	6.9394	458	0.9303	0.2487	0.9303	0.9645
No log	6.9697	460	0.9527	0.3196	0.9527	0.9761
No log	7.0	462	0.8717	0.2814	0.8717	0.9336
No log	7.0303	464	0.8225	0.4346	0.8225	0.9069
No log	7.0606	466	0.8294	0.4625	0.8294	0.9107
No log	7.0909	468	0.8308	0.4186	0.8308	0.9115
No log	7.1212	470	0.9621	0.4464	0.9621	0.9809
No log	7.1515	472	1.0293	0.4767	1.0293	1.0146
No log	7.1818	474	0.9369	0.4310	0.9369	0.9680
No log	7.2121	476	0.8010	0.3697	0.8010	0.8950
No log	7.2424	478	0.7780	0.3816	0.7780	0.8821
No log	7.2727	480	0.7889	0.4304	0.7889	0.8882
No log	7.3030	482	0.8469	0.3728	0.8469	0.9203
No log	7.3333	484	0.9643	0.4212	0.9643	0.9820
No log	7.3636	486	1.1608	0.4226	1.1608	1.0774
No log	7.3939	488	1.2320	0.4332	1.2320	1.1100
No log	7.4242	490	1.0890	0.4765	1.0890	1.0436
No log	7.4545	492	0.8467	0.4499	0.8467	0.9202
No log	7.4848	494	0.7560	0.4019	0.7560	0.8695
No log	7.5152	496	0.7563	0.3730	0.7563	0.8697
No log	7.5455	498	0.7556	0.4143	0.7556	0.8693
0.3178	7.5758	500	0.8398	0.3570	0.8398	0.9164
0.3178	7.6061	502	1.0663	0.4216	1.0663	1.0326
0.3178	7.6364	504	1.2037	0.4243	1.2037	1.0971
0.3178	7.6667	506	1.2128	0.4243	1.2128	1.1013
0.3178	7.6970	508	1.0744	0.4226	1.0744	1.0365
0.3178	7.7273	510	0.9107	0.4170	0.9107	0.9543
0.3178	7.7576	512	0.8419	0.3628	0.8419	0.9176
0.3178	7.7879	514	0.8462	0.3347	0.8462	0.9199
0.3178	7.8182	516	0.8760	0.2942	0.8760	0.9360
0.3178	7.8485	518	0.8786	0.2623	0.8786	0.9374
0.3178	7.8788	520	0.8764	0.2647	0.8764	0.9362
0.3178	7.9091	522	0.8786	0.4102	0.8786	0.9373
0.3178	7.9394	524	0.8409	0.4634	0.8409	0.9170
0.3178	7.9697	526	0.8191	0.5213	0.8191	0.9051
0.3178	8.0	528	0.8498	0.4736	0.8498	0.9218
0.3178	8.0303	530	0.9267	0.4005	0.9267	0.9627
0.3178	8.0606	532	0.8856	0.4186	0.8856	0.9411
0.3178	8.0909	534	0.8330	0.4957	0.8330	0.9127
0.3178	8.1212	536	0.8257	0.3981	0.8257	0.9087
0.3178	8.1515	538	0.8201	0.3367	0.8201	0.9056
0.3178	8.1818	540	0.8132	0.4295	0.8132	0.9018
0.3178	8.2121	542	0.8163	0.4321	0.8163	0.9035
0.3178	8.2424	544	0.8312	0.3602	0.8312	0.9117
0.3178	8.2727	546	0.8747	0.4884	0.8747	0.9352
0.3178	8.3030	548	0.8750	0.4776	0.8750	0.9354
0.3178	8.3333	550	0.8593	0.4102	0.8593	0.9270
0.3178	8.3636	552	0.8457	0.3839	0.8457	0.9196
0.3178	8.3939	554	0.8367	0.3505	0.8367	0.9147
0.3178	8.4242	556	0.8444	0.4115	0.8444	0.9189
0.3178	8.4545	558	0.8248	0.3717	0.8248	0.9082
0.3178	8.4848	560	0.8506	0.4115	0.8506	0.9223
0.3178	8.5152	562	0.9297	0.3710	0.9297	0.9642
0.3178	8.5455	564	1.0109	0.3845	1.0109	1.0054
0.3178	8.5758	566	1.0351	0.3954	1.0351	1.0174
0.3178	8.6061	568	1.0438	0.4222	1.0438	1.0217
0.3178	8.6364	570	0.9493	0.3596	0.9493	0.9743
0.3178	8.6667	572	0.9444	0.2929	0.9444	0.9718
0.3178	8.6970	574	0.9997	0.3026	0.9997	0.9999
0.3178	8.7273	576	1.0304	0.3812	1.0304	1.0151
0.3178	8.7576	578	0.9842	0.4482	0.9842	0.9921
0.3178	8.7879	580	0.9375	0.4268	0.9375	0.9682
0.3178	8.8182	582	0.8594	0.4289	0.8593	0.9270
0.3178	8.8485	584	0.8447	0.4534	0.8447	0.9191
0.3178	8.8788	586	0.8706	0.3931	0.8706	0.9330
0.3178	8.9091	588	0.9329	0.4823	0.9329	0.9659
0.3178	8.9394	590	0.9211	0.3788	0.9211	0.9597
0.3178	8.9697	592	0.9389	0.4143	0.9389	0.9690
0.3178	9.0	594	0.9385	0.3108	0.9385	0.9688
0.3178	9.0303	596	0.9311	0.3474	0.9311	0.9650
0.3178	9.0606	598	0.9648	0.3108	0.9648	0.9823
0.3178	9.0909	600	0.9539	0.3108	0.9539	0.9767
0.3178	9.1212	602	0.9500	0.3474	0.9500	0.9747

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1