ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0224
• Qwk: 0.5528
• Mse: 1.0224
• Rmse: 1.0112

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0230	2	6.7418	0.0242	6.7418	2.5965
No log	0.0460	4	4.5349	0.0972	4.5349	2.1295
No log	0.0690	6	3.5147	-0.0212	3.5147	1.8747
No log	0.0920	8	2.4929	0.2069	2.4929	1.5789
No log	0.1149	10	1.9165	0.1406	1.9165	1.3844
No log	0.1379	12	1.9409	0.2344	1.9409	1.3932
No log	0.1609	14	2.1513	0.1890	2.1513	1.4667
No log	0.1839	16	1.7750	0.2435	1.7750	1.3323
No log	0.2069	18	1.6767	0.2435	1.6767	1.2949
No log	0.2299	20	1.4632	0.2545	1.4632	1.2096
No log	0.2529	22	1.4530	0.2752	1.4530	1.2054
No log	0.2759	24	1.6176	0.2735	1.6176	1.2719
No log	0.2989	26	1.8509	0.3817	1.8509	1.3605
No log	0.3218	28	1.7125	0.3140	1.7125	1.3086
No log	0.3448	30	1.5251	0.3390	1.5251	1.2350
No log	0.3678	32	1.6047	0.3279	1.6047	1.2668
No log	0.3908	34	1.7330	0.4394	1.7330	1.3164
No log	0.4138	36	1.6128	0.4662	1.6128	1.2699
No log	0.4368	38	1.2750	0.4961	1.2750	1.1291
No log	0.4598	40	1.0626	0.5802	1.0626	1.0308
No log	0.4828	42	1.0345	0.5802	1.0345	1.0171
No log	0.5057	44	1.0274	0.6119	1.0274	1.0136
No log	0.5287	46	1.1488	0.4769	1.1488	1.0718
No log	0.5517	48	1.5492	0.3548	1.5492	1.2447
No log	0.5747	50	1.7026	0.2835	1.7026	1.3049
No log	0.5977	52	1.3637	0.4580	1.3637	1.1678
No log	0.6207	54	1.3613	0.4889	1.3613	1.1668
No log	0.6437	56	1.4423	0.3594	1.4423	1.2010
No log	0.6667	58	1.3310	0.4593	1.3310	1.1537
No log	0.6897	60	1.2355	0.5147	1.2355	1.1116
No log	0.7126	62	1.1843	0.5942	1.1843	1.0883
No log	0.7356	64	1.1452	0.5263	1.1452	1.0702
No log	0.7586	66	1.0564	0.5669	1.0564	1.0278
No log	0.7816	68	1.1290	0.5	1.1290	1.0626
No log	0.8046	70	1.3635	0.4060	1.3635	1.1677
No log	0.8276	72	1.3013	0.4361	1.3013	1.1408
No log	0.8506	74	0.9347	0.6569	0.9347	0.9668
No log	0.8736	76	0.9196	0.6618	0.9196	0.9590
No log	0.8966	78	1.0365	0.5755	1.0365	1.0181
No log	0.9195	80	1.2532	0.4818	1.2532	1.1195
No log	0.9425	82	1.2639	0.4853	1.2639	1.1242
No log	0.9655	84	0.9846	0.5802	0.9846	0.9923
No log	0.9885	86	0.9824	0.5827	0.9824	0.9912
No log	1.0115	88	0.9804	0.544	0.9804	0.9902
No log	1.0345	90	0.9407	0.6094	0.9407	0.9699
No log	1.0575	92	0.8563	0.6615	0.8563	0.9253
No log	1.0805	94	0.8328	0.6765	0.8328	0.9126
No log	1.1034	96	0.6954	0.7164	0.6954	0.8339
No log	1.1264	98	0.6386	0.7353	0.6386	0.7991
No log	1.1494	100	0.6651	0.7391	0.6651	0.8155
No log	1.1724	102	0.7875	0.6912	0.7875	0.8874
No log	1.1954	104	0.7472	0.7059	0.7472	0.8644
No log	1.2184	106	0.7274	0.7391	0.7274	0.8528
No log	1.2414	108	0.9681	0.5224	0.9681	0.9839
No log	1.2644	110	1.1878	0.4889	1.1878	1.0899
No log	1.2874	112	0.9354	0.6475	0.9354	0.9672
No log	1.3103	114	0.8374	0.6569	0.8374	0.9151
No log	1.3333	116	0.9909	0.6763	0.9909	0.9954
No log	1.3563	118	1.6667	0.4225	1.6667	1.2910
No log	1.3793	120	1.8231	0.3478	1.8231	1.3502
No log	1.4023	122	1.5968	0.4234	1.5968	1.2637
No log	1.4253	124	1.1561	0.5588	1.1561	1.0752
No log	1.4483	126	0.9995	0.5984	0.9995	0.9997
No log	1.4713	128	1.0542	0.5484	1.0542	1.0267
No log	1.4943	130	1.0392	0.5669	1.0392	1.0194
No log	1.5172	132	1.1976	0.5564	1.1976	1.0944
No log	1.5402	134	1.4970	0.4179	1.4970	1.2235
No log	1.5632	136	1.2708	0.4818	1.2708	1.1273
No log	1.5862	138	0.7965	0.6715	0.7965	0.8925
No log	1.6092	140	0.7144	0.7111	0.7144	0.8452
No log	1.6322	142	0.7347	0.6866	0.7347	0.8571
No log	1.6552	144	0.9455	0.6143	0.9455	0.9724
No log	1.6782	146	1.3899	0.4511	1.3899	1.1789
No log	1.7011	148	1.8085	0.2794	1.8085	1.3448
No log	1.7241	150	1.6318	0.3676	1.6318	1.2774
No log	1.7471	152	1.2194	0.5238	1.2194	1.1043
No log	1.7701	154	1.0919	0.6	1.0919	1.0449
No log	1.7931	156	1.0445	0.6061	1.0445	1.0220
No log	1.8161	158	1.1080	0.5954	1.1080	1.0526
No log	1.8391	160	1.4218	0.4328	1.4218	1.1924
No log	1.8621	162	1.7773	0.2308	1.7773	1.3332
No log	1.8851	164	1.6428	0.4030	1.6428	1.2817
No log	1.9080	166	1.2152	0.4769	1.2152	1.1023
No log	1.9310	168	0.9577	0.6418	0.9577	0.9786
No log	1.9540	170	0.9050	0.6471	0.9050	0.9513
No log	1.9770	172	0.9984	0.6061	0.9984	0.9992
No log	2.0	174	1.3514	0.4148	1.3514	1.1625
No log	2.0230	176	1.4591	0.3942	1.4591	1.2079
No log	2.0460	178	1.6141	0.3676	1.6141	1.2705
No log	2.0690	180	1.5189	0.3676	1.5189	1.2324
No log	2.0920	182	1.3597	0.4394	1.3597	1.1661
No log	2.1149	184	1.3405	0.5	1.3405	1.1578
No log	2.1379	186	1.1520	0.5827	1.1520	1.0733
No log	2.1609	188	1.1253	0.5938	1.1253	1.0608
No log	2.1839	190	1.2728	0.5496	1.2728	1.1282
No log	2.2069	192	1.5773	0.3704	1.5773	1.2559
No log	2.2299	194	1.8985	0.2734	1.8985	1.3779
No log	2.2529	196	2.0188	0.2429	2.0188	1.4208
No log	2.2759	198	1.8247	0.3043	1.8247	1.3508
No log	2.2989	200	1.3862	0.4885	1.3862	1.1774
No log	2.3218	202	1.1073	0.5736	1.1073	1.0523
No log	2.3448	204	1.0264	0.6	1.0264	1.0131
No log	2.3678	206	1.0949	0.5263	1.0949	1.0464
No log	2.3908	208	1.1803	0.5075	1.1803	1.0864
No log	2.4138	210	1.1061	0.5263	1.1061	1.0517
No log	2.4368	212	1.3918	0.4380	1.3918	1.1797
No log	2.4598	214	1.3842	0.4559	1.3842	1.1765
No log	2.4828	216	1.2456	0.4776	1.2456	1.1161
No log	2.5057	218	1.2848	0.4776	1.2848	1.1335
No log	2.5287	220	1.2229	0.5224	1.2229	1.1058
No log	2.5517	222	1.4961	0.3676	1.4961	1.2231
No log	2.5747	224	1.5440	0.3407	1.5440	1.2426
No log	2.5977	226	1.4612	0.3910	1.4612	1.2088
No log	2.6207	228	1.1931	0.5	1.1931	1.0923
No log	2.6437	230	1.1809	0.5	1.1809	1.0867
No log	2.6667	232	1.3728	0.4462	1.3728	1.1716
No log	2.6897	234	1.4417	0.4275	1.4417	1.2007
No log	2.7126	236	1.4994	0.3939	1.4994	1.2245
No log	2.7356	238	1.2988	0.4733	1.2988	1.1396
No log	2.7586	240	1.0027	0.5846	1.0027	1.0014
No log	2.7816	242	0.8745	0.6015	0.8745	0.9352
No log	2.8046	244	0.9494	0.6074	0.9494	0.9744
No log	2.8276	246	0.9973	0.5970	0.9973	0.9986
No log	2.8506	248	1.1002	0.5802	1.1002	1.0489
No log	2.8736	250	1.0397	0.5758	1.0397	1.0196
No log	2.8966	252	1.0914	0.5802	1.0914	1.0447
No log	2.9195	254	1.1180	0.5581	1.1180	1.0573
No log	2.9425	256	0.9975	0.5827	0.9975	0.9988
No log	2.9655	258	1.0188	0.544	1.0188	1.0093
No log	2.9885	260	1.1335	0.5354	1.1335	1.0647
No log	3.0115	262	1.1766	0.5312	1.1766	1.0847
No log	3.0345	264	1.1124	0.56	1.1124	1.0547
No log	3.0575	266	1.1046	0.5469	1.1046	1.0510
No log	3.0805	268	1.1373	0.5469	1.1373	1.0664
No log	3.1034	270	1.3966	0.4394	1.3966	1.1818
No log	3.1264	272	1.5183	0.4030	1.5183	1.2322
No log	3.1494	274	1.4160	0.4427	1.4160	1.1900
No log	3.1724	276	1.4173	0.4615	1.4173	1.1905
No log	3.1954	278	1.4530	0.4427	1.4530	1.2054
No log	3.2184	280	1.4301	0.4496	1.4301	1.1959
No log	3.2414	282	1.2329	0.5231	1.2329	1.1104
No log	3.2644	284	1.2289	0.5231	1.2289	1.1085
No log	3.2874	286	1.3319	0.4697	1.3319	1.1541
No log	3.3103	288	1.4514	0.4118	1.4514	1.2047
No log	3.3333	290	1.3974	0.4812	1.3974	1.1821
No log	3.3563	292	1.4469	0.4361	1.4469	1.2029
No log	3.3793	294	1.4359	0.4427	1.4359	1.1983
No log	3.4023	296	1.3670	0.4961	1.3670	1.1692
No log	3.4253	298	1.2451	0.4882	1.2451	1.1158
No log	3.4483	300	1.1533	0.5312	1.1533	1.0739
No log	3.4713	302	1.0020	0.5984	1.0020	1.0010
No log	3.4943	304	1.0143	0.5714	1.0143	1.0071
No log	3.5172	306	1.3084	0.4769	1.3084	1.1439
No log	3.5402	308	1.9062	0.3472	1.9062	1.3806
No log	3.5632	310	2.0061	0.2797	2.0061	1.4164
No log	3.5862	312	1.6120	0.3852	1.6120	1.2697
No log	3.6092	314	1.2810	0.4844	1.2810	1.1318
No log	3.6322	316	1.1229	0.5397	1.1229	1.0597
No log	3.6552	318	1.1124	0.5203	1.1124	1.0547
No log	3.6782	320	1.0669	0.5203	1.0669	1.0329
No log	3.7011	322	1.0985	0.512	1.0985	1.0481
No log	3.7241	324	1.4689	0.4615	1.4689	1.2120
No log	3.7471	326	1.7384	0.3796	1.7384	1.3185
No log	3.7701	328	1.7338	0.3971	1.7338	1.3167
No log	3.7931	330	1.4650	0.4615	1.4650	1.2104
No log	3.8161	332	1.1875	0.5079	1.1875	1.0897
No log	3.8391	334	1.1691	0.5	1.1691	1.0812
No log	3.8621	336	1.2712	0.5079	1.2712	1.1275
No log	3.8851	338	1.4244	0.4567	1.4244	1.1935
No log	3.9080	340	1.4243	0.4567	1.4243	1.1935
No log	3.9310	342	1.3413	0.4844	1.3413	1.1581
No log	3.9540	344	1.2917	0.4844	1.2917	1.1365
No log	3.9770	346	1.3132	0.4844	1.3132	1.1460
No log	4.0	348	1.4006	0.4961	1.4006	1.1835
No log	4.0230	350	1.6093	0.4091	1.6093	1.2686
No log	4.0460	352	1.7326	0.3704	1.7326	1.3163
No log	4.0690	354	1.6362	0.3910	1.6362	1.2791
No log	4.0920	356	1.4079	0.4688	1.4079	1.1865
No log	4.1149	358	1.1792	0.5197	1.1792	1.0859
No log	4.1379	360	1.0662	0.5469	1.0662	1.0326
No log	4.1609	362	1.1622	0.5077	1.1622	1.0780
No log	4.1839	364	1.4259	0.4733	1.4259	1.1941
No log	4.2069	366	1.4808	0.4328	1.4808	1.2169
No log	4.2299	368	1.2808	0.4961	1.2808	1.1317
No log	4.2529	370	1.1273	0.5197	1.1273	1.0617
No log	4.2759	372	1.1156	0.5079	1.1156	1.0562
No log	4.2989	374	1.0874	0.5238	1.0874	1.0428
No log	4.3218	376	1.0751	0.5197	1.0751	1.0369
No log	4.3448	378	1.0396	0.5197	1.0396	1.0196
No log	4.3678	380	1.0636	0.5312	1.0636	1.0313
No log	4.3908	382	1.1608	0.5197	1.1608	1.0774
No log	4.4138	384	1.1075	0.5238	1.1075	1.0524
No log	4.4368	386	1.0188	0.5082	1.0188	1.0094
No log	4.4598	388	1.0566	0.4655	1.0566	1.0279
No log	4.4828	390	1.1262	0.4746	1.1262	1.0612
No log	4.5057	392	1.2891	0.5	1.2891	1.1354
No log	4.5287	394	1.5224	0.4496	1.5224	1.2339
No log	4.5517	396	1.5768	0.3939	1.5768	1.2557
No log	4.5747	398	1.4493	0.4496	1.4493	1.2039
No log	4.5977	400	1.3330	0.4844	1.3330	1.1545
No log	4.6207	402	1.2377	0.5	1.2377	1.1125
No log	4.6437	404	1.3062	0.4961	1.3062	1.1429
No log	4.6667	406	1.5237	0.3788	1.5237	1.2344
No log	4.6897	408	1.7737	0.2941	1.7737	1.3318
No log	4.7126	410	1.7329	0.3433	1.7329	1.3164
No log	4.7356	412	1.5767	0.4375	1.5767	1.2557
No log	4.7586	414	1.4747	0.4882	1.4747	1.2144
No log	4.7816	416	1.3906	0.4882	1.3906	1.1793
No log	4.8046	418	1.3899	0.5	1.3899	1.1789
No log	4.8276	420	1.5181	0.3969	1.5181	1.2321
No log	4.8506	422	1.5285	0.3969	1.5285	1.2363
No log	4.8736	424	1.5091	0.4427	1.5091	1.2285
No log	4.8966	426	1.3600	0.4462	1.3600	1.1662
No log	4.9195	428	1.2512	0.4769	1.2512	1.1186
No log	4.9425	430	1.2431	0.5038	1.2431	1.1150
No log	4.9655	432	1.2968	0.4375	1.2968	1.1388
No log	4.9885	434	1.2885	0.5	1.2885	1.1351
No log	5.0115	436	1.3315	0.5	1.3315	1.1539
No log	5.0345	438	1.1974	0.5238	1.1974	1.0943
No log	5.0575	440	1.0703	0.5124	1.0703	1.0345
No log	5.0805	442	1.0143	0.5210	1.0143	1.0071
No log	5.1034	444	0.9514	0.5333	0.9514	0.9754
No log	5.1264	446	0.9766	0.512	0.9766	0.9882
No log	5.1494	448	1.0234	0.5414	1.0234	1.0117
No log	5.1724	450	0.9575	0.5354	0.9575	0.9785
No log	5.1954	452	0.9030	0.5625	0.9030	0.9503
No log	5.2184	454	0.9041	0.6349	0.9041	0.9509
No log	5.2414	456	0.9639	0.5736	0.9639	0.9818
No log	5.2644	458	1.1061	0.5156	1.1061	1.0517
No log	5.2874	460	1.3907	0.4462	1.3907	1.1793
No log	5.3103	462	1.4966	0.4275	1.4966	1.2234
No log	5.3333	464	1.3369	0.5	1.3369	1.1563
No log	5.3563	466	1.0684	0.5156	1.0684	1.0336
No log	5.3793	468	0.8334	0.6716	0.8334	0.9129
No log	5.4023	470	0.7873	0.7299	0.7873	0.8873
No log	5.4253	472	0.7777	0.7299	0.7777	0.8819
No log	5.4483	474	0.8388	0.6866	0.8388	0.9159
No log	5.4713	476	1.0476	0.5426	1.0476	1.0235
No log	5.4943	478	1.2100	0.5116	1.2100	1.1000
No log	5.5172	480	1.1953	0.5116	1.1953	1.0933
No log	5.5402	482	1.0950	0.5156	1.0950	1.0464
No log	5.5632	484	1.0037	0.5426	1.0037	1.0018
No log	5.5862	486	0.9733	0.5556	0.9733	0.9866
No log	5.6092	488	1.0238	0.5484	1.0238	1.0118
No log	5.6322	490	1.0291	0.528	1.0291	1.0145
No log	5.6552	492	1.0047	0.5397	1.0047	1.0023
No log	5.6782	494	0.9071	0.5827	0.9071	0.9524
No log	5.7011	496	0.8164	0.6094	0.8164	0.9035
No log	5.7241	498	0.8474	0.6061	0.8474	0.9205
0.3749	5.7471	500	0.9970	0.5692	0.9970	0.9985
0.3749	5.7701	502	1.0257	0.5156	1.0257	1.0128
0.3749	5.7931	504	1.0128	0.5354	1.0128	1.0064
0.3749	5.8161	506	0.9801	0.5556	0.9801	0.9900
0.3749	5.8391	508	0.9792	0.5574	0.9792	0.9896
0.3749	5.8621	510	1.0224	0.5528	1.0224	1.0112

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1