ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k4_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4430
• Qwk: 0.4462
• Mse: 1.4430
• Rmse: 1.2012

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	6.9743	0.0056	6.9743	2.6409
No log	0.2222	4	4.5177	0.0583	4.5177	2.1255
No log	0.3333	6	3.9644	-0.0290	3.9644	1.9911
No log	0.4444	8	3.7349	-0.0100	3.7349	1.9326
No log	0.5556	10	2.5164	0.1361	2.5164	1.5863
No log	0.6667	12	2.1787	0.2707	2.1787	1.4760
No log	0.7778	14	1.9342	0.2443	1.9342	1.3907
No log	0.8889	16	1.7970	0.3306	1.7970	1.3405
No log	1.0	18	2.0448	0.2222	2.0448	1.4299
No log	1.1111	20	2.1720	0.0606	2.1720	1.4738
No log	1.2222	22	2.2997	0.0	2.2997	1.5165
No log	1.3333	24	2.1859	0.0699	2.1859	1.4785
No log	1.4444	26	1.9273	0.3101	1.9273	1.3883
No log	1.5556	28	1.5186	0.3793	1.5186	1.2323
No log	1.6667	30	1.3693	0.3802	1.3693	1.1702
No log	1.7778	32	1.3803	0.4032	1.3803	1.1749
No log	1.8889	34	1.4369	0.3360	1.4369	1.1987
No log	2.0	36	1.3911	0.3361	1.3911	1.1795
No log	2.1111	38	1.3171	0.3304	1.3171	1.1477
No log	2.2222	40	1.2675	0.3214	1.2675	1.1259
No log	2.3333	42	1.2991	0.2430	1.2991	1.1398
No log	2.4444	44	1.3477	0.2909	1.3477	1.1609
No log	2.5556	46	1.3803	0.3934	1.3803	1.1749
No log	2.6667	48	1.5387	0.4320	1.5387	1.2404
No log	2.7778	50	1.4328	0.4194	1.4328	1.1970
No log	2.8889	52	1.2984	0.4603	1.2984	1.1395
No log	3.0	54	1.2043	0.3393	1.2043	1.0974
No log	3.1111	56	1.1899	0.3929	1.1899	1.0908
No log	3.2222	58	1.1652	0.4425	1.1652	1.0794
No log	3.3333	60	1.0689	0.5378	1.0689	1.0339
No log	3.4444	62	1.1145	0.5	1.1145	1.0557
No log	3.5556	64	1.1364	0.5299	1.1364	1.0660
No log	3.6667	66	1.0558	0.5546	1.0558	1.0275
No log	3.7778	68	1.0511	0.5667	1.0511	1.0252
No log	3.8889	70	1.0732	0.5785	1.0732	1.0360
No log	4.0	72	1.0808	0.4918	1.0808	1.0396
No log	4.1111	74	1.1889	0.4219	1.1889	1.0903
No log	4.2222	76	1.0533	0.4754	1.0533	1.0263
No log	4.3333	78	1.0342	0.5785	1.0342	1.0170
No log	4.4444	80	1.1262	0.4957	1.1262	1.0612
No log	4.5556	82	1.0926	0.5424	1.0926	1.0453
No log	4.6667	84	0.9477	0.5528	0.9477	0.9735
No log	4.7778	86	0.9014	0.6142	0.9014	0.9494
No log	4.8889	88	0.9097	0.5806	0.9097	0.9538
No log	5.0	90	1.1263	0.5528	1.1263	1.0613
No log	5.1111	92	1.3515	0.4320	1.3515	1.1625
No log	5.2222	94	1.2247	0.5303	1.2247	1.1067
No log	5.3333	96	0.9168	0.6364	0.9168	0.9575
No log	5.4444	98	0.8474	0.6861	0.8474	0.9205
No log	5.5556	100	0.9026	0.6406	0.9026	0.9500
No log	5.6667	102	1.0778	0.5669	1.0778	1.0382
No log	5.7778	104	1.1396	0.5691	1.1396	1.0675
No log	5.8889	106	1.1842	0.5366	1.1842	1.0882
No log	6.0	108	1.0497	0.5902	1.0497	1.0245
No log	6.1111	110	0.9113	0.6308	0.9113	0.9546
No log	6.2222	112	1.0759	0.6165	1.0759	1.0373
No log	6.3333	114	1.4212	0.4148	1.4212	1.1921
No log	6.4444	116	1.5611	0.3382	1.5611	1.2494
No log	6.5556	118	1.4261	0.4328	1.4261	1.1942
No log	6.6667	120	1.0977	0.5625	1.0977	1.0477
No log	6.7778	122	1.0194	0.5806	1.0194	1.0096
No log	6.8889	124	1.1386	0.5246	1.1386	1.0670
No log	7.0	126	1.2958	0.4667	1.2958	1.1383
No log	7.1111	128	1.2563	0.56	1.2563	1.1208
No log	7.2222	130	1.1459	0.5625	1.1459	1.0705
No log	7.3333	132	1.0458	0.6349	1.0458	1.0226
No log	7.4444	134	1.0814	0.6032	1.0814	1.0399
No log	7.5556	136	1.1305	0.5512	1.1305	1.0633
No log	7.6667	138	1.1424	0.5954	1.1424	1.0688
No log	7.7778	140	1.1601	0.5846	1.1601	1.0771
No log	7.8889	142	1.2561	0.5323	1.2561	1.1208
No log	8.0	144	1.3384	0.4918	1.3384	1.1569
No log	8.1111	146	1.2721	0.5781	1.2721	1.1279
No log	8.2222	148	1.2146	0.6107	1.2146	1.1021
No log	8.3333	150	1.1761	0.6316	1.1761	1.0845
No log	8.4444	152	1.2942	0.5263	1.2942	1.1376
No log	8.5556	154	1.4332	0.3556	1.4332	1.1972
No log	8.6667	156	1.3854	0.4812	1.3854	1.1770
No log	8.7778	158	1.1258	0.6277	1.1258	1.0610
No log	8.8889	160	0.9422	0.6617	0.9422	0.9707
No log	9.0	162	0.9325	0.6364	0.9325	0.9657
No log	9.1111	164	1.0799	0.5926	1.0799	1.0392
No log	9.2222	166	1.1896	0.5263	1.1896	1.0907
No log	9.3333	168	1.1370	0.5522	1.1370	1.0663
No log	9.4444	170	1.1127	0.5564	1.1127	1.0549
No log	9.5556	172	1.1457	0.5224	1.1457	1.0704
No log	9.6667	174	1.3466	0.4627	1.3466	1.1604
No log	9.7778	176	1.4850	0.3881	1.4850	1.2186
No log	9.8889	178	1.3714	0.4662	1.3714	1.1711
No log	10.0	180	1.1340	0.5891	1.1340	1.0649
No log	10.1111	182	1.1376	0.5806	1.1376	1.0666
No log	10.2222	184	1.2677	0.528	1.2677	1.1259
No log	10.3333	186	1.5400	0.3200	1.5400	1.2410
No log	10.4444	188	1.7019	0.2899	1.7019	1.3046
No log	10.5556	190	1.8145	0.2676	1.8145	1.3470
No log	10.6667	192	1.6724	0.3143	1.6724	1.2932
No log	10.7778	194	1.3373	0.4580	1.3373	1.1564
No log	10.8889	196	0.9959	0.5854	0.9959	0.9980
No log	11.0	198	0.9493	0.5691	0.9493	0.9743
No log	11.1111	200	0.9699	0.5289	0.9699	0.9848
No log	11.2222	202	1.0356	0.5289	1.0356	1.0176
No log	11.3333	204	1.2311	0.5246	1.2311	1.1096
No log	11.4444	206	1.4269	0.4375	1.4269	1.1945
No log	11.5556	208	1.5276	0.3333	1.5276	1.2360
No log	11.6667	210	1.4638	0.3846	1.4638	1.2099
No log	11.7778	212	1.2702	0.5271	1.2702	1.1270
No log	11.8889	214	1.0182	0.6066	1.0182	1.0091
No log	12.0	216	0.9340	0.5968	0.9340	0.9665
No log	12.1111	218	0.9331	0.5968	0.9331	0.9660
No log	12.2222	220	0.9994	0.5785	0.9994	0.9997
No log	12.3333	222	1.1520	0.5873	1.1520	1.0733
No log	12.4444	224	1.2389	0.5714	1.2389	1.1130
No log	12.5556	226	1.3082	0.4844	1.3082	1.1438
No log	12.6667	228	1.3171	0.4733	1.3171	1.1476
No log	12.7778	230	1.3835	0.4427	1.3835	1.1762
No log	12.8889	232	1.3206	0.5224	1.3206	1.1492
No log	13.0	234	1.2898	0.5224	1.2898	1.1357
No log	13.1111	236	1.2636	0.5263	1.2636	1.1241
No log	13.2222	238	1.1806	0.4961	1.1806	1.0866
No log	13.3333	240	1.1748	0.4961	1.1748	1.0839
No log	13.4444	242	1.2031	0.4961	1.2031	1.0969
No log	13.5556	244	1.2453	0.4806	1.2453	1.1159
No log	13.6667	246	1.2099	0.496	1.2099	1.1000
No log	13.7778	248	1.1245	0.5203	1.1245	1.0604
No log	13.8889	250	1.0203	0.5738	1.0203	1.0101
No log	14.0	252	0.9969	0.624	0.9969	0.9984
No log	14.1111	254	1.0821	0.5669	1.0821	1.0402
No log	14.2222	256	1.2236	0.5271	1.2236	1.1062
No log	14.3333	258	1.4434	0.3910	1.4434	1.2014
No log	14.4444	260	1.6365	0.3382	1.6365	1.2793
No log	14.5556	262	1.6217	0.3284	1.6217	1.2735
No log	14.6667	264	1.5007	0.3511	1.5007	1.2250
No log	14.7778	266	1.3435	0.4228	1.3435	1.1591
No log	14.8889	268	1.1167	0.5984	1.1167	1.0568
No log	15.0	270	1.0198	0.6202	1.0198	1.0098
No log	15.1111	272	1.0683	0.6154	1.0683	1.0336
No log	15.2222	274	1.2313	0.5333	1.2313	1.1097
No log	15.3333	276	1.3267	0.5	1.3267	1.1518
No log	15.4444	278	1.3030	0.5255	1.3030	1.1415
No log	15.5556	280	1.2768	0.5373	1.2768	1.1300
No log	15.6667	282	1.3321	0.5414	1.3321	1.1542
No log	15.7778	284	1.3207	0.5263	1.3207	1.1492
No log	15.8889	286	1.3668	0.5152	1.3668	1.1691
No log	16.0	288	1.2822	0.56	1.2822	1.1323
No log	16.1111	290	1.1824	0.5806	1.1824	1.0874
No log	16.2222	292	1.1266	0.6129	1.1266	1.0614
No log	16.3333	294	1.1427	0.6016	1.1427	1.0690
No log	16.4444	296	1.1721	0.5938	1.1721	1.0826
No log	16.5556	298	1.2305	0.5630	1.2305	1.1093
No log	16.6667	300	1.2341	0.5401	1.2341	1.1109
No log	16.7778	302	1.2629	0.5401	1.2629	1.1238
No log	16.8889	304	1.2428	0.5736	1.2428	1.1148
No log	17.0	306	1.1434	0.5902	1.1434	1.0693
No log	17.1111	308	1.1544	0.5882	1.1544	1.0744
No log	17.2222	310	1.2500	0.5593	1.2500	1.1180
No log	17.3333	312	1.3537	0.5254	1.3537	1.1635
No log	17.4444	314	1.3923	0.4538	1.3923	1.1800
No log	17.5556	316	1.3080	0.5426	1.3080	1.1437
No log	17.6667	318	1.2201	0.5802	1.2201	1.1046
No log	17.7778	320	1.0863	0.6260	1.0863	1.0423
No log	17.8889	322	1.0600	0.6015	1.0600	1.0296
No log	18.0	324	1.0856	0.5714	1.0856	1.0419
No log	18.1111	326	1.1455	0.5522	1.1455	1.0703
No log	18.2222	328	1.1869	0.5954	1.1869	1.0895
No log	18.3333	330	1.1645	0.6154	1.1645	1.0791
No log	18.4444	332	1.1943	0.6154	1.1943	1.0928
No log	18.5556	334	1.3019	0.5231	1.3019	1.1410
No log	18.6667	336	1.3710	0.4242	1.3710	1.1709
No log	18.7778	338	1.3007	0.4812	1.3007	1.1405
No log	18.8889	340	1.1619	0.6154	1.1619	1.0779
No log	19.0	342	1.0198	0.6154	1.0198	1.0099
No log	19.1111	344	0.9985	0.6357	0.9985	0.9992
No log	19.2222	346	1.0318	0.6154	1.0318	1.0158
No log	19.3333	348	1.0464	0.6	1.0464	1.0230
No log	19.4444	350	1.0769	0.5954	1.0769	1.0378
No log	19.5556	352	1.1472	0.5373	1.1472	1.0711
No log	19.6667	354	1.1279	0.5909	1.1279	1.0620
No log	19.7778	356	1.1320	0.5954	1.1320	1.0640
No log	19.8889	358	1.1677	0.6	1.1677	1.0806
No log	20.0	360	1.1278	0.5854	1.1278	1.0620
No log	20.1111	362	1.0992	0.5455	1.0992	1.0484
No log	20.2222	364	1.0879	0.5455	1.0879	1.0430
No log	20.3333	366	1.1179	0.6080	1.1179	1.0573
No log	20.4444	368	1.1338	0.6190	1.1338	1.0648
No log	20.5556	370	1.1463	0.6154	1.1463	1.0707
No log	20.6667	372	1.1613	0.5954	1.1613	1.0776
No log	20.7778	374	1.0967	0.6047	1.0967	1.0472
No log	20.8889	376	1.0282	0.6299	1.0282	1.0140
No log	21.0	378	1.0064	0.6406	1.0064	1.0032
No log	21.1111	380	1.0620	0.6349	1.0620	1.0305
No log	21.2222	382	1.1367	0.625	1.1367	1.0661
No log	21.3333	384	1.2001	0.5891	1.2001	1.0955
No log	21.4444	386	1.2424	0.5303	1.2424	1.1146
No log	21.5556	388	1.2679	0.4889	1.2679	1.1260
No log	21.6667	390	1.2539	0.5075	1.2539	1.1198
No log	21.7778	392	1.2215	0.4962	1.2215	1.1052
No log	21.8889	394	1.2601	0.5191	1.2601	1.1225
No log	22.0	396	1.3149	0.5113	1.3149	1.1467
No log	22.1111	398	1.3345	0.4662	1.3345	1.1552
No log	22.2222	400	1.2944	0.4567	1.2944	1.1377
No log	22.3333	402	1.2315	0.5484	1.2315	1.1097
No log	22.4444	404	1.2181	0.5366	1.2181	1.1037
No log	22.5556	406	1.1720	0.5366	1.1720	1.0826
No log	22.6667	408	1.1614	0.5760	1.1614	1.0777
No log	22.7778	410	1.1053	0.6032	1.1053	1.0513
No log	22.8889	412	1.1023	0.6032	1.1023	1.0499
No log	23.0	414	1.1573	0.6032	1.1573	1.0758
No log	23.1111	416	1.2622	0.4375	1.2622	1.1235
No log	23.2222	418	1.2904	0.4375	1.2904	1.1359
No log	23.3333	420	1.2488	0.4375	1.2488	1.1175
No log	23.4444	422	1.1667	0.6032	1.1667	1.0802
No log	23.5556	424	1.1856	0.5920	1.1856	1.0889
No log	23.6667	426	1.2087	0.5760	1.2087	1.0994
No log	23.7778	428	1.2613	0.48	1.2613	1.1231
No log	23.8889	430	1.2480	0.4724	1.2480	1.1171
No log	24.0	432	1.2246	0.4923	1.2246	1.1066
No log	24.1111	434	1.2164	0.5373	1.2164	1.1029
No log	24.2222	436	1.1731	0.6	1.1731	1.0831
No log	24.3333	438	1.2160	0.5469	1.2160	1.1027
No log	24.4444	440	1.3424	0.4062	1.3424	1.1586
No log	24.5556	442	1.4665	0.3906	1.4665	1.2110
No log	24.6667	444	1.4638	0.375	1.4638	1.2099
No log	24.7778	446	1.3457	0.4320	1.3457	1.1600
No log	24.8889	448	1.2420	0.4878	1.2420	1.1145
No log	25.0	450	1.2107	0.5161	1.2107	1.1003
No log	25.1111	452	1.2569	0.5556	1.2569	1.1211
No log	25.2222	454	1.4007	0.3721	1.4007	1.1835
No log	25.3333	456	1.5439	0.3206	1.5439	1.2425
No log	25.4444	458	1.5695	0.2923	1.5695	1.2528
No log	25.5556	460	1.5158	0.3721	1.5158	1.2312
No log	25.6667	462	1.4487	0.4355	1.4487	1.2036
No log	25.7778	464	1.4207	0.3448	1.4207	1.1919
No log	25.8889	466	1.4445	0.3130	1.4445	1.2019
No log	26.0	468	1.4732	0.3130	1.4732	1.2137
No log	26.1111	470	1.4732	0.3529	1.4732	1.2137
No log	26.2222	472	1.4867	0.3967	1.4867	1.2193
No log	26.3333	474	1.5320	0.4032	1.5320	1.2378
No log	26.4444	476	1.5486	0.3937	1.5486	1.2444
No log	26.5556	478	1.5593	0.3438	1.5593	1.2487
No log	26.6667	480	1.5145	0.3692	1.5145	1.2307
No log	26.7778	482	1.4010	0.4154	1.4010	1.1836
No log	26.8889	484	1.3069	0.4844	1.3069	1.1432
No log	27.0	486	1.3233	0.4615	1.3233	1.1504
No log	27.1111	488	1.3560	0.4211	1.3560	1.1645
No log	27.2222	490	1.3921	0.4118	1.3921	1.1799
No log	27.3333	492	1.3595	0.4211	1.3595	1.1660
No log	27.4444	494	1.2770	0.5224	1.2770	1.1301
No log	27.5556	496	1.2829	0.4615	1.2829	1.1327
No log	27.6667	498	1.3205	0.4341	1.3205	1.1491
0.3673	27.7778	500	1.3779	0.4496	1.3779	1.1738
0.3673	27.8889	502	1.4775	0.3939	1.4775	1.2155
0.3673	28.0	504	1.4660	0.3876	1.4660	1.2108
0.3673	28.1111	506	1.4136	0.4154	1.4136	1.1889
0.3673	28.2222	508	1.3803	0.4496	1.3803	1.1748
0.3673	28.3333	510	1.3350	0.4603	1.3350	1.1554
0.3673	28.4444	512	1.3847	0.4496	1.3847	1.1767
0.3673	28.5556	514	1.4287	0.4154	1.4287	1.1953
0.3673	28.6667	516	1.5378	0.3459	1.5378	1.2401
0.3673	28.7778	518	1.5653	0.3556	1.5653	1.2511
0.3673	28.8889	520	1.4430	0.4462	1.4430	1.2012

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1