ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3629
• Qwk: 0.4640
• Mse: 1.3629
• Rmse: 1.1674

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	7.0998	-0.0270	7.0998	2.6645
No log	0.4444	4	4.6074	0.0598	4.6074	2.1465
No log	0.6667	6	3.2153	0.0	3.2153	1.7931
No log	0.8889	8	2.4163	0.1560	2.4163	1.5544
No log	1.1111	10	2.0548	0.0992	2.0548	1.4334
No log	1.3333	12	1.9407	0.1217	1.9407	1.3931
No log	1.5556	14	1.6454	0.1905	1.6454	1.2827
No log	1.7778	16	1.6751	0.2000	1.6751	1.2943
No log	2.0	18	2.0379	0.1311	2.0379	1.4275
No log	2.2222	20	2.3888	0.0979	2.3888	1.5456
No log	2.4444	22	2.2902	0.1408	2.2902	1.5133
No log	2.6667	24	1.8805	0.2000	1.8805	1.3713
No log	2.8889	26	1.6941	0.1964	1.6941	1.3016
No log	3.1111	28	1.5352	0.2202	1.5352	1.2390
No log	3.3333	30	1.5086	0.2202	1.5086	1.2283
No log	3.5556	32	1.4934	0.2056	1.4934	1.2221
No log	3.7778	34	2.0697	0.1985	2.0697	1.4386
No log	4.0	36	2.7500	0.0859	2.7500	1.6583
No log	4.2222	38	2.6775	0.0859	2.6775	1.6363
No log	4.4444	40	2.0888	0.2899	2.0888	1.4453
No log	4.6667	42	1.5643	0.2906	1.5643	1.2507
No log	4.8889	44	1.3860	0.3509	1.3860	1.1773
No log	5.1111	46	1.4425	0.3273	1.4425	1.2011
No log	5.3333	48	1.7809	0.2124	1.7809	1.3345
No log	5.5556	50	1.6954	0.2807	1.6954	1.3021
No log	5.7778	52	1.4161	0.3770	1.4161	1.1900
No log	6.0	54	1.5974	0.3308	1.5974	1.2639
No log	6.2222	56	1.7282	0.3650	1.7282	1.3146
No log	6.4444	58	1.4261	0.4776	1.4261	1.1942
No log	6.6667	60	1.2849	0.4640	1.2849	1.1335
No log	6.8889	62	1.7669	0.2149	1.7669	1.3293
No log	7.1111	64	2.1652	0.0800	2.1652	1.4715
No log	7.3333	66	2.0076	0.1270	2.0076	1.4169
No log	7.5556	68	1.3685	0.4769	1.3685	1.1698
No log	7.7778	70	1.1550	0.5882	1.1550	1.0747
No log	8.0	72	1.1845	0.5693	1.1845	1.0883
No log	8.2222	74	1.1577	0.5954	1.1577	1.0759
No log	8.4444	76	1.2934	0.4848	1.2934	1.1373
No log	8.6667	78	1.4495	0.4179	1.4495	1.2040
No log	8.8889	80	1.4634	0.4776	1.4634	1.2097
No log	9.1111	82	1.3097	0.5426	1.3097	1.1444
No log	9.3333	84	1.1044	0.6047	1.1044	1.0509
No log	9.5556	86	1.0078	0.6202	1.0078	1.0039
No log	9.7778	88	1.0367	0.6202	1.0367	1.0182
No log	10.0	90	1.0610	0.6412	1.0610	1.0301
No log	10.2222	92	0.9784	0.6047	0.9784	0.9891
No log	10.4444	94	0.9659	0.5827	0.9659	0.9828
No log	10.6667	96	1.1226	0.5954	1.1226	1.0595
No log	10.8889	98	1.2640	0.5294	1.2640	1.1243
No log	11.1111	100	1.1340	0.5649	1.1340	1.0649
No log	11.3333	102	1.0182	0.6015	1.0182	1.0091
No log	11.5556	104	1.0318	0.6423	1.0318	1.0158
No log	11.7778	106	1.1939	0.5672	1.1939	1.0927
No log	12.0	108	1.4433	0.3662	1.4433	1.2014
No log	12.2222	110	1.3215	0.4741	1.3215	1.1496
No log	12.4444	112	1.0947	0.5984	1.0947	1.0463
No log	12.6667	114	1.0353	0.5042	1.0353	1.0175
No log	12.8889	116	1.0434	0.56	1.0434	1.0215
No log	13.1111	118	1.0447	0.5366	1.0447	1.0221
No log	13.3333	120	1.2021	0.5984	1.2021	1.0964
No log	13.5556	122	1.3242	0.5075	1.3242	1.1508
No log	13.7778	124	1.2725	0.5038	1.2725	1.1280
No log	14.0	126	1.1747	0.5736	1.1747	1.0838
No log	14.2222	128	1.1170	0.5625	1.1170	1.0569
No log	14.4444	130	1.1097	0.5625	1.1097	1.0534
No log	14.6667	132	1.2471	0.5	1.2471	1.1167
No log	14.8889	134	1.3920	0.4889	1.3920	1.1798
No log	15.1111	136	1.4709	0.4526	1.4709	1.2128
No log	15.3333	138	1.3334	0.4889	1.3334	1.1547
No log	15.5556	140	1.1756	0.5865	1.1756	1.0842
No log	15.7778	142	1.1758	0.5865	1.1758	1.0843
No log	16.0	144	1.1994	0.5865	1.1994	1.0952
No log	16.2222	146	1.1507	0.5865	1.1507	1.0727
No log	16.4444	148	1.1422	0.5865	1.1422	1.0687
No log	16.6667	150	1.1878	0.5865	1.1878	1.0899
No log	16.8889	152	1.2409	0.5865	1.2409	1.1139
No log	17.1111	154	1.1924	0.5865	1.1924	1.0920
No log	17.3333	156	1.0712	0.6	1.0712	1.0350
No log	17.5556	158	1.0122	0.5692	1.0122	1.0061
No log	17.7778	160	1.0084	0.5802	1.0084	1.0042
No log	18.0	162	1.0740	0.6107	1.0740	1.0363
No log	18.2222	164	1.1135	0.6107	1.1135	1.0552
No log	18.4444	166	0.9661	0.6107	0.9661	0.9829
No log	18.6667	168	0.8959	0.5714	0.8959	0.9465
No log	18.8889	170	0.8971	0.6260	0.8971	0.9471
No log	19.1111	172	0.9344	0.6190	0.9344	0.9666
No log	19.3333	174	0.9911	0.56	0.9911	0.9955
No log	19.5556	176	1.1212	0.6107	1.1212	1.0589
No log	19.7778	178	1.2017	0.5846	1.2017	1.0962
No log	20.0	180	1.1068	0.5736	1.1068	1.0521
No log	20.2222	182	1.0409	0.5781	1.0409	1.0203
No log	20.4444	184	1.0665	0.5625	1.0665	1.0327
No log	20.6667	186	1.1686	0.5469	1.1686	1.0810
No log	20.8889	188	1.3684	0.5038	1.3684	1.1698
No log	21.1111	190	1.3913	0.5038	1.3913	1.1795
No log	21.3333	192	1.2614	0.5079	1.2614	1.1231
No log	21.5556	194	1.2096	0.5354	1.2096	1.0998
No log	21.7778	196	1.2263	0.5469	1.2263	1.1074
No log	22.0	198	1.3220	0.5038	1.3220	1.1498
No log	22.2222	200	1.6093	0.3429	1.6093	1.2686
No log	22.4444	202	1.7318	0.2877	1.7318	1.3160
No log	22.6667	204	1.5630	0.3741	1.5630	1.2502
No log	22.8889	206	1.2805	0.5303	1.2805	1.1316
No log	23.1111	208	1.1743	0.5938	1.1743	1.0837
No log	23.3333	210	1.1522	0.5938	1.1522	1.0734
No log	23.5556	212	1.1678	0.5846	1.1678	1.0807
No log	23.7778	214	1.2400	0.5231	1.2400	1.1136
No log	24.0	216	1.2294	0.5846	1.2294	1.1088
No log	24.2222	218	1.1720	0.5846	1.1720	1.0826
No log	24.4444	220	1.1637	0.6047	1.1637	1.0787
No log	24.6667	222	1.1499	0.5827	1.1499	1.0723
No log	24.8889	224	1.1965	0.5469	1.1965	1.0939
No log	25.1111	226	1.1704	0.5827	1.1704	1.0818
No log	25.3333	228	1.1507	0.5556	1.1507	1.0727
No log	25.5556	230	1.0981	0.528	1.0981	1.0479
No log	25.7778	232	1.0846	0.528	1.0846	1.0414
No log	26.0	234	1.1056	0.5625	1.1056	1.0515
No log	26.2222	236	1.1772	0.5538	1.1772	1.0850
No log	26.4444	238	1.3338	0.5333	1.3338	1.1549
No log	26.6667	240	1.4150	0.4265	1.4150	1.1895
No log	26.8889	242	1.3167	0.4925	1.3167	1.1475
No log	27.1111	244	1.1716	0.5625	1.1716	1.0824
No log	27.3333	246	1.1354	0.5625	1.1354	1.0656
No log	27.5556	248	1.1470	0.56	1.1470	1.0710
No log	27.7778	250	1.2144	0.6094	1.2144	1.1020
No log	28.0	252	1.3260	0.4806	1.3260	1.1515
No log	28.2222	254	1.3784	0.4615	1.3784	1.1741
No log	28.4444	256	1.3656	0.4651	1.3656	1.1686
No log	28.6667	258	1.2775	0.5469	1.2775	1.1303
No log	28.8889	260	1.2245	0.5827	1.2245	1.1066
No log	29.1111	262	1.2068	0.5469	1.2068	1.0986
No log	29.3333	264	1.2698	0.5846	1.2698	1.1269
No log	29.5556	266	1.4462	0.4179	1.4462	1.2026
No log	29.7778	268	1.5477	0.3676	1.5477	1.2441
No log	30.0	270	1.4707	0.4179	1.4707	1.2127
No log	30.2222	272	1.3456	0.4651	1.3456	1.1600
No log	30.4444	274	1.2889	0.5385	1.2889	1.1353
No log	30.6667	276	1.2551	0.5920	1.2551	1.1203
No log	30.8889	278	1.2445	0.5366	1.2445	1.1156
No log	31.1111	280	1.2417	0.5366	1.2417	1.1143
No log	31.3333	282	1.2672	0.5323	1.2672	1.1257
No log	31.5556	284	1.2677	0.4921	1.2677	1.1259
No log	31.7778	286	1.2888	0.4844	1.2888	1.1352
No log	32.0	288	1.3525	0.4651	1.3525	1.1630
No log	32.2222	290	1.3505	0.4844	1.3505	1.1621
No log	32.4444	292	1.3248	0.5238	1.3248	1.1510
No log	32.6667	294	1.2994	0.4833	1.2994	1.1399
No log	32.8889	296	1.2717	0.5124	1.2717	1.1277
No log	33.1111	298	1.2570	0.5645	1.2570	1.1211
No log	33.3333	300	1.2686	0.5366	1.2686	1.1263
No log	33.5556	302	1.3123	0.5669	1.3123	1.1456
No log	33.7778	304	1.3097	0.5669	1.3097	1.1444
No log	34.0	306	1.2811	0.56	1.2811	1.1319
No log	34.2222	308	1.2337	0.4915	1.2337	1.1107
No log	34.4444	310	1.2439	0.4786	1.2439	1.1153
No log	34.6667	312	1.2540	0.5042	1.2540	1.1198
No log	34.8889	314	1.2712	0.5556	1.2712	1.1275
No log	35.1111	316	1.2549	0.5669	1.2549	1.1202
No log	35.3333	318	1.2174	0.5669	1.2174	1.1034
No log	35.5556	320	1.2240	0.5397	1.2240	1.1064
No log	35.7778	322	1.2738	0.5397	1.2738	1.1286
No log	36.0	324	1.2956	0.5397	1.2956	1.1382
No log	36.2222	326	1.2800	0.5397	1.2800	1.1314
No log	36.4444	328	1.2847	0.5039	1.2847	1.1335
No log	36.6667	330	1.3664	0.4567	1.3664	1.1689
No log	36.8889	332	1.4312	0.4567	1.4312	1.1963
No log	37.1111	334	1.3915	0.4567	1.3915	1.1796
No log	37.3333	336	1.2976	0.4762	1.2976	1.1391
No log	37.5556	338	1.2795	0.5323	1.2795	1.1312
No log	37.7778	340	1.3091	0.512	1.3091	1.1441
No log	38.0	342	1.3865	0.4688	1.3865	1.1775
No log	38.2222	344	1.4601	0.4651	1.4601	1.2083
No log	38.4444	346	1.4348	0.4651	1.4348	1.1979
No log	38.6667	348	1.3750	0.4516	1.3750	1.1726
No log	38.8889	350	1.3539	0.4793	1.3539	1.1636
No log	39.1111	352	1.3096	0.4793	1.3096	1.1444
No log	39.3333	354	1.2771	0.4793	1.2771	1.1301
No log	39.5556	356	1.2919	0.4839	1.2919	1.1366
No log	39.7778	358	1.2916	0.5238	1.2916	1.1365
No log	40.0	360	1.3291	0.4844	1.3291	1.1529
No log	40.2222	362	1.3424	0.5116	1.3424	1.1586
No log	40.4444	364	1.3439	0.4882	1.3439	1.1592
No log	40.6667	366	1.3153	0.5397	1.3153	1.1468
No log	40.8889	368	1.2896	0.5041	1.2896	1.1356
No log	41.1111	370	1.3103	0.5041	1.3103	1.1447
No log	41.3333	372	1.3192	0.4715	1.3192	1.1485
No log	41.5556	374	1.3107	0.4715	1.3107	1.1448
No log	41.7778	376	1.3384	0.5	1.3384	1.1569
No log	42.0	378	1.3571	0.5	1.3571	1.1649
No log	42.2222	380	1.3497	0.5	1.3497	1.1618
No log	42.4444	382	1.3555	0.5	1.3555	1.1643
No log	42.6667	384	1.3502	0.5082	1.3502	1.1620
No log	42.8889	386	1.3746	0.4793	1.3746	1.1724
No log	43.1111	388	1.3792	0.4793	1.3792	1.1744
No log	43.3333	390	1.4024	0.4715	1.4024	1.1842
No log	43.5556	392	1.4265	0.4839	1.4265	1.1944
No log	43.7778	394	1.4480	0.4839	1.4480	1.2033
No log	44.0	396	1.4460	0.4839	1.4460	1.2025
No log	44.2222	398	1.3993	0.4754	1.3993	1.1829
No log	44.4444	400	1.3273	0.4793	1.3273	1.1521
No log	44.6667	402	1.2915	0.5167	1.2915	1.1365
No log	44.8889	404	1.2831	0.5124	1.2831	1.1327
No log	45.1111	406	1.3042	0.5082	1.3042	1.1420
No log	45.3333	408	1.3235	0.5041	1.3235	1.1504
No log	45.5556	410	1.3730	0.4839	1.3730	1.1718
No log	45.7778	412	1.3987	0.4762	1.3987	1.1827
No log	46.0	414	1.4002	0.4480	1.4002	1.1833
No log	46.2222	416	1.3789	0.4839	1.3789	1.1743
No log	46.4444	418	1.3361	0.4754	1.3361	1.1559
No log	46.6667	420	1.2781	0.4754	1.2781	1.1305
No log	46.8889	422	1.2468	0.4754	1.2468	1.1166
No log	47.1111	424	1.2386	0.4754	1.2386	1.1129
No log	47.3333	426	1.2619	0.4754	1.2619	1.1234
No log	47.5556	428	1.3177	0.4878	1.3177	1.1479
No log	47.7778	430	1.3308	0.4878	1.3308	1.1536
No log	48.0	432	1.3222	0.4878	1.3222	1.1499
No log	48.2222	434	1.3396	0.4516	1.3396	1.1574
No log	48.4444	436	1.3032	0.4754	1.3032	1.1416
No log	48.6667	438	1.2661	0.5041	1.2661	1.1252
No log	48.8889	440	1.2620	0.5041	1.2620	1.1234
No log	49.1111	442	1.2664	0.5041	1.2664	1.1253
No log	49.3333	444	1.2694	0.5041	1.2694	1.1267
No log	49.5556	446	1.2515	0.5082	1.2515	1.1187
No log	49.7778	448	1.2059	0.5366	1.2059	1.0981
No log	50.0	450	1.2050	0.5645	1.2050	1.0977
No log	50.2222	452	1.2519	0.5323	1.2519	1.1189
No log	50.4444	454	1.3353	0.528	1.3353	1.1556
No log	50.6667	456	1.4179	0.4762	1.4179	1.1908
No log	50.8889	458	1.4298	0.4567	1.4298	1.1958
No log	51.1111	460	1.3780	0.4762	1.3780	1.1739
No log	51.3333	462	1.3116	0.5	1.3116	1.1453
No log	51.5556	464	1.2554	0.5041	1.2554	1.1204
No log	51.7778	466	1.2644	0.5	1.2644	1.1244
No log	52.0	468	1.2809	0.5	1.2809	1.1318
No log	52.2222	470	1.3264	0.4921	1.3264	1.1517
No log	52.4444	472	1.3427	0.4921	1.3427	1.1587
No log	52.6667	474	1.3783	0.4762	1.3783	1.1740
No log	52.8889	476	1.4204	0.4762	1.4204	1.1918
No log	53.1111	478	1.4548	0.4567	1.4548	1.2061
No log	53.3333	480	1.4515	0.4567	1.4515	1.2048
No log	53.5556	482	1.4433	0.4375	1.4433	1.2014
No log	53.7778	484	1.4259	0.4567	1.4259	1.1941
No log	54.0	486	1.3623	0.4715	1.3623	1.1672
No log	54.2222	488	1.3156	0.5041	1.3156	1.1470
No log	54.4444	490	1.3077	0.4793	1.3077	1.1435
No log	54.6667	492	1.3191	0.4103	1.3191	1.1485
No log	54.8889	494	1.3247	0.4068	1.3247	1.1509
No log	55.1111	496	1.3138	0.4793	1.3138	1.1462
No log	55.3333	498	1.3073	0.4754	1.3073	1.1434
0.2857	55.5556	500	1.3208	0.4715	1.3208	1.1493
0.2857	55.7778	502	1.3547	0.4480	1.3547	1.1639
0.2857	56.0	504	1.3657	0.4480	1.3657	1.1686
0.2857	56.2222	506	1.3355	0.4480	1.3355	1.1556
0.2857	56.4444	508	1.3129	0.4762	1.3129	1.1458
0.2857	56.6667	510	1.3165	0.4480	1.3165	1.1474
0.2857	56.8889	512	1.3049	0.4800	1.3049	1.1423
0.2857	57.1111	514	1.2908	0.4800	1.2908	1.1361
0.2857	57.3333	516	1.3011	0.4800	1.3011	1.1406
0.2857	57.5556	518	1.3034	0.4762	1.3034	1.1417
0.2857	57.7778	520	1.3093	0.5	1.3093	1.1442
0.2857	58.0	522	1.3117	0.5	1.3117	1.1453
0.2857	58.2222	524	1.3307	0.4640	1.3307	1.1536
0.2857	58.4444	526	1.3141	0.5	1.3141	1.1463
0.2857	58.6667	528	1.3072	0.5041	1.3072	1.1433
0.2857	58.8889	530	1.2934	0.5082	1.2934	1.1373
0.2857	59.1111	532	1.3011	0.5082	1.3011	1.1407
0.2857	59.3333	534	1.3335	0.5	1.3335	1.1548
0.2857	59.5556	536	1.3781	0.4640	1.3781	1.1739
0.2857	59.7778	538	1.3974	0.4640	1.3974	1.1821
0.2857	60.0	540	1.4210	0.4355	1.4210	1.1920
0.2857	60.2222	542	1.3984	0.4640	1.3984	1.1826
0.2857	60.4444	544	1.3629	0.4640	1.3629	1.1674

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1