ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1589
• Qwk: 0.1281
• Mse: 1.1589
• Rmse: 1.0765

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0278	2	4.5152	-0.0132	4.5152	2.1249
No log	0.0556	4	2.6560	0.0025	2.6560	1.6297
No log	0.0833	6	2.1715	-0.0370	2.1715	1.4736
No log	0.1111	8	1.4646	0.0157	1.4646	1.2102
No log	0.1389	10	1.2291	0.1144	1.2291	1.1086
No log	0.1667	12	1.2513	0.0700	1.2513	1.1186
No log	0.1944	14	1.2756	0.2142	1.2756	1.1294
No log	0.2222	16	1.5335	-0.0984	1.5335	1.2383
No log	0.25	18	1.5100	-0.0733	1.5100	1.2288
No log	0.2778	20	1.3703	0.0750	1.3703	1.1706
No log	0.3056	22	1.3384	0.0974	1.3384	1.1569
No log	0.3333	24	1.3725	0.0527	1.3725	1.1716
No log	0.3611	26	1.3833	0.0353	1.3833	1.1762
No log	0.3889	28	1.3051	0.0527	1.3051	1.1424
No log	0.4167	30	1.2217	0.0700	1.2217	1.1053
No log	0.4444	32	1.2316	0.0472	1.2316	1.1098
No log	0.4722	34	1.2590	0.0184	1.2590	1.1221
No log	0.5	36	1.3060	0.0831	1.3060	1.1428
No log	0.5278	38	1.2761	0.1168	1.2761	1.1296
No log	0.5556	40	1.2001	0.2010	1.2001	1.0955
No log	0.5833	42	1.1951	0.1793	1.1951	1.0932
No log	0.6111	44	1.1825	0.2416	1.1825	1.0874
No log	0.6389	46	1.1842	0.2781	1.1842	1.0882
No log	0.6667	48	1.1435	0.2455	1.1435	1.0694
No log	0.6944	50	1.2542	0.0509	1.2542	1.1199
No log	0.7222	52	1.3836	0.2366	1.3836	1.1763
No log	0.75	54	1.4500	0.2278	1.4500	1.2042
No log	0.7778	56	1.1220	0.2482	1.1220	1.0593
No log	0.8056	58	1.0029	0.2731	1.0029	1.0015
No log	0.8333	60	1.0806	0.2053	1.0806	1.0395
No log	0.8611	62	1.2004	0.0613	1.2004	1.0956
No log	0.8889	64	1.2659	0.0277	1.2659	1.1251
No log	0.9167	66	1.0420	0.2314	1.0420	1.0208
No log	0.9444	68	1.0203	0.2678	1.0203	1.0101
No log	0.9722	70	1.1057	0.1827	1.1057	1.0515
No log	1.0	72	1.4097	0.1823	1.4097	1.1873
No log	1.0278	74	1.2399	0.2679	1.2399	1.1135
No log	1.0556	76	1.1572	0.2491	1.1572	1.0757
No log	1.0833	78	1.1139	0.3043	1.1139	1.0554
No log	1.1111	80	1.1232	0.3659	1.1232	1.0598
No log	1.1389	82	1.1377	0.3168	1.1377	1.0666
No log	1.1667	84	1.5086	0.2878	1.5086	1.2283
No log	1.1944	86	1.7054	0.1924	1.7054	1.3059
No log	1.2222	88	1.4722	0.3100	1.4722	1.2133
No log	1.25	90	1.1537	0.3410	1.1537	1.0741
No log	1.2778	92	1.3177	0.3490	1.3177	1.1479
No log	1.3056	94	1.4148	0.2700	1.4148	1.1894
No log	1.3333	96	1.2488	0.2683	1.2488	1.1175
No log	1.3611	98	1.1448	0.3635	1.1448	1.0699
No log	1.3889	100	1.3786	0.2314	1.3786	1.1742
No log	1.4167	102	1.5107	0.3132	1.5107	1.2291
No log	1.4444	104	1.3492	0.2546	1.3492	1.1615
No log	1.4722	106	1.1537	0.3348	1.1537	1.0741
No log	1.5	108	1.0703	0.4491	1.0703	1.0346
No log	1.5278	110	1.0385	0.4659	1.0385	1.0191
No log	1.5556	112	1.1328	0.3416	1.1328	1.0643
No log	1.5833	114	1.2821	0.4387	1.2821	1.1323
No log	1.6111	116	1.2800	0.4387	1.2800	1.1314
No log	1.6389	118	1.1236	0.3318	1.1236	1.0600
No log	1.6667	120	1.1283	0.2716	1.1283	1.0622
No log	1.6944	122	1.3137	0.2983	1.3137	1.1462
No log	1.7222	124	1.3376	0.3192	1.3376	1.1565
No log	1.75	126	1.3873	0.3210	1.3873	1.1778
No log	1.7778	128	1.2152	0.3021	1.2152	1.1024
No log	1.8056	130	1.2219	0.1753	1.2219	1.1054
No log	1.8333	132	1.2687	0.2222	1.2687	1.1264
No log	1.8611	134	1.2052	0.2411	1.2052	1.0978
No log	1.8889	136	1.2728	0.4200	1.2728	1.1282
No log	1.9167	138	1.5437	0.2804	1.5437	1.2424
No log	1.9444	140	1.7204	0.3042	1.7204	1.3116
No log	1.9722	142	1.5347	0.2902	1.5347	1.2388
No log	2.0	144	1.1758	0.3220	1.1758	1.0843
No log	2.0278	146	1.0103	0.3263	1.0103	1.0051
No log	2.0556	148	1.0078	0.3263	1.0078	1.0039
No log	2.0833	150	1.1528	0.2143	1.1528	1.0737
No log	2.1111	152	1.2229	0.2799	1.2229	1.1059
No log	2.1389	154	1.1513	0.1707	1.1513	1.0730
No log	2.1667	156	1.1984	0.2236	1.1984	1.0947
No log	2.1944	158	1.2760	0.3357	1.2760	1.1296
No log	2.2222	160	1.3255	0.3357	1.3255	1.1513
No log	2.25	162	1.2441	0.3267	1.2441	1.1154
No log	2.2778	164	1.1176	0.2973	1.1176	1.0571
No log	2.3056	166	1.1752	0.2955	1.1752	1.0841
No log	2.3333	168	1.2884	0.3003	1.2884	1.1351
No log	2.3611	170	1.3076	0.2605	1.3076	1.1435
No log	2.3889	172	1.2311	0.1063	1.2311	1.1095
No log	2.4167	174	1.1429	0.1605	1.1429	1.0691
No log	2.4444	176	1.1499	0.1015	1.1499	1.0723
No log	2.4722	178	1.2214	0.0664	1.2214	1.1052
No log	2.5	180	1.2274	0.0994	1.2274	1.1079
No log	2.5278	182	1.2003	0.1465	1.2003	1.0956
No log	2.5556	184	1.1740	0.2772	1.1740	1.0835
No log	2.5833	186	1.2647	0.2723	1.2647	1.1246
No log	2.6111	188	1.5159	0.3377	1.5159	1.2312
No log	2.6389	190	1.6498	0.2127	1.6498	1.2844
No log	2.6667	192	1.3813	0.3623	1.3813	1.1753
No log	2.6944	194	1.1632	0.3505	1.1632	1.0785
No log	2.7222	196	1.0901	0.2508	1.0901	1.0441
No log	2.75	198	1.0821	0.2508	1.0821	1.0402
No log	2.7778	200	1.1236	0.1058	1.1236	1.0600
No log	2.8056	202	1.1938	0.1614	1.1938	1.0926
No log	2.8333	204	1.1919	0.1614	1.1919	1.0918
No log	2.8611	206	1.0853	0.1621	1.0853	1.0418
No log	2.8889	208	1.0239	0.2556	1.0239	1.0119
No log	2.9167	210	0.9977	0.3119	0.9977	0.9988
No log	2.9444	212	0.9944	0.3119	0.9944	0.9972
No log	2.9722	214	1.0437	0.2440	1.0437	1.0216
No log	3.0	216	1.2393	0.1707	1.2393	1.1132
No log	3.0278	218	1.3596	0.2367	1.3596	1.1660
No log	3.0556	220	1.3203	0.2403	1.3203	1.1490
No log	3.0833	222	1.2059	0.3182	1.2059	1.0981
No log	3.1111	224	1.1375	0.3343	1.1375	1.0665
No log	3.1389	226	1.2041	0.3162	1.2041	1.0973
No log	3.1667	228	1.3616	0.1986	1.3616	1.1669
No log	3.1944	230	1.4149	0.2250	1.4149	1.1895
No log	3.2222	232	1.3327	0.1557	1.3327	1.1544
No log	3.25	234	1.2321	0.1153	1.2321	1.1100
No log	3.2778	236	1.2055	0.1015	1.2055	1.0980
No log	3.3056	238	1.2404	0.0513	1.2404	1.1137
No log	3.3333	240	1.3030	0.0430	1.3030	1.1415
No log	3.3611	242	1.3418	0.0769	1.3418	1.1584
No log	3.3889	244	1.2791	0.1707	1.2791	1.1310
No log	3.4167	246	1.1565	0.2331	1.1565	1.0754
No log	3.4444	248	1.1973	0.3046	1.1973	1.0942
No log	3.4722	250	1.3635	0.2450	1.3635	1.1677
No log	3.5	252	1.5347	0.3404	1.5347	1.2388
No log	3.5278	254	1.4929	0.3160	1.4929	1.2219
No log	3.5556	256	1.3817	0.1986	1.3817	1.1754
No log	3.5833	258	1.2389	0.1443	1.2389	1.1131
No log	3.6111	260	1.1387	0.1927	1.1387	1.0671
No log	3.6389	262	1.1351	0.1927	1.1351	1.0654
No log	3.6667	264	1.1439	0.1927	1.1439	1.0695
No log	3.6944	266	1.2018	0.1015	1.2018	1.0962
No log	3.7222	268	1.2646	0.1282	1.2646	1.1246
No log	3.75	270	1.3052	0.2403	1.3052	1.1425
No log	3.7778	272	1.2983	0.3474	1.2983	1.1394
No log	3.8056	274	1.2510	0.2668	1.2510	1.1185
No log	3.8333	276	1.2159	0.2998	1.2159	1.1027
No log	3.8611	278	1.2019	0.2522	1.2019	1.0963
No log	3.8889	280	1.2199	0.2522	1.2199	1.1045
No log	3.9167	282	1.2709	0.2395	1.2709	1.1274
No log	3.9444	284	1.3151	0.1650	1.3151	1.1468
No log	3.9722	286	1.3393	0.1094	1.3393	1.1573
No log	4.0	288	1.3482	0.1188	1.3482	1.1611
No log	4.0278	290	1.3773	0.1188	1.3773	1.1736
No log	4.0556	292	1.3788	0.0769	1.3788	1.1742
No log	4.0833	294	1.3893	0.1094	1.3893	1.1787
No log	4.1111	296	1.4523	0.1570	1.4523	1.2051
No log	4.1389	298	1.5110	0.1935	1.5110	1.2292
No log	4.1667	300	1.4675	0.1282	1.4675	1.2114
No log	4.1944	302	1.3572	0.1405	1.3572	1.1650
No log	4.2222	304	1.2823	0.0849	1.2823	1.1324
No log	4.25	306	1.2779	0.0849	1.2779	1.1304
No log	4.2778	308	1.2943	0.1696	1.2943	1.1377
No log	4.3056	310	1.3441	0.1159	1.3441	1.1594
No log	4.3333	312	1.4214	0.1935	1.4214	1.1922
No log	4.3611	314	1.3507	0.2349	1.3507	1.1622
No log	4.3889	316	1.3459	0.1801	1.3459	1.1601
No log	4.4167	318	1.3636	0.2844	1.3636	1.1677
No log	4.4444	320	1.3342	0.2354	1.3342	1.1551
No log	4.4722	322	1.2666	0.1094	1.2666	1.1254
No log	4.5	324	1.2211	0.1405	1.2211	1.1051
No log	4.5278	326	1.1690	0.1717	1.1690	1.0812
No log	4.5556	328	1.1895	0.1465	1.1895	1.0906
No log	4.5833	330	1.2938	0.1898	1.2938	1.1375
No log	4.6111	332	1.4967	0.3392	1.4967	1.2234
No log	4.6389	334	1.5790	0.3431	1.5790	1.2566
No log	4.6667	336	1.4713	0.3405	1.4713	1.2130
No log	4.6944	338	1.2311	0.2934	1.2311	1.1095
No log	4.7222	340	1.0723	0.2574	1.0723	1.0355
No log	4.75	342	1.0479	0.3089	1.0479	1.0237
No log	4.7778	344	1.0500	0.2970	1.0500	1.0247
No log	4.8056	346	1.1069	0.2154	1.1069	1.0521
No log	4.8333	348	1.2150	0.2460	1.2150	1.1023
No log	4.8611	350	1.2957	0.2553	1.2957	1.1383
No log	4.8889	352	1.2772	0.2037	1.2772	1.1301
No log	4.9167	354	1.2126	0.1188	1.2126	1.1012
No log	4.9444	356	1.1414	0.0954	1.1414	1.0684
No log	4.9722	358	1.0957	0.1281	1.0957	1.0468
No log	5.0	360	1.0613	0.1281	1.0613	1.0302
No log	5.0278	362	1.0764	0.2357	1.0764	1.0375
No log	5.0556	364	1.1736	0.3734	1.1736	1.0833
No log	5.0833	366	1.3614	0.3213	1.3614	1.1668
No log	5.1111	368	1.4975	0.3455	1.4975	1.2237
No log	5.1389	370	1.4742	0.2886	1.4742	1.2142
No log	5.1667	372	1.3235	0.3574	1.3235	1.1504
No log	5.1944	374	1.1485	0.1599	1.1485	1.0717
No log	5.2222	376	1.0866	0.1281	1.0866	1.0424
No log	5.25	378	1.0631	0.1442	1.0631	1.0311
No log	5.2778	380	1.0566	0.1755	1.0566	1.0279
No log	5.3056	382	1.0829	0.2953	1.0829	1.0406
No log	5.3333	384	1.0999	0.3474	1.0999	1.0488
No log	5.3611	386	1.1300	0.3718	1.1300	1.0630
No log	5.3889	388	1.1415	0.3718	1.1415	1.0684
No log	5.4167	390	1.1455	0.3474	1.1455	1.0703
No log	5.4444	392	1.1742	0.2837	1.1742	1.0836
No log	5.4722	394	1.1734	0.3049	1.1734	1.0832
No log	5.5	396	1.1723	0.2743	1.1723	1.0827
No log	5.5278	398	1.1549	0.3001	1.1549	1.0747
No log	5.5556	400	1.1101	0.3182	1.1101	1.0536
No log	5.5833	402	1.0637	0.4031	1.0637	1.0313
No log	5.6111	404	1.0535	0.3421	1.0535	1.0264
No log	5.6389	406	1.1178	0.3394	1.1178	1.0573
No log	5.6667	408	1.2235	0.2046	1.2235	1.1061
No log	5.6944	410	1.2121	0.1148	1.2121	1.1009
No log	5.7222	412	1.1415	0.0974	1.1415	1.0684
No log	5.75	414	1.1010	0.1042	1.1010	1.0493
No log	5.7778	416	1.0648	0.1482	1.0648	1.0319
No log	5.8056	418	1.0372	0.1482	1.0372	1.0185
No log	5.8333	420	1.0578	0.1543	1.0578	1.0285
No log	5.8611	422	1.1728	0.3146	1.1728	1.0829
No log	5.8889	424	1.2666	0.3207	1.2666	1.1254
No log	5.9167	426	1.3779	0.3500	1.3779	1.1738
No log	5.9444	428	1.3579	0.3723	1.3579	1.1653
No log	5.9722	430	1.2295	0.3372	1.2295	1.1088
No log	6.0	432	1.1813	0.3178	1.1813	1.0869
No log	6.0278	434	1.1832	0.3341	1.1832	1.0878
No log	6.0556	436	1.2618	0.3207	1.2618	1.1233
No log	6.0833	438	1.3730	0.3679	1.3730	1.1717
No log	6.1111	440	1.3692	0.3093	1.3692	1.1701
No log	6.1389	442	1.2579	0.3146	1.2579	1.1216
No log	6.1667	444	1.0595	0.1442	1.0595	1.0293
No log	6.1944	446	0.9642	0.2244	0.9642	0.9819
No log	6.2222	448	0.9627	0.2244	0.9627	0.9812
No log	6.25	450	1.0285	0.1442	1.0285	1.0142
No log	6.2778	452	1.1895	0.3049	1.1895	1.0906
No log	6.3056	454	1.3161	0.3071	1.3161	1.1472
No log	6.3333	456	1.3258	0.3316	1.3258	1.1514
No log	6.3611	458	1.2595	0.2837	1.2595	1.1223
No log	6.3889	460	1.1515	0.2056	1.1515	1.0731
No log	6.4167	462	1.1205	0.1442	1.1205	1.0586
No log	6.4444	464	1.1267	0.1114	1.1267	1.0614
No log	6.4722	466	1.1309	0.1042	1.1309	1.0634
No log	6.5	468	1.1563	0.0948	1.1563	1.0753
No log	6.5278	470	1.1983	0.1379	1.1983	1.0947
No log	6.5556	472	1.1927	0.2953	1.1927	1.0921
No log	6.5833	474	1.0663	0.1911	1.0663	1.0326
No log	6.6111	476	0.9720	0.2522	0.9720	0.9859
No log	6.6389	478	0.9460	0.2944	0.9460	0.9726
No log	6.6667	480	0.9916	0.2121	0.9916	0.9958
No log	6.6944	482	1.2100	0.3474	1.2100	1.1000
No log	6.7222	484	1.4154	0.3449	1.4154	1.1897
No log	6.75	486	1.4244	0.2959	1.4244	1.1935
No log	6.7778	488	1.3132	0.2837	1.3132	1.1460
No log	6.8056	490	1.1789	0.1599	1.1789	1.0858
No log	6.8333	492	1.0481	0.1605	1.0481	1.0238
No log	6.8611	494	0.9799	0.2244	0.9799	0.9899
No log	6.8889	496	0.9895	0.2539	0.9895	0.9948
No log	6.9167	498	1.0647	0.1504	1.0647	1.0318
0.3697	6.9444	500	1.2069	0.2743	1.2069	1.0986
0.3697	6.9722	502	1.3541	0.3341	1.3541	1.1637
0.3697	7.0	504	1.3825	0.3601	1.3825	1.1758
0.3697	7.0278	506	1.2835	0.3094	1.2835	1.1329
0.3697	7.0556	508	1.1804	0.2683	1.1804	1.0865
0.3697	7.0833	510	1.0824	0.1658	1.0824	1.0404
0.3697	7.1111	512	1.0492	0.1927	1.0492	1.0243
0.3697	7.1389	514	1.0711	0.1767	1.0711	1.0349
0.3697	7.1667	516	1.1589	0.1281	1.1589	1.0765

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1