ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1292
• Qwk: 0.1281
• Mse: 1.1292
• Rmse: 1.0626

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1818	2	4.8248	-0.0104	4.8248	2.1965
No log	0.3636	4	2.8603	-0.0233	2.8603	1.6912
No log	0.5455	6	1.8661	0.0169	1.8661	1.3660
No log	0.7273	8	1.5153	0.1021	1.5153	1.2310
No log	0.9091	10	1.2010	0.2300	1.2010	1.0959
No log	1.0909	12	1.4580	0.0522	1.4580	1.2075
No log	1.2727	14	1.6197	-0.0412	1.6197	1.2727
No log	1.4545	16	1.5182	-0.0321	1.5182	1.2321
No log	1.6364	18	1.3607	0.0948	1.3607	1.1665
No log	1.8182	20	1.5140	-0.0234	1.5140	1.2305
No log	2.0	22	1.6290	-0.0029	1.6290	1.2763
No log	2.1818	24	1.4574	-0.0147	1.4574	1.2072
No log	2.3636	26	1.3173	0.1423	1.3173	1.1477
No log	2.5455	28	1.3983	0.0497	1.3983	1.1825
No log	2.7273	30	1.5877	0.0362	1.5877	1.2600
No log	2.9091	32	1.5186	0.0600	1.5186	1.2323
No log	3.0909	34	1.2753	0.1584	1.2753	1.1293
No log	3.2727	36	1.1546	0.2745	1.1546	1.0745
No log	3.4545	38	1.4473	0.0513	1.4473	1.2031
No log	3.6364	40	1.7082	0.0331	1.7082	1.3070
No log	3.8182	42	1.5906	0.0656	1.5906	1.2612
No log	4.0	44	1.3154	0.1905	1.3154	1.1469
No log	4.1818	46	1.2508	0.1640	1.2508	1.1184
No log	4.3636	48	1.2706	0.1640	1.2706	1.1272
No log	4.5455	50	1.3319	0.2365	1.3319	1.1541
No log	4.7273	52	1.3576	0.2999	1.3576	1.1652
No log	4.9091	54	1.3269	0.2411	1.3269	1.1519
No log	5.0909	56	1.3230	0.2497	1.3230	1.1502
No log	5.2727	58	1.3661	0.2979	1.3661	1.1688
No log	5.4545	60	1.3852	0.2816	1.3852	1.1770
No log	5.6364	62	1.3586	0.2291	1.3586	1.1656
No log	5.8182	64	1.3795	0.2338	1.3795	1.1745
No log	6.0	66	1.3728	0.2644	1.3728	1.1717
No log	6.1818	68	1.4071	0.2638	1.4071	1.1862
No log	6.3636	70	1.5624	0.1098	1.5624	1.2500
No log	6.5455	72	1.6459	0.2468	1.6459	1.2829
No log	6.7273	74	1.5475	0.1612	1.5475	1.2440
No log	6.9091	76	1.4675	0.2424	1.4675	1.2114
No log	7.0909	78	1.4680	0.2007	1.4680	1.2116
No log	7.2727	80	1.5427	0.1097	1.5427	1.2421
No log	7.4545	82	1.8755	-0.0111	1.8755	1.3695
No log	7.6364	84	1.9363	-0.0212	1.9363	1.3915
No log	7.8182	86	1.7065	0.0631	1.7065	1.3063
No log	8.0	88	1.4613	0.2576	1.4613	1.2088
No log	8.1818	90	1.3223	0.0938	1.3223	1.1499
No log	8.3636	92	1.2706	0.1432	1.2706	1.1272
No log	8.5455	94	1.3626	0.2033	1.3626	1.1673
No log	8.7273	96	1.6024	0.2366	1.6024	1.2658
No log	8.9091	98	1.5976	0.2366	1.5976	1.2639
No log	9.0909	100	1.6150	0.2366	1.6150	1.2708
No log	9.2727	102	1.4349	0.2248	1.4349	1.1979
No log	9.4545	104	1.3576	0.2611	1.3576	1.1652
No log	9.6364	106	1.5419	0.2277	1.5419	1.2417
No log	9.8182	108	1.7851	0.1946	1.7851	1.3361
No log	10.0	110	1.8160	0.2197	1.8160	1.3476
No log	10.1818	112	1.6592	0.1919	1.6592	1.2881
No log	10.3636	114	1.5167	0.2317	1.5167	1.2315
No log	10.5455	116	1.3325	0.1907	1.3325	1.1543
No log	10.7273	118	1.2510	0.2792	1.2510	1.1185
No log	10.9091	120	1.3461	0.2163	1.3461	1.1602
No log	11.0909	122	1.5758	0.2887	1.5758	1.2553
No log	11.2727	124	1.6820	0.2564	1.6820	1.2969
No log	11.4545	126	1.5525	0.2600	1.5525	1.2460
No log	11.6364	128	1.5114	0.2847	1.5114	1.2294
No log	11.8182	130	1.4723	0.2953	1.4723	1.2134
No log	12.0	132	1.4555	0.2862	1.4555	1.2064
No log	12.1818	134	1.4903	0.2847	1.4903	1.2208
No log	12.3636	136	1.4929	0.2970	1.4929	1.2218
No log	12.5455	138	1.3896	0.2272	1.3896	1.1788
No log	12.7273	140	1.3609	0.1535	1.3609	1.1666
No log	12.9091	142	1.3010	0.1371	1.3010	1.1406
No log	13.0909	144	1.2978	0.1067	1.2978	1.1392
No log	13.2727	146	1.3664	0.1570	1.3664	1.1689
No log	13.4545	148	1.4329	0.1597	1.4329	1.1970
No log	13.6364	150	1.4149	0.1849	1.4149	1.1895
No log	13.8182	152	1.3207	0.2679	1.3207	1.1492
No log	14.0	154	1.2853	0.2679	1.2853	1.1337
No log	14.1818	156	1.3078	0.2283	1.3078	1.1436
No log	14.3636	158	1.4726	0.3182	1.4726	1.2135
No log	14.5455	160	1.7336	0.2515	1.7336	1.3167
No log	14.7273	162	1.6976	0.2515	1.6976	1.3029
No log	14.9091	164	1.4646	0.3209	1.4646	1.2102
No log	15.0909	166	1.3740	0.3438	1.3740	1.1722
No log	15.2727	168	1.3815	0.2722	1.3815	1.1754
No log	15.4545	170	1.3809	0.2478	1.3809	1.1751
No log	15.6364	172	1.3263	0.2397	1.3263	1.1517
No log	15.8182	174	1.3540	0.1899	1.3540	1.1636
No log	16.0	176	1.4247	0.1549	1.4247	1.1936
No log	16.1818	178	1.4922	0.2084	1.4922	1.2216
No log	16.3636	180	1.4738	0.1631	1.4738	1.2140
No log	16.5455	182	1.3844	0.1753	1.3844	1.1766
No log	16.7273	184	1.3565	0.1753	1.3565	1.1647
No log	16.9091	186	1.3497	0.1753	1.3497	1.1618
No log	17.0909	188	1.4576	0.2582	1.4576	1.2073
No log	17.2727	190	1.4545	0.2582	1.4545	1.2060
No log	17.4545	192	1.3999	0.2128	1.3999	1.1832
No log	17.6364	194	1.3107	0.2527	1.3107	1.1449
No log	17.8182	196	1.2312	0.1345	1.2312	1.1096
No log	18.0	198	1.2667	0.1896	1.2667	1.1255
No log	18.1818	200	1.3900	0.2704	1.3900	1.1790
No log	18.3636	202	1.3911	0.2704	1.3911	1.1794
No log	18.5455	204	1.4478	0.2964	1.4478	1.2032
No log	18.7273	206	1.4641	0.3487	1.4641	1.2100
No log	18.9091	208	1.3876	0.2833	1.3876	1.1779
No log	19.0909	210	1.2569	0.1850	1.2569	1.1211
No log	19.2727	212	1.2344	0.1500	1.2344	1.1111
No log	19.4545	214	1.2796	0.1753	1.2796	1.1312
No log	19.6364	216	1.2073	0.1500	1.2073	1.0988
No log	19.8182	218	1.2084	0.1707	1.2084	1.0993
No log	20.0	220	1.2000	0.2288	1.2000	1.0955
No log	20.1818	222	1.2200	0.2326	1.2200	1.1045
No log	20.3636	224	1.1999	0.2195	1.1999	1.0954
No log	20.5455	226	1.2708	0.1621	1.2708	1.1273
No log	20.7273	228	1.3285	0.1979	1.3285	1.1526
No log	20.9091	230	1.2606	0.1498	1.2606	1.1228
No log	21.0909	232	1.2067	0.0954	1.2067	1.0985
No log	21.2727	234	1.1829	0.1701	1.1829	1.0876
No log	21.4545	236	1.2037	0.1701	1.2037	1.0971
No log	21.6364	238	1.3092	0.1943	1.3092	1.1442
No log	21.8182	240	1.4155	0.2359	1.4155	1.1897
No log	22.0	242	1.4732	0.3404	1.4732	1.2138
No log	22.1818	244	1.4177	0.2911	1.4177	1.1907
No log	22.3636	246	1.2950	0.2403	1.2950	1.1380
No log	22.5455	248	1.2033	0.1701	1.2033	1.0969
No log	22.7273	250	1.1438	0.1919	1.1438	1.0695
No log	22.9091	252	1.1404	0.1379	1.1404	1.0679
No log	23.0909	254	1.1783	0.1379	1.1783	1.0855
No log	23.2727	256	1.2026	0.1379	1.2026	1.0966
No log	23.4545	258	1.2235	0.1379	1.2235	1.1061
No log	23.6364	260	1.2404	0.1379	1.2404	1.1137
No log	23.8182	262	1.2038	0.1853	1.2038	1.0972
No log	24.0	264	1.1429	0.2019	1.1429	1.0691
No log	24.1818	266	1.1386	0.2317	1.1386	1.0671
No log	24.3636	268	1.2033	0.2978	1.2033	1.0970
No log	24.5455	270	1.3363	0.3025	1.3363	1.1560
No log	24.7273	272	1.3432	0.3429	1.3432	1.1590
No log	24.9091	274	1.2301	0.2041	1.2301	1.1091
No log	25.0909	276	1.1434	0.2119	1.1434	1.0693
No log	25.2727	278	1.1546	0.2009	1.1546	1.0745
No log	25.4545	280	1.2066	0.1951	1.2066	1.0984
No log	25.6364	282	1.1678	0.2100	1.1678	1.0807
No log	25.8182	284	1.1069	0.2019	1.1069	1.0521
No log	26.0	286	1.0942	0.1605	1.0942	1.0461
No log	26.1818	288	1.1021	0.1605	1.1021	1.0498
No log	26.3636	290	1.1516	0.2100	1.1516	1.0731
No log	26.5455	292	1.1836	0.2056	1.1836	1.0879
No log	26.7273	294	1.1741	0.1379	1.1741	1.0836
No log	26.9091	296	1.1882	0.1214	1.1882	1.0900
No log	27.0909	298	1.1833	0.1379	1.1833	1.0878
No log	27.2727	300	1.2131	0.1951	1.2131	1.1014
No log	27.4545	302	1.2599	0.1405	1.2599	1.1224
No log	27.6364	304	1.2530	0.1405	1.2530	1.1194
No log	27.8182	306	1.2457	0.1557	1.2457	1.1161
No log	28.0	308	1.2493	0.1557	1.2493	1.1177
No log	28.1818	310	1.2100	0.2100	1.2100	1.1000
No log	28.3636	312	1.1884	0.2056	1.1884	1.0901
No log	28.5455	314	1.1996	0.2056	1.1996	1.0953
No log	28.7273	316	1.2880	0.1943	1.2880	1.1349
No log	28.9091	318	1.4048	0.3435	1.4048	1.1852
No log	29.0909	320	1.4698	0.3238	1.4698	1.2124
No log	29.2727	322	1.3938	0.2884	1.3938	1.1806
No log	29.4545	324	1.2753	0.1477	1.2753	1.1293
No log	29.6364	326	1.2061	0.1118	1.2061	1.0982
No log	29.8182	328	1.1673	0.1701	1.1673	1.0804
No log	30.0	330	1.1750	0.1701	1.1750	1.0840
No log	30.1818	332	1.2014	0.1599	1.2014	1.0961
No log	30.3636	334	1.2190	0.1441	1.2190	1.1041
No log	30.5455	336	1.2250	0.1599	1.2250	1.1068
No log	30.7273	338	1.2339	0.1599	1.2339	1.1108
No log	30.9091	340	1.2291	0.1599	1.2291	1.1086
No log	31.0909	342	1.2736	0.1997	1.2736	1.1285
No log	31.2727	344	1.3199	0.1943	1.3199	1.1489
No log	31.4545	346	1.2878	0.1707	1.2878	1.1348
No log	31.6364	348	1.2536	0.1599	1.2536	1.1196
No log	31.8182	350	1.2851	0.1118	1.2851	1.1336
No log	32.0	352	1.3270	0.1441	1.3270	1.1520
No log	32.1818	354	1.3332	0.1282	1.3332	1.1546
No log	32.3636	356	1.3169	0.1441	1.3169	1.1476
No log	32.5455	358	1.2665	0.1118	1.2665	1.1254
No log	32.7273	360	1.2048	0.0948	1.2048	1.0976
No log	32.9091	362	1.1825	0.1279	1.1825	1.0874
No log	33.0909	364	1.2010	0.1379	1.2010	1.0959
No log	33.2727	366	1.2412	0.1344	1.2412	1.1141
No log	33.4545	368	1.2827	0.1500	1.2827	1.1325
No log	33.6364	370	1.2635	0.1654	1.2635	1.1240
No log	33.8182	372	1.2169	0.1911	1.2169	1.1031
No log	34.0	374	1.1979	0.1602	1.1979	1.0945
No log	34.1818	376	1.1999	0.1281	1.1999	1.0954
No log	34.3636	378	1.2444	0.1345	1.2444	1.1155
No log	34.5455	380	1.3337	0.2736	1.3337	1.1549
No log	34.7273	382	1.3597	0.3026	1.3597	1.1660
No log	34.9091	384	1.3073	0.2807	1.3073	1.1434
No log	35.0909	386	1.2423	0.2313	1.2423	1.1146
No log	35.2727	388	1.1897	0.1951	1.1897	1.0907
No log	35.4545	390	1.2090	0.1997	1.2090	1.0996
No log	35.6364	392	1.2364	0.2772	1.2364	1.1119
No log	35.8182	394	1.1844	0.1654	1.1844	1.0883
No log	36.0	396	1.1608	0.1344	1.1608	1.0774
No log	36.1818	398	1.2017	0.1596	1.2017	1.0962
No log	36.3636	400	1.2438	0.1840	1.2438	1.1153
No log	36.5455	402	1.2010	0.1026	1.2010	1.0959
No log	36.7273	404	1.1323	0.1281	1.1323	1.0641
No log	36.9091	406	1.1133	0.1761	1.1133	1.0551
No log	37.0909	408	1.1104	0.2076	1.1104	1.0538
No log	37.2727	410	1.1495	0.1442	1.1495	1.0722
No log	37.4545	412	1.2420	0.1650	1.2420	1.1144
No log	37.6364	414	1.3290	0.2815	1.3290	1.1528
No log	37.8182	416	1.3238	0.2941	1.3238	1.1506
No log	38.0	418	1.2572	0.1943	1.2572	1.1212
No log	38.1818	420	1.1688	0.2100	1.1688	1.0811
No log	38.3636	422	1.1364	0.2273	1.1364	1.0660
No log	38.5455	424	1.1367	0.2371	1.1367	1.0661
No log	38.7273	426	1.1801	0.2236	1.1801	1.0863
No log	38.9091	428	1.2866	0.2807	1.2866	1.1343
No log	39.0909	430	1.3565	0.3047	1.3565	1.1647
No log	39.2727	432	1.4214	0.2536	1.4214	1.1922
No log	39.4545	434	1.4145	0.2536	1.4145	1.1893
No log	39.6364	436	1.3200	0.3299	1.3200	1.1489
No log	39.8182	438	1.2039	0.1118	1.2039	1.0972
No log	40.0	440	1.1348	0.1602	1.1348	1.0653
No log	40.1818	442	1.1145	0.1343	1.1145	1.0557
No log	40.3636	444	1.1258	0.1504	1.1258	1.0610
No log	40.5455	446	1.1786	0.1183	1.1786	1.0856
No log	40.7273	448	1.2956	0.2980	1.2956	1.1382
No log	40.9091	450	1.4313	0.3339	1.4313	1.1964
No log	41.0909	452	1.5376	0.3331	1.5376	1.2400
No log	41.2727	454	1.5576	0.3345	1.5576	1.2480
No log	41.4545	456	1.4642	0.3331	1.4642	1.2100
No log	41.6364	458	1.3004	0.3155	1.3004	1.1404
No log	41.8182	460	1.1924	0.1441	1.1924	1.0920
No log	42.0	462	1.1320	0.1085	1.1320	1.0639
No log	42.1818	464	1.1163	0.1343	1.1163	1.0565
No log	42.3636	466	1.1216	0.1343	1.1216	1.0591
No log	42.5455	468	1.1509	0.0948	1.1509	1.0728
No log	42.7273	470	1.2101	0.1118	1.2101	1.1000
No log	42.9091	472	1.2927	0.2494	1.2927	1.1370
No log	43.0909	474	1.3790	0.2959	1.3790	1.1743
No log	43.2727	476	1.4463	0.3005	1.4463	1.2026
No log	43.4545	478	1.4372	0.3026	1.4372	1.1988
No log	43.6364	480	1.3517	0.3025	1.3517	1.1626
No log	43.8182	482	1.2679	0.3155	1.2679	1.1260
No log	44.0	484	1.2119	0.3357	1.2119	1.1009
No log	44.1818	486	1.2169	0.3341	1.2169	1.1031
No log	44.3636	488	1.2520	0.3094	1.2520	1.1189
No log	44.5455	490	1.2666	0.2889	1.2666	1.1254
No log	44.7273	492	1.2944	0.2586	1.2944	1.1377
No log	44.9091	494	1.2921	0.2586	1.2921	1.1367
No log	45.0909	496	1.2789	0.2317	1.2789	1.1309
No log	45.2727	498	1.2306	0.2570	1.2306	1.1093
0.2686	45.4545	500	1.1985	0.2570	1.1985	1.0948
0.2686	45.6364	502	1.1764	0.2046	1.1764	1.0846
0.2686	45.8182	504	1.1634	0.2330	1.1634	1.0786
0.2686	46.0	506	1.1402	0.1951	1.1402	1.0678
0.2686	46.1818	508	1.1234	0.1344	1.1234	1.0599
0.2686	46.3636	510	1.1292	0.1281	1.1292	1.0626

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1