ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3223
• Qwk: 0.2074
• Mse: 1.3223
• Rmse: 1.1499

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	4.6995	0.0010	4.6995	2.1678
No log	0.1905	4	2.8065	0.0248	2.8065	1.6753
No log	0.2857	6	2.3938	-0.0346	2.3938	1.5472
No log	0.3810	8	1.6293	-0.0277	1.6293	1.2765
No log	0.4762	10	1.2569	0.0132	1.2569	1.1211
No log	0.5714	12	1.2056	0.1689	1.2056	1.0980
No log	0.6667	14	1.3081	0.0628	1.3081	1.1437
No log	0.7619	16	1.5335	-0.1138	1.5335	1.2383
No log	0.8571	18	1.8269	-0.2291	1.8269	1.3516
No log	0.9524	20	2.3884	-0.3747	2.3884	1.5454
No log	1.0476	22	2.0172	-0.2449	2.0172	1.4203
No log	1.1429	24	1.6638	-0.1299	1.6638	1.2899
No log	1.2381	26	1.6735	-0.1299	1.6735	1.2936
No log	1.3333	28	1.9883	-0.2116	1.9883	1.4101
No log	1.4286	30	2.0427	-0.2512	2.0427	1.4292
No log	1.5238	32	1.4547	-0.0085	1.4547	1.2061
No log	1.6190	34	1.2458	0.1379	1.2458	1.1162
No log	1.7143	36	1.2572	0.1211	1.2572	1.1212
No log	1.8095	38	1.3139	0.0802	1.3139	1.1463
No log	1.9048	40	1.3286	0.0427	1.3286	1.1527
No log	2.0	42	1.3537	0.0353	1.3537	1.1635
No log	2.0952	44	1.3273	0.0454	1.3273	1.1521
No log	2.1905	46	1.2458	0.0880	1.2458	1.1162
No log	2.2857	48	1.2338	0.1207	1.2338	1.1108
No log	2.3810	50	1.2727	0.1601	1.2727	1.1281
No log	2.4762	52	1.2383	0.1791	1.2383	1.1128
No log	2.5714	54	1.2027	0.2043	1.2027	1.0967
No log	2.6667	56	1.2183	0.1532	1.2183	1.1037
No log	2.7619	58	1.2463	0.1232	1.2463	1.1164
No log	2.8571	60	1.2877	0.1354	1.2877	1.1348
No log	2.9524	62	1.3436	0.1715	1.3436	1.1591
No log	3.0476	64	1.3903	0.0776	1.3903	1.1791
No log	3.1429	66	1.3746	0.0865	1.3746	1.1724
No log	3.2381	68	1.2503	0.1696	1.2503	1.1182
No log	3.3333	70	1.2324	0.2019	1.2324	1.1102
No log	3.4286	72	1.4347	0.1481	1.4347	1.1978
No log	3.5238	74	1.5725	0.1515	1.5725	1.2540
No log	3.6190	76	1.4299	0.1254	1.4299	1.1958
No log	3.7143	78	1.1933	0.1090	1.1933	1.0924
No log	3.8095	80	1.1145	0.2592	1.1145	1.0557
No log	3.9048	82	1.1080	0.2440	1.1080	1.0526
No log	4.0	84	1.2551	0.0951	1.2551	1.1203
No log	4.0952	86	1.3864	0.0153	1.3864	1.1775
No log	4.1905	88	1.3886	0.0080	1.3886	1.1784
No log	4.2857	90	1.3431	0.1101	1.3431	1.1589
No log	4.3810	92	1.3240	0.2934	1.3240	1.1507
No log	4.4762	94	1.4824	0.2635	1.4824	1.2175
No log	4.5714	96	1.6143	0.2540	1.6143	1.2706
No log	4.6667	98	1.5167	0.1195	1.5167	1.2315
No log	4.7619	100	1.3443	0.1648	1.3443	1.1594
No log	4.8571	102	1.1658	0.2241	1.1658	1.0797
No log	4.9524	104	1.0858	0.2647	1.0858	1.0420
No log	5.0476	106	1.1598	0.2134	1.1598	1.0769
No log	5.1429	108	1.2762	0.0911	1.2762	1.1297
No log	5.2381	110	1.3856	0.0441	1.3856	1.1771
No log	5.3333	112	1.4319	0.0110	1.4319	1.1966
No log	5.4286	114	1.3677	0.0750	1.3677	1.1695
No log	5.5238	116	1.2522	0.1997	1.2522	1.1190
No log	5.6190	118	1.4058	0.3277	1.4058	1.1857
No log	5.7143	120	1.5968	0.2272	1.5968	1.2636
No log	5.8095	122	1.7439	0.1987	1.7439	1.3206
No log	5.9048	124	1.6179	0.2435	1.6179	1.2720
No log	6.0	126	1.3024	0.2767	1.3024	1.1412
No log	6.0952	128	1.1825	0.2810	1.1825	1.0874
No log	6.1905	130	1.1813	0.2357	1.1813	1.0869
No log	6.2857	132	1.2387	0.2619	1.2387	1.1130
No log	6.3810	134	1.2792	0.1903	1.2792	1.1310
No log	6.4762	136	1.2990	0.2509	1.2990	1.1397
No log	6.5714	138	1.2370	0.3089	1.2370	1.1122
No log	6.6667	140	1.2605	0.2870	1.2605	1.1227
No log	6.7619	142	1.2768	0.2495	1.2768	1.1300
No log	6.8571	144	1.4978	0.2612	1.4978	1.2239
No log	6.9524	146	1.8589	0.1720	1.8589	1.3634
No log	7.0476	148	1.8645	0.1720	1.8645	1.3655
No log	7.1429	150	1.6645	0.2132	1.6645	1.2901
No log	7.2381	152	1.3606	0.3243	1.3606	1.1665
No log	7.3333	154	1.1940	0.2650	1.1940	1.0927
No log	7.4286	156	1.2375	0.2978	1.2375	1.1124
No log	7.5238	158	1.2931	0.2772	1.2931	1.1371
No log	7.6190	160	1.4231	0.2964	1.4231	1.1929
No log	7.7143	162	1.5092	0.1851	1.5092	1.2285
No log	7.8095	164	1.5018	0.1935	1.5018	1.2255
No log	7.9048	166	1.4106	0.2457	1.4106	1.1877
No log	8.0	168	1.3494	0.2664	1.3494	1.1616
No log	8.0952	170	1.3265	0.2313	1.3265	1.1518
No log	8.1905	172	1.2438	0.1905	1.2438	1.1153
No log	8.2857	174	1.2396	0.2339	1.2396	1.1134
No log	8.3810	176	1.1712	0.2339	1.1712	1.0822
No log	8.4762	178	1.2273	0.2288	1.2273	1.1078
No log	8.5714	180	1.4454	0.2457	1.4454	1.2022
No log	8.6667	182	1.5751	0.2272	1.5751	1.2550
No log	8.7619	184	1.5422	0.2555	1.5422	1.2418
No log	8.8571	186	1.6549	0.2179	1.6549	1.2864
No log	8.9524	188	1.6581	0.1997	1.6581	1.2877
No log	9.0476	190	1.5604	0.2343	1.5604	1.2492
No log	9.1429	192	1.4686	0.2457	1.4686	1.2119
No log	9.2381	194	1.3785	0.1441	1.3785	1.1741
No log	9.3333	196	1.3712	0.1538	1.3712	1.1710
No log	9.4286	198	1.4623	0.2309	1.4623	1.2092
No log	9.5238	200	1.5225	0.2550	1.5225	1.2339
No log	9.6190	202	1.4387	0.3523	1.4387	1.1995
No log	9.7143	204	1.3867	0.3429	1.3867	1.1776
No log	9.8095	206	1.3358	0.2747	1.3358	1.1558
No log	9.9048	208	1.4552	0.3805	1.4552	1.2063
No log	10.0	210	1.5759	0.3478	1.5759	1.2553
No log	10.0952	212	1.6847	0.2564	1.6847	1.2980
No log	10.1905	214	1.7143	0.2278	1.7143	1.3093
No log	10.2857	216	1.6331	0.3157	1.6331	1.2779
No log	10.3810	218	1.4349	0.3615	1.4349	1.1979
No log	10.4762	220	1.4167	0.3405	1.4167	1.1903
No log	10.5714	222	1.4827	0.3026	1.4827	1.2177
No log	10.6667	224	1.6611	0.2407	1.6611	1.2888
No log	10.7619	226	1.7204	0.2620	1.7204	1.3116
No log	10.8571	228	1.7127	0.2407	1.7127	1.3087
No log	10.9524	230	1.6459	0.2521	1.6459	1.2829
No log	11.0476	232	1.5265	0.2658	1.5265	1.2355
No log	11.1429	234	1.3301	0.3363	1.3301	1.1533
No log	11.2381	236	1.2669	0.3243	1.2669	1.1256
No log	11.3333	238	1.2737	0.2844	1.2737	1.1286
No log	11.4286	240	1.2906	0.2647	1.2906	1.1360
No log	11.5238	242	1.3724	0.3363	1.3724	1.1715
No log	11.6190	244	1.4696	0.2806	1.4696	1.2123
No log	11.7143	246	1.4479	0.2829	1.4479	1.2033
No log	11.8095	248	1.5437	0.2683	1.5437	1.2425
No log	11.9048	250	1.5428	0.2658	1.5428	1.2421
No log	12.0	252	1.5461	0.2658	1.5461	1.2434
No log	12.0952	254	1.5267	0.2084	1.5267	1.2356
No log	12.1905	256	1.4116	0.2343	1.4116	1.1881
No log	12.2857	258	1.2781	0.3158	1.2781	1.1305
No log	12.3810	260	1.3500	0.2418	1.3500	1.1619
No log	12.4762	262	1.3501	0.2503	1.3501	1.1620
No log	12.5714	264	1.3439	0.2503	1.3439	1.1593
No log	12.6667	266	1.4772	0.2084	1.4772	1.2154
No log	12.7619	268	1.5396	0.2317	1.5396	1.2408
No log	12.8571	270	1.5412	0.2826	1.5412	1.2414
No log	12.9524	272	1.4104	0.3501	1.4104	1.1876
No log	13.0476	274	1.4390	0.3511	1.4390	1.1996
No log	13.1429	276	1.4534	0.3501	1.4534	1.2056
No log	13.2381	278	1.4953	0.2935	1.4953	1.2228
No log	13.3333	280	1.3733	0.3512	1.3733	1.1719
No log	13.4286	282	1.2866	0.3857	1.2866	1.1343
No log	13.5238	284	1.1797	0.2884	1.1797	1.0861
No log	13.6190	286	1.2329	0.3138	1.2329	1.1104
No log	13.7143	288	1.3341	0.3243	1.3341	1.1550
No log	13.8095	290	1.4057	0.3188	1.4057	1.1856
No log	13.9048	292	1.3247	0.2693	1.3247	1.1510
No log	14.0	294	1.2119	0.3000	1.2119	1.1009
No log	14.0952	296	1.2155	0.2207	1.2155	1.1025
No log	14.1905	298	1.3106	0.2367	1.3106	1.1448
No log	14.2857	300	1.3913	0.2881	1.3913	1.1795
No log	14.3810	302	1.4830	0.3499	1.4830	1.2178
No log	14.4762	304	1.5246	0.2989	1.5246	1.2347
No log	14.5714	306	1.3954	0.3227	1.3954	1.1813
No log	14.6667	308	1.3296	0.2875	1.3296	1.1531
No log	14.7619	310	1.3434	0.2032	1.3434	1.1591
No log	14.8571	312	1.2893	0.1903	1.2893	1.1355
No log	14.9524	314	1.2046	0.2009	1.2046	1.0976
No log	15.0476	316	1.1991	0.2009	1.1991	1.0950
No log	15.1429	318	1.3067	0.1557	1.3067	1.1431
No log	15.2381	320	1.4129	0.2839	1.4129	1.1887
No log	15.3333	322	1.3776	0.2822	1.3776	1.1737
No log	15.4286	324	1.2691	0.2681	1.2691	1.1266
No log	15.5238	326	1.2458	0.2100	1.2458	1.1162
No log	15.6190	328	1.2945	0.1997	1.2945	1.1378
No log	15.7143	330	1.3298	0.2494	1.3298	1.1532
No log	15.8095	332	1.4332	0.2839	1.4332	1.1971
No log	15.9048	334	1.5443	0.2424	1.5443	1.2427
No log	16.0	336	1.4768	0.3475	1.4768	1.2153
No log	16.0952	338	1.3015	0.2184	1.3015	1.1408
No log	16.1905	340	1.1450	0.1662	1.1450	1.0701
No log	16.2857	342	1.1089	0.2692	1.1089	1.0531
No log	16.3810	344	1.1230	0.2386	1.1230	1.0597
No log	16.4762	346	1.2172	0.2668	1.2172	1.1033
No log	16.5714	348	1.4409	0.3442	1.4409	1.2004
No log	16.6667	350	1.7297	0.1472	1.7297	1.3152
No log	16.7619	352	1.7974	0.1549	1.7974	1.3407
No log	16.8571	354	1.7352	0.1391	1.7352	1.3173
No log	16.9524	356	1.5258	0.3047	1.5258	1.2352
No log	17.0476	358	1.3518	0.1379	1.3518	1.1627
No log	17.1429	360	1.2221	0.1379	1.2221	1.1055
No log	17.2381	362	1.1517	0.1911	1.1517	1.0732
No log	17.3333	364	1.1734	0.2184	1.1734	1.0832
No log	17.4286	366	1.3391	0.3171	1.3391	1.1572
No log	17.5238	368	1.4949	0.2886	1.4949	1.2227
No log	17.6190	370	1.4921	0.2863	1.4921	1.2215
No log	17.7143	372	1.3598	0.2213	1.3598	1.1661
No log	17.8095	374	1.1583	0.2291	1.1583	1.0762
No log	17.9048	376	1.0237	0.2246	1.0237	1.0118
No log	18.0	378	1.0144	0.2142	1.0144	1.0072
No log	18.0952	380	1.0914	0.2009	1.0914	1.0447
No log	18.1905	382	1.2497	0.1659	1.2497	1.1179
No log	18.2857	384	1.3405	0.3167	1.3405	1.1578
No log	18.3810	386	1.3245	0.3405	1.3245	1.1509
No log	18.4762	388	1.3650	0.3005	1.3650	1.1683
No log	18.5714	390	1.3821	0.1345	1.3821	1.1756
No log	18.6667	392	1.3063	0.1538	1.3063	1.1429
No log	18.7619	394	1.2475	0.1217	1.2475	1.1169
No log	18.8571	396	1.2341	0.2195	1.2341	1.1109
No log	18.9524	398	1.2943	0.3501	1.2943	1.1377
No log	19.0476	400	1.4036	0.3087	1.4036	1.1847
No log	19.1429	402	1.3636	0.2857	1.3636	1.1677
No log	19.2381	404	1.3182	0.2527	1.3182	1.1481
No log	19.3333	406	1.3661	0.2115	1.3661	1.1688
No log	19.4286	408	1.3705	0.1795	1.3705	1.1707
No log	19.5238	410	1.3171	0.1498	1.3171	1.1477
No log	19.6190	412	1.2667	0.1650	1.2667	1.1255
No log	19.7143	414	1.2384	0.1801	1.2384	1.1129
No log	19.8095	416	1.3150	0.2074	1.3150	1.1467
No log	19.9048	418	1.4126	0.2632	1.4126	1.1885
No log	20.0	420	1.4147	0.2632	1.4147	1.1894
No log	20.0952	422	1.3585	0.1554	1.3585	1.1655
No log	20.1905	424	1.3531	0.1379	1.3531	1.1632
No log	20.2857	426	1.3225	0.0887	1.3225	1.1500
No log	20.3810	428	1.3181	0.0887	1.3181	1.1481
No log	20.4762	430	1.2930	0.0887	1.2930	1.1371
No log	20.5714	432	1.2802	0.1053	1.2802	1.1315
No log	20.6667	434	1.2857	0.2980	1.2857	1.1339
No log	20.7619	436	1.2446	0.3067	1.2446	1.1156
No log	20.8571	438	1.2178	0.3416	1.2178	1.1035
No log	20.9524	440	1.2837	0.3222	1.2837	1.1330
No log	21.0476	442	1.2395	0.3309	1.2395	1.1133
No log	21.1429	444	1.1792	0.2494	1.1792	1.0859
No log	21.2381	446	1.1425	0.2152	1.1425	1.0689
No log	21.3333	448	1.1630	0.1538	1.1630	1.0784
No log	21.4286	450	1.2024	0.2665	1.2024	1.0965
No log	21.5238	452	1.2939	0.2647	1.2939	1.1375
No log	21.6190	454	1.3261	0.3106	1.3261	1.1516
No log	21.7143	456	1.2699	0.2619	1.2699	1.1269
No log	21.8095	458	1.2927	0.1517	1.2927	1.1370
No log	21.9048	460	1.3355	0.1538	1.3355	1.1556
No log	22.0	462	1.2874	0.1217	1.2874	1.1346
No log	22.0952	464	1.2145	0.1217	1.2145	1.1021
No log	22.1905	466	1.1300	0.1761	1.1300	1.0630
No log	22.2857	468	1.0591	0.2371	1.0591	1.0291
No log	22.3810	470	1.0607	0.2557	1.0607	1.0299
No log	22.4762	472	1.1081	0.3530	1.1081	1.0526
No log	22.5714	474	1.2186	0.2634	1.2186	1.1039
No log	22.6667	476	1.4036	0.3188	1.4036	1.1847
No log	22.7619	478	1.4631	0.2574	1.4631	1.2096
No log	22.8571	480	1.5153	0.1929	1.5153	1.2310
No log	22.9524	482	1.4782	0.1748	1.4782	1.2158
No log	23.0476	484	1.3296	0.1252	1.3296	1.1531
No log	23.1429	486	1.1327	0.1952	1.1327	1.0643
No log	23.2381	488	1.0485	0.2175	1.0485	1.0240
No log	23.3333	490	1.0504	0.2317	1.0504	1.0249
No log	23.4286	492	1.1166	0.3212	1.1166	1.0567
No log	23.5238	494	1.2373	0.2822	1.2373	1.1124
No log	23.6190	496	1.3183	0.3045	1.3183	1.1482
No log	23.7143	498	1.4406	0.3099	1.4406	1.2003
0.352	23.8095	500	1.4426	0.3082	1.4426	1.2011
0.352	23.9048	502	1.3442	0.2903	1.3442	1.1594
0.352	24.0	504	1.1766	0.2330	1.1766	1.0847
0.352	24.0952	506	1.1293	0.2586	1.1293	1.0627
0.352	24.1905	508	1.1844	0.2291	1.1844	1.0883
0.352	24.2857	510	1.3223	0.2074	1.3223	1.1499

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1