ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4597
• Qwk: 0.1098
• Mse: 1.4597
• Rmse: 1.2082

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0215	2	4.7333	0.0041	4.7333	2.1756
No log	0.0430	4	2.4798	0.0433	2.4798	1.5747
No log	0.0645	6	1.5881	0.0363	1.5881	1.2602
No log	0.0860	8	1.3353	0.1267	1.3353	1.1555
No log	0.1075	10	1.2808	0.0559	1.2808	1.1317
No log	0.1290	12	1.3230	-0.0040	1.3230	1.1502
No log	0.1505	14	1.3488	0.0587	1.3488	1.1614
No log	0.1720	16	1.2992	0.0694	1.2992	1.1398
No log	0.1935	18	1.4144	0.0625	1.4144	1.1893
No log	0.2151	20	1.9488	0.0227	1.9488	1.3960
No log	0.2366	22	2.2579	0.0120	2.2579	1.5026
No log	0.2581	24	1.8216	-0.0082	1.8216	1.3497
No log	0.2796	26	1.4181	0.0	1.4181	1.1909
No log	0.3011	28	1.2334	0.1601	1.2334	1.1106
No log	0.3226	30	1.1910	0.2323	1.1910	1.0913
No log	0.3441	32	1.2722	0.1076	1.2722	1.1279
No log	0.3656	34	1.3473	0.0473	1.3473	1.1607
No log	0.3871	36	1.3702	0.0057	1.3702	1.1705
No log	0.4086	38	1.2992	0.0759	1.2992	1.1398
No log	0.4301	40	1.2631	0.1543	1.2631	1.1239
No log	0.4516	42	1.2917	0.1315	1.2917	1.1365
No log	0.4731	44	1.2410	0.1343	1.2410	1.1140
No log	0.4946	46	1.2407	0.1927	1.2407	1.1139
No log	0.5161	48	1.2691	0.1650	1.2691	1.1265
No log	0.5376	50	1.2964	0.1513	1.2964	1.1386
No log	0.5591	52	1.3234	0.1659	1.3234	1.1504
No log	0.5806	54	1.3319	0.1943	1.3319	1.1541
No log	0.6022	56	1.3147	0.2273	1.3147	1.1466
No log	0.6237	58	1.3265	0.1935	1.3265	1.1517
No log	0.6452	60	1.3010	0.1935	1.3010	1.1406
No log	0.6667	62	1.2755	0.1756	1.2755	1.1294
No log	0.6882	64	1.1988	0.2674	1.1988	1.0949
No log	0.7097	66	1.2330	0.2929	1.2330	1.1104
No log	0.7312	68	1.4626	0.2054	1.4626	1.2094
No log	0.7527	70	1.4548	0.2188	1.4548	1.2062
No log	0.7742	72	1.1324	0.3404	1.1324	1.0641
No log	0.7957	74	1.1029	0.3404	1.1029	1.0502
No log	0.8172	76	1.4940	0.2727	1.4940	1.2223
No log	0.8387	78	1.5576	0.2249	1.5576	1.2480
No log	0.8602	80	1.0834	0.3469	1.0834	1.0409
No log	0.8817	82	0.9987	0.3268	0.9987	0.9993
No log	0.9032	84	0.9695	0.4479	0.9695	0.9847
No log	0.9247	86	0.9545	0.3724	0.9545	0.9770
No log	0.9462	88	1.1597	0.3738	1.1597	1.0769
No log	0.9677	90	1.1428	0.4016	1.1428	1.0690
No log	0.9892	92	1.1099	0.3785	1.1099	1.0535
No log	1.0108	94	1.0419	0.3154	1.0419	1.0207
No log	1.0323	96	1.4203	0.3841	1.4203	1.1918
No log	1.0538	98	1.7816	0.2041	1.7816	1.3347
No log	1.0753	100	1.6824	0.2588	1.6824	1.2971
No log	1.0968	102	1.6235	0.2419	1.6235	1.2742
No log	1.1183	104	1.1362	0.3465	1.1362	1.0659
No log	1.1398	106	1.0477	0.4076	1.0477	1.0236
No log	1.1613	108	1.1216	0.3800	1.1216	1.0590
No log	1.1828	110	1.1460	0.3478	1.1460	1.0705
No log	1.2043	112	1.1993	0.2069	1.1993	1.0951
No log	1.2258	114	0.9998	0.3142	0.9998	0.9999
No log	1.2473	116	0.9708	0.3603	0.9708	0.9853
No log	1.2688	118	0.9602	0.3663	0.9602	0.9799
No log	1.2903	120	1.1667	0.1217	1.1667	1.0801
No log	1.3118	122	1.3525	0.0526	1.3525	1.1630
No log	1.3333	124	1.2599	0.1440	1.2599	1.1224
No log	1.3548	126	1.1035	0.2574	1.1035	1.0505
No log	1.3763	128	1.0113	0.3632	1.0113	1.0056
No log	1.3978	130	1.0665	0.3292	1.0665	1.0327
No log	1.4194	132	1.3742	0.2468	1.3742	1.1722
No log	1.4409	134	1.5959	0.2776	1.5959	1.2633
No log	1.4624	136	1.6867	0.2379	1.6867	1.2987
No log	1.4839	138	1.3583	0.3258	1.3583	1.1654
No log	1.5054	140	1.0895	0.3442	1.0895	1.0438
No log	1.5269	142	1.2288	0.3044	1.2288	1.1085
No log	1.5484	144	1.4854	0.2633	1.4854	1.2188
No log	1.5699	146	1.3513	0.2674	1.3513	1.1625
No log	1.5914	148	1.3625	0.2424	1.3625	1.1673
No log	1.6129	150	1.2221	0.0769	1.2221	1.1055
No log	1.6344	152	1.1441	0.1279	1.1441	1.0696
No log	1.6559	154	1.2791	0.0526	1.2791	1.1310
No log	1.6774	156	1.3134	0.1554	1.3134	1.1460
No log	1.6989	158	1.3576	0.1756	1.3576	1.1652
No log	1.7204	160	1.5438	0.2455	1.5438	1.2425
No log	1.7419	162	1.6154	0.2424	1.6154	1.2710
No log	1.7634	164	1.5009	0.1051	1.5009	1.2251
No log	1.7849	166	1.4005	0.1340	1.4005	1.1834
No log	1.8065	168	1.1697	0.2417	1.1697	1.0815
No log	1.8280	170	1.1296	0.2721	1.1296	1.0628
No log	1.8495	172	1.3605	0.3087	1.3605	1.1664
No log	1.8710	174	1.6083	0.2929	1.6083	1.2682
No log	1.8925	176	1.5776	0.2873	1.5776	1.2560
No log	1.9140	178	1.3801	0.2306	1.3801	1.1748
No log	1.9355	180	1.2594	0.1943	1.2594	1.1222
No log	1.9570	182	1.0705	0.2893	1.0705	1.0346
No log	1.9785	184	1.1209	0.2533	1.1209	1.0587
No log	2.0	186	1.2799	0.0887	1.2799	1.1313
No log	2.0215	188	1.2414	0.1219	1.2414	1.1142
No log	2.0430	190	1.2266	0.2317	1.2266	1.1075
No log	2.0645	192	1.0749	0.3394	1.0749	1.0368
No log	2.0860	194	1.0629	0.3902	1.0629	1.0310
No log	2.1075	196	1.3045	0.3361	1.3045	1.1421
No log	2.1290	198	1.4710	0.2521	1.4710	1.2128
No log	2.1505	200	1.4516	0.2328	1.4516	1.2048
No log	2.1720	202	1.5651	0.2191	1.5651	1.2510
No log	2.1935	204	1.6855	0.0406	1.6855	1.2983
No log	2.2151	206	1.4910	0.1042	1.4910	1.2211
No log	2.2366	208	1.4136	0.0500	1.4136	1.1889
No log	2.2581	210	1.4243	0.0592	1.4243	1.1934
No log	2.2796	212	1.3714	0.0343	1.3714	1.1711
No log	2.3011	214	1.2130	0.0872	1.2130	1.1014
No log	2.3226	216	1.2127	0.1076	1.2127	1.1012
No log	2.3441	218	1.3375	0.0454	1.3375	1.1565
No log	2.3656	220	1.4311	0.1404	1.4311	1.1963
No log	2.3871	222	1.5285	0.2950	1.5285	1.2363
No log	2.4086	224	1.4438	0.3116	1.4438	1.2016
No log	2.4301	226	1.4633	0.2621	1.4633	1.2097
No log	2.4516	228	1.4972	0.2954	1.4972	1.2236
No log	2.4731	230	1.2078	0.2956	1.2078	1.0990
No log	2.4946	232	1.1518	0.1479	1.1518	1.0732
No log	2.5161	234	1.2051	0.1316	1.2051	1.0978
No log	2.5376	236	1.2407	0.1316	1.2407	1.1139
No log	2.5591	238	1.1772	0.1479	1.1772	1.0850
No log	2.5806	240	1.1440	0.2164	1.1440	1.0696
No log	2.6022	242	1.4049	0.2275	1.4049	1.1853
No log	2.6237	244	1.7935	0.1880	1.7935	1.3392
No log	2.6452	246	1.8317	0.2082	1.8317	1.3534
No log	2.6667	248	1.5256	0.2172	1.5256	1.2352
No log	2.6882	250	1.2358	0.2506	1.2358	1.1116
No log	2.7097	252	1.2443	0.2506	1.2443	1.1155
No log	2.7312	254	1.4100	0.1935	1.4100	1.1874
No log	2.7527	256	1.5331	0.1395	1.5331	1.2382
No log	2.7742	258	1.4360	0.1098	1.4360	1.1983
No log	2.7957	260	1.2909	0.0980	1.2909	1.1362
No log	2.8172	262	1.2777	0.0980	1.2777	1.1303
No log	2.8387	264	1.3388	0.1498	1.3388	1.1571
No log	2.8602	266	1.6027	0.2144	1.6027	1.2660
No log	2.8817	268	1.8966	0.1487	1.8966	1.3772
No log	2.9032	270	1.9012	0.1524	1.9012	1.3788
No log	2.9247	272	1.7178	0.2463	1.7178	1.3106
No log	2.9462	274	1.6424	0.3086	1.6424	1.2816
No log	2.9677	276	1.5716	0.1886	1.5716	1.2536
No log	2.9892	278	1.4655	0.0186	1.4655	1.2106
No log	3.0108	280	1.3739	0.0454	1.3739	1.1721
No log	3.0323	282	1.3467	0.0454	1.3467	1.1605
No log	3.0538	284	1.2717	0.0887	1.2717	1.1277
No log	3.0753	286	1.2471	0.1750	1.2471	1.1167
No log	3.0968	288	1.3429	0.1659	1.3429	1.1589
No log	3.1183	290	1.4233	0.1722	1.4233	1.1930
No log	3.1398	292	1.5205	0.1923	1.5205	1.2331
No log	3.1613	294	1.5302	0.2514	1.5302	1.2370
No log	3.1828	296	1.4400	0.1929	1.4400	1.2000
No log	3.2043	298	1.3737	0.1481	1.3737	1.1720
No log	3.2258	300	1.3983	0.2173	1.3983	1.1825
No log	3.2473	302	1.5083	0.2479	1.5083	1.2281
No log	3.2688	304	1.3839	0.1889	1.3839	1.1764
No log	3.2903	306	1.4177	0.1889	1.4177	1.1907
No log	3.3118	308	1.4339	0.1889	1.4339	1.1974
No log	3.3333	310	1.4105	0.2173	1.4105	1.1876
No log	3.3548	312	1.4312	0.1340	1.4312	1.1963
No log	3.3763	314	1.6308	0.2285	1.6308	1.2770
No log	3.3978	316	1.7437	0.2407	1.7437	1.3205
No log	3.4194	318	1.6680	0.2542	1.6680	1.2915
No log	3.4409	320	1.4981	0.2206	1.4981	1.2240
No log	3.4624	322	1.3729	0.2747	1.3729	1.1717
No log	3.4839	324	1.5616	0.2759	1.5616	1.2496
No log	3.5054	326	1.9004	0.1448	1.9004	1.3785
No log	3.5269	328	1.9269	0.1614	1.9269	1.3881
No log	3.5484	330	1.7097	0.2285	1.7097	1.3076
No log	3.5699	332	1.3026	0.2184	1.3026	1.1413
No log	3.5914	334	1.1654	0.2164	1.1654	1.0796
No log	3.6129	336	1.2785	0.1596	1.2785	1.1307
No log	3.6344	338	1.5589	0.2065	1.5589	1.2486
No log	3.6559	340	1.6713	0.2455	1.6713	1.2928
No log	3.6774	342	1.5680	0.2065	1.5680	1.2522
No log	3.6989	344	1.4468	0.1461	1.4468	1.2028
No log	3.7204	346	1.5176	0.1283	1.5176	1.2319
No log	3.7419	348	1.7201	0.2285	1.7201	1.3115
No log	3.7634	350	1.7905	0.2620	1.7905	1.3381
No log	3.7849	352	1.6692	0.2632	1.6692	1.2920
No log	3.8065	354	1.5322	0.1886	1.5322	1.2378
No log	3.8280	356	1.5957	0.1929	1.5957	1.2632
No log	3.8495	358	1.6902	0.2455	1.6902	1.3001
No log	3.8710	360	1.7002	0.2285	1.7002	1.3039
No log	3.8925	362	1.6290	0.1886	1.6290	1.2763
No log	3.9140	364	1.4413	0.0678	1.4413	1.2005
No log	3.9355	366	1.2531	0.0802	1.2531	1.1194
No log	3.9570	368	1.2616	0.0802	1.2616	1.1232
No log	3.9785	370	1.3656	0.1283	1.3656	1.1686
No log	4.0	372	1.5759	0.1929	1.5759	1.2553
No log	4.0215	374	1.6097	0.2359	1.6097	1.2687
No log	4.0430	376	1.4561	0.0987	1.4561	1.2067
No log	4.0645	378	1.3151	0.1477	1.3151	1.1468
No log	4.0860	380	1.2845	0.1894	1.2845	1.1334
No log	4.1075	382	1.1947	0.2009	1.1947	1.0930
No log	4.1290	384	1.1664	0.2164	1.1664	1.0800
No log	4.1505	386	1.2862	0.1428	1.2862	1.1341
No log	4.1720	388	1.3907	0.0987	1.3907	1.1793
No log	4.1935	390	1.3368	0.0987	1.3368	1.1562
No log	4.2151	392	1.2877	0.2348	1.2877	1.1348
No log	4.2366	394	1.3889	0.2289	1.3889	1.1785
No log	4.2581	396	1.5791	0.2569	1.5791	1.2566
No log	4.2796	398	1.6822	0.2569	1.6822	1.2970
No log	4.3011	400	1.7290	0.2685	1.7290	1.3149
No log	4.3226	402	1.6574	0.1051	1.6574	1.2874
No log	4.3441	404	1.6612	-0.0048	1.6612	1.2889
No log	4.3656	406	1.7280	-0.0199	1.7280	1.3145
No log	4.3871	408	1.8255	-0.0746	1.8255	1.3511
No log	4.4086	410	1.8514	0.0068	1.8514	1.3607
No log	4.4301	412	1.7198	0.0512	1.7198	1.3114
No log	4.4516	414	1.5336	-0.0331	1.5336	1.2384
No log	4.4731	416	1.3797	0.0904	1.3797	1.1746
No log	4.4946	418	1.4297	0.0711	1.4297	1.1957
No log	4.5161	420	1.5741	0.0270	1.5741	1.2546
No log	4.5376	422	1.7530	-0.0027	1.7530	1.3240
No log	4.5591	424	1.7915	0.0852	1.7915	1.3385
No log	4.5806	426	1.6747	0.0884	1.6747	1.2941
No log	4.6022	428	1.4955	0.1071	1.4955	1.2229
No log	4.6237	430	1.4771	0.1071	1.4771	1.2154
No log	4.6452	432	1.5361	0.0678	1.5361	1.2394
No log	4.6667	434	1.6008	-0.0331	1.6008	1.2652
No log	4.6882	436	1.5791	-0.0331	1.5791	1.2566
No log	4.7097	438	1.4929	-0.0169	1.4929	1.2218
No log	4.7312	440	1.4337	0.0273	1.4337	1.1974
No log	4.7527	442	1.4965	0.0750	1.4965	1.2233
No log	4.7742	444	1.7108	0.2455	1.7108	1.3080
No log	4.7957	446	1.8572	0.2193	1.8572	1.3628
No log	4.8172	448	1.8326	0.2540	1.8326	1.3537
No log	4.8387	450	1.6121	0.3105	1.6121	1.2697
No log	4.8602	452	1.4845	0.1929	1.4845	1.2184
No log	4.8817	454	1.5691	0.2181	1.5691	1.2527
No log	4.9032	456	1.5516	0.1618	1.5516	1.2456
No log	4.9247	458	1.5273	0.0678	1.5273	1.2359
No log	4.9462	460	1.4349	0.0454	1.4349	1.1979
No log	4.9677	462	1.3859	0.0454	1.3859	1.1773
No log	4.9892	464	1.5147	0.0273	1.5147	1.2307
No log	5.0108	466	1.6240	0.0273	1.6240	1.2744
No log	5.0323	468	1.7119	0.0121	1.7119	1.3084
No log	5.0538	470	1.7401	-0.0911	1.7401	1.3191
No log	5.0753	472	1.7371	0.0501	1.7371	1.3180
No log	5.0968	474	1.5869	0.1708	1.5869	1.2597
No log	5.1183	476	1.5531	0.2343	1.5531	1.2462
No log	5.1398	478	1.5218	0.2489	1.5218	1.2336
No log	5.1613	480	1.4055	0.1005	1.4055	1.1855
No log	5.1828	482	1.3990	0.1005	1.3990	1.1828
No log	5.2043	484	1.5114	0.0678	1.5114	1.2294
No log	5.2258	486	1.4571	0.0678	1.4571	1.2071
No log	5.2473	488	1.5356	0.0678	1.5356	1.2392
No log	5.2688	490	1.5956	0.0512	1.5956	1.2632
No log	5.2903	492	1.4999	0.1098	1.4999	1.2247
No log	5.3118	494	1.4571	0.1098	1.4571	1.2071
No log	5.3333	496	1.3479	0.1005	1.3479	1.1610
No log	5.3548	498	1.2508	0.1312	1.2508	1.1184
0.3517	5.3763	500	1.2669	0.1986	1.2669	1.1256
0.3517	5.3978	502	1.4345	0.2606	1.4345	1.1977
0.3517	5.4194	504	1.6928	0.2066	1.6928	1.3011
0.3517	5.4409	506	1.6169	0.2285	1.6169	1.2716
0.3517	5.4624	508	1.3826	0.0818	1.3826	1.1758
0.3517	5.4839	510	1.2506	0.1596	1.2506	1.1183
0.3517	5.5054	512	1.2198	0.2003	1.2198	1.1044
0.3517	5.5269	514	1.2394	0.2003	1.2394	1.1133
0.3517	5.5484	516	1.3867	0.1098	1.3867	1.1776
0.3517	5.5699	518	1.5134	0.0818	1.5134	1.2302
0.3517	5.5914	520	1.5396	0.0656	1.5396	1.2408
0.3517	5.6129	522	1.5295	0.0920	1.5295	1.2367
0.3517	5.6344	524	1.4597	0.1098	1.4597	1.2082

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1