ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6122
• Qwk: 0.1604
• Mse: 1.6122
• Rmse: 1.2697

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	4.4061	0.0010	4.4061	2.0991
No log	0.0714	4	2.6494	0.0306	2.6494	1.6277
No log	0.1071	6	1.9695	-0.0634	1.9695	1.4034
No log	0.1429	8	1.4311	0.0995	1.4311	1.1963
No log	0.1786	10	1.3512	0.1045	1.3512	1.1624
No log	0.2143	12	1.8395	-0.0342	1.8395	1.3563
No log	0.25	14	2.0135	0.0465	2.0135	1.4190
No log	0.2857	16	1.3953	0.0651	1.3953	1.1812
No log	0.3214	18	1.3178	0.0878	1.3178	1.1480
No log	0.3571	20	1.5545	-0.0465	1.5545	1.2468
No log	0.3929	22	1.6320	-0.0814	1.6320	1.2775
No log	0.4286	24	1.5277	-0.1370	1.5277	1.2360
No log	0.4643	26	1.4965	-0.0964	1.4965	1.2233
No log	0.5	28	1.6391	-0.0664	1.6391	1.2803
No log	0.5357	30	1.8102	-0.0870	1.8102	1.3454
No log	0.5714	32	2.0007	-0.0753	2.0007	1.4145
No log	0.6071	34	1.9233	-0.1295	1.9233	1.3868
No log	0.6429	36	1.4626	0.1144	1.4626	1.2094
No log	0.6786	38	1.2483	0.2200	1.2483	1.1173
No log	0.7143	40	1.2262	0.2233	1.2262	1.1073
No log	0.75	42	1.3229	0.1289	1.3229	1.1502
No log	0.7857	44	1.3258	0.1347	1.3258	1.1514
No log	0.8214	46	1.3848	0.1289	1.3848	1.1768
No log	0.8571	48	1.4214	0.1050	1.4214	1.1922
No log	0.8929	50	1.4950	0.0376	1.4950	1.2227
No log	0.9286	52	1.3745	0.0967	1.3745	1.1724
No log	0.9643	54	1.4980	0.0572	1.4980	1.2239
No log	1.0	56	1.5500	0.0773	1.5500	1.2450
No log	1.0357	58	1.5107	0.0927	1.5107	1.2291
No log	1.0714	60	1.5156	0.1202	1.5156	1.2311
No log	1.1071	62	1.5509	0.0882	1.5509	1.2453
No log	1.1429	64	1.4013	0.2201	1.4013	1.1838
No log	1.1786	66	1.2762	0.3065	1.2762	1.1297
No log	1.2143	68	1.4398	0.1304	1.4398	1.1999
No log	1.25	70	1.8076	0.1007	1.8076	1.3445
No log	1.2857	72	2.1020	-0.1252	2.1020	1.4498
No log	1.3214	74	1.9013	0.0596	1.9013	1.3789
No log	1.3571	76	1.3399	0.2898	1.3399	1.1575
No log	1.3929	78	1.1412	0.3059	1.1412	1.0683
No log	1.4286	80	1.1380	0.3059	1.1380	1.0668
No log	1.4643	82	1.1920	0.3794	1.1920	1.0918
No log	1.5	84	1.6042	0.1443	1.6042	1.2666
No log	1.5357	86	1.8679	0.0978	1.8679	1.3667
No log	1.5714	88	1.7988	0.1304	1.7988	1.3412
No log	1.6071	90	1.3470	0.3536	1.3470	1.1606
No log	1.6429	92	1.2607	0.4475	1.2607	1.1228
No log	1.6786	94	1.4014	0.2760	1.4014	1.1838
No log	1.7143	96	1.5615	0.1409	1.5615	1.2496
No log	1.75	98	1.5760	0.1459	1.5760	1.2554
No log	1.7857	100	1.3348	0.3605	1.3348	1.1553
No log	1.8214	102	1.4091	0.2647	1.4091	1.1871
No log	1.8571	104	1.6664	0.0828	1.6664	1.2909
No log	1.8929	106	1.8267	0.1391	1.8267	1.3516
No log	1.9286	108	1.6797	0.1810	1.6797	1.2960
No log	1.9643	110	1.5263	0.2270	1.5263	1.2354
No log	2.0	112	1.1847	0.4453	1.1847	1.0884
No log	2.0357	114	1.1010	0.3590	1.1010	1.0493
No log	2.0714	116	1.2162	0.3686	1.2162	1.1028
No log	2.1071	118	1.9907	0.1845	1.9907	1.4109
No log	2.1429	120	2.3462	0.1300	2.3462	1.5317
No log	2.1786	122	1.9215	0.1814	1.9215	1.3862
No log	2.2143	124	1.3759	0.2115	1.3759	1.1730
No log	2.25	126	1.3746	0.1983	1.3746	1.1724
No log	2.2857	128	1.3584	0.2314	1.3584	1.1655
No log	2.3214	130	1.7400	0.1775	1.7400	1.3191
No log	2.3571	132	1.9584	0.1876	1.9584	1.3994
No log	2.3929	134	1.9696	0.1570	1.9696	1.4034
No log	2.4286	136	1.7496	0.2510	1.7496	1.3227
No log	2.4643	138	1.6642	0.2486	1.6642	1.2900
No log	2.5	140	1.7165	0.1702	1.7165	1.3101
No log	2.5357	142	1.3552	0.3405	1.3552	1.1641
No log	2.5714	144	1.1750	0.3952	1.1750	1.0840
No log	2.6071	146	1.3197	0.3086	1.3197	1.1488
No log	2.6429	148	1.4108	0.3287	1.4108	1.1878
No log	2.6786	150	1.2549	0.3917	1.2549	1.1202
No log	2.7143	152	1.0613	0.3639	1.0613	1.0302
No log	2.75	154	1.1890	0.3833	1.1890	1.0904
No log	2.7857	156	1.2994	0.3222	1.2994	1.1399
No log	2.8214	158	1.4923	0.3475	1.4923	1.2216
No log	2.8571	160	1.2479	0.3784	1.2479	1.1171
No log	2.8929	162	0.9871	0.3394	0.9871	0.9935
No log	2.9286	164	1.0719	0.3838	1.0719	1.0353
No log	2.9643	166	1.5259	0.2908	1.5259	1.2353
No log	3.0	168	1.8363	0.0767	1.8363	1.3551
No log	3.0357	170	1.6769	0.2813	1.6769	1.2950
No log	3.0714	172	1.2995	0.3449	1.2995	1.1400
No log	3.1071	174	1.1668	0.3538	1.1668	1.0802
No log	3.1429	176	1.1523	0.3433	1.1523	1.0734
No log	3.1786	178	1.2505	0.3406	1.2505	1.1183
No log	3.2143	180	1.5653	0.2411	1.5653	1.2511
No log	3.25	182	1.5865	0.1751	1.5865	1.2596
No log	3.2857	184	1.3757	0.1552	1.3757	1.1729
No log	3.3214	186	1.1391	0.2402	1.1391	1.0673
No log	3.3571	188	1.1585	0.2552	1.1585	1.0763
No log	3.3929	190	1.2935	0.1646	1.2935	1.1373
No log	3.4286	192	1.4306	0.1667	1.4306	1.1961
No log	3.4643	194	1.4859	0.1465	1.4859	1.2190
No log	3.5	196	1.4499	0.1674	1.4499	1.2041
No log	3.5357	198	1.4563	0.1359	1.4563	1.2068
No log	3.5714	200	1.4167	0.1847	1.4167	1.1902
No log	3.6071	202	1.5740	0.1583	1.5740	1.2546
No log	3.6429	204	1.5304	0.1498	1.5304	1.2371
No log	3.6786	206	1.4415	0.1104	1.4415	1.2006
No log	3.7143	208	1.4322	0.1336	1.4322	1.1968
No log	3.75	210	1.3299	0.1481	1.3299	1.1532
No log	3.7857	212	1.2633	0.2184	1.2633	1.1240
No log	3.8214	214	1.0686	0.2741	1.0686	1.0337
No log	3.8571	216	1.0382	0.2988	1.0382	1.0189
No log	3.8929	218	1.0339	0.2665	1.0339	1.0168
No log	3.9286	220	1.0439	0.3363	1.0439	1.0217
No log	3.9643	222	1.3393	0.2544	1.3393	1.1573
No log	4.0	224	1.6844	0.2669	1.6844	1.2979
No log	4.0357	226	1.6541	0.2669	1.6541	1.2861
No log	4.0714	228	1.3740	0.3202	1.3740	1.1722
No log	4.1071	230	1.0881	0.2108	1.0881	1.0431
No log	4.1429	232	1.0286	0.1868	1.0286	1.0142
No log	4.1786	234	1.0334	0.2019	1.0334	1.0166
No log	4.2143	236	1.0737	0.2683	1.0737	1.0362
No log	4.25	238	1.2254	0.3447	1.2254	1.1070
No log	4.2857	240	1.4756	0.3462	1.4756	1.2148
No log	4.3214	242	1.4231	0.3348	1.4231	1.1929
No log	4.3571	244	1.1540	0.2460	1.1540	1.0742
No log	4.3929	246	0.9205	0.3404	0.9205	0.9594
No log	4.4286	248	0.9462	0.3411	0.9462	0.9727
No log	4.4643	250	0.9205	0.3451	0.9205	0.9594
No log	4.5	252	0.9970	0.2377	0.9970	0.9985
No log	4.5357	254	1.3550	0.3071	1.3550	1.1641
No log	4.5714	256	1.6062	0.2542	1.6062	1.2674
No log	4.6071	258	1.5069	0.3026	1.5069	1.2276
No log	4.6429	260	1.4003	0.3254	1.4003	1.1833
No log	4.6786	262	1.4225	0.3478	1.4225	1.1927
No log	4.7143	264	1.5361	0.2261	1.5361	1.2394
No log	4.75	266	1.4597	0.2585	1.4597	1.2082
No log	4.7857	268	1.1394	0.3341	1.1394	1.0674
No log	4.8214	270	0.9317	0.3854	0.9317	0.9653
No log	4.8571	272	0.9488	0.3551	0.9488	0.9740
No log	4.8929	274	1.1075	0.3187	1.1075	1.0524
No log	4.9286	276	1.4082	0.2424	1.4082	1.1867
No log	4.9643	278	1.4366	0.2604	1.4366	1.1986
No log	5.0	280	1.2731	0.2410	1.2731	1.1283
No log	5.0357	282	1.0159	0.2800	1.0159	1.0079
No log	5.0714	284	0.9551	0.3174	0.9551	0.9773
No log	5.1071	286	1.0235	0.1480	1.0235	1.0117
No log	5.1429	288	1.2521	0.1152	1.2521	1.1190
No log	5.1786	290	1.3630	0.0539	1.3630	1.1675
No log	5.2143	292	1.3238	0.0098	1.3238	1.1506
No log	5.25	294	1.2130	0.0541	1.2130	1.1014
No log	5.2857	296	1.1443	0.1479	1.1443	1.0697
No log	5.3214	298	1.1289	0.2665	1.1289	1.0625
No log	5.3571	300	1.1837	0.2980	1.1837	1.0880
No log	5.3929	302	1.4876	0.2987	1.4876	1.2197
No log	5.4286	304	1.7670	0.1739	1.7670	1.3293
No log	5.4643	306	1.6945	0.2105	1.6945	1.3017
No log	5.5	308	1.4364	0.2341	1.4364	1.1985
No log	5.5357	310	1.1452	0.1582	1.1452	1.0701
No log	5.5714	312	1.1024	0.1417	1.1024	1.0500
No log	5.6071	314	1.1884	0.0454	1.1884	1.0901
No log	5.6429	316	1.3303	0.0541	1.3303	1.1534
No log	5.6786	318	1.2905	0.1152	1.2905	1.1360
No log	5.7143	320	1.2623	0.1789	1.2623	1.1235
No log	5.75	322	1.2940	0.2445	1.2940	1.1375
No log	5.7857	324	1.4084	0.2411	1.4084	1.1867
No log	5.8214	326	1.3442	0.2071	1.3442	1.1594
No log	5.8571	328	1.2355	0.1126	1.2355	1.1115
No log	5.8929	330	1.1933	0.1152	1.1933	1.0924
No log	5.9286	332	1.2347	0.0721	1.2347	1.1112
No log	5.9643	334	1.1565	0.0541	1.1565	1.0754
No log	6.0	336	1.0982	0.1480	1.0982	1.0480
No log	6.0357	338	1.0133	0.1706	1.0133	1.0066
No log	6.0714	340	1.0511	0.1808	1.0511	1.0253
No log	6.1071	342	1.2035	0.2173	1.2035	1.0970
No log	6.1429	344	1.3206	0.2445	1.3206	1.1492
No log	6.1786	346	1.4588	0.2765	1.4588	1.2078
No log	6.2143	348	1.3946	0.2410	1.3946	1.1809
No log	6.25	350	1.2723	0.1477	1.2723	1.1280
No log	6.2857	352	1.2334	0.1316	1.2334	1.1106
No log	6.3214	354	1.2252	0.1316	1.2252	1.1069
No log	6.3571	356	1.3872	0.2479	1.3872	1.1778
No log	6.3929	358	1.5741	0.2592	1.5741	1.2546
No log	6.4286	360	1.6499	0.2813	1.6499	1.2845
No log	6.4643	362	1.6046	0.2264	1.6046	1.2667
No log	6.5	364	1.4335	0.2173	1.4335	1.1973
No log	6.5357	366	1.2864	0.0541	1.2864	1.1342
No log	6.5714	368	1.2725	0.0541	1.2725	1.1281
No log	6.6071	370	1.3769	0.1152	1.3769	1.1734
No log	6.6429	372	1.4755	0.2225	1.4755	1.2147
No log	6.6786	374	1.5397	0.3092	1.5397	1.2408
No log	6.7143	376	1.4503	0.3650	1.4503	1.2043
No log	6.75	378	1.2394	0.3071	1.2394	1.1133
No log	6.7857	380	1.1886	0.2738	1.1886	1.0902
No log	6.8214	382	1.2896	0.3478	1.2896	1.1356
No log	6.8571	384	1.5564	0.2867	1.5564	1.2475
No log	6.8929	386	1.6305	0.2424	1.6305	1.2769
No log	6.9286	388	1.4914	0.3254	1.4914	1.2212
No log	6.9643	390	1.2499	0.2647	1.2499	1.1180
No log	7.0	392	1.1026	0.1279	1.1026	1.0500
No log	7.0357	394	1.0829	0.1443	1.0829	1.0406
No log	7.0714	396	1.1202	0.1048	1.1202	1.0584
No log	7.1071	398	1.2289	0.2087	1.2289	1.1086
No log	7.1429	400	1.3101	0.2028	1.3101	1.1446
No log	7.1786	402	1.3237	0.2678	1.3237	1.1505
No log	7.2143	404	1.2347	0.2817	1.2347	1.1112
No log	7.25	406	1.0852	0.2175	1.0852	1.0417
No log	7.2857	408	1.0580	0.1868	1.0580	1.0286
No log	7.3214	410	1.1403	0.1801	1.1403	1.0679
No log	7.3571	412	1.3842	0.2736	1.3842	1.1765
No log	7.3929	414	1.5481	0.3287	1.5481	1.2442
No log	7.4286	416	1.5393	0.3287	1.5393	1.2407
No log	7.4643	418	1.4205	0.2289	1.4205	1.1918
No log	7.5	420	1.3595	0.2373	1.3595	1.1660
No log	7.5357	422	1.2655	0.2790	1.2655	1.1249
No log	7.5714	424	1.3444	0.2964	1.3444	1.1595
No log	7.6071	426	1.5047	0.2644	1.5047	1.2267
No log	7.6429	428	1.5593	0.2489	1.5593	1.2487
No log	7.6786	430	1.4252	0.3140	1.4252	1.1938
No log	7.7143	432	1.1874	0.3792	1.1874	1.0897
No log	7.75	434	0.9996	0.2377	0.9996	0.9998
No log	7.7857	436	1.0003	0.2072	1.0003	1.0001
No log	7.8214	438	1.1140	0.2363	1.1140	1.0555
No log	7.8571	440	1.3638	0.3202	1.3638	1.1678
No log	7.8929	442	1.5521	0.3201	1.5521	1.2458
No log	7.9286	444	1.6287	0.2765	1.6287	1.2762
No log	7.9643	446	1.5283	0.2444	1.5283	1.2362
No log	8.0	448	1.4608	0.2570	1.4608	1.2086
No log	8.0357	450	1.3385	0.2087	1.3385	1.1569
No log	8.0714	452	1.2574	0.1477	1.2574	1.1213
No log	8.1071	454	1.2533	0.1152	1.2533	1.1195
No log	8.1429	456	1.3375	0.1789	1.3375	1.1565
No log	8.1786	458	1.4466	0.2876	1.4466	1.2028
No log	8.2143	460	1.5263	0.2424	1.5263	1.2354
No log	8.25	462	1.4566	0.2127	1.4566	1.2069
No log	8.2857	464	1.3311	0.2771	1.3311	1.1538
No log	8.3214	466	1.2556	0.2087	1.2556	1.1205
No log	8.3571	468	1.2692	0.1789	1.2692	1.1266
No log	8.3929	470	1.3781	0.2504	1.3781	1.1739
No log	8.4286	472	1.4224	0.2504	1.4224	1.1927
No log	8.4643	474	1.4350	0.2771	1.4350	1.1979
No log	8.5	476	1.3661	0.2504	1.3661	1.1688
No log	8.5357	478	1.3760	0.3163	1.3760	1.1730
No log	8.5714	480	1.3872	0.3406	1.3872	1.1778
No log	8.6071	482	1.3848	0.2982	1.3848	1.1768
No log	8.6429	484	1.3707	0.2910	1.3707	1.1708
No log	8.6786	486	1.4018	0.2373	1.4018	1.1840
No log	8.7143	488	1.4262	0.1789	1.4262	1.1942
No log	8.75	490	1.3617	0.1152	1.3617	1.1669
No log	8.7857	492	1.3346	0.0541	1.3346	1.1552
No log	8.8214	494	1.3031	0.1152	1.3031	1.1416
No log	8.8571	496	1.2114	0.0880	1.2114	1.1006
No log	8.8929	498	1.2556	0.1795	1.2556	1.1205
0.3501	8.9286	500	1.4207	0.2217	1.4207	1.1919
0.3501	8.9643	502	1.6392	0.2508	1.6392	1.2803
0.3501	9.0	504	1.7631	0.2232	1.7631	1.3278
0.3501	9.0357	506	1.8539	0.2118	1.8539	1.3616
0.3501	9.0714	508	1.6904	0.2353	1.6904	1.3002
0.3501	9.1071	510	1.4351	0.1929	1.4351	1.1980
0.3501	9.1429	512	1.1827	0.2454	1.1827	1.0875
0.3501	9.1786	514	1.1370	0.1505	1.1370	1.0663
0.3501	9.2143	516	1.2086	0.1114	1.2086	1.0994
0.3501	9.25	518	1.3902	0.1789	1.3902	1.1791
0.3501	9.2857	520	1.5788	0.2112	1.5788	1.2565
0.3501	9.3214	522	1.6122	0.1604	1.6122	1.2697

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1