ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1630
• Qwk: 0.2019
• Mse: 1.1630
• Rmse: 1.0784

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.6820	0.0010	4.6820	2.1638
No log	0.2222	4	2.6829	0.0306	2.6829	1.6380
No log	0.3333	6	2.0085	-0.0164	2.0085	1.4172
No log	0.4444	8	1.7153	0.0414	1.7153	1.3097
No log	0.5556	10	1.8197	-0.0698	1.8197	1.3490
No log	0.6667	12	1.7059	-0.0702	1.7059	1.3061
No log	0.7778	14	1.5911	-0.0359	1.5911	1.2614
No log	0.8889	16	1.5210	-0.0146	1.5210	1.2333
No log	1.0	18	1.2997	-0.0010	1.2997	1.1401
No log	1.1111	20	1.3085	0.0319	1.3085	1.1439
No log	1.2222	22	1.4666	0.0647	1.4666	1.2110
No log	1.3333	24	1.4182	0.0964	1.4182	1.1909
No log	1.4444	26	1.2194	0.1791	1.2194	1.1043
No log	1.5556	28	1.1698	0.2674	1.1698	1.0816
No log	1.6667	30	1.1855	0.1649	1.1855	1.0888
No log	1.7778	32	1.2201	0.2579	1.2201	1.1046
No log	1.8889	34	1.2405	0.1733	1.2405	1.1138
No log	2.0	36	1.3487	0.0432	1.3487	1.1613
No log	2.1111	38	1.4770	-0.0492	1.4770	1.2153
No log	2.2222	40	1.3535	0.0854	1.3535	1.1634
No log	2.3333	42	1.2417	0.0909	1.2417	1.1143
No log	2.4444	44	1.2007	0.0872	1.2007	1.0958
No log	2.5556	46	1.1876	0.2038	1.1876	1.0898
No log	2.6667	48	1.1855	0.2257	1.1855	1.0888
No log	2.7778	50	1.2151	0.1232	1.2151	1.1023
No log	2.8889	52	1.1789	0.2257	1.1789	1.0858
No log	3.0	54	1.1667	0.2416	1.1667	1.0801
No log	3.1111	56	1.2223	0.1168	1.2223	1.1056
No log	3.2222	58	1.2239	0.0984	1.2239	1.1063
No log	3.3333	60	1.1680	0.2053	1.1680	1.0807
No log	3.4444	62	1.2051	0.1114	1.2051	1.0978
No log	3.5556	64	1.2648	0.0948	1.2648	1.1246
No log	3.6667	66	1.1602	0.1546	1.1602	1.0771
No log	3.7778	68	1.1261	0.2584	1.1261	1.0612
No log	3.8889	70	1.1475	0.2836	1.1475	1.0712
No log	4.0	72	1.0790	0.2532	1.0790	1.0387
No log	4.1111	74	1.0632	0.3021	1.0632	1.0311
No log	4.2222	76	1.2547	0.0865	1.2547	1.1201
No log	4.3333	78	1.4009	0.0920	1.4009	1.1836
No log	4.4444	80	1.3141	0.1283	1.3141	1.1463
No log	4.5556	82	1.1037	0.2175	1.1037	1.0506
No log	4.6667	84	1.0455	0.3596	1.0455	1.0225
No log	4.7778	86	1.0435	0.3838	1.0435	1.0215
No log	4.8889	88	1.0547	0.3434	1.0547	1.0270
No log	5.0	90	1.2069	0.2248	1.2069	1.0986
No log	5.1111	92	1.2732	0.1813	1.2732	1.1284
No log	5.2222	94	1.2069	0.1813	1.2069	1.0986
No log	5.3333	96	1.1059	0.3191	1.1059	1.0516
No log	5.4444	98	1.1371	0.2060	1.1371	1.0663
No log	5.5556	100	1.2635	0.2288	1.2635	1.1241
No log	5.6667	102	1.3094	0.2934	1.3094	1.1443
No log	5.7778	104	1.2916	0.3478	1.2916	1.1365
No log	5.8889	106	1.2792	0.3711	1.2792	1.1310
No log	6.0	108	1.1841	0.3842	1.1841	1.0882
No log	6.1111	110	1.1145	0.3530	1.1145	1.0557
No log	6.2222	112	1.1349	0.3530	1.1349	1.0653
No log	6.3333	114	1.1372	0.3390	1.1372	1.0664
No log	6.4444	116	1.0846	0.3802	1.0846	1.0415
No log	6.5556	118	1.0657	0.3169	1.0657	1.0323
No log	6.6667	120	1.2181	0.2829	1.2181	1.1037
No log	6.7778	122	1.3071	0.2681	1.3071	1.1433
No log	6.8889	124	1.2637	0.3325	1.2637	1.1242
No log	7.0	126	1.2690	0.3820	1.2690	1.1265
No log	7.1111	128	1.4982	0.2968	1.4982	1.2240
No log	7.2222	130	1.8450	0.1489	1.8450	1.3583
No log	7.3333	132	1.6204	0.2465	1.6204	1.2730
No log	7.4444	134	1.1428	0.3261	1.1428	1.0690
No log	7.5556	136	1.0621	0.2706	1.0621	1.0306
No log	7.6667	138	1.0822	0.3725	1.0822	1.0403
No log	7.7778	140	1.4863	0.2647	1.4863	1.2191
No log	7.8889	142	1.9047	0.2060	1.9047	1.3801
No log	8.0	144	1.7680	0.2284	1.7680	1.3296
No log	8.1111	146	1.2775	0.3205	1.2775	1.1303
No log	8.2222	148	1.0142	0.3621	1.0142	1.0071
No log	8.3333	150	1.0102	0.3018	1.0102	1.0051
No log	8.4444	152	1.0803	0.3547	1.0803	1.0394
No log	8.5556	154	1.3113	0.2962	1.3113	1.1451
No log	8.6667	156	1.4558	0.3185	1.4558	1.2066
No log	8.7778	158	1.5107	0.2568	1.5107	1.2291
No log	8.8889	160	1.3630	0.3217	1.3630	1.1675
No log	9.0	162	1.1446	0.3958	1.1446	1.0698
No log	9.1111	164	1.0680	0.3734	1.0680	1.0334
No log	9.2222	166	1.2234	0.3813	1.2234	1.1061
No log	9.3333	168	1.5011	0.2937	1.5011	1.2252
No log	9.4444	170	1.4853	0.2911	1.4853	1.2187
No log	9.5556	172	1.2223	0.2958	1.2223	1.1056
No log	9.6667	174	1.0588	0.3405	1.0588	1.0290
No log	9.7778	176	1.0776	0.3243	1.0776	1.0381
No log	9.8889	178	1.1839	0.2590	1.1839	1.0881
No log	10.0	180	1.3469	0.3127	1.3469	1.1606
No log	10.1111	182	1.4877	0.2647	1.4877	1.2197
No log	10.2222	184	1.3390	0.3127	1.3390	1.1572
No log	10.3333	186	1.2337	0.2894	1.2337	1.1107
No log	10.4444	188	1.0549	0.3098	1.0549	1.0271
No log	10.5556	190	1.0289	0.2969	1.0289	1.0144
No log	10.6667	192	1.0870	0.3068	1.0870	1.0426
No log	10.7778	194	1.4185	0.2868	1.4185	1.1910
No log	10.8889	196	1.6155	0.3166	1.6155	1.2710
No log	11.0	198	1.4340	0.2985	1.4340	1.1975
No log	11.1111	200	1.1009	0.3696	1.1009	1.0492
No log	11.2222	202	1.0313	0.3230	1.0313	1.0155
No log	11.3333	204	1.0271	0.3117	1.0271	1.0135
No log	11.4444	206	1.1211	0.3220	1.1211	1.0588
No log	11.5556	208	1.4272	0.2822	1.4272	1.1947
No log	11.6667	210	1.5331	0.2726	1.5331	1.2382
No log	11.7778	212	1.4634	0.2647	1.4634	1.2097
No log	11.8889	214	1.2470	0.2223	1.2470	1.1167
No log	12.0	216	1.1117	0.2317	1.1117	1.0544
No log	12.1111	218	1.0992	0.2019	1.0992	1.0484
No log	12.2222	220	1.1860	0.2417	1.1860	1.0891
No log	12.3333	222	1.4701	0.2925	1.4701	1.2125
No log	12.4444	224	1.6448	0.2493	1.6448	1.2825
No log	12.5556	226	1.5714	0.2751	1.5714	1.2535
No log	12.6667	228	1.3530	0.2371	1.3530	1.1632
No log	12.7778	230	1.2521	0.1905	1.2521	1.1190
No log	12.8889	232	1.1520	0.1761	1.1520	1.0733
No log	13.0	234	1.1707	0.1658	1.1707	1.0820
No log	13.1111	236	1.3140	0.2503	1.3140	1.1463
No log	13.2222	238	1.5588	0.2925	1.5588	1.2485
No log	13.3333	240	1.5576	0.2925	1.5576	1.2480
No log	13.4444	242	1.3489	0.2534	1.3489	1.1614
No log	13.5556	244	1.1839	0.1658	1.1839	1.0881
No log	13.6667	246	1.1364	0.2233	1.1364	1.0660
No log	13.7778	248	1.1725	0.2119	1.1725	1.0828
No log	13.8889	250	1.2638	0.1405	1.2638	1.1242
No log	14.0	252	1.3565	0.2617	1.3565	1.1647
No log	14.1111	254	1.3079	0.1850	1.3079	1.1436
No log	14.2222	256	1.1942	0.2164	1.1942	1.0928
No log	14.3333	258	1.1337	0.2655	1.1337	1.0648
No log	14.4444	260	1.1242	0.2812	1.1242	1.0603
No log	14.5556	262	1.1251	0.2752	1.1251	1.0607
No log	14.6667	264	1.1279	0.4	1.1279	1.0620
No log	14.7778	266	1.1743	0.3220	1.1743	1.0837
No log	14.8889	268	1.1792	0.3308	1.1792	1.0859
No log	15.0	270	1.1490	0.2870	1.1490	1.0719
No log	15.1111	272	1.0685	0.2998	1.0685	1.0337
No log	15.2222	274	1.0213	0.2331	1.0213	1.0106
No log	15.3333	276	1.0706	0.2998	1.0706	1.0347
No log	15.4444	278	1.1908	0.2826	1.1908	1.0913
No log	15.5556	280	1.2850	0.2914	1.2850	1.1336
No log	15.6667	282	1.2333	0.2837	1.2333	1.1105
No log	15.7778	284	1.1003	0.2119	1.1003	1.0490
No log	15.8889	286	1.0255	0.2360	1.0255	1.0127
No log	16.0	288	1.0271	0.3145	1.0271	1.0134
No log	16.1111	290	1.0294	0.2360	1.0294	1.0146
No log	16.2222	292	1.0836	0.2432	1.0836	1.0410
No log	16.3333	294	1.2663	0.2173	1.2663	1.1253
No log	16.4444	296	1.4140	0.2163	1.4140	1.1891
No log	16.5556	298	1.4208	0.2163	1.4208	1.1920
No log	16.6667	300	1.2911	0.1989	1.2911	1.1363
No log	16.7778	302	1.1538	0.2009	1.1538	1.0742
No log	16.8889	304	1.0668	0.2290	1.0668	1.0328
No log	17.0	306	1.0450	0.2921	1.0450	1.0223
No log	17.1111	308	1.0738	0.2871	1.0738	1.0362
No log	17.2222	310	1.2287	0.2590	1.2287	1.1085
No log	17.3333	312	1.4822	0.2468	1.4822	1.2174
No log	17.4444	314	1.5483	0.2701	1.5483	1.2443
No log	17.5556	316	1.5037	0.2807	1.5037	1.2263
No log	17.6667	318	1.4171	0.2263	1.4171	1.1904
No log	17.7778	320	1.3756	0.2634	1.3756	1.1728
No log	17.8889	322	1.3128	0.2909	1.3128	1.1458
No log	18.0	324	1.2810	0.2650	1.2810	1.1318
No log	18.1111	326	1.2701	0.2381	1.2701	1.1270
No log	18.2222	328	1.2320	0.2381	1.2320	1.1100
No log	18.3333	330	1.1829	0.2829	1.1829	1.0876
No log	18.4444	332	1.1409	0.2432	1.1409	1.0681
No log	18.5556	334	1.1564	0.2432	1.1564	1.0754
No log	18.6667	336	1.2076	0.2586	1.2076	1.0989
No log	18.7778	338	1.2948	0.2542	1.2948	1.1379
No log	18.8889	340	1.2878	0.2542	1.2878	1.1348
No log	19.0	342	1.3025	0.2542	1.3025	1.1413
No log	19.1111	344	1.3143	0.2978	1.3143	1.1464
No log	19.2222	346	1.2308	0.2829	1.2308	1.1094
No log	19.3333	348	1.1627	0.2336	1.1627	1.0783
No log	19.4444	350	1.1408	0.1546	1.1408	1.0681
No log	19.5556	352	1.1876	0.2260	1.1876	1.0897
No log	19.6667	354	1.3588	0.3281	1.3588	1.1657
No log	19.7778	356	1.5024	0.3180	1.5024	1.2257
No log	19.8889	358	1.4396	0.3296	1.4396	1.1998
No log	20.0	360	1.3262	0.3249	1.3262	1.1516
No log	20.1111	362	1.3301	0.3024	1.3301	1.1533
No log	20.2222	364	1.3249	0.3197	1.3249	1.1510
No log	20.3333	366	1.2561	0.2681	1.2561	1.1207
No log	20.4444	368	1.2278	0.2558	1.2278	1.1081
No log	20.5556	370	1.2769	0.2558	1.2769	1.1300
No log	20.6667	372	1.3608	0.2650	1.3608	1.1665
No log	20.7778	374	1.5445	0.2099	1.5445	1.2428
No log	20.8889	376	1.6522	0.1627	1.6522	1.2854
No log	21.0	378	1.6166	0.1960	1.6166	1.2715
No log	21.1111	380	1.4676	0.2765	1.4676	1.2114
No log	21.2222	382	1.2655	0.2223	1.2655	1.1250
No log	21.3333	384	1.1212	0.1920	1.1212	1.0589
No log	21.4444	386	1.0843	0.2097	1.0843	1.0413
No log	21.5556	388	1.0701	0.1649	1.0701	1.0345
No log	21.6667	390	1.1349	0.2454	1.1349	1.0653
No log	21.7778	392	1.3038	0.2141	1.3038	1.1418
No log	21.8889	394	1.3979	0.1848	1.3979	1.1823
No log	22.0	396	1.4130	0.1848	1.4130	1.1887
No log	22.1111	398	1.3515	0.1848	1.3515	1.1625
No log	22.2222	400	1.2093	0.2650	1.2093	1.0997
No log	22.3333	402	1.1021	0.2076	1.1021	1.0498
No log	22.4444	404	1.0951	0.1667	1.0951	1.0465
No log	22.5556	406	1.1137	0.1977	1.1137	1.0553
No log	22.6667	408	1.2003	0.2558	1.2003	1.0956
No log	22.7778	410	1.3187	0.2542	1.3187	1.1484
No log	22.8889	412	1.3769	0.2574	1.3769	1.1734
No log	23.0	414	1.3508	0.2574	1.3508	1.1622
No log	23.1111	416	1.2976	0.2714	1.2976	1.1391
No log	23.2222	418	1.3038	0.2714	1.3038	1.1418
No log	23.3333	420	1.3520	0.2714	1.3520	1.1628
No log	23.4444	422	1.4282	0.1935	1.4282	1.1951
No log	23.5556	424	1.5401	0.2578	1.5401	1.2410
No log	23.6667	426	1.4855	0.2498	1.4855	1.2188
No log	23.7778	428	1.4054	0.2153	1.4054	1.1855
No log	23.8889	430	1.3345	0.1986	1.3345	1.1552
No log	24.0	432	1.2654	0.2829	1.2654	1.1249
No log	24.1111	434	1.2205	0.2516	1.2205	1.1048
No log	24.2222	436	1.2416	0.2439	1.2416	1.1143
No log	24.3333	438	1.2805	0.2330	1.2805	1.1316
No log	24.4444	440	1.3265	0.2403	1.3265	1.1517
No log	24.5556	442	1.3414	0.2471	1.3414	1.1582
No log	24.6667	444	1.3113	0.2721	1.3113	1.1451
No log	24.7778	446	1.3134	0.2069	1.3134	1.1460
No log	24.8889	448	1.3091	0.2542	1.3091	1.1442
No log	25.0	450	1.2918	0.2542	1.2918	1.1366
No log	25.1111	452	1.2685	0.2509	1.2685	1.1263
No log	25.2222	454	1.2492	0.2714	1.2492	1.1177
No log	25.3333	456	1.2167	0.1502	1.2167	1.1031
No log	25.4444	458	1.2255	0.1755	1.2255	1.1070
No log	25.5556	460	1.2736	0.2714	1.2736	1.1286
No log	25.6667	462	1.2920	0.2743	1.2920	1.1367
No log	25.7778	464	1.2785	0.2542	1.2785	1.1307
No log	25.8889	466	1.2551	0.2681	1.2551	1.1203
No log	26.0	468	1.2033	0.2590	1.2033	1.0969
No log	26.1111	470	1.1830	0.2590	1.1830	1.0877
No log	26.2222	472	1.2293	0.2542	1.2293	1.1087
No log	26.3333	474	1.3467	0.2605	1.3467	1.1605
No log	26.4444	476	1.3545	0.2574	1.3545	1.1638
No log	26.5556	478	1.3767	0.2212	1.3767	1.1733
No log	26.6667	480	1.3646	0.2212	1.3646	1.1682
No log	26.7778	482	1.3240	0.2173	1.3240	1.1506
No log	26.8889	484	1.2971	0.2542	1.2971	1.1389
No log	27.0	486	1.3060	0.2542	1.3060	1.1428
No log	27.1111	488	1.3142	0.2542	1.3142	1.1464
No log	27.2222	490	1.3796	0.2337	1.3796	1.1746
No log	27.3333	492	1.4119	0.2201	1.4119	1.1882
No log	27.4444	494	1.4351	0.1979	1.4351	1.1980
No log	27.5556	496	1.4102	0.1891	1.4102	1.1875
No log	27.6667	498	1.3142	0.2184	1.3142	1.1464
0.3353	27.7778	500	1.2036	0.2019	1.2036	1.0971
0.3353	27.8889	502	1.1883	0.1919	1.1883	1.0901
0.3353	28.0	504	1.2163	0.2119	1.2163	1.1029
0.3353	28.1111	506	1.2608	0.2651	1.2608	1.1228
0.3353	28.2222	508	1.3083	0.2046	1.3083	1.1438
0.3353	28.3333	510	1.3642	0.1844	1.3642	1.1680
0.3353	28.4444	512	1.3899	0.1844	1.3899	1.1789
0.3353	28.5556	514	1.3966	0.2278	1.3966	1.1818
0.3353	28.6667	516	1.3551	0.2278	1.3551	1.1641
0.3353	28.7778	518	1.2583	0.1750	1.2583	1.1218
0.3353	28.8889	520	1.2040	0.1344	1.2040	1.0973
0.3353	29.0	522	1.1506	0.1706	1.1506	1.0726
0.3353	29.1111	524	1.1443	0.1706	1.1443	1.0697
0.3353	29.2222	526	1.1630	0.2019	1.1630	1.0784

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1