ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2782
• Qwk: 0.1801
• Mse: 1.2782
• Rmse: 1.1306

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	4.7017	0.0042	4.7017	2.1683
No log	0.0816	4	2.8824	-0.0519	2.8824	1.6978
No log	0.1224	6	1.9469	0.0749	1.9469	1.3953
No log	0.1633	8	1.5525	0.0372	1.5525	1.2460
No log	0.2041	10	1.3767	0.0610	1.3767	1.1733
No log	0.2449	12	1.3049	0.1437	1.3049	1.1423
No log	0.2857	14	1.3996	0.0362	1.3996	1.1830
No log	0.3265	16	1.6257	0.0317	1.6257	1.2750
No log	0.3673	18	1.7006	0.0	1.7006	1.3041
No log	0.4082	20	1.5162	0.0317	1.5162	1.2313
No log	0.4490	22	1.3128	0.0104	1.3128	1.1458
No log	0.4898	24	1.1863	0.1995	1.1863	1.0892
No log	0.5306	26	1.2184	0.0628	1.2184	1.1038
No log	0.5714	28	1.2259	0.0741	1.2259	1.1072
No log	0.6122	30	1.2755	0.1791	1.2755	1.1294
No log	0.6531	32	1.4401	0.0254	1.4401	1.2001
No log	0.6939	34	1.4013	0.0169	1.4013	1.1838
No log	0.7347	36	1.4128	0.0403	1.4128	1.1886
No log	0.7755	38	1.3240	0.0449	1.3240	1.1507
No log	0.8163	40	1.2825	0.1288	1.2825	1.1325
No log	0.8571	42	1.2477	0.0952	1.2477	1.1170
No log	0.8980	44	1.2423	0.0573	1.2423	1.1146
No log	0.9388	46	1.1937	0.1144	1.1937	1.0926
No log	0.9796	48	1.2469	0.0454	1.2469	1.1167
No log	1.0204	50	1.2204	0.0454	1.2204	1.1047
No log	1.0612	52	1.1873	0.1632	1.1873	1.0896
No log	1.1020	54	1.3156	0.0362	1.3156	1.1470
No log	1.1429	56	1.5858	0.0317	1.5858	1.2593
No log	1.1837	58	1.5362	0.0317	1.5362	1.2394
No log	1.2245	60	1.3450	0.0426	1.3450	1.1597
No log	1.2653	62	1.2522	0.1753	1.2522	1.1190
No log	1.3061	64	1.1942	0.2360	1.1942	1.0928
No log	1.3469	66	1.1778	0.1444	1.1778	1.0853
No log	1.3878	68	1.2066	0.1214	1.2066	1.0985
No log	1.4286	70	1.1795	0.1504	1.1795	1.0861
No log	1.4694	72	1.1682	0.1814	1.1682	1.0808
No log	1.5102	74	1.1139	0.2132	1.1139	1.0554
No log	1.5510	76	1.1126	0.3427	1.1126	1.0548
No log	1.5918	78	1.1326	0.2417	1.1326	1.0643
No log	1.6327	80	1.0988	0.3502	1.0988	1.0482
No log	1.6735	82	1.0799	0.2025	1.0799	1.0392
No log	1.7143	84	1.0357	0.4039	1.0357	1.0177
No log	1.7551	86	0.9949	0.3463	0.9949	0.9975
No log	1.7959	88	0.9968	0.2947	0.9968	0.9984
No log	1.8367	90	1.0521	0.2409	1.0521	1.0257
No log	1.8776	92	1.1287	0.2056	1.1287	1.0624
No log	1.9184	94	1.1776	0.1903	1.1776	1.0852
No log	1.9592	96	1.2442	0.1611	1.2442	1.1154
No log	2.0	98	1.2147	0.1517	1.2147	1.1021
No log	2.0408	100	1.1371	0.2525	1.1371	1.0664
No log	2.0816	102	1.1780	0.1997	1.1780	1.0853
No log	2.1224	104	1.1325	0.2381	1.1325	1.0642
No log	2.1633	106	1.0367	0.3042	1.0367	1.0182
No log	2.2041	108	1.0282	0.3565	1.0282	1.0140
No log	2.2449	110	1.0681	0.2015	1.0681	1.0335
No log	2.2857	112	1.2782	0.3347	1.2782	1.1306
No log	2.3265	114	1.5493	0.2797	1.5493	1.2447
No log	2.3673	116	1.5318	0.2471	1.5318	1.2377
No log	2.4082	118	1.3350	0.3738	1.3350	1.1554
No log	2.4490	120	1.1919	0.3317	1.1919	1.0917
No log	2.4898	122	1.0635	0.3113	1.0635	1.0312
No log	2.5306	124	1.0582	0.2933	1.0582	1.0287
No log	2.5714	126	1.1832	0.3658	1.1832	1.0878
No log	2.6122	128	1.4772	0.3311	1.4772	1.2154
No log	2.6531	130	1.6240	0.2545	1.6240	1.2743
No log	2.6939	132	1.5089	0.3118	1.5089	1.2284
No log	2.7347	134	1.3622	0.3375	1.3622	1.1671
No log	2.7755	136	1.4678	0.3331	1.4678	1.2115
No log	2.8163	138	1.4545	0.3449	1.4545	1.2060
No log	2.8571	140	1.4585	0.3229	1.4585	1.2077
No log	2.8980	142	1.3700	0.3185	1.3700	1.1705
No log	2.9388	144	1.3624	0.3228	1.3624	1.1672
No log	2.9796	146	1.5157	0.3110	1.5157	1.2311
No log	3.0204	148	1.7814	0.2731	1.7814	1.3347
No log	3.0612	150	1.7496	0.2731	1.7496	1.3227
No log	3.1020	152	1.4394	0.2925	1.4394	1.1997
No log	3.1429	154	1.1853	0.2934	1.1853	1.0887
No log	3.1837	156	1.2261	0.3317	1.2261	1.1073
No log	3.2245	158	1.4467	0.3118	1.4467	1.2028
No log	3.2653	160	1.7284	0.3009	1.7284	1.3147
No log	3.3061	162	1.7123	0.2689	1.7123	1.3086
No log	3.3469	164	1.5606	0.3132	1.5606	1.2492
No log	3.3878	166	1.3735	0.3650	1.3735	1.1720
No log	3.4286	168	1.3508	0.2716	1.3508	1.1623
No log	3.4694	170	1.5498	0.2430	1.5498	1.2449
No log	3.5102	172	1.8918	0.1753	1.8918	1.3754
No log	3.5510	174	1.8578	0.2038	1.8578	1.3630
No log	3.5918	176	1.6003	0.2446	1.6003	1.2650
No log	3.6327	178	1.4805	0.2006	1.4805	1.2168
No log	3.6735	180	1.5783	0.2210	1.5783	1.2563
No log	3.7143	182	1.7071	0.2667	1.7071	1.3066
No log	3.7551	184	1.5946	0.2107	1.5946	1.2628
No log	3.7959	186	1.3572	0.2875	1.3572	1.1650
No log	3.8367	188	1.2985	0.2223	1.2985	1.1395
No log	3.8776	190	1.3641	0.2503	1.3641	1.1680
No log	3.9184	192	1.4063	0.2503	1.4063	1.1859
No log	3.9592	194	1.3648	0.2503	1.3648	1.1682
No log	4.0	196	1.2412	0.2953	1.2412	1.1141
No log	4.0408	198	1.2735	0.3024	1.2735	1.1285
No log	4.0816	200	1.4739	0.3006	1.4739	1.2141
No log	4.1224	202	1.6190	0.2797	1.6190	1.2724
No log	4.1633	204	1.5822	0.2973	1.5822	1.2578
No log	4.2041	206	1.3767	0.2701	1.3767	1.1733
No log	4.2449	208	1.3607	0.2620	1.3607	1.1665
No log	4.2857	210	1.2791	0.2634	1.2791	1.1310
No log	4.3265	212	1.2511	0.2236	1.2511	1.1185
No log	4.3673	214	1.1855	0.2702	1.1855	1.0888
No log	4.4082	216	1.2513	0.2084	1.2513	1.1186
No log	4.4490	218	1.4507	0.2701	1.4507	1.2044
No log	4.4898	220	1.7349	0.2735	1.7349	1.3171
No log	4.5306	222	1.8163	0.2038	1.8163	1.3477
No log	4.5714	224	1.8051	0.2170	1.8051	1.3436
No log	4.6122	226	1.7488	0.2141	1.7488	1.3224
No log	4.6531	228	1.5436	0.2576	1.5436	1.2424
No log	4.6939	230	1.3983	0.2868	1.3983	1.1825
No log	4.7347	232	1.3660	0.3143	1.3660	1.1688
No log	4.7755	234	1.3628	0.2775	1.3628	1.1674
No log	4.8163	236	1.5428	0.3008	1.5428	1.2421
No log	4.8571	238	1.6242	0.3025	1.6242	1.2744
No log	4.8980	240	1.5019	0.2935	1.5019	1.2255
No log	4.9388	242	1.2216	0.2693	1.2216	1.1053
No log	4.9796	244	1.1211	0.2248	1.1211	1.0588
No log	5.0204	246	1.1510	0.2195	1.1510	1.0728
No log	5.0612	248	1.3066	0.3293	1.3066	1.1431
No log	5.1020	250	1.4100	0.3026	1.4100	1.1874
No log	5.1429	252	1.3143	0.2870	1.3143	1.1464
No log	5.1837	254	1.1991	0.2046	1.1991	1.0950
No log	5.2245	256	1.1676	0.2195	1.1676	1.0805
No log	5.2653	258	1.2092	0.2367	1.2092	1.0996
No log	5.3061	260	1.3001	0.2961	1.3001	1.1402
No log	5.3469	262	1.3652	0.2903	1.3652	1.1684
No log	5.3878	264	1.4223	0.2829	1.4224	1.1926
No log	5.4286	266	1.3130	0.2647	1.3130	1.1458
No log	5.4694	268	1.1603	0.2762	1.1603	1.0772
No log	5.5102	270	1.1162	0.2830	1.1162	1.0565
No log	5.5510	272	1.1446	0.2762	1.1446	1.0699
No log	5.5918	274	1.3525	0.3143	1.3525	1.1630
No log	5.6327	276	1.6626	0.3219	1.6626	1.2894
No log	5.6735	278	1.8931	0.1785	1.8931	1.3759
No log	5.7143	280	1.7699	0.2419	1.7699	1.3304
No log	5.7551	282	1.4455	0.2217	1.4455	1.2023
No log	5.7959	284	1.2054	0.2829	1.2054	1.0979
No log	5.8367	286	1.1619	0.2164	1.1619	1.0779
No log	5.8776	288	1.2101	0.3095	1.2101	1.1001
No log	5.9184	290	1.3498	0.3003	1.3498	1.1618
No log	5.9592	292	1.3728	0.2589	1.3728	1.1717
No log	6.0	294	1.2604	0.2696	1.2604	1.1227
No log	6.0408	296	1.1509	0.1701	1.1509	1.0728
No log	6.0816	298	1.1520	0.1701	1.1520	1.0733
No log	6.1224	300	1.1972	0.2552	1.1972	1.0942
No log	6.1633	302	1.3265	0.2980	1.3265	1.1517
No log	6.2041	304	1.3843	0.2239	1.3843	1.1766
No log	6.2449	306	1.3091	0.2725	1.3091	1.1442
No log	6.2857	308	1.2278	0.3212	1.2278	1.1081
No log	6.3265	310	1.1932	0.3192	1.1932	1.0923
No log	6.3673	312	1.1784	0.3049	1.1784	1.0856
No log	6.4082	314	1.1941	0.2864	1.1941	1.0927
No log	6.4490	316	1.2016	0.2864	1.2016	1.0962
No log	6.4898	318	1.2111	0.2602	1.2111	1.1005
No log	6.5306	320	1.1509	0.2402	1.1509	1.0728
No log	6.5714	322	1.1607	0.2263	1.1607	1.0773
No log	6.6122	324	1.2467	0.3072	1.2467	1.1165
No log	6.6531	326	1.2922	0.2747	1.2922	1.1368
No log	6.6939	328	1.2689	0.2875	1.2689	1.1265
No log	6.7347	330	1.3494	0.3210	1.3494	1.1617
No log	6.7755	332	1.4935	0.3431	1.4935	1.2221
No log	6.8163	334	1.4904	0.3738	1.4904	1.2208
No log	6.8571	336	1.4344	0.3851	1.4344	1.1977
No log	6.8980	338	1.2866	0.3210	1.2866	1.1343
No log	6.9388	340	1.2780	0.3210	1.2780	1.1305
No log	6.9796	342	1.2635	0.3210	1.2635	1.1240
No log	7.0204	344	1.2489	0.3136	1.2489	1.1176
No log	7.0612	346	1.2164	0.3341	1.2164	1.1029
No log	7.1020	348	1.1706	0.2884	1.1706	1.0820
No log	7.1429	350	1.1593	0.2857	1.1593	1.0767
No log	7.1837	352	1.2242	0.2978	1.2242	1.1064
No log	7.2245	354	1.3505	0.3243	1.3505	1.1621
No log	7.2653	356	1.4856	0.2886	1.4856	1.2189
No log	7.3061	358	1.4869	0.3205	1.4869	1.2194
No log	7.3469	360	1.3871	0.3106	1.3871	1.1778
No log	7.3878	362	1.2761	0.3088	1.2761	1.1296
No log	7.4286	364	1.2981	0.3088	1.2981	1.1393
No log	7.4694	366	1.3855	0.3210	1.3855	1.1771
No log	7.5102	368	1.3437	0.3210	1.3437	1.1592
No log	7.5510	370	1.3005	0.3590	1.3005	1.1404
No log	7.5918	372	1.2952	0.3357	1.2952	1.1381
No log	7.6327	374	1.3517	0.3113	1.3517	1.1626
No log	7.6735	376	1.2931	0.3071	1.2931	1.1371
No log	7.7143	378	1.2064	0.2780	1.2064	1.0984
No log	7.7551	380	1.1327	0.1801	1.1327	1.0643
No log	7.7959	382	1.1416	0.2402	1.1416	1.0685
No log	7.8367	384	1.2378	0.2424	1.2378	1.1126
No log	7.8776	386	1.4898	0.3006	1.4898	1.2206
No log	7.9184	388	1.6999	0.2867	1.6999	1.3038
No log	7.9592	390	1.6928	0.2713	1.6928	1.3011
No log	8.0	392	1.4933	0.2343	1.4933	1.2220
No log	8.0408	394	1.2964	0.2263	1.2964	1.1386
No log	8.0816	396	1.1808	0.1853	1.1808	1.0866
No log	8.1224	398	1.1527	0.1717	1.1527	1.0736
No log	8.1633	400	1.1660	0.2110	1.1660	1.0798
No log	8.2041	402	1.2067	0.2141	1.2067	1.0985
No log	8.2449	404	1.2311	0.2665	1.2311	1.1095
No log	8.2857	406	1.2373	0.2263	1.2373	1.1124
No log	8.3265	408	1.2239	0.2263	1.2239	1.1063
No log	8.3673	410	1.2075	0.2542	1.2075	1.0989
No log	8.4082	412	1.2558	0.2693	1.2558	1.1206
No log	8.4490	414	1.3503	0.3227	1.3503	1.1620
No log	8.4898	416	1.3083	0.3192	1.3083	1.1438
No log	8.5306	418	1.2639	0.2664	1.2639	1.1242
No log	8.5714	420	1.3492	0.3192	1.3492	1.1616
No log	8.6122	422	1.3686	0.3227	1.3686	1.1699
No log	8.6531	424	1.2791	0.2664	1.2791	1.1310
No log	8.6939	426	1.1884	0.2195	1.1884	1.0901
No log	8.7347	428	1.2137	0.2291	1.2137	1.1017
No log	8.7755	430	1.3357	0.2938	1.3357	1.1557
No log	8.8163	432	1.3995	0.2918	1.3995	1.1830
No log	8.8571	434	1.3302	0.2097	1.3302	1.1533
No log	8.8980	436	1.2823	0.2097	1.2823	1.1324
No log	8.9388	438	1.3105	0.2634	1.3105	1.1448
No log	8.9796	440	1.3076	0.2349	1.3076	1.1435
No log	9.0204	442	1.3803	0.3402	1.3803	1.1748
No log	9.0612	444	1.3916	0.3047	1.3916	1.1797
No log	9.1020	446	1.4225	0.2619	1.4225	1.1927
No log	9.1429	448	1.4383	0.2115	1.4383	1.1993
No log	9.1837	450	1.3891	0.1703	1.3891	1.1786
No log	9.2245	452	1.3766	0.1850	1.3766	1.1733
No log	9.2653	454	1.3679	0.1703	1.3679	1.1696
No log	9.3061	456	1.3092	0.1850	1.3092	1.1442
No log	9.3469	458	1.2878	0.1850	1.2878	1.1348
No log	9.3878	460	1.3198	0.1313	1.3198	1.1488
No log	9.4286	462	1.3358	0.1313	1.3358	1.1558
No log	9.4694	464	1.2997	0.1313	1.2997	1.1401
No log	9.5102	466	1.2078	0.2291	1.2078	1.0990
No log	9.5510	468	1.1568	0.2343	1.1568	1.0755
No log	9.5918	470	1.1578	0.1820	1.1578	1.0760
No log	9.6327	472	1.1671	0.1977	1.1671	1.0803
No log	9.6735	474	1.2049	0.2304	1.2049	1.0977
No log	9.7143	476	1.3139	0.1703	1.3139	1.1463
No log	9.7551	478	1.4618	0.2309	1.4618	1.2090
No log	9.7959	480	1.4837	0.2262	1.4837	1.2181
No log	9.8367	482	1.3757	0.2301	1.3757	1.1729
No log	9.8776	484	1.2975	0.2152	1.2975	1.1391
No log	9.9184	486	1.2487	0.2152	1.2487	1.1175
No log	9.9592	488	1.2288	0.2195	1.2288	1.1085
No log	10.0	490	1.1900	0.2490	1.1900	1.0909
No log	10.0408	492	1.1977	0.2343	1.1977	1.0944
No log	10.0816	494	1.2666	0.1850	1.2666	1.1254
No log	10.1224	496	1.3124	0.2634	1.3124	1.1456
No log	10.1633	498	1.3295	0.2664	1.3295	1.1531
0.3896	10.2041	500	1.3635	0.1979	1.3635	1.1677
0.3896	10.2449	502	1.3203	0.2664	1.3203	1.1491
0.3896	10.2857	504	1.2858	0.2634	1.2858	1.1339
0.3896	10.3265	506	1.3211	0.2961	1.3211	1.1494
0.3896	10.3673	508	1.3516	0.2961	1.3516	1.1626
0.3896	10.4082	510	1.3898	0.2961	1.3898	1.1789
0.3896	10.4490	512	1.4296	0.2647	1.4296	1.1956
0.3896	10.4898	514	1.3793	0.2619	1.3793	1.1744
0.3896	10.5306	516	1.2544	0.2395	1.2544	1.1200
0.3896	10.5714	518	1.1896	0.1919	1.1896	1.0907
0.3896	10.6122	520	1.1871	0.1977	1.1871	1.0895
0.3896	10.6531	522	1.2169	0.2110	1.2169	1.1032
0.3896	10.6939	524	1.3573	0.2634	1.3573	1.1650
0.3896	10.7347	526	1.4725	0.2375	1.4725	1.2135
0.3896	10.7755	528	1.4836	0.2375	1.4836	1.2180
0.3896	10.8163	530	1.3700	0.2520	1.3700	1.1705
0.3896	10.8571	532	1.2634	0.2714	1.2634	1.1240
0.3896	10.8980	534	1.2455	0.2714	1.2455	1.1160
0.3896	10.9388	536	1.3052	0.2460	1.3052	1.1425
0.3896	10.9796	538	1.3697	0.2833	1.3697	1.1703
0.3896	11.0204	540	1.3863	0.2833	1.3863	1.1774
0.3896	11.0612	542	1.3939	0.3067	1.3939	1.1806
0.3896	11.1020	544	1.3261	0.2250	1.3261	1.1516
0.3896	11.1429	546	1.3099	0.2212	1.3099	1.1445
0.3896	11.1837	548	1.3406	0.2250	1.3406	1.1579
0.3896	11.2245	550	1.3279	0.2212	1.3279	1.1524
0.3896	11.2653	552	1.2586	0.2403	1.2586	1.1219
0.3896	11.3061	554	1.2191	0.1853	1.2191	1.1041
0.3896	11.3469	556	1.2674	0.2032	1.2674	1.1258
0.3896	11.3878	558	1.3503	0.2807	1.3503	1.1620
0.3896	11.4286	560	1.3393	0.2032	1.3393	1.1573
0.3896	11.4694	562	1.2770	0.1405	1.2770	1.1301
0.3896	11.5102	564	1.1992	0.1795	1.1992	1.0951
0.3896	11.5510	566	1.1769	0.1801	1.1769	1.0849
0.3896	11.5918	568	1.2023	0.1952	1.2023	1.0965
0.3896	11.6327	570	1.2782	0.1801	1.2782	1.1306

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1