ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3076
• Qwk: 0.2288
• Mse: 1.3076
• Rmse: 1.1435

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1818	2	4.8149	-0.0214	4.8149	2.1943
No log	0.3636	4	2.6152	0.0274	2.6152	1.6172
No log	0.5455	6	1.8265	0.0683	1.8265	1.3515
No log	0.7273	8	1.6922	0.0222	1.6922	1.3008
No log	0.9091	10	1.1989	0.1176	1.1989	1.0950
No log	1.0909	12	1.2812	0.0439	1.2812	1.1319
No log	1.2727	14	1.4025	-0.0234	1.4025	1.1843
No log	1.4545	16	1.5191	-0.0029	1.5191	1.2325
No log	1.6364	18	1.4466	-0.0795	1.4466	1.2027
No log	1.8182	20	1.7521	-0.0126	1.7521	1.3237
No log	2.0	22	1.9764	-0.0061	1.9764	1.4058
No log	2.1818	24	1.8051	-0.0126	1.8051	1.3435
No log	2.3636	26	1.6007	0.0057	1.6007	1.2652
No log	2.5455	28	1.8773	-0.0202	1.8773	1.3701
No log	2.7273	30	2.1194	0.0277	2.1194	1.4558
No log	2.9091	32	1.9581	0.0504	1.9581	1.3993
No log	3.0909	34	1.5453	-0.0674	1.5453	1.2431
No log	3.2727	36	1.2999	0.0914	1.2999	1.1401
No log	3.4545	38	1.3539	0.2061	1.3539	1.1636
No log	3.6364	40	1.3417	0.1961	1.3417	1.1583
No log	3.8182	42	1.2802	0.1517	1.2802	1.1314
No log	4.0	44	1.4004	-0.0047	1.4004	1.1834
No log	4.1818	46	1.4426	0.0104	1.4426	1.2011
No log	4.3636	48	1.3499	0.0688	1.3499	1.1619
No log	4.5455	50	1.2453	0.1493	1.2453	1.1159
No log	4.7273	52	1.2752	0.2276	1.2752	1.1293
No log	4.9091	54	1.3036	0.2752	1.3036	1.1418
No log	5.0909	56	1.3080	0.2273	1.3080	1.1437
No log	5.2727	58	1.3025	0.1888	1.3025	1.1413
No log	5.4545	60	1.3554	0.2389	1.3554	1.1642
No log	5.6364	62	1.3768	0.1644	1.3768	1.1734
No log	5.8182	64	1.3706	0.2374	1.3706	1.1707
No log	6.0	66	1.3722	0.2454	1.3722	1.1714
No log	6.1818	68	1.3786	0.2559	1.3786	1.1741
No log	6.3636	70	1.4582	0.2784	1.4582	1.2076
No log	6.5455	72	1.3879	0.3481	1.3879	1.1781
No log	6.7273	74	1.2573	0.3281	1.2573	1.1213
No log	6.9091	76	1.2642	0.3699	1.2642	1.1244
No log	7.0909	78	1.1664	0.3165	1.1664	1.0800
No log	7.2727	80	1.2146	0.3400	1.2146	1.1021
No log	7.4545	82	1.5901	0.2764	1.5901	1.2610
No log	7.6364	84	1.6875	0.2074	1.6875	1.2991
No log	7.8182	86	1.3330	0.2846	1.3330	1.1546
No log	8.0	88	1.1789	0.2955	1.1789	1.0858
No log	8.1818	90	1.1634	0.1959	1.1634	1.0786
No log	8.3636	92	1.1401	0.2850	1.1401	1.0678
No log	8.5455	94	1.2421	0.2894	1.2421	1.1145
No log	8.7273	96	1.4736	0.3024	1.4736	1.2139
No log	8.9091	98	1.4869	0.2970	1.4869	1.2194
No log	9.0909	100	1.4700	0.2895	1.4700	1.2124
No log	9.2727	102	1.3069	0.2463	1.3069	1.1432
No log	9.4545	104	1.2080	0.2701	1.2080	1.0991
No log	9.6364	106	1.2201	0.3065	1.2201	1.1046
No log	9.8182	108	1.2376	0.2424	1.2376	1.1125
No log	10.0	110	1.3303	0.2309	1.3303	1.1534
No log	10.1818	112	1.4496	0.3083	1.4496	1.2040
No log	10.3636	114	1.4144	0.2509	1.4144	1.1893
No log	10.5455	116	1.4084	0.2514	1.4084	1.1868
No log	10.7273	118	1.4537	0.2201	1.4537	1.2057
No log	10.9091	120	1.4915	0.1358	1.4915	1.2213
No log	11.0909	122	1.6116	0.1923	1.6116	1.2695
No log	11.2727	124	1.6057	0.1843	1.6057	1.2672
No log	11.4545	126	1.4093	0.1159	1.4093	1.1871
No log	11.6364	128	1.3109	0.1860	1.3109	1.1449
No log	11.8182	130	1.2820	0.2231	1.2820	1.1323
No log	12.0	132	1.2696	0.2132	1.2696	1.1267
No log	12.1818	134	1.3214	0.1825	1.3214	1.1495
No log	12.3636	136	1.3967	0.2003	1.3967	1.1818
No log	12.5455	138	1.4054	0.1913	1.4054	1.1855
No log	12.7273	140	1.3839	0.2011	1.3839	1.1764
No log	12.9091	142	1.3277	0.2322	1.3277	1.1523
No log	13.0909	144	1.3346	0.2322	1.3346	1.1552
No log	13.2727	146	1.3988	0.2491	1.3988	1.1827
No log	13.4545	148	1.5309	0.1408	1.5309	1.2373
No log	13.6364	150	1.4736	0.1649	1.4736	1.2139
No log	13.8182	152	1.4190	0.1867	1.4190	1.1912
No log	14.0	154	1.3287	0.2020	1.3287	1.1527
No log	14.1818	156	1.2871	0.2271	1.2871	1.1345
No log	14.3636	158	1.3342	0.1430	1.3342	1.1551
No log	14.5455	160	1.3896	0.0711	1.3896	1.1788
No log	14.7273	162	1.4170	0.0685	1.4170	1.1904
No log	14.9091	164	1.3722	0.0500	1.3722	1.1714
No log	15.0909	166	1.3743	0.1037	1.3743	1.1723
No log	15.2727	168	1.4137	0.1338	1.4137	1.1890
No log	15.4545	170	1.3534	0.1968	1.3534	1.1634
No log	15.6364	172	1.3043	0.2199	1.3043	1.1421
No log	15.8182	174	1.3274	0.1176	1.3274	1.1521
No log	16.0	176	1.3173	0.1176	1.3173	1.1477
No log	16.1818	178	1.2766	0.2658	1.2766	1.1299
No log	16.3636	180	1.3106	0.2121	1.3106	1.1448
No log	16.5455	182	1.4535	0.2069	1.4535	1.2056
No log	16.7273	184	1.5280	0.2113	1.5280	1.2361
No log	16.9091	186	1.4371	0.2765	1.4371	1.1988
No log	17.0909	188	1.2771	0.2712	1.2771	1.1301
No log	17.2727	190	1.2076	0.2925	1.2076	1.0989
No log	17.4545	192	1.1916	0.2676	1.1916	1.0916
No log	17.6364	194	1.2207	0.2838	1.2207	1.1049
No log	17.8182	196	1.3416	0.2563	1.3416	1.1583
No log	18.0	198	1.4222	0.2880	1.4222	1.1926
No log	18.1818	200	1.4503	0.3332	1.4503	1.2043
No log	18.3636	202	1.3704	0.3432	1.3704	1.1706
No log	18.5455	204	1.3494	0.3249	1.3494	1.1616
No log	18.7273	206	1.3867	0.2668	1.3867	1.1776
No log	18.9091	208	1.4452	0.1481	1.4452	1.2022
No log	19.0909	210	1.5197	0.1888	1.5197	1.2328
No log	19.2727	212	1.5100	0.2092	1.5100	1.2288
No log	19.4545	214	1.4096	0.2800	1.4096	1.1873
No log	19.6364	216	1.3544	0.2701	1.3544	1.1638
No log	19.8182	218	1.3700	0.2654	1.3700	1.1705
No log	20.0	220	1.4389	0.2444	1.4389	1.1996
No log	20.1818	222	1.4292	0.2037	1.4292	1.1955
No log	20.3636	224	1.3185	0.2481	1.3185	1.1483
No log	20.5455	226	1.2544	0.2783	1.2544	1.1200
No log	20.7273	228	1.2701	0.2811	1.2701	1.1270
No log	20.9091	230	1.3800	0.2956	1.3800	1.1747
No log	21.0909	232	1.5250	0.1966	1.5250	1.2349
No log	21.2727	234	1.4805	0.2461	1.4805	1.2168
No log	21.4545	236	1.3151	0.2712	1.3151	1.1468
No log	21.6364	238	1.2151	0.2783	1.2151	1.1023
No log	21.8182	240	1.1754	0.2754	1.1754	1.0841
No log	22.0	242	1.1615	0.2692	1.1615	1.0777
No log	22.1818	244	1.1817	0.2231	1.1817	1.0870
No log	22.3636	246	1.1833	0.2231	1.1833	1.0878
No log	22.5455	248	1.2417	0.2623	1.2417	1.1143
No log	22.7273	250	1.2693	0.2739	1.2693	1.1266
No log	22.9091	252	1.3587	0.3080	1.3587	1.1656
No log	23.0909	254	1.4721	0.2720	1.4721	1.2133
No log	23.2727	256	1.4179	0.3116	1.4179	1.1908
No log	23.4545	258	1.2652	0.3127	1.2652	1.1248
No log	23.6364	260	1.1877	0.2754	1.1877	1.0898
No log	23.8182	262	1.1727	0.2477	1.1727	1.0829
No log	24.0	264	1.1547	0.2477	1.1547	1.0746
No log	24.1818	266	1.1442	0.2360	1.1442	1.0697
No log	24.3636	268	1.1634	0.2692	1.1634	1.0786
No log	24.5455	270	1.1941	0.2539	1.1941	1.0928
No log	24.7273	272	1.2627	0.2015	1.2627	1.1237
No log	24.9091	274	1.3010	0.2235	1.3010	1.1406
No log	25.0909	276	1.2977	0.2532	1.2977	1.1392
No log	25.2727	278	1.2605	0.2909	1.2605	1.1227
No log	25.4545	280	1.1970	0.3157	1.1970	1.0941
No log	25.6364	282	1.1819	0.3292	1.1819	1.0871
No log	25.8182	284	1.2126	0.3326	1.2126	1.1012
No log	26.0	286	1.2919	0.3081	1.2919	1.1366
No log	26.1818	288	1.3228	0.3326	1.3228	1.1501
No log	26.3636	290	1.3149	0.3715	1.3149	1.1467
No log	26.5455	292	1.2120	0.3146	1.2120	1.1009
No log	26.7273	294	1.1378	0.2811	1.1378	1.0667
No log	26.9091	296	1.1295	0.2783	1.1295	1.0628
No log	27.0909	298	1.1537	0.2783	1.1537	1.0741
No log	27.2727	300	1.2441	0.2773	1.2441	1.1154
No log	27.4545	302	1.3448	0.2663	1.3448	1.1597
No log	27.6364	304	1.3990	0.2191	1.3990	1.1828
No log	27.8182	306	1.4002	0.2191	1.4002	1.1833
No log	28.0	308	1.3759	0.1892	1.3759	1.1730
No log	28.1818	310	1.2882	0.2110	1.2882	1.1350
No log	28.3636	312	1.1982	0.2893	1.1982	1.0946
No log	28.5455	314	1.1610	0.2360	1.1610	1.0775
No log	28.7273	316	1.1634	0.2401	1.1634	1.0786
No log	28.9091	318	1.2224	0.2673	1.2224	1.1056
No log	29.0909	320	1.3165	0.2235	1.3165	1.1474
No log	29.2727	322	1.3153	0.2864	1.3153	1.1469
No log	29.4545	324	1.3083	0.3349	1.3083	1.1438
No log	29.6364	326	1.2257	0.3115	1.2257	1.1071
No log	29.8182	328	1.1891	0.3019	1.1891	1.0904
No log	30.0	330	1.1878	0.3019	1.1878	1.0899
No log	30.1818	332	1.2321	0.3464	1.2321	1.1100
No log	30.3636	334	1.3177	0.3191	1.3177	1.1479
No log	30.5455	336	1.3598	0.3243	1.3598	1.1661
No log	30.7273	338	1.3845	0.2885	1.3845	1.1766
No log	30.9091	340	1.3309	0.3348	1.3309	1.1536
No log	31.0909	342	1.2829	0.3725	1.2829	1.1327
No log	31.2727	344	1.2565	0.3211	1.2565	1.1210
No log	31.4545	346	1.2773	0.2801	1.2773	1.1302
No log	31.6364	348	1.3380	0.1764	1.3380	1.1567
No log	31.8182	350	1.4183	0.1554	1.4183	1.1909
No log	32.0	352	1.4325	0.1891	1.4325	1.1969
No log	32.1818	354	1.3618	0.1611	1.3618	1.1669
No log	32.3636	356	1.2672	0.3069	1.2672	1.1257
No log	32.5455	358	1.2406	0.3069	1.2406	1.1138
No log	32.7273	360	1.2207	0.2754	1.2207	1.1048
No log	32.9091	362	1.2316	0.3019	1.2316	1.1098
No log	33.0909	364	1.2412	0.3043	1.2412	1.1141
No log	33.2727	366	1.2789	0.3285	1.2789	1.1309
No log	33.4545	368	1.3394	0.3491	1.3394	1.1573
No log	33.6364	370	1.3227	0.2397	1.3227	1.1501
No log	33.8182	372	1.2677	0.2810	1.2677	1.1259
No log	34.0	374	1.2133	0.2522	1.2133	1.1015
No log	34.1818	376	1.2010	0.2522	1.2010	1.0959
No log	34.3636	378	1.2133	0.2801	1.2133	1.1015
No log	34.5455	380	1.2323	0.3091	1.2323	1.1101
No log	34.7273	382	1.2401	0.3249	1.2401	1.1136
No log	34.9091	384	1.2534	0.3310	1.2534	1.1195
No log	35.0909	386	1.2668	0.3415	1.2668	1.1255
No log	35.2727	388	1.2618	0.3400	1.2618	1.1233
No log	35.4545	390	1.2702	0.3584	1.2702	1.1270
No log	35.6364	392	1.2684	0.3451	1.2684	1.1262
No log	35.8182	394	1.2257	0.2871	1.2257	1.1071
No log	36.0	396	1.2157	0.2871	1.2157	1.1026
No log	36.1818	398	1.2159	0.2871	1.2159	1.1027
No log	36.3636	400	1.2354	0.3144	1.2354	1.1115
No log	36.5455	402	1.2358	0.3289	1.2358	1.1117
No log	36.7273	404	1.2476	0.3091	1.2476	1.1170
No log	36.9091	406	1.2807	0.3359	1.2807	1.1317
No log	37.0909	408	1.2595	0.3268	1.2595	1.1223
No log	37.2727	410	1.2324	0.3136	1.2324	1.1102
No log	37.4545	412	1.2356	0.3091	1.2356	1.1116
No log	37.6364	414	1.2939	0.2999	1.2939	1.1375
No log	37.8182	416	1.3515	0.2164	1.3515	1.1625
No log	38.0	418	1.3697	0.2775	1.3697	1.1703
No log	38.1818	420	1.3372	0.2875	1.3372	1.1564
No log	38.3636	422	1.2986	0.3430	1.2986	1.1395
No log	38.5455	424	1.2829	0.3310	1.2829	1.1327
No log	38.7273	426	1.2885	0.3415	1.2885	1.1351
No log	38.9091	428	1.3080	0.3478	1.3080	1.1437
No log	39.0909	430	1.3258	0.2889	1.3258	1.1514
No log	39.2727	432	1.3661	0.2032	1.3661	1.1688
No log	39.4545	434	1.3933	0.1618	1.3933	1.1804
No log	39.6364	436	1.3515	0.1753	1.3515	1.1625
No log	39.8182	438	1.2853	0.2951	1.2853	1.1337
No log	40.0	440	1.2400	0.3289	1.2400	1.1135
No log	40.1818	442	1.2377	0.3289	1.2377	1.1125
No log	40.3636	444	1.2540	0.3343	1.2540	1.1198
No log	40.5455	446	1.2913	0.3243	1.2913	1.1363
No log	40.7273	448	1.3624	0.2029	1.3624	1.1672
No log	40.9091	450	1.3737	0.2029	1.3737	1.1721
No log	41.0909	452	1.3436	0.3064	1.3436	1.1591
No log	41.2727	454	1.2978	0.3173	1.2978	1.1392
No log	41.4545	456	1.2453	0.3157	1.2453	1.1159
No log	41.6364	458	1.2230	0.3019	1.2230	1.1059
No log	41.8182	460	1.2099	0.2970	1.2099	1.1000
No log	42.0	462	1.2017	0.2970	1.2017	1.0962
No log	42.1818	464	1.2053	0.3335	1.2053	1.0979
No log	42.3636	466	1.2363	0.3091	1.2363	1.1119
No log	42.5455	468	1.2877	0.2999	1.2877	1.1348
No log	42.7273	470	1.3060	0.2579	1.3060	1.1428
No log	42.9091	472	1.2783	0.2933	1.2783	1.1306
No log	43.0909	474	1.2571	0.3065	1.2571	1.1212
No log	43.2727	476	1.2579	0.3214	1.2579	1.1216
No log	43.4545	478	1.2789	0.3404	1.2789	1.1309
No log	43.6364	480	1.2961	0.3064	1.2961	1.1384
No log	43.8182	482	1.3303	0.2898	1.3303	1.1534
No log	44.0	484	1.3587	0.3022	1.3587	1.1657
No log	44.1818	486	1.3585	0.2677	1.3585	1.1655
No log	44.3636	488	1.3066	0.3085	1.3066	1.1431
No log	44.5455	490	1.2372	0.2976	1.2372	1.1123
No log	44.7273	492	1.1994	0.2997	1.1994	1.0952
No log	44.9091	494	1.1938	0.2877	1.1938	1.0926
No log	45.0909	496	1.1935	0.2877	1.1935	1.0925
No log	45.2727	498	1.1997	0.2877	1.1997	1.0953
0.2787	45.4545	500	1.2235	0.3157	1.2235	1.1061
0.2787	45.6364	502	1.2668	0.3375	1.2668	1.1255
0.2787	45.8182	504	1.2616	0.3375	1.2616	1.1232
0.2787	46.0	506	1.2725	0.3617	1.2725	1.1281
0.2787	46.1818	508	1.2821	0.2999	1.2821	1.1323
0.2787	46.3636	510	1.2674	0.2999	1.2674	1.1258
0.2787	46.5455	512	1.2599	0.2999	1.2599	1.1225
0.2787	46.7273	514	1.2253	0.3231	1.2253	1.1069
0.2787	46.9091	516	1.1765	0.2850	1.1765	1.0847
0.2787	47.0909	518	1.1639	0.2792	1.1639	1.0788
0.2787	47.2727	520	1.1765	0.2850	1.1765	1.0847
0.2787	47.4545	522	1.1988	0.2850	1.1988	1.0949
0.2787	47.6364	524	1.2472	0.3231	1.2472	1.1168
0.2787	47.8182	526	1.3187	0.3243	1.3187	1.1483
0.2787	48.0	528	1.4337	0.1621	1.4337	1.1974
0.2787	48.1818	530	1.5101	0.0992	1.5101	1.2288
0.2787	48.3636	532	1.5025	0.1028	1.5025	1.2258
0.2787	48.5455	534	1.4257	0.1979	1.4257	1.1940
0.2787	48.7273	536	1.3076	0.2288	1.3076	1.1435

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1