ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1730
• Qwk: 0.0989
• Mse: 1.1730
• Rmse: 1.0830

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.6479	-0.0020	4.6479	2.1559
No log	0.0909	4	2.8042	0.0066	2.8042	1.6746
No log	0.1364	6	2.5629	-0.0566	2.5629	1.6009
No log	0.1818	8	1.6482	-0.1009	1.6482	1.2838
No log	0.2273	10	1.2385	0.1110	1.2385	1.1129
No log	0.2727	12	1.2391	0.1812	1.2391	1.1131
No log	0.3182	14	1.3528	0.0319	1.3528	1.1631
No log	0.3636	16	1.1979	0.1693	1.1979	1.0945
No log	0.4091	18	1.1695	0.1952	1.1695	1.0814
No log	0.4545	20	1.1638	0.2520	1.1638	1.0788
No log	0.5	22	1.1670	0.2097	1.1670	1.0803
No log	0.5455	24	1.1760	0.1732	1.1760	1.0844
No log	0.5909	26	1.1952	0.2424	1.1952	1.0933
No log	0.6364	28	1.2331	0.1733	1.2331	1.1104
No log	0.6818	30	1.3394	0.1045	1.3394	1.1573
No log	0.7273	32	1.3618	0.0537	1.3618	1.1670
No log	0.7727	34	1.3753	0.0688	1.3753	1.1727
No log	0.8182	36	1.1898	0.2168	1.1898	1.0908
No log	0.8636	38	1.2015	0.1482	1.2015	1.0961
No log	0.9091	40	1.3730	0.0353	1.3730	1.1718
No log	0.9545	42	1.3862	0.0454	1.3862	1.1774
No log	1.0	44	1.2831	0.0353	1.2831	1.1327
No log	1.0455	46	1.1516	0.1546	1.1516	1.0731
No log	1.0909	48	1.2090	0.2245	1.2090	1.0996
No log	1.1364	50	1.3225	0.1639	1.3225	1.1500
No log	1.1818	52	1.1874	0.2342	1.1874	1.0897
No log	1.2273	54	1.1035	0.2938	1.1035	1.0505
No log	1.2727	56	1.0858	0.3145	1.0858	1.0420
No log	1.3182	58	1.1582	0.2072	1.1582	1.0762
No log	1.3636	60	1.2732	0.2381	1.2732	1.1284
No log	1.4091	62	1.2239	0.2298	1.2239	1.1063
No log	1.4545	64	1.1223	0.2800	1.1223	1.0594
No log	1.5	66	1.0874	0.3715	1.0874	1.0428
No log	1.5455	68	1.1542	0.3191	1.1542	1.0743
No log	1.5909	70	1.3220	0.3411	1.3220	1.1498
No log	1.6364	72	1.4302	0.3118	1.4302	1.1959
No log	1.6818	74	1.4971	0.2644	1.4971	1.2236
No log	1.7273	76	1.3124	0.3595	1.3124	1.1456
No log	1.7727	78	1.0845	0.3282	1.0845	1.0414
No log	1.8182	80	1.0993	0.2258	1.0993	1.0485
No log	1.8636	82	1.1282	0.2594	1.1282	1.0622
No log	1.9091	84	1.3971	0.3752	1.3971	1.1820
No log	1.9545	86	1.4414	0.3752	1.4414	1.2006
No log	2.0	88	1.4245	0.3818	1.4245	1.1935
No log	2.0455	90	1.1501	0.2515	1.1501	1.0724
No log	2.0909	92	1.1577	0.2558	1.1577	1.0760
No log	2.1364	94	1.1170	0.2144	1.1170	1.0569
No log	2.1818	96	1.1625	0.2275	1.1625	1.0782
No log	2.2273	98	1.2290	0.3316	1.2290	1.1086
No log	2.2727	100	1.1225	0.2313	1.1225	1.0595
No log	2.3182	102	1.0004	0.2640	1.0004	1.0002
No log	2.3636	104	0.9554	0.3796	0.9554	0.9774
No log	2.4091	106	1.1390	0.2958	1.1390	1.0673
No log	2.4545	108	1.7762	0.2289	1.7762	1.3327
No log	2.5	110	1.9624	0.0846	1.9624	1.4008
No log	2.5455	112	1.7964	0.1918	1.7964	1.3403
No log	2.5909	114	1.2372	0.3537	1.2372	1.1123
No log	2.6364	116	1.0387	0.3684	1.0387	1.0192
No log	2.6818	118	1.0445	0.4002	1.0445	1.0220
No log	2.7273	120	1.1254	0.2375	1.1254	1.0608
No log	2.7727	122	1.2995	0.2559	1.2995	1.1399
No log	2.8182	124	1.2848	0.2589	1.2848	1.1335
No log	2.8636	126	1.1635	0.2791	1.1635	1.0787
No log	2.9091	128	1.2420	0.2663	1.2420	1.1144
No log	2.9545	130	1.2239	0.2918	1.2239	1.1063
No log	3.0	132	1.2493	0.3232	1.2493	1.1177
No log	3.0455	134	1.4959	0.3510	1.4959	1.2231
No log	3.0909	136	1.5689	0.3345	1.5689	1.2526
No log	3.1364	138	1.4593	0.3238	1.4593	1.2080
No log	3.1818	140	1.2759	0.1703	1.2759	1.1296
No log	3.2273	142	1.1152	0.1211	1.1152	1.0560
No log	3.2727	144	1.0818	0.2142	1.0818	1.0401
No log	3.3182	146	1.1577	0.0700	1.1577	1.0760
No log	3.3636	148	1.2913	0.0607	1.2913	1.1364
No log	3.4091	150	1.3078	0.2046	1.3078	1.1436
No log	3.4545	152	1.2965	0.2046	1.2965	1.1387
No log	3.5	154	1.2662	0.2367	1.2662	1.1253
No log	3.5455	156	1.1984	0.2542	1.1984	1.0947
No log	3.5909	158	1.3140	0.3136	1.3140	1.1463
No log	3.6364	160	1.2709	0.2693	1.2709	1.1273
No log	3.6818	162	1.1129	0.1658	1.1129	1.0549
No log	3.7273	164	0.9999	0.2539	0.9999	1.0000
No log	3.7727	166	1.0324	0.1466	1.0324	1.0161
No log	3.8182	168	1.2059	0.2693	1.2059	1.0981
No log	3.8636	170	1.4013	0.2945	1.4013	1.1838
No log	3.9091	172	1.5147	0.3167	1.5147	1.2307
No log	3.9545	174	1.4196	0.2945	1.4196	1.1915
No log	4.0	176	1.2036	0.2664	1.2036	1.0971
No log	4.0455	178	1.0932	0.2810	1.0932	1.0456
No log	4.0909	180	1.1132	0.3000	1.1132	1.0551
No log	4.1364	182	1.2950	0.2341	1.2950	1.1380
No log	4.1818	184	1.5040	0.2851	1.5040	1.2264
No log	4.2273	186	1.4812	0.2851	1.4812	1.2170
No log	4.2727	188	1.3296	0.3202	1.3296	1.1531
No log	4.3182	190	1.1575	0.2714	1.1575	1.0759
No log	4.3636	192	1.1907	0.2519	1.1907	1.0912
No log	4.4091	194	1.3095	0.2678	1.3095	1.1443
No log	4.4545	196	1.2558	0.2817	1.2558	1.1206
No log	4.5	198	1.1681	0.2864	1.1681	1.0808
No log	4.5455	200	1.0907	0.2541	1.0907	1.0444
No log	4.5909	202	1.1388	0.2235	1.1388	1.0671
No log	4.6364	204	1.3409	0.3254	1.3409	1.1580
No log	4.6818	206	1.3312	0.2512	1.3312	1.1538
No log	4.7273	208	1.2941	0.2317	1.2941	1.1376
No log	4.7727	210	1.2404	0.2367	1.2404	1.1138
No log	4.8182	212	1.2602	0.1989	1.2602	1.1226
No log	4.8636	214	1.3015	0.1989	1.3015	1.1409
No log	4.9091	216	1.5795	0.3131	1.5795	1.2568
No log	4.9545	218	1.6436	0.3354	1.6436	1.2820
No log	5.0	220	1.4349	0.2707	1.4349	1.1979
No log	5.0455	222	1.2485	0.1090	1.2485	1.1174
No log	5.0909	224	1.1205	0.1210	1.1205	1.0585
No log	5.1364	226	1.0987	0.1528	1.0987	1.0482
No log	5.1818	228	1.2071	0.1712	1.2071	1.0987
No log	5.2273	230	1.4457	0.2870	1.4457	1.2024
No log	5.2727	232	1.4847	0.3238	1.4847	1.2185
No log	5.3182	234	1.4015	0.2941	1.4015	1.1839
No log	5.3636	236	1.3638	0.2941	1.3638	1.1678
No log	5.4091	238	1.3681	0.2857	1.3681	1.1697
No log	5.4545	240	1.4184	0.3405	1.4184	1.1910
No log	5.5	242	1.3468	0.2704	1.3468	1.1605
No log	5.5455	244	1.2131	0.1252	1.2131	1.1014
No log	5.5909	246	1.1454	0.1654	1.1454	1.0703
No log	5.6364	248	1.1510	0.2056	1.1510	1.0728
No log	5.6818	250	1.3239	0.1698	1.3239	1.1506
No log	5.7273	252	1.4303	0.3047	1.4303	1.1960
No log	5.7727	254	1.3470	0.3238	1.3470	1.1606
No log	5.8182	256	1.4601	0.3287	1.4601	1.2084
No log	5.8636	258	1.3742	0.3238	1.3742	1.1723
No log	5.9091	260	1.3537	0.2982	1.3537	1.1635
No log	5.9545	262	1.2503	0.2837	1.2503	1.1182
No log	6.0	264	1.2612	0.0880	1.2612	1.1230
No log	6.0455	266	1.1330	0.1110	1.1330	1.0644
No log	6.0909	268	1.0564	0.2314	1.0564	1.0278
No log	6.1364	270	1.0747	0.2155	1.0747	1.0367
No log	6.1818	272	1.1773	0.1211	1.1773	1.0850
No log	6.2273	274	1.3356	0.1637	1.3356	1.1557
No log	6.2727	276	1.5032	0.0943	1.5032	1.2260
No log	6.3182	278	1.6168	0.3354	1.6168	1.2715
No log	6.3636	280	1.6451	0.3217	1.6451	1.2826
No log	6.4091	282	1.6357	0.3521	1.6357	1.2789
No log	6.4545	284	1.6514	0.3217	1.6514	1.2851
No log	6.5	286	1.4796	0.3005	1.4796	1.2164
No log	6.5455	288	1.2725	0.1807	1.2725	1.1280
No log	6.5909	290	1.2848	0.0612	1.2848	1.1335
No log	6.6364	292	1.3438	0.0887	1.3438	1.1592
No log	6.6818	294	1.3856	0.0456	1.3856	1.1771
No log	6.7273	296	1.4675	0.0456	1.4675	1.2114
No log	6.7727	298	1.4218	0.0887	1.4218	1.1924
No log	6.8182	300	1.1923	0.1180	1.1923	1.0919
No log	6.8636	302	1.1158	0.1567	1.1158	1.0563
No log	6.9091	304	1.1117	0.1927	1.1117	1.0544
No log	6.9545	306	1.2307	0.2143	1.2307	1.1094
No log	7.0	308	1.6637	0.3396	1.6637	1.2898
No log	7.0455	310	1.7695	0.2588	1.7695	1.3302
No log	7.0909	312	1.5281	0.3086	1.5281	1.2362
No log	7.1364	314	1.2329	0.2818	1.2329	1.1104
No log	7.1818	316	1.1274	0.1310	1.1274	1.0618
No log	7.2273	318	1.1674	0.1442	1.1674	1.0804
No log	7.2727	320	1.3255	0.0887	1.3255	1.1513
No log	7.3182	322	1.3864	0.0456	1.3864	1.1775
No log	7.3636	324	1.3828	0.1592	1.3828	1.1759
No log	7.4091	326	1.2731	0.1789	1.2731	1.1283
No log	7.4545	328	1.2610	0.1807	1.2610	1.1229
No log	7.5	330	1.2500	0.2223	1.2500	1.1180
No log	7.5455	332	1.2490	0.2223	1.2490	1.1176
No log	7.5909	334	1.3252	0.2494	1.3252	1.1512
No log	7.6364	336	1.3628	0.1889	1.3628	1.1674
No log	7.6818	338	1.3417	0.1789	1.3417	1.1583
No log	7.7273	340	1.2721	0.1477	1.2721	1.1279
No log	7.7727	342	1.2418	0.2097	1.2418	1.1144
No log	7.8182	344	1.2487	0.1745	1.2487	1.1174
No log	7.8636	346	1.2991	0.2354	1.2991	1.1398
No log	7.9091	348	1.3024	0.2263	1.3024	1.1412
No log	7.9545	350	1.2064	0.2056	1.2064	1.0984
No log	8.0	352	1.1731	0.1755	1.1731	1.0831
No log	8.0455	354	1.2583	0.1596	1.2583	1.1218
No log	8.0909	356	1.4443	0.1740	1.4443	1.2018
No log	8.1364	358	1.4330	0.1191	1.4330	1.1971
No log	8.1818	360	1.2675	0.0692	1.2675	1.1259
No log	8.2273	362	1.1934	0.0682	1.1934	1.0924
No log	8.2727	364	1.1844	0.0222	1.1844	1.0883
No log	8.3182	366	1.2112	0.0318	1.2112	1.1006
No log	8.3636	368	1.3955	0.1753	1.3955	1.1813
No log	8.4091	370	1.7435	0.1961	1.7435	1.3204
No log	8.4545	372	1.8900	0.1261	1.8900	1.3748
No log	8.5	374	1.7852	0.2197	1.7852	1.3361
No log	8.5455	376	1.5537	0.2959	1.5537	1.2465
No log	8.5909	378	1.3370	0.0658	1.3370	1.1563
No log	8.6364	380	1.2624	0.0326	1.2624	1.1236
No log	8.6818	382	1.3113	0.0326	1.3113	1.1451
No log	8.7273	384	1.2964	0.0326	1.2964	1.1386
No log	8.7727	386	1.3273	0.0513	1.3273	1.1521
No log	8.8182	388	1.4098	0.2410	1.4098	1.1874
No log	8.8636	390	1.4835	0.2959	1.4835	1.2180
No log	8.9091	392	1.5603	0.3005	1.5603	1.2491
No log	8.9545	394	1.4044	0.2959	1.4044	1.1851
No log	9.0	396	1.2141	0.0822	1.2141	1.1019
No log	9.0455	398	1.1618	0.1559	1.1618	1.0779
No log	9.0909	400	1.2761	0.1935	1.2761	1.1296
No log	9.1364	402	1.5114	0.3005	1.5114	1.2294
No log	9.1818	404	1.5301	0.3005	1.5301	1.2370
No log	9.2273	406	1.3706	0.2870	1.3706	1.1707
No log	9.2727	408	1.2755	0.0419	1.2755	1.1294
No log	9.3182	410	1.2237	0.0246	1.2237	1.1062
No log	9.3636	412	1.2204	0.0318	1.2204	1.1047
No log	9.4091	414	1.2722	0.0246	1.2722	1.1279
No log	9.4545	416	1.4244	0.1427	1.4244	1.1935
No log	9.5	418	1.4951	0.2520	1.4951	1.2228
No log	9.5455	420	1.4350	0.2262	1.4350	1.1979
No log	9.5909	422	1.2798	0.25	1.2798	1.1313
No log	9.6364	424	1.1950	0.1562	1.1950	1.0932
No log	9.6818	426	1.1305	0.1567	1.1305	1.0632
No log	9.7273	428	1.1551	0.1244	1.1551	1.0747
No log	9.7727	430	1.2259	0.1114	1.2259	1.1072
No log	9.8182	432	1.3819	0.0442	1.3819	1.1755
No log	9.8636	434	1.4542	0.1404	1.4542	1.2059
No log	9.9091	436	1.4841	0.2099	1.4841	1.2182
No log	9.9545	438	1.4289	0.2055	1.4289	1.1954
No log	10.0	440	1.3683	0.2286	1.3683	1.1698
No log	10.0455	442	1.3375	0.2509	1.3375	1.1565
No log	10.0909	444	1.3617	0.1801	1.3617	1.1669
No log	10.1364	446	1.3141	0.1989	1.3141	1.1463
No log	10.1818	448	1.3107	0.1896	1.3107	1.1448
No log	10.2273	450	1.2619	0.1896	1.2619	1.1234
No log	10.2727	452	1.2510	0.1896	1.2510	1.1185
No log	10.3182	454	1.2139	0.1185	1.2139	1.1018
No log	10.3636	456	1.2276	0.1026	1.2276	1.1080
No log	10.4091	458	1.2582	0.1026	1.2582	1.1217
No log	10.4545	460	1.3027	0.1943	1.3027	1.1414
No log	10.5	462	1.4122	0.3133	1.4122	1.1884
No log	10.5455	464	1.5546	0.3140	1.5546	1.2468
No log	10.5909	466	1.7303	0.2632	1.7303	1.3154
No log	10.6364	468	1.7654	0.2975	1.7654	1.3287
No log	10.6818	470	1.6137	0.2839	1.6137	1.2703
No log	10.7273	472	1.3567	0.1122	1.3567	1.1648
No log	10.7727	474	1.1716	0.1343	1.1716	1.0824
No log	10.8182	476	1.1512	0.1278	1.1512	1.0729
No log	10.8636	478	1.2221	0.0153	1.2221	1.1055
No log	10.9091	480	1.3265	0.0454	1.3265	1.1517
No log	10.9545	482	1.3838	0.0454	1.3838	1.1764
No log	11.0	484	1.4372	0.0887	1.4372	1.1988
No log	11.0455	486	1.4261	0.1219	1.4261	1.1942
No log	11.0909	488	1.2998	0.1026	1.2998	1.1401
No log	11.1364	490	1.1524	0.1081	1.1524	1.0735
No log	11.1818	492	1.1622	0.1562	1.1622	1.0780
No log	11.2273	494	1.3533	0.1405	1.3533	1.1633
No log	11.2727	496	1.6041	0.1704	1.6041	1.2665
No log	11.3182	498	1.6673	0.1604	1.6673	1.2912
0.3112	11.3636	500	1.6206	0.2024	1.6206	1.2730
0.3112	11.4091	502	1.4810	0.1516	1.4810	1.2170
0.3112	11.4545	504	1.2928	0.2362	1.2928	1.1370
0.3112	11.5	506	1.2372	0.2235	1.2372	1.1123
0.3112	11.5455	508	1.3503	0.2201	1.3503	1.1620
0.3112	11.5909	510	1.4883	0.2309	1.4883	1.2200
0.3112	11.6364	512	1.5598	0.1980	1.5598	1.2489
0.3112	11.6818	514	1.4856	0.1345	1.4856	1.2188
0.3112	11.7273	516	1.4168	0.1219	1.4168	1.1903
0.3112	11.7727	518	1.3023	0.1122	1.3023	1.1412
0.3112	11.8182	520	1.1730	0.0989	1.1730	1.0830

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1