ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5279
• Qwk: 0.1058
• Mse: 1.5279
• Rmse: 1.2361

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0278	2	4.4274	0.0042	4.4274	2.1041
No log	0.0556	4	2.4532	0.0266	2.4532	1.5663
No log	0.0833	6	2.1725	0.0094	2.1725	1.4739
No log	0.1111	8	1.6645	-0.0286	1.6645	1.2901
No log	0.1389	10	1.2165	0.0599	1.2165	1.1029
No log	0.1667	12	1.2050	0.1711	1.2050	1.0977
No log	0.1944	14	1.2328	0.1711	1.2328	1.1103
No log	0.2222	16	1.2744	0.0349	1.2744	1.1289
No log	0.25	18	1.3014	0.0914	1.3014	1.1408
No log	0.2778	20	1.3105	0.1752	1.3105	1.1448
No log	0.3056	22	1.3140	0.0642	1.3140	1.1463
No log	0.3333	24	1.3412	0.1417	1.3412	1.1581
No log	0.3611	26	1.3401	0.0771	1.3401	1.1576
No log	0.3889	28	1.3310	0.0140	1.3310	1.1537
No log	0.4167	30	1.3507	0.0232	1.3507	1.1622
No log	0.4444	32	1.2802	0.0741	1.2802	1.1314
No log	0.4722	34	1.2320	0.2081	1.2320	1.1100
No log	0.5	36	1.2320	0.1616	1.2320	1.1100
No log	0.5278	38	1.3126	0.1278	1.3126	1.1457
No log	0.5556	40	1.5759	-0.1499	1.5759	1.2554
No log	0.5833	42	1.5040	-0.0193	1.5040	1.2264
No log	0.6111	44	1.3354	0.1042	1.3354	1.1556
No log	0.6389	46	1.2144	0.1397	1.2144	1.1020
No log	0.6667	48	1.3277	0.1966	1.3277	1.1523
No log	0.6944	50	1.3512	0.1966	1.3512	1.1624
No log	0.7222	52	1.2644	0.2088	1.2644	1.1245
No log	0.75	54	1.1997	0.1779	1.1997	1.0953
No log	0.7778	56	1.1770	0.2349	1.1770	1.0849
No log	0.8056	58	1.1734	0.2676	1.1734	1.0832
No log	0.8333	60	1.2816	0.1943	1.2816	1.1321
No log	0.8611	62	1.2919	0.2028	1.2919	1.1366
No log	0.8889	64	1.2895	0.1670	1.2895	1.1356
No log	0.9167	66	1.1340	0.2926	1.1340	1.0649
No log	0.9444	68	1.1566	0.2640	1.1566	1.0755
No log	0.9722	70	1.4398	0.1449	1.4398	1.1999
No log	1.0	72	2.1071	-0.0231	2.1071	1.4516
No log	1.0278	74	1.9691	0.0524	1.9691	1.4032
No log	1.0556	76	1.5636	0.0525	1.5636	1.2505
No log	1.0833	78	1.3968	0.2008	1.3968	1.1819
No log	1.1111	80	1.3580	0.2125	1.3580	1.1653
No log	1.1389	82	1.5135	0.0876	1.5135	1.2303
No log	1.1667	84	2.0500	0.0346	2.0500	1.4318
No log	1.1944	86	2.2609	-0.0485	2.2609	1.5036
No log	1.2222	88	2.0356	0.0504	2.0356	1.4267
No log	1.25	90	1.4363	0.2206	1.4363	1.1985
No log	1.2778	92	1.1960	0.3427	1.1960	1.0936
No log	1.3056	94	1.1999	0.2757	1.1999	1.0954
No log	1.3333	96	1.6006	0.2713	1.6006	1.2652
No log	1.3611	98	2.2886	0.0625	2.2886	1.5128
No log	1.3889	100	2.3076	0.0625	2.3076	1.5191
No log	1.4167	102	1.8949	0.1302	1.8949	1.3765
No log	1.4444	104	1.4966	0.2113	1.4966	1.2233
No log	1.4722	106	1.3508	0.1694	1.3508	1.1622
No log	1.5	108	1.3949	0.1308	1.3949	1.1811
No log	1.5278	110	1.5064	0.2542	1.5064	1.2273
No log	1.5556	112	1.6244	0.2481	1.6244	1.2745
No log	1.5833	114	1.5069	0.3254	1.5069	1.2276
No log	1.6111	116	1.4940	0.3254	1.4940	1.2223
No log	1.6389	118	1.4374	0.2578	1.4374	1.1989
No log	1.6667	120	1.4916	0.2172	1.4916	1.2213
No log	1.6944	122	1.7893	0.1235	1.7893	1.3377
No log	1.7222	124	1.8418	0.1282	1.8418	1.3571
No log	1.75	126	1.6251	0.2210	1.6251	1.2748
No log	1.7778	128	1.2346	0.2260	1.2346	1.1111
No log	1.8056	130	1.1465	0.1671	1.1465	1.0707
No log	1.8333	132	1.1618	0.1482	1.1618	1.0779
No log	1.8611	134	1.1783	0.0974	1.1783	1.0855
No log	1.8889	136	1.2674	0.1846	1.2674	1.1258
No log	1.9167	138	1.3773	0.1753	1.3773	1.1736
No log	1.9444	140	1.1667	0.1502	1.1667	1.0801
No log	1.9722	142	1.0989	0.2624	1.0989	1.0483
No log	2.0	144	1.1320	0.2346	1.1320	1.0639
No log	2.0278	146	1.2652	0.2041	1.2652	1.1248
No log	2.0556	148	1.5830	0.1336	1.5830	1.2582
No log	2.0833	150	1.5705	0.1171	1.5705	1.2532
No log	2.1111	152	1.3752	0.1554	1.3752	1.1727
No log	2.1389	154	1.3054	0.1753	1.3054	1.1425
No log	2.1667	156	1.5089	0.1395	1.5089	1.2284
No log	2.1944	158	1.8131	0.2444	1.8131	1.3465
No log	2.2222	160	1.9276	0.1499	1.9276	1.3884
No log	2.25	162	1.8449	0.2170	1.8449	1.3583
No log	2.2778	164	1.4800	0.2020	1.4800	1.2166
No log	2.3056	166	1.3218	0.1989	1.3218	1.1497
No log	2.3333	168	1.3588	0.1844	1.3588	1.1657
No log	2.3611	170	1.5373	0.2392	1.5373	1.2399
No log	2.3889	172	1.7342	0.1841	1.7342	1.3169
No log	2.4167	174	1.7421	0.1583	1.7421	1.3199
No log	2.4444	176	1.5529	0.1928	1.5529	1.2461
No log	2.4722	178	1.4063	0.1789	1.4063	1.1859
No log	2.5	180	1.3662	0.1745	1.3662	1.1688
No log	2.5278	182	1.4294	0.1427	1.4294	1.1956
No log	2.5556	184	1.4622	0.1756	1.4622	1.2092
No log	2.5833	186	1.7291	0.1960	1.7291	1.3150
No log	2.6111	188	2.0857	0.0712	2.0857	1.4442
No log	2.6389	190	2.0557	0.1110	2.0557	1.4338
No log	2.6667	192	1.6159	0.2757	1.6159	1.2712
No log	2.6944	194	1.3588	0.1596	1.3588	1.1657
No log	2.7222	196	1.2539	0.1407	1.2539	1.1198
No log	2.75	198	1.2553	0.1407	1.2553	1.1204
No log	2.7778	200	1.3532	0.2236	1.3532	1.1633
No log	2.8056	202	1.6935	0.1683	1.6935	1.3014
No log	2.8333	204	2.0082	0.1586	2.0082	1.4171
No log	2.8611	206	1.9612	0.0996	1.9612	1.4004
No log	2.8889	208	1.7114	0.0633	1.7114	1.3082
No log	2.9167	210	1.4418	0.0513	1.4418	1.2008
No log	2.9444	212	1.3417	0.1114	1.3417	1.1583
No log	2.9722	214	1.3424	0.0721	1.3424	1.1586
No log	3.0	216	1.3508	0.1769	1.3508	1.1622
No log	3.0278	218	1.4104	0.2191	1.4104	1.1876
No log	3.0556	220	1.6929	0.2408	1.6929	1.3011
No log	3.0833	222	2.1576	0.1079	2.1576	1.4689
No log	3.1111	224	2.2981	0.0625	2.2981	1.5160
No log	3.1389	226	2.0305	0.1690	2.0305	1.4250
No log	3.1667	228	1.6095	0.2036	1.6095	1.2686
No log	3.1944	230	1.2924	0.1053	1.2924	1.1369
No log	3.2222	232	1.2602	0.0628	1.2602	1.1226
No log	3.25	234	1.3440	0.0454	1.3440	1.1593
No log	3.2778	236	1.4697	0.0	1.4697	1.2123
No log	3.3056	238	1.6023	0.0838	1.6023	1.2658
No log	3.3333	240	1.7552	0.1257	1.7552	1.3248
No log	3.3611	242	1.7786	0.0925	1.7786	1.3336
No log	3.3889	244	1.6148	0.0741	1.6148	1.2708
No log	3.4167	246	1.5582	0.0447	1.5582	1.2483
No log	3.4444	248	1.5163	0.0872	1.5163	1.2314
No log	3.4722	250	1.5694	0.0672	1.5694	1.2528
No log	3.5	252	1.5211	0.1371	1.5211	1.2333
No log	3.5278	254	1.3436	0.1477	1.3436	1.1591
No log	3.5556	256	1.2538	0.1477	1.2538	1.1198
No log	3.5833	258	1.2161	0.1477	1.2161	1.1028
No log	3.6111	260	1.2536	0.2087	1.2536	1.1197
No log	3.6389	262	1.2772	0.2087	1.2772	1.1301
No log	3.6667	264	1.2374	0.2087	1.2374	1.1124
No log	3.6944	266	1.1966	0.2484	1.1966	1.0939
No log	3.7222	268	1.2842	0.2373	1.2842	1.1332
No log	3.75	270	1.2602	0.2373	1.2602	1.1226
No log	3.7778	272	1.1837	0.2484	1.1837	1.0880
No log	3.8056	274	1.1644	0.2790	1.1644	1.0791
No log	3.8333	276	1.1852	0.2354	1.1852	1.0887
No log	3.8611	278	1.1807	0.2354	1.1807	1.0866
No log	3.8889	280	1.3102	0.2736	1.3102	1.1446
No log	3.9167	282	1.5395	0.2789	1.5395	1.2408
No log	3.9444	284	1.5352	0.2935	1.5352	1.2390
No log	3.9722	286	1.4030	0.0887	1.4030	1.1845
No log	4.0	288	1.2898	0.0454	1.2898	1.1357
No log	4.0278	290	1.2008	0.0628	1.2008	1.0958
No log	4.0556	292	1.1610	0.0628	1.1610	1.0775
No log	4.0833	294	1.1821	0.0628	1.1821	1.0873
No log	4.1111	296	1.3103	0.1891	1.3103	1.1447
No log	4.1389	298	1.5563	0.3222	1.5563	1.2475
No log	4.1667	300	1.6764	0.2954	1.6764	1.2948
No log	4.1944	302	1.6909	0.2935	1.6909	1.3004
No log	4.2222	304	1.4979	0.2806	1.4979	1.2239
No log	4.25	306	1.3505	0.2201	1.3505	1.1621
No log	4.2778	308	1.1924	0.1850	1.1924	1.0920
No log	4.3056	310	1.1203	0.1379	1.1203	1.0584
No log	4.3333	312	1.1527	0.1479	1.1527	1.0736
No log	4.3611	314	1.3190	0.1404	1.3190	1.1485
No log	4.3889	316	1.5670	0.2012	1.5670	1.2518
No log	4.4167	318	1.6929	0.2987	1.6929	1.3011
No log	4.4444	320	1.6127	0.2052	1.6127	1.2699
No log	4.4722	322	1.3963	0.1031	1.3963	1.1816
No log	4.5	324	1.2612	0.1637	1.2612	1.1230
No log	4.5278	326	1.2423	0.0880	1.2423	1.1146
No log	4.5556	328	1.2984	0.0711	1.2984	1.1395
No log	4.5833	330	1.4112	0.0541	1.4112	1.1879
No log	4.6111	332	1.5246	0.1789	1.5246	1.2347
No log	4.6389	334	1.5982	0.1461	1.5982	1.2642
No log	4.6667	336	1.6183	0.1842	1.6183	1.2721
No log	4.6944	338	1.5345	0.1698	1.5345	1.2387
No log	4.7222	340	1.4597	0.1980	1.4597	1.2082
No log	4.75	342	1.5497	0.2424	1.5497	1.2449
No log	4.7778	344	1.6348	0.2435	1.6348	1.2786
No log	4.8056	346	1.6650	0.2323	1.6650	1.2904
No log	4.8333	348	1.5612	0.2181	1.5612	1.2495
No log	4.8611	350	1.4620	0.1592	1.4620	1.2091
No log	4.8889	352	1.4049	0.0098	1.4049	1.1853
No log	4.9167	354	1.3803	0.0098	1.3803	1.1748
No log	4.9444	356	1.4000	0.0098	1.4000	1.1832
No log	4.9722	358	1.4343	0.0456	1.4343	1.1976
No log	5.0	360	1.4352	0.1058	1.4352	1.1980
No log	5.0278	362	1.4422	0.1379	1.4422	1.2009
No log	5.0556	364	1.4863	0.1983	1.4863	1.2191
No log	5.0833	366	1.4454	0.1983	1.4454	1.2023
No log	5.1111	368	1.4109	0.1604	1.4109	1.1878
No log	5.1389	370	1.4812	0.2444	1.4812	1.2170
No log	5.1667	372	1.5812	0.2813	1.5812	1.2575
No log	5.1944	374	1.6234	0.2693	1.6234	1.2741
No log	5.2222	376	1.6535	0.2693	1.6535	1.2859
No log	5.25	378	1.5321	0.2966	1.5321	1.2378
No log	5.2778	380	1.3718	0.1604	1.3718	1.1712
No log	5.3056	382	1.3411	0.1687	1.3411	1.1581
No log	5.3333	384	1.4094	0.2377	1.4094	1.1872
No log	5.3611	386	1.5639	0.2197	1.5639	1.2506
No log	5.3889	388	1.6115	0.2394	1.6115	1.2695
No log	5.4167	390	1.5411	0.1718	1.5411	1.2414
No log	5.4444	392	1.3959	0.1790	1.3959	1.1815
No log	5.4722	394	1.2410	0.1477	1.2410	1.1140
No log	5.5	396	1.1725	0.0628	1.1725	1.0828
No log	5.5278	398	1.1588	0.0628	1.1588	1.0765
No log	5.5556	400	1.2031	0.1477	1.2031	1.0968
No log	5.5833	402	1.3335	0.2065	1.3335	1.1548
No log	5.6111	404	1.4411	0.2863	1.4411	1.2004
No log	5.6389	406	1.4268	0.2839	1.4268	1.1945
No log	5.6667	408	1.4804	0.2863	1.4804	1.2167
No log	5.6944	410	1.5466	0.2514	1.5466	1.2436
No log	5.7222	412	1.4789	0.2065	1.4789	1.2161
No log	5.75	414	1.4390	0.1371	1.4390	1.1996
No log	5.7778	416	1.3902	0.1058	1.3902	1.1791
No log	5.8056	418	1.3163	0.0454	1.3163	1.1473
No log	5.8333	420	1.3103	0.0	1.3103	1.1447
No log	5.8611	422	1.3119	0.0	1.3119	1.1454
No log	5.8889	424	1.3186	0.0	1.3186	1.1483
No log	5.9167	426	1.3747	0.1058	1.3747	1.1725
No log	5.9444	428	1.4761	0.1138	1.4761	1.2150
No log	5.9722	430	1.6742	0.1880	1.6742	1.2939
No log	6.0	432	1.7567	0.2381	1.7567	1.3254
No log	6.0278	434	1.7028	0.2717	1.7028	1.3049
No log	6.0556	436	1.6155	0.2293	1.6155	1.2710
No log	6.0833	438	1.5963	0.2424	1.5964	1.2635
No log	6.1111	440	1.6258	0.2857	1.6258	1.2751
No log	6.1389	442	1.5823	0.2564	1.5823	1.2579
No log	6.1667	444	1.4414	0.2631	1.4414	1.2006
No log	6.1944	446	1.3559	0.1740	1.3559	1.1644
No log	6.2222	448	1.3653	0.2537	1.3653	1.1685
No log	6.25	450	1.4709	0.2631	1.4709	1.2128
No log	6.2778	452	1.6602	0.3045	1.6602	1.2885
No log	6.3056	454	1.7266	0.2717	1.7266	1.3140
No log	6.3333	456	1.5883	0.2765	1.5883	1.2603
No log	6.3611	458	1.4107	0.1884	1.4107	1.1877
No log	6.3889	460	1.3149	0.0887	1.3149	1.1467
No log	6.4167	462	1.3147	0.0098	1.3147	1.1466
No log	6.4444	464	1.3693	0.0456	1.3693	1.1702
No log	6.4722	466	1.4311	0.1058	1.4311	1.1963
No log	6.5	468	1.4766	0.2798	1.4766	1.2151
No log	6.5278	470	1.4578	0.2377	1.4578	1.2074
No log	6.5556	472	1.4167	0.1379	1.4167	1.1903
No log	6.5833	474	1.3911	0.1058	1.3911	1.1794
No log	6.6111	476	1.4044	0.1058	1.4044	1.1851
No log	6.6389	478	1.4365	0.1983	1.4365	1.1985
No log	6.6667	480	1.4997	0.2191	1.4997	1.2246
No log	6.6944	482	1.5221	0.2444	1.5221	1.2337
No log	6.7222	484	1.5754	0.2444	1.5754	1.2552
No log	6.75	486	1.5624	0.1884	1.5624	1.2499
No log	6.7778	488	1.5006	0.1058	1.5006	1.2250
No log	6.8056	490	1.5025	0.0887	1.5025	1.2257
No log	6.8333	492	1.4751	0.0541	1.4751	1.2145
No log	6.8611	494	1.3945	0.0541	1.3945	1.1809
No log	6.8889	496	1.3695	0.0541	1.3695	1.1703
No log	6.9167	498	1.3869	0.1477	1.3869	1.1777
0.3661	6.9444	500	1.4865	0.2411	1.4865	1.2192
0.3661	6.9722	502	1.6482	0.2740	1.6482	1.2838
0.3661	7.0	504	1.7883	0.2669	1.7883	1.3373
0.3661	7.0278	506	1.7246	0.2424	1.7246	1.3133
0.3661	7.0556	508	1.5598	0.2660	1.5598	1.2489
0.3661	7.0833	510	1.4961	0.2631	1.4961	1.2232
0.3661	7.1111	512	1.4486	0.2631	1.4486	1.2036
0.3661	7.1389	514	1.4789	0.2660	1.4789	1.2161
0.3661	7.1667	516	1.5788	0.2331	1.5788	1.2565
0.3661	7.1944	518	1.5945	0.2162	1.5945	1.2627
0.3661	7.2222	520	1.6619	0.2197	1.6619	1.2892
0.3661	7.25	522	1.7007	0.2197	1.7007	1.3041
0.3661	7.2778	524	1.6489	0.2476	1.6489	1.2841
0.3661	7.3056	526	1.5922	0.2444	1.5922	1.2618
0.3661	7.3333	528	1.5720	0.1371	1.5720	1.2538
0.3661	7.3611	530	1.4932	0.0456	1.4932	1.2220
0.3661	7.3889	532	1.5123	0.0456	1.5123	1.2297
0.3661	7.4167	534	1.5356	0.1379	1.5356	1.2392
0.3661	7.4444	536	1.5279	0.1058	1.5279	1.2361

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1