ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1621
• Qwk: 0.1281
• Mse: 1.1621
• Rmse: 1.0780

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	4.9050	0.0010	4.9050	2.2147
No log	0.0645	4	3.0948	-0.0079	3.0948	1.7592
No log	0.0968	6	2.2227	-0.0173	2.2227	1.4909
No log	0.1290	8	1.8471	0.0069	1.8471	1.3591
No log	0.1613	10	2.1589	0.0021	2.1589	1.4693
No log	0.1935	12	1.8928	-0.2002	1.8928	1.3758
No log	0.2258	14	1.2773	0.1207	1.2773	1.1302
No log	0.2581	16	1.2487	-0.0147	1.2487	1.1175
No log	0.2903	18	1.4247	0.0339	1.4247	1.1936
No log	0.3226	20	1.4552	-0.0300	1.4553	1.2063
No log	0.3548	22	1.3123	0.0662	1.3123	1.1455
No log	0.3871	24	1.2178	0.2167	1.2178	1.1035
No log	0.4194	26	1.2050	0.1857	1.2050	1.0977
No log	0.4516	28	1.2043	0.1417	1.2043	1.0974
No log	0.4839	30	1.2000	0.2464	1.2000	1.0955
No log	0.5161	32	1.2022	0.2464	1.2022	1.0964
No log	0.5484	34	1.2199	0.1417	1.2199	1.1045
No log	0.5806	36	1.2400	0.1144	1.2400	1.1135
No log	0.6129	38	1.2532	0.1142	1.2532	1.1195
No log	0.6452	40	1.3050	0.0481	1.3050	1.1424
No log	0.6774	42	1.5217	0.0688	1.5217	1.2336
No log	0.7097	44	1.5533	0.0838	1.5533	1.2463
No log	0.7419	46	1.3817	0.1288	1.3817	1.1755
No log	0.7742	48	1.2167	0.1307	1.2167	1.1030
No log	0.8065	50	1.3306	0.0353	1.3306	1.1535
No log	0.8387	52	1.4397	0.0263	1.4397	1.1999
No log	0.8710	54	1.3438	0.1071	1.3438	1.1592
No log	0.9032	56	1.2074	0.1780	1.2074	1.0988
No log	0.9355	58	1.2168	0.2700	1.2168	1.1031
No log	0.9677	60	1.2102	0.2088	1.2102	1.1001
No log	1.0	62	1.1756	0.2263	1.1756	1.0843
No log	1.0323	64	1.1996	0.2490	1.1996	1.0953
No log	1.0645	66	1.3959	0.1756	1.3959	1.1815
No log	1.0968	68	1.4673	0.2285	1.4673	1.2113
No log	1.1290	70	1.3654	0.1339	1.3654	1.1685
No log	1.1613	72	1.3086	0.1717	1.3086	1.1440
No log	1.1935	74	1.3364	0.1766	1.3364	1.1560
No log	1.2258	76	1.5616	0.2229	1.5616	1.2496
No log	1.2581	78	1.7936	0.2925	1.7936	1.3393
No log	1.2903	80	1.7799	0.2497	1.7799	1.3341
No log	1.3226	82	1.7235	0.2857	1.7235	1.3128
No log	1.3548	84	1.5318	0.2320	1.5318	1.2377
No log	1.3871	86	1.4315	0.2965	1.4315	1.1964
No log	1.4194	88	1.4380	0.2985	1.4380	1.1992
No log	1.4516	90	1.5161	0.3061	1.5161	1.2313
No log	1.4839	92	1.3891	0.2907	1.3891	1.1786
No log	1.5161	94	1.2413	0.3000	1.2413	1.1141
No log	1.5484	96	1.2492	0.2898	1.2492	1.1177
No log	1.5806	98	1.5011	0.3791	1.5011	1.2252
No log	1.6129	100	1.7270	0.2689	1.7270	1.3141
No log	1.6452	102	1.5796	0.4310	1.5796	1.2568
No log	1.6774	104	1.3358	0.2621	1.3358	1.1558
No log	1.7097	106	1.2777	0.2326	1.2777	1.1304
No log	1.7419	108	1.3888	0.2826	1.3888	1.1785
No log	1.7742	110	1.4901	0.3125	1.4901	1.2207
No log	1.8065	112	1.4251	0.3590	1.4251	1.1938
No log	1.8387	114	1.3973	0.3360	1.3973	1.1821
No log	1.8710	116	1.3902	0.2966	1.3902	1.1791
No log	1.9032	118	1.4318	0.3200	1.4318	1.1966
No log	1.9355	120	1.5351	0.3299	1.5351	1.2390
No log	1.9677	122	1.3350	0.3232	1.3350	1.1554
No log	2.0	124	1.1750	0.1824	1.1750	1.0840
No log	2.0323	126	1.1824	0.2404	1.1824	1.0874
No log	2.0645	128	1.3566	0.3163	1.3566	1.1647
No log	2.0968	130	1.5171	0.2881	1.5171	1.2317
No log	2.1290	132	1.4337	0.2337	1.4337	1.1974
No log	2.1613	134	1.2308	0.3046	1.2308	1.1094
No log	2.1935	136	1.1071	0.3177	1.1071	1.0522
No log	2.2258	138	1.1234	0.3065	1.1234	1.0599
No log	2.2581	140	1.2811	0.3303	1.2811	1.1319
No log	2.2903	142	1.7737	0.2503	1.7737	1.3318
No log	2.3226	144	1.9793	0.1024	1.9793	1.4069
No log	2.3548	146	1.7908	0.2305	1.7908	1.3382
No log	2.3871	148	1.3532	0.3227	1.3532	1.1633
No log	2.4194	150	1.2017	0.2743	1.2017	1.0962
No log	2.4516	152	1.2264	0.2275	1.2264	1.1074
No log	2.4839	154	1.1974	0.2143	1.1974	1.0942
No log	2.5161	156	1.2507	0.2174	1.2507	1.1184
No log	2.5484	158	1.3896	0.2437	1.3896	1.1788
No log	2.5806	160	1.4947	0.2987	1.4947	1.2226
No log	2.6129	162	1.4398	0.3188	1.4398	1.1999
No log	2.6452	164	1.3748	0.2390	1.3748	1.1725
No log	2.6774	166	1.2880	0.2424	1.2880	1.1349
No log	2.7097	168	1.2256	0.2288	1.2256	1.1071
No log	2.7419	170	1.2488	0.1870	1.2488	1.1175
No log	2.7742	172	1.3296	0.2165	1.3296	1.1531
No log	2.8065	174	1.5084	0.2470	1.5084	1.2282
No log	2.8387	176	1.7174	0.2231	1.7174	1.3105
No log	2.8710	178	1.6057	0.2911	1.6057	1.2672
No log	2.9032	180	1.5703	0.2389	1.5703	1.2531
No log	2.9355	182	1.5956	0.2798	1.5956	1.2632
No log	2.9677	184	1.3672	0.1848	1.3672	1.1693
No log	3.0	186	1.2705	0.1212	1.2705	1.1272
No log	3.0323	188	1.2799	0.0855	1.2799	1.1313
No log	3.0645	190	1.2646	0.1371	1.2646	1.1245
No log	3.0968	192	1.4398	0.2857	1.4398	1.1999
No log	3.1290	194	1.8997	0.2006	1.8997	1.3783
No log	3.1613	196	2.0516	0.1790	2.0516	1.4323
No log	3.1935	198	1.6989	0.2622	1.6989	1.3034
No log	3.2258	200	1.4607	0.2760	1.4607	1.2086
No log	3.2581	202	1.3422	0.3778	1.3422	1.1586
No log	3.2903	204	1.3746	0.3621	1.3746	1.1725
No log	3.3226	206	1.4426	0.3523	1.4426	1.2011
No log	3.3548	208	1.5868	0.2754	1.5868	1.2597
No log	3.3871	210	1.4545	0.2701	1.4545	1.2060
No log	3.4194	212	1.2854	0.2485	1.2854	1.1337
No log	3.4516	214	1.2640	0.1727	1.2640	1.1243
No log	3.4839	216	1.3485	0.2485	1.3485	1.1612
No log	3.5161	218	1.5223	0.1643	1.5223	1.2338
No log	3.5484	220	1.5428	0.2136	1.5428	1.2421
No log	3.5806	222	1.4351	0.2163	1.4351	1.1980
No log	3.6129	224	1.3997	0.2586	1.3997	1.1831
No log	3.6452	226	1.3834	0.2586	1.3834	1.1762
No log	3.6774	228	1.4685	0.2964	1.4685	1.2118
No log	3.7097	230	1.6643	0.2973	1.6643	1.2901
No log	3.7419	232	1.7358	0.2887	1.7358	1.3175
No log	3.7742	234	1.7056	0.2735	1.7056	1.3060
No log	3.8065	236	1.4788	0.2485	1.4788	1.2161
No log	3.8387	238	1.2759	0.1991	1.2759	1.1296
No log	3.8710	240	1.2063	0.1316	1.2063	1.0983
No log	3.9032	242	1.2354	0.1316	1.2354	1.1115
No log	3.9355	244	1.3868	0.2424	1.3868	1.1776
No log	3.9677	246	1.6184	0.3008	1.6184	1.2722
No log	4.0	248	1.6058	0.2935	1.6058	1.2672
No log	4.0323	250	1.3595	0.2371	1.3595	1.1660
No log	4.0645	252	1.2659	0.1981	1.2659	1.1251
No log	4.0968	254	1.2737	0.1981	1.2737	1.1286
No log	4.1290	256	1.3956	0.2248	1.3956	1.1814
No log	4.1613	258	1.4954	0.2272	1.4954	1.2229
No log	4.1935	260	1.5844	0.2334	1.5844	1.2587
No log	4.2258	262	1.5260	0.2113	1.5260	1.2353
No log	4.2581	264	1.4879	0.2726	1.4879	1.2198
No log	4.2903	266	1.4177	0.2564	1.4177	1.1907
No log	4.3226	268	1.4753	0.2985	1.4753	1.2146
No log	4.3548	270	1.4922	0.2985	1.4922	1.2215
No log	4.3871	272	1.5635	0.2658	1.5635	1.2504
No log	4.4194	274	1.4884	0.2757	1.4884	1.2200
No log	4.4516	276	1.3453	0.2738	1.3453	1.1599
No log	4.4839	278	1.2799	0.2976	1.2799	1.1313
No log	4.5161	280	1.2666	0.3113	1.2666	1.1255
No log	4.5484	282	1.3167	0.3023	1.3167	1.1475
No log	4.5806	284	1.4273	0.2021	1.4273	1.1947
No log	4.6129	286	1.5505	0.2873	1.5505	1.2452
No log	4.6452	288	1.4966	0.2782	1.4966	1.2233
No log	4.6774	290	1.3677	0.2981	1.3677	1.1695
No log	4.7097	292	1.3647	0.2981	1.3647	1.1682
No log	4.7419	294	1.4218	0.2489	1.4218	1.1924
No log	4.7742	296	1.4249	0.2489	1.4249	1.1937
No log	4.8065	298	1.3402	0.2710	1.3402	1.1577
No log	4.8387	300	1.2259	0.2300	1.2259	1.1072
No log	4.8710	302	1.2166	0.1504	1.2166	1.1030
No log	4.9032	304	1.2499	0.2056	1.2499	1.1180
No log	4.9355	306	1.3134	0.2857	1.3134	1.1460
No log	4.9677	308	1.4100	0.1943	1.4100	1.1874
No log	5.0	310	1.4829	0.2773	1.4829	1.2178
No log	5.0323	312	1.4197	0.2875	1.4197	1.1915
No log	5.0645	314	1.3812	0.2558	1.3812	1.1752
No log	5.0968	316	1.4180	0.2681	1.4180	1.1908
No log	5.1290	318	1.5254	0.2731	1.5254	1.2351
No log	5.1613	320	1.5111	0.2757	1.5111	1.2293
No log	5.1935	322	1.4853	0.2857	1.4853	1.2187
No log	5.2258	324	1.5600	0.2633	1.5600	1.2490
No log	5.2581	326	1.5569	0.3006	1.5569	1.2477
No log	5.2903	328	1.4375	0.2881	1.4375	1.1990
No log	5.3226	330	1.4104	0.2773	1.4104	1.1876
No log	5.3548	332	1.3938	0.3084	1.3938	1.1806
No log	5.3871	334	1.4376	0.3303	1.4376	1.1990
No log	5.4194	336	1.5313	0.2798	1.5313	1.2375
No log	5.4516	338	1.5733	0.2798	1.5733	1.2543
No log	5.4839	340	1.6044	0.2820	1.6044	1.2666
No log	5.5161	342	1.4486	0.2437	1.4486	1.2036
No log	5.5484	344	1.3316	0.1625	1.3316	1.1540
No log	5.5806	346	1.3228	0.1943	1.3228	1.1501
No log	5.6129	348	1.3933	0.2163	1.3933	1.1804
No log	5.6452	350	1.4556	0.2964	1.4556	1.2065
No log	5.6774	352	1.4467	0.3405	1.4467	1.2028
No log	5.7097	354	1.3274	0.2037	1.3274	1.1521
No log	5.7419	356	1.2141	0.2370	1.2141	1.1019
No log	5.7742	358	1.2251	0.2683	1.2251	1.1068
No log	5.8065	360	1.3484	0.3384	1.3484	1.1612
No log	5.8387	362	1.5483	0.3511	1.5483	1.2443
No log	5.8710	364	1.5912	0.3140	1.5912	1.2614
No log	5.9032	366	1.4345	0.2839	1.4345	1.1977
No log	5.9355	368	1.2461	0.2291	1.2461	1.1163
No log	5.9677	370	1.1379	0.1246	1.1379	1.0667
No log	6.0	372	1.1141	0.1567	1.1141	1.0555
No log	6.0323	374	1.1207	0.1624	1.1207	1.0586
No log	6.0645	376	1.2120	0.2248	1.2120	1.1009
No log	6.0968	378	1.4417	0.3025	1.4417	1.2007
No log	6.1290	380	1.6199	0.2731	1.6199	1.2727
No log	6.1613	382	1.5446	0.3082	1.5446	1.2428
No log	6.1935	384	1.3198	0.2317	1.3198	1.1488
No log	6.2258	386	1.2292	0.2054	1.2292	1.1087
No log	6.2581	388	1.2916	0.1764	1.2916	1.1365
No log	6.2903	390	1.4007	0.1498	1.4007	1.1835
No log	6.3226	392	1.3912	0.1850	1.3912	1.1795
No log	6.3548	394	1.3330	0.1812	1.3330	1.1546
No log	6.3871	396	1.3458	0.2117	1.3458	1.1601
No log	6.4194	398	1.3388	0.2840	1.3388	1.1570
No log	6.4516	400	1.3121	0.3384	1.3121	1.1455
No log	6.4839	402	1.2562	0.2962	1.2562	1.1208
No log	6.5161	404	1.1731	0.2826	1.1731	1.0831
No log	6.5484	406	1.2658	0.2525	1.2658	1.1251
No log	6.5806	408	1.2919	0.2495	1.2919	1.1366
No log	6.6129	410	1.2289	0.2525	1.2289	1.1086
No log	6.6452	412	1.1465	0.1814	1.1465	1.0708
No log	6.6774	414	1.1439	0.1814	1.1439	1.0695
No log	6.7097	416	1.1639	0.1755	1.1639	1.0788
No log	6.7419	418	1.2206	0.1755	1.2206	1.1048
No log	6.7742	420	1.2119	0.1755	1.2119	1.1008
No log	6.8065	422	1.2757	0.2236	1.2757	1.1295
No log	6.8387	424	1.3066	0.2574	1.3066	1.1431
No log	6.8710	426	1.2560	0.2326	1.2560	1.1207
No log	6.9032	428	1.1982	0.2154	1.1982	1.0946
No log	6.9355	430	1.1835	0.1814	1.1835	1.0879
No log	6.9677	432	1.2361	0.2525	1.2361	1.1118
No log	7.0	434	1.4017	0.2721	1.4017	1.1839
No log	7.0323	436	1.4988	0.3429	1.4988	1.2243
No log	7.0645	438	1.5065	0.2983	1.5065	1.2274
No log	7.0968	440	1.4035	0.1898	1.4035	1.1847
No log	7.1290	442	1.3582	0.2046	1.3582	1.1654
No log	7.1613	444	1.3751	0.2330	1.3751	1.1726
No log	7.1935	446	1.3902	0.2330	1.3902	1.1791
No log	7.2258	448	1.4156	0.2132	1.4156	1.1898
No log	7.2581	450	1.4311	0.2132	1.4311	1.1963
No log	7.2903	452	1.3936	0.2330	1.3936	1.1805
No log	7.3226	454	1.3256	0.2195	1.3256	1.1514
No log	7.3548	456	1.3041	0.1541	1.3041	1.1420
No log	7.3871	458	1.2273	0.1701	1.2273	1.1078
No log	7.4194	460	1.2060	0.1602	1.2060	1.0982
No log	7.4516	462	1.2171	0.1602	1.2171	1.1032
No log	7.4839	464	1.2251	0.1442	1.2251	1.1068
No log	7.5161	466	1.2218	0.1442	1.2218	1.1053
No log	7.5484	468	1.2795	0.2000	1.2795	1.1312
No log	7.5806	470	1.2880	0.2602	1.2880	1.1349
No log	7.6129	472	1.2416	0.2100	1.2416	1.1143
No log	7.6452	474	1.1500	0.1504	1.1500	1.0724
No log	7.6774	476	1.1226	0.1212	1.1226	1.0595
No log	7.7097	478	1.1390	0.1504	1.1390	1.0673
No log	7.7419	480	1.2251	0.2195	1.2251	1.1068
No log	7.7742	482	1.3082	0.2864	1.3082	1.1438
No log	7.8065	484	1.3073	0.2330	1.3073	1.1434
No log	7.8387	486	1.2289	0.1541	1.2289	1.1086
No log	7.8710	488	1.1523	0.1504	1.1523	1.0735
No log	7.9032	490	1.1620	0.1504	1.1620	1.0780
No log	7.9355	492	1.2745	0.2602	1.2745	1.1289
No log	7.9677	494	1.4527	0.3402	1.4527	1.2053
No log	8.0	496	1.4742	0.2807	1.4742	1.2141
No log	8.0323	498	1.4659	0.3025	1.4659	1.2107
0.3607	8.0645	500	1.3635	0.2000	1.3635	1.1677
0.3607	8.0968	502	1.3055	0.1379	1.3055	1.1426
0.3607	8.1290	504	1.3043	0.1379	1.3043	1.1421
0.3607	8.1613	506	1.2796	0.1379	1.2796	1.1312
0.3607	8.1935	508	1.2102	0.1379	1.2102	1.1001
0.3607	8.2258	510	1.1621	0.1281	1.1621	1.0780

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1