ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1478
• Qwk: 0.1279
• Mse: 1.1478
• Rmse: 1.0714

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	4.5911	0.0010	4.5911	2.1427
No log	0.0714	4	2.9188	0.0038	2.9188	1.7085
No log	0.1071	6	2.0792	-0.0233	2.0792	1.4419
No log	0.1429	8	1.5089	0.0099	1.5089	1.2284
No log	0.1786	10	1.3065	0.0395	1.3065	1.1430
No log	0.2143	12	1.8370	0.0165	1.8370	1.3554
No log	0.25	14	2.0398	0.0443	2.0398	1.4282
No log	0.2857	16	1.5298	-0.0216	1.5298	1.2368
No log	0.3214	18	1.3378	0.0561	1.3378	1.1567
No log	0.3571	20	1.2856	0.1076	1.2856	1.1338
No log	0.3929	22	1.2754	0.1144	1.2754	1.1293
No log	0.4286	24	1.3630	0.0825	1.3630	1.1675
No log	0.4643	26	1.5336	-0.0686	1.5336	1.2384
No log	0.5	28	1.5081	-0.0686	1.5081	1.2280
No log	0.5357	30	1.4665	-0.0029	1.4665	1.2110
No log	0.5714	32	1.4581	0.0144	1.4581	1.2075
No log	0.6071	34	1.3423	0.1107	1.3423	1.1586
No log	0.6429	36	1.2522	0.0741	1.2522	1.1190
No log	0.6786	38	1.2631	0.0872	1.2631	1.1239
No log	0.7143	40	1.2703	0.0700	1.2703	1.1271
No log	0.75	42	1.2558	0.1370	1.2558	1.1206
No log	0.7857	44	1.2331	0.1654	1.2331	1.1105
No log	0.8214	46	1.4009	0.0600	1.4009	1.1836
No log	0.8571	48	1.5619	0.0723	1.5619	1.2498
No log	0.8929	50	1.5546	0.0403	1.5546	1.2469
No log	0.9286	52	1.3562	0.0537	1.3562	1.1645
No log	0.9643	54	1.2354	0.1968	1.2354	1.1115
No log	1.0	56	1.2177	0.1110	1.2177	1.1035
No log	1.0357	58	1.2160	0.1903	1.2160	1.1027
No log	1.0714	60	1.2238	0.1766	1.2238	1.1063
No log	1.1071	62	1.2348	0.2071	1.2348	1.1112
No log	1.1429	64	1.1876	0.3168	1.1876	1.0898
No log	1.1786	66	1.2104	0.2424	1.2104	1.1002
No log	1.2143	68	1.1545	0.3196	1.1545	1.0745
No log	1.25	70	1.4421	0.2144	1.4421	1.2009
No log	1.2857	72	1.8139	0.0543	1.8139	1.3468
No log	1.3214	74	1.8036	0.0153	1.8036	1.3430
No log	1.3571	76	1.4959	0.1698	1.4959	1.2231
No log	1.3929	78	1.1248	0.2520	1.1248	1.0606
No log	1.4286	80	1.3863	0.0575	1.3863	1.1774
No log	1.4643	82	1.6161	0.0403	1.6161	1.2713
No log	1.5	84	1.5734	0.0403	1.5734	1.2543
No log	1.5357	86	1.3879	0.0488	1.3879	1.1781
No log	1.5714	88	1.2247	0.3451	1.2247	1.1067
No log	1.6071	90	1.1918	0.0974	1.1918	1.0917
No log	1.6429	92	1.1713	0.1076	1.1713	1.0823
No log	1.6786	94	1.2172	0.1076	1.2172	1.1033
No log	1.7143	96	1.1828	0.1585	1.1828	1.0876
No log	1.75	98	1.0916	0.2464	1.0916	1.0448
No log	1.7857	100	1.1621	0.1995	1.1621	1.0780
No log	1.8214	102	1.1399	0.1995	1.1399	1.0676
No log	1.8571	104	1.0847	0.3806	1.0847	1.0415
No log	1.8929	106	1.3112	0.1675	1.3112	1.1451
No log	1.9286	108	1.2087	0.2005	1.2087	1.0994
No log	1.9643	110	0.9800	0.3838	0.9800	0.9899
No log	2.0	112	0.9726	0.3565	0.9726	0.9862
No log	2.0357	114	0.9464	0.3705	0.9464	0.9728
No log	2.0714	116	0.9824	0.4784	0.9824	0.9912
No log	2.1071	118	1.0352	0.3104	1.0352	1.0174
No log	2.1429	120	1.0478	0.3104	1.0478	1.0236
No log	2.1786	122	0.9900	0.3668	0.9900	0.9950
No log	2.2143	124	0.9246	0.4079	0.9246	0.9616
No log	2.25	126	1.0526	0.4007	1.0526	1.0260
No log	2.2857	128	1.0968	0.3657	1.0968	1.0473
No log	2.3214	130	0.9822	0.3506	0.9822	0.9911
No log	2.3571	132	0.9495	0.4512	0.9495	0.9744
No log	2.3929	134	0.9715	0.3363	0.9715	0.9856
No log	2.4286	136	1.1563	0.3648	1.1563	1.0753
No log	2.4643	138	1.1651	0.3537	1.1651	1.0794
No log	2.5	140	1.2219	0.3210	1.2219	1.1054
No log	2.5357	142	1.2594	0.3143	1.2594	1.1223
No log	2.5714	144	1.2207	0.2903	1.2207	1.1049
No log	2.6071	146	1.3597	0.3123	1.3597	1.1661
No log	2.6429	148	1.3459	0.3405	1.3459	1.1601
No log	2.6786	150	1.3276	0.3730	1.3276	1.1522
No log	2.7143	152	1.1982	0.4153	1.1982	1.0946
No log	2.75	154	1.1901	0.4063	1.1901	1.0909
No log	2.7857	156	1.4005	0.3309	1.4005	1.1834
No log	2.8214	158	1.6626	0.1967	1.6626	1.2894
No log	2.8571	160	1.5155	0.3177	1.5155	1.2310
No log	2.8929	162	1.1281	0.3705	1.1281	1.0621
No log	2.9286	164	1.1058	0.3465	1.1058	1.0516
No log	2.9643	166	1.1852	0.3620	1.1852	1.0887
No log	3.0	168	1.3697	0.3243	1.3697	1.1703
No log	3.0357	170	1.7313	0.2213	1.7313	1.3158
No log	3.0714	172	1.7465	0.1946	1.7465	1.3215
No log	3.1071	174	1.3837	0.2857	1.3837	1.1763
No log	3.1429	176	1.2458	0.2003	1.2458	1.1162
No log	3.1786	178	1.3853	0.2944	1.3853	1.1770
No log	3.2143	180	1.3590	0.2163	1.3590	1.1658
No log	3.25	182	1.2286	0.1658	1.2286	1.1084
No log	3.2857	184	1.2012	0.1747	1.2012	1.0960
No log	3.3214	186	1.1464	0.2028	1.1464	1.0707
No log	3.3571	188	1.1936	0.1747	1.1936	1.0925
No log	3.3929	190	1.3317	0.1696	1.3317	1.1540
No log	3.4286	192	1.3301	0.2574	1.3301	1.1533
No log	3.4643	194	1.3434	0.2965	1.3434	1.1591
No log	3.5	196	1.4449	0.3603	1.4449	1.2020
No log	3.5357	198	1.5833	0.2568	1.5833	1.2583
No log	3.5714	200	1.7676	0.2197	1.7676	1.3295
No log	3.6071	202	1.5518	0.3164	1.5518	1.2457
No log	3.6429	204	1.3904	0.2436	1.3904	1.1792
No log	3.6786	206	1.3874	0.1722	1.3874	1.1779
No log	3.7143	208	1.2662	0.0500	1.2662	1.1253
No log	3.75	210	1.3652	0.1447	1.3652	1.1684
No log	3.7857	212	1.5171	0.1547	1.5171	1.2317
No log	3.8214	214	1.3952	0.1533	1.3952	1.1812
No log	3.8571	216	1.1376	0.2636	1.1376	1.0666
No log	3.8929	218	1.0859	0.3660	1.0859	1.0421
No log	3.9286	220	1.1178	0.2372	1.1178	1.0572
No log	3.9643	222	1.0926	0.2967	1.0926	1.0453
No log	4.0	224	1.2411	0.1479	1.2411	1.1141
No log	4.0357	226	1.4633	0.1316	1.4633	1.2097
No log	4.0714	228	1.5165	0.0124	1.5165	1.2315
No log	4.1071	230	1.3799	0.1316	1.3799	1.1747
No log	4.1429	232	1.1776	0.2276	1.1776	1.0852
No log	4.1786	234	1.1109	0.2967	1.1109	1.0540
No log	4.2143	236	1.0986	0.2967	1.0986	1.0482
No log	4.25	238	1.1353	0.2432	1.1353	1.0655
No log	4.2857	240	1.3197	0.0778	1.3197	1.1488
No log	4.3214	242	1.4395	0.0920	1.4395	1.1998
No log	4.3571	244	1.3813	0.0778	1.3813	1.1753
No log	4.3929	246	1.2195	0.1801	1.2195	1.1043
No log	4.4286	248	1.1692	0.2119	1.1692	1.0813
No log	4.4643	250	1.2320	0.1801	1.2320	1.1099
No log	4.5	252	1.4089	0.0778	1.4089	1.1870
No log	4.5357	254	1.5038	0.0969	1.5038	1.2263
No log	4.5714	256	1.4555	0.1340	1.4555	1.2065
No log	4.6071	258	1.3321	0.1046	1.3321	1.1542
No log	4.6429	260	1.3590	0.1196	1.3590	1.1658
No log	4.6786	262	1.4468	0.1667	1.4468	1.2028
No log	4.7143	264	1.5719	0.1513	1.5719	1.2537
No log	4.75	266	1.6246	0.1559	1.6246	1.2746
No log	4.7857	268	1.5104	0.2009	1.5104	1.2290
No log	4.8214	270	1.3678	0.2163	1.3678	1.1695
No log	4.8571	272	1.2977	0.1896	1.2977	1.1391
No log	4.8929	274	1.1859	0.2108	1.1859	1.0890
No log	4.9286	276	1.2456	0.2132	1.2456	1.1161
No log	4.9643	278	1.2516	0.2132	1.2516	1.1187
No log	5.0	280	1.2386	0.2275	1.2386	1.1129
No log	5.0357	282	1.3169	0.2542	1.3169	1.1476
No log	5.0714	284	1.2584	0.2542	1.2584	1.1218
No log	5.1071	286	1.1629	0.2152	1.1629	1.0784
No log	5.1429	288	1.2175	0.2439	1.2175	1.1034
No log	5.1786	290	1.1683	0.2152	1.1683	1.0809
No log	5.2143	292	1.0816	0.2363	1.0816	1.0400
No log	5.25	294	1.0678	0.2263	1.0678	1.0333
No log	5.2857	296	1.1992	0.2041	1.1992	1.0951
No log	5.3214	298	1.2412	0.2084	1.2412	1.1141
No log	5.3571	300	1.2817	0.2212	1.2817	1.1321
No log	5.3929	302	1.4268	0.3045	1.4268	1.1945
No log	5.4286	304	1.5182	0.3143	1.5182	1.2321
No log	5.4643	306	1.3915	0.2108	1.3915	1.1796
No log	5.5	308	1.3281	0.2471	1.3281	1.1524
No log	5.5357	310	1.2540	0.1750	1.2540	1.1198
No log	5.5714	312	1.2470	0.2207	1.2470	1.1167
No log	5.6071	314	1.3693	0.1596	1.3693	1.1702
No log	5.6429	316	1.4793	0.1891	1.4793	1.2163
No log	5.6786	318	1.4354	0.1935	1.4354	1.1981
No log	5.7143	320	1.3429	0.2074	1.3429	1.1588
No log	5.75	322	1.4338	0.3087	1.4338	1.1974
No log	5.7857	324	1.5246	0.3404	1.5246	1.2347
No log	5.8214	326	1.5074	0.3521	1.5074	1.2278
No log	5.8571	328	1.3199	0.2985	1.3199	1.1489
No log	5.8929	330	1.3611	0.2985	1.3611	1.1667
No log	5.9286	332	1.5205	0.3238	1.5205	1.2331
No log	5.9643	334	1.6634	0.3471	1.6634	1.2897
No log	6.0	336	1.5886	0.2915	1.5886	1.2604
No log	6.0357	338	1.4013	0.2903	1.4013	1.1837
No log	6.0714	340	1.3131	0.2559	1.3131	1.1459
No log	6.1071	342	1.4432	0.3143	1.4432	1.2013
No log	6.1429	344	1.6203	0.2620	1.6203	1.2729
No log	6.1786	346	1.6703	0.1880	1.6703	1.2924
No log	6.2143	348	1.5205	0.2987	1.5205	1.2331
No log	6.25	350	1.3944	0.3293	1.3944	1.1808
No log	6.2857	352	1.4115	0.2301	1.4115	1.1881
No log	6.3214	354	1.4136	0.2224	1.4136	1.1889
No log	6.3571	356	1.4628	0.1753	1.4628	1.2094
No log	6.3929	358	1.6263	0.0431	1.6263	1.2753
No log	6.4286	360	1.6637	0.0957	1.6637	1.2898
No log	6.4643	362	1.5376	0.2647	1.5376	1.2400
No log	6.5	364	1.3263	0.2224	1.3263	1.1517
No log	6.5357	366	1.1696	0.1750	1.1696	1.0815
No log	6.5714	368	1.2416	0.1896	1.2416	1.1143
No log	6.6071	370	1.4192	0.3087	1.4192	1.1913
No log	6.6429	372	1.7320	0.1882	1.7320	1.3161
No log	6.6786	374	1.8526	0.1282	1.8526	1.3611
No log	6.7143	376	1.7461	0.1914	1.7461	1.3214
No log	6.75	378	1.5680	0.2841	1.5680	1.2522
No log	6.7857	380	1.3810	0.2647	1.3810	1.1751
No log	6.8214	382	1.3004	0.2938	1.3004	1.1404
No log	6.8571	384	1.3405	0.2263	1.3405	1.1578
No log	6.8929	386	1.3925	0.2184	1.3925	1.1800
No log	6.9286	388	1.4391	0.1313	1.4391	1.1996
No log	6.9643	390	1.3634	0.2051	1.3634	1.1677
No log	7.0	392	1.2010	0.1442	1.2010	1.0959
No log	7.0357	394	1.1523	0.1442	1.1523	1.0734
No log	7.0714	396	1.2124	0.2586	1.2124	1.1011
No log	7.1071	398	1.4298	0.3025	1.4298	1.1957
No log	7.1429	400	1.6419	0.2251	1.6419	1.2814
No log	7.1786	402	1.6404	0.2489	1.6404	1.2808
No log	7.2143	404	1.6119	0.2376	1.6119	1.2696
No log	7.25	406	1.4679	0.3177	1.4679	1.2116
No log	7.2857	408	1.2899	0.3249	1.2899	1.1357
No log	7.3214	410	1.1654	0.2909	1.1654	1.0795
No log	7.3571	412	1.1594	0.2909	1.1594	1.0768
No log	7.3929	414	1.1482	0.2909	1.1482	1.0716
No log	7.4286	416	1.2897	0.3416	1.2897	1.1356
No log	7.4643	418	1.5276	0.2775	1.5276	1.2360
No log	7.5	420	1.6057	0.2597	1.6057	1.2672
No log	7.5357	422	1.4827	0.2947	1.4827	1.2177
No log	7.5714	424	1.4943	0.2775	1.4943	1.2224
No log	7.6071	426	1.5299	0.2418	1.5299	1.2369
No log	7.6429	428	1.4517	0.2468	1.4517	1.2049
No log	7.6786	430	1.4557	0.2468	1.4557	1.2065
No log	7.7143	432	1.4800	0.3087	1.4800	1.2166
No log	7.75	434	1.4373	0.2857	1.4373	1.1989
No log	7.7857	436	1.5647	0.2820	1.5647	1.2509
No log	7.8214	438	1.5831	0.3026	1.5831	1.2582
No log	7.8571	440	1.5567	0.2985	1.5567	1.2477
No log	7.8929	442	1.4980	0.2309	1.4980	1.2239
No log	7.9286	444	1.4106	0.1891	1.4106	1.1877
No log	7.9643	446	1.3619	0.1795	1.3619	1.1670
No log	8.0	448	1.3255	0.1692	1.3255	1.1513
No log	8.0357	450	1.3531	0.1692	1.3531	1.1632
No log	8.0714	452	1.4192	0.1795	1.4192	1.1913
No log	8.1071	454	1.5010	0.0987	1.5010	1.2251
No log	8.1429	456	1.5427	0.1228	1.5427	1.2421
No log	8.1786	458	1.4944	0.2731	1.4944	1.2225
No log	8.2143	460	1.2972	0.2438	1.2972	1.1389
No log	8.25	462	1.2556	0.2574	1.2556	1.1205
No log	8.2857	464	1.2843	0.2634	1.2843	1.1332
No log	8.3214	466	1.3662	0.2503	1.3662	1.1689
No log	8.3571	468	1.5071	0.2468	1.5071	1.2276
No log	8.3929	470	1.6175	0.1968	1.6175	1.2718
No log	8.4286	472	1.5524	0.2163	1.5524	1.2460
No log	8.4643	474	1.4999	0.1371	1.4999	1.2247
No log	8.5	476	1.3705	0.1345	1.3705	1.1707
No log	8.5357	478	1.2094	0.1801	1.2094	1.0997
No log	8.5714	480	1.1696	0.1801	1.1696	1.0815
No log	8.6071	482	1.2243	0.1654	1.2243	1.1065
No log	8.6429	484	1.4147	0.2619	1.4147	1.1894
No log	8.6786	486	1.6083	0.2782	1.6083	1.2682
No log	8.7143	488	1.6952	0.0695	1.6952	1.3020
No log	8.75	490	1.6191	0.0586	1.6191	1.2724
No log	8.7857	492	1.4473	0.0865	1.4473	1.2030
No log	8.8214	494	1.2752	0.1315	1.2752	1.1292
No log	8.8571	496	1.1890	0.1480	1.1890	1.0904
No log	8.8929	498	1.1874	0.1480	1.1874	1.0897
0.4163	8.9286	500	1.2404	0.1500	1.2404	1.1137
0.4163	8.9643	502	1.3485	0.2173	1.3485	1.1613
0.4163	9.0	504	1.4011	0.3631	1.4011	1.1837
0.4163	9.0357	506	1.5198	0.3160	1.5198	1.2328
0.4163	9.0714	508	1.5162	0.3193	1.5162	1.2313
0.4163	9.1071	510	1.4562	0.3534	1.4562	1.2067
0.4163	9.1429	512	1.3422	0.3512	1.3422	1.1585
0.4163	9.1786	514	1.4058	0.3512	1.4058	1.1857
0.4163	9.2143	516	1.3996	0.1848	1.3996	1.1830
0.4163	9.25	518	1.3453	0.1345	1.3453	1.1599
0.4163	9.2857	520	1.3946	0.1345	1.3946	1.1809
0.4163	9.3214	522	1.3958	0.1026	1.3958	1.1814
0.4163	9.3571	524	1.3207	0.1026	1.3207	1.1492
0.4163	9.3929	526	1.1478	0.1279	1.1478	1.0714

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1