ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k19_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7252
• Qwk: 0.2979
• Mse: 1.7252
• Rmse: 1.3135

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0225	2	6.9596	-0.0056	6.9596	2.6381
No log	0.0449	4	4.8284	0.0085	4.8284	2.1974
No log	0.0674	6	3.6021	-0.0521	3.6021	1.8979
No log	0.0899	8	2.2911	0.1571	2.2911	1.5136
No log	0.1124	10	1.8330	0.1770	1.8330	1.3539
No log	0.1348	12	1.7080	0.1905	1.7080	1.3069
No log	0.1573	14	1.9279	0.1754	1.9279	1.3885
No log	0.1798	16	2.4203	0.0299	2.4203	1.5557
No log	0.2022	18	2.3243	0.0299	2.3243	1.5246
No log	0.2247	20	1.9822	0.1071	1.9822	1.4079
No log	0.2472	22	1.8679	0.1296	1.8679	1.3667
No log	0.2697	24	1.9690	0.1416	1.9690	1.4032
No log	0.2921	26	2.0255	0.1017	2.0255	1.4232
No log	0.3146	28	1.9002	0.1724	1.9002	1.3785
No log	0.3371	30	1.6868	0.1165	1.6868	1.2988
No log	0.3596	32	1.7476	0.0962	1.7476	1.3220
No log	0.3820	34	1.6858	0.1308	1.6858	1.2984
No log	0.4045	36	1.5808	0.0784	1.5808	1.2573
No log	0.4270	38	1.7159	0.2087	1.7159	1.3099
No log	0.4494	40	1.9448	0.2381	1.9448	1.3946
No log	0.4719	42	1.9021	0.2381	1.9021	1.3792
No log	0.4944	44	1.7425	0.2564	1.7425	1.3201
No log	0.5169	46	1.6237	0.1905	1.6237	1.2743
No log	0.5393	48	1.6016	0.1538	1.6016	1.2655
No log	0.5618	50	1.6062	0.1165	1.6062	1.2673
No log	0.5843	52	1.5853	0.1165	1.5853	1.2591
No log	0.6067	54	1.5579	0.1869	1.5579	1.2482
No log	0.6292	56	1.5226	0.2832	1.5226	1.2339
No log	0.6517	58	1.4726	0.2906	1.4726	1.2135
No log	0.6742	60	1.4479	0.4194	1.4479	1.2033
No log	0.6966	62	1.4077	0.3810	1.4077	1.1864
No log	0.7191	64	1.5144	0.3937	1.5144	1.2306
No log	0.7416	66	1.4024	0.4962	1.4024	1.1842
No log	0.7640	68	1.2771	0.5191	1.2771	1.1301
No log	0.7865	70	1.2320	0.5113	1.2320	1.1099
No log	0.8090	72	1.2491	0.5652	1.2491	1.1176
No log	0.8315	74	1.5524	0.4361	1.5524	1.2459
No log	0.8539	76	1.9027	0.1778	1.9027	1.3794
No log	0.8764	78	1.8930	0.2256	1.8930	1.3759
No log	0.8989	80	1.4835	0.3937	1.4835	1.2180
No log	0.9213	82	1.1580	0.5556	1.1580	1.0761
No log	0.9438	84	1.0883	0.5426	1.0883	1.0432
No log	0.9663	86	1.1423	0.5231	1.1423	1.0688
No log	0.9888	88	1.1092	0.5846	1.1092	1.0532
No log	1.0112	90	1.0609	0.5873	1.0609	1.0300
No log	1.0337	92	1.1985	0.4286	1.1985	1.0948
No log	1.0562	94	1.3781	0.4160	1.3781	1.1739
No log	1.0787	96	1.4425	0.3906	1.4425	1.2011
No log	1.1011	98	1.3199	0.4885	1.3199	1.1489
No log	1.1236	100	1.1702	0.5344	1.1702	1.0817
No log	1.1461	102	1.1220	0.5344	1.1220	1.0592
No log	1.1685	104	1.0927	0.5481	1.0927	1.0453
No log	1.1910	106	1.0695	0.6087	1.0695	1.0342
No log	1.2135	108	1.1511	0.5468	1.1511	1.0729
No log	1.2360	110	1.1673	0.5532	1.1673	1.0804
No log	1.2584	112	1.0720	0.5714	1.0720	1.0354
No log	1.2809	114	1.2543	0.4789	1.2543	1.1200
No log	1.3034	116	1.3297	0.4615	1.3297	1.1531
No log	1.3258	118	1.5752	0.3504	1.5752	1.2551
No log	1.3483	120	1.5923	0.3857	1.5923	1.2619
No log	1.3708	122	1.4141	0.4604	1.4141	1.1892
No log	1.3933	124	1.3119	0.5224	1.3119	1.1454
No log	1.4157	126	1.4787	0.4526	1.4787	1.2160
No log	1.4382	128	1.5308	0.4029	1.5308	1.2372
No log	1.4607	130	1.6697	0.3333	1.6697	1.2922
No log	1.4831	132	1.4130	0.4748	1.4130	1.1887
No log	1.5056	134	1.2460	0.5362	1.2460	1.1162
No log	1.5281	136	1.2075	0.5532	1.2075	1.0989
No log	1.5506	138	1.3647	0.4892	1.3647	1.1682
No log	1.5730	140	1.4082	0.4892	1.4082	1.1867
No log	1.5955	142	1.3759	0.5217	1.3759	1.1730
No log	1.6180	144	1.2872	0.6087	1.2872	1.1346
No log	1.6404	146	1.2655	0.5672	1.2655	1.1249
No log	1.6629	148	1.2413	0.5312	1.2413	1.1141
No log	1.6854	150	1.2087	0.3717	1.2087	1.0994
No log	1.7079	152	1.3184	0.5528	1.3184	1.1482
No log	1.7303	154	1.5727	0.4706	1.5727	1.2541
No log	1.7528	156	1.5946	0.4348	1.5946	1.2628
No log	1.7753	158	1.3493	0.5414	1.3493	1.1616
No log	1.7978	160	1.1406	0.6015	1.1406	1.0680
No log	1.8202	162	1.0193	0.6222	1.0193	1.0096
No log	1.8427	164	1.0920	0.6232	1.0920	1.0450
No log	1.8652	166	1.5851	0.3830	1.5851	1.2590
No log	1.8876	168	2.1209	0.2378	2.1209	1.4563
No log	1.9101	170	2.2744	0.0863	2.2744	1.5081
No log	1.9326	172	2.2226	-0.0317	2.2226	1.4908
No log	1.9551	174	2.0478	-0.0504	2.0478	1.4310
No log	1.9775	176	1.6873	0.2602	1.6873	1.2989
No log	2.0	178	1.4113	0.5217	1.4113	1.1880
No log	2.0225	180	1.2487	0.5588	1.2487	1.1174
No log	2.0449	182	1.2721	0.5507	1.2721	1.1279
No log	2.0674	184	1.4875	0.4286	1.4875	1.2196
No log	2.0899	186	1.5928	0.4029	1.5928	1.2621
No log	2.1124	188	1.4898	0.4179	1.4898	1.2206
No log	2.1348	190	1.4160	0.4776	1.4160	1.1899
No log	2.1573	192	1.4526	0.4203	1.4526	1.2053
No log	2.1798	194	1.5454	0.3857	1.5454	1.2431
No log	2.2022	196	1.2838	0.5362	1.2838	1.1330
No log	2.2247	198	1.0502	0.6232	1.0502	1.0248
No log	2.2472	200	0.9810	0.6222	0.9810	0.9905
No log	2.2697	202	1.0944	0.6277	1.0944	1.0461
No log	2.2921	204	1.1255	0.6176	1.1255	1.0609
No log	2.3146	206	1.1517	0.5985	1.1517	1.0732
No log	2.3371	208	1.3723	0.4672	1.3723	1.1714
No log	2.3596	210	1.5483	0.4203	1.5483	1.2443
No log	2.3820	212	1.5276	0.4460	1.5276	1.2360
No log	2.4045	214	1.3935	0.4672	1.3935	1.1805
No log	2.4270	216	1.2770	0.5036	1.2770	1.1301
No log	2.4494	218	1.2785	0.5286	1.2785	1.1307
No log	2.4719	220	1.2630	0.5037	1.2630	1.1238
No log	2.4944	222	1.4314	0.4672	1.4314	1.1964
No log	2.5169	224	1.5172	0.4412	1.5172	1.2318
No log	2.5393	226	1.5105	0.4143	1.5105	1.2290
No log	2.5618	228	1.4986	0.4143	1.4986	1.2242
No log	2.5843	230	1.5399	0.4113	1.5399	1.2409
No log	2.6067	232	1.4001	0.4354	1.4001	1.1833
No log	2.6292	234	1.3957	0.4354	1.3957	1.1814
No log	2.6517	236	1.4982	0.4113	1.4982	1.2240
No log	2.6742	238	1.4788	0.4113	1.4788	1.2160
No log	2.6966	240	1.3447	0.4460	1.3447	1.1596
No log	2.7191	242	1.1243	0.5481	1.1243	1.0603
No log	2.7416	244	1.0200	0.6364	1.0200	1.0100
No log	2.7640	246	1.0566	0.6260	1.0566	1.0279
No log	2.7865	248	1.2032	0.5481	1.2032	1.0969
No log	2.8090	250	1.5614	0.3972	1.5614	1.2496
No log	2.8315	252	1.8561	0.3194	1.8561	1.3624
No log	2.8539	254	1.8763	0.3380	1.8763	1.3698
No log	2.8764	256	1.7030	0.3836	1.7030	1.3050
No log	2.8989	258	1.7220	0.3380	1.7220	1.3122
No log	2.9213	260	1.6050	0.3380	1.6050	1.2669
No log	2.9438	262	1.5148	0.3478	1.5148	1.2308
No log	2.9663	264	1.4304	0.3741	1.4304	1.1960
No log	2.9888	266	1.4288	0.3597	1.4288	1.1953
No log	3.0112	268	1.3271	0.4265	1.3271	1.1520
No log	3.0337	270	1.2021	0.5037	1.2021	1.0964
No log	3.0562	272	1.2002	0.4928	1.2002	1.0956
No log	3.0787	274	1.3446	0.4029	1.3446	1.1596
No log	3.1011	276	1.5781	0.3688	1.5781	1.2562
No log	3.1236	278	1.5447	0.3688	1.5447	1.2428
No log	3.1461	280	1.3755	0.4286	1.3755	1.1728
No log	3.1685	282	1.2221	0.5324	1.2221	1.1055
No log	3.1910	284	1.2196	0.5588	1.2196	1.1043
No log	3.2135	286	1.2973	0.5109	1.2973	1.1390
No log	3.2360	288	1.2461	0.5147	1.2461	1.1163
No log	3.2584	290	1.1730	0.6029	1.1730	1.0831
No log	3.2809	292	1.1585	0.6029	1.1585	1.0763
No log	3.3034	294	1.1931	0.5441	1.1931	1.0923
No log	3.3258	296	1.1981	0.5070	1.1981	1.0946
No log	3.3483	298	1.3272	0.3972	1.3272	1.1520
No log	3.3708	300	1.4117	0.3714	1.4117	1.1882
No log	3.3933	302	1.2581	0.4638	1.2581	1.1216
No log	3.4157	304	1.0533	0.6119	1.0533	1.0263
No log	3.4382	306	1.0187	0.6418	1.0187	1.0093
No log	3.4607	308	1.0463	0.5581	1.0463	1.0229
No log	3.4831	310	1.2369	0.5522	1.2369	1.1122
No log	3.5056	312	1.4639	0.3714	1.4639	1.2099
No log	3.5281	314	1.5745	0.3714	1.5745	1.2548
No log	3.5506	316	1.4617	0.3714	1.4617	1.2090
No log	3.5730	318	1.2543	0.5469	1.2543	1.1200
No log	3.5955	320	1.1354	0.5484	1.1354	1.0655
No log	3.6180	322	1.1214	0.5484	1.1214	1.0590
No log	3.6404	324	1.1826	0.5354	1.1826	1.0875
No log	3.6629	326	1.3466	0.4706	1.3466	1.1604
No log	3.6854	328	1.6091	0.3546	1.6091	1.2685
No log	3.7079	330	1.6545	0.3380	1.6545	1.2863
No log	3.7303	332	1.4585	0.3714	1.4585	1.2077
No log	3.7528	334	1.1709	0.6029	1.1709	1.0821
No log	3.7753	336	1.0258	0.6	1.0258	1.0128
No log	3.7978	338	1.0203	0.6202	1.0203	1.0101
No log	3.8202	340	1.0741	0.6061	1.0741	1.0364
No log	3.8427	342	1.2029	0.5414	1.2029	1.0968
No log	3.8652	344	1.4016	0.4526	1.4016	1.1839
No log	3.8876	346	1.4752	0.4029	1.4752	1.2146
No log	3.9101	348	1.3912	0.4706	1.3912	1.1795
No log	3.9326	350	1.1941	0.6165	1.1941	1.0927
No log	3.9551	352	1.0865	0.5397	1.0865	1.0424
No log	3.9775	354	1.0811	0.5323	1.0811	1.0398
No log	4.0	356	1.1687	0.6	1.1687	1.0811
No log	4.0225	358	1.3128	0.5344	1.3128	1.1458
No log	4.0449	360	1.4185	0.4380	1.4185	1.1910
No log	4.0674	362	1.4335	0.4380	1.4335	1.1973
No log	4.0899	364	1.3305	0.5496	1.3305	1.1535
No log	4.1124	366	1.3008	0.5778	1.3008	1.1405
No log	4.1348	368	1.4297	0.4397	1.4297	1.1957
No log	4.1573	370	1.6608	0.3546	1.6608	1.2887
No log	4.1798	372	1.8179	0.3380	1.8179	1.3483
No log	4.2022	374	1.8090	0.2857	1.8090	1.3450
No log	4.2247	376	1.6047	0.3857	1.6047	1.2668
No log	4.2472	378	1.3847	0.4662	1.3847	1.1767
No log	4.2697	380	1.3029	0.5197	1.3029	1.1415
No log	4.2921	382	1.2965	0.5312	1.2965	1.1386
No log	4.3146	384	1.3548	0.4638	1.3548	1.1639
No log	4.3371	386	1.5593	0.3857	1.5593	1.2487
No log	4.3596	388	1.7547	0.3000	1.7547	1.3246
No log	4.3820	390	1.8086	0.3262	1.8086	1.3448
No log	4.4045	392	1.6144	0.3546	1.6144	1.2706
No log	4.4270	394	1.2534	0.5255	1.2534	1.1195
No log	4.4494	396	1.1221	0.5547	1.1221	1.0593
No log	4.4719	398	1.1418	0.5373	1.1418	1.0685
No log	4.4944	400	1.2651	0.4885	1.2651	1.1248
No log	4.5169	402	1.3506	0.4889	1.3506	1.1621
No log	4.5393	404	1.4009	0.4889	1.4009	1.1836
No log	4.5618	406	1.5284	0.4203	1.5284	1.2363
No log	4.5843	408	1.5025	0.4203	1.5025	1.2258
No log	4.6067	410	1.4228	0.4559	1.4228	1.1928
No log	4.6292	412	1.4033	0.4889	1.4033	1.1846
No log	4.6517	414	1.4287	0.4627	1.4287	1.1953
No log	4.6742	416	1.5193	0.3824	1.5193	1.2326
No log	4.6966	418	1.5166	0.4179	1.5166	1.2315
No log	4.7191	420	1.4632	0.4361	1.4632	1.2096
No log	4.7416	422	1.3707	0.4627	1.3707	1.1708
No log	4.7640	424	1.3215	0.4361	1.3215	1.1496
No log	4.7865	426	1.2769	0.4580	1.2769	1.1300
No log	4.8090	428	1.3036	0.4889	1.3036	1.1417
No log	4.8315	430	1.2616	0.4889	1.2616	1.1232
No log	4.8539	432	1.2542	0.5455	1.2542	1.1199
No log	4.8764	434	1.2407	0.5455	1.2407	1.1139
No log	4.8989	436	1.2006	0.5197	1.2006	1.0957
No log	4.9213	438	1.2297	0.5197	1.2297	1.1089
No log	4.9438	440	1.3323	0.4962	1.3323	1.1542
No log	4.9663	442	1.4808	0.3942	1.4808	1.2169
No log	4.9888	444	1.7235	0.3429	1.7235	1.3128
No log	5.0112	446	1.7655	0.3262	1.7655	1.3287
No log	5.0337	448	1.7381	0.3262	1.7381	1.3184
No log	5.0562	450	1.6399	0.3741	1.6399	1.2806
No log	5.0787	452	1.5149	0.3942	1.5149	1.2308
No log	5.1011	454	1.4684	0.4593	1.4684	1.2118
No log	5.1236	456	1.3475	0.5224	1.3475	1.1608
No log	5.1461	458	1.1914	0.5692	1.1914	1.0915
No log	5.1685	460	1.1605	0.5426	1.1605	1.0773
No log	5.1910	462	1.2437	0.5649	1.2437	1.1152
No log	5.2135	464	1.3714	0.4889	1.3714	1.1711
No log	5.2360	466	1.5544	0.3942	1.5544	1.2468
No log	5.2584	468	1.6112	0.3676	1.6112	1.2693
No log	5.2809	470	1.5534	0.4265	1.5534	1.2463
No log	5.3034	472	1.4253	0.4627	1.4253	1.1939
No log	5.3258	474	1.4327	0.4706	1.4327	1.1969
No log	5.3483	476	1.4315	0.4706	1.4315	1.1964
No log	5.3708	478	1.4923	0.4029	1.4923	1.2216
No log	5.3933	480	1.4925	0.4029	1.4925	1.2217
No log	5.4157	482	1.5240	0.4029	1.5240	1.2345
No log	5.4382	484	1.5049	0.4203	1.5049	1.2267
No log	5.4607	486	1.4391	0.4706	1.4391	1.1996
No log	5.4831	488	1.4129	0.5312	1.4129	1.1887
No log	5.5056	490	1.4071	0.5238	1.4071	1.1862
No log	5.5281	492	1.3928	0.5161	1.3928	1.1802
No log	5.5506	494	1.3716	0.5238	1.3716	1.1712
No log	5.5730	496	1.3690	0.5224	1.3690	1.1701
No log	5.5955	498	1.3977	0.4706	1.3977	1.1823
0.4181	5.6180	500	1.4524	0.4706	1.4524	1.2052
0.4181	5.6404	502	1.4569	0.4706	1.4569	1.2070
0.4181	5.6629	504	1.4182	0.4706	1.4182	1.1909
0.4181	5.6854	506	1.3585	0.4706	1.3585	1.1656
0.4181	5.7079	508	1.3150	0.5224	1.3150	1.1467
0.4181	5.7303	510	1.3353	0.5414	1.3353	1.1555
0.4181	5.7528	512	1.4228	0.4444	1.4228	1.1928
0.4181	5.7753	514	1.4335	0.4179	1.4335	1.1973
0.4181	5.7978	516	1.3406	0.5606	1.3406	1.1578
0.4181	5.8202	518	1.3243	0.5606	1.3243	1.1508
0.4181	5.8427	520	1.3303	0.5606	1.3303	1.1534
0.4181	5.8652	522	1.3266	0.5414	1.3266	1.1518
0.4181	5.8876	524	1.3788	0.4706	1.3788	1.1742
0.4181	5.9101	526	1.6126	0.3885	1.6126	1.2699
0.4181	5.9326	528	1.8017	0.2817	1.8017	1.3423
0.4181	5.9551	530	1.8023	0.2817	1.8023	1.3425
0.4181	5.9775	532	1.7252	0.2979	1.7252	1.3135

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1