ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6672
• Qwk: 0.4211
• Mse: 1.6672
• Rmse: 1.2912

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	7.0613	0.0057	7.0613	2.6573
No log	0.0702	4	4.6537	0.0873	4.6537	2.1573
No log	0.1053	6	4.0257	-0.0490	4.0257	2.0064
No log	0.1404	8	4.1456	-0.0657	4.1456	2.0361
No log	0.1754	10	3.0981	0.0258	3.0981	1.7601
No log	0.2105	12	1.9331	0.1951	1.9331	1.3904
No log	0.2456	14	2.0649	0.2149	2.0649	1.4370
No log	0.2807	16	2.0161	0.1081	2.0161	1.4199
No log	0.3158	18	1.7281	0.1509	1.7281	1.3146
No log	0.3509	20	1.7126	0.1495	1.7126	1.3087
No log	0.3860	22	1.7032	0.1296	1.7032	1.3051
No log	0.4211	24	1.6692	0.1947	1.6692	1.2920
No log	0.4561	26	1.7920	0.2542	1.7920	1.3387
No log	0.4912	28	1.6515	0.2564	1.6515	1.2851
No log	0.5263	30	1.5035	0.2632	1.5035	1.2262
No log	0.5614	32	1.4985	0.2301	1.4985	1.2241
No log	0.5965	34	1.6229	0.3000	1.6229	1.2739
No log	0.6316	36	1.5926	0.3607	1.5926	1.2620
No log	0.6667	38	1.4541	0.2435	1.4541	1.2059
No log	0.7018	40	1.7776	0.1284	1.7776	1.3333
No log	0.7368	42	2.0021	0.0	2.0021	1.4149
No log	0.7719	44	1.7176	0.1818	1.7176	1.3106
No log	0.8070	46	1.6661	0.3824	1.6661	1.2908
No log	0.8421	48	1.6190	0.4559	1.6190	1.2724
No log	0.8772	50	1.6059	0.2439	1.6059	1.2672
No log	0.9123	52	2.4576	-0.1148	2.4576	1.5677
No log	0.9474	54	2.7663	-0.2000	2.7663	1.6632
No log	0.9825	56	1.6359	0.2523	1.6359	1.2790
No log	1.0175	58	1.2378	0.4407	1.2378	1.1126
No log	1.0526	60	1.2095	0.4500	1.2095	1.0998
No log	1.0877	62	1.1986	0.4839	1.1986	1.0948
No log	1.1228	64	1.1854	0.5079	1.1854	1.0888
No log	1.1579	66	1.2734	0.4567	1.2734	1.1284
No log	1.1930	68	1.3390	0.3664	1.3390	1.1572
No log	1.2281	70	1.3661	0.3759	1.3661	1.1688
No log	1.2632	72	1.2833	0.4964	1.2833	1.1328
No log	1.2982	74	1.2714	0.4776	1.2714	1.1276
No log	1.3333	76	1.5685	0.2595	1.5685	1.2524
No log	1.3684	78	1.7078	0.2154	1.7078	1.3068
No log	1.4035	80	1.7276	0.2879	1.7276	1.3144
No log	1.4386	82	1.9215	0.2446	1.9215	1.3862
No log	1.4737	84	1.8716	0.2734	1.8716	1.3681
No log	1.5088	86	1.6012	0.3504	1.6012	1.2654
No log	1.5439	88	1.2137	0.5248	1.2137	1.1017
No log	1.5789	90	1.3309	0.4741	1.3309	1.1536
No log	1.6140	92	1.6504	0.3333	1.6504	1.2847
No log	1.6491	94	1.4599	0.4148	1.4599	1.2083
No log	1.6842	96	1.4357	0.4148	1.4357	1.1982
No log	1.7193	98	1.5533	0.3333	1.5533	1.2463
No log	1.7544	100	1.9462	0.2979	1.9462	1.3951
No log	1.7895	102	1.8687	0.3143	1.8687	1.3670
No log	1.8246	104	1.2362	0.5147	1.2362	1.1119
No log	1.8596	106	0.9307	0.6475	0.9307	0.9647
No log	1.8947	108	0.9167	0.6187	0.9167	0.9575
No log	1.9298	110	1.3547	0.4493	1.3547	1.1639
No log	1.9649	112	1.9722	0.2817	1.9722	1.4044
No log	2.0	114	1.9739	0.2979	1.9739	1.4050
No log	2.0351	116	1.7494	0.3741	1.7494	1.3226
No log	2.0702	118	1.7250	0.3741	1.7250	1.3134
No log	2.1053	120	1.8506	0.3429	1.8506	1.3604
No log	2.1404	122	1.9454	0.2676	1.9454	1.3948
No log	2.1754	124	1.8061	0.3165	1.8061	1.3439
No log	2.2105	126	1.6378	0.4317	1.6378	1.2798
No log	2.2456	128	1.5488	0.4493	1.5488	1.2445
No log	2.2807	130	1.3591	0.4783	1.3591	1.1658
No log	2.3158	132	1.4266	0.4317	1.4266	1.1944
No log	2.3509	134	1.7817	0.3165	1.7817	1.3348
No log	2.3860	136	1.8006	0.3165	1.8006	1.3419
No log	2.4211	138	1.4534	0.4242	1.4534	1.2056
No log	2.4561	140	1.1481	0.5041	1.1481	1.0715
No log	2.4912	142	1.1095	0.5323	1.1095	1.0533
No log	2.5263	144	1.2304	0.5564	1.2304	1.1092
No log	2.5614	146	1.6119	0.3165	1.6119	1.2696
No log	2.5965	148	1.6714	0.3165	1.6714	1.2928
No log	2.6316	150	1.4957	0.4085	1.4957	1.2230
No log	2.6667	152	1.3510	0.5	1.3510	1.1623
No log	2.7018	154	1.2302	0.5373	1.2302	1.1091
No log	2.7368	156	1.2928	0.5185	1.2928	1.1370
No log	2.7719	158	1.2687	0.5373	1.2687	1.1264
No log	2.8070	160	1.3150	0.5185	1.3150	1.1467
No log	2.8421	162	1.1518	0.5414	1.1518	1.0732
No log	2.8772	164	1.2112	0.5414	1.2112	1.1005
No log	2.9123	166	1.4759	0.4493	1.4759	1.2148
No log	2.9474	168	1.8902	0.2695	1.8902	1.3748
No log	2.9825	170	1.8496	0.3000	1.8496	1.3600
No log	3.0175	172	1.4608	0.4478	1.4608	1.2086
No log	3.0526	174	1.1568	0.5649	1.1568	1.0755
No log	3.0877	176	1.0831	0.6260	1.0831	1.0407
No log	3.1228	178	1.0864	0.6107	1.0864	1.0423
No log	3.1579	180	1.1654	0.5344	1.1654	1.0795
No log	3.1930	182	1.2486	0.5263	1.2486	1.1174
No log	3.2281	184	1.2681	0.5263	1.2681	1.1261
No log	3.2632	186	1.3494	0.5263	1.3494	1.1616
No log	3.2982	188	1.2674	0.5263	1.2674	1.1258
No log	3.3333	190	1.2310	0.5303	1.2310	1.1095
No log	3.3684	192	1.1007	0.5581	1.1007	1.0491
No log	3.4035	194	1.0271	0.5920	1.0271	1.0134
No log	3.4386	196	1.0219	0.5469	1.0219	1.0109
No log	3.4737	198	1.0910	0.5581	1.0910	1.0445
No log	3.5088	200	1.0548	0.5714	1.0548	1.0270
No log	3.5439	202	0.9475	0.5802	0.9475	0.9734
No log	3.5789	204	0.9408	0.5821	0.9408	0.9700
No log	3.6140	206	0.9814	0.5385	0.9814	0.9906
No log	3.6491	208	1.1989	0.5191	1.1989	1.0950
No log	3.6842	210	1.2078	0.5191	1.2078	1.0990
No log	3.7193	212	1.0662	0.5426	1.0662	1.0326
No log	3.7544	214	1.0048	0.5714	1.0048	1.0024
No log	3.7895	216	1.0617	0.5161	1.0617	1.0304
No log	3.8246	218	1.3207	0.4961	1.3207	1.1492
No log	3.8596	220	1.5849	0.3881	1.5849	1.2589
No log	3.8947	222	1.6141	0.3556	1.6141	1.2705
No log	3.9298	224	1.4941	0.4511	1.4941	1.2223
No log	3.9649	226	1.4163	0.4697	1.4163	1.1901
No log	4.0	228	1.2653	0.4885	1.2653	1.1249
No log	4.0351	230	1.3022	0.4962	1.3022	1.1412
No log	4.0702	232	1.3095	0.4848	1.3095	1.1443
No log	4.1053	234	1.3866	0.4122	1.3866	1.1775
No log	4.1404	236	1.3218	0.4688	1.3218	1.1497
No log	4.1754	238	1.2673	0.4844	1.2673	1.1257
No log	4.2105	240	1.1704	0.5469	1.1704	1.0818
No log	4.2456	242	1.1300	0.5512	1.1300	1.0630
No log	4.2807	244	1.2171	0.5496	1.2171	1.1032
No log	4.3158	246	1.4303	0.4627	1.4303	1.1960
No log	4.3509	248	1.7922	0.3358	1.7922	1.3387
No log	4.3860	250	2.0484	0.2714	2.0484	1.4312
No log	4.4211	252	1.9118	0.3165	1.9118	1.3827
No log	4.4561	254	1.4227	0.4741	1.4227	1.1928
No log	4.4912	256	1.0679	0.5426	1.0679	1.0334
No log	4.5263	258	1.0171	0.5781	1.0171	1.0085
No log	4.5614	260	1.1119	0.5426	1.1119	1.0545
No log	4.5965	262	1.4192	0.4394	1.4192	1.1913
No log	4.6316	264	1.6901	0.3529	1.6901	1.3000
No log	4.6667	266	1.6149	0.3881	1.6149	1.2708
No log	4.7018	268	1.2853	0.4427	1.2853	1.1337
No log	4.7368	270	1.0772	0.5079	1.0772	1.0379
No log	4.7719	272	1.0854	0.5161	1.0854	1.0418
No log	4.8070	274	1.2039	0.5038	1.2039	1.0972
No log	4.8421	276	1.4272	0.4412	1.4272	1.1946
No log	4.8772	278	1.4948	0.4412	1.4948	1.2226
No log	4.9123	280	1.3523	0.4444	1.3523	1.1629
No log	4.9474	282	1.3402	0.4627	1.3402	1.1577
No log	4.9825	284	1.2690	0.5	1.2690	1.1265
No log	5.0175	286	1.2476	0.5038	1.2476	1.1169
No log	5.0526	288	1.1454	0.5000	1.1454	1.0702
No log	5.0877	290	1.1318	0.5000	1.1318	1.0639
No log	5.1228	292	1.2546	0.5	1.2546	1.1201
No log	5.1579	294	1.3502	0.4478	1.3502	1.1620
No log	5.1930	296	1.2995	0.4769	1.2995	1.1400
No log	5.2281	298	1.3659	0.3876	1.3659	1.1687
No log	5.2632	300	1.4088	0.3939	1.4088	1.1869
No log	5.2982	302	1.3975	0.4179	1.3975	1.1821
No log	5.3333	304	1.3874	0.4179	1.3874	1.1779
No log	5.3684	306	1.5313	0.3852	1.5313	1.2375
No log	5.4035	308	1.4377	0.4060	1.4377	1.1990
No log	5.4386	310	1.3388	0.4308	1.3388	1.1571
No log	5.4737	312	1.3480	0.4308	1.3480	1.1611
No log	5.5088	314	1.4225	0.4308	1.4225	1.1927
No log	5.5439	316	1.5591	0.3852	1.5591	1.2486
No log	5.5789	318	1.5438	0.3852	1.5438	1.2425
No log	5.6140	320	1.3334	0.4496	1.3334	1.1547
No log	5.6491	322	1.1088	0.5366	1.1088	1.0530
No log	5.6842	324	1.0643	0.5738	1.0643	1.0317
No log	5.7193	326	1.0875	0.5760	1.0875	1.0428
No log	5.7544	328	1.2038	0.4800	1.2038	1.0972
No log	5.7895	330	1.4339	0.4211	1.4339	1.1975
No log	5.8246	332	1.4948	0.4444	1.4948	1.2226
No log	5.8596	334	1.2974	0.4697	1.2974	1.1390
No log	5.8947	336	1.1287	0.5344	1.1287	1.0624
No log	5.9298	338	1.1503	0.5303	1.1503	1.0725
No log	5.9649	340	1.2566	0.5152	1.2566	1.1210
No log	6.0	342	1.4123	0.4662	1.4123	1.1884
No log	6.0351	344	1.3722	0.4662	1.3722	1.1714
No log	6.0702	346	1.2068	0.4603	1.2068	1.0986
No log	6.1053	348	1.1612	0.4706	1.1612	1.0776
No log	6.1404	350	1.1338	0.5124	1.1338	1.0648
No log	6.1754	352	1.1484	0.4640	1.1484	1.0716
No log	6.2105	354	1.2778	0.4885	1.2778	1.1304
No log	6.2456	356	1.3299	0.4662	1.3299	1.1532
No log	6.2807	358	1.2134	0.5231	1.2134	1.1015
No log	6.3158	360	1.0972	0.496	1.0972	1.0475
No log	6.3509	362	1.0808	0.5042	1.0808	1.0396
No log	6.3860	364	1.1341	0.4793	1.1341	1.0649
No log	6.4211	366	1.2540	0.4390	1.2540	1.1198
No log	6.4561	368	1.5477	0.4122	1.5477	1.2441
No log	6.4912	370	1.7989	0.3088	1.7989	1.3412
No log	6.5263	372	1.7829	0.3088	1.7829	1.3352
No log	6.5614	374	1.5904	0.3609	1.5904	1.2611
No log	6.5965	376	1.3339	0.4516	1.3339	1.1549
No log	6.6316	378	1.2607	0.4426	1.2607	1.1228
No log	6.6667	380	1.2395	0.4839	1.2395	1.1133
No log	6.7018	382	1.2654	0.4839	1.2654	1.1249
No log	6.7368	384	1.3875	0.4320	1.3875	1.1779
No log	6.7719	386	1.5454	0.4122	1.5454	1.2431
No log	6.8070	388	1.6127	0.4091	1.6127	1.2699
No log	6.8421	390	1.5948	0.4091	1.5948	1.2628
No log	6.8772	392	1.5478	0.4341	1.5478	1.2441
No log	6.9123	394	1.4398	0.4567	1.4398	1.1999
No log	6.9474	396	1.3956	0.4715	1.3956	1.1814
No log	6.9825	398	1.3821	0.4715	1.3821	1.1756
No log	7.0175	400	1.4303	0.4390	1.4303	1.1960
No log	7.0526	402	1.4833	0.4219	1.4833	1.2179
No log	7.0877	404	1.5896	0.4341	1.5896	1.2608
No log	7.1228	406	1.6360	0.4	1.6360	1.2791
No log	7.1579	408	1.6166	0.4341	1.6166	1.2715
No log	7.1930	410	1.5162	0.4252	1.5162	1.2314
No log	7.2281	412	1.3576	0.4426	1.3576	1.1652
No log	7.2632	414	1.2344	0.512	1.2344	1.1110
No log	7.2982	416	1.1997	0.512	1.1997	1.0953
No log	7.3333	418	1.2657	0.48	1.2657	1.1250
No log	7.3684	420	1.4397	0.4375	1.4397	1.1999
No log	7.4035	422	1.5267	0.4154	1.5267	1.2356
No log	7.4386	424	1.4722	0.4094	1.4722	1.2133
No log	7.4737	426	1.3705	0.4390	1.3705	1.1707
No log	7.5088	428	1.2877	0.4553	1.2877	1.1348
No log	7.5439	430	1.2335	0.4839	1.2335	1.1106
No log	7.5789	432	1.2546	0.4603	1.2546	1.1201
No log	7.6140	434	1.2844	0.4603	1.2844	1.1333
No log	7.6491	436	1.3056	0.4531	1.3056	1.1426
No log	7.6842	438	1.2671	0.4409	1.2671	1.1256
No log	7.7193	440	1.1731	0.5238	1.1731	1.0831
No log	7.7544	442	1.1578	0.4961	1.1578	1.0760
No log	7.7895	444	1.1785	0.5077	1.1785	1.0856
No log	7.8246	446	1.2459	0.5077	1.2459	1.1162
No log	7.8596	448	1.3021	0.5038	1.3021	1.1411
No log	7.8947	450	1.4087	0.4462	1.4087	1.1869
No log	7.9298	452	1.4616	0.4427	1.4616	1.2089
No log	7.9649	454	1.3760	0.4806	1.3760	1.1730
No log	8.0	456	1.3949	0.5077	1.3949	1.1810
No log	8.0351	458	1.4556	0.4769	1.4556	1.2065
No log	8.0702	460	1.4486	0.4806	1.4486	1.2036
No log	8.1053	462	1.4229	0.5077	1.4229	1.1928
No log	8.1404	464	1.4083	0.5077	1.4083	1.1867
No log	8.1754	466	1.3608	0.5077	1.3608	1.1666
No log	8.2105	468	1.3358	0.4961	1.3358	1.1558
No log	8.2456	470	1.3965	0.5077	1.3965	1.1817
No log	8.2807	472	1.4215	0.4806	1.4215	1.1923
No log	8.3158	474	1.4177	0.4688	1.4177	1.1907
No log	8.3509	476	1.3534	0.4567	1.3534	1.1634
No log	8.3860	478	1.2623	0.512	1.2623	1.1235
No log	8.4211	480	1.1954	0.5238	1.1954	1.0934
No log	8.4561	482	1.2305	0.4882	1.2305	1.1093
No log	8.4912	484	1.2705	0.5039	1.2705	1.1272
No log	8.5263	486	1.3305	0.5	1.3305	1.1535
No log	8.5614	488	1.3292	0.5	1.3292	1.1529
No log	8.5965	490	1.2506	0.4640	1.2506	1.1183
No log	8.6316	492	1.1678	0.4715	1.1678	1.0806
No log	8.6667	494	1.1518	0.5079	1.1518	1.0732
No log	8.7018	496	1.2011	0.5116	1.2011	1.0960
No log	8.7368	498	1.3327	0.5	1.3327	1.1544
0.3836	8.7719	500	1.4765	0.4925	1.4765	1.2151
0.3836	8.8070	502	1.4657	0.4697	1.4657	1.2107
0.3836	8.8421	504	1.3687	0.5038	1.3687	1.1699
0.3836	8.8772	506	1.2548	0.5039	1.2548	1.1202
0.3836	8.9123	508	1.2194	0.5039	1.2194	1.1042
0.3836	8.9474	510	1.2363	0.5039	1.2363	1.1119
0.3836	8.9825	512	1.2785	0.4882	1.2785	1.1307
0.3836	9.0175	514	1.3391	0.4844	1.3391	1.1572
0.3836	9.0526	516	1.3396	0.4844	1.3396	1.1574
0.3836	9.0877	518	1.3334	0.5116	1.3334	1.1547
0.3836	9.1228	520	1.4413	0.4697	1.4413	1.2005
0.3836	9.1579	522	1.5750	0.4211	1.5750	1.2550
0.3836	9.1930	524	1.6035	0.4211	1.6035	1.2663
0.3836	9.2281	526	1.4832	0.4962	1.4832	1.2179
0.3836	9.2632	528	1.3485	0.5038	1.3485	1.1613
0.3836	9.2982	530	1.2556	0.5156	1.2556	1.1205
0.3836	9.3333	532	1.1745	0.5271	1.1745	1.0837
0.3836	9.3684	534	1.2006	0.5156	1.2006	1.0957
0.3836	9.4035	536	1.2742	0.5231	1.2742	1.1288
0.3836	9.4386	538	1.2358	0.5231	1.2358	1.1117
0.3836	9.4737	540	1.2382	0.5191	1.2382	1.1127
0.3836	9.5088	542	1.1626	0.5156	1.1626	1.0783
0.3836	9.5439	544	1.1587	0.5156	1.1587	1.0764
0.3836	9.5789	546	1.1807	0.5156	1.1807	1.0866
0.3836	9.6140	548	1.2486	0.5156	1.2486	1.1174
0.3836	9.6491	550	1.3491	0.4961	1.3491	1.1615
0.3836	9.6842	552	1.4078	0.5038	1.4078	1.1865
0.3836	9.7193	554	1.3843	0.5156	1.3843	1.1766
0.3836	9.7544	556	1.3483	0.5354	1.3483	1.1612
0.3836	9.7895	558	1.2879	0.5238	1.2879	1.1349
0.3836	9.8246	560	1.2796	0.512	1.2796	1.1312
0.3836	9.8596	562	1.3324	0.4878	1.3324	1.1543
0.3836	9.8947	564	1.4298	0.4677	1.4298	1.1957
0.3836	9.9298	566	1.5911	0.4462	1.5911	1.2614
0.3836	9.9649	568	1.6811	0.4211	1.6811	1.2966
0.3836	10.0	570	1.6672	0.4211	1.6672	1.2912

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1