ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8542
• Qwk: 0.2695
• Mse: 1.8542
• Rmse: 1.3617

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0270	2	6.8929	-0.0056	6.8929	2.6254
No log	0.0541	4	4.2842	0.0823	4.2842	2.0698
No log	0.0811	6	3.1945	-0.0347	3.1945	1.7873
No log	0.1081	8	2.2973	0.1000	2.2973	1.5157
No log	0.1351	10	1.7737	0.1579	1.7737	1.3318
No log	0.1622	12	1.6356	0.1698	1.6356	1.2789
No log	0.1892	14	1.6245	0.2124	1.6245	1.2746
No log	0.2162	16	2.1740	0.1692	2.1740	1.4744
No log	0.2432	18	2.0593	0.1692	2.0593	1.4350
No log	0.2703	20	1.6166	0.2373	1.6166	1.2714
No log	0.2973	22	1.5211	0.2593	1.5211	1.2333
No log	0.3243	24	1.4405	0.2430	1.4405	1.2002
No log	0.3514	26	1.4335	0.2783	1.4335	1.1973
No log	0.3784	28	1.6150	0.3226	1.6150	1.2708
No log	0.4054	30	1.4388	0.3471	1.4388	1.1995
No log	0.4324	32	1.3625	0.2655	1.3625	1.1673
No log	0.4595	34	1.4088	0.3051	1.4088	1.1869
No log	0.4865	36	1.4563	0.2281	1.4563	1.2068
No log	0.5135	38	1.5211	0.1802	1.5211	1.2333
No log	0.5405	40	1.7604	0.1441	1.7604	1.3268
No log	0.5676	42	1.9785	0.1081	1.9785	1.4066
No log	0.5946	44	1.7353	0.1636	1.7353	1.3173
No log	0.6216	46	1.4671	0.3717	1.4671	1.2113
No log	0.6486	48	1.2472	0.4706	1.2472	1.1168
No log	0.6757	50	1.1594	0.5000	1.1594	1.0768
No log	0.7027	52	1.1541	0.5781	1.1541	1.0743
No log	0.7297	54	1.3192	0.5038	1.3192	1.1486
No log	0.7568	56	1.1116	0.544	1.1116	1.0543
No log	0.7838	58	1.0228	0.5082	1.0228	1.0114
No log	0.8108	60	1.0274	0.4715	1.0274	1.0136
No log	0.8378	62	1.1264	0.5426	1.1264	1.0613
No log	0.8649	64	1.0271	0.4878	1.0271	1.0134
No log	0.8919	66	1.0989	0.5920	1.0989	1.0483
No log	0.9189	68	1.0483	0.56	1.0483	1.0239
No log	0.9459	70	1.0211	0.5984	1.0211	1.0105
No log	0.9730	72	1.1059	0.5625	1.1059	1.0516
No log	1.0	74	1.1605	0.5263	1.1605	1.0772
No log	1.0270	76	1.1773	0.5652	1.1773	1.0850
No log	1.0541	78	1.2050	0.5588	1.2050	1.0977
No log	1.0811	80	1.2773	0.5185	1.2773	1.1302
No log	1.1081	82	1.2112	0.5630	1.2112	1.1005
No log	1.1351	84	1.1764	0.6	1.1764	1.0846
No log	1.1622	86	1.3864	0.4118	1.3864	1.1775
No log	1.1892	88	1.5634	0.3597	1.5634	1.2503
No log	1.2162	90	1.5839	0.3597	1.5839	1.2585
No log	1.2432	92	1.4206	0.4265	1.4206	1.1919
No log	1.2703	94	1.3106	0.4493	1.3106	1.1448
No log	1.2973	96	1.7453	0.3243	1.7453	1.3211
No log	1.3243	98	1.6566	0.3425	1.6566	1.2871
No log	1.3514	100	1.1646	0.5441	1.1646	1.0792
No log	1.3784	102	1.2124	0.5191	1.2124	1.1011
No log	1.4054	104	1.7369	0.2857	1.7369	1.3179
No log	1.4324	106	1.8493	0.2411	1.8493	1.3599
No log	1.4595	108	1.8282	0.2571	1.8282	1.3521
No log	1.4865	110	1.6501	0.3333	1.6501	1.2846
No log	1.5135	112	1.5015	0.3824	1.5015	1.2253
No log	1.5405	114	1.7674	0.2714	1.7674	1.3294
No log	1.5676	116	1.5867	0.3404	1.5867	1.2597
No log	1.5946	118	1.0532	0.6154	1.0532	1.0263
No log	1.6216	120	0.9723	0.6412	0.9723	0.9861
No log	1.6486	122	1.0806	0.6269	1.0806	1.0395
No log	1.6757	124	1.1879	0.5588	1.1879	1.0899
No log	1.7027	126	1.5847	0.3662	1.5847	1.2588
No log	1.7297	128	1.4932	0.4493	1.4932	1.2220
No log	1.7568	130	1.1217	0.5839	1.1217	1.0591
No log	1.7838	132	0.9630	0.6462	0.9630	0.9813
No log	1.8108	134	1.0244	0.6567	1.0244	1.0121
No log	1.8378	136	1.5077	0.4681	1.5077	1.2279
No log	1.8649	138	1.7435	0.3429	1.7435	1.3204
No log	1.8919	140	1.5315	0.4526	1.5315	1.2375
No log	1.9189	142	1.4897	0.4559	1.4897	1.2205
No log	1.9459	144	1.3431	0.5075	1.3431	1.1589
No log	1.9730	146	1.3392	0.4962	1.3392	1.1572
No log	2.0	148	1.3411	0.4580	1.3411	1.1580
No log	2.0270	150	1.3688	0.4394	1.3688	1.1700
No log	2.0541	152	1.4102	0.4361	1.4102	1.1875
No log	2.0811	154	1.2641	0.5156	1.2641	1.1243
No log	2.1081	156	1.0842	0.6094	1.0842	1.0412
No log	2.1351	158	1.0488	0.6260	1.0488	1.0241
No log	2.1622	160	1.2208	0.5147	1.2208	1.1049
No log	2.1892	162	1.7305	0.3472	1.7305	1.3155
No log	2.2162	164	1.9993	0.2740	1.9993	1.4140
No log	2.2432	166	1.8025	0.2937	1.8025	1.3426
No log	2.2703	168	1.3306	0.5441	1.3306	1.1535
No log	2.2973	170	1.1756	0.5985	1.1756	1.0842
No log	2.3243	172	1.3144	0.5263	1.3144	1.1465
No log	2.3514	174	1.5594	0.4776	1.5594	1.2487
No log	2.3784	176	1.5339	0.4741	1.5339	1.2385
No log	2.4054	178	1.3184	0.5263	1.3184	1.1482
No log	2.4324	180	1.1013	0.5846	1.1013	1.0494
No log	2.4595	182	1.1019	0.5781	1.1019	1.0497
No log	2.4865	184	1.2356	0.5522	1.2356	1.1116
No log	2.5135	186	1.5607	0.3235	1.5607	1.2493
No log	2.5405	188	1.7672	0.2553	1.7672	1.3293
No log	2.5676	190	1.5756	0.3333	1.5756	1.2552
No log	2.5946	192	1.2171	0.5693	1.2171	1.1032
No log	2.6216	194	1.2615	0.5441	1.2615	1.1231
No log	2.6486	196	1.2400	0.5441	1.2400	1.1136
No log	2.6757	198	1.3732	0.5147	1.3732	1.1718
No log	2.7027	200	1.4029	0.4154	1.4029	1.1844
No log	2.7297	202	1.2672	0.5455	1.2672	1.1257
No log	2.7568	204	1.2110	0.5802	1.2110	1.1004
No log	2.7838	206	1.2501	0.5538	1.2501	1.1181
No log	2.8108	208	1.3969	0.4733	1.3969	1.1819
No log	2.8378	210	1.4075	0.4925	1.4075	1.1864
No log	2.8649	212	1.2548	0.5522	1.2548	1.1202
No log	2.8919	214	1.2088	0.5588	1.2088	1.0994
No log	2.9189	216	1.3211	0.4925	1.3211	1.1494
No log	2.9459	218	1.4848	0.3609	1.4848	1.2185
No log	2.9730	220	1.4769	0.3609	1.4769	1.2153
No log	3.0	222	1.3339	0.4882	1.3339	1.1549
No log	3.0270	224	1.2211	0.5366	1.2211	1.1050
No log	3.0541	226	1.1596	0.56	1.1596	1.0768
No log	3.0811	228	1.1613	0.5484	1.1613	1.0776
No log	3.1081	230	1.4445	0.4211	1.4445	1.2019
No log	3.1351	232	1.8057	0.2411	1.8057	1.3438
No log	3.1622	234	1.7640	0.2571	1.7640	1.3281
No log	3.1892	236	1.4522	0.4275	1.4522	1.2051
No log	3.2162	238	1.2544	0.56	1.2544	1.1200
No log	3.2432	240	1.2400	0.56	1.2400	1.1136
No log	3.2703	242	1.3228	0.4724	1.3228	1.1501
No log	3.2973	244	1.5299	0.3910	1.5299	1.2369
No log	3.3243	246	1.6620	0.2878	1.6620	1.2892
No log	3.3514	248	1.5425	0.3824	1.5425	1.2420
No log	3.3784	250	1.1610	0.6232	1.1610	1.0775
No log	3.4054	252	0.9825	0.6316	0.9825	0.9912
No log	3.4324	254	1.0037	0.6316	1.0037	1.0018
No log	3.4595	256	1.1687	0.5970	1.1687	1.0811
No log	3.4865	258	1.3736	0.4889	1.3736	1.1720
No log	3.5135	260	1.4041	0.4925	1.4041	1.1849
No log	3.5405	262	1.2066	0.5714	1.2066	1.0985
No log	3.5676	264	1.1408	0.5970	1.1408	1.0681
No log	3.5946	266	1.2294	0.5373	1.2294	1.1088
No log	3.6216	268	1.2231	0.5630	1.2231	1.1059
No log	3.6486	270	1.1737	0.6131	1.1737	1.0834
No log	3.6757	272	1.3609	0.4925	1.3609	1.1666
No log	3.7027	274	1.4167	0.4478	1.4167	1.1903
No log	3.7297	276	1.2273	0.5191	1.2273	1.1078
No log	3.7568	278	1.1170	0.5496	1.1170	1.0569
No log	3.7838	280	1.0034	0.6094	1.0034	1.0017
No log	3.8108	282	1.0121	0.6349	1.0121	1.0060
No log	3.8378	284	1.0896	0.5556	1.0896	1.0438
No log	3.8649	286	1.2826	0.4688	1.2826	1.1325
No log	3.8919	288	1.4086	0.4651	1.4086	1.1869
No log	3.9189	290	1.3194	0.4923	1.3194	1.1486
No log	3.9459	292	1.1375	0.5344	1.1375	1.0665
No log	3.9730	294	1.1688	0.5077	1.1688	1.0811
No log	4.0	296	1.2650	0.4462	1.2650	1.1247
No log	4.0270	298	1.3003	0.4531	1.3003	1.1403
No log	4.0541	300	1.3460	0.4531	1.3460	1.1602
No log	4.0811	302	1.4009	0.4531	1.4009	1.1836
No log	4.1081	304	1.2917	0.4603	1.2917	1.1365
No log	4.1351	306	1.1538	0.5197	1.1538	1.0741
No log	4.1622	308	1.0330	0.5692	1.0330	1.0164
No log	4.1892	310	1.1231	0.5414	1.1231	1.0598
No log	4.2162	312	1.2906	0.5075	1.2906	1.1361
No log	4.2432	314	1.6094	0.3478	1.6094	1.2686
No log	4.2703	316	1.9022	0.2571	1.9022	1.3792
No log	4.2973	318	1.8967	0.2571	1.8967	1.3772
No log	4.3243	320	1.5044	0.4030	1.5044	1.2266
No log	4.3514	322	1.1440	0.5496	1.1440	1.0696
No log	4.3784	324	1.0552	0.6308	1.0552	1.0272
No log	4.4054	326	1.0864	0.5781	1.0864	1.0423
No log	4.4324	328	1.2012	0.5455	1.2012	1.0960
No log	4.4595	330	1.1992	0.5224	1.1992	1.0951
No log	4.4865	332	1.1131	0.5455	1.1131	1.0550
No log	4.5135	334	0.9790	0.6187	0.9790	0.9895
No log	4.5405	336	0.9474	0.6232	0.9474	0.9734
No log	4.5676	338	1.0380	0.6131	1.0380	1.0188
No log	4.5946	340	1.2087	0.5224	1.2087	1.0994
No log	4.6216	342	1.3687	0.4122	1.3687	1.1699
No log	4.6486	344	1.4334	0.4308	1.4334	1.1972
No log	4.6757	346	1.3484	0.4724	1.3484	1.1612
No log	4.7027	348	1.2154	0.5556	1.2154	1.1024
No log	4.7297	350	1.1362	0.5938	1.1362	1.0659
No log	4.7568	352	1.1748	0.5538	1.1748	1.0839
No log	4.7838	354	1.3606	0.4308	1.3606	1.1665
No log	4.8108	356	1.4457	0.4091	1.4457	1.2024
No log	4.8378	358	1.3521	0.4651	1.3521	1.1628
No log	4.8649	360	1.1880	0.5312	1.1880	1.0899
No log	4.8919	362	1.1755	0.5312	1.1755	1.0842
No log	4.9189	364	1.2567	0.5116	1.2567	1.1210
No log	4.9459	366	1.4155	0.4496	1.4155	1.1897
No log	4.9730	368	1.4248	0.4531	1.4248	1.1937
No log	5.0	370	1.3667	0.4531	1.3667	1.1691
No log	5.0270	372	1.3427	0.4531	1.3427	1.1588
No log	5.0541	374	1.2849	0.4806	1.2849	1.1335
No log	5.0811	376	1.2493	0.4923	1.2493	1.1177
No log	5.1081	378	1.2896	0.5	1.2896	1.1356
No log	5.1351	380	1.4376	0.4118	1.4376	1.1990
No log	5.1622	382	1.4707	0.4118	1.4707	1.2127
No log	5.1892	384	1.3653	0.4662	1.3653	1.1685
No log	5.2162	386	1.2038	0.5564	1.2038	1.0972
No log	5.2432	388	1.0769	0.5938	1.0769	1.0377
No log	5.2703	390	1.0593	0.5938	1.0593	1.0292
No log	5.2973	392	1.1249	0.5821	1.1249	1.0606
No log	5.3243	394	1.2941	0.5564	1.2941	1.1376
No log	5.3514	396	1.3010	0.5564	1.3010	1.1406
No log	5.3784	398	1.1158	0.5821	1.1158	1.0563
No log	5.4054	400	1.0215	0.6061	1.0215	1.0107
No log	5.4324	402	1.1036	0.5606	1.1036	1.0505
No log	5.4595	404	1.1688	0.5564	1.1688	1.0811
No log	5.4865	406	1.2378	0.4651	1.2378	1.1126
No log	5.5135	408	1.2846	0.4688	1.2846	1.1334
No log	5.5405	410	1.2467	0.512	1.2467	1.1165
No log	5.5676	412	1.2458	0.512	1.2458	1.1161
No log	5.5946	414	1.3028	0.4923	1.3028	1.1414
No log	5.6216	416	1.4292	0.4427	1.4292	1.1955
No log	5.6486	418	1.6644	0.3043	1.6644	1.2901
No log	5.6757	420	1.7180	0.2734	1.7180	1.3107
No log	5.7027	422	1.6822	0.36	1.6822	1.2970
No log	5.7297	424	1.8744	0.25	1.8744	1.3691
No log	5.7568	426	2.0008	0.2378	2.0008	1.4145
No log	5.7838	428	2.0985	0.2378	2.0985	1.4486
No log	5.8108	430	1.8871	0.2676	1.8871	1.3737
No log	5.8378	432	1.5547	0.3582	1.5547	1.2469
No log	5.8649	434	1.4103	0.4444	1.4103	1.1876
No log	5.8919	436	1.3230	0.4800	1.3230	1.1502
No log	5.9189	438	1.3798	0.4762	1.3798	1.1746
No log	5.9459	440	1.4538	0.4394	1.4538	1.2057
No log	5.9730	442	1.3858	0.4769	1.3858	1.1772
No log	6.0	444	1.3253	0.5077	1.3253	1.1512
No log	6.0270	446	1.2649	0.5426	1.2649	1.1247
No log	6.0541	448	1.3683	0.4688	1.3683	1.1697
No log	6.0811	450	1.5804	0.3556	1.5804	1.2571
No log	6.1081	452	1.7480	0.2571	1.7480	1.3221
No log	6.1351	454	1.7478	0.2571	1.7478	1.3220
No log	6.1622	456	1.5346	0.3582	1.5346	1.2388
No log	6.1892	458	1.4359	0.3939	1.4359	1.1983
No log	6.2162	460	1.3860	0.4651	1.3860	1.1773
No log	6.2432	462	1.3922	0.4580	1.3922	1.1799
No log	6.2703	464	1.4855	0.3582	1.4855	1.2188
No log	6.2973	466	1.5759	0.3259	1.5759	1.2553
No log	6.3243	468	1.5617	0.3259	1.5617	1.2497
No log	6.3514	470	1.4583	0.4030	1.4583	1.2076
No log	6.3784	472	1.4648	0.4211	1.4648	1.2103
No log	6.4054	474	1.5924	0.3259	1.5924	1.2619
No log	6.4324	476	1.6194	0.2774	1.6194	1.2726
No log	6.4595	478	1.6123	0.2774	1.6123	1.2698
No log	6.4865	480	1.4302	0.4242	1.4302	1.1959
No log	6.5135	482	1.4138	0.4242	1.4138	1.1890
No log	6.5405	484	1.5529	0.3284	1.5529	1.2462
No log	6.5676	486	1.7831	0.2571	1.7831	1.3353
No log	6.5946	488	1.7569	0.2571	1.7569	1.3255
No log	6.6216	490	1.5691	0.3111	1.5691	1.2526
No log	6.6486	492	1.4955	0.4328	1.4955	1.2229
No log	6.6757	494	1.5010	0.4328	1.5010	1.2252
No log	6.7027	496	1.5436	0.3759	1.5436	1.2424
No log	6.7297	498	1.4867	0.4275	1.4867	1.2193
0.3646	6.7568	500	1.4178	0.4844	1.4178	1.1907
0.3646	6.7838	502	1.4205	0.4651	1.4205	1.1918
0.3646	6.8108	504	1.3975	0.4651	1.3975	1.1821
0.3646	6.8378	506	1.5192	0.3939	1.5192	1.2325
0.3646	6.8649	508	1.7678	0.2695	1.7678	1.3296
0.3646	6.8919	510	1.8542	0.2695	1.8542	1.3617

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1