ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1761
• Qwk: 0.5203
• Mse: 1.1761
• Rmse: 1.0845

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0263	2	6.9485	0.0179	6.9485	2.6360
No log	0.0526	4	4.7356	0.0690	4.7356	2.1761
No log	0.0789	6	4.4534	-0.0762	4.4534	2.1103
No log	0.1053	8	3.5114	-0.0215	3.5114	1.8739
No log	0.1316	10	2.3099	0.1594	2.3099	1.5198
No log	0.1579	12	2.1230	0.0472	2.1230	1.4571
No log	0.1842	14	2.0516	0.2051	2.0516	1.4323
No log	0.2105	16	2.1600	0.1860	2.1600	1.4697
No log	0.2368	18	1.8890	0.2623	1.8890	1.3744
No log	0.2632	20	1.5498	0.1869	1.5498	1.2449
No log	0.2895	22	1.4920	0.2545	1.4920	1.2215
No log	0.3158	24	1.5072	0.2222	1.5072	1.2277
No log	0.3421	26	1.7384	0.3937	1.7384	1.3185
No log	0.3684	28	2.1178	0.2483	2.1178	1.4553
No log	0.3947	30	2.0368	0.2483	2.0368	1.4272
No log	0.4211	32	1.7612	0.3433	1.7612	1.3271
No log	0.4474	34	1.6400	0.3433	1.6400	1.2806
No log	0.4737	36	1.3878	0.4390	1.3878	1.1781
No log	0.5	38	1.4926	0.3103	1.4926	1.2217
No log	0.5263	40	1.6367	0.3051	1.6367	1.2793
No log	0.5526	42	1.5078	0.3697	1.5078	1.2279
No log	0.5789	44	1.6132	0.3511	1.6132	1.2701
No log	0.6053	46	1.8308	0.3404	1.8308	1.3531
No log	0.6316	48	1.7569	0.3333	1.7569	1.3255
No log	0.6579	50	1.4976	0.3040	1.4976	1.2238
No log	0.6842	52	1.3496	0.3740	1.3496	1.1617
No log	0.7105	54	1.2525	0.4538	1.2525	1.1192
No log	0.7368	56	1.1865	0.4667	1.1865	1.0893
No log	0.7632	58	1.1642	0.4500	1.1642	1.0790
No log	0.7895	60	1.1495	0.4878	1.1495	1.0721
No log	0.8158	62	1.1198	0.5323	1.1198	1.0582
No log	0.8421	64	1.2645	0.4538	1.2645	1.1245
No log	0.8684	66	1.3619	0.4	1.3619	1.1670
No log	0.8947	68	1.5869	0.2540	1.5869	1.2597
No log	0.9211	70	1.5142	0.3077	1.5142	1.2305
No log	0.9474	72	1.2532	0.4627	1.2532	1.1194
No log	0.9737	74	1.0878	0.6569	1.0878	1.0430
No log	1.0	76	1.0580	0.6119	1.0580	1.0286
No log	1.0263	78	1.0620	0.5758	1.0620	1.0305
No log	1.0526	80	1.1231	0.5455	1.1231	1.0598
No log	1.0789	82	1.0501	0.6015	1.0501	1.0247
No log	1.1053	84	0.9538	0.5846	0.9538	0.9766
No log	1.1316	86	0.9797	0.5512	0.9797	0.9898
No log	1.1579	88	1.0257	0.5538	1.0257	1.0127
No log	1.1842	90	1.0423	0.6107	1.0423	1.0209
No log	1.2105	92	1.1236	0.512	1.1236	1.0600
No log	1.2368	94	1.3760	0.4580	1.3760	1.1730
No log	1.2632	96	1.4841	0.4242	1.4841	1.2182
No log	1.2895	98	1.3045	0.4733	1.3045	1.1421
No log	1.3158	100	1.1379	0.5385	1.1379	1.0667
No log	1.3421	102	1.1105	0.5909	1.1105	1.0538
No log	1.3684	104	1.2125	0.5802	1.2125	1.1011
No log	1.3947	106	1.3692	0.4511	1.3692	1.1701
No log	1.4211	108	1.2390	0.5303	1.2390	1.1131
No log	1.4474	110	0.9788	0.6260	0.9788	0.9894
No log	1.4737	112	0.9506	0.608	0.9506	0.9750
No log	1.5	114	1.0032	0.4615	1.0032	1.0016
No log	1.5263	116	1.0613	0.3860	1.0613	1.0302
No log	1.5526	118	1.1684	0.5289	1.1684	1.0809
No log	1.5789	120	1.2322	0.5528	1.2322	1.1100
No log	1.6053	122	1.1690	0.5920	1.1690	1.0812
No log	1.6316	124	1.2154	0.5625	1.2154	1.1024
No log	1.6579	126	1.2558	0.5385	1.2558	1.1206
No log	1.6842	128	1.0645	0.6	1.0645	1.0317
No log	1.7105	130	1.0013	0.6154	1.0013	1.0006
No log	1.7368	132	1.0977	0.5581	1.0977	1.0477
No log	1.7632	134	1.3718	0.4962	1.3718	1.1712
No log	1.7895	136	1.4255	0.4776	1.4255	1.1940
No log	1.8158	138	1.1400	0.5231	1.1400	1.0677
No log	1.8421	140	0.9129	0.6142	0.9129	0.9555
No log	1.8684	142	0.8697	0.625	0.8697	0.9326
No log	1.8947	144	0.9746	0.6107	0.9746	0.9872
No log	1.9211	146	1.3480	0.4444	1.3480	1.1610
No log	1.9474	148	1.3812	0.4444	1.3812	1.1752
No log	1.9737	150	1.1577	0.5303	1.1577	1.0760
No log	2.0	152	1.0791	0.5758	1.0791	1.0388
No log	2.0263	154	1.0338	0.5758	1.0338	1.0168
No log	2.0526	156	1.1483	0.5191	1.1483	1.0716
No log	2.0789	158	1.1870	0.5191	1.1870	1.0895
No log	2.1053	160	1.1359	0.5271	1.1359	1.0658
No log	2.1316	162	1.0603	0.5538	1.0603	1.0297
No log	2.1579	164	1.0402	0.5802	1.0402	1.0199
No log	2.1842	166	1.1528	0.5	1.1528	1.0737
No log	2.2105	168	1.1261	0.5	1.1261	1.0612
No log	2.2368	170	1.1369	0.5038	1.1369	1.0663
No log	2.2632	172	1.0676	0.5271	1.0676	1.0333
No log	2.2895	174	1.1986	0.4962	1.1986	1.0948
No log	2.3158	176	1.3735	0.4706	1.3735	1.1720
No log	2.3421	178	1.4970	0.4118	1.4970	1.2235
No log	2.3684	180	1.2132	0.5038	1.2132	1.1015
No log	2.3947	182	1.1203	0.5426	1.1203	1.0584
No log	2.4211	184	1.1309	0.5426	1.1309	1.0634
No log	2.4474	186	1.0607	0.5781	1.0607	1.0299
No log	2.4737	188	1.1212	0.5426	1.1212	1.0589
No log	2.5	190	1.0613	0.5426	1.0613	1.0302
No log	2.5263	192	1.0997	0.5385	1.0997	1.0487
No log	2.5526	194	1.0731	0.5271	1.0731	1.0359
No log	2.5789	196	0.9801	0.5926	0.9801	0.9900
No log	2.6053	198	1.0870	0.5271	1.0870	1.0426
No log	2.6316	200	1.2344	0.5038	1.2344	1.1110
No log	2.6579	202	1.1746	0.5271	1.1746	1.0838
No log	2.6842	204	1.1270	0.5512	1.1270	1.0616
No log	2.7105	206	1.0832	0.5669	1.0832	1.0408
No log	2.7368	208	1.0711	0.528	1.0711	1.0349
No log	2.7632	210	1.0945	0.5156	1.0945	1.0462
No log	2.7895	212	1.1001	0.5156	1.1001	1.0489
No log	2.8158	214	1.0727	0.5385	1.0727	1.0357
No log	2.8421	216	0.9615	0.5909	0.9615	0.9806
No log	2.8684	218	0.8699	0.6912	0.8699	0.9327
No log	2.8947	220	0.9701	0.5865	0.9701	0.9850
No log	2.9211	222	1.1368	0.5038	1.1368	1.0662
No log	2.9474	224	1.0734	0.5191	1.0734	1.0361
No log	2.9737	226	0.9757	0.5781	0.9757	0.9878
No log	3.0	228	0.9944	0.5736	0.9944	0.9972
No log	3.0263	230	1.1362	0.5077	1.1362	1.0659
No log	3.0526	232	1.2847	0.4769	1.2847	1.1334
No log	3.0789	234	1.3192	0.4733	1.3192	1.1486
No log	3.1053	236	1.3841	0.4361	1.3841	1.1765
No log	3.1316	238	1.3618	0.4361	1.3618	1.1670
No log	3.1579	240	1.6478	0.3913	1.6478	1.2837
No log	3.1842	242	1.7028	0.3597	1.7028	1.3049
No log	3.2105	244	1.9027	0.2958	1.9027	1.3794
No log	3.2368	246	1.9770	0.2500	1.9770	1.4061
No log	3.2632	248	1.7325	0.3623	1.7325	1.3162
No log	3.2895	250	1.4060	0.4361	1.4060	1.1858
No log	3.3158	252	1.2432	0.4806	1.2432	1.1150
No log	3.3421	254	1.1516	0.4960	1.1516	1.0731
No log	3.3684	256	1.2156	0.5077	1.2156	1.1026
No log	3.3947	258	1.4370	0.4179	1.4370	1.1988
No log	3.4211	260	1.3632	0.4179	1.3632	1.1676
No log	3.4474	262	1.0597	0.5354	1.0597	1.0294
No log	3.4737	264	1.0064	0.5873	1.0064	1.0032
No log	3.5	266	1.0589	0.5600	1.0589	1.0290
No log	3.5263	268	1.1754	0.4677	1.1754	1.0842
No log	3.5526	270	1.3502	0.4923	1.3502	1.1620
No log	3.5789	272	1.4014	0.4733	1.4014	1.1838
No log	3.6053	274	1.2863	0.4724	1.2863	1.1342
No log	3.6316	276	1.1979	0.3393	1.1979	1.0945
No log	3.6579	278	1.2041	0.4035	1.2041	1.0973
No log	3.6842	280	1.1118	0.4138	1.1118	1.0544
No log	3.7105	282	1.0405	0.5645	1.0405	1.0200
No log	3.7368	284	1.1471	0.5271	1.1471	1.0711
No log	3.7632	286	1.2470	0.4806	1.2470	1.1167
No log	3.7895	288	1.3287	0.4806	1.3287	1.1527
No log	3.8158	290	1.2234	0.5271	1.2234	1.1061
No log	3.8421	292	1.1503	0.544	1.1503	1.0725
No log	3.8684	294	1.1430	0.5366	1.1430	1.0691
No log	3.8947	296	1.2186	0.5082	1.2186	1.1039
No log	3.9211	298	1.2344	0.5484	1.2344	1.1110
No log	3.9474	300	1.2946	0.5079	1.2946	1.1378
No log	3.9737	302	1.4225	0.4806	1.4225	1.1927
No log	4.0	304	1.4285	0.4806	1.4285	1.1952
No log	4.0263	306	1.2844	0.4806	1.2844	1.1333
No log	4.0526	308	1.2201	0.4806	1.2201	1.1046
No log	4.0789	310	1.2844	0.4806	1.2844	1.1333
No log	4.1053	312	1.4355	0.4615	1.4355	1.1981
No log	4.1316	314	1.3657	0.4806	1.3657	1.1686
No log	4.1579	316	1.2368	0.4806	1.2368	1.1121
No log	4.1842	318	1.0967	0.5691	1.0967	1.0472
No log	4.2105	320	1.0509	0.5042	1.0509	1.0252
No log	4.2368	322	1.0436	0.5574	1.0436	1.0216
No log	4.2632	324	1.1138	0.5736	1.1138	1.0554
No log	4.2895	326	1.2003	0.5271	1.2003	1.0956
No log	4.3158	328	1.1771	0.5469	1.1771	1.0850
No log	4.3421	330	1.1769	0.5714	1.1769	1.0848
No log	4.3684	332	1.1630	0.5289	1.1630	1.0784
No log	4.3947	334	1.1748	0.4444	1.1748	1.0839
No log	4.4211	336	1.1533	0.608	1.1533	1.0739
No log	4.4474	338	1.1158	0.5891	1.1158	1.0563
No log	4.4737	340	1.2154	0.5156	1.2154	1.1024
No log	4.5	342	1.5841	0.4179	1.5841	1.2586
No log	4.5263	344	1.7151	0.3650	1.7151	1.3096
No log	4.5526	346	1.5813	0.3852	1.5813	1.2575
No log	4.5789	348	1.2817	0.4923	1.2817	1.1321
No log	4.6053	350	1.2724	0.4923	1.2724	1.1280
No log	4.6316	352	1.2339	0.5156	1.2339	1.1108
No log	4.6579	354	1.2366	0.5156	1.2366	1.1120
No log	4.6842	356	1.2354	0.4961	1.2354	1.1115
No log	4.7105	358	1.2043	0.5156	1.2043	1.0974
No log	4.7368	360	1.2975	0.4688	1.2975	1.1391
No log	4.7632	362	1.3900	0.4242	1.3900	1.1790
No log	4.7895	364	1.4372	0.4242	1.4372	1.1988
No log	4.8158	366	1.3288	0.4462	1.3288	1.1527
No log	4.8421	368	1.1408	0.5354	1.1408	1.0681
No log	4.8684	370	1.0863	0.5556	1.0863	1.0422
No log	4.8947	372	1.1320	0.528	1.1320	1.0639
No log	4.9211	374	1.2041	0.4882	1.2041	1.0973
No log	4.9474	376	1.1570	0.4882	1.1570	1.0757
No log	4.9737	378	1.0168	0.5556	1.0168	1.0084
No log	5.0	380	0.9755	0.5827	0.9755	0.9877
No log	5.0263	382	1.0743	0.5556	1.0743	1.0365
No log	5.0526	384	1.2105	0.4806	1.2105	1.1002
No log	5.0789	386	1.2854	0.4806	1.2854	1.1338
No log	5.1053	388	1.1938	0.5469	1.1938	1.0926
No log	5.1316	390	1.0898	0.5827	1.0898	1.0439
No log	5.1579	392	1.1158	0.5625	1.1158	1.0563
No log	5.1842	394	1.1841	0.5156	1.1841	1.0882
No log	5.2105	396	1.2515	0.5271	1.2515	1.1187
No log	5.2368	398	1.3283	0.4580	1.3283	1.1525
No log	5.2632	400	1.3020	0.4848	1.3020	1.1410
No log	5.2895	402	1.1575	0.5496	1.1575	1.0759
No log	5.3158	404	1.1253	0.5496	1.1253	1.0608
No log	5.3421	406	1.1538	0.5231	1.1538	1.0742
No log	5.3684	408	1.2219	0.5038	1.2219	1.1054
No log	5.3947	410	1.1864	0.5231	1.1864	1.0892
No log	5.4211	412	1.1826	0.4882	1.1826	1.0875
No log	5.4474	414	1.1548	0.5354	1.1548	1.0746
No log	5.4737	416	1.2284	0.4961	1.2284	1.1083
No log	5.5	418	1.2651	0.4769	1.2651	1.1247
No log	5.5263	420	1.3839	0.4211	1.3839	1.1764
No log	5.5526	422	1.4422	0.4211	1.4422	1.2009
No log	5.5789	424	1.3495	0.4545	1.3495	1.1617
No log	5.6053	426	1.2314	0.4961	1.2314	1.1097
No log	5.6316	428	1.2617	0.4769	1.2617	1.1232
No log	5.6579	430	1.3360	0.4769	1.3360	1.1559
No log	5.6842	432	1.3083	0.4769	1.3083	1.1438
No log	5.7105	434	1.2061	0.5	1.2061	1.0982
No log	5.7368	436	1.1119	0.5354	1.1119	1.0545
No log	5.7632	438	1.1323	0.5354	1.1323	1.0641
No log	5.7895	440	1.2278	0.5	1.2278	1.1081
No log	5.8158	442	1.2347	0.5	1.2347	1.1112
No log	5.8421	444	1.1626	0.5156	1.1626	1.0783
No log	5.8684	446	1.2150	0.5271	1.2150	1.1023
No log	5.8947	448	1.3837	0.4733	1.3837	1.1763
No log	5.9211	450	1.6096	0.3582	1.6096	1.2687
No log	5.9474	452	1.6597	0.3582	1.6597	1.2883
No log	5.9737	454	1.4918	0.3881	1.4918	1.2214
No log	6.0	456	1.2546	0.4733	1.2546	1.1201
No log	6.0263	458	1.0714	0.5426	1.0714	1.0351
No log	6.0526	460	1.0423	0.5538	1.0423	1.0209
No log	6.0789	462	1.1354	0.5385	1.1354	1.0656
No log	6.1053	464	1.3384	0.4615	1.3384	1.1569
No log	6.1316	466	1.4806	0.3881	1.4806	1.2168
No log	6.1579	468	1.4138	0.4242	1.4138	1.1890
No log	6.1842	470	1.2632	0.4844	1.2632	1.1239
No log	6.2105	472	1.0787	0.5625	1.0787	1.0386
No log	6.2368	474	0.9757	0.6202	0.9757	0.9878
No log	6.2632	476	0.9639	0.6202	0.9639	0.9818
No log	6.2895	478	1.0552	0.6061	1.0552	1.0272
No log	6.3158	480	1.2705	0.4812	1.2705	1.1272
No log	6.3421	482	1.3775	0.4242	1.3775	1.1737
No log	6.3684	484	1.3375	0.4427	1.3375	1.1565
No log	6.3947	486	1.2118	0.5152	1.2118	1.1008
No log	6.4211	488	1.0935	0.6094	1.0935	1.0457
No log	6.4474	490	1.1028	0.6094	1.1028	1.0502
No log	6.4737	492	1.1543	0.5891	1.1543	1.0744
No log	6.5	494	1.2703	0.5152	1.2703	1.1271
No log	6.5263	496	1.3126	0.4615	1.3126	1.1457
No log	6.5526	498	1.2223	0.5496	1.2223	1.1056
0.3738	6.5789	500	1.2016	0.5271	1.2016	1.0962
0.3738	6.6053	502	1.2567	0.5	1.2567	1.1210
0.3738	6.6316	504	1.2622	0.4724	1.2622	1.1235
0.3738	6.6579	506	1.2767	0.4724	1.2767	1.1299
0.3738	6.6842	508	1.2492	0.5	1.2492	1.1177
0.3738	6.7105	510	1.1761	0.5203	1.1761	1.0845

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1