ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2982
• Qwk: 0.4310
• Mse: 1.2982
• Rmse: 1.1394

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0286	2	7.0574	-0.0164	7.0574	2.6566
No log	0.0571	4	4.6189	0.0333	4.6189	2.1492
No log	0.0857	6	5.1459	-0.1244	5.1459	2.2684
No log	0.1143	8	4.5569	-0.1502	4.5569	2.1347
No log	0.1429	10	2.4443	0.0438	2.4443	1.5634
No log	0.1714	12	2.3250	0.0	2.3250	1.5248
No log	0.2	14	3.0997	0.0727	3.0997	1.7606
No log	0.2286	16	2.8701	0.0253	2.8701	1.6941
No log	0.2571	18	2.3553	0.0286	2.3553	1.5347
No log	0.2857	20	1.9703	0.0696	1.9703	1.4037
No log	0.3143	22	1.8577	0.1321	1.8577	1.3630
No log	0.3429	24	1.7546	0.1321	1.7546	1.3246
No log	0.3714	26	1.6666	0.1509	1.6666	1.2910
No log	0.4	28	1.6342	0.1509	1.6342	1.2783
No log	0.4286	30	1.5582	0.1869	1.5582	1.2483
No log	0.4571	32	1.4281	0.2523	1.4281	1.1950
No log	0.4857	34	1.3574	0.2832	1.3574	1.1651
No log	0.5143	36	1.4143	0.3667	1.4143	1.1892
No log	0.5429	38	1.3069	0.4000	1.3069	1.1432
No log	0.5714	40	1.3395	0.2857	1.3395	1.1574
No log	0.6	42	1.5892	0.3158	1.5892	1.2606
No log	0.6286	44	1.7477	0.2807	1.7477	1.3220
No log	0.6571	46	2.1992	-0.1091	2.1992	1.4830
No log	0.6857	48	1.6642	0.1913	1.6642	1.2900
No log	0.7143	50	1.4962	0.3051	1.4962	1.2232
No log	0.7429	52	1.4919	0.2609	1.4919	1.2214
No log	0.7714	54	1.9499	0.1429	1.9499	1.3964
No log	0.8	56	2.3331	-0.0909	2.3331	1.5274
No log	0.8286	58	1.9759	0.1416	1.9759	1.4057
No log	0.8571	60	1.4473	0.2957	1.4473	1.2030
No log	0.8857	62	1.5272	0.3770	1.5272	1.2358
No log	0.9143	64	1.6799	0.3780	1.6799	1.2961
No log	0.9429	66	1.4784	0.4320	1.4784	1.2159
No log	0.9714	68	1.3611	0.4538	1.3611	1.1667
No log	1.0	70	1.3591	0.2936	1.3591	1.1658
No log	1.0286	72	1.3756	0.2243	1.3756	1.1729
No log	1.0571	74	1.3966	0.1887	1.3966	1.1818
No log	1.0857	76	1.4503	0.1524	1.4503	1.2043
No log	1.1143	78	1.5959	0.1165	1.5959	1.2633
No log	1.1429	80	1.6959	0.1165	1.6959	1.3023
No log	1.1714	82	1.8445	0.1346	1.8445	1.3581
No log	1.2	84	2.1376	-0.0935	2.1376	1.4620
No log	1.2286	86	2.5935	-0.1770	2.5935	1.6104
No log	1.2571	88	2.5751	-0.1786	2.5751	1.6047
No log	1.2857	90	1.8423	0.1714	1.8423	1.3573
No log	1.3143	92	1.2718	0.4298	1.2718	1.1277
No log	1.3429	94	1.1952	0.5397	1.1952	1.0932
No log	1.3714	96	1.2477	0.4733	1.2477	1.1170
No log	1.4	98	1.5718	0.3824	1.5718	1.2537
No log	1.4286	100	1.5180	0.4179	1.5180	1.2321
No log	1.4571	102	1.2239	0.4715	1.2239	1.1063
No log	1.4857	104	1.2283	0.4483	1.2283	1.1083
No log	1.5143	106	1.2886	0.3423	1.2886	1.1352
No log	1.5429	108	1.4633	0.3729	1.4633	1.2097
No log	1.5714	110	1.6015	0.3866	1.6015	1.2655
No log	1.6	112	1.5626	0.2679	1.5626	1.2500
No log	1.6286	114	1.3972	0.2727	1.3972	1.1820
No log	1.6571	116	1.1796	0.4	1.1796	1.0861
No log	1.6857	118	1.1402	0.4500	1.1402	1.0678
No log	1.7143	120	1.1637	0.4833	1.1637	1.0788
No log	1.7429	122	1.5345	0.368	1.5345	1.2388
No log	1.7714	124	1.6624	0.2857	1.6624	1.2893
No log	1.8	126	1.4605	0.4286	1.4605	1.2085
No log	1.8286	128	1.2545	0.5041	1.2545	1.1200
No log	1.8571	130	1.2262	0.5041	1.2262	1.1073
No log	1.8857	132	1.1257	0.4310	1.1257	1.0610
No log	1.9143	134	1.1913	0.3860	1.1913	1.0915
No log	1.9429	136	1.4020	0.3214	1.4020	1.1841
No log	1.9714	138	1.5353	0.2832	1.5353	1.2391
No log	2.0	140	1.3891	0.3158	1.3891	1.1786
No log	2.0286	142	1.2183	0.4628	1.2183	1.1038
No log	2.0571	144	1.1224	0.4918	1.1224	1.0594
No log	2.0857	146	1.1883	0.5556	1.1883	1.0901
No log	2.1143	148	1.2417	0.5231	1.2417	1.1143
No log	2.1429	150	1.1354	0.544	1.1354	1.0656
No log	2.1714	152	1.0044	0.5289	1.0044	1.0022
No log	2.2	154	1.0938	0.5378	1.0938	1.0459
No log	2.2286	156	1.1582	0.5254	1.1582	1.0762
No log	2.2571	158	1.2242	0.3423	1.2242	1.1064
No log	2.2857	160	1.4290	0.4167	1.4290	1.1954
No log	2.3143	162	1.5080	0.384	1.5080	1.2280
No log	2.3429	164	1.3281	0.4806	1.3281	1.1524
No log	2.3714	166	1.0415	0.5669	1.0415	1.0206
No log	2.4	168	0.9949	0.5124	0.9949	0.9975
No log	2.4286	170	1.0102	0.5984	1.0102	1.0051
No log	2.4571	172	1.2779	0.5	1.2779	1.1304
No log	2.4857	174	1.8898	0.2899	1.8898	1.3747
No log	2.5143	176	2.0375	0.2286	2.0375	1.4274
No log	2.5429	178	1.8665	0.2899	1.8665	1.3662
No log	2.5714	180	1.5930	0.3910	1.5930	1.2621
No log	2.6	182	1.6054	0.375	1.6054	1.2671
No log	2.6286	184	1.4979	0.3967	1.4979	1.2239
No log	2.6571	186	1.4128	0.3932	1.4128	1.1886
No log	2.6857	188	1.3959	0.4034	1.3959	1.1815
No log	2.7143	190	1.4302	0.4228	1.4302	1.1959
No log	2.7429	192	1.6747	0.3360	1.6747	1.2941
No log	2.7714	194	1.8007	0.3206	1.8007	1.3419
No log	2.8	196	1.6916	0.3206	1.6916	1.3006
No log	2.8286	198	1.4149	0.4219	1.4149	1.1895
No log	2.8571	200	1.0829	0.5312	1.0829	1.0406
No log	2.8857	202	1.0564	0.5669	1.0564	1.0278
No log	2.9143	204	1.2072	0.4724	1.2072	1.0987
No log	2.9429	206	1.3063	0.4688	1.3063	1.1429
No log	2.9714	208	1.4392	0.4427	1.4392	1.1997
No log	3.0	210	1.3916	0.4462	1.3916	1.1797
No log	3.0286	212	1.2898	0.4844	1.2898	1.1357
No log	3.0571	214	1.2399	0.5039	1.2399	1.1135
No log	3.0857	216	1.1711	0.5354	1.1711	1.0822
No log	3.1143	218	1.0910	0.5469	1.0910	1.0445
No log	3.1429	220	1.0598	0.5469	1.0598	1.0295
No log	3.1714	222	1.0844	0.5397	1.0844	1.0413
No log	3.2	224	1.2895	0.4733	1.2895	1.1355
No log	3.2286	226	1.3982	0.4427	1.3982	1.1825
No log	3.2571	228	1.2898	0.4463	1.2898	1.1357
No log	3.2857	230	1.1935	0.3717	1.1935	1.0925
No log	3.3143	232	1.1557	0.4746	1.1557	1.0750
No log	3.3429	234	1.1689	0.5238	1.1689	1.0812
No log	3.3714	236	1.2990	0.4733	1.2990	1.1397
No log	3.4	238	1.4606	0.4511	1.4606	1.2086
No log	3.4286	240	1.4487	0.4697	1.4487	1.2036
No log	3.4571	242	1.1915	0.5397	1.1915	1.0916
No log	3.4857	244	0.9484	0.5333	0.9484	0.9739
No log	3.5143	246	0.8706	0.6512	0.8706	0.9330
No log	3.5429	248	0.9101	0.6324	0.9101	0.9540
No log	3.5714	250	1.2002	0.5333	1.2002	1.0955
No log	3.6	252	1.5992	0.3714	1.5992	1.2646
No log	3.6286	254	1.6889	0.2878	1.6889	1.2996
No log	3.6571	256	1.5587	0.3824	1.5587	1.2485
No log	3.6857	258	1.4676	0.4776	1.4676	1.2114
No log	3.7143	260	1.4982	0.4242	1.4982	1.2240
No log	3.7429	262	1.4263	0.4496	1.4263	1.1943
No log	3.7714	264	1.3622	0.4603	1.3622	1.1672
No log	3.8	266	1.3694	0.4355	1.3694	1.1702
No log	3.8286	268	1.3830	0.4228	1.3830	1.1760
No log	3.8571	270	1.3773	0.4463	1.3773	1.1736
No log	3.8857	272	1.3961	0.4228	1.3961	1.1816
No log	3.9143	274	1.2088	0.4878	1.2088	1.0995
No log	3.9429	276	1.0564	0.55	1.0564	1.0278
No log	3.9714	278	1.0650	0.5161	1.0650	1.0320
No log	4.0	280	1.1976	0.4839	1.1976	1.0944
No log	4.0286	282	1.4245	0.4031	1.4245	1.1935
No log	4.0571	284	1.5818	0.3692	1.5818	1.2577
No log	4.0857	286	1.5031	0.4	1.5031	1.2260
No log	4.1143	288	1.3008	0.5	1.3008	1.1405
No log	4.1429	290	1.1851	0.4463	1.1851	1.0886
No log	4.1714	292	1.1709	0.4667	1.1709	1.0821
No log	4.2	294	1.2160	0.5041	1.2160	1.1027
No log	4.2286	296	1.4380	0.4806	1.4380	1.1991
No log	4.2571	298	1.5312	0.4242	1.5312	1.2374
No log	4.2857	300	1.4135	0.4806	1.4135	1.1889
No log	4.3143	302	1.1823	0.4918	1.1823	1.0873
No log	4.3429	304	1.1197	0.4407	1.1197	1.0582
No log	4.3714	306	1.1425	0.4959	1.1425	1.0689
No log	4.4	308	1.1364	0.4959	1.1364	1.0660
No log	4.4286	310	1.2368	0.4878	1.2368	1.1121
No log	4.4571	312	1.2553	0.4463	1.2553	1.1204
No log	4.4857	314	1.2087	0.4918	1.2087	1.0994
No log	4.5143	316	1.1631	0.5041	1.1631	1.0785
No log	4.5429	318	1.1408	0.544	1.1408	1.0681
No log	4.5714	320	1.1167	0.5827	1.1167	1.0567
No log	4.6	322	1.1507	0.5736	1.1507	1.0727
No log	4.6286	324	1.1532	0.5736	1.1532	1.0739
No log	4.6571	326	1.2035	0.5496	1.2035	1.0970
No log	4.6857	328	1.3856	0.4776	1.3856	1.1771
No log	4.7143	330	1.4056	0.4776	1.4056	1.1856
No log	4.7429	332	1.2739	0.5426	1.2739	1.1287
No log	4.7714	334	1.2863	0.5079	1.2863	1.1341
No log	4.8	336	1.3440	0.4553	1.3440	1.1593
No log	4.8286	338	1.4454	0.4553	1.4454	1.2023
No log	4.8571	340	1.4553	0.3304	1.4553	1.2064
No log	4.8857	342	1.4968	0.3540	1.4968	1.2234
No log	4.9143	344	1.4818	0.3304	1.4818	1.2173
No log	4.9429	346	1.3638	0.3621	1.3638	1.1678
No log	4.9714	348	1.2485	0.3966	1.2485	1.1174
No log	5.0	350	1.1299	0.4793	1.1299	1.0630
No log	5.0286	352	1.0621	0.496	1.0621	1.0306
No log	5.0571	354	1.0827	0.6047	1.0827	1.0405
No log	5.0857	356	1.2110	0.5496	1.2110	1.1005
No log	5.1143	358	1.2890	0.4848	1.2890	1.1353
No log	5.1429	360	1.3224	0.5077	1.3224	1.1500
No log	5.1714	362	1.2418	0.5512	1.2418	1.1144
No log	5.2	364	1.2030	0.512	1.2030	1.0968
No log	5.2286	366	1.1236	0.528	1.1236	1.0600
No log	5.2571	368	1.1584	0.5736	1.1584	1.0763
No log	5.2857	370	1.3411	0.4580	1.3411	1.1581
No log	5.3143	372	1.4276	0.4361	1.4276	1.1948
No log	5.3429	374	1.3046	0.4812	1.3046	1.1422
No log	5.3714	376	1.1641	0.5758	1.1641	1.0789
No log	5.4	378	1.1138	0.5669	1.1138	1.0554
No log	5.4286	380	1.2340	0.5385	1.2340	1.1108
No log	5.4571	382	1.2877	0.5231	1.2877	1.1348
No log	5.4857	384	1.3298	0.4361	1.3298	1.1532
No log	5.5143	386	1.3335	0.4627	1.3335	1.1548
No log	5.5429	388	1.3897	0.4627	1.3897	1.1789
No log	5.5714	390	1.3037	0.4627	1.3037	1.1418
No log	5.6	392	1.1715	0.5606	1.1715	1.0824
No log	5.6286	394	1.0914	0.5649	1.0914	1.0447
No log	5.6571	396	1.0009	0.5938	1.0009	1.0005
No log	5.6857	398	0.9969	0.5938	0.9969	0.9984
No log	5.7143	400	1.1051	0.5736	1.1051	1.0512
No log	5.7429	402	1.1065	0.5938	1.1065	1.0519
No log	5.7714	404	1.1048	0.5827	1.1048	1.0511
No log	5.8	406	1.0630	0.5827	1.0630	1.0310
No log	5.8286	408	1.0117	0.5938	1.0117	1.0058
No log	5.8571	410	1.0403	0.5891	1.0403	1.0199
No log	5.8857	412	0.9711	0.6202	0.9711	0.9855
No log	5.9143	414	0.9174	0.6202	0.9174	0.9578
No log	5.9429	416	0.9663	0.6308	0.9663	0.9830
No log	5.9714	418	1.0992	0.5649	1.0992	1.0484
No log	6.0	420	1.1464	0.5385	1.1464	1.0707
No log	6.0286	422	1.2149	0.4961	1.2149	1.1022
No log	6.0571	424	1.1438	0.5354	1.1438	1.0695
No log	6.0857	426	1.0743	0.544	1.0743	1.0365
No log	6.1143	428	1.0401	0.5760	1.0401	1.0199
No log	6.1429	430	1.0390	0.6032	1.0390	1.0193
No log	6.1714	432	1.1091	0.5736	1.1091	1.0531
No log	6.2	434	1.1975	0.5231	1.1975	1.0943
No log	6.2286	436	1.1077	0.5692	1.1077	1.0525
No log	6.2571	438	1.0957	0.5692	1.0957	1.0468
No log	6.2857	440	1.1483	0.5344	1.1483	1.0716
No log	6.3143	442	1.0886	0.5938	1.0886	1.0433
No log	6.3429	444	1.0005	0.5920	1.0005	1.0002
No log	6.3714	446	1.0125	0.5124	1.0125	1.0062
No log	6.4	448	1.0975	0.6032	1.0975	1.0476
No log	6.4286	450	1.2273	0.5231	1.2273	1.1078
No log	6.4571	452	1.3178	0.4812	1.3178	1.1480
No log	6.4857	454	1.2608	0.5038	1.2608	1.1229
No log	6.5143	456	1.2234	0.5496	1.2234	1.1061
No log	6.5429	458	1.2462	0.5312	1.2462	1.1163
No log	6.5714	460	1.3515	0.4961	1.3515	1.1625
No log	6.6	462	1.3821	0.4769	1.3821	1.1756
No log	6.6286	464	1.2824	0.544	1.2824	1.1324
No log	6.6571	466	1.2076	0.5714	1.2076	1.0989
No log	6.6857	468	1.1412	0.5528	1.1412	1.0683
No log	6.7143	470	1.1746	0.5512	1.1746	1.0838
No log	6.7429	472	1.2645	0.5197	1.2645	1.1245
No log	6.7714	474	1.3053	0.5197	1.3053	1.1425
No log	6.8	476	1.2524	0.4918	1.2524	1.1191
No log	6.8286	478	1.2073	0.4407	1.2073	1.0988
No log	6.8571	480	1.1616	0.4310	1.1616	1.0778
No log	6.8857	482	1.1721	0.4407	1.1721	1.0826
No log	6.9143	484	1.2445	0.5238	1.2445	1.1156
No log	6.9429	486	1.3286	0.5038	1.3286	1.1527
No log	6.9714	488	1.3248	0.5	1.3248	1.1510
No log	7.0	490	1.2793	0.5271	1.2793	1.1310
No log	7.0286	492	1.2635	0.5197	1.2635	1.1240
No log	7.0571	494	1.2218	0.5041	1.2218	1.1054
No log	7.0857	496	1.2800	0.4882	1.2800	1.1314
No log	7.1143	498	1.3129	0.5000	1.3129	1.1458
0.4653	7.1429	500	1.2952	0.5000	1.2952	1.1381
0.4653	7.1714	502	1.2580	0.5231	1.2580	1.1216
0.4653	7.2	504	1.1983	0.5625	1.1983	1.0947
0.4653	7.2286	506	1.1405	0.5645	1.1405	1.0680
0.4653	7.2571	508	1.1570	0.5528	1.1570	1.0756
0.4653	7.2857	510	1.2877	0.5426	1.2877	1.1348
0.4653	7.3143	512	1.3666	0.4769	1.3666	1.1690
0.4653	7.3429	514	1.3249	0.5079	1.3249	1.1511
0.4653	7.3714	516	1.3164	0.4500	1.3164	1.1474
0.4653	7.4	518	1.3051	0.4348	1.3051	1.1424
0.4653	7.4286	520	1.2663	0.3604	1.2663	1.1253
0.4653	7.4571	522	1.2651	0.3604	1.2651	1.1248
0.4653	7.4857	524	1.2982	0.4310	1.2982	1.1394

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1