ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5187
• Qwk: 0.4462
• Mse: 1.5187
• Rmse: 1.2324

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0230	2	7.0689	-0.0167	7.0689	2.6587
No log	0.0460	4	4.9724	0.0	4.9724	2.2299
No log	0.0690	6	4.0933	-0.0597	4.0933	2.0232
No log	0.0920	8	2.4991	0.0680	2.4991	1.5809
No log	0.1149	10	1.9936	0.1228	1.9936	1.4120
No log	0.1379	12	1.9387	0.2143	1.9387	1.3924
No log	0.1609	14	2.4114	-0.0763	2.4114	1.5529
No log	0.1839	16	3.3009	0.0252	3.3009	1.8168
No log	0.2069	18	4.0078	-0.0423	4.0078	2.0020
No log	0.2299	20	3.9348	0.0	3.9348	1.9836
No log	0.2529	22	3.2571	0.0385	3.2571	1.8048
No log	0.2759	24	2.7112	0.0	2.7112	1.6466
No log	0.2989	26	2.3025	0.0571	2.3025	1.5174
No log	0.3218	28	1.9375	0.1321	1.9375	1.3919
No log	0.3448	30	1.8332	0.1132	1.8332	1.3540
No log	0.3678	32	1.9701	0.1404	1.9701	1.4036
No log	0.3908	34	2.2366	0.1493	2.2366	1.4955
No log	0.4138	36	2.2862	0.0576	2.2862	1.5120
No log	0.4368	38	2.0952	0.0968	2.0952	1.4475
No log	0.4598	40	2.1025	0.1575	2.1025	1.4500
No log	0.4828	42	1.6841	0.2456	1.6841	1.2977
No log	0.5057	44	1.5235	0.3621	1.5235	1.2343
No log	0.5287	46	1.4063	0.4034	1.4063	1.1859
No log	0.5517	48	1.3480	0.35	1.3480	1.1611
No log	0.5747	50	1.9681	0.3804	1.9681	1.4029
No log	0.5977	52	2.1109	0.3669	2.1109	1.4529
No log	0.6207	54	1.5724	0.4744	1.5724	1.2539
No log	0.6437	56	1.4153	0.5401	1.4153	1.1897
No log	0.6667	58	2.8607	-0.0876	2.8607	1.6914
No log	0.6897	60	2.5917	-0.0458	2.5917	1.6099
No log	0.7126	62	1.1943	0.5037	1.1943	1.0928
No log	0.7356	64	1.0635	0.5692	1.0635	1.0313
No log	0.7586	66	1.1730	0.4839	1.1730	1.0830
No log	0.7816	68	1.1576	0.5116	1.1576	1.0759
No log	0.8046	70	1.1508	0.5231	1.1508	1.0728
No log	0.8276	72	1.1856	0.5037	1.1856	1.0888
No log	0.8506	74	1.0065	0.5909	1.0065	1.0032
No log	0.8736	76	0.9975	0.5938	0.9975	0.9987
No log	0.8966	78	0.9395	0.6269	0.9395	0.9693
No log	0.9195	80	0.9847	0.5926	0.9847	0.9923
No log	0.9425	82	0.9252	0.6519	0.9252	0.9619
No log	0.9655	84	0.9667	0.6176	0.9667	0.9832
No log	0.9885	86	1.0369	0.5985	1.0369	1.0183
No log	1.0115	88	0.9845	0.5970	0.9845	0.9922
No log	1.0345	90	1.0319	0.6316	1.0319	1.0158
No log	1.0575	92	1.1260	0.5547	1.1260	1.0611
No log	1.0805	94	1.5645	0.3796	1.5645	1.2508
No log	1.1034	96	1.8126	0.2714	1.8126	1.3463
No log	1.1264	98	1.8637	0.2446	1.8637	1.3652
No log	1.1494	100	1.6420	0.3333	1.6420	1.2814
No log	1.1724	102	1.3045	0.5401	1.3045	1.1422
No log	1.1954	104	1.2777	0.5362	1.2777	1.1304
No log	1.2184	106	1.5056	0.4091	1.5056	1.2270
No log	1.2414	108	1.6321	0.3077	1.6321	1.2775
No log	1.2644	110	1.6542	0.3485	1.6542	1.2862
No log	1.2874	112	1.7024	0.3284	1.7024	1.3048
No log	1.3103	114	1.4679	0.3876	1.4679	1.2116
No log	1.3333	116	1.4110	0.2807	1.4110	1.1879
No log	1.3563	118	1.3347	0.3363	1.3347	1.1553
No log	1.3793	120	1.2290	0.4310	1.2290	1.1086
No log	1.4023	122	1.1530	0.4615	1.1530	1.0738
No log	1.4253	124	1.0651	0.5806	1.0651	1.0321
No log	1.4483	126	1.0388	0.5802	1.0388	1.0192
No log	1.4713	128	1.0818	0.5755	1.0818	1.0401
No log	1.4943	130	1.0045	0.5797	1.0045	1.0022
No log	1.5172	132	0.8924	0.6316	0.8924	0.9447
No log	1.5402	134	1.0989	0.5630	1.0989	1.0483
No log	1.5632	136	1.6264	0.3521	1.6264	1.2753
No log	1.5862	138	1.6653	0.3217	1.6653	1.2904
No log	1.6092	140	1.2394	0.5303	1.2394	1.1133
No log	1.6322	142	0.9187	0.5760	0.9187	0.9585
No log	1.6552	144	0.9227	0.5760	0.9227	0.9606
No log	1.6782	146	1.0897	0.6015	1.0897	1.0439
No log	1.7011	148	1.1663	0.5954	1.1663	1.0799
No log	1.7241	150	1.0518	0.6061	1.0518	1.0256
No log	1.7471	152	1.0076	0.6015	1.0076	1.0038
No log	1.7701	154	1.1513	0.5564	1.1513	1.0730
No log	1.7931	156	1.3912	0.4593	1.3912	1.1795
No log	1.8161	158	1.1942	0.5038	1.1942	1.0928
No log	1.8391	160	0.7812	0.6519	0.7812	0.8839
No log	1.8621	162	0.7069	0.7376	0.7069	0.8408
No log	1.8851	164	0.8346	0.6176	0.8346	0.9136
No log	1.9080	166	1.2815	0.5075	1.2815	1.1320
No log	1.9310	168	1.4059	0.4444	1.4059	1.1857
No log	1.9540	170	1.2094	0.5303	1.2094	1.0997
No log	1.9770	172	0.9142	0.6015	0.9142	0.9561
No log	2.0	174	0.8687	0.6154	0.8687	0.9321
No log	2.0230	176	0.8313	0.6364	0.8313	0.9117
No log	2.0460	178	0.8137	0.6567	0.8137	0.9020
No log	2.0690	180	0.8075	0.6519	0.8075	0.8986
No log	2.0920	182	1.0348	0.5564	1.0348	1.0173
No log	2.1149	184	1.3725	0.4776	1.3725	1.1715
No log	2.1379	186	1.4038	0.4776	1.4038	1.1848
No log	2.1609	188	1.1369	0.5263	1.1369	1.0663
No log	2.1839	190	0.8589	0.6515	0.8589	0.9268
No log	2.2069	192	0.8338	0.6767	0.8338	0.9131
No log	2.2299	194	0.9459	0.6	0.9459	0.9726
No log	2.2529	196	1.2188	0.5263	1.2188	1.1040
No log	2.2759	198	1.3073	0.5	1.3073	1.1434
No log	2.2989	200	1.2705	0.5263	1.2705	1.1272
No log	2.3218	202	1.0330	0.5564	1.0330	1.0164
No log	2.3448	204	0.8123	0.6912	0.8123	0.9013
No log	2.3678	206	0.8396	0.6767	0.8396	0.9163
No log	2.3908	208	0.8969	0.6615	0.8969	0.9470
No log	2.4138	210	1.0434	0.5827	1.0434	1.0215
No log	2.4368	212	1.3411	0.5	1.3411	1.1581
No log	2.4598	214	1.4891	0.3910	1.4891	1.2203
No log	2.4828	216	1.3847	0.3939	1.3847	1.1768
No log	2.5057	218	1.1226	0.5246	1.1226	1.0595
No log	2.5287	220	1.0528	0.5124	1.0528	1.0261
No log	2.5517	222	1.0851	0.5469	1.0851	1.0417
No log	2.5747	224	1.3684	0.4706	1.3684	1.1698
No log	2.5977	226	1.7067	0.3382	1.7067	1.3064
No log	2.6207	228	1.8035	0.3453	1.8035	1.3429
No log	2.6437	230	1.5349	0.4265	1.5349	1.2389
No log	2.6667	232	1.3792	0.4638	1.3792	1.1744
No log	2.6897	234	1.3986	0.4526	1.3986	1.1826
No log	2.7126	236	1.2706	0.5373	1.2706	1.1272
No log	2.7356	238	1.2061	0.5564	1.2061	1.0982
No log	2.7586	240	1.0814	0.6308	1.0814	1.0399
No log	2.7816	242	1.0360	0.6406	1.0360	1.0178
No log	2.8046	244	0.9761	0.5289	0.9761	0.9880
No log	2.8276	246	1.0169	0.5968	1.0169	1.0084
No log	2.8506	248	1.1356	0.6	1.1356	1.0656
No log	2.8736	250	1.1887	0.5538	1.1887	1.0903
No log	2.8966	252	1.0904	0.5909	1.0904	1.0442
No log	2.9195	254	1.0701	0.5909	1.0701	1.0344
No log	2.9425	256	1.1568	0.5821	1.1568	1.0755
No log	2.9655	258	1.3223	0.4892	1.3223	1.1499
No log	2.9885	260	1.4646	0.5067	1.4646	1.2102
No log	3.0115	262	1.4024	0.5035	1.4024	1.1842
No log	3.0345	264	1.2944	0.5217	1.2944	1.1377
No log	3.0575	266	1.3281	0.5037	1.3281	1.1524
No log	3.0805	268	1.3248	0.4697	1.3248	1.1510
No log	3.1034	270	1.1317	0.5538	1.1317	1.0638
No log	3.1264	272	0.9804	0.6094	0.9804	0.9901
No log	3.1494	274	0.9631	0.5984	0.9631	0.9814
No log	3.1724	276	1.1024	0.5758	1.1024	1.0500
No log	3.1954	278	1.4058	0.4741	1.4058	1.1857
No log	3.2184	280	1.5032	0.4366	1.5032	1.2260
No log	3.2414	282	1.2871	0.5481	1.2871	1.1345
No log	3.2644	284	0.9415	0.5846	0.9415	0.9703
No log	3.2874	286	0.8221	0.6094	0.8221	0.9067
No log	3.3103	288	0.8592	0.6299	0.8592	0.9269
No log	3.3333	290	0.9357	0.5968	0.9357	0.9673
No log	3.3563	292	1.1080	0.56	1.1080	1.0526
No log	3.3793	294	1.2848	0.4651	1.2848	1.1335
No log	3.4023	296	1.2920	0.4651	1.2920	1.1366
No log	3.4253	298	1.2581	0.5455	1.2581	1.1216
No log	3.4483	300	1.2852	0.5672	1.2852	1.1337
No log	3.4713	302	1.2350	0.5481	1.2350	1.1113
No log	3.4943	304	1.1644	0.5714	1.1644	1.0791
No log	3.5172	306	1.2521	0.5294	1.2521	1.1190
No log	3.5402	308	1.4013	0.4853	1.4013	1.1837
No log	3.5632	310	1.5656	0.3235	1.5656	1.2512
No log	3.5862	312	1.4750	0.4242	1.4750	1.2145
No log	3.6092	314	1.2426	0.5231	1.2426	1.1147
No log	3.6322	316	1.0994	0.5802	1.0994	1.0485
No log	3.6552	318	1.0725	0.5909	1.0725	1.0356
No log	3.6782	320	1.0675	0.5865	1.0675	1.0332
No log	3.7011	322	1.2625	0.5333	1.2625	1.1236
No log	3.7241	324	1.6374	0.3429	1.6374	1.2796
No log	3.7471	326	1.7004	0.2899	1.7004	1.3040
No log	3.7701	328	1.4789	0.4593	1.4789	1.2161
No log	3.7931	330	1.1830	0.5758	1.1830	1.0877
No log	3.8161	332	1.0443	0.6190	1.0443	1.0219
No log	3.8391	334	1.0366	0.5854	1.0366	1.0181
No log	3.8621	336	1.0651	0.5378	1.0651	1.0320
No log	3.8851	338	1.0996	0.5785	1.0996	1.0486
No log	3.9080	340	1.1136	0.5691	1.1136	1.0553
No log	3.9310	342	1.1109	0.6032	1.1109	1.0540
No log	3.9540	344	1.1611	0.5496	1.1611	1.0775
No log	3.9770	346	1.1896	0.5758	1.1896	1.0907
No log	4.0	348	1.1100	0.5758	1.1100	1.0536
No log	4.0230	350	1.1213	0.5714	1.1213	1.0589
No log	4.0460	352	1.1722	0.5714	1.1722	1.0827
No log	4.0690	354	1.2988	0.5224	1.2988	1.1397
No log	4.0920	356	1.4234	0.4427	1.4234	1.1931
No log	4.1149	358	1.4928	0.4427	1.4928	1.2218
No log	4.1379	360	1.3901	0.4882	1.3901	1.1790
No log	4.1609	362	1.2424	0.5082	1.2424	1.1146
No log	4.1839	364	1.1132	0.5085	1.1132	1.0551
No log	4.2069	366	0.9739	0.5042	0.9739	0.9869
No log	4.2299	368	0.8960	0.6016	0.8960	0.9466
No log	4.2529	370	0.8531	0.6299	0.8531	0.9236
No log	4.2759	372	0.9841	0.5802	0.9841	0.9920
No log	4.2989	374	1.3430	0.4962	1.3430	1.1589
No log	4.3218	376	1.4624	0.4511	1.4624	1.2093
No log	4.3448	378	1.2776	0.4962	1.2776	1.1303
No log	4.3678	380	0.9181	0.5802	0.9181	0.9582
No log	4.3908	382	0.7629	0.6718	0.7629	0.8734
No log	4.4138	384	0.7651	0.7023	0.7651	0.8747
No log	4.4368	386	0.8246	0.6667	0.8246	0.9081
No log	4.4598	388	0.9977	0.5736	0.9977	0.9989
No log	4.4828	390	1.2278	0.5152	1.2278	1.1081
No log	4.5057	392	1.3305	0.4776	1.3305	1.1535
No log	4.5287	394	1.2427	0.5414	1.2427	1.1148
No log	4.5517	396	1.0914	0.5714	1.0914	1.0447
No log	4.5747	398	0.8736	0.5909	0.8736	0.9347
No log	4.5977	400	0.8068	0.6418	0.8068	0.8982
No log	4.6207	402	0.8632	0.6015	0.8632	0.9291
No log	4.6437	404	1.0809	0.5714	1.0809	1.0397
No log	4.6667	406	1.3095	0.5152	1.3095	1.1443
No log	4.6897	408	1.3726	0.4615	1.3726	1.1716
No log	4.7126	410	1.2583	0.5	1.2583	1.1217
No log	4.7356	412	1.1518	0.5760	1.1518	1.0732
No log	4.7586	414	1.0438	0.5920	1.0438	1.0217
No log	4.7816	416	1.0292	0.5873	1.0292	1.0145
No log	4.8046	418	1.1451	0.5455	1.1451	1.0701
No log	4.8276	420	1.3719	0.4427	1.3719	1.1713
No log	4.8506	422	1.4340	0.4427	1.4340	1.1975
No log	4.8736	424	1.2882	0.4462	1.2882	1.1350
No log	4.8966	426	1.0497	0.5606	1.0497	1.0246
No log	4.9195	428	0.9754	0.5846	0.9754	0.9876
No log	4.9425	430	1.0132	0.5606	1.0132	1.0066
No log	4.9655	432	1.0713	0.5455	1.0713	1.0350
No log	4.9885	434	1.0440	0.5455	1.0440	1.0218
No log	5.0115	436	0.9442	0.5865	0.9442	0.9717
No log	5.0345	438	0.9363	0.6154	0.9363	0.9676
No log	5.0575	440	1.0428	0.5496	1.0428	1.0212
No log	5.0805	442	1.2336	0.4923	1.2336	1.1107
No log	5.1034	444	1.2872	0.4923	1.2872	1.1346
No log	5.1264	446	1.2159	0.4923	1.2160	1.1027
No log	5.1494	448	1.1574	0.5581	1.1574	1.0758
No log	5.1724	450	1.1910	0.5231	1.1910	1.0913
No log	5.1954	452	1.2969	0.4651	1.2969	1.1388
No log	5.2184	454	1.4359	0.4462	1.4359	1.1983
No log	5.2414	456	1.4461	0.4462	1.4461	1.2025
No log	5.2644	458	1.3515	0.4651	1.3515	1.1626
No log	5.2874	460	1.2663	0.4640	1.2663	1.1253
No log	5.3103	462	1.1715	0.4921	1.1715	1.0824
No log	5.3333	464	1.1072	0.5312	1.1072	1.0522
No log	5.3563	466	1.1328	0.5191	1.1328	1.0643
No log	5.3793	468	1.3077	0.4923	1.3077	1.1436
No log	5.4023	470	1.4465	0.4361	1.4465	1.2027
No log	5.4253	472	1.4132	0.4627	1.4132	1.1888
No log	5.4483	474	1.2326	0.5191	1.2326	1.1102
No log	5.4713	476	1.1847	0.5191	1.1847	1.0884
No log	5.4943	478	1.3168	0.5191	1.3168	1.1475
No log	5.5172	480	1.4597	0.4091	1.4597	1.2082
No log	5.5402	482	1.4280	0.4651	1.4280	1.1950
No log	5.5632	484	1.3496	0.4651	1.3496	1.1617
No log	5.5862	486	1.2926	0.5116	1.2926	1.1369
No log	5.6092	488	1.2808	0.4923	1.2808	1.1317
No log	5.6322	490	1.2127	0.5191	1.2127	1.1012
No log	5.6552	492	1.1283	0.5496	1.1283	1.0622
No log	5.6782	494	1.0412	0.5954	1.0412	1.0204
No log	5.7011	496	0.9847	0.5954	0.9847	0.9923
No log	5.7241	498	1.0017	0.5954	1.0017	1.0008
0.4357	5.7471	500	1.0588	0.5954	1.0588	1.0290
0.4357	5.7701	502	1.0502	0.5954	1.0502	1.0248
0.4357	5.7931	504	1.0230	0.6	1.0230	1.0114
0.4357	5.8161	506	1.0745	0.5231	1.0745	1.0366
0.4357	5.8391	508	1.1392	0.4961	1.1392	1.0673
0.4357	5.8621	510	1.0806	0.5197	1.0806	1.0395
0.4357	5.8851	512	1.0075	0.5920	1.0075	1.0037
0.4357	5.9080	514	0.9715	0.6190	0.9715	0.9857
0.4357	5.9310	516	0.9852	0.6142	0.9852	0.9926
0.4357	5.9540	518	1.0034	0.5846	1.0034	1.0017
0.4357	5.9770	520	1.0836	0.5271	1.0836	1.0409
0.4357	6.0	522	1.2559	0.4688	1.2559	1.1207
0.4357	6.0230	524	1.4703	0.4462	1.4703	1.2126
0.4357	6.0460	526	1.5187	0.4462	1.5187	1.2324

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1