ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k5_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2549
• Qwk: 0.5552
• Mse: 1.2549
• Rmse: 1.1202

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0741	2	5.2933	-0.0006	5.2933	2.3007
No log	0.1481	4	3.1218	0.0754	3.1218	1.7669
No log	0.2222	6	1.9563	0.0228	1.9563	1.3987
No log	0.2963	8	2.0323	0.0244	2.0323	1.4256
No log	0.3704	10	1.7644	-0.0134	1.7644	1.3283
No log	0.4444	12	1.5761	-0.0326	1.5761	1.2554
No log	0.5185	14	1.2678	0.1922	1.2678	1.1260
No log	0.5926	16	1.2139	0.1707	1.2139	1.1018
No log	0.6667	18	1.4323	0.0164	1.4323	1.1968
No log	0.7407	20	1.6317	-0.1060	1.6317	1.2774
No log	0.8148	22	1.8093	-0.0229	1.8093	1.3451
No log	0.8889	24	1.8330	0.0153	1.8330	1.3539
No log	0.9630	26	1.5415	0.0205	1.5415	1.2416
No log	1.0370	28	1.3515	0.1962	1.3515	1.1626
No log	1.1111	30	1.2912	0.0942	1.2912	1.1363
No log	1.1852	32	1.2838	0.1387	1.2838	1.1331
No log	1.2593	34	1.3089	0.1506	1.3089	1.1441
No log	1.3333	36	1.3181	0.1737	1.3181	1.1481
No log	1.4074	38	1.3175	0.2021	1.3175	1.1478
No log	1.4815	40	1.3081	0.1339	1.3081	1.1437
No log	1.5556	42	1.2825	0.1163	1.2825	1.1325
No log	1.6296	44	1.2649	0.0967	1.2649	1.1247
No log	1.7037	46	1.2694	0.0877	1.2694	1.1267
No log	1.7778	48	1.2579	0.0958	1.2579	1.1216
No log	1.8519	50	1.2656	0.1008	1.2656	1.1250
No log	1.9259	52	1.3225	0.1763	1.3225	1.1500
No log	2.0	54	1.3893	0.0611	1.3893	1.1787
No log	2.0741	56	1.3410	0.1349	1.3410	1.1580
No log	2.1481	58	1.2751	0.2464	1.2751	1.1292
No log	2.2222	60	1.2376	0.2438	1.2376	1.1125
No log	2.2963	62	1.2050	0.2263	1.2050	1.0977
No log	2.3704	64	1.1795	0.2231	1.1795	1.0860
No log	2.4444	66	1.1252	0.2619	1.1252	1.0608
No log	2.5185	68	1.1160	0.2991	1.1160	1.0564
No log	2.5926	70	1.0796	0.3033	1.0796	1.0390
No log	2.6667	72	1.0454	0.2654	1.0454	1.0224
No log	2.7407	74	1.0562	0.2320	1.0562	1.0277
No log	2.8148	76	1.0778	0.2372	1.0778	1.0382
No log	2.8889	78	1.0659	0.2457	1.0659	1.0324
No log	2.9630	80	1.0151	0.2542	1.0151	1.0075
No log	3.0370	82	0.9748	0.3025	0.9748	0.9873
No log	3.1111	84	0.9482	0.3274	0.9482	0.9738
No log	3.1852	86	0.8988	0.3781	0.8988	0.9480
No log	3.2593	88	0.8795	0.3549	0.8795	0.9378
No log	3.3333	90	0.8770	0.3236	0.8770	0.9365
No log	3.4074	92	0.9068	0.3207	0.9068	0.9523
No log	3.4815	94	0.8891	0.4310	0.8891	0.9429
No log	3.5556	96	0.8278	0.4643	0.8278	0.9099
No log	3.6296	98	0.7686	0.5458	0.7686	0.8767
No log	3.7037	100	0.7621	0.5588	0.7621	0.8730
No log	3.7778	102	0.7269	0.5514	0.7269	0.8526
No log	3.8519	104	0.7226	0.5460	0.7226	0.8501
No log	3.9259	106	0.6942	0.5999	0.6942	0.8332
No log	4.0	108	0.6545	0.6479	0.6545	0.8090
No log	4.0741	110	0.7217	0.5819	0.7217	0.8495
No log	4.1481	112	0.7180	0.6125	0.7180	0.8473
No log	4.2222	114	0.7485	0.5899	0.7485	0.8652
No log	4.2963	116	0.7596	0.5787	0.7596	0.8716
No log	4.3704	118	0.7586	0.5727	0.7586	0.8710
No log	4.4444	120	0.9620	0.5283	0.9620	0.9808
No log	4.5185	122	1.0243	0.4841	1.0243	1.0121
No log	4.5926	124	0.9321	0.5242	0.9321	0.9655
No log	4.6667	126	0.8289	0.5995	0.8289	0.9104
No log	4.7407	128	0.7355	0.6424	0.7355	0.8576
No log	4.8148	130	0.7090	0.6633	0.7090	0.8420
No log	4.8889	132	0.7140	0.6633	0.7140	0.8450
No log	4.9630	134	0.7674	0.6341	0.7674	0.8760
No log	5.0370	136	0.7984	0.5954	0.7984	0.8935
No log	5.1111	138	0.8991	0.5501	0.8991	0.9482
No log	5.1852	140	0.9569	0.5189	0.9569	0.9782
No log	5.2593	142	0.9874	0.4902	0.9874	0.9937
No log	5.3333	144	0.9143	0.5325	0.9143	0.9562
No log	5.4074	146	0.7702	0.5982	0.7702	0.8776
No log	5.4815	148	0.7150	0.6508	0.7150	0.8456
No log	5.5556	150	0.7798	0.6160	0.7798	0.8830
No log	5.6296	152	0.8417	0.5795	0.8417	0.9174
No log	5.7037	154	0.8706	0.5908	0.8706	0.9330
No log	5.7778	156	0.9390	0.5828	0.9390	0.9690
No log	5.8519	158	1.0276	0.5660	1.0276	1.0137
No log	5.9259	160	1.0607	0.5827	1.0607	1.0299
No log	6.0	162	1.0451	0.5694	1.0451	1.0223
No log	6.0741	164	1.0300	0.5571	1.0300	1.0149
No log	6.1481	166	0.7655	0.6826	0.7655	0.8749
No log	6.2222	168	0.6857	0.6654	0.6857	0.8281
No log	6.2963	170	0.7313	0.6549	0.7313	0.8552
No log	6.3704	172	0.9985	0.5791	0.9985	0.9992
No log	6.4444	174	1.2841	0.4737	1.2841	1.1332
No log	6.5185	176	1.2292	0.4617	1.2292	1.1087
No log	6.5926	178	0.9129	0.5783	0.9129	0.9555
No log	6.6667	180	0.7720	0.6405	0.7720	0.8786
No log	6.7407	182	0.7901	0.5789	0.7901	0.8889
No log	6.8148	184	0.7738	0.5757	0.7738	0.8797
No log	6.8889	186	0.8030	0.5880	0.8030	0.8961
No log	6.9630	188	0.7644	0.6345	0.7644	0.8743
No log	7.0370	190	0.8433	0.6180	0.8433	0.9183
No log	7.1111	192	1.0489	0.5576	1.0489	1.0241
No log	7.1852	194	0.9396	0.5911	0.9396	0.9693
No log	7.2593	196	0.8994	0.6115	0.8994	0.9484
No log	7.3333	198	0.8883	0.6131	0.8883	0.9425
No log	7.4074	200	0.8730	0.5972	0.8730	0.9343
No log	7.4815	202	0.9279	0.5593	0.9279	0.9633
No log	7.5556	204	0.8059	0.6261	0.8059	0.8977
No log	7.6296	206	0.7421	0.6377	0.7421	0.8614
No log	7.7037	208	0.7989	0.6139	0.7989	0.8938
No log	7.7778	210	1.0984	0.4695	1.0984	1.0481
No log	7.8519	212	1.4146	0.4499	1.4146	1.1894
No log	7.9259	214	1.2985	0.4996	1.2985	1.1395
No log	8.0	216	1.1331	0.5801	1.1331	1.0645
No log	8.0741	218	0.9849	0.5811	0.9849	0.9924
No log	8.1481	220	1.0075	0.5564	1.0075	1.0038
No log	8.2222	222	1.2023	0.5416	1.2023	1.0965
No log	8.2963	224	1.3641	0.4985	1.3641	1.1679
No log	8.3704	226	1.2288	0.5031	1.2288	1.1085
No log	8.4444	228	0.9690	0.5473	0.9690	0.9844
No log	8.5185	230	0.7965	0.6329	0.7965	0.8925
No log	8.5926	232	0.8032	0.6348	0.8032	0.8962
No log	8.6667	234	0.8228	0.6292	0.8228	0.9071
No log	8.7407	236	0.9981	0.5644	0.9981	0.9991
No log	8.8148	238	1.3263	0.4611	1.3263	1.1517
No log	8.8889	240	1.2896	0.4969	1.2896	1.1356
No log	8.9630	242	1.0071	0.5411	1.0071	1.0036
No log	9.0370	244	0.8942	0.6008	0.8942	0.9456
No log	9.1111	246	0.9296	0.5691	0.9296	0.9642
No log	9.1852	248	0.9244	0.5924	0.9244	0.9615
No log	9.2593	250	0.9810	0.5900	0.9810	0.9905
No log	9.3333	252	1.0001	0.5901	1.0001	1.0000
No log	9.4074	254	1.0522	0.5796	1.0522	1.0257
No log	9.4815	256	1.0138	0.5819	1.0138	1.0069
No log	9.5556	258	0.8263	0.6200	0.8263	0.9090
No log	9.6296	260	0.7666	0.6301	0.7666	0.8755
No log	9.7037	262	0.8202	0.5922	0.8202	0.9056
No log	9.7778	264	0.8499	0.5824	0.8499	0.9219
No log	9.8519	266	0.8960	0.5743	0.8960	0.9466
No log	9.9259	268	0.9409	0.5657	0.9409	0.9700
No log	10.0	270	0.9411	0.6003	0.9411	0.9701
No log	10.0741	272	0.9431	0.5793	0.9431	0.9711
No log	10.1481	274	0.9279	0.5857	0.9279	0.9633
No log	10.2222	276	0.9719	0.5459	0.9719	0.9859
No log	10.2963	278	1.1599	0.5476	1.1599	1.0770
No log	10.3704	280	1.5327	0.4921	1.5327	1.2380
No log	10.4444	282	1.5484	0.4771	1.5484	1.2443
No log	10.5185	284	1.3129	0.4959	1.3129	1.1458
No log	10.5926	286	1.2501	0.4608	1.2501	1.1181
No log	10.6667	288	1.2695	0.4438	1.2695	1.1267
No log	10.7407	290	1.3868	0.4631	1.3868	1.1776
No log	10.8148	292	1.4363	0.4992	1.4363	1.1984
No log	10.8889	294	1.3152	0.4757	1.3152	1.1468
No log	10.9630	296	1.2779	0.4762	1.2779	1.1305
No log	11.0370	298	1.3024	0.4827	1.3024	1.1412
No log	11.1111	300	1.2854	0.5082	1.2854	1.1337
No log	11.1852	302	1.0744	0.5390	1.0744	1.0365
No log	11.2593	304	0.9450	0.6097	0.9450	0.9721
No log	11.3333	306	0.9859	0.6080	0.9859	0.9929
No log	11.4074	308	1.1594	0.6004	1.1594	1.0768
No log	11.4815	310	1.2558	0.5790	1.2558	1.1206
No log	11.5556	312	1.1403	0.5928	1.1403	1.0679
No log	11.6296	314	0.8516	0.6917	0.8516	0.9228
No log	11.7037	316	0.7176	0.6462	0.7176	0.8471
No log	11.7778	318	0.7008	0.6462	0.7008	0.8371
No log	11.8519	320	0.7299	0.6771	0.7299	0.8543
No log	11.9259	322	0.9258	0.6310	0.9258	0.9622
No log	12.0	324	1.2715	0.5082	1.2715	1.1276
No log	12.0741	326	1.4459	0.4350	1.4459	1.2025
No log	12.1481	328	1.4325	0.4538	1.4325	1.1969
No log	12.2222	330	1.2233	0.5270	1.2233	1.1060
No log	12.2963	332	1.0986	0.5315	1.0986	1.0482
No log	12.3704	334	1.1457	0.5477	1.1457	1.0704
No log	12.4444	336	1.3487	0.5500	1.3487	1.1613
No log	12.5185	338	1.5018	0.5251	1.5018	1.2255
No log	12.5926	340	1.5253	0.5007	1.5253	1.2350
No log	12.6667	342	1.3937	0.4383	1.3937	1.1806
No log	12.7407	344	1.2772	0.4179	1.2772	1.1301
No log	12.8148	346	1.4036	0.4031	1.4036	1.1847
No log	12.8889	348	1.4617	0.4238	1.4617	1.2090
No log	12.9630	350	1.3550	0.4356	1.3550	1.1641
No log	13.0370	352	1.3019	0.4826	1.3019	1.1410
No log	13.1111	354	1.2613	0.4928	1.2613	1.1231
No log	13.1852	356	1.2932	0.4928	1.2932	1.1372
No log	13.2593	358	1.4097	0.4745	1.4097	1.1873
No log	13.3333	360	1.4654	0.4461	1.4654	1.2105
No log	13.4074	362	1.2672	0.5070	1.2672	1.1257
No log	13.4815	364	1.0136	0.5469	1.0136	1.0068
No log	13.5556	366	0.9049	0.6119	0.9049	0.9513
No log	13.6296	368	0.9764	0.5757	0.9764	0.9881
No log	13.7037	370	0.9820	0.5590	0.9820	0.9909
No log	13.7778	372	1.0477	0.5775	1.0477	1.0236
No log	13.8519	374	0.9824	0.6001	0.9824	0.9911
No log	13.9259	376	0.9387	0.6105	0.9387	0.9689
No log	14.0	378	0.9604	0.6088	0.9604	0.9800
No log	14.0741	380	0.9009	0.5984	0.9009	0.9491
No log	14.1481	382	0.8897	0.5857	0.8897	0.9433
No log	14.2222	384	0.8994	0.5618	0.8994	0.9483
No log	14.2963	386	0.8317	0.5770	0.8317	0.9120
No log	14.3704	388	0.7660	0.6214	0.7660	0.8752
No log	14.4444	390	0.7141	0.6339	0.7141	0.8450
No log	14.5185	392	0.7443	0.6135	0.7443	0.8627
No log	14.5926	394	0.8374	0.5995	0.8374	0.9151
No log	14.6667	396	0.9433	0.6280	0.9433	0.9712
No log	14.7407	398	1.0845	0.5813	1.0845	1.0414
No log	14.8148	400	1.0575	0.5972	1.0575	1.0283
No log	14.8889	402	0.8861	0.6256	0.8861	0.9413
No log	14.9630	404	0.7626	0.6159	0.7626	0.8733
No log	15.0370	406	0.7612	0.6375	0.7612	0.8724
No log	15.1111	408	0.8505	0.5853	0.8505	0.9222
No log	15.1852	410	1.0640	0.5394	1.0640	1.0315
No log	15.2593	412	1.1558	0.5101	1.1558	1.0751
No log	15.3333	414	1.0267	0.5317	1.0267	1.0133
No log	15.4074	416	0.8669	0.5925	0.8669	0.9311
No log	15.4815	418	0.8302	0.6052	0.8302	0.9111
No log	15.5556	420	0.8888	0.5362	0.8888	0.9427
No log	15.6296	422	0.9059	0.5704	0.9059	0.9518
No log	15.7037	424	0.8963	0.5821	0.8963	0.9468
No log	15.7778	426	0.9498	0.5782	0.9498	0.9746
No log	15.8519	428	0.9267	0.5869	0.9267	0.9627
No log	15.9259	430	0.8389	0.6081	0.8389	0.9159
No log	16.0	432	0.7908	0.6112	0.7908	0.8893
No log	16.0741	434	0.7574	0.6337	0.7574	0.8703
No log	16.1481	436	0.8073	0.5835	0.8073	0.8985
No log	16.2222	438	0.8734	0.5758	0.8734	0.9346
No log	16.2963	440	0.9174	0.5706	0.9174	0.9578
No log	16.3704	442	0.8531	0.5812	0.8531	0.9236
No log	16.4444	444	0.8283	0.5785	0.8283	0.9101
No log	16.5185	446	0.7871	0.5797	0.7871	0.8872
No log	16.5926	448	0.7465	0.6286	0.7465	0.8640
No log	16.6667	450	0.8496	0.5975	0.8496	0.9217
No log	16.7407	452	0.9540	0.6301	0.9540	0.9767
No log	16.8148	454	1.0168	0.5916	1.0168	1.0084
No log	16.8889	456	1.0648	0.5918	1.0648	1.0319
No log	16.9630	458	1.0502	0.5859	1.0502	1.0248
No log	17.0370	460	0.8727	0.5936	0.8727	0.9342
No log	17.1111	462	0.8029	0.6176	0.8029	0.8961
No log	17.1852	464	0.8353	0.6108	0.8353	0.9140
No log	17.2593	466	0.9625	0.5681	0.9625	0.9811
No log	17.3333	468	1.1148	0.5778	1.1148	1.0558
No log	17.4074	470	1.0814	0.5872	1.0814	1.0399
No log	17.4815	472	0.9297	0.6641	0.9297	0.9642
No log	17.5556	474	0.7742	0.6441	0.7742	0.8799
No log	17.6296	476	0.7676	0.6335	0.7676	0.8761
No log	17.7037	478	0.8760	0.5824	0.8760	0.9359
No log	17.7778	480	1.0783	0.5357	1.0783	1.0384
No log	17.8519	482	1.1388	0.5122	1.1388	1.0672
No log	17.9259	484	1.0391	0.5352	1.0391	1.0193
No log	18.0	486	0.8960	0.5594	0.8960	0.9466
No log	18.0741	488	0.7772	0.6058	0.7772	0.8816
No log	18.1481	490	0.7463	0.6150	0.7463	0.8639
No log	18.2222	492	0.7977	0.6499	0.7977	0.8931
No log	18.2963	494	0.8644	0.6332	0.8644	0.9298
No log	18.3704	496	0.8217	0.6417	0.8217	0.9065
No log	18.4444	498	0.7273	0.6806	0.7273	0.8528
0.4904	18.5185	500	0.7448	0.6759	0.7448	0.8630
0.4904	18.5926	502	0.8038	0.6293	0.8038	0.8966
0.4904	18.6667	504	0.8635	0.6310	0.8635	0.9292
0.4904	18.7407	506	0.9651	0.6238	0.9651	0.9824
0.4904	18.8148	508	1.1197	0.5830	1.1197	1.0582
0.4904	18.8889	510	1.2549	0.5552	1.2549	1.1202

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1