ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7537
• Qwk: 0.3195
• Mse: 0.7537
• Rmse: 0.8681

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0299	2	2.5325	-0.1089	2.5325	1.5914
No log	0.0597	4	1.5076	-0.0995	1.5076	1.2278
No log	0.0896	6	1.4206	-0.1800	1.4206	1.1919
No log	0.1194	8	1.4673	-0.2152	1.4673	1.2113
No log	0.1493	10	1.4828	-0.1721	1.4828	1.2177
No log	0.1791	12	1.3414	-0.1357	1.3414	1.1582
No log	0.2090	14	1.1084	-0.0609	1.1084	1.0528
No log	0.2388	16	1.0070	-0.0304	1.0070	1.0035
No log	0.2687	18	1.0212	0.0891	1.0212	1.0106
No log	0.2985	20	1.1001	0.0241	1.1001	1.0489
No log	0.3284	22	1.0876	0.0313	1.0876	1.0429
No log	0.3582	24	1.1614	-0.0785	1.1614	1.0777
No log	0.3881	26	1.1954	-0.0578	1.1954	1.0933
No log	0.4179	28	1.0512	0.0134	1.0512	1.0253
No log	0.4478	30	0.8990	0.1094	0.8990	0.9481
No log	0.4776	32	0.8641	0.0	0.8641	0.9296
No log	0.5075	34	0.9248	0.0509	0.9248	0.9617
No log	0.5373	36	0.9600	-0.0228	0.9600	0.9798
No log	0.5672	38	0.8689	0.0053	0.8689	0.9322
No log	0.5970	40	0.8193	0.1236	0.8193	0.9051
No log	0.6269	42	0.8715	0.1752	0.8715	0.9335
No log	0.6567	44	0.9301	0.2218	0.9301	0.9644
No log	0.6866	46	1.0825	-0.0825	1.0825	1.0404
No log	0.7164	48	1.1169	-0.0825	1.1169	1.0568
No log	0.7463	50	1.0957	0.0041	1.0957	1.0467
No log	0.7761	52	1.0184	0.0602	1.0184	1.0092
No log	0.8060	54	0.9361	0.2621	0.9361	0.9675
No log	0.8358	56	0.8740	0.2407	0.8740	0.9349
No log	0.8657	58	0.9218	0.1646	0.9218	0.9601
No log	0.8955	60	0.8469	0.1604	0.8469	0.9203
No log	0.9254	62	0.7714	0.1648	0.7714	0.8783
No log	0.9552	64	0.7817	0.2409	0.7817	0.8841
No log	0.9851	66	0.8261	0.3234	0.8261	0.9089
No log	1.0149	68	0.8954	0.3042	0.8954	0.9462
No log	1.0448	70	0.9184	0.2923	0.9184	0.9583
No log	1.0746	72	0.8782	0.2244	0.8782	0.9371
No log	1.1045	74	0.8228	0.2527	0.8228	0.9071
No log	1.1343	76	0.8147	0.1359	0.8147	0.9026
No log	1.1642	78	0.9495	0.0455	0.9495	0.9744
No log	1.1940	80	1.0303	0.0106	1.0303	1.0150
No log	1.2239	82	0.9820	0.1321	0.9820	0.9910
No log	1.2537	84	0.9672	0.0592	0.9672	0.9835
No log	1.2836	86	0.9528	0.0623	0.9528	0.9761
No log	1.3134	88	0.9216	0.0694	0.9216	0.9600
No log	1.3433	90	0.9119	0.1053	0.9119	0.9549
No log	1.3731	92	1.1070	0.0202	1.1070	1.0521
No log	1.4030	94	1.3775	-0.0082	1.3775	1.1737
No log	1.4328	96	1.2190	0.0369	1.2190	1.1041
No log	1.4627	98	0.9296	0.0377	0.9296	0.9642
No log	1.4925	100	0.8725	0.1359	0.8725	0.9341
No log	1.5224	102	0.8674	0.1094	0.8674	0.9314
No log	1.5522	104	0.8607	0.1094	0.8607	0.9278
No log	1.5821	106	0.8578	0.1407	0.8578	0.9262
No log	1.6119	108	0.8806	0.1359	0.8806	0.9384
No log	1.6418	110	0.9125	0.2171	0.9125	0.9552
No log	1.6716	112	0.9151	0.1313	0.9151	0.9566
No log	1.7015	114	0.9255	0.1448	0.9255	0.9620
No log	1.7313	116	0.9621	-0.0070	0.9621	0.9809
No log	1.7612	118	1.0214	0.0818	1.0214	1.0106
No log	1.7910	120	1.0330	0.0818	1.0330	1.0164
No log	1.8209	122	0.9934	0.0351	0.9934	0.9967
No log	1.8507	124	0.9656	0.0973	0.9656	0.9827
No log	1.8806	126	0.9589	0.1740	0.9589	0.9792
No log	1.9104	128	0.9637	0.1577	0.9637	0.9817
No log	1.9403	130	0.9901	0.0584	0.9901	0.9950
No log	1.9701	132	0.9923	0.0608	0.9923	0.9961
No log	2.0	134	0.9729	0.0608	0.9729	0.9864
No log	2.0299	136	0.9616	0.0715	0.9616	0.9806
No log	2.0597	138	0.9737	0.1962	0.9737	0.9868
No log	2.0896	140	0.9852	0.1617	0.9852	0.9926
No log	2.1194	142	0.9908	0.0754	0.9908	0.9954
No log	2.1493	144	1.0561	0.2013	1.0561	1.0277
No log	2.1791	146	1.0642	0.1364	1.0642	1.0316
No log	2.2090	148	1.0467	0.1720	1.0467	1.0231
No log	2.2388	150	1.0204	0.1826	1.0204	1.0102
No log	2.2687	152	1.0702	0.2676	1.0702	1.0345
No log	2.2985	154	0.9675	0.2105	0.9675	0.9836
No log	2.3284	156	0.9183	0.2495	0.9183	0.9583
No log	2.3582	158	0.8950	0.3088	0.8950	0.9461
No log	2.3881	160	0.8775	0.2926	0.8775	0.9367
No log	2.4179	162	0.8234	0.3649	0.8234	0.9074
No log	2.4478	164	0.7930	0.3890	0.7930	0.8905
No log	2.4776	166	0.7815	0.3813	0.7815	0.8841
No log	2.5075	168	0.7974	0.3675	0.7974	0.8930
No log	2.5373	170	0.8553	0.2960	0.8553	0.9248
No log	2.5672	172	0.8799	0.2549	0.8799	0.9380
No log	2.5970	174	0.9230	0.2420	0.9230	0.9607
No log	2.6269	176	0.9384	0.2387	0.9384	0.9687
No log	2.6567	178	0.9372	0.2589	0.9372	0.9681
No log	2.6866	180	0.9552	0.2416	0.9552	0.9773
No log	2.7164	182	0.8930	0.1856	0.8930	0.9450
No log	2.7463	184	0.8947	0.2116	0.8947	0.9459
No log	2.7761	186	1.0017	0.2881	1.0017	1.0009
No log	2.8060	188	0.9101	0.1954	0.9101	0.9540
No log	2.8358	190	0.8364	0.2247	0.8364	0.9145
No log	2.8657	192	0.8774	0.2076	0.8774	0.9367
No log	2.8955	194	0.9136	0.2934	0.9136	0.9558
No log	2.9254	196	0.8482	0.1853	0.8482	0.9210
No log	2.9552	198	0.8023	0.2193	0.8023	0.8957
No log	2.9851	200	0.8229	0.1946	0.8229	0.9072
No log	3.0149	202	1.0457	0.3102	1.0457	1.0226
No log	3.0448	204	1.1301	0.3031	1.1301	1.0630
No log	3.0746	206	0.9459	0.3312	0.9459	0.9726
No log	3.1045	208	0.7626	0.3025	0.7626	0.8733
No log	3.1343	210	0.7840	0.4022	0.7840	0.8854
No log	3.1642	212	0.7796	0.2478	0.7796	0.8829
No log	3.1940	214	0.8684	0.2877	0.8684	0.9319
No log	3.2239	216	0.8811	0.3043	0.8811	0.9387
No log	3.2537	218	0.7588	0.2866	0.7588	0.8711
No log	3.2836	220	0.7412	0.2834	0.7412	0.8610
No log	3.3134	222	0.7350	0.2532	0.7350	0.8573
No log	3.3433	224	0.8114	0.3770	0.8114	0.9008
No log	3.3731	226	0.9378	0.2677	0.9378	0.9684
No log	3.4030	228	0.9727	0.2554	0.9727	0.9863
No log	3.4328	230	0.8945	0.3356	0.8945	0.9458
No log	3.4627	232	0.9543	0.2958	0.9543	0.9769
No log	3.4925	234	1.0194	0.2905	1.0194	1.0097
No log	3.5224	236	0.9569	0.2958	0.9569	0.9782
No log	3.5522	238	0.8201	0.3794	0.8201	0.9056
No log	3.5821	240	0.7655	0.2530	0.7655	0.8749
No log	3.6119	242	0.7787	0.2813	0.7787	0.8824
No log	3.6418	244	0.8329	0.3399	0.8329	0.9126
No log	3.6716	246	0.8175	0.2365	0.8175	0.9042
No log	3.7015	248	0.8537	0.2071	0.8537	0.9239
No log	3.7313	250	0.9982	0.2217	0.9982	0.9991
No log	3.7612	252	1.1991	0.1943	1.1991	1.0950
No log	3.7910	254	1.3469	0.2041	1.3469	1.1606
No log	3.8209	256	1.2267	0.1995	1.2267	1.1076
No log	3.8507	258	0.9867	0.2147	0.9867	0.9933
No log	3.8806	260	0.8246	0.2204	0.8246	0.9080
No log	3.9104	262	0.8072	0.3050	0.8072	0.8985
No log	3.9403	264	0.8612	0.2383	0.8612	0.9280
No log	3.9701	266	1.0244	0.2416	1.0244	1.0121
No log	4.0	268	1.0678	0.2109	1.0678	1.0333
No log	4.0299	270	0.9417	0.3394	0.9417	0.9704
No log	4.0597	272	0.8496	0.2440	0.8496	0.9217
No log	4.0896	274	0.8435	0.2871	0.8435	0.9184
No log	4.1194	276	0.9492	0.2363	0.9492	0.9743
No log	4.1493	278	0.9441	0.2363	0.9441	0.9717
No log	4.1791	280	0.9138	0.2756	0.9138	0.9559
No log	4.2090	282	0.8403	0.2754	0.8403	0.9167
No log	4.2388	284	0.8456	0.1557	0.8456	0.9196
No log	4.2687	286	0.8942	0.2537	0.8942	0.9456
No log	4.2985	288	1.0180	0.2109	1.0180	1.0089
No log	4.3284	290	1.1088	0.1873	1.1088	1.0530
No log	4.3582	292	1.0287	0.2416	1.0287	1.0142
No log	4.3881	294	0.8617	0.2697	0.8617	0.9283
No log	4.4179	296	0.7894	0.1289	0.7894	0.8885
No log	4.4478	298	0.7933	0.2019	0.7933	0.8907
No log	4.4776	300	0.7853	0.2004	0.7853	0.8862
No log	4.5075	302	0.8136	0.3023	0.8136	0.9020
No log	4.5373	304	0.8423	0.2670	0.8423	0.9178
No log	4.5672	306	0.8173	0.1549	0.8173	0.9041
No log	4.5970	308	0.8147	0.2040	0.8147	0.9026
No log	4.6269	310	0.8025	0.1960	0.8025	0.8958
No log	4.6567	312	0.8873	0.2877	0.8873	0.9419
No log	4.6866	314	0.9598	0.3123	0.9598	0.9797
No log	4.7164	316	0.9648	0.3258	0.9648	0.9822
No log	4.7463	318	0.8312	0.2804	0.8312	0.9117
No log	4.7761	320	0.8079	0.2804	0.8079	0.8988
No log	4.8060	322	0.8640	0.3274	0.8640	0.9295
No log	4.8358	324	0.8737	0.3274	0.8737	0.9347
No log	4.8657	326	0.8044	0.3274	0.8044	0.8969
No log	4.8955	328	0.7052	0.3525	0.7052	0.8398
No log	4.9254	330	0.6889	0.3511	0.6889	0.8300
No log	4.9552	332	0.6805	0.3198	0.6805	0.8249
No log	4.9851	334	0.7304	0.3770	0.7304	0.8546
No log	5.0149	336	0.9196	0.3052	0.9196	0.9590
No log	5.0448	338	0.9550	0.3052	0.9550	0.9772
No log	5.0746	340	0.8666	0.3193	0.8666	0.9309
No log	5.1045	342	0.7239	0.3894	0.7239	0.8508
No log	5.1343	344	0.6577	0.3416	0.6577	0.8110
No log	5.1642	346	0.6609	0.3426	0.6609	0.8130
No log	5.1940	348	0.6749	0.3211	0.6749	0.8215
No log	5.2239	350	0.7244	0.3723	0.7244	0.8511
No log	5.2537	352	0.7272	0.2808	0.7272	0.8527
No log	5.2836	354	0.7153	0.3391	0.7153	0.8457
No log	5.3134	356	0.7372	0.2445	0.7372	0.8586
No log	5.3433	358	0.8391	0.3394	0.8391	0.9160
No log	5.3731	360	1.0689	0.3031	1.0689	1.0339
No log	5.4030	362	1.1190	0.3039	1.1190	1.0578
No log	5.4328	364	0.8989	0.2866	0.8989	0.9481
No log	5.4627	366	0.6820	0.3127	0.6820	0.8258
No log	5.4925	368	0.6233	0.3702	0.6233	0.7895
No log	5.5224	370	0.6045	0.3702	0.6045	0.7775
No log	5.5522	372	0.6490	0.4036	0.6490	0.8056
No log	5.5821	374	0.7231	0.3940	0.7231	0.8504
No log	5.6119	376	0.7312	0.3940	0.7312	0.8551
No log	5.6418	378	0.6819	0.3519	0.6819	0.8258
No log	5.6716	380	0.7027	0.3996	0.7027	0.8383
No log	5.7015	382	0.8104	0.3019	0.8104	0.9002
No log	5.7313	384	0.9596	0.2437	0.9596	0.9796
No log	5.7612	386	0.9809	0.2504	0.9809	0.9904
No log	5.7910	388	0.8499	0.2756	0.8499	0.9219
No log	5.8209	390	0.7137	0.3770	0.7137	0.8448
No log	5.8507	392	0.6967	0.3355	0.6967	0.8347
No log	5.8806	394	0.7311	0.3770	0.7311	0.8551
No log	5.9104	396	0.8471	0.3076	0.8471	0.9204
No log	5.9403	398	0.9555	0.2977	0.9555	0.9775
No log	5.9701	400	0.8974	0.3258	0.8974	0.9473
No log	6.0	402	0.8064	0.3239	0.8064	0.8980
No log	6.0299	404	0.7885	0.2321	0.7885	0.8880
No log	6.0597	406	0.7772	0.2669	0.7772	0.8816
No log	6.0896	408	0.7290	0.2591	0.7290	0.8538
No log	6.1194	410	0.7120	0.2652	0.7120	0.8438
No log	6.1493	412	0.7400	0.2899	0.7400	0.8602
No log	6.1791	414	0.7505	0.3131	0.7505	0.8663
No log	6.2090	416	0.6949	0.3196	0.6949	0.8336
No log	6.2388	418	0.6716	0.2621	0.6716	0.8195
No log	6.2687	420	0.6690	0.2621	0.6690	0.8179
No log	6.2985	422	0.7008	0.3471	0.7008	0.8371
No log	6.3284	424	0.7151	0.3221	0.7151	0.8457
No log	6.3582	426	0.6838	0.3545	0.6838	0.8269
No log	6.3881	428	0.7193	0.3131	0.7193	0.8481
No log	6.4179	430	0.7708	0.3384	0.7708	0.8779
No log	6.4478	432	0.7636	0.3256	0.7636	0.8738
No log	6.4776	434	0.6911	0.3590	0.6911	0.8313
No log	6.5075	436	0.6994	0.3519	0.6994	0.8363
No log	6.5373	438	0.6912	0.3590	0.6912	0.8314
No log	6.5672	440	0.6554	0.3662	0.6554	0.8096
No log	6.5970	442	0.6508	0.3662	0.6508	0.8067
No log	6.6269	444	0.6667	0.3590	0.6667	0.8165
No log	6.6567	446	0.6790	0.3590	0.6790	0.8240
No log	6.6866	448	0.6748	0.3590	0.6748	0.8215
No log	6.7164	450	0.6650	0.4352	0.6650	0.8155
No log	6.7463	452	0.6790	0.4076	0.6790	0.8240
No log	6.7761	454	0.6943	0.3814	0.6943	0.8333
No log	6.8060	456	0.7375	0.3261	0.7375	0.8588
No log	6.8358	458	0.8666	0.2949	0.8666	0.9309
No log	6.8657	460	0.8669	0.2949	0.8669	0.9311
No log	6.8955	462	0.7620	0.3195	0.7620	0.8730
No log	6.9254	464	0.7237	0.3195	0.7237	0.8507
No log	6.9552	466	0.7411	0.3195	0.7411	0.8609
No log	6.9851	468	0.7543	0.3195	0.7543	0.8685
No log	7.0149	470	0.7608	0.3195	0.7608	0.8723
No log	7.0448	472	0.8320	0.3562	0.8320	0.9121
No log	7.0746	474	0.8307	0.3562	0.8307	0.9114
No log	7.1045	476	0.7641	0.3450	0.7641	0.8741
No log	7.1343	478	0.7158	0.3475	0.7158	0.8461
No log	7.1642	480	0.6724	0.3221	0.6724	0.8200
No log	7.1940	482	0.6750	0.3314	0.6750	0.8216
No log	7.2239	484	0.6866	0.3314	0.6866	0.8286
No log	7.2537	486	0.7344	0.3305	0.7344	0.8570
No log	7.2836	488	0.7414	0.3679	0.7414	0.8611
No log	7.3134	490	0.7403	0.3679	0.7403	0.8604
No log	7.3433	492	0.7017	0.3820	0.7017	0.8377
No log	7.3731	494	0.6569	0.4614	0.6569	0.8105
No log	7.4030	496	0.6560	0.3894	0.6560	0.8099
No log	7.4328	498	0.6760	0.3894	0.6760	0.8222
0.4101	7.4627	500	0.7488	0.3195	0.7488	0.8654
0.4101	7.4925	502	0.7286	0.3195	0.7286	0.8536
0.4101	7.5224	504	0.6782	0.3814	0.6782	0.8235
0.4101	7.5522	506	0.6204	0.4001	0.6204	0.7877
0.4101	7.5821	508	0.6177	0.4291	0.6177	0.7859
0.4101	7.6119	510	0.6682	0.3866	0.6682	0.8174
0.4101	7.6418	512	0.6974	0.3798	0.6974	0.8351
0.4101	7.6716	514	0.6561	0.3615	0.6561	0.8100
0.4101	7.7015	516	0.6019	0.4780	0.6019	0.7758
0.4101	7.7313	518	0.5974	0.4148	0.5974	0.7729
0.4101	7.7612	520	0.6753	0.3868	0.6753	0.8218
0.4101	7.7910	522	0.7712	0.3417	0.7712	0.8782
0.4101	7.8209	524	0.9227	0.3411	0.9227	0.9606
0.4101	7.8507	526	0.8807	0.3290	0.8807	0.9384
0.4101	7.8806	528	0.7047	0.3475	0.7047	0.8394
0.4101	7.9104	530	0.6342	0.4243	0.6342	0.7964
0.4101	7.9403	532	0.6465	0.3942	0.6465	0.8040
0.4101	7.9701	534	0.6902	0.3776	0.6902	0.8308
0.4101	8.0	536	0.7643	0.4104	0.7643	0.8742
0.4101	8.0299	538	0.7875	0.3847	0.7875	0.8874
0.4101	8.0597	540	0.7085	0.3776	0.7085	0.8417
0.4101	8.0896	542	0.6199	0.4555	0.6199	0.7873
0.4101	8.1194	544	0.6148	0.4614	0.6148	0.7841
0.4101	8.1493	546	0.6637	0.3475	0.6637	0.8147
0.4101	8.1791	548	0.7071	0.3653	0.7071	0.8409
0.4101	8.2090	550	0.7486	0.3319	0.7486	0.8652
0.4101	8.2388	552	0.7619	0.3319	0.7619	0.8729
0.4101	8.2687	554	0.8196	0.2836	0.8196	0.9053
0.4101	8.2985	556	0.8949	0.3019	0.8949	0.9460
0.4101	8.3284	558	0.8134	0.3042	0.8134	0.9019
0.4101	8.3582	560	0.6845	0.3662	0.6845	0.8274
0.4101	8.3881	562	0.6577	0.3267	0.6577	0.8110
0.4101	8.4179	564	0.6829	0.4076	0.6829	0.8264
0.4101	8.4478	566	0.7747	0.3219	0.7747	0.8802
0.4101	8.4776	568	0.9236	0.3735	0.9236	0.9610
0.4101	8.5075	570	0.9852	0.3627	0.9852	0.9926
0.4101	8.5373	572	0.8720	0.3043	0.8720	0.9338
0.4101	8.5672	574	0.7334	0.4076	0.7334	0.8564
0.4101	8.5970	576	0.6980	0.3267	0.6980	0.8355
0.4101	8.6269	578	0.7258	0.3196	0.7258	0.8520
0.4101	8.6567	580	0.7564	0.3519	0.7564	0.8697
0.4101	8.6866	582	0.8534	0.3239	0.8534	0.9238
0.4101	8.7164	584	0.8600	0.3461	0.8600	0.9274
0.4101	8.7463	586	0.7621	0.3519	0.7621	0.8730
0.4101	8.7761	588	0.7533	0.3519	0.7533	0.8679
0.4101	8.8060	590	0.7105	0.3894	0.7105	0.8429
0.4101	8.8358	592	0.7067	0.3196	0.7067	0.8406
0.4101	8.8657	594	0.6945	0.2847	0.6945	0.8334
0.4101	8.8955	596	0.6966	0.4158	0.6966	0.8346
0.4101	8.9254	598	0.7541	0.3183	0.7541	0.8684
0.4101	8.9552	600	0.7628	0.3125	0.7628	0.8734
0.4101	8.9851	602	0.7045	0.4502	0.7045	0.8394
0.4101	9.0149	604	0.6583	0.3494	0.6583	0.8114
0.4101	9.0448	606	0.6724	0.3494	0.6724	0.8200
0.4101	9.0746	608	0.7375	0.3195	0.7375	0.8588
0.4101	9.1045	610	0.8525	0.2336	0.8525	0.9233
0.4101	9.1343	612	0.8672	0.2464	0.8672	0.9312
0.4101	9.1642	614	0.7884	0.2697	0.7884	0.8879
0.4101	9.1940	616	0.7537	0.3195	0.7537	0.8681

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1