ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0639
• Qwk: 0.2271
• Mse: 1.0639
• Rmse: 1.0314

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	2.5143	-0.0262	2.5143	1.5857
No log	0.2667	4	1.2683	0.0994	1.2683	1.1262
No log	0.4	6	1.0406	-0.0970	1.0406	1.0201
No log	0.5333	8	1.0903	-0.1680	1.0903	1.0442
No log	0.6667	10	1.1030	-0.2125	1.1030	1.0502
No log	0.8	12	0.8646	-0.0426	0.8646	0.9298
No log	0.9333	14	0.6932	0.0481	0.6932	0.8326
No log	1.0667	16	0.7194	0.0937	0.7194	0.8482
No log	1.2	18	0.6690	0.1604	0.6690	0.8179
No log	1.3333	20	0.6683	0.1604	0.6683	0.8175
No log	1.4667	22	0.6842	0.0481	0.6842	0.8272
No log	1.6	24	0.6898	0.0889	0.6898	0.8306
No log	1.7333	26	0.6979	0.0889	0.6979	0.8354
No log	1.8667	28	0.7063	0.1508	0.7063	0.8404
No log	2.0	30	0.7367	0.1648	0.7367	0.8583
No log	2.1333	32	0.7343	0.1648	0.7343	0.8569
No log	2.2667	34	0.7758	0.2012	0.7758	0.8808
No log	2.4	36	0.7360	0.1504	0.7360	0.8579
No log	2.5333	38	0.6928	0.3336	0.6928	0.8323
No log	2.6667	40	0.6866	0.3213	0.6866	0.8286
No log	2.8	42	0.7266	0.2899	0.7266	0.8524
No log	2.9333	44	0.7599	0.3157	0.7599	0.8717
No log	3.0667	46	0.8999	0.3310	0.8999	0.9486
No log	3.2	48	1.2339	0.2988	1.2339	1.1108
No log	3.3333	50	1.1708	0.2589	1.1708	1.0821
No log	3.4667	52	0.8973	0.3239	0.8973	0.9472
No log	3.6	54	0.7864	0.3121	0.7864	0.8868
No log	3.7333	56	0.9177	0.3559	0.9177	0.9580
No log	3.8667	58	0.9672	0.4032	0.9672	0.9835
No log	4.0	60	0.8859	0.3579	0.8859	0.9412
No log	4.1333	62	1.0965	0.4106	1.0965	1.0471
No log	4.2667	64	1.1032	0.4106	1.1032	1.0503
No log	4.4	66	1.2485	0.2838	1.2485	1.1174
No log	4.5333	68	1.3110	0.2571	1.3110	1.1450
No log	4.6667	70	1.1756	0.4106	1.1756	1.0843
No log	4.8	72	0.8521	0.2627	0.8521	0.9231
No log	4.9333	74	0.7996	0.2798	0.7996	0.8942
No log	5.0667	76	0.8691	0.2849	0.8691	0.9322
No log	5.2	78	1.2367	0.3401	1.2367	1.1121
No log	5.3333	80	1.3323	0.2444	1.3323	1.1542
No log	5.4667	82	1.1571	0.3650	1.1571	1.0757
No log	5.6	84	0.9564	0.3151	0.9564	0.9779
No log	5.7333	86	0.9529	0.2928	0.9529	0.9762
No log	5.8667	88	1.0192	0.3403	1.0192	1.0096
No log	6.0	90	0.9730	0.3425	0.9730	0.9864
No log	6.1333	92	0.7890	0.3330	0.7890	0.8882
No log	6.2667	94	0.7054	0.3769	0.7054	0.8399
No log	6.4	96	0.7591	0.3885	0.7591	0.8713
No log	6.5333	98	0.9935	0.3470	0.9935	0.9967
No log	6.6667	100	1.0690	0.3473	1.0690	1.0339
No log	6.8	102	0.7710	0.4173	0.7710	0.8780
No log	6.9333	104	0.6330	0.4013	0.6330	0.7956
No log	7.0667	106	0.6215	0.3581	0.6215	0.7883
No log	7.2	108	0.6627	0.3700	0.6627	0.8141
No log	7.3333	110	0.9512	0.3650	0.9512	0.9753
No log	7.4667	112	0.9826	0.3557	0.9826	0.9912
No log	7.6	114	0.7965	0.4180	0.7965	0.8925
No log	7.7333	116	0.7807	0.4723	0.7807	0.8836
No log	7.8667	118	0.9055	0.3847	0.9055	0.9516
No log	8.0	120	1.0074	0.3183	1.0074	1.0037
No log	8.1333	122	1.2078	0.2008	1.2078	1.0990
No log	8.2667	124	1.1553	0.2168	1.1553	1.0749
No log	8.4	126	0.8874	0.2670	0.8874	0.9420
No log	8.5333	128	0.7764	0.2907	0.7764	0.8811
No log	8.6667	130	0.7950	0.3314	0.7950	0.8916
No log	8.8	132	0.8746	0.2784	0.8746	0.9352
No log	8.9333	134	0.9686	0.1897	0.9686	0.9842
No log	9.0667	136	1.0975	0.2601	1.0975	1.0476
No log	9.2	138	1.1327	0.2130	1.1327	1.0643
No log	9.3333	140	1.0309	0.2833	1.0309	1.0153
No log	9.4667	142	1.0292	0.2833	1.0292	1.0145
No log	9.6	144	1.0886	0.2903	1.0886	1.0433
No log	9.7333	146	1.1797	0.1815	1.1797	1.0862
No log	9.8667	148	1.0712	0.3006	1.0712	1.0350
No log	10.0	150	0.8262	0.2904	0.8262	0.9089
No log	10.1333	152	0.7613	0.2319	0.7613	0.8725
No log	10.2667	154	0.7852	0.2063	0.7852	0.8861
No log	10.4	156	0.8148	0.2574	0.8148	0.9027
No log	10.5333	158	1.0479	0.2833	1.0479	1.0237
No log	10.6667	160	1.1251	0.2223	1.1251	1.0607
No log	10.8	162	1.1298	0.2223	1.1298	1.0629
No log	10.9333	164	0.9951	0.2626	0.9951	0.9975
No log	11.0667	166	0.8629	0.2670	0.8629	0.9289
No log	11.2	168	0.9249	0.3019	0.9249	0.9617
No log	11.3333	170	1.2385	0.2280	1.2385	1.1129
No log	11.4667	172	1.3897	0.1793	1.3897	1.1788
No log	11.6	174	1.1823	0.2280	1.1823	1.0873
No log	11.7333	176	0.8799	0.3042	0.8799	0.9380
No log	11.8667	178	0.7962	0.2328	0.7962	0.8923
No log	12.0	180	0.7682	0.2359	0.7682	0.8765
No log	12.1333	182	0.8204	0.2492	0.8204	0.9058
No log	12.2667	184	0.9260	0.3473	0.9260	0.9623
No log	12.4	186	1.0906	0.2567	1.0906	1.0443
No log	12.5333	188	1.0992	0.2459	1.0992	1.0484
No log	12.6667	190	1.0355	0.1990	1.0355	1.0176
No log	12.8	192	0.9079	0.2410	0.9079	0.9528
No log	12.9333	194	0.8512	0.1628	0.8512	0.9226
No log	13.0667	196	0.8019	0.2149	0.8019	0.8955
No log	13.2	198	0.9237	0.2410	0.9237	0.9611
No log	13.3333	200	1.1757	0.1981	1.1757	1.0843
No log	13.4667	202	1.1830	0.1860	1.1830	1.0877
No log	13.6	204	1.0016	0.3169	1.0016	1.0008
No log	13.7333	206	0.9471	0.2923	0.9471	0.9732
No log	13.8667	208	0.9628	0.2923	0.9628	0.9812
No log	14.0	210	0.9335	0.2923	0.9335	0.9662
No log	14.1333	212	0.9380	0.2923	0.9380	0.9685
No log	14.2667	214	0.9672	0.2756	0.9672	0.9835
No log	14.4	216	1.0310	0.2651	1.0310	1.0154
No log	14.5333	218	1.0392	0.2316	1.0392	1.0194
No log	14.6667	220	1.0312	0.2316	1.0312	1.0155
No log	14.8	222	1.0137	0.2703	1.0137	1.0068
No log	14.9333	224	0.9137	0.2094	0.9137	0.9559
No log	15.0667	226	0.8319	0.1766	0.8319	0.9121
No log	15.2	228	0.9222	0.1822	0.9222	0.9603
No log	15.3333	230	1.1808	0.2141	1.1808	1.0866
No log	15.4667	232	1.2523	0.1235	1.2523	1.1191
No log	15.6	234	1.0875	0.2411	1.0875	1.0428
No log	15.7333	236	0.8583	0.2297	0.8583	0.9264
No log	15.8667	238	0.7663	0.1972	0.7663	0.8754
No log	16.0	240	0.7468	0.2085	0.7468	0.8642
No log	16.1333	242	0.7787	0.1918	0.7787	0.8824
No log	16.2667	244	0.8581	0.2632	0.8581	0.9263
No log	16.4	246	0.9120	0.2142	0.9120	0.9550
No log	16.5333	248	0.9090	0.2193	0.9090	0.9534
No log	16.6667	250	0.8438	0.2297	0.8438	0.9186
No log	16.8	252	0.7519	0.1866	0.7519	0.8671
No log	16.9333	254	0.7424	0.1866	0.7424	0.8616
No log	17.0667	256	0.8073	0.2063	0.8073	0.8985
No log	17.2	258	0.8688	0.2574	0.8688	0.9321
No log	17.3333	260	0.9393	0.2463	0.9393	0.9692
No log	17.4667	262	0.9321	0.2193	0.9321	0.9655
No log	17.6	264	0.9164	0.1914	0.9164	0.9573
No log	17.7333	266	0.9373	0.2463	0.9373	0.9681
No log	17.8667	268	1.0158	0.2259	1.0158	1.0079
No log	18.0	270	1.0108	0.2046	1.0108	1.0054
No log	18.1333	272	0.9155	0.2843	0.9155	0.9568
No log	18.2667	274	0.7761	0.2467	0.7761	0.8809
No log	18.4	276	0.7416	0.3092	0.7416	0.8612
No log	18.5333	278	0.7937	0.2692	0.7937	0.8909
No log	18.6667	280	0.9576	0.2726	0.9576	0.9786
No log	18.8	282	1.0261	0.3409	1.0261	1.0130
No log	18.9333	284	1.0258	0.3409	1.0258	1.0128
No log	19.0667	286	0.8936	0.3105	0.8936	0.9453
No log	19.2	288	0.8371	0.3105	0.8371	0.9149
No log	19.3333	290	0.8264	0.2904	0.8264	0.9091
No log	19.4667	292	0.9262	0.2726	0.9262	0.9624
No log	19.6	294	1.0185	0.2259	1.0185	1.0092
No log	19.7333	296	1.0121	0.2259	1.0121	1.0060
No log	19.8667	298	1.0044	0.2615	1.0044	1.0022
No log	20.0	300	1.0193	0.1911	1.0193	1.0096
No log	20.1333	302	1.0240	0.2810	1.0240	1.0119
No log	20.2667	304	1.0623	0.2833	1.0623	1.0307
No log	20.4	306	1.1334	0.2282	1.1334	1.0646
No log	20.5333	308	1.0941	0.2589	1.0941	1.0460
No log	20.6667	310	0.9076	0.3359	0.9076	0.9527
No log	20.8	312	0.7503	0.3127	0.7503	0.8662
No log	20.9333	314	0.7239	0.2883	0.7239	0.8508
No log	21.0667	316	0.7890	0.2352	0.7890	0.8882
No log	21.2	318	0.9286	0.2982	0.9286	0.9637
No log	21.3333	320	1.0493	0.2651	1.0493	1.0244
No log	21.4667	322	1.1519	0.2567	1.1519	1.0733
No log	21.6	324	1.1573	0.2412	1.1573	1.0758
No log	21.7333	326	1.1419	0.2903	1.1419	1.0686
No log	21.8667	328	1.1000	0.2903	1.1000	1.0488
No log	22.0	330	1.0289	0.2954	1.0289	1.0143
No log	22.1333	332	0.9301	0.3409	0.9301	0.9644
No log	22.2667	334	0.8605	0.3675	0.8605	0.9276
No log	22.4	336	0.8479	0.3494	0.8479	0.9208
No log	22.5333	338	0.9131	0.2866	0.9131	0.9556
No log	22.6667	340	1.0230	0.2782	1.0230	1.0114
No log	22.8	342	1.2378	0.2282	1.2378	1.1126
No log	22.9333	344	1.4343	0.1391	1.4343	1.1976
No log	23.0667	346	1.4825	0.1391	1.4825	1.2176
No log	23.2	348	1.2901	0.2145	1.2901	1.1358
No log	23.3333	350	1.0082	0.3228	1.0082	1.0041
No log	23.4667	352	0.8982	0.3473	0.8982	0.9477
No log	23.6	354	0.8556	0.2670	0.8556	0.9250
No log	23.7333	356	0.8799	0.2923	0.8799	0.9380
No log	23.8667	358	0.9103	0.2923	0.9103	0.9541
No log	24.0	360	0.9467	0.2923	0.9467	0.9730
No log	24.1333	362	1.0292	0.2939	1.0292	1.0145
No log	24.2667	364	1.0079	0.3051	1.0079	1.0040
No log	24.4	366	0.9460	0.2923	0.9460	0.9726
No log	24.5333	368	0.9173	0.3473	0.9173	0.9577
No log	24.6667	370	0.8771	0.3105	0.8771	0.9365
No log	24.8	372	0.8564	0.3105	0.8564	0.9254
No log	24.9333	374	0.8605	0.3105	0.8605	0.9276
No log	25.0667	376	0.8683	0.3675	0.8683	0.9318
No log	25.2	378	0.8645	0.3675	0.8645	0.9298
No log	25.3333	380	0.8786	0.3918	0.8786	0.9373
No log	25.4667	382	0.8716	0.3918	0.8716	0.9336
No log	25.6	384	0.8349	0.3991	0.8349	0.9137
No log	25.7333	386	0.8817	0.3918	0.8817	0.9390
No log	25.8667	388	0.9233	0.3473	0.9233	0.9609
No log	26.0	390	0.9012	0.3918	0.9012	0.9493
No log	26.1333	392	0.9493	0.3287	0.9493	0.9743
No log	26.2667	394	0.9702	0.2939	0.9702	0.9850
No log	26.4	396	0.9189	0.3538	0.9189	0.9586
No log	26.5333	398	0.8600	0.3105	0.8600	0.9274
No log	26.6667	400	0.8426	0.3105	0.8426	0.9179
No log	26.8	402	0.8728	0.3105	0.8728	0.9342
No log	26.9333	404	1.0211	0.1949	1.0211	1.0105
No log	27.0667	406	1.1396	0.2141	1.1396	1.0675
No log	27.2	408	1.2045	0.2240	1.2045	1.0975
No log	27.3333	410	1.2748	0.1944	1.2748	1.1291
No log	27.4667	412	1.2566	0.1944	1.2566	1.1210
No log	27.6	414	1.1043	0.2100	1.1043	1.0509
No log	27.7333	416	0.9728	0.2756	0.9728	0.9863
No log	27.8667	418	0.8796	0.2784	0.8796	0.9379
No log	28.0	420	0.8558	0.2784	0.8558	0.9251
No log	28.1333	422	0.8721	0.2784	0.8721	0.9339
No log	28.2667	424	0.8977	0.2784	0.8977	0.9474
No log	28.4	426	0.9425	0.2982	0.9425	0.9708
No log	28.5333	428	0.8892	0.2297	0.8892	0.9430
No log	28.6667	430	0.8669	0.2409	0.8669	0.9311
No log	28.8	432	0.9180	0.2904	0.9180	0.9581
No log	28.9333	434	1.0790	0.2363	1.0790	1.0387
No log	29.0667	436	1.3037	0.2280	1.3037	1.1418
No log	29.2	438	1.3902	0.2074	1.3902	1.1791
No log	29.3333	440	1.1946	0.1873	1.1946	1.0930
No log	29.4667	442	0.9125	0.2463	0.9125	0.9552
No log	29.6	444	0.7604	0.2589	0.7604	0.8720
No log	29.7333	446	0.7200	0.2537	0.7200	0.8485
No log	29.8667	448	0.7242	0.2407	0.7242	0.8510
No log	30.0	450	0.7622	0.2171	0.7622	0.8730
No log	30.1333	452	0.8250	0.2518	0.8250	0.9083
No log	30.2667	454	0.9066	0.2670	0.9066	0.9522
No log	30.4	456	1.0062	0.2601	1.0062	1.0031
No log	30.5333	458	1.1489	0.1758	1.1489	1.0719
No log	30.6667	460	1.2614	0.1944	1.2614	1.1231
No log	30.8	462	1.2139	0.1944	1.2139	1.1018
No log	30.9333	464	1.0809	0.2183	1.0809	1.0397
No log	31.0667	466	0.9166	0.2670	0.9166	0.9574
No log	31.2	468	0.8434	0.2463	0.8434	0.9184
No log	31.3333	470	0.8581	0.2726	0.8581	0.9263
No log	31.4667	472	0.8939	0.2670	0.8939	0.9455
No log	31.6	474	0.9519	0.2615	0.9519	0.9757
No log	31.7333	476	0.9802	0.2211	0.9802	0.9901
No log	31.8667	478	0.9636	0.2562	0.9636	0.9816
No log	32.0	480	0.9816	0.2211	0.9816	0.9908
No log	32.1333	482	1.0303	0.2460	1.0303	1.0150
No log	32.2667	484	1.0811	0.2995	1.0811	1.0398
No log	32.4	486	1.1721	0.2252	1.1721	1.0826
No log	32.5333	488	1.1898	0.2504	1.1898	1.0908
No log	32.6667	490	1.0753	0.2995	1.0753	1.0370
No log	32.8	492	0.9884	0.2995	0.9884	0.9942
No log	32.9333	494	0.9398	0.3110	0.9398	0.9694
No log	33.0667	496	0.9311	0.3169	0.9311	0.9650
No log	33.2	498	0.8907	0.2726	0.8907	0.9438
0.2281	33.3333	500	0.8659	0.2463	0.8659	0.9305
0.2281	33.4667	502	0.9148	0.2726	0.9148	0.9565
0.2281	33.6	504	0.9888	0.3169	0.9888	0.9944
0.2281	33.7333	506	1.0324	0.2995	1.0324	1.0161
0.2281	33.8667	508	0.9960	0.3169	0.9960	0.9980
0.2281	34.0	510	0.9182	0.2463	0.9182	0.9582
0.2281	34.1333	512	0.8995	0.2463	0.8995	0.9484
0.2281	34.2667	514	0.9276	0.2670	0.9276	0.9631
0.2281	34.4	516	0.9509	0.3169	0.9509	0.9751
0.2281	34.5333	518	0.9099	0.2670	0.9099	0.9539
0.2281	34.6667	520	0.8787	0.2463	0.8787	0.9374
0.2281	34.8	522	0.8274	0.2518	0.8274	0.9096
0.2281	34.9333	524	0.8094	0.2904	0.8094	0.8996
0.2281	35.0667	526	0.8133	0.2518	0.8133	0.9019
0.2281	35.2	528	0.8713	0.2518	0.8713	0.9334
0.2281	35.3333	530	0.9467	0.2259	0.9467	0.9730
0.2281	35.4667	532	1.0065	0.2411	1.0065	1.0033
0.2281	35.6	534	1.0045	0.2411	1.0045	1.0022
0.2281	35.7333	536	0.9619	0.2810	0.9619	0.9808
0.2281	35.8667	538	0.9194	0.2670	0.9194	0.9588
0.2281	36.0	540	0.8508	0.2904	0.8508	0.9224
0.2281	36.1333	542	0.8165	0.2967	0.8165	0.9036
0.2281	36.2667	544	0.8198	0.2904	0.8198	0.9055
0.2281	36.4	546	0.8516	0.2410	0.8516	0.9228
0.2281	36.5333	548	0.8726	0.2670	0.8726	0.9342
0.2281	36.6667	550	0.9087	0.3347	0.9087	0.9532
0.2281	36.8	552	0.9338	0.2995	0.9338	0.9663
0.2281	36.9333	554	0.9068	0.3347	0.9068	0.9523
0.2281	37.0667	556	0.8629	0.3231	0.8629	0.9289
0.2281	37.2	558	0.8311	0.2518	0.8311	0.9116
0.2281	37.3333	560	0.8227	0.2518	0.8227	0.9070
0.2281	37.4667	562	0.8490	0.3294	0.8490	0.9214
0.2281	37.6	564	0.8767	0.3231	0.8767	0.9363
0.2281	37.7333	566	0.9419	0.3287	0.9419	0.9705
0.2281	37.8667	568	1.0162	0.3170	1.0163	1.0081
0.2281	38.0	570	1.0240	0.3395	1.0240	1.0119
0.2281	38.1333	572	0.9923	0.3170	0.9923	0.9962
0.2281	38.2667	574	0.9921	0.3170	0.9921	0.9960
0.2281	38.4	576	0.9383	0.3473	0.9383	0.9687
0.2281	38.5333	578	0.8532	0.3042	0.8532	0.9237
0.2281	38.6667	580	0.8170	0.3105	0.8170	0.9039
0.2281	38.8	582	0.8243	0.2463	0.8243	0.9079
0.2281	38.9333	584	0.8651	0.3294	0.8651	0.9301
0.2281	39.0667	586	0.9075	0.3231	0.9075	0.9526
0.2281	39.2	588	1.0008	0.2756	1.0008	1.0004
0.2281	39.3333	590	1.1057	0.2316	1.1057	1.0515
0.2281	39.4667	592	1.1826	0.2183	1.1826	1.0875
0.2281	39.6	594	1.1930	0.2183	1.1930	1.0923
0.2281	39.7333	596	1.1605	0.2504	1.1605	1.0773
0.2281	39.8667	598	1.0809	0.2075	1.0809	1.0397
0.2281	40.0	600	1.0556	0.2411	1.0556	1.0274
0.2281	40.1333	602	1.0367	0.2411	1.0367	1.0182
0.2281	40.2667	604	1.0444	0.2411	1.0444	1.0220
0.2281	40.4	606	1.0639	0.2271	1.0639	1.0314

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1