ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.9900
• Qwk: 0.2464
• Mse: 1.9900
• Rmse: 1.4107

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	6.8708	0.0057	6.8708	2.6212
No log	0.0656	4	4.4743	0.0506	4.4743	2.1152
No log	0.0984	6	3.8033	-0.0707	3.8033	1.9502
No log	0.1311	8	3.3344	-0.0114	3.3344	1.8260
No log	0.1639	10	2.4619	-0.0328	2.4619	1.5690
No log	0.1967	12	2.0777	0.0169	2.0777	1.4414
No log	0.2295	14	2.0825	0.1148	2.0825	1.4431
No log	0.2623	16	2.1839	0.1221	2.1839	1.4778
No log	0.2951	18	2.2158	0.1385	2.2158	1.4885
No log	0.3279	20	2.3440	-0.0704	2.3440	1.5310
No log	0.3607	22	2.4897	-0.1111	2.4897	1.5779
No log	0.3934	24	2.4586	-0.0704	2.4586	1.5680
No log	0.4262	26	2.3462	-0.0741	2.3462	1.5317
No log	0.4590	28	2.0977	0.1524	2.0977	1.4483
No log	0.4918	30	2.0072	0.0784	2.0072	1.4168
No log	0.5246	32	1.9766	0.0784	1.9766	1.4059
No log	0.5574	34	2.0488	0.0971	2.0488	1.4314
No log	0.5902	36	2.0226	0.1887	2.0226	1.4222
No log	0.6230	38	2.0587	0.2931	2.0587	1.4348
No log	0.6557	40	2.0987	0.2636	2.0987	1.4487
No log	0.6885	42	1.9987	0.2353	1.9987	1.4138
No log	0.7213	44	1.8529	0.1698	1.8529	1.3612
No log	0.7541	46	1.7486	0.0396	1.7486	1.3223
No log	0.7869	48	1.7005	0.0396	1.7005	1.3040
No log	0.8197	50	1.6984	0.0396	1.6984	1.3032
No log	0.8525	52	1.6781	0.0392	1.6781	1.2954
No log	0.8852	54	1.7723	0.2162	1.7723	1.3313
No log	0.9180	56	2.4559	0.0140	2.4559	1.5671
No log	0.9508	58	2.8712	0.0408	2.8712	1.6945
No log	0.9836	60	2.4344	0.0563	2.4344	1.5603
No log	1.0164	62	2.0575	0.1600	2.0575	1.4344
No log	1.0492	64	1.7305	0.0777	1.7305	1.3155
No log	1.0820	66	1.6529	0.0396	1.6529	1.2856
No log	1.1148	68	1.6370	0.0392	1.6370	1.2795
No log	1.1475	70	1.6570	0.0777	1.6570	1.2872
No log	1.1803	72	1.6266	0.0962	1.6266	1.2754
No log	1.2131	74	1.6737	0.1143	1.6737	1.2937
No log	1.2459	76	1.6728	0.1509	1.6728	1.2934
No log	1.2787	78	1.6717	0.1682	1.6717	1.2930
No log	1.3115	80	1.5991	0.2018	1.5991	1.2645
No log	1.3443	82	1.6065	0.2807	1.6065	1.2675
No log	1.3770	84	1.5543	0.2655	1.5543	1.2467
No log	1.4098	86	1.5275	0.2957	1.5275	1.2359
No log	1.4426	88	1.5589	0.2712	1.5589	1.2486
No log	1.4754	90	1.5796	0.3000	1.5796	1.2568
No log	1.5082	92	1.8794	0.2636	1.8794	1.3709
No log	1.5410	94	2.0991	0.0650	2.0991	1.4488
No log	1.5738	96	2.0987	0.0696	2.0987	1.4487
No log	1.6066	98	2.1191	0.0374	2.1191	1.4557
No log	1.6393	100	2.0194	0.0192	2.0194	1.4211
No log	1.6721	102	2.0863	0.0571	2.0863	1.4444
No log	1.7049	104	2.0383	0.0536	2.0383	1.4277
No log	1.7377	106	2.1374	0.0678	2.1374	1.4620
No log	1.7705	108	1.8298	0.2540	1.8298	1.3527
No log	1.8033	110	1.6803	0.3200	1.6803	1.2963
No log	1.8361	112	1.9956	0.1504	1.9956	1.4127
No log	1.8689	114	2.4530	-0.0147	2.4530	1.5662
No log	1.9016	116	2.5667	0.0	2.5667	1.6021
No log	1.9344	118	2.4097	0.1268	2.4097	1.5523
No log	1.9672	120	1.7667	0.2727	1.7667	1.3292
No log	2.0	122	1.6039	0.3548	1.6039	1.2665
No log	2.0328	124	1.7895	0.2636	1.7895	1.3377
No log	2.0656	126	2.2911	0.1549	2.2911	1.5136
No log	2.0984	128	2.5458	0.0694	2.5458	1.5956
No log	2.1311	130	2.4957	0.0839	2.4957	1.5798
No log	2.1639	132	2.1949	0.1739	2.1949	1.4815
No log	2.1967	134	1.8694	0.3000	1.8694	1.3673
No log	2.2295	136	1.9280	0.2734	1.9280	1.3885
No log	2.2623	138	2.2399	0.1022	2.2399	1.4966
No log	2.2951	140	2.5014	0.0563	2.5014	1.5816
No log	2.3279	142	2.4122	0.0966	2.4122	1.5531
No log	2.3607	144	2.1512	0.2158	2.1512	1.4667
No log	2.3934	146	2.0063	0.2628	2.0063	1.4164
No log	2.4262	148	2.0793	0.2158	2.0793	1.4420
No log	2.4590	150	2.3181	0.0966	2.3181	1.5225
No log	2.4918	152	2.1866	0.0966	2.1866	1.4787
No log	2.5246	154	1.8833	0.2836	1.8833	1.3723
No log	2.5574	156	1.7183	0.3906	1.7183	1.3109
No log	2.5902	158	1.7034	0.3770	1.7034	1.3052
No log	2.6230	160	1.8461	0.2901	1.8461	1.3587
No log	2.6557	162	1.8766	0.3134	1.8766	1.3699
No log	2.6885	164	1.8912	0.2815	1.8912	1.3752
No log	2.7213	166	2.0777	0.1844	2.0777	1.4414
No log	2.7541	168	2.3466	0.0822	2.3466	1.5319
No log	2.7869	170	2.2715	0.1259	2.2715	1.5071
No log	2.8197	172	2.0033	0.2609	2.0033	1.4154
No log	2.8525	174	1.6730	0.3111	1.6730	1.2935
No log	2.8852	176	1.6689	0.2836	1.6689	1.2918
No log	2.9180	178	1.9521	0.2446	1.9521	1.3972
No log	2.9508	180	2.1635	0.2128	2.1635	1.4709
No log	2.9836	182	2.1095	0.2128	2.1095	1.4524
No log	3.0164	184	1.9408	0.2609	1.9408	1.3931
No log	3.0492	186	1.7418	0.2815	1.7418	1.3198
No log	3.0820	188	1.4525	0.3846	1.4525	1.2052
No log	3.1148	190	1.5223	0.3485	1.5223	1.2338
No log	3.1475	192	1.9053	0.2571	1.9053	1.3803
No log	3.1803	194	2.2045	0.1831	2.2045	1.4848
No log	3.2131	196	2.4711	0.1633	2.4711	1.5720
No log	3.2459	198	2.3414	0.1538	2.3414	1.5302
No log	3.2787	200	1.9411	0.2899	1.9411	1.3932
No log	3.3115	202	1.7512	0.3407	1.7512	1.3233
No log	3.3443	204	1.6708	0.3511	1.6708	1.2926
No log	3.3770	206	1.8452	0.2667	1.8452	1.3584
No log	3.4098	208	1.9497	0.2647	1.9497	1.3963
No log	3.4426	210	2.0599	0.2158	2.0599	1.4352
No log	3.4754	212	1.9520	0.2319	1.9520	1.3972
No log	3.5082	214	1.7727	0.3008	1.7727	1.3314
No log	3.5410	216	1.8487	0.2519	1.8487	1.3597
No log	3.5738	218	2.0661	0.2000	2.0661	1.4374
No log	3.6066	220	2.0392	0.2143	2.0392	1.4280
No log	3.6393	222	2.0892	0.1986	2.0892	1.4454
No log	3.6721	224	2.0132	0.2158	2.0132	1.4189
No log	3.7049	226	1.9074	0.2774	1.9074	1.3811
No log	3.7377	228	1.9354	0.2464	1.9354	1.3912
No log	3.7705	230	2.0976	0.1831	2.0976	1.4483
No log	3.8033	232	2.1334	0.1538	2.1334	1.4606
No log	3.8361	234	2.0440	0.1986	2.0440	1.4297
No log	3.8689	236	2.0388	0.1831	2.0388	1.4279
No log	3.9016	238	1.9350	0.2319	1.9350	1.3910
No log	3.9344	240	1.9903	0.1986	1.9903	1.4108
No log	3.9672	242	2.1081	0.1538	2.1081	1.4519
No log	4.0	244	2.0634	0.1538	2.0634	1.4365
No log	4.0328	246	1.9449	0.1831	1.9449	1.3946
No log	4.0656	248	1.8962	0.2158	1.8962	1.3770
No log	4.0984	250	1.7695	0.2963	1.7695	1.3302
No log	4.1311	252	1.7579	0.2963	1.7579	1.3259
No log	4.1639	254	1.8847	0.2429	1.8847	1.3728
No log	4.1967	256	1.9078	0.2429	1.9078	1.3812
No log	4.2295	258	1.7418	0.2774	1.7418	1.3198
No log	4.2623	260	1.8028	0.2899	1.8028	1.3427
No log	4.2951	262	2.0205	0.2000	2.0205	1.4214
No log	4.3279	264	2.0684	0.2000	2.0684	1.4382
No log	4.3607	266	2.0850	0.2000	2.0850	1.4439
No log	4.3934	268	2.0043	0.2319	2.0043	1.4157
No log	4.4262	270	2.0512	0.1857	2.0512	1.4322
No log	4.4590	272	2.1579	0.1702	2.1579	1.4690
No log	4.4918	274	2.3662	0.0966	2.3662	1.5382
No log	4.5246	276	2.4330	0.0816	2.4330	1.5598
No log	4.5574	278	2.4235	0.0822	2.4235	1.5568
No log	4.5902	280	2.1872	0.1702	2.1872	1.4789
No log	4.6230	282	1.8452	0.2628	1.8452	1.3584
No log	4.6557	284	1.7762	0.2667	1.7762	1.3327
No log	4.6885	286	1.9591	0.2628	1.9591	1.3997
No log	4.7213	288	2.1086	0.2319	2.1086	1.4521
No log	4.7541	290	2.0550	0.2628	2.0550	1.4335
No log	4.7869	292	1.9700	0.2628	1.9700	1.4035
No log	4.8197	294	2.0393	0.2628	2.0393	1.4281
No log	4.8525	296	2.0892	0.2014	2.0892	1.4454
No log	4.8852	298	2.1506	0.2014	2.1506	1.4665
No log	4.9180	300	2.1909	0.2014	2.1909	1.4802
No log	4.9508	302	2.3622	0.1549	2.3622	1.5369
No log	4.9836	304	2.3333	0.1549	2.3333	1.5275
No log	5.0164	306	2.0530	0.2029	2.0530	1.4328
No log	5.0492	308	1.7260	0.3088	1.7260	1.3138
No log	5.0820	310	1.7184	0.3088	1.7184	1.3109
No log	5.1148	312	1.9143	0.2336	1.9143	1.3836
No log	5.1475	314	1.9533	0.2336	1.9533	1.3976
No log	5.1803	316	2.0949	0.2336	2.0949	1.4474
No log	5.2131	318	2.1528	0.1871	2.1528	1.4672
No log	5.2459	320	2.2449	0.1538	2.2449	1.4983
No log	5.2787	322	2.2225	0.1714	2.2225	1.4908
No log	5.3115	324	1.9721	0.2336	1.9721	1.4043
No log	5.3443	326	1.8734	0.2815	1.8734	1.3687
No log	5.3770	328	2.0109	0.2336	2.0109	1.4180
No log	5.4098	330	2.2602	0.2378	2.2602	1.5034
No log	5.4426	332	2.2765	0.2378	2.2765	1.5088
No log	5.4754	334	2.1688	0.2158	2.1688	1.4727
No log	5.5082	336	1.9272	0.2353	1.9272	1.3882
No log	5.5410	338	1.7674	0.3066	1.7674	1.3295
No log	5.5738	340	1.7927	0.3066	1.7927	1.3389
No log	5.6066	342	1.9697	0.2353	1.9697	1.4034
No log	5.6393	344	2.1997	0.1844	2.1997	1.4831
No log	5.6721	346	2.2598	0.1538	2.2598	1.5033
No log	5.7049	348	2.1121	0.2014	2.1121	1.4533
No log	5.7377	350	1.9622	0.2190	1.9622	1.4008
No log	5.7705	352	1.9160	0.2370	1.9160	1.3842
No log	5.8033	354	2.0642	0.2014	2.0642	1.4367
No log	5.8361	356	2.1072	0.2014	2.1072	1.4516
No log	5.8689	358	2.0551	0.2014	2.0551	1.4336
No log	5.9016	360	2.0375	0.2014	2.0375	1.4274
No log	5.9344	362	2.2639	0.1549	2.2639	1.5046
No log	5.9672	364	2.2946	0.1549	2.2946	1.5148
No log	6.0	366	2.0896	0.2014	2.0896	1.4455
No log	6.0328	368	1.8536	0.2628	1.8536	1.3615
No log	6.0656	370	1.8708	0.2628	1.8708	1.3678
No log	6.0984	372	2.0893	0.1844	2.0893	1.4454
No log	6.1311	374	2.1982	0.1538	2.1982	1.4826
No log	6.1639	376	2.1355	0.1844	2.1355	1.4614
No log	6.1967	378	2.0651	0.1844	2.0651	1.4370
No log	6.2295	380	2.1004	0.1844	2.1004	1.4493
No log	6.2623	382	2.2265	0.1389	2.2265	1.4922
No log	6.2951	384	2.2650	0.1389	2.2650	1.5050
No log	6.3279	386	2.1069	0.1538	2.1069	1.4515
No log	6.3607	388	1.9361	0.2590	1.9361	1.3914
No log	6.3934	390	1.8718	0.2774	1.8718	1.3681
No log	6.4262	392	1.7813	0.3284	1.7813	1.3347
No log	6.4590	394	1.7991	0.3008	1.7991	1.3413
No log	6.4918	396	1.9626	0.2336	1.9626	1.4009
No log	6.5246	398	1.9909	0.2029	1.9909	1.4110
No log	6.5574	400	2.0170	0.1871	2.0170	1.4202
No log	6.5902	402	1.9243	0.2336	1.9243	1.3872
No log	6.6230	404	1.9882	0.2000	1.9882	1.4100
No log	6.6557	406	1.9842	0.2000	1.9842	1.4086
No log	6.6885	408	1.9564	0.1857	1.9564	1.3987
No log	6.7213	410	1.9359	0.2014	1.9359	1.3914
No log	6.7541	412	1.8030	0.2941	1.8030	1.3428
No log	6.7869	414	1.8083	0.2774	1.8083	1.3447
No log	6.8197	416	1.9632	0.2319	1.9632	1.4011
No log	6.8525	418	2.1471	0.1538	2.1471	1.4653
No log	6.8852	420	2.1883	0.1538	2.1883	1.4793
No log	6.9180	422	2.0780	0.2143	2.0780	1.4415
No log	6.9508	424	2.0329	0.2319	2.0329	1.4258
No log	6.9836	426	2.0346	0.2319	2.0346	1.4264
No log	7.0164	428	1.9492	0.2319	1.9492	1.3961
No log	7.0492	430	2.0410	0.2319	2.0410	1.4286
No log	7.0820	432	2.1033	0.2319	2.1033	1.4503
No log	7.1148	434	2.1855	0.2143	2.1855	1.4783
No log	7.1475	436	2.1323	0.2319	2.1323	1.4602
No log	7.1803	438	2.0618	0.2319	2.0618	1.4359
No log	7.2131	440	1.9358	0.2319	1.9358	1.3913
No log	7.2459	442	2.0435	0.2319	2.0435	1.4295
No log	7.2787	444	1.9923	0.2319	1.9923	1.4115
No log	7.3115	446	1.8743	0.2794	1.8743	1.3690
No log	7.3443	448	1.8021	0.2794	1.8021	1.3424
No log	7.3770	450	1.7221	0.2687	1.7221	1.3123
No log	7.4098	452	1.8719	0.2794	1.8719	1.3682
No log	7.4426	454	2.1683	0.2302	2.1683	1.4725
No log	7.4754	456	2.2922	0.2069	2.2922	1.5140
No log	7.5082	458	2.0903	0.2837	2.0903	1.4458
No log	7.5410	460	1.7562	0.2794	1.7562	1.3252
No log	7.5738	462	1.6674	0.2857	1.6674	1.2913
No log	7.6066	464	1.7506	0.2794	1.7506	1.3231
No log	7.6393	466	1.9364	0.2774	1.9364	1.3916
No log	7.6721	468	1.9898	0.2609	1.9898	1.4106
No log	7.7049	470	1.8885	0.2794	1.8885	1.3742
No log	7.7377	472	1.7526	0.2941	1.7526	1.3239
No log	7.7705	474	1.8114	0.3066	1.8114	1.3459
No log	7.8033	476	2.0593	0.2571	2.0593	1.4350
No log	7.8361	478	2.1927	0.1538	2.1927	1.4808
No log	7.8689	480	2.3164	0.1389	2.3164	1.5220
No log	7.9016	482	2.2066	0.1690	2.2066	1.4855
No log	7.9344	484	2.0001	0.2571	2.0001	1.4142
No log	7.9672	486	1.8793	0.3212	1.8793	1.3709
No log	8.0	488	1.8578	0.3212	1.8578	1.3630
No log	8.0328	490	1.8465	0.3212	1.8465	1.3588
No log	8.0656	492	1.8821	0.3212	1.8821	1.3719
No log	8.0984	494	1.9374	0.2899	1.9374	1.3919
No log	8.1311	496	1.9423	0.2899	1.9423	1.3937
No log	8.1639	498	1.8617	0.2899	1.8617	1.3644
0.4671	8.1967	500	1.8541	0.2899	1.8541	1.3617
0.4671	8.2295	502	1.7879	0.2774	1.7879	1.3371
0.4671	8.2623	504	1.6564	0.3485	1.6564	1.2870
0.4671	8.2951	506	1.6360	0.3511	1.6360	1.2791
0.4671	8.3279	508	1.7697	0.3259	1.7697	1.3303
0.4671	8.3607	510	1.8415	0.2941	1.8415	1.3570
0.4671	8.3934	512	1.8640	0.3066	1.8640	1.3653
0.4671	8.4262	514	1.8314	0.3088	1.8314	1.3533
0.4671	8.4590	516	1.8341	0.3066	1.8341	1.3543
0.4671	8.4918	518	1.9109	0.2628	1.9109	1.3824
0.4671	8.5246	520	1.9449	0.2590	1.9449	1.3946
0.4671	8.5574	522	1.8663	0.2774	1.8663	1.3661
0.4671	8.5902	524	1.8305	0.2647	1.8305	1.3530
0.4671	8.6230	526	1.9900	0.2464	1.9900	1.4107

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1