ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6186
• Qwk: 0.3582
• Mse: 1.6186
• Rmse: 1.2722

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	6.9567	0.0242	6.9567	2.6376
No log	0.0606	4	4.6941	0.0602	4.6941	2.1666
No log	0.0909	6	3.3017	0.0111	3.3017	1.8171
No log	0.1212	8	2.6325	0.1549	2.6325	1.6225
No log	0.1515	10	1.8019	0.2373	1.8019	1.3423
No log	0.1818	12	2.1239	0.0945	2.1239	1.4574
No log	0.2121	14	2.3805	0.1143	2.3805	1.5429
No log	0.2424	16	2.2690	0.0310	2.2690	1.5063
No log	0.2727	18	2.0271	0.1463	2.0271	1.4238
No log	0.3030	20	1.7223	0.2143	1.7223	1.3124
No log	0.3333	22	1.6617	0.2281	1.6617	1.2891
No log	0.3636	24	2.0441	0.2171	2.0441	1.4297
No log	0.3939	26	1.9881	0.25	1.9881	1.4100
No log	0.4242	28	1.5926	0.2314	1.5926	1.2620
No log	0.4545	30	1.3289	0.3158	1.3289	1.1528
No log	0.4848	32	1.4678	0.2593	1.4678	1.2115
No log	0.5152	34	1.4871	0.2075	1.4871	1.2195
No log	0.5455	36	1.4787	0.2727	1.4787	1.2160
No log	0.5758	38	1.5852	0.2632	1.5852	1.2590
No log	0.6061	40	1.5905	0.2333	1.5905	1.2611
No log	0.6364	42	1.6253	0.3065	1.6253	1.2749
No log	0.6667	44	1.7447	0.3385	1.7447	1.3209
No log	0.6970	46	2.0983	0.0458	2.0983	1.4486
No log	0.7273	48	3.0672	-0.0902	3.0672	1.7513
No log	0.7576	50	3.4204	-0.2411	3.4204	1.8494
No log	0.7879	52	2.4391	-0.0813	2.4391	1.5618
No log	0.8182	54	1.5614	0.25	1.5614	1.2496
No log	0.8485	56	1.2838	0.3590	1.2838	1.1331
No log	0.8788	58	1.2701	0.3276	1.2701	1.1270
No log	0.9091	60	1.2254	0.4071	1.2254	1.1070
No log	0.9394	62	1.3377	0.3717	1.3377	1.1566
No log	0.9697	64	1.5106	0.3802	1.5106	1.2291
No log	1.0	66	1.5563	0.3906	1.5563	1.2475
No log	1.0303	68	1.4032	0.4098	1.4032	1.1845
No log	1.0606	70	1.3817	0.3667	1.3817	1.1755
No log	1.0909	72	1.3366	0.3636	1.3366	1.1561
No log	1.1212	74	1.4014	0.4252	1.4014	1.1838
No log	1.1515	76	1.7605	0.3111	1.7605	1.3268
No log	1.1818	78	1.8134	0.3111	1.8134	1.3466
No log	1.2121	80	1.5203	0.3934	1.5203	1.2330
No log	1.2424	82	1.3307	0.2857	1.3307	1.1536
No log	1.2727	84	1.3491	0.2906	1.3491	1.1615
No log	1.3030	86	1.2958	0.2807	1.2958	1.1383
No log	1.3333	88	1.2966	0.3393	1.2966	1.1387
No log	1.3636	90	1.9258	0.2162	1.9258	1.3877
No log	1.3939	92	3.4151	-0.4480	3.4151	1.8480
No log	1.4242	94	3.6357	-0.4000	3.6357	1.9068
No log	1.4545	96	2.7047	-0.0976	2.7047	1.6446
No log	1.4848	98	1.7287	0.2203	1.7287	1.3148
No log	1.5152	100	1.5254	0.3167	1.5254	1.2351
No log	1.5455	102	1.6240	0.2975	1.6240	1.2744
No log	1.5758	104	1.6915	0.2645	1.6915	1.3006
No log	1.6061	106	1.7110	0.2240	1.7110	1.3081
No log	1.6364	108	1.6342	0.272	1.6342	1.2783
No log	1.6667	110	1.6206	0.2656	1.6206	1.2730
No log	1.6970	112	1.8060	0.1875	1.8060	1.3439
No log	1.7273	114	1.9603	0.1168	1.9603	1.4001
No log	1.7576	116	1.9517	0.1295	1.9517	1.3970
No log	1.7879	118	1.7944	0.2353	1.7944	1.3396
No log	1.8182	120	1.8667	0.2336	1.8667	1.3663
No log	1.8485	122	2.0678	0.1277	2.0678	1.4380
No log	1.8788	124	2.1809	0.1259	2.1809	1.4768
No log	1.9091	126	1.8812	0.2590	1.8812	1.3716
No log	1.9394	128	1.6640	0.3650	1.6640	1.2900
No log	1.9697	130	1.6513	0.3235	1.6513	1.2850
No log	2.0	132	1.7924	0.2754	1.7924	1.3388
No log	2.0303	134	1.7719	0.2857	1.7719	1.3311
No log	2.0606	136	1.7572	0.2609	1.7572	1.3256
No log	2.0909	138	1.8922	0.2029	1.8922	1.3756
No log	2.1212	140	1.7768	0.25	1.7768	1.3330
No log	2.1515	142	1.5972	0.3308	1.5972	1.2638
No log	2.1818	144	1.7323	0.2837	1.7323	1.3162
No log	2.2121	146	2.2787	0.2041	2.2787	1.5095
No log	2.2424	148	2.4873	0.1633	2.4873	1.5771
No log	2.2727	150	2.2193	0.2449	2.2193	1.4897
No log	2.3030	152	1.8572	0.2920	1.8572	1.3628
No log	2.3333	154	1.8229	0.3188	1.8229	1.3501
No log	2.3636	156	1.8052	0.3188	1.8052	1.3436
No log	2.3939	158	1.7272	0.3212	1.7272	1.3142
No log	2.4242	160	1.4529	0.3939	1.4529	1.2054
No log	2.4545	162	1.2089	0.5312	1.2089	1.0995
No log	2.4848	164	1.2292	0.5312	1.2292	1.1087
No log	2.5152	166	1.5626	0.3704	1.5626	1.2500
No log	2.5455	168	1.9689	0.2857	1.9689	1.4032
No log	2.5758	170	2.0950	0.2639	2.0950	1.4474
No log	2.6061	172	1.7710	0.3286	1.7710	1.3308
No log	2.6364	174	1.3487	0.4062	1.3487	1.1613
No log	2.6667	176	1.3139	0.4252	1.3139	1.1462
No log	2.6970	178	1.5970	0.3704	1.5970	1.2637
No log	2.7273	180	2.0103	0.2394	2.0103	1.4179
No log	2.7576	182	2.0862	0.2394	2.0862	1.4444
No log	2.7879	184	1.9091	0.2899	1.9091	1.3817
No log	2.8182	186	1.6437	0.3704	1.6437	1.2821
No log	2.8485	188	1.5987	0.3731	1.5987	1.2644
No log	2.8788	190	1.7297	0.3134	1.7297	1.3152
No log	2.9091	192	1.8315	0.3134	1.8315	1.3533
No log	2.9394	194	1.7372	0.3333	1.7372	1.3180
No log	2.9697	196	1.5673	0.3939	1.5673	1.2519
No log	3.0	198	1.4247	0.3810	1.4247	1.1936
No log	3.0303	200	1.4123	0.3937	1.4123	1.1884
No log	3.0606	202	1.5052	0.4091	1.5052	1.2269
No log	3.0909	204	1.6707	0.3407	1.6707	1.2925
No log	3.1212	206	1.6496	0.3407	1.6496	1.2844
No log	3.1515	208	1.5669	0.3609	1.5669	1.2517
No log	3.1818	210	1.6475	0.3609	1.6475	1.2836
No log	3.2121	212	1.5771	0.3609	1.5771	1.2558
No log	3.2424	214	1.5209	0.3780	1.5209	1.2332
No log	3.2727	216	1.5256	0.3566	1.5256	1.2352
No log	3.3030	218	1.5901	0.3731	1.5901	1.2610
No log	3.3333	220	1.6836	0.3529	1.6836	1.2975
No log	3.3636	222	1.5854	0.3759	1.5854	1.2591
No log	3.3939	224	1.4673	0.4	1.4673	1.2113
No log	3.4242	226	1.4639	0.3511	1.4639	1.2099
No log	3.4545	228	1.6759	0.2985	1.6759	1.2946
No log	3.4848	230	2.0121	0.2774	2.0121	1.4185
No log	3.5152	232	1.9528	0.2815	1.9528	1.3974
No log	3.5455	234	1.6786	0.3158	1.6786	1.2956
No log	3.5758	236	1.4829	0.3710	1.4829	1.2177
No log	3.6061	238	1.4839	0.3710	1.4839	1.2182
No log	3.6364	240	1.5609	0.4252	1.5609	1.2494
No log	3.6667	242	1.7683	0.3008	1.7683	1.3298
No log	3.6970	244	2.0743	0.2128	2.0743	1.4403
No log	3.7273	246	2.1647	0.1831	2.1647	1.4713
No log	3.7576	248	2.0529	0.2128	2.0529	1.4328
No log	3.7879	250	1.8799	0.2754	1.8799	1.3711
No log	3.8182	252	1.8432	0.2878	1.8432	1.3576
No log	3.8485	254	1.9238	0.2714	1.9238	1.3870
No log	3.8788	256	1.8754	0.2837	1.8754	1.3695
No log	3.9091	258	1.8791	0.2837	1.8791	1.3708
No log	3.9394	260	2.0123	0.2714	2.0123	1.4186
No log	3.9697	262	2.1031	0.1831	2.1031	1.4502
No log	4.0	264	1.9268	0.2446	1.9268	1.3881
No log	4.0303	266	1.7615	0.3235	1.7615	1.3272
No log	4.0606	268	1.6376	0.3704	1.6376	1.2797
No log	4.0909	270	1.7005	0.3704	1.7005	1.3040
No log	4.1212	272	1.8218	0.2754	1.8218	1.3497
No log	4.1515	274	1.8560	0.3022	1.8560	1.3623
No log	4.1818	276	1.8287	0.3043	1.8287	1.3523
No log	4.2121	278	1.9491	0.2676	1.9491	1.3961
No log	4.2424	280	2.0333	0.2676	2.0333	1.4259
No log	4.2727	282	1.9863	0.2676	1.9863	1.4094
No log	4.3030	284	1.8408	0.2714	1.8408	1.3568
No log	4.3333	286	1.7651	0.3704	1.7651	1.3286
No log	4.3636	288	1.8071	0.3188	1.8071	1.3443
No log	4.3939	290	1.9144	0.2878	1.9144	1.3836
No log	4.4242	292	1.8202	0.3043	1.8202	1.3491
No log	4.4545	294	1.6701	0.3582	1.6701	1.2923
No log	4.4848	296	1.6361	0.3582	1.6361	1.2791
No log	4.5152	298	1.5927	0.3582	1.5927	1.2620
No log	4.5455	300	1.6373	0.3582	1.6373	1.2796
No log	4.5758	302	1.6281	0.3704	1.6281	1.2760
No log	4.6061	304	1.5555	0.3731	1.5555	1.2472
No log	4.6364	306	1.6266	0.3407	1.6266	1.2754
No log	4.6667	308	1.8861	0.3188	1.8861	1.3733
No log	4.6970	310	2.0843	0.2238	2.0843	1.4437
No log	4.7273	312	2.0698	0.2238	2.0698	1.4387
No log	4.7576	314	1.8468	0.3043	1.8468	1.3590
No log	4.7879	316	1.5401	0.4154	1.5401	1.2410
No log	4.8182	318	1.5080	0.4186	1.5080	1.2280
No log	4.8485	320	1.6551	0.3284	1.6551	1.2865
No log	4.8788	322	1.7568	0.3259	1.7568	1.3254
No log	4.9091	324	1.7780	0.3235	1.7780	1.3334
No log	4.9394	326	1.9830	0.2553	1.9830	1.4082
No log	4.9697	328	2.0009	0.2286	2.0009	1.4145
No log	5.0	330	1.8031	0.3043	1.8031	1.3428
No log	5.0303	332	1.5794	0.3759	1.5794	1.2567
No log	5.0606	334	1.5267	0.4275	1.5267	1.2356
No log	5.0909	336	1.6793	0.3433	1.6793	1.2959
No log	5.1212	338	1.9863	0.2143	1.9863	1.4094
No log	5.1515	340	2.4199	0.0972	2.4199	1.5556
No log	5.1818	342	2.6152	0.0423	2.6152	1.6171
No log	5.2121	344	2.5607	0.0423	2.5607	1.6002
No log	5.2424	346	2.3134	0.1702	2.3134	1.5210
No log	5.2727	348	1.9421	0.2774	1.9421	1.3936
No log	5.3030	350	1.6630	0.3910	1.6630	1.2896
No log	5.3333	352	1.6222	0.3939	1.6222	1.2737
No log	5.3636	354	1.7508	0.3407	1.7508	1.3232
No log	5.3939	356	1.9540	0.2143	1.9540	1.3979
No log	5.4242	358	1.9580	0.2143	1.9580	1.3993
No log	5.4545	360	1.9312	0.2319	1.9312	1.3897
No log	5.4848	362	1.8687	0.2794	1.8687	1.3670
No log	5.5152	364	1.7613	0.3259	1.7613	1.3271
No log	5.5455	366	1.6040	0.3817	1.6040	1.2665
No log	5.5758	368	1.5713	0.4341	1.5713	1.2535
No log	5.6061	370	1.5912	0.3910	1.5912	1.2614
No log	5.6364	372	1.6794	0.3582	1.6794	1.2959
No log	5.6667	374	1.6897	0.3582	1.6897	1.2999
No log	5.6970	376	1.6027	0.3910	1.6027	1.2660
No log	5.7273	378	1.4462	0.4286	1.4462	1.2026
No log	5.7576	380	1.4196	0.4390	1.4196	1.1915
No log	5.7879	382	1.4489	0.4390	1.4489	1.2037
No log	5.8182	384	1.5247	0.4567	1.5247	1.2348
No log	5.8485	386	1.5258	0.4567	1.5258	1.2352
No log	5.8788	388	1.4295	0.4567	1.4295	1.1956
No log	5.9091	390	1.2492	0.4800	1.2492	1.1177
No log	5.9394	392	1.1690	0.4839	1.1690	1.0812
No log	5.9697	394	1.2089	0.4882	1.2089	1.0995
No log	6.0	396	1.3919	0.4427	1.3919	1.1798
No log	6.0303	398	1.7106	0.3852	1.7106	1.3079
No log	6.0606	400	1.8499	0.2676	1.8499	1.3601
No log	6.0909	402	1.8823	0.2590	1.8823	1.3720
No log	6.1212	404	1.7265	0.3284	1.7265	1.3140
No log	6.1515	406	1.5837	0.4308	1.5837	1.2584
No log	6.1818	408	1.4884	0.4341	1.4884	1.2200
No log	6.2121	410	1.4904	0.4308	1.4904	1.2208
No log	6.2424	412	1.5321	0.4122	1.5321	1.2378
No log	6.2727	414	1.6131	0.3881	1.6131	1.2701
No log	6.3030	416	1.6890	0.3529	1.6890	1.2996
No log	6.3333	418	1.6802	0.3529	1.6802	1.2962
No log	6.3636	420	1.5378	0.4091	1.5378	1.2401
No log	6.3939	422	1.3782	0.4688	1.3782	1.1740
No log	6.4242	424	1.3181	0.4531	1.3181	1.1481
No log	6.4545	426	1.2373	0.4603	1.2373	1.1123
No log	6.4848	428	1.2502	0.4603	1.2502	1.1181
No log	6.5152	430	1.2847	0.4409	1.2847	1.1335
No log	6.5455	432	1.4139	0.4462	1.4139	1.1891
No log	6.5758	434	1.5411	0.4211	1.5411	1.2414
No log	6.6061	436	1.4751	0.4427	1.4751	1.2145
No log	6.6364	438	1.5092	0.4427	1.5092	1.2285
No log	6.6667	440	1.5574	0.4427	1.5574	1.2480
No log	6.6970	442	1.5809	0.3939	1.5809	1.2574
No log	6.7273	444	1.6091	0.3664	1.6091	1.2685
No log	6.7576	446	1.6168	0.3664	1.6168	1.2715
No log	6.7879	448	1.6170	0.3939	1.6170	1.2716
No log	6.8182	450	1.5286	0.4242	1.5286	1.2364
No log	6.8485	452	1.4927	0.4242	1.4927	1.2218
No log	6.8788	454	1.5656	0.4060	1.5656	1.2512
No log	6.9091	456	1.6789	0.3433	1.6789	1.2957
No log	6.9394	458	1.6497	0.3459	1.6497	1.2844
No log	6.9697	460	1.5338	0.4	1.5338	1.2385
No log	7.0	462	1.3880	0.4496	1.3880	1.1781
No log	7.0303	464	1.2312	0.4444	1.2312	1.1096
No log	7.0606	466	1.1467	0.4640	1.1467	1.0708
No log	7.0909	468	1.1254	0.4444	1.1254	1.0608
No log	7.1212	470	1.2335	0.4844	1.2335	1.1106
No log	7.1515	472	1.3270	0.4531	1.3270	1.1520
No log	7.1818	474	1.4251	0.4462	1.4251	1.1938
No log	7.2121	476	1.4088	0.4496	1.4088	1.1869
No log	7.2424	478	1.4188	0.4462	1.4188	1.1911
No log	7.2727	480	1.3854	0.4615	1.3854	1.1770
No log	7.3030	482	1.4324	0.4615	1.4324	1.1968
No log	7.3333	484	1.5602	0.4242	1.5602	1.2491
No log	7.3636	486	1.7010	0.3881	1.7010	1.3042
No log	7.3939	488	1.6883	0.4211	1.6883	1.2993
No log	7.4242	490	1.6211	0.4242	1.6211	1.2732
No log	7.4545	492	1.4931	0.4462	1.4931	1.2219
No log	7.4848	494	1.3806	0.4531	1.3806	1.1750
No log	7.5152	496	1.3005	0.4531	1.3005	1.1404
No log	7.5455	498	1.3290	0.4806	1.3290	1.1528
0.4424	7.5758	500	1.4855	0.4275	1.4855	1.2188
0.4424	7.6061	502	1.7570	0.2774	1.7570	1.3255
0.4424	7.6364	504	1.8744	0.2754	1.8744	1.3691
0.4424	7.6667	506	1.7754	0.2754	1.7754	1.3324
0.4424	7.6970	508	1.5303	0.4242	1.5303	1.2371
0.4424	7.7273	510	1.3370	0.4409	1.3370	1.1563
0.4424	7.7576	512	1.3183	0.4298	1.3183	1.1482
0.4424	7.7879	514	1.3350	0.4320	1.3350	1.1554
0.4424	7.8182	516	1.4535	0.4688	1.4535	1.2056
0.4424	7.8485	518	1.6714	0.3582	1.6714	1.2928
0.4424	7.8788	520	1.8174	0.3043	1.8174	1.3481
0.4424	7.9091	522	1.8982	0.2754	1.8982	1.3777
0.4424	7.9394	524	1.8205	0.2774	1.8205	1.3493
0.4424	7.9697	526	1.6186	0.3582	1.6186	1.2722

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1