ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k19_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5834
• Qwk: 0.3309
• Mse: 1.5834
• Rmse: 1.2583

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0241	2	6.6579	0.0	6.6579	2.5803
No log	0.0482	4	4.2049	0.0622	4.2049	2.0506
No log	0.0723	6	3.4309	0.0222	3.4309	1.8523
No log	0.0964	8	3.3559	0.0109	3.3559	1.8319
No log	0.1205	10	2.2843	0.1069	2.2843	1.5114
No log	0.1446	12	2.5376	0.0714	2.5376	1.5930
No log	0.1687	14	2.1416	0.1527	2.1416	1.4634
No log	0.1928	16	1.5958	0.1495	1.5958	1.2632
No log	0.2169	18	1.5327	0.2222	1.5327	1.2380
No log	0.2410	20	1.4944	0.2679	1.4944	1.2225
No log	0.2651	22	1.5921	0.3103	1.5921	1.2618
No log	0.2892	24	1.7660	0.3333	1.7660	1.3289
No log	0.3133	26	2.0071	0.2286	2.0071	1.4167
No log	0.3373	28	1.7205	0.3360	1.7205	1.3117
No log	0.3614	30	1.5631	0.3419	1.5631	1.2502
No log	0.3855	32	1.5312	0.3158	1.5312	1.2374
No log	0.4096	34	1.5871	0.3419	1.5871	1.2598
No log	0.4337	36	2.0028	0.2464	2.0028	1.4152
No log	0.4578	38	2.2681	0.125	2.2681	1.5060
No log	0.4819	40	1.9437	0.3182	1.9437	1.3941
No log	0.5060	42	1.6294	0.3529	1.6294	1.2765
No log	0.5301	44	1.6691	0.2243	1.6691	1.2919
No log	0.5542	46	1.6237	0.1538	1.6237	1.2742
No log	0.5783	48	1.3748	0.2056	1.3748	1.1725
No log	0.6024	50	1.2993	0.3333	1.2993	1.1399
No log	0.6265	52	2.4428	0.2682	2.4428	1.5629
No log	0.6506	54	3.2283	0.2294	3.2283	1.7968
No log	0.6747	56	2.6445	0.2116	2.6445	1.6262
No log	0.6988	58	1.7051	0.4062	1.7051	1.3058
No log	0.7229	60	1.4205	0.2523	1.4205	1.1919
No log	0.7470	62	1.4146	0.2075	1.4146	1.1894
No log	0.7711	64	1.3966	0.2222	1.3966	1.1818
No log	0.7952	66	1.3700	0.3276	1.3700	1.1705
No log	0.8193	68	1.3739	0.3559	1.3739	1.1721
No log	0.8434	70	1.2818	0.2832	1.2818	1.1322
No log	0.8675	72	1.6217	0.0741	1.6217	1.2735
No log	0.8916	74	1.8703	0.0182	1.8703	1.3676
No log	0.9157	76	1.7743	0.0755	1.7743	1.3320
No log	0.9398	78	1.4315	0.2222	1.4315	1.1965
No log	0.9639	80	1.3075	0.35	1.3075	1.1435
No log	0.9880	82	1.5708	0.3664	1.5708	1.2533
No log	1.0120	84	1.9923	0.3396	1.9923	1.4115
No log	1.0361	86	1.7947	0.3733	1.7947	1.3397
No log	1.0602	88	1.3575	0.3802	1.3575	1.1651
No log	1.0843	90	1.3946	0.2593	1.3946	1.1810
No log	1.1084	92	1.8113	0.1538	1.8113	1.3458
No log	1.1325	94	1.9978	-0.0345	1.9978	1.4134
No log	1.1566	96	1.9671	0.0	1.9671	1.4025
No log	1.1807	98	1.7968	0.1356	1.7968	1.3404
No log	1.2048	100	1.4054	0.4298	1.4054	1.1855
No log	1.2289	102	1.1932	0.4667	1.1932	1.0923
No log	1.2530	104	1.2691	0.3934	1.2691	1.1266
No log	1.2771	106	1.2415	0.3866	1.2415	1.1142
No log	1.3012	108	1.1738	0.4237	1.1738	1.0834
No log	1.3253	110	1.1392	0.4274	1.1392	1.0674
No log	1.3494	112	1.2315	0.5781	1.2315	1.1097
No log	1.3735	114	1.3008	0.4961	1.3008	1.1405
No log	1.3976	116	1.2570	0.4961	1.2570	1.1212
No log	1.4217	118	1.1902	0.5496	1.1902	1.0910
No log	1.4458	120	1.1399	0.5865	1.1399	1.0677
No log	1.4699	122	1.3313	0.4296	1.3313	1.1538
No log	1.4940	124	1.5305	0.3358	1.5305	1.2371
No log	1.5181	126	1.8558	0.2535	1.8558	1.3623
No log	1.5422	128	1.8260	0.2857	1.8260	1.3513
No log	1.5663	130	1.6602	0.2878	1.6602	1.2885
No log	1.5904	132	1.6481	0.3407	1.6481	1.2838
No log	1.6145	134	1.6306	0.3407	1.6306	1.2770
No log	1.6386	136	1.6625	0.3088	1.6625	1.2894
No log	1.6627	138	1.4705	0.4242	1.4705	1.2127
No log	1.6867	140	1.1758	0.5692	1.1758	1.0843
No log	1.7108	142	1.1903	0.5692	1.1903	1.0910
No log	1.7349	144	1.1152	0.6061	1.1152	1.0560
No log	1.7590	146	1.1138	0.5954	1.1138	1.0554
No log	1.7831	148	1.2043	0.5692	1.2043	1.0974
No log	1.8072	150	1.2925	0.4921	1.2925	1.1369
No log	1.8313	152	1.3278	0.4921	1.3278	1.1523
No log	1.8554	154	1.3189	0.4921	1.3189	1.1484
No log	1.8795	156	1.3292	0.4961	1.3292	1.1529
No log	1.9036	158	1.3479	0.4769	1.3479	1.1610
No log	1.9277	160	1.3680	0.4769	1.3680	1.1696
No log	1.9518	162	1.5174	0.3731	1.5174	1.2318
No log	1.9759	164	1.5201	0.4060	1.5201	1.2329
No log	2.0	166	1.2618	0.5455	1.2618	1.1233
No log	2.0241	168	1.1626	0.5714	1.1626	1.0782
No log	2.0482	170	1.0780	0.5426	1.0780	1.0383
No log	2.0723	172	1.0265	0.5440	1.0265	1.0132
No log	2.0964	174	1.0628	0.5625	1.0628	1.0309
No log	2.1205	176	1.0860	0.5692	1.0860	1.0421
No log	2.1446	178	1.0219	0.544	1.0219	1.0109
No log	2.1687	180	0.9793	0.6047	0.9793	0.9896
No log	2.1928	182	1.0492	0.5692	1.0492	1.0243
No log	2.2169	184	1.1502	0.5077	1.1502	1.0725
No log	2.2410	186	1.3168	0.4812	1.3168	1.1475
No log	2.2651	188	1.3835	0.4812	1.3835	1.1762
No log	2.2892	190	1.4059	0.4275	1.4059	1.1857
No log	2.3133	192	1.3127	0.4812	1.3127	1.1457
No log	2.3373	194	1.2092	0.5303	1.2092	1.0996
No log	2.3614	196	1.2304	0.5113	1.2304	1.1093
No log	2.3855	198	1.4722	0.4444	1.4722	1.2133
No log	2.4096	200	1.5387	0.3942	1.5387	1.2404
No log	2.4337	202	1.4294	0.4818	1.4294	1.1956
No log	2.4578	204	1.4175	0.4818	1.4175	1.1906
No log	2.4819	206	1.3061	0.5	1.3061	1.1428
No log	2.5060	208	1.3775	0.4928	1.3775	1.1737
No log	2.5301	210	1.5499	0.3885	1.5499	1.2449
No log	2.5542	212	1.8174	0.3143	1.8174	1.3481
No log	2.5783	214	1.8511	0.3143	1.8511	1.3606
No log	2.6024	216	1.6037	0.3676	1.6037	1.2664
No log	2.6265	218	1.2642	0.5038	1.2642	1.1244
No log	2.6506	220	1.1052	0.5397	1.1052	1.0513
No log	2.6747	222	1.1081	0.5692	1.1081	1.0526
No log	2.6988	224	1.2210	0.5113	1.2210	1.1050
No log	2.7229	226	1.3603	0.4234	1.3603	1.1663
No log	2.7470	228	1.5120	0.4058	1.5120	1.2296
No log	2.7711	230	1.5405	0.4058	1.5405	1.2412
No log	2.7952	232	1.2936	0.5113	1.2936	1.1374
No log	2.8193	234	1.1240	0.4590	1.1240	1.0602
No log	2.8434	236	1.1737	0.4538	1.1737	1.0834
No log	2.8675	238	1.2135	0.4132	1.2135	1.1016
No log	2.8916	240	1.2835	0.5426	1.2835	1.1329
No log	2.9157	242	1.4989	0.3796	1.4989	1.2243
No log	2.9398	244	1.6555	0.3333	1.6555	1.2866
No log	2.9639	246	1.6170	0.3768	1.6170	1.2716
No log	2.9880	248	1.4919	0.3796	1.4919	1.2214
No log	3.0120	250	1.4106	0.4776	1.4106	1.1877
No log	3.0361	252	1.4361	0.4394	1.4361	1.1984
No log	3.0602	254	1.6055	0.3358	1.6055	1.2671
No log	3.0843	256	1.6952	0.3165	1.6952	1.3020
No log	3.1084	258	1.5757	0.3529	1.5757	1.2553
No log	3.1325	260	1.4208	0.4559	1.4208	1.1920
No log	3.1566	262	1.4483	0.4148	1.4483	1.2034
No log	3.1807	264	1.6115	0.3852	1.6115	1.2694
No log	3.2048	266	1.7136	0.3382	1.7136	1.3090
No log	3.2289	268	1.6427	0.3852	1.6427	1.2817
No log	3.2530	270	1.4462	0.5152	1.4462	1.2026
No log	3.2771	272	1.2912	0.4961	1.2912	1.1363
No log	3.3012	274	1.3059	0.5455	1.3059	1.1427
No log	3.3253	276	1.4000	0.5152	1.4000	1.1832
No log	3.3494	278	1.4892	0.4148	1.4892	1.2203
No log	3.3735	280	1.4442	0.4412	1.4442	1.2017
No log	3.3976	282	1.5131	0.4348	1.5131	1.2301
No log	3.4217	284	1.6377	0.3286	1.6377	1.2797
No log	3.4458	286	1.7408	0.3121	1.7408	1.3194
No log	3.4699	288	1.7196	0.3121	1.7196	1.3113
No log	3.4940	290	1.6207	0.3571	1.6207	1.2731
No log	3.5181	292	1.4638	0.4853	1.4638	1.2099
No log	3.5422	294	1.5119	0.4234	1.5119	1.2296
No log	3.5663	296	1.6151	0.3478	1.6151	1.2709
No log	3.5904	298	1.6344	0.3478	1.6344	1.2784
No log	3.6145	300	1.6755	0.3478	1.6755	1.2944
No log	3.6386	302	1.5886	0.3478	1.5886	1.2604
No log	3.6627	304	1.5038	0.4662	1.5038	1.2263
No log	3.6867	306	1.5295	0.4662	1.5295	1.2367
No log	3.7108	308	1.5207	0.4627	1.5207	1.2332
No log	3.7349	310	1.4224	0.5152	1.4224	1.1926
No log	3.7590	312	1.3762	0.5455	1.3762	1.1731
No log	3.7831	314	1.4808	0.4380	1.4808	1.2169
No log	3.8072	316	1.5489	0.4088	1.5489	1.2446
No log	3.8313	318	1.5058	0.4460	1.5058	1.2271
No log	3.8554	320	1.5255	0.4348	1.5255	1.2351
No log	3.8795	322	1.6260	0.3309	1.6260	1.2752
No log	3.9036	324	1.6813	0.3143	1.6813	1.2966
No log	3.9277	326	1.6334	0.3571	1.6334	1.2781
No log	3.9518	328	1.4987	0.4173	1.4987	1.2242
No log	3.9759	330	1.2999	0.5	1.2999	1.1402
No log	4.0	332	1.2000	0.5	1.2000	1.0954
No log	4.0241	334	1.2281	0.5113	1.2281	1.1082
No log	4.0482	336	1.3907	0.4511	1.3907	1.1793
No log	4.0723	338	1.6459	0.3478	1.6459	1.2829
No log	4.0964	340	1.7071	0.3478	1.7071	1.3066
No log	4.1205	342	1.5692	0.3650	1.5692	1.2527
No log	4.1446	344	1.4498	0.3913	1.4498	1.2041
No log	4.1687	346	1.3198	0.4889	1.3198	1.1488
No log	4.1928	348	1.3048	0.4889	1.3048	1.1423
No log	4.2169	350	1.3841	0.4380	1.3841	1.1765
No log	4.2410	352	1.5903	0.3571	1.5903	1.2611
No log	4.2651	354	1.6675	0.3309	1.6675	1.2913
No log	4.2892	356	1.5843	0.3650	1.5843	1.2587
No log	4.3133	358	1.3783	0.4741	1.3783	1.1740
No log	4.3373	360	1.3537	0.4812	1.3537	1.1635
No log	4.3614	362	1.3899	0.4812	1.3899	1.1789
No log	4.3855	364	1.4681	0.4412	1.4681	1.2116
No log	4.4096	366	1.4373	0.4361	1.4373	1.1989
No log	4.4337	368	1.4672	0.4328	1.4672	1.2113
No log	4.4578	370	1.4389	0.4328	1.4389	1.1995
No log	4.4819	372	1.3714	0.4662	1.3714	1.1711
No log	4.5060	374	1.5227	0.3971	1.5227	1.2340
No log	4.5301	376	1.6314	0.3309	1.6314	1.2773
No log	4.5542	378	1.5661	0.4056	1.5661	1.2514
No log	4.5783	380	1.5887	0.4444	1.5887	1.2605
No log	4.6024	382	1.6874	0.3724	1.6874	1.2990
No log	4.6265	384	1.5263	0.4658	1.5263	1.2354
No log	4.6506	386	1.4518	0.4615	1.4518	1.2049
No log	4.6747	388	1.3573	0.4179	1.3573	1.1650
No log	4.6988	390	1.5502	0.3971	1.5502	1.2451
No log	4.7229	392	1.6669	0.3286	1.6669	1.2911
No log	4.7470	394	1.6172	0.3453	1.6172	1.2717
No log	4.7711	396	1.6515	0.3286	1.6515	1.2851
No log	4.7952	398	1.8491	0.2958	1.8491	1.3598
No log	4.8193	400	1.8401	0.2979	1.8401	1.3565
No log	4.8434	402	1.6536	0.2979	1.6536	1.2859
No log	4.8675	404	1.3930	0.4706	1.3930	1.1802
No log	4.8916	406	1.3402	0.4964	1.3402	1.1577
No log	4.9157	408	1.4203	0.4412	1.4203	1.1918
No log	4.9398	410	1.5794	0.3429	1.5794	1.2568
No log	4.9639	412	1.5484	0.3913	1.5484	1.2443
No log	4.9880	414	1.3696	0.4559	1.3696	1.1703
No log	5.0120	416	1.2206	0.5714	1.2206	1.1048
No log	5.0361	418	1.1792	0.544	1.1792	1.0859
No log	5.0602	420	1.2636	0.5414	1.2636	1.1241
No log	5.0843	422	1.5074	0.4286	1.5074	1.2277
No log	5.1084	424	1.7971	0.3448	1.7971	1.3406
No log	5.1325	426	1.8144	0.3472	1.8144	1.3470
No log	5.1566	428	1.8254	0.3472	1.8254	1.3511
No log	5.1807	430	1.5810	0.3803	1.5810	1.2574
No log	5.2048	432	1.3119	0.4783	1.3119	1.1454
No log	5.2289	434	1.1755	0.5231	1.1755	1.0842
No log	5.2530	436	1.2083	0.5231	1.2083	1.0992
No log	5.2771	438	1.3721	0.4559	1.3721	1.1713
No log	5.3012	440	1.5764	0.3913	1.5764	1.2556
No log	5.3253	442	1.6486	0.3478	1.6486	1.2840
No log	5.3494	444	1.6652	0.3309	1.6652	1.2904
No log	5.3735	446	1.5535	0.4234	1.5535	1.2464
No log	5.3976	448	1.4633	0.4234	1.4633	1.2097
No log	5.4217	450	1.3222	0.5147	1.3222	1.1499
No log	5.4458	452	1.2127	0.5224	1.2127	1.1012
No log	5.4699	454	1.2413	0.5185	1.2413	1.1141
No log	5.4940	456	1.4602	0.4234	1.4602	1.2084
No log	5.5181	458	1.5912	0.3913	1.5912	1.2614
No log	5.5422	460	1.6539	0.3741	1.6539	1.2860
No log	5.5663	462	1.6071	0.3913	1.6071	1.2677
No log	5.5904	464	1.4942	0.4088	1.4942	1.2224
No log	5.6145	466	1.3149	0.5373	1.3149	1.1467
No log	5.6386	468	1.1900	0.5344	1.1900	1.0909
No log	5.6627	470	1.1979	0.5373	1.1979	1.0945
No log	5.6867	472	1.3890	0.4964	1.3890	1.1786
No log	5.7108	474	1.8691	0.2553	1.8691	1.3671
No log	5.7349	476	2.1816	0.2098	2.1816	1.4770
No log	5.7590	478	2.1926	0.1806	2.1926	1.4807
No log	5.7831	480	1.9496	0.2817	1.9496	1.3963
No log	5.8072	482	1.6523	0.3404	1.6523	1.2854
No log	5.8313	484	1.5299	0.4444	1.5299	1.2369
No log	5.8554	486	1.5485	0.4627	1.5485	1.2444
No log	5.8795	488	1.6616	0.3333	1.6616	1.2890
No log	5.9036	490	1.6398	0.3504	1.6398	1.2805
No log	5.9277	492	1.6238	0.4	1.6238	1.2743
No log	5.9518	494	1.6240	0.4	1.6240	1.2744
No log	5.9759	496	1.6155	0.3824	1.6155	1.2710
No log	6.0	498	1.5661	0.4179	1.5661	1.2514
0.5112	6.0241	500	1.6055	0.3650	1.6055	1.2671
0.5112	6.0482	502	1.7201	0.3165	1.7201	1.3115
0.5112	6.0723	504	1.6569	0.3478	1.6569	1.2872
0.5112	6.0964	506	1.4830	0.4545	1.4830	1.2178
0.5112	6.1205	508	1.4167	0.4961	1.4167	1.1903
0.5112	6.1446	510	1.3248	0.5231	1.3248	1.1510
0.5112	6.1687	512	1.3228	0.5231	1.3228	1.1501
0.5112	6.1928	514	1.5107	0.4179	1.5107	1.2291
0.5112	6.2169	516	1.6032	0.3824	1.6032	1.2662
0.5112	6.2410	518	1.5818	0.3824	1.5818	1.2577
0.5112	6.2651	520	1.6279	0.3478	1.6279	1.2759
0.5112	6.2892	522	1.5303	0.3650	1.5303	1.2371
0.5112	6.3133	524	1.4765	0.3824	1.4765	1.2151
0.5112	6.3373	526	1.4621	0.4265	1.4621	1.2092
0.5112	6.3614	528	1.3750	0.4697	1.3750	1.1726
0.5112	6.3855	530	1.4328	0.4328	1.4328	1.1970
0.5112	6.4096	532	1.5939	0.3741	1.5939	1.2625
0.5112	6.4337	534	1.7261	0.3143	1.7261	1.3138
0.5112	6.4578	536	1.7819	0.2979	1.7819	1.3349
0.5112	6.4819	538	1.6399	0.3143	1.6399	1.2806
0.5112	6.5060	540	1.4563	0.4328	1.4563	1.2068
0.5112	6.5301	542	1.4378	0.4444	1.4378	1.1991
0.5112	6.5542	544	1.5453	0.4265	1.5453	1.2431
0.5112	6.5783	546	1.5279	0.4265	1.5279	1.2361
0.5112	6.6024	548	1.4094	0.4697	1.4094	1.1872
0.5112	6.6265	550	1.4428	0.4697	1.4428	1.2012
0.5112	6.6506	552	1.4501	0.4328	1.4502	1.2042
0.5112	6.6747	554	1.4218	0.4662	1.4218	1.1924
0.5112	6.6988	556	1.4793	0.4088	1.4793	1.2162
0.5112	6.7229	558	1.6095	0.3714	1.6095	1.2687
0.5112	6.7470	560	1.5956	0.3714	1.5956	1.2632
0.5112	6.7711	562	1.5927	0.3714	1.5927	1.2620
0.5112	6.7952	564	1.5955	0.3714	1.5955	1.2631
0.5112	6.8193	566	1.6672	0.3143	1.6672	1.2912
0.5112	6.8434	568	1.7322	0.3143	1.7322	1.3161
0.5112	6.8675	570	1.6238	0.3796	1.6238	1.2743
0.5112	6.8916	572	1.5751	0.4060	1.5751	1.2550
0.5112	6.9157	574	1.5329	0.4122	1.5329	1.2381
0.5112	6.9398	576	1.5407	0.3969	1.5407	1.2413
0.5112	6.9639	578	1.6240	0.3676	1.6240	1.2743
0.5112	6.9880	580	1.7680	0.3143	1.7680	1.3297
0.5112	7.0120	582	1.9233	0.2837	1.9233	1.3868
0.5112	7.0361	584	1.8996	0.3143	1.8996	1.3783
0.5112	7.0602	586	1.8506	0.3143	1.8506	1.3604
0.5112	7.0843	588	1.6204	0.3885	1.6204	1.2729
0.5112	7.1084	590	1.4472	0.4672	1.4472	1.2030
0.5112	7.1325	592	1.4702	0.4088	1.4702	1.2125
0.5112	7.1566	594	1.6311	0.4058	1.6311	1.2772
0.5112	7.1807	596	1.8587	0.2837	1.8587	1.3633
0.5112	7.2048	598	1.8910	0.2837	1.8910	1.3751
0.5112	7.2289	600	1.8105	0.3309	1.8105	1.3456
0.5112	7.2530	602	1.6271	0.3478	1.6271	1.2756
0.5112	7.2771	604	1.5492	0.4593	1.5492	1.2446
0.5112	7.3012	606	1.3940	0.5303	1.3940	1.1807
0.5112	7.3253	608	1.3428	0.5231	1.3428	1.1588
0.5112	7.3494	610	1.3024	0.5039	1.3024	1.1412
0.5112	7.3735	612	1.3517	0.5231	1.3517	1.1626
0.5112	7.3976	614	1.5108	0.4328	1.5108	1.2291
0.5112	7.4217	616	1.6764	0.3309	1.6764	1.2948
0.5112	7.4458	618	1.7322	0.3309	1.7322	1.3161
0.5112	7.4699	620	1.6437	0.3478	1.6437	1.2821
0.5112	7.4940	622	1.4948	0.4733	1.4948	1.2226
0.5112	7.5181	624	1.4268	0.4688	1.4268	1.1945
0.5112	7.5422	626	1.4102	0.4688	1.4102	1.1875
0.5112	7.5663	628	1.4997	0.3852	1.4997	1.2246
0.5112	7.5904	630	1.6127	0.3478	1.6127	1.2699
0.5112	7.6145	632	1.6412	0.3309	1.6412	1.2811
0.5112	7.6386	634	1.6992	0.3143	1.6992	1.3035
0.5112	7.6627	636	1.6726	0.3143	1.6726	1.2933
0.5112	7.6867	638	1.5834	0.3309	1.5834	1.2583

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1