ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k7_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7571
• Qwk: 0.3731
• Mse: 1.7571
• Rmse: 1.3255

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0606	2	6.8275	0.0242	6.8275	2.6130
No log	0.1212	4	4.6312	0.0866	4.6312	2.1520
No log	0.1818	6	3.5539	0.0	3.5539	1.8852
No log	0.2424	8	3.0837	0.0	3.0837	1.7560
No log	0.3030	10	2.1288	0.0960	2.1288	1.4590
No log	0.3636	12	2.0210	0.2087	2.0210	1.4216
No log	0.4242	14	2.3356	0.0462	2.3356	1.5283
No log	0.4848	16	2.1487	0.0640	2.1487	1.4658
No log	0.5455	18	1.7547	0.1947	1.7547	1.3247
No log	0.6061	20	1.6610	0.1887	1.6610	1.2888
No log	0.6667	22	1.7238	0.1524	1.7238	1.3130
No log	0.7273	24	1.8439	0.2321	1.8439	1.3579
No log	0.7879	26	1.9704	0.3306	1.9704	1.4037
No log	0.8485	28	2.4416	0.0138	2.4416	1.5626
No log	0.9091	30	2.6524	0.0	2.6524	1.6286
No log	0.9697	32	2.4179	0.0140	2.4179	1.5550
No log	1.0303	34	1.7836	0.3548	1.7836	1.3355
No log	1.0909	36	1.4751	0.3304	1.4751	1.2145
No log	1.1515	38	1.2894	0.3652	1.2894	1.1355
No log	1.2121	40	1.1324	0.5041	1.1324	1.0641
No log	1.2727	42	1.0668	0.5512	1.0668	1.0329
No log	1.3333	44	1.1476	0.5469	1.1476	1.0713
No log	1.3939	46	1.5649	0.2880	1.5649	1.2510
No log	1.4545	48	1.7394	0.2439	1.7394	1.3189
No log	1.5152	50	1.4154	0.4409	1.4154	1.1897
No log	1.5758	52	1.4471	0.4818	1.4471	1.2030
No log	1.6364	54	1.5003	0.4662	1.5003	1.2249
No log	1.6970	56	1.3829	0.4545	1.3829	1.1760
No log	1.7576	58	1.4116	0.4167	1.4116	1.1881
No log	1.8182	60	1.7058	0.2407	1.7058	1.3061
No log	1.8788	62	1.7520	0.1524	1.7520	1.3236
No log	1.9394	64	1.5193	0.2222	1.5193	1.2326
No log	2.0	66	1.4121	0.2857	1.4121	1.1883
No log	2.0606	68	1.3249	0.3186	1.3249	1.1511
No log	2.1212	70	1.2105	0.4174	1.2105	1.1002
No log	2.1818	72	1.2499	0.4915	1.2499	1.1180
No log	2.2424	74	1.3577	0.4370	1.3577	1.1652
No log	2.3030	76	1.6052	0.3248	1.6052	1.2669
No log	2.3636	78	1.5828	0.3193	1.5828	1.2581
No log	2.4242	80	1.4150	0.4921	1.4150	1.1895
No log	2.4848	82	1.5254	0.4034	1.5254	1.2351
No log	2.5455	84	1.4822	0.48	1.4822	1.2175
No log	2.6061	86	1.1506	0.5385	1.1506	1.0727
No log	2.6667	88	0.9634	0.6202	0.9634	0.9815
No log	2.7273	90	1.0094	0.5984	1.0094	1.0047
No log	2.7879	92	1.0596	0.6154	1.0596	1.0294
No log	2.8485	94	1.0357	0.6061	1.0357	1.0177
No log	2.9091	96	1.1590	0.5735	1.1590	1.0766
No log	2.9697	98	1.3688	0.4526	1.3688	1.1699
No log	3.0303	100	1.3424	0.4748	1.3424	1.1586
No log	3.0909	102	1.1312	0.5401	1.1312	1.0636
No log	3.1515	104	1.1496	0.5401	1.1496	1.0722
No log	3.2121	106	1.2809	0.5401	1.2809	1.1318
No log	3.2727	108	1.2020	0.5224	1.2020	1.0963
No log	3.3333	110	1.1094	0.5538	1.1094	1.0533
No log	3.3939	112	1.0991	0.5538	1.0991	1.0484
No log	3.4545	114	1.1033	0.5538	1.1033	1.0504
No log	3.5152	116	1.1125	0.5606	1.1125	1.0547
No log	3.5758	118	1.2655	0.5224	1.2655	1.1250
No log	3.6364	120	1.4027	0.4741	1.4027	1.1843
No log	3.6970	122	1.2890	0.5185	1.2890	1.1353
No log	3.7576	124	1.1167	0.5455	1.1167	1.0567
No log	3.8182	126	1.1081	0.5455	1.1081	1.0527
No log	3.8788	128	1.0803	0.6212	1.0803	1.0394
No log	3.9394	130	1.0899	0.512	1.0899	1.0440
No log	4.0	132	1.1059	0.512	1.1059	1.0516
No log	4.0606	134	1.1115	0.5669	1.1115	1.0543
No log	4.1212	136	1.2080	0.5	1.2080	1.0991
No log	4.1818	138	1.1665	0.5	1.1665	1.0800
No log	4.2424	140	1.1087	0.5354	1.1087	1.0529
No log	4.3030	142	1.1238	0.5469	1.1238	1.0601
No log	4.3636	144	1.2229	0.5	1.2229	1.1059
No log	4.4242	146	1.3304	0.4844	1.3304	1.1534
No log	4.4848	148	1.2860	0.4844	1.2860	1.1340
No log	4.5455	150	1.2084	0.5116	1.2084	1.0993
No log	4.6061	152	1.3287	0.5231	1.3287	1.1527
No log	4.6667	154	1.5127	0.4030	1.5127	1.2299
No log	4.7273	156	1.5572	0.3731	1.5572	1.2479
No log	4.7879	158	1.3499	0.5185	1.3499	1.1618
No log	4.8485	160	1.1792	0.5606	1.1792	1.0859
No log	4.9091	162	1.1326	0.5865	1.1326	1.0642
No log	4.9697	164	1.2562	0.4889	1.2562	1.1208
No log	5.0303	166	1.2853	0.5	1.2853	1.1337
No log	5.0909	168	1.3700	0.4444	1.3700	1.1705
No log	5.1515	170	1.1835	0.5385	1.1835	1.0879
No log	5.2121	172	1.0116	0.5781	1.0116	1.0058
No log	5.2727	174	0.9402	0.6032	0.9402	0.9697
No log	5.3333	176	0.9537	0.5600	0.9537	0.9766
No log	5.3939	178	1.0133	0.5625	1.0133	1.0066
No log	5.4545	180	1.2578	0.5116	1.2578	1.1215
No log	5.5152	182	1.4776	0.4242	1.4776	1.2156
No log	5.5758	184	1.5969	0.3759	1.5969	1.2637
No log	5.6364	186	1.4635	0.4308	1.4635	1.2097
No log	5.6970	188	1.2364	0.4480	1.2364	1.1119
No log	5.7576	190	1.1404	0.4706	1.1404	1.0679
No log	5.8182	192	1.1022	0.4833	1.1022	1.0499
No log	5.8788	194	1.0858	0.4878	1.0858	1.0420
No log	5.9394	196	1.2935	0.4885	1.2935	1.1373
No log	6.0	198	1.7412	0.3235	1.7412	1.3196
No log	6.0606	200	1.8964	0.2113	1.8964	1.3771
No log	6.1212	202	1.6860	0.3504	1.6860	1.2985
No log	6.1818	204	1.3577	0.5075	1.3577	1.1652
No log	6.2424	206	1.3114	0.5075	1.3114	1.1452
No log	6.3030	208	1.3525	0.4697	1.3525	1.1630
No log	6.3636	210	1.4347	0.4122	1.4347	1.1978
No log	6.4242	212	1.4289	0.4341	1.4289	1.1953
No log	6.4848	214	1.4660	0.4341	1.4660	1.2108
No log	6.5455	216	1.3916	0.4320	1.3916	1.1797
No log	6.6061	218	1.2857	0.4320	1.2857	1.1339
No log	6.6667	220	1.2769	0.4724	1.2769	1.1300
No log	6.7273	222	1.3629	0.4769	1.3629	1.1674
No log	6.7879	224	1.6308	0.3284	1.6308	1.2770
No log	6.8485	226	1.9476	0.2519	1.9476	1.3955
No log	6.9091	228	1.9369	0.2446	1.9369	1.3917
No log	6.9697	230	1.6308	0.3676	1.6308	1.2770
No log	7.0303	232	1.3084	0.4662	1.3084	1.1439
No log	7.0909	234	1.0378	0.5312	1.0378	1.0187
No log	7.1515	236	1.0273	0.5312	1.0273	1.0135
No log	7.2121	238	1.2458	0.5113	1.2458	1.1162
No log	7.2727	240	1.6485	0.3852	1.6485	1.2839
No log	7.3333	242	2.0489	0.3000	2.0489	1.4314
No log	7.3939	244	2.2165	0.1818	2.2165	1.4888
No log	7.4545	246	2.0735	0.2174	2.0735	1.4399
No log	7.5152	248	1.7588	0.3358	1.7588	1.3262
No log	7.5758	250	1.4931	0.3910	1.4931	1.2219
No log	7.6364	252	1.3587	0.4275	1.3587	1.1657
No log	7.6970	254	1.3583	0.4242	1.3583	1.1655
No log	7.7576	256	1.4649	0.3881	1.4649	1.2103
No log	7.8182	258	1.4550	0.4242	1.4550	1.2062
No log	7.8788	260	1.4777	0.4308	1.4777	1.2156
No log	7.9394	262	1.3961	0.4094	1.3961	1.1816
No log	8.0	264	1.4020	0.4160	1.4020	1.1841
No log	8.0606	266	1.4136	0.4590	1.4136	1.1890
No log	8.1212	268	1.4067	0.4	1.4067	1.1861
No log	8.1818	270	1.4187	0.4068	1.4187	1.1911
No log	8.2424	272	1.5092	0.4094	1.5092	1.2285
No log	8.3030	274	1.6635	0.3485	1.6635	1.2898
No log	8.3636	276	1.7436	0.2941	1.7436	1.3204
No log	8.4242	278	1.6322	0.3731	1.6322	1.2776
No log	8.4848	280	1.4334	0.384	1.4334	1.1973
No log	8.5455	282	1.3315	0.3802	1.3315	1.1539
No log	8.6061	284	1.3100	0.4390	1.3100	1.1446
No log	8.6667	286	1.3817	0.4567	1.3817	1.1755
No log	8.7273	288	1.5226	0.4122	1.5226	1.2339
No log	8.7879	290	1.8188	0.3546	1.8188	1.3486
No log	8.8485	292	1.9735	0.2897	1.9735	1.4048
No log	8.9091	294	1.8675	0.3546	1.8675	1.3666
No log	8.9697	296	1.4905	0.4380	1.4905	1.2208
No log	9.0303	298	1.1888	0.5152	1.1888	1.0903
No log	9.0909	300	1.1405	0.5385	1.1405	1.0680
No log	9.1515	302	1.2104	0.5385	1.2104	1.1002
No log	9.2121	304	1.3480	0.5116	1.3480	1.1610
No log	9.2727	306	1.5186	0.4394	1.5186	1.2323
No log	9.3333	308	1.6037	0.4361	1.6037	1.2664
No log	9.3939	310	1.5918	0.4361	1.5918	1.2617
No log	9.4545	312	1.4495	0.4427	1.4495	1.2039
No log	9.5152	314	1.2635	0.4961	1.2635	1.1240
No log	9.5758	316	1.2033	0.4961	1.2033	1.0970
No log	9.6364	318	1.2717	0.5077	1.2717	1.1277
No log	9.6970	320	1.3809	0.4427	1.3809	1.1751
No log	9.7576	322	1.3961	0.4427	1.3961	1.1816
No log	9.8182	324	1.5120	0.4361	1.5120	1.2296
No log	9.8788	326	1.5486	0.4361	1.5486	1.2444
No log	9.9394	328	1.4542	0.4394	1.4542	1.2059
No log	10.0	330	1.3121	0.4531	1.3121	1.1455
No log	10.0606	332	1.1749	0.4878	1.1749	1.0839
No log	10.1212	334	1.1176	0.5082	1.1176	1.0572
No log	10.1818	336	1.1140	0.5082	1.1140	1.0555
No log	10.2424	338	1.1235	0.5203	1.1235	1.0599
No log	10.3030	340	1.1602	0.4426	1.1602	1.0771
No log	10.3636	342	1.2158	0.4355	1.2158	1.1026
No log	10.4242	344	1.2958	0.4567	1.2958	1.1383
No log	10.4848	346	1.3553	0.4615	1.3553	1.1642
No log	10.5455	348	1.3374	0.4651	1.3374	1.1565
No log	10.6061	350	1.2152	0.4724	1.2152	1.1024
No log	10.6667	352	1.1650	0.4567	1.1650	1.0793
No log	10.7273	354	1.2541	0.4844	1.2541	1.1199
No log	10.7879	356	1.4728	0.4122	1.4728	1.2136
No log	10.8485	358	1.6620	0.3881	1.6620	1.2892
No log	10.9091	360	1.7583	0.3852	1.7583	1.3260
No log	10.9697	362	1.7358	0.3881	1.7358	1.3175
No log	11.0303	364	1.6965	0.3881	1.6965	1.3025
No log	11.0909	366	1.5727	0.3910	1.5727	1.2541
No log	11.1515	368	1.4506	0.4252	1.4506	1.2044
No log	11.2121	370	1.4317	0.4320	1.4317	1.1965
No log	11.2727	372	1.5318	0.4409	1.5318	1.2377
No log	11.3333	374	1.5662	0.4308	1.5662	1.2515
No log	11.3939	376	1.5186	0.4531	1.5186	1.2323
No log	11.4545	378	1.3931	0.4320	1.3931	1.1803
No log	11.5152	380	1.2821	0.4640	1.2821	1.1323
No log	11.5758	382	1.2730	0.4724	1.2730	1.1283
No log	11.6364	384	1.3911	0.4275	1.3911	1.1795
No log	11.6970	386	1.4885	0.4060	1.4885	1.2200
No log	11.7576	388	1.5425	0.3788	1.5425	1.2420
No log	11.8182	390	1.4977	0.4	1.4977	1.2238
No log	11.8788	392	1.4490	0.375	1.4490	1.2037
No log	11.9394	394	1.5200	0.3622	1.5200	1.2329
No log	12.0	396	1.7108	0.3731	1.7108	1.3080
No log	12.0606	398	1.8551	0.2899	1.8551	1.3620
No log	12.1212	400	1.8453	0.3333	1.8453	1.3584
No log	12.1818	402	1.7300	0.3382	1.7300	1.3153
No log	12.2424	404	1.5580	0.3465	1.5580	1.2482
No log	12.3030	406	1.4849	0.4127	1.4849	1.2186
No log	12.3636	408	1.5137	0.4065	1.5137	1.2303
No log	12.4242	410	1.5429	0.4065	1.5429	1.2421
No log	12.4848	412	1.5444	0.4065	1.5444	1.2427
No log	12.5455	414	1.5249	0.3871	1.5249	1.2349
No log	12.6061	416	1.5704	0.4286	1.5704	1.2532
No log	12.6667	418	1.6953	0.4060	1.6953	1.3020
No log	12.7273	420	1.7348	0.3852	1.7348	1.3171
No log	12.7879	422	1.7255	0.3881	1.7255	1.3136
No log	12.8485	424	1.6392	0.4091	1.6392	1.2803
No log	12.9091	426	1.5236	0.4	1.5236	1.2343
No log	12.9697	428	1.4196	0.3934	1.4196	1.1915
No log	13.0303	430	1.3344	0.4228	1.3344	1.1552
No log	13.0909	432	1.2769	0.4262	1.2769	1.1300
No log	13.1515	434	1.2528	0.4603	1.2528	1.1193
No log	13.2121	436	1.2921	0.4444	1.2921	1.1367
No log	13.2727	438	1.4120	0.4286	1.4120	1.1883
No log	13.3333	440	1.6255	0.3881	1.6255	1.2750
No log	13.3939	442	1.7708	0.3382	1.7708	1.3307
No log	13.4545	444	1.7958	0.3382	1.7958	1.3401
No log	13.5152	446	1.6653	0.3881	1.6653	1.2905
No log	13.5758	448	1.4344	0.4651	1.4344	1.1977
No log	13.6364	450	1.2971	0.4921	1.2971	1.1389
No log	13.6970	452	1.2667	0.5039	1.2667	1.1255
No log	13.7576	454	1.2593	0.5	1.2593	1.1222
No log	13.8182	456	1.3158	0.4921	1.3158	1.1471
No log	13.8788	458	1.3942	0.4839	1.3942	1.1808
No log	13.9394	460	1.4231	0.4882	1.4231	1.1929
No log	14.0	462	1.4857	0.4651	1.4857	1.2189
No log	14.0606	464	1.4735	0.4375	1.4735	1.2139
No log	14.1212	466	1.3647	0.4882	1.3647	1.1682
No log	14.1818	468	1.2565	0.5039	1.2565	1.1209
No log	14.2424	470	1.2836	0.4961	1.2836	1.1330
No log	14.3030	472	1.3920	0.4733	1.3920	1.1798
No log	14.3636	474	1.5837	0.3731	1.5837	1.2585
No log	14.4242	476	1.6652	0.3704	1.6652	1.2904
No log	14.4848	478	1.6107	0.3731	1.6107	1.2691
No log	14.5455	480	1.6641	0.3731	1.6641	1.2900
No log	14.6061	482	1.7273	0.3731	1.7273	1.3143
No log	14.6667	484	1.7127	0.3385	1.7127	1.3087
No log	14.7273	486	1.7056	0.3622	1.7056	1.3060
No log	14.7879	488	1.6742	0.4320	1.6742	1.2939
No log	14.8485	490	1.6438	0.4032	1.6438	1.2821
No log	14.9091	492	1.6588	0.4320	1.6588	1.2880
No log	14.9697	494	1.6396	0.4127	1.6396	1.2805
No log	15.0303	496	1.5971	0.3937	1.5971	1.2638
No log	15.0909	498	1.5935	0.4031	1.5935	1.2623
0.3713	15.1515	500	1.6218	0.3759	1.6218	1.2735
0.3713	15.2121	502	1.6407	0.3852	1.6407	1.2809
0.3713	15.2727	504	1.5497	0.4091	1.5497	1.2449
0.3713	15.3333	506	1.4625	0.4219	1.4625	1.2094
0.3713	15.3939	508	1.4800	0.4186	1.4800	1.2166
0.3713	15.4545	510	1.4807	0.4186	1.4807	1.2168
0.3713	15.5152	512	1.4121	0.4640	1.4121	1.1883
0.3713	15.5758	514	1.3944	0.4516	1.3944	1.1808
0.3713	15.6364	516	1.4409	0.4516	1.4409	1.2004
0.3713	15.6970	518	1.4692	0.4640	1.4692	1.2121
0.3713	15.7576	520	1.4643	0.4921	1.4643	1.2101
0.3713	15.8182	522	1.5061	0.4219	1.5061	1.2272
0.3713	15.8788	524	1.5203	0.4122	1.5203	1.2330
0.3713	15.9394	526	1.4846	0.4496	1.4846	1.2184
0.3713	16.0	528	1.4566	0.4496	1.4566	1.2069
0.3713	16.0606	530	1.5097	0.4580	1.5097	1.2287
0.3713	16.1212	532	1.5193	0.4361	1.5193	1.2326
0.3713	16.1818	534	1.4574	0.4496	1.4574	1.2072
0.3713	16.2424	536	1.3665	0.4724	1.3665	1.1690
0.3713	16.3030	538	1.2936	0.4194	1.2936	1.1374
0.3713	16.3636	540	1.3142	0.4	1.3142	1.1464
0.3713	16.4242	542	1.3545	0.4	1.3545	1.1638
0.3713	16.4848	544	1.4266	0.3833	1.4266	1.1944
0.3713	16.5455	546	1.5172	0.3220	1.5172	1.2317
0.3713	16.6061	548	1.6825	0.3252	1.6825	1.2971
0.3713	16.6667	550	1.7378	0.2835	1.7378	1.3183
0.3713	16.7273	552	1.6907	0.3231	1.6907	1.3003
0.3713	16.7879	554	1.5797	0.4341	1.5797	1.2568
0.3713	16.8485	556	1.5210	0.4252	1.5210	1.2333
0.3713	16.9091	558	1.5074	0.4127	1.5074	1.2277
0.3713	16.9697	560	1.5443	0.4252	1.5443	1.2427
0.3713	17.0303	562	1.5547	0.4252	1.5547	1.2469
0.3713	17.0909	564	1.5096	0.4127	1.5096	1.2287
0.3713	17.1515	566	1.4874	0.4127	1.4874	1.2196
0.3713	17.2121	568	1.4753	0.4252	1.4753	1.2146
0.3713	17.2727	570	1.5692	0.3788	1.5692	1.2527
0.3713	17.3333	572	1.7961	0.3504	1.7961	1.3402
0.3713	17.3939	574	1.9095	0.3333	1.9095	1.3818
0.3713	17.4545	576	1.8836	0.3333	1.8836	1.3724
0.3713	17.5152	578	1.7960	0.3881	1.7960	1.3401
0.3713	17.5758	580	1.6768	0.3910	1.6768	1.2949
0.3713	17.6364	582	1.6124	0.3692	1.6124	1.2698
0.3713	17.6970	584	1.5521	0.4094	1.5521	1.2458
0.3713	17.7576	586	1.5213	0.4094	1.5213	1.2334
0.3713	17.8182	588	1.4883	0.4094	1.4883	1.2200
0.3713	17.8788	590	1.5506	0.3788	1.5506	1.2452
0.3713	17.9394	592	1.7571	0.3529	1.7571	1.3256
0.3713	18.0	594	1.9686	0.3000	1.9686	1.4031
0.3713	18.0606	596	2.0330	0.3288	2.0330	1.4258
0.3713	18.1212	598	1.8953	0.3611	1.8953	1.3767
0.3713	18.1818	600	1.7571	0.3731	1.7571	1.3255

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1