ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6361
• Qwk: 0.3939
• Mse: 1.6361
• Rmse: 1.2791

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0235	2	6.8479	0.0242	6.8479	2.6168
No log	0.0471	4	4.5858	0.0706	4.5858	2.1414
No log	0.0706	6	3.7100	-0.0505	3.7100	1.9261
No log	0.0941	8	4.5033	-0.0721	4.5033	2.1221
No log	0.1176	10	3.0530	0.0256	3.0530	1.7473
No log	0.1412	12	2.4897	0.0	2.4897	1.5779
No log	0.1647	14	2.0971	0.1832	2.0971	1.4481
No log	0.1882	16	2.3592	-0.1037	2.3592	1.5360
No log	0.2118	18	2.6065	-0.0719	2.6065	1.6145
No log	0.2353	20	2.2359	-0.0150	2.2359	1.4953
No log	0.2588	22	1.5890	0.1346	1.5890	1.2606
No log	0.2824	24	1.7186	0.1143	1.7186	1.3109
No log	0.3059	26	1.6866	0.1346	1.6866	1.2987
No log	0.3294	28	1.7535	0.1651	1.7535	1.3242
No log	0.3529	30	2.4058	0.0276	2.4058	1.5511
No log	0.3765	32	3.1896	0.0833	3.1896	1.7860
No log	0.4	34	3.1297	0.0838	3.1297	1.7691
No log	0.4235	36	2.5778	0.0921	2.5778	1.6055
No log	0.4471	38	2.0512	0.1860	2.0512	1.4322
No log	0.4706	40	1.9018	0.2373	1.9018	1.3791
No log	0.4941	42	1.7715	0.1770	1.7715	1.3310
No log	0.5176	44	1.6178	0.2143	1.6178	1.2719
No log	0.5412	46	1.5219	0.2034	1.5219	1.2336
No log	0.5647	48	1.6810	0.3857	1.6810	1.2965
No log	0.5882	50	1.7663	0.4267	1.7663	1.3290
No log	0.6118	52	1.6525	0.4342	1.6525	1.2855
No log	0.6353	54	1.3573	0.4593	1.3573	1.1650
No log	0.6588	56	1.2295	0.5231	1.2295	1.1088
No log	0.6824	58	1.1951	0.5496	1.1951	1.0932
No log	0.7059	60	1.2749	0.4531	1.2749	1.1291
No log	0.7294	62	1.5590	0.3306	1.5590	1.2486
No log	0.7529	64	1.6407	0.2881	1.6407	1.2809
No log	0.7765	66	1.3444	0.4262	1.3444	1.1595
No log	0.8	68	1.0956	0.5224	1.0956	1.0467
No log	0.8235	70	1.1375	0.5606	1.1375	1.0666
No log	0.8471	72	1.1505	0.5303	1.1505	1.0726
No log	0.8706	74	1.2110	0.4545	1.2110	1.1004
No log	0.8941	76	1.4100	0.3876	1.4100	1.1875
No log	0.9176	78	1.4249	0.3817	1.4249	1.1937
No log	0.9412	80	1.4373	0.3939	1.4373	1.1989
No log	0.9647	82	1.2976	0.4	1.2976	1.1391
No log	0.9882	84	1.2193	0.4462	1.2193	1.1042
No log	1.0118	86	1.2433	0.4412	1.2433	1.1150
No log	1.0353	88	1.3041	0.4179	1.3041	1.1420
No log	1.0588	90	1.6754	0.2314	1.6754	1.2944
No log	1.0824	92	2.1704	0.0656	2.1704	1.4732
No log	1.1059	94	2.1191	0.0496	2.1191	1.4557
No log	1.1294	96	1.5537	0.2992	1.5537	1.2465
No log	1.1529	98	1.4745	0.4030	1.4745	1.2143
No log	1.1765	100	1.5130	0.4030	1.5130	1.2301
No log	1.2	102	1.3566	0.4030	1.3566	1.1647
No log	1.2235	104	1.3614	0.4030	1.3614	1.1668
No log	1.2471	106	1.1881	0.5224	1.1881	1.0900
No log	1.2706	108	1.1280	0.5755	1.1280	1.0621
No log	1.2941	110	1.2415	0.5217	1.2415	1.1142
No log	1.3176	112	1.6540	0.2878	1.6540	1.2861
No log	1.3412	114	1.6830	0.2857	1.6830	1.2973
No log	1.3647	116	1.4774	0.4088	1.4774	1.2155
No log	1.3882	118	1.2437	0.5217	1.2437	1.1152
No log	1.4118	120	1.1821	0.5778	1.1821	1.0873
No log	1.4353	122	1.1451	0.6418	1.1451	1.0701
No log	1.4588	124	1.1759	0.6107	1.1759	1.0844
No log	1.4824	126	1.1965	0.528	1.1965	1.0939
No log	1.5059	128	1.1686	0.5714	1.1686	1.0810
No log	1.5294	130	1.1897	0.5426	1.1897	1.0907
No log	1.5529	132	1.2899	0.4697	1.2899	1.1357
No log	1.5765	134	1.3200	0.4812	1.3200	1.1489
No log	1.6	136	1.2977	0.4741	1.2977	1.1392
No log	1.6235	138	1.3752	0.4412	1.3752	1.1727
No log	1.6471	140	1.6272	0.3188	1.6272	1.2756
No log	1.6706	142	1.6136	0.3429	1.6136	1.2703
No log	1.6941	144	1.3127	0.5143	1.3127	1.1457
No log	1.7176	146	1.2022	0.5390	1.2022	1.0965
No log	1.7412	148	1.1309	0.5571	1.1309	1.0634
No log	1.7647	150	1.2370	0.4892	1.2370	1.1122
No log	1.7882	152	1.4781	0.3972	1.4781	1.2158
No log	1.8118	154	1.5655	0.3688	1.5655	1.2512
No log	1.8353	156	1.4941	0.4	1.4941	1.2224
No log	1.8588	158	1.2762	0.5	1.2762	1.1297
No log	1.8824	160	1.2283	0.5556	1.2283	1.1083
No log	1.9059	162	1.2289	0.4793	1.2289	1.1086
No log	1.9294	164	1.2599	0.5156	1.2599	1.1224
No log	1.9529	166	1.3679	0.4545	1.3679	1.1696
No log	1.9765	168	1.5530	0.3796	1.5530	1.2462
No log	2.0	170	1.7325	0.2571	1.7325	1.3162
No log	2.0235	172	1.6754	0.3188	1.6754	1.2944
No log	2.0471	174	1.3936	0.4531	1.3936	1.1805
No log	2.0706	176	1.3073	0.3652	1.3073	1.1434
No log	2.0941	178	1.3256	0.2982	1.3256	1.1514
No log	2.1176	180	1.1945	0.5041	1.1945	1.0929
No log	2.1412	182	1.3330	0.4275	1.3330	1.1545
No log	2.1647	184	2.0384	0.3356	2.0384	1.4277
No log	2.1882	186	2.5690	0.1793	2.5690	1.6028
No log	2.2118	188	2.6500	0.0146	2.6500	1.6279
No log	2.2353	190	2.4727	0.0153	2.4727	1.5725
No log	2.2588	192	2.0225	0.1102	2.0225	1.4221
No log	2.2824	194	1.4197	0.3721	1.4197	1.1915
No log	2.3059	196	1.2442	0.4545	1.2442	1.1154
No log	2.3294	198	1.2376	0.5077	1.2376	1.1125
No log	2.3529	200	1.3468	0.4242	1.3468	1.1605
No log	2.3765	202	1.5438	0.3582	1.5438	1.2425
No log	2.4	204	1.5775	0.3582	1.5775	1.2560
No log	2.4235	206	1.5771	0.3556	1.5771	1.2558
No log	2.4471	208	1.5799	0.3731	1.5799	1.2569
No log	2.4706	210	1.4300	0.4275	1.4300	1.1958
No log	2.4941	212	1.3244	0.4962	1.3244	1.1508
No log	2.5176	214	1.3268	0.5	1.3268	1.1519
No log	2.5412	216	1.4873	0.4	1.4873	1.2196
No log	2.5647	218	1.5723	0.3582	1.5723	1.2539
No log	2.5882	220	1.4614	0.4496	1.4614	1.2089
No log	2.6118	222	1.2722	0.5156	1.2722	1.1279
No log	2.6353	224	1.1823	0.5736	1.1823	1.0873
No log	2.6588	226	1.3266	0.4672	1.3266	1.1518
No log	2.6824	228	1.6873	0.3571	1.6873	1.2990
No log	2.7059	230	1.7989	0.3453	1.7989	1.3412
No log	2.7294	232	1.7120	0.3453	1.7120	1.3084
No log	2.7529	234	1.6565	0.3824	1.6565	1.2871
No log	2.7765	236	1.4811	0.4060	1.4811	1.2170
No log	2.8	238	1.3603	0.4394	1.3603	1.1663
No log	2.8235	240	1.3257	0.4853	1.3257	1.1514
No log	2.8471	242	1.4967	0.4058	1.4967	1.2234
No log	2.8706	244	1.6096	0.3188	1.6096	1.2687
No log	2.8941	246	1.4977	0.4203	1.4977	1.2238
No log	2.9176	248	1.2581	0.4889	1.2581	1.1217
No log	2.9412	250	1.1435	0.5970	1.1435	1.0693
No log	2.9647	252	1.1198	0.5827	1.1198	1.0582
No log	2.9882	254	1.0987	0.5556	1.0987	1.0482
No log	3.0118	256	1.0781	0.5625	1.0781	1.0383
No log	3.0353	258	1.1250	0.5039	1.1250	1.0607
No log	3.0588	260	1.2741	0.4651	1.2741	1.1288
No log	3.0824	262	1.3740	0.4275	1.3740	1.1722
No log	3.1059	264	1.3509	0.4308	1.3509	1.1623
No log	3.1294	266	1.3984	0.4275	1.3984	1.1826
No log	3.1529	268	1.5368	0.3664	1.5368	1.2397
No log	3.1765	270	1.5854	0.3582	1.5854	1.2591
No log	3.2	272	1.4909	0.4375	1.4909	1.2210
No log	3.2235	274	1.3068	0.4762	1.3068	1.1431
No log	3.2471	276	1.2287	0.4274	1.2287	1.1085
No log	3.2706	278	1.2858	0.3860	1.2858	1.1340
No log	3.2941	280	1.3249	0.3393	1.3249	1.1510
No log	3.3176	282	1.3321	0.4500	1.3321	1.1542
No log	3.3412	284	1.4436	0.4375	1.4436	1.2015
No log	3.3647	286	1.4904	0.4496	1.4904	1.2208
No log	3.3882	288	1.4057	0.4375	1.4057	1.1856
No log	3.4118	290	1.2460	0.4724	1.2460	1.1163
No log	3.4353	292	1.1401	0.5124	1.1401	1.0678
No log	3.4588	294	1.1263	0.4833	1.1263	1.0613
No log	3.4824	296	1.1537	0.5528	1.1537	1.0741
No log	3.5059	298	1.2616	0.496	1.2616	1.1232
No log	3.5294	300	1.4807	0.4341	1.4807	1.2168
No log	3.5529	302	1.5684	0.3939	1.5684	1.2524
No log	3.5765	304	1.4269	0.4394	1.4269	1.1945
No log	3.6	306	1.2940	0.4615	1.2940	1.1375
No log	3.6235	308	1.3095	0.4615	1.3095	1.1443
No log	3.6471	310	1.3481	0.4341	1.3481	1.1611
No log	3.6706	312	1.2673	0.4615	1.2673	1.1257
No log	3.6941	314	1.1109	0.5238	1.1109	1.0540
No log	3.7176	316	1.0831	0.5238	1.0831	1.0407
No log	3.7412	318	1.0665	0.5556	1.0665	1.0327
No log	3.7647	320	1.1506	0.5116	1.1506	1.0727
No log	3.7882	322	1.1842	0.5116	1.1842	1.0882
No log	3.8118	324	1.1800	0.5116	1.1800	1.0863
No log	3.8353	326	1.2746	0.4615	1.2746	1.1290
No log	3.8588	328	1.3295	0.4615	1.3295	1.1530
No log	3.8824	330	1.3626	0.4275	1.3626	1.1673
No log	3.9059	332	1.2303	0.4615	1.2303	1.1092
No log	3.9294	334	1.0510	0.5581	1.0510	1.0252
No log	3.9529	336	0.9615	0.5625	0.9615	0.9806
No log	3.9765	338	0.9738	0.5625	0.9738	0.9868
No log	4.0	340	1.0702	0.5385	1.0702	1.0345
No log	4.0235	342	1.2635	0.4341	1.2635	1.1240
No log	4.0471	344	1.4859	0.3910	1.4859	1.2190
No log	4.0706	346	1.5066	0.3910	1.5066	1.2274
No log	4.0941	348	1.3367	0.4341	1.3367	1.1562
No log	4.1176	350	1.1708	0.5156	1.1708	1.0821
No log	4.1412	352	1.0799	0.5397	1.0799	1.0392
No log	4.1647	354	1.0440	0.5512	1.0440	1.0217
No log	4.1882	356	1.0653	0.5312	1.0653	1.0321
No log	4.2118	358	1.1964	0.4923	1.1964	1.0938
No log	4.2353	360	1.4596	0.4275	1.4596	1.2081
No log	4.2588	362	1.5395	0.4478	1.5395	1.2408
No log	4.2824	364	1.3943	0.4697	1.3943	1.1808
No log	4.3059	366	1.3043	0.4923	1.3043	1.1420
No log	4.3294	368	1.3288	0.5075	1.3288	1.1528
No log	4.3529	370	1.3303	0.4615	1.3303	1.1534
No log	4.3765	372	1.3593	0.4615	1.3593	1.1659
No log	4.4	374	1.3790	0.4615	1.3790	1.1743
No log	4.4235	376	1.4337	0.4341	1.4337	1.1974
No log	4.4471	378	1.5008	0.4341	1.5008	1.2251
No log	4.4706	380	1.4196	0.4341	1.4196	1.1914
No log	4.4941	382	1.2592	0.5	1.2592	1.1221
No log	4.5176	384	1.2198	0.4806	1.2198	1.1045
No log	4.5412	386	1.3711	0.4697	1.3711	1.1709
No log	4.5647	388	1.5419	0.4444	1.5419	1.2417
No log	4.5882	390	1.5902	0.4265	1.5902	1.2610
No log	4.6118	392	1.4873	0.4444	1.4873	1.2196
No log	4.6353	394	1.3300	0.4848	1.3300	1.1533
No log	4.6588	396	1.2945	0.5038	1.2945	1.1378
No log	4.6824	398	1.1840	0.5116	1.1840	1.0881
No log	4.7059	400	1.1608	0.5039	1.1608	1.0774
No log	4.7294	402	1.2480	0.4769	1.2480	1.1171
No log	4.7529	404	1.4668	0.4427	1.4668	1.2111
No log	4.7765	406	1.4837	0.4427	1.4837	1.2181
No log	4.8	408	1.3351	0.4697	1.3351	1.1555
No log	4.8235	410	1.1943	0.4762	1.1943	1.0928
No log	4.8471	412	1.1768	0.528	1.1768	1.0848
No log	4.8706	414	1.2954	0.4375	1.2954	1.1382
No log	4.8941	416	1.3721	0.4496	1.3721	1.1714
No log	4.9176	418	1.5222	0.4242	1.5222	1.2338
No log	4.9412	420	1.6450	0.3704	1.6450	1.2826
No log	4.9647	422	1.7346	0.3704	1.7346	1.3170
No log	4.9882	424	1.5459	0.4242	1.5459	1.2434
No log	5.0118	426	1.2432	0.5038	1.2432	1.1150
No log	5.0353	428	0.9855	0.5512	0.9855	0.9927
No log	5.0588	430	0.9458	0.5827	0.9458	0.9725
No log	5.0824	432	0.9670	0.5984	0.9670	0.9833
No log	5.1059	434	0.9807	0.5714	0.9807	0.9903
No log	5.1294	436	1.0226	0.5645	1.0226	1.0112
No log	5.1529	438	1.0905	0.528	1.0905	1.0443
No log	5.1765	440	1.1294	0.5397	1.1294	1.0627
No log	5.2	442	1.1474	0.5397	1.1474	1.0712
No log	5.2235	444	1.1631	0.5397	1.1631	1.0785
No log	5.2471	446	1.1693	0.5397	1.1693	1.0813
No log	5.2706	448	1.1492	0.5397	1.1492	1.0720
No log	5.2941	450	1.1612	0.5354	1.1612	1.0776
No log	5.3176	452	1.2284	0.5354	1.2284	1.1083
No log	5.3412	454	1.3449	0.4375	1.3449	1.1597
No log	5.3647	456	1.4825	0.4091	1.4825	1.2176
No log	5.3882	458	1.6481	0.4091	1.6481	1.2838
No log	5.4118	460	1.6417	0.3910	1.6417	1.2813
No log	5.4353	462	1.5037	0.4427	1.5037	1.2263
No log	5.4588	464	1.3290	0.4341	1.3290	1.1528
No log	5.4824	466	1.2733	0.4375	1.2733	1.1284
No log	5.5059	468	1.2873	0.4341	1.2873	1.1346
No log	5.5294	470	1.3137	0.4341	1.3137	1.1462
No log	5.5529	472	1.3889	0.4341	1.3889	1.1785
No log	5.5765	474	1.3840	0.4341	1.3840	1.1764
No log	5.6	476	1.3476	0.4375	1.3476	1.1608
No log	5.6235	478	1.3161	0.4375	1.3161	1.1472
No log	5.6471	480	1.3212	0.4375	1.3212	1.1494
No log	5.6706	482	1.4216	0.4341	1.4216	1.1923
No log	5.6941	484	1.5584	0.3910	1.5584	1.2483
No log	5.7176	486	1.7033	0.3407	1.7033	1.3051
No log	5.7412	488	1.7935	0.3066	1.7935	1.3392
No log	5.7647	490	1.6823	0.3731	1.6823	1.2970
No log	5.7882	492	1.5636	0.3817	1.5636	1.2504
No log	5.8118	494	1.4947	0.4031	1.4947	1.2226
No log	5.8353	496	1.4899	0.4031	1.4899	1.2206
No log	5.8588	498	1.4446	0.4031	1.4446	1.2019
0.4206	5.8824	500	1.4233	0.4031	1.4233	1.1930
0.4206	5.9059	502	1.4423	0.4031	1.4423	1.2010
0.4206	5.9294	504	1.4599	0.4031	1.4599	1.2082
0.4206	5.9529	506	1.4273	0.4031	1.4273	1.1947
0.4206	5.9765	508	1.4172	0.4375	1.4172	1.1905
0.4206	6.0	510	1.3689	0.4375	1.3689	1.1700
0.4206	6.0235	512	1.2923	0.4375	1.2923	1.1368
0.4206	6.0471	514	1.2534	0.4375	1.2534	1.1196
0.4206	6.0706	516	1.2787	0.4651	1.2787	1.1308
0.4206	6.0941	518	1.2695	0.4651	1.2695	1.1267
0.4206	6.1176	520	1.2958	0.4651	1.2958	1.1383
0.4206	6.1412	522	1.2657	0.4844	1.2657	1.1250
0.4206	6.1647	524	1.2793	0.4844	1.2793	1.1311
0.4206	6.1882	526	1.3464	0.4308	1.3464	1.1603
0.4206	6.2118	528	1.3922	0.4031	1.3922	1.1799
0.4206	6.2353	530	1.5036	0.3817	1.5036	1.2262
0.4206	6.2588	532	1.5916	0.3939	1.5916	1.2616
0.4206	6.2824	534	1.6833	0.3939	1.6833	1.2974
0.4206	6.3059	536	1.6361	0.3939	1.6361	1.2791

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1