ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2078
• Qwk: 0.4320
• Mse: 1.2078
• Rmse: 1.0990

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	6.8816	0.0242	6.8816	2.6233
No log	0.4444	4	4.4898	0.0806	4.4898	2.1189
No log	0.6667	6	3.7055	-0.0505	3.7055	1.9250
No log	0.8889	8	3.2935	0.0235	3.2935	1.8148
No log	1.1111	10	2.0399	0.2205	2.0399	1.4283
No log	1.3333	12	1.6913	0.2018	1.6913	1.3005
No log	1.5556	14	1.5989	0.1905	1.5989	1.2645
No log	1.7778	16	1.6834	0.2162	1.6834	1.2975
No log	2.0	18	1.9033	0.2459	1.9033	1.3796
No log	2.2222	20	2.3031	0.0845	2.3031	1.5176
No log	2.4444	22	2.4797	0.1096	2.4797	1.5747
No log	2.6667	24	1.8681	0.3721	1.8681	1.3668
No log	2.8889	26	1.5864	0.3387	1.5864	1.2595
No log	3.1111	28	1.4651	0.2759	1.4651	1.2104
No log	3.3333	30	1.4554	0.3130	1.4554	1.2064
No log	3.5556	32	1.3771	0.3415	1.3771	1.1735
No log	3.7778	34	1.9253	0.3776	1.9253	1.3876
No log	4.0	36	2.2441	0.2788	2.2441	1.4980
No log	4.2222	38	1.7124	0.4056	1.7124	1.3086
No log	4.4444	40	1.3730	0.4154	1.3730	1.1718
No log	4.6667	42	1.6545	0.2810	1.6545	1.2863
No log	4.8889	44	2.5014	-0.0159	2.5014	1.5816
No log	5.1111	46	3.3168	-0.1618	3.3168	1.8212
No log	5.3333	48	2.8402	-0.1385	2.8402	1.6853
No log	5.5556	50	1.9038	0.1322	1.9038	1.3798
No log	5.7778	52	1.4086	0.4496	1.4086	1.1869
No log	6.0	54	1.2962	0.5116	1.2962	1.1385
No log	6.2222	56	1.2941	0.4923	1.2941	1.1376
No log	6.4444	58	1.5044	0.3333	1.5044	1.2266
No log	6.6667	60	1.5947	0.2836	1.5947	1.2628
No log	6.8889	62	1.5684	0.3281	1.5684	1.2524
No log	7.1111	64	1.4751	0.352	1.4751	1.2146
No log	7.3333	66	1.4146	0.4	1.4146	1.1894
No log	7.5556	68	1.3301	0.4516	1.3301	1.1533
No log	7.7778	70	1.2389	0.4844	1.2389	1.1131
No log	8.0	72	1.2516	0.5303	1.2516	1.1188
No log	8.2222	74	1.4538	0.4462	1.4538	1.2058
No log	8.4444	76	1.6955	0.3650	1.6955	1.3021
No log	8.6667	78	1.6269	0.4	1.6269	1.2755
No log	8.8889	80	1.3261	0.5039	1.3261	1.1516
No log	9.1111	82	1.2068	0.5778	1.2068	1.0985
No log	9.3333	84	1.2473	0.5735	1.2473	1.1168
No log	9.5556	86	1.3578	0.5414	1.3578	1.1652
No log	9.7778	88	1.6409	0.3913	1.6409	1.2810
No log	10.0	90	1.7657	0.2899	1.7657	1.3288
No log	10.2222	92	1.6098	0.4412	1.6098	1.2688
No log	10.4444	94	1.4662	0.4662	1.4662	1.2109
No log	10.6667	96	1.2885	0.5373	1.2885	1.1351
No log	10.8889	98	1.1819	0.5522	1.1819	1.0871
No log	11.1111	100	1.1670	0.5455	1.1670	1.0803
No log	11.3333	102	1.2883	0.5303	1.2883	1.1350
No log	11.5556	104	1.3549	0.4848	1.3549	1.1640
No log	11.7778	106	1.4341	0.4478	1.4341	1.1975
No log	12.0	108	1.4074	0.4925	1.4074	1.1863
No log	12.2222	110	1.1758	0.5839	1.1758	1.0843
No log	12.4444	112	1.1314	0.5630	1.1314	1.0637
No log	12.6667	114	1.2822	0.5522	1.2822	1.1323
No log	12.8889	116	1.5489	0.4394	1.5489	1.2446
No log	13.1111	118	1.5794	0.4380	1.5794	1.2567
No log	13.3333	120	1.3494	0.5075	1.3494	1.1616
No log	13.5556	122	1.0898	0.5970	1.0898	1.0439
No log	13.7778	124	1.0708	0.6119	1.0708	1.0348
No log	14.0	126	1.0942	0.5693	1.0942	1.0460
No log	14.2222	128	1.1283	0.5522	1.1283	1.0622
No log	14.4444	130	1.1950	0.5414	1.1950	1.0932
No log	14.6667	132	1.3083	0.4662	1.3083	1.1438
No log	14.8889	134	1.4833	0.4511	1.4833	1.2179
No log	15.1111	136	1.3725	0.4662	1.3725	1.1715
No log	15.3333	138	1.1611	0.5333	1.1611	1.0776
No log	15.5556	140	1.0760	0.5985	1.0760	1.0373
No log	15.7778	142	1.1002	0.5882	1.1002	1.0489
No log	16.0	144	1.1027	0.5821	1.1027	1.0501
No log	16.2222	146	1.1732	0.5263	1.1732	1.0832
No log	16.4444	148	1.3476	0.4769	1.3476	1.1609
No log	16.6667	150	1.5758	0.3852	1.5758	1.2553
No log	16.8889	152	1.5733	0.4511	1.5733	1.2543
No log	17.1111	154	1.4380	0.4615	1.4380	1.1992
No log	17.3333	156	1.2552	0.4480	1.2552	1.1203
No log	17.5556	158	1.1669	0.5758	1.1669	1.0802
No log	17.7778	160	1.1733	0.5564	1.1733	1.0832
No log	18.0	162	1.1350	0.6029	1.1350	1.0654
No log	18.2222	164	1.1289	0.5865	1.1289	1.0625
No log	18.4444	166	1.2901	0.4580	1.2901	1.1358
No log	18.6667	168	1.4682	0.4511	1.4682	1.2117
No log	18.8889	170	1.4650	0.4615	1.4650	1.2104
No log	19.1111	172	1.3138	0.4462	1.3138	1.1462
No log	19.3333	174	1.2697	0.4687	1.2697	1.1268
No log	19.5556	176	1.2688	0.5079	1.2688	1.1264
No log	19.7778	178	1.2338	0.5079	1.2338	1.1108
No log	20.0	180	1.2056	0.512	1.2056	1.0980
No log	20.2222	182	1.1925	0.4878	1.1925	1.0920
No log	20.4444	184	1.1855	0.4878	1.1855	1.0888
No log	20.6667	186	1.1812	0.5079	1.1812	1.0869
No log	20.8889	188	1.1636	0.496	1.1636	1.0787
No log	21.1111	190	1.1621	0.4839	1.1621	1.0780
No log	21.3333	192	1.1859	0.5039	1.1859	1.0890
No log	21.5556	194	1.2314	0.4567	1.2314	1.1097
No log	21.7778	196	1.2273	0.4219	1.2273	1.1078
No log	22.0	198	1.2209	0.4885	1.2209	1.1049
No log	22.2222	200	1.1518	0.4715	1.1518	1.0732
No log	22.4444	202	1.1034	0.528	1.1034	1.0504
No log	22.6667	204	1.1050	0.4628	1.1050	1.0512
No log	22.8889	206	1.1146	0.5238	1.1146	1.0557
No log	23.1111	208	1.2451	0.4885	1.2451	1.1158
No log	23.3333	210	1.3139	0.4848	1.3139	1.1463
No log	23.5556	212	1.3112	0.4615	1.3112	1.1451
No log	23.7778	214	1.3060	0.4496	1.3060	1.1428
No log	24.0	216	1.2790	0.4341	1.2790	1.1309
No log	24.2222	218	1.2747	0.4062	1.2747	1.1290
No log	24.4444	220	1.3100	0.4531	1.3100	1.1445
No log	24.6667	222	1.3966	0.4219	1.3966	1.1818
No log	24.8889	224	1.5453	0.4	1.5453	1.2431
No log	25.1111	226	1.5301	0.4	1.5301	1.2370
No log	25.3333	228	1.3670	0.4580	1.3670	1.1692
No log	25.5556	230	1.1851	0.5224	1.1851	1.0886
No log	25.7778	232	1.1331	0.5538	1.1331	1.0645
No log	26.0	234	1.1421	0.5312	1.1421	1.0687
No log	26.2222	236	1.1558	0.5397	1.1558	1.0751
No log	26.4444	238	1.2082	0.512	1.2082	1.0992
No log	26.6667	240	1.2800	0.4844	1.2800	1.1314
No log	26.8889	242	1.2711	0.4409	1.2711	1.1274
No log	27.1111	244	1.2316	0.4496	1.2316	1.1098
No log	27.3333	246	1.2399	0.4496	1.2399	1.1135
No log	27.5556	248	1.2231	0.4531	1.2231	1.1059
No log	27.7778	250	1.2314	0.4531	1.2314	1.1097
No log	28.0	252	1.2656	0.4341	1.2656	1.1250
No log	28.2222	254	1.2355	0.4252	1.2355	1.1115
No log	28.4444	256	1.2353	0.4252	1.2353	1.1115
No log	28.6667	258	1.2716	0.4341	1.2716	1.1277
No log	28.8889	260	1.2963	0.4308	1.2963	1.1386
No log	29.1111	262	1.3249	0.4308	1.3249	1.1510
No log	29.3333	264	1.4080	0.4341	1.4080	1.1866
No log	29.5556	266	1.4781	0.4341	1.4781	1.2158
No log	29.7778	268	1.4800	0.4341	1.4800	1.2166
No log	30.0	270	1.3556	0.4531	1.3556	1.1643
No log	30.2222	272	1.2866	0.4806	1.2866	1.1343
No log	30.4444	274	1.2364	0.4580	1.2364	1.1119
No log	30.6667	276	1.1635	0.4769	1.1635	1.0787
No log	30.8889	278	1.1349	0.4769	1.1349	1.0653
No log	31.1111	280	1.0996	0.5312	1.0996	1.0486
No log	31.3333	282	1.1078	0.5197	1.1078	1.0525
No log	31.5556	284	1.1565	0.4961	1.1565	1.0754
No log	31.7778	286	1.2386	0.4615	1.2386	1.1129
No log	32.0	288	1.3295	0.4885	1.3295	1.1530
No log	32.2222	290	1.3515	0.4615	1.3515	1.1626
No log	32.4444	292	1.2783	0.4651	1.2783	1.1306
No log	32.6667	294	1.2170	0.4480	1.2170	1.1032
No log	32.8889	296	1.1894	0.4921	1.1894	1.0906
No log	33.1111	298	1.1854	0.4496	1.1854	1.0887
No log	33.3333	300	1.2102	0.4769	1.2102	1.1001
No log	33.5556	302	1.2590	0.4531	1.2590	1.1221
No log	33.7778	304	1.2984	0.4531	1.2984	1.1395
No log	34.0	306	1.3248	0.4567	1.3248	1.1510
No log	34.2222	308	1.3066	0.4603	1.3066	1.1431
No log	34.4444	310	1.2773	0.4677	1.2773	1.1302
No log	34.6667	312	1.2679	0.4677	1.2679	1.1260
No log	34.8889	314	1.2517	0.4677	1.2517	1.1188
No log	35.1111	316	1.2537	0.4921	1.2537	1.1197
No log	35.3333	318	1.2646	0.4882	1.2646	1.1245
No log	35.5556	320	1.2685	0.4806	1.2685	1.1263
No log	35.7778	322	1.2688	0.4531	1.2688	1.1264
No log	36.0	324	1.2380	0.4567	1.2380	1.1127
No log	36.2222	326	1.2220	0.4320	1.2220	1.1054
No log	36.4444	328	1.2027	0.4286	1.2027	1.0967
No log	36.6667	330	1.2151	0.4286	1.2151	1.1023
No log	36.8889	332	1.2455	0.4531	1.2455	1.1160
No log	37.1111	334	1.2808	0.4219	1.2808	1.1317
No log	37.3333	336	1.2772	0.3937	1.2772	1.1302
No log	37.5556	338	1.2916	0.3968	1.2916	1.1365
No log	37.7778	340	1.2980	0.4	1.2980	1.1393
No log	38.0	342	1.2944	0.4194	1.2944	1.1377
No log	38.2222	344	1.3085	0.4	1.3085	1.1439
No log	38.4444	346	1.2936	0.4228	1.2936	1.1373
No log	38.6667	348	1.3174	0.4032	1.3174	1.1478
No log	38.8889	350	1.3186	0.4	1.3186	1.1483
No log	39.1111	352	1.2782	0.3902	1.2782	1.1306
No log	39.3333	354	1.2361	0.3902	1.2361	1.1118
No log	39.5556	356	1.2227	0.4160	1.2227	1.1057
No log	39.7778	358	1.2054	0.4160	1.2054	1.0979
No log	40.0	360	1.2049	0.4567	1.2049	1.0977
No log	40.2222	362	1.2152	0.4341	1.2152	1.1023
No log	40.4444	364	1.2829	0.4308	1.2829	1.1327
No log	40.6667	366	1.2933	0.4580	1.2933	1.1372
No log	40.8889	368	1.2331	0.4567	1.2331	1.1105
No log	41.1111	370	1.2080	0.4921	1.2080	1.0991
No log	41.3333	372	1.1942	0.4286	1.1942	1.0928
No log	41.5556	374	1.1873	0.4567	1.1873	1.0896
No log	41.7778	376	1.2092	0.4531	1.2092	1.0996
No log	42.0	378	1.1972	0.4567	1.1972	1.0942
No log	42.2222	380	1.1770	0.4516	1.1770	1.0849
No log	42.4444	382	1.1840	0.4426	1.1840	1.0881
No log	42.6667	384	1.2169	0.4298	1.2169	1.1031
No log	42.8889	386	1.2706	0.4298	1.2706	1.1272
No log	43.1111	388	1.3316	0.4219	1.3316	1.1540
No log	43.3333	390	1.4678	0.4341	1.4678	1.2115
No log	43.5556	392	1.5791	0.4275	1.5791	1.2566
No log	43.7778	394	1.6095	0.3582	1.6095	1.2687
No log	44.0	396	1.5373	0.4154	1.5373	1.2399
No log	44.2222	398	1.4064	0.4580	1.4064	1.1859
No log	44.4444	400	1.2869	0.4427	1.2869	1.1344
No log	44.6667	402	1.2477	0.4580	1.2477	1.1170
No log	44.8889	404	1.2530	0.4580	1.2530	1.1194
No log	45.1111	406	1.2688	0.4697	1.2688	1.1264
No log	45.3333	408	1.2805	0.4496	1.2805	1.1316
No log	45.5556	410	1.3231	0.4341	1.3231	1.1503
No log	45.7778	412	1.3366	0.4341	1.3366	1.1561
No log	46.0	414	1.3327	0.4341	1.3327	1.1544
No log	46.2222	416	1.3149	0.4341	1.3149	1.1467
No log	46.4444	418	1.2944	0.4341	1.2944	1.1377
No log	46.6667	420	1.2589	0.4308	1.2589	1.1220
No log	46.8889	422	1.2068	0.4531	1.2068	1.0985
No log	47.1111	424	1.1709	0.4882	1.1709	1.0821
No log	47.3333	426	1.1568	0.4921	1.1568	1.0756
No log	47.5556	428	1.1446	0.4921	1.1446	1.0699
No log	47.7778	430	1.1506	0.4921	1.1506	1.0726
No log	48.0	432	1.1764	0.48	1.1764	1.0846
No log	48.2222	434	1.1926	0.48	1.1926	1.0921
No log	48.4444	436	1.2085	0.4516	1.2085	1.0993
No log	48.6667	438	1.2134	0.4426	1.2134	1.1015
No log	48.8889	440	1.2182	0.4553	1.2182	1.1037
No log	49.1111	442	1.2345	0.48	1.2345	1.1111
No log	49.3333	444	1.2589	0.4531	1.2589	1.1220
No log	49.5556	446	1.2517	0.4496	1.2517	1.1188
No log	49.7778	448	1.2297	0.4567	1.2297	1.1089
No log	50.0	450	1.2323	0.4409	1.2323	1.1101
No log	50.2222	452	1.2438	0.4567	1.2438	1.1152
No log	50.4444	454	1.2692	0.4252	1.2692	1.1266
No log	50.6667	456	1.2751	0.4252	1.2751	1.1292
No log	50.8889	458	1.2849	0.4252	1.2849	1.1335
No log	51.1111	460	1.3317	0.4341	1.3317	1.1540
No log	51.3333	462	1.3638	0.4094	1.3638	1.1678
No log	51.5556	464	1.3709	0.4094	1.3709	1.1709
No log	51.7778	466	1.3540	0.4094	1.3540	1.1636
No log	52.0	468	1.3225	0.4094	1.3225	1.1500
No log	52.2222	470	1.2745	0.4444	1.2745	1.1289
No log	52.4444	472	1.2377	0.4194	1.2377	1.1125
No log	52.6667	474	1.2299	0.4194	1.2299	1.1090
No log	52.8889	476	1.2463	0.4194	1.2463	1.1164
No log	53.1111	478	1.2772	0.4444	1.2772	1.1301
No log	53.3333	480	1.3008	0.4409	1.3008	1.1405
No log	53.5556	482	1.3513	0.4615	1.3513	1.1625
No log	53.7778	484	1.3892	0.4615	1.3892	1.1786
No log	54.0	486	1.3660	0.4615	1.3660	1.1687
No log	54.2222	488	1.3250	0.4308	1.3250	1.1511
No log	54.4444	490	1.2783	0.4462	1.2783	1.1306
No log	54.6667	492	1.2553	0.4651	1.2553	1.1204
No log	54.8889	494	1.2683	0.4651	1.2683	1.1262
No log	55.1111	496	1.2810	0.4409	1.2810	1.1318
No log	55.3333	498	1.3047	0.4531	1.3047	1.1422
0.2807	55.5556	500	1.3258	0.4531	1.3258	1.1514
0.2807	55.7778	502	1.3133	0.4844	1.3133	1.1460
0.2807	56.0	504	1.2736	0.4567	1.2736	1.1286
0.2807	56.2222	506	1.2218	0.4320	1.2218	1.1054
0.2807	56.4444	508	1.1994	0.4677	1.1994	1.0952
0.2807	56.6667	510	1.1825	0.4553	1.1825	1.0874
0.2807	56.8889	512	1.1650	0.5238	1.1650	1.0793
0.2807	57.1111	514	1.1489	0.5	1.1489	1.0719
0.2807	57.3333	516	1.1466	0.5231	1.1466	1.0708
0.2807	57.5556	518	1.1516	0.4962	1.1516	1.0731
0.2807	57.7778	520	1.1314	0.5455	1.1314	1.0637
0.2807	58.0	522	1.1019	0.5271	1.1019	1.0497
0.2807	58.2222	524	1.0743	0.5512	1.0743	1.0365
0.2807	58.4444	526	1.0467	0.5827	1.0467	1.0231
0.2807	58.6667	528	1.0405	0.5512	1.0405	1.0200
0.2807	58.8889	530	1.0427	0.5581	1.0427	1.0211
0.2807	59.1111	532	1.0596	0.5556	1.0596	1.0294
0.2807	59.3333	534	1.0985	0.56	1.0985	1.0481
0.2807	59.5556	536	1.1513	0.5625	1.1513	1.0730
0.2807	59.7778	538	1.1911	0.5	1.1911	1.0914
0.2807	60.0	540	1.2395	0.5	1.2395	1.1133
0.2807	60.2222	542	1.2672	0.4923	1.2672	1.1257
0.2807	60.4444	544	1.2537	0.4882	1.2537	1.1197
0.2807	60.6667	546	1.2222	0.4961	1.2222	1.1055
0.2807	60.8889	548	1.1935	0.4961	1.1935	1.0925
0.2807	61.1111	550	1.1603	0.4724	1.1603	1.0772
0.2807	61.3333	552	1.1486	0.4724	1.1486	1.0717
0.2807	61.5556	554	1.1320	0.5	1.1320	1.0639
0.2807	61.7778	556	1.1127	0.5231	1.1127	1.0549
0.2807	62.0	558	1.1022	0.5231	1.1022	1.0499
0.2807	62.2222	560	1.1093	0.4961	1.1093	1.0532
0.2807	62.4444	562	1.1333	0.5231	1.1333	1.0646
0.2807	62.6667	564	1.1830	0.4923	1.1830	1.0876
0.2807	62.8889	566	1.2472	0.4697	1.2472	1.1168
0.2807	63.1111	568	1.2904	0.4885	1.2904	1.1360
0.2807	63.3333	570	1.2987	0.4885	1.2987	1.1396
0.2807	63.5556	572	1.2756	0.4651	1.2756	1.1294
0.2807	63.7778	574	1.2286	0.4882	1.2286	1.1084
0.2807	64.0	576	1.2087	0.4724	1.2087	1.0994
0.2807	64.2222	578	1.2058	0.4724	1.2058	1.0981
0.2807	64.4444	580	1.1979	0.4444	1.1979	1.0945
0.2807	64.6667	582	1.1950	0.4444	1.1950	1.0932
0.2807	64.8889	584	1.2000	0.4444	1.2000	1.0954
0.2807	65.1111	586	1.2045	0.4444	1.2045	1.0975
0.2807	65.3333	588	1.2078	0.4320	1.2078	1.0990

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1