ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k2_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1284
• Qwk: 0.0556
• Mse: 1.1284
• Rmse: 1.0623

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	3.9424	-0.0109	3.9424	1.9856
No log	0.8	4	2.1749	0.0357	2.1749	1.4748
No log	1.2	6	1.7505	-0.0288	1.7505	1.3231
No log	1.6	8	1.3908	0.1463	1.3908	1.1793
No log	2.0	10	1.0239	0.3082	1.0239	1.0119
No log	2.4	12	0.9474	0.3688	0.9474	0.9734
No log	2.8	14	1.0368	0.2268	1.0368	1.0183
No log	3.2	16	0.9209	0.4365	0.9209	0.9596
No log	3.6	18	0.9337	0.3396	0.9337	0.9663
No log	4.0	20	0.9609	0.3510	0.9609	0.9802
No log	4.4	22	0.9379	0.2981	0.9379	0.9685
No log	4.8	24	0.9718	0.2865	0.9718	0.9858
No log	5.2	26	1.0579	0.2416	1.0579	1.0285
No log	5.6	28	1.0804	0.1962	1.0804	1.0394
No log	6.0	30	1.0598	0.2672	1.0598	1.0295
No log	6.4	32	1.1437	0.0823	1.1437	1.0694
No log	6.8	34	1.2664	0.0454	1.2664	1.1254
No log	7.2	36	1.1920	0.0947	1.1920	1.0918
No log	7.6	38	1.0807	0.1810	1.0807	1.0396
No log	8.0	40	1.0469	0.3139	1.0469	1.0232
No log	8.4	42	1.1135	0.1783	1.1135	1.0552
No log	8.8	44	1.3308	-0.0366	1.3308	1.1536
No log	9.2	46	1.4643	-0.0422	1.4643	1.2101
No log	9.6	48	1.5086	0.0876	1.5086	1.2282
No log	10.0	50	1.5770	0.0976	1.5770	1.2558
No log	10.4	52	1.6056	-0.0212	1.6056	1.2671
No log	10.8	54	1.5472	-0.0778	1.5472	1.2439
No log	11.2	56	1.4887	0.0579	1.4887	1.2201
No log	11.6	58	1.2836	0.0236	1.2836	1.1329
No log	12.0	60	1.1135	0.1101	1.1135	1.0552
No log	12.4	62	1.1493	0.0449	1.1493	1.0720
No log	12.8	64	1.2099	0.0395	1.2099	1.0999
No log	13.2	66	1.3105	0.0760	1.3105	1.1448
No log	13.6	68	1.3061	0.0817	1.3061	1.1429
No log	14.0	70	1.3761	0.0246	1.3761	1.1731
No log	14.4	72	1.4675	0.2038	1.4675	1.2114
No log	14.8	74	1.4929	0.1835	1.4929	1.2218
No log	15.2	76	1.3928	0.2614	1.3928	1.1802
No log	15.6	78	1.2371	0.1397	1.2371	1.1122
No log	16.0	80	1.1892	0.1992	1.1892	1.0905
No log	16.4	82	1.3037	0.1845	1.3037	1.1418
No log	16.8	84	1.5981	0.1728	1.5981	1.2642
No log	17.2	86	1.6561	0.2015	1.6561	1.2869
No log	17.6	88	1.5197	0.2206	1.5197	1.2328
No log	18.0	90	1.2789	0.1221	1.2789	1.1309
No log	18.4	92	1.2210	0.0780	1.2210	1.1050
No log	18.8	94	1.2552	0.1170	1.2552	1.1204
No log	19.2	96	1.3097	0.0931	1.3097	1.1444
No log	19.6	98	1.2791	0.1288	1.2791	1.1310
No log	20.0	100	1.1891	0.1081	1.1891	1.0904
No log	20.4	102	1.0304	0.1418	1.0304	1.0151
No log	20.8	104	0.9614	0.3178	0.9614	0.9805
No log	21.2	106	0.9455	0.3301	0.9455	0.9724
No log	21.6	108	0.9952	0.2322	0.9952	0.9976
No log	22.0	110	1.2840	0.2203	1.2840	1.1332
No log	22.4	112	1.5317	0.2424	1.5317	1.2376
No log	22.8	114	1.5020	0.2424	1.5020	1.2255
No log	23.2	116	1.4154	0.2126	1.4154	1.1897
No log	23.6	118	1.2262	0.2015	1.2262	1.1073
No log	24.0	120	0.9446	0.2678	0.9446	0.9719
No log	24.4	122	0.8544	0.4328	0.8544	0.9243
No log	24.8	124	0.8815	0.2288	0.8815	0.9389
No log	25.2	126	1.0880	0.1770	1.0880	1.0431
No log	25.6	128	1.2534	0.0510	1.2534	1.1196
No log	26.0	130	1.4322	0.0878	1.4322	1.1967
No log	26.4	132	1.4800	0.1486	1.4800	1.2166
No log	26.8	134	1.4012	0.0510	1.4012	1.1837
No log	27.2	136	1.2504	0.0	1.2504	1.1182
No log	27.6	138	1.1374	0.0888	1.1374	1.0665
No log	28.0	140	1.0707	0.0919	1.0707	1.0347
No log	28.4	142	1.0695	0.0919	1.0695	1.0342
No log	28.8	144	1.1351	0.0888	1.1351	1.0654
No log	29.2	146	1.2103	0.0	1.2103	1.1002
No log	29.6	148	1.1912	0.0	1.1912	1.0914
No log	30.0	150	1.1710	0.1228	1.1710	1.0821
No log	30.4	152	1.0848	0.1697	1.0848	1.0416
No log	30.8	154	0.9605	0.2108	0.9605	0.9800
No log	31.2	156	0.9628	0.1292	0.9628	0.9812
No log	31.6	158	1.0200	0.1351	1.0200	1.0100
No log	32.0	160	1.1214	0.0964	1.1214	1.0590
No log	32.4	162	1.2008	0.0964	1.2008	1.0958
No log	32.8	164	1.2434	0.0673	1.2434	1.1151
No log	33.2	166	1.1630	0.0931	1.1630	1.0784
No log	33.6	168	1.0503	0.0193	1.0503	1.0249
No log	34.0	170	0.9994	0.1418	0.9994	0.9997
No log	34.4	172	1.0265	0.1292	1.0265	1.0132
No log	34.8	174	1.1233	0.0510	1.1233	1.0599
No log	35.2	176	1.1927	0.0618	1.1927	1.0921
No log	35.6	178	1.2186	0.0618	1.2186	1.1039
No log	36.0	180	1.2718	-0.0244	1.2718	1.1278
No log	36.4	182	1.2792	0.0390	1.2792	1.1310
No log	36.8	184	1.3290	0.0390	1.3290	1.1528
No log	37.2	186	1.4326	0.0390	1.4326	1.1969
No log	37.6	188	1.5611	0.0390	1.5611	1.2495
No log	38.0	190	1.5503	-0.0399	1.5503	1.2451
No log	38.4	192	1.4556	-0.0244	1.4556	1.2065
No log	38.8	194	1.3321	0.0188	1.3321	1.1542
No log	39.2	196	1.2111	0.0068	1.2111	1.1005
No log	39.6	198	1.1501	0.0068	1.1501	1.0724
No log	40.0	200	1.1701	0.0122	1.1701	1.0817
No log	40.4	202	1.1917	0.0122	1.1917	1.0916
No log	40.8	204	1.1904	0.1024	1.1904	1.0911
No log	41.2	206	1.1195	0.1434	1.1195	1.0580
No log	41.6	208	1.0769	0.1528	1.0769	1.0377
No log	42.0	210	0.9953	0.2161	0.9953	0.9976
No log	42.4	212	0.9852	0.1854	0.9852	0.9926
No log	42.8	214	1.0449	0.1330	1.0449	1.0222
No log	43.2	216	1.1401	0.1370	1.1401	1.0678
No log	43.6	218	1.1915	0.0878	1.1915	1.0916
No log	44.0	220	1.1922	0.0878	1.1922	1.0919
No log	44.4	222	1.1573	0.0401	1.1573	1.0758
No log	44.8	224	1.1094	0.0	1.1094	1.0533
No log	45.2	226	1.1375	0.0	1.1375	1.0665
No log	45.6	228	1.2182	0.0401	1.2182	1.1037
No log	46.0	230	1.3215	0.0878	1.3215	1.1496
No log	46.4	232	1.3393	0.0878	1.3393	1.1573
No log	46.8	234	1.2925	0.0122	1.2925	1.1369
No log	47.2	236	1.2290	0.0	1.2290	1.1086
No log	47.6	238	1.1807	0.0445	1.1807	1.0866
No log	48.0	240	1.1539	0.0445	1.1539	1.0742
No log	48.4	242	1.1869	0.0556	1.1869	1.0895
No log	48.8	244	1.1978	0.0556	1.1978	1.0944
No log	49.2	246	1.1844	0.0556	1.1844	1.0883
No log	49.6	248	1.1549	0.0556	1.1549	1.0747
No log	50.0	250	1.1680	0.0931	1.1680	1.0807
No log	50.4	252	1.1402	0.0931	1.1402	1.0678
No log	50.8	254	1.1046	0.0445	1.1046	1.0510
No log	51.2	256	1.1400	0.0556	1.1400	1.0677
No log	51.6	258	1.2281	0.0122	1.2281	1.1082
No log	52.0	260	1.2801	0.0122	1.2801	1.1314
No log	52.4	262	1.3030	0.0811	1.3030	1.1415
No log	52.8	264	1.3485	0.0811	1.3485	1.1613
No log	53.2	266	1.3522	0.0811	1.3522	1.1629
No log	53.6	268	1.2974	0.0811	1.2974	1.1390
No log	54.0	270	1.2392	0.0811	1.2392	1.1132
No log	54.4	272	1.2378	0.0811	1.2378	1.1125
No log	54.8	274	1.2072	0.0931	1.2072	1.0987
No log	55.2	276	1.1705	0.0931	1.1705	1.0819
No log	55.6	278	1.1303	0.0931	1.1303	1.0631
No log	56.0	280	1.1409	0.0931	1.1409	1.0681
No log	56.4	282	1.1319	0.0931	1.1319	1.0639
No log	56.8	284	1.1058	0.0931	1.1058	1.0516
No log	57.2	286	1.0640	0.0445	1.0640	1.0315
No log	57.6	288	1.0330	0.0888	1.0330	1.0164
No log	58.0	290	1.0191	0.1046	1.0191	1.0095
No log	58.4	292	1.0218	0.1046	1.0218	1.0108
No log	58.8	294	1.0274	0.0710	1.0274	1.0136
No log	59.2	296	1.0538	0.0931	1.0538	1.0265
No log	59.6	298	1.0734	0.1288	1.0734	1.0360
No log	60.0	300	1.0337	0.1351	1.0337	1.0167
No log	60.4	302	1.0035	0.0888	1.0035	1.0018
No log	60.8	304	1.0242	0.0888	1.0242	1.0120
No log	61.2	306	1.0775	0.0556	1.0775	1.0380
No log	61.6	308	1.1397	0.0556	1.1397	1.0676
No log	62.0	310	1.1756	0.0556	1.1756	1.0842
No log	62.4	312	1.2021	0.0556	1.2021	1.0964
No log	62.8	314	1.2047	0.0556	1.2047	1.0976
No log	63.2	316	1.1968	0.0931	1.1968	1.0940
No log	63.6	318	1.1892	0.0931	1.1892	1.0905
No log	64.0	320	1.2089	0.0931	1.2089	1.0995
No log	64.4	322	1.2437	0.0931	1.2437	1.1152
No log	64.8	324	1.2609	0.0878	1.2609	1.1229
No log	65.2	326	1.2287	0.1288	1.2287	1.1084
No log	65.6	328	1.1731	0.0931	1.1731	1.0831
No log	66.0	330	1.1199	0.0556	1.1199	1.0583
No log	66.4	332	1.1052	0.0445	1.1052	1.0513
No log	66.8	334	1.1256	0.0445	1.1256	1.0609
No log	67.2	336	1.1647	0.0	1.1647	1.0792
No log	67.6	338	1.1781	0.0122	1.1781	1.0854
No log	68.0	340	1.1816	0.0931	1.1816	1.0870
No log	68.4	342	1.1743	0.0931	1.1743	1.0837
No log	68.8	344	1.1385	0.0931	1.1385	1.0670
No log	69.2	346	1.0806	0.0833	1.0806	1.0395
No log	69.6	348	1.0472	0.0833	1.0472	1.0233
No log	70.0	350	1.0357	0.0833	1.0357	1.0177
No log	70.4	352	1.0472	0.0833	1.0472	1.0234
No log	70.8	354	1.0845	0.0833	1.0845	1.0414
No log	71.2	356	1.1119	0.0931	1.1119	1.0545
No log	71.6	358	1.1240	0.0931	1.1240	1.0602
No log	72.0	360	1.1094	0.0931	1.1094	1.0533
No log	72.4	362	1.0743	0.0931	1.0743	1.0365
No log	72.8	364	1.0342	0.0833	1.0342	1.0170
No log	73.2	366	1.0020	0.0445	1.0020	1.0010
No log	73.6	368	1.0080	0.0445	1.0080	1.0040
No log	74.0	370	1.0325	0.0445	1.0325	1.0161
No log	74.4	372	1.0777	0.0931	1.0777	1.0381
No log	74.8	374	1.0940	0.0931	1.0940	1.0459
No log	75.2	376	1.1060	0.0931	1.1060	1.0517
No log	75.6	378	1.1263	0.0931	1.1263	1.0613
No log	76.0	380	1.1315	0.0556	1.1315	1.0637
No log	76.4	382	1.1337	0.0556	1.1337	1.0648
No log	76.8	384	1.1366	0.0556	1.1366	1.0661
No log	77.2	386	1.1201	0.0556	1.1201	1.0584
No log	77.6	388	1.1073	0.0556	1.1073	1.0523
No log	78.0	390	1.0964	0.0556	1.0964	1.0471
No log	78.4	392	1.0900	0.0556	1.0900	1.0440
No log	78.8	394	1.0717	0.0445	1.0717	1.0352
No log	79.2	396	1.0541	0.0445	1.0541	1.0267
No log	79.6	398	1.0505	0.0445	1.0505	1.0250
No log	80.0	400	1.0494	0.0445	1.0494	1.0244
No log	80.4	402	1.0367	0.0445	1.0367	1.0182
No log	80.8	404	1.0335	0.0445	1.0335	1.0166
No log	81.2	406	1.0413	0.0445	1.0413	1.0204
No log	81.6	408	1.0418	0.0445	1.0418	1.0207
No log	82.0	410	1.0365	0.0445	1.0365	1.0181
No log	82.4	412	1.0351	0.0445	1.0351	1.0174
No log	82.8	414	1.0501	0.0445	1.0501	1.0247
No log	83.2	416	1.0557	0.0445	1.0557	1.0275
No log	83.6	418	1.0708	0.0445	1.0708	1.0348
No log	84.0	420	1.0819	0.0445	1.0819	1.0401
No log	84.4	422	1.0936	0.0445	1.0936	1.0458
No log	84.8	424	1.1109	0.0445	1.1109	1.0540
No log	85.2	426	1.1399	0.0556	1.1399	1.0677
No log	85.6	428	1.1785	0.0556	1.1785	1.0856
No log	86.0	430	1.2063	0.0556	1.2063	1.0983
No log	86.4	432	1.2203	0.0556	1.2203	1.1047
No log	86.8	434	1.2236	0.0556	1.2236	1.1062
No log	87.2	436	1.2104	0.0556	1.2104	1.1002
No log	87.6	438	1.1862	0.0556	1.1862	1.0891
No log	88.0	440	1.1688	0.0556	1.1688	1.0811
No log	88.4	442	1.1607	0.0556	1.1607	1.0773
No log	88.8	444	1.1575	0.0556	1.1575	1.0759
No log	89.2	446	1.1579	0.0556	1.1579	1.0761
No log	89.6	448	1.1638	0.0556	1.1638	1.0788
No log	90.0	450	1.1697	0.0556	1.1697	1.0815
No log	90.4	452	1.1648	0.0556	1.1648	1.0793
No log	90.8	454	1.1662	0.0556	1.1662	1.0799
No log	91.2	456	1.1636	0.0556	1.1636	1.0787
No log	91.6	458	1.1513	0.0556	1.1513	1.0730
No log	92.0	460	1.1393	0.0556	1.1393	1.0674
No log	92.4	462	1.1312	0.0556	1.1312	1.0636
No log	92.8	464	1.1326	0.0556	1.1326	1.0642
No log	93.2	466	1.1291	0.0556	1.1291	1.0626
No log	93.6	468	1.1294	0.0556	1.1294	1.0627
No log	94.0	470	1.1270	0.0556	1.1270	1.0616
No log	94.4	472	1.1249	0.0556	1.1249	1.0606
No log	94.8	474	1.1261	0.0556	1.1261	1.0612
No log	95.2	476	1.1297	0.0556	1.1297	1.0629
No log	95.6	478	1.1334	0.0556	1.1334	1.0646
No log	96.0	480	1.1337	0.0556	1.1337	1.0648
No log	96.4	482	1.1360	0.0556	1.1360	1.0658
No log	96.8	484	1.1364	0.0556	1.1364	1.0660
No log	97.2	486	1.1346	0.0556	1.1346	1.0652
No log	97.6	488	1.1339	0.0556	1.1339	1.0648
No log	98.0	490	1.1330	0.0556	1.1330	1.0644
No log	98.4	492	1.1302	0.0556	1.1302	1.0631
No log	98.8	494	1.1293	0.0556	1.1293	1.0627
No log	99.2	496	1.1291	0.0556	1.1291	1.0626
No log	99.6	498	1.1287	0.0556	1.1287	1.0624
0.1626	100.0	500	1.1284	0.0556	1.1284	1.0623

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1