ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2937
• Qwk: 0.0975
• Mse: 1.2937
• Rmse: 1.1374

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	2.5978	-0.1213	2.5978	1.6118
No log	0.5	4	1.2736	0.1565	1.2736	1.1285
No log	0.75	6	0.8329	0.1724	0.8329	0.9126
No log	1.0	8	0.8480	0.1953	0.8480	0.9209
No log	1.25	10	0.9110	0.1651	0.9110	0.9545
No log	1.5	12	0.7202	0.1800	0.7202	0.8486
No log	1.75	14	0.7641	0.3807	0.7641	0.8741
No log	2.0	16	0.7821	0.3167	0.7821	0.8843
No log	2.25	18	0.6689	0.3416	0.6689	0.8178
No log	2.5	20	0.6891	0.2819	0.6891	0.8301
No log	2.75	22	0.6996	0.2819	0.6996	0.8364
No log	3.0	24	0.7185	0.2652	0.7185	0.8476
No log	3.25	26	0.7967	0.2817	0.7967	0.8926
No log	3.5	28	0.8994	0.2193	0.8994	0.9484
No log	3.75	30	0.9499	0.1461	0.9499	0.9746
No log	4.0	32	0.8822	0.2012	0.8822	0.9392
No log	4.25	34	0.8537	0.0888	0.8537	0.9239
No log	4.5	36	1.0020	0.1362	1.0020	1.0010
No log	4.75	38	1.1050	0.1525	1.1050	1.0512
No log	5.0	40	0.9958	0.2513	0.9958	0.9979
No log	5.25	42	1.0472	0.2779	1.0472	1.0233
No log	5.5	44	1.0882	0.3003	1.0882	1.0432
No log	5.75	46	1.0204	0.3073	1.0204	1.0101
No log	6.0	48	0.8045	0.2691	0.8045	0.8969
No log	6.25	50	0.8338	0.2576	0.8338	0.9131
No log	6.5	52	1.2321	0.2439	1.2321	1.1100
No log	6.75	54	1.5089	0.1075	1.5089	1.2284
No log	7.0	56	1.4975	0.1075	1.4975	1.2237
No log	7.25	58	1.2323	0.2052	1.2323	1.1101
No log	7.5	60	0.8078	0.2335	0.8078	0.8988
No log	7.75	62	0.7666	0.2140	0.7666	0.8756
No log	8.0	64	0.7767	0.2661	0.7767	0.8813
No log	8.25	66	0.9246	0.2420	0.9246	0.9616
No log	8.5	68	1.5336	0.2412	1.5336	1.2384
No log	8.75	70	1.6378	0.1735	1.6378	1.2798
No log	9.0	72	1.4232	0.2374	1.4232	1.1930
No log	9.25	74	0.9601	0.3019	0.9601	0.9799
No log	9.5	76	0.7671	0.2780	0.7671	0.8758
No log	9.75	78	0.7569	0.2843	0.7569	0.8700
No log	10.0	80	0.9122	0.2464	0.9122	0.9551
No log	10.25	82	1.3178	0.1630	1.3178	1.1480
No log	10.5	84	1.5881	0.1476	1.5881	1.2602
No log	10.75	86	1.4079	0.1473	1.4079	1.1866
No log	11.0	88	1.0954	0.2507	1.0954	1.0466
No log	11.25	90	1.0600	0.2507	1.0600	1.0296
No log	11.5	92	1.1090	0.2032	1.1090	1.0531
No log	11.75	94	1.1782	0.1795	1.1782	1.0855
No log	12.0	96	1.1686	0.1795	1.1686	1.0810
No log	12.25	98	1.0338	0.2504	1.0338	1.0168
No log	12.5	100	0.8381	0.3076	0.8381	0.9155
No log	12.75	102	0.8704	0.2830	0.8704	0.9329
No log	13.0	104	0.7819	0.2781	0.7819	0.8842
No log	13.25	106	0.8204	0.3665	0.8204	0.9057
No log	13.5	108	0.9691	0.2806	0.9691	0.9844
No log	13.75	110	0.9053	0.3579	0.9053	0.9515
No log	14.0	112	0.9428	0.2806	0.9428	0.9710
No log	14.25	114	1.0487	0.2166	1.0487	1.0241
No log	14.5	116	1.3162	0.1907	1.3162	1.1473
No log	14.75	118	1.3602	0.1621	1.3602	1.1663
No log	15.0	120	1.1808	0.1432	1.1808	1.0867
No log	15.25	122	1.0493	0.1599	1.0493	1.0244
No log	15.5	124	1.0592	0.1599	1.0592	1.0292
No log	15.75	126	1.0275	0.2271	1.0275	1.0137
No log	16.0	128	1.0584	0.1591	1.0584	1.0288
No log	16.25	130	1.1430	0.2153	1.1430	1.0691
No log	16.5	132	1.0646	0.2354	1.0646	1.0318
No log	16.75	134	0.9308	0.2147	0.9308	0.9648
No log	17.0	136	1.0397	0.2017	1.0397	1.0196
No log	17.25	138	1.1743	0.2115	1.1743	1.0836
No log	17.5	140	1.0761	0.2271	1.0761	1.0373
No log	17.75	142	0.8486	0.3371	0.8486	0.9212
No log	18.0	144	0.7898	0.3731	0.7898	0.8887
No log	18.25	146	0.8813	0.2703	0.8813	0.9388
No log	18.5	148	1.0253	0.2457	1.0253	1.0126
No log	18.75	150	1.1573	0.1907	1.1573	1.0758
No log	19.0	152	1.0668	0.2412	1.0668	1.0329
No log	19.25	154	0.8436	0.3371	0.8436	0.9185
No log	19.5	156	0.7733	0.2223	0.7733	0.8794
No log	19.75	158	0.8422	0.2643	0.8422	0.9177
No log	20.0	160	1.0519	0.2166	1.0519	1.0256
No log	20.25	162	1.1444	0.1858	1.1444	1.0698
No log	20.5	164	1.0700	0.2227	1.0700	1.0344
No log	20.75	166	1.0159	0.2227	1.0159	1.0079
No log	21.0	168	0.9563	0.2552	0.9563	0.9779
No log	21.25	170	0.8778	0.2756	0.8778	0.9369
No log	21.5	172	0.8514	0.2000	0.8514	0.9227
No log	21.75	174	0.9177	0.2510	0.9177	0.9579
No log	22.0	176	1.0882	0.2070	1.0882	1.0432
No log	22.25	178	1.0294	0.2524	1.0294	1.0146
No log	22.5	180	0.9365	0.2779	0.9365	0.9677
No log	22.75	182	0.9708	0.2703	0.9708	0.9853
No log	23.0	184	1.0461	0.2125	1.0461	1.0228
No log	23.25	186	1.1331	0.1784	1.1331	1.0645
No log	23.5	188	1.2051	0.1458	1.2051	1.0978
No log	23.75	190	1.1105	0.2141	1.1105	1.0538
No log	24.0	192	0.9287	0.2810	0.9287	0.9637
No log	24.25	194	0.8495	0.1822	0.8495	0.9217
No log	24.5	196	0.8698	0.2046	0.8698	0.9326
No log	24.75	198	0.9842	0.2552	0.9842	0.9921
No log	25.0	200	1.2756	0.1175	1.2756	1.1294
No log	25.25	202	1.4400	0.1450	1.4400	1.2000
No log	25.5	204	1.3482	0.1740	1.3482	1.1611
No log	25.75	206	1.0357	0.2166	1.0357	1.0177
No log	26.0	208	0.8016	0.1800	0.8016	0.8953
No log	26.25	210	0.7589	0.2182	0.7589	0.8712
No log	26.5	212	0.7779	0.1850	0.7779	0.8820
No log	26.75	214	0.8867	0.1682	0.8867	0.9416
No log	27.0	216	1.0086	0.1737	1.0086	1.0043
No log	27.25	218	1.1310	0.2141	1.1310	1.0635
No log	27.5	220	1.1675	0.2100	1.1675	1.0805
No log	27.75	222	1.0818	0.2141	1.0818	1.0401
No log	28.0	224	0.9734	0.1747	0.9734	0.9866
No log	28.25	226	0.8912	0.2000	0.8912	0.9440
No log	28.5	228	0.8777	0.1734	0.8777	0.9369
No log	28.75	230	0.9246	0.2000	0.9246	0.9616
No log	29.0	232	1.0525	0.1389	1.0525	1.0259
No log	29.25	234	1.1526	0.1784	1.1526	1.0736
No log	29.5	236	1.1066	0.2084	1.1066	1.0519
No log	29.75	238	0.9406	0.1348	0.9406	0.9699
No log	30.0	240	0.8672	0.1734	0.8672	0.9312
No log	30.25	242	0.8438	0.1914	0.8438	0.9186
No log	30.5	244	0.8996	0.1734	0.8996	0.9485
No log	30.75	246	0.9638	0.2075	0.9638	0.9817
No log	31.0	248	1.0681	0.2166	1.0681	1.0335
No log	31.25	250	1.0578	0.2166	1.0578	1.0285
No log	31.5	252	0.9664	0.1775	0.9664	0.9830
No log	31.75	254	0.9976	0.2209	0.9976	0.9988
No log	32.0	256	1.0240	0.1699	1.0240	1.0119
No log	32.25	258	1.1137	0.1523	1.1137	1.0553
No log	32.5	260	1.2260	0.1427	1.2260	1.1072
No log	32.75	262	1.2563	0.1427	1.2563	1.1209
No log	33.0	264	1.2085	0.1458	1.2085	1.0993
No log	33.25	266	1.1842	0.1262	1.1842	1.0882
No log	33.5	268	1.0808	0.1115	1.0808	1.0396
No log	33.75	270	1.0838	0.1176	1.0838	1.0410
No log	34.0	272	1.0747	0.1176	1.0747	1.0367
No log	34.25	274	1.1171	0.0816	1.1171	1.0569
No log	34.5	276	1.1950	0.1262	1.1950	1.0932
No log	34.75	278	1.2257	0.1748	1.2257	1.1071
No log	35.0	280	1.2008	0.1523	1.2008	1.0958
No log	35.25	282	1.1290	0.1057	1.1290	1.0625
No log	35.5	284	1.0480	0.1115	1.0480	1.0237
No log	35.75	286	0.8875	0.2463	0.8875	0.9420
No log	36.0	288	0.8057	0.2244	0.8057	0.8976
No log	36.25	290	0.8036	0.2244	0.8036	0.8965
No log	36.5	292	0.8608	0.2518	0.8608	0.9278
No log	36.75	294	0.9645	0.1535	0.9645	0.9821
No log	37.0	296	1.0261	0.2227	1.0261	1.0130
No log	37.25	298	1.0267	0.2227	1.0267	1.0133
No log	37.5	300	0.9737	0.2552	0.9737	0.9868
No log	37.75	302	0.9644	0.1535	0.9644	0.9821
No log	38.0	304	1.0284	0.1115	1.0284	1.0141
No log	38.25	306	1.0456	0.1115	1.0456	1.0225
No log	38.5	308	0.9456	0.1014	0.9456	0.9724
No log	38.75	310	0.9055	0.1454	0.9055	0.9516
No log	39.0	312	0.9376	0.1984	0.9376	0.9683
No log	39.25	314	0.9980	0.1384	0.9980	0.9990
No log	39.5	316	1.0898	0.1384	1.0898	1.0439
No log	39.75	318	1.1949	0.1557	1.1949	1.0931
No log	40.0	320	1.2961	0.1613	1.2961	1.1385
No log	40.25	322	1.2395	0.1944	1.2395	1.1133
No log	40.5	324	1.1154	0.2954	1.1154	1.0561
No log	40.75	326	0.9375	0.1277	0.9375	0.9682
No log	41.0	328	0.7762	0.2754	0.7762	0.8810
No log	41.25	330	0.7583	0.2883	0.7583	0.8708
No log	41.5	332	0.8358	0.2574	0.8358	0.9142
No log	41.75	334	0.9598	0.0925	0.9598	0.9797
No log	42.0	336	1.1429	0.1858	1.1429	1.0691
No log	42.25	338	1.2895	0.2264	1.2895	1.1355
No log	42.5	340	1.3155	0.1895	1.3155	1.1470
No log	42.75	342	1.1938	0.1784	1.1938	1.0926
No log	43.0	344	1.0301	0.1747	1.0301	1.0149
No log	43.25	346	0.9111	0.1348	0.9111	0.9545
No log	43.5	348	0.8757	0.1348	0.8757	0.9358
No log	43.75	350	0.8922	0.1348	0.8922	0.9446
No log	44.0	352	0.9428	0.0983	0.9428	0.9710
No log	44.25	354	0.9602	0.0983	0.9602	0.9799
No log	44.5	356	1.0093	0.0896	1.0093	1.0046
No log	44.75	358	1.0126	0.1463	1.0126	1.0063
No log	45.0	360	0.9734	0.1535	0.9734	0.9866
No log	45.25	362	0.9314	0.1348	0.9314	0.9651
No log	45.5	364	0.9250	0.1348	0.9250	0.9618
No log	45.75	366	0.8881	0.1348	0.8881	0.9424
No log	46.0	368	0.9034	0.1348	0.9034	0.9505
No log	46.25	370	0.9221	0.1348	0.9221	0.9602
No log	46.5	372	0.9095	0.1348	0.9095	0.9537
No log	46.75	374	0.8701	0.1501	0.8701	0.9328
No log	47.0	376	0.8342	0.1962	0.8342	0.9134
No log	47.25	378	0.8266	0.2409	0.8266	0.9091
No log	47.5	380	0.8778	0.1501	0.8778	0.9369
No log	47.75	382	1.0023	0.0983	1.0023	1.0011
No log	48.0	384	1.1107	0.1115	1.1107	1.0539
No log	48.25	386	1.1509	0.1591	1.1509	1.0728
No log	48.5	388	1.1328	0.1356	1.1328	1.0643
No log	48.75	390	1.1354	0.1591	1.1354	1.0655
No log	49.0	392	1.1811	0.1591	1.1811	1.0868
No log	49.25	394	1.1584	0.1591	1.1584	1.0763
No log	49.5	396	1.0767	0.0925	1.0767	1.0376
No log	49.75	398	1.0295	0.0925	1.0295	1.0147
No log	50.0	400	1.0162	0.0666	1.0162	1.0081
No log	50.25	402	0.9571	0.0719	0.9571	0.9783
No log	50.5	404	0.9216	0.1461	0.9216	0.9600
No log	50.75	406	0.9312	0.1110	0.9312	0.9650
No log	51.0	408	0.9715	0.1077	0.9715	0.9856
No log	51.25	410	1.0044	0.1612	1.0044	1.0022
No log	51.5	412	1.0723	0.0896	1.0723	1.0355
No log	51.75	414	1.1469	0.1389	1.1469	1.0709
No log	52.0	416	1.2057	0.2084	1.2057	1.0980
No log	52.25	418	1.2294	0.2084	1.2294	1.1088
No log	52.5	420	1.2131	0.1591	1.2131	1.1014
No log	52.75	422	1.1743	0.1591	1.1743	1.0837
No log	53.0	424	1.1226	0.1591	1.1226	1.0595
No log	53.25	426	1.0701	0.1389	1.0701	1.0344
No log	53.5	428	1.0707	0.1146	1.0707	1.0348
No log	53.75	430	1.0637	0.0925	1.0637	1.0314
No log	54.0	432	1.0922	0.1146	1.0922	1.0451
No log	54.25	434	1.1062	0.1146	1.1062	1.0518
No log	54.5	436	1.1628	0.1626	1.1628	1.0783
No log	54.75	438	1.2400	0.1774	1.2400	1.1135
No log	55.0	440	1.3380	0.1696	1.3380	1.1567
No log	55.25	442	1.4272	0.1873	1.4272	1.1947
No log	55.5	444	1.4296	0.1873	1.4296	1.1957
No log	55.75	446	1.3379	0.1696	1.3379	1.1567
No log	56.0	448	1.2766	0.1696	1.2766	1.1299
No log	56.25	450	1.2346	0.1591	1.2346	1.1111
No log	56.5	452	1.2457	0.1591	1.2457	1.1161
No log	56.75	454	1.2674	0.1293	1.2674	1.1258
No log	57.0	456	1.2554	0.1591	1.2554	1.1204
No log	57.25	458	1.2767	0.1293	1.2767	1.1299
No log	57.5	460	1.2995	0.1262	1.2995	1.1400
No log	57.75	462	1.3089	0.1262	1.3089	1.1441
No log	58.0	464	1.3107	0.1262	1.3107	1.1448
No log	58.25	466	1.2622	0.1591	1.2622	1.1235
No log	58.5	468	1.2367	0.1591	1.2367	1.1121
No log	58.75	470	1.2111	0.1591	1.2111	1.1005
No log	59.0	472	1.2186	0.1557	1.2186	1.1039
No log	59.25	474	1.2007	0.1262	1.2007	1.0958
No log	59.5	476	1.2244	0.1599	1.2244	1.1065
No log	59.75	478	1.2514	0.1458	1.2514	1.1187
No log	60.0	480	1.2382	0.1458	1.2382	1.1127
No log	60.25	482	1.1724	0.1557	1.1724	1.0828
No log	60.5	484	1.1348	0.1662	1.1348	1.0653
No log	60.75	486	1.1314	0.1626	1.1314	1.0637
No log	61.0	488	1.1302	0.1662	1.1302	1.0631
No log	61.25	490	1.1585	0.1626	1.1585	1.0763
No log	61.5	492	1.1640	0.1626	1.1640	1.0789
No log	61.75	494	1.1949	0.1626	1.1949	1.0931
No log	62.0	496	1.2124	0.1324	1.2124	1.1011
No log	62.25	498	1.2585	0.1262	1.2585	1.1218
0.1804	62.5	500	1.2591	0.1262	1.2591	1.1221
0.1804	62.75	502	1.2168	0.1293	1.2168	1.1031
0.1804	63.0	504	1.2019	0.1293	1.2019	1.0963
0.1804	63.25	506	1.2375	0.0975	1.2375	1.1124
0.1804	63.5	508	1.2780	0.0975	1.2780	1.1305
0.1804	63.75	510	1.3201	0.0975	1.3201	1.1489
0.1804	64.0	512	1.3298	0.0975	1.3298	1.1532
0.1804	64.25	514	1.2937	0.0975	1.2937	1.1374

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1