ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k3_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1797
• Qwk: 0.1115
• Mse: 1.1797
• Rmse: 1.0861

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	2.5978	-0.1213	2.5978	1.6118
No log	0.5	4	1.2736	0.1565	1.2736	1.1285
No log	0.75	6	0.8329	0.1724	0.8329	0.9126
No log	1.0	8	0.8480	0.1953	0.8480	0.9209
No log	1.25	10	0.9110	0.1651	0.9110	0.9545
No log	1.5	12	0.7202	0.1800	0.7202	0.8486
No log	1.75	14	0.7641	0.3807	0.7641	0.8741
No log	2.0	16	0.7821	0.3167	0.7821	0.8843
No log	2.25	18	0.6689	0.3416	0.6689	0.8178
No log	2.5	20	0.6891	0.2819	0.6891	0.8301
No log	2.75	22	0.6996	0.2819	0.6996	0.8364
No log	3.0	24	0.7185	0.2652	0.7185	0.8476
No log	3.25	26	0.7967	0.2817	0.7967	0.8926
No log	3.5	28	0.8994	0.2193	0.8994	0.9484
No log	3.75	30	0.9499	0.1461	0.9499	0.9746
No log	4.0	32	0.8822	0.2012	0.8822	0.9392
No log	4.25	34	0.8537	0.0888	0.8537	0.9239
No log	4.5	36	1.0020	0.1362	1.0020	1.0010
No log	4.75	38	1.1050	0.1525	1.1050	1.0512
No log	5.0	40	0.9958	0.2513	0.9958	0.9979
No log	5.25	42	1.0472	0.2779	1.0472	1.0233
No log	5.5	44	1.0882	0.3003	1.0882	1.0432
No log	5.75	46	1.0204	0.3073	1.0204	1.0101
No log	6.0	48	0.8045	0.2691	0.8045	0.8969
No log	6.25	50	0.8338	0.2576	0.8338	0.9131
No log	6.5	52	1.2321	0.2439	1.2321	1.1100
No log	6.75	54	1.5089	0.1075	1.5089	1.2284
No log	7.0	56	1.4975	0.1075	1.4975	1.2237
No log	7.25	58	1.2323	0.2052	1.2323	1.1101
No log	7.5	60	0.8078	0.2335	0.8078	0.8988
No log	7.75	62	0.7666	0.2140	0.7666	0.8756
No log	8.0	64	0.7767	0.2661	0.7767	0.8813
No log	8.25	66	0.9246	0.2420	0.9246	0.9616
No log	8.5	68	1.5336	0.2412	1.5336	1.2384
No log	8.75	70	1.6378	0.1735	1.6378	1.2798
No log	9.0	72	1.4232	0.2374	1.4232	1.1930
No log	9.25	74	0.9601	0.3019	0.9601	0.9799
No log	9.5	76	0.7671	0.2780	0.7671	0.8758
No log	9.75	78	0.7569	0.2843	0.7569	0.8700
No log	10.0	80	0.9122	0.2464	0.9122	0.9551
No log	10.25	82	1.3179	0.1630	1.3179	1.1480
No log	10.5	84	1.5881	0.1476	1.5881	1.2602
No log	10.75	86	1.4079	0.1473	1.4079	1.1866
No log	11.0	88	1.0955	0.2507	1.0955	1.0466
No log	11.25	90	1.0600	0.2507	1.0600	1.0296
No log	11.5	92	1.1090	0.2032	1.1090	1.0531
No log	11.75	94	1.1782	0.1795	1.1782	1.0854
No log	12.0	96	1.1686	0.1795	1.1686	1.0810
No log	12.25	98	1.0338	0.2504	1.0338	1.0168
No log	12.5	100	0.8381	0.3076	0.8381	0.9155
No log	12.75	102	0.8704	0.2830	0.8704	0.9329
No log	13.0	104	0.7819	0.2781	0.7819	0.8842
No log	13.25	106	0.8204	0.3665	0.8204	0.9058
No log	13.5	108	0.9691	0.2806	0.9691	0.9844
No log	13.75	110	0.9053	0.3579	0.9053	0.9514
No log	14.0	112	0.9427	0.2806	0.9427	0.9709
No log	14.25	114	1.0486	0.2166	1.0486	1.0240
No log	14.5	116	1.3161	0.1907	1.3161	1.1472
No log	14.75	118	1.3602	0.1621	1.3602	1.1663
No log	15.0	120	1.1808	0.1432	1.1808	1.0867
No log	15.25	122	1.0492	0.1599	1.0492	1.0243
No log	15.5	124	1.0591	0.1599	1.0591	1.0291
No log	15.75	126	1.0276	0.2271	1.0276	1.0137
No log	16.0	128	1.0585	0.1591	1.0585	1.0288
No log	16.25	130	1.1431	0.2153	1.1431	1.0692
No log	16.5	132	1.0645	0.2354	1.0645	1.0317
No log	16.75	134	0.9306	0.2487	0.9306	0.9647
No log	17.0	136	1.0395	0.2017	1.0395	1.0196
No log	17.25	138	1.1741	0.2115	1.1741	1.0836
No log	17.5	140	1.0761	0.2227	1.0761	1.0374
No log	17.75	142	0.8487	0.3371	0.8487	0.9212
No log	18.0	144	0.7897	0.3731	0.7897	0.8886
No log	18.25	146	0.8810	0.2703	0.8810	0.9386
No log	18.5	148	1.0248	0.2457	1.0248	1.0123
No log	18.75	150	1.1567	0.1907	1.1567	1.0755
No log	19.0	152	1.0663	0.2412	1.0663	1.0326
No log	19.25	154	0.8433	0.3371	0.8433	0.9183
No log	19.5	156	0.7734	0.2223	0.7734	0.8794
No log	19.75	158	0.8427	0.2643	0.8427	0.9180
No log	20.0	160	1.0531	0.2166	1.0531	1.0262
No log	20.25	162	1.1449	0.1858	1.1449	1.0700
No log	20.5	164	1.0697	0.2227	1.0697	1.0343
No log	20.75	166	1.0152	0.2227	1.0152	1.0076
No log	21.0	168	0.9557	0.2552	0.9557	0.9776
No log	21.25	170	0.8776	0.2756	0.8776	0.9368
No log	21.5	172	0.8514	0.2000	0.8514	0.9227
No log	21.75	174	0.9176	0.2510	0.9176	0.9579
No log	22.0	176	1.0881	0.2070	1.0881	1.0431
No log	22.25	178	1.0294	0.2524	1.0294	1.0146
No log	22.5	180	0.9365	0.2779	0.9365	0.9677
No log	22.75	182	0.9705	0.2703	0.9705	0.9851
No log	23.0	184	1.0456	0.2125	1.0456	1.0225
No log	23.25	186	1.1326	0.1784	1.1326	1.0642
No log	23.5	188	1.2046	0.1458	1.2046	1.0975
No log	23.75	190	1.1106	0.2141	1.1106	1.0538
No log	24.0	192	0.9292	0.2810	0.9292	0.9640
No log	24.25	194	0.8500	0.2094	0.8500	0.9220
No log	24.5	196	0.8703	0.2046	0.8703	0.9329
No log	24.75	198	0.9846	0.2552	0.9846	0.9923
No log	25.0	200	1.2762	0.1175	1.2762	1.1297
No log	25.25	202	1.4407	0.1450	1.4407	1.2003
No log	25.5	204	1.3484	0.1740	1.3484	1.1612
No log	25.75	206	1.0355	0.2166	1.0355	1.0176
No log	26.0	208	0.8013	0.1800	0.8013	0.8952
No log	26.25	210	0.7587	0.2182	0.7587	0.8710
No log	26.5	212	0.7775	0.1850	0.7775	0.8817
No log	26.75	214	0.8857	0.1682	0.8857	0.9411
No log	27.0	216	1.0075	0.1737	1.0075	1.0037
No log	27.25	218	1.1301	0.2141	1.1301	1.0631
No log	27.5	220	1.1666	0.2100	1.1666	1.0801
No log	27.75	222	1.0809	0.2141	1.0809	1.0397
No log	28.0	224	0.9726	0.1747	0.9726	0.9862
No log	28.25	226	0.8900	0.2000	0.8900	0.9434
No log	28.5	228	0.8759	0.1734	0.8759	0.9359
No log	28.75	230	0.9225	0.2000	0.9225	0.9605
No log	29.0	232	1.0500	0.1389	1.0500	1.0247
No log	29.25	234	1.1502	0.1784	1.1502	1.0725
No log	29.5	236	1.1040	0.2084	1.1040	1.0507
No log	29.75	238	0.9380	0.1734	0.9380	0.9685
No log	30.0	240	0.8650	0.1734	0.8650	0.9300
No log	30.25	242	0.8420	0.1914	0.8420	0.9176
No log	30.5	244	0.8989	0.1734	0.8989	0.9481
No log	30.75	246	0.9640	0.2075	0.9640	0.9818
No log	31.0	248	1.0696	0.2166	1.0696	1.0342
No log	31.25	250	1.0600	0.2166	1.0600	1.0296
No log	31.5	252	0.9685	0.1457	0.9685	0.9841
No log	31.75	254	0.9977	0.2209	0.9977	0.9988
No log	32.0	256	1.0203	0.1699	1.0203	1.0101
No log	32.25	258	1.1035	0.1356	1.1035	1.0505
No log	32.5	260	1.2101	0.1713	1.2101	1.1000
No log	32.75	262	1.2514	0.1427	1.2514	1.1186
No log	33.0	264	1.2165	0.1458	1.2165	1.1030
No log	33.25	266	1.1950	0.1262	1.1950	1.0932
No log	33.5	268	1.0917	0.1115	1.0917	1.0448
No log	33.75	270	1.0964	0.1146	1.0964	1.0471
No log	34.0	272	1.0883	0.1176	1.0883	1.0432
No log	34.25	274	1.1267	0.0816	1.1267	1.0614
No log	34.5	276	1.2014	0.1262	1.2014	1.0961
No log	34.75	278	1.2300	0.1458	1.2300	1.1090
No log	35.0	280	1.2075	0.1523	1.2075	1.0989
No log	35.25	282	1.1354	0.1057	1.1354	1.0655
No log	35.5	284	1.0550	0.1356	1.0550	1.0271
No log	35.75	286	0.8941	0.2463	0.8941	0.9456
No log	36.0	288	0.8096	0.2244	0.8096	0.8998
No log	36.25	290	0.8069	0.2244	0.8069	0.8983
No log	36.5	292	0.8626	0.2518	0.8626	0.9288
No log	36.75	294	0.9642	0.1535	0.9642	0.9820
No log	37.0	296	1.0260	0.2227	1.0260	1.0129
No log	37.25	298	1.0318	0.2227	1.0318	1.0158
No log	37.5	300	0.9790	0.2552	0.9790	0.9895
No log	37.75	302	0.9708	0.1787	0.9708	0.9853
No log	38.0	304	1.0326	0.1858	1.0326	1.0162
No log	38.25	306	1.0411	0.1115	1.0411	1.0203
No log	38.5	308	0.9439	0.1343	0.9439	0.9715
No log	38.75	310	0.9130	0.1454	0.9130	0.9555
No log	39.0	312	0.9548	0.1603	0.9548	0.9771
No log	39.25	314	1.0229	0.1384	1.0229	1.0114
No log	39.5	316	1.1177	0.1384	1.1177	1.0572
No log	39.75	318	1.2180	0.2264	1.2180	1.1036
No log	40.0	320	1.3210	0.1613	1.3210	1.1494
No log	40.25	322	1.2648	0.1944	1.2648	1.1246
No log	40.5	324	1.1365	0.2635	1.1365	1.0661
No log	40.75	326	0.9542	0.1535	0.9542	0.9768
No log	41.0	328	0.7895	0.3032	0.7895	0.8885
No log	41.25	330	0.7724	0.2883	0.7724	0.8788
No log	41.5	332	0.8533	0.2193	0.8533	0.9237
No log	41.75	334	0.9769	0.0925	0.9769	0.9884
No log	42.0	336	1.1603	0.1858	1.1603	1.0772
No log	42.25	338	1.3117	0.1968	1.3117	1.1453
No log	42.5	340	1.3368	0.1895	1.3368	1.1562
No log	42.75	342	1.2103	0.2264	1.2103	1.1001
No log	43.0	344	1.0425	0.1747	1.0425	1.0210
No log	43.25	346	0.9260	0.1348	0.9260	0.9623
No log	43.5	348	0.8924	0.1348	0.8924	0.9447
No log	43.75	350	0.9006	0.0983	0.9006	0.9490
No log	44.0	352	0.9409	0.0983	0.9409	0.9700
No log	44.25	354	0.9555	0.0983	0.9555	0.9775
No log	44.5	356	1.0044	0.0666	1.0044	1.0022
No log	44.75	358	1.0064	0.1146	1.0064	1.0032
No log	45.0	360	0.9664	0.1612	0.9664	0.9831
No log	45.25	362	0.9249	0.1348	0.9249	0.9617
No log	45.5	364	0.9190	0.1348	0.9190	0.9587
No log	45.75	366	0.8779	0.1348	0.8779	0.9370
No log	46.0	368	0.8900	0.1348	0.8900	0.9434
No log	46.25	370	0.9082	0.1348	0.9082	0.9530
No log	46.5	372	0.8901	0.1734	0.8901	0.9435
No log	46.75	374	0.8522	0.1914	0.8522	0.9232
No log	47.0	376	0.8180	0.2116	0.8180	0.9045
No log	47.25	378	0.8128	0.2116	0.8128	0.9015
No log	47.5	380	0.8649	0.1501	0.8649	0.9300
No log	47.75	382	0.9834	0.1348	0.9834	0.9917
No log	48.0	384	1.0825	0.1146	1.0825	1.0404
No log	48.25	386	1.1209	0.1115	1.1209	1.0587
No log	48.5	388	1.1145	0.0869	1.1145	1.0557
No log	48.75	390	1.1138	0.0896	1.1138	1.0553
No log	49.0	392	1.1513	0.1356	1.1513	1.0730
No log	49.25	394	1.1307	0.1146	1.1307	1.0634
No log	49.5	396	1.0612	0.0925	1.0612	1.0302
No log	49.75	398	1.0244	0.0666	1.0244	1.0121
No log	50.0	400	1.0217	0.0666	1.0217	1.0108
No log	50.25	402	0.9620	0.0719	0.9620	0.9808
No log	50.5	404	0.9273	0.1077	0.9273	0.9630
No log	50.75	406	0.9396	0.1045	0.9396	0.9693
No log	51.0	408	0.9840	0.0719	0.9840	0.9920
No log	51.25	410	1.0202	0.0925	1.0202	1.0100
No log	51.5	412	1.0864	0.0896	1.0864	1.0423
No log	51.75	414	1.1525	0.1115	1.1525	1.0735
No log	52.0	416	1.1989	0.2084	1.1989	1.0949
No log	52.25	418	1.2067	0.2084	1.2067	1.0985
No log	52.5	420	1.1813	0.1115	1.1813	1.0869
No log	52.75	422	1.1353	0.1115	1.1353	1.0655
No log	53.0	424	1.0763	0.1176	1.0763	1.0375
No log	53.25	426	1.0367	0.1241	1.0367	1.0182
No log	53.5	428	1.0560	0.1241	1.0560	1.0276
No log	53.75	430	1.0736	0.0925	1.0736	1.0361
No log	54.0	432	1.1272	0.0896	1.1272	1.0617
No log	54.25	434	1.1646	0.1146	1.1646	1.0792
No log	54.5	436	1.2107	0.1774	1.2107	1.1003
No log	54.75	438	1.2536	0.1774	1.2536	1.1196
No log	55.0	440	1.3066	0.2247	1.3066	1.1431
No log	55.25	442	1.3519	0.2153	1.3519	1.1627
No log	55.5	444	1.3243	0.2153	1.3243	1.1508
No log	55.75	446	1.2132	0.1810	1.2132	1.1014
No log	56.0	448	1.1434	0.0896	1.1434	1.0693
No log	56.25	450	1.1130	0.0925	1.1130	1.0550
No log	56.5	452	1.1289	0.1146	1.1289	1.0625
No log	56.75	454	1.1576	0.1626	1.1576	1.0759
No log	57.0	456	1.1671	0.1626	1.1671	1.0803
No log	57.25	458	1.2013	0.1591	1.2013	1.0960
No log	57.5	460	1.2236	0.1591	1.2236	1.1062
No log	57.75	462	1.2336	0.1591	1.2336	1.1107
No log	58.0	464	1.2363	0.1557	1.2363	1.1119
No log	58.25	466	1.2010	0.1626	1.2010	1.0959
No log	58.5	468	1.1848	0.1626	1.1848	1.0885
No log	58.75	470	1.1465	0.1626	1.1465	1.0707
No log	59.0	472	1.1607	0.1557	1.1607	1.0774
No log	59.25	474	1.1806	0.1557	1.1806	1.0865
No log	59.5	476	1.2185	0.1748	1.2185	1.1038
No log	59.75	478	1.2458	0.1748	1.2458	1.1162
No log	60.0	480	1.2240	0.1262	1.2240	1.1063
No log	60.25	482	1.1469	0.1626	1.1469	1.0710
No log	60.5	484	1.0861	0.1176	1.0861	1.0422
No log	60.75	486	1.0683	0.1176	1.0683	1.0336
No log	61.0	488	1.0807	0.1176	1.0807	1.0395
No log	61.25	490	1.1201	0.1422	1.1201	1.0583
No log	61.5	492	1.1326	0.1422	1.1326	1.0643
No log	61.75	494	1.1788	0.1626	1.1788	1.0857
No log	62.0	496	1.1943	0.1591	1.1943	1.0928
No log	62.25	498	1.2174	0.1293	1.2174	1.1034
0.1803	62.5	500	1.1909	0.1626	1.1909	1.0913
0.1803	62.75	502	1.1130	0.0925	1.1130	1.0550
0.1803	63.0	504	1.0620	0.0925	1.0620	1.0305
0.1803	63.25	506	1.0656	0.0925	1.0656	1.0323
0.1803	63.5	508	1.1097	0.0925	1.1097	1.0534
0.1803	63.75	510	1.1797	0.1115	1.1797	1.0861

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1