ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k5_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2546
• Qwk: 0.1453
• Mse: 1.2546
• Rmse: 1.1201

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	2.4558	-0.0449	2.4558	1.5671
No log	0.3333	4	1.2629	0.1882	1.2629	1.1238
No log	0.5	6	1.1918	-0.1866	1.1918	1.0917
No log	0.6667	8	1.1384	-0.1492	1.1384	1.0669
No log	0.8333	10	0.8990	0.1254	0.8990	0.9482
No log	1.0	12	0.7821	0.1737	0.7821	0.8843
No log	1.1667	14	0.8093	0.2103	0.8093	0.8996
No log	1.3333	16	0.7619	0.1138	0.7619	0.8729
No log	1.5	18	0.8983	0.2094	0.8983	0.9478
No log	1.6667	20	1.0006	0.1990	1.0006	1.0003
No log	1.8333	22	0.9355	0.0924	0.9355	0.9672
No log	2.0	24	0.8456	-0.0054	0.8456	0.9195
No log	2.1667	26	0.8250	0.0	0.8250	0.9083
No log	2.3333	28	0.8003	0.0428	0.8003	0.8946
No log	2.5	30	0.7562	0.0428	0.7562	0.8696
No log	2.6667	32	0.7069	0.1617	0.7069	0.8408
No log	2.8333	34	0.6652	0.2786	0.6652	0.8156
No log	3.0	36	0.6421	0.2786	0.6421	0.8013
No log	3.1667	38	0.6285	0.3151	0.6285	0.7928
No log	3.3333	40	0.6167	0.2923	0.6167	0.7853
No log	3.5	42	0.6230	0.2923	0.6230	0.7893
No log	3.6667	44	0.6669	0.2751	0.6669	0.8166
No log	3.8333	46	0.9056	0.2287	0.9056	0.9516
No log	4.0	48	0.9567	0.2964	0.9567	0.9781
No log	4.1667	50	0.6701	0.2960	0.6701	0.8186
No log	4.3333	52	0.6849	0.2576	0.6849	0.8276
No log	4.5	54	1.0355	0.3370	1.0355	1.0176
No log	4.6667	56	1.1746	0.2843	1.1746	1.0838
No log	4.8333	58	0.8429	0.4114	0.8429	0.9181
No log	5.0	60	0.7358	0.4606	0.7358	0.8578
No log	5.1667	62	0.7382	0.4606	0.7382	0.8592
No log	5.3333	64	1.1225	0.3166	1.1225	1.0595
No log	5.5	66	1.2132	0.3255	1.2132	1.1014
No log	5.6667	68	0.8601	0.4180	0.8601	0.9274
No log	5.8333	70	0.7290	0.3946	0.7290	0.8538
No log	6.0	72	0.9108	0.2890	0.9108	0.9543
No log	6.1667	74	0.8193	0.3505	0.8193	0.9052
No log	6.3333	76	0.7107	0.3335	0.7107	0.8430
No log	6.5	78	0.9283	0.3516	0.9283	0.9635
No log	6.6667	80	0.9761	0.3114	0.9761	0.9880
No log	6.8333	82	0.8797	0.4347	0.8797	0.9379
No log	7.0	84	0.7779	0.3393	0.7779	0.8820
No log	7.1667	86	0.7886	0.3051	0.7886	0.8880
No log	7.3333	88	1.0793	0.2963	1.0793	1.0389
No log	7.5	90	1.5712	0.1932	1.5712	1.2535
No log	7.6667	92	1.4735	0.2145	1.4735	1.2139
No log	7.8333	94	0.9924	0.3212	0.9924	0.9962
No log	8.0	96	0.7131	0.3995	0.7131	0.8444
No log	8.1667	98	0.6939	0.3995	0.6939	0.8330
No log	8.3333	100	0.8139	0.4614	0.8139	0.9022
No log	8.5	102	1.1798	0.2459	1.1798	1.0862
No log	8.6667	104	1.4972	0.1522	1.4972	1.2236
No log	8.8333	106	1.3106	0.2243	1.3106	1.1448
No log	9.0	108	0.8940	0.2363	0.8940	0.9455
No log	9.1667	110	0.7475	0.3088	0.7475	0.8646
No log	9.3333	112	0.7726	0.2012	0.7726	0.8790
No log	9.5	114	0.8945	0.2601	0.8945	0.9458
No log	9.6667	116	1.1900	0.2543	1.1900	1.0909
No log	9.8333	118	1.4968	0.1067	1.4968	1.2234
No log	10.0	120	1.5081	0.0846	1.5081	1.2281
No log	10.1667	122	1.2064	0.2020	1.2064	1.0984
No log	10.3333	124	1.0775	0.2006	1.0775	1.0380
No log	10.5	126	1.0148	0.2084	1.0148	1.0074
No log	10.6667	128	1.0714	0.2084	1.0714	1.0351
No log	10.8333	130	1.2006	0.1713	1.2006	1.0957
No log	11.0	132	1.4582	0.1337	1.4582	1.2076
No log	11.1667	134	1.6405	0.0290	1.6405	1.2808
No log	11.3333	136	1.6060	0.0505	1.6060	1.2673
No log	11.5	138	1.3509	0.1550	1.3509	1.1623
No log	11.6667	140	1.0187	0.2227	1.0187	1.0093
No log	11.8333	142	0.8503	0.1962	0.8503	0.9221
No log	12.0	144	0.8500	0.1914	0.8500	0.9219
No log	12.1667	146	0.9616	0.3251	0.9616	0.9806
No log	12.3333	148	1.0172	0.3517	1.0172	1.0086
No log	12.5	150	0.9317	0.2866	0.9317	0.9653
No log	12.6667	152	0.9038	0.2923	0.9038	0.9507
No log	12.8333	154	0.9967	0.3029	0.9967	0.9983
No log	13.0	156	1.1003	0.2348	1.1003	1.0490
No log	13.1667	158	1.1111	0.2125	1.1111	1.0541
No log	13.3333	160	1.2615	0.1884	1.2615	1.1232
No log	13.5	162	1.3680	0.1606	1.3680	1.1696
No log	13.6667	164	1.3305	0.1606	1.3305	1.1535
No log	13.8333	166	1.2244	0.1956	1.2244	1.1065
No log	14.0	168	1.0384	0.2119	1.0384	1.0190
No log	14.1667	170	0.9425	0.1692	0.9425	0.9708
No log	14.3333	172	0.9518	0.2308	0.9518	0.9756
No log	14.5	174	0.9077	0.1867	0.9077	0.9527
No log	14.6667	176	0.8980	0.1584	0.8980	0.9476
No log	14.8333	178	0.8506	0.2063	0.8506	0.9223
No log	15.0	180	0.8813	0.2012	0.8813	0.9388
No log	15.1667	182	1.0732	0.1935	1.0732	1.0360
No log	15.3333	184	1.3388	0.1849	1.3388	1.1571
No log	15.5	186	1.3720	0.1849	1.3720	1.1713
No log	15.6667	188	1.2399	0.1392	1.2399	1.1135
No log	15.8333	190	1.1502	0.2348	1.1502	1.0725
No log	16.0	192	1.0515	0.1499	1.0515	1.0254
No log	16.1667	194	1.0342	0.1277	1.0342	1.0170
No log	16.3333	196	1.1279	0.1949	1.1279	1.0620
No log	16.5	198	1.1560	0.1949	1.1560	1.0752
No log	16.6667	200	1.2607	0.1795	1.2607	1.1228
No log	16.8333	202	1.2653	0.1795	1.2653	1.1249
No log	17.0	204	1.2890	0.1530	1.2890	1.1354
No log	17.1667	206	1.2550	0.2006	1.2550	1.1203
No log	17.3333	208	1.2279	0.1748	1.2279	1.1081
No log	17.5	210	1.2321	0.1564	1.2321	1.1100
No log	17.6667	212	1.1842	0.2045	1.1842	1.0882
No log	17.8333	214	1.1120	0.1492	1.1120	1.0545
No log	18.0	216	1.1456	0.1810	1.1456	1.0703
No log	18.1667	218	1.2446	0.1422	1.2446	1.1156
No log	18.3333	220	1.3607	0.1606	1.3607	1.1665
No log	18.5	222	1.3613	0.2006	1.3613	1.1668
No log	18.6667	224	1.1951	0.1821	1.1951	1.0932
No log	18.8333	226	0.9870	0.1897	0.9870	0.9935
No log	19.0	228	0.9179	0.2275	0.9179	0.9581
No log	19.1667	230	0.9485	0.2387	0.9485	0.9739
No log	19.3333	232	1.0046	0.2487	1.0046	1.0023
No log	19.5	234	1.0211	0.2343	1.0211	1.0105
No log	19.6667	236	1.0828	0.2372	1.0828	1.0406
No log	19.8333	238	1.1565	0.1993	1.1565	1.0754
No log	20.0	240	1.0513	0.1775	1.0513	1.0253
No log	20.1667	242	1.0046	0.1651	1.0046	1.0023
No log	20.3333	244	0.9749	0.1777	0.9749	0.9874
No log	20.5	246	0.9639	0.2046	0.9639	0.9818
No log	20.6667	248	0.9509	0.2358	0.9509	0.9751
No log	20.8333	250	0.9954	0.2211	0.9954	0.9977
No log	21.0	252	1.0227	0.2756	1.0227	1.0113
No log	21.1667	254	1.1063	0.2227	1.1063	1.0518
No log	21.3333	256	1.0847	0.2552	1.0847	1.0415
No log	21.5	258	0.9606	0.2211	0.9606	0.9801
No log	21.6667	260	0.9072	0.2562	0.9072	0.9525
No log	21.8333	262	0.9346	0.2562	0.9346	0.9667
No log	22.0	264	1.0048	0.2833	1.0048	1.0024
No log	22.1667	266	1.0558	0.2782	1.0558	1.0275
No log	22.3333	268	1.0922	0.2590	1.0922	1.0451
No log	22.5	270	1.0383	0.1689	1.0383	1.0190
No log	22.6667	272	0.9149	0.2464	0.9149	0.9565
No log	22.8333	274	0.8534	0.1899	0.8534	0.9238
No log	23.0	276	0.8798	0.1534	0.8798	0.9380
No log	23.1667	278	0.8427	0.2063	0.8427	0.9180
No log	23.3333	280	0.8503	0.1672	0.8503	0.9221
No log	23.5	282	0.9652	0.1984	0.9652	0.9824
No log	23.6667	284	1.1081	0.2101	1.1081	1.0527
No log	23.8333	286	1.2067	0.1995	1.2067	1.0985
No log	24.0	288	1.2325	0.1995	1.2325	1.1102
No log	24.1667	290	1.2512	0.1995	1.2512	1.1186
No log	24.3333	292	1.1037	0.1583	1.1037	1.0505
No log	24.5	294	0.9760	0.1379	0.9760	0.9879
No log	24.6667	296	1.0079	0.1856	1.0079	1.0039
No log	24.8333	298	1.0399	0.1492	1.0399	1.0197
No log	25.0	300	1.1722	0.1262	1.1722	1.0827
No log	25.1667	302	1.2280	0.1262	1.2280	1.1081
No log	25.3333	304	1.1158	0.1356	1.1158	1.0563
No log	25.5	306	1.0339	0.1869	1.0339	1.0168
No log	25.6667	308	1.0740	0.1787	1.0740	1.0363
No log	25.8333	310	1.1517	0.1262	1.1517	1.0732
No log	26.0	312	1.1476	0.1116	1.1476	1.0713
No log	26.1667	314	1.1798	0.1086	1.1798	1.0862
No log	26.3333	316	1.1428	0.1147	1.1428	1.0690
No log	26.5	318	1.1064	0.1499	1.1064	1.0519
No log	26.6667	320	1.1217	0.1147	1.1217	1.0591
No log	26.8333	322	1.2467	0.1564	1.2467	1.1166
No log	27.0	324	1.3409	0.1265	1.3409	1.1580
No log	27.1667	326	1.3855	0.0627	1.3855	1.1771
No log	27.3333	328	1.3795	0.1205	1.3795	1.1745
No log	27.5	330	1.2722	0.1265	1.2722	1.1279
No log	27.6667	332	1.0952	0.1499	1.0952	1.0465
No log	27.8333	334	1.0133	0.1734	1.0133	1.0066
No log	28.0	336	1.0260	0.1734	1.0260	1.0129
No log	28.1667	338	1.1098	0.1747	1.1098	1.0535
No log	28.3333	340	1.1880	0.1564	1.1880	1.0900
No log	28.5	342	1.3581	0.1401	1.3581	1.1654
No log	28.6667	344	1.4535	0.1278	1.4535	1.2056
No log	28.8333	346	1.5588	0.1251	1.5588	1.2485
No log	29.0	348	1.5881	0.1251	1.5881	1.2602
No log	29.1667	350	1.5699	0.1251	1.5699	1.2530
No log	29.3333	352	1.4959	0.0803	1.4959	1.2231
No log	29.5	354	1.4115	0.1176	1.4115	1.1881
No log	29.6667	356	1.4102	0.1176	1.4102	1.1875
No log	29.8333	358	1.4567	0.1337	1.4567	1.2069
No log	30.0	360	1.5529	0.0803	1.5529	1.2462
No log	30.1667	362	1.6742	0.0457	1.6742	1.2939
No log	30.3333	364	1.6188	0.0741	1.6188	1.2723
No log	30.5	366	1.4315	0.1513	1.4315	1.1965
No log	30.6667	368	1.1956	0.1919	1.1956	1.0934
No log	30.8333	370	0.9844	0.2211	0.9844	0.9921
No log	31.0	372	0.8844	0.1867	0.8844	0.9404
No log	31.1667	374	0.8644	0.1962	0.8644	0.9297
No log	31.3333	376	0.8995	0.1584	0.8995	0.9484
No log	31.5	378	0.9935	0.2259	0.9935	0.9967
No log	31.6667	380	1.1299	0.2732	1.1299	1.0630
No log	31.8333	382	1.2653	0.1795	1.2653	1.1248
No log	32.0	384	1.2835	0.1795	1.2835	1.1329
No log	32.1667	386	1.2188	0.2100	1.2188	1.1040
No log	32.3333	388	1.1964	0.1599	1.1964	1.0938
No log	32.5	390	1.0861	0.2363	1.0861	1.0422
No log	32.6667	392	0.9612	0.2142	0.9612	0.9804
No log	32.8333	394	0.9000	0.1962	0.9000	0.9487
No log	33.0	396	0.9151	0.1584	0.9151	0.9566
No log	33.1667	398	0.9939	0.2410	0.9939	0.9970
No log	33.3333	400	1.1103	0.2363	1.1103	1.0537
No log	33.5	402	1.2230	0.1453	1.2230	1.1059
No log	33.6667	404	1.3540	0.1363	1.3540	1.1636
No log	33.8333	406	1.4655	0.1513	1.4655	1.2106
No log	34.0	408	1.4470	0.1334	1.4470	1.2029
No log	34.1667	410	1.3550	0.1175	1.3550	1.1640
No log	34.3333	412	1.2609	0.1497	1.2609	1.1229
No log	34.5	414	1.2480	0.1795	1.2480	1.1172
No log	34.6667	416	1.2842	0.1497	1.2842	1.1332
No log	34.8333	418	1.3443	0.1363	1.3443	1.1594
No log	35.0	420	1.3520	0.1363	1.3520	1.1628
No log	35.1667	422	1.2601	0.1638	1.2601	1.1225
No log	35.3333	424	1.0964	0.1787	1.0964	1.0471
No log	35.5	426	0.9688	0.1822	0.9688	0.9843
No log	35.6667	428	0.9255	0.1914	0.9255	0.9620
No log	35.8333	430	0.9269	0.1914	0.9269	0.9627
No log	36.0	432	0.9405	0.1180	0.9405	0.9698
No log	36.1667	434	1.0430	0.1385	1.0430	1.0213
No log	36.3333	436	1.2363	0.1956	1.2363	1.1119
No log	36.5	438	1.3858	0.1363	1.3858	1.1772
No log	36.6667	440	1.3576	0.1363	1.3576	1.1652
No log	36.8333	442	1.2336	0.1638	1.2336	1.1107
No log	37.0	444	1.1433	0.2031	1.1433	1.0693
No log	37.1667	446	1.0313	0.1274	1.0313	1.0155
No log	37.3333	448	0.9249	0.1867	0.9249	0.9617
No log	37.5	450	0.8619	0.2467	0.8619	0.9284
No log	37.6667	452	0.8716	0.2754	0.8716	0.9336
No log	37.8333	454	0.9290	0.1867	0.9290	0.9639
No log	38.0	456	1.0143	0.1385	1.0143	1.0071
No log	38.1667	458	1.0963	0.1827	1.0963	1.0470
No log	38.3333	460	1.1252	0.2271	1.1252	1.0608
No log	38.5	462	1.0936	0.1827	1.0936	1.0457
No log	38.6667	464	1.0521	0.1277	1.0521	1.0257
No log	38.8333	466	1.0492	0.1277	1.0492	1.0243
No log	39.0	468	1.0723	0.1277	1.0723	1.0355
No log	39.1667	470	1.0842	0.2075	1.0842	1.0413
No log	39.3333	472	1.1361	0.2412	1.1361	1.0659
No log	39.5	474	1.1357	0.2412	1.1357	1.0657
No log	39.6667	476	1.1395	0.2183	1.1395	1.0675
No log	39.8333	478	1.1764	0.2100	1.1764	1.0846
No log	40.0	480	1.1919	0.2100	1.1919	1.0918
No log	40.1667	482	1.1824	0.2100	1.1824	1.0874
No log	40.3333	484	1.0864	0.1499	1.0864	1.0423
No log	40.5	486	0.9841	0.1651	0.9841	0.9920
No log	40.6667	488	0.9537	0.1734	0.9537	0.9766
No log	40.8333	490	0.9934	0.1856	0.9934	0.9967
No log	41.0	492	1.0376	0.1815	1.0376	1.0186
No log	41.1667	494	1.0763	0.1653	1.0763	1.0375
No log	41.3333	496	1.1071	0.1846	1.1071	1.0522
No log	41.5	498	1.0653	0.2017	1.0653	1.0321
0.2113	41.6667	500	0.9747	0.1940	0.9747	0.9873
0.2113	41.8333	502	0.9370	0.2193	0.9370	0.9680
0.2113	42.0	504	0.9407	0.2142	0.9407	0.9699
0.2113	42.1667	506	0.9594	0.2046	0.9594	0.9795
0.2113	42.3333	508	0.9632	0.2308	0.9632	0.9814
0.2113	42.5	510	0.9971	0.1955	0.9971	0.9985
0.2113	42.6667	512	1.0829	0.2032	1.0829	1.0406
0.2113	42.8333	514	1.0943	0.2209	1.0943	1.0461
0.2113	43.0	516	1.0427	0.1653	1.0427	1.0211
0.2113	43.1667	518	0.9813	0.1815	0.9813	0.9906
0.2113	43.3333	520	0.9356	0.2670	0.9356	0.9673
0.2113	43.5	522	0.8764	0.2297	0.8764	0.9362
0.2113	43.6667	524	0.8614	0.2692	0.8614	0.9281
0.2113	43.8333	526	0.8617	0.2692	0.8617	0.9283
0.2113	44.0	528	0.8762	0.2297	0.8762	0.9361
0.2113	44.1667	530	0.9086	0.2297	0.9086	0.9532
0.2113	44.3333	532	0.9706	0.1594	0.9706	0.9852
0.2113	44.5	534	1.0774	0.1417	1.0774	1.0380
0.2113	44.6667	536	1.1670	0.1583	1.1670	1.0803
0.2113	44.8333	538	1.2170	0.1583	1.2170	1.1032
0.2113	45.0	540	1.2546	0.1453	1.2546	1.1201

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1