ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k9_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1636
• Qwk: 0.1202
• Mse: 1.1636
• Rmse: 1.0787

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	4.2022	0.0054	4.2022	2.0499
No log	0.1818	4	2.0665	0.0271	2.0665	1.4375
No log	0.2727	6	1.3293	0.0938	1.3293	1.1529
No log	0.3636	8	1.2055	0.1333	1.2055	1.0979
No log	0.4545	10	1.1096	0.1476	1.1096	1.0534
No log	0.5455	12	1.1230	0.2615	1.1230	1.0597
No log	0.6364	14	1.9505	0.0633	1.9505	1.3966
No log	0.7273	16	1.9299	0.0916	1.9299	1.3892
No log	0.8182	18	1.4919	0.0	1.4919	1.2214
No log	0.9091	20	1.1093	0.0999	1.1093	1.0532
No log	1.0	22	1.0201	0.3902	1.0201	1.0100
No log	1.0909	24	1.0723	0.0762	1.0723	1.0355
No log	1.1818	26	1.0957	0.0888	1.0957	1.0468
No log	1.2727	28	1.0425	0.1233	1.0425	1.0210
No log	1.3636	30	0.9925	0.2467	0.9925	0.9962
No log	1.4545	32	0.9567	0.2566	0.9567	0.9781
No log	1.5455	34	0.9841	0.2416	0.9841	0.9920
No log	1.6364	36	1.1296	0.1071	1.1296	1.0628
No log	1.7273	38	1.1630	0.0917	1.1630	1.0784
No log	1.8182	40	1.0763	0.1755	1.0763	1.0374
No log	1.9091	42	1.1370	0.1447	1.1370	1.0663
No log	2.0	44	1.2072	0.2298	1.2072	1.0987
No log	2.0909	46	1.0948	0.2770	1.0948	1.0463
No log	2.1818	48	1.1887	0.2263	1.1887	1.0903
No log	2.2727	50	1.4427	0.1568	1.4427	1.2011
No log	2.3636	52	1.4336	0.1442	1.4336	1.1973
No log	2.4545	54	1.4911	0.1452	1.4911	1.2211
No log	2.5455	56	1.2297	0.1649	1.2297	1.1089
No log	2.6364	58	1.0346	0.2594	1.0346	1.0172
No log	2.7273	60	0.9896	0.3048	0.9896	0.9948
No log	2.8182	62	1.1386	0.2748	1.1386	1.0670
No log	2.9091	64	1.3190	0.2359	1.3190	1.1485
No log	3.0	66	1.4436	0.1686	1.4436	1.2015
No log	3.0909	68	1.3143	0.1303	1.3143	1.1464
No log	3.1818	70	1.0963	0.1927	1.0963	1.0470
No log	3.2727	72	1.0903	0.1927	1.0903	1.0442
No log	3.3636	74	1.2835	0.2424	1.2835	1.1329
No log	3.4545	76	1.3870	0.1595	1.3870	1.1777
No log	3.5455	78	1.2384	0.1417	1.2384	1.1128
No log	3.6364	80	1.0832	0.1722	1.0832	1.0408
No log	3.7273	82	1.0289	0.1530	1.0289	1.0143
No log	3.8182	84	1.0235	0.1530	1.0235	1.0117
No log	3.9091	86	1.1302	0.1351	1.1302	1.0631
No log	4.0	88	1.3050	0.1697	1.3050	1.1424
No log	4.0909	90	1.4455	0.1703	1.4455	1.2023
No log	4.1818	92	1.3314	0.1838	1.3314	1.1539
No log	4.2727	94	1.0894	0.1139	1.0894	1.0438
No log	4.3636	96	1.0068	0.2287	1.0068	1.0034
No log	4.4545	98	1.0273	0.1653	1.0273	1.0136
No log	4.5455	100	1.1576	0.0833	1.1576	1.0759
No log	4.6364	102	1.3546	0.1486	1.3546	1.1639
No log	4.7273	104	1.4446	0.1814	1.4446	1.2019
No log	4.8182	106	1.3553	0.1486	1.3553	1.1642
No log	4.9091	108	1.1588	0.0781	1.1588	1.0765
No log	5.0	110	1.0359	0.1570	1.0359	1.0178
No log	5.0909	112	1.0211	0.1918	1.0211	1.0105
No log	5.1818	114	1.0818	0.2105	1.0818	1.0401
No log	5.2727	116	1.2599	0.2455	1.2599	1.1225
No log	5.3636	118	1.4544	0.2004	1.4544	1.2060
No log	5.4545	120	1.4670	0.1832	1.4670	1.2112
No log	5.5455	122	1.4705	0.1892	1.4705	1.2127
No log	5.6364	124	1.4491	0.1832	1.4491	1.2038
No log	5.7273	126	1.2931	0.2065	1.2931	1.1371
No log	5.8182	128	1.1325	0.1351	1.1325	1.0642
No log	5.9091	130	1.0767	0.1770	1.0767	1.0376
No log	6.0	132	1.0685	0.1351	1.0685	1.0337
No log	6.0909	134	1.1177	0.1697	1.1177	1.0572
No log	6.1818	136	1.3027	0.1278	1.3027	1.1414
No log	6.2727	138	1.4255	0.2191	1.4255	1.1939
No log	6.3636	140	1.5227	0.2339	1.5227	1.2340
No log	6.4545	142	1.5343	0.1140	1.5343	1.2387
No log	6.5455	144	1.5294	0.1058	1.5294	1.2367
No log	6.6364	146	1.4401	0.1362	1.4401	1.2001
No log	6.7273	148	1.3402	0.0841	1.3402	1.1577
No log	6.8182	150	1.2859	0.0961	1.2859	1.1340
No log	6.9091	152	1.1497	0.1110	1.1497	1.0723
No log	7.0	154	1.0052	0.2559	1.0052	1.0026
No log	7.0909	156	0.9861	0.2698	0.9861	0.9930
No log	7.1818	158	1.0562	0.2439	1.0562	1.0277
No log	7.2727	160	1.1887	0.1880	1.1887	1.0903
No log	7.3636	162	1.2434	0.1880	1.2434	1.1151
No log	7.4545	164	1.3121	0.2062	1.3121	1.1455
No log	7.5455	166	1.3752	0.2062	1.3752	1.1727
No log	7.6364	168	1.3551	0.2187	1.3551	1.1641
No log	7.7273	170	1.4147	0.2342	1.4147	1.1894
No log	7.8182	172	1.5074	0.2239	1.5074	1.2278
No log	7.9091	174	1.4633	0.2372	1.4633	1.2097
No log	8.0	176	1.3258	0.1744	1.3258	1.1514
No log	8.0909	178	1.2169	0.0931	1.2169	1.1031
No log	8.1818	180	1.1642	0.1351	1.1642	1.0790
No log	8.2727	182	1.1612	0.0987	1.1612	1.0776
No log	8.3636	184	1.1998	0.0	1.1998	1.0953
No log	8.4545	186	1.2164	0.0401	1.2164	1.1029
No log	8.5455	188	1.2507	0.0781	1.2507	1.1183
No log	8.6364	190	1.3195	0.1407	1.3195	1.1487
No log	8.7273	192	1.3444	0.2260	1.3444	1.1595
No log	8.8182	194	1.4466	0.2339	1.4466	1.2027
No log	8.9091	196	1.5211	0.2644	1.5211	1.2333
No log	9.0	198	1.5479	0.2221	1.5479	1.2442
No log	9.0909	200	1.4756	0.1950	1.4756	1.2147
No log	9.1818	202	1.3459	0.1814	1.3459	1.1601
No log	9.2727	204	1.2530	0.1288	1.2530	1.1194
No log	9.3636	206	1.2983	0.1288	1.2983	1.1394
No log	9.4545	208	1.3531	0.1744	1.3531	1.1632
No log	9.5455	210	1.3827	0.1886	1.3827	1.1759
No log	9.6364	212	1.4787	0.2417	1.4787	1.2160
No log	9.7273	214	1.6488	0.2437	1.6488	1.2841
No log	9.8182	216	1.6572	0.2174	1.6572	1.2873
No log	9.9091	218	1.4560	0.1886	1.4560	1.2066
No log	10.0	220	1.2423	0.1287	1.2423	1.1146
No log	10.0909	222	1.1716	0.1011	1.1716	1.0824
No log	10.1818	224	1.2108	0.0924	1.2108	1.1004
No log	10.2727	226	1.3034	0.0931	1.3034	1.1417
No log	10.3636	228	1.4178	0.1288	1.4178	1.1907
No log	10.4545	230	1.4110	0.1142	1.4110	1.1878
No log	10.5455	232	1.3221	0.0781	1.3221	1.1498
No log	10.6364	234	1.3172	0.1142	1.3172	1.1477
No log	10.7273	236	1.3800	0.1142	1.3800	1.1747
No log	10.8182	238	1.3491	0.1142	1.3491	1.1615
No log	10.9091	240	1.3438	0.1142	1.3438	1.1592
No log	11.0	242	1.3054	0.1288	1.3054	1.1426
No log	11.0909	244	1.2510	0.1288	1.2510	1.1185
No log	11.1818	246	1.1995	0.0556	1.1995	1.0952
No log	11.2727	248	1.2131	0.0401	1.2131	1.1014
No log	11.3636	250	1.3156	0.1052	1.3156	1.1470
No log	11.4545	252	1.4461	0.2184	1.4461	1.2026
No log	11.5455	254	1.4465	0.2184	1.4465	1.2027
No log	11.6364	256	1.3037	0.1587	1.3037	1.1418
No log	11.7273	258	1.1168	0.1555	1.1168	1.0568
No log	11.8182	260	1.0962	0.1849	1.0962	1.0470
No log	11.9091	262	1.1887	0.1795	1.1887	1.0903
No log	12.0	264	1.3770	0.2315	1.3770	1.1735
No log	12.0909	266	1.5718	0.2522	1.5718	1.2537
No log	12.1818	268	1.5556	0.1943	1.5556	1.2472
No log	12.2727	270	1.4144	0.1407	1.4144	1.1893
No log	12.3636	272	1.2094	0.0781	1.2094	1.0997
No log	12.4545	274	1.1110	0.1500	1.1110	1.0541
No log	12.5455	276	1.1221	0.0781	1.1221	1.0593
No log	12.6364	278	1.2266	0.1407	1.2266	1.1075
No log	12.7273	280	1.3332	0.2184	1.3332	1.1547
No log	12.8182	282	1.4237	0.2239	1.4237	1.1932
No log	12.9091	284	1.3954	0.2522	1.3954	1.1813
No log	13.0	286	1.3117	0.2015	1.3117	1.1453
No log	13.0909	288	1.3208	0.1552	1.3208	1.1493
No log	13.1818	290	1.3868	0.1052	1.3868	1.1776
No log	13.2727	292	1.5122	0.1744	1.5122	1.2297
No log	13.3636	294	1.6198	0.2058	1.6198	1.2727
No log	13.4545	296	1.5738	0.2270	1.5738	1.2545
No log	13.5455	298	1.4616	0.2239	1.4616	1.2090
No log	13.6364	300	1.3510	0.1562	1.3510	1.1623
No log	13.7273	302	1.2568	0.0781	1.2568	1.1211
No log	13.8182	304	1.2275	0.0401	1.2275	1.1079
No log	13.9091	306	1.2253	0.0401	1.2253	1.1069
No log	14.0	308	1.2470	0.0401	1.2470	1.1167
No log	14.0909	310	1.2925	0.0401	1.2925	1.1369
No log	14.1818	312	1.3433	0.0781	1.3433	1.1590
No log	14.2727	314	1.4639	0.1744	1.4639	1.2099
No log	14.3636	316	1.4725	0.1142	1.4725	1.2135
No log	14.4545	318	1.3810	0.0401	1.3810	1.1751
No log	14.5455	320	1.3313	0.0401	1.3313	1.1538
No log	14.6364	322	1.3294	0.0781	1.3294	1.1530
No log	14.7273	324	1.3522	0.2065	1.3522	1.1629
No log	14.8182	326	1.3838	0.2647	1.3838	1.1764
No log	14.9091	328	1.3695	0.2363	1.3695	1.1703
No log	15.0	330	1.2853	0.2313	1.2853	1.1337
No log	15.0909	332	1.2293	0.1966	1.2293	1.1087
No log	15.1818	334	1.2132	0.1886	1.2132	1.1015
No log	15.2727	336	1.2265	0.0781	1.2265	1.1075
No log	15.3636	338	1.2217	0.0401	1.2217	1.1053
No log	15.4545	340	1.2277	0.0401	1.2277	1.1080
No log	15.5455	342	1.2391	0.0401	1.2391	1.1132
No log	15.6364	344	1.3410	0.0401	1.3410	1.1580
No log	15.7273	346	1.4680	0.1142	1.4680	1.2116
No log	15.8182	348	1.5310	0.0781	1.5310	1.2373
No log	15.9091	350	1.5463	0.1744	1.5463	1.2435
No log	16.0	352	1.5859	0.2372	1.5859	1.2593
No log	16.0909	354	1.5618	0.2372	1.5618	1.2497
No log	16.1818	356	1.4245	0.1886	1.4245	1.1935
No log	16.2727	358	1.2946	0.0556	1.2946	1.1378
No log	16.3636	360	1.2128	0.0556	1.2128	1.1013
No log	16.4545	362	1.2293	0.0781	1.2293	1.1087
No log	16.5455	364	1.2827	0.1142	1.2827	1.1326
No log	16.6364	366	1.3278	0.2372	1.3278	1.1523
No log	16.7273	368	1.3299	0.2424	1.3299	1.1532
No log	16.8182	370	1.2362	0.1562	1.2362	1.1118
No log	16.9091	372	1.2020	0.0878	1.2020	1.0964
No log	17.0	374	1.2483	0.0510	1.2483	1.1173
No log	17.0909	376	1.3017	0.0510	1.3017	1.1409
No log	17.1818	378	1.3089	0.0510	1.3089	1.1441
No log	17.2727	380	1.3423	0.1562	1.3423	1.1586
No log	17.3636	382	1.3394	0.2126	1.3394	1.1573
No log	17.4545	384	1.3506	0.2424	1.3506	1.1621
No log	17.5455	386	1.2205	0.1370	1.2205	1.1048
No log	17.6364	388	1.0724	0.0618	1.0724	1.0356
No log	17.7273	390	1.0320	0.1047	1.0320	1.0159
No log	17.8182	392	1.0916	0.0433	1.0916	1.0448
No log	17.9091	394	1.2154	0.0401	1.2154	1.1025
No log	18.0	396	1.2684	0.0401	1.2684	1.1262
No log	18.0909	398	1.2639	0.0401	1.2639	1.1242
No log	18.1818	400	1.2900	0.0781	1.2900	1.1358
No log	18.2727	402	1.3361	0.1228	1.3361	1.1559
No log	18.3636	404	1.3394	0.1562	1.3394	1.1573
No log	18.4545	406	1.3904	0.2424	1.3904	1.1791
No log	18.5455	408	1.3826	0.2424	1.3826	1.1758
No log	18.6364	410	1.3514	0.1486	1.3514	1.1625
No log	18.7273	412	1.3661	0.1486	1.3661	1.1688
No log	18.8182	414	1.3542	0.0401	1.3542	1.1637
No log	18.9091	416	1.3066	0.0401	1.3066	1.1431
No log	19.0	418	1.2852	0.0	1.2852	1.1337
No log	19.0909	420	1.2439	0.0	1.2439	1.1153
No log	19.1818	422	1.2005	0.0	1.2005	1.0957
No log	19.2727	424	1.1554	0.0	1.1554	1.0749
No log	19.3636	426	1.1571	0.0155	1.1571	1.0757
No log	19.4545	428	1.1551	0.1397	1.1551	1.0747
No log	19.5455	430	1.2344	0.2424	1.2344	1.1110
No log	19.6364	432	1.3276	0.2424	1.3276	1.1522
No log	19.7273	434	1.3613	0.2424	1.3613	1.1667
No log	19.8182	436	1.3560	0.2424	1.3560	1.1645
No log	19.9091	438	1.3882	0.2424	1.3882	1.1782
No log	20.0	440	1.3912	0.2372	1.3912	1.1795
No log	20.0909	442	1.3728	0.1142	1.3728	1.1717
No log	20.1818	444	1.3151	0.0401	1.3151	1.1468
No log	20.2727	446	1.2470	0.0401	1.2470	1.1167
No log	20.3636	448	1.1991	0.0931	1.1991	1.0950
No log	20.4545	450	1.2290	0.1486	1.2290	1.1086
No log	20.5455	452	1.2172	0.1486	1.2172	1.1033
No log	20.6364	454	1.2484	0.1486	1.2484	1.1173
No log	20.7273	456	1.2303	0.0401	1.2303	1.1092
No log	20.8182	458	1.2594	0.0401	1.2594	1.1222
No log	20.9091	460	1.3197	0.0401	1.3197	1.1488
No log	21.0	462	1.3730	0.0401	1.3730	1.1717
No log	21.0909	464	1.3819	0.0401	1.3819	1.1755
No log	21.1818	466	1.4318	0.0401	1.4318	1.1966
No log	21.2727	468	1.4856	0.0781	1.4856	1.2188
No log	21.3636	470	1.4851	0.2065	1.4851	1.2187
No log	21.4545	472	1.4371	0.2372	1.4371	1.1988
No log	21.5455	474	1.5109	0.2292	1.5109	1.2292
No log	21.6364	476	1.4977	0.2292	1.4977	1.2238
No log	21.7273	478	1.3963	0.2474	1.3963	1.1817
No log	21.8182	480	1.3293	0.1744	1.3293	1.1530
No log	21.9091	482	1.3697	0.1407	1.3697	1.1704
No log	22.0	484	1.3930	0.0401	1.3930	1.1803
No log	22.0909	486	1.3572	0.0401	1.3572	1.1650
No log	22.1818	488	1.2608	0.0401	1.2608	1.1229
No log	22.2727	490	1.1685	0.0401	1.1685	1.0810
No log	22.3636	492	1.1285	0.0401	1.1285	1.0623
No log	22.4545	494	1.0441	0.0833	1.0441	1.0218
No log	22.5455	496	0.9807	0.2700	0.9807	0.9903
No log	22.6364	498	0.9520	0.2449	0.9520	0.9757
0.2608	22.7273	500	1.0317	0.2368	1.0317	1.0157
0.2608	22.8182	502	1.1846	0.2065	1.1846	1.0884
0.2608	22.9091	504	1.3328	0.2372	1.3328	1.1545
0.2608	23.0	506	1.4303	0.2372	1.4303	1.1960
0.2608	23.0909	508	1.4554	0.2372	1.4554	1.2064
0.2608	23.1818	510	1.4008	0.0781	1.4008	1.1836
0.2608	23.2727	512	1.3033	0.0401	1.3033	1.1416
0.2608	23.3636	514	1.2480	0.0401	1.2480	1.1171
0.2608	23.4545	516	1.2170	0.0401	1.2170	1.1032
0.2608	23.5455	518	1.1636	0.1202	1.1636	1.0787

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1