ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3549
• Qwk: 0.1596
• Mse: 1.3549
• Rmse: 1.1640

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0263	2	4.8022	-0.0132	4.8022	2.1914
No log	0.0526	4	2.9351	-0.0050	2.9351	1.7132
No log	0.0789	6	2.2044	-0.0553	2.2044	1.4847
No log	0.1053	8	2.0676	-0.0285	2.0676	1.4379
No log	0.1316	10	1.8414	-0.0735	1.8414	1.3570
No log	0.1579	12	1.4381	0.0201	1.4381	1.1992
No log	0.1842	14	1.4459	0.0020	1.4459	1.2025
No log	0.2105	16	1.5676	-0.1375	1.5676	1.2520
No log	0.2368	18	1.9984	-0.0295	1.9984	1.4137
No log	0.2632	20	2.5400	-0.0762	2.5400	1.5937
No log	0.2895	22	2.2913	-0.0169	2.2913	1.5137
No log	0.3158	24	1.8339	0.0372	1.8339	1.3542
No log	0.3421	26	1.4349	0.0	1.4349	1.1979
No log	0.3684	28	1.3090	0.1140	1.3090	1.1441
No log	0.3947	30	1.2531	0.0599	1.2531	1.1194
No log	0.4211	32	1.2138	0.0904	1.2138	1.1017
No log	0.4474	34	1.1956	0.1585	1.1956	1.0935
No log	0.4737	36	1.2860	0.0722	1.2860	1.1340
No log	0.5	38	1.4290	-0.0147	1.4290	1.1954
No log	0.5263	40	1.4433	-0.0463	1.4433	1.2014
No log	0.5526	42	1.3593	0.0682	1.3593	1.1659
No log	0.5789	44	1.4019	0.0442	1.4019	1.1840
No log	0.6053	46	1.4078	0.0442	1.4078	1.1865
No log	0.6316	48	1.2807	0.1042	1.2807	1.1317
No log	0.6579	50	1.2400	0.1370	1.2400	1.1136
No log	0.6842	52	1.2537	0.1107	1.2537	1.1197
No log	0.7105	54	1.2371	0.1638	1.2371	1.1122
No log	0.7368	56	1.2117	0.1011	1.2117	1.1008
No log	0.7632	58	1.2297	0.0327	1.2297	1.1089
No log	0.7895	60	1.4120	-0.0022	1.4120	1.1883
No log	0.8158	62	1.4995	-0.0022	1.4995	1.2245
No log	0.8421	64	1.4774	-0.0022	1.4774	1.2155
No log	0.8684	66	1.3757	0.0454	1.3757	1.1729
No log	0.8947	68	1.2136	0.1048	1.2136	1.1017
No log	0.9211	70	1.3188	0.0865	1.3188	1.1484
No log	0.9474	72	1.5599	0.0	1.5599	1.2490
No log	0.9737	74	1.5736	0.0	1.5736	1.2544
No log	1.0	76	1.4580	0.0	1.4580	1.2075
No log	1.0263	78	1.3203	0.0403	1.3203	1.1491
No log	1.0526	80	1.2935	-0.0199	1.2935	1.1373
No log	1.0789	82	1.3335	-0.0375	1.3335	1.1548
No log	1.1053	84	1.2847	0.0914	1.2847	1.1334
No log	1.1316	86	1.2486	0.1444	1.2486	1.1174
No log	1.1579	88	1.2472	0.0628	1.2472	1.1168
No log	1.1842	90	1.2387	0.0628	1.2387	1.1130
No log	1.2105	92	1.2353	0.0527	1.2353	1.1114
No log	1.2368	94	1.2104	0.1482	1.2104	1.1002
No log	1.2632	96	1.2037	0.1444	1.2037	1.0971
No log	1.2895	98	1.2011	0.1570	1.2011	1.0960
No log	1.3158	100	1.2008	0.1895	1.2008	1.0958
No log	1.3421	102	1.3134	0.0432	1.3134	1.1460
No log	1.3684	104	1.4063	0.0625	1.4063	1.1859
No log	1.3947	106	1.3113	0.0811	1.3113	1.1451
No log	1.4211	108	1.2505	0.1560	1.2505	1.1183
No log	1.4474	110	1.1721	0.3516	1.1721	1.0827
No log	1.4737	112	1.1064	0.2145	1.1064	1.0519
No log	1.5	114	1.1090	0.2409	1.1090	1.0531
No log	1.5263	116	1.1581	0.1431	1.1581	1.0761
No log	1.5526	118	1.4980	0.2569	1.4980	1.2239
No log	1.5789	120	1.7274	0.2540	1.7274	1.3143
No log	1.6053	122	1.5504	0.2229	1.5504	1.2451
No log	1.6316	124	1.2268	0.2145	1.2268	1.1076
No log	1.6579	126	1.5892	0.0462	1.5892	1.2606
No log	1.6842	128	1.5735	0.0512	1.5735	1.2544
No log	1.7105	130	1.3064	0.1483	1.3064	1.1430
No log	1.7368	132	1.2489	0.2331	1.2489	1.1175
No log	1.7632	134	1.2368	0.2239	1.2368	1.1121
No log	1.7895	136	1.2080	0.2802	1.2080	1.0991
No log	1.8158	138	1.1912	0.1838	1.1912	1.0914
No log	1.8421	140	1.2082	0.1182	1.2082	1.0992
No log	1.8684	142	1.3371	0.1717	1.3371	1.1563
No log	1.8947	144	1.3905	0.1280	1.3905	1.1792
No log	1.9211	146	1.3042	0.1278	1.3042	1.1420
No log	1.9474	148	1.2928	0.1022	1.2928	1.1370
No log	1.9737	150	1.3862	0.0989	1.3862	1.1774
No log	2.0	152	1.5202	0.1691	1.5202	1.2330
No log	2.0263	154	1.5860	0.1967	1.5860	1.2594
No log	2.0526	156	1.5263	0.1255	1.5263	1.2354
No log	2.0789	158	1.3805	0.2067	1.3805	1.1749
No log	2.1053	160	1.3612	0.1058	1.3612	1.1667
No log	2.1316	162	1.3744	0.1697	1.3744	1.1724
No log	2.1579	164	1.4483	0.1774	1.4483	1.2034
No log	2.1842	166	1.5598	0.1852	1.5598	1.2489
No log	2.2105	168	1.4915	0.1817	1.4915	1.2213
No log	2.2368	170	1.3626	0.0776	1.3626	1.1673
No log	2.2632	172	1.3273	0.1590	1.3273	1.1521
No log	2.2895	174	1.3772	0.0925	1.3772	1.1735
No log	2.3158	176	1.3777	0.0519	1.3777	1.1737
No log	2.3421	178	1.3940	0.0925	1.3940	1.1807
No log	2.3684	180	1.3967	0.0833	1.3967	1.1818
No log	2.3947	182	1.3795	0.0925	1.3795	1.1745
No log	2.4211	184	1.3385	0.1888	1.3385	1.1570
No log	2.4474	186	1.4120	0.2045	1.4120	1.1883
No log	2.4737	188	1.4389	0.1334	1.4389	1.1996
No log	2.5	190	1.4032	0.0994	1.4032	1.1846
No log	2.5263	192	1.3565	0.1185	1.3565	1.1647
No log	2.5526	194	1.3433	0.1337	1.3433	1.1590
No log	2.5789	196	1.3479	0.1638	1.3479	1.1610
No log	2.6053	198	1.3842	0.1824	1.3842	1.1765
No log	2.6316	200	1.4043	0.1739	1.4043	1.1850
No log	2.6579	202	1.4206	0.1469	1.4206	1.1919
No log	2.6842	204	1.3880	0.1417	1.3880	1.1781
No log	2.7105	206	1.3761	0.1773	1.3761	1.1731
No log	2.7368	208	1.3611	0.2067	1.3611	1.1666
No log	2.7632	210	1.3496	0.2292	1.3496	1.1617
No log	2.7895	212	1.2630	0.2712	1.2630	1.1239
No log	2.8158	214	1.2350	0.2458	1.2350	1.1113
No log	2.8421	216	1.1990	0.2904	1.1990	1.0950
No log	2.8684	218	1.1876	0.3088	1.1876	1.0898
No log	2.8947	220	1.2229	0.2764	1.2229	1.1058
No log	2.9211	222	1.3960	0.2742	1.3960	1.1815
No log	2.9474	224	1.6456	0.1884	1.6456	1.2828
No log	2.9737	226	1.6443	0.1848	1.6443	1.2823
No log	3.0	228	1.4651	0.2555	1.4651	1.2104
No log	3.0263	230	1.2975	0.1136	1.2975	1.1391
No log	3.0526	232	1.2219	0.2608	1.2219	1.1054
No log	3.0789	234	1.2159	0.2608	1.2159	1.1027
No log	3.1053	236	1.2646	0.2060	1.2646	1.1245
No log	3.1316	238	1.3652	0.2443	1.3652	1.1684
No log	3.1579	240	1.3913	0.2733	1.3913	1.1795
No log	3.1842	242	1.4716	0.2478	1.4716	1.2131
No log	3.2105	244	1.3837	0.2303	1.3837	1.1763
No log	3.2368	246	1.4075	0.2181	1.4075	1.1864
No log	3.2632	248	1.3158	0.2692	1.3158	1.1471
No log	3.2895	250	1.2086	0.2877	1.2086	1.0994
No log	3.3158	252	1.2016	0.1975	1.2016	1.0962
No log	3.3421	254	1.2488	0.0946	1.2488	1.1175
No log	3.3684	256	1.3334	0.1428	1.3334	1.1547
No log	3.3947	258	1.3709	0.1670	1.3709	1.1708
No log	3.4211	260	1.3176	0.1585	1.3176	1.1479
No log	3.4474	262	1.2420	0.2285	1.2420	1.1144
No log	3.4737	264	1.2879	0.1957	1.2879	1.1349
No log	3.5	266	1.4488	0.2172	1.4488	1.2037
No log	3.5263	268	1.5106	0.2314	1.5106	1.2291
No log	3.5526	270	1.3879	0.2201	1.3879	1.1781
No log	3.5789	272	1.2529	0.1814	1.2529	1.1193
No log	3.6053	274	1.2506	0.1602	1.2506	1.1183
No log	3.6316	276	1.2533	0.1602	1.2533	1.1195
No log	3.6579	278	1.3195	0.1500	1.3195	1.1487
No log	3.6842	280	1.3325	0.1500	1.3325	1.1543
No log	3.7105	282	1.2638	0.1504	1.2638	1.1242
No log	3.7368	284	1.2159	0.1986	1.2159	1.1027
No log	3.7632	286	1.1993	0.2001	1.1993	1.0951
No log	3.7895	288	1.1923	0.1654	1.1923	1.0919
No log	3.8158	290	1.1725	0.1886	1.1725	1.0828
No log	3.8421	292	1.2199	0.2015	1.2199	1.1045
No log	3.8684	294	1.2877	0.2403	1.2877	1.1348
No log	3.8947	296	1.2517	0.2375	1.2517	1.1188
No log	3.9211	298	1.2315	0.2671	1.2315	1.1097
No log	3.9474	300	1.2392	0.2310	1.2392	1.1132
No log	3.9737	302	1.2690	0.2403	1.2690	1.1265
No log	4.0	304	1.3256	0.1594	1.3256	1.1513
No log	4.0263	306	1.4092	0.1537	1.4092	1.1871
No log	4.0526	308	1.3747	0.1163	1.3747	1.1725
No log	4.0789	310	1.3562	0.1594	1.3562	1.1646
No log	4.1053	312	1.3264	0.1594	1.3264	1.1517
No log	4.1316	314	1.2681	0.1567	1.2681	1.1261
No log	4.1579	316	1.2367	0.1567	1.2367	1.1121
No log	4.1842	318	1.2299	0.2424	1.2299	1.1090
No log	4.2105	320	1.2344	0.2020	1.2344	1.1111
No log	4.2368	322	1.2990	0.2174	1.2990	1.1397
No log	4.2632	324	1.3443	0.2607	1.3443	1.1594
No log	4.2895	326	1.4013	0.2511	1.4013	1.1837
No log	4.3158	328	1.4061	0.2387	1.4061	1.1858
No log	4.3421	330	1.3237	0.2321	1.3237	1.1505
No log	4.3684	332	1.2054	0.1559	1.2054	1.0979
No log	4.3947	334	1.1548	0.1507	1.1548	1.0746
No log	4.4211	336	1.1700	0.2416	1.1700	1.0817
No log	4.4474	338	1.1737	0.1834	1.1737	1.0834
No log	4.4737	340	1.1950	0.1775	1.1950	1.0932
No log	4.5	342	1.2245	0.1310	1.2245	1.1066
No log	4.5263	344	1.2099	0.1775	1.2099	1.0999
No log	4.5526	346	1.2291	0.2113	1.2291	1.1086
No log	4.5789	348	1.2765	0.2322	1.2765	1.1298
No log	4.6053	350	1.2914	0.2322	1.2914	1.1364
No log	4.6316	352	1.3327	0.2211	1.3327	1.1544
No log	4.6579	354	1.3992	0.1438	1.3992	1.1829
No log	4.6842	356	1.4151	0.1549	1.4151	1.1896
No log	4.7105	358	1.3751	0.2224	1.3751	1.1726
No log	4.7368	360	1.2813	0.2152	1.2813	1.1320
No log	4.7632	362	1.2231	0.1309	1.2231	1.1059
No log	4.7895	364	1.2192	0.1370	1.2192	1.1042
No log	4.8158	366	1.2470	0.1121	1.2470	1.1167
No log	4.8421	368	1.3375	0.2397	1.3375	1.1565
No log	4.8684	370	1.4940	0.2051	1.4940	1.2223
No log	4.8947	372	1.5254	0.1929	1.5254	1.2351
No log	4.9211	374	1.4816	0.1597	1.4816	1.2172
No log	4.9474	376	1.3703	0.0871	1.3703	1.1706
No log	4.9737	378	1.2867	0.1081	1.2867	1.1343
No log	5.0	380	1.2644	0.1081	1.2644	1.1245
No log	5.0263	382	1.2638	0.1081	1.2638	1.1242
No log	5.0526	384	1.2511	0.0721	1.2511	1.1185
No log	5.0789	386	1.2491	0.0721	1.2491	1.1176
No log	5.1053	388	1.2964	0.1801	1.2964	1.1386
No log	5.1316	390	1.3508	0.1312	1.3508	1.1622
No log	5.1579	392	1.3741	0.2132	1.3741	1.1722
No log	5.1842	394	1.3167	0.1814	1.3167	1.1475
No log	5.2105	396	1.2722	0.0863	1.2722	1.1279
No log	5.2368	398	1.2878	0.2541	1.2878	1.1348
No log	5.2632	400	1.3320	0.2452	1.3320	1.1541
No log	5.2895	402	1.3903	0.2313	1.3903	1.1791
No log	5.3158	404	1.3770	0.2173	1.3770	1.1734
No log	5.3421	406	1.3200	0.2313	1.3200	1.1489
No log	5.3684	408	1.2824	0.2619	1.2824	1.1324
No log	5.3947	410	1.2486	0.2552	1.2486	1.1174
No log	5.4211	412	1.3278	0.1611	1.3278	1.1523
No log	5.4474	414	1.3197	0.1801	1.3197	1.1488
No log	5.4737	416	1.2804	0.2250	1.2804	1.1316
No log	5.5	418	1.2671	0.2250	1.2671	1.1256
No log	5.5263	420	1.3406	0.1611	1.3406	1.1578
No log	5.5526	422	1.3634	0.1986	1.3634	1.1676
No log	5.5789	424	1.3372	0.2124	1.3372	1.1564
No log	5.6053	426	1.3431	0.1484	1.3431	1.1589
No log	5.6316	428	1.4003	0.0741	1.4003	1.1833
No log	5.6579	430	1.4287	0.1282	1.4287	1.1953
No log	5.6842	432	1.4045	0.1067	1.4045	1.1851
No log	5.7105	434	1.3395	0.1801	1.3395	1.1574
No log	5.7368	436	1.3011	0.1180	1.3011	1.1407
No log	5.7632	438	1.3096	0.1180	1.3096	1.1444
No log	5.7895	440	1.3469	0.1701	1.3469	1.1606
No log	5.8158	442	1.5075	0.1585	1.5075	1.2278
No log	5.8421	444	1.6502	0.0764	1.6502	1.2846
No log	5.8684	446	1.6350	0.1230	1.6350	1.2787
No log	5.8947	448	1.4696	0.1722	1.4696	1.2123
No log	5.9211	450	1.3533	0.1338	1.3533	1.1633
No log	5.9474	452	1.3210	0.1911	1.3210	1.1494
No log	5.9737	454	1.2988	0.1442	1.2988	1.1397
No log	6.0	456	1.3104	0.1801	1.3104	1.1447
No log	6.0263	458	1.3273	0.1801	1.3273	1.1521
No log	6.0526	460	1.3068	0.1801	1.3068	1.1431
No log	6.0789	462	1.3088	0.1801	1.3088	1.1440
No log	6.1053	464	1.3346	0.2108	1.3346	1.1553
No log	6.1316	466	1.3149	0.1801	1.3149	1.1467
No log	6.1579	468	1.2952	0.1801	1.2952	1.1381
No log	6.1842	470	1.2944	0.1801	1.2944	1.1377
No log	6.2105	472	1.3105	0.2108	1.3105	1.1448
No log	6.2368	474	1.3524	0.2313	1.3524	1.1629
No log	6.2632	476	1.4107	0.1761	1.4107	1.1877
No log	6.2895	478	1.4086	0.1761	1.4086	1.1868
No log	6.3158	480	1.4122	0.2163	1.4122	1.1884
No log	6.3421	482	1.3779	0.2163	1.3779	1.1738
No log	6.3684	484	1.4308	0.1851	1.4308	1.1962
No log	6.3947	486	1.4028	0.2028	1.4028	1.1844
No log	6.4211	488	1.2923	0.1599	1.2923	1.1368
No log	6.4474	490	1.2412	0.1860	1.2412	1.1141
No log	6.4737	492	1.2331	0.1645	1.2331	1.1105
No log	6.5	494	1.2587	0.1479	1.2587	1.1219
No log	6.5263	496	1.2524	0.1479	1.2524	1.1191
No log	6.5526	498	1.2744	0.1026	1.2744	1.1289
0.4199	6.5789	500	1.3260	0.1989	1.3260	1.1515
0.4199	6.6053	502	1.4493	0.2055	1.4493	1.2039
0.4199	6.6316	504	1.4365	0.1687	1.4365	1.1986
0.4199	6.6579	506	1.4140	0.1335	1.4140	1.1891
0.4199	6.6842	508	1.4284	0.1064	1.4284	1.1952
0.4199	6.7105	510	1.3825	0.1405	1.3825	1.1758
0.4199	6.7368	512	1.3549	0.1596	1.3549	1.1640

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1