ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k15_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0415
• Qwk: 0.0539
• Mse: 1.0415
• Rmse: 1.0206

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0260	2	2.4913	-0.0262	2.4913	1.5784
No log	0.0519	4	1.3073	0.1281	1.3073	1.1434
No log	0.0779	6	1.0373	-0.0970	1.0373	1.0185
No log	0.1039	8	0.9465	0.1341	0.9465	0.9729
No log	0.1299	10	1.1284	0.0584	1.1284	1.0623
No log	0.1558	12	1.3139	-0.1496	1.3139	1.1463
No log	0.1818	14	1.2068	-0.0152	1.2068	1.0985
No log	0.2078	16	0.9170	0.1661	0.9170	0.9576
No log	0.2338	18	0.9001	0.2096	0.9001	0.9487
No log	0.2597	20	1.0496	0.0553	1.0496	1.0245
No log	0.2857	22	1.1889	-0.1139	1.1889	1.0903
No log	0.3117	24	1.0317	0.0041	1.0317	1.0157
No log	0.3377	26	0.8298	0.1648	0.8298	0.9109
No log	0.3636	28	0.8078	0.2285	0.8078	0.8988
No log	0.3896	30	0.8773	0.2116	0.8773	0.9366
No log	0.4156	32	0.8665	0.1550	0.8665	0.9308
No log	0.4416	34	0.8941	0.1050	0.8941	0.9456
No log	0.4675	36	0.9367	0.0377	0.9367	0.9679
No log	0.4935	38	0.8887	-0.0127	0.8887	0.9427
No log	0.5195	40	0.8604	0.1225	0.8604	0.9276
No log	0.5455	42	0.8287	0.1359	0.8287	0.9103
No log	0.5714	44	0.8066	0.0573	0.8066	0.8981
No log	0.5974	46	0.7735	0.0679	0.7735	0.8795
No log	0.6234	48	0.8151	0.0481	0.8151	0.9028
No log	0.6494	50	0.8329	0.0481	0.8329	0.9127
No log	0.6753	52	0.8153	0.0	0.8153	0.9030
No log	0.7013	54	0.8396	0.0679	0.8396	0.9163
No log	0.7273	56	0.9896	0.0165	0.9896	0.9948
No log	0.7532	58	1.0713	-0.1255	1.0713	1.0350
No log	0.7792	60	0.9869	0.0522	0.9869	0.9934
No log	0.8052	62	0.9225	0.1699	0.9225	0.9605
No log	0.8312	64	1.0744	0.1086	1.0744	1.0365
No log	0.8571	66	1.2124	0.0688	1.2124	1.1011
No log	0.8831	68	1.1752	0.0206	1.1752	1.0840
No log	0.9091	70	0.9478	0.1766	0.9478	0.9735
No log	0.9351	72	0.8662	0.0966	0.8662	0.9307
No log	0.9610	74	0.8719	0.1313	0.8719	0.9337
No log	0.9870	76	0.9143	0.1866	0.9143	0.9562
No log	1.0130	78	0.9778	0.2063	0.9778	0.9888
No log	1.0390	80	0.9458	0.1866	0.9458	0.9725
No log	1.0649	82	0.9029	0.0563	0.9029	0.9502
No log	1.0909	84	0.9465	0.0043	0.9465	0.9729
No log	1.1169	86	1.1808	0.1284	1.1808	1.0867
No log	1.1429	88	1.1573	0.1843	1.1573	1.0758
No log	1.1688	90	1.0035	0.0600	1.0035	1.0017
No log	1.1948	92	0.8920	-0.0500	0.8920	0.9444
No log	1.2208	94	0.9030	0.0966	0.9030	0.9503
No log	1.2468	96	1.0386	0.1217	1.0386	1.0191
No log	1.2727	98	1.1832	0.1086	1.1832	1.0878
No log	1.2987	100	1.2351	0.0206	1.2351	1.1113
No log	1.3247	102	1.2343	0.0493	1.2343	1.1110
No log	1.3506	104	1.1745	0.0437	1.1745	1.0837
No log	1.3766	106	1.0848	0.0419	1.0848	1.0415
No log	1.4026	108	1.0630	0.0563	1.0630	1.0310
No log	1.4286	110	1.0563	0.0930	1.0563	1.0278
No log	1.4545	112	1.0464	0.0971	1.0464	1.0230
No log	1.4805	114	1.0663	0.0614	1.0663	1.0326
No log	1.5065	116	1.0990	0.1179	1.0990	1.0483
No log	1.5325	118	1.1187	0.1179	1.1187	1.0577
No log	1.5584	120	1.1433	-0.0105	1.1433	1.0693
No log	1.5844	122	1.1363	0.0619	1.1363	1.0660
No log	1.6104	124	1.0516	0.1661	1.0516	1.0255
No log	1.6364	126	0.9738	0.1953	0.9738	0.9868
No log	1.6623	128	0.9444	0.1866	0.9444	0.9718
No log	1.6883	130	0.9513	0.2285	0.9513	0.9753
No log	1.7143	132	0.9457	0.1884	0.9457	0.9725
No log	1.7403	134	0.9482	0.1386	0.9482	0.9737
No log	1.7662	136	0.9836	0.0084	0.9836	0.9918
No log	1.7922	138	0.9566	0.1052	0.9566	0.9780
No log	1.8182	140	0.9445	0.1052	0.9445	0.9718
No log	1.8442	142	0.9344	0.0687	0.9344	0.9667
No log	1.8701	144	0.9371	0.1661	0.9371	0.9681
No log	1.8961	146	0.9297	0.1766	0.9297	0.9642
No log	1.9221	148	0.9549	0.1628	0.9549	0.9772
No log	1.9481	150	0.9152	0.1628	0.9152	0.9567
No log	1.9740	152	0.9009	0.1256	0.9009	0.9491
No log	2.0	154	0.9619	0.1052	0.9619	0.9808
No log	2.0260	156	0.9652	0.1052	0.9652	0.9825
No log	2.0519	158	0.9110	0.1256	0.9110	0.9545
No log	2.0779	160	0.9143	0.1141	0.9143	0.9562
No log	2.1039	162	0.8968	0.1624	0.8968	0.9470
No log	2.1299	164	0.9162	0.0637	0.9162	0.9572
No log	2.1558	166	0.9906	0.0378	0.9906	0.9953
No log	2.1818	168	0.9768	0.0406	0.9768	0.9884
No log	2.2078	170	0.9324	0.1051	0.9324	0.9656
No log	2.2338	172	0.9419	0.1028	0.9419	0.9705
No log	2.2597	174	1.0389	0.1501	1.0389	1.0193
No log	2.2857	176	1.0412	0.1998	1.0412	1.0204
No log	2.3117	178	1.0086	0.2511	1.0086	1.0043
No log	2.3377	180	0.9950	0.3201	0.9950	0.9975
No log	2.3636	182	0.9725	0.1682	0.9725	0.9862
No log	2.3896	184	0.9225	0.2853	0.9225	0.9605
No log	2.4156	186	0.8960	0.2078	0.8960	0.9466
No log	2.4416	188	0.9523	0.2724	0.9523	0.9759
No log	2.4675	190	1.0223	0.1969	1.0223	1.0111
No log	2.4935	192	1.0529	0.1594	1.0529	1.0261
No log	2.5195	194	0.9966	0.2781	0.9966	0.9983
No log	2.5455	196	0.9855	0.2099	0.9855	0.9927
No log	2.5714	198	1.0691	0.1886	1.0691	1.0340
No log	2.5974	200	1.1510	0.1803	1.1510	1.0728
No log	2.6234	202	1.1589	0.1781	1.1589	1.0765
No log	2.6494	204	1.1841	0.2310	1.1841	1.0882
No log	2.6753	206	1.1739	0.1319	1.1739	1.0835
No log	2.7013	208	1.1743	0.1287	1.1743	1.0837
No log	2.7273	210	1.2062	0.1439	1.2062	1.0983
No log	2.7532	212	1.2459	0.1810	1.2459	1.1162
No log	2.7792	214	1.2629	0.1146	1.2629	1.1238
No log	2.8052	216	1.2535	0.1846	1.2535	1.1196
No log	2.8312	218	1.1675	0.0961	1.1675	1.0805
No log	2.8571	220	1.0945	0.0909	1.0945	1.0462
No log	2.8831	222	1.0885	-0.0323	1.0885	1.0433
No log	2.9091	224	1.0533	0.0978	1.0533	1.0263
No log	2.9351	226	1.0700	0.1607	1.0700	1.0344
No log	2.9610	228	1.1794	0.0955	1.1794	1.0860
No log	2.9870	230	1.2050	0.1962	1.2050	1.0977
No log	3.0130	232	1.1400	0.1015	1.1400	1.0677
No log	3.0390	234	1.0642	0.1205	1.0642	1.0316
No log	3.0649	236	1.0407	0.0379	1.0407	1.0202
No log	3.0909	238	1.0336	0.0668	1.0336	1.0167
No log	3.1169	240	1.0227	0.1801	1.0227	1.0113
No log	3.1429	242	0.9983	0.1915	0.9983	0.9992
No log	3.1688	244	0.9542	0.0872	0.9542	0.9768
No log	3.1948	246	0.9490	0.1450	0.9490	0.9741
No log	3.2208	248	0.9425	0.1736	0.9425	0.9708
No log	3.2468	250	0.9560	0.2163	0.9560	0.9777
No log	3.2727	252	0.9353	0.1598	0.9353	0.9671
No log	3.2987	254	0.9092	0.1403	0.9092	0.9535
No log	3.3247	256	0.9215	0.1857	0.9215	0.9600
No log	3.3506	258	0.9441	0.2034	0.9441	0.9717
No log	3.3766	260	0.9446	0.0912	0.9446	0.9719
No log	3.4026	262	0.9494	0.1066	0.9494	0.9744
No log	3.4286	264	0.9900	0.0932	0.9900	0.9950
No log	3.4545	266	1.0072	0.0932	1.0072	1.0036
No log	3.4805	268	1.0204	0.0927	1.0204	1.0101
No log	3.5065	270	1.0154	0.1176	1.0154	1.0077
No log	3.5325	272	1.0513	0.1248	1.0513	1.0254
No log	3.5584	274	1.1717	0.1803	1.1717	1.0824
No log	3.5844	276	1.2983	0.1663	1.2983	1.1394
No log	3.6104	278	1.3056	0.1704	1.3056	1.1426
No log	3.6364	280	1.2206	0.2031	1.2206	1.1048
No log	3.6623	282	1.1202	0.1743	1.1202	1.0584
No log	3.6883	284	1.1111	0.1542	1.1111	1.0541
No log	3.7143	286	1.0907	0.2091	1.0907	1.0444
No log	3.7403	288	1.1271	0.1412	1.1271	1.0617
No log	3.7662	290	1.1302	0.1333	1.1302	1.0631
No log	3.7922	292	1.1147	0.2093	1.1147	1.0558
No log	3.8182	294	1.0971	0.1818	1.0971	1.0474
No log	3.8442	296	1.0882	0.0941	1.0882	1.0432
No log	3.8701	298	1.1630	0.1770	1.1630	1.0784
No log	3.8961	300	1.2517	0.1898	1.2517	1.1188
No log	3.9221	302	1.2048	0.1923	1.2048	1.0976
No log	3.9481	304	1.0547	0.0939	1.0547	1.0270
No log	3.9740	306	1.0273	0.1732	1.0273	1.0136
No log	4.0	308	1.0223	0.1662	1.0223	1.0111
No log	4.0260	310	1.0783	0.1389	1.0783	1.0384
No log	4.0519	312	1.0939	0.1699	1.0939	1.0459
No log	4.0779	314	1.1589	0.2012	1.1589	1.0765
No log	4.1039	316	1.2495	0.1275	1.2495	1.1178
No log	4.1299	318	1.2738	0.0982	1.2738	1.1286
No log	4.1558	320	1.3616	0.0655	1.3616	1.1669
No log	4.1818	322	1.2883	0.0732	1.2883	1.1350
No log	4.2078	324	1.1395	0.2014	1.1395	1.0675
No log	4.2338	326	1.0469	0.1175	1.0469	1.0232
No log	4.2597	328	0.9829	0.1472	0.9829	0.9914
No log	4.2857	330	0.9909	0.1310	0.9909	0.9954
No log	4.3117	332	1.0191	0.1533	1.0191	1.0095
No log	4.3377	334	1.0671	0.1107	1.0671	1.0330
No log	4.3636	336	1.1227	0.2651	1.1227	1.0596
No log	4.3896	338	1.1136	0.2651	1.1136	1.0553
No log	4.4156	340	1.0715	0.2420	1.0715	1.0352
No log	4.4416	342	1.0259	0.1168	1.0259	1.0129
No log	4.4675	344	1.0081	0.1099	1.0081	1.0040
No log	4.4935	346	1.0015	0.0752	1.0015	1.0007
No log	4.5195	348	1.0314	0.1720	1.0314	1.0156
No log	4.5455	350	1.0941	0.1831	1.0941	1.0460
No log	4.5714	352	1.1298	0.1689	1.1298	1.0629
No log	4.5974	354	1.1412	0.1689	1.1412	1.0683
No log	4.6234	356	1.0827	0.2374	1.0827	1.0405
No log	4.6494	358	1.0616	0.1198	1.0616	1.0303
No log	4.6753	360	1.1079	0.1066	1.1079	1.0526
No log	4.7013	362	1.1357	0.1226	1.1357	1.0657
No log	4.7273	364	1.2197	0.1705	1.2197	1.1044
No log	4.7532	366	1.2970	0.2004	1.2970	1.1389
No log	4.7792	368	1.2562	0.1884	1.2562	1.1208
No log	4.8052	370	1.1775	0.1948	1.1775	1.0851
No log	4.8312	372	1.0564	0.2359	1.0564	1.0278
No log	4.8571	374	1.0254	0.0943	1.0254	1.0126
No log	4.8831	376	1.0329	0.0943	1.0329	1.0163
No log	4.9091	378	1.1207	0.2303	1.1207	1.0586
No log	4.9351	380	1.1597	0.2234	1.1597	1.0769
No log	4.9610	382	1.0961	0.2303	1.0961	1.0469
No log	4.9870	384	0.9964	0.1641	0.9964	0.9982
No log	5.0130	386	0.9921	0.0431	0.9921	0.9961
No log	5.0390	388	1.0021	0.0790	1.0021	1.0010
No log	5.0649	390	0.9822	0.1874	0.9822	0.9910
No log	5.0909	392	1.0753	0.2404	1.0753	1.0370
No log	5.1169	394	1.1834	0.1697	1.1834	1.0878
No log	5.1429	396	1.1932	0.1697	1.1932	1.0923
No log	5.1688	398	1.1106	0.1514	1.1106	1.0539
No log	5.1948	400	1.0794	0.1196	1.0794	1.0389
No log	5.2208	402	1.1053	0.1106	1.1053	1.0513
No log	5.2468	404	1.1618	0.1923	1.1618	1.0779
No log	5.2727	406	1.2918	0.1492	1.2918	1.1366
No log	5.2987	408	1.4194	0.1754	1.4194	1.1914
No log	5.3247	410	1.4187	0.1829	1.4187	1.1911
No log	5.3506	412	1.3161	0.2110	1.3161	1.1472
No log	5.3766	414	1.1784	0.1287	1.1784	1.0856
No log	5.4026	416	1.1200	0.1076	1.1200	1.0583
No log	5.4286	418	1.1026	0.0852	1.1026	1.0501
No log	5.4545	420	1.1225	0.1326	1.1225	1.0595
No log	5.4805	422	1.1190	0.1326	1.1190	1.0578
No log	5.5065	424	1.1655	0.0986	1.1655	1.0796
No log	5.5325	426	1.2769	0.1764	1.2769	1.1300
No log	5.5584	428	1.2884	0.1846	1.2884	1.1351
No log	5.5844	430	1.2372	0.2440	1.2372	1.1123
No log	5.6104	432	1.1369	0.1018	1.1369	1.0662
No log	5.6364	434	1.0550	0.1413	1.0550	1.0271
No log	5.6623	436	0.9984	0.1033	0.9984	0.9992
No log	5.6883	438	0.9822	0.0330	0.9822	0.9911
No log	5.7143	440	1.0109	0.2387	1.0109	1.0054
No log	5.7403	442	1.0773	0.2147	1.0773	1.0379
No log	5.7662	444	1.1679	0.2150	1.1679	1.0807
No log	5.7922	446	1.1854	0.1961	1.1854	1.0888
No log	5.8182	448	1.1261	0.0806	1.1261	1.0612
No log	5.8442	450	1.1064	0.1430	1.1064	1.0518
No log	5.8701	452	1.0743	0.0806	1.0743	1.0365
No log	5.8961	454	1.0680	0.1755	1.0680	1.0334
No log	5.9221	456	1.0493	0.1818	1.0493	1.0244
No log	5.9481	458	1.0613	0.1634	1.0613	1.0302
No log	5.9740	460	1.0639	0.1940	1.0639	1.0315
No log	6.0	462	1.0756	0.2310	1.0756	1.0371
No log	6.0260	464	1.0670	0.2676	1.0670	1.0330
No log	6.0519	466	1.1068	0.2256	1.1068	1.0521
No log	6.0779	468	1.1056	0.1132	1.1056	1.0515
No log	6.1039	470	1.1372	0.1219	1.1372	1.0664
No log	6.1299	472	1.1385	0.0932	1.1385	1.0670
No log	6.1558	474	1.1323	0.1515	1.1323	1.0641
No log	6.1818	476	1.1243	0.1890	1.1243	1.0603
No log	6.2078	478	1.0759	0.1546	1.0759	1.0373
No log	6.2338	480	1.0202	0.2140	1.0202	1.0101
No log	6.2597	482	1.0011	0.1161	1.0011	1.0005
No log	6.2857	484	0.9991	0.1945	0.9991	0.9995
No log	6.3117	486	1.0256	0.1563	1.0256	1.0127
No log	6.3377	488	1.0305	0.2099	1.0305	1.0151
No log	6.3636	490	1.0490	0.1405	1.0490	1.0242
No log	6.3896	492	1.0939	0.2183	1.0939	1.0459
No log	6.4156	494	1.1238	0.2183	1.1238	1.0601
No log	6.4416	496	1.1288	0.0965	1.1288	1.0625
No log	6.4675	498	1.2163	0.1769	1.2163	1.1028
0.4785	6.4935	500	1.2161	0.1932	1.2161	1.1028
0.4785	6.5195	502	1.1036	0.0715	1.1036	1.0505
0.4785	6.5455	504	1.0267	0.1173	1.0267	1.0133
0.4785	6.5714	506	1.0247	0.0262	1.0247	1.0123
0.4785	6.5974	508	1.0032	-0.0066	1.0032	1.0016
0.4785	6.6234	510	1.0415	0.0539	1.0415	1.0206

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1