ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6328
• Qwk: -0.0025
• Mse: 1.6328
• Rmse: 1.2778

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	2.6285	-0.0407	2.6285	1.6213
No log	0.0930	4	1.3633	0.0745	1.3633	1.1676
No log	0.1395	6	1.1048	-0.1355	1.1048	1.0511
No log	0.1860	8	1.0158	0.0826	1.0158	1.0079
No log	0.2326	10	1.0283	0.1584	1.0283	1.0140
No log	0.2791	12	0.9754	0.0888	0.9754	0.9876
No log	0.3256	14	0.9090	0.0359	0.9090	0.9534
No log	0.3721	16	0.9072	0.0	0.9072	0.9525
No log	0.4186	18	0.8771	0.0	0.8771	0.9365
No log	0.4651	20	0.8262	0.0	0.8262	0.9090
No log	0.5116	22	0.7842	0.0	0.7842	0.8856
No log	0.5581	24	0.7594	0.0	0.7594	0.8714
No log	0.6047	26	0.6931	0.1617	0.6931	0.8325
No log	0.6512	28	0.7831	0.1699	0.7831	0.8849
No log	0.6977	30	0.8161	0.0573	0.8161	0.9034
No log	0.7442	32	0.7901	0.0208	0.7901	0.8889
No log	0.7907	34	0.7525	0.2652	0.7525	0.8675
No log	0.8372	36	0.7478	0.2027	0.7478	0.8648
No log	0.8837	38	0.7608	0.1359	0.7608	0.8723
No log	0.9302	40	0.7575	0.0643	0.7575	0.8703
No log	0.9767	42	0.7585	0.0840	0.7585	0.8709
No log	1.0233	44	0.7843	0.0	0.7843	0.8856
No log	1.0698	46	0.7821	0.0481	0.7821	0.8844
No log	1.1163	48	0.7659	0.1287	0.7659	0.8751
No log	1.1628	50	0.7468	0.1094	0.7468	0.8642
No log	1.2093	52	0.7781	0.1918	0.7781	0.8821
No log	1.2558	54	0.8127	0.3099	0.8127	0.9015
No log	1.3023	56	0.8233	0.3746	0.8233	0.9074
No log	1.3488	58	0.8361	0.3473	0.8361	0.9144
No log	1.3953	60	0.9360	0.2460	0.9360	0.9674
No log	1.4419	62	0.9949	0.1909	0.9949	0.9974
No log	1.4884	64	1.0230	0.2141	1.0230	1.0114
No log	1.5349	66	0.9933	0.3170	0.9933	0.9967
No log	1.5814	68	0.9048	0.2995	0.9048	0.9512
No log	1.6279	70	0.8476	0.2866	0.8476	0.9206
No log	1.6744	72	0.8168	0.2904	0.8168	0.9038
No log	1.7209	74	0.7806	0.2227	0.7806	0.8835
No log	1.7674	76	0.7628	0.2171	0.7628	0.8734
No log	1.8140	78	0.8267	0.2297	0.8267	0.9092
No log	1.8605	80	0.9433	0.2046	0.9433	0.9712
No log	1.9070	82	1.0377	0.1747	1.0377	1.0187
No log	1.9535	84	1.0807	0.2227	1.0807	1.0396
No log	2.0	86	1.0454	0.2601	1.0454	1.0224
No log	2.0465	88	1.0288	0.2886	1.0288	1.0143
No log	2.0930	90	1.1035	0.2504	1.1035	1.0505
No log	2.1395	92	1.2012	0.1758	1.2012	1.0960
No log	2.1860	94	1.1180	-0.0352	1.1180	1.0574
No log	2.2326	96	1.0788	0.0105	1.0788	1.0386
No log	2.2791	98	1.0987	0.1243	1.0987	1.0482
No log	2.3256	100	1.1313	0.2504	1.1313	1.0636
No log	2.3721	102	1.1583	0.1832	1.1583	1.0762
No log	2.4186	104	1.0970	0.2651	1.0970	1.0474
No log	2.4651	106	1.0328	0.2866	1.0328	1.0163
No log	2.5116	108	0.9618	0.1672	0.9618	0.9807
No log	2.5581	110	0.9519	0.1254	0.9519	0.9757
No log	2.6047	112	1.0057	0.0437	1.0057	1.0028
No log	2.6512	114	1.1770	0.1635	1.1770	1.0849
No log	2.6977	116	1.3657	0.0417	1.3657	1.1686
No log	2.7442	118	1.4969	-0.0570	1.4969	1.2235
No log	2.7907	120	1.5591	-0.0586	1.5591	1.2486
No log	2.8372	122	1.5974	-0.0602	1.5974	1.2639
No log	2.8837	124	1.6785	-0.1050	1.6785	1.2956
No log	2.9302	126	1.6761	0.0948	1.6761	1.2946
No log	2.9767	128	1.5789	0.0842	1.5789	1.2565
No log	3.0233	130	1.4750	0.0293	1.4750	1.2145
No log	3.0698	132	1.1931	-0.0116	1.1931	1.0923
No log	3.1163	134	1.1070	0.0652	1.1070	1.0522
No log	3.1628	136	1.0425	0.0652	1.0425	1.0210
No log	3.2093	138	1.0331	0.1822	1.0331	1.0164
No log	3.2558	140	1.1716	0.1557	1.1715	1.0824
No log	3.3023	142	1.2470	0.1688	1.2470	1.1167
No log	3.3488	144	1.1819	0.2324	1.1819	1.0872
No log	3.3953	146	1.0955	0.2227	1.0955	1.0467
No log	3.4419	148	1.0384	0.1911	1.0384	1.0190
No log	3.4884	150	1.0915	0.1955	1.0915	1.0447
No log	3.5349	152	1.1681	0.1635	1.1681	1.0808
No log	3.5814	154	1.3121	0.1621	1.3121	1.1455
No log	3.6279	156	1.3481	0.0679	1.3481	1.1611
No log	3.6744	158	1.2771	0.1283	1.2771	1.1301
No log	3.7209	160	1.2347	0.1588	1.2347	1.1112
No log	3.7674	162	1.0812	0.2903	1.0812	1.0398
No log	3.8140	164	1.0837	0.2903	1.0837	1.0410
No log	3.8605	166	1.1576	0.2914	1.1576	1.0759
No log	3.9070	168	1.1666	0.2353	1.1666	1.0801
No log	3.9535	170	1.1873	0.2258	1.1873	1.0896
No log	4.0	172	1.1339	0.1832	1.1339	1.0649
No log	4.0465	174	1.1938	0.1713	1.1938	1.0926
No log	4.0930	176	1.3533	0.1643	1.3533	1.1633
No log	4.1395	178	1.6160	0.0802	1.6160	1.2712
No log	4.1860	180	1.5713	0.0923	1.5713	1.2535
No log	4.2326	182	1.4799	0.0923	1.4799	1.2165
No log	4.2791	184	1.2956	0.1917	1.2956	1.1382
No log	4.3256	186	1.1059	0.1870	1.1059	1.0516
No log	4.3721	188	1.0365	0.3051	1.0365	1.0181
No log	4.4186	190	1.0838	0.2552	1.0838	1.0410
No log	4.4651	192	1.1656	0.1341	1.1656	1.0796
No log	4.5116	194	1.2184	0.0822	1.2184	1.1038
No log	4.5581	196	1.2180	0.1067	1.2180	1.1036
No log	4.6047	198	1.1497	0.1944	1.1497	1.0723
No log	4.6512	200	1.0973	0.2059	1.0973	1.0475
No log	4.6977	202	1.0913	0.2876	1.0913	1.0446
No log	4.7442	204	1.0222	0.2910	1.0222	1.0110
No log	4.7907	206	0.9622	0.3134	0.9622	0.9809
No log	4.8372	208	0.9138	0.3564	0.9138	0.9559
No log	4.8837	210	0.9591	0.3287	0.9591	0.9793
No log	4.9302	212	1.0398	0.2141	1.0398	1.0197
No log	4.9767	214	1.1549	0.2107	1.1549	1.0746
No log	5.0233	216	1.1542	0.1825	1.1542	1.0743
No log	5.0698	218	1.1360	0.2579	1.1360	1.0658
No log	5.1163	220	1.2475	0.1906	1.2475	1.1169
No log	5.1628	222	1.3903	0.1189	1.3903	1.1791
No log	5.2093	224	1.4521	0.0969	1.4521	1.2050
No log	5.2558	226	1.4152	0.1559	1.4152	1.1896
No log	5.3023	228	1.3500	0.1212	1.3500	1.1619
No log	5.3488	230	1.2671	0.1638	1.2671	1.1257
No log	5.3953	232	1.2671	0.1638	1.2671	1.1257
No log	5.4419	234	1.1900	0.1784	1.1900	1.0909
No log	5.4884	236	1.1138	0.2367	1.1138	1.0554
No log	5.5349	238	1.0780	0.1832	1.0780	1.0383
No log	5.5814	240	1.1466	0.1815	1.1466	1.0708
No log	5.6279	242	1.1600	0.2092	1.1600	1.0770
No log	5.6744	244	1.1158	0.1748	1.1158	1.0563
No log	5.7209	246	1.0224	0.2084	1.0224	1.0111
No log	5.7674	248	0.9552	0.2410	0.9552	0.9773
No log	5.8140	250	1.0505	0.2209	1.0505	1.0250
No log	5.8605	252	1.1856	0.1490	1.1856	1.0889
No log	5.9070	254	1.2218	0.0790	1.2218	1.1053
No log	5.9535	256	1.1907	0.0546	1.1907	1.0912
No log	6.0	258	1.2663	0.1175	1.2663	1.1253
No log	6.0465	260	1.1781	0.2020	1.1781	1.0854
No log	6.0930	262	0.9985	0.3051	0.9985	0.9992
No log	6.1395	264	0.9948	0.3287	0.9948	0.9974
No log	6.1860	266	1.1141	0.1758	1.1141	1.0555
No log	6.2326	268	1.4155	0.0389	1.4155	1.1897
No log	6.2791	270	1.5923	0.0196	1.5923	1.2619
No log	6.3256	272	1.4439	-0.0086	1.4439	1.2016
No log	6.3721	274	1.4802	-0.0086	1.4802	1.2167
No log	6.4186	276	1.7238	0.0583	1.7238	1.3129
No log	6.4651	278	1.6742	0.0350	1.6742	1.2939
No log	6.5116	280	1.2591	0.1121	1.2591	1.1221
No log	6.5581	282	1.0375	0.2457	1.0375	1.0186
No log	6.6047	284	0.9553	0.2460	0.9553	0.9774
No log	6.6512	286	1.0208	0.2552	1.0208	1.0104
No log	6.6977	288	1.1527	0.1688	1.1527	1.0736
No log	6.7442	290	1.2895	0.0993	1.2895	1.1356
No log	6.7907	292	1.3484	0.0720	1.3484	1.1612
No log	6.8372	294	1.3219	0.0720	1.3219	1.1498
No log	6.8837	296	1.1972	0.1371	1.1972	1.0941
No log	6.9302	298	1.1526	0.1688	1.1526	1.0736
No log	6.9767	300	1.2533	0.1067	1.2533	1.1195
No log	7.0233	302	1.3621	0.0	1.3621	1.1671
No log	7.0698	304	1.3769	-0.0231	1.3769	1.1734
No log	7.1163	306	1.3315	0.0475	1.3315	1.1539
No log	7.1628	308	1.2616	0.1513	1.2616	1.1232
No log	7.2093	310	1.2104	0.1815	1.2104	1.1002
No log	7.2558	312	1.0832	0.2954	1.0832	1.0408
No log	7.3023	314	1.0310	0.1709	1.0310	1.0154
No log	7.3488	316	1.0435	0.1671	1.0435	1.0215
No log	7.3953	318	1.0803	0.1599	1.0803	1.0394
No log	7.4419	320	1.0761	0.1949	1.0761	1.0374
No log	7.4884	322	1.1504	0.1397	1.1504	1.0726
No log	7.5349	324	1.3481	0.1261	1.3481	1.1611
No log	7.5814	326	1.3793	0.0925	1.3793	1.1745
No log	7.6279	328	1.3325	0.0704	1.3325	1.1543
No log	7.6744	330	1.3351	0.0969	1.3351	1.1555
No log	7.7209	332	1.2733	0.1042	1.2733	1.1284
No log	7.7674	334	1.3174	0.1395	1.3174	1.1478
No log	7.8140	336	1.3190	0.1469	1.3190	1.1485
No log	7.8605	338	1.3423	0.1469	1.3423	1.1586
No log	7.9070	340	1.2286	0.1309	1.2286	1.1084
No log	7.9535	342	1.1266	0.1148	1.1266	1.0614
No log	8.0	344	1.1778	0.1121	1.1778	1.0853
No log	8.0465	346	1.1950	0.1067	1.1950	1.0932
No log	8.0930	348	1.3601	0.0758	1.3601	1.1663
No log	8.1395	350	1.4750	0.0215	1.4750	1.2145
No log	8.1860	352	1.4052	0.0493	1.4052	1.1854
No log	8.2326	354	1.4514	0.0251	1.4514	1.2047
No log	8.2791	356	1.5602	0.0767	1.5602	1.2491
No log	8.3256	358	1.4541	0.1075	1.4541	1.2059
No log	8.3721	360	1.3366	0.1172	1.3366	1.1561
No log	8.4186	362	1.2348	0.1042	1.2348	1.1112
No log	8.4651	364	1.2024	0.1067	1.2024	1.0965
No log	8.5116	366	1.1959	0.1120	1.1959	1.0936
No log	8.5581	368	1.1671	0.1713	1.1671	1.0803
No log	8.6047	370	1.1653	0.1713	1.1653	1.0795
No log	8.6512	372	1.2770	0.1280	1.2770	1.1301
No log	8.6977	374	1.3479	0.0860	1.3479	1.1610
No log	8.7442	376	1.3169	0.0860	1.3169	1.1476
No log	8.7907	378	1.2261	0.1042	1.2261	1.1073
No log	8.8372	380	1.0886	0.2324	1.0886	1.0433
No log	8.8837	382	0.9986	0.3114	0.9986	0.9993
No log	8.9302	384	1.0772	0.2522	1.0772	1.0379
No log	8.9767	386	1.3035	0.1226	1.3035	1.1417
No log	9.0233	388	1.3989	0.1075	1.3989	1.1828
No log	9.0698	390	1.3490	0.1075	1.3490	1.1615
No log	9.1163	392	1.3201	0.1399	1.3201	1.1490
No log	9.1628	394	1.3147	0.1312	1.3147	1.1466
No log	9.2093	396	1.3357	0.1016	1.3357	1.1557
No log	9.2558	398	1.3330	0.0754	1.3330	1.1546
No log	9.3023	400	1.2859	0.1016	1.2859	1.1340
No log	9.3488	402	1.2076	0.0822	1.2076	1.0989
No log	9.3953	404	1.0897	0.2324	1.0897	1.0439
No log	9.4419	406	1.0347	0.1870	1.0347	1.0172
No log	9.4884	408	1.2047	0.1337	1.2047	1.0976
No log	9.5349	410	1.4109	0.0968	1.4109	1.1878
No log	9.5814	412	1.4276	0.0645	1.4276	1.1948
No log	9.6279	414	1.3864	0.1075	1.3864	1.1775
No log	9.6744	416	1.3134	0.1147	1.3134	1.1460
No log	9.7209	418	1.2284	0.1171	1.2284	1.1083
No log	9.7674	420	1.2464	0.1455	1.2464	1.1164
No log	9.8140	422	1.3611	0.1122	1.3611	1.1667
No log	9.8605	424	1.5586	0.0186	1.5586	1.2485
No log	9.9070	426	1.5991	0.0168	1.5991	1.2646
No log	9.9535	428	1.7894	0.0967	1.7894	1.3377
No log	10.0	430	1.9202	0.0967	1.9202	1.3857
No log	10.0465	432	1.8389	0.0640	1.8389	1.3561
No log	10.0930	434	1.5239	0.0422	1.5239	1.2344
No log	10.1395	436	1.2351	0.1148	1.2351	1.1114
No log	10.1860	438	1.0848	0.1499	1.0848	1.0415
No log	10.2326	440	1.1142	0.0736	1.1142	1.0555
No log	10.2791	442	1.2657	0.1399	1.2657	1.1250
No log	10.3256	444	1.5127	0.0613	1.5127	1.2299
No log	10.3721	446	1.5725	0.0613	1.5725	1.2540
No log	10.4186	448	1.4644	0.0842	1.4644	1.2101
No log	10.4651	450	1.2661	0.1042	1.2661	1.1252
No log	10.5116	452	1.1971	0.1371	1.1971	1.0941
No log	10.5581	454	1.2147	0.1371	1.2147	1.1021
No log	10.6047	456	1.3641	0.0715	1.3641	1.1679
No log	10.6512	458	1.5524	0.0168	1.5524	1.2460
No log	10.6977	460	1.6357	0.0186	1.6357	1.2789
No log	10.7442	462	1.6638	0.0186	1.6638	1.2899
No log	10.7907	464	1.5861	0.0422	1.5861	1.2594
No log	10.8372	466	1.5137	0.0225	1.5137	1.2303
No log	10.8837	468	1.3310	0.1041	1.3310	1.1537
No log	10.9302	470	1.1108	0.1205	1.1108	1.0539
No log	10.9767	472	1.0151	0.1909	1.0151	1.0075
No log	11.0233	474	1.0078	0.2227	1.0078	1.0039
No log	11.0698	476	1.1400	0.1176	1.1400	1.0677
No log	11.1163	478	1.3058	0.1041	1.3058	1.1427
No log	11.1628	480	1.4708	0.0659	1.4708	1.2128
No log	11.2093	482	1.5496	0.0422	1.5496	1.2448
No log	11.2558	484	1.5144	0.0422	1.5144	1.2306
No log	11.3023	486	1.5076	0.0422	1.5076	1.2279
No log	11.3488	488	1.5260	0.0422	1.5260	1.2353
No log	11.3953	490	1.4935	0.0422	1.4935	1.2221
No log	11.4419	492	1.4146	0.0695	1.4146	1.1894
No log	11.4884	494	1.3736	0.0517	1.3736	1.1720
No log	11.5349	496	1.3425	0.0776	1.3425	1.1587
No log	11.5814	498	1.4448	0.0695	1.4448	1.2020
0.3376	11.6279	500	1.6322	0.0389	1.6322	1.2776
0.3376	11.6744	502	1.7857	0.0168	1.7857	1.3363
0.3376	11.7209	504	1.7996	0.0350	1.7996	1.3415
0.3376	11.7674	506	1.6923	0.0168	1.6923	1.3009
0.3376	11.8140	508	1.6117	-0.0025	1.6117	1.2695
0.3376	11.8605	510	1.6328	-0.0025	1.6328	1.2778

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1