ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9607
• Qwk: -0.0260
• Mse: 0.9607
• Rmse: 0.9801

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	3.8746	-0.0057	3.8746	1.9684
No log	0.0930	4	2.1270	0.0104	2.1270	1.4584
No log	0.1395	6	1.6808	0.0560	1.6808	1.2965
No log	0.1860	8	1.4260	0.0230	1.4260	1.1942
No log	0.2326	10	1.0257	-0.1632	1.0257	1.0128
No log	0.2791	12	0.8937	-0.1253	0.8937	0.9454
No log	0.3256	14	1.1692	0.0119	1.1692	1.0813
No log	0.3721	16	1.7046	-0.0271	1.7046	1.3056
No log	0.4186	18	1.6561	0.0	1.6561	1.2869
No log	0.4651	20	1.3765	0.0	1.3765	1.1733
No log	0.5116	22	1.0437	0.0279	1.0437	1.0216
No log	0.5581	24	0.9838	0.0083	0.9838	0.9919
No log	0.6047	26	0.8897	-0.1265	0.8897	0.9432
No log	0.6512	28	0.7826	-0.0101	0.7826	0.8846
No log	0.6977	30	0.7472	0.0	0.7472	0.8644
No log	0.7442	32	0.8298	-0.2278	0.8298	0.9110
No log	0.7907	34	1.0278	-0.1019	1.0278	1.0138
No log	0.8372	36	1.0332	-0.0133	1.0332	1.0165
No log	0.8837	38	1.0292	-0.0411	1.0292	1.0145
No log	0.9302	40	1.0409	-0.0704	1.0409	1.0202
No log	0.9767	42	1.0606	-0.0149	1.0606	1.0298
No log	1.0233	44	0.9490	-0.1282	0.9490	0.9742
No log	1.0698	46	0.9441	-0.0977	0.9441	0.9717
No log	1.1163	48	1.0271	-0.0728	1.0271	1.0135
No log	1.1628	50	1.0936	-0.0728	1.0936	1.0458
No log	1.2093	52	1.0124	-0.0899	1.0124	1.0062
No log	1.2558	54	0.8899	-0.0008	0.8899	0.9434
No log	1.3023	56	0.9805	-0.0854	0.9805	0.9902
No log	1.3488	58	1.1476	-0.0720	1.1476	1.0712
No log	1.3953	60	1.1381	-0.0468	1.1381	1.0668
No log	1.4419	62	1.1595	-0.0457	1.1595	1.0768
No log	1.4884	64	0.9959	-0.1226	0.9959	0.9980
No log	1.5349	66	0.9225	0.0188	0.9225	0.9605
No log	1.5814	68	0.9943	-0.0439	0.9943	0.9972
No log	1.6279	70	1.1467	-0.1092	1.1467	1.0708
No log	1.6744	72	1.3880	-0.1566	1.3880	1.1781
No log	1.7209	74	1.4511	-0.1461	1.4511	1.2046
No log	1.7674	76	1.1851	-0.0253	1.1851	1.0886
No log	1.8140	78	1.0652	-0.0545	1.0652	1.0321
No log	1.8605	80	0.9572	0.0476	0.9572	0.9784
No log	1.9070	82	0.7643	0.1627	0.7643	0.8742
No log	1.9535	84	0.7472	0.1691	0.7472	0.8644
No log	2.0	86	0.9149	0.0377	0.9149	0.9565
No log	2.0465	88	1.3629	-0.0209	1.3629	1.1674
No log	2.0930	90	1.6866	0.0756	1.6866	1.2987
No log	2.1395	92	1.4873	-0.0253	1.4873	1.2196
No log	2.1860	94	1.1415	-0.0987	1.1415	1.0684
No log	2.2326	96	0.9095	-0.0163	0.9095	0.9537
No log	2.2791	98	0.9015	0.0748	0.9015	0.9495
No log	2.3256	100	1.2792	0.0561	1.2792	1.1310
No log	2.3721	102	1.7095	0.0290	1.7095	1.3075
No log	2.4186	104	1.5765	0.0380	1.5765	1.2556
No log	2.4651	106	1.5219	0.0214	1.5219	1.2337
No log	2.5116	108	1.2347	-0.0194	1.2347	1.1112
No log	2.5581	110	0.9169	0.0245	0.9169	0.9575
No log	2.6047	112	0.9623	0.0643	0.9623	0.9810
No log	2.6512	114	0.9510	0.0796	0.9510	0.9752
No log	2.6977	116	1.0784	-0.0073	1.0784	1.0385
No log	2.7442	118	1.4051	-0.0348	1.4051	1.1854
No log	2.7907	120	1.4675	-0.0114	1.4675	1.2114
No log	2.8372	122	1.3524	-0.0334	1.3524	1.1629
No log	2.8837	124	1.1207	0.0107	1.1207	1.0586
No log	2.9302	126	1.0077	0.0470	1.0077	1.0038
No log	2.9767	128	1.0501	-0.0279	1.0501	1.0247
No log	3.0233	130	1.1778	-0.0094	1.1778	1.0853
No log	3.0698	132	1.4616	-0.0883	1.4616	1.2090
No log	3.1163	134	1.4663	-0.0557	1.4663	1.2109
No log	3.1628	136	1.1936	-0.0128	1.1936	1.0925
No log	3.2093	138	1.0492	-0.0184	1.0492	1.0243
No log	3.2558	140	1.0042	0.0245	1.0042	1.0021
No log	3.3023	142	1.1272	0.0683	1.1272	1.0617
No log	3.3488	144	1.7200	-0.0331	1.7200	1.3115
No log	3.3953	146	2.2993	0.0306	2.2993	1.5164
No log	3.4419	148	2.1683	0.0271	2.1683	1.4725
No log	3.4884	150	1.7152	0.0111	1.7152	1.3096
No log	3.5349	152	1.2298	0.0522	1.2298	1.1090
No log	3.5814	154	1.1349	-0.0190	1.1349	1.0653
No log	3.6279	156	1.1614	-0.0190	1.1614	1.0777
No log	3.6744	158	1.2530	0.0313	1.2530	1.1194
No log	3.7209	160	1.3705	-0.0785	1.3705	1.1707
No log	3.7674	162	1.4371	-0.0216	1.4371	1.1988
No log	3.8140	164	1.3040	-0.0181	1.3040	1.1419
No log	3.8605	166	1.3260	-0.0568	1.3260	1.1515
No log	3.9070	168	1.3764	-0.0579	1.3764	1.1732
No log	3.9535	170	1.2373	0.0121	1.2373	1.1123
No log	4.0	172	1.0896	0.0056	1.0896	1.0439
No log	4.0465	174	1.1986	0.0352	1.1986	1.0948
No log	4.0930	176	1.2926	0.0354	1.2926	1.1369
No log	4.1395	178	1.2888	0.0105	1.2888	1.1352
No log	4.1860	180	1.2059	0.0471	1.2059	1.0981
No log	4.2326	182	1.0529	0.0304	1.0529	1.0261
No log	4.2791	184	0.9986	-0.0607	0.9986	0.9993
No log	4.3256	186	0.8687	0.0538	0.8687	0.9320
No log	4.3721	188	0.8218	0.0175	0.8218	0.9065
No log	4.4186	190	0.8166	0.1299	0.8166	0.9037
No log	4.4651	192	0.8938	0.0681	0.8938	0.9454
No log	4.5116	194	0.8205	0.0940	0.8205	0.9058
No log	4.5581	196	0.9736	-0.0440	0.9736	0.9867
No log	4.6047	198	1.2403	0.0917	1.2403	1.1137
No log	4.6512	200	1.1194	0.0492	1.1194	1.0580
No log	4.6977	202	0.8477	0.0490	0.8477	0.9207
No log	4.7442	204	0.8201	0.0679	0.8201	0.9056
No log	4.7907	206	0.9541	-0.0425	0.9541	0.9768
No log	4.8372	208	1.1576	-0.0110	1.1576	1.0759
No log	4.8837	210	1.1290	-0.0066	1.1290	1.0625
No log	4.9302	212	1.2397	0.0725	1.2397	1.1134
No log	4.9767	214	1.4285	0.1004	1.4285	1.1952
No log	5.0233	216	1.2755	0.0849	1.2755	1.1294
No log	5.0698	218	0.9882	0.0562	0.9882	0.9941
No log	5.1163	220	0.9039	0.0289	0.9039	0.9507
No log	5.1628	222	0.8574	0.0269	0.8574	0.9259
No log	5.2093	224	1.0184	0.0392	1.0184	1.0092
No log	5.2558	226	1.6535	-0.0083	1.6535	1.2859
No log	5.3023	228	1.9662	0.0493	1.9662	1.4022
No log	5.3488	230	1.7723	-0.0136	1.7723	1.3313
No log	5.3953	232	1.3630	0.0287	1.3630	1.1675
No log	5.4419	234	1.2847	0.0098	1.2847	1.1335
No log	5.4884	236	1.2340	0.0783	1.2340	1.1109
No log	5.5349	238	1.1794	0.0498	1.1794	1.0860
No log	5.5814	240	1.2616	0.0443	1.2616	1.1232
No log	5.6279	242	1.1043	0.1399	1.1043	1.0509
No log	5.6744	244	0.8976	-0.0178	0.8976	0.9474
No log	5.7209	246	0.8662	0.0549	0.8662	0.9307
No log	5.7674	248	0.8557	0.0347	0.8557	0.9250
No log	5.8140	250	1.0092	0.0293	1.0092	1.0046
No log	5.8605	252	1.5893	0.1042	1.5893	1.2607
No log	5.9070	254	1.8367	0.0168	1.8367	1.3553
No log	5.9535	256	1.5456	0.0813	1.5456	1.2432
No log	6.0	258	1.2102	0.0519	1.2102	1.1001
No log	6.0465	260	1.0104	0.0392	1.0104	1.0052
No log	6.0930	262	0.9770	-0.0164	0.9770	0.9884
No log	6.1395	264	1.0072	0.0435	1.0072	1.0036
No log	6.1860	266	1.0540	0.0407	1.0540	1.0267
No log	6.2326	268	1.1098	0.0273	1.1098	1.0535
No log	6.2791	270	1.1854	0.0440	1.1854	1.0888
No log	6.3256	272	1.1228	0.0566	1.1228	1.0596
No log	6.3721	274	0.9498	0.0727	0.9498	0.9746
No log	6.4186	276	0.9164	0.0362	0.9164	0.9573
No log	6.4651	278	0.9709	0.1025	0.9709	0.9853
No log	6.5116	280	1.0363	0.0877	1.0363	1.0180
No log	6.5581	282	1.0572	0.1228	1.0572	1.0282
No log	6.6047	284	1.0244	0.0596	1.0244	1.0121
No log	6.6512	286	1.0861	0.0547	1.0861	1.0422
No log	6.6977	288	1.1502	0.0829	1.1502	1.0725
No log	6.7442	290	1.1535	0.0668	1.1535	1.0740
No log	6.7907	292	1.1412	0.0960	1.1412	1.0683
No log	6.8372	294	1.0739	0.0956	1.0739	1.0363
No log	6.8837	296	1.0007	0.1541	1.0007	1.0004
No log	6.9302	298	0.9647	0.1105	0.9647	0.9822
No log	6.9767	300	0.9045	0.1648	0.9045	0.9511
No log	7.0233	302	0.9172	0.1379	0.9172	0.9577
No log	7.0698	304	0.9222	0.1361	0.9222	0.9603
No log	7.1163	306	1.0000	0.1479	1.0000	1.0000
No log	7.1628	308	1.2390	0.1492	1.2390	1.1131
No log	7.2093	310	1.1484	0.1182	1.1484	1.0716
No log	7.2558	312	0.9600	0.0886	0.9600	0.9798
No log	7.3023	314	0.8989	0.0692	0.8989	0.9481
No log	7.3488	316	0.8666	0.0392	0.8666	0.9309
No log	7.3953	318	1.0622	0.0134	1.0622	1.0306
No log	7.4419	320	1.1715	0.1042	1.1715	1.0823
No log	7.4884	322	1.1104	0.0508	1.1104	1.0538
No log	7.5349	324	0.9115	0.0062	0.9115	0.9547
No log	7.5814	326	0.8663	0.1012	0.8663	0.9308
No log	7.6279	328	0.8710	0.0113	0.8710	0.9332
No log	7.6744	330	1.0159	0.0250	1.0159	1.0079
No log	7.7209	332	1.2023	0.0980	1.2023	1.0965
No log	7.7674	334	1.1041	0.0508	1.1041	1.0508
No log	7.8140	336	0.9031	0.0762	0.9031	0.9503
No log	7.8605	338	0.8719	0.0066	0.8719	0.9338
No log	7.9070	340	0.9248	0.0747	0.9248	0.9616
No log	7.9535	342	0.9028	0.0337	0.9028	0.9502
No log	8.0	344	0.9021	-0.0946	0.9021	0.9498
No log	8.0465	346	1.0798	0.0267	1.0798	1.0391
No log	8.0930	348	1.3686	0.0576	1.3686	1.1699
No log	8.1395	350	1.3543	0.0875	1.3543	1.1638
No log	8.1860	352	1.1796	0.0309	1.1796	1.0861
No log	8.2326	354	1.1087	-0.0225	1.1087	1.0530
No log	8.2791	356	1.0635	0.0019	1.0635	1.0312
No log	8.3256	358	1.0740	0.0844	1.0740	1.0363
No log	8.3721	360	1.0726	0.0536	1.0726	1.0357
No log	8.4186	362	1.0784	0.0839	1.0784	1.0384
No log	8.4651	364	1.0375	0.0760	1.0375	1.0186
No log	8.5116	366	1.0048	0.1173	1.0048	1.0024
No log	8.5581	368	1.0906	0.0475	1.0906	1.0443
No log	8.6047	370	1.1885	0.0365	1.1885	1.0902
No log	8.6512	372	1.2405	0.0512	1.2405	1.1138
No log	8.6977	374	1.1894	0.0476	1.1894	1.0906
No log	8.7442	376	1.0016	-0.0029	1.0016	1.0008
No log	8.7907	378	0.9479	0.0509	0.9479	0.9736
No log	8.8372	380	0.8935	0.0975	0.8935	0.9452
No log	8.8837	382	0.9310	0.0348	0.9310	0.9649
No log	8.9302	384	1.0948	0.1363	1.0948	1.0463
No log	8.9767	386	1.0337	0.0843	1.0337	1.0167
No log	9.0233	388	1.0209	0.0877	1.0209	1.0104
No log	9.0698	390	0.9045	0.0316	0.9045	0.9511
No log	9.1163	392	0.8818	0.0793	0.8818	0.9391
No log	9.1628	394	0.8540	0.1308	0.8540	0.9241
No log	9.2093	396	0.8633	0.0884	0.8633	0.9291
No log	9.2558	398	0.9789	0.1360	0.9789	0.9894
No log	9.3023	400	1.0713	0.0458	1.0713	1.0350
No log	9.3488	402	0.9727	0.0909	0.9727	0.9862
No log	9.3953	404	0.8351	0.0529	0.8351	0.9138
No log	9.4419	406	0.8555	-0.0088	0.8555	0.9249
No log	9.4884	408	0.8657	0.0583	0.8657	0.9304
No log	9.5349	410	1.0202	-0.0090	1.0202	1.0101
No log	9.5814	412	1.1767	0.0634	1.1767	1.0848
No log	9.6279	414	1.0907	0.0451	1.0907	1.0444
No log	9.6744	416	0.9165	0.0452	0.9165	0.9573
No log	9.7209	418	0.9068	0.0563	0.9068	0.9522
No log	9.7674	420	0.8969	0.0552	0.8969	0.9471
No log	9.8140	422	0.9351	0.0348	0.9351	0.9670
No log	9.8605	424	1.0864	0.0152	1.0864	1.0423
No log	9.9070	426	1.1632	0.0391	1.1632	1.0785
No log	9.9535	428	0.9743	-0.0456	0.9743	0.9871
No log	10.0	430	0.8691	0.1807	0.8691	0.9322
No log	10.0465	432	0.8273	0.0749	0.8273	0.9095
No log	10.0930	434	0.8140	0.1440	0.8140	0.9022
No log	10.1395	436	0.9230	0.0684	0.9230	0.9607
No log	10.1860	438	1.1901	0.1117	1.1901	1.0909
No log	10.2326	440	1.1923	0.1117	1.1923	1.0919
No log	10.2791	442	1.0087	0.1225	1.0087	1.0043
No log	10.3256	444	0.9146	0.0805	0.9146	0.9563
No log	10.3721	446	0.9260	0.0084	0.9260	0.9623
No log	10.4186	448	0.9630	0.0986	0.9630	0.9813
No log	10.4651	450	0.9393	0.0037	0.9393	0.9692
No log	10.5116	452	0.9084	0.0120	0.9084	0.9531
No log	10.5581	454	0.8969	0.0143	0.8969	0.9470
No log	10.6047	456	0.9042	0.0799	0.9042	0.9509
No log	10.6512	458	0.9297	0.0762	0.9297	0.9642
No log	10.6977	460	0.9485	0.0058	0.9485	0.9739
No log	10.7442	462	0.9561	-0.0098	0.9561	0.9778
No log	10.7907	464	0.9322	-0.0124	0.9322	0.9655
No log	10.8372	466	0.8921	0.0452	0.8921	0.9445
No log	10.8837	468	0.8854	0.0748	0.8854	0.9410
No log	10.9302	470	0.9256	0.1064	0.9256	0.9621
No log	10.9767	472	0.9489	0.1406	0.9489	0.9741
No log	11.0233	474	0.9025	0.1107	0.9025	0.9500
No log	11.0698	476	0.8809	0.1196	0.8809	0.9386
No log	11.1163	478	0.9505	0.0642	0.9505	0.9749
No log	11.1628	480	1.1151	0.0778	1.1151	1.0560
No log	11.2093	482	1.2029	0.0666	1.2029	1.0967
No log	11.2558	484	1.1585	0.0694	1.1585	1.0763
No log	11.3023	486	1.0246	0.0881	1.0246	1.0122
No log	11.3488	488	0.9313	0.0105	0.9313	0.9650
No log	11.3953	490	0.8925	-0.0605	0.8925	0.9447
No log	11.4419	492	0.8680	0.0109	0.8680	0.9317
No log	11.4884	494	0.8926	0.0362	0.8926	0.9448
No log	11.5349	496	1.0026	0.0498	1.0026	1.0013
No log	11.5814	498	0.9977	0.0416	0.9977	0.9988
0.3784	11.6279	500	0.8582	0.0233	0.8582	0.9264
0.3784	11.6744	502	0.7649	0.0680	0.7649	0.8746
0.3784	11.7209	504	0.8097	0.0810	0.8097	0.8998
0.3784	11.7674	506	0.8056	0.0277	0.8056	0.8975
0.3784	11.8140	508	0.9010	0.0233	0.9010	0.9492
0.3784	11.8605	510	1.0610	0.0717	1.0610	1.0301
0.3784	11.9070	512	1.0470	0.0443	1.0470	1.0232
0.3784	11.9535	514	0.9960	-0.0151	0.9960	0.9980
0.3784	12.0	516	0.8821	0.0200	0.8821	0.9392
0.3784	12.0465	518	0.8776	0.1018	0.8776	0.9368
0.3784	12.0930	520	0.8866	0.0975	0.8866	0.9416
0.3784	12.1395	522	0.9874	0.0267	0.9874	0.9937
0.3784	12.1860	524	1.0946	0.1215	1.0946	1.0462
0.3784	12.2326	526	1.0904	0.0416	1.0904	1.0442
0.3784	12.2791	528	1.0185	0.0180	1.0185	1.0092
0.3784	12.3256	530	0.9267	0.0421	0.9267	0.9626
0.3784	12.3721	532	0.8762	0.0421	0.8762	0.9361
0.3784	12.4186	534	0.8583	0.0497	0.8583	0.9265
0.3784	12.4651	536	0.8583	0.0497	0.8583	0.9264
0.3784	12.5116	538	0.8702	0.0734	0.8702	0.9328
0.3784	12.5581	540	0.9026	0.0636	0.9026	0.9501
0.3784	12.6047	542	0.8967	0.0953	0.8967	0.9469
0.3784	12.6512	544	0.8950	0.1065	0.8950	0.9460
0.3784	12.6977	546	0.9061	0.0627	0.9061	0.9519
0.3784	12.7442	548	0.8067	0.2220	0.8067	0.8982
0.3784	12.7907	550	0.7344	0.0650	0.7344	0.8570
0.3784	12.8372	552	0.7093	0.1097	0.7093	0.8422
0.3784	12.8837	554	0.7417	0.2277	0.7417	0.8612
0.3784	12.9302	556	0.8066	0.1291	0.8066	0.8981
0.3784	12.9767	558	0.8961	-0.0143	0.8961	0.9466
0.3784	13.0233	560	0.9313	-0.0182	0.9313	0.9651
0.3784	13.0698	562	0.8608	0.0260	0.8608	0.9278
0.3784	13.1163	564	0.8597	0.0676	0.8597	0.9272
0.3784	13.1628	566	0.8823	0.0734	0.8823	0.9393
0.3784	13.2093	568	0.9040	0.0734	0.9040	0.9508
0.3784	13.2558	570	0.9194	0.0333	0.9194	0.9589
0.3784	13.3023	572	0.9418	0.0566	0.9418	0.9705
0.3784	13.3488	574	0.9405	0.0060	0.9405	0.9698
0.3784	13.3953	576	0.9508	-0.0731	0.9508	0.9751
0.3784	13.4419	578	0.9940	0.0129	0.9940	0.9970
0.3784	13.4884	580	1.1040	0.0241	1.1040	1.0507
0.3784	13.5349	582	1.2229	0.0701	1.2229	1.1058
0.3784	13.5814	584	1.1701	0.0758	1.1701	1.0817
0.3784	13.6279	586	1.0767	0.0481	1.0767	1.0376
0.3784	13.6744	588	1.0463	0.0492	1.0463	1.0229
0.3784	13.7209	590	1.0043	0.0566	1.0043	1.0021
0.3784	13.7674	592	1.0246	0.0256	1.0246	1.0122
0.3784	13.8140	594	1.0515	0.0240	1.0515	1.0254
0.3784	13.8605	596	1.0066	-0.0025	1.0066	1.0033
0.3784	13.9070	598	0.9447	0.0070	0.9447	0.9720
0.3784	13.9535	600	0.8961	-0.0784	0.8961	0.9466
0.3784	14.0	602	0.8811	-0.0138	0.8811	0.9387
0.3784	14.0465	604	0.8524	0.0805	0.8524	0.9232
0.3784	14.0930	606	0.8531	0.0805	0.8531	0.9236
0.3784	14.1395	608	0.8693	0.0708	0.8693	0.9324
0.3784	14.1860	610	0.8735	0.0700	0.8735	0.9346
0.3784	14.2326	612	0.8757	0.0700	0.8757	0.9358
0.3784	14.2791	614	0.8667	0.0452	0.8667	0.9310
0.3784	14.3256	616	0.8822	-0.0260	0.8822	0.9392
0.3784	14.3721	618	0.9092	-0.0251	0.9092	0.9535
0.3784	14.4186	620	0.9475	0.0324	0.9475	0.9734
0.3784	14.4651	622	1.0786	0.0481	1.0786	1.0386
0.3784	14.5116	624	1.2449	0.0736	1.2449	1.1158
0.3784	14.5581	626	1.2033	0.0612	1.2033	1.0969
0.3784	14.6047	628	1.0115	0.0125	1.0115	1.0057
0.3784	14.6512	630	0.9353	-0.0054	0.9353	0.9671
0.3784	14.6977	632	0.9458	-0.0706	0.9458	0.9725
0.3784	14.7442	634	0.9624	-0.0260	0.9624	0.9810
0.3784	14.7907	636	0.9607	-0.0260	0.9607	0.9801

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1