ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k9_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9216
• Qwk: -0.0345
• Mse: 0.9216
• Rmse: 0.9600

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0870	2	4.0820	0.0185	4.0820	2.0204
No log	0.1739	4	2.1870	0.0063	2.1870	1.4789
No log	0.2609	6	1.7386	0.0153	1.7386	1.3186
No log	0.3478	8	1.4680	-0.0217	1.4680	1.2116
No log	0.4348	10	1.0550	-0.0918	1.0550	1.0272
No log	0.5217	12	0.8871	0.0946	0.8871	0.9418
No log	0.6087	14	0.9995	-0.0207	0.9995	0.9997
No log	0.6957	16	1.0119	-0.0446	1.0119	1.0059
No log	0.7826	18	1.2517	0.0048	1.2517	1.1188
No log	0.8696	20	1.4249	-0.0247	1.4249	1.1937
No log	0.9565	22	0.9505	-0.0285	0.9505	0.9749
No log	1.0435	24	0.9445	-0.0595	0.9445	0.9719
No log	1.1304	26	1.0847	0.0610	1.0847	1.0415
No log	1.2174	28	1.2407	0.0	1.2407	1.1139
No log	1.3043	30	1.3873	0.0	1.3873	1.1778
No log	1.3913	32	1.4812	0.0	1.4812	1.2170
No log	1.4783	34	1.2708	0.0	1.2708	1.1273
No log	1.5652	36	1.2222	0.0	1.2222	1.1055
No log	1.6522	38	1.1095	0.0	1.1095	1.0533
No log	1.7391	40	1.1339	0.0	1.1339	1.0649
No log	1.8261	42	1.0943	0.0358	1.0943	1.0461
No log	1.9130	44	0.9348	0.0329	0.9348	0.9669
No log	2.0	46	1.0900	-0.0133	1.0900	1.0440
No log	2.0870	48	1.2011	-0.0164	1.2011	1.0959
No log	2.1739	50	1.1986	-0.0164	1.1986	1.0948
No log	2.2609	52	1.1088	0.0196	1.1088	1.0530
No log	2.3478	54	0.7783	0.0759	0.7783	0.8822
No log	2.4348	56	0.7094	-0.0069	0.7094	0.8422
No log	2.5217	58	0.8152	-0.1249	0.8152	0.9029
No log	2.6087	60	1.6176	0.0083	1.6176	1.2719
No log	2.6957	62	1.9932	-0.0482	1.9932	1.4118
No log	2.7826	64	1.5647	-0.0207	1.5647	1.2509
No log	2.8696	66	1.1291	-0.0117	1.1291	1.0626
No log	2.9565	68	0.8620	-0.0425	0.8620	0.9285
No log	3.0435	70	0.7736	0.0225	0.7736	0.8795
No log	3.1304	72	1.0120	-0.1665	1.0120	1.0060
No log	3.2174	74	1.8141	0.0196	1.8141	1.3469
No log	3.3043	76	1.3311	0.0631	1.3311	1.1537
No log	3.3913	78	0.9802	-0.1671	0.9802	0.9900
No log	3.4783	80	0.8949	-0.0699	0.8949	0.9460
No log	3.5652	82	1.2293	-0.0200	1.2293	1.1087
No log	3.6522	84	1.3034	-0.0282	1.3034	1.1417
No log	3.7391	86	1.0466	-0.1169	1.0466	1.0230
No log	3.8261	88	0.8199	-0.0967	0.8199	0.9055
No log	3.9130	90	0.8112	-0.0428	0.8112	0.9007
No log	4.0	92	0.8360	0.0282	0.8360	0.9143
No log	4.0870	94	1.1694	-0.0513	1.1694	1.0814
No log	4.1739	96	1.0338	-0.0442	1.0338	1.0168
No log	4.2609	98	0.8174	-0.0506	0.8174	0.9041
No log	4.3478	100	0.8248	-0.1106	0.8248	0.9082
No log	4.4348	102	0.8656	-0.1738	0.8656	0.9304
No log	4.5217	104	0.8391	-0.0725	0.8391	0.9160
No log	4.6087	106	1.2024	-0.0211	1.2024	1.0965
No log	4.6957	108	1.3177	-0.0245	1.3177	1.1479
No log	4.7826	110	1.6495	-0.0392	1.6495	1.2843
No log	4.8696	112	1.1357	-0.1267	1.1357	1.0657
No log	4.9565	114	0.7351	0.0416	0.7351	0.8574
No log	5.0435	116	0.7049	0.0	0.7049	0.8396
No log	5.1304	118	0.7172	-0.0035	0.7172	0.8469
No log	5.2174	120	0.9271	-0.2032	0.9271	0.9629
No log	5.3043	122	1.3093	-0.0133	1.3093	1.1443
No log	5.3913	124	1.1270	-0.0668	1.1270	1.0616
No log	5.4783	126	1.0969	-0.1276	1.0969	1.0473
No log	5.5652	128	1.5504	-0.0114	1.5504	1.2451
No log	5.6522	130	1.3673	-0.0648	1.3673	1.1693
No log	5.7391	132	0.9690	-0.2368	0.9690	0.9844
No log	5.8261	134	0.8503	-0.2008	0.8503	0.9221
No log	5.9130	136	0.9850	-0.1985	0.9850	0.9925
No log	6.0	138	1.5155	-0.1249	1.5155	1.2311
No log	6.0870	140	1.7462	-0.0891	1.7462	1.3214
No log	6.1739	142	1.0911	-0.1650	1.0911	1.0445
No log	6.2609	144	0.7650	-0.1220	0.7650	0.8747
No log	6.3478	146	0.7508	-0.1216	0.7508	0.8665
No log	6.4348	148	0.8593	-0.1241	0.8593	0.9270
No log	6.5217	150	1.7528	-0.0941	1.7528	1.3239
No log	6.6087	152	2.3407	-0.0633	2.3407	1.5299
No log	6.6957	154	1.9437	-0.1152	1.9437	1.3941
No log	6.7826	156	0.9686	-0.0828	0.9686	0.9842
No log	6.8696	158	0.7755	-0.0493	0.7755	0.8806
No log	6.9565	160	0.7877	-0.2201	0.7877	0.8875
No log	7.0435	162	1.1193	-0.0031	1.1193	1.0580
No log	7.1304	164	1.3454	-0.0193	1.3454	1.1599
No log	7.2174	166	1.1388	-0.0117	1.1388	1.0672
No log	7.3043	168	0.8137	-0.0287	0.8137	0.9021
No log	7.3913	170	0.7470	-0.0591	0.7470	0.8643
No log	7.4783	172	0.8062	-0.0718	0.8062	0.8979
No log	7.5652	174	1.2115	-0.0133	1.2115	1.1007
No log	7.6522	176	1.4541	-0.0207	1.4541	1.2059
No log	7.7391	178	1.2625	-0.0399	1.2625	1.1236
No log	7.8261	180	1.0081	-0.0157	1.0081	1.0040
No log	7.9130	182	1.0451	-0.0194	1.0451	1.0223
No log	8.0	184	1.1785	0.0196	1.1785	1.0856
No log	8.0870	186	0.9781	0.0175	0.9781	0.9890
No log	8.1739	188	0.9034	0.0576	0.9034	0.9505
No log	8.2609	190	0.8676	0.0304	0.8676	0.9315
No log	8.3478	192	0.9259	0.0515	0.9259	0.9622
No log	8.4348	194	1.0622	0.0067	1.0622	1.0306
No log	8.5217	196	0.9162	0.0277	0.9162	0.9572
No log	8.6087	198	0.8049	-0.0295	0.8049	0.8972
No log	8.6957	200	0.8309	-0.0823	0.8309	0.9116
No log	8.7826	202	1.0001	0.0431	1.0001	1.0000
No log	8.8696	204	1.2848	0.0401	1.2848	1.1335
No log	8.9565	206	1.2007	0.0423	1.2007	1.0958
No log	9.0435	208	0.8689	0.0984	0.8689	0.9322
No log	9.1304	210	0.7312	-0.0560	0.7312	0.8551
No log	9.2174	212	0.7365	-0.0451	0.7365	0.8582
No log	9.3043	214	0.7410	-0.0062	0.7410	0.8608
No log	9.3913	216	1.0054	0.0366	1.0054	1.0027
No log	9.4783	218	1.2030	0.0100	1.2030	1.0968
No log	9.5652	220	1.0357	0.0252	1.0357	1.0177
No log	9.6522	222	0.8515	-0.0408	0.8515	0.9228
No log	9.7391	224	0.7587	-0.1168	0.7587	0.8710
No log	9.8261	226	0.8015	0.0068	0.8015	0.8953
No log	9.9130	228	1.0375	0.0401	1.0375	1.0186
No log	10.0	230	1.1756	0.0048	1.1756	1.0843
No log	10.0870	232	1.0353	0.0518	1.0353	1.0175
No log	10.1739	234	0.7658	-0.0699	0.7658	0.8751
No log	10.2609	236	0.7467	-0.0967	0.7467	0.8641
No log	10.3478	238	0.7777	-0.0699	0.7777	0.8818
No log	10.4348	240	0.9529	0.0416	0.9529	0.9762
No log	10.5217	242	0.9759	0.0006	0.9759	0.9879
No log	10.6087	244	0.9133	0.0129	0.9133	0.9557
No log	10.6957	246	0.9186	-0.0194	0.9186	0.9584
No log	10.7826	248	0.8711	0.0224	0.8711	0.9333
No log	10.8696	250	0.8473	-0.0441	0.8473	0.9205
No log	10.9565	252	0.8361	-0.0030	0.8361	0.9144
No log	11.0435	254	0.8427	-0.0441	0.8427	0.9180
No log	11.1304	256	0.8230	-0.0723	0.8230	0.9072
No log	11.2174	258	0.8046	-0.1194	0.8046	0.8970
No log	11.3043	260	0.7882	-0.1168	0.7882	0.8878
No log	11.3913	262	0.8099	-0.1633	0.8099	0.9000
No log	11.4783	264	0.9076	0.0587	0.9076	0.9527
No log	11.5652	266	0.9393	0.0526	0.9393	0.9692
No log	11.6522	268	0.8873	-0.0456	0.8873	0.9420
No log	11.7391	270	0.7828	-0.1682	0.7828	0.8848
No log	11.8261	272	0.7645	-0.0627	0.7645	0.8744
No log	11.9130	274	0.8135	-0.1638	0.8135	0.9019
No log	12.0	276	0.9523	0.0741	0.9523	0.9758
No log	12.0870	278	0.9136	0.0873	0.9136	0.9558
No log	12.1739	280	0.7623	-0.0690	0.7623	0.8731
No log	12.2609	282	0.7125	0.0064	0.7125	0.8441
No log	12.3478	284	0.7132	0.0064	0.7132	0.8445
No log	12.4348	286	0.7203	-0.0571	0.7203	0.8487
No log	12.5217	288	0.7713	0.0768	0.7713	0.8782
No log	12.6087	290	0.7752	0.0768	0.7752	0.8805
No log	12.6957	292	0.7899	-0.0331	0.7899	0.8888
No log	12.7826	294	0.7254	0.0355	0.7254	0.8517
No log	12.8696	296	0.7328	0.0355	0.7328	0.8560
No log	12.9565	298	0.7934	-0.1184	0.7934	0.8908
No log	13.0435	300	0.8367	-0.0755	0.8367	0.9147
No log	13.1304	302	0.8043	-0.1176	0.8043	0.8968
No log	13.2174	304	0.7665	-0.1682	0.7665	0.8755
No log	13.3043	306	0.8063	-0.0690	0.8063	0.8979
No log	13.3913	308	0.8953	-0.0833	0.8953	0.9462
No log	13.4783	310	1.0534	-0.0345	1.0534	1.0264
No log	13.5652	312	0.9939	-0.0013	0.9939	0.9970
No log	13.6522	314	0.8277	-0.0790	0.8277	0.9098
No log	13.7391	316	0.7889	-0.1168	0.7889	0.8882
No log	13.8261	318	0.8352	-0.0295	0.8352	0.9139
No log	13.9130	320	0.9373	-0.0545	0.9373	0.9681
No log	14.0	322	0.9576	-0.0200	0.9576	0.9786
No log	14.0870	324	0.9096	-0.0182	0.9096	0.9537
No log	14.1739	326	0.8077	0.0282	0.8077	0.8987
No log	14.2609	328	0.8141	0.0670	0.8141	0.9023
No log	14.3478	330	0.8409	0.0377	0.8409	0.9170
No log	14.4348	332	0.8167	-0.0812	0.8167	0.9037
No log	14.5217	334	0.7723	-0.1176	0.7723	0.8788
No log	14.6087	336	0.7703	-0.1610	0.7703	0.8777
No log	14.6957	338	0.7910	-0.0704	0.7910	0.8894
No log	14.7826	340	0.7825	-0.1187	0.7825	0.8846
No log	14.8696	342	0.8470	-0.0490	0.8470	0.9203
No log	14.9565	344	0.8945	0.0431	0.8945	0.9458
No log	15.0435	346	0.8226	-0.0474	0.8226	0.9070
No log	15.1304	348	0.7865	0.0476	0.7865	0.8869
No log	15.2174	350	0.7916	0.0068	0.7916	0.8897
No log	15.3043	352	0.7897	0.0123	0.7897	0.8887
No log	15.3913	354	0.8197	-0.0828	0.8197	0.9054
No log	15.4783	356	0.8824	-0.0143	0.8824	0.9393
No log	15.5652	358	0.8251	-0.0490	0.8251	0.9084
No log	15.6522	360	0.7692	0.0071	0.7692	0.8770
No log	15.7391	362	0.7904	0.0129	0.7904	0.8891
No log	15.8261	364	0.7966	-0.0790	0.7966	0.8925
No log	15.9130	366	0.8854	0.0182	0.8854	0.9410
No log	16.0	368	1.0204	-0.0385	1.0204	1.0102
No log	16.0870	370	1.0273	-0.0133	1.0273	1.0136
No log	16.1739	372	0.9590	0.0353	0.9590	0.9793
No log	16.2609	374	0.7915	-0.0778	0.7915	0.8897
No log	16.3478	376	0.7366	0.0338	0.7366	0.8582
No log	16.4348	378	0.7506	0.0600	0.7506	0.8664
No log	16.5217	380	0.8421	-0.0076	0.8421	0.9177
No log	16.6087	382	0.9870	0.1007	0.9870	0.9935
No log	16.6957	384	1.0253	0.1007	1.0253	1.0126
No log	16.7826	386	1.0313	0.0319	1.0313	1.0155
No log	16.8696	388	0.9357	0.0810	0.9357	0.9673
No log	16.9565	390	0.8404	-0.0787	0.8404	0.9168
No log	17.0435	392	0.8067	-0.1126	0.8067	0.8982
No log	17.1304	394	0.8347	-0.0799	0.8347	0.9136
No log	17.2174	396	0.9220	-0.1232	0.9220	0.9602
No log	17.3043	398	0.9205	0.0470	0.9205	0.9594
No log	17.3913	400	0.8383	0.0250	0.8383	0.9156
No log	17.4783	402	0.8325	0.1354	0.8325	0.9124
No log	17.5652	404	0.9077	0.0805	0.9077	0.9527
No log	17.6522	406	0.9504	0.1042	0.9504	0.9749
No log	17.7391	408	0.7965	0.1542	0.7965	0.8924
No log	17.8261	410	0.6947	-0.0488	0.6947	0.8335
No log	17.9130	412	0.6846	0.0061	0.6846	0.8274
No log	18.0	414	0.6779	-0.0030	0.6779	0.8234
No log	18.0870	416	0.7851	0.0769	0.7851	0.8860
No log	18.1739	418	0.9664	0.0342	0.9664	0.9831
No log	18.2609	420	1.0461	-0.0129	1.0461	1.0228
No log	18.3478	422	0.9899	-0.0675	0.9899	0.9949
No log	18.4348	424	0.8482	0.0016	0.8482	0.9210
No log	18.5217	426	0.7629	0.0394	0.7629	0.8735
No log	18.6087	428	0.7578	-0.0532	0.7578	0.8705
No log	18.6957	430	0.7997	-0.0612	0.7997	0.8942
No log	18.7826	432	0.9082	0.0175	0.9082	0.9530
No log	18.8696	434	0.9304	-0.0885	0.9304	0.9646
No log	18.9565	436	0.8225	-0.1214	0.8225	0.9069
No log	19.0435	438	0.7289	-0.0160	0.7289	0.8538
No log	19.1304	440	0.7176	-0.0679	0.7176	0.8471
No log	19.2174	442	0.7620	-0.0778	0.7620	0.8729
No log	19.3043	444	0.9343	0.0545	0.9343	0.9666
No log	19.3913	446	1.0598	0.0260	1.0598	1.0295
No log	19.4783	448	1.0793	-0.0372	1.0793	1.0389
No log	19.5652	450	0.9432	0.0134	0.9432	0.9712
No log	19.6522	452	0.8051	0.0016	0.8051	0.8973
No log	19.7391	454	0.7763	-0.0295	0.7763	0.8811
No log	19.8261	456	0.8022	0.0095	0.8022	0.8957
No log	19.9130	458	0.8637	-0.0504	0.8637	0.9294
No log	20.0	460	0.9628	0.0067	0.9628	0.9812
No log	20.0870	462	1.0989	-0.0435	1.0989	1.0483
No log	20.1739	464	1.2310	-0.0193	1.2310	1.1095
No log	20.2609	466	1.2450	0.0065	1.2450	1.1158
No log	20.3478	468	1.0364	0.0710	1.0364	1.0180
No log	20.4348	470	0.7964	-0.0812	0.7964	0.8924
No log	20.5217	472	0.7590	0.0680	0.7590	0.8712
No log	20.6087	474	0.8595	0.0277	0.8595	0.9271
No log	20.6957	476	0.9457	-0.1232	0.9457	0.9725
No log	20.7826	478	0.9973	-0.0972	0.9973	0.9986
No log	20.8696	480	1.0215	0.0176	1.0215	1.0107
No log	20.9565	482	1.0832	-0.0149	1.0832	1.0408
No log	21.0435	484	1.1452	-0.0207	1.1452	1.0702
No log	21.1304	486	1.0850	0.0156	1.0850	1.0416
No log	21.2174	488	0.8795	0.0909	0.8795	0.9378
No log	21.3043	490	0.7848	-0.0008	0.7848	0.8859
No log	21.3913	492	0.8263	0.0609	0.8263	0.9090
No log	21.4783	494	0.9835	0.0006	0.9835	0.9917
No log	21.5652	496	1.1281	0.0338	1.1281	1.0621
No log	21.6522	498	1.1036	-0.0178	1.1036	1.0505
0.2728	21.7391	500	0.9809	-0.0031	0.9809	0.9904
0.2728	21.8261	502	0.8171	-0.0391	0.8171	0.9040
0.2728	21.9130	504	0.7434	0.0611	0.7434	0.8622
0.2728	22.0	506	0.7366	0.1144	0.7366	0.8582
0.2728	22.0870	508	0.7753	-0.0778	0.7753	0.8805
0.2728	22.1739	510	0.7365	0.0123	0.7365	0.8582
0.2728	22.2609	512	0.7084	0.0214	0.7084	0.8416
0.2728	22.3478	514	0.7422	0.0490	0.7422	0.8615
0.2728	22.4348	516	0.7720	0.0826	0.7720	0.8786
0.2728	22.5217	518	0.8303	0.1406	0.8303	0.9112
0.2728	22.6087	520	0.9019	0.0772	0.9019	0.9497
0.2728	22.6957	522	0.9580	0.0329	0.9580	0.9788
0.2728	22.7826	524	0.9261	0.0710	0.9261	0.9624
0.2728	22.8696	526	0.8424	0.1406	0.8424	0.9178
0.2728	22.9565	528	0.7820	0.0831	0.7820	0.8843
0.2728	23.0435	530	0.7744	0.0041	0.7744	0.8800
0.2728	23.1304	532	0.8074	0.1064	0.8074	0.8986
0.2728	23.2174	534	0.9209	0.0741	0.9209	0.9596
0.2728	23.3043	536	1.0338	-0.0411	1.0338	1.0167
0.2728	23.3913	538	1.0188	-0.0411	1.0188	1.0093
0.2728	23.4783	540	0.9168	0.0046	0.9168	0.9575
0.2728	23.5652	542	0.8033	-0.0303	0.8033	0.8963
0.2728	23.6522	544	0.7632	0.0879	0.7632	0.8736
0.2728	23.7391	546	0.7758	-0.0583	0.7758	0.8808
0.2728	23.8261	548	0.8114	-0.0672	0.8114	0.9008
0.2728	23.9130	550	0.8571	-0.0441	0.8571	0.9258
0.2728	24.0	552	0.8381	-0.0031	0.8381	0.9155
0.2728	24.0870	554	0.8349	0.0333	0.8349	0.9137
0.2728	24.1739	556	0.8340	0.0304	0.8340	0.9132
0.2728	24.2609	558	0.8142	-0.0031	0.8142	0.9023
0.2728	24.3478	560	0.8390	-0.0054	0.8390	0.9160
0.2728	24.4348	562	0.8625	0.0277	0.8625	0.9287
0.2728	24.5217	564	0.8567	0.0277	0.8567	0.9256
0.2728	24.6087	566	0.8177	-0.0008	0.8177	0.9043
0.2728	24.6957	568	0.8054	0.0377	0.8054	0.8974
0.2728	24.7826	570	0.8267	-0.0138	0.8267	0.9092
0.2728	24.8696	572	0.8601	0.0207	0.8601	0.9274
0.2728	24.9565	574	0.8351	0.0207	0.8351	0.9138
0.2728	25.0435	576	0.7503	0.1449	0.7503	0.8662
0.2728	25.1304	578	0.7305	-0.0033	0.7305	0.8547
0.2728	25.2174	580	0.7547	-0.0118	0.7547	0.8687
0.2728	25.3043	582	0.8396	0.0392	0.8396	0.9163
0.2728	25.3913	584	0.9982	-0.0925	0.9982	0.9991
0.2728	25.4783	586	1.0788	-0.0114	1.0788	1.0386
0.2728	25.5652	588	1.0276	-0.0387	1.0276	1.0137
0.2728	25.6522	590	0.9505	-0.0948	0.9505	0.9749
0.2728	25.7391	592	0.9216	-0.0345	0.9216	0.9600

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1