ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9065
• Qwk: -0.0939
• Mse: 0.9065
• Rmse: 0.9521

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	4.0078	-0.0086	4.0078	2.0019
No log	0.1429	4	2.3040	0.0050	2.3040	1.5179
No log	0.2143	6	1.7188	0.0213	1.7188	1.3110
No log	0.2857	8	2.5964	-0.0173	2.5964	1.6113
No log	0.3571	10	1.6501	0.0	1.6501	1.2845
No log	0.4286	12	0.9892	0.0338	0.9892	0.9946
No log	0.5	14	0.8504	-0.0008	0.8504	0.9222
No log	0.5714	16	0.8559	-0.0852	0.8559	0.9252
No log	0.6429	18	0.9104	-0.0345	0.9104	0.9542
No log	0.7143	20	0.8016	-0.0331	0.8016	0.8953
No log	0.7857	22	0.7142	0.0964	0.7142	0.8451
No log	0.8571	24	0.7123	-0.0101	0.7123	0.8440
No log	0.9286	26	0.7582	-0.0215	0.7582	0.8708
No log	1.0	28	0.7863	-0.0778	0.7863	0.8867
No log	1.0714	30	0.7845	-0.0778	0.7845	0.8857
No log	1.1429	32	0.7984	-0.0331	0.7984	0.8935
No log	1.2143	34	0.9085	-0.0200	0.9085	0.9531
No log	1.2857	36	1.0486	-0.0398	1.0486	1.0240
No log	1.3571	38	1.1888	-0.0247	1.1888	1.0903
No log	1.4286	40	1.2154	-0.0247	1.2154	1.1024
No log	1.5	42	1.2591	0.0	1.2591	1.1221
No log	1.5714	44	1.5619	0.0	1.5619	1.2497
No log	1.6429	46	1.7773	0.0	1.7773	1.3331
No log	1.7143	48	1.6927	0.0	1.6927	1.3010
No log	1.7857	50	1.3587	0.0	1.3587	1.1656
No log	1.8571	52	1.0400	-0.0247	1.0400	1.0198
No log	1.9286	54	0.8784	-0.0200	0.8784	0.9372
No log	2.0	56	0.9407	-0.0385	0.9407	0.9699
No log	2.0714	58	1.1677	-0.0457	1.1677	1.0806
No log	2.1429	60	0.9736	0.0111	0.9736	0.9867
No log	2.2143	62	0.8485	0.0129	0.8485	0.9212
No log	2.2857	64	0.9610	0.0089	0.9610	0.9803
No log	2.3571	66	1.6775	0.0	1.6775	1.2952
No log	2.4286	68	2.0345	0.0	2.0345	1.4264
No log	2.5	70	1.6961	0.0	1.6961	1.3023
No log	2.5714	72	0.9915	-0.0648	0.9915	0.9957
No log	2.6429	74	0.7193	0.0	0.7193	0.8481
No log	2.7143	76	0.7240	0.0	0.7240	0.8509
No log	2.7857	78	0.8240	-0.0753	0.8240	0.9078
No log	2.8571	80	1.1512	0.0065	1.1512	1.0729
No log	2.9286	82	1.4776	0.0	1.4776	1.2156
No log	3.0	84	1.5124	0.0	1.5124	1.2298
No log	3.0714	86	1.2389	-0.0490	1.2389	1.1130
No log	3.1429	88	0.8617	0.0867	0.8617	0.9283
No log	3.2143	90	0.7712	-0.1067	0.7712	0.8782
No log	3.2857	92	0.7764	-0.0499	0.7764	0.8811
No log	3.3571	94	0.7584	-0.0035	0.7584	0.8709
No log	3.4286	96	0.7949	-0.0725	0.7949	0.8916
No log	3.5	98	1.0811	-0.0997	1.0811	1.0398
No log	3.5714	100	1.4950	0.0	1.4950	1.2227
No log	3.6429	102	1.5608	0.0	1.5608	1.2493
No log	3.7143	104	1.4641	0.0	1.4641	1.2100
No log	3.7857	106	1.2625	0.0032	1.2625	1.1236
No log	3.8571	108	1.0650	-0.0686	1.0650	1.0320
No log	3.9286	110	1.0235	0.0006	1.0235	1.0117
No log	4.0	112	1.0047	0.0026	1.0047	1.0023
No log	4.0714	114	1.1076	0.0006	1.1076	1.0524
No log	4.1429	116	1.0311	0.0067	1.0311	1.0154
No log	4.2143	118	0.8567	0.0476	0.8567	0.9256
No log	4.2857	120	0.8541	0.0071	0.8541	0.9242
No log	4.3571	122	0.8219	0.0159	0.8219	0.9066
No log	4.4286	124	0.8759	0.0099	0.8759	0.9359
No log	4.5	126	0.8327	-0.1599	0.8327	0.9125
No log	4.5714	128	0.8956	-0.0204	0.8956	0.9464
No log	4.6429	130	0.9031	-0.0144	0.9031	0.9503
No log	4.7143	132	1.0854	-0.0327	1.0854	1.0418
No log	4.7857	134	1.3102	-0.0746	1.3102	1.1446
No log	4.8571	136	1.0427	-0.0355	1.0427	1.0211
No log	4.9286	138	0.9299	-0.1737	0.9299	0.9643
No log	5.0	140	0.8625	-0.1628	0.8625	0.9287
No log	5.0714	142	0.8067	-0.1148	0.8067	0.8982
No log	5.1429	144	0.8360	-0.0679	0.8360	0.9143
No log	5.2143	146	0.8128	-0.0679	0.8128	0.9015
No log	5.2857	148	0.7983	-0.1220	0.7983	0.8935
No log	5.3571	150	0.8530	-0.1622	0.8530	0.9236
No log	5.4286	152	0.9466	-0.2335	0.9466	0.9729
No log	5.5	154	1.0113	-0.0853	1.0113	1.0056
No log	5.5714	156	0.9187	0.0955	0.9187	0.9585
No log	5.6429	158	0.8965	-0.0089	0.8965	0.9468
No log	5.7143	160	0.8105	-0.1893	0.8105	0.9003
No log	5.7857	162	0.8725	0.0191	0.8725	0.9341
No log	5.8571	164	1.1973	-0.0892	1.1973	1.0942
No log	5.9286	166	1.0704	-0.0877	1.0704	1.0346
No log	6.0	168	0.8192	-0.0711	0.8192	0.9051
No log	6.0714	170	0.8452	-0.0892	0.8452	0.9193
No log	6.1429	172	0.9274	-0.1301	0.9274	0.9630
No log	6.2143	174	0.9220	-0.1722	0.9220	0.9602
No log	6.2857	176	0.9018	-0.1795	0.9018	0.9496
No log	6.3571	178	0.8776	-0.1871	0.8776	0.9368
No log	6.4286	180	0.8677	-0.1106	0.8677	0.9315
No log	6.5	182	0.9072	0.0152	0.9072	0.9525
No log	6.5714	184	0.8640	-0.1395	0.8640	0.9295
No log	6.6429	186	0.8658	-0.1795	0.8658	0.9305
No log	6.7143	188	0.8598	-0.0999	0.8598	0.9272
No log	6.7857	190	0.8958	0.0095	0.8958	0.9465
No log	6.8571	192	0.9228	0.0476	0.9228	0.9606
No log	6.9286	194	0.8151	-0.1939	0.8151	0.9028
No log	7.0	196	0.8725	-0.1606	0.8725	0.9341
No log	7.0714	198	0.8588	-0.1753	0.8588	0.9267
No log	7.1429	200	0.7776	-0.0499	0.7776	0.8818
No log	7.2143	202	0.7261	-0.0035	0.7261	0.8521
No log	7.2857	204	0.7522	0.0296	0.7522	0.8673
No log	7.3571	206	0.7696	0.0334	0.7696	0.8773
No log	7.4286	208	0.7941	-0.0560	0.7941	0.8911
No log	7.5	210	0.9058	0.0297	0.9058	0.9517
No log	7.5714	212	0.9425	0.0734	0.9425	0.9708
No log	7.6429	214	0.8681	-0.0173	0.8681	0.9317
No log	7.7143	216	0.8121	-0.1333	0.8121	0.9012
No log	7.7857	218	0.8278	0.0680	0.8278	0.9098
No log	7.8571	220	0.8043	0.0714	0.8043	0.8968
No log	7.9286	222	0.7498	0.0964	0.7498	0.8659
No log	8.0	224	0.7339	-0.0035	0.7339	0.8567
No log	8.0714	226	0.7192	-0.0035	0.7192	0.8481
No log	8.1429	228	0.7245	0.0506	0.7245	0.8512
No log	8.2143	230	0.7477	-0.0595	0.7477	0.8647
No log	8.2857	232	0.7746	0.0481	0.7746	0.8801
No log	8.3571	234	0.8002	-0.0108	0.8002	0.8946
No log	8.4286	236	0.7968	-0.0108	0.7968	0.8926
No log	8.5	238	0.8144	-0.0541	0.8144	0.9025
No log	8.5714	240	0.8439	-0.0354	0.8439	0.9186
No log	8.6429	242	0.8522	-0.1273	0.8522	0.9231
No log	8.7143	244	0.8489	-0.0567	0.8489	0.9214
No log	8.7857	246	0.8415	-0.1040	0.8415	0.9173
No log	8.8571	248	0.8458	-0.1106	0.8458	0.9197
No log	8.9286	250	0.8791	-0.0660	0.8791	0.9376
No log	9.0	252	0.8953	-0.1106	0.8953	0.9462
No log	9.0714	254	0.9150	-0.0870	0.9150	0.9566
No log	9.1429	256	0.9315	-0.0821	0.9315	0.9651
No log	9.2143	258	0.9346	-0.0939	0.9346	0.9667
No log	9.2857	260	0.9359	-0.0643	0.9359	0.9674
No log	9.3571	262	0.9072	-0.1106	0.9072	0.9525
No log	9.4286	264	0.9146	-0.2030	0.9146	0.9564
No log	9.5	266	0.9356	-0.2550	0.9356	0.9673
No log	9.5714	268	0.8882	-0.2326	0.8882	0.9425
No log	9.6429	270	0.9101	-0.0228	0.9101	0.9540
No log	9.7143	272	0.9498	0.0953	0.9498	0.9746
No log	9.7857	274	0.9362	0.0588	0.9362	0.9676
No log	9.8571	276	0.9414	-0.1066	0.9414	0.9702
No log	9.9286	278	0.9206	-0.1334	0.9206	0.9595
No log	10.0	280	0.8991	-0.1851	0.8991	0.9482
No log	10.0714	282	0.9021	-0.1851	0.9021	0.9498
No log	10.1429	284	0.8954	-0.2416	0.8954	0.9462
No log	10.2143	286	0.9040	0.0628	0.9040	0.9508
No log	10.2857	288	0.8856	0.0628	0.8856	0.9411
No log	10.3571	290	0.8401	-0.1230	0.8401	0.9166
No log	10.4286	292	0.8473	-0.1033	0.8473	0.9205
No log	10.5	294	0.8653	-0.0921	0.8653	0.9302
No log	10.5714	296	0.8720	-0.1395	0.8720	0.9338
No log	10.6429	298	0.9071	-0.1409	0.9071	0.9524
No log	10.7143	300	0.9007	-0.1409	0.9007	0.9490
No log	10.7857	302	0.8965	0.0218	0.8965	0.9468
No log	10.8571	304	0.8458	0.0173	0.8458	0.9197
No log	10.9286	306	0.8280	-0.0488	0.8280	0.9100
No log	11.0	308	0.8465	-0.0921	0.8465	0.9201
No log	11.0714	310	0.8645	-0.0648	0.8645	0.9298
No log	11.1429	312	0.8466	-0.1722	0.8466	0.9201
No log	11.2143	314	0.8362	-0.0567	0.8362	0.9144
No log	11.2857	316	0.8188	-0.0059	0.8188	0.9049
No log	11.3571	318	0.7921	-0.1158	0.7921	0.8900
No log	11.4286	320	0.7992	-0.0949	0.7992	0.8940
No log	11.5	322	0.8025	-0.0949	0.8025	0.8959
No log	11.5714	324	0.7980	0.0031	0.7980	0.8933
No log	11.6429	326	0.8088	-0.0204	0.8088	0.8993
No log	11.7143	328	0.9440	0.0748	0.9440	0.9716
No log	11.7857	330	1.0642	-0.0163	1.0642	1.0316
No log	11.8571	332	1.0006	0.0748	1.0006	1.0003
No log	11.9286	334	0.9172	-0.0138	0.9172	0.9577
No log	12.0	336	0.9494	-0.1945	0.9494	0.9744
No log	12.0714	338	0.9906	-0.1111	0.9906	0.9953
No log	12.1429	340	0.9452	-0.2138	0.9452	0.9722
No log	12.2143	342	0.8794	-0.1916	0.8794	0.9378
No log	12.2857	344	0.9150	-0.0351	0.9150	0.9566
No log	12.3571	346	0.9193	0.0476	0.9193	0.9588
No log	12.4286	348	0.9086	0.0476	0.9086	0.9532
No log	12.5	350	0.8871	-0.0287	0.8871	0.9419
No log	12.5714	352	0.8837	-0.0354	0.8837	0.9400
No log	12.6429	354	0.8966	0.0617	0.8966	0.9469
No log	12.7143	356	0.8690	0.0606	0.8690	0.9322
No log	12.7857	358	0.8574	-0.0955	0.8574	0.9260
No log	12.8571	360	0.8944	0.0628	0.8944	0.9457
No log	12.9286	362	0.9553	0.0786	0.9553	0.9774
No log	13.0	364	0.8912	0.0549	0.8912	0.9440
No log	13.0714	366	0.8174	-0.0240	0.8174	0.9041
No log	13.1429	368	0.8302	0.0085	0.8302	0.9111
No log	13.2143	370	0.8938	-0.0138	0.8938	0.9454
No log	13.2857	372	0.8845	-0.0268	0.8845	0.9405
No log	13.3571	374	0.8778	-0.1278	0.8778	0.9369
No log	13.4286	376	0.9218	-0.0734	0.9218	0.9601
No log	13.5	378	0.9513	-0.0706	0.9513	0.9753
No log	13.5714	380	0.9456	-0.1227	0.9456	0.9724
No log	13.6429	382	0.9136	-0.0734	0.9136	0.9558
No log	13.7143	384	0.8860	-0.1584	0.8860	0.9413
No log	13.7857	386	0.8287	-0.1604	0.8287	0.9103
No log	13.8571	388	0.8223	-0.0240	0.8223	0.9068
No log	13.9286	390	0.8788	0.0588	0.8788	0.9374
No log	14.0	392	0.8831	0.0628	0.8831	0.9397
No log	14.0714	394	0.8764	-0.0690	0.8764	0.9362
No log	14.1429	396	0.8928	-0.1126	0.8928	0.9449
No log	14.2143	398	0.9355	-0.0699	0.9355	0.9672
No log	14.2857	400	0.9487	0.0826	0.9487	0.9740
No log	14.3571	402	0.8732	0.1047	0.8732	0.9344
No log	14.4286	404	0.8321	-0.1585	0.8321	0.9122
No log	14.5	406	0.8285	-0.1860	0.8285	0.9102
No log	14.5714	408	0.8140	-0.1604	0.8140	0.9022
No log	14.6429	410	0.8098	-0.0264	0.8098	0.8999
No log	14.7143	412	0.8968	0.0442	0.8968	0.9470
No log	14.7857	414	0.9016	-0.0008	0.9016	0.9495
No log	14.8571	416	0.8447	-0.0252	0.8447	0.9191
No log	14.9286	418	0.8419	-0.1939	0.8419	0.9176
No log	15.0	420	0.8776	-0.1643	0.8776	0.9368
No log	15.0714	422	0.8878	-0.2206	0.8878	0.9422
No log	15.1429	424	0.9218	-0.1131	0.9218	0.9601
No log	15.2143	426	0.9430	-0.1140	0.9430	0.9711
No log	15.2857	428	0.9250	0.0095	0.9250	0.9617
No log	15.3571	430	0.8944	-0.0274	0.8944	0.9457
No log	15.4286	432	0.8689	-0.0252	0.8689	0.9321
No log	15.5	434	0.9009	-0.1072	0.9009	0.9492
No log	15.5714	436	0.9437	-0.0686	0.9437	0.9714
No log	15.6429	438	0.9184	-0.2354	0.9184	0.9583
No log	15.7143	440	0.9218	-0.1993	0.9218	0.9601
No log	15.7857	442	0.8872	-0.1851	0.8872	0.9419
No log	15.8571	444	0.8510	-0.1939	0.8510	0.9225
No log	15.9286	446	0.8280	-0.0967	0.8280	0.9099
No log	16.0	448	0.7917	-0.0062	0.7917	0.8898
No log	16.0714	450	0.7839	-0.1599	0.7839	0.8854
No log	16.1429	452	0.8247	-0.0690	0.8247	0.9081
No log	16.2143	454	0.8815	0.0600	0.8815	0.9389
No log	16.2857	456	0.9336	0.0476	0.9336	0.9662
No log	16.3571	458	0.9673	-0.0101	0.9673	0.9835
No log	16.4286	460	1.0251	-0.0236	1.0251	1.0125
No log	16.5	462	0.9654	-0.0163	0.9654	0.9826
No log	16.5714	464	0.9218	-0.1337	0.9218	0.9601
No log	16.6429	466	0.9466	-0.1027	0.9466	0.9729
No log	16.7143	468	0.9577	-0.0983	0.9577	0.9786
No log	16.7857	470	0.9649	-0.0946	0.9649	0.9823
No log	16.8571	472	1.0196	0.0207	1.0196	1.0098
No log	16.9286	474	1.0147	0.0207	1.0147	1.0073
No log	17.0	476	0.9067	0.0476	0.9067	0.9522
No log	17.0714	478	0.8287	-0.0725	0.8287	0.9104
No log	17.1429	480	0.8238	-0.1594	0.8238	0.9076
No log	17.2143	482	0.8092	-0.1172	0.8092	0.8996
No log	17.2857	484	0.8238	0.0191	0.8238	0.9077
No log	17.3571	486	0.8305	0.1047	0.8305	0.9113
No log	17.4286	488	0.8473	0.0512	0.8473	0.9205
No log	17.5	490	0.8783	0.1196	0.8783	0.9372
No log	17.5714	492	0.8827	0.0442	0.8827	0.9395
No log	17.6429	494	0.8944	0.0409	0.8944	0.9457
No log	17.7143	496	0.8620	-0.0186	0.8620	0.9284
No log	17.7857	498	0.8633	-0.1060	0.8633	0.9291
0.3351	17.8571	500	0.8633	-0.0614	0.8633	0.9292
0.3351	17.9286	502	0.8778	0.1096	0.8778	0.9369
0.3351	18.0	504	0.9725	0.1107	0.9725	0.9862
0.3351	18.0714	506	0.9738	0.1107	0.9738	0.9868
0.3351	18.1429	508	0.9064	-0.0230	0.9064	0.9520
0.3351	18.2143	510	0.8827	-0.1638	0.8827	0.9395
0.3351	18.2857	512	0.8731	-0.0785	0.8731	0.9344
0.3351	18.3571	514	0.8349	-0.1395	0.8349	0.9137
0.3351	18.4286	516	0.8199	-0.0309	0.8199	0.9055
0.3351	18.5	518	0.8477	0.0512	0.8477	0.9207
0.3351	18.5714	520	0.8439	0.0099	0.8439	0.9186
0.3351	18.6429	522	0.8697	-0.2066	0.8697	0.9326
0.3351	18.7143	524	0.9301	-0.0808	0.9301	0.9644
0.3351	18.7857	526	0.9237	-0.0498	0.9237	0.9611
0.3351	18.8571	528	0.9271	-0.0123	0.9271	0.9629
0.3351	18.9286	530	0.9231	0.1466	0.9231	0.9608
0.3351	19.0	532	0.8780	-0.2207	0.8780	0.9370
0.3351	19.0714	534	0.8166	-0.0612	0.8166	0.9037
0.3351	19.1429	536	0.8171	0.0152	0.8171	0.9039
0.3351	19.2143	538	0.8411	0.0909	0.8411	0.9171
0.3351	19.2857	540	0.8385	0.0909	0.8385	0.9157
0.3351	19.3571	542	0.8286	0.0123	0.8286	0.9103
0.3351	19.4286	544	0.8382	-0.1905	0.8382	0.9155
0.3351	19.5	546	0.8791	-0.0563	0.8791	0.9376
0.3351	19.5714	548	0.8978	-0.0119	0.8978	0.9475
0.3351	19.6429	550	0.8861	0.0600	0.8861	0.9413
0.3351	19.7143	552	0.8449	-0.2222	0.8449	0.9192
0.3351	19.7857	554	0.8185	-0.1589	0.8185	0.9047
0.3351	19.8571	556	0.8236	-0.1121	0.8236	0.9075
0.3351	19.9286	558	0.8376	-0.1841	0.8376	0.9152
0.3351	20.0	560	0.8742	0.0185	0.8742	0.9350
0.3351	20.0714	562	0.8761	-0.0598	0.8761	0.9360
0.3351	20.1429	564	0.8671	-0.0563	0.8671	0.9312
0.3351	20.2143	566	0.8473	-0.0578	0.8473	0.9205
0.3351	20.2857	568	0.8296	0.0095	0.8296	0.9108
0.3351	20.3571	570	0.8160	0.0095	0.8160	0.9033
0.3351	20.4286	572	0.8166	0.0095	0.8166	0.9037
0.3351	20.5	574	0.8149	0.0175	0.8149	0.9027
0.3351	20.5714	576	0.8242	-0.0549	0.8242	0.9079
0.3351	20.6429	578	0.8405	-0.0373	0.8405	0.9168
0.3351	20.7143	580	0.8571	0.0172	0.8571	0.9258
0.3351	20.7857	582	0.8679	0.0603	0.8679	0.9316
0.3351	20.8571	584	0.8555	0.0654	0.8555	0.9249
0.3351	20.9286	586	0.8065	0.1395	0.8065	0.8981
0.3351	21.0	588	0.7635	-0.0612	0.7635	0.8738
0.3351	21.0714	590	0.7570	-0.0188	0.7570	0.8700
0.3351	21.1429	592	0.7557	-0.0725	0.7557	0.8693
0.3351	21.2143	594	0.7652	-0.0188	0.7652	0.8747
0.3351	21.2857	596	0.7707	-0.0188	0.7707	0.8779
0.3351	21.3571	598	0.7751	-0.0188	0.7751	0.8804
0.3351	21.4286	600	0.7769	-0.0188	0.7769	0.8814
0.3351	21.5	602	0.7838	-0.0188	0.7838	0.8853
0.3351	21.5714	604	0.7908	-0.0188	0.7908	0.8892
0.3351	21.6429	606	0.7960	0.0225	0.7960	0.8922
0.3351	21.7143	608	0.8039	0.0225	0.8039	0.8966
0.3351	21.7857	610	0.8067	-0.0240	0.8067	0.8982
0.3351	21.8571	612	0.8118	-0.2008	0.8118	0.9010
0.3351	21.9286	614	0.8239	-0.1851	0.8239	0.9077
0.3351	22.0	616	0.8192	-0.2465	0.8192	0.9051
0.3351	22.0714	618	0.8073	-0.0240	0.8073	0.8985
0.3351	22.1429	620	0.8289	-0.1589	0.8289	0.9105
0.3351	22.2143	622	0.8528	-0.1832	0.8528	0.9235
0.3351	22.2857	624	0.8723	-0.2114	0.8723	0.9340
0.3351	22.3571	626	0.8908	-0.1690	0.8908	0.9438
0.3351	22.4286	628	0.9065	-0.0939	0.9065	0.9521

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1