ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0111
• Qwk: 0.56
• Mse: 1.0111
• Rmse: 1.0056

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	6.9249	0.0116	6.9249	2.6315
No log	0.0909	4	4.2976	0.0833	4.2976	2.0731
No log	0.1364	6	3.4261	-0.0215	3.4261	1.8510
No log	0.1818	8	2.6630	0.0966	2.6630	1.6319
No log	0.2273	10	1.9026	0.0855	1.9026	1.3794
No log	0.2727	12	1.7500	0.1947	1.7500	1.3229
No log	0.3182	14	1.9872	0.1475	1.9872	1.4097
No log	0.3636	16	1.7258	0.2393	1.7258	1.3137
No log	0.4091	18	1.6313	0.2393	1.6313	1.2772
No log	0.4545	20	1.4634	0.2655	1.4634	1.2097
No log	0.5	22	1.4582	0.2609	1.4582	1.2076
No log	0.5455	24	1.4956	0.1802	1.4956	1.2230
No log	0.5909	26	1.6177	0.1852	1.6177	1.2719
No log	0.6364	28	1.5866	0.2321	1.5866	1.2596
No log	0.6818	30	2.0635	-0.0917	2.0635	1.4365
No log	0.7273	32	2.7977	-0.2314	2.7977	1.6726
No log	0.7727	34	2.8998	-0.2677	2.8998	1.7029
No log	0.8182	36	1.7269	0.2645	1.7269	1.3141
No log	0.8636	38	1.0691	0.5426	1.0691	1.0340
No log	0.9091	40	0.9939	0.5846	0.9939	0.9970
No log	0.9545	42	1.2128	0.4590	1.2128	1.1013
No log	1.0	44	1.9106	0.1897	1.9106	1.3823
No log	1.0455	46	1.4357	0.3967	1.4357	1.1982
No log	1.0909	48	0.8064	0.7353	0.8064	0.8980
No log	1.1364	50	1.3968	0.5180	1.3968	1.1819
No log	1.1818	52	1.7481	0.3571	1.7481	1.3222
No log	1.2273	54	1.4796	0.5	1.4796	1.2164
No log	1.2727	56	1.0269	0.5806	1.0269	1.0134
No log	1.3182	58	1.1850	0.4724	1.1850	1.0886
No log	1.3636	60	1.5894	0.375	1.5894	1.2607
No log	1.4091	62	1.5599	0.352	1.5599	1.2490
No log	1.4545	64	1.1155	0.5827	1.1155	1.0562
No log	1.5	66	1.0287	0.5082	1.0287	1.0142
No log	1.5455	68	1.1506	0.4516	1.1506	1.0726
No log	1.5909	70	1.1047	0.4628	1.1047	1.0511
No log	1.6364	72	1.0816	0.5455	1.0816	1.0400
No log	1.6818	74	1.1031	0.5620	1.1031	1.0503
No log	1.7273	76	1.3858	0.3590	1.3858	1.1772
No log	1.7727	78	1.5641	0.3590	1.5641	1.2506
No log	1.8182	80	1.3881	0.3793	1.3881	1.1782
No log	1.8636	82	1.0634	0.5455	1.0634	1.0312
No log	1.9091	84	0.9081	0.6212	0.9081	0.9530
No log	1.9545	86	0.9596	0.5426	0.9596	0.9796
No log	2.0	88	1.3592	0.4754	1.3592	1.1659
No log	2.0455	90	1.6733	0.3000	1.6733	1.2935
No log	2.0909	92	1.1519	0.5156	1.1519	1.0733
No log	2.1364	94	0.8826	0.6565	0.8826	0.9395
No log	2.1818	96	0.7777	0.6617	0.7777	0.8819
No log	2.2273	98	0.8192	0.6970	0.8192	0.9051
No log	2.2727	100	0.7940	0.7313	0.7940	0.8911
No log	2.3182	102	0.8673	0.6412	0.8673	0.9313
No log	2.3636	104	1.0584	0.5758	1.0584	1.0288
No log	2.4091	106	0.9568	0.6119	0.9568	0.9782
No log	2.4545	108	0.8599	0.6617	0.8599	0.9273
No log	2.5	110	0.7638	0.6970	0.7638	0.8739
No log	2.5455	112	0.8140	0.6462	0.8140	0.9022
No log	2.5909	114	0.9148	0.6462	0.9148	0.9564
No log	2.6364	116	0.8725	0.6462	0.8725	0.9341
No log	2.6818	118	0.8146	0.6718	0.8146	0.9025
No log	2.7273	120	0.8049	0.6715	0.8049	0.8971
No log	2.7727	122	0.7808	0.6809	0.7808	0.8836
No log	2.8182	124	1.0025	0.6043	1.0025	1.0012
No log	2.8636	126	1.2683	0.5507	1.2683	1.1262
No log	2.9091	128	1.1008	0.5797	1.1008	1.0492
No log	2.9545	130	0.7710	0.6767	0.7710	0.8781
No log	3.0	132	0.8146	0.6466	0.8146	0.9026
No log	3.0455	134	0.9165	0.5899	0.9165	0.9573
No log	3.0909	136	0.8583	0.6142	0.8583	0.9265
No log	3.1364	138	0.9003	0.6667	0.9003	0.9489
No log	3.1818	140	1.2188	0.4839	1.2188	1.1040
No log	3.2273	142	1.2745	0.48	1.2745	1.1289
No log	3.2727	144	1.0753	0.6066	1.0753	1.0370
No log	3.3182	146	0.9472	0.5528	0.9472	0.9732
No log	3.3636	148	0.8299	0.6562	0.8299	0.9110
No log	3.4091	150	0.7078	0.7368	0.7078	0.8413
No log	3.4545	152	0.7139	0.6857	0.7139	0.8449
No log	3.5	154	1.3549	0.5	1.3549	1.1640
No log	3.5455	156	1.9695	0.3497	1.9695	1.4034
No log	3.5909	158	1.9931	0.3188	1.9931	1.4118
No log	3.6364	160	1.5532	0.4265	1.5532	1.2463
No log	3.6818	162	0.9775	0.6286	0.9775	0.9887
No log	3.7273	164	0.7464	0.7681	0.7464	0.8639
No log	3.7727	166	0.7850	0.6963	0.7850	0.8860
No log	3.8182	168	0.8638	0.6917	0.8638	0.9294
No log	3.8636	170	1.1205	0.4833	1.1205	1.0585
No log	3.9091	172	1.2304	0.4500	1.2304	1.1092
No log	3.9545	174	1.0887	0.5738	1.0887	1.0434
No log	4.0	176	0.9427	0.6016	0.9427	0.9709
No log	4.0455	178	0.9412	0.6129	0.9412	0.9701
No log	4.0909	180	0.9403	0.608	0.9403	0.9697
No log	4.1364	182	0.9253	0.6047	0.9253	0.9619
No log	4.1818	184	0.9229	0.5891	0.9229	0.9607
No log	4.2273	186	0.8581	0.6154	0.8581	0.9263
No log	4.2727	188	0.7589	0.7068	0.7589	0.8712
No log	4.3182	190	0.7781	0.6923	0.7781	0.8821
No log	4.3636	192	0.9304	0.6142	0.9304	0.9646
No log	4.4091	194	1.0040	0.5938	1.0040	1.0020
No log	4.4545	196	0.9835	0.5968	0.9835	0.9917
No log	4.5	198	0.9926	0.5968	0.9926	0.9963
No log	4.5455	200	0.9880	0.5902	0.9880	0.9940
No log	4.5909	202	0.9413	0.5785	0.9413	0.9702
No log	4.6364	204	0.9009	0.6066	0.9009	0.9492
No log	4.6818	206	0.8115	0.6667	0.8115	0.9008
No log	4.7273	208	0.7512	0.6970	0.7512	0.8667
No log	4.7727	210	0.7900	0.6142	0.7900	0.8888
No log	4.8182	212	0.8516	0.6	0.8516	0.9228
No log	4.8636	214	0.7861	0.625	0.7861	0.8866
No log	4.9091	216	0.7682	0.6822	0.7682	0.8765
No log	4.9545	218	0.7816	0.6870	0.7816	0.8841
No log	5.0	220	0.8143	0.6667	0.8143	0.9024
No log	5.0455	222	0.8228	0.6769	0.8228	0.9071
No log	5.0909	224	0.8543	0.656	0.8543	0.9243
No log	5.1364	226	0.8769	0.6190	0.8769	0.9364
No log	5.1818	228	0.8720	0.6190	0.8720	0.9338
No log	5.2273	230	0.8757	0.6142	0.8757	0.9358
No log	5.2727	232	0.8558	0.5938	0.8558	0.9251
No log	5.3182	234	0.8427	0.6154	0.8427	0.9180
No log	5.3636	236	0.8267	0.6870	0.8267	0.9092
No log	5.4091	238	0.8624	0.6412	0.8624	0.9286
No log	5.4545	240	0.8935	0.6412	0.8935	0.9452
No log	5.5	242	0.8760	0.6412	0.8760	0.9360
No log	5.5455	244	0.9457	0.5846	0.9457	0.9725
No log	5.5909	246	1.1334	0.5185	1.1334	1.0646
No log	5.6364	248	1.2623	0.4627	1.2623	1.1235
No log	5.6818	250	1.0528	0.5271	1.0528	1.0261
No log	5.7273	252	0.9519	0.6718	0.9519	0.9757
No log	5.7727	254	1.0386	0.5984	1.0386	1.0191
No log	5.8182	256	0.9566	0.6357	0.9566	0.9781
No log	5.8636	258	0.9278	0.6260	0.9278	0.9632
No log	5.9091	260	1.0971	0.5564	1.0971	1.0474
No log	5.9545	262	1.0422	0.6131	1.0422	1.0209
No log	6.0	264	0.9459	0.6377	0.9459	0.9726
No log	6.0455	266	0.9048	0.6423	0.9048	0.9512
No log	6.0909	268	1.0157	0.5970	1.0157	1.0078
No log	6.1364	270	1.1291	0.5606	1.1291	1.0626
No log	6.1818	272	1.1770	0.5231	1.1770	1.0849
No log	6.2273	274	0.9995	0.5469	0.9995	0.9998
No log	6.2727	276	0.8452	0.6822	0.8452	0.9194
No log	6.3182	278	0.8177	0.6970	0.8177	0.9043
No log	6.3636	280	0.7994	0.6818	0.7994	0.8941
No log	6.4091	282	0.8099	0.6718	0.8099	0.9000
No log	6.4545	284	1.0842	0.5581	1.0842	1.0413
No log	6.5	286	1.3071	0.4662	1.3071	1.1433
No log	6.5455	288	1.3055	0.4662	1.3055	1.1426
No log	6.5909	290	1.0262	0.6015	1.0262	1.0130
No log	6.6364	292	0.8843	0.6512	0.8843	0.9404
No log	6.6818	294	0.8947	0.7077	0.8947	0.9459
No log	6.7273	296	0.9666	0.624	0.9666	0.9832
No log	6.7727	298	1.0423	0.6016	1.0423	1.0210
No log	6.8182	300	1.0847	0.5366	1.0847	1.0415
No log	6.8636	302	1.0980	0.5366	1.0980	1.0479
No log	6.9091	304	1.1653	0.4724	1.1653	1.0795
No log	6.9545	306	1.1218	0.5	1.1218	1.0591
No log	7.0	308	0.9302	0.6260	0.9302	0.9645
No log	7.0455	310	0.7863	0.6818	0.7863	0.8868
No log	7.0909	312	0.7945	0.7023	0.7945	0.8914
No log	7.1364	314	0.8611	0.6457	0.8611	0.9280
No log	7.1818	316	1.0387	0.5760	1.0387	1.0191
No log	7.2273	318	1.2078	0.4567	1.2078	1.0990
No log	7.2727	320	1.2036	0.4603	1.2036	1.0971
No log	7.3182	322	1.0650	0.5082	1.0650	1.0320
No log	7.3636	324	0.9529	0.608	0.9529	0.9761
No log	7.4091	326	0.8961	0.656	0.8961	0.9466
No log	7.4545	328	0.8826	0.6290	0.8826	0.9395
No log	7.5	330	0.9297	0.6299	0.9297	0.9642
No log	7.5455	332	0.9903	0.5625	0.9903	0.9951
No log	7.5909	334	0.9606	0.6	0.9606	0.9801
No log	7.6364	336	0.9773	0.5736	0.9773	0.9886
No log	7.6818	338	0.9609	0.6202	0.9609	0.9803
No log	7.7273	340	1.0033	0.5827	1.0033	1.0017
No log	7.7727	342	0.9724	0.6406	0.9724	0.9861
No log	7.8182	344	0.9459	0.6299	0.9459	0.9726
No log	7.8636	346	0.9332	0.6562	0.9332	0.9660
No log	7.9091	348	0.9220	0.6299	0.9220	0.9602
No log	7.9545	350	0.8702	0.6667	0.8702	0.9329
No log	8.0	352	0.9044	0.6299	0.9044	0.9510
No log	8.0455	354	0.9948	0.5920	0.9948	0.9974
No log	8.0909	356	1.0169	0.5920	1.0169	1.0084
No log	8.1364	358	1.0032	0.55	1.0032	1.0016
No log	8.1818	360	1.0272	0.4915	1.0272	1.0135
No log	8.2273	362	0.9959	0.4915	0.9959	0.9980
No log	8.2727	364	0.8894	0.6016	0.8894	0.9431
No log	8.3182	366	0.9025	0.5806	0.9025	0.9500
No log	8.3636	368	0.9361	0.5714	0.9361	0.9675
No log	8.4091	370	0.9966	0.544	0.9966	0.9983
No log	8.4545	372	1.0042	0.5645	1.0042	1.0021
No log	8.5	374	0.9591	0.5902	0.9591	0.9793
No log	8.5455	376	0.9273	0.6290	0.9273	0.9630
No log	8.5909	378	0.8756	0.6290	0.8756	0.9357
No log	8.6364	380	0.8436	0.6290	0.8436	0.9185
No log	8.6818	382	0.8659	0.6349	0.8659	0.9305
No log	8.7273	384	0.9077	0.5984	0.9077	0.9527
No log	8.7727	386	0.9509	0.5891	0.9509	0.9751
No log	8.8182	388	0.8819	0.6094	0.8819	0.9391
No log	8.8636	390	0.8302	0.64	0.8302	0.9111
No log	8.9091	392	0.8502	0.6129	0.8502	0.9220
No log	8.9545	394	0.9155	0.6016	0.9155	0.9568
No log	9.0	396	0.9953	0.4828	0.9953	0.9976
No log	9.0455	398	1.0131	0.4957	1.0131	1.0065
No log	9.0909	400	0.9831	0.4957	0.9831	0.9915
No log	9.1364	402	0.9173	0.5902	0.9173	0.9577
No log	9.1818	404	0.8906	0.5902	0.8906	0.9437
No log	9.2273	406	0.9033	0.5854	0.9033	0.9504
No log	9.2727	408	0.9261	0.5738	0.9261	0.9623
No log	9.3182	410	0.9158	0.5500	0.9158	0.9569
No log	9.3636	412	0.9472	0.5378	0.9472	0.9732
No log	9.4091	414	0.9922	0.5738	0.9922	0.9961
No log	9.4545	416	1.0477	0.56	1.0477	1.0236
No log	9.5	418	1.0551	0.5625	1.0551	1.0272
No log	9.5455	420	0.9757	0.5968	0.9757	0.9878
No log	9.5909	422	0.9511	0.6016	0.9511	0.9752
No log	9.6364	424	0.9757	0.6016	0.9757	0.9878
No log	9.6818	426	1.0491	0.5625	1.0491	1.0243
No log	9.7273	428	1.1507	0.48	1.1507	1.0727
No log	9.7727	430	1.1352	0.48	1.1352	1.0655
No log	9.8182	432	1.0599	0.5410	1.0599	1.0295
No log	9.8636	434	1.0042	0.55	1.0042	1.0021
No log	9.9091	436	0.9288	0.5620	0.9288	0.9637
No log	9.9545	438	0.8690	0.6016	0.8690	0.9322
No log	10.0	440	0.8750	0.6190	0.8750	0.9354
No log	10.0455	442	0.9710	0.5781	0.9710	0.9854
No log	10.0909	444	1.0397	0.5079	1.0397	1.0197
No log	10.1364	446	1.0266	0.5625	1.0266	1.0132
No log	10.1818	448	1.0155	0.5512	1.0155	1.0077
No log	10.2273	450	0.9693	0.6299	0.9693	0.9845
No log	10.2727	452	0.8865	0.6769	0.8865	0.9415
No log	10.3182	454	0.8823	0.6769	0.8823	0.9393
No log	10.3636	456	0.9182	0.6364	0.9182	0.9582
No log	10.4091	458	1.0227	0.5846	1.0227	1.0113
No log	10.4545	460	1.0560	0.5846	1.0560	1.0276
No log	10.5	462	1.1172	0.5581	1.1172	1.0570
No log	10.5455	464	1.1545	0.5581	1.1545	1.0745
No log	10.5909	466	1.1289	0.5827	1.1289	1.0625
No log	10.6364	468	1.1313	0.5714	1.1313	1.0636
No log	10.6818	470	1.0770	0.5806	1.0770	1.0378
No log	10.7273	472	1.0334	0.5806	1.0334	1.0165
No log	10.7727	474	0.9660	0.608	0.9660	0.9828
No log	10.8182	476	0.9631	0.5920	0.9631	0.9814
No log	10.8636	478	0.9732	0.5714	0.9732	0.9865
No log	10.9091	480	0.9975	0.5512	0.9975	0.9988
No log	10.9545	482	0.9709	0.5714	0.9709	0.9853
No log	11.0	484	0.9816	0.5714	0.9816	0.9908
No log	11.0455	486	1.0007	0.5161	1.0007	1.0003
No log	11.0909	488	0.9933	0.5714	0.9933	0.9966
No log	11.1364	490	0.9594	0.5806	0.9594	0.9795
No log	11.1818	492	0.8926	0.624	0.8926	0.9448
No log	11.2273	494	0.8515	0.64	0.8515	0.9228
No log	11.2727	496	0.8484	0.64	0.8484	0.9211
No log	11.3182	498	0.8798	0.6190	0.8798	0.9380
0.3842	11.3636	500	0.9646	0.5920	0.9646	0.9822
0.3842	11.4091	502	1.0437	0.5625	1.0437	1.0216
0.3842	11.4545	504	1.0128	0.5827	1.0128	1.0064
0.3842	11.5	506	0.8991	0.5714	0.8991	0.9482
0.3842	11.5455	508	0.8325	0.5968	0.8325	0.9124
0.3842	11.5909	510	0.8222	0.6457	0.8222	0.9068
0.3842	11.6364	512	0.8608	0.608	0.8608	0.9278
0.3842	11.6818	514	0.8554	0.5738	0.8554	0.9249
0.3842	11.7273	516	0.8458	0.6190	0.8458	0.9196
0.3842	11.7727	518	0.8995	0.5984	0.8995	0.9484
0.3842	11.8182	520	0.9361	0.5669	0.9361	0.9675
0.3842	11.8636	522	0.9256	0.5781	0.9256	0.9621
0.3842	11.9091	524	0.8540	0.6299	0.8540	0.9241
0.3842	11.9545	526	0.8542	0.6299	0.8542	0.9242
0.3842	12.0	528	0.9222	0.5984	0.9222	0.9603
0.3842	12.0455	530	0.9217	0.5984	0.9217	0.9601
0.3842	12.0909	532	0.9389	0.5984	0.9389	0.9689
0.3842	12.1364	534	0.9732	0.5873	0.9732	0.9865
0.3842	12.1818	536	0.9446	0.6032	0.9446	0.9719
0.3842	12.2273	538	0.8967	0.5920	0.8967	0.9470
0.3842	12.2727	540	0.9073	0.5920	0.9073	0.9525
0.3842	12.3182	542	0.8893	0.6190	0.8893	0.9430
0.3842	12.3636	544	0.9401	0.5781	0.9401	0.9696
0.3842	12.4091	546	1.0411	0.5469	1.0411	1.0204
0.3842	12.4545	548	1.0421	0.5581	1.0421	1.0208
0.3842	12.5	550	0.9696	0.5938	0.9696	0.9847
0.3842	12.5455	552	0.9517	0.6299	0.9517	0.9755
0.3842	12.5909	554	0.9931	0.5984	0.9931	0.9965
0.3842	12.6364	556	1.0520	0.5556	1.0520	1.0257
0.3842	12.6818	558	1.0211	0.5827	1.0211	1.0105
0.3842	12.7273	560	0.9944	0.5806	0.9944	0.9972
0.3842	12.7727	562	1.0275	0.5556	1.0275	1.0136
0.3842	12.8182	564	1.0111	0.56	1.0111	1.0056

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1