ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6577
• Qwk: 0.5787
• Mse: 0.6577
• Rmse: 0.8110

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.05	2	3.9909	-0.0074	3.9909	1.9977
No log	0.1	4	2.4807	-0.0019	2.4807	1.5750
No log	0.15	6	1.5446	-0.0700	1.5446	1.2428
No log	0.2	8	1.0272	0.3014	1.0272	1.0135
No log	0.25	10	1.0108	0.2314	1.0108	1.0054
No log	0.3	12	1.1497	0.1304	1.1497	1.0723
No log	0.35	14	1.6688	0.0741	1.6688	1.2918
No log	0.4	16	1.3909	0.1112	1.3909	1.1794
No log	0.45	18	1.1219	0.1471	1.1219	1.0592
No log	0.5	20	1.0266	0.2367	1.0266	1.0132
No log	0.55	22	0.9202	0.375	0.9202	0.9593
No log	0.6	24	0.9903	0.3697	0.9903	0.9951
No log	0.65	26	1.0607	0.4264	1.0607	1.0299
No log	0.7	28	0.8461	0.4984	0.8461	0.9198
No log	0.75	30	0.7558	0.5385	0.7558	0.8693
No log	0.8	32	0.8182	0.6243	0.8182	0.9046
No log	0.85	34	0.7865	0.6069	0.7865	0.8868
No log	0.9	36	0.9436	0.5215	0.9436	0.9714
No log	0.95	38	1.0435	0.4817	1.0435	1.0215
No log	1.0	40	0.8389	0.6088	0.8389	0.9159
No log	1.05	42	0.7557	0.6239	0.7557	0.8693
No log	1.1	44	0.7896	0.5836	0.7896	0.8886
No log	1.15	46	0.7285	0.6329	0.7285	0.8535
No log	1.2	48	0.7236	0.6121	0.7236	0.8507
No log	1.25	50	0.7969	0.5559	0.7969	0.8927
No log	1.3	52	0.8171	0.5116	0.8171	0.9039
No log	1.35	54	0.7279	0.6121	0.7279	0.8532
No log	1.4	56	0.6720	0.6343	0.6720	0.8198
No log	1.45	58	0.6778	0.6206	0.6778	0.8233
No log	1.5	60	0.6714	0.6297	0.6714	0.8194
No log	1.55	62	0.6839	0.6041	0.6839	0.8270
No log	1.6	64	0.8031	0.6109	0.8031	0.8962
No log	1.65	66	0.7611	0.6065	0.7611	0.8724
No log	1.7	68	0.6916	0.6113	0.6916	0.8316
No log	1.75	70	0.6558	0.5931	0.6558	0.8098
No log	1.8	72	0.6257	0.6430	0.6257	0.7910
No log	1.85	74	0.6242	0.5985	0.6242	0.7901
No log	1.9	76	0.6229	0.6406	0.6229	0.7892
No log	1.95	78	0.6274	0.6343	0.6274	0.7921
No log	2.0	80	0.6116	0.6196	0.6116	0.7821
No log	2.05	82	0.7114	0.6465	0.7114	0.8435
No log	2.1	84	0.6550	0.6377	0.6550	0.8093
No log	2.15	86	0.6260	0.6552	0.6260	0.7912
No log	2.2	88	0.6236	0.6519	0.6236	0.7897
No log	2.25	90	0.6771	0.6929	0.6771	0.8229
No log	2.3	92	0.6275	0.6630	0.6275	0.7921
No log	2.35	94	0.6247	0.6630	0.6247	0.7904
No log	2.4	96	0.6011	0.6570	0.6011	0.7753
No log	2.45	98	0.6041	0.6426	0.6041	0.7773
No log	2.5	100	0.6289	0.6060	0.6289	0.7930
No log	2.55	102	0.6823	0.5748	0.6823	0.8260
No log	2.6	104	0.7825	0.6110	0.7825	0.8846
No log	2.65	106	0.7181	0.6074	0.7181	0.8474
No log	2.7	108	0.6099	0.6465	0.6099	0.7809
No log	2.75	110	0.5936	0.6452	0.5936	0.7705
No log	2.8	112	0.5913	0.6360	0.5913	0.7690
No log	2.85	114	0.7060	0.6434	0.7060	0.8402
No log	2.9	116	1.0419	0.5122	1.0419	1.0207
No log	2.95	118	1.0470	0.5283	1.0470	1.0232
No log	3.0	120	0.7697	0.6148	0.7697	0.8773
No log	3.05	122	0.6034	0.6578	0.6034	0.7768
No log	3.1	124	0.6127	0.6487	0.6127	0.7828
No log	3.15	126	0.6029	0.6520	0.6029	0.7765
No log	3.2	128	0.5906	0.6562	0.5906	0.7685
No log	3.25	130	0.5862	0.5884	0.5862	0.7657
No log	3.3	132	0.5883	0.5682	0.5883	0.7670
No log	3.35	134	0.6099	0.6879	0.6099	0.7810
No log	3.4	136	0.7399	0.6336	0.7399	0.8602
No log	3.45	138	0.7118	0.6556	0.7118	0.8437
No log	3.5	140	0.6019	0.6451	0.6019	0.7758
No log	3.55	142	0.6490	0.5586	0.6490	0.8056
No log	3.6	144	0.7014	0.5868	0.7014	0.8375
No log	3.65	146	0.6042	0.5716	0.6042	0.7773
No log	3.7	148	0.6176	0.6537	0.6176	0.7858
No log	3.75	150	0.7154	0.6190	0.7154	0.8458
No log	3.8	152	0.6471	0.7008	0.6471	0.8045
No log	3.85	154	0.6044	0.6590	0.6044	0.7774
No log	3.9	156	0.8792	0.6072	0.8792	0.9377
No log	3.95	158	1.0667	0.5437	1.0667	1.0328
No log	4.0	160	0.8765	0.5944	0.8765	0.9362
No log	4.05	162	0.6231	0.6025	0.6231	0.7894
No log	4.1	164	0.6048	0.6432	0.6048	0.7777
No log	4.15	166	0.7188	0.6300	0.7188	0.8478
No log	4.2	168	0.7348	0.6476	0.7348	0.8572
No log	4.25	170	0.6160	0.6291	0.6160	0.7848
No log	4.3	172	0.6063	0.5421	0.6063	0.7787
No log	4.35	174	0.6909	0.5729	0.6909	0.8312
No log	4.4	176	0.6769	0.5520	0.6769	0.8227
No log	4.45	178	0.5932	0.6022	0.5932	0.7702
No log	4.5	180	0.6459	0.7227	0.6459	0.8037
No log	4.55	182	0.8975	0.5601	0.8975	0.9474
No log	4.6	184	0.9143	0.5338	0.9143	0.9562
No log	4.65	186	0.7223	0.6653	0.7223	0.8499
No log	4.7	188	0.5721	0.6886	0.5721	0.7564
No log	4.75	190	0.5925	0.5726	0.5925	0.7697
No log	4.8	192	0.6143	0.5726	0.6143	0.7838
No log	4.85	194	0.5897	0.6022	0.5897	0.7679
No log	4.9	196	0.5910	0.6609	0.5910	0.7687
No log	4.95	198	0.5892	0.6636	0.5892	0.7676
No log	5.0	200	0.5885	0.5704	0.5885	0.7671
No log	5.05	202	0.6719	0.5870	0.6719	0.8197
No log	5.1	204	0.6701	0.5676	0.6701	0.8186
No log	5.15	206	0.5913	0.5647	0.5913	0.7690
No log	5.2	208	0.5877	0.6519	0.5877	0.7666
No log	5.25	210	0.6214	0.6782	0.6214	0.7883
No log	5.3	212	0.6584	0.6756	0.6584	0.8114
No log	5.35	214	0.6255	0.6850	0.6255	0.7909
No log	5.4	216	0.6302	0.6471	0.6302	0.7938
No log	5.45	218	0.6436	0.6484	0.6436	0.8023
No log	5.5	220	0.7202	0.6069	0.7202	0.8486
No log	5.55	222	0.6880	0.6251	0.6880	0.8295
No log	5.6	224	0.6116	0.5926	0.6116	0.7820
No log	5.65	226	0.5830	0.6400	0.5830	0.7636
No log	5.7	228	0.5985	0.6251	0.5985	0.7736
No log	5.75	230	0.6505	0.5708	0.6505	0.8065
No log	5.8	232	0.7306	0.5792	0.7306	0.8548
No log	5.85	234	0.6840	0.5895	0.6840	0.8271
No log	5.9	236	0.6319	0.5708	0.6319	0.7949
No log	5.95	238	0.5882	0.5928	0.5882	0.7669
No log	6.0	240	0.5860	0.6745	0.5860	0.7655
No log	6.05	242	0.5899	0.6339	0.5899	0.7680
No log	6.1	244	0.5912	0.6339	0.5912	0.7689
No log	6.15	246	0.5975	0.6164	0.5975	0.7730
No log	6.2	248	0.5873	0.6452	0.5873	0.7664
No log	6.25	250	0.5694	0.6354	0.5694	0.7546
No log	6.3	252	0.5850	0.6517	0.5850	0.7649
No log	6.35	254	0.6380	0.6129	0.6380	0.7987
No log	6.4	256	0.6458	0.6021	0.6458	0.8036
No log	6.45	258	0.6681	0.5650	0.6681	0.8174
No log	6.5	260	0.6374	0.5825	0.6374	0.7984
No log	6.55	262	0.5730	0.6581	0.5730	0.7570
No log	6.6	264	0.6209	0.6774	0.6209	0.7880
No log	6.65	266	0.6321	0.6438	0.6321	0.7950
No log	6.7	268	0.5795	0.6123	0.5795	0.7612
No log	6.75	270	0.5778	0.5983	0.5778	0.7601
No log	6.8	272	0.5679	0.6123	0.5679	0.7536
No log	6.85	274	0.5655	0.6196	0.5655	0.7520
No log	6.9	276	0.5678	0.6196	0.5678	0.7536
No log	6.95	278	0.5693	0.6001	0.5693	0.7545
No log	7.0	280	0.5779	0.5950	0.5779	0.7602
No log	7.05	282	0.5933	0.6269	0.5933	0.7703
No log	7.1	284	0.5708	0.5898	0.5708	0.7555
No log	7.15	286	0.5637	0.6398	0.5637	0.7508
No log	7.2	288	0.5566	0.6076	0.5566	0.7461
No log	7.25	290	0.5513	0.6581	0.5513	0.7425
No log	7.3	292	0.6023	0.6586	0.6023	0.7761
No log	7.35	294	0.6354	0.6461	0.6354	0.7971
No log	7.4	296	0.7507	0.6266	0.7507	0.8664
No log	7.45	298	0.6876	0.6599	0.6876	0.8292
No log	7.5	300	0.5682	0.6725	0.5682	0.7538
No log	7.55	302	0.5867	0.6485	0.5867	0.7659
No log	7.6	304	0.6026	0.6386	0.6026	0.7763
No log	7.65	306	0.5690	0.5969	0.5690	0.7543
No log	7.7	308	0.5501	0.6087	0.5501	0.7417
No log	7.75	310	0.6220	0.6701	0.6220	0.7886
No log	7.8	312	0.6783	0.6230	0.6783	0.8236
No log	7.85	314	0.6333	0.6669	0.6333	0.7958
No log	7.9	316	0.5781	0.5909	0.5781	0.7603
No log	7.95	318	0.5917	0.5877	0.5917	0.7692
No log	8.0	320	0.6373	0.5570	0.6373	0.7983
No log	8.05	322	0.6670	0.5142	0.6670	0.8167
No log	8.1	324	0.6542	0.4898	0.6542	0.8089
No log	8.15	326	0.6286	0.5570	0.6286	0.7928
No log	8.2	328	0.5936	0.6007	0.5936	0.7704
No log	8.25	330	0.5824	0.6838	0.5824	0.7631
No log	8.3	332	0.5889	0.7005	0.5889	0.7674
No log	8.35	334	0.5908	0.6916	0.5908	0.7687
No log	8.4	336	0.5984	0.6095	0.5984	0.7736
No log	8.45	338	0.6128	0.5843	0.6128	0.7828
No log	8.5	340	0.6535	0.5672	0.6535	0.8084
No log	8.55	342	0.7343	0.4808	0.7343	0.8569
No log	8.6	344	0.7420	0.5154	0.7420	0.8614
No log	8.65	346	0.6621	0.5961	0.6621	0.8137
No log	8.7	348	0.5953	0.6740	0.5953	0.7716
No log	8.75	350	0.6178	0.6998	0.6178	0.7860
No log	8.8	352	0.6003	0.7158	0.6003	0.7748
No log	8.85	354	0.5814	0.6275	0.5814	0.7625
No log	8.9	356	0.6204	0.6240	0.6204	0.7877
No log	8.95	358	0.6984	0.6200	0.6984	0.8357
No log	9.0	360	0.7416	0.6320	0.7416	0.8611
No log	9.05	362	0.6523	0.6575	0.6523	0.8077
No log	9.1	364	0.5900	0.6049	0.5900	0.7681
No log	9.15	366	0.5775	0.5966	0.5775	0.7599
No log	9.2	368	0.5895	0.6415	0.5895	0.7678
No log	9.25	370	0.5855	0.6415	0.5855	0.7652
No log	9.3	372	0.5856	0.5966	0.5856	0.7653
No log	9.35	374	0.6413	0.5586	0.6413	0.8008
No log	9.4	376	0.6735	0.5697	0.6735	0.8207
No log	9.45	378	0.6280	0.6129	0.6280	0.7925
No log	9.5	380	0.5757	0.6297	0.5757	0.7587
No log	9.55	382	0.5935	0.6806	0.5935	0.7704
No log	9.6	384	0.5934	0.6806	0.5934	0.7703
No log	9.65	386	0.5813	0.6415	0.5813	0.7624
No log	9.7	388	0.5843	0.6262	0.5843	0.7644
No log	9.75	390	0.5944	0.6296	0.5944	0.7710
No log	9.8	392	0.6192	0.6128	0.6192	0.7869
No log	9.85	394	0.6324	0.5902	0.6324	0.7952
No log	9.9	396	0.6315	0.5345	0.6315	0.7947
No log	9.95	398	0.6457	0.5740	0.6457	0.8036
No log	10.0	400	0.6308	0.5933	0.6308	0.7942
No log	10.05	402	0.5889	0.6780	0.5889	0.7674
No log	10.1	404	0.5912	0.6368	0.5912	0.7689
No log	10.15	406	0.6040	0.6063	0.6040	0.7772
No log	10.2	408	0.5885	0.5909	0.5885	0.7671
No log	10.25	410	0.5938	0.6389	0.5938	0.7706
No log	10.3	412	0.6544	0.6438	0.6544	0.8090
No log	10.35	414	0.6678	0.6109	0.6678	0.8172
No log	10.4	416	0.6838	0.6109	0.6838	0.8269
No log	10.45	418	0.6401	0.5969	0.6401	0.8000
No log	10.5	420	0.6061	0.6133	0.6061	0.7785
No log	10.55	422	0.6050	0.6133	0.6050	0.7778
No log	10.6	424	0.6047	0.6104	0.6047	0.7776
No log	10.65	426	0.6323	0.6656	0.6323	0.7951
No log	10.7	428	0.7065	0.5856	0.7065	0.8405
No log	10.75	430	0.6858	0.6329	0.6858	0.8282
No log	10.8	432	0.6131	0.6772	0.6131	0.7830
No log	10.85	434	0.6246	0.5706	0.6246	0.7903
No log	10.9	436	0.6457	0.5826	0.6457	0.8036
No log	10.95	438	0.6116	0.5524	0.6116	0.7820
No log	11.0	440	0.6067	0.6046	0.6067	0.7789
No log	11.05	442	0.6359	0.6143	0.6359	0.7974
No log	11.1	444	0.6599	0.5361	0.6599	0.8124
No log	11.15	446	0.6590	0.5758	0.6590	0.8118
No log	11.2	448	0.6442	0.5932	0.6442	0.8026
No log	11.25	450	0.6331	0.6301	0.6331	0.7957
No log	11.3	452	0.6339	0.6301	0.6339	0.7962
No log	11.35	454	0.6215	0.6301	0.6215	0.7884
No log	11.4	456	0.6107	0.6239	0.6107	0.7814
No log	11.45	458	0.6376	0.5943	0.6376	0.7985
No log	11.5	460	0.6502	0.5874	0.6502	0.8064
No log	11.55	462	0.6258	0.6128	0.6258	0.7911
No log	11.6	464	0.5953	0.6254	0.5953	0.7716
No log	11.65	466	0.5828	0.6479	0.5828	0.7634
No log	11.7	468	0.5802	0.6263	0.5802	0.7617
No log	11.75	470	0.5955	0.6843	0.5955	0.7717
No log	11.8	472	0.6038	0.6843	0.6038	0.7771
No log	11.85	474	0.6060	0.6875	0.6060	0.7785
No log	11.9	476	0.5973	0.6383	0.5973	0.7728
No log	11.95	478	0.5928	0.6407	0.5928	0.7699
No log	12.0	480	0.5978	0.6332	0.5978	0.7732
No log	12.05	482	0.5956	0.6307	0.5956	0.7718
No log	12.1	484	0.5978	0.5977	0.5978	0.7732
No log	12.15	486	0.5987	0.5988	0.5987	0.7738
No log	12.2	488	0.5881	0.6259	0.5881	0.7669
No log	12.25	490	0.5912	0.6368	0.5912	0.7689
No log	12.3	492	0.5928	0.6456	0.5928	0.7699
No log	12.35	494	0.5961	0.6482	0.5961	0.7721
No log	12.4	496	0.6024	0.6186	0.6024	0.7761
No log	12.45	498	0.6216	0.6207	0.6216	0.7884
0.2437	12.5	500	0.6333	0.5797	0.6333	0.7958
0.2437	12.55	502	0.6243	0.6143	0.6243	0.7901
0.2437	12.6	504	0.6152	0.6380	0.6152	0.7844
0.2437	12.65	506	0.6038	0.6272	0.6038	0.7771
0.2437	12.7	508	0.5974	0.6144	0.5974	0.7729
0.2437	12.75	510	0.6042	0.6006	0.6042	0.7773
0.2437	12.8	512	0.6059	0.6006	0.6059	0.7784
0.2437	12.85	514	0.6127	0.6013	0.6127	0.7828
0.2437	12.9	516	0.6291	0.5631	0.6291	0.7932
0.2437	12.95	518	0.6699	0.5485	0.6699	0.8185
0.2437	13.0	520	0.6955	0.5234	0.6955	0.8340
0.2437	13.05	522	0.6703	0.5359	0.6703	0.8187
0.2437	13.1	524	0.6397	0.5847	0.6397	0.7998
0.2437	13.15	526	0.6167	0.5977	0.6167	0.7853
0.2437	13.2	528	0.6106	0.6185	0.6106	0.7814
0.2437	13.25	530	0.5953	0.6175	0.5953	0.7716
0.2437	13.3	532	0.5962	0.5712	0.5962	0.7722
0.2437	13.35	534	0.6410	0.5797	0.6410	0.8006
0.2437	13.4	536	0.6520	0.5317	0.6520	0.8075
0.2437	13.45	538	0.6168	0.5577	0.6168	0.7854
0.2437	13.5	540	0.5882	0.6186	0.5882	0.7669
0.2437	13.55	542	0.6071	0.6172	0.6071	0.7792
0.2437	13.6	544	0.6492	0.5831	0.6492	0.8057
0.2437	13.65	546	0.6812	0.5831	0.6812	0.8254
0.2437	13.7	548	0.6627	0.5909	0.6627	0.8141
0.2437	13.75	550	0.5877	0.6244	0.5877	0.7666
0.2437	13.8	552	0.5582	0.6813	0.5582	0.7471
0.2437	13.85	554	0.5856	0.6868	0.5856	0.7653
0.2437	13.9	556	0.6197	0.6343	0.6197	0.7872
0.2437	13.95	558	0.6135	0.6570	0.6135	0.7833
0.2437	14.0	560	0.6162	0.6129	0.6162	0.7850
0.2437	14.05	562	0.6399	0.5879	0.6399	0.8000
0.2437	14.1	564	0.6343	0.5817	0.6343	0.7964
0.2437	14.15	566	0.6205	0.5725	0.6205	0.7877
0.2437	14.2	568	0.6035	0.5725	0.6035	0.7768
0.2437	14.25	570	0.5890	0.6316	0.5890	0.7675
0.2437	14.3	572	0.5770	0.6284	0.5770	0.7596
0.2437	14.35	574	0.5708	0.6306	0.5708	0.7555
0.2437	14.4	576	0.5690	0.6470	0.5690	0.7543
0.2437	14.45	578	0.5685	0.6269	0.5685	0.7540
0.2437	14.5	580	0.5906	0.6164	0.5906	0.7685
0.2437	14.55	582	0.6257	0.5536	0.6257	0.7910
0.2437	14.6	584	0.6084	0.6203	0.6084	0.7800
0.2437	14.65	586	0.5675	0.6508	0.5675	0.7533
0.2437	14.7	588	0.5637	0.6215	0.5637	0.7508
0.2437	14.75	590	0.5704	0.6470	0.5704	0.7552
0.2437	14.8	592	0.5754	0.6057	0.5754	0.7585
0.2437	14.85	594	0.5769	0.6057	0.5769	0.7595
0.2437	14.9	596	0.5741	0.6237	0.5741	0.7577
0.2437	14.95	598	0.5729	0.6237	0.5729	0.7569
0.2437	15.0	600	0.5726	0.6206	0.5726	0.7567
0.2437	15.05	602	0.5762	0.6144	0.5762	0.7591
0.2437	15.1	604	0.5920	0.6262	0.5920	0.7694
0.2437	15.15	606	0.6085	0.5943	0.6085	0.7801
0.2437	15.2	608	0.6072	0.5972	0.6072	0.7792
0.2437	15.25	610	0.6049	0.6024	0.6049	0.7778
0.2437	15.3	612	0.5972	0.6024	0.5972	0.7728
0.2437	15.35	614	0.5755	0.6307	0.5755	0.7586
0.2437	15.4	616	0.5784	0.6154	0.5784	0.7605
0.2437	15.45	618	0.6032	0.6584	0.6032	0.7767
0.2437	15.5	620	0.6172	0.6547	0.6172	0.7856
0.2437	15.55	622	0.6462	0.5923	0.6462	0.8038
0.2437	15.6	624	0.6531	0.5751	0.6531	0.8082
0.2437	15.65	626	0.6510	0.5317	0.6510	0.8068
0.2437	15.7	628	0.6174	0.5996	0.6174	0.7858
0.2437	15.75	630	0.5923	0.6345	0.5923	0.7696
0.2437	15.8	632	0.5929	0.6007	0.5929	0.7700
0.2437	15.85	634	0.6136	0.6656	0.6136	0.7833
0.2437	15.9	636	0.6133	0.6519	0.6133	0.7831
0.2437	15.95	638	0.5990	0.6113	0.5990	0.7740
0.2437	16.0	640	0.5808	0.6154	0.5808	0.7621
0.2437	16.05	642	0.5790	0.6154	0.5790	0.7609
0.2437	16.1	644	0.5866	0.6262	0.5866	0.7659
0.2437	16.15	646	0.5732	0.6262	0.5732	0.7571
0.2437	16.2	648	0.5669	0.6451	0.5669	0.7529
0.2437	16.25	650	0.5748	0.5917	0.5748	0.7582
0.2437	16.3	652	0.6086	0.5797	0.6086	0.7801
0.2437	16.35	654	0.6220	0.5618	0.6220	0.7887
0.2437	16.4	656	0.6283	0.5577	0.6283	0.7926
0.2437	16.45	658	0.6437	0.5346	0.6437	0.8023
0.2437	16.5	660	0.6577	0.5787	0.6577	0.8110

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1