ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k7_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5308
• Qwk: 0.6013
• Mse: 0.5308
• Rmse: 0.7285

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	3.7193	-0.0252	3.7193	1.9286
No log	0.1143	4	3.0101	0.0358	3.0101	1.7350
No log	0.1714	6	1.5706	-0.0359	1.5706	1.2532
No log	0.2286	8	1.0866	0.1864	1.0866	1.0424
No log	0.2857	10	1.0940	0.1107	1.0940	1.0460
No log	0.3429	12	1.1032	0.1989	1.1032	1.0503
No log	0.4	14	1.0873	0.2120	1.0873	1.0427
No log	0.4571	16	1.0777	0.1711	1.0777	1.0381
No log	0.5143	18	0.9197	0.3836	0.9197	0.9590
No log	0.5714	20	0.8908	0.3709	0.8908	0.9438
No log	0.6286	22	0.9748	0.2100	0.9748	0.9873
No log	0.6857	24	1.0313	0.2471	1.0313	1.0155
No log	0.7429	26	0.9471	0.2850	0.9471	0.9732
No log	0.8	28	0.7935	0.4962	0.7935	0.8908
No log	0.8571	30	0.7495	0.4819	0.7495	0.8657
No log	0.9143	32	0.7363	0.4816	0.7363	0.8581
No log	0.9714	34	0.8715	0.4888	0.8715	0.9335
No log	1.0286	36	0.7825	0.5518	0.7825	0.8846
No log	1.0857	38	0.7499	0.5795	0.7499	0.8660
No log	1.1429	40	0.7299	0.5646	0.7299	0.8543
No log	1.2	42	0.7200	0.5539	0.7200	0.8485
No log	1.2571	44	0.7499	0.6054	0.7499	0.8660
No log	1.3143	46	0.7578	0.5888	0.7578	0.8705
No log	1.3714	48	0.7787	0.6055	0.7787	0.8824
No log	1.4286	50	0.6944	0.6144	0.6944	0.8333
No log	1.4857	52	0.6601	0.6564	0.6601	0.8125
No log	1.5429	54	0.6981	0.5865	0.6981	0.8355
No log	1.6	56	0.7758	0.5350	0.7758	0.8808
No log	1.6571	58	0.6654	0.6368	0.6654	0.8157
No log	1.7143	60	0.6840	0.6452	0.6840	0.8270
No log	1.7714	62	0.8389	0.6405	0.8389	0.9159
No log	1.8286	64	0.7103	0.6353	0.7103	0.8428
No log	1.8857	66	0.6537	0.6124	0.6537	0.8085
No log	1.9429	68	0.6801	0.6278	0.6801	0.8247
No log	2.0	70	0.9596	0.4923	0.9596	0.9796
No log	2.0571	72	1.0329	0.4505	1.0329	1.0163
No log	2.1143	74	0.7475	0.5902	0.7475	0.8646
No log	2.1714	76	0.8282	0.5910	0.8282	0.9100
No log	2.2286	78	1.0507	0.4580	1.0507	1.0251
No log	2.2857	80	1.0085	0.4767	1.0085	1.0042
No log	2.3429	82	0.7512	0.5746	0.7512	0.8667
No log	2.4	84	0.6567	0.6057	0.6567	0.8103
No log	2.4571	86	0.6887	0.5327	0.6887	0.8299
No log	2.5143	88	0.6646	0.5542	0.6646	0.8152
No log	2.5714	90	0.6356	0.5985	0.6356	0.7973
No log	2.6286	92	0.6639	0.5898	0.6639	0.8148
No log	2.6857	94	0.8419	0.5521	0.8419	0.9176
No log	2.7429	96	0.9008	0.5516	0.9008	0.9491
No log	2.8	98	0.9403	0.5346	0.9403	0.9697
No log	2.8571	100	0.7717	0.5925	0.7717	0.8785
No log	2.9143	102	0.6826	0.6352	0.6826	0.8262
No log	2.9714	104	0.6585	0.6581	0.6585	0.8115
No log	3.0286	106	0.7158	0.5245	0.7158	0.8460
No log	3.0857	108	0.7706	0.5653	0.7706	0.8778
No log	3.1429	110	0.7264	0.5653	0.7264	0.8523
No log	3.2	112	0.7226	0.5913	0.7226	0.8500
No log	3.2571	114	0.7986	0.5948	0.7986	0.8937
No log	3.3143	116	0.7870	0.6083	0.7870	0.8871
No log	3.3714	118	0.7837	0.7059	0.7837	0.8853
No log	3.4286	120	0.8412	0.6656	0.8412	0.9172
No log	3.4857	122	0.7540	0.6785	0.7540	0.8683
No log	3.5429	124	0.6603	0.5797	0.6603	0.8126
No log	3.6	126	0.6802	0.6429	0.6802	0.8247
No log	3.6571	128	0.7214	0.6042	0.7214	0.8493
No log	3.7143	130	0.6524	0.6469	0.6524	0.8077
No log	3.7714	132	0.6205	0.5432	0.6205	0.7877
No log	3.8286	134	0.6097	0.5879	0.6097	0.7808
No log	3.8857	136	0.5870	0.6482	0.5870	0.7662
No log	3.9429	138	0.6744	0.6554	0.6744	0.8212
No log	4.0	140	0.8257	0.5808	0.8257	0.9087
No log	4.0571	142	0.6947	0.6427	0.6947	0.8335
No log	4.1143	144	0.5686	0.6942	0.5686	0.7541
No log	4.1714	146	0.7251	0.6092	0.7251	0.8515
No log	4.2286	148	0.7401	0.5811	0.7401	0.8603
No log	4.2857	150	0.5806	0.6544	0.5806	0.7620
No log	4.3429	152	0.6362	0.6670	0.6362	0.7976
No log	4.4	154	0.7372	0.5928	0.7372	0.8586
No log	4.4571	156	0.6494	0.6587	0.6494	0.8059
No log	4.5143	158	0.5472	0.6144	0.5472	0.7397
No log	4.5714	160	0.5568	0.6419	0.5568	0.7462
No log	4.6286	162	0.5486	0.6452	0.5486	0.7407
No log	4.6857	164	0.5811	0.6664	0.5811	0.7623
No log	4.7429	166	0.7893	0.5930	0.7893	0.8884
No log	4.8	168	0.8644	0.5056	0.8644	0.9297
No log	4.8571	170	0.7409	0.5160	0.7409	0.8607
No log	4.9143	172	0.6256	0.5972	0.6256	0.7909
No log	4.9714	174	0.7095	0.5805	0.7095	0.8423
No log	5.0286	176	0.7984	0.5574	0.7984	0.8935
No log	5.0857	178	0.7248	0.6154	0.7248	0.8514
No log	5.1429	180	0.6064	0.6869	0.6064	0.7787
No log	5.2	182	0.6732	0.5828	0.6732	0.8205
No log	5.2571	184	0.7755	0.6165	0.7755	0.8806
No log	5.3143	186	0.7223	0.5601	0.7223	0.8499
No log	5.3714	188	0.6370	0.6066	0.6370	0.7981
No log	5.4286	190	0.6525	0.6572	0.6525	0.8078
No log	5.4857	192	0.7284	0.5520	0.7284	0.8534
No log	5.5429	194	0.7487	0.5681	0.7487	0.8653
No log	5.6	196	0.6932	0.6622	0.6932	0.8326
No log	5.6571	198	0.7281	0.5993	0.7281	0.8533
No log	5.7143	200	0.7668	0.5949	0.7668	0.8757
No log	5.7714	202	0.7338	0.6032	0.7338	0.8566
No log	5.8286	204	0.6736	0.6572	0.6736	0.8207
No log	5.8857	206	0.6707	0.6144	0.6707	0.8189
No log	5.9429	208	0.6637	0.5930	0.6637	0.8147
No log	6.0	210	0.6503	0.6302	0.6503	0.8064
No log	6.0571	212	0.6468	0.6166	0.6468	0.8042
No log	6.1143	214	0.6403	0.6263	0.6403	0.8002
No log	6.1714	216	0.6280	0.6789	0.6280	0.7925
No log	6.2286	218	0.6474	0.6744	0.6474	0.8046
No log	6.2857	220	0.6816	0.6012	0.6816	0.8256
No log	6.3429	222	0.6328	0.6923	0.6328	0.7955
No log	6.4	224	0.6145	0.6421	0.6145	0.7839
No log	6.4571	226	0.6400	0.6228	0.6400	0.8000
No log	6.5143	228	0.6112	0.6219	0.6112	0.7818
No log	6.5714	230	0.5991	0.5988	0.5991	0.7740
No log	6.6286	232	0.5973	0.6497	0.5973	0.7729
No log	6.6857	234	0.5758	0.6903	0.5758	0.7588
No log	6.7429	236	0.5860	0.6347	0.5860	0.7655
No log	6.8	238	0.6099	0.6519	0.6099	0.7810
No log	6.8571	240	0.6003	0.6740	0.6003	0.7748
No log	6.9143	242	0.5940	0.6659	0.5940	0.7707
No log	6.9714	244	0.6192	0.6015	0.6192	0.7869
No log	7.0286	246	0.6090	0.6725	0.6090	0.7804
No log	7.0857	248	0.6298	0.6446	0.6298	0.7936
No log	7.1429	250	0.6576	0.6259	0.6576	0.8109
No log	7.2	252	0.6311	0.6259	0.6311	0.7944
No log	7.2571	254	0.6137	0.5996	0.6137	0.7834
No log	7.3143	256	0.5994	0.6018	0.5994	0.7742
No log	7.3714	258	0.5974	0.6206	0.5974	0.7729
No log	7.4286	260	0.5880	0.6650	0.5880	0.7668
No log	7.4857	262	0.5934	0.6672	0.5934	0.7703
No log	7.5429	264	0.6252	0.6296	0.6252	0.7907
No log	7.6	266	0.6152	0.6291	0.6152	0.7843
No log	7.6571	268	0.6097	0.5644	0.6097	0.7808
No log	7.7143	270	0.6351	0.5228	0.6351	0.7970
No log	7.7714	272	0.6068	0.5428	0.6068	0.7790
No log	7.8286	274	0.5763	0.6085	0.5763	0.7591
No log	7.8857	276	0.5922	0.6473	0.5922	0.7696
No log	7.9429	278	0.6107	0.6572	0.6107	0.7814
No log	8.0	280	0.6105	0.6114	0.6105	0.7814
No log	8.0571	282	0.6077	0.6114	0.6077	0.7796
No log	8.1143	284	0.6089	0.6320	0.6089	0.7804
No log	8.1714	286	0.6333	0.6094	0.6333	0.7958
No log	8.2286	288	0.6239	0.6094	0.6239	0.7899
No log	8.2857	290	0.5946	0.6424	0.5946	0.7711
No log	8.3429	292	0.5794	0.6689	0.5794	0.7612
No log	8.4	294	0.5876	0.6598	0.5876	0.7666
No log	8.4571	296	0.6628	0.5650	0.6628	0.8141
No log	8.5143	298	0.6563	0.6022	0.6563	0.8101
No log	8.5714	300	0.5806	0.6491	0.5806	0.7620
No log	8.6286	302	0.5912	0.6846	0.5912	0.7689
No log	8.6857	304	0.6213	0.6347	0.6213	0.7882
No log	8.7429	306	0.6209	0.5546	0.6209	0.7880
No log	8.8	308	0.6520	0.5534	0.6520	0.8075
No log	8.8571	310	0.6675	0.5534	0.6675	0.8170
No log	8.9143	312	0.6434	0.5425	0.6434	0.8021
No log	8.9714	314	0.6100	0.6186	0.6100	0.7811
No log	9.0286	316	0.6076	0.5995	0.6076	0.7795
No log	9.0857	318	0.6203	0.5945	0.6203	0.7876
No log	9.1429	320	0.6016	0.6482	0.6016	0.7757
No log	9.2	322	0.5972	0.6473	0.5972	0.7728
No log	9.2571	324	0.5947	0.6805	0.5947	0.7711
No log	9.3143	326	0.5951	0.6519	0.5951	0.7714
No log	9.3714	328	0.5724	0.6518	0.5724	0.7566
No log	9.4286	330	0.6083	0.6215	0.6083	0.7799
No log	9.4857	332	0.6490	0.6194	0.6490	0.8056
No log	9.5429	334	0.6074	0.6205	0.6074	0.7794
No log	9.6	336	0.5877	0.6725	0.5877	0.7666
No log	9.6571	338	0.6468	0.6260	0.6468	0.8042
No log	9.7143	340	0.6880	0.6026	0.6880	0.8295
No log	9.7714	342	0.6667	0.6414	0.6667	0.8165
No log	9.8286	344	0.6461	0.6491	0.6461	0.8038
No log	9.8857	346	0.6619	0.6195	0.6619	0.8136
No log	9.9429	348	0.6663	0.5977	0.6663	0.8163
No log	10.0	350	0.6696	0.5487	0.6696	0.8183
No log	10.0571	352	0.6759	0.5540	0.6759	0.8221
No log	10.1143	354	0.6986	0.6102	0.6986	0.8358
No log	10.1714	356	0.7264	0.5727	0.7264	0.8523
No log	10.2286	358	0.7318	0.6043	0.7318	0.8554
No log	10.2857	360	0.6724	0.6310	0.6724	0.8200
No log	10.3429	362	0.6450	0.6614	0.6450	0.8031
No log	10.4	364	0.6490	0.6310	0.6490	0.8056
No log	10.4571	366	0.6722	0.6002	0.6722	0.8199
No log	10.5143	368	0.6644	0.5895	0.6644	0.8151
No log	10.5714	370	0.6668	0.5787	0.6668	0.8166
No log	10.6286	372	0.6412	0.6493	0.6412	0.8008
No log	10.6857	374	0.6229	0.6439	0.6229	0.7893
No log	10.7429	376	0.6216	0.6364	0.6216	0.7884
No log	10.8	378	0.6279	0.6433	0.6279	0.7924
No log	10.8571	380	0.6582	0.5727	0.6582	0.8113
No log	10.9143	382	0.7019	0.5819	0.7019	0.8378
No log	10.9714	384	0.6660	0.5718	0.6660	0.8161
No log	11.0286	386	0.6181	0.6243	0.6181	0.7862
No log	11.0857	388	0.6272	0.6318	0.6272	0.7920
No log	11.1429	390	0.6435	0.6412	0.6435	0.8022
No log	11.2	392	0.6423	0.6446	0.6423	0.8014
No log	11.2571	394	0.6453	0.5756	0.6453	0.8033
No log	11.3143	396	0.6018	0.6066	0.6018	0.7758
No log	11.3714	398	0.5675	0.6543	0.5675	0.7533
No log	11.4286	400	0.6139	0.6997	0.6139	0.7835
No log	11.4857	402	0.6097	0.6997	0.6097	0.7808
No log	11.5429	404	0.5736	0.6618	0.5736	0.7574
No log	11.6	406	0.5733	0.6959	0.5733	0.7572
No log	11.6571	408	0.6721	0.5777	0.6721	0.8198
No log	11.7143	410	0.7447	0.5370	0.7447	0.8630
No log	11.7714	412	0.8076	0.5014	0.8076	0.8987
No log	11.8286	414	0.7867	0.5346	0.7867	0.8869
No log	11.8857	416	0.7170	0.5833	0.7170	0.8468
No log	11.9429	418	0.6543	0.6084	0.6543	0.8089
No log	12.0	420	0.6151	0.6124	0.6151	0.7843
No log	12.0571	422	0.6564	0.5951	0.6564	0.8102
No log	12.1143	424	0.6653	0.5951	0.6653	0.8157
No log	12.1714	426	0.6322	0.5930	0.6322	0.7951
No log	12.2286	428	0.6144	0.5923	0.6144	0.7838
No log	12.2857	430	0.6169	0.5536	0.6169	0.7854
No log	12.3429	432	0.6188	0.5459	0.6188	0.7866
No log	12.4	434	0.6223	0.5877	0.6223	0.7889
No log	12.4571	436	0.6129	0.5575	0.6129	0.7829
No log	12.5143	438	0.6016	0.5939	0.6016	0.7757
No log	12.5714	440	0.5890	0.5771	0.5890	0.7675
No log	12.6286	442	0.5950	0.5879	0.5950	0.7714
No log	12.6857	444	0.6025	0.6089	0.6025	0.7762
No log	12.7429	446	0.5918	0.6368	0.5918	0.7693
No log	12.8	448	0.5911	0.6949	0.5911	0.7688
No log	12.8571	450	0.5925	0.6622	0.5925	0.7697
No log	12.9143	452	0.6129	0.6341	0.6129	0.7829
No log	12.9714	454	0.6456	0.6228	0.6456	0.8035
No log	13.0286	456	0.6473	0.6259	0.6473	0.8046
No log	13.0857	458	0.6480	0.6584	0.6480	0.8050
No log	13.1429	460	0.6283	0.6593	0.6283	0.7927
No log	13.2	462	0.6005	0.6500	0.6005	0.7749
No log	13.2571	464	0.5980	0.6610	0.5980	0.7733
No log	13.3143	466	0.5982	0.6610	0.5982	0.7734
No log	13.3714	468	0.5920	0.6196	0.5920	0.7694
No log	13.4286	470	0.5976	0.5704	0.5976	0.7730
No log	13.4857	472	0.5970	0.6022	0.5970	0.7726
No log	13.5429	474	0.5973	0.5909	0.5973	0.7729
No log	13.6	476	0.5939	0.5909	0.5939	0.7707
No log	13.6571	478	0.5951	0.6374	0.5951	0.7714
No log	13.7143	480	0.6073	0.6664	0.6073	0.7793
No log	13.7714	482	0.6160	0.6830	0.6160	0.7849
No log	13.8286	484	0.5917	0.6491	0.5917	0.7692
No log	13.8857	486	0.5787	0.6039	0.5787	0.7608
No log	13.9429	488	0.5877	0.5905	0.5877	0.7666
No log	14.0	490	0.5858	0.5659	0.5858	0.7654
No log	14.0571	492	0.5877	0.6341	0.5877	0.7666
No log	14.1143	494	0.6057	0.6341	0.6057	0.7783
No log	14.1714	496	0.6198	0.6636	0.6198	0.7872
No log	14.2286	498	0.6090	0.6636	0.6090	0.7804
0.2429	14.2857	500	0.5918	0.6341	0.5918	0.7693
0.2429	14.3429	502	0.5810	0.6365	0.5810	0.7622
0.2429	14.4	504	0.5865	0.6333	0.5865	0.7658
0.2429	14.4571	506	0.5807	0.6455	0.5807	0.7620
0.2429	14.5143	508	0.5749	0.5983	0.5749	0.7582
0.2429	14.5714	510	0.5701	0.6107	0.5701	0.7550
0.2429	14.6286	512	0.5670	0.6455	0.5670	0.7530
0.2429	14.6857	514	0.5922	0.6948	0.5922	0.7695
0.2429	14.7429	516	0.5779	0.6597	0.5779	0.7602
0.2429	14.8	518	0.5462	0.6680	0.5462	0.7390
0.2429	14.8571	520	0.5669	0.6779	0.5669	0.7529
0.2429	14.9143	522	0.5840	0.6265	0.5840	0.7642
0.2429	14.9714	524	0.5659	0.6570	0.5659	0.7523
0.2429	15.0286	526	0.5592	0.6350	0.5592	0.7478
0.2429	15.0857	528	0.5832	0.6333	0.5832	0.7637
0.2429	15.1429	530	0.6032	0.6626	0.6032	0.7766
0.2429	15.2	532	0.5920	0.6736	0.5920	0.7694
0.2429	15.2571	534	0.5716	0.5871	0.5716	0.7561
0.2429	15.3143	536	0.5690	0.6196	0.5690	0.7543
0.2429	15.3714	538	0.5719	0.6537	0.5719	0.7562
0.2429	15.4286	540	0.5760	0.6430	0.5760	0.7589
0.2429	15.4857	542	0.5944	0.6948	0.5944	0.7710
0.2429	15.5429	544	0.5903	0.6790	0.5903	0.7683
0.2429	15.6	546	0.5616	0.6473	0.5616	0.7494
0.2429	15.6571	548	0.5543	0.6364	0.5543	0.7445
0.2429	15.7143	550	0.5530	0.6470	0.5530	0.7436
0.2429	15.7714	552	0.5494	0.6753	0.5494	0.7412
0.2429	15.8286	554	0.5628	0.6732	0.5628	0.7502
0.2429	15.8857	556	0.5850	0.6790	0.5850	0.7648
0.2429	15.9429	558	0.5685	0.6693	0.5685	0.7540
0.2429	16.0	560	0.5596	0.6528	0.5596	0.7481
0.2429	16.0571	562	0.5480	0.6634	0.5480	0.7403
0.2429	16.1143	564	0.5402	0.6634	0.5402	0.7350
0.2429	16.1714	566	0.5176	0.6720	0.5176	0.7195
0.2429	16.2286	568	0.5183	0.6762	0.5183	0.7200
0.2429	16.2857	570	0.5247	0.6648	0.5247	0.7244
0.2429	16.3429	572	0.5170	0.6302	0.5170	0.7190
0.2429	16.4	574	0.5450	0.6362	0.5450	0.7382
0.2429	16.4571	576	0.5675	0.6507	0.5675	0.7533
0.2429	16.5143	578	0.6229	0.6236	0.6229	0.7893
0.2429	16.5714	580	0.6394	0.6218	0.6394	0.7996
0.2429	16.6286	582	0.6161	0.6361	0.6161	0.7849
0.2429	16.6857	584	0.5571	0.7067	0.5571	0.7464
0.2429	16.7429	586	0.5458	0.7034	0.5458	0.7388
0.2429	16.8	588	0.5517	0.6147	0.5517	0.7428
0.2429	16.8571	590	0.5530	0.6269	0.5530	0.7436
0.2429	16.9143	592	0.5493	0.6113	0.5493	0.7412
0.2429	16.9714	594	0.5392	0.6219	0.5392	0.7343
0.2429	17.0286	596	0.5308	0.6013	0.5308	0.7285

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1