ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1408
• Qwk: 0.6267
• Mse: 1.1408
• Rmse: 1.0681

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0267	2	6.5821	0.0308	6.5821	2.5656
No log	0.0533	4	4.8057	0.0519	4.8057	2.1922
No log	0.08	6	2.8985	0.0988	2.8985	1.7025
No log	0.1067	8	2.0379	0.1527	2.0379	1.4276
No log	0.1333	10	1.6666	0.1905	1.6666	1.2910
No log	0.16	12	1.6871	0.1905	1.6871	1.2989
No log	0.1867	14	1.6272	0.2182	1.6272	1.2756
No log	0.2133	16	1.5030	0.4538	1.5030	1.2260
No log	0.24	18	1.5158	0.3243	1.5158	1.2312
No log	0.2667	20	1.3391	0.3894	1.3391	1.1572
No log	0.2933	22	1.2557	0.3898	1.2557	1.1206
No log	0.32	24	1.5757	0.4031	1.5757	1.2553
No log	0.3467	26	1.3986	0.3833	1.3986	1.1826
No log	0.3733	28	1.4274	0.3214	1.4274	1.1947
No log	0.4	30	1.4730	0.1802	1.4730	1.2137
No log	0.4267	32	1.7095	0.1786	1.7095	1.3075
No log	0.4533	34	1.5508	0.2759	1.5508	1.2453
No log	0.48	36	1.1598	0.4959	1.1598	1.0769
No log	0.5067	38	1.1164	0.5344	1.1164	1.0566
No log	0.5333	40	1.2227	0.4918	1.2227	1.1058
No log	0.56	42	1.3983	0.4918	1.3983	1.1825
No log	0.5867	44	1.3719	0.4444	1.3719	1.1713
No log	0.6133	46	1.3096	0.4375	1.3096	1.1444
No log	0.64	48	1.3725	0.4762	1.3725	1.1715
No log	0.6667	50	1.3820	0.4062	1.3820	1.1756
No log	0.6933	52	1.3249	0.4462	1.3249	1.1510
No log	0.72	54	1.4548	0.4375	1.4548	1.2061
No log	0.7467	56	1.5486	0.3731	1.5486	1.2444
No log	0.7733	58	1.2856	0.4806	1.2856	1.1338
No log	0.8	60	1.1658	0.5693	1.1658	1.0797
No log	0.8267	62	1.2038	0.5294	1.2038	1.0972
No log	0.8533	64	1.2976	0.4394	1.2976	1.1391
No log	0.88	66	1.2724	0.5405	1.2724	1.1280
No log	0.9067	68	1.1696	0.5772	1.1696	1.0815
No log	0.9333	70	1.0050	0.6575	1.0050	1.0025
No log	0.96	72	0.9631	0.6567	0.9631	0.9814
No log	0.9867	74	1.2449	0.4627	1.2449	1.1157
No log	1.0133	76	1.1386	0.5113	1.1386	1.0671
No log	1.04	78	0.9493	0.5581	0.9493	0.9743
No log	1.0667	80	1.0174	0.5882	1.0174	1.0087
No log	1.0933	82	1.3622	0.5526	1.3622	1.1671
No log	1.12	84	1.5662	0.4605	1.5662	1.2515
No log	1.1467	86	1.6069	0.3910	1.6069	1.2676
No log	1.1733	88	1.4654	0.4511	1.4654	1.2105
No log	1.2	90	1.2010	0.5581	1.2010	1.0959
No log	1.2267	92	0.9642	0.5714	0.9642	0.9820
No log	1.2533	94	0.8921	0.6286	0.8920	0.9445
No log	1.28	96	0.8563	0.6301	0.8563	0.9254
No log	1.3067	98	0.9932	0.6222	0.9932	0.9966
No log	1.3333	100	1.3639	0.4511	1.3639	1.1678
No log	1.3600	102	1.4396	0.4545	1.4396	1.1998
No log	1.3867	104	1.4141	0.4662	1.4141	1.1892
No log	1.4133	106	1.3531	0.4748	1.3531	1.1632
No log	1.44	108	1.3512	0.4741	1.3512	1.1624
No log	1.4667	110	1.2089	0.5630	1.2089	1.0995
No log	1.4933	112	1.1937	0.5630	1.1937	1.0926
No log	1.52	114	1.0768	0.5362	1.0768	1.0377
No log	1.5467	116	1.0411	0.5797	1.0411	1.0203
No log	1.5733	118	1.1525	0.5714	1.1525	1.0736
No log	1.6	120	1.2256	0.5503	1.2256	1.1071
No log	1.6267	122	1.2923	0.5098	1.2923	1.1368
No log	1.6533	124	1.4238	0.5217	1.4238	1.1932
No log	1.6800	126	1.4127	0.5031	1.4127	1.1886
No log	1.7067	128	1.2616	0.5306	1.2616	1.1232
No log	1.7333	130	1.1088	0.6286	1.1088	1.0530
No log	1.76	132	1.0378	0.5857	1.0378	1.0187
No log	1.7867	134	1.0789	0.6316	1.0789	1.0387
No log	1.8133	136	1.0335	0.6410	1.0335	1.0166
No log	1.8400	138	0.9168	0.6364	0.9168	0.9575
No log	1.8667	140	0.8129	0.6619	0.8129	0.9016
No log	1.8933	142	0.8189	0.7059	0.8189	0.9049
No log	1.92	144	0.8413	0.7050	0.8413	0.9172
No log	1.9467	146	0.8954	0.6412	0.8954	0.9463
No log	1.9733	148	1.0395	0.6056	1.0395	1.0196
No log	2.0	150	1.1656	0.6093	1.1656	1.0796
No log	2.0267	152	1.2456	0.6061	1.2456	1.1161
No log	2.0533	154	1.1556	0.6335	1.1556	1.0750
No log	2.08	156	1.0805	0.6133	1.0805	1.0395
No log	2.1067	158	0.9843	0.6389	0.9843	0.9921
No log	2.1333	160	0.9240	0.6714	0.9240	0.9613
No log	2.16	162	0.8796	0.6111	0.8796	0.9379
No log	2.1867	164	0.8722	0.6345	0.8722	0.9339
No log	2.2133	166	0.8615	0.6575	0.8615	0.9282
No log	2.24	168	0.9554	0.6528	0.9554	0.9774
No log	2.2667	170	0.9570	0.6351	0.9570	0.9783
No log	2.2933	172	1.1541	0.6265	1.1541	1.0743
No log	2.32	174	1.1382	0.5867	1.1382	1.0669
No log	2.3467	176	1.0503	0.6667	1.0503	1.0248
No log	2.3733	178	1.0182	0.6212	1.0183	1.0091
No log	2.4	180	1.0359	0.6615	1.0359	1.0178
No log	2.4267	182	1.1847	0.528	1.1847	1.0885
No log	2.4533	184	1.1858	0.5366	1.1858	1.0890
No log	2.48	186	1.0468	0.5865	1.0468	1.0231
No log	2.5067	188	1.0266	0.6490	1.0266	1.0132
No log	2.5333	190	1.0136	0.6525	1.0136	1.0068
No log	2.56	192	1.0107	0.6389	1.0107	1.0054
No log	2.5867	194	1.1434	0.6347	1.1434	1.0693
No log	2.6133	196	1.4457	0.5989	1.4457	1.2024
No log	2.64	198	1.4651	0.6	1.4651	1.2104
No log	2.6667	200	1.0652	0.6429	1.0652	1.0321
No log	2.6933	202	0.7889	0.6986	0.7889	0.8882
No log	2.7200	204	0.7759	0.7111	0.7759	0.8809
No log	2.7467	206	0.8253	0.6866	0.8253	0.9085
No log	2.7733	208	0.9659	0.6	0.9659	0.9828
No log	2.8	210	1.2652	0.5255	1.2652	1.1248
No log	2.8267	212	1.3447	0.5	1.3447	1.1596
No log	2.8533	214	1.2867	0.5417	1.2867	1.1343
No log	2.88	216	1.2208	0.5594	1.2208	1.1049
No log	2.9067	218	1.0160	0.6522	1.0160	1.0080
No log	2.9333	220	0.9318	0.6515	0.9318	0.9653
No log	2.96	222	0.8959	0.6316	0.8959	0.9465
No log	2.9867	224	0.8563	0.6212	0.8563	0.9254
No log	3.0133	226	0.8239	0.6618	0.8239	0.9077
No log	3.04	228	0.8120	0.6715	0.8120	0.9011
No log	3.0667	230	0.7740	0.6861	0.7740	0.8798
No log	3.0933	232	0.7744	0.6861	0.7744	0.8800
No log	3.12	234	0.8604	0.6471	0.8604	0.9276
No log	3.1467	236	1.0469	0.6164	1.0469	1.0232
No log	3.1733	238	1.0335	0.6331	1.0335	1.0166
No log	3.2	240	0.9714	0.6569	0.9714	0.9856
No log	3.2267	242	0.8944	0.6567	0.8944	0.9457
No log	3.2533	244	0.8251	0.6815	0.8251	0.9084
No log	3.2800	246	0.8610	0.6567	0.8610	0.9279
No log	3.3067	248	0.9849	0.6494	0.9849	0.9924
No log	3.3333	250	1.0241	0.6829	1.0241	1.0120
No log	3.36	252	0.9381	0.6753	0.9381	0.9685
No log	3.3867	254	0.8678	0.6759	0.8678	0.9316
No log	3.4133	256	0.8603	0.6667	0.8603	0.9275
No log	3.44	258	0.9004	0.6713	0.9004	0.9489
No log	3.4667	260	0.9682	0.6447	0.9682	0.9840
No log	3.4933	262	1.0343	0.6581	1.0343	1.0170
No log	3.52	264	1.0204	0.6358	1.0204	1.0102
No log	3.5467	266	0.9825	0.6389	0.9825	0.9912
No log	3.5733	268	1.0142	0.6714	1.0142	1.0071
No log	3.6	270	1.1065	0.6345	1.1065	1.0519
No log	3.6267	272	1.1752	0.6133	1.1752	1.0841
No log	3.6533	274	1.3280	0.6380	1.3280	1.1524
No log	3.68	276	1.2490	0.6375	1.2490	1.1176
No log	3.7067	278	1.0836	0.5957	1.0836	1.0410
No log	3.7333	280	1.0125	0.6232	1.0125	1.0062
No log	3.76	282	1.0194	0.6241	1.0194	1.0097
No log	3.7867	284	1.0839	0.6584	1.0839	1.0411
No log	3.8133	286	1.2929	0.6279	1.2929	1.1370
No log	3.84	288	1.3836	0.6235	1.3836	1.1763
No log	3.8667	290	1.2300	0.6258	1.2300	1.1091
No log	3.8933	292	0.9993	0.6331	0.9993	0.9996
No log	3.92	294	0.8884	0.6364	0.8884	0.9425
No log	3.9467	296	0.8348	0.6364	0.8348	0.9137
No log	3.9733	298	0.7968	0.6525	0.7968	0.8926
No log	4.0	300	0.7907	0.6892	0.7907	0.8892
No log	4.0267	302	0.8393	0.6887	0.8393	0.9162
No log	4.0533	304	0.8224	0.6803	0.8224	0.9069
No log	4.08	306	0.8453	0.6809	0.8453	0.9194
No log	4.1067	308	0.9443	0.6471	0.9443	0.9717
No log	4.1333	310	1.1526	0.6099	1.1526	1.0736
No log	4.16	312	1.2928	0.5931	1.2928	1.1370
No log	4.1867	314	1.2973	0.6111	1.2973	1.1390
No log	4.2133	316	1.1761	0.6047	1.1761	1.0845
No log	4.24	318	1.0156	0.6667	1.0156	1.0078
No log	4.2667	320	0.9182	0.6519	0.9182	0.9582
No log	4.2933	322	0.8699	0.6434	0.8699	0.9327
No log	4.32	324	0.9482	0.6824	0.9482	0.9737
No log	4.3467	326	0.8760	0.6706	0.8760	0.9359
No log	4.3733	328	0.7450	0.7355	0.7450	0.8632
No log	4.4	330	0.7312	0.7133	0.7312	0.8551
No log	4.4267	332	0.7891	0.6569	0.7891	0.8883
No log	4.4533	334	0.8552	0.6423	0.8552	0.9248
No log	4.48	336	0.8545	0.6423	0.8545	0.9244
No log	4.5067	338	0.9514	0.6522	0.9514	0.9754
No log	4.5333	340	1.0154	0.6338	1.0154	1.0077
No log	4.5600	342	1.0191	0.6301	1.0191	1.0095
No log	4.5867	344	1.0419	0.6581	1.0419	1.0207
No log	4.6133	346	1.0525	0.6543	1.0525	1.0259
No log	4.64	348	1.0788	0.6548	1.0788	1.0387
No log	4.6667	350	1.0346	0.6587	1.0346	1.0172
No log	4.6933	352	0.9744	0.6708	0.9744	0.9871
No log	4.72	354	0.9126	0.6573	0.9126	0.9553
No log	4.7467	356	0.8955	0.6712	0.8955	0.9463
No log	4.7733	358	0.8219	0.6846	0.8219	0.9066
No log	4.8	360	0.8547	0.6909	0.8547	0.9245
No log	4.8267	362	0.8212	0.7089	0.8212	0.9062
No log	4.8533	364	0.8515	0.6918	0.8515	0.9228
No log	4.88	366	0.8398	0.6711	0.8398	0.9164
No log	4.9067	368	0.8405	0.6571	0.8405	0.9168
No log	4.9333	370	0.8735	0.6567	0.8735	0.9346
No log	4.96	372	0.9412	0.6316	0.9412	0.9702
No log	4.9867	374	0.9029	0.6567	0.9029	0.9502
No log	5.0133	376	0.8636	0.6567	0.8636	0.9293
No log	5.04	378	0.9010	0.6569	0.9010	0.9492
No log	5.0667	380	1.0178	0.6456	1.0178	1.0089
No log	5.0933	382	1.1909	0.6441	1.1909	1.0913
No log	5.12	384	1.1999	0.6590	1.1999	1.0954
No log	5.1467	386	1.2847	0.6374	1.2847	1.1334
No log	5.1733	388	1.1295	0.6707	1.1295	1.0628
No log	5.2	390	0.9931	0.6531	0.9931	0.9965
No log	5.2267	392	0.9041	0.6519	0.9041	0.9509
No log	5.2533	394	0.8938	0.6667	0.8938	0.9454
No log	5.28	396	0.9675	0.6324	0.9675	0.9836
No log	5.3067	398	0.9576	0.6331	0.9576	0.9786
No log	5.3333	400	0.9202	0.6519	0.9202	0.9592
No log	5.36	402	1.0023	0.6522	1.0023	1.0012
No log	5.3867	404	1.0835	0.6351	1.0835	1.0409
No log	5.4133	406	1.1082	0.6316	1.1082	1.0527
No log	5.44	408	1.1270	0.6452	1.1270	1.0616
No log	5.4667	410	0.9487	0.6667	0.9487	0.9740
No log	5.4933	412	0.8774	0.6667	0.8774	0.9367
No log	5.52	414	0.8424	0.6357	0.8424	0.9178
No log	5.5467	416	0.8237	0.6462	0.8237	0.9076
No log	5.5733	418	0.8512	0.6815	0.8512	0.9226
No log	5.6	420	0.9649	0.6839	0.9649	0.9823
No log	5.6267	422	1.1245	0.6824	1.1245	1.0604
No log	5.6533	424	1.1819	0.6667	1.1819	1.0872
No log	5.68	426	0.9884	0.72	0.9884	0.9942
No log	5.7067	428	0.8079	0.7239	0.8079	0.8988
No log	5.7333	430	0.7595	0.7114	0.7595	0.8715
No log	5.76	432	0.7661	0.6993	0.7661	0.8752
No log	5.7867	434	0.8374	0.6806	0.8374	0.9151
No log	5.8133	436	0.9518	0.6757	0.9518	0.9756
No log	5.84	438	1.0416	0.6216	1.0416	1.0206
No log	5.8667	440	0.9815	0.6143	0.9815	0.9907
No log	5.8933	442	0.8454	0.6815	0.8454	0.9195
No log	5.92	444	0.7453	0.6716	0.7453	0.8633
No log	5.9467	446	0.7158	0.7143	0.7158	0.8460
No log	5.9733	448	0.7510	0.7105	0.7510	0.8666
No log	6.0	450	0.8081	0.7143	0.8081	0.8990
No log	6.0267	452	0.9622	0.6784	0.9622	0.9809
No log	6.0533	454	0.9881	0.6784	0.9881	0.9940
No log	6.08	456	0.8970	0.6667	0.8970	0.9471
No log	6.1067	458	0.8423	0.6122	0.8423	0.9178
No log	6.1333	460	0.8363	0.6667	0.8363	0.9145
No log	6.16	462	0.8839	0.6087	0.8839	0.9401
No log	6.1867	464	0.8670	0.6316	0.8670	0.9311
No log	6.2133	466	0.8267	0.6515	0.8267	0.9092
No log	6.24	468	0.8251	0.6515	0.8251	0.9084
No log	6.2667	470	0.8844	0.6232	0.8844	0.9404
No log	6.2933	472	0.9627	0.6625	0.9627	0.9811
No log	6.32	474	0.8659	0.6994	0.8659	0.9305
No log	6.3467	476	0.7522	0.6887	0.7522	0.8673
No log	6.3733	478	0.6782	0.7429	0.6782	0.8235
No log	6.4	480	0.6779	0.75	0.6779	0.8233
No log	6.4267	482	0.6716	0.7101	0.6716	0.8195
No log	6.4533	484	0.7177	0.6753	0.7177	0.8472
No log	6.48	486	0.8461	0.7093	0.8461	0.9198
No log	6.5067	488	0.8771	0.7093	0.8771	0.9365
No log	6.5333	490	0.8551	0.7013	0.8551	0.9247
No log	6.5600	492	0.8704	0.6370	0.8704	0.9329
No log	6.5867	494	0.8790	0.6370	0.8790	0.9376
No log	6.6133	496	0.8815	0.6528	0.8815	0.9389
No log	6.64	498	0.8984	0.6286	0.8984	0.9478
0.3994	6.6667	500	0.9893	0.6528	0.9893	0.9946
0.3994	6.6933	502	1.0074	0.6383	1.0074	1.0037
0.3994	6.72	504	1.0355	0.6154	1.0355	1.0176
0.3994	6.7467	506	0.9736	0.6483	0.9736	0.9867
0.3994	6.7733	508	0.9824	0.6486	0.9824	0.9912
0.3994	6.8	510	1.0654	0.6667	1.0654	1.0322
0.3994	6.8267	512	1.1340	0.6867	1.1340	1.0649
0.3994	6.8533	514	1.0399	0.6832	1.0399	1.0197
0.3994	6.88	516	0.9217	0.6483	0.9217	0.9601
0.3994	6.9067	518	0.8927	0.6331	0.8927	0.9448
0.3994	6.9333	520	0.8352	0.6571	0.8352	0.9139
0.3994	6.96	522	0.7899	0.6809	0.7899	0.8888
0.3994	6.9867	524	0.7931	0.6667	0.7931	0.8906
0.3994	7.0133	526	0.8459	0.6711	0.8459	0.9197
0.3994	7.04	528	1.0011	0.6909	1.0011	1.0005
0.3994	7.0667	530	1.0277	0.6909	1.0277	1.0137
0.3994	7.0933	532	1.0156	0.6667	1.0156	1.0078
0.3994	7.12	534	0.9228	0.6621	0.9228	0.9606
0.3994	7.1467	536	0.7986	0.6957	0.7986	0.8936
0.3994	7.1733	538	0.7947	0.6767	0.7947	0.8915
0.3994	7.2	540	0.8324	0.6906	0.8324	0.9124
0.3994	7.2267	542	0.8850	0.6479	0.8850	0.9408
0.3994	7.2533	544	0.9470	0.6667	0.9470	0.9731
0.3994	7.28	546	0.8715	0.6933	0.8715	0.9336
0.3994	7.3067	548	0.7596	0.7237	0.7596	0.8715
0.3994	7.3333	550	0.6945	0.7383	0.6945	0.8333
0.3994	7.36	552	0.7395	0.7451	0.7395	0.8599
0.3994	7.3867	554	0.8758	0.6957	0.8758	0.9358
0.3994	7.4133	556	1.0618	0.6893	1.0618	1.0304
0.3994	7.44	558	0.9994	0.6977	0.9994	0.9997
0.3994	7.4667	560	0.9515	0.675	0.9515	0.9755
0.3994	7.4933	562	0.9291	0.6839	0.9291	0.9639
0.3994	7.52	564	0.8246	0.6712	0.8246	0.9081
0.3994	7.5467	566	0.7416	0.7042	0.7416	0.8611
0.3994	7.5733	568	0.7260	0.7042	0.7260	0.8520
0.3994	7.6	570	0.7601	0.6573	0.7601	0.8718
0.3994	7.6267	572	0.8184	0.6968	0.8184	0.9047
0.3994	7.6533	574	0.9584	0.6625	0.9584	0.9790
0.3994	7.68	576	0.9674	0.6625	0.9674	0.9835
0.3994	7.7067	578	0.8920	0.6887	0.8920	0.9444
0.3994	7.7333	580	0.7792	0.6712	0.7792	0.8827
0.3994	7.76	582	0.6942	0.7050	0.6942	0.8332
0.3994	7.7867	584	0.6610	0.7397	0.6610	0.8130
0.3994	7.8133	586	0.7164	0.6892	0.7164	0.8464
0.3994	7.84	588	0.8348	0.7059	0.8348	0.9137
0.3994	7.8667	590	1.0212	0.6579	1.0212	1.0105
0.3994	7.8933	592	1.0514	0.6338	1.0514	1.0254
0.3994	7.92	594	0.9808	0.6471	0.9808	0.9903
0.3994	7.9467	596	0.8731	0.6364	0.8731	0.9344
0.3994	7.9733	598	0.8297	0.6767	0.8297	0.9109
0.3994	8.0	600	0.8191	0.6912	0.8191	0.9051
0.3994	8.0267	602	0.8094	0.6912	0.8094	0.8996
0.3994	8.0533	604	0.7649	0.7007	0.7649	0.8746
0.3994	8.08	606	0.7698	0.6713	0.7698	0.8774
0.3994	8.1067	608	0.8035	0.6712	0.8035	0.8964
0.3994	8.1333	610	0.8827	0.6883	0.8827	0.9395
0.3994	8.16	612	0.9922	0.6988	0.9922	0.9961
0.3994	8.1867	614	1.1632	0.6127	1.1632	1.0785
0.3994	8.2133	616	1.1961	0.6	1.1961	1.0937
0.3994	8.24	618	1.0847	0.6277	1.0847	1.0415
0.3994	8.2667	620	0.9617	0.6412	0.9617	0.9807
0.3994	8.2933	622	0.9359	0.6565	0.9359	0.9674
0.3994	8.32	624	0.9352	0.6412	0.9352	0.9671
0.3994	8.3467	626	0.9832	0.6370	0.9832	0.9916
0.3994	8.3733	628	1.0969	0.5957	1.0969	1.0473
0.3994	8.4	630	1.1430	0.5946	1.1430	1.0691
0.3994	8.4267	632	1.1408	0.6267	1.1408	1.0681

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1