ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8222
• Qwk: 0.5429
• Mse: 0.8222
• Rmse: 0.9068

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1176	2	4.7663	0.0010	4.7663	2.1832
No log	0.2353	4	2.8495	-0.0104	2.8495	1.6880
No log	0.3529	6	1.5936	0.0504	1.5936	1.2624
No log	0.4706	8	1.3759	0.1198	1.3759	1.1730
No log	0.5882	10	1.2607	0.1145	1.2607	1.1228
No log	0.7059	12	1.2275	0.1076	1.2275	1.1079
No log	0.8235	14	1.3571	0.2539	1.3571	1.1649
No log	0.9412	16	1.3356	0.2615	1.3356	1.1557
No log	1.0588	18	1.1606	0.2640	1.1606	1.0773
No log	1.1765	20	1.0760	0.2971	1.0760	1.0373
No log	1.2941	22	1.0793	0.2850	1.0793	1.0389
No log	1.4118	24	1.0870	0.4449	1.0870	1.0426
No log	1.5294	26	1.1198	0.375	1.1198	1.0582
No log	1.6471	28	0.9682	0.4650	0.9682	0.9840
No log	1.7647	30	0.9490	0.4917	0.9490	0.9741
No log	1.8824	32	0.8519	0.5645	0.8519	0.9230
No log	2.0	34	1.2631	0.4353	1.2631	1.1239
No log	2.1176	36	1.5313	0.3403	1.5313	1.2375
No log	2.2353	38	1.2494	0.4310	1.2494	1.1178
No log	2.3529	40	0.7557	0.5671	0.7557	0.8693
No log	2.4706	42	0.8325	0.5451	0.8325	0.9124
No log	2.5882	44	0.7513	0.5089	0.7513	0.8668
No log	2.7059	46	0.9953	0.4228	0.9953	0.9977
No log	2.8235	48	1.6332	0.2376	1.6332	1.2780
No log	2.9412	50	1.5719	0.2440	1.5719	1.2538
No log	3.0588	52	0.9864	0.3791	0.9864	0.9932
No log	3.1765	54	0.7923	0.5547	0.7923	0.8901
No log	3.2941	56	0.9823	0.5286	0.9823	0.9911
No log	3.4118	58	0.9057	0.5249	0.9057	0.9517
No log	3.5294	60	0.8178	0.6358	0.8178	0.9043
No log	3.6471	62	0.8700	0.5794	0.8700	0.9328
No log	3.7647	64	0.9371	0.5617	0.9371	0.9681
No log	3.8824	66	0.7709	0.5905	0.7709	0.8780
No log	4.0	68	0.7270	0.6809	0.7270	0.8526
No log	4.1176	70	0.6977	0.6918	0.6977	0.8353
No log	4.2353	72	0.6680	0.6682	0.6680	0.8173
No log	4.3529	74	0.6777	0.5540	0.6777	0.8232
No log	4.4706	76	0.7423	0.5853	0.7423	0.8616
No log	4.5882	78	0.6795	0.6192	0.6795	0.8243
No log	4.7059	80	0.7448	0.6944	0.7448	0.8630
No log	4.8235	82	0.9746	0.5455	0.9746	0.9872
No log	4.9412	84	1.1238	0.4758	1.1238	1.0601
No log	5.0588	86	0.9298	0.5547	0.9298	0.9642
No log	5.1765	88	0.7223	0.5959	0.7223	0.8499
No log	5.2941	90	0.7391	0.5524	0.7391	0.8597
No log	5.4118	92	0.8494	0.5372	0.8494	0.9216
No log	5.5294	94	0.7479	0.5524	0.7479	0.8648
No log	5.6471	96	0.7373	0.5964	0.7373	0.8587
No log	5.7647	98	0.8722	0.5553	0.8722	0.9339
No log	5.8824	100	0.8294	0.6068	0.8294	0.9107
No log	6.0	102	0.7466	0.6563	0.7466	0.8641
No log	6.1176	104	0.7685	0.5666	0.7685	0.8766
No log	6.2353	106	0.7728	0.5265	0.7728	0.8791
No log	6.3529	108	0.7898	0.6140	0.7898	0.8887
No log	6.4706	110	0.8176	0.5075	0.8176	0.9042
No log	6.5882	112	0.8288	0.5019	0.8288	0.9104
No log	6.7059	114	0.7877	0.5272	0.7877	0.8875
No log	6.8235	116	0.9298	0.5393	0.9298	0.9643
No log	6.9412	118	0.9042	0.5493	0.9042	0.9509
No log	7.0588	120	0.7999	0.5367	0.7999	0.8944
No log	7.1765	122	0.9633	0.5279	0.9633	0.9815
No log	7.2941	124	1.1440	0.4561	1.1440	1.0696
No log	7.4118	126	1.0109	0.5417	1.0109	1.0054
No log	7.5294	128	0.8073	0.5500	0.8073	0.8985
No log	7.6471	130	0.8032	0.5470	0.8032	0.8962
No log	7.7647	132	1.0095	0.4377	1.0095	1.0047
No log	7.8824	134	1.0626	0.4186	1.0626	1.0308
No log	8.0	136	0.8988	0.5775	0.8988	0.9480
No log	8.1176	138	0.7838	0.5962	0.7838	0.8853
No log	8.2353	140	0.8545	0.6537	0.8545	0.9244
No log	8.3529	142	0.9121	0.5981	0.9121	0.9550
No log	8.4706	144	0.8770	0.6305	0.8770	0.9365
No log	8.5882	146	0.7041	0.6461	0.7041	0.8391
No log	8.7059	148	0.6983	0.5979	0.6983	0.8357
No log	8.8235	150	0.7768	0.6295	0.7768	0.8813
No log	8.9412	152	0.8170	0.6162	0.8170	0.9039
No log	9.0588	154	0.7647	0.6162	0.7647	0.8744
No log	9.1765	156	0.6924	0.5963	0.6924	0.8321
No log	9.2941	158	0.6892	0.5988	0.6892	0.8302
No log	9.4118	160	0.6855	0.5997	0.6855	0.8279
No log	9.5294	162	0.6925	0.6120	0.6925	0.8321
No log	9.6471	164	0.8477	0.5911	0.8477	0.9207
No log	9.7647	166	0.9067	0.5547	0.9067	0.9522
No log	9.8824	168	0.8344	0.5614	0.8344	0.9134
No log	10.0	170	0.7199	0.6436	0.7199	0.8485
No log	10.1176	172	0.6976	0.6525	0.6976	0.8352
No log	10.2353	174	0.7369	0.5996	0.7369	0.8584
No log	10.3529	176	0.7162	0.6110	0.7162	0.8463
No log	10.4706	178	0.6938	0.5968	0.6938	0.8329
No log	10.5882	180	0.7236	0.5819	0.7236	0.8507
No log	10.7059	182	0.8221	0.5395	0.8221	0.9067
No log	10.8235	184	0.8862	0.4702	0.8862	0.9414
No log	10.9412	186	0.7917	0.5918	0.7917	0.8898
No log	11.0588	188	0.7170	0.5637	0.7170	0.8467
No log	11.1765	190	0.6641	0.5866	0.6641	0.8149
No log	11.2941	192	0.6786	0.6151	0.6786	0.8238
No log	11.4118	194	0.6828	0.6389	0.6828	0.8263
No log	11.5294	196	0.7058	0.5590	0.7058	0.8401
No log	11.6471	198	0.7288	0.5144	0.7288	0.8537
No log	11.7647	200	0.7190	0.4826	0.7190	0.8480
No log	11.8824	202	0.7151	0.5504	0.7151	0.8456
No log	12.0	204	0.7438	0.6089	0.7438	0.8624
No log	12.1176	206	0.8278	0.5827	0.8278	0.9098
No log	12.2353	208	0.7817	0.5871	0.7817	0.8841
No log	12.3529	210	0.7499	0.5895	0.7499	0.8660
No log	12.4706	212	0.7979	0.5106	0.7979	0.8933
No log	12.5882	214	0.8356	0.5325	0.8356	0.9141
No log	12.7059	216	0.8169	0.5339	0.8169	0.9038
No log	12.8235	218	0.8507	0.6071	0.8507	0.9224
No log	12.9412	220	1.0289	0.5405	1.0289	1.0144
No log	13.0588	222	1.0962	0.5473	1.0962	1.0470
No log	13.1765	224	0.9941	0.5646	0.9941	0.9971
No log	13.2941	226	0.9277	0.5677	0.9277	0.9632
No log	13.4118	228	0.8988	0.5534	0.8988	0.9480
No log	13.5294	230	0.9037	0.5444	0.9037	0.9507
No log	13.6471	232	0.9293	0.5301	0.9293	0.9640
No log	13.7647	234	0.9081	0.5312	0.9081	0.9529
No log	13.8824	236	0.8316	0.5658	0.8316	0.9119
No log	14.0	238	0.8106	0.5223	0.8106	0.9004
No log	14.1176	240	0.8132	0.5204	0.8132	0.9018
No log	14.2353	242	0.8029	0.5037	0.8029	0.8960
No log	14.3529	244	0.8349	0.5444	0.8349	0.9137
No log	14.4706	246	0.8177	0.5872	0.8177	0.9042
No log	14.5882	248	0.8000	0.5633	0.8000	0.8944
No log	14.7059	250	0.7806	0.5657	0.7806	0.8835
No log	14.8235	252	0.7485	0.6107	0.7485	0.8652
No log	14.9412	254	0.7412	0.6176	0.7412	0.8609
No log	15.0588	256	0.7638	0.6223	0.7638	0.8740
No log	15.1765	258	0.7265	0.6356	0.7265	0.8524
No log	15.2941	260	0.7082	0.6263	0.7082	0.8415
No log	15.4118	262	0.7371	0.5789	0.7371	0.8586
No log	15.5294	264	0.7230	0.6288	0.7230	0.8503
No log	15.6471	266	0.7274	0.6450	0.7274	0.8529
No log	15.7647	268	0.7484	0.6067	0.7484	0.8651
No log	15.8824	270	0.8270	0.5819	0.8270	0.9094
No log	16.0	272	0.9060	0.5510	0.9060	0.9519
No log	16.1176	274	0.8714	0.5536	0.8714	0.9335
No log	16.2353	276	0.8286	0.5736	0.8286	0.9103
No log	16.3529	278	0.7735	0.5484	0.7735	0.8795
No log	16.4706	280	0.7633	0.5407	0.7633	0.8736
No log	16.5882	282	0.7678	0.5235	0.7678	0.8762
No log	16.7059	284	0.7646	0.5355	0.7646	0.8744
No log	16.8235	286	0.7675	0.5283	0.7675	0.8761
No log	16.9412	288	0.7645	0.5567	0.7645	0.8744
No log	17.0588	290	0.7639	0.5735	0.7639	0.8740
No log	17.1765	292	0.7732	0.6032	0.7732	0.8793
No log	17.2941	294	0.7565	0.6119	0.7565	0.8698
No log	17.4118	296	0.7561	0.5376	0.7561	0.8695
No log	17.5294	298	0.7650	0.5905	0.7650	0.8746
No log	17.6471	300	0.7407	0.6439	0.7407	0.8607
No log	17.7647	302	0.7359	0.6239	0.7359	0.8578
No log	17.8824	304	0.7170	0.6347	0.7170	0.8468
No log	18.0	306	0.7151	0.6129	0.7151	0.8457
No log	18.1176	308	0.7517	0.6001	0.7518	0.8670
No log	18.2353	310	0.7708	0.5542	0.7708	0.8780
No log	18.3529	312	0.7534	0.5542	0.7534	0.8680
No log	18.4706	314	0.7259	0.5663	0.7259	0.8520
No log	18.5882	316	0.6891	0.6290	0.6891	0.8301
No log	18.7059	318	0.7343	0.6072	0.7343	0.8569
No log	18.8235	320	0.8354	0.4977	0.8354	0.9140
No log	18.9412	322	0.8558	0.4977	0.8558	0.9251
No log	19.0588	324	0.8719	0.4804	0.8719	0.9338
No log	19.1765	326	0.7946	0.5325	0.7946	0.8914
No log	19.2941	328	0.7207	0.6275	0.7207	0.8489
No log	19.4118	330	0.7594	0.6409	0.7594	0.8714
No log	19.5294	332	0.8006	0.5905	0.8006	0.8948
No log	19.6471	334	0.7694	0.6175	0.7694	0.8771
No log	19.7647	336	0.7691	0.4454	0.7691	0.8770
No log	19.8824	338	0.8099	0.5200	0.8099	0.9000
No log	20.0	340	0.8129	0.5200	0.8129	0.9016
No log	20.1176	342	0.7983	0.4699	0.7983	0.8935
No log	20.2353	344	0.7951	0.5137	0.7951	0.8917
No log	20.3529	346	0.8015	0.5769	0.8015	0.8953
No log	20.4706	348	0.8040	0.4760	0.8040	0.8967
No log	20.5882	350	0.8142	0.5039	0.8142	0.9023
No log	20.7059	352	0.8218	0.4774	0.8218	0.9065
No log	20.8235	354	0.8093	0.5172	0.8093	0.8996
No log	20.9412	356	0.7932	0.5407	0.7932	0.8906
No log	21.0588	358	0.8107	0.6203	0.8107	0.9004
No log	21.1765	360	0.8527	0.5934	0.8527	0.9234
No log	21.2941	362	0.8348	0.6071	0.8348	0.9137
No log	21.4118	364	0.7978	0.6332	0.7978	0.8932
No log	21.5294	366	0.8079	0.5522	0.8079	0.8988
No log	21.6471	368	0.8285	0.5568	0.8285	0.9102
No log	21.7647	370	0.8122	0.5545	0.8122	0.9012
No log	21.8824	372	0.8000	0.5522	0.8000	0.8944
No log	22.0	374	0.7928	0.5560	0.7928	0.8904
No log	22.1176	376	0.8108	0.5977	0.8108	0.9004
No log	22.2353	378	0.8392	0.6402	0.8392	0.9161
No log	22.3529	380	0.8294	0.6436	0.8294	0.9107
No log	22.4706	382	0.7909	0.5868	0.7909	0.8893
No log	22.5882	384	0.7923	0.5631	0.7923	0.8901
No log	22.7059	386	0.8643	0.4976	0.8643	0.9297
No log	22.8235	388	0.9088	0.4612	0.9088	0.9533
No log	22.9412	390	0.8434	0.5332	0.8434	0.9184
No log	23.0588	392	0.7607	0.5522	0.7607	0.8722
No log	23.1765	394	0.7789	0.6479	0.7789	0.8825
No log	23.2941	396	0.8789	0.5403	0.8789	0.9375
No log	23.4118	398	0.9447	0.5174	0.9447	0.9719
No log	23.5294	400	0.9032	0.5190	0.9032	0.9504
No log	23.6471	402	0.7840	0.6162	0.7840	0.8855
No log	23.7647	404	0.7085	0.6992	0.7085	0.8417
No log	23.8824	406	0.7315	0.5631	0.7315	0.8553
No log	24.0	408	0.7337	0.5737	0.7337	0.8566
No log	24.1176	410	0.6989	0.5631	0.6989	0.8360
No log	24.2353	412	0.6725	0.6260	0.6725	0.8200
No log	24.3529	414	0.6909	0.6761	0.6909	0.8312
No log	24.4706	416	0.7518	0.5534	0.7518	0.8671
No log	24.5882	418	0.7744	0.5625	0.7744	0.8800
No log	24.7059	420	0.7327	0.5650	0.7327	0.8560
No log	24.8235	422	0.6684	0.7024	0.6684	0.8175
No log	24.9412	424	0.6499	0.6921	0.6499	0.8061
No log	25.0588	426	0.6679	0.6797	0.6679	0.8173
No log	25.1765	428	0.6987	0.6116	0.6987	0.8359
No log	25.2941	430	0.6854	0.6709	0.6854	0.8279
No log	25.4118	432	0.6786	0.7201	0.6786	0.8238
No log	25.5294	434	0.6899	0.6833	0.6899	0.8306
No log	25.6471	436	0.7490	0.6280	0.7490	0.8654
No log	25.7647	438	0.8463	0.5487	0.8463	0.9199
No log	25.8824	440	0.8866	0.5260	0.8866	0.9416
No log	26.0	442	0.8733	0.5575	0.8733	0.9345
No log	26.1176	444	0.8255	0.5487	0.8255	0.9086
No log	26.2353	446	0.7654	0.6076	0.7654	0.8749
No log	26.3529	448	0.7521	0.6429	0.7521	0.8672
No log	26.4706	450	0.7806	0.6490	0.7806	0.8835
No log	26.5882	452	0.7839	0.6517	0.7839	0.8854
No log	26.7059	454	0.7522	0.6647	0.7522	0.8673
No log	26.8235	456	0.7321	0.6172	0.7321	0.8556
No log	26.9412	458	0.7292	0.6074	0.7292	0.8540
No log	27.0588	460	0.7316	0.6074	0.7316	0.8553
No log	27.1765	462	0.7182	0.5889	0.7182	0.8474
No log	27.2941	464	0.7083	0.6659	0.7083	0.8416
No log	27.4118	466	0.7194	0.6251	0.7194	0.8482
No log	27.5294	468	0.7238	0.6468	0.7238	0.8508
No log	27.6471	470	0.7155	0.6468	0.7155	0.8459
No log	27.7647	472	0.7036	0.6575	0.7036	0.8388
No log	27.8824	474	0.6916	0.6704	0.6916	0.8316
No log	28.0	476	0.6866	0.6824	0.6866	0.8286
No log	28.1176	478	0.6910	0.6966	0.6910	0.8313
No log	28.2353	480	0.6923	0.6966	0.6923	0.8320
No log	28.3529	482	0.6885	0.6739	0.6885	0.8297
No log	28.4706	484	0.6886	0.7235	0.6886	0.8298
No log	28.5882	486	0.6954	0.6773	0.6954	0.8339
No log	28.7059	488	0.7013	0.6825	0.7013	0.8374
No log	28.8235	490	0.6837	0.6933	0.6837	0.8268
No log	28.9412	492	0.6803	0.6816	0.6803	0.8248
No log	29.0588	494	0.6887	0.6635	0.6887	0.8299
No log	29.1765	496	0.7037	0.6185	0.7037	0.8389
No log	29.2941	498	0.7133	0.6220	0.7133	0.8446
0.2656	29.4118	500	0.7256	0.5870	0.7256	0.8518
0.2656	29.5294	502	0.7279	0.5686	0.7279	0.8532
0.2656	29.6471	504	0.7140	0.5961	0.7140	0.8450
0.2656	29.7647	506	0.7198	0.5735	0.7198	0.8484
0.2656	29.8824	508	0.7383	0.6374	0.7383	0.8592
0.2656	30.0	510	0.7473	0.6374	0.7473	0.8645
0.2656	30.1176	512	0.7226	0.6583	0.7226	0.8500
0.2656	30.2353	514	0.7029	0.6260	0.7029	0.8384
0.2656	30.3529	516	0.7124	0.6074	0.7124	0.8441
0.2656	30.4706	518	0.7278	0.6064	0.7278	0.8531
0.2656	30.5882	520	0.7295	0.5608	0.7295	0.8541
0.2656	30.7059	522	0.7257	0.5946	0.7257	0.8519
0.2656	30.8235	524	0.6962	0.6966	0.6962	0.8344
0.2656	30.9412	526	0.6842	0.7235	0.6842	0.8272
0.2656	31.0588	528	0.6744	0.7025	0.6744	0.8212
0.2656	31.1765	530	0.6728	0.6707	0.6728	0.8202
0.2656	31.2941	532	0.6695	0.6981	0.6695	0.8182
0.2656	31.4118	534	0.6633	0.7024	0.6633	0.8144
0.2656	31.5294	536	0.6588	0.7131	0.6588	0.8117
0.2656	31.6471	538	0.6588	0.7344	0.6588	0.8117
0.2656	31.7647	540	0.6566	0.7057	0.6566	0.8103
0.2656	31.8824	542	0.6598	0.6554	0.6598	0.8123
0.2656	32.0	544	0.6819	0.6332	0.6819	0.8258
0.2656	32.1176	546	0.7004	0.6006	0.7004	0.8369
0.2656	32.2353	548	0.6634	0.6419	0.6634	0.8145
0.2656	32.3529	550	0.6391	0.7198	0.6391	0.7994
0.2656	32.4706	552	0.6523	0.6916	0.6523	0.8077
0.2656	32.5882	554	0.6795	0.7007	0.6795	0.8243
0.2656	32.7059	556	0.6746	0.7007	0.6746	0.8213
0.2656	32.8235	558	0.6591	0.6853	0.6591	0.8118
0.2656	32.9412	560	0.6481	0.6981	0.6481	0.8050
0.2656	33.0588	562	0.6561	0.6964	0.6561	0.8100
0.2656	33.1765	564	0.6868	0.6675	0.6868	0.8288
0.2656	33.2941	566	0.7120	0.5881	0.7120	0.8438
0.2656	33.4118	568	0.7464	0.5991	0.7464	0.8639
0.2656	33.5294	570	0.7640	0.5991	0.7640	0.8740
0.2656	33.6471	572	0.7830	0.5954	0.7830	0.8849
0.2656	33.7647	574	0.8153	0.5926	0.8153	0.9029
0.2656	33.8824	576	0.7974	0.5985	0.7974	0.8930
0.2656	34.0	578	0.7352	0.6320	0.7352	0.8575
0.2656	34.1176	580	0.6710	0.6816	0.6710	0.8192
0.2656	34.2353	582	0.6408	0.6921	0.6408	0.8005
0.2656	34.3529	584	0.6472	0.6771	0.6472	0.8045
0.2656	34.4706	586	0.6583	0.6779	0.6583	0.8114
0.2656	34.5882	588	0.6736	0.6539	0.6736	0.8207
0.2656	34.7059	590	0.6943	0.6656	0.6943	0.8333
0.2656	34.8235	592	0.6875	0.6960	0.6875	0.8291
0.2656	34.9412	594	0.6758	0.6960	0.6758	0.8221
0.2656	35.0588	596	0.6712	0.6799	0.6712	0.8193
0.2656	35.1765	598	0.6658	0.6963	0.6658	0.8160
0.2656	35.2941	600	0.6743	0.6963	0.6743	0.8211
0.2656	35.4118	602	0.6770	0.6860	0.6770	0.8228
0.2656	35.5294	604	0.6801	0.6860	0.6801	0.8247
0.2656	35.6471	606	0.6828	0.6893	0.6828	0.8263
0.2656	35.7647	608	0.7063	0.6063	0.7063	0.8404
0.2656	35.8824	610	0.7554	0.5458	0.7554	0.8691
0.2656	36.0	612	0.7944	0.5458	0.7944	0.8913
0.2656	36.1176	614	0.7961	0.5458	0.7961	0.8922
0.2656	36.2353	616	0.7785	0.5433	0.7785	0.8823
0.2656	36.3529	618	0.7535	0.5902	0.7535	0.8681
0.2656	36.4706	620	0.7588	0.5796	0.7588	0.8711
0.2656	36.5882	622	0.7685	0.5796	0.7685	0.8766
0.2656	36.7059	624	0.7808	0.5916	0.7808	0.8836
0.2656	36.8235	626	0.7942	0.5726	0.7942	0.8912
0.2656	36.9412	628	0.8090	0.5226	0.8090	0.8995
0.2656	37.0588	630	0.8132	0.5420	0.8132	0.9018
0.2656	37.1765	632	0.8197	0.5429	0.8197	0.9054
0.2656	37.2941	634	0.8222	0.5429	0.8222	0.9068

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1