ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7906
• Qwk: 0.5541
• Mse: 0.7906
• Rmse: 0.8892

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	4.5996	0.0163	4.5997	2.1447
No log	0.6667	4	3.0606	-0.0641	3.0606	1.7494
No log	1.0	6	1.7605	0.0504	1.7605	1.3268
No log	1.3333	8	1.3136	0.0225	1.3136	1.1461
No log	1.6667	10	1.2152	0.1278	1.2152	1.1024
No log	2.0	12	1.1979	0.1814	1.1979	1.0945
No log	2.3333	14	1.1866	0.1314	1.1866	1.0893
No log	2.6667	16	1.2055	0.2010	1.2055	1.0980
No log	3.0	18	1.3435	0.0898	1.3435	1.1591
No log	3.3333	20	1.4209	0.0898	1.4209	1.1920
No log	3.6667	22	1.2996	0.1314	1.2996	1.1400
No log	4.0	24	1.1009	0.2439	1.1009	1.0492
No log	4.3333	26	1.0029	0.4008	1.0029	1.0014
No log	4.6667	28	1.0017	0.3693	1.0017	1.0008
No log	5.0	30	1.0506	0.3056	1.0506	1.0250
No log	5.3333	32	1.1353	0.2916	1.1353	1.0655
No log	5.6667	34	1.0806	0.3142	1.0806	1.0395
No log	6.0	36	1.0268	0.2581	1.0268	1.0133
No log	6.3333	38	0.9982	0.4699	0.9982	0.9991
No log	6.6667	40	1.0312	0.3648	1.0312	1.0155
No log	7.0	42	1.0058	0.4596	1.0058	1.0029
No log	7.3333	44	0.9747	0.4763	0.9747	0.9872
No log	7.6667	46	0.9644	0.4230	0.9644	0.9820
No log	8.0	48	0.9358	0.5531	0.9358	0.9674
No log	8.3333	50	1.0560	0.5685	1.0560	1.0276
No log	8.6667	52	0.8886	0.5170	0.8886	0.9426
No log	9.0	54	0.7991	0.5746	0.7991	0.8939
No log	9.3333	56	0.8383	0.5513	0.8383	0.9156
No log	9.6667	58	0.7924	0.5598	0.7924	0.8901
No log	10.0	60	0.9639	0.5537	0.9639	0.9818
No log	10.3333	62	0.9812	0.5464	0.9812	0.9905
No log	10.6667	64	0.9596	0.5855	0.9596	0.9796
No log	11.0	66	0.9297	0.5323	0.9297	0.9642
No log	11.3333	68	0.8948	0.5009	0.8948	0.9459
No log	11.6667	70	0.8729	0.5624	0.8729	0.9343
No log	12.0	72	0.8940	0.5398	0.8940	0.9455
No log	12.3333	74	0.8074	0.5914	0.8074	0.8986
No log	12.6667	76	0.8165	0.6073	0.8165	0.9036
No log	13.0	78	0.8297	0.6073	0.8297	0.9109
No log	13.3333	80	0.7700	0.5635	0.7700	0.8775
No log	13.6667	82	0.8006	0.5370	0.8006	0.8947
No log	14.0	84	0.8068	0.5251	0.8068	0.8982
No log	14.3333	86	0.7750	0.5376	0.7750	0.8804
No log	14.6667	88	0.7646	0.5395	0.7646	0.8744
No log	15.0	90	0.8051	0.5227	0.8051	0.8973
No log	15.3333	92	0.7946	0.5345	0.7946	0.8914
No log	15.6667	94	0.7757	0.5669	0.7757	0.8807
No log	16.0	96	0.7938	0.5300	0.7938	0.8910
No log	16.3333	98	0.8084	0.5105	0.8084	0.8991
No log	16.6667	100	0.8623	0.5151	0.8623	0.9286
No log	17.0	102	0.9123	0.4677	0.9123	0.9552
No log	17.3333	104	0.8712	0.4829	0.8712	0.9334
No log	17.6667	106	0.8439	0.4681	0.8439	0.9187
No log	18.0	108	0.8617	0.4945	0.8617	0.9283
No log	18.3333	110	0.8875	0.4760	0.8875	0.9421
No log	18.6667	112	0.9072	0.4823	0.9072	0.9525
No log	19.0	114	1.0373	0.5149	1.0373	1.0185
No log	19.3333	116	1.0533	0.5375	1.0533	1.0263
No log	19.6667	118	1.0933	0.5571	1.0933	1.0456
No log	20.0	120	0.9296	0.5411	0.9296	0.9641
No log	20.3333	122	0.8614	0.5690	0.8614	0.9281
No log	20.6667	124	0.8099	0.6140	0.8099	0.9000
No log	21.0	126	0.7892	0.5806	0.7892	0.8884
No log	21.3333	128	0.8150	0.5788	0.8150	0.9028
No log	21.6667	130	0.8123	0.5814	0.8123	0.9013
No log	22.0	132	0.7540	0.5315	0.7540	0.8683
No log	22.3333	134	0.7567	0.5336	0.7567	0.8699
No log	22.6667	136	0.7723	0.5530	0.7723	0.8788
No log	23.0	138	0.8013	0.5971	0.8013	0.8952
No log	23.3333	140	0.8848	0.5185	0.8848	0.9407
No log	23.6667	142	0.8856	0.5218	0.8856	0.9410
No log	24.0	144	0.8305	0.5390	0.8305	0.9113
No log	24.3333	146	0.8122	0.5621	0.8122	0.9012
No log	24.6667	148	0.8135	0.5711	0.8135	0.9020
No log	25.0	150	0.8407	0.5324	0.8407	0.9169
No log	25.3333	152	0.8835	0.5337	0.8835	0.9399
No log	25.6667	154	0.8987	0.5025	0.8987	0.9480
No log	26.0	156	0.8944	0.4996	0.8944	0.9457
No log	26.3333	158	0.8608	0.5254	0.8608	0.9278
No log	26.6667	160	0.8494	0.5370	0.8494	0.9217
No log	27.0	162	0.8192	0.5864	0.8192	0.9051
No log	27.3333	164	0.7584	0.5791	0.7584	0.8709
No log	27.6667	166	0.7966	0.5275	0.7966	0.8925
No log	28.0	168	0.7813	0.5846	0.7813	0.8839
No log	28.3333	170	0.7730	0.6289	0.7730	0.8792
No log	28.6667	172	0.8424	0.5601	0.8424	0.9178
No log	29.0	174	1.0091	0.5547	1.0091	1.0046
No log	29.3333	176	1.0706	0.5356	1.0706	1.0347
No log	29.6667	178	0.9428	0.5626	0.9428	0.9710
No log	30.0	180	0.8741	0.5345	0.8741	0.9349
No log	30.3333	182	0.8315	0.5345	0.8315	0.9119
No log	30.6667	184	0.7957	0.5588	0.7957	0.8920
No log	31.0	186	0.7982	0.5588	0.7982	0.8934
No log	31.3333	188	0.8218	0.5269	0.8218	0.9065
No log	31.6667	190	0.8305	0.5161	0.8305	0.9113
No log	32.0	192	0.8872	0.5394	0.8872	0.9419
No log	32.3333	194	0.9238	0.5170	0.9238	0.9611
No log	32.6667	196	0.8837	0.5517	0.8837	0.9400
No log	33.0	198	0.8403	0.5094	0.8403	0.9167
No log	33.3333	200	0.8440	0.5744	0.8440	0.9187
No log	33.6667	202	0.8242	0.5561	0.8242	0.9079
No log	34.0	204	0.8115	0.5426	0.8115	0.9008
No log	34.3333	206	0.8173	0.5279	0.8173	0.9040
No log	34.6667	208	0.8549	0.5301	0.8549	0.9246
No log	35.0	210	0.8920	0.5385	0.8920	0.9445
No log	35.3333	212	0.8237	0.5685	0.8237	0.9076
No log	35.6667	214	0.7626	0.5432	0.7626	0.8733
No log	36.0	216	0.7486	0.5961	0.7486	0.8652
No log	36.3333	218	0.7577	0.5621	0.7577	0.8705
No log	36.6667	220	0.7757	0.6129	0.7757	0.8807
No log	37.0	222	0.8209	0.5996	0.8209	0.9060
No log	37.3333	224	0.9118	0.5493	0.9118	0.9549
No log	37.6667	226	0.9057	0.5847	0.9057	0.9517
No log	38.0	228	0.8229	0.5814	0.8229	0.9071
No log	38.3333	230	0.7588	0.5248	0.7588	0.8711
No log	38.6667	232	0.7470	0.5507	0.7470	0.8643
No log	39.0	234	0.7509	0.5931	0.7509	0.8665
No log	39.3333	236	0.7654	0.5511	0.7654	0.8749
No log	39.6667	238	0.8039	0.5753	0.8039	0.8966
No log	40.0	240	0.8394	0.5706	0.8394	0.9162
No log	40.3333	242	0.8746	0.5578	0.8746	0.9352
No log	40.6667	244	0.8251	0.5541	0.8251	0.9083
No log	41.0	246	0.7860	0.5798	0.7860	0.8866
No log	41.3333	248	0.7711	0.5951	0.7711	0.8781
No log	41.6667	250	0.7636	0.5647	0.7636	0.8738
No log	42.0	252	0.7677	0.5541	0.7677	0.8762
No log	42.3333	254	0.8233	0.5495	0.8233	0.9073
No log	42.6667	256	0.8368	0.5495	0.8368	0.9148
No log	43.0	258	0.8035	0.5788	0.8035	0.8964
No log	43.3333	260	0.7728	0.5869	0.7728	0.8791
No log	43.6667	262	0.7666	0.5969	0.7666	0.8756
No log	44.0	264	0.7587	0.5944	0.7587	0.8710
No log	44.3333	266	0.7499	0.5951	0.7499	0.8660
No log	44.6667	268	0.7552	0.6047	0.7552	0.8690
No log	45.0	270	0.7956	0.5892	0.7956	0.8920
No log	45.3333	272	0.8001	0.5928	0.8001	0.8945
No log	45.6667	274	0.7883	0.6119	0.7883	0.8879
No log	46.0	276	0.7964	0.6367	0.7964	0.8924
No log	46.3333	278	0.8535	0.5455	0.8535	0.9238
No log	46.6667	280	0.8624	0.5455	0.8624	0.9286
No log	47.0	282	0.8137	0.5666	0.8137	0.9021
No log	47.3333	284	0.8007	0.6021	0.8007	0.8948
No log	47.6667	286	0.8179	0.5541	0.8179	0.9044
No log	48.0	288	0.8272	0.5434	0.8272	0.9095
No log	48.3333	290	0.8109	0.5541	0.8109	0.9005
No log	48.6667	292	0.8179	0.5385	0.8179	0.9044
No log	49.0	294	0.8251	0.5611	0.8251	0.9084
No log	49.3333	296	0.8369	0.5769	0.8369	0.9148
No log	49.6667	298	0.8377	0.5611	0.8377	0.9152
No log	50.0	300	0.8310	0.5554	0.8310	0.9116
No log	50.3333	302	0.8183	0.5554	0.8183	0.9046
No log	50.6667	304	0.8048	0.5713	0.8048	0.8971
No log	51.0	306	0.7971	0.5305	0.7971	0.8928
No log	51.3333	308	0.8131	0.5068	0.8131	0.9017
No log	51.6667	310	0.8119	0.5068	0.8119	0.9011
No log	52.0	312	0.7984	0.5305	0.7984	0.8935
No log	52.3333	314	0.7939	0.5815	0.7939	0.8910
No log	52.6667	316	0.8192	0.5280	0.8192	0.9051
No log	53.0	318	0.8324	0.5382	0.8324	0.9124
No log	53.3333	320	0.8305	0.5556	0.8305	0.9113
No log	53.6667	322	0.8521	0.5690	0.8521	0.9231
No log	54.0	324	0.8616	0.5947	0.8616	0.9282
No log	54.3333	326	0.8513	0.5589	0.8513	0.9227
No log	54.6667	328	0.8362	0.5989	0.8362	0.9145
No log	55.0	330	0.8287	0.5477	0.8287	0.9103
No log	55.3333	332	0.8127	0.5679	0.8127	0.9015
No log	55.6667	334	0.7894	0.5484	0.7894	0.8885
No log	56.0	336	0.7810	0.4939	0.7810	0.8838
No log	56.3333	338	0.7881	0.5110	0.7881	0.8878
No log	56.6667	340	0.7936	0.5563	0.7936	0.8908
No log	57.0	342	0.8130	0.5624	0.8130	0.9017
No log	57.3333	344	0.8081	0.5624	0.8081	0.8989
No log	57.6667	346	0.7714	0.5305	0.7714	0.8783
No log	58.0	348	0.7560	0.5824	0.7560	0.8695
No log	58.3333	350	0.7654	0.5634	0.7654	0.8748
No log	58.6667	352	0.7625	0.5880	0.7625	0.8732
No log	59.0	354	0.7471	0.6119	0.7471	0.8643
No log	59.3333	356	0.7428	0.5997	0.7428	0.8619
No log	59.6667	358	0.7461	0.5659	0.7461	0.8638
No log	60.0	360	0.7581	0.5479	0.7581	0.8707
No log	60.3333	362	0.7709	0.5370	0.7709	0.8780
No log	60.6667	364	0.7890	0.5370	0.7890	0.8883
No log	61.0	366	0.8034	0.5261	0.8034	0.8963
No log	61.3333	368	0.8052	0.5541	0.8052	0.8973
No log	61.6667	370	0.7988	0.5541	0.7988	0.8937
No log	62.0	372	0.8009	0.5420	0.8009	0.8949
No log	62.3333	374	0.8038	0.5420	0.8038	0.8966
No log	62.6667	376	0.7989	0.5527	0.7989	0.8938
No log	63.0	378	0.7940	0.5841	0.7940	0.8911
No log	63.3333	380	0.7896	0.5841	0.7896	0.8886
No log	63.6667	382	0.7914	0.5958	0.7914	0.8896
No log	64.0	384	0.8000	0.6224	0.8000	0.8944
No log	64.3333	386	0.7927	0.5958	0.7927	0.8903
No log	64.6667	388	0.7848	0.5781	0.7848	0.8859
No log	65.0	390	0.7710	0.5980	0.7710	0.8780
No log	65.3333	392	0.7601	0.5856	0.7601	0.8718
No log	65.6667	394	0.7736	0.5779	0.7736	0.8795
No log	66.0	396	0.7943	0.5434	0.7943	0.8912
No log	66.3333	398	0.8142	0.5947	0.8142	0.9023
No log	66.6667	400	0.8134	0.5659	0.8134	0.9019
No log	67.0	402	0.7914	0.5788	0.7914	0.8896
No log	67.3333	404	0.7587	0.5501	0.7587	0.8710
No log	67.6667	406	0.7518	0.5856	0.7518	0.8671
No log	68.0	408	0.7570	0.5856	0.7570	0.8701
No log	68.3333	410	0.7642	0.5523	0.7642	0.8742
No log	68.6667	412	0.7727	0.5501	0.7727	0.8790
No log	69.0	414	0.7706	0.5501	0.7706	0.8779
No log	69.3333	416	0.7697	0.5746	0.7697	0.8773
No log	69.6667	418	0.7731	0.5658	0.7731	0.8793
No log	70.0	420	0.7789	0.5746	0.7789	0.8825
No log	70.3333	422	0.7878	0.5611	0.7878	0.8876
No log	70.6667	424	0.7953	0.5194	0.7953	0.8918
No log	71.0	426	0.7988	0.5194	0.7988	0.8938
No log	71.3333	428	0.8030	0.5635	0.8030	0.8961
No log	71.6667	430	0.8165	0.5611	0.8165	0.9036
No log	72.0	432	0.8268	0.5635	0.8268	0.9093
No log	72.3333	434	0.8354	0.5367	0.8354	0.9140
No log	72.6667	436	0.8390	0.5395	0.8390	0.9160
No log	73.0	438	0.8327	0.5395	0.8327	0.9125
No log	73.3333	440	0.8240	0.5655	0.8240	0.9077
No log	73.6667	442	0.8199	0.5533	0.8199	0.9055
No log	74.0	444	0.8225	0.5194	0.8225	0.9069
No log	74.3333	446	0.8303	0.5601	0.8303	0.9112
No log	74.6667	448	0.8251	0.5601	0.8251	0.9084
No log	75.0	450	0.8139	0.5434	0.8139	0.9022
No log	75.3333	452	0.8064	0.5370	0.8064	0.8980
No log	75.6667	454	0.7953	0.5400	0.7953	0.8918
No log	76.0	456	0.7936	0.5529	0.7936	0.8909
No log	76.3333	458	0.7972	0.5633	0.7972	0.8928
No log	76.6667	460	0.7989	0.5633	0.7989	0.8938
No log	77.0	462	0.8030	0.5354	0.8030	0.8961
No log	77.3333	464	0.8134	0.5531	0.8134	0.9019
No log	77.6667	466	0.8269	0.5747	0.8269	0.9094
No log	78.0	468	0.8324	0.5896	0.8324	0.9124
No log	78.3333	470	0.8257	0.5844	0.8257	0.9087
No log	78.6667	472	0.8164	0.5690	0.8164	0.9035
No log	79.0	474	0.8044	0.5815	0.8044	0.8969
No log	79.3333	476	0.7946	0.5815	0.7946	0.8914
No log	79.6667	478	0.7824	0.5815	0.7824	0.8845
No log	80.0	480	0.7707	0.5951	0.7707	0.8779
No log	80.3333	482	0.7644	0.5766	0.7644	0.8743
No log	80.6667	484	0.7613	0.5683	0.7613	0.8725
No log	81.0	486	0.7568	0.5997	0.7568	0.8699
No log	81.3333	488	0.7569	0.5997	0.7569	0.8700
No log	81.6667	490	0.7588	0.5885	0.7588	0.8711
No log	82.0	492	0.7650	0.5587	0.7650	0.8746
No log	82.3333	494	0.7669	0.5587	0.7669	0.8757
No log	82.6667	496	0.7728	0.5370	0.7728	0.8791
No log	83.0	498	0.7805	0.5370	0.7805	0.8835
0.2215	83.3333	500	0.7856	0.5370	0.7856	0.8864
0.2215	83.6667	502	0.7894	0.5370	0.7894	0.8885
0.2215	84.0	504	0.7959	0.5706	0.7959	0.8921
0.2215	84.3333	506	0.7959	0.5706	0.7959	0.8921
0.2215	84.6667	508	0.7943	0.5370	0.7943	0.8912
0.2215	85.0	510	0.7948	0.5370	0.7948	0.8915
0.2215	85.3333	512	0.7902	0.5370	0.7902	0.8889
0.2215	85.6667	514	0.7840	0.5370	0.7840	0.8854
0.2215	86.0	516	0.7823	0.5479	0.7823	0.8845
0.2215	86.3333	518	0.7818	0.5229	0.7818	0.8842
0.2215	86.6667	520	0.7814	0.5337	0.7814	0.8839
0.2215	87.0	522	0.7783	0.5529	0.7783	0.8822
0.2215	87.3333	524	0.7761	0.5531	0.7761	0.8809
0.2215	87.6667	526	0.7752	0.5531	0.7752	0.8805
0.2215	88.0	528	0.7770	0.5337	0.7770	0.8815
0.2215	88.3333	530	0.7801	0.5506	0.7801	0.8832
0.2215	88.6667	532	0.7840	0.5753	0.7840	0.8854
0.2215	89.0	534	0.7842	0.5647	0.7842	0.8856
0.2215	89.3333	536	0.7855	0.5541	0.7855	0.8863
0.2215	89.6667	538	0.7858	0.5541	0.7858	0.8864
0.2215	90.0	540	0.7857	0.5647	0.7857	0.8864
0.2215	90.3333	542	0.7852	0.5370	0.7852	0.8861
0.2215	90.6667	544	0.7863	0.5541	0.7863	0.8867
0.2215	91.0	546	0.7859	0.5541	0.7859	0.8865
0.2215	91.3333	548	0.7863	0.5541	0.7863	0.8867
0.2215	91.6667	550	0.7866	0.5541	0.7866	0.8869
0.2215	92.0	552	0.7875	0.5541	0.7875	0.8874
0.2215	92.3333	554	0.7916	0.5541	0.7916	0.8897
0.2215	92.6667	556	0.7934	0.5541	0.7934	0.8907
0.2215	93.0	558	0.7948	0.5706	0.7948	0.8915
0.2215	93.3333	560	0.7961	0.5601	0.7961	0.8922
0.2215	93.6667	562	0.7962	0.5706	0.7962	0.8923
0.2215	94.0	564	0.7983	0.5706	0.7983	0.8935
0.2215	94.3333	566	0.8015	0.5706	0.8015	0.8953
0.2215	94.6667	568	0.8049	0.5601	0.8049	0.8972
0.2215	95.0	570	0.8059	0.5601	0.8059	0.8977
0.2215	95.3333	572	0.8056	0.5706	0.8056	0.8976
0.2215	95.6667	574	0.8063	0.5706	0.8063	0.8979
0.2215	96.0	576	0.8049	0.5706	0.8049	0.8972
0.2215	96.3333	578	0.8035	0.5706	0.8035	0.8964
0.2215	96.6667	580	0.8006	0.5706	0.8006	0.8948
0.2215	97.0	582	0.7996	0.5706	0.7996	0.8942
0.2215	97.3333	584	0.7985	0.5706	0.7985	0.8936
0.2215	97.6667	586	0.7973	0.5706	0.7973	0.8929
0.2215	98.0	588	0.7962	0.5706	0.7962	0.8923
0.2215	98.3333	590	0.7949	0.5706	0.7949	0.8916
0.2215	98.6667	592	0.7933	0.5541	0.7933	0.8907
0.2215	99.0	594	0.7919	0.5541	0.7919	0.8899
0.2215	99.3333	596	0.7911	0.5541	0.7911	0.8894
0.2215	99.6667	598	0.7908	0.5541	0.7908	0.8893
0.2215	100.0	600	0.7906	0.5541	0.7906	0.8892

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1