ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8929
• Qwk: 0.4282
• Mse: 0.8929
• Rmse: 0.9449

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1538	2	4.6920	0.0010	4.6920	2.1661
No log	0.3077	4	2.8462	0.0193	2.8462	1.6871
No log	0.4615	6	1.8909	-0.0017	1.8909	1.3751
No log	0.6154	8	1.3492	0.0182	1.3492	1.1616
No log	0.7692	10	1.2170	0.1110	1.2170	1.1032
No log	0.9231	12	1.1726	0.2124	1.1726	1.0829
No log	1.0769	14	1.2150	0.1448	1.2150	1.1023
No log	1.2308	16	1.0845	0.2628	1.0845	1.0414
No log	1.3846	18	1.0476	0.2731	1.0476	1.0235
No log	1.5385	20	1.2835	0.1604	1.2835	1.1329
No log	1.6923	22	1.5415	0.0622	1.5415	1.2416
No log	1.8462	24	1.3498	0.0838	1.3498	1.1618
No log	2.0	26	1.1142	0.2378	1.1142	1.0556
No log	2.1538	28	1.0834	0.2155	1.0834	1.0409
No log	2.3077	30	1.0866	0.2111	1.0866	1.0424
No log	2.4615	32	1.1247	0.2532	1.1247	1.0605
No log	2.6154	34	1.2070	0.2543	1.2070	1.0987
No log	2.7692	36	1.3373	0.0362	1.3373	1.1564
No log	2.9231	38	1.1854	0.2058	1.1854	1.0888
No log	3.0769	40	1.0153	0.3565	1.0153	1.0076
No log	3.2308	42	1.1237	0.3380	1.1237	1.0601
No log	3.3846	44	1.2077	0.3595	1.2077	1.0989
No log	3.5385	46	0.9756	0.3268	0.9756	0.9877
No log	3.6923	48	1.1367	0.2780	1.1367	1.0662
No log	3.8462	50	1.7020	0.1747	1.7020	1.3046
No log	4.0	52	1.7128	0.1387	1.7128	1.3087
No log	4.1538	54	1.4436	0.1395	1.4436	1.2015
No log	4.3077	56	1.0273	0.3173	1.0273	1.0136
No log	4.4615	58	0.8932	0.4541	0.8932	0.9451
No log	4.6154	60	0.9132	0.4439	0.9132	0.9556
No log	4.7692	62	1.0518	0.3330	1.0518	1.0256
No log	4.9231	64	1.0580	0.3313	1.0580	1.0286
No log	5.0769	66	0.8914	0.4760	0.8914	0.9441
No log	5.2308	68	0.8262	0.4612	0.8262	0.9089
No log	5.3846	70	0.8235	0.5137	0.8235	0.9074
No log	5.5385	72	0.8124	0.5365	0.8124	0.9013
No log	5.6923	74	0.8171	0.5086	0.8171	0.9039
No log	5.8462	76	0.8100	0.4930	0.8100	0.9000
No log	6.0	78	0.9398	0.4471	0.9398	0.9695
No log	6.1538	80	1.1644	0.2984	1.1644	1.0791
No log	6.3077	82	1.0137	0.4248	1.0137	1.0068
No log	6.4615	84	0.8215	0.4726	0.8215	0.9064
No log	6.6154	86	0.8516	0.4501	0.8516	0.9228
No log	6.7692	88	0.8808	0.4874	0.8808	0.9385
No log	6.9231	90	1.1157	0.4298	1.1157	1.0563
No log	7.0769	92	1.2176	0.3068	1.2176	1.1034
No log	7.2308	94	1.0113	0.3424	1.0113	1.0056
No log	7.3846	96	0.8207	0.4009	0.8207	0.9059
No log	7.5385	98	0.8317	0.4879	0.8317	0.9120
No log	7.6923	100	0.8739	0.4542	0.8739	0.9348
No log	7.8462	102	0.8180	0.5089	0.8180	0.9044
No log	8.0	104	0.8206	0.4847	0.8206	0.9059
No log	8.1538	106	0.8225	0.4724	0.8225	0.9069
No log	8.3077	108	0.8432	0.4325	0.8432	0.9183
No log	8.4615	110	0.8133	0.4966	0.8133	0.9018
No log	8.6154	112	0.8217	0.4777	0.8217	0.9065
No log	8.7692	114	0.8890	0.4948	0.8890	0.9429
No log	8.9231	116	0.9866	0.4755	0.9866	0.9933
No log	9.0769	118	0.8818	0.4948	0.8818	0.9390
No log	9.2308	120	0.8085	0.4835	0.8085	0.8991
No log	9.3846	122	1.0252	0.4422	1.0252	1.0125
No log	9.5385	124	1.0265	0.3744	1.0265	1.0132
No log	9.6923	126	0.8815	0.3840	0.8815	0.9389
No log	9.8462	128	0.9192	0.4093	0.9192	0.9587
No log	10.0	130	1.1302	0.3071	1.1302	1.0631
No log	10.1538	132	1.1708	0.3826	1.1708	1.0820
No log	10.3077	134	0.9832	0.4226	0.9832	0.9916
No log	10.4615	136	0.8235	0.4871	0.8235	0.9074
No log	10.6154	138	0.9147	0.4898	0.9147	0.9564
No log	10.7692	140	0.9099	0.4458	0.9098	0.9539
No log	10.9231	142	0.8082	0.4671	0.8082	0.8990
No log	11.0769	144	0.9351	0.4563	0.9351	0.9670
No log	11.2308	146	1.1605	0.4152	1.1605	1.0772
No log	11.3846	148	1.0609	0.4632	1.0609	1.0300
No log	11.5385	150	0.8300	0.4641	0.8300	0.9111
No log	11.6923	152	0.8093	0.3854	0.8093	0.8996
No log	11.8462	154	0.9048	0.4765	0.9048	0.9512
No log	12.0	156	0.8693	0.4295	0.8693	0.9323
No log	12.1538	158	0.8110	0.5358	0.8110	0.9006
No log	12.3077	160	0.8639	0.4946	0.8639	0.9295
No log	12.4615	162	0.8243	0.5058	0.8243	0.9079
No log	12.6154	164	0.8126	0.4359	0.8126	0.9014
No log	12.7692	166	0.8143	0.4328	0.8143	0.9024
No log	12.9231	168	0.8400	0.4648	0.8400	0.9165
No log	13.0769	170	0.8562	0.4648	0.8562	0.9253
No log	13.2308	172	0.8137	0.4579	0.8137	0.9020
No log	13.3846	174	0.8190	0.4488	0.8190	0.9050
No log	13.5385	176	0.8326	0.4488	0.8326	0.9125
No log	13.6923	178	0.9086	0.5353	0.9086	0.9532
No log	13.8462	180	0.9825	0.4694	0.9825	0.9912
No log	14.0	182	1.0094	0.4694	1.0094	1.0047
No log	14.1538	184	0.9493	0.5353	0.9493	0.9743
No log	14.3077	186	0.8462	0.4397	0.8462	0.9199
No log	14.4615	188	0.8275	0.4965	0.8275	0.9097
No log	14.6154	190	0.8286	0.4757	0.8286	0.9103
No log	14.7692	192	0.8811	0.5154	0.8811	0.9387
No log	14.9231	194	0.9633	0.4394	0.9633	0.9815
No log	15.0769	196	0.9611	0.4598	0.9611	0.9803
No log	15.2308	198	0.8980	0.5164	0.8980	0.9476
No log	15.3846	200	0.8160	0.5041	0.8160	0.9033
No log	15.5385	202	0.8123	0.5477	0.8123	0.9013
No log	15.6923	204	0.8210	0.5455	0.8210	0.9061
No log	15.8462	206	0.8554	0.5730	0.8554	0.9249
No log	16.0	208	0.8745	0.5111	0.8745	0.9352
No log	16.1538	210	0.8515	0.4733	0.8515	0.9228
No log	16.3077	212	0.8334	0.4526	0.8334	0.9129
No log	16.4615	214	0.8040	0.4893	0.8040	0.8967
No log	16.6154	216	0.7976	0.4373	0.7976	0.8931
No log	16.7692	218	0.8093	0.5077	0.8093	0.8996
No log	16.9231	220	0.7636	0.5716	0.7636	0.8738
No log	17.0769	222	0.7589	0.5766	0.7589	0.8711
No log	17.2308	224	0.7613	0.5528	0.7613	0.8725
No log	17.3846	226	0.7646	0.5716	0.7646	0.8744
No log	17.5385	228	0.7789	0.5474	0.7789	0.8826
No log	17.6923	230	0.7980	0.4865	0.7980	0.8933
No log	17.8462	232	0.8109	0.4734	0.8109	0.9005
No log	18.0	234	0.8447	0.4912	0.8447	0.9191
No log	18.1538	236	0.9141	0.4532	0.9141	0.9561
No log	18.3077	238	0.9541	0.4513	0.9541	0.9768
No log	18.4615	240	0.8996	0.4777	0.8996	0.9484
No log	18.6154	242	0.8265	0.4734	0.8265	0.9091
No log	18.7692	244	0.8114	0.5178	0.8114	0.9008
No log	18.9231	246	0.8119	0.5056	0.8119	0.9010
No log	19.0769	248	0.8476	0.4476	0.8476	0.9207
No log	19.2308	250	1.0106	0.3794	1.0106	1.0053
No log	19.3846	252	1.0543	0.3503	1.0543	1.0268
No log	19.5385	254	0.9720	0.3777	0.9720	0.9859
No log	19.6923	256	0.8454	0.4377	0.8454	0.9195
No log	19.8462	258	0.8030	0.5251	0.8030	0.8961
No log	20.0	260	0.8069	0.5961	0.8069	0.8983
No log	20.1538	262	0.8194	0.4953	0.8194	0.9052
No log	20.3077	264	0.9736	0.5360	0.9736	0.9867
No log	20.4615	266	1.1339	0.4215	1.1339	1.0648
No log	20.6154	268	1.1179	0.4022	1.1179	1.0573
No log	20.7692	270	0.9825	0.4166	0.9825	0.9912
No log	20.9231	272	0.8563	0.4584	0.8563	0.9254
No log	21.0769	274	0.8270	0.3998	0.8270	0.9094
No log	21.2308	276	0.8287	0.4482	0.8287	0.9104
No log	21.3846	278	0.8719	0.5030	0.8719	0.9338
No log	21.5385	280	0.8936	0.5014	0.8936	0.9453
No log	21.6923	282	0.9047	0.4553	0.9047	0.9512
No log	21.8462	284	0.8662	0.4983	0.8662	0.9307
No log	22.0	286	0.8136	0.4852	0.8136	0.9020
No log	22.1538	288	0.8224	0.5275	0.8224	0.9068
No log	22.3077	290	0.9177	0.4745	0.9177	0.9580
No log	22.4615	292	0.9125	0.4961	0.9125	0.9552
No log	22.6154	294	0.8201	0.6035	0.8201	0.9056
No log	22.7692	296	0.7927	0.5085	0.7927	0.8903
No log	22.9231	298	0.8062	0.4119	0.8062	0.8979
No log	23.0769	300	0.8315	0.4119	0.8315	0.9119
No log	23.2308	302	0.8298	0.3873	0.8298	0.9109
No log	23.3846	304	0.8106	0.4258	0.8106	0.9003
No log	23.5385	306	0.8098	0.5213	0.8098	0.8999
No log	23.6923	308	0.8510	0.5161	0.8510	0.9225
No log	23.8462	310	0.8759	0.4916	0.8759	0.9359
No log	24.0	312	0.8689	0.5161	0.8689	0.9322
No log	24.1538	314	0.8627	0.4498	0.8627	0.9288
No log	24.3077	316	0.8574	0.4406	0.8574	0.9260
No log	24.4615	318	0.8239	0.4635	0.8239	0.9077
No log	24.6154	320	0.8018	0.4079	0.8018	0.8954
No log	24.7692	322	0.8322	0.4700	0.8322	0.9122
No log	24.9231	324	0.8963	0.5111	0.8963	0.9467
No log	25.0769	326	0.9550	0.4127	0.9550	0.9772
No log	25.2308	328	0.9459	0.3891	0.9459	0.9726
No log	25.3846	330	0.9240	0.3463	0.9240	0.9612
No log	25.5385	332	0.8968	0.4243	0.8968	0.9470
No log	25.6923	334	0.8641	0.3674	0.8641	0.9296
No log	25.8462	336	0.8336	0.4455	0.8336	0.9130
No log	26.0	338	0.8172	0.4620	0.8172	0.9040
No log	26.1538	340	0.8263	0.4700	0.8263	0.9090
No log	26.3077	342	0.8525	0.4799	0.8525	0.9233
No log	26.4615	344	0.8626	0.4799	0.8626	0.9287
No log	26.6154	346	0.8558	0.4700	0.8558	0.9251
No log	26.7692	348	0.8309	0.4948	0.8309	0.9115
No log	26.9231	350	0.8053	0.4637	0.8053	0.8974
No log	27.0769	352	0.8062	0.4540	0.8062	0.8979
No log	27.2308	354	0.8128	0.4948	0.8128	0.9015
No log	27.3846	356	0.8389	0.4700	0.8389	0.9159
No log	27.5385	358	0.8422	0.4916	0.8422	0.9177
No log	27.6923	360	0.8371	0.4916	0.8371	0.9149
No log	27.8462	362	0.8141	0.5154	0.8141	0.9023
No log	28.0	364	0.8156	0.5167	0.8156	0.9031
No log	28.1538	366	0.8278	0.5132	0.8278	0.9098
No log	28.3077	368	0.8069	0.5675	0.8069	0.8983
No log	28.4615	370	0.8560	0.4916	0.8560	0.9252
No log	28.6154	372	0.9683	0.3941	0.9683	0.9840
No log	28.7692	374	1.0042	0.3941	1.0042	1.0021
No log	28.9231	376	0.9767	0.4297	0.9767	0.9883
No log	29.0769	378	0.9324	0.4722	0.9324	0.9656
No log	29.2308	380	0.9093	0.4077	0.9093	0.9536
No log	29.3846	382	0.8833	0.4397	0.8833	0.9399
No log	29.5385	384	0.8434	0.4393	0.8434	0.9183
No log	29.6923	386	0.8026	0.5308	0.8026	0.8959
No log	29.8462	388	0.7799	0.4965	0.7799	0.8831
No log	30.0	390	0.8026	0.4796	0.8026	0.8959
No log	30.1538	392	0.8256	0.4648	0.8256	0.9086
No log	30.3077	394	0.8411	0.4648	0.8411	0.9171
No log	30.4615	396	0.8334	0.5362	0.8334	0.9129
No log	30.6154	398	0.8225	0.4243	0.8225	0.9069
No log	30.7692	400	0.8225	0.3779	0.8225	0.9069
No log	30.9231	402	0.8212	0.4077	0.8212	0.9062
No log	31.0769	404	0.8106	0.3896	0.8106	0.9003
No log	31.2308	406	0.8002	0.4181	0.8002	0.8946
No log	31.3846	408	0.7910	0.4662	0.7910	0.8894
No log	31.5385	410	0.7852	0.4789	0.7852	0.8861
No log	31.6923	412	0.7853	0.4871	0.7853	0.8862
No log	31.8462	414	0.7872	0.4871	0.7872	0.8873
No log	32.0	416	0.8106	0.4799	0.8106	0.9003
No log	32.1538	418	0.8628	0.5014	0.8628	0.9289
No log	32.3077	420	0.8597	0.4799	0.8597	0.9272
No log	32.4615	422	0.8362	0.3994	0.8362	0.9144
No log	32.6154	424	0.8479	0.4498	0.8479	0.9208
No log	32.7692	426	0.8748	0.4469	0.8748	0.9353
No log	32.9231	428	0.8589	0.4469	0.8589	0.9268
No log	33.0769	430	0.8118	0.4847	0.8118	0.9010
No log	33.2308	432	0.8139	0.4865	0.8139	0.9022
No log	33.3846	434	0.8342	0.4946	0.8342	0.9133
No log	33.5385	436	0.8454	0.4611	0.8454	0.9194
No log	33.6923	438	0.8440	0.3896	0.8440	0.9187
No log	33.8462	440	0.8378	0.3896	0.8378	0.9153
No log	34.0	442	0.8329	0.3896	0.8329	0.9126
No log	34.1538	444	0.8205	0.4548	0.8205	0.9058
No log	34.3077	446	0.8073	0.4609	0.8073	0.8985
No log	34.4615	448	0.8200	0.4848	0.8200	0.9056
No log	34.6154	450	0.8381	0.5102	0.8381	0.9155
No log	34.7692	452	0.8546	0.5037	0.8546	0.9245
No log	34.9231	454	0.8510	0.5133	0.8510	0.9225
No log	35.0769	456	0.8807	0.4829	0.8807	0.9384
No log	35.2308	458	0.8673	0.4676	0.8673	0.9313
No log	35.3846	460	0.8412	0.4476	0.8412	0.9172
No log	35.5385	462	0.8313	0.3938	0.8313	0.9117
No log	35.6923	464	0.8492	0.4381	0.8492	0.9215
No log	35.8462	466	0.8753	0.4824	0.8753	0.9356
No log	36.0	468	0.8898	0.4928	0.8898	0.9433
No log	36.1538	470	0.8956	0.4943	0.8956	0.9464
No log	36.3077	472	0.8721	0.3734	0.8721	0.9339
No log	36.4615	474	0.8545	0.4180	0.8545	0.9244
No log	36.6154	476	0.8406	0.4491	0.8406	0.9168
No log	36.7692	478	0.8385	0.5024	0.8385	0.9157
No log	36.9231	480	0.8323	0.5299	0.8323	0.9123
No log	37.0769	482	0.8284	0.4902	0.8284	0.9102
No log	37.2308	484	0.8423	0.4521	0.8423	0.9178
No log	37.3846	486	0.8520	0.4612	0.8520	0.9231
No log	37.5385	488	0.8502	0.4313	0.8502	0.9220
No log	37.6923	490	0.8618	0.4220	0.8618	0.9283
No log	37.8462	492	0.8700	0.4220	0.8700	0.9327
No log	38.0	494	0.8838	0.4036	0.8838	0.9401
No log	38.1538	496	0.9050	0.4450	0.9050	0.9513
No log	38.3077	498	0.9382	0.4302	0.9382	0.9686
0.2769	38.4615	500	0.9272	0.4532	0.9272	0.9629
0.2769	38.6154	502	0.8735	0.4898	0.8735	0.9346
0.2769	38.7692	504	0.8368	0.4996	0.8368	0.9148
0.2769	38.9231	506	0.8307	0.5178	0.8307	0.9114
0.2769	39.0769	508	0.8380	0.4489	0.8380	0.9154
0.2769	39.2308	510	0.8343	0.4575	0.8343	0.9134
0.2769	39.3846	512	0.8257	0.5364	0.8257	0.9087
0.2769	39.5385	514	0.8275	0.5119	0.8275	0.9096
0.2769	39.6923	516	0.8358	0.5184	0.8358	0.9142
0.2769	39.8462	518	0.8509	0.4239	0.8509	0.9225
0.2769	40.0	520	0.8599	0.4700	0.8599	0.9273
0.2769	40.1538	522	0.8538	0.4700	0.8538	0.9240
0.2769	40.3077	524	0.8440	0.4002	0.8440	0.9187
0.2769	40.4615	526	0.8427	0.4454	0.8427	0.9180
0.2769	40.6154	528	0.8487	0.4607	0.8487	0.9213
0.2769	40.7692	530	0.8393	0.4607	0.8393	0.9161
0.2769	40.9231	532	0.8233	0.4812	0.8233	0.9073
0.2769	41.0769	534	0.8154	0.5299	0.8154	0.9030
0.2769	41.2308	536	0.8135	0.4789	0.8135	0.9019
0.2769	41.3846	538	0.8208	0.4401	0.8208	0.9060
0.2769	41.5385	540	0.8259	0.4789	0.8259	0.9088
0.2769	41.6923	542	0.8409	0.4885	0.8409	0.9170
0.2769	41.8462	544	0.8750	0.3942	0.8750	0.9354
0.2769	42.0	546	0.9166	0.4214	0.9166	0.9574
0.2769	42.1538	548	0.9240	0.4115	0.9240	0.9613
0.2769	42.3077	550	0.8970	0.3846	0.8970	0.9471
0.2769	42.4615	552	0.8687	0.5009	0.8687	0.9321
0.2769	42.6154	554	0.8653	0.4450	0.8653	0.9302
0.2769	42.7692	556	0.8843	0.4241	0.8843	0.9404
0.2769	42.9231	558	0.8961	0.4434	0.8961	0.9466
0.2769	43.0769	560	0.8974	0.3854	0.8974	0.9473
0.2769	43.2308	562	0.8929	0.4282	0.8929	0.9449

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1