ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8463
• Qwk: 0.4242
• Mse: 0.8463
• Rmse: 0.9199

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	4.6611	-0.0132	4.6611	2.1590
No log	0.4444	4	2.8839	-0.0233	2.8839	1.6982
No log	0.6667	6	1.6576	0.0372	1.6576	1.2875
No log	0.8889	8	1.5754	0.0372	1.5754	1.2551
No log	1.1111	10	1.2487	0.2278	1.2487	1.1175
No log	1.3333	12	1.1588	0.2142	1.1588	1.0765
No log	1.5556	14	1.1591	0.1482	1.1591	1.0766
No log	1.7778	16	1.1665	0.3663	1.1665	1.0800
No log	2.0	18	1.2615	0.0776	1.2615	1.1232
No log	2.2222	20	1.2770	0.0838	1.2770	1.1300
No log	2.4444	22	1.3426	0.0426	1.3426	1.1587
No log	2.6667	24	1.2832	0.0512	1.2832	1.1328
No log	2.8889	26	1.2647	0.0838	1.2647	1.1246
No log	3.1111	28	1.1501	0.2886	1.1501	1.0724
No log	3.3333	30	1.1653	0.1935	1.1653	1.0795
No log	3.5556	32	1.1212	0.2991	1.1212	1.0588
No log	3.7778	34	1.1653	0.1136	1.1653	1.0795
No log	4.0	36	1.4015	0.2112	1.4015	1.1838
No log	4.2222	38	1.4656	0.2471	1.4656	1.2106
No log	4.4444	40	1.2101	0.2242	1.2101	1.1001
No log	4.6667	42	1.0996	0.2709	1.0996	1.0486
No log	4.8889	44	1.0924	0.4031	1.0924	1.0452
No log	5.1111	46	1.2047	0.2772	1.2047	1.0976
No log	5.3333	48	1.1399	0.3256	1.1399	1.0677
No log	5.5556	50	1.0694	0.2877	1.0694	1.0341
No log	5.7778	52	1.1973	0.2368	1.1973	1.0942
No log	6.0	54	1.2785	0.3006	1.2785	1.1307
No log	6.2222	56	1.1825	0.3716	1.1825	1.0874
No log	6.4444	58	1.0231	0.4660	1.0231	1.0115
No log	6.6667	60	1.0184	0.4515	1.0184	1.0092
No log	6.8889	62	0.9606	0.4835	0.9606	0.9801
No log	7.1111	64	1.1235	0.4384	1.1235	1.0600
No log	7.3333	66	1.2295	0.3605	1.2295	1.1088
No log	7.5556	68	0.9477	0.5011	0.9477	0.9735
No log	7.7778	70	1.0520	0.4988	1.0520	1.0257
No log	8.0	72	1.1078	0.4758	1.1078	1.0525
No log	8.2222	74	0.9455	0.3779	0.9455	0.9723
No log	8.4444	76	0.9336	0.4982	0.9336	0.9662
No log	8.6667	78	0.9588	0.5131	0.9588	0.9792
No log	8.8889	80	0.9487	0.4982	0.9487	0.9740
No log	9.1111	82	0.9485	0.4747	0.9485	0.9739
No log	9.3333	84	0.9952	0.4630	0.9952	0.9976
No log	9.5556	86	0.9488	0.4847	0.9488	0.9741
No log	9.7778	88	1.0591	0.4554	1.0591	1.0291
No log	10.0	90	1.1812	0.4035	1.1812	1.0868
No log	10.2222	92	0.9458	0.4832	0.9458	0.9725
No log	10.4444	94	1.0657	0.4534	1.0657	1.0323
No log	10.6667	96	0.9813	0.4088	0.9813	0.9906
No log	10.8889	98	0.9574	0.4848	0.9574	0.9785
No log	11.1111	100	1.1947	0.3792	1.1947	1.0930
No log	11.3333	102	1.0234	0.4866	1.0234	1.0116
No log	11.5556	104	0.8565	0.4728	0.8565	0.9255
No log	11.7778	106	0.8909	0.4201	0.8909	0.9439
No log	12.0	108	0.9674	0.4368	0.9674	0.9836
No log	12.2222	110	0.9211	0.4201	0.9211	0.9597
No log	12.4444	112	0.9117	0.5216	0.9117	0.9548
No log	12.6667	114	0.9818	0.4964	0.9818	0.9909
No log	12.8889	116	0.9258	0.4002	0.9258	0.9622
No log	13.1111	118	0.9643	0.4166	0.9643	0.9820
No log	13.3333	120	0.9723	0.4378	0.9723	0.9860
No log	13.5556	122	0.8968	0.4076	0.8968	0.9470
No log	13.7778	124	0.8852	0.3892	0.8852	0.9409
No log	14.0	126	0.8653	0.3631	0.8653	0.9302
No log	14.2222	128	0.8949	0.4919	0.8949	0.9460
No log	14.4444	130	0.8766	0.3631	0.8766	0.9362
No log	14.6667	132	0.8889	0.3211	0.8889	0.9428
No log	14.8889	134	0.9460	0.4255	0.9460	0.9726
No log	15.1111	136	1.0380	0.4758	1.0380	1.0188
No log	15.3333	138	0.9529	0.4003	0.9529	0.9762
No log	15.5556	140	0.8934	0.3237	0.8934	0.9452
No log	15.7778	142	0.9012	0.3652	0.9012	0.9493
No log	16.0	144	0.9298	0.2972	0.9298	0.9642
No log	16.2222	146	1.0336	0.4405	1.0336	1.0166
No log	16.4444	148	1.0257	0.4186	1.0257	1.0127
No log	16.6667	150	0.9556	0.3073	0.9556	0.9775
No log	16.8889	152	0.9076	0.3270	0.9076	0.9527
No log	17.1111	154	0.9002	0.3478	0.9002	0.9488
No log	17.3333	156	0.9580	0.3887	0.9580	0.9788
No log	17.5556	158	0.9879	0.4302	0.9879	0.9939
No log	17.7778	160	1.0064	0.4487	1.0064	1.0032
No log	18.0	162	0.9450	0.4289	0.9450	0.9721
No log	18.2222	164	0.8992	0.4050	0.8992	0.9483
No log	18.4444	166	0.8944	0.4768	0.8944	0.9457
No log	18.6667	168	0.8998	0.3191	0.8998	0.9486
No log	18.8889	170	0.9619	0.3667	0.9619	0.9808
No log	19.1111	172	0.9843	0.3409	0.9843	0.9921
No log	19.3333	174	0.9326	0.3186	0.9326	0.9657
No log	19.5556	176	0.9152	0.3165	0.9152	0.9567
No log	19.7778	178	0.9446	0.3667	0.9446	0.9719
No log	20.0	180	0.9584	0.3945	0.9584	0.9790
No log	20.2222	182	0.9138	0.4699	0.9138	0.9559
No log	20.4444	184	0.9338	0.4699	0.9338	0.9663
No log	20.6667	186	0.9288	0.4370	0.9288	0.9637
No log	20.8889	188	0.9425	0.4022	0.9425	0.9708
No log	21.1111	190	1.0175	0.4508	1.0175	1.0087
No log	21.3333	192	1.0035	0.4098	1.0035	1.0017
No log	21.5556	194	0.9134	0.3165	0.9134	0.9557
No log	21.7778	196	0.8695	0.3380	0.8695	0.9324
No log	22.0	198	0.8556	0.3819	0.8556	0.9250
No log	22.2222	200	0.8638	0.4401	0.8638	0.9294
No log	22.4444	202	0.8865	0.5256	0.8865	0.9416
No log	22.6667	204	0.8794	0.5256	0.8794	0.9377
No log	22.8889	206	0.8814	0.4694	0.8814	0.9388
No log	23.1111	208	0.9086	0.4131	0.9086	0.9532
No log	23.3333	210	0.8783	0.4165	0.8783	0.9372
No log	23.5556	212	0.8660	0.3936	0.8660	0.9306
No log	23.7778	214	0.8383	0.4318	0.8383	0.9156
No log	24.0	216	0.8450	0.5327	0.8450	0.9192
No log	24.2222	218	0.8516	0.5322	0.8516	0.9228
No log	24.4444	220	0.9234	0.4638	0.9234	0.9609
No log	24.6667	222	1.0707	0.4498	1.0707	1.0347
No log	24.8889	224	1.0682	0.4328	1.0682	1.0335
No log	25.1111	226	0.9777	0.4638	0.9777	0.9888
No log	25.3333	228	0.9215	0.4572	0.9215	0.9600
No log	25.5556	230	0.9103	0.3412	0.9103	0.9541
No log	25.7778	232	0.9325	0.3716	0.9325	0.9656
No log	26.0	234	1.0316	0.4007	1.0316	1.0157
No log	26.2222	236	1.1597	0.3537	1.1597	1.0769
No log	26.4444	238	1.1979	0.3025	1.1979	1.0945
No log	26.6667	240	1.1384	0.3771	1.1384	1.0670
No log	26.8889	242	1.0326	0.3954	1.0326	1.0162
No log	27.1111	244	0.9750	0.3042	0.9750	0.9874
No log	27.3333	246	0.9924	0.3486	0.9924	0.9962
No log	27.5556	248	0.9785	0.3486	0.9785	0.9892
No log	27.7778	250	0.9502	0.3506	0.9502	0.9748
No log	28.0	252	0.9541	0.3979	0.9541	0.9768
No log	28.2222	254	0.9311	0.3874	0.9311	0.9649
No log	28.4444	256	0.9100	0.4405	0.9100	0.9539
No log	28.6667	258	0.8910	0.4534	0.8910	0.9439
No log	28.8889	260	0.8799	0.4143	0.8799	0.9380
No log	29.1111	262	0.8787	0.4948	0.8787	0.9374
No log	29.3333	264	0.8723	0.5431	0.8723	0.9339
No log	29.5556	266	0.8658	0.5184	0.8658	0.9305
No log	29.7778	268	0.8717	0.4820	0.8717	0.9336
No log	30.0	270	0.8959	0.3936	0.8959	0.9465
No log	30.2222	272	0.9424	0.3478	0.9424	0.9708
No log	30.4444	274	0.9511	0.3349	0.9511	0.9753
No log	30.6667	276	0.9358	0.3478	0.9358	0.9673
No log	30.8889	278	0.9585	0.3528	0.9585	0.9791
No log	31.1111	280	0.9313	0.4375	0.9313	0.9650
No log	31.3333	282	0.8775	0.4934	0.8775	0.9368
No log	31.5556	284	0.8761	0.5439	0.8761	0.9360
No log	31.7778	286	0.8901	0.5376	0.8901	0.9434
No log	32.0	288	0.8742	0.5370	0.8742	0.9350
No log	32.2222	290	0.8787	0.5259	0.8787	0.9374
No log	32.4444	292	0.9219	0.4166	0.9219	0.9601
No log	32.6667	294	0.9052	0.4293	0.9052	0.9514
No log	32.8889	296	0.8734	0.4429	0.8734	0.9346
No log	33.1111	298	0.8688	0.4429	0.8688	0.9321
No log	33.3333	300	0.8541	0.3998	0.8541	0.9242
No log	33.5556	302	0.8639	0.4356	0.8639	0.9294
No log	33.7778	304	0.8632	0.4512	0.8632	0.9291
No log	34.0	306	0.8767	0.4587	0.8767	0.9363
No log	34.2222	308	0.8926	0.4747	0.8926	0.9448
No log	34.4444	310	0.9064	0.4747	0.9064	0.9521
No log	34.6667	312	0.9136	0.4454	0.9136	0.9558
No log	34.8889	314	0.9290	0.4237	0.9290	0.9638
No log	35.1111	316	0.9472	0.3771	0.9472	0.9733
No log	35.3333	318	0.9602	0.3756	0.9602	0.9799
No log	35.5556	320	0.9882	0.3854	0.9882	0.9941
No log	35.7778	322	1.0122	0.3860	1.0122	1.0061
No log	36.0	324	1.0493	0.3390	1.0493	1.0244
No log	36.2222	326	1.0546	0.3830	1.0546	1.0269
No log	36.4444	328	1.0530	0.4166	1.0530	1.0262
No log	36.6667	330	1.0218	0.4289	1.0218	1.0108
No log	36.8889	332	0.9642	0.4236	0.9642	0.9819
No log	37.1111	334	0.9246	0.4871	0.9246	0.9615
No log	37.3333	336	0.9092	0.4996	0.9092	0.9535
No log	37.5556	338	0.8935	0.4996	0.8935	0.9452
No log	37.7778	340	0.8846	0.5220	0.8846	0.9405
No log	38.0	342	0.9031	0.4435	0.9031	0.9503
No log	38.2222	344	0.9317	0.4390	0.9317	0.9653
No log	38.4444	346	0.9181	0.4470	0.9181	0.9582
No log	38.6667	348	0.9131	0.4563	0.9131	0.9556
No log	38.8889	350	0.8705	0.4412	0.8705	0.9330
No log	39.1111	352	0.8828	0.4615	0.8828	0.9396
No log	39.3333	354	0.9004	0.4372	0.9004	0.9489
No log	39.5556	356	0.8847	0.4490	0.8847	0.9406
No log	39.7778	358	0.8564	0.4840	0.8564	0.9254
No log	40.0	360	0.8512	0.5562	0.8512	0.9226
No log	40.2222	362	0.8679	0.5756	0.8679	0.9316
No log	40.4444	364	0.8708	0.5220	0.8708	0.9332
No log	40.6667	366	0.8883	0.5094	0.8883	0.9425
No log	40.8889	368	0.8745	0.4812	0.8745	0.9351
No log	41.1111	370	0.8602	0.4601	0.8602	0.9275
No log	41.3333	372	0.8731	0.4527	0.8731	0.9344
No log	41.5556	374	0.8520	0.4726	0.8520	0.9230
No log	41.7778	376	0.8385	0.4318	0.8385	0.9157
No log	42.0	378	0.8642	0.3931	0.8642	0.9296
No log	42.2222	380	0.8963	0.3762	0.8963	0.9467
No log	42.4444	382	0.8780	0.3667	0.8780	0.9370
No log	42.6667	384	0.8511	0.4031	0.8511	0.9225
No log	42.8889	386	0.8346	0.3970	0.8346	0.9135
No log	43.1111	388	0.8272	0.5043	0.8272	0.9095
No log	43.3333	390	0.8326	0.5287	0.8326	0.9125
No log	43.5556	392	0.8658	0.4646	0.8658	0.9305
No log	43.7778	394	0.8809	0.4829	0.8809	0.9385
No log	44.0	396	0.8605	0.5152	0.8605	0.9277
No log	44.2222	398	0.8454	0.5895	0.8454	0.9195
No log	44.4444	400	0.8407	0.5735	0.8407	0.9169
No log	44.6667	402	0.8403	0.4996	0.8403	0.9167
No log	44.8889	404	0.8563	0.4293	0.8563	0.9254
No log	45.1111	406	0.9045	0.3908	0.9045	0.9510
No log	45.3333	408	0.9366	0.3918	0.9366	0.9678
No log	45.5556	410	0.9469	0.3918	0.9469	0.9731
No log	45.7778	412	0.9396	0.3918	0.9396	0.9693
No log	46.0	414	0.9205	0.3913	0.9205	0.9594
No log	46.2222	416	0.9123	0.4257	0.9123	0.9552
No log	46.4444	418	0.9131	0.4257	0.9131	0.9555
No log	46.6667	420	0.8921	0.4257	0.8921	0.9445
No log	46.8889	422	0.8797	0.3866	0.8797	0.9379
No log	47.1111	424	0.8440	0.4889	0.8440	0.9187
No log	47.3333	426	0.8312	0.5596	0.8312	0.9117
No log	47.5556	428	0.8292	0.5359	0.8292	0.9106
No log	47.7778	430	0.8283	0.4907	0.8283	0.9101
No log	48.0	432	0.8224	0.5259	0.8224	0.9069
No log	48.2222	434	0.8131	0.4757	0.8131	0.9017
No log	48.4444	436	0.8112	0.4768	0.8112	0.9007
No log	48.6667	438	0.8187	0.4628	0.8187	0.9048
No log	48.8889	440	0.8380	0.5259	0.8380	0.9154
No log	49.1111	442	0.8658	0.4889	0.8658	0.9305
No log	49.3333	444	0.8979	0.3954	0.8979	0.9476
No log	49.5556	446	0.9236	0.4167	0.9236	0.9610
No log	49.7778	448	0.9064	0.4078	0.9064	0.9520
No log	50.0	450	0.8743	0.4690	0.8743	0.9350
No log	50.2222	452	0.8569	0.4724	0.8569	0.9257
No log	50.4444	454	0.8561	0.4505	0.8561	0.9253
No log	50.6667	456	0.8680	0.4820	0.8680	0.9317
No log	50.8889	458	0.8854	0.4690	0.8854	0.9410
No log	51.1111	460	0.9136	0.4034	0.9136	0.9558
No log	51.3333	462	0.9078	0.4295	0.9078	0.9528
No log	51.5556	464	0.8764	0.4295	0.8764	0.9362
No log	51.7778	466	0.8573	0.4595	0.8573	0.9259
No log	52.0	468	0.8533	0.4377	0.8533	0.9238
No log	52.2222	470	0.8567	0.4377	0.8567	0.9256
No log	52.4444	472	0.8580	0.4377	0.8580	0.9263
No log	52.6667	474	0.8638	0.4241	0.8638	0.9294
No log	52.8889	476	0.8784	0.3602	0.8784	0.9372
No log	53.1111	478	0.8743	0.3506	0.8743	0.9350
No log	53.3333	480	0.8680	0.4240	0.8680	0.9317
No log	53.5556	482	0.8558	0.4240	0.8558	0.9251
No log	53.7778	484	0.8419	0.4646	0.8419	0.9175
No log	54.0	486	0.8339	0.5027	0.8339	0.9132
No log	54.2222	488	0.8246	0.4884	0.8246	0.9081
No log	54.4444	490	0.8277	0.4373	0.8277	0.9098
No log	54.6667	492	0.8480	0.5201	0.8480	0.9209
No log	54.8889	494	0.8600	0.5201	0.8600	0.9273
No log	55.1111	496	0.8660	0.5374	0.8660	0.9306
No log	55.3333	498	0.8761	0.5014	0.8761	0.9360
0.2541	55.5556	500	0.8824	0.5014	0.8824	0.9394
0.2541	55.7778	502	0.8809	0.5014	0.8809	0.9386
0.2541	56.0	504	0.8721	0.4840	0.8721	0.9339
0.2541	56.2222	506	0.8711	0.4202	0.8711	0.9333
0.2541	56.4444	508	0.8525	0.4470	0.8525	0.9233
0.2541	56.6667	510	0.8463	0.4242	0.8463	0.9199

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1