ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7534
• Qwk: 0.5269
• Mse: 0.7534
• Rmse: 0.8680

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	4.1649	-0.0344	4.1649	2.0408
No log	0.0727	4	2.1025	0.0383	2.1025	1.4500
No log	0.1091	6	1.1074	0.0864	1.1074	1.0523
No log	0.1455	8	0.7769	0.0224	0.7769	0.8814
No log	0.1818	10	1.1168	-0.0742	1.1168	1.0568
No log	0.2182	12	1.4714	-0.0125	1.4714	1.2130
No log	0.2545	14	1.0077	-0.0325	1.0077	1.0038
No log	0.2909	16	0.8048	0.0259	0.8048	0.8971
No log	0.3273	18	0.8726	0.0075	0.8726	0.9341
No log	0.3636	20	1.0809	0.0505	1.0809	1.0397
No log	0.4	22	1.3637	0.1343	1.3637	1.1678
No log	0.4364	24	0.9114	0.2126	0.9114	0.9547
No log	0.4727	26	0.6360	0.4045	0.6360	0.7975
No log	0.5091	28	0.6410	0.2362	0.6410	0.8006
No log	0.5455	30	0.6304	0.2880	0.6304	0.7940
No log	0.5818	32	0.5998	0.4219	0.5998	0.7745
No log	0.6182	34	0.8601	0.3157	0.8601	0.9274
No log	0.6545	36	1.1621	0.2472	1.1621	1.0780
No log	0.6909	38	0.9940	0.2413	0.9940	0.9970
No log	0.7273	40	0.7382	0.3496	0.7382	0.8592
No log	0.7636	42	0.7188	0.3358	0.7188	0.8478
No log	0.8	44	0.7843	0.2880	0.7843	0.8856
No log	0.8364	46	0.7830	0.2665	0.7830	0.8849
No log	0.8727	48	0.8769	0.1876	0.8769	0.9364
No log	0.9091	50	0.8270	0.1838	0.8270	0.9094
No log	0.9455	52	0.8741	0.1672	0.8741	0.9349
No log	0.9818	54	0.9622	0.1687	0.9622	0.9809
No log	1.0182	56	0.8931	0.1717	0.8931	0.9450
No log	1.0545	58	0.8435	0.2133	0.8435	0.9184
No log	1.0909	60	0.8848	0.1922	0.8848	0.9406
No log	1.1273	62	0.8033	0.2382	0.8033	0.8963
No log	1.1636	64	0.6971	0.3141	0.6971	0.8349
No log	1.2	66	0.6208	0.3399	0.6208	0.7879
No log	1.2364	68	0.6167	0.3498	0.6167	0.7853
No log	1.2727	70	0.6237	0.4192	0.6237	0.7898
No log	1.3091	72	0.6301	0.3594	0.6301	0.7938
No log	1.3455	74	0.6187	0.4528	0.6187	0.7866
No log	1.3818	76	0.6567	0.3804	0.6567	0.8103
No log	1.4182	78	0.8940	0.3253	0.8940	0.9455
No log	1.4545	80	1.2209	0.2809	1.2209	1.1050
No log	1.4909	82	1.1155	0.2915	1.1155	1.0562
No log	1.5273	84	0.8804	0.3128	0.8804	0.9383
No log	1.5636	86	0.6803	0.3575	0.6803	0.8248
No log	1.6	88	0.6335	0.3717	0.6335	0.7959
No log	1.6364	90	0.6238	0.4386	0.6238	0.7898
No log	1.6727	92	0.6117	0.4066	0.6117	0.7821
No log	1.7091	94	0.6518	0.3823	0.6518	0.8073
No log	1.7455	96	0.7767	0.3822	0.7767	0.8813
No log	1.7818	98	0.8164	0.3716	0.8164	0.9036
No log	1.8182	100	0.6944	0.4053	0.6944	0.8333
No log	1.8545	102	0.6177	0.4605	0.6177	0.7860
No log	1.8909	104	0.6181	0.4633	0.6181	0.7862
No log	1.9273	106	0.6152	0.4497	0.6152	0.7844
No log	1.9636	108	0.6409	0.4362	0.6409	0.8005
No log	2.0	110	0.6307	0.4441	0.6307	0.7942
No log	2.0364	112	0.6236	0.4572	0.6236	0.7897
No log	2.0727	114	0.6457	0.4315	0.6457	0.8035
No log	2.1091	116	0.6358	0.4315	0.6358	0.7974
No log	2.1455	118	0.6054	0.4280	0.6054	0.7781
No log	2.1818	120	0.6570	0.4200	0.6570	0.8106
No log	2.2182	122	0.6874	0.4424	0.6874	0.8291
No log	2.2545	124	0.6695	0.4524	0.6695	0.8182
No log	2.2909	126	0.7255	0.4609	0.7255	0.8518
No log	2.3273	128	0.8598	0.3868	0.8598	0.9272
No log	2.3636	130	0.7983	0.4169	0.7983	0.8935
No log	2.4	132	0.7177	0.4214	0.7177	0.8472
No log	2.4364	134	0.8678	0.3185	0.8678	0.9315
No log	2.4727	136	0.8864	0.2911	0.8864	0.9415
No log	2.5091	138	0.7567	0.4185	0.7567	0.8699
No log	2.5455	140	0.7226	0.4412	0.7226	0.8500
No log	2.5818	142	0.8395	0.3446	0.8395	0.9162
No log	2.6182	144	0.7830	0.4060	0.7830	0.8849
No log	2.6545	146	0.6553	0.4096	0.6553	0.8095
No log	2.6909	148	0.6257	0.4516	0.6257	0.7910
No log	2.7273	150	0.6736	0.4471	0.6736	0.8207
No log	2.7636	152	0.6432	0.4547	0.6432	0.8020
No log	2.8	154	0.6295	0.4541	0.6295	0.7934
No log	2.8364	156	0.6920	0.3983	0.6920	0.8319
No log	2.8727	158	0.7012	0.4077	0.7012	0.8374
No log	2.9091	160	0.7006	0.3809	0.7006	0.8370
No log	2.9455	162	0.6124	0.4134	0.6124	0.7825
No log	2.9818	164	0.5959	0.4424	0.5959	0.7719
No log	3.0182	166	0.6071	0.4536	0.6071	0.7792
No log	3.0545	168	0.6095	0.4324	0.6095	0.7807
No log	3.0909	170	0.6743	0.4262	0.6743	0.8211
No log	3.1273	172	0.8221	0.3223	0.8221	0.9067
No log	3.1636	174	0.8169	0.3829	0.8169	0.9038
No log	3.2	176	0.7074	0.4843	0.7074	0.8411
No log	3.2364	178	0.7287	0.4566	0.7287	0.8537
No log	3.2727	180	0.7314	0.4558	0.7314	0.8552
No log	3.3091	182	0.7034	0.5034	0.7034	0.8387
No log	3.3455	184	0.7140	0.4071	0.7140	0.8450
No log	3.3818	186	0.7377	0.3889	0.7377	0.8589
No log	3.4182	188	0.7759	0.3907	0.7759	0.8808
No log	3.4545	190	0.7346	0.3867	0.7346	0.8571
No log	3.4909	192	0.7165	0.4799	0.7165	0.8465
No log	3.5273	194	0.7514	0.5249	0.7514	0.8669
No log	3.5636	196	0.7548	0.5290	0.7548	0.8688
No log	3.6	198	0.7450	0.4340	0.7450	0.8631
No log	3.6364	200	0.7875	0.4	0.7875	0.8874
No log	3.6727	202	0.8068	0.3749	0.8068	0.8982
No log	3.7091	204	0.7569	0.4	0.7569	0.8700
No log	3.7455	206	0.7004	0.4716	0.7004	0.8369
No log	3.7818	208	0.7074	0.5606	0.7074	0.8411
No log	3.8182	210	0.7286	0.5726	0.7286	0.8536
No log	3.8545	212	0.7282	0.5665	0.7282	0.8533
No log	3.8909	214	0.7067	0.4982	0.7067	0.8407
No log	3.9273	216	0.7059	0.4886	0.7059	0.8402
No log	3.9636	218	0.7070	0.5079	0.7070	0.8408
No log	4.0	220	0.7232	0.5361	0.7232	0.8504
No log	4.0364	222	0.7179	0.5	0.7179	0.8473
No log	4.0727	224	0.7105	0.4897	0.7105	0.8429
No log	4.1091	226	0.7147	0.5	0.7147	0.8454
No log	4.1455	228	0.7185	0.4991	0.7185	0.8477
No log	4.1818	230	0.7175	0.5015	0.7175	0.8471
No log	4.2182	232	0.7162	0.4956	0.7162	0.8463
No log	4.2545	234	0.7130	0.4607	0.7130	0.8444
No log	4.2909	236	0.7170	0.4498	0.7170	0.8468
No log	4.3273	238	0.7455	0.4632	0.7455	0.8634
No log	4.3636	240	0.8532	0.4489	0.8532	0.9237
No log	4.4	242	0.8777	0.4373	0.8777	0.9369
No log	4.4364	244	0.7637	0.4527	0.7637	0.8739
No log	4.4727	246	0.6981	0.4737	0.6981	0.8356
No log	4.5091	248	0.6705	0.4991	0.6705	0.8189
No log	4.5455	250	0.6854	0.4741	0.6854	0.8279
No log	4.5818	252	0.6733	0.4773	0.6733	0.8206
No log	4.6182	254	0.6617	0.4773	0.6617	0.8134
No log	4.6545	256	0.6700	0.4690	0.6700	0.8186
No log	4.6909	258	0.6654	0.4946	0.6654	0.8157
No log	4.7273	260	0.6690	0.4891	0.6690	0.8179
No log	4.7636	262	0.6669	0.5074	0.6669	0.8166
No log	4.8	264	0.7178	0.4886	0.7178	0.8473
No log	4.8364	266	0.7931	0.4653	0.7931	0.8905
No log	4.8727	268	0.8316	0.4764	0.8316	0.9119
No log	4.9091	270	0.8159	0.4793	0.8159	0.9033
No log	4.9455	272	0.7762	0.4722	0.7762	0.8810
No log	4.9818	274	0.7703	0.4405	0.7703	0.8777
No log	5.0182	276	0.7975	0.4293	0.7975	0.8930
No log	5.0545	278	0.8214	0.4533	0.8214	0.9063
No log	5.0909	280	0.8231	0.4217	0.8231	0.9073
No log	5.1273	282	0.8029	0.4085	0.8029	0.8961
No log	5.1636	284	0.7874	0.4005	0.7874	0.8873
No log	5.2	286	0.7566	0.4277	0.7566	0.8699
No log	5.2364	288	0.7237	0.4257	0.7237	0.8507
No log	5.2727	290	0.6925	0.4456	0.6925	0.8322
No log	5.3091	292	0.7069	0.4944	0.7069	0.8407
No log	5.3455	294	0.7403	0.4788	0.7403	0.8604
No log	5.3818	296	0.7387	0.4847	0.7387	0.8595
No log	5.4182	298	0.6699	0.4853	0.6699	0.8184
No log	5.4545	300	0.6389	0.5300	0.6389	0.7993
No log	5.4909	302	0.6485	0.5173	0.6485	0.8053
No log	5.5273	304	0.6973	0.5270	0.6973	0.8351
No log	5.5636	306	0.7459	0.5041	0.7459	0.8636
No log	5.6	308	0.7818	0.5206	0.7818	0.8842
No log	5.6364	310	0.7823	0.5206	0.7823	0.8845
No log	5.6727	312	0.7644	0.5157	0.7644	0.8743
No log	5.7091	314	0.7426	0.5323	0.7426	0.8617
No log	5.7455	316	0.7529	0.5296	0.7529	0.8677
No log	5.7818	318	0.7682	0.5157	0.7682	0.8765
No log	5.8182	320	0.7586	0.5253	0.7586	0.8710
No log	5.8545	322	0.7493	0.5395	0.7493	0.8656
No log	5.8909	324	0.7319	0.5461	0.7319	0.8555
No log	5.9273	326	0.7370	0.5185	0.7370	0.8585
No log	5.9636	328	0.7495	0.5323	0.7495	0.8657
No log	6.0	330	0.7356	0.5128	0.7356	0.8577
No log	6.0364	332	0.7148	0.5413	0.7148	0.8455
No log	6.0727	334	0.7201	0.5488	0.7201	0.8486
No log	6.1091	336	0.7349	0.5137	0.7349	0.8573
No log	6.1455	338	0.7392	0.4981	0.7392	0.8598
No log	6.1818	340	0.7576	0.5064	0.7576	0.8704
No log	6.2182	342	0.7625	0.5064	0.7625	0.8732
No log	6.2545	344	0.7348	0.4949	0.7348	0.8572
No log	6.2909	346	0.7309	0.4842	0.7309	0.8549
No log	6.3273	348	0.7366	0.4960	0.7366	0.8583
No log	6.3636	350	0.7542	0.4863	0.7542	0.8684
No log	6.4	352	0.7632	0.4799	0.7632	0.8736
No log	6.4364	354	0.7683	0.4867	0.7683	0.8765
No log	6.4727	356	0.7968	0.5105	0.7968	0.8926
No log	6.5091	358	0.8258	0.5115	0.8258	0.9087
No log	6.5455	360	0.8135	0.5246	0.8135	0.9020
No log	6.5818	362	0.7678	0.5140	0.7678	0.8763
No log	6.6182	364	0.7551	0.4853	0.7551	0.8689
No log	6.6545	366	0.7508	0.4860	0.7508	0.8665
No log	6.6909	368	0.7612	0.5433	0.7612	0.8725
No log	6.7273	370	0.8071	0.4904	0.8071	0.8984
No log	6.7636	372	0.8476	0.4756	0.8476	0.9206
No log	6.8	374	0.8437	0.4809	0.8437	0.9186
No log	6.8364	376	0.7939	0.4910	0.7939	0.8910
No log	6.8727	378	0.7263	0.5200	0.7263	0.8522
No log	6.9091	380	0.6930	0.5133	0.6930	0.8325
No log	6.9455	382	0.6908	0.4907	0.6908	0.8312
No log	6.9818	384	0.6975	0.5133	0.6975	0.8351
No log	7.0182	386	0.7208	0.4785	0.7208	0.8490
No log	7.0545	388	0.7620	0.5153	0.7620	0.8729
No log	7.0909	390	0.7817	0.5134	0.7817	0.8841
No log	7.1273	392	0.7710	0.4864	0.7710	0.8781
No log	7.1636	394	0.7573	0.4778	0.7573	0.8702
No log	7.2	396	0.7535	0.4880	0.7535	0.8680
No log	7.2364	398	0.7480	0.4814	0.7480	0.8649
No log	7.2727	400	0.7532	0.4699	0.7532	0.8679
No log	7.3091	402	0.7475	0.4773	0.7475	0.8646
No log	7.3455	404	0.7473	0.4822	0.7473	0.8645
No log	7.3818	406	0.7539	0.4822	0.7539	0.8683
No log	7.4182	408	0.7503	0.4822	0.7503	0.8662
No log	7.4545	410	0.7553	0.4816	0.7553	0.8691
No log	7.4909	412	0.7430	0.4835	0.7430	0.8620
No log	7.5273	414	0.7321	0.5146	0.7321	0.8556
No log	7.5636	416	0.7297	0.4961	0.7297	0.8543
No log	7.6	418	0.7320	0.4961	0.7320	0.8556
No log	7.6364	420	0.7487	0.5013	0.7487	0.8653
No log	7.6727	422	0.7736	0.5035	0.7736	0.8795
No log	7.7091	424	0.7904	0.4950	0.7904	0.8890
No log	7.7455	426	0.8016	0.5115	0.8016	0.8953
No log	7.7818	428	0.8042	0.5115	0.8042	0.8967
No log	7.8182	430	0.7908	0.5115	0.7908	0.8893
No log	7.8545	432	0.7622	0.5193	0.7622	0.8730
No log	7.8909	434	0.7367	0.5350	0.7367	0.8583
No log	7.9273	436	0.7205	0.5446	0.7205	0.8489
No log	7.9636	438	0.7221	0.5350	0.7221	0.8498
No log	8.0	440	0.7295	0.5350	0.7295	0.8541
No log	8.0364	442	0.7481	0.5193	0.7481	0.8649
No log	8.0727	444	0.7511	0.5193	0.7511	0.8666
No log	8.1091	446	0.7528	0.5193	0.7528	0.8676
No log	8.1455	448	0.7533	0.5193	0.7533	0.8679
No log	8.1818	450	0.7464	0.5193	0.7464	0.8639
No log	8.2182	452	0.7346	0.5203	0.7346	0.8571
No log	8.2545	454	0.7159	0.5473	0.7159	0.8461
No log	8.2909	456	0.7073	0.5441	0.7073	0.8410
No log	8.3273	458	0.7061	0.5441	0.7061	0.8403
No log	8.3636	460	0.7144	0.5621	0.7144	0.8452
No log	8.4	462	0.7379	0.5208	0.7379	0.8590
No log	8.4364	464	0.7512	0.5128	0.7512	0.8667
No log	8.4727	466	0.7523	0.5128	0.7523	0.8673
No log	8.5091	468	0.7527	0.5128	0.7527	0.8676
No log	8.5455	470	0.7440	0.5173	0.7440	0.8626
No log	8.5818	472	0.7375	0.5314	0.7375	0.8588
No log	8.6182	474	0.7480	0.5173	0.7480	0.8649
No log	8.6545	476	0.7501	0.5173	0.7501	0.8661
No log	8.6909	478	0.7419	0.4941	0.7419	0.8613
No log	8.7273	480	0.7408	0.4824	0.7408	0.8607
No log	8.7636	482	0.7405	0.4983	0.7405	0.8605
No log	8.8	484	0.7498	0.4974	0.7498	0.8659
No log	8.8364	486	0.7646	0.4829	0.7646	0.8744
No log	8.8727	488	0.7787	0.4816	0.7787	0.8825
No log	8.9091	490	0.7865	0.4810	0.7865	0.8868
No log	8.9455	492	0.7914	0.4810	0.7914	0.8896
No log	8.9818	494	0.7948	0.4804	0.7948	0.8915
No log	9.0182	496	0.7895	0.4810	0.7895	0.8885
No log	9.0545	498	0.7809	0.4816	0.7809	0.8837
0.4234	9.0909	500	0.7815	0.4816	0.7815	0.8840
0.4234	9.1273	502	0.7846	0.4816	0.7846	0.8858
0.4234	9.1636	504	0.7853	0.4997	0.7853	0.8862
0.4234	9.2	506	0.7804	0.4997	0.7804	0.8834
0.4234	9.2364	508	0.7781	0.4997	0.7781	0.8821
0.4234	9.2727	510	0.7742	0.4997	0.7742	0.8799
0.4234	9.3091	512	0.7712	0.4989	0.7712	0.8782
0.4234	9.3455	514	0.7690	0.4989	0.7690	0.8769
0.4234	9.3818	516	0.7642	0.5127	0.7642	0.8742
0.4234	9.4182	518	0.7591	0.5269	0.7591	0.8713
0.4234	9.4545	520	0.7548	0.5269	0.7548	0.8688
0.4234	9.4909	522	0.7505	0.5269	0.7505	0.8663
0.4234	9.5273	524	0.7487	0.5147	0.7487	0.8653
0.4234	9.5636	526	0.7482	0.5147	0.7482	0.8650
0.4234	9.6	528	0.7500	0.5269	0.7500	0.8660
0.4234	9.6364	530	0.7534	0.5269	0.7534	0.8680
0.4234	9.6727	532	0.7542	0.5269	0.7542	0.8685
0.4234	9.7091	534	0.7547	0.5269	0.7547	0.8687
0.4234	9.7455	536	0.7554	0.5269	0.7554	0.8691
0.4234	9.7818	538	0.7546	0.5269	0.7546	0.8686
0.4234	9.8182	540	0.7533	0.5269	0.7533	0.8680
0.4234	9.8545	542	0.7522	0.5269	0.7522	0.8673
0.4234	9.8909	544	0.7519	0.5269	0.7519	0.8671
0.4234	9.9273	546	0.7524	0.5269	0.7524	0.8674
0.4234	9.9636	548	0.7531	0.5269	0.7531	0.8678
0.4234	10.0	550	0.7534	0.5269	0.7534	0.8680

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1