ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k19_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6654
• Qwk: 0.4684
• Mse: 0.6654
• Rmse: 0.8157

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	2.5798	-0.0262	2.5798	1.6062
No log	0.0833	4	1.3015	0.0257	1.3015	1.1408
No log	0.125	6	0.9846	0.0952	0.9846	0.9922
No log	0.1667	8	0.9859	-0.0622	0.9859	0.9929
No log	0.2083	10	1.0198	0.1010	1.0198	1.0098
No log	0.25	12	1.0319	0.1573	1.0319	1.0158
No log	0.2917	14	0.8183	0.2604	0.8183	0.9046
No log	0.3333	16	0.7493	0.1604	0.7493	0.8656
No log	0.375	18	0.7263	0.1604	0.7263	0.8522
No log	0.4167	20	0.7026	0.2713	0.7026	0.8382
No log	0.4583	22	0.6832	0.2374	0.6832	0.8265
No log	0.5	24	0.6945	0.1272	0.6945	0.8333
No log	0.5417	26	0.6746	0.1282	0.6746	0.8214
No log	0.5833	28	0.6806	0.1282	0.6806	0.8250
No log	0.625	30	0.7425	0.1358	0.7425	0.8617
No log	0.6667	32	0.8876	0.3051	0.8876	0.9421
No log	0.7083	34	0.9346	0.2908	0.9346	0.9667
No log	0.75	36	0.8546	0.2109	0.8546	0.9244
No log	0.7917	38	0.7977	0.0	0.7977	0.8931
No log	0.8333	40	0.7529	0.0	0.7529	0.8677
No log	0.875	42	0.7419	0.0840	0.7419	0.8614
No log	0.9167	44	0.7544	0.1236	0.7544	0.8686
No log	0.9583	46	0.7678	0.1617	0.7678	0.8763
No log	1.0	48	0.7639	0.1617	0.7639	0.8740
No log	1.0417	50	0.7656	0.1617	0.7656	0.8750
No log	1.0833	52	0.7988	0.1648	0.7988	0.8937
No log	1.125	54	0.9725	0.2939	0.9725	0.9861
No log	1.1667	56	0.8658	0.3231	0.8658	0.9305
No log	1.2083	58	0.6718	0.2145	0.6718	0.8197
No log	1.25	60	0.6418	0.2405	0.6418	0.8011
No log	1.2917	62	0.6544	0.3151	0.6544	0.8089
No log	1.3333	64	0.5926	0.2923	0.5926	0.7698
No log	1.375	66	0.5840	0.3502	0.5840	0.7642
No log	1.4167	68	0.5950	0.4526	0.5950	0.7714
No log	1.4583	70	0.6134	0.4294	0.6134	0.7832
No log	1.5	72	0.6334	0.4850	0.6334	0.7959
No log	1.5417	74	0.6144	0.4294	0.6144	0.7838
No log	1.5833	76	0.6195	0.5142	0.6195	0.7871
No log	1.625	78	0.7888	0.3567	0.7888	0.8881
No log	1.6667	80	0.8590	0.3095	0.8590	0.9268
No log	1.7083	82	0.6895	0.4516	0.6895	0.8304
No log	1.75	84	0.6865	0.3953	0.6865	0.8286
No log	1.7917	86	0.6918	0.3706	0.6918	0.8317
No log	1.8333	88	0.6630	0.3656	0.6630	0.8142
No log	1.875	90	0.7336	0.3840	0.7336	0.8565
No log	1.9167	92	0.6924	0.3296	0.6924	0.8321
No log	1.9583	94	0.6084	0.2923	0.6084	0.7800
No log	2.0	96	0.6327	0.3563	0.6327	0.7954
No log	2.0417	98	0.7051	0.3522	0.7051	0.8397
No log	2.0833	100	0.6547	0.4083	0.6547	0.8091
No log	2.125	102	0.6031	0.2783	0.6031	0.7766
No log	2.1667	104	0.7853	0.3319	0.7853	0.8861
No log	2.2083	106	0.8405	0.3562	0.8405	0.9168
No log	2.25	108	0.6887	0.3840	0.6887	0.8299
No log	2.2917	110	0.6108	0.4074	0.6108	0.7815
No log	2.3333	112	0.5918	0.3859	0.5918	0.7693
No log	2.375	114	0.5867	0.3478	0.5867	0.7660
No log	2.4167	116	0.6434	0.4597	0.6434	0.8021
No log	2.4583	118	0.6364	0.4835	0.6364	0.7978
No log	2.5	120	0.5780	0.4684	0.5780	0.7602
No log	2.5417	122	0.5992	0.4782	0.5992	0.7741
No log	2.5833	124	0.5554	0.4455	0.5554	0.7452
No log	2.625	126	0.5550	0.4681	0.5550	0.7450
No log	2.6667	128	0.7090	0.5215	0.7090	0.8420
No log	2.7083	130	0.9971	0.3798	0.9971	0.9985
No log	2.75	132	0.7941	0.4366	0.7941	0.8911
No log	2.7917	134	0.5935	0.4212	0.5935	0.7704
No log	2.8333	136	0.6088	0.4051	0.6088	0.7803
No log	2.875	138	0.6472	0.4466	0.6472	0.8045
No log	2.9167	140	0.6425	0.3517	0.6425	0.8016
No log	2.9583	142	0.6223	0.4434	0.6223	0.7889
No log	3.0	144	0.8063	0.3909	0.8063	0.8979
No log	3.0417	146	0.7331	0.4444	0.7331	0.8562
No log	3.0833	148	0.5918	0.4555	0.5918	0.7693
No log	3.125	150	0.6318	0.3069	0.6318	0.7949
No log	3.1667	152	0.6056	0.3373	0.6056	0.7782
No log	3.2083	154	0.5700	0.4661	0.5700	0.7550
No log	3.25	156	0.5774	0.4473	0.5774	0.7599
No log	3.2917	158	0.5859	0.4352	0.5859	0.7655
No log	3.3333	160	0.5824	0.2852	0.5824	0.7632
No log	3.375	162	0.5748	0.3474	0.5748	0.7582
No log	3.4167	164	0.5622	0.3728	0.5622	0.7498
No log	3.4583	166	0.5713	0.3738	0.5713	0.7559
No log	3.5	168	0.6101	0.4222	0.6101	0.7811
No log	3.5417	170	0.5915	0.4516	0.5915	0.7691
No log	3.5833	172	0.5867	0.5319	0.5867	0.7660
No log	3.625	174	0.5604	0.5286	0.5604	0.7486
No log	3.6667	176	0.5486	0.5682	0.5486	0.7407
No log	3.7083	178	0.5317	0.5951	0.5317	0.7292
No log	3.75	180	0.5337	0.4904	0.5337	0.7306
No log	3.7917	182	0.6123	0.4395	0.6123	0.7825
No log	3.8333	184	0.6644	0.4341	0.6644	0.8151
No log	3.875	186	0.7125	0.4380	0.7125	0.8441
No log	3.9167	188	0.6299	0.4967	0.6299	0.7937
No log	3.9583	190	0.5566	0.5234	0.5566	0.7460
No log	4.0	192	0.5494	0.5084	0.5494	0.7412
No log	4.0417	194	0.5495	0.4757	0.5495	0.7413
No log	4.0833	196	0.5603	0.5009	0.5603	0.7486
No log	4.125	198	0.5534	0.5009	0.5534	0.7439
No log	4.1667	200	0.5450	0.4343	0.5450	0.7382
No log	4.2083	202	0.5528	0.4149	0.5528	0.7435
No log	4.25	204	0.5949	0.4732	0.5949	0.7713
No log	4.2917	206	0.5468	0.5587	0.5468	0.7394
No log	4.3333	208	0.5256	0.5009	0.5256	0.7250
No log	4.375	210	0.5152	0.5039	0.5152	0.7178
No log	4.4167	212	0.5099	0.4973	0.5099	0.7141
No log	4.4583	214	0.5377	0.5779	0.5377	0.7333
No log	4.5	216	0.5733	0.5922	0.5733	0.7571
No log	4.5417	218	0.6127	0.5664	0.6127	0.7828
No log	4.5833	220	0.5551	0.5584	0.5551	0.7450
No log	4.625	222	0.5123	0.5533	0.5123	0.7158
No log	4.6667	224	0.5587	0.6070	0.5587	0.7475
No log	4.7083	226	0.6041	0.5673	0.6041	0.7772
No log	4.75	228	0.5458	0.6070	0.5458	0.7388
No log	4.7917	230	0.5237	0.5009	0.5237	0.7237
No log	4.8333	232	0.5211	0.4776	0.5211	0.7219
No log	4.875	234	0.5223	0.4329	0.5223	0.7227
No log	4.9167	236	0.5157	0.4114	0.5157	0.7181
No log	4.9583	238	0.5332	0.4642	0.5332	0.7302
No log	5.0	240	0.5180	0.5003	0.5180	0.7197
No log	5.0417	242	0.5120	0.4757	0.5120	0.7155
No log	5.0833	244	0.5108	0.5523	0.5108	0.7147
No log	5.125	246	0.5241	0.5483	0.5241	0.7239
No log	5.1667	248	0.5030	0.4876	0.5030	0.7092
No log	5.2083	250	0.5487	0.5166	0.5487	0.7408
No log	5.25	252	0.6370	0.4606	0.6370	0.7981
No log	5.2917	254	0.5567	0.4948	0.5567	0.7461
No log	5.3333	256	0.5267	0.3806	0.5267	0.7257
No log	5.375	258	0.6781	0.4015	0.6781	0.8235
No log	5.4167	260	0.6956	0.3777	0.6956	0.8340
No log	5.4583	262	0.5727	0.3730	0.5727	0.7568
No log	5.5	264	0.5179	0.4747	0.5179	0.7197
No log	5.5417	266	0.5372	0.4808	0.5372	0.7330
No log	5.5833	268	0.5093	0.4660	0.5093	0.7137
No log	5.625	270	0.5021	0.5125	0.5021	0.7086
No log	5.6667	272	0.5995	0.4842	0.5995	0.7743
No log	5.7083	274	0.6393	0.4783	0.6393	0.7996
No log	5.75	276	0.5677	0.4789	0.5677	0.7535
No log	5.7917	278	0.5294	0.5177	0.5294	0.7276
No log	5.8333	280	0.6097	0.4721	0.6097	0.7809
No log	5.875	282	0.6235	0.4721	0.6235	0.7896
No log	5.9167	284	0.5612	0.4337	0.5612	0.7491
No log	5.9583	286	0.5618	0.4504	0.5618	0.7496
No log	6.0	288	0.5679	0.3651	0.5679	0.7536
No log	6.0417	290	0.5740	0.3651	0.5740	0.7577
No log	6.0833	292	0.6299	0.4292	0.6299	0.7937
No log	6.125	294	0.7268	0.4387	0.7268	0.8525
No log	6.1667	296	0.7152	0.4224	0.7152	0.8457
No log	6.2083	298	0.6405	0.4292	0.6405	0.8003
No log	6.25	300	0.5940	0.4229	0.5940	0.7707
No log	6.2917	302	0.5859	0.4229	0.5859	0.7655
No log	6.3333	304	0.6039	0.4314	0.6039	0.7771
No log	6.375	306	0.6291	0.4044	0.6291	0.7932
No log	6.4167	308	0.6596	0.4292	0.6596	0.8122
No log	6.4583	310	0.6245	0.4397	0.6245	0.7902
No log	6.5	312	0.6103	0.3702	0.6103	0.7812
No log	6.5417	314	0.5946	0.3995	0.5946	0.7711
No log	6.5833	316	0.6490	0.4704	0.6490	0.8056
No log	6.625	318	0.7105	0.4239	0.7105	0.8429
No log	6.6667	320	0.7130	0.4408	0.7130	0.8444
No log	6.7083	322	0.6687	0.4704	0.6687	0.8177
No log	6.75	324	0.6610	0.4704	0.6610	0.8130
No log	6.7917	326	0.6092	0.3864	0.6092	0.7805
No log	6.8333	328	0.5842	0.3937	0.5842	0.7643
No log	6.875	330	0.5741	0.3837	0.5741	0.7577
No log	6.9167	332	0.5773	0.3890	0.5773	0.7598
No log	6.9583	334	0.5708	0.3890	0.5708	0.7555
No log	7.0	336	0.5718	0.3890	0.5718	0.7561
No log	7.0417	338	0.5633	0.4253	0.5633	0.7505
No log	7.0833	340	0.5682	0.4590	0.5682	0.7538
No log	7.125	342	0.5650	0.3426	0.5650	0.7516
No log	7.1667	344	0.5814	0.3675	0.5814	0.7625
No log	7.2083	346	0.6257	0.3640	0.6257	0.7910
No log	7.25	348	0.6113	0.3640	0.6113	0.7818
No log	7.2917	350	0.5509	0.3970	0.5509	0.7423
No log	7.3333	352	0.5406	0.5143	0.5406	0.7352
No log	7.375	354	0.5391	0.4617	0.5391	0.7342
No log	7.4167	356	0.5600	0.4179	0.5600	0.7484
No log	7.4583	358	0.5497	0.4201	0.5497	0.7414
No log	7.5	360	0.5316	0.4555	0.5316	0.7291
No log	7.5417	362	0.5327	0.4555	0.5327	0.7298
No log	7.5833	364	0.5364	0.4493	0.5364	0.7324
No log	7.625	366	0.5485	0.4788	0.5485	0.7406
No log	7.6667	368	0.5192	0.4984	0.5192	0.7206
No log	7.7083	370	0.5140	0.4402	0.5140	0.7169
No log	7.75	372	0.5097	0.4657	0.5097	0.7140
No log	7.7917	374	0.5003	0.4885	0.5003	0.7073
No log	7.8333	376	0.4963	0.4719	0.4963	0.7045
No log	7.875	378	0.4934	0.5357	0.4934	0.7024
No log	7.9167	380	0.5041	0.5812	0.5041	0.7100
No log	7.9583	382	0.5097	0.5538	0.5097	0.7140
No log	8.0	384	0.5473	0.5607	0.5473	0.7398
No log	8.0417	386	0.5306	0.5678	0.5306	0.7284
No log	8.0833	388	0.5166	0.5619	0.5166	0.7187
No log	8.125	390	0.6788	0.5569	0.6788	0.8239
No log	8.1667	392	0.7580	0.4784	0.7580	0.8706
No log	8.2083	394	0.6782	0.5418	0.6782	0.8235
No log	8.25	396	0.5613	0.4179	0.5613	0.7492
No log	8.2917	398	0.5096	0.4742	0.5096	0.7139
No log	8.3333	400	0.5094	0.5231	0.5094	0.7137
No log	8.375	402	0.5161	0.4617	0.5161	0.7184
No log	8.4167	404	0.5800	0.5016	0.5800	0.7616
No log	8.4583	406	0.6008	0.5237	0.6008	0.7751
No log	8.5	408	0.5472	0.4576	0.5472	0.7397
No log	8.5417	410	0.5102	0.4953	0.5102	0.7143
No log	8.5833	412	0.5030	0.5286	0.5030	0.7092
No log	8.625	414	0.5034	0.4953	0.5034	0.7095
No log	8.6667	416	0.5060	0.4953	0.5060	0.7113
No log	8.7083	418	0.5126	0.4953	0.5126	0.7160
No log	8.75	420	0.5451	0.4847	0.5451	0.7383
No log	8.7917	422	0.5872	0.4660	0.5872	0.7663
No log	8.8333	424	0.5975	0.4179	0.5975	0.7730
No log	8.875	426	0.5760	0.4257	0.5760	0.7589
No log	8.9167	428	0.5370	0.4441	0.5370	0.7328
No log	8.9583	430	0.5172	0.4953	0.5172	0.7191
No log	9.0	432	0.5205	0.5195	0.5205	0.7215
No log	9.0417	434	0.5237	0.5672	0.5237	0.7237
No log	9.0833	436	0.5273	0.5656	0.5273	0.7262
No log	9.125	438	0.5755	0.3931	0.5755	0.7586
No log	9.1667	440	0.6843	0.5354	0.6843	0.8272
No log	9.2083	442	0.7021	0.5107	0.7021	0.8379
No log	9.25	444	0.6373	0.3914	0.6373	0.7983
No log	9.2917	446	0.6166	0.3914	0.6166	0.7853
No log	9.3333	448	0.6290	0.3640	0.6290	0.7931
No log	9.375	450	0.6524	0.4371	0.6524	0.8077
No log	9.4167	452	0.6414	0.3700	0.6414	0.8009
No log	9.4583	454	0.6675	0.4550	0.6675	0.8170
No log	9.5	456	0.7030	0.5040	0.7030	0.8384
No log	9.5417	458	0.6722	0.4302	0.6722	0.8198
No log	9.5833	460	0.6322	0.4227	0.6322	0.7951
No log	9.625	462	0.6022	0.4434	0.6022	0.7760
No log	9.6667	464	0.6088	0.4660	0.6088	0.7803
No log	9.7083	466	0.6141	0.4206	0.6141	0.7836
No log	9.75	468	0.5940	0.4504	0.5940	0.7707
No log	9.7917	470	0.6008	0.4747	0.6008	0.7751
No log	9.8333	472	0.5809	0.4463	0.5809	0.7622
No log	9.875	474	0.5610	0.3964	0.5610	0.7490
No log	9.9167	476	0.5598	0.4547	0.5598	0.7482
No log	9.9583	478	0.5643	0.4934	0.5643	0.7512
No log	10.0	480	0.5658	0.4847	0.5658	0.7522
No log	10.0417	482	0.5799	0.4455	0.5799	0.7615
No log	10.0833	484	0.6415	0.4642	0.6415	0.8009
No log	10.125	486	0.7279	0.5090	0.7279	0.8532
No log	10.1667	488	0.7043	0.5113	0.7043	0.8392
No log	10.2083	490	0.6157	0.4451	0.6157	0.7847
No log	10.25	492	0.5869	0.4103	0.5869	0.7661
No log	10.2917	494	0.6206	0.4393	0.6206	0.7878
No log	10.3333	496	0.6862	0.5113	0.6862	0.8284
No log	10.375	498	0.7175	0.4880	0.7175	0.8470
0.3225	10.4167	500	0.7183	0.4819	0.7183	0.8475
0.3225	10.4583	502	0.6559	0.4282	0.6559	0.8099
0.3225	10.5	504	0.5997	0.4377	0.5997	0.7744
0.3225	10.5417	506	0.5825	0.4455	0.5825	0.7632
0.3225	10.5833	508	0.6163	0.3914	0.6163	0.7850
0.3225	10.625	510	0.6654	0.4684	0.6654	0.8157

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1