ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k19_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6925
• Qwk: 0.7206
• Mse: 0.6925
• Rmse: 0.8322

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0233	2	7.2013	0.0055	7.2013	2.6835
No log	0.0465	4	4.3078	0.1469	4.3078	2.0755
No log	0.0698	6	3.1026	0.0970	3.1026	1.7614
No log	0.0930	8	2.1821	0.1926	2.1821	1.4772
No log	0.1163	10	1.7709	0.1455	1.7709	1.3308
No log	0.1395	12	2.0216	0.1639	2.0216	1.4218
No log	0.1628	14	1.8071	0.0943	1.8071	1.3443
No log	0.1860	16	1.8532	0.0935	1.8532	1.3613
No log	0.2093	18	2.8131	-0.0420	2.8131	1.6772
No log	0.2326	20	2.9715	0.0400	2.9715	1.7238
No log	0.2558	22	2.7456	0.0676	2.7456	1.6570
No log	0.2791	24	2.2622	0.1135	2.2622	1.5041
No log	0.3023	26	1.9837	0.2647	1.9837	1.4084
No log	0.3256	28	1.3743	0.4034	1.3743	1.1723
No log	0.3488	30	1.3492	0.4480	1.3492	1.1616
No log	0.3721	32	1.3273	0.3214	1.3273	1.1521
No log	0.3953	34	1.7001	0.3566	1.7001	1.3039
No log	0.4186	36	2.2978	0.1733	2.2978	1.5159
No log	0.4419	38	2.8221	0.1325	2.8221	1.6799
No log	0.4651	40	2.8524	0.1325	2.8524	1.6889
No log	0.4884	42	2.4646	0.1258	2.4646	1.5699
No log	0.5116	44	2.2348	0.1818	2.2348	1.4949
No log	0.5349	46	2.0721	0.2297	2.0721	1.4395
No log	0.5581	48	1.8775	0.3217	1.8775	1.3702
No log	0.5814	50	1.8853	0.3056	1.8853	1.3731
No log	0.6047	52	1.5233	0.4651	1.5233	1.2342
No log	0.6279	54	1.1337	0.4370	1.1337	1.0648
No log	0.6512	56	1.1837	0.4874	1.1837	1.0880
No log	0.6744	58	1.1650	0.5000	1.1650	1.0793
No log	0.6977	60	1.0375	0.5397	1.0375	1.0186
No log	0.7209	62	0.9760	0.6	0.9760	0.9879
No log	0.7442	64	0.9474	0.6308	0.9474	0.9734
No log	0.7674	66	0.9730	0.5625	0.9730	0.9864
No log	0.7907	68	1.0320	0.5827	1.0320	1.0159
No log	0.8140	70	1.0261	0.5354	1.0261	1.0130
No log	0.8372	72	1.1237	0.5312	1.1237	1.0600
No log	0.8605	74	1.0118	0.5366	1.0118	1.0059
No log	0.8837	76	0.9751	0.5366	0.9751	0.9875
No log	0.9070	78	0.9067	0.5645	0.9067	0.9522
No log	0.9302	80	0.7949	0.6466	0.7949	0.8916
No log	0.9535	82	0.7030	0.6618	0.7030	0.8384
No log	0.9767	84	0.6799	0.7234	0.6799	0.8245
No log	1.0	86	0.6467	0.7568	0.6467	0.8042
No log	1.0233	88	0.6155	0.7898	0.6155	0.7845
No log	1.0465	90	0.5967	0.8	0.5967	0.7725
No log	1.0698	92	0.6459	0.76	0.6459	0.8037
No log	1.0930	94	0.9303	0.6429	0.9303	0.9645
No log	1.1163	96	1.1207	0.5588	1.1207	1.0586
No log	1.1395	98	0.9495	0.5821	0.9495	0.9744
No log	1.1628	100	0.7548	0.6815	0.7548	0.8688
No log	1.1860	102	0.8503	0.6963	0.8503	0.9221
No log	1.2093	104	1.0572	0.5735	1.0572	1.0282
No log	1.2326	106	0.8059	0.7133	0.8059	0.8977
No log	1.2558	108	0.6920	0.6950	0.6920	0.8319
No log	1.2791	110	1.0965	0.5362	1.0965	1.0471
No log	1.3023	112	1.3137	0.4681	1.3137	1.1462
No log	1.3256	114	1.0360	0.5972	1.0360	1.0178
No log	1.3488	116	0.6783	0.7260	0.6783	0.8236
No log	1.3721	118	0.5427	0.7974	0.5427	0.7367
No log	1.3953	120	0.7447	0.7439	0.7447	0.8629
No log	1.4186	122	0.8128	0.7239	0.8128	0.9016
No log	1.4419	124	0.7009	0.7848	0.7009	0.8372
No log	1.4651	126	0.5797	0.8000	0.5797	0.7614
No log	1.4884	128	0.5744	0.8000	0.5744	0.7579
No log	1.5116	130	0.5625	0.8000	0.5625	0.7500
No log	1.5349	132	0.5572	0.8000	0.5572	0.7464
No log	1.5581	134	0.6588	0.7613	0.6588	0.8117
No log	1.5814	136	0.8166	0.7006	0.8166	0.9037
No log	1.6047	138	0.6451	0.7742	0.6451	0.8032
No log	1.6279	140	0.5112	0.8105	0.5112	0.7150
No log	1.6512	142	0.8092	0.6839	0.8092	0.8996
No log	1.6744	144	0.9549	0.6490	0.9549	0.9772
No log	1.6977	146	0.8751	0.6667	0.8751	0.9355
No log	1.7209	148	0.7586	0.7397	0.7586	0.8710
No log	1.7442	150	0.6845	0.7310	0.6845	0.8274
No log	1.7674	152	0.6498	0.7361	0.6498	0.8061
No log	1.7907	154	0.6823	0.7448	0.6823	0.8260
No log	1.8140	156	0.7448	0.7361	0.7448	0.8630
No log	1.8372	158	0.7590	0.7273	0.7590	0.8712
No log	1.8605	160	0.7383	0.7092	0.7383	0.8592
No log	1.8837	162	0.7497	0.7	0.7497	0.8658
No log	1.9070	164	0.7565	0.7050	0.7565	0.8698
No log	1.9302	166	0.7491	0.7143	0.7491	0.8655
No log	1.9535	168	0.7369	0.7143	0.7369	0.8584
No log	1.9767	170	0.6814	0.7273	0.6814	0.8255
No log	2.0	172	0.6951	0.6812	0.6951	0.8337
No log	2.0233	174	0.7583	0.6667	0.7583	0.8708
No log	2.0465	176	0.7590	0.6866	0.7590	0.8712
No log	2.0698	178	0.6709	0.7391	0.6709	0.8191
No log	2.0930	180	0.6165	0.7660	0.6165	0.7852
No log	2.1163	182	0.5973	0.7465	0.5973	0.7728
No log	2.1395	184	0.5851	0.7778	0.5851	0.7649
No log	2.1628	186	0.6110	0.7429	0.6110	0.7817
No log	2.1860	188	0.7250	0.6713	0.7250	0.8515
No log	2.2093	190	0.8130	0.6622	0.8130	0.9017
No log	2.2326	192	0.7356	0.6803	0.7356	0.8577
No log	2.2558	194	0.6138	0.7763	0.6138	0.7834
No log	2.2791	196	0.4970	0.8101	0.4970	0.7049
No log	2.3023	198	0.4815	0.8485	0.4815	0.6939
No log	2.3256	200	0.4748	0.8375	0.4748	0.6891
No log	2.3488	202	0.5174	0.7975	0.5174	0.7193
No log	2.3721	204	0.5565	0.8129	0.5565	0.7460
No log	2.3953	206	0.5886	0.8025	0.5886	0.7672
No log	2.4186	208	0.6236	0.7671	0.6236	0.7897
No log	2.4419	210	0.6100	0.7619	0.6100	0.7810
No log	2.4651	212	0.5932	0.7838	0.5932	0.7702
No log	2.4884	214	0.5648	0.7947	0.5648	0.7516
No log	2.5116	216	0.5442	0.7947	0.5442	0.7377
No log	2.5349	218	0.5284	0.8052	0.5284	0.7269
No log	2.5581	220	0.5286	0.8176	0.5286	0.7271
No log	2.5814	222	0.5770	0.8101	0.5770	0.7596
No log	2.6047	224	0.6168	0.7682	0.6168	0.7854
No log	2.6279	226	0.5886	0.8182	0.5886	0.7672
No log	2.6512	228	0.5615	0.8258	0.5615	0.7493
No log	2.6744	230	0.5641	0.8176	0.5641	0.7511
No log	2.6977	232	0.5720	0.8	0.5720	0.7563
No log	2.7209	234	0.5121	0.8176	0.5121	0.7156
No log	2.7442	236	0.4488	0.8364	0.4488	0.6699
No log	2.7674	238	0.4310	0.8434	0.4310	0.6565
No log	2.7907	240	0.4400	0.8466	0.4400	0.6633
No log	2.8140	242	0.4702	0.8199	0.4702	0.6857
No log	2.8372	244	0.4784	0.8415	0.4784	0.6916
No log	2.8605	246	0.5390	0.7950	0.5390	0.7341
No log	2.8837	248	0.5829	0.7975	0.5829	0.7635
No log	2.9070	250	0.6383	0.7925	0.6383	0.7989
No log	2.9302	252	0.5547	0.8129	0.5547	0.7448
No log	2.9535	254	0.5258	0.7947	0.5258	0.7252
No log	2.9767	256	0.7318	0.6846	0.7318	0.8555
No log	3.0	258	0.7595	0.6928	0.7595	0.8715
No log	3.0233	260	0.7632	0.7027	0.7632	0.8736
No log	3.0465	262	0.6069	0.7534	0.6069	0.7790
No log	3.0698	264	0.5627	0.7808	0.5627	0.7502
No log	3.0930	266	0.5966	0.7724	0.5966	0.7724
No log	3.1163	268	0.6504	0.7465	0.6504	0.8065
No log	3.1395	270	0.7384	0.7143	0.7384	0.8593
No log	3.1628	272	0.7556	0.7059	0.7556	0.8693
No log	3.1860	274	0.8064	0.6	0.8064	0.8980
No log	3.2093	276	0.9566	0.5970	0.9566	0.9780
No log	3.2326	278	1.0763	0.5857	1.0763	1.0375
No log	3.2558	280	0.9905	0.6	0.9905	0.9952
No log	3.2791	282	0.8092	0.6074	0.8092	0.8996
No log	3.3023	284	0.7011	0.7194	0.7011	0.8373
No log	3.3256	286	0.7906	0.7248	0.7906	0.8892
No log	3.3488	288	0.7977	0.7020	0.7977	0.8932
No log	3.3721	290	0.7033	0.7483	0.7033	0.8386
No log	3.3953	292	0.6290	0.7534	0.6290	0.7931
No log	3.4186	294	0.6188	0.7619	0.6188	0.7866
No log	3.4419	296	0.6645	0.7552	0.6645	0.8151
No log	3.4651	298	0.7094	0.7286	0.7094	0.8423
No log	3.4884	300	0.7431	0.6861	0.7431	0.8620
No log	3.5116	302	0.7311	0.6957	0.7311	0.8550
No log	3.5349	304	0.6826	0.7448	0.6826	0.8262
No log	3.5581	306	0.6271	0.7534	0.6271	0.7919
No log	3.5814	308	0.5650	0.7733	0.5650	0.7517
No log	3.6047	310	0.5418	0.8026	0.5418	0.7360
No log	3.6279	312	0.5717	0.7945	0.5717	0.7561
No log	3.6512	314	0.5992	0.7724	0.5992	0.7741
No log	3.6744	316	0.5881	0.7838	0.5881	0.7668
No log	3.6977	318	0.5913	0.7619	0.5913	0.7690
No log	3.7209	320	0.5469	0.7867	0.5469	0.7396
No log	3.7442	322	0.5057	0.7974	0.5057	0.7111
No log	3.7674	324	0.5081	0.7922	0.5081	0.7128
No log	3.7907	326	0.5488	0.7975	0.5488	0.7408
No log	3.8140	328	0.6830	0.7484	0.6830	0.8264
No log	3.8372	330	0.7381	0.72	0.7381	0.8591
No log	3.8605	332	0.6575	0.7248	0.6575	0.8108
No log	3.8837	334	0.5907	0.7843	0.5907	0.7686
No log	3.9070	336	0.5733	0.7919	0.5733	0.7572
No log	3.9302	338	0.6155	0.8105	0.6155	0.7845
No log	3.9535	340	0.6229	0.7755	0.6229	0.7893
No log	3.9767	342	0.6448	0.7843	0.6448	0.8030
No log	4.0	344	0.7507	0.7075	0.7507	0.8664
No log	4.0233	346	0.7551	0.7075	0.7551	0.8689
No log	4.0465	348	0.6472	0.7682	0.6472	0.8045
No log	4.0698	350	0.5535	0.7843	0.5535	0.7440
No log	4.0930	352	0.5467	0.7922	0.5467	0.7394
No log	4.1163	354	0.5688	0.7974	0.5688	0.7542
No log	4.1395	356	0.5469	0.7922	0.5469	0.7395
No log	4.1628	358	0.5407	0.7922	0.5407	0.7353
No log	4.1860	360	0.5288	0.7922	0.5288	0.7272
No log	4.2093	362	0.5385	0.8105	0.5385	0.7338
No log	4.2326	364	0.5589	0.7815	0.5589	0.7476
No log	4.2558	366	0.5629	0.7843	0.5629	0.7503
No log	4.2791	368	0.5997	0.7534	0.5997	0.7744
No log	4.3023	370	0.6152	0.7534	0.6152	0.7843
No log	4.3256	372	0.5793	0.7651	0.5793	0.7611
No log	4.3488	374	0.5811	0.7867	0.5811	0.7623
No log	4.3721	376	0.6287	0.7432	0.6287	0.7929
No log	4.3953	378	0.6516	0.7310	0.6516	0.8072
No log	4.4186	380	0.6517	0.7172	0.6517	0.8073
No log	4.4419	382	0.6763	0.6857	0.6763	0.8224
No log	4.4651	384	0.6977	0.6619	0.6977	0.8353
No log	4.4884	386	0.6917	0.6857	0.6917	0.8317
No log	4.5116	388	0.6781	0.7042	0.6781	0.8235
No log	4.5349	390	0.6802	0.7092	0.6802	0.8247
No log	4.5581	392	0.6590	0.7133	0.6590	0.8118
No log	4.5814	394	0.6028	0.7347	0.6028	0.7764
No log	4.6047	396	0.5881	0.7703	0.5881	0.7669
No log	4.6279	398	0.6128	0.7448	0.6128	0.7828
No log	4.6512	400	0.6065	0.8	0.6065	0.7788
No log	4.6744	402	0.6506	0.7234	0.6506	0.8066
No log	4.6977	404	0.6840	0.7092	0.6840	0.8270
No log	4.7209	406	0.6394	0.7429	0.6394	0.7996
No log	4.7442	408	0.6256	0.75	0.6256	0.7909
No log	4.7674	410	0.6497	0.7467	0.6497	0.8060
No log	4.7907	412	0.5871	0.75	0.5871	0.7662
No log	4.8140	414	0.4954	0.8026	0.4954	0.7038
No log	4.8372	416	0.5467	0.7975	0.5467	0.7394
No log	4.8605	418	0.6312	0.7310	0.6312	0.7945
No log	4.8837	420	0.6548	0.7183	0.6548	0.8092
No log	4.9070	422	0.6208	0.75	0.6208	0.7879
No log	4.9302	424	0.6529	0.7692	0.6529	0.8080
No log	4.9535	426	0.7305	0.7101	0.7305	0.8547
No log	4.9767	428	0.7354	0.7246	0.7354	0.8576
No log	5.0	430	0.6687	0.7518	0.6687	0.8177
No log	5.0233	432	0.6096	0.7534	0.6096	0.7808
No log	5.0465	434	0.5408	0.8212	0.5408	0.7354
No log	5.0698	436	0.5103	0.8258	0.5103	0.7143
No log	5.0930	438	0.5062	0.8077	0.5062	0.7115
No log	5.1163	440	0.4988	0.8205	0.4988	0.7062
No log	5.1395	442	0.5083	0.8205	0.5083	0.7130
No log	5.1628	444	0.5336	0.8105	0.5336	0.7305
No log	5.1860	446	0.5793	0.7919	0.5793	0.7611
No log	5.2093	448	0.6455	0.75	0.6455	0.8035
No log	5.2326	450	0.6350	0.7619	0.6350	0.7968
No log	5.2558	452	0.6253	0.7568	0.6253	0.7907
No log	5.2791	454	0.5670	0.8212	0.5670	0.7530
No log	5.3023	456	0.5121	0.8280	0.5121	0.7156
No log	5.3256	458	0.5626	0.7898	0.5626	0.7501
No log	5.3488	460	0.5517	0.7799	0.5517	0.7428
No log	5.3721	462	0.4982	0.8272	0.4982	0.7059
No log	5.3953	464	0.4557	0.8125	0.4557	0.6751
No log	5.4186	466	0.5896	0.7815	0.5896	0.7678
No log	5.4419	468	0.7980	0.6849	0.7980	0.8933
No log	5.4651	470	0.8710	0.6667	0.8710	0.9333
No log	5.4884	472	0.7664	0.6713	0.7664	0.8755
No log	5.5116	474	0.6428	0.76	0.6428	0.8018
No log	5.5349	476	0.5561	0.8	0.5561	0.7457
No log	5.5581	478	0.5394	0.8267	0.5394	0.7345
No log	5.5814	480	0.5418	0.8	0.5418	0.7361
No log	5.6047	482	0.5948	0.7703	0.5948	0.7712
No log	5.6279	484	0.6286	0.7534	0.6286	0.7929
No log	5.6512	486	0.5915	0.7619	0.5915	0.7691
No log	5.6744	488	0.5564	0.8	0.5564	0.7459
No log	5.6977	490	0.5466	0.7947	0.5466	0.7393
No log	5.7209	492	0.5704	0.7651	0.5704	0.7552
No log	5.7442	494	0.6160	0.7568	0.6160	0.7849
No log	5.7674	496	0.5847	0.7568	0.5847	0.7647
No log	5.7907	498	0.5198	0.7947	0.5198	0.7209
0.4348	5.8140	500	0.5252	0.8312	0.5252	0.7247
0.4348	5.8372	502	0.6934	0.7308	0.6934	0.8327
0.4348	5.8605	504	0.8490	0.6842	0.8490	0.9214
0.4348	5.8837	506	0.8424	0.6486	0.8424	0.9178
0.4348	5.9070	508	0.7746	0.7050	0.7746	0.8801
0.4348	5.9302	510	0.6925	0.7206	0.6925	0.8322

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1