ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5070
• Qwk: 0.3882
• Mse: 0.5070
• Rmse: 0.7120

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	3.1327	0.0014	3.1327	1.7699
No log	0.0769	4	1.5165	0.0168	1.5165	1.2315
No log	0.1154	6	0.8834	0.0661	0.8834	0.9399
No log	0.1538	8	0.9111	0.1525	0.9111	0.9545
No log	0.1923	10	0.6326	0.0815	0.6326	0.7954
No log	0.2308	12	0.6472	0.0388	0.6472	0.8045
No log	0.2692	14	0.5698	-0.0159	0.5698	0.7548
No log	0.3077	16	0.6737	0.2917	0.6737	0.8208
No log	0.3462	18	0.5977	0.2418	0.5977	0.7731
No log	0.3846	20	0.5319	0.1206	0.5319	0.7293
No log	0.4231	22	0.6993	0.2410	0.6993	0.8362
No log	0.4615	24	0.6414	0.2593	0.6414	0.8009
No log	0.5	26	0.5454	0.0	0.5454	0.7385
No log	0.5385	28	0.6325	0.0	0.6325	0.7953
No log	0.5769	30	0.5977	0.0	0.5977	0.7731
No log	0.6154	32	0.5381	0.0	0.5381	0.7336
No log	0.6538	34	0.6487	0.3333	0.6487	0.8054
No log	0.6923	36	0.6026	0.2889	0.6026	0.7763
No log	0.7308	38	0.5793	0.0815	0.5793	0.7611
No log	0.7692	40	0.5933	0.3333	0.5933	0.7702
No log	0.8077	42	1.0187	0.0794	1.0187	1.0093
No log	0.8462	44	1.3354	0.0345	1.3354	1.1556
No log	0.8846	46	1.2738	0.0698	1.2738	1.1286
No log	0.9231	48	0.8225	0.0843	0.8225	0.9069
No log	0.9615	50	0.5763	0.3086	0.5763	0.7591
No log	1.0	52	0.5226	0.1111	0.5226	0.7229
No log	1.0385	54	0.5090	0.0569	0.5090	0.7135
No log	1.0769	56	0.5124	0.0303	0.5124	0.7158
No log	1.1154	58	0.5369	0.0725	0.5369	0.7327
No log	1.1538	60	0.6772	0.2083	0.6772	0.8229
No log	1.1923	62	0.7020	0.2169	0.7020	0.8379
No log	1.2308	64	1.0359	0.1795	1.0359	1.0178
No log	1.2692	66	0.6886	0.1556	0.6886	0.8298
No log	1.3077	68	0.7954	0.2000	0.7954	0.8918
No log	1.3462	70	0.7422	0.2464	0.7422	0.8615
No log	1.3846	72	0.7199	0.2549	0.7199	0.8484
No log	1.4231	74	0.5163	0.2593	0.5163	0.7185
No log	1.4615	76	0.8670	0.2340	0.8670	0.9312
No log	1.5	78	0.6768	0.3333	0.6768	0.8227
No log	1.5385	80	0.6964	0.3214	0.6964	0.8345
No log	1.5769	82	1.8880	0.0667	1.8880	1.3740
No log	1.6154	84	1.9029	0.0336	1.9029	1.3795
No log	1.6538	86	1.1195	0.1429	1.1195	1.0581
No log	1.6923	88	0.5058	0.0815	0.5058	0.7112
No log	1.7308	90	0.8067	-0.0462	0.8067	0.8982
No log	1.7692	92	0.7802	-0.0560	0.7802	0.8833
No log	1.8077	94	0.7172	-0.1429	0.7172	0.8469
No log	1.8462	96	0.6791	0.0569	0.6791	0.8241
No log	1.8846	98	0.7522	0.1481	0.7522	0.8673
No log	1.9231	100	0.8401	0.2479	0.8401	0.9166
No log	1.9615	102	0.7368	0.2381	0.7368	0.8584
No log	2.0	104	0.5527	0.2970	0.5527	0.7435
No log	2.0385	106	0.5222	0.1773	0.5222	0.7226
No log	2.0769	108	0.6172	0.2637	0.6172	0.7856
No log	2.1154	110	1.2035	0.0698	1.2035	1.0970
No log	2.1538	112	1.2292	0.0345	1.2292	1.1087
No log	2.1923	114	0.8294	0.1934	0.8294	0.9107
No log	2.2308	116	0.4823	0.0857	0.4823	0.6944
No log	2.2692	118	0.5000	0.2552	0.5000	0.7071
No log	2.3077	120	0.5410	0.2516	0.5410	0.7355
No log	2.3462	122	0.4877	0.3247	0.4877	0.6983
No log	2.3846	124	0.5834	0.3860	0.5834	0.7638
No log	2.4231	126	1.2090	0.1587	1.2090	1.0995
No log	2.4615	128	1.1670	0.1940	1.1670	1.0803
No log	2.5	130	0.5793	0.2793	0.5793	0.7611
No log	2.5385	132	0.6618	0.3191	0.6618	0.8135
No log	2.5769	134	1.1042	0.1238	1.1042	1.0508
No log	2.6154	136	1.1195	0.1238	1.1195	1.0580
No log	2.6538	138	0.6430	0.3191	0.6430	0.8019
No log	2.6923	140	0.4828	0.3591	0.4828	0.6948
No log	2.7308	142	0.5888	0.3427	0.5888	0.7673
No log	2.7692	144	0.5360	0.3831	0.5360	0.7321
No log	2.8077	146	0.4983	0.3609	0.4983	0.7059
No log	2.8462	148	0.8782	0.2308	0.8782	0.9371
No log	2.8846	150	0.8315	0.2000	0.8315	0.9118
No log	2.9231	152	0.4826	0.3882	0.4826	0.6947
No log	2.9615	154	0.6042	0.3462	0.6042	0.7773
No log	3.0	156	1.0585	0.2296	1.0585	1.0288
No log	3.0385	158	0.9549	0.2653	0.9549	0.9772
No log	3.0769	160	0.5914	0.3990	0.5914	0.7690
No log	3.1154	162	0.5009	0.3455	0.5009	0.7077
No log	3.1538	164	0.6269	0.2941	0.6269	0.7917
No log	3.1923	166	0.5624	0.3032	0.5624	0.7499
No log	3.2308	168	0.4748	0.2418	0.4748	0.6890
No log	3.2692	170	0.5201	0.2914	0.5201	0.7212
No log	3.3077	172	0.5340	0.2360	0.5340	0.7308
No log	3.3462	174	0.4896	0.3333	0.4896	0.6997
No log	3.3846	176	0.5075	0.3216	0.5075	0.7124
No log	3.4231	178	0.5935	0.3797	0.5935	0.7704
No log	3.4615	180	0.6505	0.2793	0.6505	0.8065
No log	3.5	182	0.6859	0.2775	0.6859	0.8282
No log	3.5385	184	0.5963	0.3831	0.5963	0.7722
No log	3.5769	186	0.5618	0.3333	0.5618	0.7495
No log	3.6154	188	0.5625	0.3439	0.5625	0.7500
No log	3.6538	190	0.5554	0.3548	0.5554	0.7452
No log	3.6923	192	0.5763	0.4162	0.5763	0.7592
No log	3.7308	194	0.5349	0.3118	0.5349	0.7314
No log	3.7692	196	0.5471	0.3191	0.5471	0.7396
No log	3.8077	198	0.5217	0.3191	0.5217	0.7223
No log	3.8462	200	0.5289	0.3778	0.5289	0.7272
No log	3.8846	202	0.5218	0.3488	0.5218	0.7224
No log	3.9231	204	0.4787	0.3684	0.4787	0.6919
No log	3.9615	206	0.4876	0.3023	0.4876	0.6983
No log	4.0	208	0.4676	0.35	0.4676	0.6838
No log	4.0385	210	0.4596	0.3067	0.4596	0.6780
No log	4.0769	212	0.5317	0.3292	0.5317	0.7292
No log	4.1154	214	0.5693	0.3591	0.5693	0.7545
No log	4.1538	216	0.5191	0.3533	0.5191	0.7205
No log	4.1923	218	0.4685	0.5122	0.4685	0.6845
No log	4.2308	220	0.4772	0.4682	0.4772	0.6908
No log	4.2692	222	0.5116	0.3446	0.5116	0.7153
No log	4.3077	224	0.5238	0.4583	0.5238	0.7237
No log	4.3462	226	0.6173	0.3761	0.6173	0.7857
No log	4.3846	228	0.5804	0.4171	0.5804	0.7619
No log	4.4231	230	0.6184	0.3929	0.6184	0.7864
No log	4.4615	232	0.6946	0.3973	0.6946	0.8334
No log	4.5	234	0.7229	0.3929	0.7229	0.8503
No log	4.5385	236	0.5563	0.4227	0.5563	0.7458
No log	4.5769	238	0.5867	0.2917	0.5867	0.7660
No log	4.6154	240	0.6048	0.3769	0.6048	0.7777
No log	4.6538	242	0.5234	0.3182	0.5234	0.7235
No log	4.6923	244	0.5319	0.3978	0.5319	0.7293
No log	4.7308	246	0.5212	0.3846	0.5212	0.7220
No log	4.7692	248	0.5202	0.3333	0.5202	0.7213
No log	4.8077	250	0.5338	0.3846	0.5338	0.7306
No log	4.8462	252	0.6411	0.3524	0.6411	0.8007
No log	4.8846	254	0.8072	0.3473	0.8072	0.8985
No log	4.9231	256	0.6915	0.3793	0.6915	0.8316
No log	4.9615	258	0.6044	0.4185	0.6044	0.7774
No log	5.0	260	0.5360	0.3297	0.5360	0.7321
No log	5.0385	262	0.5355	0.3191	0.5355	0.7318
No log	5.0769	264	0.5311	0.3846	0.5311	0.7288
No log	5.1154	266	0.6214	0.3394	0.6214	0.7883
No log	5.1538	268	0.6579	0.3488	0.6579	0.8111
No log	5.1923	270	0.5301	0.3617	0.5301	0.7281
No log	5.2308	272	0.5048	0.4607	0.5048	0.7105
No log	5.2692	274	0.5070	0.4220	0.5070	0.7121
No log	5.3077	276	0.5127	0.4227	0.5127	0.7160
No log	5.3462	278	0.6753	0.3645	0.6753	0.8218
No log	5.3846	280	0.7054	0.3188	0.7054	0.8399
No log	5.4231	282	0.5441	0.3469	0.5441	0.7376
No log	5.4615	284	0.5219	0.3730	0.5219	0.7225
No log	5.5	286	0.5428	0.4098	0.5428	0.7367
No log	5.5385	288	0.5181	0.3617	0.5181	0.7198
No log	5.5769	290	0.6140	0.3623	0.6140	0.7836
No log	5.6154	292	0.6187	0.3585	0.6187	0.7866
No log	5.6538	294	0.5684	0.3508	0.5684	0.7540
No log	5.6923	296	0.5443	0.3263	0.5443	0.7377
No log	5.7308	298	0.5802	0.3469	0.5802	0.7617
No log	5.7692	300	0.5735	0.3016	0.5735	0.7573
No log	5.8077	302	0.5429	0.2889	0.5429	0.7368
No log	5.8462	304	0.5425	0.1908	0.5425	0.7366
No log	5.8846	306	0.5484	0.3297	0.5484	0.7405
No log	5.9231	308	0.6030	0.4343	0.6030	0.7765
No log	5.9615	310	0.5792	0.4286	0.5792	0.7610
No log	6.0	312	0.5288	0.2889	0.5288	0.7272
No log	6.0385	314	0.5204	0.3136	0.5204	0.7214
No log	6.0769	316	0.5522	0.2727	0.5522	0.7431
No log	6.1154	318	0.5074	0.2683	0.5074	0.7123
No log	6.1538	320	0.4982	0.4152	0.4982	0.7058
No log	6.1923	322	0.5552	0.3407	0.5552	0.7451
No log	6.2308	324	0.5361	0.3333	0.5361	0.7322
No log	6.2692	326	0.4808	0.4217	0.4808	0.6934
No log	6.3077	328	0.4719	0.4634	0.4719	0.6869
No log	6.3462	330	0.4770	0.4217	0.4770	0.6906
No log	6.3846	332	0.5022	0.3865	0.5022	0.7086
No log	6.4231	334	0.5142	0.3865	0.5142	0.7170
No log	6.4615	336	0.4904	0.4217	0.4904	0.7003
No log	6.5	338	0.4870	0.4217	0.4870	0.6978
No log	6.5385	340	0.5177	0.35	0.5177	0.7195
No log	6.5769	342	0.5379	0.3659	0.5379	0.7334
No log	6.6154	344	0.5572	0.3520	0.5572	0.7465
No log	6.6538	346	0.5300	0.4012	0.5300	0.7280
No log	6.6923	348	0.4896	0.3735	0.4896	0.6997
No log	6.7308	350	0.4784	0.3882	0.4784	0.6917
No log	6.7692	352	0.4846	0.3735	0.4846	0.6961
No log	6.8077	354	0.5063	0.4152	0.5063	0.7115
No log	6.8462	356	0.5069	0.4152	0.5069	0.7120
No log	6.8846	358	0.4865	0.4286	0.4865	0.6975
No log	6.9231	360	0.4864	0.4286	0.4864	0.6974
No log	6.9615	362	0.5067	0.4091	0.5067	0.7119
No log	7.0	364	0.5401	0.4051	0.5401	0.7349
No log	7.0385	366	0.5609	0.4167	0.5609	0.7489
No log	7.0769	368	0.5201	0.4286	0.5201	0.7212
No log	7.1154	370	0.4925	0.3000	0.4925	0.7018
No log	7.1538	372	0.5394	0.2370	0.5394	0.7345
No log	7.1923	374	0.5880	0.2179	0.5880	0.7668
No log	7.2308	376	0.5583	0.2727	0.5583	0.7472
No log	7.2692	378	0.5010	0.2405	0.5010	0.7078
No log	7.3077	380	0.4939	0.2821	0.4939	0.7028
No log	7.3462	382	0.5034	0.2632	0.5034	0.7095
No log	7.3846	384	0.5460	0.4483	0.5460	0.7389
No log	7.4231	386	0.5782	0.3769	0.5782	0.7604
No log	7.4615	388	0.5634	0.4227	0.5634	0.7506
No log	7.5	390	0.5093	0.4012	0.5093	0.7136
No log	7.5385	392	0.4924	0.2704	0.4924	0.7017
No log	7.5769	394	0.5380	0.2471	0.5380	0.7335
No log	7.6154	396	0.5825	0.2088	0.5825	0.7632
No log	7.6538	398	0.5606	0.2370	0.5606	0.7487
No log	7.6923	400	0.5104	0.2298	0.5104	0.7144
No log	7.7308	402	0.4963	0.2533	0.4963	0.7045
No log	7.7692	404	0.5057	0.2632	0.5057	0.7111
No log	7.8077	406	0.5083	0.3121	0.5083	0.7130
No log	7.8462	408	0.5048	0.2632	0.5048	0.7105
No log	7.8846	410	0.4935	0.2418	0.4935	0.7025
No log	7.9231	412	0.5076	0.1899	0.5076	0.7124
No log	7.9615	414	0.5258	0.2941	0.5258	0.7251
No log	8.0	416	0.5248	0.2941	0.5248	0.7244
No log	8.0385	418	0.5042	0.1899	0.5042	0.7100
No log	8.0769	420	0.4917	0.2418	0.4917	0.7012
No log	8.1154	422	0.5277	0.4483	0.5277	0.7264
No log	8.1538	424	0.5872	0.3814	0.5872	0.7663
No log	8.1923	426	0.5966	0.3725	0.5966	0.7724
No log	8.2308	428	0.5602	0.3814	0.5602	0.7485
No log	8.2692	430	0.5105	0.4074	0.5105	0.7145
No log	8.3077	432	0.4929	0.25	0.4929	0.7021
No log	8.3462	434	0.4947	0.2883	0.4947	0.7033
No log	8.3846	436	0.4931	0.25	0.4931	0.7022
No log	8.4231	438	0.4930	0.2593	0.4930	0.7021
No log	8.4615	440	0.4932	0.2883	0.4932	0.7023
No log	8.5	442	0.4929	0.2970	0.4929	0.7020
No log	8.5385	444	0.4936	0.3412	0.4936	0.7025
No log	8.5769	446	0.4981	0.4152	0.4981	0.7058
No log	8.6154	448	0.5017	0.4152	0.5017	0.7083
No log	8.6538	450	0.5160	0.3882	0.5160	0.7183
No log	8.6923	452	0.5139	0.3882	0.5139	0.7169
No log	8.7308	454	0.5001	0.4152	0.5001	0.7072
No log	8.7692	456	0.4950	0.3735	0.4950	0.7036
No log	8.8077	458	0.4950	0.3292	0.4950	0.7035
No log	8.8462	460	0.4928	0.3292	0.4928	0.7020
No log	8.8846	462	0.4957	0.2911	0.4957	0.7041
No log	8.9231	464	0.5025	0.3455	0.5025	0.7089
No log	8.9615	466	0.5096	0.3533	0.5096	0.7139
No log	9.0	468	0.5116	0.3659	0.5116	0.7152
No log	9.0385	470	0.5110	0.3659	0.5110	0.7148
No log	9.0769	472	0.5005	0.3333	0.5005	0.7074
No log	9.1154	474	0.4923	0.2704	0.4923	0.7016
No log	9.1538	476	0.4913	0.2704	0.4913	0.7010
No log	9.1923	478	0.4918	0.2704	0.4918	0.7013
No log	9.2308	480	0.4921	0.3086	0.4921	0.7015
No log	9.2692	482	0.4922	0.3086	0.4922	0.7016
No log	9.3077	484	0.4928	0.3086	0.4928	0.7020
No log	9.3462	486	0.4936	0.3086	0.4936	0.7026
No log	9.3846	488	0.4943	0.3086	0.4943	0.7030
No log	9.4231	490	0.4955	0.3086	0.4955	0.7039
No log	9.4615	492	0.4968	0.3659	0.4968	0.7049
No log	9.5	494	0.5007	0.3735	0.5007	0.7076
No log	9.5385	496	0.5081	0.4091	0.5081	0.7128
No log	9.5769	498	0.5165	0.3533	0.5165	0.7187
0.4126	9.6154	500	0.5178	0.3533	0.5178	0.7196
0.4126	9.6538	502	0.5134	0.3533	0.5134	0.7165
0.4126	9.6923	504	0.5083	0.4091	0.5083	0.7129
0.4126	9.7308	506	0.5079	0.4091	0.5079	0.7127
0.4126	9.7692	508	0.5080	0.4091	0.5080	0.7127
0.4126	9.8077	510	0.5090	0.3757	0.5090	0.7134
0.4126	9.8462	512	0.5084	0.3757	0.5084	0.7130
0.4126	9.8846	514	0.5081	0.3882	0.5081	0.7128
0.4126	9.9231	516	0.5074	0.3882	0.5074	0.7123
0.4126	9.9615	518	0.5070	0.3882	0.5070	0.7120
0.4126	10.0	520	0.5070	0.3882	0.5070	0.7120

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1