ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8671
• Qwk: 0.6667
• Mse: 0.8671
• Rmse: 0.9312

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0274	2	6.8048	-0.0171	6.8048	2.6086
No log	0.0548	4	4.2786	0.0606	4.2786	2.0685
No log	0.0822	6	4.1909	-0.0796	4.1909	2.0472
No log	0.1096	8	3.2784	-0.0588	3.2784	1.8106
No log	0.1370	10	2.1345	0.1111	2.1345	1.4610
No log	0.1644	12	1.8554	0.1852	1.8554	1.3621
No log	0.1918	14	1.8673	0.1495	1.8673	1.3665
No log	0.2192	16	2.0601	0.1579	2.0601	1.4353
No log	0.2466	18	1.9771	0.1455	1.9771	1.4061
No log	0.2740	20	1.8333	0.1714	1.8333	1.3540
No log	0.3014	22	1.8039	0.1261	1.8039	1.3431
No log	0.3288	24	1.9430	0.0513	1.9430	1.3939
No log	0.3562	26	1.8058	0.1239	1.8058	1.3438
No log	0.3836	28	1.5277	0.1333	1.5277	1.2360
No log	0.4110	30	1.7509	0.3419	1.7509	1.3232
No log	0.4384	32	1.8548	0.3667	1.8548	1.3619
No log	0.4658	34	2.1132	0.1871	2.1132	1.4537
No log	0.4932	36	1.9910	0.2044	1.9910	1.4110
No log	0.5205	38	1.4451	0.4068	1.4451	1.2021
No log	0.5479	40	1.2057	0.3717	1.2057	1.0980
No log	0.5753	42	1.2320	0.4035	1.2320	1.1100
No log	0.6027	44	1.2475	0.2909	1.2475	1.1169
No log	0.6301	46	1.2609	0.3393	1.2609	1.1229
No log	0.6575	48	1.3355	0.3866	1.3355	1.1556
No log	0.6849	50	1.5232	0.3529	1.5232	1.2342
No log	0.7123	52	1.5761	0.3000	1.5761	1.2554
No log	0.7397	54	1.4104	0.3761	1.4104	1.1876
No log	0.7671	56	1.2463	0.4065	1.2463	1.1164
No log	0.7945	58	1.1960	0.4545	1.1960	1.0936
No log	0.8219	60	1.0443	0.5238	1.0443	1.0219
No log	0.8493	62	0.9246	0.625	0.9246	0.9615
No log	0.8767	64	0.8779	0.625	0.8779	0.9370
No log	0.9041	66	0.9821	0.5547	0.9821	0.9910
No log	0.9315	68	1.0061	0.5612	1.0061	1.0031
No log	0.9589	70	0.9782	0.5612	0.9782	0.9890
No log	0.9863	72	0.7926	0.6619	0.7926	0.8903
No log	1.0137	74	0.9521	0.5645	0.9521	0.9757
No log	1.0411	76	1.4886	0.3967	1.4886	1.2201
No log	1.0685	78	1.3024	0.4959	1.3024	1.1412
No log	1.0959	80	0.9158	0.6412	0.9158	0.9570
No log	1.1233	82	0.9352	0.6241	0.9352	0.9670
No log	1.1507	84	1.0375	0.5931	1.0375	1.0186
No log	1.1781	86	0.8567	0.6475	0.8567	0.9256
No log	1.2055	88	0.9351	0.5891	0.9351	0.9670
No log	1.2329	90	0.9959	0.6061	0.9959	0.9979
No log	1.2603	92	0.8792	0.6462	0.8792	0.9377
No log	1.2877	94	1.0293	0.5203	1.0292	1.0145
No log	1.3151	96	1.2159	0.4615	1.2159	1.1027
No log	1.3425	98	0.9745	0.4667	0.9745	0.9872
No log	1.3699	100	1.0286	0.6080	1.0286	1.0142
No log	1.3973	102	1.2564	0.5484	1.2564	1.1209
No log	1.4247	104	1.1583	0.5760	1.1583	1.0762
No log	1.4521	106	0.9024	0.6615	0.9024	0.9500
No log	1.4795	108	1.0939	0.5811	1.0939	1.0459
No log	1.5068	110	1.1825	0.5897	1.1825	1.0874
No log	1.5342	112	0.8192	0.7284	0.8192	0.9051
No log	1.5616	114	0.5810	0.7639	0.5810	0.7623
No log	1.5890	116	0.6187	0.7397	0.6187	0.7866
No log	1.6164	118	0.7412	0.7347	0.7412	0.8609
No log	1.6438	120	0.8529	0.6423	0.8529	0.9235
No log	1.6712	122	0.8168	0.6466	0.8168	0.9038
No log	1.6986	124	0.8987	0.6269	0.8987	0.9480
No log	1.7260	126	0.9273	0.6222	0.9273	0.9630
No log	1.7534	128	0.9792	0.6277	0.9792	0.9896
No log	1.7808	130	0.9292	0.6277	0.9292	0.9640
No log	1.8082	132	0.9053	0.6912	0.9053	0.9515
No log	1.8356	134	0.9300	0.6912	0.9300	0.9644
No log	1.8630	136	0.8388	0.7050	0.8388	0.9159
No log	1.8904	138	0.7099	0.7692	0.7099	0.8425
No log	1.9178	140	0.6062	0.8258	0.6062	0.7786
No log	1.9452	142	0.5838	0.8125	0.5838	0.7641
No log	1.9726	144	0.6488	0.7722	0.6488	0.8055
No log	2.0	146	0.6780	0.7320	0.6780	0.8234
No log	2.0274	148	0.6603	0.7582	0.6603	0.8126
No log	2.0548	150	0.6637	0.7733	0.6637	0.8147
No log	2.0822	152	0.6768	0.7619	0.6768	0.8227
No log	2.1096	154	0.7825	0.7050	0.7825	0.8846
No log	2.1370	156	0.8561	0.6906	0.8561	0.9252
No log	2.1644	158	0.8267	0.7	0.8267	0.9092
No log	2.1918	160	0.8221	0.6475	0.8221	0.9067
No log	2.2192	162	0.7780	0.6993	0.7780	0.8821
No log	2.2466	164	0.6792	0.7945	0.6792	0.8242
No log	2.2740	166	0.8273	0.6806	0.8273	0.9096
No log	2.3014	168	0.7968	0.6944	0.7968	0.8926
No log	2.3288	170	0.6477	0.7568	0.6477	0.8048
No log	2.3562	172	0.6312	0.7763	0.6312	0.7945
No log	2.3836	174	0.6406	0.7632	0.6406	0.8004
No log	2.4110	176	0.7271	0.7248	0.7271	0.8527
No log	2.4384	178	0.6972	0.7222	0.6972	0.8350
No log	2.4658	180	0.8556	0.7310	0.8556	0.9250
No log	2.4932	182	0.8677	0.6950	0.8677	0.9315
No log	2.5205	184	0.8396	0.6812	0.8396	0.9163
No log	2.5479	186	0.8919	0.6377	0.8919	0.9444
No log	2.5753	188	0.8874	0.6377	0.8874	0.9420
No log	2.6027	190	0.8559	0.7092	0.8559	0.9252
No log	2.6301	192	0.8713	0.7194	0.8713	0.9334
No log	2.6575	194	0.8404	0.7273	0.8404	0.9167
No log	2.6849	196	0.8084	0.7234	0.8084	0.8991
No log	2.7123	198	0.8671	0.6809	0.8671	0.9312
No log	2.7397	200	0.9037	0.6809	0.9037	0.9506
No log	2.7671	202	0.8397	0.7234	0.8397	0.9164
No log	2.7945	204	0.9057	0.7153	0.9057	0.9517
No log	2.8219	206	0.9363	0.6719	0.9363	0.9676
No log	2.8493	208	0.8949	0.6519	0.8949	0.9460
No log	2.8767	210	0.8554	0.6383	0.8554	0.9249
No log	2.9041	212	0.7208	0.7534	0.7208	0.8490
No log	2.9315	214	0.6797	0.7383	0.6797	0.8244
No log	2.9589	216	0.7258	0.7383	0.7258	0.8519
No log	2.9863	218	0.7771	0.7285	0.7771	0.8815
No log	3.0137	220	0.7248	0.7891	0.7248	0.8514
No log	3.0411	222	0.6496	0.8	0.6496	0.8060
No log	3.0685	224	0.6708	0.7692	0.6708	0.8190
No log	3.0959	226	0.6566	0.7821	0.6566	0.8103
No log	3.1233	228	0.6339	0.8	0.6339	0.7962
No log	3.1507	230	0.6737	0.7922	0.6737	0.8208
No log	3.1781	232	0.6563	0.7922	0.6563	0.8101
No log	3.2055	234	0.6560	0.8105	0.6560	0.8099
No log	3.2329	236	0.6925	0.7838	0.6925	0.8322
No log	3.2603	238	0.7416	0.7552	0.7416	0.8612
No log	3.2877	240	0.8045	0.7007	0.8045	0.8969
No log	3.3151	242	0.7998	0.7246	0.7998	0.8943
No log	3.3425	244	0.7613	0.6993	0.7613	0.8725
No log	3.3699	246	0.7082	0.7114	0.7082	0.8416
No log	3.3973	248	0.5862	0.8	0.5862	0.7657
No log	3.4247	250	0.5848	0.8125	0.5848	0.7647
No log	3.4521	252	0.5198	0.8101	0.5198	0.7210
No log	3.4795	254	0.5136	0.7821	0.5136	0.7166
No log	3.5068	256	0.5423	0.7815	0.5423	0.7364
No log	3.5342	258	0.6125	0.7586	0.6125	0.7826
No log	3.5616	260	0.6697	0.7143	0.6697	0.8183
No log	3.5890	262	0.6738	0.7143	0.6738	0.8208
No log	3.6164	264	0.6731	0.7887	0.6731	0.8204
No log	3.6438	266	0.7214	0.7714	0.7214	0.8493
No log	3.6712	268	0.7386	0.7206	0.7386	0.8594
No log	3.6986	270	0.7195	0.6866	0.7195	0.8482
No log	3.7260	272	0.6888	0.7273	0.6888	0.8299
No log	3.7534	274	0.6589	0.7586	0.6589	0.8117
No log	3.7808	276	0.6933	0.7310	0.6933	0.8327
No log	3.8082	278	0.7776	0.6667	0.7776	0.8818
No log	3.8356	280	0.7682	0.6565	0.7682	0.8765
No log	3.8630	282	0.8235	0.6716	0.8235	0.9075
No log	3.8904	284	0.9358	0.6370	0.9358	0.9674
No log	3.9178	286	0.8598	0.6861	0.8598	0.9272
No log	3.9452	288	0.8103	0.6906	0.8103	0.9001
No log	3.9726	290	0.7898	0.7042	0.7898	0.8887
No log	4.0	292	0.8030	0.7	0.8030	0.8961
No log	4.0274	294	0.8680	0.6906	0.8680	0.9317
No log	4.0548	296	0.9095	0.6383	0.9095	0.9537
No log	4.0822	298	0.8526	0.6621	0.8526	0.9234
No log	4.1096	300	0.6862	0.7432	0.6862	0.8284
No log	4.1370	302	0.6421	0.7862	0.6421	0.8013
No log	4.1644	304	0.7119	0.6667	0.7119	0.8438
No log	4.1918	306	0.7365	0.6619	0.7365	0.8582
No log	4.2192	308	0.7282	0.7376	0.7282	0.8533
No log	4.2466	310	0.8242	0.6901	0.8242	0.9079
No log	4.2740	312	0.8759	0.6806	0.8759	0.9359
No log	4.3014	314	0.7925	0.7211	0.7925	0.8902
No log	4.3288	316	0.6496	0.7568	0.6496	0.8060
No log	4.3562	318	0.6195	0.8027	0.6195	0.7871
No log	4.3836	320	0.6413	0.7586	0.6413	0.8008
No log	4.4110	322	0.7597	0.7310	0.7597	0.8716
No log	4.4384	324	0.8958	0.6761	0.8958	0.9465
No log	4.4658	326	0.9254	0.6383	0.9254	0.9620
No log	4.4932	328	0.9500	0.6338	0.9500	0.9747
No log	4.5205	330	0.7707	0.7027	0.7707	0.8779
No log	4.5479	332	0.6331	0.7347	0.6331	0.7957
No log	4.5753	334	0.6451	0.7397	0.6451	0.8032
No log	4.6027	336	0.7799	0.6761	0.7799	0.8831
No log	4.6301	338	0.8103	0.6667	0.8103	0.9002
No log	4.6575	340	0.8127	0.6714	0.8127	0.9015
No log	4.6849	342	0.7292	0.7324	0.7292	0.8539
No log	4.7123	344	0.7353	0.7234	0.7353	0.8575
No log	4.7397	346	0.7315	0.7143	0.7315	0.8553
No log	4.7671	348	0.7106	0.7286	0.7106	0.8430
No log	4.7945	350	0.7212	0.7286	0.7212	0.8492
No log	4.8219	352	0.7582	0.7194	0.7582	0.8708
No log	4.8493	354	0.7114	0.7413	0.7114	0.8434
No log	4.8767	356	0.6934	0.7586	0.6934	0.8327
No log	4.9041	358	0.7390	0.7448	0.7390	0.8596
No log	4.9315	360	0.6957	0.7808	0.6957	0.8341
No log	4.9589	362	0.6946	0.7273	0.6946	0.8334
No log	4.9863	364	0.6910	0.7222	0.6910	0.8313
No log	5.0137	366	0.6216	0.7568	0.6216	0.7884
No log	5.0411	368	0.5922	0.7947	0.5922	0.7696
No log	5.0685	370	0.6381	0.8105	0.6381	0.7988
No log	5.0959	372	0.6550	0.7755	0.6550	0.8093
No log	5.1233	374	0.6455	0.7808	0.6455	0.8034
No log	5.1507	376	0.7676	0.7	0.7676	0.8761
No log	5.1781	378	0.9780	0.6429	0.9780	0.9889
No log	5.2055	380	1.0130	0.6418	1.0130	1.0065
No log	5.2329	382	0.9415	0.6418	0.9415	0.9703
No log	5.2603	384	0.8266	0.7286	0.8266	0.9092
No log	5.2877	386	0.7032	0.7671	0.7032	0.8386
No log	5.3151	388	0.6268	0.7671	0.6268	0.7917
No log	5.3425	390	0.6509	0.7532	0.6509	0.8068
No log	5.3699	392	0.7046	0.75	0.7046	0.8394
No log	5.3973	394	0.7064	0.7403	0.7064	0.8405
No log	5.4247	396	0.6326	0.7297	0.6326	0.7954
No log	5.4521	398	0.6115	0.7808	0.6115	0.7820
No log	5.4795	400	0.6993	0.7376	0.6993	0.8362
No log	5.5068	402	0.7293	0.6957	0.7293	0.8540
No log	5.5342	404	0.7391	0.7194	0.7391	0.8597
No log	5.5616	406	0.7843	0.7092	0.7843	0.8856
No log	5.5890	408	0.7153	0.7310	0.7153	0.8457
No log	5.6164	410	0.6331	0.7568	0.6331	0.7957
No log	5.6438	412	0.5657	0.7703	0.5657	0.7521
No log	5.6712	414	0.5308	0.8182	0.5308	0.7286
No log	5.6986	416	0.6264	0.7949	0.6264	0.7915
No log	5.7260	418	0.6868	0.7692	0.6868	0.8287
No log	5.7534	420	0.6015	0.8205	0.6015	0.7756
No log	5.7808	422	0.6605	0.7310	0.6605	0.8127
No log	5.8082	424	0.8988	0.6806	0.8988	0.9480
No log	5.8356	426	0.9855	0.6383	0.9855	0.9927
No log	5.8630	428	0.9132	0.6806	0.9132	0.9556
No log	5.8904	430	0.7847	0.75	0.7847	0.8858
No log	5.9178	432	0.7080	0.7703	0.7080	0.8414
No log	5.9452	434	0.6866	0.7742	0.6866	0.8286
No log	5.9726	436	0.6596	0.7771	0.6596	0.8121
No log	6.0	438	0.6406	0.7871	0.6406	0.8004
No log	6.0274	440	0.6518	0.7871	0.6518	0.8073
No log	6.0548	442	0.7502	0.7075	0.7502	0.8662
No log	6.0822	444	0.8613	0.6759	0.8613	0.9280
No log	6.1096	446	0.8733	0.6906	0.8733	0.9345
No log	6.1370	448	0.8185	0.7234	0.8185	0.9047
No log	6.1644	450	0.8110	0.7183	0.8110	0.9006
No log	6.1918	452	0.8128	0.6897	0.8128	0.9015
No log	6.2192	454	0.7472	0.7347	0.7472	0.8644
No log	6.2466	456	0.6685	0.7974	0.6685	0.8176
No log	6.2740	458	0.6131	0.8129	0.6131	0.7830
No log	6.3014	460	0.5667	0.8280	0.5667	0.7528
No log	6.3288	462	0.5428	0.8375	0.5428	0.7368
No log	6.3562	464	0.5266	0.8344	0.5266	0.7257
No log	6.3836	466	0.5274	0.8272	0.5274	0.7262
No log	6.4110	468	0.5777	0.7468	0.5777	0.7601
No log	6.4384	470	0.5884	0.7673	0.5884	0.7671
No log	6.4658	472	0.5629	0.8125	0.5629	0.7503
No log	6.4932	474	0.5768	0.8025	0.5768	0.7595
No log	6.5205	476	0.5595	0.8125	0.5595	0.7480
No log	6.5479	478	0.5879	0.8428	0.5879	0.7667
No log	6.5753	480	0.7305	0.8075	0.7305	0.8547
No log	6.6027	482	0.8978	0.6982	0.8978	0.9475
No log	6.6301	484	0.8531	0.7066	0.8531	0.9236
No log	6.6575	486	0.6602	0.8221	0.6602	0.8125
No log	6.6849	488	0.5144	0.8228	0.5144	0.7172
No log	6.7123	490	0.5718	0.7898	0.5718	0.7562
No log	6.7397	492	0.6704	0.7561	0.6704	0.8188
No log	6.7671	494	0.6437	0.7730	0.6437	0.8023
No log	6.7945	496	0.5700	0.7879	0.5700	0.7550
No log	6.8219	498	0.5689	0.775	0.5689	0.7543
0.4296	6.8493	500	0.5906	0.7673	0.5906	0.7685
0.4296	6.8767	502	0.5925	0.7799	0.5925	0.7697
0.4296	6.9041	504	0.5722	0.7975	0.5722	0.7565
0.4296	6.9315	506	0.5798	0.7975	0.5798	0.7615
0.4296	6.9589	508	0.5767	0.7799	0.5767	0.7594
0.4296	6.9863	510	0.5433	0.7875	0.5433	0.7371
0.4296	7.0137	512	0.5475	0.7925	0.5475	0.7399
0.4296	7.0411	514	0.5967	0.7742	0.5967	0.7725
0.4296	7.0685	516	0.6178	0.7682	0.6178	0.7860
0.4296	7.0959	518	0.5814	0.8129	0.5814	0.7625
0.4296	7.1233	520	0.5663	0.7843	0.5663	0.7526
0.4296	7.1507	522	0.5470	0.8052	0.5470	0.7396
0.4296	7.1781	524	0.5365	0.8153	0.5365	0.7325
0.4296	7.2055	526	0.5642	0.7582	0.5642	0.7511
0.4296	7.2329	528	0.6222	0.7763	0.6222	0.7888
0.4296	7.2603	530	0.6417	0.7550	0.6417	0.8011
0.4296	7.2877	532	0.7046	0.7361	0.7046	0.8394
0.4296	7.3151	534	0.7221	0.7552	0.7221	0.8498
0.4296	7.3425	536	0.7100	0.7552	0.7100	0.8426
0.4296	7.3699	538	0.6885	0.7724	0.6885	0.8297
0.4296	7.3973	540	0.6938	0.7432	0.6938	0.8329
0.4296	7.4247	542	0.7247	0.7619	0.7247	0.8513
0.4296	7.4521	544	0.7594	0.7448	0.7594	0.8714
0.4296	7.4795	546	0.8166	0.7273	0.8166	0.9037
0.4296	7.5068	548	0.8671	0.6667	0.8671	0.9312

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1