ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7246
• Qwk: 0.5589
• Mse: 0.7246
• Rmse: 0.8512

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0345	2	4.2146	-0.0185	4.2146	2.0530
No log	0.0690	4	2.4435	-0.0463	2.4435	1.5632
No log	0.1034	6	1.3180	0.0225	1.3180	1.1481
No log	0.1379	8	0.7861	0.0961	0.7861	0.8866
No log	0.1724	10	0.7820	0.1716	0.7820	0.8843
No log	0.2069	12	0.7828	0.1138	0.7828	0.8848
No log	0.2414	14	0.7425	0.2532	0.7425	0.8617
No log	0.2759	16	0.7633	0.1922	0.7633	0.8737
No log	0.3103	18	0.8133	0.2095	0.8133	0.9018
No log	0.3448	20	0.7430	0.4330	0.7430	0.8619
No log	0.3793	22	1.0705	0.3144	1.0705	1.0346
No log	0.4138	24	1.1840	0.2410	1.1840	1.0881
No log	0.4483	26	0.8738	0.2605	0.8738	0.9348
No log	0.4828	28	0.6677	0.2713	0.6677	0.8171
No log	0.5172	30	0.6763	0.3293	0.6763	0.8224
No log	0.5517	32	0.7709	0.2002	0.7709	0.8780
No log	0.5862	34	0.7256	0.2773	0.7256	0.8518
No log	0.6207	36	0.6713	0.2546	0.6713	0.8194
No log	0.6552	38	0.7590	0.1499	0.7590	0.8712
No log	0.6897	40	0.7724	0.2345	0.7724	0.8788
No log	0.7241	42	0.6315	0.3541	0.6315	0.7946
No log	0.7586	44	0.6526	0.4504	0.6526	0.8078
No log	0.7931	46	0.6313	0.5271	0.6313	0.7946
No log	0.8276	48	0.6441	0.4944	0.6441	0.8026
No log	0.8621	50	0.6593	0.5283	0.6593	0.8120
No log	0.8966	52	0.6628	0.5320	0.6628	0.8141
No log	0.9310	54	0.6888	0.4695	0.6888	0.8299
No log	0.9655	56	0.6490	0.5317	0.6490	0.8056
No log	1.0	58	0.6335	0.5192	0.6335	0.7959
No log	1.0345	60	0.6493	0.4970	0.6493	0.8058
No log	1.0690	62	0.6296	0.5481	0.6296	0.7935
No log	1.1034	64	0.6410	0.4966	0.6410	0.8007
No log	1.1379	66	0.6340	0.5411	0.6340	0.7962
No log	1.1724	68	0.6229	0.5554	0.6229	0.7893
No log	1.2069	70	0.6491	0.4723	0.6491	0.8057
No log	1.2414	72	0.6483	0.5383	0.6483	0.8052
No log	1.2759	74	0.6542	0.5976	0.6542	0.8088
No log	1.3103	76	0.7220	0.4947	0.7220	0.8497
No log	1.3448	78	0.7563	0.4928	0.7563	0.8696
No log	1.3793	80	0.9305	0.4510	0.9305	0.9646
No log	1.4138	82	0.9108	0.4630	0.9108	0.9544
No log	1.4483	84	0.8385	0.4951	0.8385	0.9157
No log	1.4828	86	1.0107	0.4466	1.0107	1.0054
No log	1.5172	88	1.3749	0.4145	1.3749	1.1726
No log	1.5517	90	1.0702	0.4685	1.0702	1.0345
No log	1.5862	92	0.6982	0.5154	0.6982	0.8356
No log	1.6207	94	0.6874	0.4975	0.6874	0.8291
No log	1.6552	96	0.6761	0.4994	0.6761	0.8223
No log	1.6897	98	0.7512	0.5051	0.7512	0.8667
No log	1.7241	100	0.7357	0.4827	0.7357	0.8577
No log	1.7586	102	0.7116	0.5157	0.7116	0.8436
No log	1.7931	104	0.7265	0.4957	0.7265	0.8524
No log	1.8276	106	0.7920	0.5250	0.7920	0.8899
No log	1.8621	108	0.8000	0.4943	0.8000	0.8944
No log	1.8966	110	0.8230	0.5148	0.8230	0.9072
No log	1.9310	112	1.0953	0.4286	1.0953	1.0466
No log	1.9655	114	1.0460	0.4618	1.0460	1.0228
No log	2.0	116	0.8305	0.5016	0.8305	0.9113
No log	2.0345	118	0.8320	0.5446	0.8320	0.9122
No log	2.0690	120	0.8494	0.5535	0.8494	0.9216
No log	2.1034	122	0.7360	0.5257	0.7360	0.8579
No log	2.1379	124	0.7314	0.5647	0.7314	0.8552
No log	2.1724	126	0.7123	0.5843	0.7123	0.8440
No log	2.2069	128	0.7052	0.5263	0.7052	0.8397
No log	2.2414	130	0.7167	0.5342	0.7167	0.8466
No log	2.2759	132	0.8809	0.5282	0.8809	0.9386
No log	2.3103	134	0.9086	0.5346	0.9086	0.9532
No log	2.3448	136	0.8972	0.5195	0.8972	0.9472
No log	2.3793	138	0.7308	0.5690	0.7308	0.8549
No log	2.4138	140	0.7292	0.5364	0.7292	0.8539
No log	2.4483	142	0.7963	0.4881	0.7963	0.8924
No log	2.4828	144	0.9940	0.5577	0.9940	0.9970
No log	2.5172	146	1.0014	0.5298	1.0014	1.0007
No log	2.5517	148	0.8041	0.5223	0.8041	0.8967
No log	2.5862	150	0.7455	0.5097	0.7455	0.8634
No log	2.6207	152	0.7207	0.5236	0.7207	0.8489
No log	2.6552	154	0.7280	0.5422	0.7280	0.8532
No log	2.6897	156	0.7039	0.5245	0.7039	0.8390
No log	2.7241	158	0.6332	0.5994	0.6332	0.7957
No log	2.7586	160	0.6604	0.5089	0.6604	0.8126
No log	2.7931	162	0.7133	0.5430	0.7133	0.8446
No log	2.8276	164	0.8190	0.5322	0.8190	0.9050
No log	2.8621	166	1.0332	0.4940	1.0332	1.0165
No log	2.8966	168	1.0761	0.4735	1.0761	1.0374
No log	2.9310	170	0.8941	0.5305	0.8941	0.9456
No log	2.9655	172	0.8460	0.5007	0.8460	0.9198
No log	3.0	174	0.8950	0.5546	0.8950	0.9461
No log	3.0345	176	0.9935	0.5245	0.9935	0.9967
No log	3.0690	178	0.8924	0.5227	0.8924	0.9447
No log	3.1034	180	0.6750	0.5674	0.6750	0.8216
No log	3.1379	182	0.7249	0.5110	0.7249	0.8514
No log	3.1724	184	0.7089	0.5087	0.7089	0.8420
No log	3.2069	186	0.6563	0.5579	0.6563	0.8101
No log	3.2414	188	0.8991	0.5324	0.8991	0.9482
No log	3.2759	190	1.0388	0.4755	1.0388	1.0192
No log	3.3103	192	0.8941	0.5303	0.8941	0.9456
No log	3.3448	194	0.7335	0.5076	0.7335	0.8565
No log	3.3793	196	0.7222	0.5193	0.7222	0.8498
No log	3.4138	198	0.7173	0.5216	0.7173	0.8469
No log	3.4483	200	0.6945	0.5003	0.6945	0.8333
No log	3.4828	202	0.6854	0.5533	0.6854	0.8279
No log	3.5172	204	0.7564	0.5729	0.7564	0.8697
No log	3.5517	206	0.7581	0.5731	0.7581	0.8707
No log	3.5862	208	0.6978	0.5678	0.6978	0.8354
No log	3.6207	210	0.6869	0.4845	0.6869	0.8288
No log	3.6552	212	0.7116	0.5271	0.7116	0.8436
No log	3.6897	214	0.7617	0.5523	0.7617	0.8728
No log	3.7241	216	0.7617	0.5549	0.7617	0.8728
No log	3.7586	218	0.7810	0.5509	0.7810	0.8838
No log	3.7931	220	0.8114	0.5264	0.8114	0.9008
No log	3.8276	222	0.7748	0.5143	0.7748	0.8802
No log	3.8621	224	0.7372	0.5040	0.7372	0.8586
No log	3.8966	226	0.7543	0.4926	0.7543	0.8685
No log	3.9310	228	0.8541	0.4849	0.8541	0.9242
No log	3.9655	230	0.8967	0.4770	0.8967	0.9469
No log	4.0	232	0.8246	0.4682	0.8246	0.9081
No log	4.0345	234	0.7443	0.4956	0.7443	0.8627
No log	4.0690	236	0.7103	0.5151	0.7103	0.8428
No log	4.1034	238	0.7209	0.5368	0.7209	0.8490
No log	4.1379	240	0.7330	0.5342	0.7330	0.8562
No log	4.1724	242	0.7704	0.5195	0.7704	0.8777
No log	4.2069	244	0.8179	0.4787	0.8179	0.9044
No log	4.2414	246	0.8183	0.4851	0.8183	0.9046
No log	4.2759	248	0.8069	0.5227	0.8069	0.8983
No log	4.3103	250	0.8050	0.5216	0.8050	0.8972
No log	4.3448	252	0.7672	0.5334	0.7672	0.8759
No log	4.3793	254	0.7647	0.5050	0.7647	0.8745
No log	4.4138	256	0.8802	0.4907	0.8802	0.9382
No log	4.4483	258	0.9366	0.4758	0.9366	0.9678
No log	4.4828	260	0.8799	0.4793	0.8799	0.9381
No log	4.5172	262	0.6893	0.5803	0.6893	0.8303
No log	4.5517	264	0.6130	0.5601	0.6130	0.7829
No log	4.5862	266	0.6538	0.5329	0.6538	0.8086
No log	4.6207	268	0.6696	0.5270	0.6696	0.8183
No log	4.6552	270	0.7229	0.5218	0.7229	0.8502
No log	4.6897	272	0.8309	0.5391	0.8309	0.9115
No log	4.7241	274	0.8550	0.5387	0.8550	0.9247
No log	4.7586	276	0.7980	0.5351	0.7980	0.8933
No log	4.7931	278	0.7346	0.5361	0.7346	0.8571
No log	4.8276	280	0.7074	0.5176	0.7074	0.8411
No log	4.8621	282	0.6973	0.5301	0.6973	0.8350
No log	4.8966	284	0.6846	0.5017	0.6846	0.8274
No log	4.9310	286	0.7019	0.5305	0.7019	0.8378
No log	4.9655	288	0.7343	0.5519	0.7343	0.8569
No log	5.0	290	0.7798	0.5440	0.7798	0.8830
No log	5.0345	292	0.7536	0.5533	0.7536	0.8681
No log	5.0690	294	0.7296	0.5547	0.7296	0.8542
No log	5.1034	296	0.7454	0.5362	0.7454	0.8633
No log	5.1379	298	0.9175	0.4699	0.9175	0.9579
No log	5.1724	300	1.0180	0.4323	1.0180	1.0089
No log	5.2069	302	0.9301	0.4405	0.9301	0.9644
No log	5.2414	304	0.7898	0.5193	0.7898	0.8887
No log	5.2759	306	0.7587	0.5470	0.7587	0.8710
No log	5.3103	308	0.7866	0.5228	0.7866	0.8869
No log	5.3448	310	0.8098	0.5255	0.8098	0.8999
No log	5.3793	312	0.8320	0.5350	0.8320	0.9121
No log	5.4138	314	0.8940	0.5122	0.8940	0.9455
No log	5.4483	316	1.0069	0.4613	1.0069	1.0035
No log	5.4828	318	0.9744	0.4721	0.9744	0.9871
No log	5.5172	320	0.8228	0.5354	0.8228	0.9071
No log	5.5517	322	0.7458	0.5282	0.7458	0.8636
No log	5.5862	324	0.7298	0.5321	0.7298	0.8543
No log	5.6207	326	0.7425	0.5206	0.7425	0.8617
No log	5.6552	328	0.8107	0.5416	0.8107	0.9004
No log	5.6897	330	0.9106	0.5261	0.9106	0.9542
No log	5.7241	332	0.9991	0.5042	0.9991	0.9995
No log	5.7586	334	0.9889	0.5121	0.9889	0.9944
No log	5.7931	336	0.8815	0.5224	0.8815	0.9389
No log	5.8276	338	0.7990	0.5196	0.7990	0.8939
No log	5.8621	340	0.7642	0.5208	0.7642	0.8742
No log	5.8966	342	0.7360	0.5045	0.7360	0.8579
No log	5.9310	344	0.7096	0.5226	0.7096	0.8424
No log	5.9655	346	0.7338	0.5362	0.7338	0.8566
No log	6.0	348	0.8216	0.5542	0.8216	0.9064
No log	6.0345	350	0.8425	0.5259	0.8425	0.9179
No log	6.0690	352	0.7800	0.5447	0.7800	0.8832
No log	6.1034	354	0.6987	0.5505	0.6987	0.8359
No log	6.1379	356	0.6958	0.5177	0.6958	0.8341
No log	6.1724	358	0.7628	0.5293	0.7628	0.8734
No log	6.2069	360	0.7967	0.5122	0.7967	0.8926
No log	6.2414	362	0.8021	0.5105	0.8021	0.8956
No log	6.2759	364	0.8230	0.5258	0.8230	0.9072
No log	6.3103	366	0.9069	0.5229	0.9069	0.9523
No log	6.3448	368	0.9494	0.4856	0.9494	0.9744
No log	6.3793	370	0.9082	0.4928	0.9082	0.9530
No log	6.4138	372	0.8276	0.5343	0.8276	0.9097
No log	6.4483	374	0.7913	0.5412	0.7913	0.8896
No log	6.4828	376	0.7648	0.5510	0.7648	0.8746
No log	6.5172	378	0.7684	0.5511	0.7684	0.8766
No log	6.5517	380	0.7701	0.5398	0.7701	0.8776
No log	6.5862	382	0.8014	0.5171	0.8014	0.8952
No log	6.6207	384	0.8627	0.4858	0.8627	0.9288
No log	6.6552	386	0.8588	0.4958	0.8588	0.9267
No log	6.6897	388	0.7874	0.5330	0.7874	0.8873
No log	6.7241	390	0.7505	0.5242	0.7505	0.8663
No log	6.7586	392	0.7268	0.5635	0.7268	0.8525
No log	6.7931	394	0.7129	0.5350	0.7129	0.8443
No log	6.8276	396	0.6899	0.5614	0.6899	0.8306
No log	6.8621	398	0.6821	0.5855	0.6821	0.8259
No log	6.8966	400	0.7249	0.5362	0.7249	0.8514
No log	6.9310	402	0.8046	0.5227	0.8046	0.8970
No log	6.9655	404	0.8307	0.5041	0.8307	0.9114
No log	7.0	406	0.7883	0.5544	0.7883	0.8879
No log	7.0345	408	0.7240	0.5464	0.7240	0.8509
No log	7.0690	410	0.6890	0.5904	0.6890	0.8301
No log	7.1034	412	0.6961	0.5666	0.6961	0.8343
No log	7.1379	414	0.7185	0.5620	0.7185	0.8477
No log	7.1724	416	0.7535	0.5613	0.7535	0.8680
No log	7.2069	418	0.8028	0.5522	0.8028	0.8960
No log	7.2414	420	0.8728	0.5097	0.8728	0.9342
No log	7.2759	422	0.9126	0.5289	0.9126	0.9553
No log	7.3103	424	0.9060	0.5106	0.9060	0.9518
No log	7.3448	426	0.8744	0.5523	0.8744	0.9351
No log	7.3793	428	0.8324	0.5453	0.8324	0.9123
No log	7.4138	430	0.7893	0.5573	0.7893	0.8884
No log	7.4483	432	0.7582	0.5534	0.7582	0.8707
No log	7.4828	434	0.7027	0.5659	0.7027	0.8383
No log	7.5172	436	0.6718	0.5619	0.6718	0.8197
No log	7.5517	438	0.6692	0.5547	0.6692	0.8180
No log	7.5862	440	0.6784	0.5748	0.6784	0.8237
No log	7.6207	442	0.6868	0.5577	0.6868	0.8287
No log	7.6552	444	0.7105	0.5429	0.7105	0.8429
No log	7.6897	446	0.7323	0.5593	0.7323	0.8558
No log	7.7241	448	0.7672	0.5491	0.7672	0.8759
No log	7.7586	450	0.7895	0.5491	0.7895	0.8885
No log	7.7931	452	0.7946	0.5366	0.7946	0.8914
No log	7.8276	454	0.7822	0.5349	0.7822	0.8844
No log	7.8621	456	0.7582	0.5370	0.7582	0.8707
No log	7.8966	458	0.7271	0.5419	0.7271	0.8527
No log	7.9310	460	0.7018	0.5698	0.7018	0.8377
No log	7.9655	462	0.6963	0.5741	0.6963	0.8344
No log	8.0	464	0.7023	0.5589	0.7023	0.8380
No log	8.0345	466	0.7052	0.5504	0.7052	0.8398
No log	8.0690	468	0.6927	0.5646	0.6927	0.8323
No log	8.1034	470	0.6706	0.5562	0.6706	0.8189
No log	8.1379	472	0.6502	0.5829	0.6502	0.8064
No log	8.1724	474	0.6562	0.5554	0.6562	0.8101
No log	8.2069	476	0.6733	0.5309	0.6733	0.8206
No log	8.2414	478	0.6923	0.5309	0.6923	0.8321
No log	8.2759	480	0.6936	0.5669	0.6936	0.8328
No log	8.3103	482	0.6905	0.5408	0.6905	0.8310
No log	8.3448	484	0.6959	0.5464	0.6959	0.8342
No log	8.3793	486	0.7217	0.5314	0.7217	0.8495
No log	8.4138	488	0.7606	0.5357	0.7606	0.8721
No log	8.4483	490	0.7816	0.5155	0.7816	0.8841
No log	8.4828	492	0.7716	0.5357	0.7716	0.8784
No log	8.5172	494	0.7493	0.5383	0.7493	0.8656
No log	8.5517	496	0.7263	0.5359	0.7263	0.8522
No log	8.5862	498	0.7109	0.5494	0.7109	0.8432
0.4205	8.6207	500	0.7144	0.5565	0.7144	0.8453
0.4205	8.6552	502	0.7294	0.5276	0.7294	0.8541
0.4205	8.6897	504	0.7384	0.5388	0.7384	0.8593
0.4205	8.7241	506	0.7459	0.5459	0.7459	0.8637
0.4205	8.7586	508	0.7516	0.5456	0.7516	0.8669
0.4205	8.7931	510	0.7554	0.5456	0.7554	0.8691
0.4205	8.8276	512	0.7567	0.5457	0.7567	0.8699
0.4205	8.8621	514	0.7513	0.5535	0.7513	0.8668
0.4205	8.8966	516	0.7396	0.5616	0.7396	0.8600
0.4205	8.9310	518	0.7358	0.5456	0.7358	0.8578
0.4205	8.9655	520	0.7379	0.5443	0.7379	0.8590
0.4205	9.0	522	0.7471	0.5616	0.7471	0.8643
0.4205	9.0345	524	0.7543	0.5616	0.7543	0.8685
0.4205	9.0690	526	0.7644	0.5391	0.7644	0.8743
0.4205	9.1034	528	0.7723	0.5391	0.7723	0.8788
0.4205	9.1379	530	0.7795	0.5391	0.7795	0.8829
0.4205	9.1724	532	0.7858	0.5395	0.7858	0.8865
0.4205	9.2069	534	0.7836	0.5395	0.7836	0.8852
0.4205	9.2414	536	0.7741	0.5482	0.7741	0.8798
0.4205	9.2759	538	0.7645	0.5482	0.7645	0.8744
0.4205	9.3103	540	0.7589	0.5391	0.7589	0.8711
0.4205	9.3448	542	0.7500	0.5481	0.7500	0.8660
0.4205	9.3793	544	0.7379	0.5509	0.7379	0.8590
0.4205	9.4138	546	0.7288	0.5456	0.7288	0.8537
0.4205	9.4483	548	0.7212	0.5456	0.7212	0.8492
0.4205	9.4828	550	0.7138	0.5412	0.7138	0.8449
0.4205	9.5172	552	0.7076	0.5467	0.7076	0.8412
0.4205	9.5517	554	0.7022	0.5340	0.7022	0.8380
0.4205	9.5862	556	0.7005	0.5451	0.7005	0.8370
0.4205	9.6207	558	0.7002	0.5451	0.7002	0.8368
0.4205	9.6552	560	0.7030	0.5494	0.7030	0.8384
0.4205	9.6897	562	0.7081	0.5535	0.7081	0.8415
0.4205	9.7241	564	0.7136	0.5589	0.7136	0.8448
0.4205	9.7586	566	0.7192	0.5589	0.7192	0.8481
0.4205	9.7931	568	0.7212	0.5589	0.7212	0.8492
0.4205	9.8276	570	0.7230	0.5589	0.7230	0.8503
0.4205	9.8621	572	0.7234	0.5589	0.7234	0.8505
0.4205	9.8966	574	0.7239	0.5589	0.7239	0.8508
0.4205	9.9310	576	0.7242	0.5589	0.7242	0.8510
0.4205	9.9655	578	0.7244	0.5589	0.7244	0.8511
0.4205	10.0	580	0.7246	0.5589	0.7246	0.8512

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1