ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8583
• Qwk: 0.6824
• Mse: 0.8583
• Rmse: 0.9265

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.0917	0.0007	5.0917	2.2565
No log	0.0784	4	3.1100	0.0688	3.1100	1.7635
No log	0.1176	6	1.8309	0.1058	1.8309	1.3531
No log	0.1569	8	1.4029	0.1267	1.4029	1.1844
No log	0.1961	10	1.5252	0.0414	1.5252	1.2350
No log	0.2353	12	1.5537	-0.0027	1.5537	1.2465
No log	0.2745	14	1.5484	0.0251	1.5484	1.2443
No log	0.3137	16	1.2319	0.2729	1.2319	1.1099
No log	0.3529	18	1.3301	0.2510	1.3301	1.1533
No log	0.3922	20	1.3253	0.2087	1.3253	1.1512
No log	0.4314	22	1.2319	0.2450	1.2319	1.1099
No log	0.4706	24	1.0583	0.3585	1.0583	1.0287
No log	0.5098	26	1.1743	0.3430	1.1743	1.0837
No log	0.5490	28	1.8231	0.2589	1.8231	1.3502
No log	0.5882	30	1.8284	0.2689	1.8284	1.3522
No log	0.6275	32	1.1672	0.3512	1.1672	1.0804
No log	0.6667	34	1.0503	0.3505	1.0503	1.0249
No log	0.7059	36	1.0663	0.4274	1.0663	1.0326
No log	0.7451	38	1.0453	0.4483	1.0453	1.0224
No log	0.7843	40	1.0805	0.4477	1.0805	1.0395
No log	0.8235	42	1.1348	0.4339	1.1348	1.0653
No log	0.8627	44	0.9955	0.5348	0.9955	0.9977
No log	0.9020	46	0.8599	0.5795	0.8599	0.9273
No log	0.9412	48	0.9126	0.5652	0.9126	0.9553
No log	0.9804	50	0.9012	0.6078	0.9012	0.9493
No log	1.0196	52	1.2124	0.4529	1.2124	1.1011
No log	1.0588	54	1.8858	0.3318	1.8858	1.3732
No log	1.0980	56	1.6604	0.3502	1.6604	1.2886
No log	1.1373	58	1.0003	0.5270	1.0003	1.0002
No log	1.1765	60	0.8265	0.6118	0.8265	0.9091
No log	1.2157	62	0.9342	0.5008	0.9342	0.9665
No log	1.2549	64	0.8636	0.5247	0.8636	0.9293
No log	1.2941	66	0.8730	0.5742	0.8730	0.9343
No log	1.3333	68	0.9704	0.4992	0.9704	0.9851
No log	1.3725	70	1.0559	0.4601	1.0559	1.0276
No log	1.4118	72	0.9120	0.5566	0.9120	0.9550
No log	1.4510	74	0.8342	0.5803	0.8342	0.9133
No log	1.4902	76	0.8474	0.5560	0.8474	0.9206
No log	1.5294	78	0.8388	0.5452	0.8388	0.9159
No log	1.5686	80	0.9876	0.5055	0.9876	0.9938
No log	1.6078	82	1.0743	0.3826	1.0743	1.0365
No log	1.6471	84	0.9151	0.5125	0.9151	0.9566
No log	1.6863	86	0.7493	0.5738	0.7493	0.8656
No log	1.7255	88	1.0297	0.5611	1.0297	1.0147
No log	1.7647	90	1.2886	0.4717	1.2886	1.1352
No log	1.8039	92	1.1347	0.5104	1.1347	1.0652
No log	1.8431	94	0.8636	0.6432	0.8636	0.9293
No log	1.8824	96	0.7475	0.6770	0.7475	0.8646
No log	1.9216	98	0.7011	0.6953	0.7011	0.8373
No log	1.9608	100	0.6937	0.6869	0.6937	0.8329
No log	2.0	102	0.7833	0.7131	0.7833	0.8851
No log	2.0392	104	1.0371	0.6125	1.0371	1.0184
No log	2.0784	106	1.0035	0.6323	1.0035	1.0018
No log	2.1176	108	0.7605	0.7085	0.7605	0.8721
No log	2.1569	110	0.7299	0.6866	0.7299	0.8543
No log	2.1961	112	0.7251	0.6997	0.7251	0.8515
No log	2.2353	114	0.7022	0.7098	0.7022	0.8380
No log	2.2745	116	0.7327	0.7297	0.7327	0.8560
No log	2.3137	118	0.7536	0.7257	0.7536	0.8681
No log	2.3529	120	0.8327	0.7250	0.8327	0.9125
No log	2.3922	122	0.7928	0.7343	0.7928	0.8904
No log	2.4314	124	0.8750	0.7107	0.8750	0.9354
No log	2.4706	126	0.8282	0.7048	0.8282	0.9101
No log	2.5098	128	0.7620	0.7165	0.7620	0.8729
No log	2.5490	130	0.7450	0.6913	0.7450	0.8632
No log	2.5882	132	0.7370	0.6896	0.7370	0.8585
No log	2.6275	134	0.7590	0.6874	0.7590	0.8712
No log	2.6667	136	0.8945	0.7231	0.8945	0.9458
No log	2.7059	138	0.8905	0.7155	0.8905	0.9437
No log	2.7451	140	0.8210	0.7050	0.8210	0.9061
No log	2.7843	142	0.9764	0.6791	0.9764	0.9881
No log	2.8235	144	1.2901	0.5523	1.2901	1.1358
No log	2.8627	146	1.4947	0.5138	1.4947	1.2226
No log	2.9020	148	1.4422	0.4985	1.4422	1.2009
No log	2.9412	150	1.1533	0.5665	1.1533	1.0739
No log	2.9804	152	0.8090	0.6827	0.8090	0.8994
No log	3.0196	154	0.7197	0.7307	0.7197	0.8483
No log	3.0588	156	0.7321	0.7112	0.7321	0.8556
No log	3.0980	158	0.8620	0.7056	0.8620	0.9284
No log	3.1373	160	1.0380	0.6088	1.0380	1.0188
No log	3.1765	162	0.9644	0.6181	0.9644	0.9820
No log	3.2157	164	0.8246	0.6805	0.8246	0.9081
No log	3.2549	166	0.7121	0.7235	0.7121	0.8438
No log	3.2941	168	0.6583	0.6982	0.6583	0.8114
No log	3.3333	170	0.6910	0.7308	0.6910	0.8313
No log	3.3725	172	0.8929	0.6716	0.8929	0.9449
No log	3.4118	174	1.2064	0.5648	1.2064	1.0984
No log	3.4510	176	1.4416	0.5407	1.4416	1.2007
No log	3.4902	178	1.5152	0.5224	1.5152	1.2309
No log	3.5294	180	1.4530	0.5423	1.4530	1.2054
No log	3.5686	182	1.3006	0.5663	1.3006	1.1404
No log	3.6078	184	1.1013	0.6077	1.1013	1.0494
No log	3.6471	186	0.8819	0.6885	0.8819	0.9391
No log	3.6863	188	0.7231	0.7331	0.7231	0.8503
No log	3.7255	190	0.6924	0.7420	0.6924	0.8321
No log	3.7647	192	0.8209	0.6846	0.8209	0.9060
No log	3.8039	194	0.9864	0.6103	0.9864	0.9932
No log	3.8431	196	0.9761	0.6212	0.9761	0.9880
No log	3.8824	198	0.9319	0.6232	0.9319	0.9654
No log	3.9216	200	0.9263	0.6498	0.9263	0.9624
No log	3.9608	202	0.9744	0.5998	0.9744	0.9871
No log	4.0	204	1.0186	0.6005	1.0186	1.0093
No log	4.0392	206	1.0749	0.5943	1.0749	1.0368
No log	4.0784	208	1.1856	0.5884	1.1856	1.0889
No log	4.1176	210	1.0865	0.5931	1.0865	1.0424
No log	4.1569	212	0.9812	0.6495	0.9812	0.9906
No log	4.1961	214	0.9139	0.6393	0.9139	0.9560
No log	4.2353	216	0.8933	0.6321	0.8933	0.9452
No log	4.2745	218	0.8517	0.6505	0.8517	0.9229
No log	4.3137	220	0.8415	0.6501	0.8415	0.9173
No log	4.3529	222	0.7751	0.6656	0.7751	0.8804
No log	4.3922	224	0.7112	0.6652	0.7112	0.8433
No log	4.4314	226	0.7091	0.6187	0.7091	0.8421
No log	4.4706	228	0.6983	0.6663	0.6983	0.8356
No log	4.5098	230	0.6995	0.7348	0.6995	0.8364
No log	4.5490	232	0.8357	0.6760	0.8357	0.9142
No log	4.5882	234	1.0152	0.6269	1.0152	1.0076
No log	4.6275	236	1.0999	0.6046	1.0999	1.0488
No log	4.6667	238	1.1404	0.5829	1.1404	1.0679
No log	4.7059	240	1.1295	0.5911	1.1295	1.0628
No log	4.7451	242	1.0190	0.6059	1.0190	1.0095
No log	4.7843	244	0.9831	0.6220	0.9831	0.9915
No log	4.8235	246	0.8594	0.6795	0.8594	0.9270
No log	4.8627	248	0.8419	0.6899	0.8419	0.9176
No log	4.9020	250	0.8953	0.6826	0.8953	0.9462
No log	4.9412	252	0.8675	0.6826	0.8675	0.9314
No log	4.9804	254	0.8309	0.7044	0.8309	0.9115
No log	5.0196	256	0.8849	0.6797	0.8849	0.9407
No log	5.0588	258	0.8749	0.6832	0.8749	0.9354
No log	5.0980	260	0.7647	0.7067	0.7647	0.8745
No log	5.1373	262	0.6965	0.7460	0.6965	0.8345
No log	5.1765	264	0.6695	0.7259	0.6695	0.8182
No log	5.2157	266	0.7111	0.6903	0.7111	0.8433
No log	5.2549	268	0.8307	0.6667	0.8307	0.9114
No log	5.2941	270	0.9833	0.6304	0.9833	0.9916
No log	5.3333	272	0.9819	0.6378	0.9819	0.9909
No log	5.3725	274	0.8485	0.6753	0.8485	0.9212
No log	5.4118	276	0.7416	0.7060	0.7416	0.8612
No log	5.4510	278	0.7542	0.7015	0.7542	0.8684
No log	5.4902	280	0.8229	0.7087	0.8229	0.9071
No log	5.5294	282	1.0300	0.6429	1.0300	1.0149
No log	5.5686	284	1.2771	0.6030	1.2771	1.1301
No log	5.6078	286	1.3186	0.5913	1.3186	1.1483
No log	5.6471	288	1.1894	0.5636	1.1894	1.0906
No log	5.6863	290	0.9593	0.6473	0.9593	0.9794
No log	5.7255	292	0.8387	0.6726	0.8387	0.9158
No log	5.7647	294	0.7655	0.7066	0.7655	0.8750
No log	5.8039	296	0.7541	0.6971	0.7541	0.8684
No log	5.8431	298	0.8093	0.6921	0.8093	0.8996
No log	5.8824	300	0.9414	0.6344	0.9414	0.9702
No log	5.9216	302	1.0052	0.6158	1.0052	1.0026
No log	5.9608	304	0.9823	0.6221	0.9823	0.9911
No log	6.0	306	0.9568	0.6221	0.9568	0.9781
No log	6.0392	308	0.9009	0.6814	0.9009	0.9491
No log	6.0784	310	0.9234	0.6741	0.9234	0.9609
No log	6.1176	312	0.8873	0.6757	0.8873	0.9420
No log	6.1569	314	0.8746	0.6750	0.8746	0.9352
No log	6.1961	316	0.9264	0.6053	0.9264	0.9625
No log	6.2353	318	0.9693	0.6053	0.9693	0.9845
No log	6.2745	320	0.9514	0.6325	0.9514	0.9754
No log	6.3137	322	0.8576	0.6683	0.8576	0.9261
No log	6.3529	324	0.7604	0.7112	0.7604	0.8720
No log	6.3922	326	0.7340	0.7076	0.7340	0.8567
No log	6.4314	328	0.7547	0.6996	0.7547	0.8687
No log	6.4706	330	0.8300	0.6769	0.8300	0.9110
No log	6.5098	332	0.9099	0.6305	0.9099	0.9539
No log	6.5490	334	0.8916	0.6319	0.8916	0.9442
No log	6.5882	336	0.8098	0.6636	0.8098	0.8999
No log	6.6275	338	0.7875	0.6941	0.7875	0.8874
No log	6.6667	340	0.8143	0.6636	0.8143	0.9024
No log	6.7059	342	0.8408	0.6493	0.8408	0.9170
No log	6.7451	344	0.8657	0.6468	0.8657	0.9304
No log	6.7843	346	0.8861	0.6387	0.8861	0.9413
No log	6.8235	348	0.9366	0.6265	0.9366	0.9678
No log	6.8627	350	0.8998	0.6063	0.8998	0.9486
No log	6.9020	352	0.8169	0.6732	0.8169	0.9039
No log	6.9412	354	0.7301	0.7156	0.7301	0.8544
No log	6.9804	356	0.7153	0.6985	0.7153	0.8457
No log	7.0196	358	0.7225	0.7050	0.7225	0.8500
No log	7.0588	360	0.7732	0.6929	0.7732	0.8793
No log	7.0980	362	0.8603	0.6816	0.8603	0.9275
No log	7.1373	364	0.9284	0.6189	0.9284	0.9636
No log	7.1765	366	0.9319	0.6189	0.9319	0.9653
No log	7.2157	368	0.9300	0.6189	0.9300	0.9643
No log	7.2549	370	0.8746	0.6564	0.8746	0.9352
No log	7.2941	372	0.8479	0.6761	0.8479	0.9208
No log	7.3333	374	0.8677	0.6805	0.8677	0.9315
No log	7.3725	376	0.9060	0.6325	0.9060	0.9518
No log	7.4118	378	0.8766	0.6667	0.8766	0.9363
No log	7.4510	380	0.8598	0.6667	0.8598	0.9273
No log	7.4902	382	0.8694	0.6667	0.8694	0.9324
No log	7.5294	384	0.9047	0.6667	0.9047	0.9512
No log	7.5686	386	0.9484	0.6217	0.9484	0.9739
No log	7.6078	388	0.9431	0.6258	0.9431	0.9711
No log	7.6471	390	0.9659	0.6087	0.9659	0.9828
No log	7.6863	392	0.9776	0.6087	0.9776	0.9888
No log	7.7255	394	0.9520	0.6139	0.9520	0.9757
No log	7.7647	396	0.8866	0.6692	0.8866	0.9416
No log	7.8039	398	0.8307	0.7029	0.8307	0.9114
No log	7.8431	400	0.8143	0.7035	0.8143	0.9024
No log	7.8824	402	0.8472	0.7087	0.8472	0.9204
No log	7.9216	404	0.9269	0.6539	0.9269	0.9628
No log	7.9608	406	0.9704	0.6187	0.9704	0.9851
No log	8.0	408	0.9876	0.6155	0.9876	0.9938
No log	8.0392	410	0.9631	0.6164	0.9631	0.9814
No log	8.0784	412	0.9390	0.6386	0.9390	0.9690
No log	8.1176	414	0.9353	0.6386	0.9353	0.9671
No log	8.1569	416	0.8911	0.6728	0.8911	0.9440
No log	8.1961	418	0.8465	0.6718	0.8465	0.9200
No log	8.2353	420	0.8376	0.6718	0.8376	0.9152
No log	8.2745	422	0.8562	0.6780	0.8562	0.9253
No log	8.3137	424	0.8776	0.6824	0.8776	0.9368
No log	8.3529	426	0.8904	0.6824	0.8904	0.9436
No log	8.3922	428	0.9065	0.6634	0.9065	0.9521
No log	8.4314	430	0.9209	0.6634	0.9209	0.9597
No log	8.4706	432	0.9084	0.6634	0.9084	0.9531
No log	8.5098	434	0.8719	0.6824	0.8719	0.9337
No log	8.5490	436	0.8681	0.6788	0.8681	0.9317
No log	8.5882	438	0.8729	0.6788	0.8729	0.9343
No log	8.6275	440	0.8840	0.6634	0.8840	0.9402
No log	8.6667	442	0.8894	0.6634	0.8894	0.9431
No log	8.7059	444	0.8961	0.6634	0.8961	0.9466
No log	8.7451	446	0.9037	0.6634	0.9037	0.9506
No log	8.7843	448	0.9188	0.6618	0.9188	0.9585
No log	8.8235	450	0.9400	0.6526	0.9400	0.9695
No log	8.8627	452	0.9601	0.6358	0.9601	0.9798
No log	8.9020	454	0.9561	0.6496	0.9561	0.9778
No log	8.9412	456	0.9336	0.6526	0.9336	0.9662
No log	8.9804	458	0.8836	0.6634	0.8836	0.9400
No log	9.0196	460	0.8416	0.6762	0.8416	0.9174
No log	9.0588	462	0.8165	0.6664	0.8165	0.9036
No log	9.0980	464	0.7964	0.6681	0.7964	0.8924
No log	9.1373	466	0.7960	0.6681	0.7960	0.8922
No log	9.1765	468	0.8015	0.6681	0.8015	0.8953
No log	9.2157	470	0.8253	0.6700	0.8253	0.9084
No log	9.2549	472	0.8551	0.6728	0.8551	0.9247
No log	9.2941	474	0.8822	0.6728	0.8822	0.9392
No log	9.3333	476	0.8989	0.6728	0.8989	0.9481
No log	9.3725	478	0.9123	0.6499	0.9123	0.9551
No log	9.4118	480	0.9062	0.6728	0.9062	0.9519
No log	9.4510	482	0.8931	0.6728	0.8931	0.9450
No log	9.4902	484	0.8790	0.6728	0.8790	0.9375
No log	9.5294	486	0.8687	0.6728	0.8687	0.9320
No log	9.5686	488	0.8571	0.6824	0.8571	0.9258
No log	9.6078	490	0.8439	0.6824	0.8439	0.9187
No log	9.6471	492	0.8357	0.6824	0.8357	0.9142
No log	9.6863	494	0.8285	0.6824	0.8285	0.9102
No log	9.7255	496	0.8296	0.6824	0.8296	0.9108
No log	9.7647	498	0.8335	0.6824	0.8335	0.9129
0.4398	9.8039	500	0.8395	0.6824	0.8395	0.9163
0.4398	9.8431	502	0.8439	0.6824	0.8439	0.9186
0.4398	9.8824	504	0.8488	0.6824	0.8488	0.9213
0.4398	9.9216	506	0.8537	0.6824	0.8537	0.9240
0.4398	9.9608	508	0.8572	0.6824	0.8572	0.9258
0.4398	10.0	510	0.8583	0.6824	0.8583	0.9265

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1