ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9629
• Qwk: 0.5879
• Mse: 0.9629
• Rmse: 0.9813

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	2.2261	-0.0230	2.2261	1.4920
No log	0.0784	4	1.6020	0.1791	1.6020	1.2657
No log	0.1176	6	1.2910	0.2499	1.2910	1.1362
No log	0.1569	8	1.6794	0.1173	1.6794	1.2959
No log	0.1961	10	1.6943	0.1074	1.6943	1.3017
No log	0.2353	12	1.9867	0.1517	1.9867	1.4095
No log	0.2745	14	2.2963	0.1610	2.2963	1.5153
No log	0.3137	16	2.0774	0.2116	2.0774	1.4413
No log	0.3529	18	1.9230	0.2597	1.9230	1.3867
No log	0.3922	20	1.6622	0.2511	1.6622	1.2893
No log	0.4314	22	1.6635	0.2151	1.6635	1.2898
No log	0.4706	24	1.7896	0.2470	1.7896	1.3378
No log	0.5098	26	1.6673	0.2292	1.6673	1.2912
No log	0.5490	28	1.5466	0.1832	1.5466	1.2436
No log	0.5882	30	1.4949	0.1403	1.4949	1.2226
No log	0.6275	32	1.5860	0.3274	1.5860	1.2594
No log	0.6667	34	1.8976	0.2798	1.8976	1.3775
No log	0.7059	36	1.7587	0.2766	1.7587	1.3262
No log	0.7451	38	1.3562	0.2875	1.3562	1.1646
No log	0.7843	40	1.2864	0.2796	1.2864	1.1342
No log	0.8235	42	1.2474	0.3287	1.2474	1.1169
No log	0.8627	44	1.2409	0.3159	1.2409	1.1140
No log	0.9020	46	1.2521	0.2891	1.2521	1.1190
No log	0.9412	48	1.2233	0.2868	1.2233	1.1060
No log	0.9804	50	1.3016	0.2455	1.3016	1.1409
No log	1.0196	52	1.3957	0.2838	1.3957	1.1814
No log	1.0588	54	1.6562	0.3668	1.6562	1.2869
No log	1.0980	56	1.5803	0.3679	1.5803	1.2571
No log	1.1373	58	1.4999	0.3988	1.4999	1.2247
No log	1.1765	60	1.5359	0.4546	1.5359	1.2393
No log	1.2157	62	1.4781	0.4609	1.4781	1.2158
No log	1.2549	64	1.4566	0.4669	1.4566	1.2069
No log	1.2941	66	1.5847	0.4707	1.5847	1.2588
No log	1.3333	68	1.3729	0.4543	1.3729	1.1717
No log	1.3725	70	1.1969	0.4652	1.1969	1.0940
No log	1.4118	72	1.2646	0.4340	1.2646	1.1245
No log	1.4510	74	1.1846	0.4453	1.1846	1.0884
No log	1.4902	76	1.1760	0.4459	1.1760	1.0844
No log	1.5294	78	1.2158	0.4393	1.2158	1.1026
No log	1.5686	80	1.2306	0.4523	1.2306	1.1093
No log	1.6078	82	1.4256	0.4529	1.4256	1.1940
No log	1.6471	84	1.2569	0.4448	1.2569	1.1211
No log	1.6863	86	1.0827	0.4747	1.0827	1.0405
No log	1.7255	88	1.0187	0.5253	1.0187	1.0093
No log	1.7647	90	1.0159	0.5349	1.0159	1.0079
No log	1.8039	92	1.0037	0.5377	1.0037	1.0019
No log	1.8431	94	1.3857	0.5195	1.3857	1.1771
No log	1.8824	96	1.3631	0.5387	1.3631	1.1675
No log	1.9216	98	1.0284	0.5936	1.0284	1.0141
No log	1.9608	100	0.9436	0.5991	0.9436	0.9714
No log	2.0	102	0.8802	0.6175	0.8802	0.9382
No log	2.0392	104	0.9435	0.6308	0.9435	0.9714
No log	2.0784	106	1.5178	0.5146	1.5178	1.2320
No log	2.1176	108	2.3028	0.4778	2.3028	1.5175
No log	2.1569	110	1.9483	0.4904	1.9483	1.3958
No log	2.1961	112	1.3519	0.5302	1.3519	1.1627
No log	2.2353	114	1.4348	0.5171	1.4348	1.1978
No log	2.2745	116	1.4226	0.5181	1.4226	1.1927
No log	2.3137	118	1.1107	0.5557	1.1107	1.0539
No log	2.3529	120	1.0022	0.5719	1.0022	1.0011
No log	2.3922	122	0.9009	0.5687	0.9009	0.9491
No log	2.4314	124	0.9006	0.6109	0.9006	0.9490
No log	2.4706	126	1.0769	0.5721	1.0769	1.0377
No log	2.5098	128	1.3179	0.5540	1.3179	1.1480
No log	2.5490	130	1.2058	0.5579	1.2058	1.0981
No log	2.5882	132	1.0202	0.5697	1.0202	1.0100
No log	2.6275	134	1.0881	0.5834	1.0881	1.0431
No log	2.6667	136	0.9912	0.5565	0.9912	0.9956
No log	2.7059	138	1.0697	0.5812	1.0697	1.0342
No log	2.7451	140	1.1254	0.5833	1.1254	1.0609
No log	2.7843	142	1.1495	0.5864	1.1495	1.0721
No log	2.8235	144	1.1864	0.6040	1.1864	1.0892
No log	2.8627	146	1.1424	0.6009	1.1424	1.0688
No log	2.9020	148	0.9240	0.5974	0.9240	0.9612
No log	2.9412	150	1.1027	0.6209	1.1027	1.0501
No log	2.9804	152	1.0861	0.6209	1.0861	1.0421
No log	3.0196	154	1.3007	0.6276	1.3007	1.1405
No log	3.0588	156	1.3067	0.6139	1.3067	1.1431
No log	3.0980	158	1.0973	0.6284	1.0973	1.0475
No log	3.1373	160	0.9907	0.6256	0.9907	0.9953
No log	3.1765	162	1.2359	0.6094	1.2359	1.1117
No log	3.2157	164	1.2269	0.6052	1.2269	1.1077
No log	3.2549	166	1.1814	0.5991	1.1814	1.0869
No log	3.2941	168	1.3297	0.5825	1.3297	1.1531
No log	3.3333	170	1.4480	0.5487	1.4480	1.2033
No log	3.3725	172	1.3114	0.5511	1.3114	1.1451
No log	3.4118	174	1.0716	0.5768	1.0716	1.0352
No log	3.4510	176	1.1403	0.5605	1.1403	1.0678
No log	3.4902	178	1.3044	0.5515	1.3044	1.1421
No log	3.5294	180	1.2975	0.5515	1.2975	1.1391
No log	3.5686	182	1.1664	0.5648	1.1664	1.0800
No log	3.6078	184	1.0377	0.5947	1.0377	1.0187
No log	3.6471	186	1.0475	0.5701	1.0475	1.0235
No log	3.6863	188	1.2287	0.5638	1.2287	1.1085
No log	3.7255	190	1.2465	0.5638	1.2465	1.1165
No log	3.7647	192	1.1945	0.5692	1.1945	1.0929
No log	3.8039	194	1.2290	0.5673	1.2290	1.1086
No log	3.8431	196	1.2805	0.5808	1.2805	1.1316
No log	3.8824	198	1.3632	0.5620	1.3632	1.1676
No log	3.9216	200	1.2460	0.5790	1.2460	1.1163
No log	3.9608	202	0.9906	0.5973	0.9906	0.9953
No log	4.0	204	1.0357	0.5791	1.0357	1.0177
No log	4.0392	206	1.1530	0.5801	1.1530	1.0738
No log	4.0784	208	1.2617	0.5871	1.2617	1.1233
No log	4.1176	210	1.3412	0.5576	1.3412	1.1581
No log	4.1569	212	1.1725	0.5702	1.1725	1.0828
No log	4.1961	214	1.1425	0.5679	1.1425	1.0689
No log	4.2353	216	1.1199	0.5679	1.1199	1.0583
No log	4.2745	218	1.2116	0.5726	1.2116	1.1007
No log	4.3137	220	1.2035	0.5561	1.2035	1.0970
No log	4.3529	222	1.1456	0.5690	1.1456	1.0703
No log	4.3922	224	1.0715	0.5677	1.0715	1.0351
No log	4.4314	226	1.2681	0.5552	1.2681	1.1261
No log	4.4706	228	1.3695	0.5285	1.3695	1.1703
No log	4.5098	230	1.5112	0.5268	1.5112	1.2293
No log	4.5490	232	1.5889	0.5273	1.5889	1.2605
No log	4.5882	234	1.4111	0.5457	1.4111	1.1879
No log	4.6275	236	1.1598	0.5548	1.1598	1.0769
No log	4.6667	238	1.1226	0.5446	1.1226	1.0595
No log	4.7059	240	1.2496	0.5450	1.2496	1.1179
No log	4.7451	242	1.2772	0.5533	1.2772	1.1301
No log	4.7843	244	1.1797	0.5470	1.1797	1.0862
No log	4.8235	246	0.9620	0.5788	0.9620	0.9808
No log	4.8627	248	0.8555	0.6316	0.8555	0.9249
No log	4.9020	250	0.8848	0.6103	0.8848	0.9407
No log	4.9412	252	1.0620	0.5458	1.0620	1.0306
No log	4.9804	254	1.3845	0.5290	1.3845	1.1766
No log	5.0196	256	1.4430	0.5416	1.4430	1.2012
No log	5.0588	258	1.2323	0.5409	1.2323	1.1101
No log	5.0980	260	0.9895	0.6006	0.9895	0.9947
No log	5.1373	262	0.9857	0.6019	0.9857	0.9928
No log	5.1765	264	1.1682	0.5483	1.1682	1.0809
No log	5.2157	266	1.4278	0.5628	1.4278	1.1949
No log	5.2549	268	1.4083	0.5668	1.4083	1.1867
No log	5.2941	270	1.2156	0.5575	1.2156	1.1025
No log	5.3333	272	1.0301	0.5709	1.0301	1.0149
No log	5.3725	274	1.0642	0.5765	1.0642	1.0316
No log	5.4118	276	1.2689	0.5359	1.2689	1.1264
No log	5.4510	278	1.5765	0.5241	1.5765	1.2556
No log	5.4902	280	1.6066	0.5059	1.6066	1.2675
No log	5.5294	282	1.5642	0.5036	1.5642	1.2507
No log	5.5686	284	1.3845	0.5309	1.3845	1.1767
No log	5.6078	286	1.2451	0.5468	1.2451	1.1159
No log	5.6471	288	1.2211	0.5468	1.2211	1.1050
No log	5.6863	290	1.1403	0.5513	1.1403	1.0678
No log	5.7255	292	1.1948	0.5513	1.1948	1.0931
No log	5.7647	294	1.1730	0.5479	1.1730	1.0830
No log	5.8039	296	1.0872	0.5656	1.0872	1.0427
No log	5.8431	298	0.9763	0.5993	0.9763	0.9881
No log	5.8824	300	0.9590	0.6118	0.9590	0.9793
No log	5.9216	302	1.0145	0.5620	1.0145	1.0072
No log	5.9608	304	1.1217	0.5646	1.1217	1.0591
No log	6.0	306	1.1345	0.5602	1.1345	1.0651
No log	6.0392	308	1.1033	0.5646	1.1033	1.0504
No log	6.0784	310	1.0247	0.5609	1.0247	1.0123
No log	6.1176	312	1.0578	0.5633	1.0578	1.0285
No log	6.1569	314	1.0730	0.5532	1.0730	1.0359
No log	6.1961	316	1.0529	0.5542	1.0529	1.0261
No log	6.2353	318	1.0112	0.5723	1.0112	1.0056
No log	6.2745	320	1.0966	0.5442	1.0966	1.0472
No log	6.3137	322	1.1811	0.5595	1.1811	1.0868
No log	6.3529	324	1.2431	0.5685	1.2431	1.1149
No log	6.3922	326	1.2073	0.5847	1.2073	1.0988
No log	6.4314	328	1.1694	0.5886	1.1694	1.0814
No log	6.4706	330	1.1578	0.5950	1.1578	1.0760
No log	6.5098	332	1.0470	0.5899	1.0470	1.0232
No log	6.5490	334	1.0017	0.5824	1.0017	1.0008
No log	6.5882	336	1.0098	0.5735	1.0098	1.0049
No log	6.6275	338	1.0341	0.5735	1.0341	1.0169
No log	6.6667	340	1.0899	0.5856	1.0899	1.0440
No log	6.7059	342	1.0478	0.5801	1.0478	1.0236
No log	6.7451	344	0.9228	0.6093	0.9228	0.9606
No log	6.7843	346	0.8457	0.6055	0.8457	0.9196
No log	6.8235	348	0.8337	0.5984	0.8337	0.9131
No log	6.8627	350	0.9100	0.6290	0.9100	0.9539
No log	6.9020	352	1.0334	0.5952	1.0334	1.0166
No log	6.9412	354	1.0736	0.5928	1.0736	1.0362
No log	6.9804	356	1.1579	0.5661	1.1579	1.0761
No log	7.0196	358	1.1518	0.5661	1.1518	1.0732
No log	7.0588	360	1.0535	0.5834	1.0535	1.0264
No log	7.0980	362	1.0322	0.5846	1.0322	1.0160
No log	7.1373	364	1.0991	0.5612	1.0991	1.0484
No log	7.1765	366	1.1418	0.5692	1.1418	1.0685
No log	7.2157	368	1.1057	0.5789	1.1057	1.0515
No log	7.2549	370	1.0667	0.5778	1.0667	1.0328
No log	7.2941	372	1.0827	0.5712	1.0827	1.0405
No log	7.3333	374	1.1714	0.5766	1.1714	1.0823
No log	7.3725	376	1.2863	0.5657	1.2863	1.1342
No log	7.4118	378	1.3071	0.5657	1.3071	1.1433
No log	7.4510	380	1.2122	0.5837	1.2122	1.1010
No log	7.4902	382	1.0519	0.5701	1.0519	1.0256
No log	7.5294	384	0.9168	0.6033	0.9168	0.9575
No log	7.5686	386	0.8545	0.6168	0.8545	0.9244
No log	7.6078	388	0.8665	0.5941	0.8665	0.9309
No log	7.6471	390	0.9493	0.5777	0.9493	0.9743
No log	7.6863	392	1.0855	0.5745	1.0855	1.0418
No log	7.7255	394	1.1273	0.5725	1.1273	1.0617
No log	7.7647	396	1.0897	0.5735	1.0897	1.0439
No log	7.8039	398	0.9920	0.5869	0.9920	0.9960
No log	7.8431	400	0.9014	0.5964	0.9014	0.9494
No log	7.8824	402	0.8814	0.5886	0.8814	0.9388
No log	7.9216	404	0.9092	0.5836	0.9092	0.9535
No log	7.9608	406	0.9314	0.5915	0.9314	0.9651
No log	8.0	408	0.9420	0.5790	0.9420	0.9706
No log	8.0392	410	0.9301	0.5755	0.9301	0.9644
No log	8.0784	412	0.9495	0.5755	0.9495	0.9744
No log	8.1176	414	1.0162	0.5985	1.0162	1.0081
No log	8.1569	416	1.0348	0.5985	1.0348	1.0173
No log	8.1961	418	1.0207	0.5952	1.0207	1.0103
No log	8.2353	420	0.9553	0.5880	0.9553	0.9774
No log	8.2745	422	0.8835	0.5931	0.8835	0.9400
No log	8.3137	424	0.8462	0.6024	0.8462	0.9199
No log	8.3529	426	0.8274	0.6183	0.8274	0.9096
No log	8.3922	428	0.8485	0.6024	0.8485	0.9212
No log	8.4314	430	0.9051	0.5941	0.9051	0.9514
No log	8.4706	432	0.9623	0.5998	0.9623	0.9810
No log	8.5098	434	1.0097	0.5970	1.0097	1.0048
No log	8.5490	436	1.0132	0.5952	1.0132	1.0066
No log	8.5882	438	0.9969	0.5952	0.9969	0.9985
No log	8.6275	440	0.9701	0.5867	0.9701	0.9849
No log	8.6667	442	0.9299	0.6008	0.9299	0.9643
No log	8.7059	444	0.8947	0.6045	0.8947	0.9459
No log	8.7451	446	0.8667	0.5897	0.8667	0.9310
No log	8.7843	448	0.8376	0.6240	0.8376	0.9152
No log	8.8235	450	0.8064	0.6541	0.8064	0.8980
No log	8.8627	452	0.8091	0.6541	0.8091	0.8995
No log	8.9020	454	0.8369	0.6240	0.8369	0.9148
No log	8.9412	456	0.8880	0.6122	0.8880	0.9423
No log	8.9804	458	0.9653	0.5945	0.9653	0.9825
No log	9.0196	460	1.0521	0.5933	1.0521	1.0257
No log	9.0588	462	1.0879	0.5923	1.0879	1.0430
No log	9.0980	464	1.0859	0.5923	1.0859	1.0421
No log	9.1373	466	1.0571	0.5891	1.0571	1.0282
No log	9.1765	468	1.0195	0.5895	1.0195	1.0097
No log	9.2157	470	0.9924	0.5945	0.9924	0.9962
No log	9.2549	472	0.9687	0.5846	0.9687	0.9842
No log	9.2941	474	0.9623	0.5846	0.9623	0.9810
No log	9.3333	476	0.9709	0.5945	0.9709	0.9853
No log	9.3725	478	0.9744	0.5945	0.9744	0.9871
No log	9.4118	480	0.9852	0.5945	0.9852	0.9926
No log	9.4510	482	0.9895	0.5945	0.9895	0.9947
No log	9.4902	484	1.0000	0.5945	1.0000	1.0000
No log	9.5294	486	0.9925	0.5945	0.9925	0.9962
No log	9.5686	488	0.9804	0.5945	0.9804	0.9901
No log	9.6078	490	0.9598	0.5879	0.9598	0.9797
No log	9.6471	492	0.9492	0.5778	0.9492	0.9743
No log	9.6863	494	0.9433	0.5778	0.9433	0.9712
No log	9.7255	496	0.9480	0.5879	0.9480	0.9736
No log	9.7647	498	0.9475	0.5879	0.9475	0.9734
0.322	9.8039	500	0.9472	0.5879	0.9472	0.9732
0.322	9.8431	502	0.9520	0.5879	0.9520	0.9757
0.322	9.8824	504	0.9570	0.5879	0.9570	0.9783
0.322	9.9216	506	0.9619	0.5879	0.9619	0.9808
0.322	9.9608	508	0.9629	0.5879	0.9629	0.9813
0.322	10.0	510	0.9629	0.5879	0.9629	0.9813

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1