ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0271
• Qwk: 0.5869
• Mse: 1.0271
• Rmse: 1.0135

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	2.1780	0.0699	2.1780	1.4758
No log	0.0784	4	1.4833	0.1973	1.4833	1.2179
No log	0.1176	6	1.3405	0.1888	1.3405	1.1578
No log	0.1569	8	1.6008	0.3654	1.6008	1.2652
No log	0.1961	10	1.9457	0.2443	1.9457	1.3949
No log	0.2353	12	2.1941	0.2090	2.1941	1.4813
No log	0.2745	14	1.7499	0.1058	1.7499	1.3228
No log	0.3137	16	1.6662	0.0915	1.6662	1.2908
No log	0.3529	18	1.5549	0.0727	1.5549	1.2469
No log	0.3922	20	1.7662	0.1924	1.7662	1.3290
No log	0.4314	22	2.1372	0.2303	2.1372	1.4619
No log	0.4706	24	2.0674	0.2518	2.0674	1.4379
No log	0.5098	26	1.7969	0.2641	1.7969	1.3405
No log	0.5490	28	1.4581	0.0541	1.4581	1.2075
No log	0.5882	30	1.3921	0.1399	1.3921	1.1799
No log	0.6275	32	1.3390	0.2293	1.3390	1.1572
No log	0.6667	34	1.3304	0.2641	1.3304	1.1534
No log	0.7059	36	1.3110	0.2247	1.3110	1.1450
No log	0.7451	38	1.3368	0.2643	1.3368	1.1562
No log	0.7843	40	1.4853	0.2691	1.4853	1.2187
No log	0.8235	42	1.7906	0.2808	1.7906	1.3381
No log	0.8627	44	1.8483	0.2808	1.8483	1.3595
No log	0.9020	46	1.5198	0.3075	1.5198	1.2328
No log	0.9412	48	1.3029	0.2189	1.3029	1.1415
No log	0.9804	50	1.2451	0.2577	1.2451	1.1158
No log	1.0196	52	1.3943	0.3569	1.3943	1.1808
No log	1.0588	54	2.0454	0.3507	2.0454	1.4302
No log	1.0980	56	2.0680	0.3333	2.0680	1.4381
No log	1.1373	58	1.5101	0.4169	1.5101	1.2289
No log	1.1765	60	1.1632	0.3827	1.1632	1.0785
No log	1.2157	62	1.0961	0.4316	1.0961	1.0470
No log	1.2549	64	1.1932	0.3971	1.1932	1.0923
No log	1.2941	66	1.2921	0.4277	1.2921	1.1367
No log	1.3333	68	1.1809	0.3854	1.1809	1.0867
No log	1.3725	70	1.0709	0.4312	1.0709	1.0349
No log	1.4118	72	1.1163	0.4426	1.1163	1.0565
No log	1.4510	74	1.2363	0.4587	1.2363	1.1119
No log	1.4902	76	1.5479	0.5024	1.5479	1.2441
No log	1.5294	78	1.9337	0.4674	1.9337	1.3906
No log	1.5686	80	1.8372	0.5005	1.8372	1.3554
No log	1.6078	82	1.6441	0.5158	1.6441	1.2822
No log	1.6471	84	1.2453	0.4958	1.2453	1.1160
No log	1.6863	86	1.4267	0.4821	1.4267	1.1945
No log	1.7255	88	1.5521	0.4785	1.5521	1.2458
No log	1.7647	90	1.5785	0.4934	1.5785	1.2564
No log	1.8039	92	1.4055	0.5124	1.4055	1.1856
No log	1.8431	94	1.1434	0.5308	1.1434	1.0693
No log	1.8824	96	1.1408	0.5553	1.1408	1.0681
No log	1.9216	98	1.3090	0.5564	1.3090	1.1441
No log	1.9608	100	1.6552	0.5308	1.6552	1.2865
No log	2.0	102	1.2080	0.5649	1.2080	1.0991
No log	2.0392	104	0.8600	0.5854	0.8600	0.9274
No log	2.0784	106	0.8313	0.5860	0.8313	0.9118
No log	2.1176	108	0.8696	0.6070	0.8696	0.9325
No log	2.1569	110	1.3350	0.5747	1.3350	1.1554
No log	2.1961	112	2.3487	0.3945	2.3487	1.5326
No log	2.2353	114	2.4365	0.3610	2.4365	1.5609
No log	2.2745	116	1.7442	0.4481	1.7442	1.3207
No log	2.3137	118	1.2487	0.5107	1.2487	1.1174
No log	2.3529	120	1.0516	0.5033	1.0516	1.0255
No log	2.3922	122	1.1224	0.5208	1.1224	1.0595
No log	2.4314	124	1.2056	0.5503	1.2056	1.0980
No log	2.4706	126	1.0747	0.5744	1.0747	1.0367
No log	2.5098	128	1.1021	0.5554	1.1021	1.0498
No log	2.5490	130	1.1773	0.5470	1.1773	1.0850
No log	2.5882	132	1.3276	0.5304	1.3276	1.1522
No log	2.6275	134	1.5266	0.5393	1.5266	1.2355
No log	2.6667	136	1.2335	0.5376	1.2335	1.1106
No log	2.7059	138	1.2069	0.5348	1.2069	1.0986
No log	2.7451	140	1.4182	0.5392	1.4182	1.1909
No log	2.7843	142	1.4856	0.5343	1.4856	1.2188
No log	2.8235	144	1.1598	0.5561	1.1598	1.0769
No log	2.8627	146	0.9704	0.5478	0.9704	0.9851
No log	2.9020	148	0.9359	0.5395	0.9359	0.9674
No log	2.9412	150	1.1125	0.5470	1.1125	1.0547
No log	2.9804	152	1.4044	0.5354	1.4044	1.1851
No log	3.0196	154	1.3956	0.5356	1.3956	1.1813
No log	3.0588	156	1.1284	0.5625	1.1284	1.0623
No log	3.0980	158	0.9180	0.5873	0.9180	0.9581
No log	3.1373	160	0.9036	0.5873	0.9036	0.9506
No log	3.1765	162	0.9323	0.5966	0.9323	0.9656
No log	3.2157	164	1.0470	0.5633	1.0470	1.0232
No log	3.2549	166	1.2563	0.5527	1.2563	1.1208
No log	3.2941	168	1.2330	0.5503	1.2330	1.1104
No log	3.3333	170	1.0441	0.5857	1.0441	1.0218
No log	3.3725	172	0.9148	0.6055	0.9148	0.9565
No log	3.4118	174	0.8385	0.6407	0.8385	0.9157
No log	3.4510	176	0.8495	0.6290	0.8495	0.9217
No log	3.4902	178	0.9312	0.6219	0.9312	0.9650
No log	3.5294	180	1.0660	0.6000	1.0660	1.0325
No log	3.5686	182	1.3448	0.5510	1.3448	1.1596
No log	3.6078	184	1.2467	0.5551	1.2467	1.1165
No log	3.6471	186	1.1388	0.5850	1.1388	1.0672
No log	3.6863	188	0.9436	0.6165	0.9436	0.9714
No log	3.7255	190	0.8235	0.6114	0.8235	0.9075
No log	3.7647	192	0.8581	0.5867	0.8581	0.9264
No log	3.8039	194	1.1032	0.5757	1.1032	1.0503
No log	3.8431	196	1.4574	0.5429	1.4574	1.2072
No log	3.8824	198	1.4212	0.5426	1.4212	1.1922
No log	3.9216	200	1.1194	0.5702	1.1194	1.0580
No log	3.9608	202	0.9150	0.5877	0.9150	0.9565
No log	4.0	204	0.8502	0.6006	0.8502	0.9221
No log	4.0392	206	0.9154	0.5780	0.9154	0.9567
No log	4.0784	208	1.1556	0.5367	1.1556	1.0750
No log	4.1176	210	1.3295	0.5539	1.3295	1.1530
No log	4.1569	212	1.2202	0.5469	1.2202	1.1046
No log	4.1961	214	1.0264	0.5967	1.0264	1.0131
No log	4.2353	216	0.8886	0.6278	0.8886	0.9427
No log	4.2745	218	0.9268	0.6035	0.9268	0.9627
No log	4.3137	220	1.0540	0.5967	1.0540	1.0267
No log	4.3529	222	1.1668	0.5587	1.1668	1.0802
No log	4.3922	224	1.1317	0.5649	1.1317	1.0638
No log	4.4314	226	0.9861	0.5938	0.9861	0.9930
No log	4.4706	228	0.9051	0.6177	0.9051	0.9514
No log	4.5098	230	0.9431	0.5930	0.9431	0.9711
No log	4.5490	232	1.0983	0.5923	1.0983	1.0480
No log	4.5882	234	1.1815	0.5544	1.1815	1.0870
No log	4.6275	236	1.1338	0.5724	1.1338	1.0648
No log	4.6667	238	0.9810	0.5825	0.9810	0.9905
No log	4.7059	240	0.9948	0.5834	0.9948	0.9974
No log	4.7451	242	1.0372	0.5985	1.0372	1.0184
No log	4.7843	244	1.1475	0.6046	1.1475	1.0712
No log	4.8235	246	1.2397	0.5974	1.2397	1.1134
No log	4.8627	248	1.2449	0.5851	1.2449	1.1158
No log	4.9020	250	1.2501	0.5785	1.2501	1.1181
No log	4.9412	252	1.2698	0.5688	1.2698	1.1269
No log	4.9804	254	1.0946	0.6099	1.0946	1.0462
No log	5.0196	256	1.0590	0.6006	1.0590	1.0291
No log	5.0588	258	1.1929	0.5937	1.1929	1.0922
No log	5.0980	260	1.2418	0.5441	1.2418	1.1143
No log	5.1373	262	1.3040	0.5335	1.3040	1.1419
No log	5.1765	264	1.2396	0.5399	1.2396	1.1134
No log	5.2157	266	1.2231	0.5399	1.2231	1.1059
No log	5.2549	268	1.2190	0.5524	1.2190	1.1041
No log	5.2941	270	1.1483	0.5747	1.1483	1.0716
No log	5.3333	272	1.2461	0.5567	1.2461	1.1163
No log	5.3725	274	1.3038	0.5757	1.3038	1.1418
No log	5.4118	276	1.3021	0.5668	1.3021	1.1411
No log	5.4510	278	1.3790	0.5699	1.3790	1.1743
No log	5.4902	280	1.3235	0.5699	1.3235	1.1504
No log	5.5294	282	1.1766	0.5991	1.1766	1.0847
No log	5.5686	284	1.2113	0.5953	1.2113	1.1006
No log	5.6078	286	1.2856	0.5673	1.2856	1.1339
No log	5.6471	288	1.2619	0.5576	1.2619	1.1234
No log	5.6863	290	1.2202	0.5518	1.2202	1.1046
No log	5.7255	292	1.1142	0.5631	1.1142	1.0556
No log	5.7647	294	0.9667	0.5455	0.9667	0.9832
No log	5.8039	296	0.9351	0.5387	0.9351	0.9670
No log	5.8431	298	0.9731	0.5572	0.9731	0.9865
No log	5.8824	300	1.0195	0.5804	1.0195	1.0097
No log	5.9216	302	1.1357	0.5479	1.1357	1.0657
No log	5.9608	304	1.2969	0.5577	1.2969	1.1388
No log	6.0	306	1.3009	0.5494	1.3009	1.1406
No log	6.0392	308	1.1748	0.5639	1.1748	1.0839
No log	6.0784	310	1.1144	0.5659	1.1144	1.0557
No log	6.1176	312	1.1148	0.5659	1.1148	1.0558
No log	6.1569	314	1.1566	0.5505	1.1566	1.0754
No log	6.1961	316	1.1064	0.5479	1.1064	1.0519
No log	6.2353	318	1.0378	0.5688	1.0378	1.0187
No log	6.2745	320	1.0250	0.5699	1.0250	1.0124
No log	6.3137	322	1.0354	0.5699	1.0354	1.0175
No log	6.3529	324	1.0830	0.5498	1.0830	1.0407
No log	6.3922	326	1.1758	0.5596	1.1758	1.0844
No log	6.4314	328	1.2039	0.5596	1.2039	1.0972
No log	6.4706	330	1.1331	0.5573	1.1331	1.0645
No log	6.5098	332	1.0195	0.5569	1.0195	1.0097
No log	6.5490	334	0.9939	0.5867	0.9939	0.9969
No log	6.5882	336	0.9392	0.5926	0.9392	0.9691
No log	6.6275	338	0.9476	0.5926	0.9476	0.9735
No log	6.6667	340	0.9747	0.6033	0.9747	0.9873
No log	6.7059	342	1.0561	0.5646	1.0561	1.0276
No log	6.7451	344	1.1052	0.5669	1.1052	1.0513
No log	6.7843	346	1.0565	0.5577	1.0565	1.0279
No log	6.8235	348	1.0334	0.5701	1.0334	1.0166
No log	6.8627	350	1.0004	0.5879	1.0004	1.0002
No log	6.9020	352	0.9752	0.5923	0.9752	0.9875
No log	6.9412	354	0.9386	0.6067	0.9386	0.9688
No log	6.9804	356	0.8573	0.6148	0.8573	0.9259
No log	7.0196	358	0.8331	0.6208	0.8331	0.9127
No log	7.0588	360	0.8628	0.6011	0.8628	0.9289
No log	7.0980	362	0.9560	0.5946	0.9560	0.9777
No log	7.1373	364	1.0935	0.5601	1.0935	1.0457
No log	7.1765	366	1.1784	0.5543	1.1784	1.0856
No log	7.2157	368	1.1558	0.5552	1.1558	1.0751
No log	7.2549	370	1.0840	0.5625	1.0840	1.0411
No log	7.2941	372	1.0102	0.5712	1.0102	1.0051
No log	7.3333	374	0.9913	0.5757	0.9913	0.9956
No log	7.3725	376	0.9822	0.5757	0.9822	0.9911
No log	7.4118	378	1.0119	0.5768	1.0119	1.0059
No log	7.4510	380	1.0791	0.5626	1.0791	1.0388
No log	7.4902	382	1.0776	0.5626	1.0776	1.0381
No log	7.5294	384	1.0442	0.5789	1.0442	1.0219
No log	7.5686	386	1.0553	0.5724	1.0553	1.0273
No log	7.6078	388	1.0829	0.5724	1.0829	1.0406
No log	7.6471	390	1.1191	0.5882	1.1191	1.0579
No log	7.6863	392	1.1252	0.5973	1.1252	1.0608
No log	7.7255	394	1.1170	0.5788	1.1170	1.0569
No log	7.7647	396	1.0607	0.5885	1.0607	1.0299
No log	7.8039	398	1.0451	0.5789	1.0451	1.0223
No log	7.8431	400	1.0354	0.5768	1.0354	1.0175
No log	7.8824	402	1.0298	0.5768	1.0298	1.0148
No log	7.9216	404	1.0526	0.5768	1.0526	1.0260
No log	7.9608	406	1.1233	0.5461	1.1233	1.0599
No log	8.0	408	1.1878	0.5483	1.1878	1.0899
No log	8.0392	410	1.1844	0.5483	1.1844	1.0883
No log	8.0784	412	1.1239	0.5461	1.1239	1.0602
No log	8.1176	414	1.0466	0.5768	1.0466	1.0230
No log	8.1569	416	0.9824	0.5848	0.9824	0.9912
No log	8.1961	418	0.9719	0.5913	0.9719	0.9858
No log	8.2353	420	0.9909	0.5811	0.9909	0.9954
No log	8.2745	422	1.0257	0.5789	1.0257	1.0128
No log	8.3137	424	1.0343	0.5789	1.0343	1.0170
No log	8.3529	426	1.0516	0.5626	1.0516	1.0255
No log	8.3922	428	1.0488	0.5626	1.0488	1.0241
No log	8.4314	430	1.0404	0.5626	1.0404	1.0200
No log	8.4706	432	1.0777	0.5626	1.0777	1.0381
No log	8.5098	434	1.0841	0.5626	1.0841	1.0412
No log	8.5490	436	1.1018	0.5506	1.1018	1.0496
No log	8.5882	438	1.0999	0.5463	1.0999	1.0488
No log	8.6275	440	1.0896	0.5506	1.0896	1.0438
No log	8.6667	442	1.0704	0.5481	1.0704	1.0346
No log	8.7059	444	1.0543	0.5481	1.0543	1.0268
No log	8.7451	446	1.0470	0.5481	1.0470	1.0232
No log	8.7843	448	1.0253	0.5602	1.0253	1.0126
No log	8.8235	450	1.0070	0.5677	1.0070	1.0035
No log	8.8627	452	0.9747	0.5826	0.9747	0.9873
No log	8.9020	454	0.9566	0.5946	0.9566	0.9780
No log	8.9412	456	0.9604	0.5946	0.9604	0.9800
No log	8.9804	458	0.9796	0.5848	0.9796	0.9898
No log	9.0196	460	0.9834	0.5848	0.9834	0.9917
No log	9.0588	462	1.0045	0.5869	1.0045	1.0023
No log	9.0980	464	1.0441	0.5490	1.0441	1.0218
No log	9.1373	466	1.0806	0.5481	1.0806	1.0395
No log	9.1765	468	1.0909	0.5506	1.0909	1.0445
No log	9.2157	470	1.0862	0.5481	1.0862	1.0422
No log	9.2549	472	1.0692	0.5481	1.0692	1.0340
No log	9.2941	474	1.0569	0.5481	1.0569	1.0280
No log	9.3333	476	1.0410	0.5612	1.0410	1.0203
No log	9.3725	478	1.0211	0.5779	1.0211	1.0105
No log	9.4118	480	1.0033	0.5869	1.0033	1.0017
No log	9.4510	482	0.9889	0.5869	0.9889	0.9944
No log	9.4902	484	0.9769	0.5848	0.9769	0.9884
No log	9.5294	486	0.9642	0.5893	0.9642	0.9820
No log	9.5686	488	0.9640	0.5893	0.9640	0.9818
No log	9.6078	490	0.9711	0.5848	0.9711	0.9854
No log	9.6471	492	0.9794	0.5848	0.9794	0.9897
No log	9.6863	494	0.9815	0.5848	0.9815	0.9907
No log	9.7255	496	0.9851	0.5848	0.9851	0.9925
No log	9.7647	498	0.9926	0.5848	0.9926	0.9963
0.3694	9.8039	500	1.0026	0.5869	1.0026	1.0013
0.3694	9.8431	502	1.0115	0.5869	1.0115	1.0057
0.3694	9.8824	504	1.0182	0.5869	1.0182	1.0091
0.3694	9.9216	506	1.0225	0.5869	1.0225	1.0112
0.3694	9.9608	508	1.0256	0.5869	1.0256	1.0127
0.3694	10.0	510	1.0271	0.5869	1.0271	1.0135

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1