ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9691
• Qwk: 0.6109
• Mse: 0.9691
• Rmse: 0.9844

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	2.2652	-0.0076	2.2652	1.5051
No log	0.0870	4	2.1236	-0.0497	2.1236	1.4573
No log	0.1304	6	1.8406	-0.0140	1.8406	1.3567
No log	0.1739	8	1.6141	0.1188	1.6141	1.2705
No log	0.2174	10	1.4982	0.1243	1.4982	1.2240
No log	0.2609	12	1.3803	0.1444	1.3803	1.1749
No log	0.3043	14	1.3278	0.1772	1.3278	1.1523
No log	0.3478	16	1.4049	0.3470	1.4049	1.1853
No log	0.3913	18	1.3875	0.3657	1.3875	1.1779
No log	0.4348	20	1.4490	0.2453	1.4490	1.2037
No log	0.4783	22	1.5902	0.1354	1.5902	1.2610
No log	0.5217	24	1.3913	0.1764	1.3913	1.1795
No log	0.5652	26	1.2495	0.2983	1.2495	1.1178
No log	0.6087	28	1.3384	0.2406	1.3384	1.1569
No log	0.6522	30	1.3941	0.3219	1.3941	1.1807
No log	0.6957	32	1.3901	0.3330	1.3901	1.1790
No log	0.7391	34	1.2911	0.2921	1.2911	1.1362
No log	0.7826	36	1.1948	0.3514	1.1948	1.0931
No log	0.8261	38	1.1314	0.4032	1.1314	1.0637
No log	0.8696	40	1.1075	0.4054	1.1075	1.0524
No log	0.9130	42	1.1199	0.4257	1.1199	1.0582
No log	0.9565	44	1.1040	0.4499	1.1040	1.0507
No log	1.0	46	1.0907	0.4254	1.0907	1.0444
No log	1.0435	48	1.0980	0.4408	1.0980	1.0479
No log	1.0870	50	1.1118	0.4180	1.1118	1.0544
No log	1.1304	52	1.0691	0.4543	1.0691	1.0340
No log	1.1739	54	1.0628	0.4684	1.0628	1.0309
No log	1.2174	56	1.1288	0.4880	1.1288	1.0625
No log	1.2609	58	1.1074	0.5031	1.1074	1.0523
No log	1.3043	60	1.0427	0.4866	1.0427	1.0211
No log	1.3478	62	1.0077	0.5152	1.0077	1.0039
No log	1.3913	64	1.0035	0.5152	1.0035	1.0018
No log	1.4348	66	1.0041	0.4859	1.0041	1.0020
No log	1.4783	68	1.0037	0.5117	1.0037	1.0018
No log	1.5217	70	1.0399	0.4539	1.0399	1.0197
No log	1.5652	72	1.0845	0.4694	1.0845	1.0414
No log	1.6087	74	1.0328	0.4650	1.0328	1.0162
No log	1.6522	76	0.9876	0.5107	0.9876	0.9938
No log	1.6957	78	1.1231	0.4895	1.1231	1.0598
No log	1.7391	80	1.2240	0.4721	1.2240	1.1063
No log	1.7826	82	1.1151	0.5259	1.1151	1.0560
No log	1.8261	84	0.9885	0.4780	0.9885	0.9942
No log	1.8696	86	1.0310	0.3877	1.0310	1.0154
No log	1.9130	88	1.0303	0.3877	1.0303	1.0151
No log	1.9565	90	1.0037	0.3805	1.0037	1.0019
No log	2.0	92	0.9869	0.4075	0.9869	0.9934
No log	2.0435	94	0.9735	0.4929	0.9735	0.9866
No log	2.0870	96	1.0345	0.5397	1.0345	1.0171
No log	2.1304	98	1.2370	0.5166	1.2370	1.1122
No log	2.1739	100	1.2544	0.5003	1.2544	1.1200
No log	2.2174	102	1.1175	0.5171	1.1175	1.0571
No log	2.2609	104	0.9271	0.5775	0.9271	0.9629
No log	2.3043	106	0.9128	0.5573	0.9128	0.9554
No log	2.3478	108	0.9275	0.5777	0.9275	0.9630
No log	2.3913	110	1.0372	0.5114	1.0372	1.0184
No log	2.4348	112	1.0836	0.5324	1.0836	1.0410
No log	2.4783	114	1.2002	0.4980	1.2002	1.0956
No log	2.5217	116	1.1563	0.5261	1.1563	1.0753
No log	2.5652	118	0.9935	0.5430	0.9935	0.9967
No log	2.6087	120	0.9696	0.5164	0.9696	0.9847
No log	2.6522	122	1.0970	0.5466	1.0970	1.0474
No log	2.6957	124	1.3084	0.5346	1.3084	1.1438
No log	2.7391	126	1.2599	0.5976	1.2599	1.1224
No log	2.7826	128	1.1071	0.5376	1.1071	1.0522
No log	2.8261	130	1.0263	0.5510	1.0263	1.0131
No log	2.8696	132	0.9328	0.5663	0.9328	0.9658
No log	2.9130	134	0.9020	0.5663	0.9020	0.9497
No log	2.9565	136	0.9038	0.5861	0.9038	0.9507
No log	3.0	138	1.0315	0.5634	1.0315	1.0156
No log	3.0435	140	1.0842	0.5626	1.0842	1.0412
No log	3.0870	142	0.9720	0.5687	0.9720	0.9859
No log	3.1304	144	0.8789	0.5796	0.8789	0.9375
No log	3.1739	146	0.8874	0.5752	0.8874	0.9420
No log	3.2174	148	0.9737	0.5818	0.9737	0.9867
No log	3.2609	150	1.1378	0.5957	1.1378	1.0667
No log	3.3043	152	1.1700	0.5833	1.1700	1.0816
No log	3.3478	154	1.1614	0.5820	1.1614	1.0777
No log	3.3913	156	0.9917	0.5926	0.9917	0.9958
No log	3.4348	158	0.9599	0.6093	0.9599	0.9797
No log	3.4783	160	1.1038	0.5797	1.1038	1.0506
No log	3.5217	162	1.3246	0.5847	1.3246	1.1509
No log	3.5652	164	1.3037	0.5713	1.3037	1.1418
No log	3.6087	166	1.0796	0.5930	1.0796	1.0391
No log	3.6522	168	0.9108	0.5835	0.9108	0.9544
No log	3.6957	170	0.8998	0.5836	0.8998	0.9486
No log	3.7391	172	0.9663	0.5687	0.9663	0.9830
No log	3.7826	174	1.0322	0.5346	1.0322	1.0160
No log	3.8261	176	1.1804	0.5467	1.1804	1.0864
No log	3.8696	178	1.1715	0.5574	1.1715	1.0824
No log	3.9130	180	1.1265	0.5905	1.1265	1.0614
No log	3.9565	182	1.2205	0.5882	1.2205	1.1048
No log	4.0	184	1.2008	0.5935	1.2008	1.0958
No log	4.0435	186	1.1284	0.5911	1.1284	1.0623
No log	4.0870	188	1.1885	0.5875	1.1885	1.0902
No log	4.1304	190	1.2276	0.5832	1.2276	1.1080
No log	4.1739	192	1.3229	0.5669	1.3229	1.1502
No log	4.2174	194	1.2169	0.5667	1.2169	1.1032
No log	4.2609	196	1.0380	0.5670	1.0380	1.0188
No log	4.3043	198	0.9120	0.5472	0.9120	0.9550
No log	4.3478	200	0.9019	0.5463	0.9019	0.9497
No log	4.3913	202	0.9529	0.5359	0.9529	0.9762
No log	4.4348	204	1.0670	0.5708	1.0670	1.0330
No log	4.4783	206	1.2192	0.5187	1.2192	1.1042
No log	4.5217	208	1.2070	0.5360	1.2070	1.0987
No log	4.5652	210	1.0506	0.5778	1.0506	1.0250
No log	4.6087	212	0.9901	0.5839	0.9901	0.9951
No log	4.6522	214	1.0158	0.5849	1.0158	1.0078
No log	4.6957	216	1.0873	0.6062	1.0873	1.0427
No log	4.7391	218	1.0958	0.6213	1.0958	1.0468
No log	4.7826	220	1.2269	0.5798	1.2269	1.1077
No log	4.8261	222	1.4301	0.5392	1.4301	1.1959
No log	4.8696	224	1.4066	0.5336	1.4066	1.1860
No log	4.9130	226	1.2078	0.5633	1.2078	1.0990
No log	4.9565	228	1.0349	0.5838	1.0349	1.0173
No log	5.0	230	0.9696	0.5778	0.9696	0.9847
No log	5.0435	232	0.9589	0.5460	0.9589	0.9792
No log	5.0870	234	0.9664	0.5741	0.9664	0.9831
No log	5.1304	236	0.9656	0.5626	0.9656	0.9827
No log	5.1739	238	1.0084	0.5766	1.0084	1.0042
No log	5.2174	240	0.9750	0.5765	0.9750	0.9874
No log	5.2609	242	0.9102	0.5917	0.9102	0.9540
No log	5.3043	244	0.8760	0.5917	0.8760	0.9360
No log	5.3478	246	0.8775	0.6288	0.8775	0.9367
No log	5.3913	248	0.9231	0.6309	0.9231	0.9608
No log	5.4348	250	0.9661	0.6198	0.9661	0.9829
No log	5.4783	252	0.9712	0.6184	0.9712	0.9855
No log	5.5217	254	0.9560	0.6426	0.9560	0.9777
No log	5.5652	256	0.9512	0.6248	0.9512	0.9753
No log	5.6087	258	0.9477	0.6105	0.9477	0.9735
No log	5.6522	260	0.9021	0.6325	0.9021	0.9498
No log	5.6957	262	0.8981	0.6339	0.8981	0.9477
No log	5.7391	264	0.9530	0.6144	0.9530	0.9762
No log	5.7826	266	1.0236	0.6161	1.0236	1.0118
No log	5.8261	268	1.0179	0.6032	1.0179	1.0089
No log	5.8696	270	0.9602	0.5943	0.9602	0.9799
No log	5.9130	272	0.8834	0.6148	0.8834	0.9399
No log	5.9565	274	0.8613	0.6310	0.8613	0.9281
No log	6.0	276	0.8726	0.6569	0.8726	0.9341
No log	6.0435	278	0.9120	0.6535	0.9120	0.9550
No log	6.0870	280	0.9284	0.6507	0.9284	0.9635
No log	6.1304	282	0.9019	0.6445	0.9019	0.9497
No log	6.1739	284	0.8723	0.6526	0.8723	0.9340
No log	6.2174	286	0.8392	0.6526	0.8392	0.9161
No log	6.2609	288	0.8482	0.6395	0.8482	0.9210
No log	6.3043	290	0.9212	0.6347	0.9212	0.9598
No log	6.3478	292	0.9843	0.6095	0.9843	0.9921
No log	6.3913	294	1.0365	0.6055	1.0365	1.0181
No log	6.4348	296	1.1098	0.5926	1.1098	1.0535
No log	6.4783	298	1.1545	0.5903	1.1545	1.0745
No log	6.5217	300	1.0975	0.5907	1.0975	1.0476
No log	6.5652	302	0.9960	0.6037	0.9960	0.9980
No log	6.6087	304	0.9321	0.6026	0.9321	0.9655
No log	6.6522	306	0.9202	0.6123	0.9202	0.9592
No log	6.6957	308	0.9458	0.6081	0.9458	0.9725
No log	6.7391	310	0.9605	0.6081	0.9605	0.9801
No log	6.7826	312	0.9831	0.6099	0.9831	0.9915
No log	6.8261	314	1.0264	0.6085	1.0264	1.0131
No log	6.8696	316	1.0161	0.6085	1.0161	1.0080
No log	6.9130	318	0.9493	0.5816	0.9493	0.9743
No log	6.9565	320	0.9195	0.5841	0.9195	0.9589
No log	7.0	322	0.9159	0.5817	0.9159	0.9570
No log	7.0435	324	0.9423	0.5730	0.9423	0.9707
No log	7.0870	326	0.9780	0.5826	0.9780	0.9889
No log	7.1304	328	0.9592	0.5718	0.9592	0.9794
No log	7.1739	330	0.9370	0.5742	0.9370	0.9680
No log	7.2174	332	0.9170	0.5754	0.9170	0.9576
No log	7.2609	334	0.9512	0.5730	0.9512	0.9753
No log	7.3043	336	0.9789	0.5943	0.9789	0.9894
No log	7.3478	338	1.0057	0.6035	1.0057	1.0028
No log	7.3913	340	1.0018	0.6035	1.0018	1.0009
No log	7.4348	342	0.9926	0.6095	0.9926	0.9963
No log	7.4783	344	1.0258	0.6035	1.0258	1.0128
No log	7.5217	346	1.0595	0.6089	1.0595	1.0293
No log	7.5652	348	1.0683	0.6089	1.0683	1.0336
No log	7.6087	350	1.1067	0.5982	1.1067	1.0520
No log	7.6522	352	1.1200	0.6001	1.1200	1.0583
No log	7.6957	354	1.1127	0.6014	1.1127	1.0548
No log	7.7391	356	1.1063	0.5998	1.1063	1.0518
No log	7.7826	358	1.1302	0.5820	1.1302	1.0631
No log	7.8261	360	1.1823	0.5723	1.1823	1.0873
No log	7.8696	362	1.2550	0.5861	1.2550	1.1203
No log	7.9130	364	1.2999	0.5693	1.2999	1.1401
No log	7.9565	366	1.2678	0.5850	1.2678	1.1260
No log	8.0	368	1.1824	0.5820	1.1824	1.0874
No log	8.0435	370	1.0849	0.5882	1.0849	1.0416
No log	8.0870	372	0.9975	0.6040	0.9975	0.9988
No log	8.1304	374	0.9731	0.6054	0.9731	0.9865
No log	8.1739	376	0.9620	0.6054	0.9620	0.9808
No log	8.2174	378	0.9772	0.6054	0.9772	0.9885
No log	8.2609	380	1.0031	0.6109	1.0031	1.0015
No log	8.3043	382	1.0227	0.6035	1.0227	1.0113
No log	8.3478	384	1.0183	0.6081	1.0183	1.0091
No log	8.3913	386	1.0036	0.6081	1.0036	1.0018
No log	8.4348	388	1.0148	0.6081	1.0148	1.0074
No log	8.4783	390	1.0196	0.6081	1.0196	1.0098
No log	8.5217	392	1.0031	0.6081	1.0031	1.0016
No log	8.5652	394	0.9873	0.6095	0.9873	0.9936
No log	8.6087	396	0.9674	0.6109	0.9674	0.9836
No log	8.6522	398	0.9642	0.6207	0.9642	0.9819
No log	8.6957	400	0.9755	0.6095	0.9755	0.9877
No log	8.7391	402	1.0074	0.6081	1.0074	1.0037
No log	8.7826	404	1.0605	0.6085	1.0605	1.0298
No log	8.8261	406	1.0968	0.6168	1.0968	1.0473
No log	8.8696	408	1.0963	0.6232	1.0963	1.0471
No log	8.9130	410	1.0805	0.6103	1.0805	1.0395
No log	8.9565	412	1.0665	0.6085	1.0665	1.0327
No log	9.0	414	1.0434	0.6085	1.0434	1.0215
No log	9.0435	416	1.0170	0.6085	1.0170	1.0085
No log	9.0870	418	1.0001	0.6085	1.0001	1.0001
No log	9.1304	420	0.9774	0.6113	0.9774	0.9886
No log	9.1739	422	0.9638	0.6109	0.9638	0.9817
No log	9.2174	424	0.9573	0.6087	0.9573	0.9784
No log	9.2609	426	0.9674	0.6109	0.9674	0.9836
No log	9.3043	428	0.9851	0.6113	0.9851	0.9925
No log	9.3478	430	1.0046	0.6085	1.0046	1.0023
No log	9.3913	432	1.0232	0.6085	1.0232	1.0116
No log	9.4348	434	1.0311	0.6085	1.0311	1.0154
No log	9.4783	436	1.0267	0.6085	1.0267	1.0133
No log	9.5217	438	1.0124	0.6085	1.0124	1.0062
No log	9.5652	440	0.9997	0.6099	0.9997	0.9999
No log	9.6087	442	0.9950	0.6099	0.9950	0.9975
No log	9.6522	444	0.9946	0.6099	0.9946	0.9973
No log	9.6957	446	0.9893	0.6099	0.9893	0.9946
No log	9.7391	448	0.9839	0.6113	0.9839	0.9919
No log	9.7826	450	0.9769	0.6113	0.9769	0.9884
No log	9.8261	452	0.9720	0.6109	0.9720	0.9859
No log	9.8696	454	0.9706	0.6109	0.9706	0.9852
No log	9.9130	456	0.9701	0.6109	0.9701	0.9849
No log	9.9565	458	0.9692	0.6109	0.9692	0.9845
No log	10.0	460	0.9691	0.6109	0.9691	0.9844

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1