ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8342
• Qwk: 0.5439
• Mse: 0.8342
• Rmse: 0.9133

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.3333	2	5.2401	-0.0075	5.2401	2.2891
No log	0.6667	4	3.5067	0.0276	3.5067	1.8726
No log	1.0	6	1.9065	0.0790	1.9065	1.3808
No log	1.3333	8	1.2406	0.1289	1.2406	1.1138
No log	1.6667	10	1.0584	0.2711	1.0584	1.0288
No log	2.0	12	1.4461	0.1498	1.4461	1.2025
No log	2.3333	14	1.3232	0.1545	1.3232	1.1503
No log	2.6667	16	1.0454	0.3318	1.0454	1.0225
No log	3.0	18	1.0523	0.3190	1.0523	1.0258
No log	3.3333	20	1.2239	0.2515	1.2239	1.1063
No log	3.6667	22	1.0980	0.4191	1.0980	1.0478
No log	4.0	24	0.8976	0.4502	0.8976	0.9474
No log	4.3333	26	1.1022	0.4962	1.1022	1.0499
No log	4.6667	28	1.0831	0.4124	1.0831	1.0407
No log	5.0	30	0.9470	0.4877	0.9470	0.9731
No log	5.3333	32	1.1300	0.4264	1.1300	1.0630
No log	5.6667	34	1.1859	0.3693	1.1859	1.0890
No log	6.0	36	0.9432	0.4229	0.9432	0.9712
No log	6.3333	38	1.1280	0.4952	1.1280	1.0621
No log	6.6667	40	1.2048	0.4825	1.2048	1.0977
No log	7.0	42	0.9217	0.4548	0.9217	0.9600
No log	7.3333	44	1.3261	0.2910	1.3261	1.1516
No log	7.6667	46	1.2117	0.3719	1.2117	1.1008
No log	8.0	48	1.0579	0.4735	1.0579	1.0285
No log	8.3333	50	0.8455	0.4885	0.8455	0.9195
No log	8.6667	52	0.8496	0.5611	0.8496	0.9217
No log	9.0	54	0.8689	0.4575	0.8689	0.9321
No log	9.3333	56	0.9808	0.5022	0.9808	0.9903
No log	9.6667	58	1.2090	0.4153	1.2090	1.0995
No log	10.0	60	1.1705	0.4323	1.1705	1.0819
No log	10.3333	62	1.3720	0.3396	1.3720	1.1713
No log	10.6667	64	1.2048	0.3859	1.2048	1.0976
No log	11.0	66	1.0394	0.5169	1.0394	1.0195
No log	11.3333	68	0.9391	0.5309	0.9391	0.9691
No log	11.6667	70	0.9149	0.4954	0.9149	0.9565
No log	12.0	72	0.9976	0.4594	0.9976	0.9988
No log	12.3333	74	1.0327	0.4755	1.0327	1.0162
No log	12.6667	76	1.0536	0.5279	1.0536	1.0264
No log	13.0	78	0.8763	0.5323	0.8763	0.9361
No log	13.3333	80	0.8730	0.5986	0.8730	0.9343
No log	13.6667	82	0.9187	0.5416	0.9187	0.9585
No log	14.0	84	1.0069	0.4765	1.0069	1.0035
No log	14.3333	86	0.9878	0.4309	0.9878	0.9939
No log	14.6667	88	0.9004	0.4634	0.9004	0.9489
No log	15.0	90	0.9464	0.3953	0.9464	0.9728
No log	15.3333	92	0.9732	0.4257	0.9732	0.9865
No log	15.6667	94	1.1173	0.3381	1.1173	1.0570
No log	16.0	96	1.1753	0.2581	1.1753	1.0841
No log	16.3333	98	1.0383	0.4328	1.0383	1.0190
No log	16.6667	100	0.9907	0.4308	0.9907	0.9953
No log	17.0	102	0.9945	0.4146	0.9945	0.9973
No log	17.3333	104	0.9877	0.4426	0.9877	0.9938
No log	17.6667	106	0.9846	0.5008	0.9846	0.9923
No log	18.0	108	1.1272	0.4755	1.1272	1.0617
No log	18.3333	110	1.1551	0.4289	1.1551	1.0748
No log	18.6667	112	0.9621	0.4668	0.9621	0.9809
No log	19.0	114	0.8984	0.4653	0.8984	0.9479
No log	19.3333	116	0.9072	0.4533	0.9072	0.9525
No log	19.6667	118	0.8826	0.4505	0.8826	0.9395
No log	20.0	120	0.9098	0.4258	0.9098	0.9539
No log	20.3333	122	1.0312	0.4344	1.0312	1.0155
No log	20.6667	124	0.9595	0.4581	0.9595	0.9795
No log	21.0	126	0.8738	0.4429	0.8738	0.9348
No log	21.3333	128	0.9659	0.4479	0.9659	0.9828
No log	21.6667	130	0.9306	0.4615	0.9306	0.9647
No log	22.0	132	0.9383	0.5132	0.9383	0.9687
No log	22.3333	134	1.0335	0.4782	1.0335	1.0166
No log	22.6667	136	0.9543	0.5090	0.9543	0.9769
No log	23.0	138	0.8764	0.5621	0.8764	0.9362
No log	23.3333	140	0.8768	0.4852	0.8768	0.9364
No log	23.6667	142	0.8824	0.5192	0.8824	0.9394
No log	24.0	144	0.8679	0.5431	0.8679	0.9316
No log	24.3333	146	0.8977	0.5216	0.8977	0.9474
No log	24.6667	148	0.9845	0.4813	0.9845	0.9922
No log	25.0	150	1.0108	0.4802	1.0108	1.0054
No log	25.3333	152	0.9779	0.4323	0.9779	0.9889
No log	25.6667	154	0.9807	0.4693	0.9807	0.9903
No log	26.0	156	0.9844	0.4209	0.9844	0.9922
No log	26.3333	158	1.0180	0.3762	1.0180	1.0090
No log	26.6667	160	0.9708	0.3968	0.9708	0.9853
No log	27.0	162	0.9506	0.4626	0.9506	0.9750
No log	27.3333	164	0.9432	0.4920	0.9432	0.9712
No log	27.6667	166	0.9557	0.4807	0.9557	0.9776
No log	28.0	168	0.9737	0.5386	0.9737	0.9868
No log	28.3333	170	0.9830	0.5348	0.9830	0.9914
No log	28.6667	172	0.9858	0.5323	0.9858	0.9929
No log	29.0	174	1.0092	0.4636	1.0092	1.0046
No log	29.3333	176	1.0290	0.4755	1.0290	1.0144
No log	29.6667	178	0.9877	0.4765	0.9877	0.9938
No log	30.0	180	0.8922	0.5474	0.8922	0.9446
No log	30.3333	182	0.8759	0.4728	0.8759	0.9359
No log	30.6667	184	0.8687	0.4948	0.8687	0.9321
No log	31.0	186	0.8729	0.4662	0.8729	0.9343
No log	31.3333	188	0.9279	0.4331	0.9279	0.9633
No log	31.6667	190	0.9241	0.4331	0.9241	0.9613
No log	32.0	192	0.9200	0.4254	0.9200	0.9592
No log	32.3333	194	0.9355	0.4141	0.9355	0.9672
No log	32.6667	196	0.9299	0.3977	0.9299	0.9643
No log	33.0	198	0.9245	0.4699	0.9245	0.9615
No log	33.3333	200	0.9372	0.4699	0.9372	0.9681
No log	33.6667	202	0.9246	0.4664	0.9246	0.9616
No log	34.0	204	0.9318	0.4942	0.9318	0.9653
No log	34.3333	206	0.9471	0.4727	0.9471	0.9732
No log	34.6667	208	0.9455	0.4247	0.9455	0.9724
No log	35.0	210	0.9482	0.4215	0.9482	0.9738
No log	35.3333	212	0.9736	0.5137	0.9736	0.9867
No log	35.6667	214	1.0288	0.4705	1.0288	1.0143
No log	36.0	216	1.0159	0.4290	1.0159	1.0079
No log	36.3333	218	0.9901	0.4064	0.9901	0.9951
No log	36.6667	220	0.9657	0.4774	0.9657	0.9827
No log	37.0	222	0.9447	0.5077	0.9447	0.9720
No log	37.3333	224	0.9196	0.5177	0.9196	0.9590
No log	37.6667	226	0.8902	0.4040	0.8902	0.9435
No log	38.0	228	0.8784	0.4720	0.8784	0.9372
No log	38.3333	230	0.8669	0.4440	0.8669	0.9311
No log	38.6667	232	0.9069	0.4932	0.9069	0.9523
No log	39.0	234	1.0403	0.4153	1.0403	1.0199
No log	39.3333	236	0.9931	0.4595	0.9931	0.9966
No log	39.6667	238	0.8566	0.4657	0.8566	0.9255
No log	40.0	240	0.8073	0.5124	0.8073	0.8985
No log	40.3333	242	0.8818	0.4983	0.8818	0.9391
No log	40.6667	244	0.8788	0.5419	0.8788	0.9375
No log	41.0	246	0.8659	0.4346	0.8659	0.9305
No log	41.3333	248	0.8941	0.4504	0.8941	0.9456
No log	41.6667	250	0.9263	0.4919	0.9263	0.9624
No log	42.0	252	0.9116	0.4731	0.9116	0.9548
No log	42.3333	254	0.8835	0.4160	0.8835	0.9399
No log	42.6667	256	0.9169	0.4783	0.9169	0.9576
No log	43.0	258	0.9960	0.4949	0.9960	0.9980
No log	43.3333	260	1.0367	0.5134	1.0367	1.0182
No log	43.6667	262	0.9845	0.4916	0.9845	0.9922
No log	44.0	264	0.9001	0.5256	0.9001	0.9487
No log	44.3333	266	0.8962	0.5244	0.8962	0.9467
No log	44.6667	268	0.9308	0.5106	0.9308	0.9648
No log	45.0	270	0.9211	0.5094	0.9211	0.9598
No log	45.3333	272	0.8835	0.5216	0.8835	0.9399
No log	45.6667	274	0.8858	0.5238	0.8858	0.9412
No log	46.0	276	0.9406	0.5170	0.9406	0.9698
No log	46.3333	278	0.9825	0.5384	0.9825	0.9912
No log	46.6667	280	0.9549	0.5367	0.9549	0.9772
No log	47.0	282	0.9334	0.5036	0.9334	0.9661
No log	47.3333	284	1.0013	0.5005	1.0013	1.0006
No log	47.6667	286	1.1253	0.4186	1.1253	1.0608
No log	48.0	288	1.1446	0.4186	1.1446	1.0698
No log	48.3333	290	1.0481	0.4784	1.0481	1.0238
No log	48.6667	292	0.9356	0.4890	0.9356	0.9673
No log	49.0	294	0.8805	0.4739	0.8805	0.9383
No log	49.3333	296	0.8791	0.4397	0.8791	0.9376
No log	49.6667	298	0.9044	0.4796	0.9044	0.9510
No log	50.0	300	0.9283	0.4894	0.9283	0.9635
No log	50.3333	302	0.9475	0.4417	0.9475	0.9734
No log	50.6667	304	0.9609	0.4589	0.9609	0.9802
No log	51.0	306	0.9590	0.4316	0.9590	0.9793
No log	51.3333	308	0.9482	0.4690	0.9482	0.9738
No log	51.6667	310	0.9165	0.4420	0.9165	0.9573
No log	52.0	312	0.8912	0.4634	0.8912	0.9440
No log	52.3333	314	0.8849	0.4929	0.8849	0.9407
No log	52.6667	316	0.8720	0.5567	0.8720	0.9338
No log	53.0	318	0.8535	0.5515	0.8535	0.9239
No log	53.3333	320	0.8466	0.5343	0.8466	0.9201
No log	53.6667	322	0.8577	0.4996	0.8577	0.9261
No log	54.0	324	0.8766	0.5324	0.8766	0.9363
No log	54.3333	326	0.8883	0.5476	0.8883	0.9425
No log	54.6667	328	0.8787	0.5476	0.8787	0.9374
No log	55.0	330	0.8562	0.5489	0.8562	0.9253
No log	55.3333	332	0.8467	0.5753	0.8467	0.9201
No log	55.6667	334	0.8443	0.6029	0.8443	0.9189
No log	56.0	336	0.8543	0.5568	0.8543	0.9243
No log	56.3333	338	0.8548	0.5568	0.8548	0.9245
No log	56.6667	340	0.8436	0.5518	0.8436	0.9185
No log	57.0	342	0.8384	0.5573	0.8384	0.9157
No log	57.3333	344	0.8409	0.5573	0.8409	0.9170
No log	57.6667	346	0.8427	0.5507	0.8427	0.9180
No log	58.0	348	0.8507	0.4994	0.8507	0.9223
No log	58.3333	350	0.8582	0.5008	0.8582	0.9264
No log	58.6667	352	0.8768	0.5063	0.8768	0.9364
No log	59.0	354	0.8925	0.5063	0.8925	0.9447
No log	59.3333	356	0.9089	0.5063	0.9089	0.9534
No log	59.6667	358	0.9060	0.5243	0.9060	0.9518
No log	60.0	360	0.8957	0.5747	0.8957	0.9464
No log	60.3333	362	0.8678	0.5723	0.8678	0.9315
No log	60.6667	364	0.8464	0.5917	0.8464	0.9200
No log	61.0	366	0.8387	0.5824	0.8387	0.9158
No log	61.3333	368	0.8377	0.5611	0.8377	0.9153
No log	61.6667	370	0.8448	0.5305	0.8448	0.9191
No log	62.0	372	0.8409	0.4969	0.8409	0.9170
No log	62.3333	374	0.8300	0.4983	0.8300	0.9110
No log	62.6667	376	0.8233	0.5229	0.8233	0.9074
No log	63.0	378	0.8129	0.5892	0.8129	0.9016
No log	63.3333	380	0.8184	0.5997	0.8184	0.9046
No log	63.6667	382	0.8291	0.5866	0.8291	0.9105
No log	64.0	384	0.8373	0.5412	0.8373	0.9150
No log	64.3333	386	0.8480	0.5347	0.8480	0.9209
No log	64.6667	388	0.8415	0.5347	0.8415	0.9173
No log	65.0	390	0.8344	0.5776	0.8344	0.9135
No log	65.3333	392	0.8271	0.6225	0.8271	0.9095
No log	65.6667	394	0.8205	0.6382	0.8205	0.9058
No log	66.0	396	0.8147	0.6097	0.8147	0.9026
No log	66.3333	398	0.8069	0.6119	0.8069	0.8983
No log	66.6667	400	0.8001	0.5555	0.8001	0.8945
No log	67.0	402	0.8014	0.5431	0.8014	0.8952
No log	67.3333	404	0.8033	0.5738	0.8033	0.8963
No log	67.6667	406	0.8050	0.5738	0.8050	0.8972
No log	68.0	408	0.8002	0.5969	0.8002	0.8946
No log	68.3333	410	0.7984	0.6151	0.7984	0.8935
No log	68.6667	412	0.7978	0.6095	0.7978	0.8932
No log	69.0	414	0.7947	0.6260	0.7947	0.8915
No log	69.3333	416	0.7927	0.5978	0.7927	0.8904
No log	69.6667	418	0.7955	0.6487	0.7955	0.8919
No log	70.0	420	0.8083	0.6077	0.8083	0.8991
No log	70.3333	422	0.8189	0.5971	0.8189	0.9049
No log	70.6667	424	0.8395	0.6131	0.8395	0.9163
No log	71.0	426	0.8488	0.5731	0.8488	0.9213
No log	71.3333	428	0.8449	0.6235	0.8449	0.9192
No log	71.6667	430	0.8429	0.5886	0.8429	0.9181
No log	72.0	432	0.8418	0.5879	0.8418	0.9175
No log	72.3333	434	0.8465	0.5781	0.8465	0.9200
No log	72.6667	436	0.8530	0.5434	0.8530	0.9236
No log	73.0	438	0.8566	0.5620	0.8566	0.9255
No log	73.3333	440	0.8545	0.5434	0.8545	0.9244
No log	73.6667	442	0.8533	0.5781	0.8533	0.9238
No log	74.0	444	0.8505	0.6056	0.8505	0.9222
No log	74.3333	446	0.8485	0.5658	0.8485	0.9211
No log	74.6667	448	0.8452	0.5944	0.8452	0.9193
No log	75.0	450	0.8414	0.5892	0.8414	0.9173
No log	75.3333	452	0.8352	0.5741	0.8352	0.9139
No log	75.6667	454	0.8273	0.5741	0.8273	0.9096
No log	76.0	456	0.8242	0.5741	0.8242	0.9079
No log	76.3333	458	0.8196	0.5741	0.8196	0.9053
No log	76.6667	460	0.8190	0.5741	0.8190	0.9050
No log	77.0	462	0.8224	0.5621	0.8224	0.9069
No log	77.3333	464	0.8279	0.5556	0.8279	0.9099
No log	77.6667	466	0.8371	0.5472	0.8371	0.9149
No log	78.0	468	0.8438	0.5472	0.8438	0.9186
No log	78.3333	470	0.8526	0.5347	0.8526	0.9234
No log	78.6667	472	0.8594	0.5347	0.8594	0.9271
No log	79.0	474	0.8612	0.5347	0.8612	0.9280
No log	79.3333	476	0.8586	0.5347	0.8586	0.9266
No log	79.6667	478	0.8526	0.5094	0.8526	0.9234
No log	80.0	480	0.8445	0.5126	0.8445	0.9190
No log	80.3333	482	0.8419	0.5548	0.8419	0.9175
No log	80.6667	484	0.8408	0.5886	0.8408	0.9169
No log	81.0	486	0.8401	0.5670	0.8401	0.9165
No log	81.3333	488	0.8336	0.5670	0.8336	0.9130
No log	81.6667	490	0.8258	0.6183	0.8258	0.9087
No log	82.0	492	0.8188	0.5856	0.8188	0.9049
No log	82.3333	494	0.8150	0.5484	0.8150	0.9028
No log	82.6667	496	0.8169	0.5709	0.8169	0.9038
No log	83.0	498	0.8220	0.5484	0.8220	0.9066
0.2071	83.3333	500	0.8284	0.5658	0.8284	0.9102
0.2071	83.6667	502	0.8338	0.5658	0.8338	0.9131
0.2071	84.0	504	0.8359	0.5658	0.8359	0.9143
0.2071	84.3333	506	0.8348	0.5487	0.8348	0.9137
0.2071	84.6667	508	0.8340	0.5439	0.8340	0.9132
0.2071	85.0	510	0.8342	0.5439	0.8342	0.9133

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1