ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9904
• Qwk: 0.3124
• Mse: 0.9904
• Rmse: 0.9952

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.0223	-0.0101	4.0223	2.0056
No log	0.0870	4	2.1125	0.0537	2.1125	1.4534
No log	0.1304	6	1.2801	0.0584	1.2801	1.1314
No log	0.1739	8	1.1475	0.1944	1.1475	1.0712
No log	0.2174	10	1.1905	0.2166	1.1905	1.0911
No log	0.2609	12	1.1179	0.1046	1.1179	1.0573
No log	0.3043	14	1.0891	0.1046	1.0891	1.0436
No log	0.3478	16	1.0504	0.1046	1.0504	1.0249
No log	0.3913	18	1.0780	0.2314	1.0780	1.0383
No log	0.4348	20	1.0653	0.2114	1.0653	1.0321
No log	0.4783	22	1.0592	0.2865	1.0592	1.0292
No log	0.5217	24	1.0291	0.2566	1.0291	1.0144
No log	0.5652	26	1.0021	0.1810	1.0021	1.0010
No log	0.6087	28	1.0411	0.2236	1.0411	1.0203
No log	0.6522	30	1.0538	0.2424	1.0538	1.0265
No log	0.6957	32	0.9977	0.2154	0.9977	0.9988
No log	0.7391	34	1.0371	0.2958	1.0371	1.0184
No log	0.7826	36	0.9664	0.2935	0.9664	0.9831
No log	0.8261	38	0.9398	0.1857	0.9398	0.9694
No log	0.8696	40	0.9723	0.3483	0.9723	0.9860
No log	0.9130	42	1.0721	0.3287	1.0721	1.0354
No log	0.9565	44	1.2198	0.2273	1.2198	1.1044
No log	1.0	46	0.9720	0.3483	0.9720	0.9859
No log	1.0435	48	0.8665	0.3407	0.8665	0.9309
No log	1.0870	50	0.9745	0.2567	0.9745	0.9872
No log	1.1304	52	1.0153	0.3276	1.0153	1.0076
No log	1.1739	54	1.0002	0.3885	1.0002	1.0001
No log	1.2174	56	0.9320	0.5164	0.9320	0.9654
No log	1.2609	58	0.7444	0.5192	0.7444	0.8628
No log	1.3043	60	0.7497	0.5635	0.7497	0.8658
No log	1.3478	62	0.8204	0.4518	0.8204	0.9057
No log	1.3913	64	0.7703	0.6119	0.7703	0.8777
No log	1.4348	66	0.8684	0.5298	0.8684	0.9319
No log	1.4783	68	0.7968	0.5363	0.7968	0.8926
No log	1.5217	70	0.8711	0.4624	0.8711	0.9333
No log	1.5652	72	0.8384	0.4833	0.8384	0.9156
No log	1.6087	74	0.7434	0.5844	0.7434	0.8622
No log	1.6522	76	0.7113	0.5736	0.7113	0.8434
No log	1.6957	78	0.6830	0.6390	0.6830	0.8265
No log	1.7391	80	0.6651	0.6584	0.6651	0.8156
No log	1.7826	82	0.7022	0.6497	0.7022	0.8380
No log	1.8261	84	0.6961	0.5223	0.6961	0.8343
No log	1.8696	86	0.8143	0.5266	0.8143	0.9024
No log	1.9130	88	0.7777	0.4741	0.7777	0.8819
No log	1.9565	90	0.7565	0.5024	0.7565	0.8698
No log	2.0	92	0.7726	0.5107	0.7726	0.8790
No log	2.0435	94	0.7848	0.4981	0.7848	0.8859
No log	2.0870	96	0.8970	0.4595	0.8970	0.9471
No log	2.1304	98	0.8859	0.4947	0.8859	0.9412
No log	2.1739	100	0.8136	0.4990	0.8136	0.9020
No log	2.2174	102	0.8586	0.5543	0.8586	0.9266
No log	2.2609	104	1.0935	0.3973	1.0935	1.0457
No log	2.3043	106	1.1103	0.3819	1.1103	1.0537
No log	2.3478	108	0.8536	0.4638	0.8536	0.9239
No log	2.3913	110	0.8009	0.4662	0.8009	0.8949
No log	2.4348	112	0.8347	0.4953	0.8347	0.9136
No log	2.4783	114	0.9416	0.4500	0.9416	0.9703
No log	2.5217	116	0.9658	0.4389	0.9658	0.9828
No log	2.5652	118	0.9216	0.4171	0.9216	0.9600
No log	2.6087	120	0.8829	0.4034	0.8829	0.9396
No log	2.6522	122	0.8182	0.4471	0.8182	0.9045
No log	2.6957	124	0.8056	0.4802	0.8056	0.8975
No log	2.7391	126	0.8110	0.3860	0.8110	0.9005
No log	2.7826	128	0.9759	0.3480	0.9759	0.9879
No log	2.8261	130	1.0573	0.3395	1.0573	1.0282
No log	2.8696	132	1.0347	0.3270	1.0347	1.0172
No log	2.9130	134	1.0547	0.4	1.0547	1.0270
No log	2.9565	136	0.9701	0.4320	0.9701	0.9849
No log	3.0	138	0.9237	0.5778	0.9237	0.9611
No log	3.0435	140	0.9137	0.5696	0.9137	0.9559
No log	3.0870	142	0.9774	0.5352	0.9774	0.9886
No log	3.1304	144	0.9621	0.5273	0.9621	0.9809
No log	3.1739	146	0.8333	0.5317	0.8333	0.9129
No log	3.2174	148	0.7669	0.4948	0.7669	0.8757
No log	3.2609	150	0.7652	0.4476	0.7652	0.8747
No log	3.3043	152	0.7757	0.4220	0.7757	0.8807
No log	3.3478	154	0.7942	0.4075	0.7942	0.8912
No log	3.3913	156	0.7960	0.4075	0.7960	0.8922
No log	3.4348	158	0.8581	0.4318	0.8581	0.9263
No log	3.4783	160	0.8436	0.4318	0.8436	0.9185
No log	3.5217	162	0.7469	0.4742	0.7469	0.8642
No log	3.5652	164	0.7094	0.5591	0.7094	0.8423
No log	3.6087	166	0.7337	0.6403	0.7337	0.8566
No log	3.6522	168	0.7136	0.5984	0.7136	0.8448
No log	3.6957	170	0.7319	0.5618	0.7319	0.8555
No log	3.7391	172	0.7684	0.5150	0.7684	0.8766
No log	3.7826	174	0.8110	0.4695	0.8110	0.9006
No log	3.8261	176	0.7754	0.4599	0.7754	0.8805
No log	3.8696	178	0.7805	0.4244	0.7805	0.8834
No log	3.9130	180	0.8008	0.3725	0.8008	0.8949
No log	3.9565	182	0.8470	0.4812	0.8470	0.9203
No log	4.0	184	0.8721	0.4681	0.8721	0.9339
No log	4.0435	186	0.8420	0.4712	0.8420	0.9176
No log	4.0870	188	0.8774	0.4806	0.8774	0.9367
No log	4.1304	190	0.9367	0.4423	0.9367	0.9679
No log	4.1739	192	0.8906	0.4169	0.8906	0.9437
No log	4.2174	194	0.7898	0.4824	0.7898	0.8887
No log	4.2609	196	0.7626	0.5152	0.7626	0.8733
No log	4.3043	198	0.7498	0.5068	0.7498	0.8659
No log	4.3478	200	0.7281	0.5483	0.7281	0.8533
No log	4.3913	202	0.7476	0.5425	0.7476	0.8646
No log	4.4348	204	0.7459	0.5540	0.7459	0.8637
No log	4.4783	206	0.6777	0.5700	0.6777	0.8233
No log	4.5217	208	0.6974	0.5887	0.6974	0.8351
No log	4.5652	210	0.7403	0.5366	0.7403	0.8604
No log	4.6087	212	0.6954	0.5357	0.6954	0.8339
No log	4.6522	214	0.7469	0.4610	0.7469	0.8642
No log	4.6957	216	0.8340	0.4292	0.8340	0.9132
No log	4.7391	218	0.7992	0.4450	0.7992	0.8940
No log	4.7826	220	0.7065	0.5472	0.7065	0.8405
No log	4.8261	222	0.6663	0.6442	0.6663	0.8163
No log	4.8696	224	0.6726	0.6207	0.6726	0.8201
No log	4.9130	226	0.6896	0.5741	0.6896	0.8304
No log	4.9565	228	0.8333	0.5211	0.8333	0.9128
No log	5.0	230	0.9044	0.5188	0.9044	0.9510
No log	5.0435	232	0.9345	0.5090	0.9345	0.9667
No log	5.0870	234	0.7738	0.5416	0.7738	0.8797
No log	5.1304	236	0.7056	0.4691	0.7056	0.8400
No log	5.1739	238	0.7364	0.5425	0.7364	0.8582
No log	5.2174	240	0.7354	0.5066	0.7354	0.8575
No log	5.2609	242	0.7451	0.4097	0.7451	0.8632
No log	5.3043	244	0.8000	0.4428	0.8000	0.8944
No log	5.3478	246	0.8817	0.4681	0.8817	0.9390
No log	5.3913	248	0.8768	0.4433	0.8768	0.9364
No log	5.4348	250	0.7929	0.4461	0.7929	0.8905
No log	5.4783	252	0.7580	0.4743	0.7580	0.8707
No log	5.5217	254	0.7600	0.5357	0.7600	0.8718
No log	5.5652	256	0.8058	0.4728	0.8058	0.8977
No log	5.6087	258	0.8640	0.3804	0.8640	0.9295
No log	5.6522	260	0.8753	0.3648	0.8753	0.9356
No log	5.6957	262	0.8447	0.3503	0.8447	0.9191
No log	5.7391	264	0.8335	0.4180	0.8335	0.9129
No log	5.7826	266	0.8192	0.4847	0.8192	0.9051
No log	5.8261	268	0.8097	0.4847	0.8097	0.8998
No log	5.8696	270	0.8186	0.6147	0.8186	0.9048
No log	5.9130	272	0.7954	0.5840	0.7954	0.8919
No log	5.9565	274	0.7750	0.5155	0.7750	0.8804
No log	6.0	276	0.7708	0.4630	0.7708	0.8780
No log	6.0435	278	0.7845	0.4843	0.7845	0.8857
No log	6.0870	280	0.8073	0.4579	0.8073	0.8985
No log	6.1304	282	0.7743	0.4456	0.7743	0.8799
No log	6.1739	284	0.7532	0.4286	0.7532	0.8679
No log	6.2174	286	0.7501	0.4269	0.7501	0.8661
No log	6.2609	288	0.7776	0.4579	0.7776	0.8818
No log	6.3043	290	0.8400	0.4809	0.8400	0.9165
No log	6.3478	292	0.8636	0.4429	0.8636	0.9293
No log	6.3913	294	0.8603	0.4429	0.8603	0.9275
No log	6.4348	296	0.8080	0.5042	0.8080	0.8989
No log	6.4783	298	0.7604	0.5810	0.7604	0.8720
No log	6.5217	300	0.7371	0.4509	0.7371	0.8586
No log	6.5652	302	0.7286	0.5198	0.7286	0.8536
No log	6.6087	304	0.7074	0.4903	0.7074	0.8411
No log	6.6522	306	0.7384	0.5361	0.7384	0.8593
No log	6.6957	308	0.7677	0.5103	0.7677	0.8762
No log	6.7391	310	0.7498	0.5361	0.7498	0.8659
No log	6.7826	312	0.7302	0.4557	0.7302	0.8545
No log	6.8261	314	0.7936	0.5243	0.7936	0.8909
No log	6.8696	316	0.8320	0.5443	0.8320	0.9121
No log	6.9130	318	0.7703	0.4893	0.7703	0.8777
No log	6.9565	320	0.7263	0.5024	0.7263	0.8522
No log	7.0	322	0.7393	0.5477	0.7393	0.8598
No log	7.0435	324	0.7518	0.5937	0.7518	0.8671
No log	7.0870	326	0.7403	0.5472	0.7403	0.8604
No log	7.1304	328	0.7374	0.5038	0.7374	0.8587
No log	7.1739	330	0.7442	0.4819	0.7442	0.8627
No log	7.2174	332	0.7518	0.4908	0.7518	0.8671
No log	7.2609	334	0.7682	0.4893	0.7682	0.8765
No log	7.3043	336	0.8339	0.4180	0.8339	0.9132
No log	7.3478	338	0.9617	0.3363	0.9617	0.9806
No log	7.3913	340	1.1241	0.3578	1.1241	1.0603
No log	7.4348	342	1.2030	0.3624	1.2030	1.0968
No log	7.4783	344	1.1572	0.4201	1.1572	1.0757
No log	7.5217	346	1.0679	0.4078	1.0679	1.0334
No log	7.5652	348	1.0537	0.3827	1.0537	1.0265
No log	7.6087	350	1.1230	0.3703	1.1230	1.0597
No log	7.6522	352	1.1506	0.3039	1.1506	1.0727
No log	7.6957	354	1.0484	0.2820	1.0484	1.0239
No log	7.7391	356	0.9377	0.4060	0.9377	0.9684
No log	7.7826	358	0.9301	0.4060	0.9301	0.9644
No log	7.8261	360	0.8810	0.4478	0.8810	0.9386
No log	7.8696	362	0.8519	0.4478	0.8519	0.9230
No log	7.9130	364	0.8260	0.5103	0.8260	0.9088
No log	7.9565	366	0.8232	0.5103	0.8232	0.9073
No log	8.0	368	0.8024	0.5135	0.8024	0.8958
No log	8.0435	370	0.8032	0.5135	0.8032	0.8962
No log	8.0870	372	0.7983	0.5135	0.7983	0.8935
No log	8.1304	374	0.7979	0.5135	0.7979	0.8933
No log	8.1739	376	0.8250	0.5084	0.8250	0.9083
No log	8.2174	378	0.8206	0.4743	0.8206	0.9059
No log	8.2609	380	0.7788	0.5135	0.7788	0.8825
No log	8.3043	382	0.7696	0.4576	0.7696	0.8773
No log	8.3478	384	0.7732	0.4856	0.7732	0.8793
No log	8.3913	386	0.7775	0.5275	0.7775	0.8818
No log	8.4348	388	0.8013	0.5558	0.8013	0.8951
No log	8.4783	390	0.8340	0.5413	0.8340	0.9132
No log	8.5217	392	0.8403	0.5413	0.8403	0.9167
No log	8.5652	394	0.8196	0.4629	0.8196	0.9053
No log	8.6087	396	0.8173	0.4908	0.8173	0.9040
No log	8.6522	398	0.8069	0.4295	0.8069	0.8983
No log	8.6957	400	0.7986	0.4295	0.7986	0.8936
No log	8.7391	402	0.8262	0.4251	0.8262	0.9090
No log	8.7826	404	0.9012	0.4728	0.9012	0.9493
No log	8.8261	406	0.9603	0.4327	0.9603	0.9800
No log	8.8696	408	0.9005	0.4727	0.9005	0.9489
No log	8.9130	410	0.7942	0.4759	0.7942	0.8912
No log	8.9565	412	0.7343	0.4174	0.7343	0.8569
No log	9.0	414	0.7422	0.4590	0.7422	0.8615
No log	9.0435	416	0.7314	0.4706	0.7314	0.8552
No log	9.0870	418	0.7530	0.4903	0.7530	0.8677
No log	9.1304	420	0.8352	0.5413	0.8352	0.9139
No log	9.1739	422	0.9521	0.5	0.9521	0.9758
No log	9.2174	424	0.9506	0.4775	0.9506	0.9750
No log	9.2609	426	0.8769	0.5056	0.8769	0.9364
No log	9.3043	428	0.7749	0.4595	0.7749	0.8803
No log	9.3478	430	0.7194	0.4676	0.7194	0.8482
No log	9.3913	432	0.7083	0.4069	0.7083	0.8416
No log	9.4348	434	0.7073	0.4676	0.7073	0.8410
No log	9.4783	436	0.7617	0.5605	0.7617	0.8728
No log	9.5217	438	0.8826	0.5400	0.8826	0.9395
No log	9.5652	440	0.9331	0.5157	0.9331	0.9660
No log	9.6087	442	0.9594	0.5372	0.9594	0.9795
No log	9.6522	444	0.9061	0.5707	0.9061	0.9519
No log	9.6957	446	0.8243	0.5948	0.8243	0.9079
No log	9.7391	448	0.7741	0.5345	0.7741	0.8798
No log	9.7826	450	0.7580	0.5359	0.7580	0.8706
No log	9.8261	452	0.7420	0.4918	0.7420	0.8614
No log	9.8696	454	0.7494	0.4422	0.7494	0.8657
No log	9.9130	456	0.7558	0.4557	0.7558	0.8694
No log	9.9565	458	0.7489	0.4439	0.7489	0.8654
No log	10.0	460	0.7400	0.4807	0.7400	0.8602
No log	10.0435	462	0.7423	0.4918	0.7423	0.8615
No log	10.0870	464	0.7461	0.4789	0.7461	0.8637
No log	10.1304	466	0.7437	0.4918	0.7437	0.8624
No log	10.1739	468	0.7401	0.4691	0.7401	0.8603
No log	10.2174	470	0.7445	0.4609	0.7445	0.8628
No log	10.2609	472	0.7404	0.4346	0.7404	0.8605
No log	10.3043	474	0.7429	0.4444	0.7429	0.8619
No log	10.3478	476	0.7433	0.4691	0.7433	0.8621
No log	10.3913	478	0.7469	0.4594	0.7469	0.8642
No log	10.4348	480	0.7433	0.4706	0.7433	0.8622
No log	10.4783	482	0.7387	0.4819	0.7387	0.8595
No log	10.5217	484	0.7318	0.5046	0.7318	0.8555
No log	10.5652	486	0.7320	0.5052	0.7320	0.8556
No log	10.6087	488	0.7318	0.5386	0.7318	0.8554
No log	10.6522	490	0.7320	0.5163	0.7320	0.8556
No log	10.6957	492	0.7406	0.4706	0.7406	0.8606
No log	10.7391	494	0.7333	0.4706	0.7333	0.8563
No log	10.7826	496	0.7252	0.4578	0.7252	0.8516
No log	10.8261	498	0.7243	0.4706	0.7243	0.8511
0.2673	10.8696	500	0.7189	0.4706	0.7189	0.8479
0.2673	10.9130	502	0.7200	0.4578	0.7200	0.8485
0.2673	10.9565	504	0.7396	0.4918	0.7396	0.8600
0.2673	11.0	506	0.7499	0.5146	0.7499	0.8660
0.2673	11.0435	508	0.7432	0.4804	0.7432	0.8621
0.2673	11.0870	510	0.7404	0.4721	0.7403	0.8604
0.2673	11.1304	512	0.7562	0.4614	0.7562	0.8696
0.2673	11.1739	514	0.7826	0.5373	0.7826	0.8846
0.2673	11.2174	516	0.8259	0.4713	0.8259	0.9088
0.2673	11.2609	518	0.8631	0.4697	0.8631	0.9290
0.2673	11.3043	520	0.9116	0.3938	0.9116	0.9548
0.2673	11.3478	522	0.9634	0.3601	0.9634	0.9815
0.2673	11.3913	524	0.9981	0.3624	0.9981	0.9991
0.2673	11.4348	526	0.9466	0.4783	0.9466	0.9730
0.2673	11.4783	528	0.8508	0.5695	0.8508	0.9224
0.2673	11.5217	530	0.8350	0.5822	0.8350	0.9138
0.2673	11.5652	532	0.8523	0.5292	0.8523	0.9232
0.2673	11.6087	534	0.9028	0.4932	0.9028	0.9502
0.2673	11.6522	536	0.9549	0.2820	0.9549	0.9772
0.2673	11.6957	538	1.0219	0.2273	1.0219	1.0109
0.2673	11.7391	540	1.0553	0.2416	1.0553	1.0273
0.2673	11.7826	542	1.0503	0.2820	1.0503	1.0248
0.2673	11.8261	544	0.9904	0.3124	0.9904	0.9952

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1