ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7192
• Qwk: 0.7459
• Mse: 0.7192
• Rmse: 0.8481

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.3238	-0.0140	2.3238	1.5244
No log	0.0645	4	1.4672	0.2148	1.4672	1.2113
No log	0.0968	6	1.2834	0.1672	1.2834	1.1329
No log	0.1290	8	1.2886	0.2186	1.2886	1.1351
No log	0.1613	10	1.2972	0.1266	1.2972	1.1389
No log	0.1935	12	1.3383	0.1216	1.3383	1.1569
No log	0.2258	14	1.3616	0.1009	1.3616	1.1669
No log	0.2581	16	1.4328	0.2780	1.4328	1.1970
No log	0.2903	18	1.4657	0.3056	1.4657	1.2107
No log	0.3226	20	1.3546	0.1954	1.3546	1.1639
No log	0.3548	22	1.2953	0.1189	1.2953	1.1381
No log	0.3871	24	1.3234	0.3263	1.3234	1.1504
No log	0.4194	26	1.3565	0.3392	1.3565	1.1647
No log	0.4516	28	1.3089	0.3249	1.3089	1.1441
No log	0.4839	30	1.2289	0.3655	1.2289	1.1086
No log	0.5161	32	1.2055	0.2407	1.2055	1.0979
No log	0.5484	34	1.2163	0.1913	1.2163	1.1029
No log	0.5806	36	1.2291	0.1071	1.2291	1.1086
No log	0.6129	38	1.2691	0.1071	1.2691	1.1265
No log	0.6452	40	1.3016	0.1360	1.3016	1.1409
No log	0.6774	42	1.3164	0.2678	1.3164	1.1473
No log	0.7097	44	1.2412	0.2886	1.2412	1.1141
No log	0.7419	46	1.1430	0.3245	1.1430	1.0691
No log	0.7742	48	1.0733	0.3908	1.0733	1.0360
No log	0.8065	50	1.0533	0.4136	1.0533	1.0263
No log	0.8387	52	1.1341	0.4160	1.1341	1.0649
No log	0.8710	54	1.0904	0.4628	1.0904	1.0442
No log	0.9032	56	0.9839	0.4728	0.9839	0.9919
No log	0.9355	58	1.1323	0.4705	1.1323	1.0641
No log	0.9677	60	1.1440	0.4652	1.1440	1.0696
No log	1.0	62	1.0333	0.4850	1.0333	1.0165
No log	1.0323	64	1.0657	0.4711	1.0657	1.0323
No log	1.0645	66	1.0351	0.4727	1.0351	1.0174
No log	1.0968	68	0.9735	0.4889	0.9735	0.9866
No log	1.1290	70	1.0037	0.4167	1.0037	1.0019
No log	1.1613	72	1.0994	0.4267	1.0994	1.0485
No log	1.1935	74	1.1342	0.4399	1.1342	1.0650
No log	1.2258	76	1.2156	0.4524	1.2156	1.1025
No log	1.2581	78	1.2899	0.4379	1.2899	1.1357
No log	1.2903	80	1.2660	0.4400	1.2660	1.1252
No log	1.3226	82	1.2277	0.4472	1.2277	1.1080
No log	1.3548	84	1.0724	0.4596	1.0724	1.0355
No log	1.3871	86	0.9224	0.5525	0.9224	0.9604
No log	1.4194	88	0.9099	0.5872	0.9099	0.9539
No log	1.4516	90	0.9341	0.5471	0.9341	0.9665
No log	1.4839	92	0.9676	0.5099	0.9676	0.9836
No log	1.5161	94	0.9963	0.5210	0.9963	0.9982
No log	1.5484	96	0.8771	0.5703	0.8771	0.9365
No log	1.5806	98	0.8543	0.5703	0.8543	0.9243
No log	1.6129	100	0.8366	0.5963	0.8366	0.9146
No log	1.6452	102	0.7864	0.6006	0.7864	0.8868
No log	1.6774	104	0.7933	0.5822	0.7933	0.8907
No log	1.7097	106	0.7862	0.6030	0.7862	0.8867
No log	1.7419	108	0.9502	0.6117	0.9502	0.9748
No log	1.7742	110	1.2328	0.5531	1.2328	1.1103
No log	1.8065	112	1.1990	0.5716	1.1990	1.0950
No log	1.8387	114	1.0943	0.5802	1.0943	1.0461
No log	1.8710	116	1.1196	0.5458	1.1196	1.0581
No log	1.9032	118	1.1907	0.5545	1.1907	1.0912
No log	1.9355	120	1.3783	0.5262	1.3783	1.1740
No log	1.9677	122	1.4005	0.4905	1.4005	1.1834
No log	2.0	124	1.1885	0.5296	1.1885	1.0902
No log	2.0323	126	0.9722	0.5529	0.9722	0.9860
No log	2.0645	128	0.7969	0.6420	0.7969	0.8927
No log	2.0968	130	0.7774	0.6420	0.7774	0.8817
No log	2.1290	132	0.8410	0.6288	0.8410	0.9171
No log	2.1613	134	1.1104	0.5455	1.1104	1.0537
No log	2.1935	136	1.4358	0.4613	1.4358	1.1983
No log	2.2258	138	1.3261	0.5034	1.3261	1.1516
No log	2.2581	140	1.0035	0.5897	1.0035	1.0017
No log	2.2903	142	0.8835	0.5855	0.8835	0.9400
No log	2.3226	144	0.8784	0.5820	0.8784	0.9372
No log	2.3548	146	0.9492	0.5491	0.9492	0.9743
No log	2.3871	148	1.1260	0.5214	1.1260	1.0612
No log	2.4194	150	1.2039	0.5050	1.2039	1.0972
No log	2.4516	152	1.2858	0.4638	1.2858	1.1339
No log	2.4839	154	1.2176	0.5043	1.2176	1.1034
No log	2.5161	156	1.0633	0.5105	1.0633	1.0312
No log	2.5484	158	0.8944	0.5820	0.8944	0.9457
No log	2.5806	160	0.8574	0.5922	0.8574	0.9259
No log	2.6129	162	0.8255	0.5818	0.8255	0.9086
No log	2.6452	164	0.8432	0.5919	0.8432	0.9183
No log	2.6774	166	0.8425	0.5963	0.8425	0.9179
No log	2.7097	168	0.9197	0.6170	0.9197	0.9590
No log	2.7419	170	1.0675	0.6060	1.0675	1.0332
No log	2.7742	172	1.2746	0.5428	1.2746	1.1290
No log	2.8065	174	1.2862	0.5345	1.2862	1.1341
No log	2.8387	176	1.1289	0.5471	1.1289	1.0625
No log	2.8710	178	0.9628	0.6069	0.9628	0.9812
No log	2.9032	180	0.8764	0.6188	0.8764	0.9362
No log	2.9355	182	0.8741	0.6167	0.8741	0.9349
No log	2.9677	184	0.8361	0.6015	0.8361	0.9144
No log	3.0	186	0.8981	0.6357	0.8981	0.9477
No log	3.0323	188	1.1116	0.5651	1.1116	1.0543
No log	3.0645	190	1.3462	0.5249	1.3462	1.1603
No log	3.0968	192	1.3617	0.5330	1.3617	1.1669
No log	3.1290	194	1.2764	0.5537	1.2764	1.1298
No log	3.1613	196	1.0644	0.5580	1.0644	1.0317
No log	3.1935	198	0.9700	0.5499	0.9700	0.9849
No log	3.2258	200	0.9341	0.5503	0.9341	0.9665
No log	3.2581	202	0.9447	0.5577	0.9447	0.9720
No log	3.2903	204	0.9851	0.5339	0.9851	0.9925
No log	3.3226	206	1.1101	0.5555	1.1101	1.0536
No log	3.3548	208	1.3794	0.5453	1.3794	1.1745
No log	3.3871	210	1.4240	0.5453	1.4240	1.1933
No log	3.4194	212	1.2304	0.5654	1.2304	1.1092
No log	3.4516	214	0.9492	0.5992	0.9492	0.9743
No log	3.4839	216	0.7915	0.6508	0.7915	0.8896
No log	3.5161	218	0.7655	0.6595	0.7655	0.8749
No log	3.5484	220	0.8073	0.6406	0.8073	0.8985
No log	3.5806	222	0.8919	0.6561	0.8919	0.9444
No log	3.6129	224	0.9906	0.6009	0.9906	0.9953
No log	3.6452	226	1.0980	0.5430	1.0980	1.0479
No log	3.6774	228	1.1227	0.5376	1.1227	1.0596
No log	3.7097	230	1.0812	0.5430	1.0812	1.0398
No log	3.7419	232	1.0066	0.6136	1.0066	1.0033
No log	3.7742	234	0.9241	0.6454	0.9241	0.9613
No log	3.8065	236	0.8599	0.6527	0.8599	0.9273
No log	3.8387	238	0.8311	0.6679	0.8311	0.9117
No log	3.8710	240	0.8318	0.6554	0.8318	0.9120
No log	3.9032	242	0.8521	0.6579	0.8521	0.9231
No log	3.9355	244	0.9855	0.6030	0.9855	0.9927
No log	3.9677	246	1.2440	0.5666	1.2440	1.1154
No log	4.0	248	1.3935	0.5427	1.3935	1.1805
No log	4.0323	250	1.3582	0.5427	1.3582	1.1654
No log	4.0645	252	1.1557	0.5634	1.1557	1.0750
No log	4.0968	254	0.9451	0.5878	0.9451	0.9722
No log	4.1290	256	0.8644	0.6040	0.8644	0.9297
No log	4.1613	258	0.8362	0.6130	0.8362	0.9144
No log	4.1935	260	0.8904	0.5943	0.8904	0.9436
No log	4.2258	262	0.9833	0.5574	0.9833	0.9916
No log	4.2581	264	0.9793	0.5656	0.9793	0.9896
No log	4.2903	266	0.9607	0.5828	0.9607	0.9801
No log	4.3226	268	0.8745	0.6280	0.8745	0.9351
No log	4.3548	270	0.7647	0.6487	0.7647	0.8744
No log	4.3871	272	0.7355	0.6619	0.7355	0.8576
No log	4.4194	274	0.7347	0.6827	0.7347	0.8572
No log	4.4516	276	0.7648	0.6796	0.7648	0.8745
No log	4.4839	278	0.7667	0.6803	0.7667	0.8756
No log	4.5161	280	0.7203	0.6868	0.7203	0.8487
No log	4.5484	282	0.6977	0.7101	0.6977	0.8353
No log	4.5806	284	0.6675	0.7441	0.6675	0.8170
No log	4.6129	286	0.6699	0.7269	0.6699	0.8185
No log	4.6452	288	0.7013	0.7020	0.7013	0.8374
No log	4.6774	290	0.7102	0.6851	0.7102	0.8428
No log	4.7097	292	0.7398	0.6892	0.7398	0.8601
No log	4.7419	294	0.7756	0.6896	0.7756	0.8807
No log	4.7742	296	0.7643	0.6843	0.7643	0.8743
No log	4.8065	298	0.6990	0.7279	0.6990	0.8360
No log	4.8387	300	0.6779	0.7671	0.6779	0.8234
No log	4.8710	302	0.6533	0.7597	0.6533	0.8083
No log	4.9032	304	0.6459	0.7462	0.6459	0.8037
No log	4.9355	306	0.6478	0.7477	0.6478	0.8048
No log	4.9677	308	0.6540	0.7552	0.6540	0.8087
No log	5.0	310	0.6915	0.7467	0.6915	0.8316
No log	5.0323	312	0.7781	0.6575	0.7781	0.8821
No log	5.0645	314	0.8901	0.6153	0.8901	0.9435
No log	5.0968	316	0.9716	0.5915	0.9716	0.9857
No log	5.1290	318	0.9471	0.5985	0.9471	0.9732
No log	5.1613	320	0.8863	0.6167	0.8863	0.9414
No log	5.1935	322	0.8494	0.6806	0.8494	0.9217
No log	5.2258	324	0.7892	0.7204	0.7892	0.8884
No log	5.2581	326	0.7645	0.7360	0.7645	0.8743
No log	5.2903	328	0.7567	0.7482	0.7567	0.8699
No log	5.3226	330	0.7383	0.7493	0.7383	0.8592
No log	5.3548	332	0.6798	0.7745	0.6798	0.8245
No log	5.3871	334	0.6496	0.7482	0.6496	0.8060
No log	5.4194	336	0.6289	0.7329	0.6289	0.7930
No log	5.4516	338	0.6311	0.7414	0.6311	0.7944
No log	5.4839	340	0.6511	0.7497	0.6511	0.8069
No log	5.5161	342	0.7194	0.7419	0.7194	0.8482
No log	5.5484	344	0.8464	0.7088	0.8464	0.9200
No log	5.5806	346	0.8730	0.6821	0.8730	0.9343
No log	5.6129	348	0.8405	0.6985	0.8405	0.9168
No log	5.6452	350	0.7717	0.6938	0.7717	0.8785
No log	5.6774	352	0.7074	0.7311	0.7074	0.8411
No log	5.7097	354	0.6872	0.7295	0.6872	0.8290
No log	5.7419	356	0.6975	0.7359	0.6975	0.8352
No log	5.7742	358	0.7218	0.7179	0.7218	0.8496
No log	5.8065	360	0.7737	0.6900	0.7737	0.8796
No log	5.8387	362	0.7896	0.7019	0.7896	0.8886
No log	5.8710	364	0.7765	0.7190	0.7765	0.8812
No log	5.9032	366	0.7529	0.7232	0.7529	0.8677
No log	5.9355	368	0.7143	0.7146	0.7143	0.8451
No log	5.9677	370	0.6813	0.7434	0.6813	0.8254
No log	6.0	372	0.6566	0.7589	0.6566	0.8103
No log	6.0323	374	0.6437	0.7488	0.6437	0.8023
No log	6.0645	376	0.6474	0.7549	0.6474	0.8046
No log	6.0968	378	0.6783	0.7715	0.6783	0.8236
No log	6.1290	380	0.7712	0.7101	0.7712	0.8782
No log	6.1613	382	0.8639	0.6771	0.8639	0.9295
No log	6.1935	384	0.9025	0.6655	0.9025	0.9500
No log	6.2258	386	0.8676	0.6771	0.8676	0.9314
No log	6.2581	388	0.8006	0.6995	0.8006	0.8948
No log	6.2903	390	0.7503	0.7157	0.7503	0.8662
No log	6.3226	392	0.7180	0.7116	0.7180	0.8474
No log	6.3548	394	0.6863	0.7387	0.6863	0.8284
No log	6.3871	396	0.6854	0.7403	0.6854	0.8279
No log	6.4194	398	0.7076	0.7220	0.7076	0.8412
No log	6.4516	400	0.7172	0.7243	0.7172	0.8469
No log	6.4839	402	0.6988	0.7372	0.6988	0.8359
No log	6.5161	404	0.6983	0.7372	0.6983	0.8356
No log	6.5484	406	0.7188	0.7386	0.7188	0.8478
No log	6.5806	408	0.7479	0.7280	0.7479	0.8648
No log	6.6129	410	0.7455	0.7173	0.7455	0.8634
No log	6.6452	412	0.7737	0.6980	0.7737	0.8796
No log	6.6774	414	0.8143	0.6922	0.8143	0.9024
No log	6.7097	416	0.8087	0.7019	0.8087	0.8993
No log	6.7419	418	0.7924	0.6979	0.7924	0.8902
No log	6.7742	420	0.7643	0.6918	0.7643	0.8743
No log	6.8065	422	0.7366	0.7303	0.7366	0.8582
No log	6.8387	424	0.7220	0.7303	0.7220	0.8497
No log	6.8710	426	0.7135	0.7303	0.7135	0.8447
No log	6.9032	428	0.6936	0.7333	0.6936	0.8328
No log	6.9355	430	0.6804	0.7628	0.6804	0.8248
No log	6.9677	432	0.6998	0.7493	0.6998	0.8365
No log	7.0	434	0.7403	0.7396	0.7403	0.8604
No log	7.0323	436	0.7739	0.7387	0.7739	0.8797
No log	7.0645	438	0.7675	0.7430	0.7675	0.8761
No log	7.0968	440	0.7156	0.7366	0.7156	0.8459
No log	7.1290	442	0.6874	0.7580	0.6874	0.8291
No log	7.1613	444	0.7085	0.7510	0.7085	0.8417
No log	7.1935	446	0.7345	0.7401	0.7345	0.8571
No log	7.2258	448	0.7591	0.7430	0.7591	0.8713
No log	7.2581	450	0.7320	0.7396	0.7320	0.8556
No log	7.2903	452	0.6973	0.7427	0.6973	0.8351
No log	7.3226	454	0.6591	0.7470	0.6591	0.8119
No log	7.3548	456	0.6439	0.7505	0.6439	0.8024
No log	7.3871	458	0.6516	0.7387	0.6516	0.8072
No log	7.4194	460	0.6732	0.7403	0.6732	0.8205
No log	7.4516	462	0.6928	0.7287	0.6928	0.8323
No log	7.4839	464	0.7112	0.7219	0.7112	0.8433
No log	7.5161	466	0.7377	0.7171	0.7377	0.8589
No log	7.5484	468	0.7653	0.7210	0.7653	0.8748
No log	7.5806	470	0.7709	0.7211	0.7709	0.8780
No log	7.6129	472	0.7595	0.7101	0.7595	0.8715
No log	7.6452	474	0.7235	0.7390	0.7235	0.8506
No log	7.6774	476	0.6856	0.7661	0.6856	0.8280
No log	7.7097	478	0.6675	0.7741	0.6675	0.8170
No log	7.7419	480	0.6584	0.7684	0.6584	0.8114
No log	7.7742	482	0.6563	0.7684	0.6563	0.8101
No log	7.8065	484	0.6736	0.7697	0.6736	0.8207
No log	7.8387	486	0.6800	0.7503	0.6800	0.8246
No log	7.8710	488	0.6947	0.7449	0.6947	0.8335
No log	7.9032	490	0.7293	0.7375	0.7293	0.8540
No log	7.9355	492	0.7612	0.7076	0.7612	0.8725
No log	7.9677	494	0.7812	0.7134	0.7812	0.8838
No log	8.0	496	0.7800	0.7134	0.7800	0.8832
No log	8.0323	498	0.7774	0.7076	0.7774	0.8817
0.3068	8.0645	500	0.7627	0.7175	0.7627	0.8733
0.3068	8.0968	502	0.7262	0.7498	0.7262	0.8522
0.3068	8.1290	504	0.7058	0.7383	0.7058	0.8401
0.3068	8.1613	506	0.6958	0.7390	0.6958	0.8341
0.3068	8.1935	508	0.7025	0.7390	0.7025	0.8382
0.3068	8.2258	510	0.7224	0.7498	0.7224	0.8499
0.3068	8.2581	512	0.7422	0.7396	0.7422	0.8615
0.3068	8.2903	514	0.7583	0.7432	0.7583	0.8708
0.3068	8.3226	516	0.7821	0.7183	0.7821	0.8843
0.3068	8.3548	518	0.8032	0.6981	0.8032	0.8962
0.3068	8.3871	520	0.8047	0.6981	0.8047	0.8971
0.3068	8.4194	522	0.8036	0.6981	0.8036	0.8964
0.3068	8.4516	524	0.7884	0.7088	0.7884	0.8879
0.3068	8.4839	526	0.7692	0.7253	0.7692	0.8770
0.3068	8.5161	528	0.7460	0.7418	0.7460	0.8637
0.3068	8.5484	530	0.7338	0.7418	0.7338	0.8566
0.3068	8.5806	532	0.7387	0.7418	0.7387	0.8595
0.3068	8.6129	534	0.7475	0.7418	0.7475	0.8646
0.3068	8.6452	536	0.7682	0.7268	0.7682	0.8765
0.3068	8.6774	538	0.8067	0.6861	0.8067	0.8981
0.3068	8.7097	540	0.8332	0.6800	0.8332	0.9128
0.3068	8.7419	542	0.8368	0.6807	0.8368	0.9147
0.3068	8.7742	544	0.8181	0.6861	0.8181	0.9045
0.3068	8.8065	546	0.7978	0.6927	0.7978	0.8932
0.3068	8.8387	548	0.7768	0.7233	0.7768	0.8814
0.3068	8.8710	550	0.7589	0.7374	0.7589	0.8712
0.3068	8.9032	552	0.7462	0.7495	0.7462	0.8639
0.3068	8.9355	554	0.7394	0.7495	0.7394	0.8599
0.3068	8.9677	556	0.7463	0.7495	0.7463	0.8639
0.3068	9.0	558	0.7480	0.7495	0.7480	0.8649
0.3068	9.0323	560	0.7406	0.7459	0.7406	0.8606
0.3068	9.0645	562	0.7407	0.7459	0.7407	0.8606
0.3068	9.0968	564	0.7441	0.7459	0.7441	0.8626
0.3068	9.1290	566	0.7502	0.7338	0.7502	0.8661
0.3068	9.1613	568	0.7523	0.7338	0.7523	0.8673
0.3068	9.1935	570	0.7517	0.7338	0.7517	0.8670
0.3068	9.2258	572	0.7514	0.7338	0.7514	0.8668
0.3068	9.2581	574	0.7478	0.7338	0.7478	0.8648
0.3068	9.2903	576	0.7399	0.7338	0.7399	0.8602
0.3068	9.3226	578	0.7314	0.7338	0.7314	0.8552
0.3068	9.3548	580	0.7201	0.7560	0.7201	0.8486
0.3068	9.3871	582	0.7110	0.7766	0.7110	0.8432
0.3068	9.4194	584	0.7025	0.7692	0.7025	0.8382
0.3068	9.4516	586	0.6973	0.7717	0.6973	0.8351
0.3068	9.4839	588	0.6996	0.7692	0.6996	0.8364
0.3068	9.5161	590	0.7065	0.7766	0.7065	0.8405
0.3068	9.5484	592	0.7096	0.7766	0.7096	0.8424
0.3068	9.5806	594	0.7103	0.7662	0.7103	0.8428
0.3068	9.6129	596	0.7083	0.7662	0.7083	0.8416
0.3068	9.6452	598	0.7092	0.7662	0.7092	0.8421
0.3068	9.6774	600	0.7114	0.7662	0.7114	0.8434
0.3068	9.7097	602	0.7126	0.7560	0.7126	0.8442
0.3068	9.7419	604	0.7135	0.7459	0.7135	0.8447
0.3068	9.7742	606	0.7155	0.7459	0.7155	0.8459
0.3068	9.8065	608	0.7185	0.7459	0.7185	0.8476
0.3068	9.8387	610	0.7184	0.7459	0.7184	0.8476
0.3068	9.8710	612	0.7185	0.7459	0.7185	0.8476
0.3068	9.9032	614	0.7185	0.7459	0.7185	0.8476
0.3068	9.9355	616	0.7190	0.7459	0.7190	0.8479
0.3068	9.9677	618	0.7193	0.7459	0.7193	0.8481
0.3068	10.0	620	0.7192	0.7459	0.7192	0.8481

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1