ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8114
• Qwk: 0.7206
• Mse: 0.8114
• Rmse: 0.9008

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0244	2	6.5996	0.0188	6.5996	2.5690
No log	0.0488	4	4.4957	0.0706	4.4957	2.1203
No log	0.0732	6	3.0814	0.0988	3.0814	1.7554
No log	0.0976	8	2.2546	0.0839	2.2546	1.5015
No log	0.1220	10	1.8316	0.1468	1.8316	1.3534
No log	0.1463	12	1.6905	0.1509	1.6905	1.3002
No log	0.1707	14	1.6853	0.1308	1.6853	1.2982
No log	0.1951	16	2.1503	0.1120	2.1503	1.4664
No log	0.2195	18	2.1950	0.1270	2.1950	1.4815
No log	0.2439	20	2.3348	0.0889	2.3348	1.5280
No log	0.2683	22	2.0093	0.1667	2.0093	1.4175
No log	0.2927	24	1.8265	0.1852	1.8265	1.3515
No log	0.3171	26	1.9878	0.3279	1.9878	1.4099
No log	0.3415	28	2.2840	0.0411	2.2840	1.5113
No log	0.3659	30	2.3927	0.0	2.3927	1.5468
No log	0.3902	32	2.4583	-0.0268	2.4583	1.5679
No log	0.4146	34	2.3148	-0.0268	2.3148	1.5215
No log	0.4390	36	2.0683	0.2406	2.0683	1.4382
No log	0.4634	38	1.6843	0.3304	1.6843	1.2978
No log	0.4878	40	1.5162	0.2832	1.5162	1.2313
No log	0.5122	42	1.5081	0.2342	1.5081	1.2281
No log	0.5366	44	1.6111	0.3051	1.6111	1.2693
No log	0.5610	46	1.8446	0.2540	1.8446	1.3581
No log	0.5854	48	2.2406	0.0432	2.2406	1.4969
No log	0.6098	50	2.8998	0.0610	2.8998	1.7029
No log	0.6341	52	2.7459	0.0519	2.7459	1.6571
No log	0.6585	54	1.8937	0.3361	1.8937	1.3761
No log	0.6829	56	1.5468	0.2385	1.5468	1.2437
No log	0.7073	58	1.4710	0.2243	1.4710	1.2128
No log	0.7317	60	1.3753	0.2075	1.3753	1.1727
No log	0.7561	62	1.3047	0.2075	1.3047	1.1422
No log	0.7805	64	1.2077	0.3604	1.2077	1.0989
No log	0.8049	66	1.2330	0.3697	1.2330	1.1104
No log	0.8293	68	1.6340	0.3692	1.6340	1.2783
No log	0.8537	70	1.9616	0.3077	1.9616	1.4006
No log	0.8780	72	1.4075	0.4444	1.4075	1.1864
No log	0.9024	74	0.9702	0.56	0.9702	0.9850
No log	0.9268	76	1.0817	0.6462	1.0817	1.0401
No log	0.9512	78	1.1270	0.5846	1.1270	1.0616
No log	0.9756	80	1.1442	0.5085	1.1442	1.0697
No log	1.0	82	1.2347	0.4874	1.2347	1.1112
No log	1.0244	84	1.2849	0.4615	1.2849	1.1335
No log	1.0488	86	1.2780	0.5210	1.2780	1.1305
No log	1.0732	88	1.2587	0.4500	1.2587	1.1219
No log	1.0976	90	1.1841	0.4793	1.1841	1.0881
No log	1.1220	92	1.1375	0.4762	1.1375	1.0665
No log	1.1463	94	1.1613	0.5426	1.1613	1.0777
No log	1.1707	96	1.0064	0.56	1.0064	1.0032
No log	1.1951	98	1.0644	0.5691	1.0644	1.0317
No log	1.2195	100	1.2556	0.4370	1.2556	1.1205
No log	1.2439	102	1.2882	0.4370	1.2882	1.1350
No log	1.2683	104	1.0236	0.6202	1.0236	1.0117
No log	1.2927	106	0.9580	0.5736	0.9580	0.9788
No log	1.3171	108	0.9278	0.5781	0.9278	0.9632
No log	1.3415	110	0.9251	0.6364	0.9251	0.9618
No log	1.3659	112	1.2179	0.4889	1.2179	1.1036
No log	1.3902	114	1.5604	0.3881	1.5604	1.2491
No log	1.4146	116	1.3866	0.4593	1.3866	1.1775
No log	1.4390	118	0.9320	0.6383	0.9320	0.9654
No log	1.4634	120	0.8475	0.6573	0.8475	0.9206
No log	1.4878	122	0.9103	0.6383	0.9103	0.9541
No log	1.5122	124	1.1632	0.5109	1.1632	1.0785
No log	1.5366	126	1.3177	0.4478	1.3177	1.1479
No log	1.5610	128	1.0816	0.5672	1.0816	1.0400
No log	1.5854	130	0.9050	0.6667	0.9050	0.9513
No log	1.6098	132	0.8487	0.6957	0.8487	0.9213
No log	1.6341	134	0.8706	0.6667	0.8706	0.9331
No log	1.6585	136	1.0129	0.6212	1.0129	1.0064
No log	1.6829	138	0.9289	0.6212	0.9289	0.9638
No log	1.7073	140	0.8697	0.6466	0.8697	0.9326
No log	1.7317	142	0.7713	0.75	0.7713	0.8782
No log	1.7561	144	0.7178	0.7448	0.7178	0.8472
No log	1.7805	146	0.7122	0.75	0.7122	0.8439
No log	1.8049	148	0.7185	0.7724	0.7185	0.8476
No log	1.8293	150	0.7205	0.7413	0.7205	0.8488
No log	1.8537	152	0.7008	0.75	0.7008	0.8371
No log	1.8780	154	0.6917	0.7586	0.6917	0.8317
No log	1.9024	156	0.6848	0.7586	0.6848	0.8275
No log	1.9268	158	0.7396	0.7361	0.7396	0.8600
No log	1.9512	160	0.9884	0.6232	0.9884	0.9942
No log	1.9756	162	0.9204	0.6853	0.9204	0.9594
No log	2.0	164	0.6924	0.7568	0.6924	0.8321
No log	2.0244	166	0.7011	0.7397	0.7011	0.8373
No log	2.0488	168	0.8340	0.7483	0.8340	0.9132
No log	2.0732	170	0.9137	0.7361	0.9137	0.9559
No log	2.0976	172	0.7783	0.7586	0.7783	0.8822
No log	2.1220	174	0.7964	0.7260	0.7964	0.8924
No log	2.1463	176	0.7854	0.7260	0.7854	0.8862
No log	2.1707	178	0.8310	0.7273	0.8310	0.9116
No log	2.1951	180	0.8888	0.6277	0.8888	0.9428
No log	2.2195	182	0.8477	0.6187	0.8477	0.9207
No log	2.2439	184	0.7963	0.6525	0.7963	0.8924
No log	2.2683	186	0.6518	0.8	0.6518	0.8073
No log	2.2927	188	0.6423	0.7682	0.6423	0.8014
No log	2.3171	190	0.5808	0.7974	0.5808	0.7621
No log	2.3415	192	0.7212	0.7417	0.7212	0.8492
No log	2.3659	194	1.4479	0.4741	1.4479	1.2033
No log	2.3902	196	1.9541	0.1692	1.9541	1.3979
No log	2.4146	198	1.7219	0.2540	1.7219	1.3122
No log	2.4390	200	1.1059	0.5333	1.1059	1.0516
No log	2.4634	202	0.7910	0.7517	0.7910	0.8894
No log	2.4878	204	0.7641	0.7448	0.7641	0.8741
No log	2.5122	206	0.7878	0.6861	0.7878	0.8876
No log	2.5366	208	0.8033	0.6618	0.8033	0.8963
No log	2.5610	210	0.8216	0.7059	0.8216	0.9064
No log	2.5854	212	0.9138	0.5926	0.9138	0.9559
No log	2.6098	214	0.9574	0.5942	0.9574	0.9784
No log	2.6341	216	0.8541	0.6667	0.8541	0.9242
No log	2.6585	218	0.7569	0.6667	0.7569	0.8700
No log	2.6829	220	0.7308	0.6667	0.7308	0.8549
No log	2.7073	222	0.7045	0.7190	0.7045	0.8394
No log	2.7317	224	0.7209	0.6897	0.7209	0.8490
No log	2.7561	226	0.6939	0.7083	0.6939	0.8330
No log	2.7805	228	0.8046	0.6620	0.8046	0.8970
No log	2.8049	230	0.8398	0.6338	0.8398	0.9164
No log	2.8293	232	0.8760	0.5985	0.8760	0.9359
No log	2.8537	234	0.8618	0.6029	0.8618	0.9283
No log	2.8780	236	0.7672	0.7234	0.7672	0.8759
No log	2.9024	238	0.6984	0.7465	0.6984	0.8357
No log	2.9268	240	0.7199	0.7222	0.7199	0.8485
No log	2.9512	242	0.6817	0.7483	0.6817	0.8256
No log	2.9756	244	0.7322	0.7260	0.7322	0.8557
No log	3.0	246	0.7292	0.7397	0.7292	0.8539
No log	3.0244	248	0.6961	0.7310	0.6961	0.8343
No log	3.0488	250	0.7339	0.7	0.7339	0.8567
No log	3.0732	252	0.7272	0.7273	0.7272	0.8528
No log	3.0976	254	0.6915	0.7310	0.6915	0.8316
No log	3.1220	256	0.6960	0.7273	0.6960	0.8343
No log	3.1463	258	0.7777	0.7075	0.7777	0.8819
No log	3.1707	260	0.6988	0.7133	0.6988	0.8359
No log	3.1951	262	0.6132	0.7397	0.6132	0.7831
No log	3.2195	264	0.7099	0.7211	0.7099	0.8426
No log	3.2439	266	0.9558	0.6620	0.9558	0.9776
No log	3.2683	268	1.0899	0.6	1.0899	1.0440
No log	3.2927	270	1.0583	0.6241	1.0583	1.0287
No log	3.3171	272	0.8394	0.6806	0.8394	0.9162
No log	3.3415	274	0.6712	0.7552	0.6712	0.8193
No log	3.3659	276	0.6826	0.7724	0.6826	0.8262
No log	3.3902	278	0.7835	0.7465	0.7835	0.8851
No log	3.4146	280	0.8399	0.6812	0.8399	0.9165
No log	3.4390	282	0.7892	0.7050	0.7892	0.8884
No log	3.4634	284	0.7139	0.7518	0.7139	0.8449
No log	3.4878	286	0.6547	0.7465	0.6547	0.8092
No log	3.5122	288	0.5704	0.7619	0.5704	0.7552
No log	3.5366	290	0.5400	0.8026	0.5400	0.7348
No log	3.5610	292	0.6418	0.7561	0.6418	0.8011
No log	3.5854	294	1.0138	0.6164	1.0138	1.0069
No log	3.6098	296	1.2323	0.5401	1.2323	1.1101
No log	3.6341	298	1.0372	0.5985	1.0372	1.0184
No log	3.6585	300	0.7001	0.6944	0.7001	0.8367
No log	3.6829	302	0.6195	0.7867	0.6195	0.7871
No log	3.7073	304	0.6436	0.7586	0.6436	0.8023
No log	3.7317	306	0.6598	0.7671	0.6598	0.8123
No log	3.7561	308	0.7389	0.7183	0.7389	0.8596
No log	3.7805	310	0.8222	0.6475	0.8222	0.9067
No log	3.8049	312	0.9677	0.6029	0.9677	0.9837
No log	3.8293	314	0.9603	0.6277	0.9603	0.9799
No log	3.8537	316	0.7952	0.6763	0.7952	0.8918
No log	3.8780	318	0.7061	0.6763	0.7061	0.8403
No log	3.9024	320	0.7138	0.7050	0.7138	0.8448
No log	3.9268	322	0.7253	0.6906	0.7253	0.8516
No log	3.9512	324	0.8401	0.6522	0.8401	0.9166
No log	3.9756	326	0.9974	0.6377	0.9974	0.9987
No log	4.0	328	1.0443	0.5672	1.0443	1.0219
No log	4.0244	330	0.9307	0.6423	0.9307	0.9647
No log	4.0488	332	0.7970	0.7007	0.7970	0.8927
No log	4.0732	334	0.7829	0.6715	0.7829	0.8848
No log	4.0976	336	0.7841	0.6950	0.7841	0.8855
No log	4.1220	338	0.7258	0.6857	0.7258	0.8519
No log	4.1463	340	0.6843	0.7534	0.6843	0.8272
No log	4.1707	342	0.7037	0.7172	0.7037	0.8389
No log	4.1951	344	0.6869	0.7222	0.6869	0.8288
No log	4.2195	346	0.6648	0.6809	0.6648	0.8153
No log	4.2439	348	0.7065	0.7	0.7065	0.8405
No log	4.2683	350	0.6821	0.7092	0.6821	0.8259
No log	4.2927	352	0.6110	0.7075	0.6110	0.7817
No log	4.3171	354	0.6125	0.7403	0.6125	0.7826
No log	4.3415	356	0.8857	0.7248	0.8857	0.9411
No log	4.3659	358	1.0615	0.6575	1.0615	1.0303
No log	4.3902	360	0.9616	0.6986	0.9616	0.9806
No log	4.4146	362	0.9988	0.6667	0.9988	0.9994
No log	4.4390	364	0.9985	0.5985	0.9985	0.9993
No log	4.4634	366	0.9199	0.6029	0.9199	0.9591
No log	4.4878	368	0.8544	0.6269	0.8544	0.9244
No log	4.5122	370	0.8615	0.6466	0.8615	0.9282
No log	4.5366	372	0.9397	0.5865	0.9397	0.9694
No log	4.5610	374	0.8977	0.6119	0.8977	0.9475
No log	4.5854	376	0.7604	0.6765	0.7604	0.8720
No log	4.6098	378	0.6760	0.7413	0.6760	0.8222
No log	4.6341	380	0.6738	0.7355	0.6738	0.8208
No log	4.6585	382	0.6044	0.7901	0.6044	0.7775
No log	4.6829	384	0.5624	0.7919	0.5624	0.7499
No log	4.7073	386	0.5917	0.7838	0.5917	0.7692
No log	4.7317	388	0.6314	0.7534	0.6314	0.7946
No log	4.7561	390	0.6838	0.7429	0.6838	0.8269
No log	4.7805	392	0.7223	0.7286	0.7223	0.8499
No log	4.8049	394	0.7548	0.7338	0.7548	0.8688
No log	4.8293	396	0.7661	0.7286	0.7661	0.8753
No log	4.8537	398	0.7430	0.7429	0.7430	0.8620
No log	4.8780	400	0.7196	0.7429	0.7196	0.8483
No log	4.9024	402	0.7336	0.7286	0.7336	0.8565
No log	4.9268	404	0.8450	0.6714	0.8450	0.9193
No log	4.9512	406	0.8888	0.6377	0.8888	0.9428
No log	4.9756	408	0.8299	0.6714	0.8299	0.9110
No log	5.0	410	0.7335	0.7143	0.7335	0.8565
No log	5.0244	412	0.7092	0.7465	0.7092	0.8421
No log	5.0488	414	0.7091	0.7465	0.7091	0.8421
No log	5.0732	416	0.7125	0.7397	0.7125	0.8441
No log	5.0976	418	0.7052	0.7397	0.7052	0.8397
No log	5.1220	420	0.7209	0.7211	0.7209	0.8490
No log	5.1463	422	0.6554	0.7733	0.6554	0.8095
No log	5.1707	424	0.6027	0.8026	0.6027	0.7763
No log	5.1951	426	0.5624	0.8026	0.5624	0.7499
No log	5.2195	428	0.5628	0.7532	0.5628	0.7502
No log	5.2439	430	0.5690	0.7403	0.5690	0.7543
No log	5.2683	432	0.6213	0.7403	0.6213	0.7882
No log	5.2927	434	0.6380	0.7403	0.6380	0.7988
No log	5.3171	436	0.6243	0.7403	0.6243	0.7901
No log	5.3415	438	0.6110	0.7451	0.6110	0.7817
No log	5.3659	440	0.6068	0.7451	0.6068	0.7789
No log	5.3902	442	0.6540	0.7285	0.6540	0.8087
No log	5.4146	444	0.7061	0.7333	0.7061	0.8403
No log	5.4390	446	0.6228	0.7516	0.6228	0.7892
No log	5.4634	448	0.5896	0.75	0.5896	0.7678
No log	5.4878	450	0.6262	0.7389	0.6262	0.7913
No log	5.5122	452	0.7058	0.7248	0.7058	0.8401
No log	5.5366	454	0.7303	0.7083	0.7303	0.8545
No log	5.5610	456	0.6492	0.7347	0.6492	0.8058
No log	5.5854	458	0.6244	0.7891	0.6244	0.7902
No log	5.6098	460	0.6001	0.7895	0.6001	0.7746
No log	5.6341	462	0.6909	0.7248	0.6909	0.8312
No log	5.6585	464	0.8413	0.6986	0.8413	0.9172
No log	5.6829	466	0.8668	0.6853	0.8668	0.9310
No log	5.7073	468	0.7203	0.7368	0.7203	0.8487
No log	5.7317	470	0.6321	0.7613	0.6321	0.7951
No log	5.7561	472	0.6516	0.7285	0.6516	0.8072
No log	5.7805	474	0.8015	0.6667	0.8015	0.8953
No log	5.8049	476	0.8868	0.6714	0.8868	0.9417
No log	5.8293	478	0.8508	0.6714	0.8508	0.9224
No log	5.8537	480	0.7296	0.6993	0.7296	0.8542
No log	5.8780	482	0.6382	0.7333	0.6382	0.7989
No log	5.9024	484	0.6416	0.7333	0.6416	0.8010
No log	5.9268	486	0.6013	0.75	0.6013	0.7754
No log	5.9512	488	0.6036	0.7417	0.6036	0.7769
No log	5.9756	490	0.6530	0.7333	0.6530	0.8081
No log	6.0	492	0.7371	0.7075	0.7371	0.8585
No log	6.0244	494	0.7040	0.7162	0.7040	0.8390
No log	6.0488	496	0.6579	0.7383	0.6579	0.8111
No log	6.0732	498	0.6483	0.7606	0.6483	0.8052
0.498	6.0976	500	0.7240	0.7361	0.7240	0.8509
0.498	6.1220	502	0.6766	0.7222	0.6766	0.8225
0.498	6.1463	504	0.6207	0.7586	0.6207	0.7878
0.498	6.1707	506	0.6628	0.7297	0.6628	0.8141
0.498	6.1951	508	0.7452	0.7468	0.7452	0.8632
0.498	6.2195	510	0.7937	0.7516	0.7937	0.8909
0.498	6.2439	512	0.7257	0.7333	0.7257	0.8519
0.498	6.2683	514	0.6891	0.6901	0.6891	0.8301
0.498	6.2927	516	0.7295	0.7286	0.7295	0.8541
0.498	6.3171	518	0.7817	0.7246	0.7817	0.8842
0.498	6.3415	520	0.8114	0.7206	0.8114	0.9008

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1