ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9317
• Qwk: 0.6360
• Mse: 0.9317
• Rmse: 0.9652

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	2.3199	-0.0013	2.3199	1.5231
No log	0.0755	4	1.5610	0.1710	1.5610	1.2494
No log	0.1132	6	1.6173	0.0634	1.6173	1.2717
No log	0.1509	8	1.7117	0.1631	1.7117	1.3083
No log	0.1887	10	1.5879	0.2512	1.5879	1.2601
No log	0.2264	12	1.5534	0.1383	1.5534	1.2464
No log	0.2642	14	1.5495	0.0827	1.5495	1.2448
No log	0.3019	16	1.5504	0.0674	1.5504	1.2451
No log	0.3396	18	1.6012	0.2131	1.6012	1.2654
No log	0.3774	20	1.7948	0.3158	1.7948	1.3397
No log	0.4151	22	1.8547	0.2952	1.8547	1.3619
No log	0.4528	24	1.7923	0.3158	1.7923	1.3388
No log	0.4906	26	1.7208	0.3760	1.7208	1.3118
No log	0.5283	28	1.5617	0.3519	1.5617	1.2497
No log	0.5660	30	1.3356	0.2292	1.3356	1.1557
No log	0.6038	32	1.2375	0.1985	1.2375	1.1124
No log	0.6415	34	1.2229	0.2035	1.2229	1.1058
No log	0.6792	36	1.2211	0.2497	1.2211	1.1050
No log	0.7170	38	1.3537	0.2072	1.3537	1.1635
No log	0.7547	40	1.8944	0.1563	1.8944	1.3764
No log	0.7925	42	2.1253	0.1219	2.1253	1.4579
No log	0.8302	44	1.8399	0.2381	1.8399	1.3564
No log	0.8679	46	1.4555	0.2866	1.4555	1.2064
No log	0.9057	48	1.2201	0.3981	1.2201	1.1046
No log	0.9434	50	1.1880	0.3265	1.1880	1.0900
No log	0.9811	52	1.2024	0.2957	1.2024	1.0965
No log	1.0189	54	1.2007	0.3223	1.2007	1.0957
No log	1.0566	56	1.2688	0.3143	1.2688	1.1264
No log	1.0943	58	1.3313	0.3310	1.3313	1.1538
No log	1.1321	60	1.3002	0.2832	1.3002	1.1402
No log	1.1698	62	1.2483	0.3293	1.2483	1.1173
No log	1.2075	64	1.2243	0.3215	1.2243	1.1065
No log	1.2453	66	1.1847	0.3769	1.1847	1.0884
No log	1.2830	68	1.2344	0.3802	1.2344	1.1111
No log	1.3208	70	1.2340	0.4025	1.2340	1.1109
No log	1.3585	72	1.1144	0.4274	1.1144	1.0556
No log	1.3962	74	1.0613	0.4337	1.0613	1.0302
No log	1.4340	76	1.0436	0.4292	1.0436	1.0215
No log	1.4717	78	1.1021	0.4677	1.1021	1.0498
No log	1.5094	80	1.4309	0.3862	1.4309	1.1962
No log	1.5472	82	1.6207	0.3545	1.6207	1.2731
No log	1.5849	84	1.5908	0.3350	1.5908	1.2613
No log	1.6226	86	1.4157	0.4036	1.4157	1.1898
No log	1.6604	88	1.2006	0.4190	1.2006	1.0957
No log	1.6981	90	1.0561	0.4696	1.0561	1.0277
No log	1.7358	92	1.0151	0.4630	1.0151	1.0075
No log	1.7736	94	1.0218	0.4900	1.0218	1.0108
No log	1.8113	96	1.0592	0.4777	1.0592	1.0292
No log	1.8491	98	1.2029	0.4240	1.2029	1.0968
No log	1.8868	100	1.1950	0.4538	1.1950	1.0932
No log	1.9245	102	0.9900	0.5600	0.9900	0.9950
No log	1.9623	104	0.9042	0.5815	0.9042	0.9509
No log	2.0	106	0.8841	0.5580	0.8841	0.9403
No log	2.0377	108	0.9096	0.5986	0.9096	0.9537
No log	2.0755	110	1.0753	0.5549	1.0753	1.0370
No log	2.1132	112	1.2314	0.4913	1.2314	1.1097
No log	2.1509	114	1.1825	0.5279	1.1825	1.0874
No log	2.1887	116	1.1675	0.5279	1.1675	1.0805
No log	2.2264	118	1.1286	0.5471	1.1286	1.0623
No log	2.2642	120	1.0948	0.5499	1.0948	1.0463
No log	2.3019	122	1.1691	0.5219	1.1691	1.0812
No log	2.3396	124	1.1690	0.5014	1.1690	1.0812
No log	2.3774	126	1.1521	0.4981	1.1521	1.0733
No log	2.4151	128	1.2728	0.4796	1.2728	1.1282
No log	2.4528	130	1.4093	0.4874	1.4093	1.1871
No log	2.4906	132	1.3750	0.4737	1.3750	1.1726
No log	2.5283	134	1.1442	0.5013	1.1442	1.0697
No log	2.5660	136	0.9217	0.5662	0.9217	0.9600
No log	2.6038	138	0.8811	0.5447	0.8811	0.9387
No log	2.6415	140	0.8988	0.5277	0.8988	0.9480
No log	2.6792	142	0.8819	0.5342	0.8819	0.9391
No log	2.7170	144	0.9165	0.5492	0.9165	0.9574
No log	2.7547	146	1.1311	0.4963	1.1311	1.0635
No log	2.7925	148	1.4186	0.5011	1.4186	1.1910
No log	2.8302	150	1.4697	0.5078	1.4697	1.2123
No log	2.8679	152	1.2772	0.5196	1.2772	1.1302
No log	2.9057	154	0.9857	0.5661	0.9857	0.9928
No log	2.9434	156	0.7822	0.6413	0.7822	0.8844
No log	2.9811	158	0.7641	0.5985	0.7641	0.8741
No log	3.0189	160	0.7951	0.5955	0.7951	0.8917
No log	3.0566	162	0.7764	0.5866	0.7764	0.8811
No log	3.0943	164	0.7509	0.6250	0.7509	0.8665
No log	3.1321	166	0.7991	0.6653	0.7991	0.8939
No log	3.1698	168	0.9743	0.5925	0.9743	0.9871
No log	3.2075	170	1.0654	0.5562	1.0654	1.0322
No log	3.2453	172	1.0254	0.5874	1.0254	1.0126
No log	3.2830	174	0.9631	0.5793	0.9631	0.9814
No log	3.3208	176	0.8818	0.6208	0.8818	0.9391
No log	3.3585	178	0.8667	0.6274	0.8667	0.9310
No log	3.3962	180	0.8612	0.6178	0.8612	0.9280
No log	3.4340	182	0.8844	0.5783	0.8844	0.9404
No log	3.4717	184	0.9119	0.5692	0.9119	0.9549
No log	3.5094	186	1.0106	0.5555	1.0106	1.0053
No log	3.5472	188	1.0808	0.5470	1.0808	1.0396
No log	3.5849	190	1.0951	0.5576	1.0951	1.0465
No log	3.6226	192	1.0761	0.5470	1.0761	1.0374
No log	3.6604	194	0.9834	0.5804	0.9834	0.9917
No log	3.6981	196	0.8832	0.5806	0.8832	0.9398
No log	3.7358	198	0.8749	0.5541	0.8749	0.9353
No log	3.7736	200	0.9304	0.5641	0.9304	0.9645
No log	3.8113	202	0.9760	0.5732	0.9760	0.9879
No log	3.8491	204	1.0971	0.5478	1.0971	1.0474
No log	3.8868	206	1.2896	0.5585	1.2896	1.1356
No log	3.9245	208	1.3972	0.5449	1.3972	1.1820
No log	3.9623	210	1.3784	0.5497	1.3784	1.1740
No log	4.0	212	1.1937	0.5583	1.1937	1.0926
No log	4.0377	214	1.0033	0.6303	1.0033	1.0017
No log	4.0755	216	0.9125	0.6356	0.9125	0.9552
No log	4.1132	218	0.9243	0.6341	0.9243	0.9614
No log	4.1509	220	1.0128	0.6159	1.0128	1.0064
No log	4.1887	222	1.1080	0.6060	1.1080	1.0526
No log	4.2264	224	1.1927	0.5794	1.1927	1.0921
No log	4.2642	226	1.2326	0.5715	1.2326	1.1102
No log	4.3019	228	1.1412	0.5794	1.1412	1.0683
No log	4.3396	230	1.0646	0.6323	1.0646	1.0318
No log	4.3774	232	0.9939	0.6196	0.9939	0.9969
No log	4.4151	234	0.8936	0.5944	0.8936	0.9453
No log	4.4528	236	0.8774	0.6057	0.8774	0.9367
No log	4.4906	238	0.9057	0.5753	0.9057	0.9517
No log	4.5283	240	0.9862	0.5791	0.9862	0.9931
No log	4.5660	242	1.1603	0.5360	1.1603	1.0772
No log	4.6038	244	1.3522	0.5653	1.3522	1.1628
No log	4.6415	246	1.3666	0.5697	1.3666	1.1690
No log	4.6792	248	1.3419	0.5666	1.3419	1.1584
No log	4.7170	250	1.2671	0.5840	1.2671	1.1257
No log	4.7547	252	1.1395	0.5970	1.1395	1.0675
No log	4.7925	254	1.0406	0.5954	1.0406	1.0201
No log	4.8302	256	0.9410	0.6059	0.9410	0.9700
No log	4.8679	258	0.8650	0.6094	0.8650	0.9301
No log	4.9057	260	0.8233	0.6395	0.8233	0.9074
No log	4.9434	262	0.7923	0.6692	0.7923	0.8901
No log	4.9811	264	0.8245	0.6436	0.8245	0.9080
No log	5.0189	266	0.9339	0.5956	0.9339	0.9664
No log	5.0566	268	1.0383	0.5721	1.0383	1.0190
No log	5.0943	270	1.0584	0.5675	1.0584	1.0288
No log	5.1321	272	1.0076	0.5897	1.0076	1.0038
No log	5.1698	274	0.9508	0.5933	0.9508	0.9751
No log	5.2075	276	0.8830	0.6400	0.8830	0.9397
No log	5.2453	278	0.8391	0.6597	0.8391	0.9160
No log	5.2830	280	0.8516	0.6825	0.8516	0.9228
No log	5.3208	282	0.9247	0.6097	0.9247	0.9616
No log	5.3585	284	1.0422	0.5957	1.0422	1.0209
No log	5.3962	286	1.1691	0.5832	1.1691	1.0812
No log	5.4340	288	1.1813	0.5656	1.1813	1.0869
No log	5.4717	290	1.1153	0.5768	1.1153	1.0561
No log	5.5094	292	1.0406	0.5768	1.0406	1.0201
No log	5.5472	294	0.9453	0.5731	0.9453	0.9722
No log	5.5849	296	0.9166	0.5769	0.9166	0.9574
No log	5.6226	298	0.8991	0.5958	0.8991	0.9482
No log	5.6604	300	0.9067	0.5901	0.9067	0.9522
No log	5.6981	302	0.9204	0.5959	0.9204	0.9594
No log	5.7358	304	0.9718	0.5907	0.9718	0.9858
No log	5.7736	306	1.0746	0.5858	1.0746	1.0366
No log	5.8113	308	1.2088	0.5592	1.2088	1.0994
No log	5.8491	310	1.3283	0.5313	1.3283	1.1525
No log	5.8868	312	1.3506	0.5196	1.3506	1.1621
No log	5.9245	314	1.2879	0.5230	1.2879	1.1349
No log	5.9623	316	1.1675	0.5426	1.1675	1.0805
No log	6.0	318	1.0812	0.5629	1.0812	1.0398
No log	6.0377	320	1.0252	0.5568	1.0252	1.0125
No log	6.0755	322	1.0190	0.5578	1.0190	1.0095
No log	6.1132	324	1.0311	0.5568	1.0311	1.0154
No log	6.1509	326	1.0871	0.5699	1.0871	1.0426
No log	6.1887	328	1.1366	0.5653	1.1366	1.0661
No log	6.2264	330	1.1199	0.5699	1.1199	1.0582
No log	6.2642	332	1.0643	0.5629	1.0643	1.0317
No log	6.3019	334	1.0167	0.5757	1.0167	1.0083
No log	6.3396	336	0.9629	0.5999	0.9629	0.9813
No log	6.3774	338	0.9639	0.6117	0.9639	0.9818
No log	6.4151	340	0.9897	0.5946	0.9897	0.9948
No log	6.4528	342	1.0097	0.5933	1.0097	1.0049
No log	6.4906	344	0.9737	0.5969	0.9737	0.9868
No log	6.5283	346	0.9737	0.5969	0.9737	0.9868
No log	6.5660	348	1.0068	0.6012	1.0068	1.0034
No log	6.6038	350	1.0530	0.5527	1.0530	1.0262
No log	6.6415	352	1.0491	0.5573	1.0491	1.0242
No log	6.6792	354	1.0052	0.5930	1.0052	1.0026
No log	6.7170	356	0.9528	0.6223	0.9528	0.9761
No log	6.7547	358	0.9331	0.6339	0.9331	0.9660
No log	6.7925	360	0.9349	0.6165	0.9349	0.9669
No log	6.8302	362	0.9769	0.5976	0.9769	0.9884
No log	6.8679	364	0.9957	0.5745	0.9957	0.9978
No log	6.9057	366	0.9884	0.5963	0.9884	0.9942
No log	6.9434	368	0.9497	0.6290	0.9497	0.9745
No log	6.9811	370	0.9248	0.6180	0.9248	0.9617
No log	7.0189	372	0.8836	0.6204	0.8836	0.9400
No log	7.0566	374	0.8842	0.6303	0.8842	0.9403
No log	7.0943	376	0.8907	0.6324	0.8907	0.9437
No log	7.1321	378	0.9094	0.6438	0.9094	0.9536
No log	7.1698	380	0.9013	0.6438	0.9013	0.9494
No log	7.2075	382	0.8630	0.6480	0.8630	0.9290
No log	7.2453	384	0.8746	0.6454	0.8746	0.9352
No log	7.2830	386	0.8941	0.6329	0.8941	0.9456
No log	7.3208	388	0.9037	0.6340	0.9037	0.9506
No log	7.3585	390	0.9208	0.6215	0.9208	0.9596
No log	7.3962	392	0.9381	0.6215	0.9381	0.9685
No log	7.4340	394	0.9374	0.6215	0.9374	0.9682
No log	7.4717	396	0.9142	0.6340	0.9142	0.9562
No log	7.5094	398	0.8902	0.6290	0.8902	0.9435
No log	7.5472	400	0.8862	0.6254	0.8862	0.9414
No log	7.5849	402	0.9136	0.6290	0.9136	0.9558
No log	7.6226	404	0.9386	0.6340	0.9386	0.9688
No log	7.6604	406	0.9645	0.6345	0.9645	0.9821
No log	7.6981	408	0.9866	0.6221	0.9866	0.9933
No log	7.7358	410	0.9828	0.6221	0.9828	0.9914
No log	7.7736	412	0.9717	0.6221	0.9717	0.9858
No log	7.8113	414	0.9482	0.6250	0.9482	0.9738
No log	7.8491	416	0.9180	0.6099	0.9180	0.9581
No log	7.8868	418	0.8859	0.6034	0.8859	0.9412
No log	7.9245	420	0.8739	0.6268	0.8739	0.9348
No log	7.9623	422	0.8717	0.6268	0.8717	0.9337
No log	8.0	424	0.8507	0.6371	0.8507	0.9224
No log	8.0377	426	0.8444	0.6300	0.8444	0.9189
No log	8.0755	428	0.8529	0.6300	0.8529	0.9235
No log	8.1132	430	0.8621	0.6300	0.8621	0.9285
No log	8.1509	432	0.8641	0.6300	0.8641	0.9296
No log	8.1887	434	0.8480	0.6300	0.8480	0.9209
No log	8.2264	436	0.8509	0.6300	0.8509	0.9224
No log	8.2642	438	0.8735	0.6268	0.8735	0.9346
No log	8.3019	440	0.9024	0.6175	0.9024	0.9500
No log	8.3396	442	0.9163	0.6229	0.9163	0.9573
No log	8.3774	444	0.9370	0.6453	0.9370	0.9680
No log	8.4151	446	0.9513	0.6453	0.9513	0.9754
No log	8.4528	448	0.9602	0.6453	0.9602	0.9799
No log	8.4906	450	0.9777	0.6453	0.9777	0.9888
No log	8.5283	452	1.0085	0.6237	1.0085	1.0042
No log	8.5660	454	1.0356	0.6114	1.0356	1.0176
No log	8.6038	456	1.0463	0.5992	1.0463	1.0229
No log	8.6415	458	1.0466	0.5992	1.0466	1.0230
No log	8.6792	460	1.0418	0.5992	1.0418	1.0207
No log	8.7170	462	1.0334	0.5992	1.0334	1.0166
No log	8.7547	464	1.0118	0.5992	1.0118	1.0059
No log	8.7925	466	0.9818	0.6066	0.9818	0.9909
No log	8.8302	468	0.9651	0.6093	0.9651	0.9824
No log	8.8679	470	0.9504	0.6093	0.9504	0.9749
No log	8.9057	472	0.9332	0.6071	0.9332	0.9660
No log	8.9434	474	0.9307	0.6071	0.9307	0.9647
No log	8.9811	476	0.9326	0.6071	0.9326	0.9657
No log	9.0189	478	0.9270	0.6071	0.9270	0.9628
No log	9.0566	480	0.9339	0.6236	0.9339	0.9664
No log	9.0943	482	0.9381	0.6236	0.9381	0.9686
No log	9.1321	484	0.9342	0.6360	0.9342	0.9665
No log	9.1698	486	0.9238	0.6360	0.9238	0.9612
No log	9.2075	488	0.9203	0.6360	0.9203	0.9593
No log	9.2453	490	0.9219	0.6360	0.9219	0.9601
No log	9.2830	492	0.9316	0.6360	0.9316	0.9652
No log	9.3208	494	0.9406	0.6453	0.9406	0.9699
No log	9.3585	496	0.9432	0.6453	0.9432	0.9712
No log	9.3962	498	0.9414	0.6360	0.9414	0.9703
0.3123	9.4340	500	0.9444	0.6360	0.9444	0.9718
0.3123	9.4717	502	0.9454	0.6360	0.9454	0.9723
0.3123	9.5094	504	0.9457	0.6236	0.9457	0.9725
0.3123	9.5472	506	0.9456	0.6236	0.9456	0.9724
0.3123	9.5849	508	0.9429	0.6360	0.9429	0.9710
0.3123	9.6226	510	0.9382	0.6360	0.9382	0.9686
0.3123	9.6604	512	0.9357	0.6360	0.9357	0.9673
0.3123	9.6981	514	0.9330	0.6360	0.9330	0.9659
0.3123	9.7358	516	0.9332	0.6360	0.9332	0.9660
0.3123	9.7736	518	0.9336	0.6360	0.9336	0.9662
0.3123	9.8113	520	0.9337	0.6360	0.9337	0.9663
0.3123	9.8491	522	0.9340	0.6360	0.9340	0.9664
0.3123	9.8868	524	0.9330	0.6360	0.9330	0.9659
0.3123	9.9245	526	0.9317	0.6360	0.9317	0.9652
0.3123	9.9623	528	0.9317	0.6360	0.9317	0.9653
0.3123	10.0	530	0.9317	0.6360	0.9317	0.9652

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1