ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k19_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0410
• Qwk: 0.5972
• Mse: 1.0410
• Rmse: 1.0203

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0233	2	6.8160	0.0176	6.8160	2.6108
No log	0.0465	4	4.8436	0.0303	4.8436	2.2008
No log	0.0698	6	2.9630	0.0988	2.9630	1.7213
No log	0.0930	8	2.2332	0.1143	2.2332	1.4944
No log	0.1163	10	1.8450	0.1651	1.8450	1.3583
No log	0.1395	12	1.8241	0.1481	1.8241	1.3506
No log	0.1628	14	1.9026	0.1982	1.9026	1.3793
No log	0.1860	16	1.9782	0.1538	1.9782	1.4065
No log	0.2093	18	2.1683	0.1045	2.1683	1.4725
No log	0.2326	20	2.4514	0.0833	2.4514	1.5657
No log	0.2558	22	2.1780	0.1135	2.1780	1.4758
No log	0.2791	24	2.0522	0.25	2.0522	1.4325
No log	0.3023	26	1.7966	0.2791	1.7966	1.3404
No log	0.3256	28	1.5514	0.3621	1.5514	1.2455
No log	0.3488	30	1.5025	0.2727	1.5025	1.2258
No log	0.3721	32	1.4307	0.2407	1.4307	1.1961
No log	0.3953	34	1.3799	0.2569	1.3799	1.1747
No log	0.4186	36	1.5418	0.3025	1.5418	1.2417
No log	0.4419	38	1.7358	0.272	1.7358	1.3175
No log	0.4651	40	1.6339	0.2787	1.6339	1.2782
No log	0.4884	42	1.7381	0.2540	1.7381	1.3184
No log	0.5116	44	1.5801	0.3252	1.5801	1.2570
No log	0.5349	46	1.6376	0.2903	1.6376	1.2797
No log	0.5581	48	1.6284	0.2927	1.6284	1.2761
No log	0.5814	50	1.4917	0.2542	1.4917	1.2213
No log	0.6047	52	1.6504	0.2439	1.6504	1.2847
No log	0.6279	54	1.7222	0.2969	1.7222	1.3123
No log	0.6512	56	1.6065	0.3016	1.6065	1.2675
No log	0.6744	58	1.4731	0.1754	1.4731	1.2137
No log	0.6977	60	1.6261	0.2407	1.6261	1.2752
No log	0.7209	62	1.5378	0.3036	1.5378	1.2401
No log	0.7442	64	1.2805	0.4480	1.2805	1.1316
No log	0.7674	66	1.2766	0.5039	1.2766	1.1299
No log	0.7907	68	1.4414	0.4380	1.4414	1.2006
No log	0.8140	70	1.5935	0.3546	1.5935	1.2624
No log	0.8372	72	1.8283	0.2657	1.8283	1.3521
No log	0.8605	74	1.8219	0.3576	1.8219	1.3498
No log	0.8837	76	1.5531	0.3586	1.5531	1.2462
No log	0.9070	78	1.4304	0.4571	1.4304	1.1960
No log	0.9302	80	1.4318	0.4429	1.4318	1.1966
No log	0.9535	82	1.5412	0.3913	1.5412	1.2415
No log	0.9767	84	1.4216	0.4762	1.4216	1.1923
No log	1.0	86	1.4662	0.3276	1.4662	1.2109
No log	1.0233	88	1.3195	0.2321	1.3195	1.1487
No log	1.0465	90	1.2903	0.3540	1.2903	1.1359
No log	1.0698	92	1.3303	0.4274	1.3303	1.1534
No log	1.0930	94	1.2344	0.3363	1.2344	1.1110
No log	1.1163	96	1.1308	0.4828	1.1308	1.0634
No log	1.1395	98	1.2253	0.5827	1.2253	1.1069
No log	1.1628	100	1.2748	0.4844	1.2748	1.1291
No log	1.1860	102	1.2845	0.4839	1.2845	1.1334
No log	1.2093	104	1.2727	0.4715	1.2727	1.1281
No log	1.2326	106	1.2865	0.4923	1.2865	1.1343
No log	1.2558	108	1.2369	0.4962	1.2369	1.1122
No log	1.2791	110	1.2030	0.4769	1.2030	1.0968
No log	1.3023	112	1.3211	0.4662	1.3211	1.1494
No log	1.3256	114	1.4770	0.4559	1.4770	1.2153
No log	1.3488	116	1.5522	0.4211	1.5522	1.2459
No log	1.3721	118	1.5547	0.3065	1.5547	1.2469
No log	1.3953	120	1.5562	0.3529	1.5562	1.2475
No log	1.4186	122	1.5209	0.3898	1.5209	1.2333
No log	1.4419	124	1.6273	0.3077	1.6273	1.2757
No log	1.4651	126	1.7202	0.2655	1.7202	1.3115
No log	1.4884	128	1.5949	0.3306	1.5949	1.2629
No log	1.5116	130	1.5104	0.3594	1.5104	1.2290
No log	1.5349	132	1.5319	0.3704	1.5319	1.2377
No log	1.5581	134	1.6609	0.3429	1.6609	1.2888
No log	1.5814	136	1.8355	0.3243	1.8355	1.3548
No log	1.6047	138	1.8447	0.2877	1.8447	1.3582
No log	1.6279	140	1.6236	0.3165	1.6236	1.2742
No log	1.6512	142	1.5047	0.3256	1.5047	1.2267
No log	1.6744	144	1.5178	0.3566	1.5178	1.2320
No log	1.6977	146	1.5404	0.3385	1.5404	1.2411
No log	1.7209	148	1.6562	0.3714	1.6562	1.2869
No log	1.7442	150	1.5984	0.4380	1.5984	1.2643
No log	1.7674	152	1.3820	0.4262	1.3820	1.1756
No log	1.7907	154	1.2716	0.4103	1.2716	1.1277
No log	1.8140	156	1.2410	0.5197	1.2410	1.1140
No log	1.8372	158	1.2986	0.5075	1.2986	1.1395
No log	1.8605	160	1.2509	0.5113	1.2509	1.1184
No log	1.8837	162	1.0901	0.5865	1.0901	1.0441
No log	1.9070	164	1.0195	0.6667	1.0195	1.0097
No log	1.9302	166	1.0042	0.6531	1.0042	1.0021
No log	1.9535	168	1.0597	0.5972	1.0597	1.0294
No log	1.9767	170	1.2521	0.4932	1.2521	1.1190
No log	2.0	172	1.3328	0.4868	1.3328	1.1545
No log	2.0233	174	1.2447	0.5563	1.2447	1.1157
No log	2.0465	176	1.1117	0.5541	1.1117	1.0544
No log	2.0698	178	0.9398	0.64	0.9398	0.9694
No log	2.0930	180	0.9931	0.6443	0.9931	0.9965
No log	2.1163	182	0.9949	0.6122	0.9949	0.9975
No log	2.1395	184	0.9310	0.6800	0.9310	0.9649
No log	2.1628	186	0.9527	0.6434	0.9527	0.9760
No log	2.1860	188	0.9680	0.6294	0.9680	0.9839
No log	2.2093	190	0.9559	0.6619	0.9559	0.9777
No log	2.2326	192	0.9843	0.6338	0.9843	0.9921
No log	2.2558	194	0.9857	0.6475	0.9857	0.9928
No log	2.2791	196	0.9961	0.6197	0.9961	0.9981
No log	2.3023	198	1.0458	0.5946	1.0458	1.0226
No log	2.3256	200	0.9326	0.6438	0.9326	0.9657
No log	2.3488	202	0.8203	0.6939	0.8203	0.9057
No log	2.3721	204	0.8278	0.6849	0.8278	0.9098
No log	2.3953	206	0.9287	0.6338	0.9287	0.9637
No log	2.4186	208	1.2300	0.5535	1.2300	1.1091
No log	2.4419	210	1.3903	0.5535	1.3903	1.1791
No log	2.4651	212	1.2400	0.5535	1.2400	1.1136
No log	2.4884	214	0.8890	0.6968	0.8890	0.9428
No log	2.5116	216	0.8220	0.6887	0.8220	0.9066
No log	2.5349	218	0.9095	0.6438	0.9095	0.9537
No log	2.5581	220	1.2086	0.5578	1.2086	1.0994
No log	2.5814	222	1.3572	0.5556	1.3572	1.1650
No log	2.6047	224	1.3688	0.5286	1.3688	1.1699
No log	2.6279	226	1.1272	0.6571	1.1272	1.0617
No log	2.6512	228	0.9264	0.6861	0.9264	0.9625
No log	2.6744	230	0.8745	0.6715	0.8745	0.9352
No log	2.6977	232	0.8455	0.6763	0.8455	0.9195
No log	2.7209	234	0.8549	0.6475	0.8549	0.9246
No log	2.7442	236	0.8947	0.6621	0.8947	0.9459
No log	2.7674	238	0.9302	0.6621	0.9302	0.9645
No log	2.7907	240	0.9402	0.6667	0.9402	0.9696
No log	2.8140	242	0.9866	0.6164	0.9866	0.9933
No log	2.8372	244	0.9261	0.6525	0.9261	0.9623
No log	2.8605	246	0.9561	0.5985	0.9561	0.9778
No log	2.8837	248	1.0149	0.5672	1.0149	1.0074
No log	2.9070	250	1.0446	0.5496	1.0446	1.0220
No log	2.9302	252	1.0964	0.5758	1.0964	1.0471
No log	2.9535	254	1.1593	0.5802	1.1593	1.0767
No log	2.9767	256	1.1836	0.5496	1.1836	1.0879
No log	3.0	258	1.2214	0.5152	1.2214	1.1052
No log	3.0233	260	1.2749	0.4662	1.2749	1.1291
No log	3.0465	262	1.3290	0.4545	1.3290	1.1528
No log	3.0698	264	1.3832	0.5036	1.3832	1.1761
No log	3.0930	266	1.4738	0.4521	1.4738	1.2140
No log	3.1163	268	1.5358	0.4196	1.5358	1.2393
No log	3.1395	270	1.5126	0.4354	1.5126	1.2299
No log	3.1628	272	1.4447	0.5248	1.4447	1.2020
No log	3.1860	274	1.4063	0.5	1.4063	1.1859
No log	3.2093	276	1.4104	0.5211	1.4104	1.1876
No log	3.2326	278	1.3822	0.5248	1.3822	1.1757
No log	3.2558	280	1.3617	0.5324	1.3617	1.1669
No log	3.2791	282	1.3167	0.5414	1.3167	1.1475
No log	3.3023	284	1.3070	0.4394	1.3070	1.1432
No log	3.3256	286	1.2367	0.5185	1.2367	1.1121
No log	3.3488	288	1.1573	0.5985	1.1573	1.0758
No log	3.3721	290	1.0895	0.6087	1.0895	1.0438
No log	3.3953	292	1.0778	0.6	1.0778	1.0382
No log	3.4186	294	1.0933	0.5734	1.0933	1.0456
No log	3.4419	296	1.0224	0.6479	1.0224	1.0112
No log	3.4651	298	0.9362	0.6232	0.9362	0.9676
No log	3.4884	300	0.9020	0.6423	0.9020	0.9498
No log	3.5116	302	0.8951	0.6619	0.8951	0.9461
No log	3.5349	304	0.9652	0.6056	0.9652	0.9824
No log	3.5581	306	0.9497	0.6187	0.9497	0.9745
No log	3.5814	308	0.9568	0.6528	0.9568	0.9781
No log	3.6047	310	1.0113	0.6207	1.0113	1.0057
No log	3.6279	312	0.9550	0.6479	0.9550	0.9772
No log	3.6512	314	0.9389	0.6853	0.9389	0.9690
No log	3.6744	316	0.9051	0.6944	0.9051	0.9513
No log	3.6977	318	0.9010	0.6759	0.9010	0.9492
No log	3.7209	320	0.9037	0.6525	0.9037	0.9506
No log	3.7442	322	0.9363	0.6667	0.9363	0.9676
No log	3.7674	324	0.9310	0.6331	0.9310	0.9649
No log	3.7907	326	0.9220	0.6475	0.9220	0.9602
No log	3.8140	328	0.9389	0.6154	0.9389	0.9690
No log	3.8372	330	1.0532	0.6081	1.0532	1.0263
No log	3.8605	332	1.0916	0.5890	1.0916	1.0448
No log	3.8837	334	1.0019	0.6164	1.0019	1.0009
No log	3.9070	336	0.9546	0.6069	0.9546	0.9770
No log	3.9302	338	1.0130	0.6069	1.0130	1.0065
No log	3.9535	340	1.1080	0.5931	1.1080	1.0526
No log	3.9767	342	1.1161	0.6027	1.1161	1.0565
No log	4.0	344	1.1149	0.6027	1.1149	1.0559
No log	4.0233	346	1.0048	0.6338	1.0048	1.0024
No log	4.0465	348	0.9081	0.6573	0.9081	0.9530
No log	4.0698	350	0.8445	0.6803	0.8445	0.9189
No log	4.0930	352	0.8320	0.6887	0.8320	0.9121
No log	4.1163	354	0.9074	0.6410	0.9074	0.9526
No log	4.1395	356	0.9690	0.6234	0.9690	0.9844
No log	4.1628	358	1.1197	0.5867	1.1197	1.0582
No log	4.1860	360	1.1343	0.5850	1.1343	1.0651
No log	4.2093	362	0.9958	0.6207	0.9958	0.9979
No log	4.2326	364	0.9138	0.6857	0.9138	0.9559
No log	4.2558	366	0.8856	0.6857	0.8856	0.9411
No log	4.2791	368	0.8395	0.6950	0.8395	0.9163
No log	4.3023	370	0.8545	0.6806	0.8545	0.9244
No log	4.3256	372	0.9352	0.6853	0.9352	0.9671
No log	4.3488	374	1.0180	0.6667	1.0180	1.0090
No log	4.3721	376	1.0089	0.6667	1.0089	1.0044
No log	4.3953	378	0.9051	0.6853	0.9051	0.9514
No log	4.4186	380	0.8183	0.6846	0.8183	0.9046
No log	4.4419	382	0.8079	0.7273	0.8079	0.8989
No log	4.4651	384	0.8090	0.7105	0.8090	0.8994
No log	4.4884	386	0.9130	0.6667	0.9130	0.9555
No log	4.5116	388	1.0288	0.5772	1.0288	1.0143
No log	4.5349	390	0.9700	0.6345	0.9700	0.9849
No log	4.5581	392	0.8639	0.6573	0.8639	0.9295
No log	4.5814	394	0.8640	0.6475	0.8640	0.9295
No log	4.6047	396	0.9017	0.6525	0.9017	0.9496
No log	4.6279	398	0.9995	0.6197	0.9995	0.9998
No log	4.6512	400	1.1946	0.5694	1.1946	1.0930
No log	4.6744	402	1.3581	0.5211	1.3581	1.1654
No log	4.6977	404	1.3416	0.5211	1.3416	1.1583
No log	4.7209	406	1.1425	0.5850	1.1425	1.0689
No log	4.7442	408	0.9717	0.6483	0.9717	0.9858
No log	4.7674	410	0.9119	0.6575	0.9119	0.9549
No log	4.7907	412	0.9482	0.6486	0.9482	0.9738
No log	4.8140	414	1.0794	0.5906	1.0794	1.0390
No log	4.8372	416	1.1845	0.5850	1.1845	1.0883
No log	4.8605	418	1.1165	0.6027	1.1165	1.0566
No log	4.8837	420	1.0275	0.6575	1.0275	1.0136
No log	4.9070	422	0.9190	0.6338	0.9190	0.9586
No log	4.9302	424	0.8844	0.6383	0.8844	0.9404
No log	4.9535	426	0.8752	0.6383	0.8752	0.9355
No log	4.9767	428	0.8712	0.6241	0.8712	0.9334
No log	5.0	430	0.9223	0.6438	0.9223	0.9604
No log	5.0233	432	0.9734	0.6259	0.9734	0.9866
No log	5.0465	434	0.9348	0.6081	0.9348	0.9668
No log	5.0698	436	0.8739	0.6531	0.8739	0.9348
No log	5.0930	438	0.8680	0.6577	0.8680	0.9317
No log	5.1163	440	0.8733	0.6395	0.8733	0.9345
No log	5.1395	442	0.9548	0.6345	0.9548	0.9771
No log	5.1628	444	0.9992	0.6056	0.9992	0.9996
No log	5.1860	446	0.9856	0.6043	0.9856	0.9928
No log	5.2093	448	0.9634	0.6232	0.9634	0.9815
No log	5.2326	450	0.9449	0.6087	0.9449	0.9721
No log	5.2558	452	0.9825	0.6043	0.9825	0.9912
No log	5.2791	454	1.0766	0.6232	1.0766	1.0376
No log	5.3023	456	1.0775	0.6074	1.0775	1.0380
No log	5.3256	458	1.0263	0.6074	1.0263	1.0131
No log	5.3488	460	0.8873	0.6087	0.8873	0.9420
No log	5.3721	462	0.8085	0.6475	0.8085	0.8992
No log	5.3953	464	0.8145	0.6277	0.8145	0.9025
No log	5.4186	466	0.9188	0.6277	0.9188	0.9585
No log	5.4419	468	1.0581	0.6131	1.0581	1.0287
No log	5.4651	470	1.0918	0.5882	1.0918	1.0449
No log	5.4884	472	0.9972	0.6197	0.9972	0.9986
No log	5.5116	474	0.7888	0.6667	0.7888	0.8882
No log	5.5349	476	0.6934	0.7123	0.6934	0.8327
No log	5.5581	478	0.6854	0.7397	0.6854	0.8279
No log	5.5814	480	0.7011	0.7483	0.7011	0.8373
No log	5.6047	482	0.7443	0.6901	0.7443	0.8627
No log	5.6279	484	0.8066	0.6667	0.8066	0.8981
No log	5.6512	486	0.9300	0.6434	0.9300	0.9644
No log	5.6744	488	0.9888	0.6197	0.9888	0.9944
No log	5.6977	490	1.0809	0.5714	1.0809	1.0397
No log	5.7209	492	1.0611	0.5874	1.0611	1.0301
No log	5.7442	494	0.9584	0.6434	0.9584	0.9790
No log	5.7674	496	0.9293	0.6483	0.9293	0.9640
No log	5.7907	498	0.9215	0.6187	0.9215	0.9599
0.4888	5.8140	500	0.9483	0.6131	0.9483	0.9738
0.4888	5.8372	502	0.9859	0.6131	0.9859	0.9929
0.4888	5.8605	504	0.9852	0.6338	0.9852	0.9926
0.4888	5.8837	506	0.9363	0.6345	0.9363	0.9676
0.4888	5.9070	508	0.8572	0.6528	0.8572	0.9259
0.4888	5.9302	510	0.8616	0.7417	0.8616	0.9282
0.4888	5.9535	512	0.8596	0.7417	0.8596	0.9272
0.4888	5.9767	514	0.8319	0.7237	0.8319	0.9121
0.4888	6.0	516	0.8547	0.6711	0.8547	0.9245
0.4888	6.0233	518	0.9285	0.6849	0.9285	0.9636
0.4888	6.0465	520	1.0031	0.6621	1.0031	1.0015
0.4888	6.0698	522	1.0944	0.6027	1.0944	1.0461
0.4888	6.0930	524	1.0882	0.6099	1.0882	1.0432
0.4888	6.1163	526	1.0250	0.6429	1.0250	1.0124
0.4888	6.1395	528	0.9472	0.6714	0.9472	0.9732
0.4888	6.1628	530	0.8992	0.6806	0.8992	0.9483
0.4888	6.1860	532	0.8688	0.6853	0.8688	0.9321
0.4888	6.2093	534	0.8738	0.6901	0.8738	0.9348
0.4888	6.2326	536	0.9428	0.6571	0.9428	0.9710
0.4888	6.2558	538	1.0357	0.6053	1.0357	1.0177
0.4888	6.2791	540	1.1546	0.5897	1.1546	1.0745
0.4888	6.3023	542	1.1561	0.5578	1.1561	1.0752
0.4888	6.3256	544	1.0407	0.6043	1.0407	1.0202
0.4888	6.3488	546	0.9573	0.6269	0.9573	0.9784
0.4888	6.3721	548	0.9607	0.6569	0.9607	0.9801
0.4888	6.3953	550	0.9719	0.6277	0.9719	0.9858
0.4888	6.4186	552	1.0150	0.6143	1.0150	1.0075
0.4888	6.4419	554	1.0687	0.5931	1.0687	1.0338
0.4888	6.4651	556	1.0860	0.6027	1.0860	1.0421
0.4888	6.4884	558	1.0286	0.5833	1.0286	1.0142
0.4888	6.5116	560	0.9671	0.6241	0.9671	0.9834
0.4888	6.5349	562	0.9246	0.6475	0.9246	0.9616
0.4888	6.5581	564	0.9067	0.6429	0.9067	0.9522
0.4888	6.5814	566	0.9069	0.6429	0.9069	0.9523
0.4888	6.6047	568	0.9548	0.6338	0.9548	0.9771
0.4888	6.6279	570	1.0336	0.6345	1.0336	1.0167
0.4888	6.6512	572	1.0777	0.6345	1.0777	1.0381
0.4888	6.6744	574	1.1040	0.6027	1.1040	1.0507
0.4888	6.6977	576	1.0299	0.5793	1.0299	1.0149
0.4888	6.7209	578	1.0004	0.6069	1.0004	1.0002
0.4888	6.7442	580	1.0248	0.5931	1.0248	1.0123
0.4888	6.7674	582	1.0410	0.5972	1.0410	1.0203

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1