ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8202
• Qwk: 0.4575
• Mse: 0.8202
• Rmse: 0.9056

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	4.4799	0.0018	4.4799	2.1166
No log	0.4444	4	2.5936	0.0248	2.5936	1.6105
No log	0.6667	6	1.7460	0.0062	1.7460	1.3214
No log	0.8889	8	1.5093	0.0227	1.5093	1.2285
No log	1.1111	10	1.2503	0.1237	1.2503	1.1182
No log	1.3333	12	1.2552	0.1671	1.2552	1.1203
No log	1.5556	14	1.3789	-0.0636	1.3789	1.1743
No log	1.7778	16	1.8056	0.0082	1.8056	1.3437
No log	2.0	18	1.8410	0.0444	1.8410	1.3568
No log	2.2222	20	1.7640	0.0585	1.7640	1.3282
No log	2.4444	22	1.3950	0.0019	1.3950	1.1811
No log	2.6667	24	1.2359	0.2025	1.2359	1.1117
No log	2.8889	26	1.2147	0.2097	1.2147	1.1021
No log	3.1111	28	1.1990	0.1935	1.1990	1.0950
No log	3.3333	30	1.1995	0.2097	1.1995	1.0952
No log	3.5556	32	1.1961	0.2155	1.1961	1.0937
No log	3.7778	34	1.2160	0.1519	1.2160	1.1027
No log	4.0	36	1.2720	0.0408	1.2720	1.1278
No log	4.2222	38	1.2846	0.0322	1.2846	1.1334
No log	4.4444	40	1.3040	0.0218	1.3040	1.1419
No log	4.6667	42	1.3121	0.1515	1.3121	1.1455
No log	4.8889	44	1.3168	0.1503	1.3168	1.1475
No log	5.1111	46	1.3526	0.1171	1.3526	1.1630
No log	5.3333	48	1.3534	0.1615	1.3534	1.1634
No log	5.5556	50	1.3813	0.1826	1.3813	1.1753
No log	5.7778	52	1.1720	0.2108	1.1720	1.0826
No log	6.0	54	1.1100	0.2757	1.1100	1.0536
No log	6.2222	56	1.3119	0.2729	1.3119	1.1454
No log	6.4444	58	1.4945	0.2060	1.4945	1.2225
No log	6.6667	60	1.3997	0.2136	1.3997	1.1831
No log	6.8889	62	1.1303	0.3724	1.1303	1.0631
No log	7.1111	64	1.0489	0.4882	1.0489	1.0241
No log	7.3333	66	1.2947	0.3119	1.2947	1.1378
No log	7.5556	68	1.5522	0.3038	1.5522	1.2459
No log	7.7778	70	1.2158	0.2873	1.2158	1.1026
No log	8.0	72	1.0130	0.4698	1.0130	1.0065
No log	8.2222	74	1.0347	0.4846	1.0347	1.0172
No log	8.4444	76	1.0653	0.4914	1.0653	1.0321
No log	8.6667	78	1.0657	0.4914	1.0657	1.0323
No log	8.8889	80	1.0746	0.4292	1.0746	1.0366
No log	9.1111	82	1.0532	0.4474	1.0532	1.0262
No log	9.3333	84	1.1034	0.3596	1.1034	1.0504
No log	9.5556	86	1.0502	0.4996	1.0502	1.0248
No log	9.7778	88	1.0360	0.4996	1.0360	1.0178
No log	10.0	90	0.9971	0.4981	0.9971	0.9986
No log	10.2222	92	1.1214	0.4055	1.1214	1.0590
No log	10.4444	94	1.0523	0.4606	1.0523	1.0258
No log	10.6667	96	1.0147	0.4430	1.0147	1.0073
No log	10.8889	98	1.3857	0.3162	1.3857	1.1771
No log	11.1111	100	1.6906	0.2774	1.6906	1.3002
No log	11.3333	102	1.2875	0.2595	1.2875	1.1347
No log	11.5556	104	1.1145	0.4407	1.1145	1.0557
No log	11.7778	106	1.1432	0.3671	1.1432	1.0692
No log	12.0	108	1.1309	0.4230	1.1309	1.0634
No log	12.2222	110	1.3445	0.2510	1.3445	1.1595
No log	12.4444	112	1.5085	0.2593	1.5085	1.2282
No log	12.6667	114	1.2179	0.2295	1.2179	1.1036
No log	12.8889	116	0.9641	0.4962	0.9641	0.9819
No log	13.1111	118	1.0780	0.3551	1.0780	1.0383
No log	13.3333	120	1.0853	0.3135	1.0853	1.0418
No log	13.5556	122	0.9682	0.4810	0.9682	0.9840
No log	13.7778	124	1.1544	0.3260	1.1544	1.0744
No log	14.0	126	1.3162	0.2650	1.3162	1.1473
No log	14.2222	128	1.1300	0.2510	1.1300	1.0630
No log	14.4444	130	1.0246	0.4219	1.0246	1.0122
No log	14.6667	132	1.1271	0.3365	1.1271	1.0617
No log	14.8889	134	1.2474	0.2806	1.2474	1.1169
No log	15.1111	136	1.2135	0.3370	1.2135	1.1016
No log	15.3333	138	1.0673	0.3701	1.0673	1.0331
No log	15.5556	140	1.0017	0.4847	1.0017	1.0009
No log	15.7778	142	1.1061	0.2755	1.1061	1.0517
No log	16.0	144	1.1260	0.2264	1.1260	1.0611
No log	16.2222	146	1.0465	0.3572	1.0465	1.0230
No log	16.4444	148	0.9518	0.5226	0.9518	0.9756
No log	16.6667	150	0.9651	0.5335	0.9651	0.9824
No log	16.8889	152	0.9521	0.4349	0.9521	0.9757
No log	17.1111	154	0.9804	0.4216	0.9804	0.9902
No log	17.3333	156	1.0256	0.4421	1.0256	1.0127
No log	17.5556	158	1.0561	0.4579	1.0561	1.0277
No log	17.7778	160	1.1575	0.3025	1.1575	1.0759
No log	18.0	162	1.3546	0.3444	1.3546	1.1639
No log	18.2222	164	1.2440	0.3428	1.2440	1.1153
No log	18.4444	166	1.0108	0.3812	1.0108	1.0054
No log	18.6667	168	0.9082	0.5186	0.9082	0.9530
No log	18.8889	170	0.8842	0.4575	0.8842	0.9403
No log	19.1111	172	0.8946	0.4181	0.8946	0.9458
No log	19.3333	174	0.9009	0.5312	0.9009	0.9492
No log	19.5556	176	1.1148	0.3067	1.1148	1.0559
No log	19.7778	178	1.2203	0.3076	1.2203	1.1047
No log	20.0	180	1.0407	0.4018	1.0407	1.0201
No log	20.2222	182	0.9469	0.5618	0.9469	0.9731
No log	20.4444	184	0.9320	0.5926	0.9320	0.9654
No log	20.6667	186	0.9536	0.5006	0.9536	0.9765
No log	20.8889	188	0.9323	0.5618	0.9323	0.9656
No log	21.1111	190	0.8839	0.4826	0.8839	0.9402
No log	21.3333	192	0.8925	0.4048	0.8925	0.9447
No log	21.5556	194	0.8805	0.4318	0.8805	0.9384
No log	21.7778	196	0.9008	0.5357	0.9008	0.9491
No log	22.0	198	0.9807	0.4774	0.9807	0.9903
No log	22.2222	200	0.9587	0.5085	0.9587	0.9791
No log	22.4444	202	0.8987	0.4916	0.8987	0.9480
No log	22.6667	204	0.9107	0.4216	0.9107	0.9543
No log	22.8889	206	0.8938	0.4343	0.8938	0.9454
No log	23.1111	208	0.8968	0.5167	0.8968	0.9470
No log	23.3333	210	0.9373	0.4912	0.9373	0.9682
No log	23.5556	212	1.0252	0.3624	1.0252	1.0125
No log	23.7778	214	0.9769	0.4975	0.9769	0.9884
No log	24.0	216	0.8810	0.4860	0.8810	0.9386
No log	24.2222	218	0.8563	0.4219	0.8563	0.9254
No log	24.4444	220	0.8432	0.4219	0.8432	0.9182
No log	24.6667	222	0.8346	0.4356	0.8346	0.9135
No log	24.8889	224	0.8383	0.5357	0.8383	0.9156
No log	25.1111	226	0.8430	0.5266	0.8430	0.9181
No log	25.3333	228	0.8078	0.4626	0.8078	0.8988
No log	25.5556	230	0.8215	0.4962	0.8215	0.9064
No log	25.7778	232	0.8429	0.4962	0.8429	0.9181
No log	26.0	234	0.8566	0.4343	0.8566	0.9255
No log	26.2222	236	0.8695	0.4962	0.8695	0.9325
No log	26.4444	238	0.8637	0.4947	0.8637	0.9293
No log	26.6667	240	0.8468	0.4977	0.8468	0.9202
No log	26.8889	242	0.8595	0.4993	0.8595	0.9271
No log	27.1111	244	0.9248	0.5075	0.9248	0.9617
No log	27.3333	246	1.0118	0.3207	1.0118	1.0059
No log	27.5556	248	1.0292	0.3622	1.0292	1.0145
No log	27.7778	250	0.9963	0.4613	0.9963	0.9982
No log	28.0	252	0.8973	0.5009	0.8973	0.9473
No log	28.2222	254	0.8732	0.4705	0.8732	0.9344
No log	28.4444	256	0.8709	0.4568	0.8709	0.9332
No log	28.6667	258	0.8653	0.4575	0.8653	0.9302
No log	28.8889	260	0.8741	0.5335	0.8741	0.9349
No log	29.1111	262	0.9435	0.4880	0.9435	0.9713
No log	29.3333	264	0.9694	0.5133	0.9694	0.9846
No log	29.5556	266	0.9083	0.5245	0.9083	0.9530
No log	29.7778	268	0.8828	0.4218	0.8828	0.9396
No log	30.0	270	0.9221	0.4430	0.9221	0.9603
No log	30.2222	272	0.9485	0.4668	0.9485	0.9739
No log	30.4444	274	0.9890	0.4634	0.9890	0.9945
No log	30.6667	276	1.0355	0.4211	1.0355	1.0176
No log	30.8889	278	1.0551	0.3714	1.0551	1.0272
No log	31.1111	280	0.9851	0.4007	0.9851	0.9925
No log	31.3333	282	0.9216	0.4282	0.9216	0.9600
No log	31.5556	284	0.9137	0.4002	0.9137	0.9559
No log	31.7778	286	0.9159	0.4280	0.9159	0.9570
No log	32.0	288	0.9318	0.4563	0.9318	0.9653
No log	32.2222	290	0.9728	0.3719	0.9728	0.9863
No log	32.4444	292	1.0161	0.3939	1.0161	1.0080
No log	32.6667	294	1.0335	0.4138	1.0335	1.0166
No log	32.8889	296	0.9898	0.4763	0.9898	0.9949
No log	33.1111	298	0.9260	0.4947	0.9260	0.9623
No log	33.3333	300	0.9223	0.4798	0.9223	0.9604
No log	33.5556	302	0.9292	0.4579	0.9292	0.9640
No log	33.7778	304	0.9327	0.4502	0.9327	0.9658
No log	34.0	306	0.9303	0.4231	0.9303	0.9645
No log	34.2222	308	0.9751	0.4332	0.9751	0.9875
No log	34.4444	310	1.0252	0.3731	1.0252	1.0125
No log	34.6667	312	0.9743	0.4465	0.9743	0.9871
No log	34.8889	314	0.9106	0.4388	0.9106	0.9542
No log	35.1111	316	0.9286	0.4181	0.9286	0.9636
No log	35.3333	318	0.9756	0.4363	0.9756	0.9877
No log	35.5556	320	0.9730	0.4363	0.9730	0.9864
No log	35.7778	322	0.9373	0.4560	0.9373	0.9681
No log	36.0	324	0.9601	0.4514	0.9601	0.9799
No log	36.2222	326	0.9761	0.4103	0.9761	0.9880
No log	36.4444	328	0.9557	0.4514	0.9557	0.9776
No log	36.6667	330	0.9216	0.4534	0.9216	0.9600
No log	36.8889	332	0.9119	0.4401	0.9119	0.9549
No log	37.1111	334	0.9029	0.4013	0.9029	0.9502
No log	37.3333	336	0.8883	0.4527	0.8883	0.9425
No log	37.5556	338	0.9033	0.4352	0.9033	0.9504
No log	37.7778	340	0.9463	0.4235	0.9463	0.9728
No log	38.0	342	0.9431	0.4271	0.9431	0.9711
No log	38.2222	344	0.9276	0.4926	0.9276	0.9631
No log	38.4444	346	0.8747	0.4960	0.8747	0.9352
No log	38.6667	348	0.8467	0.4826	0.8467	0.9202
No log	38.8889	350	0.8413	0.3762	0.8413	0.9172
No log	39.1111	352	0.8345	0.3762	0.8345	0.9135
No log	39.3333	354	0.8218	0.4141	0.8218	0.9065
No log	39.5556	356	0.8155	0.4826	0.8155	0.9030
No log	39.7778	358	0.8186	0.4847	0.8186	0.9048
No log	40.0	360	0.8169	0.5335	0.8169	0.9038
No log	40.2222	362	0.8065	0.5335	0.8065	0.8980
No log	40.4444	364	0.8124	0.5335	0.8124	0.9013
No log	40.6667	366	0.8395	0.5563	0.8395	0.9163
No log	40.8889	368	0.8586	0.5150	0.8586	0.9266
No log	41.1111	370	0.8620	0.5275	0.8620	0.9284
No log	41.3333	372	0.8565	0.5497	0.8565	0.9255
No log	41.5556	374	0.8466	0.5802	0.8466	0.9201
No log	41.7778	376	0.8120	0.5563	0.8120	0.9011
No log	42.0	378	0.7846	0.5186	0.7846	0.8858
No log	42.2222	380	0.7846	0.5042	0.7846	0.8858
No log	42.4444	382	0.7821	0.5058	0.7821	0.8844
No log	42.6667	384	0.7996	0.5538	0.7996	0.8942
No log	42.8889	386	0.8644	0.5618	0.8644	0.9298
No log	43.1111	388	0.8889	0.5737	0.8889	0.9428
No log	43.3333	390	0.8680	0.5618	0.8680	0.9316
No log	43.5556	392	0.8213	0.5563	0.8213	0.9062
No log	43.7778	394	0.7954	0.4834	0.7954	0.8919
No log	44.0	396	0.8035	0.4181	0.8035	0.8964
No log	44.2222	398	0.8010	0.4181	0.8010	0.8950
No log	44.4444	400	0.7999	0.4681	0.7999	0.8944
No log	44.6667	402	0.8098	0.5312	0.8098	0.8999
No log	44.8889	404	0.8235	0.5312	0.8235	0.9075
No log	45.1111	406	0.8387	0.4705	0.8387	0.9158
No log	45.3333	408	0.8600	0.4547	0.8600	0.9273
No log	45.5556	410	0.8677	0.4547	0.8677	0.9315
No log	45.7778	412	0.8656	0.4628	0.8656	0.9304
No log	46.0	414	0.8493	0.4435	0.8493	0.9216
No log	46.2222	416	0.8287	0.4218	0.8287	0.9103
No log	46.4444	418	0.8194	0.4705	0.8194	0.9052
No log	46.6667	420	0.8247	0.4847	0.8247	0.9081
No log	46.8889	422	0.8349	0.5335	0.8349	0.9137
No log	47.1111	424	0.8367	0.5335	0.8367	0.9147
No log	47.3333	426	0.8304	0.4485	0.8304	0.9113
No log	47.5556	428	0.8407	0.4644	0.8407	0.9169
No log	47.7778	430	0.8514	0.4636	0.8514	0.9227
No log	48.0	432	0.8504	0.4560	0.8504	0.9221
No log	48.2222	434	0.8634	0.4514	0.8634	0.9292
No log	48.4444	436	0.8901	0.5009	0.8901	0.9434
No log	48.6667	438	0.9089	0.4686	0.9089	0.9534
No log	48.8889	440	0.9070	0.4686	0.9070	0.9523
No log	49.1111	442	0.8615	0.4879	0.8615	0.9282
No log	49.3333	444	0.8362	0.4479	0.8362	0.9144
No log	49.5556	446	0.8333	0.4086	0.8333	0.9128
No log	49.7778	448	0.8373	0.3908	0.8373	0.9150
No log	50.0	450	0.8418	0.3908	0.8418	0.9175
No log	50.2222	452	0.8364	0.4218	0.8364	0.9146
No log	50.4444	454	0.8513	0.5186	0.8513	0.9227
No log	50.6667	456	0.8657	0.5312	0.8657	0.9304
No log	50.8889	458	0.8713	0.5291	0.8713	0.9334
No log	51.1111	460	0.8602	0.5312	0.8602	0.9275
No log	51.3333	462	0.8367	0.5186	0.8367	0.9147
No log	51.5556	464	0.8247	0.4086	0.8247	0.9081
No log	51.7778	466	0.8231	0.4087	0.8231	0.9073
No log	52.0	468	0.8288	0.3957	0.8288	0.9104
No log	52.2222	470	0.8340	0.4181	0.8340	0.9132
No log	52.4444	472	0.8267	0.3961	0.8267	0.9093
No log	52.6667	474	0.8143	0.4087	0.8143	0.9024
No log	52.8889	476	0.8018	0.4218	0.8018	0.8955
No log	53.1111	478	0.7986	0.5186	0.7986	0.8936
No log	53.3333	480	0.8012	0.5186	0.8012	0.8951
No log	53.5556	482	0.7964	0.5058	0.7964	0.8924
No log	53.7778	484	0.7985	0.4045	0.7985	0.8936
No log	54.0	486	0.8109	0.4045	0.8109	0.9005
No log	54.2222	488	0.8195	0.4048	0.8195	0.9053
No log	54.4444	490	0.8160	0.4048	0.8160	0.9033
No log	54.6667	492	0.8051	0.5058	0.8051	0.8973
No log	54.8889	494	0.8101	0.5186	0.8101	0.9001
No log	55.1111	496	0.8413	0.5312	0.8413	0.9172
No log	55.3333	498	0.8721	0.5120	0.8721	0.9338
0.2706	55.5556	500	0.8700	0.5138	0.8700	0.9327
0.2706	55.7778	502	0.8350	0.5459	0.8350	0.9138
0.2706	56.0	504	0.8045	0.5175	0.8045	0.8969
0.2706	56.2222	506	0.8075	0.3908	0.8075	0.8986
0.2706	56.4444	508	0.8239	0.3908	0.8239	0.9077
0.2706	56.6667	510	0.8193	0.3908	0.8193	0.9052
0.2706	56.8889	512	0.8172	0.4045	0.8172	0.9040
0.2706	57.1111	514	0.8202	0.4575	0.8202	0.9056

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1