ArabicNewSplits6_FineTuningAraBERT_run2_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6863
• Qwk: 0.3860
• Mse: 0.6863
• Rmse: 0.8285

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	3.1669	0.0082	3.1669	1.7796
No log	0.0702	4	2.2464	-0.0718	2.2464	1.4988
No log	0.1053	6	1.0471	0.0255	1.0471	1.0233
No log	0.1404	8	1.3091	0.0255	1.3091	1.1442
No log	0.1754	10	0.6701	0.2542	0.6701	0.8186
No log	0.2105	12	0.5666	0.0	0.5666	0.7528
No log	0.2456	14	0.5719	0.0	0.5719	0.7562
No log	0.2807	16	0.6508	0.1282	0.6508	0.8067
No log	0.3158	18	0.7386	0.0588	0.7386	0.8594
No log	0.3509	20	0.7709	0.1238	0.7709	0.8780
No log	0.3860	22	0.7953	0.0857	0.7953	0.8918
No log	0.4211	24	0.5727	0.0	0.5727	0.7568
No log	0.4561	26	0.6043	-0.0081	0.6043	0.7774
No log	0.4912	28	0.8623	0.1000	0.8623	0.9286
No log	0.5263	30	0.9365	0.0431	0.9365	0.9677
No log	0.5614	32	0.7030	0.2000	0.7030	0.8385
No log	0.5965	34	0.5849	-0.0081	0.5849	0.7648
No log	0.6316	36	0.6166	0.0569	0.6166	0.7852
No log	0.6667	38	1.0515	0.0431	1.0515	1.0254
No log	0.7018	40	1.3613	0.0345	1.3613	1.1667
No log	0.7368	42	0.9369	0.0	0.9369	0.9679
No log	0.7719	44	0.6373	0.2653	0.6373	0.7983
No log	0.8070	46	0.5704	-0.0233	0.5704	0.7553
No log	0.8421	48	0.7532	0.2432	0.7532	0.8679
No log	0.8772	50	0.8817	0.0078	0.8817	0.9390
No log	0.9123	52	0.9429	-0.0268	0.9429	0.9710
No log	0.9474	54	0.8436	0.0947	0.8436	0.9185
No log	0.9825	56	0.7426	0.0545	0.7426	0.8618
No log	1.0175	58	0.6535	-0.0233	0.6535	0.8084
No log	1.0526	60	0.5997	-0.0233	0.5997	0.7744
No log	1.0877	62	0.6000	-0.0435	0.6000	0.7746
No log	1.1228	64	0.6889	0.2000	0.6889	0.8300
No log	1.1579	66	0.6800	0.2083	0.6800	0.8246
No log	1.1930	68	0.6486	0.1724	0.6486	0.8054
No log	1.2281	70	0.5677	-0.0233	0.5677	0.7535
No log	1.2632	72	0.5527	-0.0159	0.5527	0.7434
No log	1.2982	74	0.5583	0.0	0.5583	0.7472
No log	1.3333	76	0.5595	0.0	0.5595	0.7480
No log	1.3684	78	0.5441	-0.0081	0.5441	0.7376
No log	1.4035	80	0.5260	0.0909	0.5260	0.7253
No log	1.4386	82	0.5353	-0.0159	0.5353	0.7316
No log	1.4737	84	0.5377	-0.0233	0.5377	0.7333
No log	1.5088	86	0.6195	0.2099	0.6195	0.7871
No log	1.5439	88	0.7928	0.3242	0.7928	0.8904
No log	1.5789	90	0.9131	0.2258	0.9131	0.9556
No log	1.6140	92	0.7705	0.2877	0.7705	0.8778
No log	1.6491	94	0.5389	0.0476	0.5389	0.7341
No log	1.6842	96	0.5378	0.1079	0.5378	0.7333
No log	1.7193	98	0.6932	0.3978	0.6932	0.8326
No log	1.7544	100	1.0610	0.1467	1.0610	1.0300
No log	1.7895	102	0.9344	0.1373	0.9344	0.9666
No log	1.8246	104	0.6336	0.1373	0.6336	0.7960
No log	1.8596	106	0.5049	0.2000	0.5049	0.7106
No log	1.8947	108	0.5451	0.2795	0.5451	0.7383
No log	1.9298	110	0.7583	0.3214	0.7583	0.8708
No log	1.9649	112	0.7020	0.2919	0.7020	0.8379
No log	2.0	114	0.6094	0.1707	0.6094	0.7806
No log	2.0351	116	0.7445	0.2086	0.7445	0.8629
No log	2.0702	118	0.7451	0.2865	0.7451	0.8632
No log	2.1053	120	0.6318	0.2832	0.6318	0.7949
No log	2.1404	122	0.5566	0.3371	0.5566	0.7460
No log	2.1754	124	0.5616	0.3258	0.5616	0.7494
No log	2.2105	126	0.5168	0.3121	0.5168	0.7189
No log	2.2456	128	0.6176	0.2513	0.6176	0.7859
No log	2.2807	130	0.6843	0.2607	0.6843	0.8272
No log	2.3158	132	0.5794	0.3369	0.5794	0.7612
No log	2.3509	134	0.5572	0.3684	0.5572	0.7464
No log	2.3860	136	0.6471	0.3153	0.6471	0.8044
No log	2.4211	138	0.6230	0.3394	0.6230	0.7893
No log	2.4561	140	0.5065	0.4346	0.5065	0.7117
No log	2.4912	142	0.4941	0.4583	0.4941	0.7029
No log	2.5263	144	0.6261	0.3433	0.6261	0.7913
No log	2.5614	146	1.0890	0.1399	1.0890	1.0435
No log	2.5965	148	1.1321	0.1409	1.1321	1.0640
No log	2.6316	150	0.8787	0.2569	0.8787	0.9374
No log	2.6667	152	0.5490	0.3641	0.5490	0.7409
No log	2.7018	154	0.5523	0.36	0.5523	0.7432
No log	2.7368	156	0.6210	0.3761	0.6210	0.7880
No log	2.7719	158	0.4965	0.3258	0.4965	0.7046
No log	2.8070	160	0.6574	0.2360	0.6574	0.8108
No log	2.8421	162	1.3402	0.1226	1.3402	1.1577
No log	2.8772	164	1.4351	0.0769	1.4351	1.1980
No log	2.9123	166	0.9684	0.1613	0.9684	0.9841
No log	2.9474	168	0.5110	0.3258	0.5110	0.7148
No log	2.9825	170	0.5830	0.4502	0.5830	0.7635
No log	3.0175	172	0.7047	0.3188	0.7047	0.8394
No log	3.0526	174	0.4846	0.4286	0.4846	0.6961
No log	3.0877	176	0.6942	0.3365	0.6942	0.8332
No log	3.1228	178	0.8377	0.1613	0.8377	0.9152
No log	3.1579	180	0.7091	0.2919	0.7091	0.8421
No log	3.1930	182	0.5544	0.4035	0.5544	0.7446
No log	3.2281	184	0.6659	0.4335	0.6659	0.8160
No log	3.2632	186	0.5636	0.4182	0.5636	0.7507
No log	3.2982	188	0.6563	0.3744	0.6563	0.8101
No log	3.3333	190	1.1477	0.1941	1.1477	1.0713
No log	3.3684	192	1.3238	0.1945	1.3238	1.1506
No log	3.4035	194	0.9555	0.1597	0.9555	0.9775
No log	3.4386	196	0.6745	0.3237	0.6745	0.8213
No log	3.4737	198	0.6552	0.4178	0.6552	0.8094
No log	3.5088	200	0.7203	0.3488	0.7203	0.8487
No log	3.5439	202	0.7919	0.2222	0.7919	0.8899
No log	3.5789	204	0.9334	0.2593	0.9334	0.9661
No log	3.6140	206	1.1664	0.1661	1.1664	1.0800
No log	3.6491	208	1.0585	0.1642	1.0585	1.0288
No log	3.6842	210	1.0713	0.1661	1.0713	1.0350
No log	3.7193	212	0.9721	0.1940	0.9721	0.9859
No log	3.7544	214	0.9495	0.2243	0.9495	0.9744
No log	3.7895	216	0.8076	0.2960	0.8076	0.8987
No log	3.8246	218	0.8507	0.2188	0.8507	0.9224
No log	3.8596	220	0.8077	0.2787	0.8077	0.8987
No log	3.8947	222	1.1071	0.1661	1.1071	1.0522
No log	3.9298	224	1.3317	0.0909	1.3317	1.1540
No log	3.9649	226	1.3745	0.0927	1.3745	1.1724
No log	4.0	228	1.0897	0.1942	1.0897	1.0439
No log	4.0351	230	0.6588	0.3951	0.6588	0.8117
No log	4.0702	232	0.5501	0.4545	0.5501	0.7417
No log	4.1053	234	0.6257	0.4231	0.6257	0.7910
No log	4.1404	236	0.8631	0.1613	0.8631	0.9290
No log	4.1754	238	1.1530	0.1141	1.1530	1.0738
No log	4.2105	240	1.0740	0.1655	1.0740	1.0364
No log	4.2456	242	0.8092	0.2961	0.8092	0.8995
No log	4.2807	244	0.7096	0.3704	0.7096	0.8424
No log	4.3158	246	0.9459	0.1648	0.9459	0.9726
No log	4.3509	248	1.2334	0.1155	1.2334	1.1106
No log	4.3860	250	1.1178	0.1141	1.1178	1.0573
No log	4.4211	252	0.7350	0.3628	0.7350	0.8573
No log	4.4561	254	0.4986	0.4105	0.4986	0.7061
No log	4.4912	256	0.4901	0.3990	0.4901	0.7000
No log	4.5263	258	0.5424	0.4694	0.5424	0.7365
No log	4.5614	260	0.7492	0.3973	0.7492	0.8655
No log	4.5965	262	0.9987	0.1278	0.9987	0.9994
No log	4.6316	264	0.9094	0.1803	0.9094	0.9536
No log	4.6667	266	0.7245	0.4133	0.7245	0.8512
No log	4.7018	268	0.6157	0.3831	0.6157	0.7847
No log	4.7368	270	0.5936	0.3878	0.5936	0.7704
No log	4.7719	272	0.6640	0.3786	0.6640	0.8149
No log	4.8070	274	0.9210	0.1873	0.9210	0.9597
No log	4.8421	276	1.0501	0.0791	1.0501	1.0248
No log	4.8772	278	0.8556	0.2469	0.8556	0.9250
No log	4.9123	280	0.6122	0.3878	0.6122	0.7824
No log	4.9474	282	0.5569	0.3333	0.5569	0.7462
No log	4.9825	284	0.5430	0.3407	0.5430	0.7369
No log	5.0175	286	0.5709	0.3663	0.5709	0.7556
No log	5.0526	288	0.7397	0.25	0.7397	0.8601
No log	5.0877	290	0.9690	0.1318	0.9690	0.9844
No log	5.1228	292	0.9458	0.1818	0.9458	0.9725
No log	5.1579	294	0.6931	0.3418	0.6931	0.8325
No log	5.1930	296	0.6438	0.3833	0.6438	0.8024
No log	5.2281	298	0.7643	0.3386	0.7643	0.8743
No log	5.2632	300	1.0569	0.1355	1.0569	1.0281
No log	5.2982	302	1.1402	0.1378	1.1402	1.0678
No log	5.3333	304	0.9279	0.1937	0.9279	0.9633
No log	5.3684	306	0.7594	0.2821	0.7594	0.8714
No log	5.4035	308	0.7902	0.2554	0.7902	0.8889
No log	5.4386	310	0.6560	0.28	0.6560	0.8099
No log	5.4737	312	0.5948	0.3878	0.5948	0.7712
No log	5.5088	314	0.6413	0.3131	0.6413	0.8008
No log	5.5439	316	0.8127	0.2632	0.8127	0.9015
No log	5.5789	318	1.0040	0.1661	1.0040	1.0020
No log	5.6140	320	1.0558	0.1389	1.0558	1.0275
No log	5.6491	322	0.9587	0.1886	0.9587	0.9791
No log	5.6842	324	0.7180	0.3874	0.7180	0.8473
No log	5.7193	326	0.6287	0.3982	0.6287	0.7929
No log	5.7544	328	0.6558	0.3818	0.6558	0.8098
No log	5.7895	330	0.7509	0.3628	0.7509	0.8665
No log	5.8246	332	0.7644	0.3628	0.7644	0.8743
No log	5.8596	334	0.6386	0.3818	0.6386	0.7991
No log	5.8947	336	0.5690	0.3892	0.5690	0.7543
No log	5.9298	338	0.6401	0.3917	0.6401	0.8001
No log	5.9649	340	0.7033	0.3886	0.7033	0.8386
No log	6.0	342	0.7379	0.3628	0.7379	0.8590
No log	6.0351	344	0.6776	0.3818	0.6776	0.8232
No log	6.0702	346	0.5650	0.4563	0.5650	0.7517
No log	6.1053	348	0.5593	0.4563	0.5593	0.7479
No log	6.1404	350	0.5672	0.4563	0.5672	0.7531
No log	6.1754	352	0.5777	0.4502	0.5777	0.7600
No log	6.2105	354	0.6366	0.4233	0.6366	0.7978
No log	6.2456	356	0.6524	0.4233	0.6524	0.8077
No log	6.2807	358	0.7887	0.3571	0.7887	0.8881
No log	6.3158	360	0.9525	0.1642	0.9525	0.9760
No log	6.3509	362	1.0073	0.1648	1.0073	1.0037
No log	6.3860	364	0.8476	0.3247	0.8476	0.9207
No log	6.4211	366	0.6232	0.4703	0.6232	0.7894
No log	6.4561	368	0.5550	0.3769	0.5550	0.7450
No log	6.4912	370	0.5694	0.4118	0.5694	0.7546
No log	6.5263	372	0.7004	0.3874	0.7004	0.8369
No log	6.5614	374	0.7785	0.3214	0.7785	0.8823
No log	6.5965	376	0.7925	0.3537	0.7925	0.8902
No log	6.6316	378	0.7264	0.3607	0.7264	0.8523
No log	6.6667	380	0.6284	0.3962	0.6284	0.7927
No log	6.7018	382	0.6033	0.3663	0.6033	0.7767
No log	6.7368	384	0.5765	0.4563	0.5765	0.7592
No log	6.7719	386	0.6018	0.4010	0.6018	0.7758
No log	6.8070	388	0.6371	0.4118	0.6371	0.7982
No log	6.8421	390	0.7322	0.3571	0.7322	0.8557
No log	6.8772	392	0.7674	0.3504	0.7674	0.8760
No log	6.9123	394	0.8256	0.2771	0.8256	0.9086
No log	6.9474	396	0.8213	0.2771	0.8213	0.9062
No log	6.9825	398	0.7419	0.3214	0.7419	0.8613
No log	7.0175	400	0.6181	0.4178	0.6181	0.7862
No log	7.0526	402	0.5774	0.4882	0.5774	0.7599
No log	7.0877	404	0.6127	0.4178	0.6127	0.7828
No log	7.1228	406	0.6829	0.4233	0.6829	0.8264
No log	7.1579	408	0.6590	0.4128	0.6590	0.8118
No log	7.1930	410	0.5621	0.3939	0.5621	0.7498
No log	7.2281	412	0.5165	0.3407	0.5165	0.7187
No log	7.2632	414	0.5154	0.3412	0.5154	0.7179
No log	7.2982	416	0.5199	0.3407	0.5199	0.7211
No log	7.3333	418	0.5527	0.3878	0.5527	0.7434
No log	7.3684	420	0.6312	0.4178	0.6312	0.7945
No log	7.4035	422	0.6933	0.3548	0.6933	0.8326
No log	7.4386	424	0.6885	0.3455	0.6885	0.8298
No log	7.4737	426	0.6185	0.4178	0.6185	0.7864
No log	7.5088	428	0.5695	0.4882	0.5695	0.7546
No log	7.5439	430	0.5888	0.4882	0.5888	0.7673
No log	7.5789	432	0.6786	0.4067	0.6786	0.8238
No log	7.6140	434	0.7432	0.3607	0.7432	0.8621
No log	7.6491	436	0.7585	0.3394	0.7585	0.8709
No log	7.6842	438	0.7746	0.3394	0.7746	0.8801
No log	7.7193	440	0.7023	0.3427	0.7023	0.8380
No log	7.7544	442	0.6486	0.3892	0.6486	0.8054
No log	7.7895	444	0.5832	0.4112	0.5832	0.7637
No log	7.8246	446	0.5902	0.3663	0.5902	0.7682
No log	7.8596	448	0.6096	0.4118	0.6096	0.7808
No log	7.8947	450	0.6169	0.4118	0.6169	0.7854
No log	7.9298	452	0.6145	0.4396	0.6145	0.7839
No log	7.9649	454	0.6860	0.3571	0.6860	0.8283
No log	8.0	456	0.7737	0.3939	0.7737	0.8796
No log	8.0351	458	0.8372	0.2248	0.8372	0.9150
No log	8.0702	460	0.7964	0.2520	0.7964	0.8924
No log	8.1053	462	0.7272	0.3833	0.7272	0.8528
No log	8.1404	464	0.7090	0.3648	0.7090	0.8420
No log	8.1754	466	0.6617	0.4495	0.6617	0.8135
No log	8.2105	468	0.6193	0.4930	0.6193	0.7870
No log	8.2456	470	0.6318	0.4930	0.6318	0.7949
No log	8.2807	472	0.6510	0.4930	0.6510	0.8068
No log	8.3158	474	0.6451	0.4930	0.6451	0.8032
No log	8.3509	476	0.6143	0.4680	0.6143	0.7837
No log	8.3860	478	0.5988	0.4563	0.5988	0.7738
No log	8.4211	480	0.5860	0.4563	0.5860	0.7655
No log	8.4561	482	0.5721	0.4229	0.5721	0.7564
No log	8.4912	484	0.5613	0.3508	0.5613	0.7492
No log	8.5263	486	0.5776	0.4563	0.5776	0.7600
No log	8.5614	488	0.6191	0.4563	0.6191	0.7868
No log	8.5965	490	0.6549	0.4495	0.6549	0.8093
No log	8.6316	492	0.7073	0.3548	0.7073	0.8410
No log	8.6667	494	0.7424	0.3128	0.7424	0.8616
No log	8.7018	496	0.7328	0.3128	0.7328	0.8560
No log	8.7368	498	0.6808	0.3962	0.6808	0.8251
0.4215	8.7719	500	0.6324	0.4074	0.6324	0.7953
0.4215	8.8070	502	0.6063	0.4502	0.6063	0.7786
0.4215	8.8421	504	0.5847	0.4563	0.5847	0.7647
0.4215	8.8772	506	0.5900	0.4563	0.5900	0.7681
0.4215	8.9123	508	0.6037	0.4502	0.6037	0.7770
0.4215	8.9474	510	0.6120	0.4502	0.6120	0.7823
0.4215	8.9825	512	0.6350	0.4128	0.6350	0.7968
0.4215	9.0175	514	0.6843	0.3818	0.6843	0.8272
0.4215	9.0526	516	0.7455	0.3242	0.7455	0.8634
0.4215	9.0877	518	0.7630	0.3242	0.7630	0.8735
0.4215	9.1228	520	0.7498	0.3242	0.7498	0.8659
0.4215	9.1579	522	0.7128	0.3455	0.7128	0.8443
0.4215	9.1930	524	0.6910	0.3455	0.6910	0.8312
0.4215	9.2281	526	0.6718	0.3860	0.6718	0.8196
0.4215	9.2632	528	0.6552	0.4286	0.6552	0.8095
0.4215	9.2982	530	0.6537	0.4286	0.6537	0.8085
0.4215	9.3333	532	0.6545	0.4286	0.6545	0.8090
0.4215	9.3684	534	0.6396	0.4286	0.6396	0.7997
0.4215	9.4035	536	0.6273	0.4815	0.6273	0.7920
0.4215	9.4386	538	0.6309	0.4554	0.6309	0.7943
0.4215	9.4737	540	0.6424	0.4286	0.6424	0.8015
0.4215	9.5088	542	0.6630	0.4286	0.6630	0.8142
0.4215	9.5439	544	0.6770	0.3860	0.6770	0.8228
0.4215	9.5789	546	0.6796	0.3860	0.6796	0.8244
0.4215	9.6140	548	0.6875	0.3455	0.6875	0.8291
0.4215	9.6491	550	0.6902	0.3455	0.6902	0.8308
0.4215	9.6842	552	0.6869	0.3860	0.6869	0.8288
0.4215	9.7193	554	0.6852	0.3860	0.6852	0.8278
0.4215	9.7544	556	0.6865	0.3860	0.6865	0.8286
0.4215	9.7895	558	0.6896	0.3860	0.6896	0.8304
0.4215	9.8246	560	0.6912	0.3455	0.6912	0.8314
0.4215	9.8596	562	0.6883	0.3860	0.6883	0.8296
0.4215	9.8947	564	0.6870	0.3860	0.6870	0.8289
0.4215	9.9298	566	0.6859	0.3860	0.6859	0.8282
0.4215	9.9649	568	0.6860	0.3860	0.6860	0.8282
0.4215	10.0	570	0.6863	0.3860	0.6863	0.8285

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1