ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7813
• Qwk: 0.6475
• Mse: 0.7813
• Rmse: 0.8839

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	6.9770	0.0118	6.9770	2.6414
No log	0.0784	4	4.4350	0.1089	4.4350	2.1059
No log	0.1176	6	3.2002	0.0936	3.2002	1.7889
No log	0.1569	8	2.3740	0.1026	2.3740	1.5408
No log	0.1961	10	2.2877	0.0671	2.2877	1.5125
No log	0.2353	12	3.0710	0.1000	3.0710	1.7524
No log	0.2745	14	3.5049	0.0765	3.5049	1.8722
No log	0.3137	16	3.0755	0.1023	3.0755	1.7537
No log	0.3529	18	1.9697	0.2353	1.9697	1.4035
No log	0.3922	20	1.2895	0.3333	1.2895	1.1355
No log	0.4314	22	1.9512	0.1739	1.9512	1.3968
No log	0.4706	24	2.5154	-0.0172	2.5154	1.5860
No log	0.5098	26	2.4059	0.0000	2.4059	1.5511
No log	0.5490	28	1.6027	0.2727	1.6027	1.2660
No log	0.5882	30	1.1494	0.4071	1.1494	1.0721
No log	0.6275	32	1.6131	0.3704	1.6131	1.2701
No log	0.6667	34	2.0754	0.2361	2.0754	1.4406
No log	0.7059	36	2.2974	0.1622	2.2974	1.5157
No log	0.7451	38	2.0182	0.2222	2.0182	1.4206
No log	0.7843	40	1.6499	0.4211	1.6499	1.2845
No log	0.8235	42	1.4654	0.4567	1.4654	1.2105
No log	0.8627	44	1.3165	0.3761	1.3165	1.1474
No log	0.9020	46	1.2152	0.4	1.2152	1.1024
No log	0.9412	48	1.1721	0.4444	1.1721	1.0826
No log	0.9804	50	1.1822	0.4202	1.1822	1.0873
No log	1.0196	52	1.2116	0.4132	1.2116	1.1007
No log	1.0588	54	1.1702	0.4516	1.1702	1.0818
No log	1.0980	56	1.1119	0.5116	1.1119	1.0544
No log	1.1373	58	0.9791	0.5954	0.9791	0.9895
No log	1.1765	60	1.3041	0.5303	1.3041	1.1420
No log	1.2157	62	1.6718	0.3309	1.6718	1.2930
No log	1.2549	64	1.4963	0.4478	1.4963	1.2232
No log	1.2941	66	1.3056	0.5038	1.3056	1.1426
No log	1.3333	68	1.0467	0.5865	1.0467	1.0231
No log	1.3725	70	1.0211	0.5865	1.0211	1.0105
No log	1.4118	72	1.0262	0.6043	1.0262	1.0130
No log	1.4510	74	0.9849	0.6525	0.9849	0.9924
No log	1.4902	76	0.9961	0.5985	0.9961	0.9980
No log	1.5294	78	0.8618	0.6986	0.8618	0.9283
No log	1.5686	80	0.7884	0.7347	0.7884	0.8879
No log	1.6078	82	0.7542	0.7310	0.7542	0.8685
No log	1.6471	84	0.7073	0.7324	0.7073	0.8410
No log	1.6863	86	0.7149	0.6815	0.7149	0.8455
No log	1.7255	88	0.6957	0.7299	0.6957	0.8341
No log	1.7647	90	0.6759	0.7429	0.6759	0.8221
No log	1.8039	92	0.6457	0.7324	0.6457	0.8036
No log	1.8431	94	0.6330	0.7448	0.6330	0.7956
No log	1.8824	96	0.5949	0.7821	0.5949	0.7713
No log	1.9216	98	0.8811	0.6538	0.8811	0.9387
No log	1.9608	100	1.3076	0.5621	1.3076	1.1435
No log	2.0	102	1.4760	0.5563	1.4760	1.2149
No log	2.0392	104	1.2154	0.5828	1.2154	1.1025
No log	2.0784	106	1.1061	0.5921	1.1061	1.0517
No log	2.1176	108	1.2399	0.5867	1.2399	1.1135
No log	2.1569	110	1.5312	0.4384	1.5312	1.2374
No log	2.1961	112	1.3022	0.5526	1.3022	1.1411
No log	2.2353	114	0.8724	0.6800	0.8724	0.9340
No log	2.2745	116	0.6259	0.7310	0.6259	0.7911
No log	2.3137	118	0.5566	0.8205	0.5566	0.7461
No log	2.3529	120	0.5449	0.8052	0.5449	0.7382
No log	2.3922	122	0.5400	0.8153	0.5400	0.7348
No log	2.4314	124	0.4994	0.8428	0.4994	0.7067
No log	2.4706	126	0.5513	0.8228	0.5513	0.7425
No log	2.5098	128	0.5974	0.8354	0.5974	0.7729
No log	2.5490	130	0.6514	0.7712	0.6514	0.8071
No log	2.5882	132	0.8013	0.6803	0.8013	0.8951
No log	2.6275	134	1.1664	0.6027	1.1664	1.0800
No log	2.6667	136	1.3960	0.4397	1.3960	1.1815
No log	2.7059	138	1.2651	0.4857	1.2651	1.1248
No log	2.7451	140	1.0461	0.6176	1.0461	1.0228
No log	2.7843	142	1.0066	0.6269	1.0066	1.0033
No log	2.8235	144	0.9463	0.6667	0.9463	0.9728
No log	2.8627	146	0.8885	0.6713	0.8885	0.9426
No log	2.9020	148	0.8006	0.6950	0.8006	0.8947
No log	2.9412	150	0.7590	0.7	0.7590	0.8712
No log	2.9804	152	0.7703	0.6619	0.7703	0.8776
No log	3.0196	154	0.7381	0.7083	0.7381	0.8591
No log	3.0588	156	0.7287	0.7397	0.7287	0.8536
No log	3.0980	158	0.7115	0.7123	0.7115	0.8435
No log	3.1373	160	0.6772	0.7020	0.6772	0.8229
No log	3.1765	162	0.6462	0.7417	0.6462	0.8039
No log	3.2157	164	0.6420	0.7417	0.6420	0.8012
No log	3.2549	166	0.6453	0.7619	0.6453	0.8033
No log	3.2941	168	0.7158	0.7211	0.7158	0.8460
No log	3.3333	170	0.7124	0.7248	0.7124	0.8440
No log	3.3725	172	0.7232	0.7248	0.7232	0.8504
No log	3.4118	174	0.6937	0.7162	0.6937	0.8329
No log	3.4510	176	0.6525	0.7582	0.6525	0.8078
No log	3.4902	178	0.7313	0.7467	0.7313	0.8552
No log	3.5294	180	0.6716	0.7397	0.6716	0.8195
No log	3.5686	182	0.6326	0.7467	0.6326	0.7953
No log	3.6078	184	0.6617	0.7517	0.6617	0.8134
No log	3.6471	186	0.7941	0.6846	0.7941	0.8911
No log	3.6863	188	0.7289	0.7550	0.7289	0.8537
No log	3.7255	190	0.6351	0.7467	0.6351	0.7969
No log	3.7647	192	0.6510	0.7619	0.6510	0.8068
No log	3.8039	194	0.7016	0.7619	0.7016	0.8376
No log	3.8431	196	0.7522	0.7413	0.7522	0.8673
No log	3.8824	198	0.7578	0.7234	0.7578	0.8705
No log	3.9216	200	0.7485	0.7222	0.7485	0.8652
No log	3.9608	202	0.7230	0.7222	0.7230	0.8503
No log	4.0	204	0.7957	0.7034	0.7957	0.8920
No log	4.0392	206	0.9011	0.6483	0.9011	0.9493
No log	4.0784	208	0.9039	0.6483	0.9039	0.9507
No log	4.1176	210	0.9119	0.6389	0.9119	0.9550
No log	4.1569	212	0.8948	0.6479	0.8948	0.9459
No log	4.1961	214	0.8138	0.7034	0.8138	0.9021
No log	4.2353	216	0.7687	0.6901	0.7687	0.8768
No log	4.2745	218	0.7604	0.6809	0.7604	0.8720
No log	4.3137	220	0.7515	0.6714	0.7515	0.8669
No log	4.3529	222	0.7303	0.6809	0.7303	0.8546
No log	4.3922	224	0.6681	0.7606	0.6681	0.8174
No log	4.4314	226	0.6379	0.7639	0.6379	0.7987
No log	4.4706	228	0.6248	0.7483	0.6248	0.7904
No log	4.5098	230	0.6500	0.7517	0.6500	0.8062
No log	4.5490	232	0.6156	0.7682	0.6156	0.7846
No log	4.5882	234	0.5675	0.7871	0.5675	0.7533
No log	4.6275	236	0.6234	0.7483	0.6234	0.7895
No log	4.6667	238	0.7086	0.7310	0.7086	0.8418
No log	4.7059	240	0.7509	0.6861	0.7509	0.8666
No log	4.7451	242	0.7465	0.6815	0.7465	0.8640
No log	4.7843	244	0.7106	0.6765	0.7106	0.8430
No log	4.8235	246	0.6996	0.6861	0.6996	0.8364
No log	4.8627	248	0.6213	0.7397	0.6213	0.7883
No log	4.9020	250	0.5638	0.8	0.5638	0.7509
No log	4.9412	252	0.6275	0.7719	0.6275	0.7921
No log	4.9804	254	0.6992	0.7614	0.6992	0.8362
No log	5.0196	256	0.7162	0.7273	0.7162	0.8463
No log	5.0588	258	0.7187	0.7183	0.7187	0.8478
No log	5.0980	260	0.7180	0.7092	0.7180	0.8473
No log	5.1373	262	0.7009	0.7092	0.7009	0.8372
No log	5.1765	264	0.6261	0.7778	0.6261	0.7913
No log	5.2157	266	0.5934	0.7724	0.5934	0.7703
No log	5.2549	268	0.6997	0.7133	0.6997	0.8365
No log	5.2941	270	0.7417	0.6757	0.7417	0.8612
No log	5.3333	272	0.6918	0.7190	0.6918	0.8318
No log	5.3725	274	0.7720	0.7356	0.7720	0.8786
No log	5.4118	276	0.9372	0.7059	0.9372	0.9681
No log	5.4510	278	0.7871	0.7030	0.7871	0.8872
No log	5.4902	280	0.5927	0.7568	0.5927	0.7699
No log	5.5294	282	0.5916	0.7838	0.5916	0.7692
No log	5.5686	284	0.6658	0.7092	0.6658	0.8160
No log	5.6078	286	0.6745	0.7413	0.6745	0.8213
No log	5.6471	288	0.6350	0.7838	0.6350	0.7969
No log	5.6863	290	0.6298	0.7347	0.6298	0.7936
No log	5.7255	292	0.6255	0.7347	0.6255	0.7909
No log	5.7647	294	0.6649	0.7260	0.6649	0.8154
No log	5.8039	296	0.6850	0.7417	0.6850	0.8277
No log	5.8431	298	0.7007	0.7172	0.7007	0.8370
No log	5.8824	300	0.7054	0.7222	0.7054	0.8399
No log	5.9216	302	0.6602	0.7467	0.6602	0.8125
No log	5.9608	304	0.6040	0.7898	0.6040	0.7772
No log	6.0	306	0.5910	0.7613	0.5910	0.7688
No log	6.0392	308	0.5870	0.7532	0.5870	0.7662
No log	6.0784	310	0.5714	0.7467	0.5714	0.7559
No log	6.1176	312	0.5675	0.7260	0.5675	0.7533
No log	6.1569	314	0.5490	0.7260	0.5490	0.7409
No log	6.1961	316	0.4980	0.8052	0.4980	0.7057
No log	6.2353	318	0.5030	0.8408	0.5030	0.7092
No log	6.2745	320	0.4637	0.85	0.4637	0.6810
No log	6.3137	322	0.4744	0.8272	0.4744	0.6888
No log	6.3529	324	0.6574	0.7545	0.6574	0.8108
No log	6.3922	326	0.7436	0.7152	0.7436	0.8623
No log	6.4314	328	0.6982	0.6757	0.6982	0.8356
No log	6.4706	330	0.6161	0.7397	0.6161	0.7849
No log	6.5098	332	0.6597	0.7083	0.6597	0.8122
No log	6.5490	334	0.7584	0.6957	0.7584	0.8708
No log	6.5882	336	0.6888	0.7630	0.6888	0.8300
No log	6.6275	338	0.5667	0.7821	0.5667	0.7528
No log	6.6667	340	0.4814	0.8158	0.4814	0.6938
No log	6.7059	342	0.5005	0.8375	0.5005	0.7075
No log	6.7451	344	0.4881	0.8323	0.4881	0.6987
No log	6.7843	346	0.4988	0.8242	0.4988	0.7063
No log	6.8235	348	0.6803	0.7647	0.6803	0.8248
No log	6.8627	350	0.7247	0.7574	0.7247	0.8513
No log	6.9020	352	0.5844	0.7875	0.5844	0.7645
No log	6.9412	354	0.5011	0.8101	0.5011	0.7079
No log	6.9804	356	0.6218	0.8052	0.6218	0.7885
No log	7.0196	358	0.6275	0.7763	0.6275	0.7922
No log	7.0588	360	0.5633	0.8079	0.5633	0.7505
No log	7.0980	362	0.6168	0.7568	0.6168	0.7853
No log	7.1373	364	0.6194	0.7310	0.6194	0.7870
No log	7.1765	366	0.5521	0.8079	0.5521	0.7431
No log	7.2157	368	0.5123	0.8289	0.5123	0.7157
No log	7.2549	370	0.4972	0.8182	0.4972	0.7051
No log	7.2941	372	0.5560	0.7929	0.5560	0.7457
No log	7.3333	374	0.6904	0.7684	0.6904	0.8309
No log	7.3725	376	0.9012	0.6772	0.9012	0.9493
No log	7.4118	378	0.9543	0.6353	0.9543	0.9769
No log	7.4510	380	0.9116	0.6351	0.9116	0.9548
No log	7.4902	382	0.7885	0.7123	0.7885	0.8880
No log	7.5294	384	0.6295	0.7785	0.6295	0.7934
No log	7.5686	386	0.5348	0.8312	0.5348	0.7313
No log	7.6078	388	0.4976	0.8182	0.4976	0.7054
No log	7.6471	390	0.5199	0.8079	0.5199	0.7211
No log	7.6863	392	0.5672	0.7763	0.5672	0.7532
No log	7.7255	394	0.5452	0.8129	0.5452	0.7384
No log	7.7647	396	0.4505	0.8289	0.4505	0.6712
No log	7.8039	398	0.4540	0.8153	0.4540	0.6738
No log	7.8431	400	0.5477	0.8077	0.5477	0.7400
No log	7.8824	402	0.5595	0.8077	0.5595	0.7480
No log	7.9216	404	0.4810	0.8101	0.4810	0.6935
No log	7.9608	406	0.4521	0.8027	0.4521	0.6724
No log	8.0	408	0.4423	0.8108	0.4423	0.6650
No log	8.0392	410	0.4544	0.8108	0.4544	0.6741
No log	8.0784	412	0.4321	0.8228	0.4321	0.6574
No log	8.1176	414	0.4415	0.8228	0.4415	0.6644
No log	8.1569	416	0.4451	0.8228	0.4451	0.6671
No log	8.1961	418	0.4276	0.8333	0.4276	0.6539
No log	8.2353	420	0.4297	0.8383	0.4297	0.6555
No log	8.2745	422	0.4236	0.8523	0.4236	0.6508
No log	8.3137	424	0.3711	0.8639	0.3711	0.6092
No log	8.3529	426	0.4134	0.8447	0.4134	0.6429
No log	8.3922	428	0.4517	0.8395	0.4517	0.6721
No log	8.4314	430	0.3943	0.8176	0.3943	0.6279
No log	8.4706	432	0.4375	0.8163	0.4375	0.6614
No log	8.5098	434	0.5979	0.7391	0.5979	0.7732
No log	8.5490	436	0.6526	0.7059	0.6526	0.8078
No log	8.5882	438	0.5989	0.7353	0.5989	0.7739
No log	8.6275	440	0.5214	0.7556	0.5214	0.7221
No log	8.6667	442	0.4605	0.8054	0.4605	0.6786
No log	8.7059	444	0.4418	0.8158	0.4418	0.6647
No log	8.7451	446	0.4338	0.8354	0.4338	0.6587
No log	8.7843	448	0.4489	0.8182	0.4489	0.6700
No log	8.8235	450	0.4507	0.8302	0.4507	0.6713
No log	8.8627	452	0.4711	0.8129	0.4711	0.6864
No log	8.9020	454	0.5308	0.7947	0.5308	0.7286
No log	8.9412	456	0.5506	0.7919	0.5506	0.7420
No log	8.9804	458	0.5620	0.7660	0.5620	0.7497
No log	9.0196	460	0.6483	0.7042	0.6483	0.8052
No log	9.0588	462	0.6705	0.6713	0.6705	0.8188
No log	9.0980	464	0.6213	0.7586	0.6213	0.7883
No log	9.1373	466	0.5552	0.7947	0.5552	0.7451
No log	9.1765	468	0.5318	0.8105	0.5318	0.7292
No log	9.2157	470	0.5471	0.7974	0.5471	0.7397
No log	9.2549	472	0.5302	0.8077	0.5302	0.7281
No log	9.2941	474	0.4898	0.8408	0.4898	0.6999
No log	9.3333	476	0.4832	0.825	0.4832	0.6951
No log	9.3725	478	0.5064	0.8	0.5064	0.7116
No log	9.4118	480	0.4463	0.8323	0.4463	0.6681
No log	9.4510	482	0.4410	0.8605	0.4410	0.6641
No log	9.4902	484	0.5014	0.8557	0.5014	0.7081
No log	9.5294	486	0.5483	0.8211	0.5483	0.7405
No log	9.5686	488	0.6041	0.7590	0.6041	0.7773
No log	9.6078	490	0.6585	0.7285	0.6585	0.8115
No log	9.6471	492	0.6337	0.7465	0.6337	0.7961
No log	9.6863	494	0.6113	0.7692	0.6113	0.7819
No log	9.7255	496	0.5837	0.8027	0.5837	0.7640
No log	9.7647	498	0.5542	0.8026	0.5542	0.7445
0.3944	9.8039	500	0.5239	0.8182	0.5239	0.7238
0.3944	9.8431	502	0.5186	0.8258	0.5186	0.7201
0.3944	9.8824	504	0.5628	0.7843	0.5628	0.7502
0.3944	9.9216	506	0.5645	0.8025	0.5645	0.7513
0.3944	9.9608	508	0.5076	0.8354	0.5076	0.7125
0.3944	10.0	510	0.4977	0.8228	0.4977	0.7055
0.3944	10.0392	512	0.5281	0.8025	0.5281	0.7267
0.3944	10.0784	514	0.5249	0.8228	0.5249	0.7245
0.3944	10.1176	516	0.5301	0.8333	0.5301	0.7281
0.3944	10.1569	518	0.5740	0.7397	0.5740	0.7576
0.3944	10.1961	520	0.6291	0.7397	0.6291	0.7932
0.3944	10.2353	522	0.6500	0.7273	0.6500	0.8062
0.3944	10.2745	524	0.6871	0.7376	0.6871	0.8289
0.3944	10.3137	526	0.7813	0.6475	0.7813	0.8839

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1