ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8918
• Qwk: 0.3777
• Mse: 0.8918
• Rmse: 0.9444

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	4.7022	0.0010	4.7022	2.1685
No log	0.1053	4	3.1002	-0.0191	3.1002	1.7607
No log	0.1579	6	2.4807	-0.0614	2.4807	1.5750
No log	0.2105	8	1.8480	-0.0364	1.8480	1.3594
No log	0.2632	10	1.2560	0.1080	1.2560	1.1207
No log	0.3158	12	1.2535	0.0714	1.2535	1.1196
No log	0.3684	14	1.3432	0.0210	1.3432	1.1590
No log	0.4211	16	1.2302	0.1638	1.2302	1.1091
No log	0.4737	18	1.3626	0.0561	1.3626	1.1673
No log	0.5263	20	1.2569	0.0952	1.2569	1.1211
No log	0.5789	22	1.1787	0.2053	1.1787	1.0857
No log	0.6316	24	1.1781	0.0914	1.1781	1.0854
No log	0.6842	26	1.2206	0.0952	1.2206	1.1048
No log	0.7368	28	1.3662	0.0688	1.3662	1.1688
No log	0.7895	30	1.4241	0.0750	1.4241	1.1934
No log	0.8421	32	1.2377	0.1320	1.2377	1.1125
No log	0.8947	34	1.1744	0.1830	1.1744	1.0837
No log	0.9474	36	1.1351	0.1335	1.1351	1.0654
No log	1.0	38	1.1803	0.1417	1.1803	1.0864
No log	1.0526	40	1.2175	0.1952	1.2175	1.1034
No log	1.1053	42	1.0943	0.2440	1.0943	1.0461
No log	1.1579	44	1.1053	0.2454	1.1053	1.0514
No log	1.2105	46	1.1117	0.2555	1.1117	1.0543
No log	1.2632	48	1.0601	0.2893	1.0601	1.0296
No log	1.3158	50	1.0479	0.2300	1.0479	1.0237
No log	1.3684	52	1.0577	0.2199	1.0577	1.0284
No log	1.4211	54	1.0828	0.2401	1.0828	1.0406
No log	1.4737	56	1.1318	0.2016	1.1318	1.0638
No log	1.5263	58	1.1646	0.2358	1.1646	1.0792
No log	1.5789	60	1.1776	0.2199	1.1776	1.0852
No log	1.6316	62	1.2283	0.2592	1.2283	1.1083
No log	1.6842	64	1.2266	0.3493	1.2266	1.1075
No log	1.7368	66	1.2049	0.2764	1.2049	1.0977
No log	1.7895	68	1.1107	0.3379	1.1107	1.0539
No log	1.8421	70	1.2927	0.3200	1.2927	1.1370
No log	1.8947	72	1.5014	0.1300	1.5014	1.2253
No log	1.9474	74	1.3504	0.3041	1.3504	1.1621
No log	2.0	76	1.0446	0.3950	1.0446	1.0221
No log	2.0526	78	0.9352	0.4449	0.9352	0.9670
No log	2.1053	80	0.8954	0.4385	0.8954	0.9463
No log	2.1579	82	0.8800	0.4346	0.8800	0.9381
No log	2.2105	84	0.9006	0.4440	0.9006	0.9490
No log	2.2632	86	1.0656	0.5334	1.0656	1.0323
No log	2.3158	88	1.0020	0.4874	1.0020	1.0010
No log	2.3684	90	0.8813	0.5214	0.8813	0.9388
No log	2.4211	92	1.1200	0.4954	1.1200	1.0583
No log	2.4737	94	1.0323	0.4856	1.0323	1.0160
No log	2.5263	96	0.8677	0.5218	0.8677	0.9315
No log	2.5789	98	1.2274	0.4732	1.2274	1.1079
No log	2.6316	100	1.1978	0.4916	1.1978	1.0944
No log	2.6842	102	0.8886	0.5192	0.8886	0.9426
No log	2.7368	104	0.8017	0.5606	0.8017	0.8954
No log	2.7895	106	0.8004	0.5606	0.8004	0.8946
No log	2.8421	108	0.8253	0.5338	0.8253	0.9085
No log	2.8947	110	0.8705	0.5365	0.8705	0.9330
No log	2.9474	112	0.8306	0.5825	0.8306	0.9113
No log	3.0	114	0.9472	0.3847	0.9472	0.9732
No log	3.0526	116	1.1705	0.4524	1.1705	1.0819
No log	3.1053	118	1.2293	0.4404	1.2293	1.1087
No log	3.1579	120	1.0028	0.3738	1.0028	1.0014
No log	3.2105	122	0.9056	0.5673	0.9056	0.9516
No log	3.2632	124	0.9510	0.4236	0.9510	0.9752
No log	3.3158	126	0.9164	0.4241	0.9164	0.9573
No log	3.3684	128	0.9477	0.3966	0.9477	0.9735
No log	3.4211	130	0.9170	0.3861	0.9170	0.9576
No log	3.4737	132	0.8888	0.3896	0.8888	0.9427
No log	3.5263	134	0.9039	0.4002	0.9039	0.9507
No log	3.5789	136	0.9143	0.4465	0.9143	0.9562
No log	3.6316	138	0.9857	0.4412	0.9857	0.9928
No log	3.6842	140	1.3391	0.3481	1.3391	1.1572
No log	3.7368	142	1.5403	0.3239	1.5403	1.2411
No log	3.7895	144	1.2513	0.4186	1.2513	1.1186
No log	3.8421	146	0.9053	0.4846	0.9053	0.9515
No log	3.8947	148	0.9185	0.4042	0.9185	0.9584
No log	3.9474	150	0.9040	0.4175	0.9040	0.9508
No log	4.0	152	0.8842	0.4006	0.8842	0.9403
No log	4.0526	154	1.0290	0.3971	1.0290	1.0144
No log	4.1053	156	1.0742	0.3734	1.0742	1.0364
No log	4.1579	158	1.0337	0.4063	1.0337	1.0167
No log	4.2105	160	0.9046	0.4261	0.9046	0.9511
No log	4.2632	162	0.8267	0.4792	0.8267	0.9092
No log	4.3158	164	0.9923	0.4677	0.9923	0.9962
No log	4.3684	166	1.0645	0.4182	1.0645	1.0318
No log	4.4211	168	0.8753	0.5629	0.8753	0.9356
No log	4.4737	170	0.8896	0.5024	0.8896	0.9432
No log	4.5263	172	0.9474	0.5461	0.9474	0.9734
No log	4.5789	174	0.8628	0.5050	0.8628	0.9289
No log	4.6316	176	0.8359	0.5263	0.8359	0.9143
No log	4.6842	178	1.1063	0.4257	1.1063	1.0518
No log	4.7368	180	1.2774	0.3441	1.2774	1.1302
No log	4.7895	182	1.0840	0.4022	1.0840	1.0412
No log	4.8421	184	0.8597	0.4270	0.8597	0.9272
No log	4.8947	186	0.8727	0.4280	0.8727	0.9342
No log	4.9474	188	0.9550	0.4163	0.9550	0.9773
No log	5.0	190	0.9268	0.3401	0.9268	0.9627
No log	5.0526	192	0.8870	0.4016	0.8870	0.9418
No log	5.1053	194	0.9590	0.4700	0.9590	0.9793
No log	5.1579	196	0.9387	0.3947	0.9387	0.9689
No log	5.2105	198	0.9147	0.4460	0.9147	0.9564
No log	5.2632	200	0.8771	0.4079	0.8771	0.9366
No log	5.3158	202	0.9630	0.4165	0.9630	0.9813
No log	5.3684	204	0.9944	0.4681	0.9944	0.9972
No log	5.4211	206	0.8797	0.3966	0.8797	0.9379
No log	5.4737	208	0.8153	0.4324	0.8153	0.9029
No log	5.5263	210	0.8349	0.4324	0.8349	0.9137
No log	5.5789	212	0.8756	0.3020	0.8756	0.9358
No log	5.6316	214	0.9342	0.3976	0.9342	0.9666
No log	5.6842	216	1.0688	0.3001	1.0688	1.0338
No log	5.7368	218	1.0753	0.3857	1.0753	1.0370
No log	5.7895	220	0.9381	0.4257	0.9381	0.9686
No log	5.8421	222	0.8322	0.5580	0.8322	0.9123
No log	5.8947	224	0.8510	0.5263	0.8510	0.9225
No log	5.9474	226	0.8335	0.5821	0.8335	0.9130
No log	6.0	228	0.8648	0.4889	0.8648	0.9300
No log	6.0526	230	1.0732	0.4561	1.0732	1.0360
No log	6.1053	232	1.1082	0.4453	1.1082	1.0527
No log	6.1579	234	0.9866	0.3876	0.9866	0.9933
No log	6.2105	236	0.8579	0.3812	0.8579	0.9263
No log	6.2632	238	0.8283	0.4760	0.8283	0.9101
No log	6.3158	240	0.8286	0.5257	0.8286	0.9103
No log	6.3684	242	0.8022	0.4691	0.8022	0.8957
No log	6.4211	244	0.8085	0.4637	0.8085	0.8991
No log	6.4737	246	0.8345	0.4840	0.8345	0.9135
No log	6.5263	248	0.9536	0.4886	0.9536	0.9765
No log	6.5789	250	0.9512	0.3913	0.9512	0.9753
No log	6.6316	252	0.9069	0.3941	0.9069	0.9523
No log	6.6842	254	0.8466	0.4181	0.8466	0.9201
No log	6.7368	256	0.8568	0.3596	0.8568	0.9256
No log	6.7895	258	0.8551	0.3896	0.8551	0.9247
No log	6.8421	260	0.8696	0.3700	0.8696	0.9325
No log	6.8947	262	0.9769	0.3686	0.9769	0.9884
No log	6.9474	264	1.0676	0.4426	1.0676	1.0333
No log	7.0	266	1.0567	0.4339	1.0567	1.0279
No log	7.0526	268	0.9340	0.3854	0.9340	0.9665
No log	7.1053	270	0.9116	0.3834	0.9116	0.9548
No log	7.1579	272	0.9447	0.4165	0.9447	0.9720
No log	7.2105	274	1.0609	0.4580	1.0609	1.0300
No log	7.2632	276	1.1719	0.4234	1.1719	1.0825
No log	7.3158	278	1.1138	0.3839	1.1138	1.0554
No log	7.3684	280	1.0733	0.4349	1.0733	1.0360
No log	7.4211	282	0.9329	0.4089	0.9329	0.9659
No log	7.4737	284	0.8774	0.3645	0.8774	0.9367
No log	7.5263	286	0.8803	0.3891	0.8803	0.9382
No log	7.5789	288	0.9838	0.4089	0.9838	0.9919
No log	7.6316	290	1.0408	0.3824	1.0408	1.0202
No log	7.6842	292	1.0373	0.4280	1.0373	1.0185
No log	7.7368	294	1.0228	0.4223	1.0228	1.0114
No log	7.7895	296	0.9333	0.3744	0.9333	0.9661
No log	7.8421	298	0.8613	0.3926	0.8613	0.9281
No log	7.8947	300	0.8824	0.4361	0.8824	0.9394
No log	7.9474	302	0.8727	0.3572	0.8727	0.9342
No log	8.0	304	0.8138	0.4470	0.8138	0.9021
No log	8.0526	306	0.7760	0.4832	0.7760	0.8809
No log	8.1053	308	0.7716	0.5073	0.7716	0.8784
No log	8.1579	310	0.8163	0.5131	0.8163	0.9035
No log	8.2105	312	0.7918	0.5455	0.7918	0.8898
No log	8.2632	314	0.7662	0.5283	0.7662	0.8753
No log	8.3158	316	0.7770	0.5175	0.7770	0.8815
No log	8.3684	318	0.8210	0.4377	0.8210	0.9061
No log	8.4211	320	0.8517	0.3720	0.8517	0.9229
No log	8.4737	322	0.8170	0.3478	0.8170	0.9039
No log	8.5263	324	0.8032	0.4472	0.8032	0.8962
No log	8.5789	326	0.7916	0.4180	0.7916	0.8897
No log	8.6316	328	0.7969	0.3896	0.7969	0.8927
No log	8.6842	330	0.8664	0.5111	0.8664	0.9308
No log	8.7368	332	0.9146	0.4444	0.9146	0.9564
No log	8.7895	334	0.8829	0.4302	0.8829	0.9396
No log	8.8421	336	0.8502	0.3478	0.8502	0.9221
No log	8.8947	338	0.8377	0.3478	0.8377	0.9153
No log	8.9474	340	0.8279	0.3525	0.8279	0.9099
No log	9.0	342	0.8535	0.4706	0.8535	0.9238
No log	9.0526	344	0.8891	0.4706	0.8891	0.9429
No log	9.1053	346	0.8801	0.4511	0.8801	0.9381
No log	9.1579	348	0.8602	0.4180	0.8602	0.9275
No log	9.2105	350	0.9082	0.3335	0.9082	0.9530
No log	9.2632	352	0.9436	0.2791	0.9436	0.9714
No log	9.3158	354	0.9180	0.3335	0.9180	0.9581
No log	9.3684	356	0.8629	0.3478	0.8629	0.9289
No log	9.4211	358	0.8344	0.4180	0.8344	0.9135
No log	9.4737	360	0.8115	0.4579	0.8115	0.9008
No log	9.5263	362	0.8083	0.4817	0.8083	0.8991
No log	9.5789	364	0.8516	0.4242	0.8516	0.9228
No log	9.6316	366	0.9379	0.4484	0.9379	0.9684
No log	9.6842	368	0.9267	0.4720	0.9267	0.9626
No log	9.7368	370	0.8745	0.4102	0.8745	0.9352
No log	9.7895	372	0.8441	0.4242	0.8441	0.9188
No log	9.8421	374	0.8330	0.4385	0.8330	0.9127
No log	9.8947	376	0.8172	0.3921	0.8172	0.9040
No log	9.9474	378	0.8139	0.4769	0.8139	0.9022
No log	10.0	380	0.8648	0.3961	0.8648	0.9300
No log	10.0526	382	0.9781	0.4773	0.9781	0.9890
No log	10.1053	384	1.0154	0.4545	1.0154	1.0077
No log	10.1579	386	0.9898	0.3836	0.9898	0.9949
No log	10.2105	388	0.9316	0.3335	0.9316	0.9652
No log	10.2632	390	0.8737	0.2887	0.8737	0.9347
No log	10.3158	392	0.8245	0.3299	0.8245	0.9080
No log	10.3684	394	0.8100	0.4157	0.8100	0.9000
No log	10.4211	396	0.8185	0.4854	0.8185	0.9047
No log	10.4737	398	0.8147	0.5156	0.8147	0.9026
No log	10.5263	400	0.7514	0.4874	0.7514	0.8668
No log	10.5789	402	0.7563	0.5649	0.7563	0.8697
No log	10.6316	404	0.7786	0.5270	0.7786	0.8824
No log	10.6842	406	0.7553	0.5244	0.7553	0.8691
No log	10.7368	408	0.7549	0.5244	0.7549	0.8689
No log	10.7895	410	0.7451	0.5028	0.7451	0.8632
No log	10.8421	412	0.7552	0.5028	0.7552	0.8690
No log	10.8947	414	0.7892	0.4620	0.7892	0.8884
No log	10.9474	416	0.8215	0.4302	0.8215	0.9063
No log	11.0	418	0.8154	0.4532	0.8154	0.9030
No log	11.0526	420	0.8362	0.4507	0.8362	0.9144
No log	11.1053	422	0.8966	0.4824	0.8966	0.9469
No log	11.1579	424	0.8861	0.4921	0.8861	0.9413
No log	11.2105	426	0.8374	0.4890	0.8374	0.9151
No log	11.2632	428	0.8104	0.4631	0.8104	0.9002
No log	11.3158	430	0.8160	0.4648	0.8160	0.9033
No log	11.3684	432	0.8592	0.5227	0.8592	0.9269
No log	11.4211	434	0.9002	0.4576	0.9002	0.9488
No log	11.4737	436	0.9039	0.4368	0.9039	0.9507
No log	11.5263	438	0.8958	0.4527	0.8958	0.9465
No log	11.5789	440	0.8531	0.4104	0.8531	0.9236
No log	11.6316	442	0.8431	0.4874	0.8431	0.9182
No log	11.6842	444	0.8998	0.4236	0.8998	0.9486
No log	11.7368	446	0.9574	0.3992	0.9574	0.9785
No log	11.7895	448	0.9366	0.3602	0.9366	0.9678
No log	11.8421	450	0.8848	0.4072	0.8848	0.9407
No log	11.8947	452	0.8980	0.3596	0.8980	0.9476
No log	11.9474	454	0.9243	0.3957	0.9243	0.9614
No log	12.0	456	0.8762	0.3854	0.8762	0.9360
No log	12.0526	458	0.8518	0.4608	0.8518	0.9229
No log	12.1053	460	0.9299	0.3402	0.9299	0.9643
No log	12.1579	462	0.9792	0.3560	0.9792	0.9895
No log	12.2105	464	0.9011	0.3291	0.9011	0.9492
No log	12.2632	466	0.8663	0.3994	0.8663	0.9308
No log	12.3158	468	0.9503	0.3677	0.9503	0.9748
No log	12.3684	470	0.9599	0.3677	0.9599	0.9798
No log	12.4211	472	0.8875	0.3070	0.8875	0.9421
No log	12.4737	474	0.8397	0.3779	0.8397	0.9163
No log	12.5263	476	0.8293	0.3779	0.8293	0.9107
No log	12.5789	478	0.8438	0.4242	0.8438	0.9186
No log	12.6316	480	0.8749	0.3966	0.8749	0.9354
No log	12.6842	482	0.8427	0.4102	0.8427	0.9180
No log	12.7368	484	0.8391	0.4102	0.8391	0.9160
No log	12.7895	486	0.8255	0.4102	0.8255	0.9085
No log	12.8421	488	0.8272	0.3744	0.8272	0.9095
No log	12.8947	490	0.8285	0.3744	0.8285	0.9102
No log	12.9474	492	0.8353	0.3744	0.8353	0.9139
No log	13.0	494	0.8384	0.3744	0.8384	0.9156
No log	13.0526	496	0.8275	0.3998	0.8275	0.9097
No log	13.1053	498	0.7852	0.4533	0.7852	0.8861
0.3458	13.1579	500	0.7951	0.5112	0.7951	0.8917
0.3458	13.2105	502	0.8548	0.5737	0.8548	0.9246
0.3458	13.2632	504	0.8413	0.5618	0.8413	0.9172
0.3458	13.3158	506	0.7998	0.4461	0.7998	0.8943
0.3458	13.3684	508	0.8547	0.3970	0.8547	0.9245
0.3458	13.4211	510	0.9364	0.4345	0.9364	0.9677
0.3458	13.4737	512	0.9395	0.4222	0.9395	0.9693
0.3458	13.5263	514	0.8918	0.3777	0.8918	0.9444

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1