ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k15_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9238
• Qwk: 0.4057
• Mse: 0.9238
• Rmse: 0.9611

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.6775	-0.0020	4.6775	2.1628
No log	0.0870	4	2.7905	0.0	2.7905	1.6705
No log	0.1304	6	1.7597	0.0198	1.7597	1.3265
No log	0.1739	8	1.3280	0.1254	1.3280	1.1524
No log	0.2174	10	1.1757	0.2886	1.1757	1.0843
No log	0.2609	12	1.2144	0.1196	1.2144	1.1020
No log	0.3043	14	1.5108	0.0667	1.5108	1.2291
No log	0.3478	16	1.9014	0.1717	1.9014	1.3789
No log	0.3913	18	1.8367	0.1439	1.8367	1.3553
No log	0.4348	20	1.4053	0.1516	1.4053	1.1855
No log	0.4783	22	1.1865	0.1438	1.1865	1.0893
No log	0.5217	24	1.0501	0.3140	1.0501	1.0247
No log	0.5652	26	1.0785	0.2408	1.0785	1.0385
No log	0.6087	28	1.1321	0.2212	1.1321	1.0640
No log	0.6522	30	1.2894	0.1257	1.2894	1.1355
No log	0.6957	32	1.3674	0.1257	1.3674	1.1694
No log	0.7391	34	1.4222	0.1533	1.4222	1.1926
No log	0.7826	36	1.2119	0.2333	1.2119	1.1008
No log	0.8261	38	1.1469	0.2640	1.1469	1.0709
No log	0.8696	40	1.1290	0.3018	1.1290	1.0625
No log	0.9130	42	1.1894	0.1436	1.1894	1.0906
No log	0.9565	44	1.1889	0.1492	1.1889	1.0904
No log	1.0	46	1.1211	0.2964	1.1211	1.0588
No log	1.0435	48	1.0485	0.3379	1.0485	1.0240
No log	1.0870	50	0.9646	0.4505	0.9646	0.9821
No log	1.1304	52	0.9649	0.4617	0.9649	0.9823
No log	1.1739	54	0.9863	0.4119	0.9863	0.9931
No log	1.2174	56	1.0166	0.4102	1.0166	1.0083
No log	1.2609	58	1.0709	0.4781	1.0709	1.0348
No log	1.3043	60	1.0081	0.3378	1.0080	1.0040
No log	1.3478	62	0.9778	0.4649	0.9778	0.9889
No log	1.3913	64	0.9372	0.5290	0.9372	0.9681
No log	1.4348	66	0.8516	0.4523	0.8516	0.9228
No log	1.4783	68	0.8784	0.5572	0.8784	0.9372
No log	1.5217	70	0.9882	0.4974	0.9882	0.9941
No log	1.5652	72	0.8891	0.4461	0.8891	0.9429
No log	1.6087	74	0.9294	0.3767	0.9294	0.9640
No log	1.6522	76	0.9125	0.3881	0.9125	0.9552
No log	1.6957	78	0.9464	0.4399	0.9464	0.9728
No log	1.7391	80	0.9705	0.4177	0.9705	0.9852
No log	1.7826	82	1.0447	0.4134	1.0447	1.0221
No log	1.8261	84	1.1646	0.4471	1.1646	1.0791
No log	1.8696	86	1.0202	0.4103	1.0202	1.0101
No log	1.9130	88	0.9903	0.4586	0.9903	0.9951
No log	1.9565	90	1.0073	0.4267	1.0073	1.0037
No log	2.0	92	1.0349	0.4028	1.0349	1.0173
No log	2.0435	94	1.0444	0.3165	1.0444	1.0220
No log	2.0870	96	0.9910	0.3627	0.9910	0.9955
No log	2.1304	98	1.2253	0.3561	1.2253	1.1069
No log	2.1739	100	1.1461	0.4191	1.1461	1.0705
No log	2.2174	102	1.0342	0.3137	1.0342	1.0170
No log	2.2609	104	1.0505	0.2995	1.0505	1.0250
No log	2.3043	106	1.0933	0.2958	1.0933	1.0456
No log	2.3478	108	1.1148	0.2898	1.1148	1.0559
No log	2.3913	110	1.0408	0.4321	1.0408	1.0202
No log	2.4348	112	1.0658	0.4703	1.0658	1.0324
No log	2.4783	114	1.1256	0.3663	1.1256	1.0610
No log	2.5217	116	1.2002	0.3847	1.2002	1.0955
No log	2.5652	118	1.0658	0.4530	1.0658	1.0324
No log	2.6087	120	1.0814	0.4543	1.0814	1.0399
No log	2.6522	122	1.0163	0.4331	1.0163	1.0081
No log	2.6957	124	1.0043	0.4665	1.0043	1.0022
No log	2.7391	126	1.3588	0.3673	1.3588	1.1657
No log	2.7826	128	1.3746	0.3665	1.3746	1.1724
No log	2.8261	130	1.0568	0.4200	1.0568	1.0280
No log	2.8696	132	1.0092	0.3169	1.0092	1.0046
No log	2.9130	134	1.1988	0.3559	1.1988	1.0949
No log	2.9565	136	1.0825	0.3719	1.0825	1.0404
No log	3.0	138	0.9557	0.2968	0.9557	0.9776
No log	3.0435	140	1.2906	0.3649	1.2906	1.1361
No log	3.0870	142	1.5047	0.3125	1.5047	1.2267
No log	3.1304	144	1.2938	0.3649	1.2938	1.1374
No log	3.1739	146	1.0501	0.3683	1.0501	1.0248
No log	3.2174	148	1.0254	0.3219	1.0254	1.0126
No log	3.2609	150	1.0872	0.3249	1.0872	1.0427
No log	3.3043	152	1.1291	0.2978	1.1291	1.0626
No log	3.3478	154	1.1254	0.2978	1.1254	1.0609
No log	3.3913	156	1.0886	0.3677	1.0886	1.0433
No log	3.4348	158	1.0874	0.3206	1.0874	1.0428
No log	3.4783	160	1.0217	0.3256	1.0217	1.0108
No log	3.5217	162	0.9599	0.3697	0.9599	0.9797
No log	3.5652	164	0.9605	0.3516	0.9605	0.9801
No log	3.6087	166	0.9572	0.3476	0.9572	0.9784
No log	3.6522	168	0.9578	0.4023	0.9578	0.9787
No log	3.6957	170	1.0040	0.3282	1.0040	1.0020
No log	3.7391	172	1.0585	0.3836	1.0585	1.0288
No log	3.7826	174	0.9587	0.4366	0.9587	0.9792
No log	3.8261	176	0.9950	0.4668	0.9950	0.9975
No log	3.8696	178	1.1318	0.4436	1.1318	1.0639
No log	3.9130	180	0.9923	0.4050	0.9923	0.9961
No log	3.9565	182	0.9055	0.3374	0.9055	0.9516
No log	4.0	184	1.0610	0.4010	1.0610	1.0300
No log	4.0435	186	1.0580	0.4010	1.0580	1.0286
No log	4.0870	188	0.9287	0.3583	0.9287	0.9637
No log	4.1304	190	0.9720	0.4198	0.9720	0.9859
No log	4.1739	192	0.9448	0.4157	0.9448	0.9720
No log	4.2174	194	0.9317	0.4006	0.9317	0.9652
No log	4.2609	196	1.0475	0.4337	1.0475	1.0235
No log	4.3043	198	0.9972	0.4325	0.9972	0.9986
No log	4.3478	200	0.9264	0.4583	0.9264	0.9625
No log	4.3913	202	0.9552	0.4454	0.9552	0.9773
No log	4.4348	204	0.9504	0.4377	0.9504	0.9749
No log	4.4783	206	1.0096	0.4091	1.0096	1.0048
No log	4.5217	208	1.1664	0.4093	1.1664	1.0800
No log	4.5652	210	1.2032	0.4441	1.2032	1.0969
No log	4.6087	212	1.0904	0.3997	1.0904	1.0442
No log	4.6522	214	0.9841	0.4124	0.9841	0.9920
No log	4.6957	216	0.9578	0.3733	0.9578	0.9787
No log	4.7391	218	0.9690	0.3497	0.9690	0.9844
No log	4.7826	220	0.9679	0.3497	0.9679	0.9838
No log	4.8261	222	0.9687	0.3497	0.9687	0.9842
No log	4.8696	224	0.9630	0.3497	0.9630	0.9813
No log	4.9130	226	0.9712	0.3821	0.9712	0.9855
No log	4.9565	228	1.0257	0.3218	1.0257	1.0128
No log	5.0	230	0.9825	0.3723	0.9825	0.9912
No log	5.0435	232	0.9420	0.3374	0.9420	0.9706
No log	5.0870	234	0.9281	0.3641	0.9281	0.9634
No log	5.1304	236	0.9240	0.3879	0.9240	0.9613
No log	5.1739	238	0.9175	0.3879	0.9175	0.9579
No log	5.2174	240	0.9152	0.3779	0.9152	0.9567
No log	5.2609	242	0.9172	0.3927	0.9172	0.9577
No log	5.3043	244	0.9530	0.3433	0.9530	0.9762
No log	5.3478	246	1.0204	0.3850	1.0204	1.0102
No log	5.3913	248	1.0606	0.3841	1.0606	1.0298
No log	5.4348	250	0.9711	0.3892	0.9711	0.9855
No log	5.4783	252	0.8628	0.4393	0.8628	0.9289
No log	5.5217	254	0.8663	0.4916	0.8663	0.9308
No log	5.5652	256	0.8655	0.4852	0.8655	0.9303
No log	5.6087	258	0.8829	0.3584	0.8829	0.9396
No log	5.6522	260	0.9113	0.3813	0.9113	0.9546
No log	5.6957	262	0.8995	0.3374	0.8995	0.9484
No log	5.7391	264	0.9459	0.3100	0.9459	0.9726
No log	5.7826	266	1.0148	0.1808	1.0148	1.0074
No log	5.8261	268	1.0192	0.2417	1.0192	1.0096
No log	5.8696	270	0.9475	0.2708	0.9475	0.9734
No log	5.9130	272	0.9040	0.3830	0.9040	0.9508
No log	5.9565	274	0.8915	0.3821	0.8915	0.9442
No log	6.0	276	0.8823	0.3908	0.8823	0.9393
No log	6.0435	278	0.9490	0.4771	0.9490	0.9742
No log	6.0870	280	0.9422	0.4576	0.9422	0.9707
No log	6.1304	282	0.8791	0.4181	0.8791	0.9376
No log	6.1739	284	0.9241	0.3947	0.9241	0.9613
No log	6.2174	286	0.9215	0.3627	0.9215	0.9599
No log	6.2609	288	0.9365	0.3069	0.9365	0.9677
No log	6.3043	290	1.0630	0.4058	1.0630	1.0310
No log	6.3478	292	1.0644	0.3914	1.0644	1.0317
No log	6.3913	294	0.9878	0.2188	0.9878	0.9939
No log	6.4348	296	0.9591	0.2763	0.9591	0.9793
No log	6.4783	298	0.9426	0.3119	0.9426	0.9709
No log	6.5217	300	0.9172	0.3174	0.9172	0.9577
No log	6.5652	302	0.8728	0.3493	0.8728	0.9342
No log	6.6087	304	0.8499	0.4061	0.8499	0.9219
No log	6.6522	306	0.8407	0.3869	0.8407	0.9169
No log	6.6957	308	0.8183	0.4385	0.8183	0.9046
No log	6.7391	310	0.8205	0.5380	0.8205	0.9058
No log	6.7826	312	0.8374	0.5752	0.8374	0.9151
No log	6.8261	314	0.8127	0.5011	0.8127	0.9015
No log	6.8696	316	0.8412	0.4326	0.8412	0.9172
No log	6.9130	318	0.8724	0.3965	0.8724	0.9340
No log	6.9565	320	0.9023	0.3326	0.9023	0.9499
No log	7.0	322	0.9167	0.3298	0.9167	0.9575
No log	7.0435	324	0.9059	0.3196	0.9059	0.9518
No log	7.0870	326	0.9158	0.3564	0.9158	0.9570
No log	7.1304	328	0.9227	0.3169	0.9227	0.9606
No log	7.1739	330	0.9335	0.3169	0.9335	0.9662
No log	7.2174	332	0.9734	0.3389	0.9734	0.9866
No log	7.2609	334	0.9520	0.3122	0.9520	0.9757
No log	7.3043	336	0.9187	0.2893	0.9187	0.9585
No log	7.3478	338	0.8984	0.3840	0.8984	0.9478
No log	7.3913	340	0.8870	0.3169	0.8870	0.9418
No log	7.4348	342	0.8930	0.4261	0.8930	0.9450
No log	7.4783	344	0.8976	0.5124	0.8976	0.9474
No log	7.5217	346	0.8629	0.4164	0.8629	0.9289
No log	7.5652	348	0.8509	0.3933	0.8509	0.9225
No log	7.6087	350	0.8766	0.3596	0.8766	0.9363
No log	7.6522	352	0.8602	0.3913	0.8602	0.9274
No log	7.6957	354	0.8270	0.4884	0.8270	0.9094
No log	7.7391	356	0.9111	0.4894	0.9111	0.9545
No log	7.7826	358	1.1379	0.4647	1.1379	1.0667
No log	7.8261	360	1.1975	0.4360	1.1975	1.0943
No log	7.8696	362	1.1565	0.4815	1.1565	1.0754
No log	7.9130	364	1.0614	0.5083	1.0614	1.0302
No log	7.9565	366	0.9251	0.4553	0.9251	0.9618
No log	8.0	368	0.8415	0.4750	0.8415	0.9173
No log	8.0435	370	0.8408	0.4510	0.8408	0.9170
No log	8.0870	372	0.8391	0.4449	0.8391	0.9160
No log	8.1304	374	0.8412	0.4455	0.8412	0.9172
No log	8.1739	376	0.8906	0.3677	0.8906	0.9437
No log	8.2174	378	0.8980	0.3533	0.8980	0.9476
No log	8.2609	380	0.8716	0.3804	0.8716	0.9336
No log	8.3043	382	0.8529	0.3957	0.8529	0.9235
No log	8.3478	384	0.8308	0.4745	0.8308	0.9115
No log	8.3913	386	0.8256	0.4822	0.8256	0.9086
No log	8.4348	388	0.8372	0.3871	0.8372	0.9150
No log	8.4783	390	0.9085	0.4735	0.9085	0.9531
No log	8.5217	392	0.9352	0.4735	0.9352	0.9670
No log	8.5652	394	0.8693	0.3965	0.8693	0.9324
No log	8.6087	396	0.9096	0.3931	0.9096	0.9537
No log	8.6522	398	1.0036	0.4348	1.0036	1.0018
No log	8.6957	400	1.0068	0.3996	1.0068	1.0034
No log	8.7391	402	0.9580	0.2969	0.9580	0.9788
No log	8.7826	404	0.9596	0.2729	0.9596	0.9796
No log	8.8261	406	0.9959	0.3250	0.9959	0.9979
No log	8.8696	408	0.9922	0.3356	0.9922	0.9961
No log	8.9130	410	0.9895	0.2941	0.9895	0.9948
No log	8.9565	412	1.0892	0.3001	1.0892	1.0437
No log	9.0	414	1.2138	0.3534	1.2138	1.1017
No log	9.0435	416	1.1568	0.3490	1.1568	1.0756
No log	9.0870	418	0.9992	0.4690	0.9992	0.9996
No log	9.1304	420	0.9164	0.3854	0.9164	0.9573
No log	9.1739	422	0.9091	0.4218	0.9091	0.9535
No log	9.2174	424	0.9073	0.4218	0.9073	0.9525
No log	9.2609	426	0.9090	0.4218	0.9090	0.9534
No log	9.3043	428	0.9441	0.3729	0.9441	0.9717
No log	9.3478	430	1.0733	0.3881	1.0733	1.0360
No log	9.3913	432	1.1264	0.3639	1.1264	1.0613
No log	9.4348	434	1.0841	0.3068	1.0841	1.0412
No log	9.4783	436	0.9943	0.3547	0.9943	0.9972
No log	9.5217	438	0.9413	0.3729	0.9413	0.9702
No log	9.5652	440	0.9113	0.4316	0.9113	0.9546
No log	9.6087	442	0.9086	0.4316	0.9086	0.9532
No log	9.6522	444	0.9219	0.4104	0.9219	0.9602
No log	9.6957	446	0.9605	0.3834	0.9605	0.9800
No log	9.7391	448	0.9708	0.4069	0.9708	0.9853
No log	9.7826	450	0.9504	0.4069	0.9504	0.9749
No log	9.8261	452	0.8940	0.4476	0.8940	0.9455
No log	9.8696	454	0.8925	0.4016	0.8925	0.9447
No log	9.9130	456	0.9217	0.3814	0.9217	0.9600
No log	9.9565	458	0.9182	0.4221	0.9182	0.9583
No log	10.0	460	0.9111	0.3990	0.9111	0.9545
No log	10.0435	462	0.9358	0.3961	0.9358	0.9674
No log	10.0870	464	0.9406	0.4302	0.9406	0.9699
No log	10.1304	466	0.9127	0.3961	0.9127	0.9553
No log	10.1739	468	0.8961	0.4244	0.8961	0.9466
No log	10.2174	470	0.8911	0.4665	0.8911	0.9440
No log	10.2609	472	0.8931	0.3861	0.8931	0.9451
No log	10.3043	474	0.9176	0.4743	0.9176	0.9579
No log	10.3478	476	0.9020	0.4302	0.9020	0.9498
No log	10.3913	478	0.8912	0.4059	0.8912	0.9441
No log	10.4348	480	0.8890	0.3779	0.8890	0.9429
No log	10.4783	482	0.9057	0.3570	0.9057	0.9517
No log	10.5217	484	0.9163	0.3414	0.9163	0.9572
No log	10.5652	486	0.9174	0.3414	0.9174	0.9578
No log	10.6087	488	0.9186	0.4057	0.9186	0.9584
No log	10.6522	490	0.9383	0.3289	0.9383	0.9687
No log	10.6957	492	0.9370	0.3677	0.9370	0.9680
No log	10.7391	494	0.9178	0.4057	0.9178	0.9580
No log	10.7826	496	0.8939	0.4141	0.8939	0.9454
No log	10.8261	498	0.8894	0.4318	0.8894	0.9431
0.3458	10.8696	500	0.9132	0.4059	0.9132	0.9556
0.3458	10.9130	502	0.9629	0.3677	0.9629	0.9813
0.3458	10.9565	504	0.9553	0.3677	0.9553	0.9774
0.3458	11.0	506	0.9145	0.3414	0.9145	0.9563
0.3458	11.0435	508	0.8858	0.3830	0.8858	0.9412
0.3458	11.0870	510	0.8805	0.4100	0.8805	0.9384
0.3458	11.1304	512	0.8516	0.4652	0.8516	0.9228
0.3458	11.1739	514	0.8375	0.4628	0.8375	0.9151
0.3458	11.2174	516	0.9237	0.4986	0.9237	0.9611
0.3458	11.2609	518	0.9346	0.4986	0.9346	0.9668
0.3458	11.3043	520	0.8725	0.5637	0.8725	0.9341
0.3458	11.3478	522	0.8218	0.4813	0.8218	0.9065
0.3458	11.3913	524	0.8191	0.3723	0.8191	0.9050
0.3458	11.4348	526	0.8158	0.3723	0.8158	0.9032
0.3458	11.4783	528	0.8186	0.4363	0.8186	0.9048
0.3458	11.5217	530	0.8543	0.4203	0.8543	0.9243
0.3458	11.5652	532	0.9352	0.5063	0.9352	0.9671
0.3458	11.6087	534	0.9881	0.5417	0.9881	0.9940
0.3458	11.6522	536	0.9767	0.5046	0.9767	0.9883
0.3458	11.6957	538	0.9723	0.3926	0.9723	0.9860
0.3458	11.7391	540	0.9588	0.4164	0.9588	0.9792
0.3458	11.7826	542	0.9186	0.3677	0.9186	0.9584
0.3458	11.8261	544	0.8759	0.3689	0.8759	0.9359
0.3458	11.8696	546	0.8783	0.3525	0.8783	0.9372
0.3458	11.9130	548	0.8919	0.3045	0.8919	0.9444
0.3458	11.9565	550	0.9238	0.4057	0.9238	0.9611

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1