ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9739
• Qwk: 0.2887
• Mse: 0.9739
• Rmse: 0.9869

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	4.0634	-0.0270	4.0634	2.0158
No log	0.0656	4	2.2633	-0.0111	2.2633	1.5044
No log	0.0984	6	1.5699	0.0328	1.5699	1.2530
No log	0.1311	8	1.2296	0.1186	1.2296	1.1089
No log	0.1639	10	1.2208	0.0576	1.2208	1.1049
No log	0.1967	12	1.3358	0.0779	1.3358	1.1558
No log	0.2295	14	1.3181	0.0779	1.3181	1.1481
No log	0.2623	16	1.1913	0.0741	1.1913	1.0915
No log	0.2951	18	1.1621	0.2192	1.1621	1.0780
No log	0.3279	20	1.2283	0.2893	1.2283	1.1083
No log	0.3607	22	1.2434	0.2690	1.2434	1.1151
No log	0.3934	24	1.2074	0.1651	1.2074	1.0988
No log	0.4262	26	1.1282	0.1192	1.1282	1.0622
No log	0.4590	28	1.1621	0.0957	1.1621	1.0780
No log	0.4918	30	1.1320	0.3218	1.1320	1.0640
No log	0.5246	32	1.1163	0.2829	1.1163	1.0565
No log	0.5574	34	1.1537	0.3206	1.1537	1.0741
No log	0.5902	36	1.1505	0.3003	1.1505	1.0726
No log	0.6230	38	1.0877	0.2050	1.0877	1.0429
No log	0.6557	40	1.0114	0.1935	1.0114	1.0057
No log	0.6885	42	1.0232	0.2761	1.0232	1.0115
No log	0.7213	44	1.1970	0.3468	1.1970	1.0941
No log	0.7541	46	1.1322	0.3211	1.1322	1.0641
No log	0.7869	48	0.9966	0.2432	0.9966	0.9983
No log	0.8197	50	0.9659	0.2384	0.9659	0.9828
No log	0.8525	52	0.9647	0.1885	0.9647	0.9822
No log	0.8852	54	0.9791	0.2323	0.9791	0.9895
No log	0.9180	56	1.0280	0.3027	1.0280	1.0139
No log	0.9508	58	1.1819	0.2857	1.1819	1.0871
No log	0.9836	60	1.4716	0.1853	1.4716	1.2131
No log	1.0164	62	1.8242	0.1857	1.8242	1.3506
No log	1.0492	64	1.4440	0.2692	1.4440	1.2017
No log	1.0820	66	1.1442	0.3573	1.1442	1.0697
No log	1.1148	68	1.1525	0.3968	1.1525	1.0735
No log	1.1475	70	1.1788	0.3947	1.1788	1.0857
No log	1.1803	72	1.1905	0.4055	1.1905	1.0911
No log	1.2131	74	1.1588	0.4026	1.1588	1.0765
No log	1.2459	76	1.1304	0.4162	1.1304	1.0632
No log	1.2787	78	1.1587	0.3152	1.1587	1.0764
No log	1.3115	80	1.1066	0.3014	1.1066	1.0520
No log	1.3443	82	1.0863	0.3692	1.0863	1.0423
No log	1.3770	84	1.3048	0.3238	1.3048	1.1423
No log	1.4098	86	1.3485	0.3077	1.3485	1.1612
No log	1.4426	88	1.1204	0.2913	1.1204	1.0585
No log	1.4754	90	1.0750	0.3693	1.0750	1.0368
No log	1.5082	92	1.1601	0.2148	1.1601	1.0771
No log	1.5410	94	1.1484	0.1780	1.1484	1.0716
No log	1.5738	96	1.0250	0.3108	1.0250	1.0124
No log	1.6066	98	0.9929	0.3169	0.9929	0.9964
No log	1.6393	100	1.0123	0.3661	1.0123	1.0061
No log	1.6721	102	1.0480	0.4449	1.0480	1.0237
No log	1.7049	104	1.0924	0.4082	1.0924	1.0452
No log	1.7377	106	1.1051	0.4723	1.1051	1.0512
No log	1.7705	108	1.0751	0.4751	1.0751	1.0369
No log	1.8033	110	1.0688	0.5009	1.0688	1.0338
No log	1.8361	112	1.0995	0.4323	1.0995	1.0486
No log	1.8689	114	1.1090	0.4780	1.1090	1.0531
No log	1.9016	116	1.1431	0.3214	1.1431	1.0692
No log	1.9344	118	1.1553	0.3404	1.1553	1.0748
No log	1.9672	120	1.1293	0.3662	1.1293	1.0627
No log	2.0	122	1.1091	0.2980	1.1091	1.0531
No log	2.0328	124	1.1320	0.2651	1.1320	1.0640
No log	2.0656	126	1.0939	0.2911	1.0939	1.0459
No log	2.0984	128	1.0716	0.2829	1.0716	1.0352
No log	2.1311	130	1.1400	0.3050	1.1400	1.0677
No log	2.1639	132	1.1217	0.3254	1.1217	1.0591
No log	2.1967	134	1.0550	0.4875	1.0550	1.0271
No log	2.2295	136	1.1547	0.2726	1.1547	1.0746
No log	2.2623	138	1.1769	0.2579	1.1769	1.0848
No log	2.2951	140	1.1354	0.4484	1.1354	1.0655
No log	2.3279	142	1.0935	0.4039	1.0935	1.0457
No log	2.3607	144	1.0516	0.4247	1.0516	1.0255
No log	2.3934	146	1.0653	0.4102	1.0653	1.0321
No log	2.4262	148	1.0365	0.4630	1.0365	1.0181
No log	2.4590	150	1.0173	0.4264	1.0173	1.0086
No log	2.4918	152	1.0386	0.3824	1.0386	1.0191
No log	2.5246	154	1.0578	0.4085	1.0578	1.0285
No log	2.5574	156	1.0234	0.4012	1.0234	1.0116
No log	2.5902	158	1.0833	0.3381	1.0833	1.0408
No log	2.6230	160	0.9949	0.4045	0.9949	0.9975
No log	2.6557	162	0.9084	0.3744	0.9084	0.9531
No log	2.6885	164	0.8951	0.3744	0.8951	0.9461
No log	2.7213	166	0.9030	0.4329	0.9030	0.9503
No log	2.7541	168	1.0170	0.3912	1.0170	1.0085
No log	2.7869	170	0.9714	0.3897	0.9714	0.9856
No log	2.8197	172	0.9006	0.4141	0.9006	0.9490
No log	2.8525	174	0.9869	0.4335	0.9869	0.9934
No log	2.8852	176	1.0114	0.3957	1.0114	1.0057
No log	2.9180	178	0.9131	0.4483	0.9131	0.9556
No log	2.9508	180	0.9384	0.3853	0.9384	0.9687
No log	2.9836	182	0.9854	0.4196	0.9854	0.9927
No log	3.0164	184	0.9449	0.4505	0.9449	0.9720
No log	3.0492	186	0.9644	0.5081	0.9644	0.9820
No log	3.0820	188	1.0307	0.4484	1.0307	1.0152
No log	3.1148	190	0.9740	0.4483	0.9740	0.9869
No log	3.1475	192	0.9651	0.3529	0.9651	0.9824
No log	3.1803	194	1.0387	0.2586	1.0387	1.0192
No log	3.2131	196	0.9639	0.3382	0.9639	0.9818
No log	3.2459	198	0.8992	0.3367	0.8992	0.9483
No log	3.2787	200	1.0109	0.2487	1.0109	1.0054
No log	3.3115	202	1.0807	0.3728	1.0807	1.0396
No log	3.3443	204	1.0685	0.3992	1.0685	1.0337
No log	3.3770	206	1.0565	0.3715	1.0565	1.0278
No log	3.4098	208	1.0845	0.3747	1.0845	1.0414
No log	3.4426	210	1.1347	0.3454	1.1347	1.0652
No log	3.4754	212	1.1449	0.3649	1.1449	1.0700
No log	3.5082	214	1.1326	0.3378	1.1326	1.0643
No log	3.5410	216	1.0806	0.4465	1.0806	1.0395
No log	3.5738	218	0.9761	0.4631	0.9761	0.9880
No log	3.6066	220	0.9505	0.4534	0.9505	0.9750
No log	3.6393	222	0.9652	0.4078	0.9652	0.9824
No log	3.6721	224	1.0376	0.3161	1.0376	1.0186
No log	3.7049	226	1.0534	0.3161	1.0534	1.0264
No log	3.7377	228	1.0370	0.3161	1.0370	1.0183
No log	3.7705	230	1.0162	0.4214	1.0162	1.0081
No log	3.8033	232	0.9961	0.4755	0.9961	0.9980
No log	3.8361	234	0.9996	0.4328	0.9996	0.9998
No log	3.8689	236	1.0054	0.3699	1.0054	1.0027
No log	3.9016	238	1.0037	0.3733	1.0037	1.0018
No log	3.9344	240	0.9895	0.3474	0.9895	0.9947
No log	3.9672	242	0.9967	0.3474	0.9967	0.9984
No log	4.0	244	1.0561	0.4379	1.0561	1.0277
No log	4.0328	246	1.2173	0.3642	1.2173	1.1033
No log	4.0656	248	1.2252	0.3734	1.2252	1.1069
No log	4.0984	250	1.1500	0.4032	1.1500	1.0724
No log	4.1311	252	1.1225	0.4228	1.1225	1.0595
No log	4.1639	254	1.1157	0.4107	1.1157	1.0562
No log	4.1967	256	1.0278	0.4115	1.0278	1.0138
No log	4.2295	258	0.9441	0.3994	0.9441	0.9716
No log	4.2623	260	0.9224	0.3802	0.9224	0.9604
No log	4.2951	262	0.9537	0.4361	0.9537	0.9766
No log	4.3279	264	1.1725	0.3969	1.1725	1.0828
No log	4.3607	266	1.3437	0.1955	1.3437	1.1592
No log	4.3934	268	1.3058	0.2822	1.3058	1.1427
No log	4.4262	270	1.1855	0.3712	1.1855	1.0888
No log	4.4590	272	1.1160	0.3085	1.1160	1.0564
No log	4.4918	274	1.1217	0.3732	1.1217	1.0591
No log	4.5246	276	1.1154	0.3584	1.1154	1.0561
No log	4.5574	278	1.0089	0.2963	1.0089	1.0044
No log	4.5902	280	0.9280	0.3697	0.9280	0.9633
No log	4.6230	282	0.9258	0.3011	0.9258	0.9622
No log	4.6557	284	0.9378	0.3258	0.9378	0.9684
No log	4.6885	286	0.9703	0.3780	0.9703	0.9850
No log	4.7213	288	1.0785	0.2263	1.0785	1.0385
No log	4.7541	290	1.1055	0.3176	1.1055	1.0514
No log	4.7869	292	0.9971	0.3804	0.9971	0.9986
No log	4.8197	294	0.9554	0.4352	0.9554	0.9775
No log	4.8525	296	0.9550	0.4237	0.9550	0.9773
No log	4.8852	298	1.0344	0.3987	1.0344	1.0171
No log	4.9180	300	1.0464	0.3987	1.0464	1.0229
No log	4.9508	302	0.9823	0.4247	0.9823	0.9911
No log	4.9836	304	1.0131	0.3250	1.0131	1.0065
No log	5.0164	306	1.0408	0.3987	1.0408	1.0202
No log	5.0492	308	1.0563	0.3987	1.0563	1.0278
No log	5.0820	310	0.9964	0.4164	0.9964	0.9982
No log	5.1148	312	0.9998	0.4413	0.9998	0.9999
No log	5.1475	314	1.0371	0.4410	1.0371	1.0184
No log	5.1803	316	1.0712	0.4079	1.0712	1.0350
No log	5.2131	318	1.1080	0.3549	1.1080	1.0526
No log	5.2459	320	1.0266	0.3990	1.0266	1.0132
No log	5.2787	322	0.9847	0.3661	0.9847	0.9923
No log	5.3115	324	1.0183	0.3566	1.0183	1.0091
No log	5.3443	326	0.9897	0.3590	0.9897	0.9948
No log	5.3770	328	0.9929	0.3091	0.9929	0.9964
No log	5.4098	330	1.0712	0.3989	1.0712	1.0350
No log	5.4426	332	1.0573	0.3989	1.0573	1.0282
No log	5.4754	334	1.0424	0.3710	1.0424	1.0210
No log	5.5082	336	1.0264	0.2577	1.0264	1.0131
No log	5.5410	338	1.0300	0.2577	1.0300	1.0149
No log	5.5738	340	1.0294	0.2577	1.0294	1.0146
No log	5.6066	342	1.0007	0.2910	1.0007	1.0003
No log	5.6393	344	1.0078	0.3747	1.0078	1.0039
No log	5.6721	346	1.0259	0.3014	1.0259	1.0129
No log	5.7049	348	1.1163	0.3444	1.1163	1.0566
No log	5.7377	350	1.2430	0.2304	1.2430	1.1149
No log	5.7705	352	1.2762	0.2355	1.2762	1.1297
No log	5.8033	354	1.3106	0.2792	1.3106	1.1448
No log	5.8361	356	1.2691	0.2864	1.2691	1.1266
No log	5.8689	358	1.1191	0.1776	1.1191	1.0579
No log	5.9016	360	1.0595	0.2919	1.0595	1.0293
No log	5.9344	362	1.0659	0.2919	1.0659	1.0324
No log	5.9672	364	1.1244	0.2179	1.1244	1.0604
No log	6.0	366	1.1509	0.2481	1.1509	1.0728
No log	6.0328	368	1.1254	0.2175	1.1254	1.0608
No log	6.0656	370	1.0836	0.2077	1.0836	1.0410
No log	6.0984	372	1.0349	0.3272	1.0349	1.0173
No log	6.1311	374	1.0481	0.3167	1.0481	1.0237
No log	6.1639	376	1.1163	0.2655	1.1163	1.0566
No log	6.1967	378	1.1430	0.2263	1.1430	1.0691
No log	6.2295	380	1.1308	0.2632	1.1308	1.0634
No log	6.2623	382	1.1835	0.2409	1.1835	1.0879
No log	6.2951	384	1.1381	0.2296	1.1381	1.0668
No log	6.3279	386	1.0397	0.2792	1.0397	1.0197
No log	6.3607	388	1.0138	0.2929	1.0138	1.0069
No log	6.3934	390	1.0590	0.2632	1.0590	1.0291
No log	6.4262	392	1.0779	0.2239	1.0779	1.0382
No log	6.4590	394	1.1088	0.2610	1.1088	1.0530
No log	6.4918	396	1.0797	0.3176	1.0797	1.0391
No log	6.5246	398	1.0207	0.2086	1.0207	1.0103
No log	6.5574	400	0.9586	0.3556	0.9586	0.9791
No log	6.5902	402	0.9463	0.3878	0.9463	0.9728
No log	6.6230	404	0.9449	0.3996	0.9449	0.9721
No log	6.6557	406	0.9787	0.2600	0.9787	0.9893
No log	6.6885	408	1.0894	0.3565	1.0894	1.0437
No log	6.7213	410	1.1513	0.3847	1.1513	1.0730
No log	6.7541	412	1.1534	0.3444	1.1534	1.0740
No log	6.7869	414	1.1465	0.3444	1.1465	1.0707
No log	6.8197	416	1.0885	0.3115	1.0885	1.0433
No log	6.8525	418	1.1098	0.2726	1.1098	1.0535
No log	6.8852	420	1.1131	0.2155	1.1131	1.0550
No log	6.9180	422	1.1595	0.1750	1.1595	1.0768
No log	6.9508	424	1.1864	0.1343	1.1864	1.0892
No log	6.9836	426	1.1576	0.1750	1.1576	1.0759
No log	7.0164	428	1.1413	0.2076	1.1413	1.0683
No log	7.0492	430	1.0756	0.3672	1.0756	1.0371
No log	7.0820	432	1.0589	0.4135	1.0589	1.0290
No log	7.1148	434	1.0689	0.4135	1.0689	1.0339
No log	7.1475	436	1.0726	0.4238	1.0726	1.0357
No log	7.1803	438	1.0019	0.2909	1.0019	1.0009
No log	7.2131	440	0.9619	0.3151	0.9619	0.9808
No log	7.2459	442	0.9349	0.3717	0.9349	0.9669
No log	7.2787	444	0.9324	0.3717	0.9324	0.9656
No log	7.3115	446	0.9454	0.3697	0.9454	0.9723
No log	7.3443	448	0.9709	0.3272	0.9709	0.9854
No log	7.3770	450	0.9745	0.3445	0.9745	0.9872
No log	7.4098	452	1.0229	0.3217	1.0229	1.0114
No log	7.4426	454	1.0126	0.3217	1.0126	1.0063
No log	7.4754	456	0.9873	0.3285	0.9873	0.9936
No log	7.5082	458	0.9457	0.3156	0.9457	0.9725
No log	7.5410	460	0.9380	0.3200	0.9380	0.9685
No log	7.5738	462	0.9420	0.3156	0.9420	0.9706
No log	7.6066	464	0.9766	0.3236	0.9766	0.9882
No log	7.6393	466	1.0322	0.2505	1.0322	1.0160
No log	7.6721	468	1.0593	0.2494	1.0593	1.0292
No log	7.7049	470	1.0375	0.2949	1.0375	1.0186
No log	7.7377	472	1.0150	0.3005	1.0150	1.0075
No log	7.7705	474	1.0223	0.3083	1.0223	1.0111
No log	7.8033	476	0.9959	0.4231	0.9959	0.9980
No log	7.8361	478	0.9183	0.4378	0.9183	0.9583
No log	7.8689	480	0.9034	0.3797	0.9034	0.9505
No log	7.9016	482	0.8924	0.3779	0.8924	0.9447
No log	7.9344	484	0.9117	0.4264	0.9117	0.9548
No log	7.9672	486	1.0346	0.4371	1.0346	1.0172
No log	8.0	488	1.1161	0.4222	1.1161	1.0565
No log	8.0328	490	1.0857	0.3717	1.0857	1.0420
No log	8.0656	492	0.9848	0.2721	0.9848	0.9924
No log	8.0984	494	0.9372	0.3293	0.9372	0.9681
No log	8.1311	496	0.9053	0.3697	0.9053	0.9515
No log	8.1639	498	0.9094	0.3576	0.9094	0.9536
0.2716	8.1967	500	0.9368	0.4271	0.9368	0.9679
0.2716	8.2295	502	0.9591	0.4273	0.9591	0.9793
0.2716	8.2623	504	1.0180	0.3512	1.0180	1.0089
0.2716	8.2951	506	1.0214	0.3512	1.0214	1.0107
0.2716	8.3279	508	0.9955	0.4241	0.9955	0.9977
0.2716	8.3607	510	0.9944	0.3087	0.9944	0.9972
0.2716	8.3934	512	0.9739	0.2887	0.9739	0.9869

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1