ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1805
• Qwk: 0.5455
• Mse: 1.1805
• Rmse: 1.0865

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	6.7810	0.0116	6.7810	2.6040
No log	0.0702	4	4.1738	0.0702	4.1738	2.0430
No log	0.1053	6	3.4316	0.0	3.4316	1.8525
No log	0.1404	8	2.6543	0.1258	2.6543	1.6292
No log	0.1754	10	2.3478	0.0816	2.3478	1.5323
No log	0.2105	12	1.9373	0.2149	1.9373	1.3919
No log	0.2456	14	1.6519	0.2143	1.6519	1.2853
No log	0.2807	16	1.5090	0.2435	1.5090	1.2284
No log	0.3158	18	1.4216	0.3025	1.4216	1.1923
No log	0.3509	20	1.4408	0.3025	1.4408	1.2003
No log	0.3860	22	1.6642	0.3101	1.6642	1.2900
No log	0.4211	24	1.8737	0.3188	1.8737	1.3688
No log	0.4561	26	1.6295	0.3438	1.6295	1.2765
No log	0.4912	28	1.5542	0.3937	1.5542	1.2467
No log	0.5263	30	1.3551	0.2759	1.3551	1.1641
No log	0.5614	32	1.3769	0.2321	1.3769	1.1734
No log	0.5965	34	1.6054	0.3226	1.6054	1.2670
No log	0.6316	36	1.9742	0.3235	1.9742	1.4051
No log	0.6667	38	1.9450	0.3121	1.9450	1.3946
No log	0.7018	40	1.7615	0.3852	1.7615	1.3272
No log	0.7368	42	1.7149	0.3182	1.7149	1.3095
No log	0.7719	44	1.7031	0.3741	1.7031	1.3050
No log	0.8070	46	1.7934	0.3972	1.7934	1.3392
No log	0.8421	48	1.5931	0.4218	1.5931	1.2622
No log	0.8772	50	1.2955	0.5324	1.2955	1.1382
No log	0.9123	52	1.1668	0.5362	1.1668	1.0802
No log	0.9474	54	1.1734	0.5821	1.1734	1.0832
No log	0.9825	56	1.3107	0.4762	1.3107	1.1449
No log	1.0175	58	1.2334	0.4882	1.2334	1.1106
No log	1.0526	60	1.2125	0.4662	1.2125	1.1012
No log	1.0877	62	1.4008	0.4317	1.4008	1.1836
No log	1.1228	64	1.3022	0.4965	1.3022	1.1411
No log	1.1579	66	1.2308	0.5037	1.2308	1.1094
No log	1.1930	68	1.2879	0.4275	1.2879	1.1348
No log	1.2281	70	1.4725	0.3802	1.4725	1.2135
No log	1.2632	72	1.8793	0.2333	1.8793	1.3709
No log	1.2982	74	1.7287	0.2975	1.7287	1.3148
No log	1.3333	76	1.2895	0.5	1.2895	1.1355
No log	1.3684	78	1.4963	0.4615	1.4963	1.2232
No log	1.4035	80	1.7879	0.3401	1.7879	1.3371
No log	1.4386	82	1.5711	0.3942	1.5711	1.2534
No log	1.4737	84	1.3246	0.4127	1.3246	1.1509
No log	1.5088	86	1.2196	0.4961	1.2196	1.1044
No log	1.5439	88	1.2007	0.4921	1.2007	1.0958
No log	1.5789	90	1.1713	0.5312	1.1713	1.0823
No log	1.6140	92	1.1997	0.5882	1.1997	1.0953
No log	1.6491	94	1.1723	0.5882	1.1723	1.0827
No log	1.6842	96	1.2297	0.5526	1.2297	1.1089
No log	1.7193	98	1.1856	0.5733	1.1856	1.0888
No log	1.7544	100	1.0440	0.6154	1.0440	1.0218
No log	1.7895	102	1.0516	0.5547	1.0516	1.0255
No log	1.8246	104	0.9325	0.7083	0.9325	0.9657
No log	1.8596	106	0.8924	0.6752	0.8924	0.9447
No log	1.8947	108	0.8391	0.6993	0.8391	0.9160
No log	1.9298	110	0.8597	0.7042	0.8597	0.9272
No log	1.9649	112	0.9365	0.5758	0.9365	0.9677
No log	2.0	114	1.0475	0.5606	1.0475	1.0235
No log	2.0351	116	0.9669	0.5802	0.9669	0.9833
No log	2.0702	118	1.1467	0.5354	1.1467	1.0708
No log	2.1053	120	1.2073	0.5197	1.2073	1.0988
No log	2.1404	122	1.0636	0.5312	1.0636	1.0313
No log	2.1754	124	0.9434	0.6423	0.9434	0.9713
No log	2.2105	126	0.8995	0.6331	0.8995	0.9484
No log	2.2456	128	0.8781	0.6331	0.8781	0.9371
No log	2.2807	130	1.0089	0.6761	1.0089	1.0045
No log	2.3158	132	1.1257	0.5839	1.1257	1.0610
No log	2.3509	134	0.9809	0.6853	0.9809	0.9904
No log	2.3860	136	0.9616	0.6667	0.9616	0.9806
No log	2.4211	138	0.9353	0.5846	0.9353	0.9671
No log	2.4561	140	0.9795	0.5079	0.9795	0.9897
No log	2.4912	142	1.0147	0.5039	1.0147	1.0073
No log	2.5263	144	1.0423	0.5652	1.0423	1.0209
No log	2.5614	146	1.2837	0.5897	1.2837	1.1330
No log	2.5965	148	1.3904	0.5576	1.3904	1.1792
No log	2.6316	150	1.0489	0.6216	1.0489	1.0242
No log	2.6667	152	0.8941	0.6618	0.8941	0.9456
No log	2.7018	154	0.8983	0.6619	0.8983	0.9478
No log	2.7368	156	0.9023	0.6763	0.9023	0.9499
No log	2.7719	158	0.9707	0.5899	0.9707	0.9853
No log	2.8070	160	1.1335	0.6207	1.1335	1.0647
No log	2.8421	162	1.1202	0.625	1.1202	1.0584
No log	2.8772	164	0.9496	0.6131	0.9496	0.9745
No log	2.9123	166	0.9873	0.5672	0.9873	0.9936
No log	2.9474	168	1.0894	0.5630	1.0894	1.0437
No log	2.9825	170	0.9550	0.6619	0.9550	0.9772
No log	3.0175	172	0.8037	0.6950	0.8037	0.8965
No log	3.0526	174	0.8221	0.6944	0.8221	0.9067
No log	3.0877	176	1.0150	0.6623	1.0150	1.0075
No log	3.1228	178	0.9899	0.6351	0.9899	0.9949
No log	3.1579	180	0.8861	0.5865	0.8861	0.9413
No log	3.1930	182	1.0247	0.5781	1.0247	1.0123
No log	3.2281	184	1.0652	0.5161	1.0652	1.0321
No log	3.2632	186	1.0420	0.48	1.0420	1.0208
No log	3.2982	188	1.0886	0.5344	1.0886	1.0433
No log	3.3333	190	1.0753	0.5385	1.0753	1.0370
No log	3.3684	192	1.0255	0.5079	1.0255	1.0127
No log	3.4035	194	1.0223	0.6061	1.0222	1.0111
No log	3.4386	196	1.2798	0.4962	1.2798	1.1313
No log	3.4737	198	1.4950	0.4762	1.4950	1.2227
No log	3.5088	200	1.4899	0.4539	1.4899	1.2206
No log	3.5439	202	1.5827	0.4173	1.5827	1.2581
No log	3.5789	204	1.6440	0.2720	1.6440	1.2822
No log	3.6140	206	1.6406	0.3443	1.6406	1.2809
No log	3.6491	208	1.5131	0.4032	1.5131	1.2301
No log	3.6842	210	1.2774	0.4921	1.2774	1.1302
No log	3.7193	212	1.1814	0.5039	1.1814	1.0869
No log	3.7544	214	1.1991	0.4882	1.1991	1.0950
No log	3.7895	216	1.1724	0.5039	1.1724	1.0828
No log	3.8246	218	1.2297	0.4	1.2297	1.1089
No log	3.8596	220	1.3493	0.4103	1.3493	1.1616
No log	3.8947	222	1.3334	0.3571	1.3334	1.1547
No log	3.9298	224	1.2598	0.3652	1.2598	1.1224
No log	3.9649	226	1.2802	0.4160	1.2802	1.1315
No log	4.0	228	1.2801	0.4567	1.2801	1.1314
No log	4.0351	230	1.2048	0.5156	1.2048	1.0977
No log	4.0702	232	1.2011	0.4202	1.2011	1.0960
No log	4.1053	234	1.1923	0.4237	1.1923	1.0919
No log	4.1404	236	1.1462	0.4516	1.1462	1.0706
No log	4.1754	238	1.0993	0.5079	1.0993	1.0485
No log	4.2105	240	1.0906	0.5538	1.0906	1.0443
No log	4.2456	242	1.1814	0.5753	1.1814	1.0869
No log	4.2807	244	1.1743	0.5714	1.1743	1.0836
No log	4.3158	246	1.0389	0.5538	1.0389	1.0192
No log	4.3509	248	1.0028	0.5581	1.0028	1.0014
No log	4.3860	250	0.9899	0.6107	0.9899	0.9950
No log	4.4211	252	0.9874	0.5581	0.9874	0.9937
No log	4.4561	254	1.0510	0.5344	1.0510	1.0252
No log	4.4912	256	1.0679	0.5156	1.0679	1.0334
No log	4.5263	258	1.1058	0.48	1.1058	1.0516
No log	4.5614	260	1.1590	0.4202	1.1590	1.0765
No log	4.5965	262	1.1357	0.4500	1.1357	1.0657
No log	4.6316	264	1.1145	0.4553	1.1145	1.0557
No log	4.6667	266	1.1215	0.5116	1.1215	1.0590
No log	4.7018	268	1.1506	0.4844	1.1506	1.0727
No log	4.7368	270	1.1332	0.4463	1.1332	1.0645
No log	4.7719	272	1.1859	0.5312	1.1859	1.0890
No log	4.8070	274	1.2586	0.4806	1.2586	1.1219
No log	4.8421	276	1.2617	0.4688	1.2617	1.1233
No log	4.8772	278	1.1886	0.5079	1.1886	1.0902
No log	4.9123	280	1.1252	0.4298	1.1252	1.0608
No log	4.9474	282	1.1257	0.5039	1.1257	1.0610
No log	4.9825	284	1.0981	0.496	1.0981	1.0479
No log	5.0175	286	1.0987	0.4553	1.0987	1.0482
No log	5.0526	288	1.0995	0.4677	1.0995	1.0486
No log	5.0877	290	1.1059	0.5039	1.1059	1.0516
No log	5.1228	292	1.1106	0.5039	1.1106	1.0538
No log	5.1579	294	1.1301	0.4844	1.1301	1.0631
No log	5.1930	296	1.1290	0.5116	1.1290	1.0625
No log	5.2281	298	1.1483	0.5077	1.1483	1.0716
No log	5.2632	300	1.2022	0.5	1.2022	1.0965
No log	5.2982	302	1.2252	0.4882	1.2252	1.1069
No log	5.3333	304	1.2309	0.4355	1.2309	1.1094
No log	5.3684	306	1.2290	0.4516	1.2290	1.1086
No log	5.4035	308	1.2007	0.4882	1.2007	1.0958
No log	5.4386	310	1.1650	0.4098	1.1650	1.0793
No log	5.4737	312	1.1859	0.5	1.1859	1.0890
No log	5.5088	314	1.1953	0.4844	1.1953	1.0933
No log	5.5439	316	1.1473	0.4882	1.1473	1.0711
No log	5.5789	318	1.1630	0.4390	1.1630	1.0784
No log	5.6140	320	1.1510	0.4262	1.1510	1.0729
No log	5.6491	322	1.1516	0.4677	1.1516	1.0731
No log	5.6842	324	1.1659	0.48	1.1659	1.0798
No log	5.7193	326	1.2119	0.4921	1.2119	1.1009
No log	5.7544	328	1.2134	0.4921	1.2134	1.1016
No log	5.7895	330	1.2006	0.4921	1.2006	1.0957
No log	5.8246	332	1.1425	0.4355	1.1425	1.0689
No log	5.8596	334	1.1053	0.4228	1.1053	1.0513
No log	5.8947	336	1.0901	0.4480	1.0901	1.0441
No log	5.9298	338	1.0665	0.4844	1.0665	1.0327
No log	5.9649	340	1.0925	0.5303	1.0925	1.0452
No log	6.0	342	1.0786	0.5414	1.0786	1.0386
No log	6.0351	344	0.9893	0.5926	0.9893	0.9946
No log	6.0702	346	0.9729	0.6029	0.9729	0.9863
No log	6.1053	348	1.1440	0.5857	1.1440	1.0696
No log	6.1404	350	1.1938	0.5333	1.1938	1.0926
No log	6.1754	352	1.1089	0.6107	1.1089	1.0530
No log	6.2105	354	1.0758	0.4516	1.0758	1.0372
No log	6.2456	356	1.2534	0.4733	1.2534	1.1196
No log	6.2807	358	1.3252	0.4776	1.3252	1.1512
No log	6.3158	360	1.2413	0.4769	1.2413	1.1142
No log	6.3509	362	1.1483	0.4677	1.1483	1.0716
No log	6.3860	364	1.1521	0.4640	1.1521	1.0734
No log	6.4211	366	1.1449	0.4762	1.1449	1.0700
No log	6.4561	368	1.0906	0.4640	1.0906	1.0443
No log	6.4912	370	1.0466	0.5156	1.0466	1.0230
No log	6.5263	372	1.0730	0.4882	1.0730	1.0358
No log	6.5614	374	1.1120	0.4882	1.1120	1.0545
No log	6.5965	376	1.1195	0.4132	1.1195	1.0581
No log	6.6316	378	1.1099	0.4132	1.1099	1.0535
No log	6.6667	380	1.1082	0.4355	1.1082	1.0527
No log	6.7018	382	1.1406	0.4463	1.1406	1.0680
No log	6.7368	384	1.1677	0.3866	1.1677	1.0806
No log	6.7719	386	1.1543	0.4516	1.1543	1.0744
No log	6.8070	388	1.1516	0.4320	1.1516	1.0731
No log	6.8421	390	1.1563	0.4194	1.1563	1.0753
No log	6.8772	392	1.1543	0.4844	1.1543	1.0744
No log	6.9123	394	1.1676	0.5455	1.1676	1.0806
No log	6.9474	396	1.1167	0.5606	1.1167	1.0567
No log	6.9825	398	1.1057	0.5077	1.1057	1.0515
No log	7.0175	400	1.1039	0.4844	1.1039	1.0507
No log	7.0526	402	1.1389	0.4603	1.1389	1.0672
No log	7.0877	404	1.1577	0.4603	1.1577	1.0760
No log	7.1228	406	1.1141	0.4961	1.1141	1.0555
No log	7.1579	408	1.0683	0.5778	1.0683	1.0336
No log	7.1930	410	1.0427	0.5957	1.0427	1.0211
No log	7.2281	412	0.9844	0.5942	0.9844	0.9922
No log	7.2632	414	0.9540	0.5522	0.9540	0.9767
No log	7.2982	416	1.0055	0.5909	1.0055	1.0027
No log	7.3333	418	1.0332	0.5649	1.0332	1.0165
No log	7.3684	420	1.0240	0.5197	1.0240	1.0119
No log	7.4035	422	1.0431	0.4098	1.0431	1.0213
No log	7.4386	424	1.0852	0.4355	1.0852	1.0417
No log	7.4737	426	1.1234	0.4167	1.1234	1.0599
No log	7.5088	428	1.1310	0.3898	1.1310	1.0635
No log	7.5439	430	1.1233	0.3652	1.1233	1.0599
No log	7.5789	432	1.0938	0.3793	1.0938	1.0459
No log	7.6140	434	1.0459	0.4706	1.0459	1.0227
No log	7.6491	436	1.0291	0.4918	1.0291	1.0145
No log	7.6842	438	1.0815	0.4706	1.0815	1.0399
No log	7.7193	440	1.1201	0.4538	1.1201	1.0583
No log	7.7544	442	1.1748	0.4370	1.1748	1.0839
No log	7.7895	444	1.1311	0.4463	1.1311	1.0635
No log	7.8246	446	1.0687	0.5041	1.0687	1.0338
No log	7.8596	448	1.0576	0.5736	1.0576	1.0284
No log	7.8947	450	1.0907	0.5496	1.0907	1.0444
No log	7.9298	452	1.0998	0.5312	1.0998	1.0487
No log	7.9649	454	1.0745	0.4628	1.0745	1.0366
No log	8.0	456	1.0884	0.4746	1.0884	1.0433
No log	8.0351	458	1.0995	0.4833	1.0995	1.0486
No log	8.0702	460	1.0479	0.5161	1.0479	1.0237
No log	8.1053	462	0.9848	0.5426	0.9848	0.9923
No log	8.1404	464	0.9665	0.5312	0.9665	0.9831
No log	8.1754	466	1.0188	0.5156	1.0188	1.0093
No log	8.2105	468	1.0725	0.5156	1.0725	1.0356
No log	8.2456	470	1.0993	0.5197	1.0993	1.0485
No log	8.2807	472	1.1035	0.4463	1.1035	1.0505
No log	8.3158	474	1.0951	0.4667	1.0951	1.0465
No log	8.3509	476	1.0181	0.4839	1.0181	1.0090
No log	8.3860	478	0.9564	0.5606	0.9564	0.9779
No log	8.4211	480	0.9346	0.5985	0.9346	0.9667
No log	8.4561	482	0.9222	0.5714	0.9222	0.9603
No log	8.4912	484	0.9478	0.5156	0.9478	0.9735
No log	8.5263	486	1.0739	0.512	1.0739	1.0363
No log	8.5614	488	1.2409	0.4237	1.2409	1.1140
No log	8.5965	490	1.2179	0.4103	1.2179	1.1036
No log	8.6316	492	1.0933	0.4754	1.0933	1.0456
No log	8.6667	494	0.9431	0.5538	0.9431	0.9711
No log	8.7018	496	0.8510	0.5926	0.8510	0.9225
No log	8.7368	498	0.8342	0.6423	0.8342	0.9133
0.3664	8.7719	500	0.8086	0.6619	0.8086	0.8992
0.3664	8.8070	502	0.8169	0.6619	0.8169	0.9038
0.3664	8.8421	504	0.9007	0.6714	0.9007	0.9490
0.3664	8.8772	506	0.9649	0.6154	0.9649	0.9823
0.3664	8.9123	508	0.9719	0.5161	0.9719	0.9859
0.3664	8.9474	510	1.0399	0.48	1.0399	1.0198
0.3664	8.9825	512	1.1395	0.5455	1.1395	1.0675
0.3664	9.0175	514	1.1805	0.5455	1.1805	1.0865

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1