ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k14_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6338
• Qwk: 0.4576
• Mse: 0.6338
• Rmse: 0.7961

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	2.5365	-0.0262	2.5365	1.5926
No log	0.0833	4	1.2412	0.0741	1.2412	1.1141
No log	0.125	6	0.8117	0.0481	0.8117	0.9009
No log	0.1667	8	0.8454	0.0	0.8454	0.9195
No log	0.2083	10	0.7711	-0.0054	0.7711	0.8781
No log	0.25	12	0.7772	0.1139	0.7772	0.8816
No log	0.2917	14	0.8266	0.2244	0.8266	0.9092
No log	0.3333	16	0.7989	0.1866	0.7989	0.8938
No log	0.375	18	0.7601	0.0428	0.7601	0.8718
No log	0.4167	20	0.9086	0.0522	0.9086	0.9532
No log	0.4583	22	0.9120	0.1339	0.9120	0.9550
No log	0.5	24	0.8053	-0.0426	0.8053	0.8974
No log	0.5417	26	0.7904	0.0359	0.7904	0.8891
No log	0.5833	28	0.8712	-0.0049	0.8712	0.9334
No log	0.625	30	0.7641	0.1846	0.7641	0.8741
No log	0.6667	32	0.7426	0.0	0.7426	0.8617
No log	0.7083	34	0.8192	0.0940	0.8192	0.9051
No log	0.75	36	0.8245	0.0940	0.8245	0.9080
No log	0.7917	38	0.7823	0.1321	0.7823	0.8845
No log	0.8333	40	0.7042	0.1660	0.7042	0.8392
No log	0.875	42	0.7478	0.1498	0.7478	0.8648
No log	0.9167	44	0.8054	0.1867	0.8054	0.8974
No log	0.9583	46	0.7973	0.0393	0.7973	0.8929
No log	1.0	48	0.8392	0.1700	0.8392	0.9161
No log	1.0417	50	0.9795	0.1639	0.9795	0.9897
No log	1.0833	52	1.0709	0.1869	1.0709	1.0348
No log	1.125	54	1.0032	0.2222	1.0032	1.0016
No log	1.1667	56	0.8012	0.1345	0.8012	0.8951
No log	1.2083	58	0.7039	0.2353	0.7039	0.8390
No log	1.25	60	0.6833	0.1580	0.6833	0.8266
No log	1.2917	62	0.6734	0.1580	0.6734	0.8206
No log	1.3333	64	0.6698	0.1646	0.6698	0.8184
No log	1.375	66	0.6552	0.1660	0.6552	0.8094
No log	1.4167	68	0.6298	0.1184	0.6298	0.7936
No log	1.4583	70	0.6049	0.1184	0.6049	0.7777
No log	1.5	72	0.5867	0.4243	0.5867	0.7659
No log	1.5417	74	0.5873	0.4614	0.5873	0.7664
No log	1.5833	76	0.6010	0.4878	0.6010	0.7752
No log	1.625	78	0.7514	0.2865	0.7514	0.8668
No log	1.6667	80	0.7637	0.2951	0.7637	0.8739
No log	1.7083	82	0.6468	0.3679	0.6468	0.8042
No log	1.75	84	0.6699	0.3789	0.6699	0.8185
No log	1.7917	86	0.8488	0.4102	0.8488	0.9213
No log	1.8333	88	0.7748	0.3918	0.7748	0.8802
No log	1.875	90	0.6617	0.2890	0.6617	0.8135
No log	1.9167	92	0.6842	0.2576	0.6842	0.8272
No log	1.9583	94	0.7108	0.2837	0.7108	0.8431
No log	2.0	96	0.6859	0.2078	0.6859	0.8282
No log	2.0417	98	0.6985	0.2360	0.6985	0.8358
No log	2.0833	100	0.7220	0.2681	0.7220	0.8497
No log	2.125	102	0.7327	0.2889	0.7327	0.8560
No log	2.1667	104	0.7585	0.2434	0.7585	0.8709
No log	2.2083	106	0.8221	0.2414	0.8221	0.9067
No log	2.25	108	0.8162	0.2708	0.8162	0.9034
No log	2.2917	110	0.7344	0.2874	0.7344	0.8570
No log	2.3333	112	0.7328	0.3910	0.7328	0.8560
No log	2.375	114	0.7337	0.2722	0.7337	0.8566
No log	2.4167	116	0.6954	0.2506	0.6954	0.8339
No log	2.4583	118	0.7812	0.1623	0.7812	0.8839
No log	2.5	120	0.9137	0.2613	0.9137	0.9559
No log	2.5417	122	0.9818	0.2559	0.9818	0.9909
No log	2.5833	124	0.9972	0.2813	0.9972	0.9986
No log	2.625	126	0.9097	0.2008	0.9097	0.9538
No log	2.6667	128	0.7834	0.1686	0.7834	0.8851
No log	2.7083	130	0.6734	0.2353	0.6734	0.8206
No log	2.75	132	0.6331	0.3153	0.6331	0.7957
No log	2.7917	134	0.6210	0.3714	0.6210	0.7880
No log	2.8333	136	0.6390	0.4329	0.6390	0.7993
No log	2.875	138	0.6369	0.4342	0.6369	0.7981
No log	2.9167	140	0.6590	0.4448	0.6590	0.8118
No log	2.9583	142	0.6613	0.4448	0.6613	0.8132
No log	3.0	144	0.6850	0.4302	0.6850	0.8276
No log	3.0417	146	0.7437	0.4531	0.7437	0.8624
No log	3.0833	148	0.6999	0.4872	0.6999	0.8366
No log	3.125	150	0.7066	0.4241	0.7066	0.8406
No log	3.1667	152	0.7612	0.3464	0.7612	0.8724
No log	3.2083	154	0.6940	0.4334	0.6940	0.8331
No log	3.25	156	0.6871	0.4360	0.6871	0.8289
No log	3.2917	158	0.6854	0.4444	0.6854	0.8279
No log	3.3333	160	0.6797	0.3243	0.6797	0.8245
No log	3.375	162	0.6815	0.4384	0.6815	0.8255
No log	3.4167	164	0.6755	0.4230	0.6755	0.8219
No log	3.4583	166	0.6782	0.4230	0.6782	0.8235
No log	3.5	168	0.6751	0.5457	0.6751	0.8216
No log	3.5417	170	0.6727	0.5239	0.6727	0.8202
No log	3.5833	172	0.6682	0.4389	0.6682	0.8174
No log	3.625	174	0.7098	0.4144	0.7098	0.8425
No log	3.6667	176	0.7197	0.4369	0.7197	0.8484
No log	3.7083	178	0.6625	0.4562	0.6625	0.8140
No log	3.75	180	0.6566	0.4245	0.6566	0.8103
No log	3.7917	182	0.6916	0.3946	0.6916	0.8316
No log	3.8333	184	0.6773	0.3946	0.6773	0.8230
No log	3.875	186	0.6689	0.3879	0.6689	0.8179
No log	3.9167	188	0.6424	0.3964	0.6424	0.8015
No log	3.9583	190	0.6559	0.3224	0.6559	0.8099
No log	4.0	192	0.6528	0.3224	0.6528	0.8080
No log	4.0417	194	0.6681	0.3763	0.6681	0.8174
No log	4.0833	196	0.6692	0.4020	0.6692	0.8180
No log	4.125	198	0.7264	0.4173	0.7264	0.8523
No log	4.1667	200	0.7006	0.4144	0.7006	0.8370
No log	4.2083	202	0.6607	0.4377	0.6607	0.8129
No log	4.25	204	0.6565	0.4222	0.6565	0.8103
No log	4.2917	206	0.6445	0.4575	0.6445	0.8028
No log	4.3333	208	0.6398	0.4010	0.6398	0.7999
No log	4.375	210	0.6262	0.3923	0.6262	0.7913
No log	4.4167	212	0.6147	0.4695	0.6147	0.7840
No log	4.4583	214	0.6087	0.4642	0.6087	0.7802
No log	4.5	216	0.6058	0.5048	0.6058	0.7784
No log	4.5417	218	0.6028	0.5542	0.6028	0.7764
No log	4.5833	220	0.6294	0.5204	0.6294	0.7934
No log	4.625	222	0.6182	0.4525	0.6182	0.7863
No log	4.6667	224	0.6054	0.4699	0.6054	0.7781
No log	4.7083	226	0.6011	0.3839	0.6011	0.7753
No log	4.75	228	0.5960	0.3890	0.5960	0.7720
No log	4.7917	230	0.6008	0.3945	0.6008	0.7751
No log	4.8333	232	0.5894	0.3890	0.5894	0.7677
No log	4.875	234	0.5972	0.4484	0.5972	0.7728
No log	4.9167	236	0.6319	0.3808	0.6319	0.7949
No log	4.9583	238	0.6576	0.4444	0.6576	0.8110
No log	5.0	240	0.7071	0.4670	0.7071	0.8409
No log	5.0417	242	0.6366	0.4562	0.6366	0.7979
No log	5.0833	244	0.6233	0.4681	0.6233	0.7895
No log	5.125	246	0.6244	0.4681	0.6244	0.7902
No log	5.1667	248	0.6553	0.4513	0.6553	0.8095
No log	5.2083	250	0.6558	0.4587	0.6558	0.8098
No log	5.25	252	0.6550	0.4822	0.6550	0.8093
No log	5.2917	254	0.6511	0.4609	0.6511	0.8069
No log	5.3333	256	0.6357	0.5383	0.6357	0.7973
No log	5.375	258	0.6671	0.4436	0.6671	0.8167
No log	5.4167	260	0.6389	0.4965	0.6389	0.7993
No log	5.4583	262	0.6050	0.5020	0.6050	0.7778
No log	5.5	264	0.6041	0.4847	0.6041	0.7772
No log	5.5417	266	0.6098	0.4642	0.6098	0.7809
No log	5.5833	268	0.6125	0.5286	0.6125	0.7826
No log	5.625	270	0.6433	0.4674	0.6433	0.8021
No log	5.6667	272	0.6358	0.4569	0.6358	0.7974
No log	5.7083	274	0.6095	0.5227	0.6095	0.7807
No log	5.75	276	0.6076	0.5227	0.6076	0.7795
No log	5.7917	278	0.6115	0.5171	0.6115	0.7820
No log	5.8333	280	0.5924	0.5326	0.5924	0.7697
No log	5.875	282	0.6034	0.4704	0.6034	0.7768
No log	5.9167	284	0.6138	0.4190	0.6138	0.7834
No log	5.9583	286	0.5936	0.4639	0.5936	0.7705
No log	6.0	288	0.5927	0.5042	0.5927	0.7699
No log	6.0417	290	0.5984	0.5397	0.5984	0.7736
No log	6.0833	292	0.5821	0.5444	0.5821	0.7629
No log	6.125	294	0.5903	0.5668	0.5903	0.7683
No log	6.1667	296	0.6331	0.5908	0.6331	0.7957
No log	6.2083	298	0.6225	0.5884	0.6225	0.7890
No log	6.25	300	0.5847	0.5988	0.5847	0.7646
No log	6.2917	302	0.6195	0.4018	0.6195	0.7871
No log	6.3333	304	0.7347	0.4396	0.7347	0.8571
No log	6.375	306	0.7966	0.3906	0.7966	0.8925
No log	6.4167	308	0.7491	0.3946	0.7491	0.8655
No log	6.4583	310	0.6450	0.4150	0.6450	0.8031
No log	6.5	312	0.5990	0.5768	0.5990	0.7739
No log	6.5417	314	0.6152	0.5947	0.6152	0.7843
No log	6.5833	316	0.6229	0.5528	0.6229	0.7893
No log	6.625	318	0.6086	0.5501	0.6086	0.7801
No log	6.6667	320	0.6089	0.5373	0.6089	0.7803
No log	6.7083	322	0.6208	0.4517	0.6208	0.7879
No log	6.75	324	0.6097	0.4703	0.6097	0.7808
No log	6.7917	326	0.6156	0.3123	0.6156	0.7846
No log	6.8333	328	0.6291	0.2243	0.6291	0.7931
No log	6.875	330	0.6393	0.1498	0.6393	0.7996
No log	6.9167	332	0.6310	0.1498	0.6310	0.7943
No log	6.9583	334	0.6388	0.3967	0.6388	0.7992
No log	7.0	336	0.6462	0.4719	0.6462	0.8039
No log	7.0417	338	0.6364	0.4271	0.6364	0.7977
No log	7.0833	340	0.5893	0.5692	0.5893	0.7677
No log	7.125	342	0.5766	0.5357	0.5766	0.7593
No log	7.1667	344	0.5723	0.4740	0.5723	0.7565
No log	7.2083	346	0.5588	0.5798	0.5588	0.7475
No log	7.25	348	0.5800	0.4480	0.5800	0.7615
No log	7.2917	350	0.5842	0.4499	0.5842	0.7643
No log	7.3333	352	0.5494	0.5617	0.5494	0.7412
No log	7.375	354	0.5509	0.4795	0.5509	0.7422
No log	7.4167	356	0.5657	0.4795	0.5657	0.7521
No log	7.4583	358	0.5481	0.4482	0.5481	0.7403
No log	7.5	360	0.5495	0.4923	0.5495	0.7413
No log	7.5417	362	0.5617	0.5266	0.5617	0.7495
No log	7.5833	364	0.5489	0.5037	0.5489	0.7408
No log	7.625	366	0.5543	0.4937	0.5543	0.7445
No log	7.6667	368	0.5903	0.5211	0.5903	0.7683
No log	7.7083	370	0.6053	0.5211	0.6053	0.7780
No log	7.75	372	0.6195	0.5605	0.6195	0.7871
No log	7.7917	374	0.6041	0.4956	0.6041	0.7772
No log	7.8333	376	0.5854	0.4970	0.5854	0.7651
No log	7.875	378	0.5641	0.4970	0.5641	0.7511
No log	7.9167	380	0.5548	0.5625	0.5548	0.7449
No log	7.9583	382	0.5545	0.4857	0.5545	0.7446
No log	8.0	384	0.5565	0.4538	0.5565	0.7460
No log	8.0417	386	0.5612	0.4111	0.5612	0.7491
No log	8.0833	388	0.5765	0.4547	0.5765	0.7593
No log	8.125	390	0.6316	0.4531	0.6316	0.7947
No log	8.1667	392	0.6504	0.4829	0.6504	0.8065
No log	8.2083	394	0.6158	0.5040	0.6158	0.7847
No log	8.25	396	0.6083	0.4767	0.6083	0.7799
No log	8.2917	398	0.6251	0.5345	0.6251	0.7907
No log	8.3333	400	0.6142	0.4574	0.6142	0.7837
No log	8.375	402	0.6210	0.4220	0.6210	0.7880
No log	8.4167	404	0.6268	0.4648	0.6268	0.7917
No log	8.4583	406	0.6372	0.4893	0.6372	0.7982
No log	8.5	408	0.6447	0.4610	0.6447	0.8029
No log	8.5417	410	0.6305	0.5179	0.6305	0.7941
No log	8.5833	412	0.5861	0.5552	0.5861	0.7656
No log	8.625	414	0.5818	0.5019	0.5818	0.7628
No log	8.6667	416	0.6066	0.4939	0.6066	0.7789
No log	8.7083	418	0.5919	0.5143	0.5919	0.7693
No log	8.75	420	0.5677	0.5044	0.5677	0.7535
No log	8.7917	422	0.5839	0.5871	0.5839	0.7641
No log	8.8333	424	0.5725	0.5211	0.5725	0.7566
No log	8.875	426	0.5488	0.4953	0.5488	0.7408
No log	8.9167	428	0.5566	0.4717	0.5566	0.7460
No log	8.9583	430	0.5867	0.5065	0.5867	0.7660
No log	9.0	432	0.6689	0.4279	0.6689	0.8179
No log	9.0417	434	0.6460	0.4477	0.6460	0.8037
No log	9.0833	436	0.5793	0.5318	0.5793	0.7611
No log	9.125	438	0.5875	0.6010	0.5875	0.7665
No log	9.1667	440	0.6191	0.4755	0.6191	0.7868
No log	9.2083	442	0.6434	0.4755	0.6434	0.8021
No log	9.25	444	0.6118	0.4749	0.6118	0.7822
No log	9.2917	446	0.5853	0.4945	0.5853	0.7651
No log	9.3333	448	0.5799	0.5671	0.5799	0.7615
No log	9.375	450	0.5790	0.5042	0.5790	0.7609
No log	9.4167	452	0.5792	0.4866	0.5792	0.7611
No log	9.4583	454	0.5799	0.5289	0.5799	0.7615
No log	9.5	456	0.6099	0.5323	0.6099	0.7809
No log	9.5417	458	0.6295	0.5368	0.6295	0.7934
No log	9.5833	460	0.6399	0.5368	0.6399	0.7999
No log	9.625	462	0.6220	0.5323	0.6220	0.7887
No log	9.6667	464	0.5845	0.5357	0.5845	0.7645
No log	9.7083	466	0.5869	0.5321	0.5869	0.7661
No log	9.75	468	0.6188	0.4215	0.6188	0.7866
No log	9.7917	470	0.6027	0.4869	0.6027	0.7764
No log	9.8333	472	0.5813	0.5473	0.5813	0.7624
No log	9.875	474	0.6018	0.5605	0.6018	0.7758
No log	9.9167	476	0.6126	0.5338	0.6126	0.7827
No log	9.9583	478	0.5996	0.5148	0.5996	0.7743
No log	10.0	480	0.5910	0.5488	0.5910	0.7688
No log	10.0417	482	0.5892	0.5286	0.5892	0.7676
No log	10.0833	484	0.5876	0.3837	0.5876	0.7666
No log	10.125	486	0.6054	0.4493	0.6054	0.7781
No log	10.1667	488	0.6155	0.4292	0.6155	0.7845
No log	10.2083	490	0.6332	0.4597	0.6332	0.7958
No log	10.25	492	0.6456	0.4606	0.6456	0.8035
No log	10.2917	494	0.6122	0.5426	0.6122	0.7824
No log	10.3333	496	0.5812	0.4222	0.5812	0.7623
No log	10.375	498	0.6052	0.5266	0.6052	0.7779
0.3036	10.4167	500	0.6155	0.4875	0.6155	0.7845
0.3036	10.4583	502	0.6105	0.4747	0.6105	0.7813
0.3036	10.5	504	0.5910	0.4747	0.5910	0.7688
0.3036	10.5417	506	0.5754	0.5161	0.5754	0.7585
0.3036	10.5833	508	0.5459	0.5227	0.5459	0.7388
0.3036	10.625	510	0.5500	0.5053	0.5500	0.7416
0.3036	10.6667	512	0.5700	0.5098	0.5700	0.7550
0.3036	10.7083	514	0.6056	0.5388	0.6056	0.7782
0.3036	10.75	516	0.6129	0.5293	0.6129	0.7829
0.3036	10.7917	518	0.5808	0.5445	0.5808	0.7621
0.3036	10.8333	520	0.5408	0.5817	0.5408	0.7354
0.3036	10.875	522	0.5345	0.5817	0.5345	0.7311
0.3036	10.9167	524	0.5303	0.5817	0.5303	0.7282
0.3036	10.9583	526	0.5308	0.4613	0.5308	0.7286
0.3036	11.0	528	0.5296	0.3808	0.5296	0.7277
0.3036	11.0417	530	0.5286	0.3808	0.5286	0.7271
0.3036	11.0833	532	0.5253	0.5061	0.5253	0.7248
0.3036	11.125	534	0.5420	0.5208	0.5420	0.7362
0.3036	11.1667	536	0.5299	0.6068	0.5299	0.7279
0.3036	11.2083	538	0.5184	0.5444	0.5184	0.7200
0.3036	11.25	540	0.5455	0.5639	0.5455	0.7386
0.3036	11.2917	542	0.5861	0.5445	0.5861	0.7655
0.3036	11.3333	544	0.5736	0.5673	0.5736	0.7574
0.3036	11.375	546	0.5575	0.5014	0.5575	0.7466
0.3036	11.4167	548	0.5442	0.5719	0.5442	0.7377
0.3036	11.4583	550	0.5541	0.5079	0.5541	0.7443
0.3036	11.5	552	0.5566	0.5493	0.5566	0.7461
0.3036	11.5417	554	0.5514	0.4569	0.5514	0.7426
0.3036	11.5833	556	0.5531	0.4569	0.5531	0.7437
0.3036	11.625	558	0.5751	0.4393	0.5751	0.7583
0.3036	11.6667	560	0.5741	0.4484	0.5741	0.7577
0.3036	11.7083	562	0.5560	0.4937	0.5560	0.7456
0.3036	11.75	564	0.5671	0.6479	0.5671	0.7530
0.3036	11.7917	566	0.5596	0.5902	0.5596	0.7481
0.3036	11.8333	568	0.5474	0.5888	0.5474	0.7399
0.3036	11.875	570	0.5404	0.5518	0.5404	0.7351
0.3036	11.9167	572	0.5339	0.5341	0.5339	0.7307
0.3036	11.9583	574	0.5285	0.5324	0.5285	0.7270
0.3036	12.0	576	0.5224	0.4837	0.5224	0.7228
0.3036	12.0417	578	0.5237	0.5584	0.5237	0.7237
0.3036	12.0833	580	0.5267	0.6229	0.5267	0.7257
0.3036	12.125	582	0.5271	0.6001	0.5271	0.7260
0.3036	12.1667	584	0.5305	0.6215	0.5305	0.7283
0.3036	12.2083	586	0.5347	0.5631	0.5347	0.7312
0.3036	12.25	588	0.5375	0.5386	0.5375	0.7331
0.3036	12.2917	590	0.5446	0.4867	0.5446	0.7379
0.3036	12.3333	592	0.5607	0.4592	0.5607	0.7488
0.3036	12.375	594	0.5835	0.4158	0.5835	0.7639
0.3036	12.4167	596	0.6291	0.4576	0.6291	0.7932
0.3036	12.4583	598	0.6338	0.4576	0.6338	0.7961

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1