ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9112
• Qwk: 0.4214
• Mse: 0.9112
• Rmse: 0.9546

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	3.8692	-0.0108	3.8692	1.9670
No log	0.1176	4	2.0589	0.1187	2.0589	1.4349
No log	0.1765	6	1.7129	0.0639	1.7129	1.3088
No log	0.2353	8	1.6614	0.1303	1.6614	1.2889
No log	0.2941	10	1.3907	0.0778	1.3907	1.1793
No log	0.3529	12	1.2176	0.1245	1.2176	1.1034
No log	0.4118	14	0.9470	0.4339	0.9470	0.9731
No log	0.4706	16	0.9081	0.3094	0.9081	0.9530
No log	0.5294	18	0.9753	0.2618	0.9753	0.9876
No log	0.5882	20	1.0737	0.2214	1.0737	1.0362
No log	0.6471	22	1.0429	0.1549	1.0429	1.0212
No log	0.7059	24	0.9941	0.3001	0.9941	0.9971
No log	0.7647	26	1.8116	0.1325	1.8116	1.3460
No log	0.8235	28	2.3047	-0.0111	2.3047	1.5181
No log	0.8824	30	1.6288	0.1084	1.6288	1.2762
No log	0.9412	32	1.1879	0.0878	1.1879	1.0899
No log	1.0	34	1.1906	0.1255	1.1906	1.0912
No log	1.0588	36	1.2015	0.1370	1.2015	1.0961
No log	1.1176	38	1.2420	0.1628	1.2420	1.1145
No log	1.1765	40	1.2388	0.2260	1.2388	1.1130
No log	1.2353	42	1.2204	0.2377	1.2204	1.1047
No log	1.2941	44	1.0530	0.2925	1.0530	1.0261
No log	1.3529	46	1.0141	0.2376	1.0141	1.0070
No log	1.4118	48	1.2000	0.1838	1.2000	1.0954
No log	1.4706	50	1.7127	0.1967	1.7127	1.3087
No log	1.5294	52	1.8202	0.1484	1.8202	1.3491
No log	1.5882	54	1.4228	0.1651	1.4228	1.1928
No log	1.6471	56	1.0644	0.2543	1.0644	1.0317
No log	1.7059	58	1.0075	0.2956	1.0075	1.0037
No log	1.7647	60	0.9786	0.3693	0.9786	0.9892
No log	1.8235	62	0.9619	0.3323	0.9619	0.9808
No log	1.8824	64	0.9676	0.2998	0.9676	0.9836
No log	1.9412	66	1.0973	0.2238	1.0973	1.0475
No log	2.0	68	1.1653	0.3344	1.1653	1.0795
No log	2.0588	70	1.0989	0.2857	1.0989	1.0483
No log	2.1176	72	0.9875	0.2549	0.9875	0.9937
No log	2.1765	74	1.0193	0.2316	1.0193	1.0096
No log	2.2353	76	1.3573	0.3095	1.3573	1.1650
No log	2.2941	78	1.7066	0.2299	1.7066	1.3064
No log	2.3529	80	1.5759	0.2689	1.5759	1.2553
No log	2.4118	82	1.3168	0.1817	1.3168	1.1475
No log	2.4706	84	1.1427	0.1739	1.1427	1.0690
No log	2.5294	86	1.0315	0.2352	1.0315	1.0156
No log	2.5882	88	0.9762	0.2063	0.9762	0.9880
No log	2.6471	90	0.9324	0.2954	0.9324	0.9656
No log	2.7059	92	0.9221	0.3271	0.9221	0.9603
No log	2.7647	94	0.9420	0.2348	0.9420	0.9706
No log	2.8235	96	0.9902	0.3142	0.9902	0.9951
No log	2.8824	98	0.8746	0.3818	0.8746	0.9352
No log	2.9412	100	0.8343	0.4411	0.8343	0.9134
No log	3.0	102	0.8400	0.4444	0.8400	0.9165
No log	3.0588	104	0.8216	0.4329	0.8216	0.9064
No log	3.1176	106	0.7866	0.4434	0.7866	0.8869
No log	3.1765	108	0.9532	0.3921	0.9532	0.9763
No log	3.2353	110	1.0351	0.3293	1.0351	1.0174
No log	3.2941	112	0.9121	0.4491	0.9121	0.9550
No log	3.3529	114	0.9448	0.4615	0.9448	0.9720
No log	3.4118	116	1.2167	0.3701	1.2167	1.1030
No log	3.4706	118	0.9896	0.4023	0.9896	0.9948
No log	3.5294	120	0.8531	0.4871	0.8531	0.9237
No log	3.5882	122	0.8939	0.4313	0.8939	0.9455
No log	3.6471	124	0.9356	0.4228	0.9356	0.9673
No log	3.7059	126	0.8174	0.5190	0.8174	0.9041
No log	3.7647	128	0.8419	0.5636	0.8419	0.9175
No log	3.8235	130	0.8262	0.4277	0.8262	0.9089
No log	3.8824	132	0.8212	0.5213	0.8212	0.9062
No log	3.9412	134	0.9017	0.4829	0.9017	0.9496
No log	4.0	136	1.0753	0.4067	1.0753	1.0370
No log	4.0588	138	0.9695	0.4815	0.9695	0.9846
No log	4.1176	140	0.9178	0.3042	0.9178	0.9580
No log	4.1765	142	1.2064	0.3715	1.2064	1.0983
No log	4.2353	144	1.4480	0.3539	1.4480	1.2033
No log	4.2941	146	1.2732	0.3579	1.2732	1.1284
No log	4.3529	148	0.9160	0.3976	0.9160	0.9571
No log	4.4118	150	0.8667	0.5355	0.8667	0.9310
No log	4.4706	152	1.0544	0.4191	1.0544	1.0268
No log	4.5294	154	1.0152	0.5307	1.0152	1.0076
No log	4.5882	156	0.8480	0.4839	0.8480	0.9208
No log	4.6471	158	0.8785	0.3596	0.8785	0.9373
No log	4.7059	160	1.0804	0.4265	1.0804	1.0394
No log	4.7647	162	1.0758	0.4854	1.0758	1.0372
No log	4.8235	164	0.8981	0.3976	0.8981	0.9477
No log	4.8824	166	0.7878	0.4938	0.7878	0.8876
No log	4.9412	168	0.8048	0.5057	0.8048	0.8971
No log	5.0	170	0.8639	0.5147	0.8639	0.9295
No log	5.0588	172	0.8271	0.5267	0.8271	0.9095
No log	5.1176	174	0.8042	0.5459	0.8042	0.8968
No log	5.1765	176	0.8485	0.4998	0.8485	0.9211
No log	5.2353	178	0.9456	0.4166	0.9456	0.9724
No log	5.2941	180	0.8772	0.4444	0.8772	0.9366
No log	5.3529	182	0.7949	0.4611	0.7949	0.8916
No log	5.4118	184	0.7781	0.4661	0.7781	0.8821
No log	5.4706	186	0.8051	0.5267	0.8051	0.8973
No log	5.5294	188	0.7639	0.5500	0.7639	0.8740
No log	5.5882	190	0.7562	0.5673	0.7562	0.8696
No log	5.6471	192	0.7534	0.5945	0.7534	0.8680
No log	5.7059	194	0.7688	0.5500	0.7688	0.8768
No log	5.7647	196	0.7775	0.5279	0.7775	0.8817
No log	5.8235	198	0.7783	0.5471	0.7783	0.8822
No log	5.8824	200	0.8113	0.5035	0.8113	0.9007
No log	5.9412	202	0.8516	0.5480	0.8516	0.9228
No log	6.0	204	0.8978	0.5559	0.8978	0.9475
No log	6.0588	206	0.9413	0.4757	0.9413	0.9702
No log	6.1176	208	1.0071	0.4222	1.0071	1.0035
No log	6.1765	210	0.9513	0.4635	0.9513	0.9753
No log	6.2353	212	0.9278	0.5111	0.9278	0.9632
No log	6.2941	214	0.9194	0.4676	0.9194	0.9588
No log	6.3529	216	0.9181	0.4871	0.9181	0.9582
No log	6.4118	218	0.9074	0.4419	0.9074	0.9526
No log	6.4706	220	0.9069	0.4175	0.9069	0.9523
No log	6.5294	222	0.9074	0.5085	0.9074	0.9526
No log	6.5882	224	0.9043	0.4575	0.9043	0.9509
No log	6.6471	226	0.9261	0.5161	0.9261	0.9623
No log	6.7059	228	0.9019	0.4915	0.9019	0.9497
No log	6.7647	230	0.9118	0.4846	0.9118	0.9549
No log	6.8235	232	0.9142	0.4620	0.9142	0.9561
No log	6.8824	234	0.8976	0.4366	0.8976	0.9474
No log	6.9412	236	0.8748	0.3897	0.8748	0.9353
No log	7.0	238	0.8796	0.3747	0.8796	0.9379
No log	7.0588	240	0.8837	0.3841	0.8837	0.9401
No log	7.1176	242	0.8822	0.4430	0.8822	0.9393
No log	7.1765	244	0.8910	0.5074	0.8910	0.9439
No log	7.2353	246	0.9662	0.4930	0.9662	0.9830
No log	7.2941	248	1.0528	0.3556	1.0528	1.0261
No log	7.3529	250	1.0680	0.3893	1.0680	1.0334
No log	7.4118	252	0.9719	0.3844	0.9719	0.9859
No log	7.4706	254	0.9099	0.3272	0.9099	0.9539
No log	7.5294	256	0.9307	0.3052	0.9307	0.9647
No log	7.5882	258	0.9345	0.3172	0.9345	0.9667
No log	7.6471	260	0.9425	0.3272	0.9425	0.9708
No log	7.7059	262	0.9555	0.3563	0.9555	0.9775
No log	7.7647	264	0.9528	0.3493	0.9528	0.9761
No log	7.8235	266	0.9486	0.3402	0.9486	0.9740
No log	7.8824	268	0.9395	0.3075	0.9395	0.9693
No log	7.9412	270	0.9308	0.3243	0.9308	0.9648
No log	8.0	272	0.9283	0.3358	0.9283	0.9635
No log	8.0588	274	0.9344	0.3590	0.9344	0.9667
No log	8.1176	276	0.9180	0.3950	0.9180	0.9581
No log	8.1765	278	0.9422	0.3817	0.9422	0.9706
No log	8.2353	280	0.9177	0.4691	0.9177	0.9580
No log	8.2941	282	0.9398	0.3596	0.9398	0.9694
No log	8.3529	284	1.0449	0.3756	1.0449	1.0222
No log	8.4118	286	1.0281	0.3775	1.0281	1.0139
No log	8.4706	288	0.9296	0.3771	0.9296	0.9641
No log	8.5294	290	0.8737	0.4375	0.8737	0.9347
No log	8.5882	292	0.9135	0.4131	0.9135	0.9558
No log	8.6471	294	1.0223	0.4030	1.0223	1.0111
No log	8.7059	296	1.0271	0.3573	1.0271	1.0135
No log	8.7647	298	0.9763	0.3742	0.9763	0.9881
No log	8.8235	300	0.9624	0.3618	0.9624	0.9810
No log	8.8824	302	0.9746	0.3535	0.9746	0.9872
No log	8.9412	304	1.0152	0.3558	1.0152	1.0076
No log	9.0	306	1.0640	0.3081	1.0640	1.0315
No log	9.0588	308	1.0621	0.3119	1.0621	1.0306
No log	9.1176	310	0.9522	0.3491	0.9522	0.9758
No log	9.1765	312	0.8810	0.4192	0.8810	0.9386
No log	9.2353	314	0.8729	0.5179	0.8729	0.9343
No log	9.2941	316	0.8425	0.4810	0.8425	0.9179
No log	9.3529	318	0.8525	0.4435	0.8525	0.9233
No log	9.4118	320	0.8778	0.4607	0.8778	0.9369
No log	9.4706	322	0.8659	0.4722	0.8659	0.9305
No log	9.5294	324	0.8187	0.4459	0.8187	0.9048
No log	9.5882	326	0.8084	0.5057	0.8084	0.8991
No log	9.6471	328	0.8195	0.4721	0.8195	0.9053
No log	9.7059	330	0.8145	0.5057	0.8145	0.9025
No log	9.7647	332	0.8138	0.5057	0.8138	0.9021
No log	9.8235	334	0.8146	0.5063	0.8146	0.9025
No log	9.8824	336	0.8643	0.4556	0.8643	0.9297
No log	9.9412	338	0.8690	0.4672	0.8690	0.9322
No log	10.0	340	0.8101	0.4819	0.8101	0.9000
No log	10.0588	342	0.8087	0.4305	0.8087	0.8993
No log	10.1176	344	0.8082	0.4757	0.8082	0.8990
No log	10.1765	346	0.7952	0.4660	0.7952	0.8918
No log	10.2353	348	0.7994	0.4888	0.7994	0.8941
No log	10.2941	350	0.8021	0.4660	0.8021	0.8956
No log	10.3529	352	0.8113	0.5166	0.8113	0.9007
No log	10.4118	354	0.8137	0.5275	0.8137	0.9021
No log	10.4706	356	0.8243	0.5120	0.8243	0.9079
No log	10.5294	358	0.8413	0.5303	0.8413	0.9172
No log	10.5882	360	0.8587	0.5495	0.8587	0.9267
No log	10.6471	362	0.8475	0.5106	0.8475	0.9206
No log	10.7059	364	0.8577	0.4718	0.8577	0.9261
No log	10.7647	366	0.8956	0.4077	0.8956	0.9464
No log	10.8235	368	0.9153	0.4077	0.9153	0.9567
No log	10.8824	370	0.8856	0.4490	0.8856	0.9411
No log	10.9412	372	0.8732	0.4598	0.8732	0.9344
No log	11.0	374	0.8634	0.4581	0.8634	0.9292
No log	11.0588	376	0.8583	0.4581	0.8583	0.9265
No log	11.1176	378	0.8574	0.4581	0.8574	0.9260
No log	11.1765	380	0.8570	0.4903	0.8570	0.9257
No log	11.2353	382	0.8723	0.4749	0.8723	0.9340
No log	11.2941	384	0.8606	0.4885	0.8606	0.9277
No log	11.3529	386	0.8500	0.4920	0.8500	0.9220
No log	11.4118	388	0.8361	0.5057	0.8361	0.9144
No log	11.4706	390	0.8328	0.4845	0.8328	0.9126
No log	11.5294	392	0.8237	0.5274	0.8237	0.9076
No log	11.5882	394	0.8337	0.4630	0.8337	0.9131
No log	11.6471	396	0.8407	0.4768	0.8407	0.9169
No log	11.7059	398	0.8510	0.4662	0.8510	0.9225
No log	11.7647	400	0.8561	0.5203	0.8561	0.9252
No log	11.8235	402	0.9125	0.5152	0.9125	0.9553
No log	11.8824	404	0.9095	0.5152	0.9095	0.9537
No log	11.9412	406	0.8623	0.5102	0.8623	0.9286
No log	12.0	408	0.8346	0.5261	0.8346	0.9136
No log	12.0588	410	0.8404	0.4368	0.8404	0.9167
No log	12.1176	412	0.8519	0.4466	0.8519	0.9230
No log	12.1765	414	0.8254	0.4237	0.8254	0.9085
No log	12.2353	416	0.8105	0.4594	0.8105	0.9003
No log	12.2941	418	0.8457	0.4284	0.8457	0.9196
No log	12.3529	420	0.8154	0.4486	0.8154	0.9030
No log	12.4118	422	0.8272	0.5057	0.8272	0.9095
No log	12.4706	424	0.9208	0.5114	0.9208	0.9596
No log	12.5294	426	0.9518	0.4694	0.9518	0.9756
No log	12.5882	428	0.8540	0.5537	0.8540	0.9241
No log	12.6471	430	0.7822	0.5002	0.7822	0.8844
No log	12.7059	432	0.7808	0.4469	0.7808	0.8836
No log	12.7647	434	0.8126	0.5469	0.8126	0.9015
No log	12.8235	436	0.8116	0.5469	0.8116	0.9009
No log	12.8824	438	0.8133	0.5315	0.8133	0.9018
No log	12.9412	440	0.8241	0.4647	0.8241	0.9078
No log	13.0	442	0.8817	0.4812	0.8817	0.9390
No log	13.0588	444	0.8742	0.4115	0.8742	0.9350
No log	13.1176	446	0.8352	0.4110	0.8352	0.9139
No log	13.1765	448	0.8190	0.4279	0.8190	0.9050
No log	13.2353	450	0.8165	0.4297	0.8165	0.9036
No log	13.2941	452	0.8151	0.4429	0.8151	0.9029
No log	13.3529	454	0.8054	0.4434	0.8054	0.8974
No log	13.4118	456	0.8192	0.4596	0.8192	0.9051
No log	13.4706	458	0.8203	0.4235	0.8203	0.9057
No log	13.5294	460	0.8182	0.4186	0.8182	0.9045
No log	13.5882	462	0.8385	0.3965	0.8385	0.9157
No log	13.6471	464	0.8973	0.5370	0.8973	0.9472
No log	13.7059	466	0.8879	0.5059	0.8879	0.9423
No log	13.7647	468	0.8445	0.4089	0.8445	0.9190
No log	13.8235	470	0.8707	0.4142	0.8707	0.9331
No log	13.8824	472	0.8817	0.3925	0.8817	0.9390
No log	13.9412	474	0.8407	0.4352	0.8407	0.9169
No log	14.0	476	0.8779	0.5072	0.8779	0.9369
No log	14.0588	478	0.9380	0.5119	0.9380	0.9685
No log	14.1176	480	0.9256	0.5443	0.9256	0.9621
No log	14.1765	482	0.8791	0.4752	0.8791	0.9376
No log	14.2353	484	0.8510	0.4434	0.8510	0.9225
No log	14.2941	486	0.8495	0.4434	0.8495	0.9217
No log	14.3529	488	0.8580	0.4647	0.8580	0.9263
No log	14.4118	490	0.8815	0.4634	0.8815	0.9389
No log	14.4706	492	0.9469	0.4810	0.9469	0.9731
No log	14.5294	494	0.9192	0.4620	0.9192	0.9587
No log	14.5882	496	0.8750	0.4518	0.8750	0.9354
No log	14.6471	498	0.8705	0.4719	0.8705	0.9330
0.2954	14.7059	500	0.8830	0.4963	0.8830	0.9397
0.2954	14.7647	502	0.8540	0.4936	0.8540	0.9241
0.2954	14.8235	504	0.8620	0.4857	0.8620	0.9285
0.2954	14.8824	506	0.9292	0.4500	0.9292	0.9640
0.2954	14.9412	508	0.9364	0.4907	0.9364	0.9677
0.2954	15.0	510	0.9112	0.4214	0.9112	0.9546

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1