ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k4_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6978
• Qwk: 0.7211
• Mse: 0.6978
• Rmse: 0.8353

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	7.0547	0.0056	7.0547	2.6561
No log	0.2222	4	4.6484	0.0235	4.6484	2.1560
No log	0.3333	6	3.4077	-0.0437	3.4077	1.8460
No log	0.4444	8	4.5891	-0.0748	4.5891	2.1422
No log	0.5556	10	4.6588	-0.0086	4.6588	2.1584
No log	0.6667	12	3.7718	-0.1152	3.7718	1.9421
No log	0.7778	14	2.7144	0.0839	2.7144	1.6475
No log	0.8889	16	2.2561	0.1654	2.2561	1.5020
No log	1.0	18	2.6207	0.1769	2.6207	1.6188
No log	1.1111	20	2.9479	0.1420	2.9479	1.7170
No log	1.2222	22	2.8226	0.1882	2.8226	1.6801
No log	1.3333	24	2.9339	0.1648	2.9339	1.7129
No log	1.4444	26	2.5850	0.1988	2.5850	1.6078
No log	1.5556	28	2.0667	0.2313	2.0667	1.4376
No log	1.6667	30	1.7268	0.3939	1.7268	1.3141
No log	1.7778	32	1.5881	0.3939	1.5881	1.2602
No log	1.8889	34	1.9281	0.3529	1.9281	1.3886
No log	2.0	36	2.0897	0.3353	2.0897	1.4456
No log	2.1111	38	2.1717	0.3468	2.1717	1.4737
No log	2.2222	40	2.9414	0.2723	2.9414	1.7151
No log	2.3333	42	3.8018	0.2155	3.8018	1.9498
No log	2.4444	44	3.5590	0.2478	3.5590	1.8865
No log	2.5556	46	2.0929	0.3353	2.0929	1.4467
No log	2.6667	48	1.3258	0.5180	1.3258	1.1514
No log	2.7778	50	1.3517	0.5	1.3517	1.1626
No log	2.8889	52	1.6722	0.4648	1.6722	1.2931
No log	3.0	54	1.8183	0.4161	1.8183	1.3485
No log	3.1111	56	1.8662	0.3268	1.8662	1.3661
No log	3.2222	58	1.8592	0.3671	1.8592	1.3635
No log	3.3333	60	1.7115	0.4768	1.7115	1.3083
No log	3.4444	62	1.4526	0.5070	1.4526	1.2052
No log	3.5556	64	1.3428	0.5211	1.3428	1.1588
No log	3.6667	66	1.3118	0.5211	1.3118	1.1453
No log	3.7778	68	1.7581	0.4420	1.7581	1.3259
No log	3.8889	70	3.0006	0.2909	3.0006	1.7322
No log	4.0	72	3.4938	0.2712	3.4938	1.8692
No log	4.1111	74	2.5798	0.4259	2.5798	1.6062
No log	4.2222	76	1.3631	0.5668	1.3631	1.1675
No log	4.3333	78	0.9086	0.6490	0.9086	0.9532
No log	4.4444	80	0.8876	0.6839	0.8876	0.9421
No log	4.5556	82	1.0562	0.6786	1.0562	1.0277
No log	4.6667	84	1.3613	0.5856	1.3613	1.1667
No log	4.7778	86	1.3994	0.5843	1.3994	1.1830
No log	4.8889	88	1.2643	0.6145	1.2643	1.1244
No log	5.0	90	0.9110	0.6706	0.9110	0.9545
No log	5.1111	92	0.8152	0.7081	0.8152	0.9029
No log	5.2222	94	0.7936	0.7515	0.7936	0.8909
No log	5.3333	96	0.9740	0.7052	0.9740	0.9869
No log	5.4444	98	1.0369	0.6742	1.0369	1.0183
No log	5.5556	100	0.8156	0.7093	0.8156	0.9031
No log	5.6667	102	0.8078	0.6806	0.8078	0.8988
No log	5.7778	104	0.8614	0.6906	0.8614	0.9281
No log	5.8889	106	0.8391	0.6939	0.8391	0.9160
No log	6.0	108	1.0164	0.6824	1.0164	1.0082
No log	6.1111	110	1.1544	0.6591	1.1544	1.0744
No log	6.2222	112	0.9878	0.6667	0.9878	0.9939
No log	6.3333	114	0.8696	0.6667	0.8696	0.9325
No log	6.4444	116	0.8774	0.6951	0.8774	0.9367
No log	6.5556	118	1.0362	0.6667	1.0362	1.0180
No log	6.6667	120	0.9867	0.6860	0.9867	0.9933
No log	6.7778	122	0.8616	0.7337	0.8616	0.9282
No log	6.8889	124	0.8564	0.6624	0.8564	0.9254
No log	7.0	126	0.8554	0.7368	0.8554	0.9249
No log	7.1111	128	1.0437	0.6706	1.0437	1.0216
No log	7.2222	130	0.9801	0.6709	0.9801	0.9900
No log	7.3333	132	0.8979	0.6389	0.8979	0.9476
No log	7.4444	134	0.8575	0.6187	0.8575	0.9260
No log	7.5556	136	0.8504	0.6483	0.8504	0.9221
No log	7.6667	138	0.8326	0.6667	0.8326	0.9125
No log	7.7778	140	0.8238	0.6620	0.8238	0.9076
No log	7.8889	142	0.8118	0.6486	0.8118	0.9010
No log	8.0	144	0.8153	0.7296	0.8153	0.9029
No log	8.1111	146	0.8282	0.7125	0.8282	0.9101
No log	8.2222	148	0.8723	0.7018	0.8723	0.9340
No log	8.3333	150	0.8415	0.7407	0.8415	0.9173
No log	8.4444	152	0.7948	0.7205	0.7948	0.8915
No log	8.5556	154	0.8086	0.7407	0.8086	0.8992
No log	8.6667	156	0.8168	0.7219	0.8168	0.9038
No log	8.7778	158	0.9458	0.7396	0.9458	0.9725
No log	8.8889	160	1.1412	0.7129	1.1412	1.0682
No log	9.0	162	0.9868	0.7150	0.9868	0.9934
No log	9.1111	164	0.8228	0.7667	0.8228	0.9071
No log	9.2222	166	0.8252	0.7108	0.8252	0.9084
No log	9.3333	168	0.8377	0.6988	0.8377	0.9152
No log	9.4444	170	0.8780	0.7101	0.8780	0.9370
No log	9.5556	172	0.9847	0.6897	0.9847	0.9923
No log	9.6667	174	1.0219	0.6971	1.0219	1.0109
No log	9.7778	176	0.8999	0.6316	0.8999	0.9486
No log	9.8889	178	0.8867	0.6490	0.8867	0.9417
No log	10.0	180	0.8871	0.6835	0.8871	0.9419
No log	10.1111	182	1.0357	0.7045	1.0357	1.0177
No log	10.2222	184	0.9997	0.6860	0.9997	0.9998
No log	10.3333	186	1.0146	0.6784	1.0146	1.0073
No log	10.4444	188	1.1736	0.6629	1.1736	1.0833
No log	10.5556	190	0.9444	0.6982	0.9444	0.9718
No log	10.6667	192	0.7860	0.7089	0.7860	0.8865
No log	10.7778	194	0.8119	0.6857	0.8119	0.9010
No log	10.8889	196	0.8692	0.6761	0.8692	0.9323
No log	11.0	198	1.1472	0.6154	1.1472	1.0711
No log	11.1111	200	1.5654	0.5150	1.5654	1.2511
No log	11.2222	202	1.4927	0.5263	1.4927	1.2218
No log	11.3333	204	1.0815	0.6543	1.0815	1.0400
No log	11.4444	206	0.8216	0.6711	0.8216	0.9064
No log	11.5556	208	0.8339	0.7237	0.8339	0.9132
No log	11.6667	210	0.8380	0.6747	0.8380	0.9154
No log	11.7778	212	1.0493	0.7243	1.0493	1.0243
No log	11.8889	214	1.5092	0.56	1.5092	1.2285
No log	12.0	216	1.5109	0.5714	1.5109	1.2292
No log	12.1111	218	1.1175	0.6923	1.1175	1.0571
No log	12.2222	220	0.9319	0.6707	0.9319	0.9653
No log	12.3333	222	0.8524	0.7179	0.8524	0.9232
No log	12.4444	224	0.9103	0.6667	0.9103	0.9541
No log	12.5556	226	0.9550	0.6667	0.9550	0.9772
No log	12.6667	228	0.9971	0.6452	0.9971	0.9986
No log	12.7778	230	0.9625	0.6538	0.9625	0.9811
No log	12.8889	232	1.0447	0.6707	1.0447	1.0221
No log	13.0	234	1.1176	0.6628	1.1176	1.0572
No log	13.1111	236	0.9744	0.7086	0.9744	0.9871
No log	13.2222	238	0.7997	0.7529	0.7997	0.8943
No log	13.3333	240	0.7782	0.7305	0.7782	0.8821
No log	13.4444	242	0.7816	0.7229	0.7816	0.8841
No log	13.5556	244	0.7876	0.7362	0.7876	0.8875
No log	13.6667	246	0.7789	0.7284	0.7789	0.8826
No log	13.7778	248	0.7847	0.7531	0.7847	0.8858
No log	13.8889	250	0.7837	0.7929	0.7837	0.8853
No log	14.0	252	0.7579	0.7636	0.7579	0.8706
No log	14.1111	254	0.7181	0.7564	0.7181	0.8474
No log	14.2222	256	0.7257	0.7260	0.7257	0.8519
No log	14.3333	258	0.7504	0.7075	0.7504	0.8662
No log	14.4444	260	0.7491	0.7075	0.7491	0.8655
No log	14.5556	262	0.7337	0.7950	0.7337	0.8565
No log	14.6667	264	0.7741	0.7765	0.7741	0.8798
No log	14.7778	266	0.7483	0.7516	0.7483	0.8651
No log	14.8889	268	0.7376	0.7436	0.7376	0.8588
No log	15.0	270	0.7530	0.7375	0.7530	0.8677
No log	15.1111	272	0.7750	0.7561	0.7750	0.8804
No log	15.2222	274	0.7955	0.7561	0.7955	0.8919
No log	15.3333	276	0.7659	0.7636	0.7659	0.8751
No log	15.4444	278	0.8039	0.7160	0.8039	0.8966
No log	15.5556	280	0.7866	0.7160	0.7866	0.8869
No log	15.6667	282	0.7261	0.7403	0.7261	0.8521
No log	15.7778	284	0.7308	0.7285	0.7308	0.8549
No log	15.8889	286	0.7652	0.6832	0.7652	0.8747
No log	16.0	288	0.8155	0.7425	0.8155	0.9031
No log	16.1111	290	0.8414	0.7349	0.8414	0.9173
No log	16.2222	292	0.9092	0.6905	0.9092	0.9535
No log	16.3333	294	0.9350	0.6826	0.9350	0.9669
No log	16.4444	296	0.8281	0.7152	0.8282	0.9100
No log	16.5556	298	0.7634	0.7170	0.7634	0.8738
No log	16.6667	300	0.7936	0.7407	0.7936	0.8908
No log	16.7778	302	0.9323	0.6626	0.9323	0.9656
No log	16.8889	304	1.0003	0.6588	1.0003	1.0002
No log	17.0	306	0.8831	0.6786	0.8831	0.9397
No log	17.1111	308	0.7336	0.7952	0.7336	0.8565
No log	17.2222	310	0.7233	0.7059	0.7233	0.8504
No log	17.3333	312	0.7209	0.7027	0.7209	0.8491
No log	17.4444	314	0.7154	0.7582	0.7154	0.8458
No log	17.5556	316	0.7832	0.725	0.7832	0.8850
No log	17.6667	318	0.7845	0.7179	0.7845	0.8857
No log	17.7778	320	0.7287	0.7417	0.7287	0.8536
No log	17.8889	322	0.7174	0.7222	0.7174	0.8470
No log	18.0	324	0.7769	0.7310	0.7769	0.8814
No log	18.1111	326	0.8315	0.6849	0.8315	0.9119
No log	18.2222	328	0.7651	0.7347	0.7651	0.8747
No log	18.3333	330	0.7047	0.7152	0.7047	0.8395
No log	18.4444	332	0.7439	0.7848	0.7439	0.8625
No log	18.5556	334	0.7336	0.7742	0.7336	0.8565
No log	18.6667	336	0.7538	0.7162	0.7538	0.8682
No log	18.7778	338	0.8783	0.7092	0.8783	0.9372
No log	18.8889	340	0.9254	0.6286	0.9254	0.9620
No log	19.0	342	0.8321	0.7183	0.8321	0.9122
No log	19.1111	344	0.7238	0.7162	0.7238	0.8508
No log	19.2222	346	0.7142	0.7451	0.7142	0.8451
No log	19.3333	348	0.7090	0.7451	0.7090	0.8420
No log	19.4444	350	0.6969	0.7162	0.6969	0.8348
No log	19.5556	352	0.7937	0.6897	0.7937	0.8909
No log	19.6667	354	0.8783	0.6667	0.8783	0.9372
No log	19.7778	356	0.8125	0.6897	0.8125	0.9014
No log	19.8889	358	0.7511	0.7172	0.7511	0.8667
No log	20.0	360	0.7273	0.7297	0.7273	0.8528
No log	20.1111	362	0.7378	0.6986	0.7378	0.8589
No log	20.2222	364	0.7618	0.6986	0.7618	0.8728
No log	20.3333	366	0.7716	0.7234	0.7716	0.8784
No log	20.4444	368	0.7794	0.7172	0.7794	0.8828
No log	20.5556	370	0.7880	0.6950	0.7880	0.8877
No log	20.6667	372	0.7912	0.7	0.7912	0.8895
No log	20.7778	374	0.7693	0.7101	0.7693	0.8771
No log	20.8889	376	0.7678	0.7101	0.7678	0.8763
No log	21.0	378	0.7514	0.7286	0.7514	0.8669
No log	21.1111	380	0.7358	0.7286	0.7358	0.8578
No log	21.2222	382	0.7094	0.7413	0.7094	0.8423
No log	21.3333	384	0.6884	0.7361	0.6884	0.8297
No log	21.4444	386	0.6746	0.7550	0.6746	0.8213
No log	21.5556	388	0.6699	0.7875	0.6699	0.8185
No log	21.6667	390	0.6876	0.7875	0.6876	0.8292
No log	21.7778	392	0.7168	0.7595	0.7168	0.8466
No log	21.8889	394	0.7190	0.7692	0.7190	0.8479
No log	22.0	396	0.7020	0.7848	0.7020	0.8378
No log	22.1111	398	0.6895	0.7771	0.6895	0.8304
No log	22.2222	400	0.7637	0.7636	0.7637	0.8739
No log	22.3333	402	0.8862	0.7030	0.8862	0.9414
No log	22.4444	404	0.8523	0.7362	0.8523	0.9232
No log	22.5556	406	0.7192	0.7799	0.7192	0.8481
No log	22.6667	408	0.6834	0.7368	0.6834	0.8267
No log	22.7778	410	0.6564	0.7550	0.6564	0.8102
No log	22.8889	412	0.6563	0.7383	0.6563	0.8101
No log	23.0	414	0.6845	0.7368	0.6845	0.8273
No log	23.1111	416	0.7294	0.7531	0.7294	0.8541
No log	23.2222	418	0.7712	0.7362	0.7712	0.8782
No log	23.3333	420	0.8089	0.7160	0.8089	0.8994
No log	23.4444	422	0.7489	0.7439	0.7489	0.8654
No log	23.5556	424	0.6899	0.7531	0.6899	0.8306
No log	23.6667	426	0.6815	0.775	0.6815	0.8256
No log	23.7778	428	0.7380	0.7329	0.7380	0.8590
No log	23.8889	430	0.7695	0.7439	0.7695	0.8772
No log	24.0	432	0.7176	0.7407	0.7176	0.8471
No log	24.1111	434	0.7051	0.7355	0.7051	0.8397
No log	24.2222	436	0.7281	0.7215	0.7281	0.8533
No log	24.3333	438	0.7408	0.7226	0.7408	0.8607
No log	24.4444	440	0.7512	0.7237	0.7512	0.8667
No log	24.5556	442	0.7388	0.7273	0.7388	0.8595
No log	24.6667	444	0.7426	0.7273	0.7426	0.8617
No log	24.7778	446	0.7335	0.7333	0.7335	0.8565
No log	24.8889	448	0.7178	0.7297	0.7178	0.8473
No log	25.0	450	0.7097	0.7448	0.7097	0.8424
No log	25.1111	452	0.7062	0.7448	0.7062	0.8403
No log	25.2222	454	0.6913	0.7383	0.6913	0.8314
No log	25.3333	456	0.6787	0.7383	0.6787	0.8238
No log	25.4444	458	0.6791	0.7582	0.6791	0.8240
No log	25.5556	460	0.6861	0.7730	0.6861	0.8283
No log	25.6667	462	0.7252	0.7831	0.7252	0.8516
No log	25.7778	464	0.8031	0.7024	0.8031	0.8962
No log	25.8889	466	0.7662	0.7229	0.7662	0.8754
No log	26.0	468	0.7206	0.7831	0.7206	0.8489
No log	26.1111	470	0.6804	0.7531	0.6804	0.8249
No log	26.2222	472	0.6989	0.7389	0.6989	0.8360
No log	26.3333	474	0.7461	0.6962	0.7461	0.8638
No log	26.4444	476	0.8449	0.7081	0.8449	0.9192
No log	26.5556	478	0.7971	0.7284	0.7971	0.8928
No log	26.6667	480	0.7036	0.7831	0.7036	0.8388
No log	26.7778	482	0.6604	0.7853	0.6604	0.8127
No log	26.8889	484	0.6610	0.7320	0.6610	0.8130
No log	27.0	486	0.7248	0.7310	0.7248	0.8513
No log	27.1111	488	0.7217	0.7260	0.7217	0.8495
No log	27.2222	490	0.6694	0.7297	0.6694	0.8182
No log	27.3333	492	0.6594	0.7368	0.6594	0.8120
No log	27.4444	494	0.6819	0.7297	0.6819	0.8258
No log	27.5556	496	0.7288	0.7075	0.7288	0.8537
No log	27.6667	498	0.7152	0.7260	0.7152	0.8457
0.3561	27.7778	500	0.7010	0.7297	0.7010	0.8373
0.3561	27.8889	502	0.6601	0.7285	0.6601	0.8124
0.3561	28.0	504	0.7361	0.7329	0.7361	0.8579
0.3561	28.1111	506	0.8866	0.7081	0.8866	0.9416
0.3561	28.2222	508	0.8659	0.7081	0.8659	0.9305
0.3561	28.3333	510	0.7676	0.7226	0.7676	0.8762
0.3561	28.4444	512	0.7090	0.7162	0.7090	0.8420
0.3561	28.5556	514	0.6978	0.7211	0.6978	0.8353

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1