ArabicNewSplits5_FineTuningAraBERT_run2_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8046
• Qwk: 0.6339
• Mse: 0.8046
• Rmse: 0.8970

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.05	2	5.4572	-0.0191	5.4572	2.3361
No log	0.1	4	3.4059	0.0729	3.4059	1.8455
No log	0.15	6	2.6712	-0.0456	2.6712	1.6344
No log	0.2	8	2.0344	0.0562	2.0344	1.4263
No log	0.25	10	1.5923	0.1084	1.5923	1.2619
No log	0.3	12	1.3997	0.1769	1.3997	1.1831
No log	0.35	14	1.1875	0.3021	1.1875	1.0897
No log	0.4	16	1.1987	0.2784	1.1987	1.0949
No log	0.45	18	1.3411	0.0663	1.3411	1.1580
No log	0.5	20	1.5711	0.0720	1.5711	1.2534
No log	0.55	22	1.5553	0.0763	1.5553	1.2471
No log	0.6	24	1.2437	0.2582	1.2437	1.1152
No log	0.65	26	1.2223	0.3017	1.2223	1.1056
No log	0.7	28	1.5918	0.1162	1.5918	1.2617
No log	0.75	30	1.6853	0.1461	1.6853	1.2982
No log	0.8	32	1.3216	0.3032	1.3216	1.1496
No log	0.85	34	1.3779	0.2319	1.3779	1.1739
No log	0.9	36	1.3303	0.3518	1.3303	1.1534
No log	0.95	38	1.2796	0.3541	1.2796	1.1312
No log	1.0	40	1.2676	0.3858	1.2676	1.1259
No log	1.05	42	1.1058	0.4216	1.1058	1.0516
No log	1.1	44	1.0219	0.4294	1.0219	1.0109
No log	1.15	46	0.8984	0.4987	0.8984	0.9478
No log	1.2	48	0.8657	0.5578	0.8657	0.9304
No log	1.25	50	0.8799	0.5598	0.8799	0.9380
No log	1.3	52	1.0233	0.5110	1.0233	1.0116
No log	1.35	54	0.9684	0.5301	0.9684	0.9841
No log	1.4	56	0.9014	0.5678	0.9014	0.9494
No log	1.45	58	0.7358	0.6714	0.7358	0.8578
No log	1.5	60	0.7871	0.6347	0.7871	0.8872
No log	1.55	62	0.7243	0.6589	0.7243	0.8511
No log	1.6	64	0.7271	0.6722	0.7271	0.8527
No log	1.65	66	0.8221	0.5832	0.8221	0.9067
No log	1.7	68	1.2755	0.3608	1.2755	1.1294
No log	1.75	70	1.6297	0.0834	1.6297	1.2766
No log	1.8	72	1.4720	0.1882	1.4720	1.2133
No log	1.85	74	1.0842	0.3984	1.0842	1.0412
No log	1.9	76	0.7815	0.6414	0.7815	0.8840
No log	1.95	78	0.8414	0.6121	0.8414	0.9173
No log	2.0	80	0.7670	0.6714	0.7670	0.8758
No log	2.05	82	0.7178	0.6893	0.7178	0.8472
No log	2.1	84	0.7650	0.6342	0.7650	0.8746
No log	2.15	86	0.7346	0.6861	0.7346	0.8571
No log	2.2	88	0.7331	0.6817	0.7331	0.8562
No log	2.25	90	0.7674	0.6502	0.7674	0.8760
No log	2.3	92	0.7585	0.6893	0.7585	0.8709
No log	2.35	94	0.8205	0.6165	0.8205	0.9058
No log	2.4	96	0.8763	0.6061	0.8763	0.9361
No log	2.45	98	0.8006	0.6292	0.8006	0.8947
No log	2.5	100	0.7543	0.6476	0.7543	0.8685
No log	2.55	102	0.7715	0.6420	0.7715	0.8783
No log	2.6	104	0.7393	0.6412	0.7393	0.8598
No log	2.65	106	0.7628	0.6364	0.7628	0.8734
No log	2.7	108	0.7507	0.6872	0.7507	0.8665
No log	2.75	110	0.7992	0.6374	0.7992	0.8940
No log	2.8	112	0.8961	0.6311	0.8961	0.9466
No log	2.85	114	0.9355	0.6452	0.9355	0.9672
No log	2.9	116	1.0041	0.5702	1.0041	1.0020
No log	2.95	118	0.9568	0.5723	0.9568	0.9781
No log	3.0	120	0.7819	0.6682	0.7819	0.8842
No log	3.05	122	0.7668	0.6433	0.7668	0.8757
No log	3.1	124	0.7553	0.6210	0.7553	0.8691
No log	3.15	126	0.7602	0.6112	0.7602	0.8719
No log	3.2	128	0.7834	0.6216	0.7834	0.8851
No log	3.25	130	0.7935	0.6254	0.7935	0.8908
No log	3.3	132	0.7921	0.6294	0.7921	0.8900
No log	3.35	134	0.8366	0.5541	0.8366	0.9146
No log	3.4	136	0.7824	0.6393	0.7824	0.8845
No log	3.45	138	0.8338	0.6509	0.8338	0.9131
No log	3.5	140	0.8553	0.6022	0.8553	0.9248
No log	3.55	142	0.7808	0.6616	0.7808	0.8836
No log	3.6	144	0.7645	0.6507	0.7645	0.8744
No log	3.65	146	0.7547	0.6520	0.7547	0.8688
No log	3.7	148	0.7379	0.6622	0.7379	0.8590
No log	3.75	150	0.7324	0.6674	0.7324	0.8558
No log	3.8	152	0.7280	0.6725	0.7280	0.8532
No log	3.85	154	0.7154	0.6437	0.7154	0.8458
No log	3.9	156	0.6732	0.6689	0.6732	0.8205
No log	3.95	158	0.7296	0.6138	0.7296	0.8542
No log	4.0	160	0.7668	0.6026	0.7668	0.8757
No log	4.05	162	0.6991	0.6432	0.6991	0.8361
No log	4.1	164	0.6872	0.6625	0.6872	0.8290
No log	4.15	166	0.7564	0.6474	0.7564	0.8697
No log	4.2	168	0.8170	0.6119	0.8170	0.9039
No log	4.25	170	0.8010	0.6625	0.8010	0.8950
No log	4.3	172	0.7908	0.6452	0.7908	0.8893
No log	4.35	174	0.7899	0.6284	0.7899	0.8887
No log	4.4	176	0.8107	0.6330	0.8107	0.9004
No log	4.45	178	0.7944	0.6228	0.7944	0.8913
No log	4.5	180	0.7878	0.6324	0.7878	0.8876
No log	4.55	182	0.7827	0.6579	0.7827	0.8847
No log	4.6	184	0.7666	0.6485	0.7666	0.8755
No log	4.65	186	0.7540	0.6521	0.7540	0.8683
No log	4.7	188	0.7455	0.6569	0.7455	0.8634
No log	4.75	190	0.7481	0.6508	0.7481	0.8649
No log	4.8	192	0.7519	0.6491	0.7519	0.8671
No log	4.85	194	0.7499	0.6483	0.7499	0.8660
No log	4.9	196	0.7542	0.6443	0.7542	0.8685
No log	4.95	198	0.7594	0.6526	0.7594	0.8715
No log	5.0	200	0.7856	0.6300	0.7856	0.8863
No log	5.05	202	0.7984	0.6091	0.7984	0.8935
No log	5.1	204	0.8258	0.6088	0.8258	0.9087
No log	5.15	206	0.8390	0.6050	0.8390	0.9160
No log	5.2	208	0.8479	0.6161	0.8479	0.9208
No log	5.25	210	0.8274	0.6159	0.8274	0.9096
No log	5.3	212	0.8144	0.6237	0.8144	0.9025
No log	5.35	214	0.8045	0.6157	0.8045	0.8969
No log	5.4	216	0.8143	0.6268	0.8143	0.9024
No log	5.45	218	0.8150	0.6297	0.8150	0.9028
No log	5.5	220	0.8225	0.6195	0.8225	0.9069
No log	5.55	222	0.8641	0.6137	0.8641	0.9296
No log	5.6	224	0.8885	0.5682	0.8885	0.9426
No log	5.65	226	0.8296	0.6127	0.8296	0.9108
No log	5.7	228	0.7794	0.6756	0.7794	0.8829
No log	5.75	230	0.7671	0.6714	0.7671	0.8759
No log	5.8	232	0.7547	0.6697	0.7547	0.8688
No log	5.85	234	0.7492	0.6618	0.7492	0.8656
No log	5.9	236	0.7522	0.6638	0.7522	0.8673
No log	5.95	238	0.7676	0.6845	0.7676	0.8761
No log	6.0	240	0.7853	0.6517	0.7853	0.8862
No log	6.05	242	0.7926	0.6517	0.7926	0.8903
No log	6.1	244	0.8129	0.6500	0.8129	0.9016
No log	6.15	246	0.7976	0.6629	0.7976	0.8931
No log	6.2	248	0.7858	0.6764	0.7858	0.8865
No log	6.25	250	0.7825	0.6768	0.7825	0.8846
No log	6.3	252	0.7852	0.6912	0.7852	0.8861
No log	6.35	254	0.8047	0.6592	0.8047	0.8970
No log	6.4	256	0.7920	0.6684	0.7920	0.8899
No log	6.45	258	0.7691	0.6630	0.7691	0.8770
No log	6.5	260	0.7665	0.6640	0.7665	0.8755
No log	6.55	262	0.7764	0.6555	0.7764	0.8811
No log	6.6	264	0.7820	0.6468	0.7820	0.8843
No log	6.65	266	0.7964	0.6531	0.7964	0.8924
No log	6.7	268	0.8074	0.6509	0.8074	0.8986
No log	6.75	270	0.8043	0.6714	0.8043	0.8968
No log	6.8	272	0.8098	0.6711	0.8098	0.8999
No log	6.85	274	0.8123	0.6715	0.8123	0.9013
No log	6.9	276	0.8152	0.6868	0.8152	0.9029
No log	6.95	278	0.8061	0.7085	0.8061	0.8978
No log	7.0	280	0.7957	0.6573	0.7957	0.8920
No log	7.05	282	0.7983	0.6142	0.7983	0.8935
No log	7.1	284	0.7846	0.6270	0.7846	0.8858
No log	7.15	286	0.7669	0.6626	0.7669	0.8757
No log	7.2	288	0.7773	0.6745	0.7773	0.8816
No log	7.25	290	0.8187	0.6392	0.8187	0.9048
No log	7.3	292	0.8304	0.6407	0.8304	0.9112
No log	7.35	294	0.8062	0.6492	0.8062	0.8979
No log	7.4	296	0.7940	0.6440	0.7940	0.8911
No log	7.45	298	0.7722	0.6715	0.7722	0.8788
No log	7.5	300	0.7724	0.6628	0.7724	0.8789
No log	7.55	302	0.7781	0.6705	0.7781	0.8821
No log	7.6	304	0.7861	0.6528	0.7861	0.8866
No log	7.65	306	0.7891	0.6528	0.7891	0.8883
No log	7.7	308	0.8035	0.6478	0.8035	0.8964
No log	7.75	310	0.8296	0.6408	0.8296	0.9108
No log	7.8	312	0.8561	0.6123	0.8561	0.9253
No log	7.85	314	0.8504	0.6123	0.8504	0.9222
No log	7.9	316	0.8410	0.6306	0.8410	0.9170
No log	7.95	318	0.8285	0.6277	0.8285	0.9102
No log	8.0	320	0.8183	0.6169	0.8183	0.9046
No log	8.05	322	0.8126	0.6169	0.8126	0.9015
No log	8.1	324	0.8087	0.6169	0.8087	0.8993
No log	8.15	326	0.8030	0.6277	0.8030	0.8961
No log	8.2	328	0.8051	0.6230	0.8051	0.8973
No log	8.25	330	0.8180	0.6215	0.8180	0.9044
No log	8.3	332	0.8259	0.6174	0.8259	0.9088
No log	8.35	334	0.8180	0.6215	0.8180	0.9044
No log	8.4	336	0.8103	0.6215	0.8103	0.9002
No log	8.45	338	0.8038	0.6239	0.8038	0.8965
No log	8.5	340	0.7965	0.6082	0.7965	0.8925
No log	8.55	342	0.7968	0.6087	0.7968	0.8926
No log	8.6	344	0.7937	0.6004	0.7937	0.8909
No log	8.65	346	0.7906	0.6145	0.7906	0.8892
No log	8.7	348	0.7839	0.6250	0.7839	0.8854
No log	8.75	350	0.7793	0.6164	0.7793	0.8828
No log	8.8	352	0.7688	0.6512	0.7688	0.8768
No log	8.85	354	0.7660	0.6512	0.7660	0.8752
No log	8.9	356	0.7647	0.6502	0.7647	0.8744
No log	8.95	358	0.7693	0.6333	0.7693	0.8771
No log	9.0	360	0.7791	0.6276	0.7791	0.8827
No log	9.05	362	0.7863	0.6159	0.7863	0.8867
No log	9.1	364	0.7853	0.6159	0.7853	0.8862
No log	9.15	366	0.7776	0.6168	0.7776	0.8818
No log	9.2	368	0.7666	0.6451	0.7666	0.8756
No log	9.25	370	0.7626	0.6519	0.7626	0.8733
No log	9.3	372	0.7625	0.6705	0.7625	0.8732
No log	9.35	374	0.7647	0.6519	0.7647	0.8745
No log	9.4	376	0.7670	0.6419	0.7670	0.8758
No log	9.45	378	0.7713	0.6350	0.7713	0.8782
No log	9.5	380	0.7761	0.6326	0.7761	0.8809
No log	9.55	382	0.7815	0.6311	0.7815	0.8840
No log	9.6	384	0.7877	0.6302	0.7877	0.8875
No log	9.65	386	0.7926	0.6386	0.7926	0.8903
No log	9.7	388	0.7955	0.6386	0.7955	0.8919
No log	9.75	390	0.7988	0.6386	0.7988	0.8937
No log	9.8	392	0.8027	0.6339	0.8027	0.8959
No log	9.85	394	0.8053	0.6339	0.8053	0.8974
No log	9.9	396	0.8054	0.6339	0.8054	0.8975
No log	9.95	398	0.8050	0.6339	0.8050	0.8972
No log	10.0	400	0.8046	0.6339	0.8046	0.8970

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1