ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5953
• Qwk: 0.7709
• Mse: 0.5953
• Rmse: 0.7716

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	2.2233	0.0214	2.2233	1.4911
No log	0.0714	4	1.4594	0.1887	1.4594	1.2081
No log	0.1071	6	1.2668	0.2605	1.2668	1.1255
No log	0.1429	8	1.4047	0.3868	1.4047	1.1852
No log	0.1786	10	1.5808	0.3404	1.5808	1.2573
No log	0.2143	12	1.7868	0.3119	1.7868	1.3367
No log	0.25	14	1.4740	0.3462	1.4740	1.2141
No log	0.2857	16	1.2760	0.3002	1.2760	1.1296
No log	0.3214	18	1.2178	0.3217	1.2178	1.1035
No log	0.3571	20	1.1503	0.3745	1.1503	1.0725
No log	0.3929	22	1.0628	0.4474	1.0628	1.0309
No log	0.4286	24	1.0386	0.4602	1.0386	1.0191
No log	0.4643	26	1.0421	0.4967	1.0421	1.0208
No log	0.5	28	0.9879	0.5162	0.9879	0.9940
No log	0.5357	30	0.8723	0.5747	0.8723	0.9340
No log	0.5714	32	1.0266	0.4490	1.0266	1.0132
No log	0.6071	34	1.2731	0.3382	1.2731	1.1283
No log	0.6429	36	1.0743	0.4601	1.0743	1.0365
No log	0.6786	38	0.8028	0.5964	0.8028	0.8960
No log	0.7143	40	0.8717	0.5781	0.8717	0.9337
No log	0.75	42	0.8844	0.5756	0.8844	0.9404
No log	0.7857	44	0.7934	0.6258	0.7934	0.8907
No log	0.8214	46	0.8094	0.5846	0.8094	0.8997
No log	0.8571	48	0.8540	0.5148	0.8540	0.9241
No log	0.8929	50	0.8310	0.5838	0.8310	0.9116
No log	0.9286	52	0.8880	0.5770	0.8880	0.9423
No log	0.9643	54	0.9601	0.5664	0.9601	0.9798
No log	1.0	56	0.9328	0.5714	0.9328	0.9658
No log	1.0357	58	0.8607	0.5417	0.8607	0.9278
No log	1.0714	60	0.8138	0.5752	0.8138	0.9021
No log	1.1071	62	0.8064	0.6540	0.8064	0.8980
No log	1.1429	64	0.7578	0.6809	0.7578	0.8705
No log	1.1786	66	0.7140	0.6370	0.7140	0.8450
No log	1.2143	68	0.7078	0.6505	0.7078	0.8413
No log	1.25	70	0.6604	0.7315	0.6604	0.8127
No log	1.2857	72	0.7613	0.7105	0.7613	0.8725
No log	1.3214	74	0.7052	0.7048	0.7052	0.8398
No log	1.3571	76	0.6464	0.7368	0.6464	0.8040
No log	1.3929	78	0.6544	0.7268	0.6544	0.8089
No log	1.4286	80	0.7740	0.6796	0.7740	0.8798
No log	1.4643	82	1.2725	0.5993	1.2725	1.1280
No log	1.5	84	1.3605	0.5720	1.3605	1.1664
No log	1.5357	86	1.0149	0.6149	1.0149	1.0074
No log	1.5714	88	0.7680	0.6877	0.7680	0.8764
No log	1.6071	90	0.7382	0.6561	0.7382	0.8592
No log	1.6429	92	0.7528	0.6678	0.7528	0.8677
No log	1.6786	94	0.9237	0.6636	0.9237	0.9611
No log	1.7143	96	1.1971	0.5935	1.1971	1.0941
No log	1.75	98	1.4527	0.5889	1.4527	1.2053
No log	1.7857	100	1.3225	0.6096	1.3225	1.1500
No log	1.8214	102	0.8910	0.6875	0.8910	0.9439
No log	1.8571	104	0.6579	0.7195	0.6579	0.8111
No log	1.8929	106	0.6219	0.7056	0.6219	0.7886
No log	1.9286	108	0.6336	0.7300	0.6336	0.7960
No log	1.9643	110	0.8048	0.7090	0.8048	0.8971
No log	2.0	112	0.9938	0.6547	0.9938	0.9969
No log	2.0357	114	1.0583	0.6356	1.0583	1.0287
No log	2.0714	116	0.9653	0.6540	0.9653	0.9825
No log	2.1071	118	0.7166	0.7519	0.7166	0.8465
No log	2.1429	120	0.6181	0.6849	0.6181	0.7862
No log	2.1786	122	0.6532	0.6824	0.6532	0.8082
No log	2.2143	124	0.6239	0.6610	0.6239	0.7899
No log	2.25	126	0.6189	0.7506	0.6189	0.7867
No log	2.2857	128	0.7499	0.7324	0.7499	0.8660
No log	2.3214	130	1.0212	0.6616	1.0212	1.0105
No log	2.3571	132	1.1422	0.6118	1.1422	1.0687
No log	2.3929	134	1.0222	0.6319	1.0222	1.0110
No log	2.4286	136	0.8188	0.6911	0.8188	0.9049
No log	2.4643	138	0.7706	0.6876	0.7706	0.8778
No log	2.5	140	0.7272	0.7184	0.7272	0.8528
No log	2.5357	142	0.7689	0.7152	0.7689	0.8769
No log	2.5714	144	0.8396	0.7125	0.8396	0.9163
No log	2.6071	146	0.8716	0.7221	0.8716	0.9336
No log	2.6429	148	0.8582	0.7195	0.8582	0.9264
No log	2.6786	150	0.7477	0.7499	0.7477	0.8647
No log	2.7143	152	0.6567	0.7733	0.6567	0.8104
No log	2.75	154	0.6396	0.7751	0.6396	0.7998
No log	2.7857	156	0.6523	0.7747	0.6523	0.8077
No log	2.8214	158	0.6589	0.7678	0.6589	0.8118
No log	2.8571	160	0.6160	0.7336	0.6160	0.7849
No log	2.8929	162	0.6125	0.7213	0.6125	0.7826
No log	2.9286	164	0.6656	0.7672	0.6656	0.8159
No log	2.9643	166	0.7246	0.7598	0.7246	0.8512
No log	3.0	168	0.7096	0.7639	0.7096	0.8424
No log	3.0357	170	0.7417	0.7553	0.7417	0.8612
No log	3.0714	172	0.7111	0.7549	0.7111	0.8433
No log	3.1071	174	0.6669	0.7580	0.6669	0.8166
No log	3.1429	176	0.6827	0.7422	0.6827	0.8263
No log	3.1786	178	0.7199	0.7656	0.7199	0.8485
No log	3.2143	180	0.8606	0.7101	0.8606	0.9277
No log	3.25	182	0.9589	0.6586	0.9589	0.9792
No log	3.2857	184	0.9182	0.7093	0.9182	0.9582
No log	3.3214	186	0.7757	0.7154	0.7757	0.8808
No log	3.3571	188	0.6852	0.7532	0.6852	0.8278
No log	3.3929	190	0.6659	0.7495	0.6659	0.8160
No log	3.4286	192	0.7138	0.7349	0.7138	0.8449
No log	3.4643	194	0.8130	0.7125	0.8130	0.9017
No log	3.5	196	0.9401	0.6573	0.9401	0.9696
No log	3.5357	198	1.0461	0.6019	1.0461	1.0228
No log	3.5714	200	1.0435	0.6214	1.0435	1.0215
No log	3.6071	202	0.9953	0.6367	0.9953	0.9976
No log	3.6429	204	0.9285	0.6788	0.9285	0.9636
No log	3.6786	206	0.8391	0.7097	0.8391	0.9160
No log	3.7143	208	0.8268	0.7063	0.8268	0.9093
No log	3.75	210	0.8550	0.7059	0.8550	0.9247
No log	3.7857	212	0.8202	0.7095	0.8202	0.9056
No log	3.8214	214	0.7339	0.7325	0.7339	0.8567
No log	3.8571	216	0.6677	0.7338	0.6677	0.8171
No log	3.8929	218	0.6543	0.7183	0.6543	0.8089
No log	3.9286	220	0.6874	0.7246	0.6874	0.8291
No log	3.9643	222	0.7823	0.7164	0.7823	0.8845
No log	4.0	224	0.8974	0.6933	0.8974	0.9473
No log	4.0357	226	0.8276	0.7096	0.8276	0.9097
No log	4.0714	228	0.6833	0.7369	0.6833	0.8266
No log	4.1071	230	0.6291	0.7139	0.6291	0.7931
No log	4.1429	232	0.6255	0.7291	0.6255	0.7909
No log	4.1786	234	0.6555	0.7332	0.6555	0.8096
No log	4.2143	236	0.8149	0.7160	0.8149	0.9027
No log	4.25	238	1.0813	0.6493	1.0813	1.0398
No log	4.2857	240	1.1444	0.6293	1.1444	1.0698
No log	4.3214	242	1.0069	0.6773	1.0069	1.0034
No log	4.3571	244	0.7921	0.7199	0.7921	0.8900
No log	4.3929	246	0.6471	0.7511	0.6471	0.8044
No log	4.4286	248	0.6232	0.7315	0.6232	0.7895
No log	4.4643	250	0.6322	0.7553	0.6322	0.7951
No log	4.5	252	0.7206	0.7309	0.7206	0.8489
No log	4.5357	254	0.8289	0.7295	0.8289	0.9104
No log	4.5714	256	0.8258	0.7393	0.8258	0.9087
No log	4.6071	258	0.7356	0.7287	0.7356	0.8577
No log	4.6429	260	0.7008	0.7417	0.7008	0.8371
No log	4.6786	262	0.7087	0.7410	0.7087	0.8419
No log	4.7143	264	0.6976	0.7272	0.6976	0.8352
No log	4.75	266	0.6958	0.7309	0.6958	0.8341
No log	4.7857	268	0.7255	0.7402	0.7255	0.8518
No log	4.8214	270	0.7700	0.7353	0.7700	0.8775
No log	4.8571	272	0.8263	0.7171	0.8263	0.9090
No log	4.8929	274	0.8306	0.7226	0.8306	0.9114
No log	4.9286	276	0.7818	0.7188	0.7818	0.8842
No log	4.9643	278	0.8130	0.7089	0.8130	0.9017
No log	5.0	280	0.8216	0.7105	0.8216	0.9064
No log	5.0357	282	0.7984	0.7168	0.7984	0.8935
No log	5.0714	284	0.6948	0.7587	0.6948	0.8335
No log	5.1071	286	0.6315	0.7661	0.6315	0.7947
No log	5.1429	288	0.6079	0.7728	0.6079	0.7797
No log	5.1786	290	0.6165	0.7654	0.6165	0.7852
No log	5.2143	292	0.6643	0.7663	0.6643	0.8150
No log	5.25	294	0.6841	0.7558	0.6841	0.8271
No log	5.2857	296	0.6779	0.7652	0.6779	0.8234
No log	5.3214	298	0.6830	0.7583	0.6830	0.8264
No log	5.3571	300	0.6767	0.7560	0.6767	0.8226
No log	5.3929	302	0.6147	0.7440	0.6147	0.7841
No log	5.4286	304	0.6014	0.7427	0.6014	0.7755
No log	5.4643	306	0.6383	0.7393	0.6383	0.7989
No log	5.5	308	0.7404	0.7331	0.7404	0.8605
No log	5.5357	310	0.7990	0.7003	0.7990	0.8938
No log	5.5714	312	0.7552	0.7409	0.7552	0.8690
No log	5.6071	314	0.6730	0.7629	0.6730	0.8204
No log	5.6429	316	0.6350	0.7513	0.6350	0.7969
No log	5.6786	318	0.6219	0.7513	0.6219	0.7886
No log	5.7143	320	0.6127	0.7568	0.6127	0.7827
No log	5.75	322	0.5961	0.7702	0.5961	0.7721
No log	5.7857	324	0.5877	0.7812	0.5877	0.7666
No log	5.8214	326	0.5773	0.7757	0.5773	0.7598
No log	5.8571	328	0.5553	0.7335	0.5553	0.7452
No log	5.8929	330	0.5551	0.7375	0.5551	0.7451
No log	5.9286	332	0.5733	0.7503	0.5733	0.7572
No log	5.9643	334	0.6104	0.7519	0.6104	0.7813
No log	6.0	336	0.6364	0.7439	0.6364	0.7977
No log	6.0357	338	0.6969	0.7540	0.6969	0.8348
No log	6.0714	340	0.7155	0.7418	0.7155	0.8459
No log	6.1071	342	0.6759	0.7490	0.6759	0.8222
No log	6.1429	344	0.6219	0.7415	0.6219	0.7886
No log	6.1786	346	0.5971	0.7574	0.5971	0.7727
No log	6.2143	348	0.5976	0.7696	0.5976	0.7730
No log	6.25	350	0.6409	0.7382	0.6409	0.8006
No log	6.2857	352	0.7142	0.7517	0.7142	0.8451
No log	6.3214	354	0.7575	0.7508	0.7575	0.8704
No log	6.3571	356	0.7284	0.7548	0.7284	0.8535
No log	6.3929	358	0.6679	0.7507	0.6679	0.8173
No log	6.4286	360	0.6247	0.7728	0.6247	0.7904
No log	6.4643	362	0.5871	0.7709	0.5871	0.7662
No log	6.5	364	0.5866	0.7553	0.5866	0.7659
No log	6.5357	366	0.6006	0.7678	0.6006	0.7750
No log	6.5714	368	0.6395	0.7613	0.6395	0.7997
No log	6.6071	370	0.6521	0.7510	0.6521	0.8075
No log	6.6429	372	0.6709	0.7429	0.6709	0.8191
No log	6.6786	374	0.6616	0.7545	0.6616	0.8134
No log	6.7143	376	0.6559	0.7551	0.6559	0.8099
No log	6.75	378	0.6312	0.7620	0.6312	0.7945
No log	6.7857	380	0.6494	0.7633	0.6494	0.8058
No log	6.8214	382	0.7066	0.7634	0.7066	0.8406
No log	6.8571	384	0.7616	0.7391	0.7616	0.8727
No log	6.8929	386	0.7516	0.7413	0.7516	0.8670
No log	6.9286	388	0.7202	0.7413	0.7202	0.8486
No log	6.9643	390	0.6630	0.7468	0.6630	0.8143
No log	7.0	392	0.6001	0.7501	0.6001	0.7747
No log	7.0357	394	0.5774	0.7776	0.5774	0.7599
No log	7.0714	396	0.5798	0.7690	0.5798	0.7614
No log	7.1071	398	0.6036	0.7678	0.6036	0.7769
No log	7.1429	400	0.6428	0.7639	0.6428	0.8017
No log	7.1786	402	0.6764	0.7523	0.6764	0.8225
No log	7.2143	404	0.6925	0.7536	0.6925	0.8322
No log	7.25	406	0.6883	0.7536	0.6883	0.8296
No log	7.2857	408	0.6557	0.7668	0.6557	0.8098
No log	7.3214	410	0.6253	0.7547	0.6253	0.7908
No log	7.3571	412	0.5932	0.7678	0.5932	0.7702
No log	7.3929	414	0.5791	0.7733	0.5791	0.7610
No log	7.4286	416	0.5941	0.7501	0.5941	0.7707
No log	7.4643	418	0.6291	0.7558	0.6291	0.7932
No log	7.5	420	0.6569	0.7501	0.6569	0.8105
No log	7.5357	422	0.6897	0.7414	0.6897	0.8305
No log	7.5714	424	0.6864	0.7414	0.6864	0.8285
No log	7.6071	426	0.6717	0.7456	0.6717	0.8196
No log	7.6429	428	0.6568	0.7537	0.6568	0.8104
No log	7.6786	430	0.6252	0.7747	0.6252	0.7907
No log	7.7143	432	0.6009	0.7833	0.6009	0.7752
No log	7.75	434	0.5987	0.7795	0.5987	0.7738
No log	7.7857	436	0.6208	0.7845	0.6208	0.7879
No log	7.8214	438	0.6458	0.7650	0.6458	0.8036
No log	7.8571	440	0.6678	0.7603	0.6678	0.8172
No log	7.8929	442	0.6746	0.7462	0.6746	0.8214
No log	7.9286	444	0.6783	0.7517	0.6783	0.8236
No log	7.9643	446	0.7081	0.7571	0.7081	0.8415
No log	8.0	448	0.7188	0.7432	0.7188	0.8478
No log	8.0357	450	0.6970	0.7611	0.6970	0.8349
No log	8.0714	452	0.6595	0.7627	0.6595	0.8121
No log	8.1071	454	0.6201	0.7644	0.6201	0.7875
No log	8.1429	456	0.6032	0.7660	0.6032	0.7767
No log	8.1786	458	0.5906	0.7806	0.5906	0.7685
No log	8.2143	460	0.5827	0.7776	0.5827	0.7633
No log	8.25	462	0.5912	0.7690	0.5912	0.7689
No log	8.2857	464	0.5979	0.7585	0.5979	0.7733
No log	8.3214	466	0.6049	0.7635	0.6049	0.7777
No log	8.3571	468	0.6118	0.7592	0.6118	0.7822
No log	8.3929	470	0.6137	0.7592	0.6137	0.7834
No log	8.4286	472	0.6123	0.7592	0.6123	0.7825
No log	8.4643	474	0.6079	0.7592	0.6079	0.7797
No log	8.5	476	0.6049	0.7629	0.6049	0.7778
No log	8.5357	478	0.6117	0.7586	0.6117	0.7821
No log	8.5714	480	0.6072	0.7586	0.6072	0.7792
No log	8.6071	482	0.6106	0.7586	0.6106	0.7814
No log	8.6429	484	0.6234	0.7586	0.6234	0.7896
No log	8.6786	486	0.6358	0.7577	0.6358	0.7974
No log	8.7143	488	0.6342	0.7577	0.6342	0.7963
No log	8.75	490	0.6215	0.7661	0.6215	0.7884
No log	8.7857	492	0.6050	0.7629	0.6050	0.7778
No log	8.8214	494	0.5961	0.7635	0.5961	0.7721
No log	8.8571	496	0.5827	0.7561	0.5827	0.7634
No log	8.8929	498	0.5781	0.7561	0.5781	0.7603
0.3201	8.9286	500	0.5805	0.7598	0.5805	0.7619
0.3201	8.9643	502	0.5809	0.7598	0.5809	0.7622
0.3201	9.0	504	0.5840	0.7635	0.5840	0.7642
0.3201	9.0357	506	0.5850	0.7635	0.5850	0.7648
0.3201	9.0714	508	0.5929	0.7672	0.5929	0.7700
0.3201	9.1071	510	0.6037	0.7586	0.6037	0.7770
0.3201	9.1429	512	0.6060	0.7586	0.6060	0.7785
0.3201	9.1786	514	0.6111	0.7586	0.6111	0.7817
0.3201	9.2143	516	0.6083	0.7661	0.6083	0.7800
0.3201	9.25	518	0.6038	0.7746	0.6038	0.7770
0.3201	9.2857	520	0.5951	0.7635	0.5951	0.7714
0.3201	9.3214	522	0.5827	0.7598	0.5827	0.7634
0.3201	9.3571	524	0.5770	0.7622	0.5770	0.7596
0.3201	9.3929	526	0.5723	0.7622	0.5723	0.7565
0.3201	9.4286	528	0.5735	0.7622	0.5735	0.7573
0.3201	9.4643	530	0.5754	0.7598	0.5754	0.7585
0.3201	9.5	532	0.5758	0.7622	0.5758	0.7588
0.3201	9.5357	534	0.5780	0.7598	0.5780	0.7602
0.3201	9.5714	536	0.5805	0.7598	0.5805	0.7619
0.3201	9.6071	538	0.5830	0.7672	0.5830	0.7635
0.3201	9.6429	540	0.5839	0.7672	0.5839	0.7641
0.3201	9.6786	542	0.5884	0.7672	0.5884	0.7670
0.3201	9.7143	544	0.5926	0.7672	0.5926	0.7698
0.3201	9.75	546	0.5964	0.7709	0.5964	0.7723
0.3201	9.7857	548	0.5978	0.7709	0.5978	0.7732
0.3201	9.8214	550	0.5984	0.7709	0.5984	0.7736
0.3201	9.8571	552	0.5974	0.7709	0.5974	0.7729
0.3201	9.8929	554	0.5971	0.7709	0.5971	0.7727
0.3201	9.9286	556	0.5965	0.7709	0.5965	0.7723
0.3201	9.9643	558	0.5958	0.7709	0.5958	0.7719
0.3201	10.0	560	0.5953	0.7709	0.5953	0.7716

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1