ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8436
• Qwk: 0.6911
• Mse: 0.8436
• Rmse: 0.9185

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	2.2658	0.0275	2.2658	1.5052
No log	0.0714	4	1.4505	0.2359	1.4505	1.2044
No log	0.1071	6	1.3475	0.2123	1.3475	1.1608
No log	0.1429	8	1.6738	0.3027	1.6738	1.2938
No log	0.1786	10	1.8369	0.2975	1.8369	1.3553
No log	0.2143	12	1.8094	0.3128	1.8094	1.3451
No log	0.25	14	1.4519	0.2730	1.4519	1.2050
No log	0.2857	16	1.3340	0.2044	1.3340	1.1550
No log	0.3214	18	1.2939	0.2346	1.2939	1.1375
No log	0.3571	20	1.3810	0.2779	1.3810	1.1752
No log	0.3929	22	1.3519	0.3402	1.3519	1.1627
No log	0.4286	24	1.1605	0.3327	1.1605	1.0773
No log	0.4643	26	1.1477	0.3475	1.1477	1.0713
No log	0.5	28	1.2906	0.3734	1.2906	1.1361
No log	0.5357	30	1.4163	0.4212	1.4163	1.1901
No log	0.5714	32	1.2612	0.4183	1.2612	1.1230
No log	0.6071	34	1.1783	0.3844	1.1783	1.0855
No log	0.6429	36	1.1523	0.4122	1.1523	1.0735
No log	0.6786	38	1.2238	0.3481	1.2238	1.1063
No log	0.7143	40	1.4017	0.4136	1.4017	1.1839
No log	0.75	42	1.4040	0.4256	1.4040	1.1849
No log	0.7857	44	1.3002	0.3906	1.3002	1.1403
No log	0.8214	46	1.1943	0.3866	1.1943	1.0928
No log	0.8571	48	1.2478	0.4014	1.2478	1.1171
No log	0.8929	50	1.3840	0.4169	1.3840	1.1764
No log	0.9286	52	1.5135	0.4388	1.5135	1.2303
No log	0.9643	54	1.6664	0.4208	1.6664	1.2909
No log	1.0	56	1.3087	0.5079	1.3087	1.1440
No log	1.0357	58	0.9028	0.6270	0.9028	0.9502
No log	1.0714	60	0.8754	0.5255	0.8754	0.9356
No log	1.1071	62	0.8592	0.5881	0.8592	0.9269
No log	1.1429	64	1.1048	0.5679	1.1048	1.0511
No log	1.1786	66	1.3598	0.5638	1.3598	1.1661
No log	1.2143	68	1.1556	0.5937	1.1556	1.0750
No log	1.25	70	0.9070	0.6406	0.9070	0.9524
No log	1.2857	72	0.8207	0.6643	0.8207	0.9059
No log	1.3214	74	0.7713	0.6275	0.7713	0.8783
No log	1.3571	76	0.8033	0.6459	0.8033	0.8963
No log	1.3929	78	0.8690	0.6357	0.8690	0.9322
No log	1.4286	80	0.8885	0.6338	0.8885	0.9426
No log	1.4643	82	0.8551	0.6489	0.8551	0.9247
No log	1.5	84	0.8249	0.6657	0.8249	0.9082
No log	1.5357	86	0.8756	0.6761	0.8756	0.9357
No log	1.5714	88	0.9398	0.6513	0.9398	0.9694
No log	1.6071	90	0.9974	0.6417	0.9974	0.9987
No log	1.6429	92	0.9278	0.6530	0.9278	0.9632
No log	1.6786	94	0.8605	0.6735	0.8605	0.9276
No log	1.7143	96	0.8809	0.6745	0.8809	0.9385
No log	1.75	98	1.0392	0.6409	1.0392	1.0194
No log	1.7857	100	1.2277	0.6024	1.2277	1.1080
No log	1.8214	102	1.0071	0.6391	1.0071	1.0036
No log	1.8571	104	0.9171	0.6510	0.9171	0.9576
No log	1.8929	106	1.0649	0.6219	1.0649	1.0320
No log	1.9286	108	1.3740	0.5232	1.3740	1.1722
No log	1.9643	110	1.2400	0.5285	1.2400	1.1135
No log	2.0	112	0.9123	0.5955	0.9123	0.9551
No log	2.0357	114	0.8442	0.6318	0.8442	0.9188
No log	2.0714	116	0.9224	0.6175	0.9224	0.9604
No log	2.1071	118	1.1115	0.5690	1.1115	1.0543
No log	2.1429	120	1.1216	0.5887	1.1216	1.0591
No log	2.1786	122	0.8808	0.6429	0.8808	0.9385
No log	2.2143	124	0.7381	0.6739	0.7381	0.8591
No log	2.25	126	0.7370	0.6799	0.7370	0.8585
No log	2.2857	128	0.7919	0.6844	0.7919	0.8899
No log	2.3214	130	0.8551	0.6732	0.8551	0.9247
No log	2.3571	132	0.8323	0.6890	0.8323	0.9123
No log	2.3929	134	0.7593	0.6684	0.7593	0.8714
No log	2.4286	136	0.7237	0.6641	0.7237	0.8507
No log	2.4643	138	0.7349	0.6654	0.7349	0.8573
No log	2.5	140	0.7777	0.6954	0.7777	0.8819
No log	2.5357	142	0.9205	0.6771	0.9205	0.9595
No log	2.5714	144	1.1343	0.5808	1.1343	1.0650
No log	2.6071	146	1.3080	0.5346	1.3080	1.1437
No log	2.6429	148	1.2747	0.5402	1.2747	1.1290
No log	2.6786	150	1.1009	0.5849	1.1009	1.0493
No log	2.7143	152	0.9135	0.6476	0.9135	0.9558
No log	2.75	154	0.7958	0.6877	0.7958	0.8921
No log	2.7857	156	0.7437	0.6781	0.7437	0.8624
No log	2.8214	158	0.7826	0.7063	0.7826	0.8847
No log	2.8571	160	0.9801	0.6491	0.9801	0.9900
No log	2.8929	162	1.0436	0.6340	1.0436	1.0216
No log	2.9286	164	0.8964	0.6788	0.8964	0.9468
No log	2.9643	166	0.7400	0.7016	0.7400	0.8602
No log	3.0	168	0.6940	0.6985	0.6940	0.8330
No log	3.0357	170	0.7385	0.7016	0.7385	0.8593
No log	3.0714	172	0.8467	0.7010	0.8467	0.9202
No log	3.1071	174	0.9076	0.6858	0.9076	0.9527
No log	3.1429	176	0.8328	0.7176	0.8328	0.9126
No log	3.1786	178	0.7014	0.7270	0.7014	0.8375
No log	3.2143	180	0.6690	0.6820	0.6690	0.8179
No log	3.25	182	0.6789	0.7103	0.6789	0.8240
No log	3.2857	184	0.7764	0.7228	0.7764	0.8811
No log	3.3214	186	1.0335	0.6372	1.0335	1.0166
No log	3.3571	188	1.0912	0.6259	1.0912	1.0446
No log	3.3929	190	0.9131	0.6852	0.9131	0.9556
No log	3.4286	192	0.7234	0.7098	0.7234	0.8505
No log	3.4643	194	0.7002	0.7060	0.7002	0.8368
No log	3.5	196	0.7986	0.7175	0.7986	0.8937
No log	3.5357	198	0.9803	0.6592	0.9803	0.9901
No log	3.5714	200	1.0406	0.6573	1.0406	1.0201
No log	3.6071	202	0.9911	0.6523	0.9911	0.9955
No log	3.6429	204	0.7933	0.6926	0.7933	0.8907
No log	3.6786	206	0.6948	0.6954	0.6948	0.8335
No log	3.7143	208	0.7207	0.6894	0.7207	0.8490
No log	3.75	210	0.7346	0.7024	0.7346	0.8571
No log	3.7857	212	0.7508	0.7137	0.7508	0.8665
No log	3.8214	214	0.8136	0.6824	0.8136	0.9020
No log	3.8571	216	0.8055	0.6987	0.8055	0.8975
No log	3.8929	218	0.8074	0.7131	0.8074	0.8986
No log	3.9286	220	0.7023	0.7470	0.7023	0.8381
No log	3.9643	222	0.6201	0.7131	0.6201	0.7875
No log	4.0	224	0.6158	0.7099	0.6158	0.7847
No log	4.0357	226	0.6657	0.7405	0.6657	0.8159
No log	4.0714	228	0.8506	0.6943	0.8506	0.9223
No log	4.1071	230	1.0076	0.6503	1.0076	1.0038
No log	4.1429	232	0.9847	0.6453	0.9847	0.9923
No log	4.1786	234	0.8005	0.7158	0.8005	0.8947
No log	4.2143	236	0.6708	0.7293	0.6708	0.8190
No log	4.25	238	0.6439	0.7346	0.6439	0.8024
No log	4.2857	240	0.6646	0.7210	0.6646	0.8152
No log	4.3214	242	0.6813	0.7218	0.6813	0.8254
No log	4.3571	244	0.7039	0.7130	0.7039	0.8390
No log	4.3929	246	0.7704	0.7175	0.7704	0.8778
No log	4.4286	248	0.7339	0.7068	0.7339	0.8567
No log	4.4643	250	0.6998	0.7039	0.6998	0.8365
No log	4.5	252	0.7072	0.7032	0.7072	0.8409
No log	4.5357	254	0.7242	0.6979	0.7242	0.8510
No log	4.5714	256	0.7684	0.7033	0.7684	0.8766
No log	4.6071	258	0.8394	0.7164	0.8394	0.9162
No log	4.6429	260	0.7931	0.7211	0.7931	0.8905
No log	4.6786	262	0.7283	0.6988	0.7283	0.8534
No log	4.7143	264	0.6752	0.7279	0.6752	0.8217
No log	4.75	266	0.7031	0.7075	0.7031	0.8385
No log	4.7857	268	0.8281	0.7100	0.8281	0.9100
No log	4.8214	270	1.0123	0.6379	1.0123	1.0061
No log	4.8571	272	1.0977	0.5959	1.0977	1.0477
No log	4.8929	274	1.0271	0.6183	1.0271	1.0135
No log	4.9286	276	0.8758	0.6793	0.8758	0.9358
No log	4.9643	278	0.7909	0.6880	0.7909	0.8893
No log	5.0	280	0.7773	0.7027	0.7773	0.8817
No log	5.0357	282	0.8306	0.6842	0.8306	0.9114
No log	5.0714	284	0.9144	0.6723	0.9144	0.9563
No log	5.1071	286	0.9802	0.6372	0.9802	0.9901
No log	5.1429	288	0.9175	0.6883	0.9175	0.9579
No log	5.1786	290	0.7839	0.7176	0.7839	0.8854
No log	5.2143	292	0.7260	0.7032	0.7260	0.8521
No log	5.25	294	0.7243	0.7052	0.7243	0.8511
No log	5.2857	296	0.7825	0.7141	0.7825	0.8846
No log	5.3214	298	0.8722	0.7132	0.8722	0.9339
No log	5.3571	300	0.8621	0.7090	0.8621	0.9285
No log	5.3929	302	0.8003	0.7106	0.8003	0.8946
No log	5.4286	304	0.7156	0.7068	0.7156	0.8459
No log	5.4643	306	0.6930	0.7051	0.6930	0.8325
No log	5.5	308	0.6946	0.7059	0.6946	0.8334
No log	5.5357	310	0.7410	0.6912	0.7410	0.8608
No log	5.5714	312	0.8120	0.7114	0.8120	0.9011
No log	5.6071	314	0.9193	0.6849	0.9193	0.9588
No log	5.6429	316	0.9379	0.6773	0.9379	0.9685
No log	5.6786	318	0.8602	0.7164	0.8602	0.9275
No log	5.7143	320	0.8047	0.7092	0.8047	0.8970
No log	5.75	322	0.7735	0.7034	0.7735	0.8795
No log	5.7857	324	0.8095	0.7092	0.8095	0.8997
No log	5.8214	326	0.8380	0.7164	0.8380	0.9154
No log	5.8571	328	0.8982	0.6680	0.8982	0.9477
No log	5.8929	330	0.9795	0.6464	0.9795	0.9897
No log	5.9286	332	0.9838	0.6360	0.9838	0.9919
No log	5.9643	334	0.9577	0.6491	0.9577	0.9786
No log	6.0	336	0.8503	0.6934	0.8503	0.9221
No log	6.0357	338	0.7619	0.6854	0.7619	0.8729
No log	6.0714	340	0.7263	0.7120	0.7263	0.8522
No log	6.1071	342	0.7230	0.7120	0.7230	0.8503
No log	6.1429	344	0.7704	0.6879	0.7704	0.8777
No log	6.1786	346	0.8391	0.6900	0.8391	0.9160
No log	6.2143	348	0.9176	0.6926	0.9176	0.9579
No log	6.25	350	0.9242	0.6931	0.9242	0.9614
No log	6.2857	352	0.8728	0.6893	0.8728	0.9342
No log	6.3214	354	0.8437	0.6893	0.8437	0.9185
No log	6.3571	356	0.7807	0.7211	0.7807	0.8835
No log	6.3929	358	0.7329	0.7418	0.7329	0.8561
No log	6.4286	360	0.7449	0.7252	0.7449	0.8630
No log	6.4643	362	0.7703	0.7188	0.7703	0.8777
No log	6.5	364	0.8292	0.7105	0.8292	0.9106
No log	6.5357	366	0.9017	0.6722	0.9017	0.9496
No log	6.5714	368	0.8973	0.6605	0.8973	0.9472
No log	6.6071	370	0.8271	0.7105	0.8271	0.9095
No log	6.6429	372	0.7631	0.7083	0.7631	0.8736
No log	6.6786	374	0.7291	0.7130	0.7291	0.8538
No log	6.7143	376	0.7295	0.7130	0.7295	0.8541
No log	6.75	378	0.7740	0.6921	0.7740	0.8798
No log	6.7857	380	0.8701	0.6822	0.8701	0.9328
No log	6.8214	382	0.9500	0.6712	0.9500	0.9747
No log	6.8571	384	0.9533	0.6752	0.9533	0.9763
No log	6.8929	386	0.8888	0.6747	0.8888	0.9428
No log	6.9286	388	0.8426	0.6923	0.8426	0.9179
No log	6.9643	390	0.7773	0.7100	0.7773	0.8817
No log	7.0	392	0.7196	0.7065	0.7196	0.8483
No log	7.0357	394	0.6998	0.7263	0.6998	0.8365
No log	7.0714	396	0.7124	0.7234	0.7124	0.8440
No log	7.1071	398	0.7630	0.7137	0.7630	0.8735
No log	7.1429	400	0.8233	0.6731	0.8233	0.9074
No log	7.1786	402	0.9040	0.6816	0.9040	0.9508
No log	7.2143	404	0.9443	0.6705	0.9443	0.9718
No log	7.25	406	0.9221	0.6773	0.9221	0.9603
No log	7.2857	408	0.9206	0.6829	0.9206	0.9595
No log	7.3214	410	0.8852	0.6771	0.8852	0.9408
No log	7.3571	412	0.8560	0.6756	0.8560	0.9252
No log	7.3929	414	0.8323	0.6816	0.8323	0.9123
No log	7.4286	416	0.8215	0.6913	0.8215	0.9064
No log	7.4643	418	0.7838	0.6926	0.7838	0.8853
No log	7.5	420	0.7391	0.6938	0.7391	0.8597
No log	7.5357	422	0.7285	0.6979	0.7285	0.8535
No log	7.5714	424	0.7419	0.6938	0.7419	0.8614
No log	7.6071	426	0.7740	0.7150	0.7740	0.8798
No log	7.6429	428	0.8299	0.6792	0.8299	0.9110
No log	7.6786	430	0.9203	0.6705	0.9203	0.9593
No log	7.7143	432	0.9656	0.6672	0.9656	0.9827
No log	7.75	434	0.9648	0.6672	0.9648	0.9823
No log	7.7857	436	0.9110	0.6856	0.9110	0.9545
No log	7.8214	438	0.8299	0.6696	0.8299	0.9110
No log	7.8571	440	0.7535	0.6968	0.7536	0.8681
No log	7.8929	442	0.7097	0.6902	0.7097	0.8425
No log	7.9286	444	0.6898	0.7147	0.6898	0.8305
No log	7.9643	446	0.6990	0.6974	0.6990	0.8361
No log	8.0	448	0.7221	0.6862	0.7221	0.8497
No log	8.0357	450	0.7719	0.6833	0.7719	0.8786
No log	8.0714	452	0.8268	0.6852	0.8268	0.9093
No log	8.1071	454	0.8973	0.6773	0.8973	0.9473
No log	8.1429	456	0.9415	0.6655	0.9415	0.9703
No log	8.1786	458	0.9456	0.6614	0.9456	0.9724
No log	8.2143	460	0.9176	0.6705	0.9176	0.9579
No log	8.25	462	0.8961	0.6705	0.8961	0.9466
No log	8.2857	464	0.8830	0.6705	0.8830	0.9397
No log	8.3214	466	0.8721	0.6705	0.8721	0.9338
No log	8.3571	468	0.8574	0.6747	0.8574	0.9259
No log	8.3929	470	0.8679	0.6747	0.8679	0.9316
No log	8.4286	472	0.8732	0.6747	0.8732	0.9345
No log	8.4643	474	0.8842	0.6747	0.8842	0.9403
No log	8.5	476	0.9005	0.6705	0.9005	0.9489
No log	8.5357	478	0.8938	0.6773	0.8938	0.9454
No log	8.5714	480	0.8751	0.6773	0.8751	0.9354
No log	8.6071	482	0.8633	0.6773	0.8633	0.9291
No log	8.6429	484	0.8565	0.6868	0.8565	0.9255
No log	8.6786	486	0.8657	0.6773	0.8657	0.9304
No log	8.7143	488	0.8685	0.6773	0.8685	0.9319
No log	8.75	490	0.8670	0.6868	0.8670	0.9311
No log	8.7857	492	0.8583	0.6911	0.8583	0.9264
No log	8.8214	494	0.8437	0.6911	0.8437	0.9185
No log	8.8571	496	0.8269	0.6911	0.8269	0.9093
No log	8.8929	498	0.8174	0.6852	0.8174	0.9041
0.3034	8.9286	500	0.8084	0.6792	0.8084	0.8991
0.3034	8.9643	502	0.8027	0.6913	0.8027	0.8959
0.3034	9.0	504	0.8113	0.6852	0.8113	0.9007
0.3034	9.0357	506	0.8308	0.6911	0.8308	0.9115
0.3034	9.0714	508	0.8468	0.6840	0.8468	0.9202
0.3034	9.1071	510	0.8673	0.6840	0.8673	0.9313
0.3034	9.1429	512	0.8747	0.6705	0.8747	0.9352
0.3034	9.1786	514	0.8698	0.6798	0.8698	0.9326
0.3034	9.2143	516	0.8581	0.6840	0.8581	0.9264
0.3034	9.25	518	0.8413	0.6840	0.8413	0.9172
0.3034	9.2857	520	0.8290	0.6840	0.8290	0.9105
0.3034	9.3214	522	0.8199	0.6911	0.8199	0.9055
0.3034	9.3571	524	0.8164	0.6911	0.8164	0.9035
0.3034	9.3929	526	0.8150	0.6911	0.8150	0.9028
0.3034	9.4286	528	0.8176	0.6911	0.8176	0.9042
0.3034	9.4643	530	0.8184	0.6911	0.8184	0.9047
0.3034	9.5	532	0.8126	0.6911	0.8126	0.9014
0.3034	9.5357	534	0.8079	0.7007	0.8079	0.8988
0.3034	9.5714	536	0.8051	0.7007	0.8051	0.8973
0.3034	9.6071	538	0.8074	0.7007	0.8074	0.8986
0.3034	9.6429	540	0.8125	0.7007	0.8125	0.9014
0.3034	9.6786	542	0.8179	0.7007	0.8179	0.9044
0.3034	9.7143	544	0.8241	0.6911	0.8241	0.9078
0.3034	9.75	546	0.8314	0.6911	0.8314	0.9118
0.3034	9.7857	548	0.8359	0.6911	0.8359	0.9143
0.3034	9.8214	550	0.8387	0.6911	0.8387	0.9158
0.3034	9.8571	552	0.8409	0.6911	0.8409	0.9170
0.3034	9.8929	554	0.8429	0.6911	0.8429	0.9181
0.3034	9.9286	556	0.8432	0.6911	0.8432	0.9183
0.3034	9.9643	558	0.8436	0.6911	0.8436	0.9185
0.3034	10.0	560	0.8436	0.6911	0.8436	0.9185

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1