ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9342
• Qwk: 0.6922
• Mse: 0.9342
• Rmse: 0.9665

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	2.1680	0.0156	2.1680	1.4724
No log	0.0909	4	1.6328	0.0759	1.6328	1.2778
No log	0.1364	6	1.7104	0.1495	1.7104	1.3078
No log	0.1818	8	1.8170	0.1722	1.8170	1.3480
No log	0.2273	10	1.8184	0.2171	1.8184	1.3485
No log	0.2727	12	1.5745	0.2915	1.5745	1.2548
No log	0.3182	14	1.3895	0.2868	1.3895	1.1788
No log	0.3636	16	1.4465	0.3895	1.4465	1.2027
No log	0.4091	18	1.7245	0.2592	1.7245	1.3132
No log	0.4545	20	1.7516	0.2823	1.7516	1.3235
No log	0.5	22	1.7216	0.2741	1.7216	1.3121
No log	0.5455	24	1.7452	0.3527	1.7452	1.3211
No log	0.5909	26	1.8904	0.2585	1.8904	1.3749
No log	0.6364	28	1.9483	0.2440	1.9483	1.3958
No log	0.6818	30	1.8016	0.3158	1.8016	1.3423
No log	0.7273	32	1.6147	0.3312	1.6147	1.2707
No log	0.7727	34	1.6195	0.3318	1.6195	1.2726
No log	0.8182	36	1.7093	0.3179	1.7093	1.3074
No log	0.8636	38	2.0448	0.3231	2.0448	1.4300
No log	0.9091	40	2.4748	0.3008	2.4748	1.5732
No log	0.9545	42	2.5004	0.2930	2.5004	1.5813
No log	1.0	44	2.6207	0.3084	2.6207	1.6189
No log	1.0455	46	2.3959	0.3450	2.3959	1.5479
No log	1.0909	48	1.9170	0.3512	1.9170	1.3846
No log	1.1364	50	1.6163	0.4136	1.6163	1.2713
No log	1.1818	52	1.4347	0.4604	1.4347	1.1978
No log	1.2273	54	1.3761	0.4604	1.3761	1.1731
No log	1.2727	56	1.4589	0.4397	1.4589	1.2078
No log	1.3182	58	1.6848	0.3992	1.6848	1.2980
No log	1.3636	60	1.8731	0.3906	1.8731	1.3686
No log	1.4091	62	2.0583	0.3542	2.0583	1.4347
No log	1.4545	64	2.2413	0.3484	2.2413	1.4971
No log	1.5	66	2.1829	0.3439	2.1829	1.4775
No log	1.5455	68	2.0682	0.3909	2.0682	1.4381
No log	1.5909	70	2.0189	0.4207	2.0189	1.4209
No log	1.6364	72	1.9722	0.4055	1.9722	1.4044
No log	1.6818	74	1.8347	0.4221	1.8347	1.3545
No log	1.7273	76	1.7451	0.4499	1.7451	1.3210
No log	1.7727	78	1.6437	0.4535	1.6437	1.2821
No log	1.8182	80	1.5829	0.4680	1.5829	1.2581
No log	1.8636	82	1.6915	0.5012	1.6915	1.3006
No log	1.9091	84	1.5738	0.5111	1.5738	1.2545
No log	1.9545	86	1.3353	0.6001	1.3353	1.1556
No log	2.0	88	1.1906	0.6172	1.1906	1.0912
No log	2.0455	90	1.0371	0.6507	1.0371	1.0184
No log	2.0909	92	0.8947	0.6661	0.8947	0.9459
No log	2.1364	94	0.9397	0.6516	0.9397	0.9694
No log	2.1818	96	1.0246	0.6694	1.0246	1.0122
No log	2.2273	98	1.2177	0.6540	1.2177	1.1035
No log	2.2727	100	1.2185	0.6599	1.2185	1.1039
No log	2.3182	102	1.0245	0.6610	1.0245	1.0122
No log	2.3636	104	0.7633	0.6957	0.7633	0.8737
No log	2.4091	106	0.6927	0.6924	0.6927	0.8323
No log	2.4545	108	0.7725	0.6893	0.7725	0.8789
No log	2.5	110	0.9001	0.6839	0.9001	0.9487
No log	2.5455	112	1.1227	0.6547	1.1227	1.0596
No log	2.5909	114	1.2300	0.6269	1.2300	1.1091
No log	2.6364	116	1.0795	0.6601	1.0795	1.0390
No log	2.6818	118	0.8566	0.6638	0.8566	0.9256
No log	2.7273	120	0.7266	0.6875	0.7266	0.8524
No log	2.7727	122	0.7483	0.6707	0.7483	0.8650
No log	2.8182	124	0.8038	0.6582	0.8038	0.8965
No log	2.8636	126	0.9754	0.6382	0.9754	0.9876
No log	2.9091	128	1.1845	0.5768	1.1845	1.0884
No log	2.9545	130	1.3295	0.5298	1.3295	1.1531
No log	3.0	132	1.4821	0.5221	1.4821	1.2174
No log	3.0455	134	1.7291	0.5208	1.7291	1.3150
No log	3.0909	136	1.6951	0.5265	1.6951	1.3020
No log	3.1364	138	1.3037	0.5930	1.3037	1.1418
No log	3.1818	140	0.9399	0.6564	0.9399	0.9695
No log	3.2273	142	0.8237	0.6293	0.8237	0.9076
No log	3.2727	144	0.8373	0.6188	0.8373	0.9150
No log	3.3182	146	0.9444	0.6547	0.9444	0.9718
No log	3.3636	148	1.1681	0.5956	1.1681	1.0808
No log	3.4091	150	1.1470	0.6054	1.1470	1.0710
No log	3.4545	152	0.9801	0.6248	0.9801	0.9900
No log	3.5	154	1.0082	0.6277	1.0082	1.0041
No log	3.5455	156	1.0596	0.6249	1.0596	1.0294
No log	3.5909	158	1.1173	0.6418	1.1173	1.0570
No log	3.6364	160	1.1568	0.6577	1.1568	1.0756
No log	3.6818	162	1.2351	0.6212	1.2351	1.1114
No log	3.7273	164	1.1867	0.6484	1.1867	1.0894
No log	3.7727	166	1.0815	0.6584	1.0815	1.0400
No log	3.8182	168	0.8835	0.6944	0.8835	0.9400
No log	3.8636	170	0.7720	0.6890	0.7720	0.8786
No log	3.9091	172	0.8037	0.7072	0.8037	0.8965
No log	3.9545	174	0.8924	0.6914	0.8924	0.9447
No log	4.0	176	0.9970	0.6597	0.9970	0.9985
No log	4.0455	178	1.1355	0.6426	1.1355	1.0656
No log	4.0909	180	1.0738	0.6207	1.0738	1.0362
No log	4.1364	182	1.0084	0.6176	1.0084	1.0042
No log	4.1818	184	0.9840	0.6387	0.9840	0.9919
No log	4.2273	186	0.9258	0.6511	0.9258	0.9622
No log	4.2727	188	0.9648	0.6268	0.9648	0.9822
No log	4.3182	190	1.0572	0.5935	1.0572	1.0282
No log	4.3636	192	1.0900	0.5923	1.0900	1.0440
No log	4.4091	194	1.1252	0.5923	1.1252	1.0608
No log	4.4545	196	1.1693	0.6180	1.1693	1.0814
No log	4.5	198	1.1848	0.6252	1.1848	1.0885
No log	4.5455	200	1.1898	0.6252	1.1898	1.0908
No log	4.5909	202	1.1692	0.6290	1.1692	1.0813
No log	4.6364	204	1.1927	0.6290	1.1927	1.0921
No log	4.6818	206	1.0668	0.6106	1.0668	1.0329
No log	4.7273	208	0.9401	0.6425	0.9401	0.9696
No log	4.7727	210	0.8338	0.6502	0.8338	0.9131
No log	4.8182	212	0.8409	0.6582	0.8409	0.9170
No log	4.8636	214	0.9294	0.6525	0.9294	0.9641
No log	4.9091	216	0.9986	0.6673	0.9986	0.9993
No log	4.9545	218	1.1457	0.6465	1.1457	1.0704
No log	5.0	220	1.2508	0.6187	1.2508	1.1184
No log	5.0455	222	1.3116	0.5845	1.3116	1.1453
No log	5.0909	224	1.3092	0.5550	1.3092	1.1442
No log	5.1364	226	1.2635	0.5479	1.2635	1.1241
No log	5.1818	228	1.3528	0.5427	1.3528	1.1631
No log	5.2273	230	1.4165	0.5385	1.4165	1.1902
No log	5.2727	232	1.4201	0.5370	1.4201	1.1917
No log	5.3182	234	1.3217	0.5485	1.3217	1.1497
No log	5.3636	236	1.3149	0.5509	1.3149	1.1467
No log	5.4091	238	1.3566	0.5485	1.3566	1.1647
No log	5.4545	240	1.4510	0.5377	1.4510	1.2046
No log	5.5	242	1.4957	0.5519	1.4957	1.2230
No log	5.5455	244	1.4481	0.5526	1.4481	1.2034
No log	5.5909	246	1.2738	0.5655	1.2738	1.1286
No log	5.6364	248	1.0804	0.6282	1.0804	1.0394
No log	5.6818	250	0.9375	0.6512	0.9375	0.9683
No log	5.7273	252	0.9308	0.6351	0.9308	0.9648
No log	5.7727	254	0.9843	0.6479	0.9843	0.9921
No log	5.8182	256	1.0529	0.6426	1.0529	1.0261
No log	5.8636	258	1.0610	0.6426	1.0610	1.0300
No log	5.9091	260	0.9601	0.6456	0.9601	0.9799
No log	5.9545	262	0.8621	0.6651	0.8621	0.9285
No log	6.0	264	0.8366	0.6322	0.8366	0.9147
No log	6.0455	266	0.9088	0.6256	0.9088	0.9533
No log	6.0909	268	1.0053	0.6353	1.0053	1.0027
No log	6.1364	270	1.0416	0.6391	1.0416	1.0206
No log	6.1818	272	1.0157	0.6560	1.0157	1.0078
No log	6.2273	274	0.9739	0.6789	0.9739	0.9869
No log	6.2727	276	0.9512	0.6755	0.9512	0.9753
No log	6.3182	278	0.9840	0.6816	0.9840	0.9920
No log	6.3636	280	1.1085	0.6488	1.1085	1.0529
No log	6.4091	282	1.2702	0.5922	1.2702	1.1270
No log	6.4545	284	1.4601	0.5370	1.4601	1.2083
No log	6.5	286	1.5784	0.5335	1.5784	1.2563
No log	6.5455	288	1.5172	0.5270	1.5172	1.2317
No log	6.5909	290	1.3709	0.5621	1.3709	1.1709
No log	6.6364	292	1.2283	0.5879	1.2283	1.1083
No log	6.6818	294	1.1120	0.6478	1.1120	1.0545
No log	6.7273	296	1.0288	0.6650	1.0288	1.0143
No log	6.7727	298	1.0008	0.6714	1.0008	1.0004
No log	6.8182	300	0.9819	0.6864	0.9819	0.9909
No log	6.8636	302	0.9957	0.6633	0.9957	0.9978
No log	6.9091	304	0.9609	0.6912	0.9609	0.9802
No log	6.9545	306	0.9710	0.6844	0.9710	0.9854
No log	7.0	308	1.0001	0.6712	1.0001	1.0000
No log	7.0455	310	0.9890	0.6867	0.9890	0.9945
No log	7.0909	312	1.0010	0.6861	1.0010	1.0005
No log	7.1364	314	1.0350	0.6444	1.0350	1.0174
No log	7.1818	316	1.0074	0.6826	1.0074	1.0037
No log	7.2273	318	0.9406	0.6928	0.9406	0.9698
No log	7.2727	320	0.8687	0.6797	0.8687	0.9320
No log	7.3182	322	0.8200	0.7019	0.8200	0.9056
No log	7.3636	324	0.8366	0.7269	0.8366	0.9146
No log	7.4091	326	0.9212	0.7076	0.9212	0.9598
No log	7.4545	328	1.0365	0.6636	1.0365	1.0181
No log	7.5	330	1.0809	0.6621	1.0809	1.0397
No log	7.5455	332	1.1307	0.6492	1.1307	1.0634
No log	7.5909	334	1.1114	0.6492	1.1114	1.0542
No log	7.6364	336	1.0316	0.6800	1.0316	1.0157
No log	7.6818	338	0.9725	0.7033	0.9725	0.9862
No log	7.7273	340	0.9597	0.7169	0.9597	0.9796
No log	7.7727	342	0.9819	0.6947	0.9819	0.9909
No log	7.8182	344	0.9952	0.6947	0.9952	0.9976
No log	7.8636	346	0.9599	0.7169	0.9599	0.9797
No log	7.9091	348	0.9358	0.7176	0.9358	0.9673
No log	7.9545	350	0.9171	0.7182	0.9171	0.9577
No log	8.0	352	0.8926	0.7182	0.8926	0.9448
No log	8.0455	354	0.9103	0.7182	0.9103	0.9541
No log	8.0909	356	0.9563	0.7169	0.9563	0.9779
No log	8.1364	358	0.9565	0.7169	0.9565	0.9780
No log	8.1818	360	0.9273	0.7169	0.9273	0.9630
No log	8.2273	362	0.9105	0.7136	0.9105	0.9542
No log	8.2727	364	0.8752	0.7136	0.8752	0.9355
No log	8.3182	366	0.8453	0.7098	0.8453	0.9194
No log	8.3636	368	0.8406	0.7098	0.8406	0.9168
No log	8.4091	370	0.8604	0.7131	0.8604	0.9276
No log	8.4545	372	0.8996	0.7136	0.8996	0.9485
No log	8.5	374	0.9542	0.7058	0.9542	0.9768
No log	8.5455	376	1.0006	0.6774	1.0006	1.0003
No log	8.5909	378	1.0055	0.6774	1.0055	1.0027
No log	8.6364	380	0.9796	0.6998	0.9796	0.9898
No log	8.6818	382	0.9319	0.6998	0.9319	0.9654
No log	8.7273	384	0.8787	0.6924	0.8787	0.9374
No log	8.7727	386	0.8401	0.7059	0.8401	0.9166
No log	8.8182	388	0.8341	0.7059	0.8341	0.9133
No log	8.8636	390	0.8389	0.7059	0.8389	0.9159
No log	8.9091	392	0.8634	0.6908	0.8634	0.9292
No log	8.9545	394	0.8872	0.6811	0.8872	0.9419
No log	9.0	396	0.8981	0.6811	0.8981	0.9477
No log	9.0455	398	0.9031	0.6889	0.9031	0.9503
No log	9.0909	400	0.9245	0.6998	0.9245	0.9615
No log	9.1364	402	0.9535	0.6998	0.9535	0.9765
No log	9.1818	404	0.9847	0.6998	0.9847	0.9923
No log	9.2273	406	1.0115	0.6774	1.0115	1.0057
No log	9.2727	408	1.0321	0.6774	1.0321	1.0159
No log	9.3182	410	1.0304	0.6774	1.0304	1.0151
No log	9.3636	412	1.0204	0.6774	1.0204	1.0102
No log	9.4091	414	1.0037	0.6910	1.0037	1.0018
No log	9.4545	416	0.9917	0.6910	0.9917	0.9959
No log	9.5	418	0.9842	0.6833	0.9842	0.9921
No log	9.5455	420	0.9714	0.6922	0.9714	0.9856
No log	9.5909	422	0.9609	0.6922	0.9609	0.9803
No log	9.6364	424	0.9473	0.6922	0.9473	0.9733
No log	9.6818	426	0.9399	0.6922	0.9399	0.9695
No log	9.7273	428	0.9362	0.6922	0.9362	0.9676
No log	9.7727	430	0.9317	0.6922	0.9317	0.9652
No log	9.8182	432	0.9266	0.6922	0.9266	0.9626
No log	9.8636	434	0.9263	0.6922	0.9263	0.9624
No log	9.9091	436	0.9293	0.6922	0.9293	0.9640
No log	9.9545	438	0.9328	0.6922	0.9328	0.9658
No log	10.0	440	0.9342	0.6922	0.9342	0.9665

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1