ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k8_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6946
• Qwk: 0.1675
• Mse: 0.6946
• Rmse: 0.8334

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0556	2	3.7111	0.0	3.7111	1.9264
No log	0.1111	4	2.4117	-0.0163	2.4117	1.5530
No log	0.1667	6	1.4622	0.0255	1.4622	1.2092
No log	0.2222	8	1.0519	0.0632	1.0519	1.0256
No log	0.2778	10	0.6496	0.1020	0.6496	0.8060
No log	0.3333	12	0.6119	0.0569	0.6119	0.7822
No log	0.3889	14	0.6217	0.0569	0.6217	0.7884
No log	0.4444	16	0.7361	0.1475	0.7361	0.8579
No log	0.5	18	0.6389	0.1030	0.6389	0.7993
No log	0.5556	20	0.6311	0.0569	0.6311	0.7944
No log	0.6111	22	0.6515	0.0	0.6515	0.8071
No log	0.6667	24	0.5680	0.0569	0.5680	0.7537
No log	0.7222	26	0.8891	0.0823	0.8891	0.9429
No log	0.7778	28	0.9588	0.0617	0.9588	0.9792
No log	0.8333	30	0.7530	0.1712	0.7530	0.8678
No log	0.8889	32	0.5959	0.0303	0.5959	0.7720
No log	0.9444	34	0.6484	0.0	0.6484	0.8052
No log	1.0	36	0.7096	0.0	0.7096	0.8424
No log	1.0556	38	0.6402	0.0	0.6402	0.8001
No log	1.1111	40	0.6079	0.0222	0.6079	0.7797
No log	1.1667	42	0.7106	0.1638	0.7106	0.8430
No log	1.2222	44	0.7749	0.0918	0.7749	0.8803
No log	1.2778	46	0.6087	0.1111	0.6087	0.7802
No log	1.3333	48	0.6242	0.0	0.6242	0.7901
No log	1.3889	50	0.6590	0.0	0.6590	0.8118
No log	1.4444	52	0.6369	0.0909	0.6369	0.7981
No log	1.5	54	0.7216	0.0409	0.7216	0.8495
No log	1.5556	56	1.1467	0.0888	1.1467	1.0708
No log	1.6111	58	1.0264	0.0357	1.0264	1.0131
No log	1.6667	60	0.7527	0.1195	0.7527	0.8676
No log	1.7222	62	0.8996	0.0045	0.8996	0.9485
No log	1.7778	64	0.9512	-0.0396	0.9512	0.9753
No log	1.8333	66	0.8171	0.1186	0.8171	0.9039
No log	1.8889	68	0.8384	0.0417	0.8384	0.9156
No log	1.9444	70	0.7068	-0.0115	0.7068	0.8407
No log	2.0	72	1.1653	0.0040	1.1653	1.0795
No log	2.0556	74	1.5368	-0.0323	1.5368	1.2397
No log	2.1111	76	0.9920	0.0442	0.9920	0.9960
No log	2.1667	78	0.6773	0.2169	0.6773	0.8230
No log	2.2222	80	0.6838	0.1919	0.6838	0.8269
No log	2.2778	82	0.7908	0.1579	0.7908	0.8892
No log	2.3333	84	0.9282	0.0044	0.9282	0.9634
No log	2.3889	86	1.3364	0.1049	1.3364	1.1560
No log	2.4444	88	1.3187	0.1304	1.3187	1.1483
No log	2.5	90	0.6843	0.3371	0.6843	0.8272
No log	2.5556	92	0.6332	0.3333	0.6332	0.7957
No log	2.6111	94	0.7317	0.2332	0.7317	0.8554
No log	2.6667	96	1.5326	0.1084	1.5326	1.2380
No log	2.7222	98	1.7162	0.0659	1.7162	1.3100
No log	2.7778	100	0.8900	0.1111	0.8900	0.9434
No log	2.8333	102	0.8784	0.1712	0.8784	0.9372
No log	2.8889	104	1.1433	0.1571	1.1433	1.0692
No log	2.9444	106	0.7112	0.1675	0.7112	0.8433
No log	3.0	108	1.0949	0.0406	1.0949	1.0464
No log	3.0556	110	1.5842	0.0788	1.5842	1.2586
No log	3.1111	112	1.3256	0.0278	1.3256	1.1513
No log	3.1667	114	0.7083	0.2195	0.7083	0.8416
No log	3.2222	116	0.7691	0.0833	0.7691	0.8770
No log	3.2778	118	0.8148	0.1133	0.8148	0.9027
No log	3.3333	120	0.6634	0.1801	0.6634	0.8145
No log	3.3889	122	0.9328	0.1504	0.9328	0.9658
No log	3.4444	124	0.9200	0.1504	0.9200	0.9592
No log	3.5	126	0.7195	0.1345	0.7195	0.8483
No log	3.5556	128	0.9085	0.0685	0.9085	0.9532
No log	3.6111	130	0.9035	0.0631	0.9035	0.9505
No log	3.6667	132	0.7376	0.1732	0.7376	0.8589
No log	3.7222	134	0.9604	0.0769	0.9604	0.9800
No log	3.7778	136	0.8653	0.1287	0.8653	0.9302
No log	3.8333	138	0.7199	0.1732	0.7199	0.8485
No log	3.8889	140	0.7233	0.1364	0.7233	0.8505
No log	3.9444	142	0.7665	0.1828	0.7665	0.8755
No log	4.0	144	0.7990	0.1429	0.7990	0.8938
No log	4.0556	146	0.8142	0.1443	0.8142	0.9023
No log	4.1111	148	0.8244	0.1527	0.8244	0.9080
No log	4.1667	150	0.8021	0.1515	0.8021	0.8956
No log	4.2222	152	0.7824	0.2350	0.7824	0.8845
No log	4.2778	154	0.9613	0.0744	0.9613	0.9805
No log	4.3333	156	1.3301	0.1351	1.3301	1.1533
No log	4.3889	158	1.1549	0.0929	1.1549	1.0746
No log	4.4444	160	0.7772	0.2897	0.7772	0.8816
No log	4.5	162	0.7816	0.2838	0.7816	0.8841
No log	4.5556	164	0.9549	0.2069	0.9549	0.9772
No log	4.6111	166	1.3212	0.1560	1.3212	1.1494
No log	4.6667	168	1.1828	0.1572	1.1828	1.0876
No log	4.7222	170	0.7162	0.2251	0.7162	0.8463
No log	4.7778	172	0.6258	0.3023	0.6258	0.7911
No log	4.8333	174	0.6915	0.2360	0.6915	0.8315
No log	4.8889	176	0.8964	0.1864	0.8964	0.9468
No log	4.9444	178	0.7453	0.2941	0.7453	0.8633
No log	5.0	180	0.6125	0.3103	0.6125	0.7826
No log	5.0556	182	0.5966	0.3103	0.5966	0.7724
No log	5.1111	184	0.6576	0.2350	0.6576	0.8109
No log	5.1667	186	0.7769	0.2453	0.7769	0.8814
No log	5.2222	188	1.1126	0.1882	1.1126	1.0548
No log	5.2778	190	0.9525	0.2129	0.9525	0.9759
No log	5.3333	192	0.7116	0.1921	0.7116	0.8435
No log	5.3889	194	0.6371	0.3043	0.6371	0.7982
No log	5.4444	196	0.6441	0.3297	0.6441	0.8025
No log	5.5	198	0.7816	0.1373	0.7816	0.8841
No log	5.5556	200	1.0161	0.2119	1.0161	1.0080
No log	5.6111	202	0.9511	0.2126	0.9511	0.9752
No log	5.6667	204	0.7563	0.1373	0.7563	0.8697
No log	5.7222	206	0.7620	0.1269	0.7620	0.8729
No log	5.7778	208	0.8686	0.1781	0.8686	0.9320
No log	5.8333	210	0.9058	0.1781	0.9058	0.9517
No log	5.8889	212	0.7296	0.1915	0.7296	0.8542
No log	5.9444	214	0.7101	0.1398	0.7101	0.8426
No log	6.0	216	0.8334	0.1287	0.8334	0.9129
No log	6.0556	218	1.1669	0.1601	1.1669	1.0802
No log	6.1111	220	1.3022	0.1634	1.3022	1.1411
No log	6.1667	222	1.0310	0.1815	1.0310	1.0154
No log	6.2222	224	0.7336	0.2323	0.7336	0.8565
No log	6.2778	226	0.6373	0.2558	0.6373	0.7983
No log	6.3333	228	0.6289	0.3455	0.6289	0.7930
No log	6.3889	230	0.6359	0.1902	0.6359	0.7974
No log	6.4444	232	0.7066	0.125	0.7066	0.8406
No log	6.5	234	0.7789	0.1373	0.7789	0.8826
No log	6.5556	236	0.8379	0.1388	0.8379	0.9154
No log	6.6111	238	0.8274	0.1321	0.8274	0.9096
No log	6.6667	240	0.8609	0.1321	0.8609	0.9278
No log	6.7222	242	0.9173	0.1781	0.9173	0.9578
No log	6.7778	244	0.8046	0.1321	0.8046	0.8970
No log	6.8333	246	0.7091	0.1475	0.7091	0.8421
No log	6.8889	248	0.7146	0.1088	0.7146	0.8454
No log	6.9444	250	0.7382	0.1340	0.7382	0.8592
No log	7.0	252	0.7375	0.1340	0.7375	0.8588
No log	7.0556	254	0.7255	0.1269	0.7255	0.8518
No log	7.1111	256	0.6854	0.1828	0.6854	0.8279
No log	7.1667	258	0.6769	0.2688	0.6769	0.8227
No log	7.2222	260	0.6956	0.3333	0.6956	0.8340
No log	7.2778	262	0.7271	0.1340	0.7271	0.8527
No log	7.3333	264	0.8124	0.1456	0.8124	0.9013
No log	7.3889	266	0.9732	0.1795	0.9732	0.9865
No log	7.4444	268	0.9692	0.1795	0.9692	0.9845
No log	7.5	270	0.8519	0.0599	0.8519	0.9230
No log	7.5556	272	0.7382	0.1269	0.7382	0.8592
No log	7.6111	274	0.7208	0.3016	0.7208	0.8490
No log	7.6667	276	0.7254	0.3089	0.7254	0.8517
No log	7.7222	278	0.7054	0.2766	0.7054	0.8399
No log	7.7778	280	0.6821	0.2865	0.6821	0.8259
No log	7.8333	282	0.6626	0.2179	0.6626	0.8140
No log	7.8889	284	0.7102	0.1675	0.7102	0.8427
No log	7.9444	286	0.7664	0.0980	0.7664	0.8754
No log	8.0	288	0.7381	0.1287	0.7381	0.8591
No log	8.0556	290	0.6751	0.2165	0.6751	0.8216
No log	8.1111	292	0.6571	0.2179	0.6571	0.8106
No log	8.1667	294	0.6602	0.2179	0.6602	0.8125
No log	8.2222	296	0.6839	0.2157	0.6839	0.8270
No log	8.2778	298	0.7665	0.1402	0.7665	0.8755
No log	8.3333	300	0.8160	0.1416	0.8160	0.9033
No log	8.3889	302	0.7962	0.1402	0.7962	0.8923
No log	8.4444	304	0.7879	0.1402	0.7879	0.8876
No log	8.5	306	0.7878	0.1402	0.7878	0.8876
No log	8.5556	308	0.7531	0.0980	0.7531	0.8678
No log	8.6111	310	0.7045	0.2536	0.7045	0.8394
No log	8.6667	312	0.6631	0.2563	0.6631	0.8143
No log	8.7222	314	0.6454	0.2542	0.6454	0.8034
No log	8.7778	316	0.6432	0.2542	0.6432	0.8020
No log	8.8333	318	0.6583	0.2577	0.6583	0.8113
No log	8.8889	320	0.6972	0.2233	0.6972	0.8350
No log	8.9444	322	0.7613	0.0943	0.7613	0.8725
No log	9.0	324	0.8411	0.1429	0.8411	0.9171
No log	9.0556	326	0.8989	0.1504	0.8989	0.9481
No log	9.1111	328	0.9090	0.1515	0.9090	0.9534
No log	9.1667	330	0.8702	0.1855	0.8702	0.9328
No log	9.2222	332	0.7994	0.1416	0.7994	0.8941
No log	9.2778	334	0.7302	0.1304	0.7302	0.8545
No log	9.3333	336	0.6903	0.1675	0.6903	0.8309
No log	9.3889	338	0.6645	0.1503	0.6645	0.8152
No log	9.4444	340	0.6489	0.2563	0.6489	0.8055
No log	9.5	342	0.6447	0.2563	0.6447	0.8030
No log	9.5556	344	0.6506	0.2563	0.6506	0.8066
No log	9.6111	346	0.6582	0.1503	0.6582	0.8113
No log	9.6667	348	0.6663	0.1503	0.6663	0.8163
No log	9.7222	350	0.6751	0.1919	0.6751	0.8217
No log	9.7778	352	0.6865	0.1675	0.6865	0.8286
No log	9.8333	354	0.6927	0.1675	0.6927	0.8323
No log	9.8889	356	0.6947	0.1675	0.6947	0.8335
No log	9.9444	358	0.6946	0.1675	0.6946	0.8334
No log	10.0	360	0.6946	0.1675	0.6946	0.8334

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1