ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3021
• Qwk: 0.1125
• Mse: 1.3021
• Rmse: 1.1411

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	3.3201	-0.0350	3.3201	1.8221
No log	0.0816	4	1.6711	-0.0130	1.6711	1.2927
No log	0.1224	6	1.2888	0.0335	1.2888	1.1353
No log	0.1633	8	0.6280	-0.0411	0.6280	0.7924
No log	0.2041	10	0.6590	-0.0159	0.6590	0.8118
No log	0.2449	12	0.7494	-0.0732	0.7494	0.8657
No log	0.2857	14	0.7579	-0.0746	0.7579	0.8706
No log	0.3265	16	0.7254	-0.0909	0.7254	0.8517
No log	0.3673	18	0.6949	0.0476	0.6949	0.8336
No log	0.4082	20	0.7215	-0.0159	0.7215	0.8494
No log	0.4490	22	0.6605	-0.0081	0.6605	0.8127
No log	0.4898	24	0.6185	0.0	0.6185	0.7864
No log	0.5306	26	0.6179	0.0	0.6179	0.7860
No log	0.5714	28	0.6212	0.0	0.6212	0.7882
No log	0.6122	30	0.6297	0.0	0.6297	0.7935
No log	0.6531	32	0.7004	0.0	0.7004	0.8369
No log	0.6939	34	0.6817	0.0	0.6817	0.8257
No log	0.7347	36	0.6374	0.0	0.6374	0.7984
No log	0.7755	38	0.6924	-0.0963	0.6924	0.8321
No log	0.8163	40	0.7198	-0.1111	0.7198	0.8484
No log	0.8571	42	0.7251	-0.1631	0.7251	0.8515
No log	0.8980	44	0.6838	-0.0963	0.6838	0.8269
No log	0.9388	46	0.6605	-0.0233	0.6605	0.8127
No log	0.9796	48	0.6493	-0.0159	0.6493	0.8058
No log	1.0204	50	0.7023	0.0720	0.7023	0.8380
No log	1.0612	52	0.7156	0.0769	0.7156	0.8460
No log	1.1020	54	0.6620	0.0067	0.6620	0.8136
No log	1.1429	56	0.7612	0.0647	0.7612	0.8724
No log	1.1837	58	0.8426	0.0370	0.8426	0.9179
No log	1.2245	60	0.6950	0.0380	0.6950	0.8337
No log	1.2653	62	0.7629	0.1195	0.7629	0.8735
No log	1.3061	64	0.7838	0.1285	0.7838	0.8853
No log	1.3469	66	0.7048	0.1325	0.7048	0.8395
No log	1.3878	68	0.7108	0.1138	0.7108	0.8431
No log	1.4286	70	0.7606	0.0703	0.7606	0.8722
No log	1.4694	72	0.6818	0.0526	0.6818	0.8257
No log	1.5102	74	0.7421	0.0545	0.7421	0.8615
No log	1.5510	76	0.7816	0.0638	0.7816	0.8841
No log	1.5918	78	1.0772	0.0866	1.0772	1.0379
No log	1.6327	80	1.0615	0.0551	1.0615	1.0303
No log	1.6735	82	0.8017	0.0374	0.8017	0.8954
No log	1.7143	84	0.8436	0.0457	0.8436	0.9185
No log	1.7551	86	0.8352	0.0157	0.8352	0.9139
No log	1.7959	88	0.8219	0.0359	0.8219	0.9066
No log	1.8367	90	1.1136	0.0270	1.1136	1.0553
No log	1.8776	92	1.1101	0.0551	1.1101	1.0536
No log	1.9184	94	1.0601	0.0820	1.0601	1.0296
No log	1.9592	96	0.9032	0.0049	0.9032	0.9504
No log	2.0	98	0.9125	0.0316	0.9125	0.9552
No log	2.0408	100	0.8845	0.125	0.8845	0.9405
No log	2.0816	102	0.9243	0.0	0.9243	0.9614
No log	2.1224	104	1.2570	0.0111	1.2570	1.1212
No log	2.1633	106	1.2108	0.0335	1.2108	1.1004
No log	2.2041	108	0.9503	0.0230	0.9503	0.9748
No log	2.2449	110	0.8059	0.1269	0.8059	0.8977
No log	2.2857	112	0.7734	0.1304	0.7734	0.8794
No log	2.3265	114	0.7662	0.1158	0.7662	0.8753
No log	2.3673	116	0.7733	0.0497	0.7733	0.8794
No log	2.4082	118	0.7999	0.0439	0.7999	0.8944
No log	2.4490	120	0.8683	0.0512	0.8683	0.9318
No log	2.4898	122	0.9555	0.0968	0.9555	0.9775
No log	2.5306	124	1.0150	0.0207	1.0150	1.0075
No log	2.5714	126	1.1068	0.1818	1.1068	1.0520
No log	2.6122	128	1.4304	0.1329	1.4304	1.1960
No log	2.6531	130	1.6650	0.1160	1.6650	1.2903
No log	2.6939	132	1.1443	0.1533	1.1443	1.0697
No log	2.7347	134	0.9506	0.1807	0.9506	0.9750
No log	2.7755	136	0.9121	0.2510	0.9121	0.9550
No log	2.8163	138	1.3727	0.1429	1.3727	1.1716
No log	2.8571	140	2.3967	0.0619	2.3967	1.5481
No log	2.8980	142	2.3370	0.0427	2.3370	1.5287
No log	2.9388	144	1.6572	0.1304	1.6572	1.2873
No log	2.9796	146	1.3527	0.0809	1.3527	1.1630
No log	3.0204	148	1.5534	0.1097	1.5534	1.2464
No log	3.0612	150	2.0837	0.0386	2.0837	1.4435
No log	3.1020	152	2.0327	0.0148	2.0327	1.4257
No log	3.1429	154	1.7148	0.0284	1.7148	1.3095
No log	3.1837	156	1.6884	0.0573	1.6884	1.2994
No log	3.2245	158	1.8517	-0.0029	1.8517	1.3608
No log	3.2653	160	1.8319	0.0247	1.8319	1.3535
No log	3.3061	162	1.8459	0.0227	1.8459	1.3586
No log	3.3469	164	1.5142	0.0789	1.5142	1.2305
No log	3.3878	166	1.3427	0.1143	1.3427	1.1587
No log	3.4286	168	1.5910	0.0062	1.5910	1.2614
No log	3.4694	170	1.6742	-0.0265	1.6742	1.2939
No log	3.5102	172	2.0368	0.0392	2.0368	1.4272
No log	3.5510	174	1.9040	0.0028	1.9040	1.3799
No log	3.5918	176	1.8051	-0.0233	1.8051	1.3435
No log	3.6327	178	1.9539	0.0313	1.9539	1.3978
No log	3.6735	180	2.0659	0.0028	2.0659	1.4373
No log	3.7143	182	1.6933	0.0289	1.6933	1.3013
No log	3.7551	184	1.6537	0.0264	1.6537	1.2860
No log	3.7959	186	2.0217	-0.0221	2.0217	1.4219
No log	3.8367	188	2.1020	-0.0479	2.1020	1.4498
No log	3.8776	190	2.0227	-0.0029	2.0227	1.4222
No log	3.9184	192	1.7533	-0.0149	1.7533	1.3241
No log	3.9592	194	1.3072	0.1095	1.3072	1.1433
No log	4.0	196	1.2501	0.1292	1.2501	1.1181
No log	4.0408	198	1.4974	0.0499	1.4974	1.2237
No log	4.0816	200	2.0012	0.0437	2.0012	1.4146
No log	4.1224	202	1.9437	-0.0055	1.9437	1.3942
No log	4.1633	204	1.4794	0.0405	1.4794	1.2163
No log	4.2041	206	1.0633	0.0871	1.0633	1.0312
No log	4.2449	208	1.0732	0.0871	1.0732	1.0360
No log	4.2857	210	1.4165	0.0886	1.4165	1.1902
No log	4.3265	212	1.9881	0.0457	1.9881	1.4100
No log	4.3673	214	2.0231	0.0515	2.0231	1.4224
No log	4.4082	216	1.5722	-0.0205	1.5722	1.2539
No log	4.4490	218	1.3819	0.0891	1.3819	1.1755
No log	4.4898	220	1.2099	0.1014	1.2099	1.0999
No log	4.5306	222	1.4167	0.0868	1.4167	1.1903
No log	4.5714	224	1.4441	0.1083	1.4441	1.2017
No log	4.6122	226	1.3385	0.1316	1.3385	1.1569
No log	4.6531	228	1.5219	0.0843	1.5219	1.2337
No log	4.6939	230	1.6500	0.0659	1.6500	1.2845
No log	4.7347	232	2.0869	0.0420	2.0869	1.4446
No log	4.7755	234	2.1084	0.0449	2.1084	1.4520
No log	4.8163	236	1.9599	0.0408	1.9599	1.3999
No log	4.8571	238	1.5649	0.0909	1.5649	1.2510
No log	4.8980	240	1.4588	0.0915	1.4588	1.2078
No log	4.9388	242	1.6746	-0.0221	1.6746	1.2941
No log	4.9796	244	1.9358	0.0866	1.9358	1.3913
No log	5.0204	246	1.8022	0.0423	1.8022	1.3424
No log	5.0612	248	1.6399	-0.0210	1.6399	1.2806
No log	5.1020	250	1.4166	0.1141	1.4166	1.1902
No log	5.1429	252	1.2634	0.0556	1.2634	1.1240
No log	5.1837	254	1.2644	0.0580	1.2644	1.1245
No log	5.2245	256	1.5562	0.0984	1.5562	1.2475
No log	5.2653	258	1.9711	-0.0213	1.9711	1.4039
No log	5.3061	260	1.8980	-0.0028	1.8980	1.3777
No log	5.3469	262	1.5636	0.0523	1.5636	1.2504
No log	5.3878	264	1.2237	0.1081	1.2237	1.1062
No log	5.4286	266	1.2211	0.1081	1.2211	1.1050
No log	5.4694	268	1.1965	0.1317	1.1965	1.0939
No log	5.5102	270	1.3438	0.1373	1.3438	1.1592
No log	5.5510	272	1.4944	0.1226	1.4944	1.2225
No log	5.5918	274	1.4445	0.0933	1.4445	1.2019
No log	5.6327	276	1.4196	0.1111	1.4196	1.1915
No log	5.6735	278	1.3035	0.1081	1.3035	1.1417
No log	5.7143	280	1.3695	0.1081	1.3695	1.1702
No log	5.7551	282	1.6655	0.0991	1.6655	1.2905
No log	5.7959	284	1.8900	-0.0305	1.8900	1.3748
No log	5.8367	286	1.7622	-0.0115	1.7622	1.3275
No log	5.8776	288	1.3603	0.1068	1.3603	1.1663
No log	5.9184	290	1.1131	0.1292	1.1131	1.0550
No log	5.9592	292	1.0827	0.1292	1.0827	1.0405
No log	6.0	294	1.2454	0.0565	1.2454	1.1160
No log	6.0408	296	1.6308	0.0877	1.6308	1.2770
No log	6.0816	298	1.7875	0.0508	1.7875	1.3370
No log	6.1224	300	1.6691	0.0227	1.6691	1.2919
No log	6.1633	302	1.4032	0.0886	1.4032	1.1846
No log	6.2041	304	1.3907	0.1083	1.3907	1.1793
No log	6.2449	306	1.6405	0.0734	1.6405	1.2808
No log	6.2857	308	1.9829	0.0513	1.9829	1.4082
No log	6.3265	310	1.9113	0.0496	1.9113	1.3825
No log	6.3673	312	1.7527	0.0	1.7527	1.3239
No log	6.4082	314	1.6304	0.0734	1.6304	1.2769
No log	6.4490	316	1.7750	0.0276	1.7750	1.3323
No log	6.4898	318	1.7664	0.0029	1.7664	1.3291
No log	6.5306	320	1.5226	0.1083	1.5226	1.2339
No log	6.5714	322	1.3799	0.1182	1.3799	1.1747
No log	6.6122	324	1.3322	0.1125	1.3322	1.1542
No log	6.6531	326	1.4717	0.0968	1.4717	1.2131
No log	6.6939	328	1.5018	0.0927	1.5018	1.2255
No log	6.7347	330	1.5761	0.0250	1.5761	1.2554
No log	6.7755	332	1.5378	0.0440	1.5378	1.2401
No log	6.8163	334	1.4111	0.1139	1.4111	1.1879
No log	6.8571	336	1.4547	0.1139	1.4547	1.2061
No log	6.8980	338	1.4799	0.0692	1.4799	1.2165
No log	6.9388	340	1.6035	-0.0182	1.6035	1.2663
No log	6.9796	342	1.5795	-0.0182	1.5795	1.2568
No log	7.0204	344	1.4888	0.0712	1.4888	1.2202
No log	7.0612	346	1.4262	0.0692	1.4262	1.1942
No log	7.1020	348	1.4547	0.0277	1.4547	1.2061
No log	7.1429	350	1.3905	0.0692	1.3905	1.1792
No log	7.1837	352	1.3124	0.1125	1.3124	1.1456
No log	7.2245	354	1.3985	0.0217	1.3985	1.1826
No log	7.2653	356	1.5491	-0.0182	1.5491	1.2446
No log	7.3061	358	1.5232	-0.0182	1.5232	1.2342
No log	7.3469	360	1.4722	0.0464	1.4722	1.2134
No log	7.3878	362	1.4204	0.1139	1.4204	1.1918
No log	7.4286	364	1.2809	0.1125	1.2809	1.1318
No log	7.4694	366	1.2262	0.0541	1.2262	1.1074
No log	7.5102	368	1.2077	0.1014	1.2077	1.0990
No log	7.5510	370	1.2785	0.0850	1.2785	1.1307
No log	7.5918	372	1.4803	0.0250	1.4803	1.2167
No log	7.6327	374	1.6025	0.0296	1.6025	1.2659
No log	7.6735	376	1.5760	0.0296	1.5760	1.2554
No log	7.7143	378	1.4332	0.0638	1.4332	1.1971
No log	7.7551	380	1.2674	0.1081	1.2674	1.1258
No log	7.7959	382	1.2286	0.1317	1.2286	1.1084
No log	7.8367	384	1.2626	0.1340	1.2626	1.1237
No log	7.8776	386	1.3786	0.1111	1.3786	1.1741
No log	7.9184	388	1.5565	0.0453	1.5565	1.2476
No log	7.9592	390	1.6194	0.0554	1.6194	1.2726
No log	8.0	392	1.6157	0.0520	1.6157	1.2711
No log	8.0408	394	1.5018	0.0733	1.5018	1.2255
No log	8.0816	396	1.4448	0.0488	1.4448	1.2020
No log	8.1224	398	1.4289	0.0488	1.4289	1.1954
No log	8.1633	400	1.3615	0.0968	1.3615	1.1669
No log	8.2041	402	1.3405	0.0927	1.3405	1.1578
No log	8.2449	404	1.3885	0.0927	1.3885	1.1783
No log	8.2857	406	1.4351	0.0920	1.4351	1.1980
No log	8.3265	408	1.4453	0.0920	1.4453	1.2022
No log	8.3673	410	1.4622	0.0920	1.4622	1.2092
No log	8.4082	412	1.5327	0.0453	1.5327	1.2380
No log	8.4490	414	1.6213	0.0698	1.6213	1.2733
No log	8.4898	416	1.6230	0.0264	1.6230	1.2740
No log	8.5306	418	1.5787	0.0264	1.5787	1.2565
No log	8.5714	420	1.5317	0.0453	1.5317	1.2376
No log	8.6122	422	1.4271	0.0909	1.4271	1.1946
No log	8.6531	424	1.3469	0.0627	1.3469	1.1606
No log	8.6939	426	1.2952	0.0831	1.2952	1.1381
No log	8.7347	428	1.2993	0.0831	1.2993	1.1399
No log	8.7755	430	1.3311	0.0909	1.3311	1.1537
No log	8.8163	432	1.4082	0.0440	1.4082	1.1867
No log	8.8571	434	1.4967	0.0244	1.4967	1.2234
No log	8.8980	436	1.5348	0.0311	1.5348	1.2389
No log	8.9388	438	1.4877	0.0476	1.4877	1.2197
No log	8.9796	440	1.4030	0.0440	1.4030	1.1845
No log	9.0204	442	1.2976	0.0909	1.2976	1.1391
No log	9.0612	444	1.2243	0.1096	1.2243	1.1065
No log	9.1020	446	1.1839	0.1032	1.1839	1.0881
No log	9.1429	448	1.1883	0.1032	1.1883	1.0901
No log	9.1837	450	1.2034	0.0769	1.2034	1.0970
No log	9.2245	452	1.2561	0.1096	1.2561	1.1208
No log	9.2653	454	1.3265	0.0909	1.3265	1.1517
No log	9.3061	456	1.4171	0.0440	1.4171	1.1904
No log	9.3469	458	1.4661	0.0440	1.4661	1.2108
No log	9.3878	460	1.4723	0.0440	1.4723	1.2134
No log	9.4286	462	1.4563	0.0440	1.4563	1.2068
No log	9.4694	464	1.4227	0.0440	1.4227	1.1928
No log	9.5102	466	1.4002	0.0927	1.4002	1.1833
No log	9.5510	468	1.3796	0.0909	1.3796	1.1746
No log	9.5918	470	1.3560	0.0909	1.3560	1.1645
No log	9.6327	472	1.3519	0.0909	1.3519	1.1627
No log	9.6735	474	1.3434	0.0909	1.3434	1.1591
No log	9.7143	476	1.3285	0.0909	1.3285	1.1526
No log	9.7551	478	1.3262	0.0909	1.3262	1.1516
No log	9.7959	480	1.3271	0.0909	1.3271	1.1520
No log	9.8367	482	1.3186	0.0909	1.3186	1.1483
No log	9.8776	484	1.3141	0.0909	1.3141	1.1463
No log	9.9184	486	1.3092	0.0909	1.3092	1.1442
No log	9.9592	488	1.3040	0.1125	1.3040	1.1419
No log	10.0	490	1.3021	0.1125	1.3021	1.1411

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1