ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9337
• Qwk: 0.4853
• Mse: 0.9337
• Rmse: 0.9663

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	3.9709	-0.0239	3.9709	1.9927
No log	0.0645	4	1.9198	0.0556	1.9198	1.3856
No log	0.0968	6	1.1863	0.0424	1.1863	1.0892
No log	0.1290	8	0.8044	0.0457	0.8044	0.8969
No log	0.1613	10	0.7221	0.2108	0.7221	0.8498
No log	0.1935	12	0.8894	0.0594	0.8894	0.9431
No log	0.2258	14	1.0119	-0.0402	1.0119	1.0060
No log	0.2581	16	0.7534	0.2505	0.7534	0.8680
No log	0.2903	18	0.7357	0.1667	0.7357	0.8577
No log	0.3226	20	0.7265	0.1381	0.7265	0.8523
No log	0.3548	22	0.7148	0.1381	0.7148	0.8454
No log	0.3871	24	0.7059	0.2023	0.7059	0.8402
No log	0.4194	26	0.7003	0.2333	0.7003	0.8369
No log	0.4516	28	0.6835	0.2645	0.6835	0.8268
No log	0.4839	30	0.6746	0.2333	0.6746	0.8213
No log	0.5161	32	0.7083	0.1546	0.7083	0.8416
No log	0.5484	34	0.8511	0.1276	0.8511	0.9225
No log	0.5806	36	0.8655	0.1333	0.8655	0.9303
No log	0.6129	38	0.8609	0.1333	0.8609	0.9279
No log	0.6452	40	0.7621	0.1667	0.7621	0.8730
No log	0.6774	42	0.6623	0.2648	0.6623	0.8138
No log	0.7097	44	0.6626	0.2882	0.6626	0.8140
No log	0.7419	46	0.6534	0.2690	0.6534	0.8084
No log	0.7742	48	0.6567	0.3426	0.6567	0.8104
No log	0.8065	50	0.8236	0.3506	0.8236	0.9075
No log	0.8387	52	0.9761	0.3201	0.9761	0.9880
No log	0.8710	54	1.1364	0.3064	1.1364	1.0660
No log	0.9032	56	0.9981	0.3273	0.9981	0.9990
No log	0.9355	58	0.8476	0.3645	0.8476	0.9207
No log	0.9677	60	0.6686	0.4357	0.6686	0.8177
No log	1.0	62	0.6463	0.4633	0.6463	0.8039
No log	1.0323	64	0.6702	0.5051	0.6702	0.8186
No log	1.0645	66	0.7608	0.4658	0.7608	0.8722
No log	1.0968	68	0.8321	0.4377	0.8321	0.9122
No log	1.1290	70	0.7525	0.4876	0.7525	0.8675
No log	1.1613	72	0.8312	0.4468	0.8312	0.9117
No log	1.1935	74	0.9995	0.3916	0.9995	0.9997
No log	1.2258	76	1.0270	0.3648	1.0270	1.0134
No log	1.2581	78	1.1007	0.3611	1.1007	1.0491
No log	1.2903	80	0.9763	0.4135	0.9763	0.9881
No log	1.3226	82	0.7733	0.4398	0.7733	0.8794
No log	1.3548	84	0.8242	0.4454	0.8242	0.9079
No log	1.3871	86	1.0034	0.3596	1.0034	1.0017
No log	1.4194	88	0.9915	0.3805	0.9915	0.9957
No log	1.4516	90	1.0315	0.3825	1.0315	1.0156
No log	1.4839	92	1.1567	0.3572	1.1567	1.0755
No log	1.5161	94	1.2601	0.3513	1.2601	1.1225
No log	1.5484	96	1.3502	0.3373	1.3502	1.1620
No log	1.5806	98	1.3726	0.3032	1.3726	1.1716
No log	1.6129	100	1.2602	0.3545	1.2602	1.1226
No log	1.6452	102	1.1466	0.3573	1.1466	1.0708
No log	1.6774	104	1.0365	0.3856	1.0365	1.0181
No log	1.7097	106	1.2055	0.3787	1.2055	1.0979
No log	1.7419	108	1.3300	0.3881	1.3300	1.1532
No log	1.7742	110	1.2696	0.4041	1.2696	1.1267
No log	1.8065	112	1.2528	0.3799	1.2528	1.1193
No log	1.8387	114	0.9565	0.4353	0.9565	0.9780
No log	1.8710	116	0.7249	0.4883	0.7249	0.8514
No log	1.9032	118	0.7027	0.4875	0.7027	0.8383
No log	1.9355	120	0.7815	0.4451	0.7815	0.8840
No log	1.9677	122	1.0918	0.3351	1.0918	1.0449
No log	2.0	124	1.4595	0.2911	1.4595	1.2081
No log	2.0323	126	1.3789	0.3953	1.3789	1.1743
No log	2.0645	128	0.9837	0.4773	0.9837	0.9918
No log	2.0968	130	0.8875	0.4836	0.8875	0.9421
No log	2.1290	132	0.9985	0.4504	0.9985	0.9992
No log	2.1613	134	1.4886	0.3480	1.4886	1.2201
No log	2.1935	136	1.6203	0.3063	1.6203	1.2729
No log	2.2258	138	1.3475	0.3367	1.3475	1.1608
No log	2.2581	140	0.8749	0.4646	0.8749	0.9354
No log	2.2903	142	0.6686	0.5200	0.6686	0.8177
No log	2.3226	144	0.6817	0.5071	0.6817	0.8256
No log	2.3548	146	0.8410	0.4896	0.8410	0.9171
No log	2.3871	148	1.2352	0.4446	1.2352	1.1114
No log	2.4194	150	1.4632	0.3928	1.4632	1.2096
No log	2.4516	152	1.3477	0.4170	1.3477	1.1609
No log	2.4839	154	1.2878	0.4222	1.2878	1.1348
No log	2.5161	156	1.0554	0.4575	1.0554	1.0273
No log	2.5484	158	0.9351	0.4478	0.9351	0.9670
No log	2.5806	160	0.9891	0.4684	0.9891	0.9945
No log	2.6129	162	1.0250	0.4244	1.0250	1.0124
No log	2.6452	164	0.9161	0.4225	0.9161	0.9571
No log	2.6774	166	1.0228	0.4045	1.0228	1.0113
No log	2.7097	168	1.1469	0.3213	1.1469	1.0710
No log	2.7419	170	1.0724	0.3665	1.0724	1.0355
No log	2.7742	172	0.8750	0.4240	0.8750	0.9354
No log	2.8065	174	0.8104	0.4697	0.8104	0.9002
No log	2.8387	176	0.9153	0.4426	0.9153	0.9567
No log	2.8710	178	1.0307	0.4082	1.0307	1.0152
No log	2.9032	180	1.0797	0.4038	1.0797	1.0391
No log	2.9355	182	0.9592	0.5003	0.9592	0.9794
No log	2.9677	184	1.0664	0.3991	1.0664	1.0327
No log	3.0	186	1.1454	0.4059	1.1454	1.0702
No log	3.0323	188	1.1019	0.4231	1.1019	1.0497
No log	3.0645	190	1.0238	0.4374	1.0238	1.0118
No log	3.0968	192	0.9943	0.4313	0.9943	0.9972
No log	3.1290	194	0.9535	0.4759	0.9535	0.9765
No log	3.1613	196	0.8554	0.4801	0.8554	0.9249
No log	3.1935	198	0.9323	0.4843	0.9323	0.9655
No log	3.2258	200	1.2338	0.4150	1.2338	1.1108
No log	3.2581	202	1.3676	0.3708	1.3676	1.1694
No log	3.2903	204	1.1803	0.4073	1.1803	1.0864
No log	3.3226	206	1.0139	0.4889	1.0139	1.0069
No log	3.3548	208	0.8879	0.4961	0.8879	0.9423
No log	3.3871	210	0.8611	0.4992	0.8611	0.9280
No log	3.4194	212	0.9860	0.4830	0.9860	0.9930
No log	3.4516	214	1.2107	0.3933	1.2107	1.1003
No log	3.4839	216	1.1509	0.3917	1.1509	1.0728
No log	3.5161	218	0.9502	0.4402	0.9502	0.9748
No log	3.5484	220	0.9275	0.4815	0.9275	0.9631
No log	3.5806	222	0.9161	0.4836	0.9161	0.9571
No log	3.6129	224	0.8869	0.4778	0.8869	0.9417
No log	3.6452	226	0.9886	0.4630	0.9886	0.9943
No log	3.6774	228	1.0696	0.4338	1.0696	1.0342
No log	3.7097	230	1.0419	0.4181	1.0419	1.0207
No log	3.7419	232	0.8395	0.4755	0.8395	0.9163
No log	3.7742	234	0.7082	0.5587	0.7082	0.8416
No log	3.8065	236	0.7574	0.5332	0.7574	0.8703
No log	3.8387	238	1.0119	0.4401	1.0119	1.0059
No log	3.8710	240	1.4882	0.3616	1.4882	1.2199
No log	3.9032	242	1.7255	0.3157	1.7255	1.3136
No log	3.9355	244	1.6125	0.3356	1.6125	1.2698
No log	3.9677	246	1.2321	0.3811	1.2321	1.1100
No log	4.0	248	0.9612	0.4111	0.9612	0.9804
No log	4.0323	250	0.7816	0.4222	0.7816	0.8841
No log	4.0645	252	0.7732	0.4376	0.7732	0.8793
No log	4.0968	254	0.8567	0.4755	0.8567	0.9256
No log	4.1290	256	1.0909	0.4355	1.0909	1.0445
No log	4.1613	258	1.4847	0.3567	1.4847	1.2185
No log	4.1935	260	1.6816	0.3242	1.6816	1.2968
No log	4.2258	262	1.5617	0.3273	1.5617	1.2497
No log	4.2581	264	1.2630	0.3701	1.2630	1.1238
No log	4.2903	266	0.8838	0.4446	0.8838	0.9401
No log	4.3226	268	0.6541	0.5094	0.6541	0.8088
No log	4.3548	270	0.5825	0.5543	0.5825	0.7632
No log	4.3871	272	0.6039	0.5221	0.6039	0.7771
No log	4.4194	274	0.7269	0.4822	0.7269	0.8526
No log	4.4516	276	0.8176	0.4101	0.8176	0.9042
No log	4.4839	278	0.8126	0.3958	0.8126	0.9014
No log	4.5161	280	0.7882	0.4319	0.7882	0.8878
No log	4.5484	282	0.7079	0.4945	0.7079	0.8413
No log	4.5806	284	0.6389	0.5229	0.6389	0.7993
No log	4.6129	286	0.6510	0.5234	0.6510	0.8069
No log	4.6452	288	0.7554	0.4855	0.7554	0.8692
No log	4.6774	290	0.9689	0.4328	0.9689	0.9843
No log	4.7097	292	1.1177	0.4442	1.1177	1.0572
No log	4.7419	294	1.0827	0.4503	1.0827	1.0405
No log	4.7742	296	0.9312	0.4535	0.9312	0.9650
No log	4.8065	298	0.8199	0.4447	0.8199	0.9055
No log	4.8387	300	0.8106	0.4855	0.8106	0.9004
No log	4.8710	302	0.8932	0.4744	0.8932	0.9451
No log	4.9032	304	0.9452	0.4676	0.9452	0.9722
No log	4.9355	306	0.9936	0.4477	0.9936	0.9968
No log	4.9677	308	1.1513	0.4140	1.1513	1.0730
No log	5.0	310	1.2379	0.3884	1.2379	1.1126
No log	5.0323	312	1.1884	0.3711	1.1884	1.0902
No log	5.0645	314	1.0097	0.4464	1.0097	1.0048
No log	5.0968	316	0.8064	0.4527	0.8064	0.8980
No log	5.1290	318	0.7449	0.4983	0.7449	0.8631
No log	5.1613	320	0.7169	0.5284	0.7169	0.8467
No log	5.1935	322	0.7698	0.4648	0.7698	0.8774
No log	5.2258	324	0.8879	0.4611	0.8879	0.9423
No log	5.2581	326	1.1493	0.3838	1.1493	1.0720
No log	5.2903	328	1.2928	0.3622	1.2928	1.1370
No log	5.3226	330	1.2230	0.3527	1.2230	1.1059
No log	5.3548	332	1.0375	0.4178	1.0375	1.0186
No log	5.3871	334	0.8942	0.4529	0.8942	0.9456
No log	5.4194	336	0.8032	0.4642	0.8032	0.8962
No log	5.4516	338	0.7996	0.4755	0.7996	0.8942
No log	5.4839	340	0.8117	0.4690	0.8117	0.9009
No log	5.5161	342	0.7879	0.4803	0.7879	0.8876
No log	5.5484	344	0.8580	0.4591	0.8580	0.9263
No log	5.5806	346	0.9461	0.4167	0.9461	0.9727
No log	5.6129	348	0.8982	0.4240	0.8982	0.9478
No log	5.6452	350	0.8700	0.4240	0.8700	0.9327
No log	5.6774	352	0.8365	0.4521	0.8365	0.9146
No log	5.7097	354	0.8274	0.4334	0.8274	0.9096
No log	5.7419	356	0.7817	0.4979	0.7817	0.8841
No log	5.7742	358	0.8267	0.4478	0.8267	0.9092
No log	5.8065	360	0.9695	0.4313	0.9695	0.9846
No log	5.8387	362	1.1364	0.4140	1.1364	1.0660
No log	5.8710	364	1.2880	0.3945	1.2880	1.1349
No log	5.9032	366	1.2687	0.3887	1.2687	1.1264
No log	5.9355	368	1.1358	0.4118	1.1358	1.0657
No log	5.9677	370	1.0363	0.4404	1.0363	1.0180
No log	6.0	372	0.9847	0.4343	0.9847	0.9923
No log	6.0323	374	0.8951	0.4767	0.8951	0.9461
No log	6.0645	376	0.8984	0.4762	0.8984	0.9479
No log	6.0968	378	0.9846	0.4447	0.9846	0.9923
No log	6.1290	380	1.0865	0.3851	1.0865	1.0423
No log	6.1613	382	1.0803	0.3851	1.0803	1.0394
No log	6.1935	384	1.0014	0.4226	1.0014	1.0007
No log	6.2258	386	0.9505	0.4446	0.9505	0.9749
No log	6.2581	388	0.8663	0.4489	0.8663	0.9307
No log	6.2903	390	0.8690	0.4538	0.8690	0.9322
No log	6.3226	392	0.9094	0.4513	0.9094	0.9536
No log	6.3548	394	0.9599	0.4362	0.9599	0.9798
No log	6.3871	396	0.9735	0.4362	0.9735	0.9867
No log	6.4194	398	0.9515	0.4429	0.9515	0.9754
No log	6.4516	400	0.9040	0.4313	0.9040	0.9508
No log	6.4839	402	0.8622	0.4315	0.8622	0.9285
No log	6.5161	404	0.7879	0.4621	0.7879	0.8876
No log	6.5484	406	0.7740	0.4639	0.7740	0.8798
No log	6.5806	408	0.7589	0.4601	0.7589	0.8711
No log	6.6129	410	0.8063	0.4527	0.8063	0.8979
No log	6.6452	412	0.8600	0.4443	0.8600	0.9274
No log	6.6774	414	0.9527	0.4226	0.9527	0.9761
No log	6.7097	416	0.9771	0.4226	0.9771	0.9885
No log	6.7419	418	0.9760	0.4226	0.9760	0.9879
No log	6.7742	420	0.9861	0.4226	0.9861	0.9930
No log	6.8065	422	0.9524	0.4474	0.9524	0.9759
No log	6.8387	424	0.8905	0.4370	0.8905	0.9437
No log	6.8710	426	0.8125	0.4557	0.8125	0.9014
No log	6.9032	428	0.8081	0.4557	0.8081	0.8989
No log	6.9355	430	0.8656	0.4463	0.8656	0.9304
No log	6.9677	432	0.8830	0.4544	0.8830	0.9397
No log	7.0	434	0.9102	0.4460	0.9102	0.9540
No log	7.0323	436	0.9205	0.4186	0.9205	0.9594
No log	7.0645	438	0.9314	0.4186	0.9314	0.9651
No log	7.0968	440	0.9372	0.4112	0.9372	0.9681
No log	7.1290	442	0.9001	0.4186	0.9001	0.9487
No log	7.1613	444	0.9105	0.4112	0.9105	0.9542
No log	7.1935	446	0.9591	0.4112	0.9591	0.9793
No log	7.2258	448	1.0179	0.4189	1.0179	1.0089
No log	7.2581	450	1.0388	0.4068	1.0388	1.0192
No log	7.2903	452	0.9777	0.4189	0.9777	0.9888
No log	7.3226	454	0.8983	0.4641	0.8983	0.9478
No log	7.3548	456	0.8734	0.4773	0.8734	0.9345
No log	7.3871	458	0.8336	0.4715	0.8336	0.9130
No log	7.4194	460	0.8073	0.4773	0.8073	0.8985
No log	7.4516	462	0.7863	0.4834	0.7863	0.8867
No log	7.4839	464	0.7252	0.4851	0.7252	0.8516
No log	7.5161	466	0.6855	0.5009	0.6855	0.8280
No log	7.5484	468	0.6872	0.4959	0.6872	0.8290
No log	7.5806	470	0.7134	0.4858	0.7134	0.8446
No log	7.6129	472	0.7400	0.4858	0.7400	0.8602
No log	7.6452	474	0.7756	0.4705	0.7756	0.8807
No log	7.6774	476	0.7975	0.4749	0.7975	0.8930
No log	7.7097	478	0.7743	0.4565	0.7743	0.8799
No log	7.7419	480	0.7578	0.4844	0.7578	0.8705
No log	7.7742	482	0.7230	0.4619	0.7230	0.8503
No log	7.8065	484	0.7198	0.4608	0.7198	0.8484
No log	7.8387	486	0.7347	0.4692	0.7347	0.8571
No log	7.8710	488	0.7733	0.4546	0.7733	0.8794
No log	7.9032	490	0.8315	0.4705	0.8315	0.9119
No log	7.9355	492	0.9086	0.4562	0.9086	0.9532
No log	7.9677	494	0.9578	0.4399	0.9578	0.9786
No log	8.0	496	0.9806	0.4447	0.9806	0.9902
No log	8.0323	498	0.9575	0.4398	0.9575	0.9785
0.4826	8.0645	500	0.9004	0.4628	0.9004	0.9489
0.4826	8.0968	502	0.8775	0.4773	0.8775	0.9368
0.4826	8.1290	504	0.8589	0.4839	0.8589	0.9268
0.4826	8.1613	506	0.8408	0.4767	0.8408	0.9169
0.4826	8.1935	508	0.8347	0.4822	0.8347	0.9136
0.4826	8.2258	510	0.8083	0.4718	0.8083	0.8990
0.4826	8.2581	512	0.7973	0.4551	0.7973	0.8929
0.4826	8.2903	514	0.8097	0.4730	0.8097	0.8998
0.4826	8.3226	516	0.8472	0.4832	0.8472	0.9205
0.4826	8.3548	518	0.8991	0.4551	0.8991	0.9482
0.4826	8.3871	520	0.9341	0.4541	0.9341	0.9665
0.4826	8.4194	522	0.9791	0.4241	0.9791	0.9895
0.4826	8.4516	524	1.0130	0.4241	1.0130	1.0065
0.4826	8.4839	526	1.0502	0.4241	1.0502	1.0248
0.4826	8.5161	528	1.0443	0.4241	1.0443	1.0219
0.4826	8.5484	530	1.0247	0.4312	1.0247	1.0123
0.4826	8.5806	532	0.9786	0.4535	0.9786	0.9892
0.4826	8.6129	534	0.9279	0.4573	0.9279	0.9633
0.4826	8.6452	536	0.9165	0.4573	0.9165	0.9573
0.4826	8.6774	538	0.9105	0.4573	0.9105	0.9542
0.4826	8.7097	540	0.8994	0.4641	0.8994	0.9484
0.4826	8.7419	542	0.8947	0.4836	0.8947	0.9459
0.4826	8.7742	544	0.9041	0.4641	0.9041	0.9509
0.4826	8.8065	546	0.9375	0.4729	0.9375	0.9682
0.4826	8.8387	548	0.9831	0.4521	0.9831	0.9915
0.4826	8.8710	550	0.9941	0.4521	0.9941	0.9971
0.4826	8.9032	552	0.9920	0.4521	0.9920	0.9960
0.4826	8.9355	554	0.9686	0.4521	0.9686	0.9842
0.4826	8.9677	556	0.9556	0.4712	0.9556	0.9775
0.4826	9.0	558	0.9322	0.4918	0.9322	0.9655
0.4826	9.0323	560	0.9039	0.4815	0.9039	0.9508
0.4826	9.0645	562	0.8876	0.4815	0.8876	0.9421
0.4826	9.0968	564	0.8681	0.4773	0.8681	0.9317
0.4826	9.1290	566	0.8702	0.4710	0.8702	0.9328
0.4826	9.1613	568	0.8909	0.4698	0.8909	0.9439
0.4826	9.1935	570	0.9151	0.4745	0.9151	0.9566
0.4826	9.2258	572	0.9239	0.4745	0.9239	0.9612
0.4826	9.2581	574	0.9259	0.4745	0.9259	0.9622
0.4826	9.2903	576	0.9388	0.4860	0.9388	0.9689
0.4826	9.3226	578	0.9467	0.4853	0.9467	0.9730
0.4826	9.3548	580	0.9506	0.4853	0.9506	0.9750
0.4826	9.3871	582	0.9393	0.4860	0.9393	0.9692
0.4826	9.4194	584	0.9223	0.4745	0.9223	0.9604
0.4826	9.4516	586	0.9061	0.4693	0.9061	0.9519
0.4826	9.4839	588	0.9026	0.4693	0.9026	0.9501
0.4826	9.5161	590	0.9067	0.4693	0.9067	0.9522
0.4826	9.5484	592	0.9039	0.4693	0.9039	0.9508
0.4826	9.5806	594	0.9033	0.4745	0.9033	0.9504
0.4826	9.6129	596	0.9031	0.4745	0.9031	0.9503
0.4826	9.6452	598	0.9085	0.4745	0.9085	0.9532
0.4826	9.6774	600	0.9175	0.4611	0.9175	0.9579
0.4826	9.7097	602	0.9252	0.4724	0.9252	0.9619
0.4826	9.7419	604	0.9310	0.4724	0.9310	0.9649
0.4826	9.7742	606	0.9366	0.4775	0.9366	0.9678
0.4826	9.8065	608	0.9363	0.4775	0.9363	0.9676
0.4826	9.8387	610	0.9335	0.4853	0.9335	0.9662
0.4826	9.8710	612	0.9321	0.4853	0.9321	0.9655
0.4826	9.9032	614	0.9327	0.4853	0.9327	0.9657
0.4826	9.9355	616	0.9323	0.4853	0.9323	0.9655
0.4826	9.9677	618	0.9329	0.4853	0.9329	0.9659
0.4826	10.0	620	0.9337	0.4853	0.9337	0.9663

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1