ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7119
• Qwk: 0.3600
• Mse: 0.7119
• Rmse: 0.8437

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	3.3254	-0.0149	3.3254	1.8236
No log	0.0645	4	1.7444	-0.0101	1.7444	1.3207
No log	0.0968	6	1.0735	-0.0268	1.0735	1.0361
No log	0.1290	8	0.7103	0.0805	0.7103	0.8428
No log	0.1613	10	0.6462	-0.0612	0.6462	0.8039
No log	0.1935	12	0.7001	-0.0435	0.7001	0.8367
No log	0.2258	14	0.6067	0.1698	0.6067	0.7789
No log	0.2581	16	1.3295	0.0817	1.3295	1.1530
No log	0.2903	18	1.0220	0.1055	1.0220	1.0109
No log	0.3226	20	0.6260	0.2542	0.6260	0.7912
No log	0.3548	22	0.5505	0.0476	0.5505	0.7420
No log	0.3871	24	0.5680	0.0388	0.5680	0.7537
No log	0.4194	26	0.6361	0.0732	0.6361	0.7976
No log	0.4516	28	0.6244	0.0071	0.6244	0.7902
No log	0.4839	30	0.6262	0.1045	0.6262	0.7913
No log	0.5161	32	0.6496	0.1163	0.6496	0.8060
No log	0.5484	34	0.6519	0.0952	0.6519	0.8074
No log	0.5806	36	0.7628	0.2523	0.7628	0.8734
No log	0.6129	38	1.0353	0.2263	1.0353	1.0175
No log	0.6452	40	0.8073	0.2920	0.8073	0.8985
No log	0.6774	42	0.6931	0.3524	0.6931	0.8325
No log	0.7097	44	0.6271	0.1209	0.6271	0.7919
No log	0.7419	46	0.5648	0.1285	0.5648	0.7515
No log	0.7742	48	0.5535	0.1739	0.5535	0.7440
No log	0.8065	50	0.6449	0.2157	0.6449	0.8031
No log	0.8387	52	0.5702	0.3231	0.5702	0.7551
No log	0.8710	54	0.6199	0.3469	0.6199	0.7874
No log	0.9032	56	0.6434	0.3469	0.6434	0.8021
No log	0.9355	58	0.6060	0.2323	0.6060	0.7785
No log	0.9677	60	0.8042	0.2803	0.8042	0.8968
No log	1.0	62	0.5990	0.4502	0.5990	0.7740
No log	1.0323	64	0.5948	0.3398	0.5948	0.7712
No log	1.0645	66	1.1968	0.12	1.1968	1.0940
No log	1.0968	68	1.3762	0.0788	1.3762	1.1731
No log	1.1290	70	0.7980	0.2137	0.7980	0.8933
No log	1.1613	72	0.6635	0.2986	0.6635	0.8145
No log	1.1935	74	0.8250	0.2070	0.8250	0.9083
No log	1.2258	76	0.5908	0.3016	0.5908	0.7686
No log	1.2581	78	0.7320	0.2549	0.7320	0.8556
No log	1.2903	80	0.8490	0.25	0.8490	0.9214
No log	1.3226	82	0.5813	0.2865	0.5813	0.7624
No log	1.3548	84	0.6107	0.2941	0.6107	0.7815
No log	1.3871	86	0.6733	0.2079	0.6733	0.8205
No log	1.4194	88	0.5614	0.3446	0.5614	0.7492
No log	1.4516	90	0.6606	0.2086	0.6606	0.8127
No log	1.4839	92	1.0784	0.1818	1.0784	1.0385
No log	1.5161	94	1.0660	0.2124	1.0660	1.0325
No log	1.5484	96	0.7575	0.1837	0.7575	0.8703
No log	1.5806	98	0.5891	0.2444	0.5891	0.7675
No log	1.6129	100	0.5917	0.2970	0.5917	0.7692
No log	1.6452	102	0.6734	0.2432	0.6734	0.8206
No log	1.6774	104	0.9756	0.2062	0.9756	0.9877
No log	1.7097	106	0.9439	0.2389	0.9439	0.9715
No log	1.7419	108	0.6747	0.3171	0.6747	0.8214
No log	1.7742	110	0.5923	0.2370	0.5923	0.7696
No log	1.8065	112	0.6584	0.3433	0.6584	0.8114
No log	1.8387	114	1.8930	0.1142	1.8930	1.3759
No log	1.8710	116	2.4209	0.0476	2.4209	1.5559
No log	1.9032	118	1.4461	0.2408	1.4461	1.2025
No log	1.9355	120	0.6528	0.2830	0.6528	0.8079
No log	1.9677	122	0.5919	0.3725	0.5919	0.7694
No log	2.0	124	0.7093	0.2696	0.7093	0.8422
No log	2.0323	126	0.6246	0.2593	0.6246	0.7903
No log	2.0645	128	0.6937	0.2696	0.6937	0.8329
No log	2.0968	130	0.5579	0.3498	0.5579	0.7469
No log	2.1290	132	0.6097	0.2579	0.6097	0.7809
No log	2.1613	134	0.7263	0.3391	0.7263	0.8522
No log	2.1935	136	1.0018	0.3123	1.0018	1.0009
No log	2.2258	138	0.6556	0.2390	0.6556	0.8097
No log	2.2581	140	0.6166	0.4450	0.6166	0.7852
No log	2.2903	142	0.5431	0.4225	0.5431	0.7369
No log	2.3226	144	0.8712	0.2366	0.8712	0.9334
No log	2.3548	146	0.9837	0.2334	0.9837	0.9918
No log	2.3871	148	0.8527	0.2374	0.8527	0.9234
No log	2.4194	150	1.0607	0.2054	1.0607	1.0299
No log	2.4516	152	1.0863	0.1557	1.0863	1.0423
No log	2.4839	154	0.7310	0.3504	0.7310	0.8550
No log	2.5161	156	0.8027	0.2667	0.8027	0.8960
No log	2.5484	158	1.5475	0.2167	1.5475	1.2440
No log	2.5806	160	2.4732	0.0669	2.4732	1.5726
No log	2.6129	162	2.2961	0.1094	2.2961	1.5153
No log	2.6452	164	0.9689	0.2440	0.9689	0.9843
No log	2.6774	166	0.6194	0.4798	0.6194	0.7870
No log	2.7097	168	0.8158	0.3636	0.8158	0.9032
No log	2.7419	170	1.3761	0.2568	1.3761	1.1731
No log	2.7742	172	1.1017	0.2508	1.1017	1.0496
No log	2.8065	174	0.6646	0.3722	0.6646	0.8152
No log	2.8387	176	0.8226	0.2993	0.8226	0.9069
No log	2.8710	178	1.3350	0.2941	1.3350	1.1554
No log	2.9032	180	0.9670	0.3103	0.9670	0.9833
No log	2.9355	182	0.7559	0.3011	0.7559	0.8694
No log	2.9677	184	1.0329	0.3113	1.0329	1.0163
No log	3.0	186	0.9749	0.3311	0.9749	0.9873
No log	3.0323	188	0.5744	0.4502	0.5744	0.7579
No log	3.0645	190	0.5586	0.4502	0.5586	0.7474
No log	3.0968	192	0.5492	0.4502	0.5492	0.7411
No log	3.1290	194	0.7376	0.2787	0.7376	0.8589
No log	3.1613	196	0.6744	0.3188	0.6744	0.8212
No log	3.1935	198	0.7433	0.2520	0.7433	0.8622
No log	3.2258	200	0.6347	0.3214	0.6347	0.7967
No log	3.2581	202	0.4837	0.5892	0.4837	0.6955
No log	3.2903	204	0.5362	0.4924	0.5362	0.7323
No log	3.3226	206	0.8014	0.3360	0.8014	0.8952
No log	3.3548	208	1.1107	0.2313	1.1107	1.0539
No log	3.3871	210	0.9454	0.2340	0.9454	0.9723
No log	3.4194	212	0.6320	0.4286	0.6320	0.7950
No log	3.4516	214	0.7223	0.3821	0.7223	0.8499
No log	3.4839	216	1.0203	0.1594	1.0203	1.0101
No log	3.5161	218	0.8404	0.2184	0.8404	0.9168
No log	3.5484	220	0.5482	0.3978	0.5482	0.7404
No log	3.5806	222	0.5279	0.3684	0.5279	0.7266
No log	3.6129	224	0.6158	0.3299	0.6158	0.7847
No log	3.6452	226	0.6013	0.3299	0.6013	0.7754
No log	3.6774	228	0.6367	0.3153	0.6367	0.7979
No log	3.7097	230	0.7764	0.3036	0.7764	0.8811
No log	3.7419	232	0.7396	0.3188	0.7396	0.8600
No log	3.7742	234	0.7112	0.3702	0.7112	0.8433
No log	3.8065	236	1.0506	0.2113	1.0506	1.0250
No log	3.8387	238	1.2057	0.2485	1.2057	1.0980
No log	3.8710	240	0.8371	0.3280	0.8371	0.9149
No log	3.9032	242	0.6208	0.3448	0.6208	0.7879
No log	3.9355	244	0.6845	0.2727	0.6845	0.8274
No log	3.9677	246	0.9633	0.2714	0.9633	0.9815
No log	4.0	248	1.0802	0.2388	1.0802	1.0393
No log	4.0323	250	0.9560	0.2490	0.9560	0.9777
No log	4.0645	252	0.5964	0.2239	0.5964	0.7723
No log	4.0968	254	0.5513	0.2967	0.5513	0.7425
No log	4.1290	256	0.5975	0.2893	0.5975	0.7730
No log	4.1613	258	0.7780	0.2881	0.7780	0.8820
No log	4.1935	260	0.7348	0.2941	0.7348	0.8572
No log	4.2258	262	0.5674	0.3846	0.5674	0.7533
No log	4.2581	264	0.5173	0.4286	0.5173	0.7192
No log	4.2903	266	0.5633	0.3575	0.5633	0.7505
No log	4.3226	268	0.7944	0.2787	0.7944	0.8913
No log	4.3548	270	0.7904	0.2881	0.7904	0.8891
No log	4.3871	272	0.6612	0.3962	0.6612	0.8131
No log	4.4194	274	0.5060	0.4627	0.5060	0.7113
No log	4.4516	276	0.5029	0.4627	0.5029	0.7091
No log	4.4839	278	0.7172	0.3600	0.7172	0.8469
No log	4.5161	280	1.6376	0.1792	1.6376	1.2797
No log	4.5484	282	2.0641	0.1924	2.0641	1.4367
No log	4.5806	284	1.7036	0.1830	1.7036	1.3052
No log	4.6129	286	0.8743	0.3957	0.8743	0.9350
No log	4.6452	288	0.5898	0.4516	0.5898	0.7680
No log	4.6774	290	0.6008	0.4939	0.6008	0.7751
No log	4.7097	292	0.8982	0.3404	0.8982	0.9477
No log	4.7419	294	1.1515	0.2294	1.1515	1.0731
No log	4.7742	296	1.0256	0.2303	1.0256	1.0127
No log	4.8065	298	0.6028	0.5113	0.6028	0.7764
No log	4.8387	300	0.5150	0.5152	0.5150	0.7176
No log	4.8710	302	0.4885	0.4455	0.4885	0.6989
No log	4.9032	304	0.4977	0.4455	0.4977	0.7055
No log	4.9355	306	0.5617	0.5434	0.5617	0.7495
No log	4.9677	308	0.7728	0.4325	0.7728	0.8791
No log	5.0	310	1.1883	0.2298	1.1883	1.0901
No log	5.0323	312	1.1917	0.2298	1.1917	1.0917
No log	5.0645	314	0.9446	0.3165	0.9446	0.9719
No log	5.0968	316	0.7420	0.4161	0.7420	0.8614
No log	5.1290	318	0.6001	0.4393	0.6001	0.7747
No log	5.1613	320	0.6628	0.4921	0.6628	0.8141
No log	5.1935	322	1.1051	0.3165	1.1051	1.0513
No log	5.2258	324	1.3304	0.2229	1.3304	1.1534
No log	5.2581	326	1.0212	0.3183	1.0212	1.0105
No log	5.2903	328	0.7108	0.4504	0.7108	0.8431
No log	5.3226	330	0.5568	0.3744	0.5568	0.7462
No log	5.3548	332	0.5422	0.4231	0.5422	0.7363
No log	5.3871	334	0.6293	0.4495	0.6293	0.7933
No log	5.4194	336	0.8350	0.2424	0.8350	0.9138
No log	5.4516	338	0.7538	0.2787	0.7538	0.8682
No log	5.4839	340	0.5523	0.4343	0.5523	0.7432
No log	5.5161	342	0.5023	0.4409	0.5023	0.7087
No log	5.5484	344	0.5071	0.4229	0.5071	0.7121
No log	5.5806	346	0.5060	0.5102	0.5060	0.7113
No log	5.6129	348	0.7014	0.3242	0.7014	0.8375
No log	5.6452	350	0.7974	0.2672	0.7974	0.8930
No log	5.6774	352	0.6557	0.3739	0.6557	0.8097
No log	5.7097	354	0.5186	0.5779	0.5186	0.7202
No log	5.7419	356	0.5132	0.5261	0.5132	0.7164
No log	5.7742	358	0.5956	0.5242	0.5956	0.7717
No log	5.8065	360	0.9404	0.3020	0.9404	0.9697
No log	5.8387	362	1.1290	0.3009	1.1290	1.0625
No log	5.8710	364	0.9638	0.3165	0.9638	0.9817
No log	5.9032	366	0.6568	0.4980	0.6568	0.8105
No log	5.9355	368	0.5789	0.4897	0.5789	0.7609
No log	5.9677	370	0.5953	0.5592	0.5953	0.7715
No log	6.0	372	0.7440	0.3731	0.7440	0.8626
No log	6.0323	374	0.8950	0.2774	0.8950	0.9460
No log	6.0645	376	0.7584	0.2424	0.7584	0.8709
No log	6.0968	378	0.5442	0.4518	0.5442	0.7377
No log	6.1290	380	0.4638	0.4725	0.4638	0.6810
No log	6.1613	382	0.4579	0.5269	0.4579	0.6767
No log	6.1935	384	0.4885	0.4098	0.4885	0.6989
No log	6.2258	386	0.6930	0.2838	0.6930	0.8325
No log	6.2581	388	0.9362	0.3016	0.9362	0.9676
No log	6.2903	390	0.9512	0.2971	0.9512	0.9753
No log	6.3226	392	0.8075	0.3223	0.8075	0.8986
No log	6.3548	394	0.5701	0.5404	0.5701	0.7551
No log	6.3871	396	0.5033	0.4766	0.5033	0.7094
No log	6.4194	398	0.4965	0.4766	0.4965	0.7046
No log	6.4516	400	0.5100	0.5349	0.5100	0.7142
No log	6.4839	402	0.6516	0.4286	0.6516	0.8072
No log	6.5161	404	0.8488	0.2828	0.8488	0.9213
No log	6.5484	406	0.8158	0.3123	0.8158	0.9032
No log	6.5806	408	0.6378	0.3607	0.6378	0.7987
No log	6.6129	410	0.5345	0.5423	0.5345	0.7311
No log	6.6452	412	0.4933	0.5169	0.4933	0.7023
No log	6.6774	414	0.5081	0.5169	0.5081	0.7128
No log	6.7097	416	0.6072	0.4980	0.6072	0.7792
No log	6.7419	418	0.8553	0.2727	0.8553	0.9248
No log	6.7742	420	1.2466	0.2420	1.2466	1.1165
No log	6.8065	422	1.4013	0.2219	1.4013	1.1838
No log	6.8387	424	1.2428	0.2285	1.2428	1.1148
No log	6.8710	426	0.8891	0.3049	0.8891	0.9429
No log	6.9032	428	0.5670	0.5215	0.5670	0.7530
No log	6.9355	430	0.5069	0.4902	0.5069	0.7120
No log	6.9677	432	0.5097	0.4902	0.5097	0.7140
No log	7.0	434	0.5771	0.4766	0.5771	0.7597
No log	7.0323	436	0.8335	0.2828	0.8335	0.9129
No log	7.0645	438	1.1380	0.2547	1.1380	1.0668
No log	7.0968	440	1.1742	0.2547	1.1742	1.0836
No log	7.1290	442	0.9795	0.2774	0.9795	0.9897
No log	7.1613	444	0.7549	0.3265	0.7549	0.8689
No log	7.1935	446	0.6704	0.4737	0.6704	0.8188
No log	7.2258	448	0.6210	0.4862	0.6210	0.7880
No log	7.2581	450	0.5861	0.4930	0.5861	0.7655
No log	7.2903	452	0.6537	0.4043	0.6537	0.8085
No log	7.3226	454	0.6553	0.3667	0.6553	0.8095
No log	7.3548	456	0.6728	0.3667	0.6728	0.8203
No log	7.3871	458	0.6242	0.4133	0.6242	0.7901
No log	7.4194	460	0.5938	0.4439	0.5938	0.7706
No log	7.4516	462	0.6514	0.3702	0.6514	0.8071
No log	7.4839	464	0.6385	0.3702	0.6385	0.7991
No log	7.5161	466	0.6280	0.4087	0.6280	0.7925
No log	7.5484	468	0.6585	0.3667	0.6585	0.8115
No log	7.5806	470	0.6591	0.4087	0.6591	0.8118
No log	7.6129	472	0.7038	0.3600	0.7038	0.8389
No log	7.6452	474	0.6563	0.4087	0.6563	0.8101
No log	7.6774	476	0.6538	0.4087	0.6538	0.8086
No log	7.7097	478	0.6326	0.4081	0.6326	0.7954
No log	7.7419	480	0.6726	0.4087	0.6726	0.8201
No log	7.7742	482	0.6393	0.4133	0.6393	0.7996
No log	7.8065	484	0.6521	0.4133	0.6521	0.8075
No log	7.8387	486	0.6973	0.3255	0.6973	0.8351
No log	7.8710	488	0.7786	0.3213	0.7786	0.8824
No log	7.9032	490	0.7560	0.3745	0.7560	0.8695
No log	7.9355	492	0.6530	0.3702	0.6530	0.8081
No log	7.9677	494	0.6094	0.4133	0.6094	0.7806
No log	8.0	496	0.6127	0.4133	0.6127	0.7828
No log	8.0323	498	0.5694	0.4286	0.5694	0.7546
0.3826	8.0645	500	0.5563	0.4341	0.5563	0.7459
0.3826	8.0968	502	0.5693	0.4286	0.5693	0.7545
0.3826	8.1290	504	0.5732	0.4233	0.5732	0.7571
0.3826	8.1613	506	0.5996	0.3917	0.5996	0.7744
0.3826	8.1935	508	0.6640	0.3480	0.6640	0.8148
0.3826	8.2258	510	0.7069	0.3058	0.7069	0.8408
0.3826	8.2581	512	0.6795	0.3448	0.6795	0.8243
0.3826	8.2903	514	0.6036	0.4182	0.6036	0.7769
0.3826	8.3226	516	0.5491	0.4286	0.5491	0.7410
0.3826	8.3548	518	0.5605	0.4286	0.5605	0.7487
0.3826	8.3871	520	0.6245	0.3917	0.6245	0.7902
0.3826	8.4194	522	0.6790	0.3058	0.6790	0.8240
0.3826	8.4516	524	0.6862	0.3058	0.6862	0.8283
0.3826	8.4839	526	0.6897	0.3058	0.6897	0.8305
0.3826	8.5161	528	0.6779	0.3080	0.6779	0.8233
0.3826	8.5484	530	0.6834	0.3080	0.6834	0.8267
0.3826	8.5806	532	0.6439	0.3833	0.6439	0.8024
0.3826	8.6129	534	0.6203	0.3874	0.6203	0.7876
0.3826	8.6452	536	0.6399	0.3874	0.6399	0.8000
0.3826	8.6774	538	0.6723	0.4150	0.6723	0.8199
0.3826	8.7097	540	0.7272	0.3731	0.7272	0.8528
0.3826	8.7419	542	0.7557	0.3407	0.7557	0.8693
0.3826	8.7742	544	0.7348	0.3407	0.7348	0.8572
0.3826	8.8065	546	0.6952	0.4150	0.6952	0.8338
0.3826	8.8387	548	0.6862	0.4150	0.6862	0.8284
0.3826	8.8710	550	0.6751	0.4150	0.6751	0.8217
0.3826	8.9032	552	0.6683	0.4194	0.6683	0.8175
0.3826	8.9355	554	0.6559	0.4194	0.6559	0.8099
0.3826	8.9677	556	0.6710	0.4194	0.6710	0.8191
0.3826	9.0	558	0.6487	0.4043	0.6487	0.8054
0.3826	9.0323	560	0.6165	0.4182	0.6165	0.7851
0.3826	9.0645	562	0.5892	0.4286	0.5892	0.7676
0.3826	9.0968	564	0.5931	0.4286	0.5931	0.7701
0.3826	9.1290	566	0.6095	0.4010	0.6095	0.7807
0.3826	9.1613	568	0.6369	0.4043	0.6369	0.7981
0.3826	9.1935	570	0.6356	0.4043	0.6356	0.7973
0.3826	9.2258	572	0.6311	0.3874	0.6311	0.7944
0.3826	9.2581	574	0.6296	0.3917	0.6296	0.7935
0.3826	9.2903	576	0.6141	0.3962	0.6141	0.7836
0.3826	9.3226	578	0.5827	0.4286	0.5827	0.7634
0.3826	9.3548	580	0.5604	0.4341	0.5604	0.7486
0.3826	9.3871	582	0.5438	0.4286	0.5438	0.7374
0.3826	9.4194	584	0.5482	0.4286	0.5482	0.7404
0.3826	9.4516	586	0.5580	0.4286	0.5580	0.7470
0.3826	9.4839	588	0.5702	0.4286	0.5702	0.7551
0.3826	9.5161	590	0.5818	0.4286	0.5818	0.7628
0.3826	9.5484	592	0.5930	0.4286	0.5930	0.7700
0.3826	9.5806	594	0.6015	0.4010	0.6015	0.7756
0.3826	9.6129	596	0.6139	0.3962	0.6139	0.7835
0.3826	9.6452	598	0.6309	0.3962	0.6309	0.7943
0.3826	9.6774	600	0.6511	0.4087	0.6511	0.8069
0.3826	9.7097	602	0.6747	0.4043	0.6747	0.8214
0.3826	9.7419	604	0.7020	0.3633	0.7020	0.8378
0.3826	9.7742	606	0.7174	0.3569	0.7174	0.8470
0.3826	9.8065	608	0.7230	0.3569	0.7230	0.8503
0.3826	9.8387	610	0.7214	0.3569	0.7214	0.8493
0.3826	9.8710	612	0.7153	0.3569	0.7153	0.8458
0.3826	9.9032	614	0.7118	0.3600	0.7118	0.8437
0.3826	9.9355	616	0.7119	0.3600	0.7119	0.8437
0.3826	9.9677	618	0.7117	0.3600	0.7117	0.8436
0.3826	10.0	620	0.7119	0.3600	0.7119	0.8437

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1