ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8785
• Qwk: 0.6644
• Mse: 0.8785
• Rmse: 0.9373

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0312	2	2.4261	0.0195	2.4261	1.5576
No log	0.0625	4	1.5819	0.1430	1.5819	1.2577
No log	0.0938	6	1.5833	0.0750	1.5833	1.2583
No log	0.125	8	1.6424	0.0489	1.6424	1.2816
No log	0.1562	10	1.5563	0.1066	1.5563	1.2475
No log	0.1875	12	1.6560	0.3227	1.6560	1.2869
No log	0.2188	14	1.6052	0.3185	1.6052	1.2670
No log	0.25	16	1.4096	0.3051	1.4096	1.1873
No log	0.2812	18	1.2718	0.2325	1.2718	1.1277
No log	0.3125	20	1.2368	0.1968	1.2368	1.1121
No log	0.3438	22	1.2217	0.2037	1.2217	1.1053
No log	0.375	24	1.2883	0.2811	1.2883	1.1350
No log	0.4062	26	1.2906	0.3853	1.2906	1.1360
No log	0.4375	28	1.2121	0.3767	1.2121	1.1010
No log	0.4688	30	1.2868	0.3662	1.2868	1.1344
No log	0.5	32	1.2349	0.3640	1.2349	1.1113
No log	0.5312	34	1.4490	0.3678	1.4490	1.2037
No log	0.5625	36	1.3913	0.3680	1.3913	1.1795
No log	0.5938	38	1.1931	0.3627	1.1931	1.0923
No log	0.625	40	1.1229	0.4510	1.1229	1.0597
No log	0.6562	42	1.0949	0.4547	1.0949	1.0464
No log	0.6875	44	1.1078	0.4310	1.1078	1.0525
No log	0.7188	46	1.1820	0.3848	1.1820	1.0872
No log	0.75	48	1.3025	0.4442	1.3025	1.1413
No log	0.7812	50	1.2857	0.4161	1.2857	1.1339
No log	0.8125	52	1.2026	0.3947	1.2026	1.0966
No log	0.8438	54	1.1928	0.4098	1.1928	1.0922
No log	0.875	56	1.2980	0.4461	1.2980	1.1393
No log	0.9062	58	1.2060	0.4727	1.2060	1.0982
No log	0.9375	60	1.0896	0.4700	1.0896	1.0439
No log	0.9688	62	1.0764	0.4834	1.0764	1.0375
No log	1.0	64	1.4844	0.5293	1.4844	1.2184
No log	1.0312	66	1.7022	0.4766	1.7022	1.3047
No log	1.0625	68	1.3620	0.5026	1.3620	1.1671
No log	1.0938	70	1.0267	0.4654	1.0267	1.0133
No log	1.125	72	1.0321	0.4374	1.0321	1.0159
No log	1.1562	74	1.0963	0.4729	1.0963	1.0470
No log	1.1875	76	1.1606	0.5083	1.1606	1.0773
No log	1.2188	78	1.0604	0.4991	1.0604	1.0298
No log	1.25	80	1.1110	0.5031	1.1110	1.0540
No log	1.2812	82	1.2235	0.5435	1.2235	1.1061
No log	1.3125	84	1.2150	0.5496	1.2150	1.1023
No log	1.3438	86	1.4912	0.4770	1.4912	1.2211
No log	1.375	88	1.5252	0.5138	1.5252	1.2350
No log	1.4062	90	1.2282	0.5456	1.2282	1.1082
No log	1.4375	92	0.9376	0.5792	0.9376	0.9683
No log	1.4688	94	0.9843	0.5553	0.9843	0.9921
No log	1.5	96	1.1961	0.5558	1.1961	1.0937
No log	1.5312	98	1.2263	0.5659	1.2263	1.1074
No log	1.5625	100	1.0863	0.5417	1.0863	1.0423
No log	1.5938	102	0.8838	0.6178	0.8838	0.9401
No log	1.625	104	0.9219	0.6288	0.9219	0.9601
No log	1.6562	106	1.0963	0.5667	1.0963	1.0470
No log	1.6875	108	1.3619	0.5637	1.3619	1.1670
No log	1.7188	110	1.7134	0.5279	1.7134	1.3090
No log	1.75	112	1.5502	0.5329	1.5502	1.2451
No log	1.7812	114	1.0373	0.5396	1.0373	1.0185
No log	1.8125	116	0.9285	0.5903	0.9285	0.9636
No log	1.8438	118	0.9411	0.5692	0.9411	0.9701
No log	1.875	120	1.2079	0.5335	1.2079	1.0990
No log	1.9062	122	1.7761	0.4670	1.7761	1.3327
No log	1.9375	124	1.8300	0.4629	1.8300	1.3528
No log	1.9688	126	1.4625	0.5269	1.4625	1.2093
No log	2.0	128	1.2009	0.6069	1.2009	1.0959
No log	2.0312	130	1.3259	0.5782	1.3259	1.1515
No log	2.0625	132	1.4017	0.5735	1.4017	1.1839
No log	2.0938	134	1.4827	0.5438	1.4827	1.2177
No log	2.125	136	1.5476	0.5542	1.5476	1.2440
No log	2.1562	138	1.4375	0.5780	1.4375	1.1990
No log	2.1875	140	1.3743	0.5710	1.3743	1.1723
No log	2.2188	142	1.1502	0.5821	1.1502	1.0725
No log	2.25	144	1.0704	0.5814	1.0704	1.0346
No log	2.2812	146	1.0860	0.5416	1.0860	1.0421
No log	2.3125	148	1.0667	0.5445	1.0667	1.0328
No log	2.3438	150	1.1648	0.5040	1.1648	1.0792
No log	2.375	152	1.3779	0.4958	1.3779	1.1739
No log	2.4062	154	1.5971	0.4662	1.5971	1.2638
No log	2.4375	156	1.4783	0.4802	1.4783	1.2159
No log	2.4688	158	1.1329	0.5326	1.1329	1.0644
No log	2.5	160	0.9783	0.6210	0.9783	0.9891
No log	2.5312	162	1.0128	0.5673	1.0128	1.0064
No log	2.5625	164	1.0984	0.5679	1.0984	1.0480
No log	2.5938	166	1.1793	0.5835	1.1793	1.0860
No log	2.625	168	1.2619	0.5835	1.2619	1.1233
No log	2.6562	170	1.0359	0.6042	1.0359	1.0178
No log	2.6875	172	0.9051	0.6255	0.9051	0.9514
No log	2.7188	174	0.9099	0.6548	0.9099	0.9539
No log	2.75	176	0.9115	0.6312	0.9115	0.9548
No log	2.7812	178	0.8858	0.6563	0.8858	0.9411
No log	2.8125	180	1.0213	0.6202	1.0213	1.0106
No log	2.8438	182	1.2262	0.5919	1.2262	1.1073
No log	2.875	184	1.3148	0.5716	1.3148	1.1466
No log	2.9062	186	1.2432	0.5866	1.2432	1.1150
No log	2.9375	188	1.0964	0.6221	1.0964	1.0471
No log	2.9688	190	1.1292	0.6060	1.1292	1.0626
No log	3.0	192	1.2635	0.5971	1.2635	1.1240
No log	3.0312	194	1.1139	0.6221	1.1139	1.0554
No log	3.0625	196	0.9204	0.6218	0.9204	0.9594
No log	3.0938	198	0.8895	0.6226	0.8895	0.9431
No log	3.125	200	0.9520	0.6120	0.9520	0.9757
No log	3.1562	202	0.9972	0.6260	0.9972	0.9986
No log	3.1875	204	0.8692	0.6421	0.8692	0.9323
No log	3.2188	206	0.7592	0.6411	0.7592	0.8713
No log	3.25	208	0.7699	0.6360	0.7699	0.8774
No log	3.2812	210	0.8866	0.6308	0.8866	0.9416
No log	3.3125	212	1.1155	0.5973	1.1155	1.0562
No log	3.3438	214	1.2040	0.5654	1.2040	1.0973
No log	3.375	216	1.0940	0.5973	1.0940	1.0459
No log	3.4062	218	0.9950	0.6648	0.9950	0.9975
No log	3.4375	220	0.9351	0.6595	0.9351	0.9670
No log	3.4688	222	0.8103	0.6721	0.8103	0.9001
No log	3.5	224	0.8165	0.6668	0.8165	0.9036
No log	3.5312	226	0.9250	0.6434	0.9250	0.9618
No log	3.5625	228	0.8870	0.6603	0.8870	0.9418
No log	3.5938	230	0.8908	0.6603	0.8908	0.9438
No log	3.625	232	0.8632	0.6467	0.8632	0.9291
No log	3.6562	234	0.8306	0.6600	0.8306	0.9114
No log	3.6875	236	0.7788	0.6588	0.7788	0.8825
No log	3.7188	238	0.8367	0.6456	0.8367	0.9147
No log	3.75	240	0.9782	0.6616	0.9782	0.9890
No log	3.7812	242	1.1431	0.6260	1.1431	1.0692
No log	3.8125	244	1.2847	0.6101	1.2847	1.1335
No log	3.8438	246	1.3459	0.5961	1.3459	1.1601
No log	3.875	248	1.1942	0.6492	1.1942	1.0928
No log	3.9062	250	1.0068	0.6527	1.0068	1.0034
No log	3.9375	252	0.9792	0.6507	0.9792	0.9895
No log	3.9688	254	1.0750	0.6585	1.0750	1.0368
No log	4.0	256	1.3334	0.5890	1.3334	1.1547
No log	4.0312	258	1.4287	0.5624	1.4287	1.1953
No log	4.0625	260	1.2817	0.5786	1.2817	1.1321
No log	4.0938	262	1.0211	0.6220	1.0211	1.0105
No log	4.125	264	0.8588	0.6421	0.8588	0.9267
No log	4.1562	266	0.8647	0.6421	0.8647	0.9299
No log	4.1875	268	1.0060	0.6209	1.0060	1.0030
No log	4.2188	270	1.3165	0.5806	1.3165	1.1474
No log	4.25	272	1.5320	0.5468	1.5320	1.2377
No log	4.2812	274	1.4814	0.5652	1.4814	1.2171
No log	4.3125	276	1.2331	0.5848	1.2331	1.1105
No log	4.3438	278	0.9833	0.6432	0.9833	0.9916
No log	4.375	280	0.8975	0.6451	0.8975	0.9474
No log	4.4062	282	0.9319	0.6410	0.9319	0.9654
No log	4.4375	284	0.9210	0.6410	0.9210	0.9597
No log	4.4688	286	0.9133	0.6463	0.9133	0.9557
No log	4.5	288	1.0316	0.6421	1.0316	1.0157
No log	4.5312	290	1.1090	0.6299	1.1090	1.0531
No log	4.5625	292	1.0561	0.6210	1.0561	1.0277
No log	4.5938	294	0.9578	0.6260	0.9578	0.9786
No log	4.625	296	0.9518	0.6165	0.9518	0.9756
No log	4.6562	298	0.9420	0.5946	0.9420	0.9706
No log	4.6875	300	0.9468	0.5946	0.9468	0.9730
No log	4.7188	302	1.0141	0.6237	1.0141	1.0070
No log	4.75	304	1.0574	0.6084	1.0574	1.0283
No log	4.7812	306	0.9903	0.6306	0.9903	0.9952
No log	4.8125	308	0.9560	0.6246	0.9560	0.9778
No log	4.8438	310	0.8751	0.6582	0.8751	0.9354
No log	4.875	312	0.8051	0.6623	0.8051	0.8973
No log	4.9062	314	0.8520	0.6582	0.8520	0.9230
No log	4.9375	316	1.0208	0.6648	1.0208	1.0104
No log	4.9688	318	1.1036	0.6666	1.1036	1.0505
No log	5.0	320	1.1546	0.6503	1.1546	1.0745
No log	5.0312	322	1.2130	0.6233	1.2130	1.1014
No log	5.0625	324	1.1487	0.6397	1.1487	1.0718
No log	5.0938	326	1.1014	0.6397	1.1014	1.0495
No log	5.125	328	0.9800	0.6706	0.9800	0.9899
No log	5.1562	330	0.9516	0.6638	0.9516	0.9755
No log	5.1875	332	0.9728	0.6459	0.9728	0.9863
No log	5.2188	334	1.0442	0.6387	1.0442	1.0219
No log	5.25	336	0.9708	0.6500	0.9708	0.9853
No log	5.2812	338	0.9864	0.6500	0.9864	0.9932
No log	5.3125	340	0.9677	0.6500	0.9677	0.9837
No log	5.3438	342	0.9622	0.6581	0.9622	0.9809
No log	5.375	344	0.9352	0.6581	0.9352	0.9671
No log	5.4062	346	1.0211	0.6624	1.0211	1.0105
No log	5.4375	348	1.1669	0.6486	1.1669	1.0802
No log	5.4688	350	1.2834	0.6112	1.2834	1.1329
No log	5.5	352	1.2333	0.6063	1.2333	1.1105
No log	5.5312	354	1.1196	0.6484	1.1196	1.0581
No log	5.5625	356	0.9979	0.6545	0.9979	0.9989
No log	5.5938	358	0.9380	0.6597	0.9380	0.9685
No log	5.625	360	0.9337	0.6597	0.9337	0.9663
No log	5.6562	362	1.0063	0.6545	1.0063	1.0032
No log	5.6875	364	1.0773	0.6427	1.0773	1.0379
No log	5.7188	366	1.1183	0.6497	1.1183	1.0575
No log	5.75	368	1.0854	0.6464	1.0854	1.0418
No log	5.7812	370	1.0784	0.6348	1.0784	1.0384
No log	5.8125	372	1.0703	0.6348	1.0703	1.0346
No log	5.8438	374	1.0276	0.6587	1.0276	1.0137
No log	5.875	376	0.9404	0.6521	0.9404	0.9697
No log	5.9062	378	0.8248	0.6804	0.8248	0.9082
No log	5.9375	380	0.8111	0.6804	0.8111	0.9006
No log	5.9688	382	0.8290	0.6867	0.8290	0.9105
No log	6.0	384	0.8825	0.6840	0.8825	0.9394
No log	6.0312	386	0.9348	0.6505	0.9348	0.9669
No log	6.0625	388	0.9471	0.6505	0.9471	0.9732
No log	6.0938	390	1.0114	0.6461	1.0114	1.0057
No log	6.125	392	1.1362	0.6313	1.1362	1.0659
No log	6.1562	394	1.1524	0.6399	1.1524	1.0735
No log	6.1875	396	1.1536	0.6399	1.1536	1.0741
No log	6.2188	398	1.1730	0.6299	1.1730	1.0831
No log	6.25	400	1.1334	0.6385	1.1334	1.0646
No log	6.2812	402	1.0145	0.6331	1.0145	1.0072
No log	6.3125	404	0.9069	0.6828	0.9069	0.9523
No log	6.3438	406	0.9200	0.6670	0.9200	0.9592
No log	6.375	408	0.9812	0.6339	0.9812	0.9905
No log	6.4062	410	1.0459	0.6317	1.0459	1.0227
No log	6.4375	412	1.0679	0.6462	1.0679	1.0334
No log	6.4688	414	1.1255	0.6547	1.1255	1.0609
No log	6.5	416	1.0743	0.6494	1.0743	1.0365
No log	6.5312	418	0.9965	0.6496	0.9965	0.9983
No log	6.5625	420	0.8985	0.6454	0.8985	0.9479
No log	6.5938	422	0.8664	0.6552	0.8664	0.9308
No log	6.625	424	0.8420	0.6561	0.8420	0.9176
No log	6.6562	426	0.8294	0.6561	0.8294	0.9107
No log	6.6875	428	0.8848	0.6447	0.8848	0.9406
No log	6.7188	430	0.9920	0.6571	0.9920	0.9960
No log	6.75	432	1.0653	0.6736	1.0653	1.0322
No log	6.7812	434	1.0458	0.6711	1.0458	1.0226
No log	6.8125	436	1.0298	0.6680	1.0298	1.0148
No log	6.8438	438	1.0226	0.6680	1.0226	1.0113
No log	6.875	440	0.9912	0.6503	0.9912	0.9956
No log	6.9062	442	0.9030	0.6483	0.9030	0.9503
No log	6.9375	444	0.8618	0.6634	0.8618	0.9283
No log	6.9688	446	0.8438	0.6561	0.8438	0.9186
No log	7.0	448	0.8838	0.6516	0.8838	0.9401
No log	7.0312	450	0.9657	0.6493	0.9657	0.9827
No log	7.0625	452	1.0636	0.6526	1.0636	1.0313
No log	7.0938	454	1.0904	0.6526	1.0904	1.0442
No log	7.125	456	1.0822	0.6537	1.0822	1.0403
No log	7.1562	458	1.0408	0.6646	1.0408	1.0202
No log	7.1875	460	0.9642	0.6723	0.9642	0.9819
No log	7.2188	462	0.9218	0.6617	0.9218	0.9601
No log	7.25	464	0.9177	0.6582	0.9177	0.9580
No log	7.2812	466	0.9164	0.6582	0.9164	0.9573
No log	7.3125	468	0.9262	0.6432	0.9262	0.9624
No log	7.3438	470	0.9494	0.6527	0.9494	0.9744
No log	7.375	472	1.0328	0.6697	1.0328	1.0163
No log	7.4062	474	1.0614	0.6697	1.0614	1.0303
No log	7.4375	476	1.0178	0.6697	1.0178	1.0088
No log	7.4688	478	0.9218	0.6502	0.9218	0.9601
No log	7.5	480	0.8375	0.6624	0.8375	0.9152
No log	7.5312	482	0.8032	0.6553	0.8032	0.8962
No log	7.5625	484	0.8004	0.6553	0.8004	0.8947
No log	7.5938	486	0.8322	0.6544	0.8322	0.9122
No log	7.625	488	0.8733	0.6598	0.8733	0.9345
No log	7.6562	490	0.8936	0.6634	0.8936	0.9453
No log	7.6875	492	0.9125	0.6653	0.9125	0.9552
No log	7.7188	494	0.9605	0.6758	0.9605	0.9801
No log	7.75	496	1.0164	0.6655	1.0164	1.0082
No log	7.7812	498	1.0116	0.6646	1.0116	1.0058
0.3501	7.8125	500	0.9666	0.6585	0.9666	0.9832
0.3501	7.8438	502	0.9167	0.6653	0.9167	0.9575
0.3501	7.875	504	0.8667	0.6563	0.8667	0.9310
0.3501	7.9062	506	0.8366	0.6686	0.8366	0.9147
0.3501	7.9375	508	0.8369	0.6686	0.8369	0.9148
0.3501	7.9688	510	0.8773	0.6598	0.8773	0.9367
0.3501	8.0	512	0.9113	0.6776	0.9113	0.9546
0.3501	8.0312	514	0.9472	0.6826	0.9472	0.9732
0.3501	8.0625	516	0.9711	0.6861	0.9711	0.9855
0.3501	8.0938	518	0.9934	0.6861	0.9934	0.9967
0.3501	8.125	520	1.0183	0.6773	1.0183	1.0091
0.3501	8.1562	522	1.0410	0.6754	1.0410	1.0203
0.3501	8.1875	524	1.0600	0.6810	1.0600	1.0296
0.3501	8.2188	526	1.0673	0.6810	1.0673	1.0331
0.3501	8.25	528	1.0932	0.6522	1.0932	1.0456
0.3501	8.2812	530	1.0730	0.6649	1.0730	1.0358
0.3501	8.3125	532	1.0237	0.6838	1.0237	1.0118
0.3501	8.3438	534	0.9898	0.6780	0.9898	0.9949
0.3501	8.375	536	0.9431	0.6776	0.9431	0.9712
0.3501	8.4062	538	0.9108	0.6679	0.9108	0.9544
0.3501	8.4375	540	0.9023	0.6776	0.9023	0.9499
0.3501	8.4688	542	0.8976	0.6776	0.8976	0.9474
0.3501	8.5	544	0.9027	0.6610	0.9027	0.9501
0.3501	8.5312	546	0.9095	0.6603	0.9095	0.9537
0.3501	8.5625	548	0.9026	0.6603	0.9026	0.9501
0.3501	8.5938	550	0.9045	0.6603	0.9045	0.9511
0.3501	8.625	552	0.8838	0.6575	0.8838	0.9401
0.3501	8.6562	554	0.8624	0.6643	0.8624	0.9286
0.3501	8.6875	556	0.8569	0.6552	0.8569	0.9257
0.3501	8.7188	558	0.8545	0.6507	0.8545	0.9244
0.3501	8.75	560	0.8476	0.6552	0.8476	0.9207
0.3501	8.7812	562	0.8510	0.6507	0.8510	0.9225
0.3501	8.8125	564	0.8585	0.6507	0.8585	0.9266
0.3501	8.8438	566	0.8695	0.6554	0.8695	0.9324
0.3501	8.875	568	0.8756	0.6590	0.8756	0.9357
0.3501	8.9062	570	0.8617	0.6410	0.8617	0.9283
0.3501	8.9375	572	0.8480	0.6516	0.8480	0.9209
0.3501	8.9688	574	0.8457	0.6516	0.8457	0.9196
0.3501	9.0	576	0.8342	0.6561	0.8342	0.9134
0.3501	9.0312	578	0.8352	0.6561	0.8352	0.9139
0.3501	9.0625	580	0.8488	0.6516	0.8488	0.9213
0.3501	9.0938	582	0.8678	0.6419	0.8678	0.9316
0.3501	9.125	584	0.8720	0.6454	0.8720	0.9338
0.3501	9.1562	586	0.8709	0.6352	0.8709	0.9332
0.3501	9.1875	588	0.8836	0.6575	0.8836	0.9400
0.3501	9.2188	590	0.8961	0.6569	0.8961	0.9466
0.3501	9.25	592	0.8950	0.6569	0.8950	0.9461
0.3501	9.2812	594	0.9083	0.6654	0.9083	0.9530
0.3501	9.3125	596	0.9147	0.6746	0.9147	0.9564
0.3501	9.3438	598	0.9116	0.6713	0.9116	0.9548
0.3501	9.375	600	0.9115	0.6713	0.9115	0.9547
0.3501	9.4062	602	0.9085	0.6654	0.9085	0.9531
0.3501	9.4375	604	0.9080	0.6654	0.9080	0.9529
0.3501	9.4688	606	0.9076	0.6654	0.9076	0.9527
0.3501	9.5	608	0.9046	0.6654	0.9046	0.9511
0.3501	9.5312	610	0.9033	0.6654	0.9033	0.9504
0.3501	9.5625	612	0.9010	0.6654	0.9010	0.9492
0.3501	9.5938	614	0.8947	0.6575	0.8947	0.9459
0.3501	9.625	616	0.8857	0.6575	0.8857	0.9411
0.3501	9.6562	618	0.8790	0.6502	0.8790	0.9375
0.3501	9.6875	620	0.8758	0.6502	0.8758	0.9359
0.3501	9.7188	622	0.8736	0.6502	0.8736	0.9347
0.3501	9.75	624	0.8723	0.6467	0.8723	0.9340
0.3501	9.7812	626	0.8723	0.6502	0.8723	0.9340
0.3501	9.8125	628	0.8747	0.6502	0.8747	0.9353
0.3501	9.8438	630	0.8747	0.6502	0.8747	0.9353
0.3501	9.875	632	0.8765	0.6644	0.8765	0.9362
0.3501	9.9062	634	0.8776	0.6644	0.8776	0.9368
0.3501	9.9375	636	0.8779	0.6644	0.8779	0.9370
0.3501	9.9688	638	0.8781	0.6644	0.8781	0.9371
0.3501	10.0	640	0.8785	0.6644	0.8785	0.9373

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1