ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8832
• Qwk: 0.7030
• Mse: 0.8832
• Rmse: 0.9398

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	2.2479	0.0250	2.2479	1.4993
No log	0.0714	4	1.4431	0.2480	1.4431	1.2013
No log	0.1071	6	1.5100	0.1209	1.5100	1.2288
No log	0.1429	8	1.8075	0.2235	1.8075	1.3444
No log	0.1786	10	2.2957	0.1632	2.2957	1.5152
No log	0.2143	12	2.2682	0.1988	2.2682	1.5060
No log	0.25	14	2.2008	0.1950	2.2008	1.4835
No log	0.2857	16	1.8779	0.1786	1.8779	1.3704
No log	0.3214	18	1.8393	0.1130	1.8393	1.3562
No log	0.3571	20	1.8411	0.1573	1.8411	1.3569
No log	0.3929	22	1.9334	0.2315	1.9334	1.3905
No log	0.4286	24	1.9163	0.2824	1.9163	1.3843
No log	0.4643	26	1.9489	0.3026	1.9489	1.3960
No log	0.5	28	2.0296	0.2547	2.0296	1.4246
No log	0.5357	30	2.1725	0.2421	2.1725	1.4739
No log	0.5714	32	2.0422	0.2367	2.0422	1.4290
No log	0.6071	34	1.8270	0.2868	1.8270	1.3517
No log	0.6429	36	1.6186	0.3673	1.6186	1.2722
No log	0.6786	38	1.4785	0.3815	1.4785	1.2160
No log	0.7143	40	1.4320	0.3725	1.4320	1.1966
No log	0.75	42	1.4751	0.3932	1.4751	1.2145
No log	0.7857	44	1.5879	0.3903	1.5879	1.2601
No log	0.8214	46	1.4643	0.4125	1.4643	1.2101
No log	0.8571	48	1.4016	0.4125	1.4016	1.1839
No log	0.8929	50	1.3806	0.4269	1.3806	1.1750
No log	0.9286	52	1.5213	0.4025	1.5213	1.2334
No log	0.9643	54	1.2609	0.4430	1.2609	1.1229
No log	1.0	56	0.9927	0.4778	0.9927	0.9963
No log	1.0357	58	1.1180	0.4758	1.1180	1.0574
No log	1.0714	60	1.6603	0.5005	1.6603	1.2885
No log	1.1071	62	1.8937	0.4802	1.8937	1.3761
No log	1.1429	64	1.5883	0.5154	1.5883	1.2603
No log	1.1786	66	1.0759	0.5697	1.0759	1.0373
No log	1.2143	68	0.7705	0.6253	0.7705	0.8778
No log	1.25	70	0.7475	0.6766	0.7475	0.8646
No log	1.2857	72	0.9916	0.5964	0.9916	0.9958
No log	1.3214	74	1.8116	0.5168	1.8116	1.3459
No log	1.3571	76	2.3836	0.4154	2.3836	1.5439
No log	1.3929	78	2.2022	0.4737	2.2022	1.4840
No log	1.4286	80	1.3973	0.5580	1.3973	1.1821
No log	1.4643	82	0.9180	0.5772	0.9180	0.9581
No log	1.5	84	0.8708	0.5524	0.8708	0.9332
No log	1.5357	86	0.9721	0.5680	0.9721	0.9859
No log	1.5714	88	1.3659	0.5452	1.3659	1.1687
No log	1.6071	90	1.7116	0.5123	1.7116	1.3083
No log	1.6429	92	1.6654	0.5128	1.6654	1.2905
No log	1.6786	94	1.2007	0.5596	1.2007	1.0958
No log	1.7143	96	1.0399	0.6176	1.0399	1.0197
No log	1.75	98	1.2004	0.5538	1.2004	1.0956
No log	1.7857	100	1.6004	0.5138	1.6004	1.2651
No log	1.8214	102	1.5690	0.5043	1.5690	1.2526
No log	1.8571	104	1.1676	0.5595	1.1676	1.0805
No log	1.8929	106	0.9127	0.6271	0.9127	0.9554
No log	1.9286	108	0.9660	0.6198	0.9660	0.9829
No log	1.9643	110	1.2819	0.5720	1.2819	1.1322
No log	2.0	112	1.5373	0.5905	1.5373	1.2399
No log	2.0357	114	1.3853	0.5859	1.3853	1.1770
No log	2.0714	116	1.0144	0.6342	1.0144	1.0072
No log	2.1071	118	0.9580	0.6466	0.9580	0.9788
No log	2.1429	120	0.9727	0.6622	0.9727	0.9863
No log	2.1786	122	0.9161	0.6403	0.9161	0.9571
No log	2.2143	124	0.7332	0.7325	0.7332	0.8562
No log	2.25	126	0.7146	0.7355	0.7146	0.8453
No log	2.2857	128	0.7194	0.7355	0.7194	0.8482
No log	2.3214	130	0.7954	0.6813	0.7954	0.8919
No log	2.3571	132	1.0765	0.5917	1.0765	1.0376
No log	2.3929	134	1.1948	0.5765	1.1948	1.0931
No log	2.4286	136	1.0337	0.6160	1.0337	1.0167
No log	2.4643	138	0.8360	0.6654	0.8360	0.9144
No log	2.5	140	0.7871	0.6798	0.7871	0.8872
No log	2.5357	142	0.8649	0.6558	0.8649	0.9300
No log	2.5714	144	1.0452	0.6310	1.0452	1.0224
No log	2.6071	146	1.4949	0.5875	1.4949	1.2227
No log	2.6429	148	1.8899	0.5287	1.8899	1.3747
No log	2.6786	150	1.8140	0.5396	1.8140	1.3468
No log	2.7143	152	1.4615	0.5519	1.4615	1.2089
No log	2.75	154	1.0322	0.5789	1.0322	1.0159
No log	2.7857	156	0.7615	0.6629	0.7615	0.8726
No log	2.8214	158	0.7100	0.6586	0.7100	0.8426
No log	2.8571	160	0.7166	0.6727	0.7166	0.8465
No log	2.8929	162	0.7790	0.6431	0.7790	0.8826
No log	2.9286	164	0.8653	0.6065	0.8653	0.9302
No log	2.9643	166	1.0937	0.5658	1.0937	1.0458
No log	3.0	168	1.4896	0.5358	1.4896	1.2205
No log	3.0357	170	1.7033	0.5276	1.7033	1.3051
No log	3.0714	172	1.5945	0.5491	1.5945	1.2627
No log	3.1071	174	1.2531	0.5672	1.2531	1.1194
No log	3.1429	176	0.8907	0.6504	0.8907	0.9438
No log	3.1786	178	0.7638	0.6680	0.7638	0.8740
No log	3.2143	180	0.7083	0.6508	0.7083	0.8416
No log	3.25	182	0.7325	0.6508	0.7325	0.8559
No log	3.2857	184	0.8267	0.6509	0.8267	0.9092
No log	3.3214	186	1.0306	0.6010	1.0306	1.0152
No log	3.3571	188	1.2062	0.6059	1.2062	1.0983
No log	3.3929	190	1.1815	0.6096	1.1815	1.0870
No log	3.4286	192	1.0914	0.6045	1.0914	1.0447
No log	3.4643	194	0.9147	0.6253	0.9147	0.9564
No log	3.5	196	0.8392	0.6295	0.8392	0.9161
No log	3.5357	198	0.8423	0.6379	0.8423	0.9178
No log	3.5714	200	0.9201	0.6346	0.9201	0.9592
No log	3.6071	202	1.0619	0.6247	1.0619	1.0305
No log	3.6429	204	1.3131	0.6145	1.3131	1.1459
No log	3.6786	206	1.4415	0.6075	1.4415	1.2006
No log	3.7143	208	1.3875	0.6170	1.3875	1.1779
No log	3.75	210	1.1335	0.6272	1.1335	1.0647
No log	3.7857	212	0.9012	0.6514	0.9012	0.9493
No log	3.8214	214	0.7170	0.7392	0.7170	0.8467
No log	3.8571	216	0.6754	0.7685	0.6754	0.8218
No log	3.8929	218	0.6980	0.7507	0.6980	0.8355
No log	3.9286	220	0.8058	0.7041	0.8058	0.8977
No log	3.9643	222	1.0089	0.6360	1.0089	1.0044
No log	4.0	224	1.1224	0.6321	1.1224	1.0594
No log	4.0357	226	1.1260	0.6264	1.1260	1.0611
No log	4.0714	228	1.0936	0.6381	1.0936	1.0457
No log	4.1071	230	1.0442	0.6364	1.0442	1.0219
No log	4.1429	232	1.0712	0.6166	1.0712	1.0350
No log	4.1786	234	1.1824	0.6107	1.1824	1.0874
No log	4.2143	236	1.2375	0.6136	1.2375	1.1124
No log	4.25	238	1.1800	0.6122	1.1800	1.0863
No log	4.2857	240	1.0070	0.6323	1.0070	1.0035
No log	4.3214	242	0.8073	0.7022	0.8073	0.8985
No log	4.3571	244	0.7073	0.7698	0.7073	0.8410
No log	4.3929	246	0.7155	0.7544	0.7155	0.8459
No log	4.4286	248	0.7921	0.7476	0.7921	0.8900
No log	4.4643	250	0.8279	0.7307	0.8279	0.9099
No log	4.5	252	0.8471	0.7116	0.8471	0.9204
No log	4.5357	254	0.8538	0.7032	0.8538	0.9240
No log	4.5714	256	0.8041	0.6960	0.8041	0.8967
No log	4.6071	258	0.7328	0.7074	0.7328	0.8560
No log	4.6429	260	0.7208	0.7253	0.7208	0.8490
No log	4.6786	262	0.7040	0.7383	0.7040	0.8390
No log	4.7143	264	0.6707	0.7530	0.6707	0.8190
No log	4.75	266	0.6547	0.7555	0.6547	0.8091
No log	4.7857	268	0.6605	0.7627	0.6605	0.8127
No log	4.8214	270	0.7358	0.7447	0.7358	0.8578
No log	4.8571	272	0.8176	0.7011	0.8176	0.9042
No log	4.8929	274	0.7879	0.7152	0.7879	0.8876
No log	4.9286	276	0.6967	0.7686	0.6967	0.8347
No log	4.9643	278	0.6621	0.7617	0.6621	0.8137
No log	5.0	280	0.6654	0.7425	0.6654	0.8157
No log	5.0357	282	0.6956	0.7590	0.6956	0.8340
No log	5.0714	284	0.7827	0.7120	0.7827	0.8847
No log	5.1071	286	0.9205	0.6804	0.9205	0.9594
No log	5.1429	288	0.9445	0.6804	0.9445	0.9718
No log	5.1786	290	0.8854	0.6930	0.8854	0.9410
No log	5.2143	292	0.9062	0.6804	0.9062	0.9520
No log	5.25	294	0.9021	0.6804	0.9021	0.9498
No log	5.2857	296	0.8089	0.6991	0.8089	0.8994
No log	5.3214	298	0.7821	0.7162	0.7821	0.8844
No log	5.3571	300	0.8422	0.6859	0.8422	0.9177
No log	5.3929	302	0.9411	0.6768	0.9411	0.9701
No log	5.4286	304	0.9765	0.6732	0.9765	0.9882
No log	5.4643	306	0.9435	0.6768	0.9435	0.9713
No log	5.5	308	0.9229	0.6717	0.9229	0.9607
No log	5.5357	310	0.8880	0.6703	0.8880	0.9424
No log	5.5714	312	0.8547	0.6832	0.8547	0.9245
No log	5.6071	314	0.8275	0.6759	0.8275	0.9096
No log	5.6429	316	0.8080	0.6964	0.8080	0.8989
No log	5.6786	318	0.8459	0.6815	0.8459	0.9198
No log	5.7143	320	0.9257	0.6537	0.9257	0.9621
No log	5.75	322	1.0598	0.6027	1.0598	1.0295
No log	5.7857	324	1.2571	0.6010	1.2571	1.1212
No log	5.8214	326	1.3308	0.6051	1.3308	1.1536
No log	5.8571	328	1.2935	0.6037	1.2935	1.1373
No log	5.8929	330	1.1697	0.6142	1.1697	1.0815
No log	5.9286	332	1.0143	0.6607	1.0143	1.0071
No log	5.9643	334	0.9327	0.6666	0.9327	0.9658
No log	6.0	336	0.9114	0.6719	0.9114	0.9547
No log	6.0357	338	0.9848	0.6586	0.9848	0.9924
No log	6.0714	340	1.0819	0.6404	1.0819	1.0401
No log	6.1071	342	1.1425	0.6204	1.1425	1.0689
No log	6.1429	344	1.1087	0.6256	1.1087	1.0530
No log	6.1786	346	1.0239	0.6493	1.0239	1.0119
No log	6.2143	348	0.9204	0.6549	0.9204	0.9594
No log	6.25	350	0.8383	0.6936	0.8383	0.9156
No log	6.2857	352	0.8147	0.7041	0.8147	0.9026
No log	6.3214	354	0.8350	0.6949	0.8350	0.9138
No log	6.3571	356	0.8290	0.6962	0.8290	0.9105
No log	6.3929	358	0.8326	0.6916	0.8326	0.9125
No log	6.4286	360	0.8704	0.6630	0.8704	0.9329
No log	6.4643	362	0.9067	0.6550	0.9067	0.9522
No log	6.5	364	0.9291	0.6520	0.9291	0.9639
No log	6.5357	366	0.9078	0.6680	0.9078	0.9528
No log	6.5714	368	0.8287	0.6752	0.8287	0.9103
No log	6.6071	370	0.7610	0.7248	0.7610	0.8724
No log	6.6429	372	0.7451	0.7289	0.7451	0.8632
No log	6.6786	374	0.7353	0.7289	0.7353	0.8575
No log	6.7143	376	0.7669	0.7343	0.7669	0.8758
No log	6.75	378	0.8640	0.6951	0.8640	0.9295
No log	6.7857	380	0.9243	0.6743	0.9243	0.9614
No log	6.8214	382	0.9280	0.6666	0.9280	0.9633
No log	6.8571	384	0.9089	0.6697	0.9089	0.9533
No log	6.8929	386	0.8749	0.6857	0.8749	0.9354
No log	6.9286	388	0.8270	0.7190	0.8270	0.9094
No log	6.9643	390	0.8356	0.7077	0.8356	0.9141
No log	7.0	392	0.8641	0.6951	0.8641	0.9296
No log	7.0357	394	0.8656	0.6885	0.8656	0.9304
No log	7.0714	396	0.8491	0.7012	0.8491	0.9215
No log	7.1071	398	0.8428	0.7122	0.8428	0.9180
No log	7.1429	400	0.8727	0.6923	0.8727	0.9342
No log	7.1786	402	0.8986	0.6938	0.8986	0.9480
No log	7.2143	404	0.9336	0.6688	0.9336	0.9663
No log	7.25	406	0.9582	0.6726	0.9582	0.9789
No log	7.2857	408	0.9454	0.6651	0.9454	0.9723
No log	7.3214	410	0.9099	0.6743	0.9099	0.9539
No log	7.3571	412	0.8930	0.6868	0.8930	0.9450
No log	7.3929	414	0.8503	0.7103	0.8503	0.9221
No log	7.4286	416	0.8327	0.7263	0.8327	0.9125
No log	7.4643	418	0.8491	0.7152	0.8491	0.9215
No log	7.5	420	0.8780	0.7062	0.8780	0.9370
No log	7.5357	422	0.9161	0.6727	0.9161	0.9572
No log	7.5714	424	0.9300	0.6628	0.9300	0.9644
No log	7.6071	426	0.9802	0.6644	0.9802	0.9901
No log	7.6429	428	1.0020	0.6652	1.0020	1.0010
No log	7.6786	430	1.0068	0.6652	1.0068	1.0034
No log	7.7143	432	0.9919	0.6652	0.9919	0.9960
No log	7.75	434	0.9386	0.6809	0.9386	0.9688
No log	7.7857	436	0.8695	0.6960	0.8695	0.9324
No log	7.8214	438	0.8146	0.7249	0.8146	0.9026
No log	7.8571	440	0.7814	0.7323	0.7814	0.8840
No log	7.8929	442	0.7830	0.7248	0.7830	0.8849
No log	7.9286	444	0.8131	0.7019	0.8131	0.9017
No log	7.9643	446	0.8196	0.7019	0.8196	0.9053
No log	8.0	448	0.8423	0.7000	0.8423	0.9178
No log	8.0357	450	0.8740	0.6800	0.8740	0.9349
No log	8.0714	452	0.9218	0.6797	0.9218	0.9601
No log	8.1071	454	0.9512	0.6613	0.9512	0.9753
No log	8.1429	456	0.9607	0.6604	0.9607	0.9802
No log	8.1786	458	0.9765	0.6521	0.9765	0.9882
No log	8.2143	460	0.9721	0.6521	0.9721	0.9860
No log	8.25	462	0.9557	0.6521	0.9557	0.9776
No log	8.2857	464	0.9192	0.6784	0.9192	0.9587
No log	8.3214	466	0.8779	0.6817	0.8779	0.9370
No log	8.3571	468	0.8557	0.6834	0.8557	0.9250
No log	8.3929	470	0.8519	0.6834	0.8519	0.9230
No log	8.4286	472	0.8635	0.6834	0.8635	0.9293
No log	8.4643	474	0.8678	0.6912	0.8678	0.9316
No log	8.5	476	0.8956	0.6912	0.8956	0.9464
No log	8.5357	478	0.9384	0.6712	0.9384	0.9687
No log	8.5714	480	0.9746	0.6530	0.9746	0.9872
No log	8.6071	482	1.0150	0.6607	1.0150	1.0075
No log	8.6429	484	1.0452	0.6465	1.0452	1.0224
No log	8.6786	486	1.0536	0.6465	1.0536	1.0265
No log	8.7143	488	1.0540	0.6465	1.0540	1.0266
No log	8.75	490	1.0372	0.6465	1.0372	1.0184
No log	8.7857	492	1.0084	0.6503	1.0084	1.0042
No log	8.8214	494	0.9709	0.6613	0.9709	0.9853
No log	8.8571	496	0.9373	0.6797	0.9373	0.9681
No log	8.8929	498	0.9327	0.6797	0.9327	0.9658
0.3325	8.9286	500	0.9467	0.6712	0.9467	0.9730
0.3325	8.9643	502	0.9551	0.6674	0.9551	0.9773
0.3325	9.0	504	0.9592	0.6590	0.9592	0.9794
0.3325	9.0357	506	0.9602	0.6696	0.9602	0.9799
0.3325	9.0714	508	0.9633	0.6696	0.9633	0.9815
0.3325	9.1071	510	0.9645	0.6636	0.9645	0.9821
0.3325	9.1429	512	0.9524	0.6673	0.9524	0.9759
0.3325	9.1786	514	0.9387	0.6819	0.9387	0.9689
0.3325	9.2143	516	0.9275	0.6943	0.9275	0.9631
0.3325	9.25	518	0.9209	0.6943	0.9209	0.9597
0.3325	9.2857	520	0.9188	0.6943	0.9188	0.9585
0.3325	9.3214	522	0.9185	0.6943	0.9185	0.9584
0.3325	9.3571	524	0.9145	0.6943	0.9145	0.9563
0.3325	9.3929	526	0.9081	0.6943	0.9081	0.9529
0.3325	9.4286	528	0.8982	0.7030	0.8982	0.9477
0.3325	9.4643	530	0.8863	0.7030	0.8863	0.9414
0.3325	9.5	532	0.8760	0.7138	0.8760	0.9359
0.3325	9.5357	534	0.8630	0.7085	0.8630	0.9290
0.3325	9.5714	536	0.8603	0.7083	0.8603	0.9275
0.3325	9.6071	538	0.8649	0.7085	0.8649	0.9300
0.3325	9.6429	540	0.8670	0.7026	0.8670	0.9311
0.3325	9.6786	542	0.8667	0.7026	0.8667	0.9310
0.3325	9.7143	544	0.8681	0.7030	0.8681	0.9317
0.3325	9.75	546	0.8707	0.7030	0.8707	0.9331
0.3325	9.7857	548	0.8737	0.7030	0.8737	0.9347
0.3325	9.8214	550	0.8754	0.7030	0.8754	0.9356
0.3325	9.8571	552	0.8777	0.7030	0.8777	0.9369
0.3325	9.8929	554	0.8807	0.7030	0.8807	0.9384
0.3325	9.9286	556	0.8824	0.7030	0.8824	0.9394
0.3325	9.9643	558	0.8830	0.7030	0.8830	0.9397
0.3325	10.0	560	0.8832	0.7030	0.8832	0.9398

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1