ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5305
• Qwk: 0.3684
• Mse: 0.5305
• Rmse: 0.7283

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	3.2498	-0.0126	3.2498	1.8027
No log	0.0714	4	1.8577	0.0130	1.8577	1.3630
No log	0.1071	6	1.8803	0.0652	1.8803	1.3713
No log	0.1429	8	0.7528	0.0769	0.7528	0.8677
No log	0.1786	10	0.6139	0.0303	0.6139	0.7835
No log	0.2143	12	0.5891	0.1407	0.5891	0.7675
No log	0.25	14	0.5764	0.0476	0.5764	0.7592
No log	0.2857	16	0.6660	0.1590	0.6660	0.8161
No log	0.3214	18	0.6214	0.2251	0.6214	0.7883
No log	0.3571	20	0.5573	0.0909	0.5573	0.7465
No log	0.3929	22	0.5713	0.3757	0.5713	0.7559
No log	0.4286	24	0.5800	0.3295	0.5800	0.7616
No log	0.4643	26	0.6702	0.2766	0.6702	0.8187
No log	0.5	28	0.8110	0.3067	0.8110	0.9006
No log	0.5357	30	0.6072	0.2444	0.6072	0.7792
No log	0.5714	32	0.6032	0.2444	0.6032	0.7767
No log	0.6071	34	0.7596	0.2150	0.7596	0.8716
No log	0.6429	36	0.8280	0.2212	0.8280	0.9099
No log	0.6786	38	0.6462	0.2000	0.6462	0.8039
No log	0.7143	40	1.0233	0.1347	1.0233	1.0116
No log	0.75	42	0.8517	0.1416	0.8517	0.9229
No log	0.7857	44	0.6714	0.2000	0.6714	0.8194
No log	0.8214	46	0.7991	0.2000	0.7991	0.8939
No log	0.8571	48	0.6912	0.0222	0.6912	0.8314
No log	0.8929	50	0.6573	0.2575	0.6573	0.8108
No log	0.9286	52	1.2225	0.0067	1.2225	1.1057
No log	0.9643	54	1.1739	-0.0270	1.1739	1.0835
No log	1.0	56	0.7027	0.1590	0.7027	0.8382
No log	1.0357	58	1.0716	0.1807	1.0716	1.0352
No log	1.0714	60	1.0764	0.1807	1.0764	1.0375
No log	1.1071	62	0.6999	0.2174	0.6999	0.8366
No log	1.1429	64	0.7300	0.2513	0.7300	0.8544
No log	1.1786	66	0.5979	0.2289	0.5979	0.7732
No log	1.2143	68	0.6784	0.3103	0.6784	0.8237
No log	1.25	70	0.8299	0.1220	0.8299	0.9110
No log	1.2857	72	0.7872	0.2000	0.7872	0.8872
No log	1.3214	74	0.5378	0.2298	0.5378	0.7334
No log	1.3571	76	0.6410	0.2967	0.6410	0.8006
No log	1.3929	78	0.7528	0.2464	0.7528	0.8676
No log	1.4286	80	0.6167	0.1837	0.6167	0.7853
No log	1.4643	82	0.9900	0.2340	0.9900	0.9950
No log	1.5	84	1.1772	0.2129	1.1772	1.0850
No log	1.5357	86	0.9205	0.2821	0.9205	0.9594
No log	1.5714	88	0.7483	0.3274	0.7483	0.8651
No log	1.6071	90	0.9713	0.1471	0.9713	0.9856
No log	1.6429	92	0.6603	0.3242	0.6603	0.8126
No log	1.6786	94	0.7189	0.1921	0.7189	0.8479
No log	1.7143	96	0.8211	0.1855	0.8211	0.9061
No log	1.75	98	0.8680	0.1515	0.8680	0.9317
No log	1.7857	100	0.5735	0.2000	0.5735	0.7573
No log	1.8214	102	0.6160	0.2965	0.6160	0.7848
No log	1.8571	104	0.5446	0.3757	0.5446	0.7380
No log	1.8929	106	0.5363	0.4286	0.5363	0.7323
No log	1.9286	108	0.5569	0.4815	0.5569	0.7462
No log	1.9643	110	0.8159	0.3143	0.8159	0.9033
No log	2.0	112	0.8625	0.3123	0.8625	0.9287
No log	2.0357	114	0.7485	0.3011	0.7485	0.8652
No log	2.0714	116	0.5772	0.5113	0.5772	0.7598
No log	2.1071	118	0.7212	0.2340	0.7212	0.8492
No log	2.1429	120	1.2118	0.2285	1.2118	1.1008
No log	2.1786	122	0.7428	0.2479	0.7428	0.8619
No log	2.2143	124	0.5930	0.1753	0.5930	0.7701
No log	2.25	126	0.9651	0.1545	0.9651	0.9824
No log	2.2857	128	1.0399	0.1486	1.0399	1.0197
No log	2.3214	130	0.6423	0.1527	0.6423	0.8014
No log	2.3571	132	0.9114	0.1873	0.9114	0.9546
No log	2.3929	134	1.7278	0.2078	1.7278	1.3145
No log	2.4286	136	1.3176	0.2232	1.3176	1.1478
No log	2.4643	138	0.5634	0.4680	0.5634	0.7506
No log	2.5	140	0.6368	0.2780	0.6368	0.7980
No log	2.5357	142	0.6798	0.1698	0.6798	0.8245
No log	2.5714	144	0.5101	0.4286	0.5101	0.7142
No log	2.6071	146	0.5925	0.3043	0.5925	0.7697
No log	2.6429	148	0.5806	0.3043	0.5806	0.7619
No log	2.6786	150	0.5007	0.4012	0.5007	0.7076
No log	2.7143	152	0.5108	0.3295	0.5108	0.7147
No log	2.75	154	0.5378	0.3258	0.5378	0.7334
No log	2.7857	156	0.6558	0.3367	0.6558	0.8098
No log	2.8214	158	0.5194	0.4348	0.5194	0.7207
No log	2.8571	160	0.5073	0.4286	0.5073	0.7122
No log	2.8929	162	0.6733	0.3028	0.6733	0.8206
No log	2.9286	164	0.7070	0.3448	0.7070	0.8408
No log	2.9643	166	0.6080	0.3297	0.6080	0.7797
No log	3.0	168	0.4747	0.4536	0.4747	0.6890
No log	3.0357	170	0.4790	0.4350	0.4790	0.6921
No log	3.0714	172	0.6653	0.3271	0.6653	0.8157
No log	3.1071	174	0.6099	0.3231	0.6099	0.7810
No log	3.1429	176	0.4951	0.4105	0.4951	0.7036
No log	3.1786	178	0.5793	0.4286	0.5793	0.7611
No log	3.2143	180	0.5070	0.4346	0.5070	0.7121
No log	3.25	182	0.7780	0.2996	0.7780	0.8820
No log	3.2857	184	0.7610	0.3231	0.7610	0.8724
No log	3.3214	186	0.5063	0.4343	0.5063	0.7116
No log	3.3571	188	0.5265	0.4225	0.5265	0.7256
No log	3.3929	190	0.5972	0.3927	0.5972	0.7728
No log	3.4286	192	0.4869	0.3953	0.4869	0.6978
No log	3.4643	194	0.4859	0.4286	0.4859	0.6971
No log	3.5	196	0.4690	0.4286	0.4690	0.6849
No log	3.5357	198	0.4573	0.3966	0.4573	0.6763
No log	3.5714	200	0.5032	0.4475	0.5032	0.7094
No log	3.6071	202	0.6103	0.36	0.6103	0.7812
No log	3.6429	204	0.5458	0.4526	0.5458	0.7388
No log	3.6786	206	0.4471	0.4083	0.4471	0.6686
No log	3.7143	208	0.5656	0.3402	0.5656	0.7521
No log	3.75	210	0.5401	0.3520	0.5401	0.7349
No log	3.7857	212	0.4421	0.3846	0.4421	0.6649
No log	3.8214	214	0.5446	0.4413	0.5446	0.7379
No log	3.8571	216	0.8106	0.1781	0.8106	0.9003
No log	3.8929	218	0.7728	0.2300	0.7728	0.8791
No log	3.9286	220	0.5154	0.4475	0.5154	0.7179
No log	3.9643	222	0.5935	0.3333	0.5935	0.7704
No log	4.0	224	0.7710	0.2320	0.7710	0.8780
No log	4.0357	226	0.6485	0.3414	0.6485	0.8053
No log	4.0714	228	0.5526	0.4286	0.5526	0.7434
No log	4.1071	230	0.7035	0.2607	0.7035	0.8387
No log	4.1429	232	0.6376	0.2871	0.6376	0.7985
No log	4.1786	234	0.5079	0.3898	0.5079	0.7127
No log	4.2143	236	0.5713	0.3641	0.5713	0.7559
No log	4.25	238	0.5674	0.3730	0.5674	0.7533
No log	4.2857	240	0.4900	0.3208	0.4900	0.7000
No log	4.3214	242	0.5330	0.3966	0.5330	0.7301
No log	4.3571	244	0.5511	0.3966	0.5511	0.7424
No log	4.3929	246	0.4936	0.4083	0.4936	0.7026
No log	4.4286	248	0.4821	0.3374	0.4821	0.6943
No log	4.4643	250	0.4809	0.3533	0.4809	0.6934
No log	4.5	252	0.5439	0.3661	0.5439	0.7375
No log	4.5357	254	0.5867	0.3498	0.5867	0.7659
No log	4.5714	256	0.4940	0.4152	0.4940	0.7029
No log	4.6071	258	0.4805	0.3829	0.4805	0.6932
No log	4.6429	260	0.4822	0.3829	0.4822	0.6944
No log	4.6786	262	0.5523	0.4346	0.5523	0.7432
No log	4.7143	264	0.6658	0.3755	0.6658	0.8160
No log	4.75	266	0.8065	0.2613	0.8065	0.8981
No log	4.7857	268	0.8101	0.2184	0.8101	0.9001
No log	4.8214	270	0.7182	0.2787	0.7182	0.8475
No log	4.8571	272	0.6284	0.3951	0.6284	0.7927
No log	4.8929	274	0.5316	0.3684	0.5316	0.7291
No log	4.9286	276	0.5163	0.3684	0.5163	0.7185
No log	4.9643	278	0.5909	0.3103	0.5909	0.7687
No log	5.0	280	0.6848	0.3061	0.6848	0.8275
No log	5.0357	282	0.8386	0.2327	0.8386	0.9158
No log	5.0714	284	0.8175	0.2327	0.8175	0.9041
No log	5.1071	286	0.5854	0.4400	0.5854	0.7651
No log	5.1429	288	0.4972	0.3953	0.4972	0.7051
No log	5.1786	290	0.5069	0.3898	0.5069	0.7120
No log	5.2143	292	0.5366	0.3478	0.5366	0.7325
No log	5.25	294	0.5948	0.3951	0.5948	0.7712
No log	5.2857	296	0.6173	0.3116	0.6173	0.7857
No log	5.3214	298	0.6713	0.3333	0.6713	0.8193
No log	5.3571	300	0.6956	0.3306	0.6956	0.8340
No log	5.3929	302	0.5689	0.4043	0.5689	0.7543
No log	5.4286	304	0.5080	0.4652	0.5080	0.7127
No log	5.4643	306	0.5226	0.3769	0.5226	0.7229
No log	5.5	308	0.5007	0.4033	0.5007	0.7076
No log	5.5357	310	0.5791	0.3535	0.5791	0.7610
No log	5.5714	312	0.6619	0.3274	0.6619	0.8136
No log	5.6071	314	0.6101	0.3299	0.6101	0.7811
No log	5.6429	316	0.5455	0.4475	0.5455	0.7386
No log	5.6786	318	0.5144	0.4157	0.5144	0.7172
No log	5.7143	320	0.5417	0.3913	0.5417	0.7360
No log	5.75	322	0.6433	0.3585	0.6433	0.8021
No log	5.7857	324	0.6669	0.2315	0.6669	0.8166
No log	5.8214	326	0.5718	0.3778	0.5718	0.7562
No log	5.8571	328	0.5451	0.3684	0.5451	0.7383
No log	5.8929	330	0.5519	0.3684	0.5519	0.7429
No log	5.9286	332	0.6386	0.1910	0.6386	0.7991
No log	5.9643	334	0.6998	0.2308	0.6998	0.8365
No log	6.0	336	0.6677	0.1917	0.6677	0.8171
No log	6.0357	338	0.5727	0.3333	0.5727	0.7568
No log	6.0714	340	0.5585	0.4157	0.5585	0.7473
No log	6.1071	342	0.5664	0.3609	0.5664	0.7526
No log	6.1429	344	0.6091	0.2457	0.6091	0.7805
No log	6.1786	346	0.6867	0.2150	0.6867	0.8287
No log	6.2143	348	0.6740	0.2233	0.6740	0.8210
No log	6.25	350	0.5817	0.3000	0.5817	0.7627
No log	6.2857	352	0.5395	0.2883	0.5395	0.7345
No log	6.3214	354	0.5349	0.3000	0.5349	0.7314
No log	6.3571	356	0.5352	0.2771	0.5352	0.7316
No log	6.3929	358	0.5270	0.3333	0.5270	0.7259
No log	6.4286	360	0.5418	0.3609	0.5418	0.7360
No log	6.4643	362	0.5961	0.2542	0.5961	0.7721
No log	6.5	364	0.6000	0.2542	0.6000	0.7746
No log	6.5357	366	0.5412	0.3735	0.5412	0.7357
No log	6.5714	368	0.5263	0.3292	0.5263	0.7254
No log	6.6071	370	0.5218	0.2883	0.5218	0.7224
No log	6.6429	372	0.5209	0.3735	0.5209	0.7217
No log	6.6786	374	0.5446	0.2485	0.5446	0.7380
No log	6.7143	376	0.5472	0.2485	0.5472	0.7397
No log	6.75	378	0.5357	0.3374	0.5357	0.7319
No log	6.7857	380	0.5206	0.4012	0.5206	0.7215
No log	6.8214	382	0.5357	0.3684	0.5357	0.7319
No log	6.8571	384	0.5413	0.3810	0.5413	0.7357
No log	6.8929	386	0.5643	0.3636	0.5643	0.7512
No log	6.9286	388	0.6619	0.2871	0.6619	0.8136
No log	6.9643	390	0.7304	0.2217	0.7304	0.8546
No log	7.0	392	0.7387	0.25	0.7387	0.8595
No log	7.0357	394	0.6378	0.3118	0.6378	0.7986
No log	7.0714	396	0.5871	0.3520	0.5871	0.7663
No log	7.1071	398	0.5721	0.3407	0.5721	0.7564
No log	7.1429	400	0.5717	0.3520	0.5717	0.7561
No log	7.1786	402	0.6229	0.3333	0.6229	0.7892
No log	7.2143	404	0.6446	0.2265	0.6446	0.8029
No log	7.25	406	0.5837	0.3939	0.5837	0.7640
No log	7.2857	408	0.5239	0.3659	0.5239	0.7238
No log	7.3214	410	0.5157	0.3032	0.5157	0.7182
No log	7.3571	412	0.5226	0.3292	0.5226	0.7229
No log	7.3929	414	0.5188	0.2911	0.5188	0.7203
No log	7.4286	416	0.5057	0.3032	0.5057	0.7112
No log	7.4643	418	0.5039	0.3377	0.5039	0.7098
No log	7.5	420	0.5202	0.3987	0.5202	0.7212
No log	7.5357	422	0.5426	0.4286	0.5426	0.7366
No log	7.5714	424	0.5306	0.4286	0.5306	0.7284
No log	7.6071	426	0.4973	0.3846	0.4973	0.7052
No log	7.6429	428	0.4939	0.35	0.4939	0.7028
No log	7.6786	430	0.4958	0.35	0.4958	0.7041
No log	7.7143	432	0.5016	0.3846	0.5016	0.7083
No log	7.75	434	0.5084	0.4286	0.5084	0.7131
No log	7.7857	436	0.5112	0.4217	0.5112	0.7150
No log	7.8214	438	0.5098	0.3580	0.5098	0.7140
No log	7.8571	440	0.5209	0.3735	0.5209	0.7218
No log	7.8929	442	0.5207	0.3735	0.5207	0.7216
No log	7.9286	444	0.5142	0.3953	0.5142	0.7171
No log	7.9643	446	0.5445	0.4286	0.5445	0.7379
No log	8.0	448	0.5776	0.3371	0.5776	0.7600
No log	8.0357	450	0.5659	0.3708	0.5659	0.7522
No log	8.0714	452	0.5540	0.4286	0.5540	0.7443
No log	8.1071	454	0.5271	0.4620	0.5271	0.7260
No log	8.1429	456	0.5169	0.3898	0.5169	0.7190
No log	8.1786	458	0.5178	0.3898	0.5178	0.7196
No log	8.2143	460	0.5238	0.3898	0.5238	0.7237
No log	8.25	462	0.5216	0.3898	0.5216	0.7222
No log	8.2857	464	0.5413	0.4286	0.5413	0.7357
No log	8.3214	466	0.5548	0.3882	0.5548	0.7448
No log	8.3571	468	0.5451	0.4286	0.5451	0.7383
No log	8.3929	470	0.5454	0.4286	0.5454	0.7385
No log	8.4286	472	0.5430	0.4286	0.5430	0.7369
No log	8.4643	474	0.5299	0.3684	0.5299	0.7280
No log	8.5	476	0.5173	0.3953	0.5173	0.7192
No log	8.5357	478	0.5178	0.3533	0.5178	0.7196
No log	8.5714	480	0.5211	0.3121	0.5211	0.7219
No log	8.6071	482	0.5206	0.3121	0.5206	0.7216
No log	8.6429	484	0.5197	0.3121	0.5197	0.7209
No log	8.6786	486	0.5153	0.3580	0.5153	0.7178
No log	8.7143	488	0.5164	0.4083	0.5164	0.7186
No log	8.75	490	0.5210	0.4083	0.5210	0.7218
No log	8.7857	492	0.5315	0.3684	0.5315	0.7290
No log	8.8214	494	0.5345	0.3939	0.5345	0.7311
No log	8.8571	496	0.5342	0.3939	0.5342	0.7309
No log	8.8929	498	0.5228	0.3684	0.5228	0.7230
0.3707	8.9286	500	0.5136	0.4083	0.5136	0.7167
0.3707	8.9643	502	0.5101	0.4146	0.5101	0.7142
0.3707	9.0	504	0.5099	0.4146	0.5099	0.7141
0.3707	9.0357	506	0.5120	0.4083	0.5120	0.7156
0.3707	9.0714	508	0.5126	0.4083	0.5126	0.7159
0.3707	9.1071	510	0.5129	0.4146	0.5129	0.7162
0.3707	9.1429	512	0.5164	0.3735	0.5164	0.7186
0.3707	9.1786	514	0.5211	0.3735	0.5211	0.7218
0.3707	9.2143	516	0.5244	0.4286	0.5244	0.7241
0.3707	9.25	518	0.5220	0.3684	0.5220	0.7225
0.3707	9.2857	520	0.5200	0.3735	0.5200	0.7211
0.3707	9.3214	522	0.5155	0.4012	0.5155	0.7180
0.3707	9.3571	524	0.5148	0.4012	0.5148	0.7175
0.3707	9.3929	526	0.5151	0.4012	0.5151	0.7177
0.3707	9.4286	528	0.5144	0.4012	0.5144	0.7172
0.3707	9.4643	530	0.5148	0.4012	0.5148	0.7175
0.3707	9.5	532	0.5151	0.4012	0.5151	0.7177
0.3707	9.5357	534	0.5155	0.4012	0.5155	0.7180
0.3707	9.5714	536	0.5170	0.3953	0.5170	0.7190
0.3707	9.6071	538	0.5195	0.3898	0.5195	0.7208
0.3707	9.6429	540	0.5227	0.4023	0.5227	0.7230
0.3707	9.6786	542	0.5257	0.4023	0.5257	0.7251
0.3707	9.7143	544	0.5293	0.4023	0.5293	0.7276
0.3707	9.75	546	0.5343	0.3684	0.5343	0.7309
0.3707	9.7857	548	0.5375	0.3684	0.5375	0.7331
0.3707	9.8214	550	0.5379	0.3684	0.5379	0.7334
0.3707	9.8571	552	0.5363	0.3684	0.5363	0.7323
0.3707	9.8929	554	0.5337	0.3684	0.5337	0.7306
0.3707	9.9286	556	0.5318	0.3684	0.5318	0.7293
0.3707	9.9643	558	0.5310	0.3684	0.5310	0.7287
0.3707	10.0	560	0.5305	0.3684	0.5305	0.7283

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1