ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k11_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9263
• Qwk: 0.4916
• Mse: 0.9263
• Rmse: 0.9624

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	3.9146	-0.0043	3.9146	1.9785
No log	0.0645	4	1.7974	0.1241	1.7974	1.3407
No log	0.0968	6	0.9618	0.0460	0.9618	0.9807
No log	0.1290	8	0.7342	0.2152	0.7342	0.8568
No log	0.1613	10	0.7470	0.1960	0.7470	0.8643
No log	0.1935	12	0.7475	0.1204	0.7475	0.8646
No log	0.2258	14	0.8503	0.1658	0.8503	0.9221
No log	0.2581	16	1.2315	0.0504	1.2315	1.1097
No log	0.2903	18	1.2522	0.0402	1.2522	1.1190
No log	0.3226	20	1.2154	0.0330	1.2154	1.1024
No log	0.3548	22	0.8568	0.2333	0.8568	0.9256
No log	0.3871	24	0.6074	0.2561	0.6074	0.7794
No log	0.4194	26	0.6224	0.2730	0.6224	0.7889
No log	0.4516	28	0.5926	0.3252	0.5926	0.7698
No log	0.4839	30	0.5781	0.3585	0.5781	0.7603
No log	0.5161	32	0.5819	0.4205	0.5819	0.7628
No log	0.5484	34	0.6017	0.4802	0.6017	0.7757
No log	0.5806	36	0.8520	0.4165	0.8520	0.9230
No log	0.6129	38	1.3702	0.2688	1.3702	1.1706
No log	0.6452	40	1.1092	0.3532	1.1092	1.0532
No log	0.6774	42	0.6862	0.5748	0.6862	0.8284
No log	0.7097	44	0.8942	0.4724	0.8942	0.9456
No log	0.7419	46	0.9117	0.4731	0.9117	0.9548
No log	0.7742	48	0.7124	0.5587	0.7124	0.8440
No log	0.8065	50	0.6809	0.5566	0.6809	0.8252
No log	0.8387	52	0.7664	0.4192	0.7664	0.8754
No log	0.8710	54	0.6342	0.4779	0.6342	0.7964
No log	0.9032	56	0.5958	0.5198	0.5958	0.7719
No log	0.9355	58	0.7157	0.4833	0.7157	0.8460
No log	0.9677	60	0.7100	0.4833	0.7100	0.8426
No log	1.0	62	0.7684	0.4532	0.7684	0.8766
No log	1.0323	64	0.7235	0.4773	0.7235	0.8506
No log	1.0645	66	0.5840	0.5596	0.5840	0.7642
No log	1.0968	68	0.6998	0.5368	0.6998	0.8365
No log	1.1290	70	0.9007	0.5076	0.9007	0.9491
No log	1.1613	72	0.8172	0.5360	0.8172	0.9040
No log	1.1935	74	0.6905	0.5909	0.6905	0.8310
No log	1.2258	76	0.5983	0.5746	0.5983	0.7735
No log	1.2581	78	0.6035	0.5809	0.6035	0.7769
No log	1.2903	80	0.5885	0.5720	0.5885	0.7671
No log	1.3226	82	0.8370	0.5131	0.8370	0.9149
No log	1.3548	84	1.2842	0.4151	1.2842	1.1332
No log	1.3871	86	1.4499	0.3649	1.4499	1.2041
No log	1.4194	88	1.1525	0.4579	1.1525	1.0735
No log	1.4516	90	0.7780	0.5682	0.7780	0.8820
No log	1.4839	92	0.7382	0.5428	0.7382	0.8592
No log	1.5161	94	0.7577	0.5133	0.7577	0.8705
No log	1.5484	96	0.7874	0.5208	0.7874	0.8873
No log	1.5806	98	0.7436	0.5517	0.7436	0.8623
No log	1.6129	100	0.8143	0.5430	0.8143	0.9024
No log	1.6452	102	0.9681	0.4753	0.9681	0.9839
No log	1.6774	104	0.9547	0.4918	0.9547	0.9771
No log	1.7097	106	0.8842	0.5125	0.8842	0.9403
No log	1.7419	108	0.7090	0.4761	0.7090	0.8420
No log	1.7742	110	0.6955	0.5436	0.6955	0.8339
No log	1.8065	112	0.7379	0.5700	0.7379	0.8590
No log	1.8387	114	0.8268	0.5585	0.8268	0.9093
No log	1.8710	116	0.9422	0.5371	0.9422	0.9707
No log	1.9032	118	1.0495	0.4664	1.0495	1.0244
No log	1.9355	120	1.0390	0.5238	1.0390	1.0193
No log	1.9677	122	1.0504	0.5298	1.0504	1.0249
No log	2.0	124	0.9698	0.5472	0.9698	0.9848
No log	2.0323	126	0.8365	0.5481	0.8365	0.9146
No log	2.0645	128	0.8312	0.5199	0.8312	0.9117
No log	2.0968	130	0.8946	0.5451	0.8946	0.9459
No log	2.1290	132	1.0458	0.4979	1.0458	1.0226
No log	2.1613	134	1.1078	0.4766	1.1078	1.0525
No log	2.1935	136	1.1902	0.4713	1.1902	1.0910
No log	2.2258	138	1.2877	0.4187	1.2877	1.1348
No log	2.2581	140	1.2357	0.4487	1.2357	1.1116
No log	2.2903	142	1.0638	0.4565	1.0638	1.0314
No log	2.3226	144	0.9300	0.4926	0.9300	0.9644
No log	2.3548	146	0.8766	0.4701	0.8766	0.9362
No log	2.3871	148	0.9046	0.4600	0.9046	0.9511
No log	2.4194	150	0.8473	0.4607	0.8473	0.9205
No log	2.4516	152	0.8085	0.4621	0.8085	0.8992
No log	2.4839	154	0.8168	0.4865	0.8168	0.9038
No log	2.5161	156	0.8872	0.4758	0.8872	0.9419
No log	2.5484	158	0.9220	0.4738	0.9220	0.9602
No log	2.5806	160	0.9481	0.4670	0.9481	0.9737
No log	2.6129	162	0.9759	0.4691	0.9759	0.9879
No log	2.6452	164	0.8349	0.4936	0.8349	0.9137
No log	2.6774	166	0.7491	0.4907	0.7491	0.8655
No log	2.7097	168	0.7813	0.5323	0.7813	0.8839
No log	2.7419	170	0.8659	0.4832	0.8659	0.9306
No log	2.7742	172	0.9421	0.4708	0.9421	0.9706
No log	2.8065	174	1.0250	0.4726	1.0250	1.0124
No log	2.8387	176	1.0552	0.4887	1.0552	1.0272
No log	2.8710	178	1.0466	0.4910	1.0466	1.0230
No log	2.9032	180	0.9093	0.4758	0.9093	0.9536
No log	2.9355	182	0.8104	0.4945	0.8104	0.9002
No log	2.9677	184	0.7599	0.5060	0.7599	0.8717
No log	3.0	186	0.8267	0.5206	0.8267	0.9092
No log	3.0323	188	0.8340	0.4920	0.8340	0.9132
No log	3.0645	190	0.9138	0.5021	0.9138	0.9559
No log	3.0968	192	1.1733	0.4617	1.1733	1.0832
No log	3.1290	194	1.4156	0.4130	1.4156	1.1898
No log	3.1613	196	1.3316	0.4469	1.3316	1.1539
No log	3.1935	198	1.1012	0.4810	1.1012	1.0494
No log	3.2258	200	0.9514	0.4794	0.9514	0.9754
No log	3.2581	202	0.9564	0.4722	0.9564	0.9780
No log	3.2903	204	0.8733	0.4686	0.8733	0.9345
No log	3.3226	206	0.7983	0.5068	0.7983	0.8935
No log	3.3548	208	0.8665	0.4509	0.8665	0.9309
No log	3.3871	210	1.0436	0.3869	1.0436	1.0216
No log	3.4194	212	1.0512	0.3869	1.0512	1.0253
No log	3.4516	214	0.9046	0.4319	0.9046	0.9511
No log	3.4839	216	0.8133	0.4886	0.8133	0.9019
No log	3.5161	218	0.8176	0.4844	0.8176	0.9042
No log	3.5484	220	0.8832	0.4410	0.8832	0.9398
No log	3.5806	222	0.9289	0.4773	0.9289	0.9638
No log	3.6129	224	0.9391	0.4692	0.9391	0.9691
No log	3.6452	226	0.9972	0.4870	0.9972	0.9986
No log	3.6774	228	1.0274	0.4441	1.0274	1.0136
No log	3.7097	230	0.9847	0.4253	0.9847	0.9923
No log	3.7419	232	0.9076	0.4370	0.9076	0.9527
No log	3.7742	234	0.7681	0.4722	0.7681	0.8764
No log	3.8065	236	0.7396	0.5537	0.7396	0.8600
No log	3.8387	238	0.7799	0.4997	0.7799	0.8831
No log	3.8710	240	0.8721	0.4674	0.8721	0.9339
No log	3.9032	242	0.9896	0.4529	0.9896	0.9948
No log	3.9355	244	1.1094	0.4300	1.1094	1.0533
No log	3.9677	246	1.1458	0.4355	1.1458	1.0704
No log	4.0	248	1.0868	0.4568	1.0868	1.0425
No log	4.0323	250	1.0098	0.4568	1.0098	1.0049
No log	4.0645	252	0.8921	0.4652	0.8921	0.9445
No log	4.0968	254	0.8159	0.4951	0.8159	0.9032
No log	4.1290	256	0.8451	0.4735	0.8451	0.9193
No log	4.1613	258	1.0030	0.4040	1.0030	1.0015
No log	4.1935	260	1.0654	0.4355	1.0654	1.0322
No log	4.2258	262	1.0553	0.4566	1.0553	1.0273
No log	4.2581	264	0.9187	0.4700	0.9187	0.9585
No log	4.2903	266	0.8060	0.4983	0.8060	0.8978
No log	4.3226	268	0.7857	0.5301	0.7857	0.8864
No log	4.3548	270	0.8052	0.5105	0.8052	0.8973
No log	4.3871	272	0.9095	0.5101	0.9095	0.9537
No log	4.4194	274	1.0784	0.4533	1.0784	1.0384
No log	4.4516	276	1.0681	0.4640	1.0681	1.0335
No log	4.4839	278	0.9508	0.5009	0.9508	0.9751
No log	4.5161	280	0.8552	0.5109	0.8552	0.9248
No log	4.5484	282	0.8360	0.5316	0.8360	0.9143
No log	4.5806	284	0.8152	0.5393	0.8152	0.9029
No log	4.6129	286	0.8133	0.4693	0.8133	0.9018
No log	4.6452	288	0.8318	0.5015	0.8318	0.9120
No log	4.6774	290	0.9374	0.4643	0.9374	0.9682
No log	4.7097	292	1.0530	0.4498	1.0530	1.0262
No log	4.7419	294	1.2051	0.4084	1.2051	1.0978
No log	4.7742	296	1.1914	0.4099	1.1914	1.0915
No log	4.8065	298	1.0769	0.4615	1.0769	1.0377
No log	4.8387	300	0.9451	0.4749	0.9451	0.9722
No log	4.8710	302	0.9227	0.4824	0.9227	0.9606
No log	4.9032	304	0.9298	0.4665	0.9298	0.9643
No log	4.9355	306	0.9441	0.4863	0.9441	0.9717
No log	4.9677	308	0.9336	0.4805	0.9336	0.9662
No log	5.0	310	0.9183	0.4800	0.9183	0.9583
No log	5.0323	312	0.9064	0.4995	0.9064	0.9520
No log	5.0645	314	0.8908	0.4842	0.8908	0.9438
No log	5.0968	316	0.8886	0.4968	0.8886	0.9427
No log	5.1290	318	0.8807	0.5025	0.8807	0.9384
No log	5.1613	320	0.8780	0.4983	0.8780	0.9370
No log	5.1935	322	0.8638	0.5129	0.8638	0.9294
No log	5.2258	324	0.8616	0.5076	0.8616	0.9282
No log	5.2581	326	0.8401	0.5155	0.8401	0.9166
No log	5.2903	328	0.8347	0.5146	0.8347	0.9136
No log	5.3226	330	0.8390	0.5179	0.8390	0.9160
No log	5.3548	332	0.8511	0.4920	0.8511	0.9226
No log	5.3871	334	0.8726	0.5172	0.8726	0.9341
No log	5.4194	336	0.8949	0.5039	0.8949	0.9460
No log	5.4516	338	0.9393	0.4881	0.9393	0.9692
No log	5.4839	340	1.0551	0.4739	1.0551	1.0272
No log	5.5161	342	1.2105	0.4365	1.2105	1.1002
No log	5.5484	344	1.2005	0.4519	1.2005	1.0957
No log	5.5806	346	1.0753	0.4842	1.0753	1.0370
No log	5.6129	348	0.9371	0.5058	0.9371	0.9680
No log	5.6452	350	0.9052	0.4485	0.9052	0.9514
No log	5.6774	352	0.9028	0.4516	0.9028	0.9501
No log	5.7097	354	0.9308	0.5	0.9308	0.9648
No log	5.7419	356	1.0002	0.5109	1.0002	1.0001
No log	5.7742	358	1.0907	0.4389	1.0907	1.0444
No log	5.8065	360	1.0853	0.4360	1.0853	1.0418
No log	5.8387	362	1.0159	0.4414	1.0159	1.0079
No log	5.8710	364	0.9546	0.4855	0.9546	0.9770
No log	5.9032	366	0.8928	0.5061	0.8928	0.9449
No log	5.9355	368	0.8723	0.4995	0.8723	0.9340
No log	5.9677	370	0.8595	0.5018	0.8595	0.9271
No log	6.0	372	0.8876	0.4858	0.8876	0.9421
No log	6.0323	374	0.9459	0.4492	0.9459	0.9726
No log	6.0645	376	1.0349	0.4374	1.0349	1.0173
No log	6.0968	378	1.0967	0.4538	1.0967	1.0472
No log	6.1290	380	1.1076	0.4713	1.1076	1.0524
No log	6.1613	382	1.1720	0.4696	1.1720	1.0826
No log	6.1935	384	1.1879	0.4696	1.1879	1.0899
No log	6.2258	386	1.1052	0.4841	1.1052	1.0513
No log	6.2581	388	0.9844	0.4756	0.9844	0.9922
No log	6.2903	390	0.8633	0.5159	0.8633	0.9292
No log	6.3226	392	0.8368	0.5419	0.8368	0.9148
No log	6.3548	394	0.8740	0.5089	0.8740	0.9349
No log	6.3871	396	0.9598	0.4751	0.9598	0.9797
No log	6.4194	398	1.0033	0.4509	1.0033	1.0016
No log	6.4516	400	1.0409	0.4676	1.0409	1.0202
No log	6.4839	402	1.0066	0.4726	1.0066	1.0033
No log	6.5161	404	0.9364	0.5005	0.9364	0.9677
No log	6.5484	406	0.8813	0.5098	0.8813	0.9388
No log	6.5806	408	0.8808	0.5010	0.8808	0.9385
No log	6.6129	410	0.8722	0.5072	0.8722	0.9339
No log	6.6452	412	0.8759	0.5323	0.8759	0.9359
No log	6.6774	414	0.8825	0.5104	0.8825	0.9394
No log	6.7097	416	0.9237	0.4565	0.9237	0.9611
No log	6.7419	418	0.9538	0.4569	0.9538	0.9766
No log	6.7742	420	0.9043	0.4513	0.9043	0.9510
No log	6.8065	422	0.8483	0.4625	0.8483	0.9210
No log	6.8387	424	0.7926	0.4899	0.7926	0.8903
No log	6.8710	426	0.7913	0.4886	0.7913	0.8896
No log	6.9032	428	0.8203	0.4886	0.8203	0.9057
No log	6.9355	430	0.8218	0.4886	0.8218	0.9065
No log	6.9677	432	0.8082	0.4908	0.8082	0.8990
No log	7.0	434	0.7766	0.5272	0.7766	0.8813
No log	7.0323	436	0.7460	0.5684	0.7460	0.8637
No log	7.0645	438	0.7474	0.5617	0.7474	0.8645
No log	7.0968	440	0.7780	0.5276	0.7780	0.8820
No log	7.1290	442	0.8151	0.5211	0.8151	0.9028
No log	7.1613	444	0.8432	0.5196	0.8432	0.9183
No log	7.1935	446	0.8793	0.5032	0.8793	0.9377
No log	7.2258	448	0.9147	0.4912	0.9147	0.9564
No log	7.2581	450	0.9040	0.5040	0.9040	0.9508
No log	7.2903	452	0.8879	0.5159	0.8879	0.9423
No log	7.3226	454	0.8831	0.5173	0.8831	0.9397
No log	7.3548	456	0.8724	0.5242	0.8724	0.9340
No log	7.3871	458	0.8600	0.5242	0.8600	0.9274
No log	7.4194	460	0.8438	0.4982	0.8438	0.9186
No log	7.4516	462	0.8295	0.5042	0.8295	0.9108
No log	7.4839	464	0.8143	0.5094	0.8143	0.9024
No log	7.5161	466	0.8207	0.5094	0.8207	0.9059
No log	7.5484	468	0.8361	0.5094	0.8361	0.9144
No log	7.5806	470	0.8726	0.4952	0.8726	0.9341
No log	7.6129	472	0.8774	0.4889	0.8774	0.9367
No log	7.6452	474	0.8830	0.4889	0.8830	0.9397
No log	7.6774	476	0.8744	0.4895	0.8744	0.9351
No log	7.7097	478	0.8571	0.5010	0.8571	0.9258
No log	7.7419	480	0.8394	0.4959	0.8394	0.9162
No log	7.7742	482	0.8542	0.5010	0.8542	0.9242
No log	7.8065	484	0.8464	0.4959	0.8464	0.9200
No log	7.8387	486	0.8309	0.4975	0.8309	0.9115
No log	7.8710	488	0.8501	0.5025	0.8501	0.9220
No log	7.9032	490	0.8651	0.4910	0.8651	0.9301
No log	7.9355	492	0.9127	0.4995	0.9127	0.9554
No log	7.9677	494	0.9485	0.4981	0.9485	0.9739
No log	8.0	496	0.9500	0.4920	0.9500	0.9747
No log	8.0323	498	0.9398	0.4933	0.9398	0.9694
0.4198	8.0645	500	0.9157	0.4946	0.9157	0.9569
0.4198	8.0968	502	0.8888	0.4910	0.8888	0.9428
0.4198	8.1290	504	0.8725	0.4910	0.8725	0.9341
0.4198	8.1613	506	0.8672	0.4975	0.8672	0.9312
0.4198	8.1935	508	0.8758	0.4967	0.8758	0.9358
0.4198	8.2258	510	0.8690	0.5010	0.8690	0.9322
0.4198	8.2581	512	0.8621	0.5010	0.8621	0.9285
0.4198	8.2903	514	0.8607	0.5010	0.8607	0.9277
0.4198	8.3226	516	0.8745	0.5060	0.8745	0.9352
0.4198	8.3548	518	0.8650	0.5060	0.8650	0.9301
0.4198	8.3871	520	0.8448	0.4960	0.8448	0.9191
0.4198	8.4194	522	0.8448	0.4967	0.8448	0.9191
0.4198	8.4516	524	0.8704	0.4960	0.8704	0.9329
0.4198	8.4839	526	0.9012	0.4995	0.9012	0.9493
0.4198	8.5161	528	0.9235	0.4995	0.9235	0.9610
0.4198	8.5484	530	0.9645	0.4968	0.9645	0.9821
0.4198	8.5806	532	0.9925	0.5014	0.9925	0.9962
0.4198	8.6129	534	1.0047	0.5014	1.0047	1.0023
0.4198	8.6452	536	1.0137	0.5014	1.0137	1.0068
0.4198	8.6774	538	1.0121	0.4955	1.0121	1.0060
0.4198	8.7097	540	1.0074	0.4792	1.0074	1.0037
0.4198	8.7419	542	0.9938	0.4908	0.9938	0.9969
0.4198	8.7742	544	0.9631	0.4981	0.9631	0.9814
0.4198	8.8065	546	0.9224	0.4940	0.9224	0.9604
0.4198	8.8387	548	0.8900	0.4961	0.8900	0.9434
0.4198	8.8710	550	0.8743	0.4976	0.8743	0.9351
0.4198	8.9032	552	0.8782	0.4976	0.8782	0.9371
0.4198	8.9355	554	0.8895	0.4976	0.8895	0.9431
0.4198	8.9677	556	0.8887	0.4976	0.8887	0.9427
0.4198	9.0	558	0.8985	0.4976	0.8985	0.9479
0.4198	9.0323	560	0.9141	0.4976	0.9141	0.9561
0.4198	9.0645	562	0.9316	0.4847	0.9316	0.9652
0.4198	9.0968	564	0.9589	0.4825	0.9589	0.9792
0.4198	9.1290	566	0.9722	0.4825	0.9722	0.9860
0.4198	9.1613	568	0.9725	0.4922	0.9725	0.9861
0.4198	9.1935	570	0.9749	0.4922	0.9749	0.9873
0.4198	9.2258	572	0.9772	0.4968	0.9772	0.9885
0.4198	9.2581	574	0.9787	0.4968	0.9787	0.9893
0.4198	9.2903	576	0.9822	0.4968	0.9822	0.9911
0.4198	9.3226	578	0.9795	0.4968	0.9795	0.9897
0.4198	9.3548	580	0.9671	0.4928	0.9671	0.9834
0.4198	9.3871	582	0.9574	0.4832	0.9574	0.9785
0.4198	9.4194	584	0.9521	0.4894	0.9521	0.9758
0.4198	9.4516	586	0.9456	0.4894	0.9456	0.9724
0.4198	9.4839	588	0.9415	0.4894	0.9415	0.9703
0.4198	9.5161	590	0.9426	0.4894	0.9426	0.9709
0.4198	9.5484	592	0.9406	0.4954	0.9406	0.9699
0.4198	9.5806	594	0.9330	0.4954	0.9330	0.9659
0.4198	9.6129	596	0.9277	0.4906	0.9277	0.9631
0.4198	9.6452	598	0.9276	0.4906	0.9276	0.9631
0.4198	9.6774	600	0.9277	0.4906	0.9277	0.9632
0.4198	9.7097	602	0.9301	0.4914	0.9301	0.9644
0.4198	9.7419	604	0.9310	0.4856	0.9310	0.9649
0.4198	9.7742	606	0.9270	0.4976	0.9270	0.9628
0.4198	9.8065	608	0.9267	0.4976	0.9267	0.9626
0.4198	9.8387	610	0.9284	0.4916	0.9284	0.9635
0.4198	9.8710	612	0.9282	0.4916	0.9282	0.9634
0.4198	9.9032	614	0.9268	0.4916	0.9268	0.9627
0.4198	9.9355	616	0.9262	0.4916	0.9262	0.9624
0.4198	9.9677	618	0.9260	0.4916	0.9260	0.9623
0.4198	10.0	620	0.9263	0.4916	0.9263	0.9624

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1