ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8935
• Qwk: 0.4582
• Mse: 0.8935
• Rmse: 0.9453

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	3.8309	-0.0075	3.8309	1.9573
No log	0.0769	4	1.9624	0.0660	1.9624	1.4009
No log	0.1154	6	1.1115	0.0560	1.1115	1.0543
No log	0.1538	8	0.7739	0.0746	0.7739	0.8797
No log	0.1923	10	0.7203	0.2289	0.7203	0.8487
No log	0.2308	12	0.8289	0.0594	0.8289	0.9105
No log	0.2692	14	1.1104	-0.0113	1.1104	1.0537
No log	0.3077	16	0.9310	0.0156	0.9310	0.9649
No log	0.3462	18	0.8041	0.0541	0.8041	0.8967
No log	0.3846	20	0.8330	-0.0544	0.8330	0.9127
No log	0.4231	22	0.7494	0.1171	0.7494	0.8657
No log	0.4615	24	0.8077	0.0270	0.8077	0.8987
No log	0.5	26	0.7989	0.0329	0.7989	0.8938
No log	0.5385	28	0.7191	0.1494	0.7191	0.8480
No log	0.5769	30	0.7013	0.1344	0.7013	0.8374
No log	0.6154	32	0.7062	0.1171	0.7062	0.8403
No log	0.6538	34	0.7272	0.2224	0.7272	0.8528
No log	0.6923	36	0.7396	0.1960	0.7396	0.8600
No log	0.7308	38	0.6437	0.2015	0.6437	0.8023
No log	0.7692	40	0.6316	0.2453	0.6316	0.7947
No log	0.8077	42	0.7223	0.3810	0.7223	0.8499
No log	0.8462	44	0.6615	0.3821	0.6615	0.8134
No log	0.8846	46	0.5803	0.4672	0.5803	0.7617
No log	0.9231	48	0.5792	0.4758	0.5792	0.7611
No log	0.9615	50	0.6097	0.5090	0.6097	0.7808
No log	1.0	52	0.6909	0.5256	0.6909	0.8312
No log	1.0385	54	0.6725	0.5692	0.6725	0.8200
No log	1.0769	56	0.6415	0.4946	0.6415	0.8010
No log	1.1154	58	0.8533	0.4848	0.8533	0.9237
No log	1.1538	60	0.9320	0.4463	0.9320	0.9654
No log	1.1923	62	0.9140	0.4434	0.9140	0.9560
No log	1.2308	64	1.3834	0.3972	1.3834	1.1762
No log	1.2692	66	1.6134	0.3483	1.6134	1.2702
No log	1.3077	68	1.3798	0.4017	1.3798	1.1747
No log	1.3462	70	1.0658	0.4616	1.0658	1.0324
No log	1.3846	72	1.1616	0.4334	1.1616	1.0778
No log	1.4231	74	1.5719	0.3372	1.5719	1.2537
No log	1.4615	76	1.9571	0.2603	1.9571	1.3990
No log	1.5	78	1.2078	0.4238	1.2078	1.0990
No log	1.5385	80	0.7412	0.4766	0.7412	0.8609
No log	1.5769	82	0.7808	0.4637	0.7808	0.8836
No log	1.6154	84	0.8272	0.4893	0.8272	0.9095
No log	1.6538	86	1.3284	0.4179	1.3284	1.1525
No log	1.6923	88	1.5393	0.3914	1.5393	1.2407
No log	1.7308	90	1.2345	0.4405	1.2345	1.1111
No log	1.7692	92	0.9180	0.4957	0.9180	0.9581
No log	1.8077	94	0.8141	0.5286	0.8141	0.9023
No log	1.8462	96	0.9124	0.4991	0.9124	0.9552
No log	1.8846	98	0.9348	0.4659	0.9348	0.9669
No log	1.9231	100	0.8862	0.4857	0.8862	0.9414
No log	1.9615	102	0.8437	0.4765	0.8437	0.9185
No log	2.0	104	0.7635	0.5358	0.7635	0.8738
No log	2.0385	106	0.7687	0.5416	0.7687	0.8768
No log	2.0769	108	0.8266	0.4704	0.8266	0.9092
No log	2.1154	110	0.8554	0.5172	0.8554	0.9249
No log	2.1538	112	1.0608	0.4683	1.0608	1.0300
No log	2.1923	114	1.0952	0.4681	1.0952	1.0465
No log	2.2308	116	0.8524	0.5156	0.8524	0.9232
No log	2.2692	118	0.8018	0.5300	0.8018	0.8954
No log	2.3077	120	0.8193	0.5216	0.8193	0.9051
No log	2.3462	122	0.8646	0.4992	0.8646	0.9298
No log	2.3846	124	1.1532	0.4567	1.1532	1.0739
No log	2.4231	126	1.3923	0.4288	1.3923	1.1800
No log	2.4615	128	1.4277	0.4204	1.4277	1.1949
No log	2.5	130	1.0652	0.4705	1.0652	1.0321
No log	2.5385	132	0.8021	0.5041	0.8021	0.8956
No log	2.5769	134	0.7986	0.4932	0.7986	0.8937
No log	2.6154	136	0.7888	0.5385	0.7888	0.8881
No log	2.6538	138	0.9832	0.4472	0.9832	0.9916
No log	2.6923	140	1.6106	0.3897	1.6106	1.2691
No log	2.7308	142	1.8202	0.3016	1.8202	1.3491
No log	2.7692	144	1.4308	0.4081	1.4308	1.1962
No log	2.8077	146	0.8876	0.4685	0.8876	0.9421
No log	2.8462	148	0.7823	0.4921	0.7823	0.8845
No log	2.8846	150	0.8236	0.5046	0.8236	0.9075
No log	2.9231	152	0.9360	0.4524	0.9360	0.9675
No log	2.9615	154	1.0104	0.4679	1.0104	1.0052
No log	3.0	156	1.0568	0.4678	1.0568	1.0280
No log	3.0385	158	0.9816	0.4747	0.9816	0.9908
No log	3.0769	160	0.9573	0.5238	0.9573	0.9784
No log	3.1154	162	0.9556	0.5204	0.9556	0.9775
No log	3.1538	164	1.1106	0.4579	1.1106	1.0538
No log	3.1923	166	1.1386	0.4644	1.1386	1.0670
No log	3.2308	168	0.9419	0.4727	0.9419	0.9705
No log	3.2692	170	0.8364	0.5350	0.8364	0.9146
No log	3.3077	172	0.7746	0.5434	0.7746	0.8801
No log	3.3462	174	0.7468	0.5624	0.7468	0.8642
No log	3.3846	176	0.8720	0.4824	0.8720	0.9338
No log	3.4231	178	0.9405	0.4433	0.9405	0.9698
No log	3.4615	180	0.8534	0.4762	0.8534	0.9238
No log	3.5	182	0.7811	0.4733	0.7811	0.8838
No log	3.5385	184	0.8503	0.4672	0.8503	0.9221
No log	3.5769	186	0.9545	0.4688	0.9545	0.9770
No log	3.6154	188	1.0553	0.4529	1.0553	1.0273
No log	3.6538	190	1.1185	0.4524	1.1185	1.0576
No log	3.6923	192	0.9948	0.4526	0.9948	0.9974
No log	3.7308	194	0.9490	0.4500	0.9490	0.9742
No log	3.7692	196	1.0254	0.4777	1.0254	1.0126
No log	3.8077	198	1.1450	0.4326	1.1450	1.0700
No log	3.8462	200	1.0904	0.4250	1.0904	1.0442
No log	3.8846	202	0.9294	0.4590	0.9294	0.9641
No log	3.9231	204	0.7821	0.4461	0.7821	0.8844
No log	3.9615	206	0.7912	0.4443	0.7912	0.8895
No log	4.0	208	0.8405	0.4226	0.8405	0.9168
No log	4.0385	210	0.8345	0.4600	0.8345	0.9135
No log	4.0769	212	0.8101	0.4659	0.8101	0.9000
No log	4.1154	214	0.8648	0.4358	0.8648	0.9300
No log	4.1538	216	0.9426	0.4627	0.9426	0.9709
No log	4.1923	218	0.9585	0.4744	0.9585	0.9790
No log	4.2308	220	0.8692	0.4828	0.8692	0.9323
No log	4.2692	222	0.8886	0.4946	0.8886	0.9426
No log	4.3077	224	0.9755	0.4931	0.9755	0.9877
No log	4.3462	226	1.1044	0.4640	1.1044	1.0509
No log	4.3846	228	1.0939	0.4640	1.0939	1.0459
No log	4.4231	230	0.9364	0.4926	0.9364	0.9677
No log	4.4615	232	0.8646	0.4490	0.8646	0.9298
No log	4.5	234	0.7653	0.4574	0.7653	0.8748
No log	4.5385	236	0.7262	0.5112	0.7262	0.8521
No log	4.5769	238	0.7342	0.4761	0.7342	0.8568
No log	4.6154	240	0.7495	0.4627	0.7495	0.8657
No log	4.6538	242	0.7761	0.5167	0.7761	0.8810
No log	4.6923	244	0.8279	0.4660	0.8279	0.9099
No log	4.7308	246	0.9220	0.4555	0.9220	0.9602
No log	4.7692	248	0.9332	0.4493	0.9332	0.9660
No log	4.8077	250	0.8709	0.4590	0.8709	0.9332
No log	4.8462	252	0.8280	0.4414	0.8280	0.9099
No log	4.8846	254	0.8360	0.4728	0.8360	0.9143
No log	4.9231	256	0.9193	0.5035	0.9193	0.9588
No log	4.9615	258	0.9971	0.4656	0.9971	0.9985
No log	5.0	260	1.0917	0.4457	1.0917	1.0449
No log	5.0385	262	1.0317	0.4695	1.0317	1.0157
No log	5.0769	264	0.8787	0.4797	0.8787	0.9374
No log	5.1154	266	0.8372	0.4759	0.8372	0.9150
No log	5.1538	268	0.8564	0.4702	0.8564	0.9254
No log	5.1923	270	0.9074	0.4456	0.9074	0.9526
No log	5.2308	272	0.9862	0.4579	0.9862	0.9931
No log	5.2692	274	1.0375	0.4513	1.0375	1.0186
No log	5.3077	276	1.0329	0.4451	1.0329	1.0163
No log	5.3462	278	0.9376	0.4569	0.9376	0.9683
No log	5.3846	280	0.9189	0.4402	0.9189	0.9586
No log	5.4231	282	0.9107	0.4402	0.9107	0.9543
No log	5.4615	284	0.8679	0.4355	0.8679	0.9316
No log	5.5	286	0.8223	0.4341	0.8223	0.9068
No log	5.5385	288	0.7637	0.4201	0.7637	0.8739
No log	5.5769	290	0.7562	0.4410	0.7562	0.8696
No log	5.6154	292	0.7941	0.4289	0.7941	0.8911
No log	5.6538	294	0.8831	0.4565	0.8831	0.9397
No log	5.6923	296	0.9042	0.4640	0.9042	0.9509
No log	5.7308	298	0.9425	0.4575	0.9425	0.9708
No log	5.7692	300	0.9095	0.4721	0.9095	0.9537
No log	5.8077	302	0.8568	0.4304	0.8568	0.9256
No log	5.8462	304	0.8368	0.4406	0.8368	0.9148
No log	5.8846	306	0.8783	0.4516	0.8783	0.9372
No log	5.9231	308	0.9645	0.4686	0.9645	0.9821
No log	5.9615	310	1.0161	0.4618	1.0161	1.0080
No log	6.0	312	0.9740	0.4492	0.9740	0.9869
No log	6.0385	314	0.9296	0.4704	0.9296	0.9642
No log	6.0769	316	0.8835	0.4447	0.8835	0.9400
No log	6.1154	318	0.8494	0.4678	0.8494	0.9216
No log	6.1538	320	0.8659	0.4444	0.8659	0.9306
No log	6.1923	322	0.9647	0.4532	0.9647	0.9822
No log	6.2308	324	1.0148	0.4475	1.0148	1.0074
No log	6.2692	326	0.9804	0.4629	0.9804	0.9901
No log	6.3077	328	0.8871	0.4411	0.8871	0.9419
No log	6.3462	330	0.7667	0.4651	0.7667	0.8756
No log	6.3846	332	0.7039	0.4582	0.7039	0.8390
No log	6.4231	334	0.7178	0.4553	0.7178	0.8472
No log	6.4615	336	0.7397	0.4686	0.7397	0.8601
No log	6.5	338	0.7864	0.4570	0.7864	0.8868
No log	6.5385	340	0.8884	0.4695	0.8884	0.9425
No log	6.5769	342	1.0488	0.4504	1.0488	1.0241
No log	6.6154	344	1.1271	0.4538	1.1271	1.0616
No log	6.6538	346	1.0810	0.4756	1.0810	1.0397
No log	6.6923	348	0.9856	0.4620	0.9856	0.9928
No log	6.7308	350	0.9100	0.4727	0.9100	0.9539
No log	6.7692	352	0.9041	0.4632	0.9041	0.9508
No log	6.8077	354	0.9446	0.4770	0.9446	0.9719
No log	6.8462	356	1.0195	0.4636	1.0195	1.0097
No log	6.8846	358	1.0949	0.4654	1.0949	1.0464
No log	6.9231	360	1.0868	0.4579	1.0868	1.0425
No log	6.9615	362	1.0029	0.4832	1.0029	1.0014
No log	7.0	364	0.9163	0.4561	0.9163	0.9573
No log	7.0385	366	0.8719	0.4720	0.8719	0.9338
No log	7.0769	368	0.8678	0.4668	0.8678	0.9315
No log	7.1154	370	0.8975	0.4643	0.8975	0.9474
No log	7.1538	372	0.9551	0.4703	0.9551	0.9773
No log	7.1923	374	0.9736	0.4773	0.9736	0.9867
No log	7.2308	376	0.9484	0.4898	0.9484	0.9738
No log	7.2692	378	0.9108	0.4555	0.9108	0.9543
No log	7.3077	380	0.8930	0.4724	0.8930	0.9450
No log	7.3462	382	0.8984	0.4653	0.8984	0.9478
No log	7.3846	384	0.8894	0.4784	0.8894	0.9431
No log	7.4231	386	0.8730	0.4494	0.8730	0.9343
No log	7.4615	388	0.8429	0.4630	0.8429	0.9181
No log	7.5	390	0.8714	0.4631	0.8714	0.9335
No log	7.5385	392	0.8989	0.4616	0.8989	0.9481
No log	7.5769	394	0.9537	0.4543	0.9537	0.9766
No log	7.6154	396	1.0619	0.4524	1.0619	1.0305
No log	7.6538	398	1.1619	0.4431	1.1619	1.0779
No log	7.6923	400	1.2243	0.4395	1.2243	1.1065
No log	7.7308	402	1.1759	0.4492	1.1759	1.0844
No log	7.7692	404	1.1281	0.4250	1.1281	1.0621
No log	7.8077	406	1.0585	0.4293	1.0585	1.0288
No log	7.8462	408	0.9735	0.4435	0.9735	0.9867
No log	7.8846	410	0.9412	0.4597	0.9412	0.9702
No log	7.9231	412	0.9615	0.4614	0.9615	0.9805
No log	7.9615	414	0.9726	0.4601	0.9726	0.9862
No log	8.0	416	1.0175	0.4516	1.0175	1.0087
No log	8.0385	418	1.0123	0.4570	1.0123	1.0061
No log	8.0769	420	0.9635	0.4566	0.9635	0.9816
No log	8.1154	422	0.9249	0.4566	0.9249	0.9617
No log	8.1538	424	0.9176	0.4566	0.9176	0.9579
No log	8.1923	426	0.9436	0.4566	0.9436	0.9714
No log	8.2308	428	0.9898	0.4566	0.9898	0.9949
No log	8.2692	430	1.0060	0.4510	1.0060	1.0030
No log	8.3077	432	1.0195	0.4407	1.0195	1.0097
No log	8.3462	434	0.9984	0.4247	0.9984	0.9992
No log	8.3846	436	0.9802	0.4281	0.9802	0.9900
No log	8.4231	438	0.9287	0.4604	0.9287	0.9637
No log	8.4615	440	0.8842	0.4659	0.8842	0.9403
No log	8.5	442	0.8704	0.4419	0.8704	0.9329
No log	8.5385	444	0.8691	0.4468	0.8691	0.9323
No log	8.5769	446	0.8696	0.4558	0.8696	0.9325
No log	8.6154	448	0.8585	0.4337	0.8585	0.9265
No log	8.6538	450	0.8762	0.4596	0.8762	0.9361
No log	8.6923	452	0.9040	0.4317	0.9040	0.9508
No log	8.7308	454	0.9482	0.4229	0.9482	0.9738
No log	8.7692	456	0.9689	0.4396	0.9689	0.9843
No log	8.8077	458	0.9706	0.4563	0.9706	0.9852
No log	8.8462	460	0.9460	0.4386	0.9460	0.9726
No log	8.8846	462	0.9201	0.4386	0.9201	0.9592
No log	8.9231	464	0.8948	0.4135	0.8948	0.9460
No log	8.9615	466	0.8630	0.4375	0.8630	0.9290
No log	9.0	468	0.8445	0.4376	0.8445	0.9189
No log	9.0385	470	0.8402	0.4247	0.8402	0.9166
No log	9.0769	472	0.8432	0.4376	0.8432	0.9183
No log	9.1154	474	0.8640	0.4375	0.8640	0.9295
No log	9.1538	476	0.8839	0.4247	0.8839	0.9401
No log	9.1923	478	0.9186	0.4300	0.9186	0.9584
No log	9.2308	480	0.9604	0.4229	0.9604	0.9800
No log	9.2692	482	0.9876	0.4397	0.9876	0.9938
No log	9.3077	484	0.9955	0.4396	0.9955	0.9977
No log	9.3462	486	0.9895	0.4297	0.9895	0.9947
No log	9.3846	488	0.9815	0.4297	0.9815	0.9907
No log	9.4231	490	0.9614	0.4331	0.9614	0.9805
No log	9.4615	492	0.9535	0.4331	0.9535	0.9765
No log	9.5	494	0.9465	0.4383	0.9465	0.9729
No log	9.5385	496	0.9349	0.4317	0.9349	0.9669
No log	9.5769	498	0.9200	0.4317	0.9200	0.9592
0.469	9.6154	500	0.9072	0.4579	0.9072	0.9525
0.469	9.6538	502	0.8974	0.4592	0.8974	0.9473
0.469	9.6923	504	0.8899	0.4596	0.8899	0.9434
0.469	9.7308	506	0.8840	0.4533	0.8840	0.9402
0.469	9.7692	508	0.8807	0.4533	0.8807	0.9385
0.469	9.8077	510	0.8797	0.4533	0.8797	0.9379
0.469	9.8462	512	0.8823	0.4533	0.8823	0.9393
0.469	9.8846	514	0.8870	0.4596	0.8870	0.9418
0.469	9.9231	516	0.8903	0.4596	0.8903	0.9435
0.469	9.9615	518	0.8930	0.4582	0.8930	0.9450
0.469	10.0	520	0.8935	0.4582	0.8935	0.9453

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1