ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7324
• Qwk: 0.5563
• Mse: 0.7324
• Rmse: 0.8558

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0435	2	4.0437	-0.0313	4.0437	2.0109
No log	0.0870	4	2.0444	0.0285	2.0444	1.4298
No log	0.1304	6	1.2204	0.0495	1.2204	1.1047
No log	0.1739	8	0.9108	-0.0096	0.9108	0.9544
No log	0.2174	10	0.7702	0.1033	0.7702	0.8776
No log	0.2609	12	0.7050	0.2061	0.7050	0.8396
No log	0.3043	14	0.7338	0.1171	0.7338	0.8566
No log	0.3478	16	0.7394	0.125	0.7394	0.8599
No log	0.3913	18	0.9084	0.0891	0.9084	0.9531
No log	0.4348	20	1.0088	0.0276	1.0088	1.0044
No log	0.4783	22	1.1586	0.0324	1.1586	1.0764
No log	0.5217	24	1.3260	0.0825	1.3260	1.1515
No log	0.5652	26	1.2102	0.0491	1.2102	1.1001
No log	0.6087	28	0.9572	0.0618	0.9572	0.9784
No log	0.6522	30	0.7941	0.2096	0.7941	0.8911
No log	0.6957	32	0.6797	0.2819	0.6797	0.8244
No log	0.7391	34	0.6818	0.2535	0.6818	0.8257
No log	0.7826	36	0.6893	0.3078	0.6893	0.8302
No log	0.8261	38	0.8027	0.1411	0.8027	0.8959
No log	0.8696	40	0.9802	0.1786	0.9802	0.9900
No log	0.9130	42	1.4225	0.1442	1.4225	1.1927
No log	0.9565	44	1.4604	0.1570	1.4604	1.2085
No log	1.0	46	1.1817	0.1906	1.1817	1.0870
No log	1.0435	48	0.7990	0.1602	0.7990	0.8939
No log	1.0870	50	0.6370	0.3560	0.6370	0.7981
No log	1.1304	52	0.5873	0.375	0.5873	0.7664
No log	1.1739	54	0.6541	0.2775	0.6541	0.8088
No log	1.2174	56	0.7332	0.1981	0.7332	0.8563
No log	1.2609	58	0.8526	0.2210	0.8526	0.9233
No log	1.3043	60	0.9367	0.2227	0.9367	0.9678
No log	1.3478	62	0.9008	0.2339	0.9008	0.9491
No log	1.3913	64	0.7327	0.2575	0.7327	0.8560
No log	1.4348	66	0.6714	0.3637	0.6714	0.8194
No log	1.4783	68	0.7047	0.3452	0.7047	0.8395
No log	1.5217	70	0.7071	0.3567	0.7071	0.8409
No log	1.5652	72	0.6917	0.4041	0.6917	0.8317
No log	1.6087	74	0.7274	0.3714	0.7274	0.8529
No log	1.6522	76	0.7028	0.4369	0.7028	0.8383
No log	1.6957	78	0.7497	0.4116	0.7497	0.8658
No log	1.7391	80	0.7081	0.4780	0.7081	0.8415
No log	1.7826	82	0.7022	0.4847	0.7022	0.8380
No log	1.8261	84	0.6438	0.4677	0.6438	0.8024
No log	1.8696	86	0.6843	0.4413	0.6843	0.8272
No log	1.9130	88	0.6253	0.4781	0.6253	0.7908
No log	1.9565	90	0.5936	0.5205	0.5936	0.7705
No log	2.0	92	0.6232	0.4922	0.6232	0.7894
No log	2.0435	94	0.7104	0.5084	0.7104	0.8428
No log	2.0870	96	0.8750	0.4296	0.8750	0.9354
No log	2.1304	98	0.9075	0.4072	0.9075	0.9526
No log	2.1739	100	0.7624	0.4916	0.7624	0.8731
No log	2.2174	102	0.7056	0.5208	0.7056	0.8400
No log	2.2609	104	0.7403	0.5361	0.7403	0.8604
No log	2.3043	106	0.7950	0.5077	0.7950	0.8916
No log	2.3478	108	0.9137	0.4496	0.9137	0.9559
No log	2.3913	110	0.8752	0.4557	0.8752	0.9355
No log	2.4348	112	0.7949	0.5294	0.7949	0.8916
No log	2.4783	114	0.7670	0.5203	0.7670	0.8758
No log	2.5217	116	0.7246	0.5403	0.7246	0.8512
No log	2.5652	118	0.7436	0.4879	0.7436	0.8623
No log	2.6087	120	0.7833	0.4559	0.7833	0.8850
No log	2.6522	122	0.7846	0.4570	0.7846	0.8858
No log	2.6957	124	0.7311	0.5225	0.7311	0.8550
No log	2.7391	126	0.7274	0.5448	0.7274	0.8529
No log	2.7826	128	0.6780	0.5414	0.6780	0.8234
No log	2.8261	130	0.6646	0.5183	0.6646	0.8152
No log	2.8696	132	0.6887	0.4791	0.6887	0.8299
No log	2.9130	134	0.6954	0.5017	0.6954	0.8339
No log	2.9565	136	0.6789	0.4819	0.6789	0.8240
No log	3.0	138	0.6570	0.5457	0.6570	0.8106
No log	3.0435	140	0.6597	0.5521	0.6597	0.8122
No log	3.0870	142	0.6789	0.5373	0.6789	0.8240
No log	3.1304	144	0.7097	0.5269	0.7097	0.8424
No log	3.1739	146	0.7497	0.4880	0.7497	0.8658
No log	3.2174	148	0.9401	0.3622	0.9401	0.9696
No log	3.2609	150	0.9774	0.3395	0.9774	0.9886
No log	3.3043	152	0.8392	0.4491	0.8392	0.9161
No log	3.3478	154	0.7563	0.5542	0.7563	0.8697
No log	3.3913	156	0.7061	0.5411	0.7061	0.8403
No log	3.4348	158	0.7050	0.4870	0.7050	0.8397
No log	3.4783	160	0.7447	0.5014	0.7447	0.8630
No log	3.5217	162	0.7198	0.5321	0.7198	0.8484
No log	3.5652	164	0.7028	0.5306	0.7028	0.8383
No log	3.6087	166	0.7112	0.5156	0.7112	0.8433
No log	3.6522	168	0.6859	0.5302	0.6859	0.8282
No log	3.6957	170	0.6644	0.5321	0.6644	0.8151
No log	3.7391	172	0.6774	0.5280	0.6774	0.8230
No log	3.7826	174	0.6954	0.5296	0.6954	0.8339
No log	3.8261	176	0.7174	0.5286	0.7174	0.8470
No log	3.8696	178	0.7304	0.5104	0.7304	0.8546
No log	3.9130	180	0.7744	0.5008	0.7744	0.8800
No log	3.9565	182	0.8373	0.5054	0.8373	0.9151
No log	4.0	184	0.8895	0.4613	0.8895	0.9431
No log	4.0435	186	0.9165	0.5268	0.9165	0.9573
No log	4.0870	188	0.9681	0.4561	0.9681	0.9839
No log	4.1304	190	0.9403	0.4926	0.9403	0.9697
No log	4.1739	192	0.8651	0.5127	0.8651	0.9301
No log	4.2174	194	0.7881	0.5096	0.7881	0.8877
No log	4.2609	196	0.7443	0.5148	0.7443	0.8627
No log	4.3043	198	0.7375	0.5352	0.7375	0.8588
No log	4.3478	200	0.7801	0.5179	0.7801	0.8832
No log	4.3913	202	0.8133	0.5053	0.8133	0.9019
No log	4.4348	204	0.7838	0.5220	0.7838	0.8853
No log	4.4783	206	0.8096	0.5253	0.8096	0.8998
No log	4.5217	208	0.8445	0.5197	0.8445	0.9190
No log	4.5652	210	0.8241	0.5269	0.8241	0.9078
No log	4.6087	212	0.8255	0.5158	0.8255	0.9086
No log	4.6522	214	0.8642	0.5134	0.8642	0.9296
No log	4.6957	216	0.9377	0.5076	0.9377	0.9683
No log	4.7391	218	0.9310	0.5123	0.9310	0.9649
No log	4.7826	220	0.8316	0.4975	0.8316	0.9119
No log	4.8261	222	0.7517	0.5157	0.7517	0.8670
No log	4.8696	224	0.7240	0.5831	0.7240	0.8509
No log	4.9130	226	0.7067	0.5657	0.7067	0.8406
No log	4.9565	228	0.6715	0.5672	0.6715	0.8195
No log	5.0	230	0.6672	0.5624	0.6672	0.8168
No log	5.0435	232	0.7144	0.5157	0.7144	0.8452
No log	5.0870	234	0.7401	0.4841	0.7401	0.8603
No log	5.1304	236	0.7334	0.5433	0.7334	0.8564
No log	5.1739	238	0.7299	0.5550	0.7299	0.8543
No log	5.2174	240	0.7317	0.5634	0.7317	0.8554
No log	5.2609	242	0.7168	0.5509	0.7168	0.8467
No log	5.3043	244	0.7164	0.5564	0.7164	0.8464
No log	5.3478	246	0.7439	0.5355	0.7439	0.8625
No log	5.3913	248	0.7494	0.5537	0.7494	0.8657
No log	5.4348	250	0.7489	0.5616	0.7489	0.8654
No log	5.4783	252	0.7325	0.5524	0.7325	0.8558
No log	5.5217	254	0.7112	0.5524	0.7112	0.8434
No log	5.5652	256	0.7007	0.5314	0.7007	0.8371
No log	5.6087	258	0.7050	0.5298	0.7050	0.8396
No log	5.6522	260	0.7310	0.5050	0.7310	0.8550
No log	5.6957	262	0.7097	0.5415	0.7097	0.8424
No log	5.7391	264	0.6787	0.5480	0.6787	0.8239
No log	5.7826	266	0.6966	0.5499	0.6966	0.8346
No log	5.8261	268	0.7655	0.5261	0.7655	0.8749
No log	5.8696	270	0.7815	0.5266	0.7815	0.8840
No log	5.9130	272	0.7537	0.5216	0.7537	0.8682
No log	5.9565	274	0.7080	0.5539	0.7080	0.8414
No log	6.0	276	0.7231	0.5482	0.7231	0.8504
No log	6.0435	278	0.7748	0.4816	0.7748	0.8802
No log	6.0870	280	0.7911	0.4842	0.7911	0.8895
No log	6.1304	282	0.7512	0.5072	0.7512	0.8667
No log	6.1739	284	0.7211	0.5917	0.7211	0.8492
No log	6.2174	286	0.8129	0.5076	0.8129	0.9016
No log	6.2609	288	0.9941	0.4492	0.9941	0.9971
No log	6.3043	290	1.0588	0.4023	1.0588	1.0290
No log	6.3478	292	0.9684	0.4481	0.9684	0.9841
No log	6.3913	294	0.7905	0.5302	0.7905	0.8891
No log	6.4348	296	0.6763	0.5838	0.6763	0.8224
No log	6.4783	298	0.6711	0.5647	0.6711	0.8192
No log	6.5217	300	0.7119	0.5051	0.7119	0.8437
No log	6.5652	302	0.7107	0.5051	0.7107	0.8431
No log	6.6087	304	0.6819	0.5563	0.6819	0.8258
No log	6.6522	306	0.6745	0.5815	0.6745	0.8213
No log	6.6957	308	0.7095	0.5837	0.7095	0.8423
No log	6.7391	310	0.7457	0.5211	0.7457	0.8636
No log	6.7826	312	0.7462	0.5211	0.7462	0.8638
No log	6.8261	314	0.7295	0.5317	0.7295	0.8541
No log	6.8696	316	0.7238	0.5688	0.7238	0.8508
No log	6.9130	318	0.7198	0.5617	0.7198	0.8484
No log	6.9565	320	0.7371	0.5494	0.7371	0.8586
No log	7.0	322	0.7533	0.5602	0.7533	0.8679
No log	7.0435	324	0.7677	0.5813	0.7677	0.8762
No log	7.0870	326	0.7737	0.5284	0.7737	0.8796
No log	7.1304	328	0.7792	0.5231	0.7792	0.8827
No log	7.1739	330	0.7808	0.5313	0.7808	0.8836
No log	7.2174	332	0.7611	0.5221	0.7611	0.8724
No log	7.2609	334	0.7511	0.5592	0.7511	0.8667
No log	7.3043	336	0.7420	0.5562	0.7420	0.8614
No log	7.3478	338	0.7344	0.5562	0.7344	0.8570
No log	7.3913	340	0.7095	0.5462	0.7095	0.8423
No log	7.4348	342	0.6841	0.5476	0.6841	0.8271
No log	7.4783	344	0.6641	0.5505	0.6641	0.8149
No log	7.5217	346	0.6601	0.5785	0.6601	0.8124
No log	7.5652	348	0.6641	0.6009	0.6641	0.8149
No log	7.6087	350	0.6669	0.5709	0.6669	0.8166
No log	7.6522	352	0.6737	0.5709	0.6737	0.8208
No log	7.6957	354	0.6768	0.5709	0.6768	0.8227
No log	7.7391	356	0.6753	0.5709	0.6753	0.8218
No log	7.7826	358	0.6790	0.5709	0.6790	0.8240
No log	7.8261	360	0.6851	0.5564	0.6851	0.8277
No log	7.8696	362	0.7040	0.5577	0.7040	0.8390
No log	7.9130	364	0.7165	0.5493	0.7165	0.8465
No log	7.9565	366	0.7173	0.5535	0.7173	0.8469
No log	8.0	368	0.7135	0.5677	0.7135	0.8447
No log	8.0435	370	0.7124	0.5677	0.7124	0.8440
No log	8.0870	372	0.7118	0.5677	0.7118	0.8437
No log	8.1304	374	0.7151	0.5494	0.7151	0.8456
No log	8.1739	376	0.7272	0.5494	0.7272	0.8528
No log	8.2174	378	0.7369	0.5494	0.7369	0.8584
No log	8.2609	380	0.7424	0.5662	0.7424	0.8616
No log	8.3043	382	0.7412	0.5662	0.7412	0.8609
No log	8.3478	384	0.7445	0.5662	0.7445	0.8629
No log	8.3913	386	0.7412	0.5577	0.7412	0.8610
No log	8.4348	388	0.7326	0.5577	0.7326	0.8559
No log	8.4783	390	0.7262	0.5662	0.7262	0.8522
No log	8.5217	392	0.7250	0.5509	0.7250	0.8515
No log	8.5652	394	0.7267	0.5211	0.7267	0.8525
No log	8.6087	396	0.7252	0.5193	0.7252	0.8516
No log	8.6522	398	0.7191	0.5333	0.7191	0.8480
No log	8.6957	400	0.7075	0.5302	0.7075	0.8412
No log	8.7391	402	0.6986	0.5276	0.6986	0.8358
No log	8.7826	404	0.6877	0.5693	0.6877	0.8293
No log	8.8261	406	0.6893	0.5491	0.6893	0.8302
No log	8.8696	408	0.6981	0.5464	0.6981	0.8355
No log	8.9130	410	0.7069	0.5577	0.7069	0.8408
No log	8.9565	412	0.7101	0.5577	0.7101	0.8427
No log	9.0	414	0.7125	0.5577	0.7125	0.8441
No log	9.0435	416	0.7164	0.5550	0.7164	0.8464
No log	9.0870	418	0.7171	0.5508	0.7171	0.8468
No log	9.1304	420	0.7224	0.5260	0.7224	0.8499
No log	9.1739	422	0.7288	0.5265	0.7288	0.8537
No log	9.2174	424	0.7294	0.5260	0.7294	0.8541
No log	9.2609	426	0.7281	0.5260	0.7281	0.8533
No log	9.3043	428	0.7270	0.5509	0.7270	0.8527
No log	9.3478	430	0.7271	0.5479	0.7271	0.8527
No log	9.3913	432	0.7275	0.5577	0.7275	0.8529
No log	9.4348	434	0.7270	0.5577	0.7270	0.8526
No log	9.4783	436	0.7277	0.5577	0.7277	0.8530
No log	9.5217	438	0.7317	0.5563	0.7317	0.8554
No log	9.5652	440	0.7363	0.5367	0.7363	0.8581
No log	9.6087	442	0.7386	0.5367	0.7386	0.8594
No log	9.6522	444	0.7378	0.5367	0.7378	0.8589
No log	9.6957	446	0.7351	0.5563	0.7351	0.8574
No log	9.7391	448	0.7337	0.5563	0.7337	0.8566
No log	9.7826	450	0.7334	0.5563	0.7334	0.8564
No log	9.8261	452	0.7327	0.5577	0.7327	0.8560
No log	9.8696	454	0.7325	0.5577	0.7325	0.8559
No log	9.9130	456	0.7326	0.5563	0.7326	0.8559
No log	9.9565	458	0.7325	0.5563	0.7325	0.8559
No log	10.0	460	0.7324	0.5563	0.7324	0.8558

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1