ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7307
• Qwk: 0.5235
• Mse: 0.7307
• Rmse: 0.8548

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	4.6705	0.0010	4.6705	2.1611
No log	0.3333	4	2.6941	0.0215	2.6941	1.6414
No log	0.5	6	1.7015	0.0372	1.7015	1.3044
No log	0.6667	8	1.3518	0.0811	1.3518	1.1627
No log	0.8333	10	1.1885	0.1857	1.1885	1.0902
No log	1.0	12	1.2404	0.0802	1.2404	1.1137
No log	1.1667	14	1.2829	0.0802	1.2829	1.1326
No log	1.3333	16	1.2515	0.1247	1.2515	1.1187
No log	1.5	18	1.5618	-0.0149	1.5618	1.2497
No log	1.6667	20	1.8265	0.0227	1.8265	1.3515
No log	1.8333	22	1.6318	0.0	1.6318	1.2774
No log	2.0	24	1.3089	0.0	1.3089	1.1441
No log	2.1667	26	1.1603	0.3565	1.1603	1.0772
No log	2.3333	28	1.0788	0.3965	1.0788	1.0387
No log	2.5	30	1.0864	0.3441	1.0864	1.0423
No log	2.6667	32	1.2526	0.1346	1.2526	1.1192
No log	2.8333	34	1.2017	0.1472	1.2017	1.0962
No log	3.0	36	1.3830	0.1552	1.3830	1.1760
No log	3.1667	38	1.3496	0.1552	1.3496	1.1617
No log	3.3333	40	1.1004	0.2386	1.1004	1.0490
No log	3.5	42	1.0507	0.2938	1.0507	1.0251
No log	3.6667	44	1.0208	0.3095	1.0208	1.0103
No log	3.8333	46	1.0269	0.2520	1.0269	1.0133
No log	4.0	48	1.0172	0.2556	1.0172	1.0086
No log	4.1667	50	1.1643	0.2220	1.1643	1.0790
No log	4.3333	52	1.2629	0.2919	1.2629	1.1238
No log	4.5	54	1.0573	0.3012	1.0573	1.0283
No log	4.6667	56	0.9597	0.3854	0.9597	0.9796
No log	4.8333	58	1.0472	0.3978	1.0472	1.0233
No log	5.0	60	0.9315	0.4078	0.9315	0.9651
No log	5.1667	62	1.0528	0.4640	1.0528	1.0261
No log	5.3333	64	1.3060	0.3949	1.3060	1.1428
No log	5.5	66	1.0021	0.5185	1.0021	1.0011
No log	5.6667	68	0.8255	0.5198	0.8255	0.9086
No log	5.8333	70	0.7848	0.5922	0.7848	0.8859
No log	6.0	72	0.8002	0.5869	0.8002	0.8945
No log	6.1667	74	0.7996	0.5439	0.7996	0.8942
No log	6.3333	76	0.7988	0.5621	0.7988	0.8938
No log	6.5	78	0.7880	0.5738	0.7880	0.8877
No log	6.6667	80	0.7812	0.5951	0.7812	0.8839
No log	6.8333	82	0.7683	0.5938	0.7683	0.8765
No log	7.0	84	0.8295	0.5933	0.8295	0.9108
No log	7.1667	86	0.9499	0.4941	0.9499	0.9747
No log	7.3333	88	0.8851	0.5554	0.8851	0.9408
No log	7.5	90	0.7631	0.6205	0.7631	0.8735
No log	7.6667	92	0.7434	0.5754	0.7434	0.8622
No log	7.8333	94	0.7397	0.6053	0.7397	0.8601
No log	8.0	96	0.8409	0.5352	0.8409	0.9170
No log	8.1667	98	0.9544	0.4739	0.9544	0.9769
No log	8.3333	100	0.9353	0.4794	0.9353	0.9671
No log	8.5	102	0.8160	0.5476	0.8160	0.9033
No log	8.6667	104	0.8500	0.5875	0.8500	0.9219
No log	8.8333	106	0.9034	0.5380	0.9034	0.9505
No log	9.0	108	0.9523	0.5352	0.9523	0.9758
No log	9.1667	110	1.0156	0.4573	1.0156	1.0078
No log	9.3333	112	0.9521	0.5441	0.9521	0.9758
No log	9.5	114	1.0818	0.4840	1.0818	1.0401
No log	9.6667	116	1.2881	0.4246	1.2881	1.1349
No log	9.8333	118	1.2127	0.4407	1.2127	1.1012
No log	10.0	120	0.9846	0.4372	0.9846	0.9923
No log	10.1667	122	0.9110	0.3874	0.9110	0.9545
No log	10.3333	124	0.9722	0.3567	0.9722	0.9860
No log	10.5	126	0.9602	0.3390	0.9602	0.9799
No log	10.6667	128	0.9200	0.3929	0.9200	0.9592
No log	10.8333	130	0.9145	0.4866	0.9145	0.9563
No log	11.0	132	0.8729	0.5186	0.8729	0.9343
No log	11.1667	134	0.8293	0.4313	0.8293	0.9107
No log	11.3333	136	0.8169	0.5339	0.8169	0.9038
No log	11.5	138	0.7988	0.6404	0.7988	0.8938
No log	11.6667	140	0.7911	0.5807	0.7911	0.8894
No log	11.8333	142	0.9138	0.4910	0.9138	0.9559
No log	12.0	144	0.9373	0.4730	0.9373	0.9682
No log	12.1667	146	0.7752	0.5793	0.7752	0.8804
No log	12.3333	148	0.7102	0.6257	0.7102	0.8427
No log	12.5	150	0.7032	0.6257	0.7032	0.8385
No log	12.6667	152	0.7009	0.6431	0.7009	0.8372
No log	12.8333	154	0.7129	0.5985	0.7129	0.8443
No log	13.0	156	0.7338	0.6057	0.7338	0.8566
No log	13.1667	158	0.7446	0.6346	0.7446	0.8629
No log	13.3333	160	0.7522	0.6308	0.7522	0.8673
No log	13.5	162	0.7510	0.5756	0.7510	0.8666
No log	13.6667	164	0.8417	0.5455	0.8417	0.9174
No log	13.8333	166	0.8651	0.5133	0.8651	0.9301
No log	14.0	168	0.7907	0.4527	0.7907	0.8892
No log	14.1667	170	0.8040	0.4711	0.8040	0.8967
No log	14.3333	172	0.8948	0.4186	0.8948	0.9459
No log	14.5	174	0.8777	0.4440	0.8777	0.9369
No log	14.6667	176	0.8152	0.3998	0.8152	0.9029
No log	14.8333	178	0.8848	0.4439	0.8848	0.9407
No log	15.0	180	0.8461	0.4657	0.8461	0.9199
No log	15.1667	182	0.7825	0.4828	0.7825	0.8846
No log	15.3333	184	0.8264	0.5287	0.8264	0.9091
No log	15.5	186	0.8062	0.4507	0.8062	0.8979
No log	15.6667	188	0.7541	0.5528	0.7541	0.8684
No log	15.8333	190	0.7473	0.5342	0.7473	0.8645
No log	16.0	192	0.7517	0.5342	0.7517	0.8670
No log	16.1667	194	0.7479	0.5455	0.7479	0.8648
No log	16.3333	196	0.7572	0.5331	0.7572	0.8702
No log	16.5	198	0.7911	0.6365	0.7911	0.8894
No log	16.6667	200	0.8458	0.6307	0.8458	0.9197
No log	16.8333	202	0.7936	0.6019	0.7936	0.8908
No log	17.0	204	0.7629	0.6154	0.7629	0.8734
No log	17.1667	206	0.7465	0.6251	0.7465	0.8640
No log	17.3333	208	0.7453	0.6258	0.7453	0.8633
No log	17.5	210	0.7021	0.6328	0.7021	0.8379
No log	17.6667	212	0.7055	0.6333	0.7055	0.8400
No log	17.8333	214	0.7044	0.6424	0.7044	0.8393
No log	18.0	216	0.7067	0.6054	0.7067	0.8407
No log	18.1667	218	0.7959	0.5322	0.7959	0.8921
No log	18.3333	220	0.8116	0.5511	0.8116	0.9009
No log	18.5	222	0.6918	0.6340	0.6918	0.8317
No log	18.6667	224	0.7500	0.4929	0.7500	0.8660
No log	18.8333	226	0.9404	0.5357	0.9404	0.9698
No log	19.0	228	0.9149	0.5222	0.9149	0.9565
No log	19.1667	230	0.7464	0.4841	0.7464	0.8639
No log	19.3333	232	0.7327	0.4934	0.7327	0.8560
No log	19.5	234	0.8471	0.5113	0.8471	0.9204
No log	19.6667	236	0.8861	0.5098	0.8861	0.9413
No log	19.8333	238	0.7945	0.5071	0.7945	0.8914
No log	20.0	240	0.7220	0.5439	0.7220	0.8497
No log	20.1667	242	0.7644	0.6022	0.7644	0.8743
No log	20.3333	244	0.7553	0.6022	0.7553	0.8691
No log	20.5	246	0.7171	0.5787	0.7171	0.8468
No log	20.6667	248	0.7550	0.5996	0.7550	0.8689
No log	20.8333	250	0.8831	0.5461	0.8831	0.9397
No log	21.0	252	0.9116	0.5421	0.9116	0.9548
No log	21.1667	254	0.8235	0.5627	0.8235	0.9075
No log	21.3333	256	0.7026	0.6120	0.7026	0.8382
No log	21.5	258	0.6898	0.5773	0.6898	0.8306
No log	21.6667	260	0.6997	0.5802	0.6997	0.8365
No log	21.8333	262	0.6885	0.5755	0.6885	0.8298
No log	22.0	264	0.6966	0.6029	0.6966	0.8346
No log	22.1667	266	0.7229	0.6088	0.7229	0.8502
No log	22.3333	268	0.7377	0.6215	0.7377	0.8589
No log	22.5	270	0.7135	0.6340	0.7135	0.8447
No log	22.6667	272	0.7074	0.5633	0.7074	0.8411
No log	22.8333	274	0.7058	0.5633	0.7058	0.8401
No log	23.0	276	0.7103	0.6029	0.7103	0.8428
No log	23.1667	278	0.7526	0.5814	0.7526	0.8675
No log	23.3333	280	0.7975	0.5444	0.7975	0.8930
No log	23.5	282	0.7501	0.5102	0.7501	0.8661
No log	23.6667	284	0.7057	0.5946	0.7057	0.8401
No log	23.8333	286	0.7267	0.5470	0.7267	0.8525
No log	24.0	288	0.7921	0.5835	0.7921	0.8900
No log	24.1667	290	0.7764	0.5530	0.7764	0.8811
No log	24.3333	292	0.6961	0.5993	0.6961	0.8344
No log	24.5	294	0.7806	0.625	0.7806	0.8835
No log	24.6667	296	0.8972	0.5626	0.8972	0.9472
No log	24.8333	298	0.8949	0.5703	0.8949	0.9460
No log	25.0	300	0.7984	0.5412	0.7984	0.8935
No log	25.1667	302	0.7150	0.6300	0.7150	0.8455
No log	25.3333	304	0.7101	0.6404	0.7101	0.8427
No log	25.5	306	0.7065	0.6355	0.7065	0.8406
No log	25.6667	308	0.7541	0.6162	0.7541	0.8684
No log	25.8333	310	0.8304	0.5648	0.8304	0.9113
No log	26.0	312	0.7898	0.5513	0.7898	0.8887
No log	26.1667	314	0.7809	0.5716	0.7809	0.8837
No log	26.3333	316	0.7910	0.5591	0.7910	0.8894
No log	26.5	318	0.7569	0.5792	0.7569	0.8700
No log	26.6667	320	0.7328	0.5869	0.7328	0.8560
No log	26.8333	322	0.7168	0.5455	0.7168	0.8466
No log	27.0	324	0.7068	0.5267	0.7068	0.8407
No log	27.1667	326	0.7140	0.5070	0.7140	0.8450
No log	27.3333	328	0.7919	0.5614	0.7919	0.8899
No log	27.5	330	0.8382	0.5696	0.8382	0.9155
No log	27.6667	332	0.8332	0.5672	0.8332	0.9128
No log	27.8333	334	0.7521	0.5637	0.7521	0.8672
No log	28.0	336	0.6969	0.6228	0.6969	0.8348
No log	28.1667	338	0.6763	0.6269	0.6763	0.8224
No log	28.3333	340	0.6751	0.6269	0.6751	0.8216
No log	28.5	342	0.6730	0.6290	0.6730	0.8204
No log	28.6667	344	0.6792	0.6456	0.6792	0.8242
No log	28.8333	346	0.6949	0.6032	0.6949	0.8336
No log	29.0	348	0.7095	0.6215	0.7095	0.8423
No log	29.1667	350	0.6971	0.6647	0.6971	0.8349
No log	29.3333	352	0.7003	0.5691	0.7003	0.8368
No log	29.5	354	0.7245	0.5503	0.7245	0.8512
No log	29.6667	356	0.7262	0.5503	0.7262	0.8521
No log	29.8333	358	0.6968	0.5500	0.6968	0.8347
No log	30.0	360	0.6806	0.6032	0.6806	0.8250
No log	30.1667	362	0.6765	0.5690	0.6765	0.8225
No log	30.3333	364	0.6854	0.5483	0.6854	0.8279
No log	30.5	366	0.6951	0.5483	0.6951	0.8337
No log	30.6667	368	0.7075	0.5329	0.7075	0.8411
No log	30.8333	370	0.7122	0.5329	0.7122	0.8439
No log	31.0	372	0.7144	0.5329	0.7144	0.8452
No log	31.1667	374	0.7159	0.5308	0.7159	0.8461
No log	31.3333	376	0.7166	0.5752	0.7166	0.8465
No log	31.5	378	0.7042	0.6041	0.7042	0.8392
No log	31.6667	380	0.7002	0.6067	0.7002	0.8368
No log	31.8333	382	0.6965	0.6228	0.6965	0.8346
No log	32.0	384	0.7013	0.5848	0.7013	0.8374
No log	32.1667	386	0.7503	0.6481	0.7503	0.8662
No log	32.3333	388	0.7827	0.5899	0.7827	0.8847
No log	32.5	390	0.7764	0.5954	0.7764	0.8811
No log	32.6667	392	0.7903	0.5490	0.7903	0.8890
No log	32.8333	394	0.7996	0.5379	0.7996	0.8942
No log	33.0	396	0.7796	0.5660	0.7796	0.8830
No log	33.1667	398	0.7276	0.6266	0.7276	0.8530
No log	33.3333	400	0.7021	0.6202	0.7021	0.8379
No log	33.5	402	0.7076	0.6202	0.7076	0.8412
No log	33.6667	404	0.7118	0.6404	0.7118	0.8437
No log	33.8333	406	0.7161	0.6175	0.7161	0.8462
No log	34.0	408	0.7195	0.5987	0.7195	0.8482
No log	34.1667	410	0.7483	0.5685	0.7483	0.8650
No log	34.3333	412	0.7706	0.5276	0.7706	0.8778
No log	34.5	414	0.7987	0.5399	0.7987	0.8937
No log	34.6667	416	0.8220	0.5098	0.8220	0.9066
No log	34.8333	418	0.8423	0.5098	0.8423	0.9178
No log	35.0	420	0.8175	0.5098	0.8175	0.9041
No log	35.1667	422	0.7433	0.5513	0.7433	0.8621
No log	35.3333	424	0.7143	0.5875	0.7143	0.8452
No log	35.5	426	0.7175	0.5934	0.7175	0.8470
No log	35.6667	428	0.7433	0.5991	0.7433	0.8621
No log	35.8333	430	0.7491	0.5962	0.7491	0.8655
No log	36.0	432	0.7210	0.6417	0.7210	0.8491
No log	36.1667	434	0.6917	0.6518	0.6917	0.8317
No log	36.3333	436	0.6823	0.6573	0.6823	0.8260
No log	36.5	438	0.6711	0.6479	0.6711	0.8192
No log	36.6667	440	0.6697	0.6141	0.6697	0.8184
No log	36.8333	442	0.6717	0.5711	0.6717	0.8196
No log	37.0	444	0.6760	0.5233	0.6760	0.8222
No log	37.1667	446	0.6828	0.5662	0.6828	0.8263
No log	37.3333	448	0.6948	0.6154	0.6948	0.8336
No log	37.5	450	0.6982	0.6044	0.6982	0.8356
No log	37.6667	452	0.7180	0.6068	0.7180	0.8473
No log	37.8333	454	0.7120	0.6121	0.7120	0.8438
No log	38.0	456	0.6800	0.6565	0.6800	0.8246
No log	38.1667	458	0.6824	0.5607	0.6824	0.8261
No log	38.3333	460	0.6932	0.5840	0.6932	0.8326
No log	38.5	462	0.6961	0.5370	0.6961	0.8343
No log	38.6667	464	0.7078	0.5815	0.7078	0.8413
No log	38.8333	466	0.7209	0.5957	0.7209	0.8491
No log	39.0	468	0.7325	0.6013	0.7325	0.8558
No log	39.1667	470	0.7303	0.5983	0.7303	0.8546
No log	39.3333	472	0.7337	0.5949	0.7337	0.8565
No log	39.5	474	0.7336	0.5783	0.7336	0.8565
No log	39.6667	476	0.7270	0.5455	0.7270	0.8526
No log	39.8333	478	0.7314	0.5119	0.7314	0.8552
No log	40.0	480	0.7354	0.5119	0.7354	0.8576
No log	40.1667	482	0.7398	0.5119	0.7398	0.8601
No log	40.3333	484	0.7341	0.4920	0.7341	0.8568
No log	40.5	486	0.7288	0.4920	0.7288	0.8537
No log	40.6667	488	0.7158	0.4980	0.7158	0.8461
No log	40.8333	490	0.7165	0.5596	0.7165	0.8465
No log	41.0	492	0.7273	0.5979	0.7273	0.8528
No log	41.1667	494	0.7461	0.6162	0.7461	0.8638
No log	41.3333	496	0.7404	0.6110	0.7404	0.8604
No log	41.5	498	0.7387	0.5869	0.7387	0.8595
0.2695	41.6667	500	0.7745	0.5769	0.7745	0.8800
0.2695	41.8333	502	0.7885	0.5661	0.7885	0.8880
0.2695	42.0	504	0.7631	0.5796	0.7631	0.8736
0.2695	42.1667	506	0.7458	0.5447	0.7458	0.8636
0.2695	42.3333	508	0.7181	0.5979	0.7181	0.8474
0.2695	42.5	510	0.6925	0.5408	0.6925	0.8322
0.2695	42.6667	512	0.6846	0.5408	0.6846	0.8274
0.2695	42.8333	514	0.6860	0.5838	0.6860	0.8283
0.2695	43.0	516	0.7110	0.6266	0.7110	0.8432
0.2695	43.1667	518	0.7246	0.6350	0.7246	0.8512
0.2695	43.3333	520	0.7085	0.6266	0.7085	0.8417
0.2695	43.5	522	0.6841	0.6404	0.6841	0.8271
0.2695	43.6667	524	0.6713	0.6196	0.6713	0.8193
0.2695	43.8333	526	0.6644	0.6417	0.6644	0.8151
0.2695	44.0	528	0.6678	0.6290	0.6678	0.8172
0.2695	44.1667	530	0.6720	0.6108	0.6720	0.8198
0.2695	44.3333	532	0.6920	0.5610	0.6920	0.8318
0.2695	44.5	534	0.7132	0.6154	0.7132	0.8445
0.2695	44.6667	536	0.7062	0.5787	0.7062	0.8403
0.2695	44.8333	538	0.6933	0.6120	0.6933	0.8326
0.2695	45.0	540	0.6953	0.6371	0.6953	0.8338
0.2695	45.1667	542	0.6961	0.6479	0.6961	0.8343
0.2695	45.3333	544	0.6789	0.5951	0.6789	0.8239
0.2695	45.5	546	0.6672	0.6340	0.6672	0.8168
0.2695	45.6667	548	0.6541	0.6575	0.6541	0.8088
0.2695	45.8333	550	0.6511	0.6616	0.6511	0.8069
0.2695	46.0	552	0.6519	0.6575	0.6519	0.8074
0.2695	46.1667	554	0.6644	0.6918	0.6644	0.8151
0.2695	46.3333	556	0.7123	0.6518	0.7123	0.8440
0.2695	46.5	558	0.7443	0.6182	0.7443	0.8628
0.2695	46.6667	560	0.7353	0.6382	0.7353	0.8575
0.2695	46.8333	562	0.7390	0.6182	0.7390	0.8596
0.2695	47.0	564	0.7242	0.6490	0.7242	0.8510
0.2695	47.1667	566	0.7275	0.6089	0.7275	0.8529
0.2695	47.3333	568	0.7194	0.5698	0.7194	0.8482
0.2695	47.5	570	0.7102	0.5661	0.7102	0.8428
0.2695	47.6667	572	0.7034	0.5892	0.7034	0.8387
0.2695	47.8333	574	0.7071	0.6175	0.7071	0.8409
0.2695	48.0	576	0.7018	0.6209	0.7018	0.8377
0.2695	48.1667	578	0.7066	0.6335	0.7066	0.8406
0.2695	48.3333	580	0.7036	0.6041	0.7036	0.8388
0.2695	48.5	582	0.6994	0.5380	0.6994	0.8363
0.2695	48.6667	584	0.6929	0.5195	0.6929	0.8324
0.2695	48.8333	586	0.6892	0.5849	0.6892	0.8302
0.2695	49.0	588	0.6810	0.5849	0.6810	0.8252
0.2695	49.1667	590	0.6736	0.5854	0.6736	0.8207
0.2695	49.3333	592	0.6861	0.6593	0.6861	0.8283
0.2695	49.5	594	0.7180	0.6490	0.7180	0.8473
0.2695	49.6667	596	0.7366	0.6246	0.7366	0.8583
0.2695	49.8333	598	0.7506	0.6068	0.7506	0.8663
0.2695	50.0	600	0.7529	0.6038	0.7529	0.8677
0.2695	50.1667	602	0.7421	0.6174	0.7421	0.8615
0.2695	50.3333	604	0.7381	0.6453	0.7381	0.8591
0.2695	50.5	606	0.7371	0.6555	0.7371	0.8585
0.2695	50.6667	608	0.7417	0.6555	0.7417	0.8612
0.2695	50.8333	610	0.7496	0.6417	0.7496	0.8658
0.2695	51.0	612	0.7368	0.6417	0.7368	0.8584
0.2695	51.1667	614	0.7177	0.6435	0.7177	0.8472
0.2695	51.3333	616	0.7053	0.6163	0.7053	0.8398
0.2695	51.5	618	0.7044	0.6393	0.7044	0.8393
0.2695	51.6667	620	0.7116	0.6196	0.7116	0.8436
0.2695	51.8333	622	0.7160	0.6032	0.7160	0.8462
0.2695	52.0	624	0.7209	0.6032	0.7209	0.8491
0.2695	52.1667	626	0.7324	0.5892	0.7324	0.8558
0.2695	52.3333	628	0.7385	0.5892	0.7385	0.8593
0.2695	52.5	630	0.7365	0.5892	0.7365	0.8582
0.2695	52.6667	632	0.7400	0.5892	0.7400	0.8602
0.2695	52.8333	634	0.7432	0.5892	0.7432	0.8621
0.2695	53.0	636	0.7403	0.5921	0.7403	0.8604
0.2695	53.1667	638	0.7345	0.5862	0.7345	0.8571
0.2695	53.3333	640	0.7303	0.5242	0.7303	0.8546
0.2695	53.5	642	0.7314	0.4853	0.7314	0.8552
0.2695	53.6667	644	0.7315	0.4993	0.7315	0.8553
0.2695	53.8333	646	0.7330	0.5150	0.7330	0.8562
0.2695	54.0	648	0.7307	0.5235	0.7307	0.8548

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1