ArabicNewSplits5_FineTuningAraBERT_run2_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7746
• Qwk: 0.7430
• Mse: 0.7746
• Rmse: 0.8801

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.1919	0.0255	2.1919	1.4805
No log	0.0645	4	1.6490	0.0561	1.6490	1.2841
No log	0.0968	6	1.5166	0.1018	1.5166	1.2315
No log	0.1290	8	1.4912	0.1464	1.4912	1.2211
No log	0.1613	10	1.3829	0.1449	1.3829	1.1760
No log	0.1935	12	1.3646	0.1438	1.3646	1.1682
No log	0.2258	14	1.4976	0.2821	1.4976	1.2238
No log	0.2581	16	1.3723	0.2743	1.3723	1.1715
No log	0.2903	18	1.2658	0.2065	1.2658	1.1251
No log	0.3226	20	1.1838	0.2247	1.1838	1.0880
No log	0.3548	22	1.1696	0.3490	1.1696	1.0815
No log	0.3871	24	1.1846	0.3754	1.1846	1.0884
No log	0.4194	26	1.2413	0.3028	1.2413	1.1141
No log	0.4516	28	1.2916	0.2975	1.2916	1.1365
No log	0.4839	30	1.2846	0.2400	1.2846	1.1334
No log	0.5161	32	1.1503	0.3109	1.1503	1.0725
No log	0.5484	34	1.0413	0.4694	1.0413	1.0204
No log	0.5806	36	0.9803	0.5254	0.9803	0.9901
No log	0.6129	38	0.9647	0.5703	0.9647	0.9822
No log	0.6452	40	1.1834	0.3868	1.1834	1.0878
No log	0.6774	42	1.4879	0.3136	1.4879	1.2198
No log	0.7097	44	1.4178	0.3793	1.4178	1.1907
No log	0.7419	46	1.1030	0.4367	1.1030	1.0502
No log	0.7742	48	1.0259	0.4836	1.0259	1.0129
No log	0.8065	50	1.0362	0.4569	1.0362	1.0180
No log	0.8387	52	1.0366	0.4291	1.0366	1.0181
No log	0.8710	54	1.0267	0.4314	1.0267	1.0133
No log	0.9032	56	0.9985	0.4597	0.9985	0.9992
No log	0.9355	58	0.9668	0.4503	0.9668	0.9833
No log	0.9677	60	0.9512	0.4390	0.9512	0.9753
No log	1.0	62	0.9370	0.5042	0.9370	0.9680
No log	1.0323	64	0.9056	0.5120	0.9056	0.9516
No log	1.0645	66	0.8722	0.6022	0.8722	0.9339
No log	1.0968	68	0.8708	0.5893	0.8708	0.9332
No log	1.1290	70	1.0741	0.4871	1.0741	1.0364
No log	1.1613	72	1.1603	0.4439	1.1603	1.0772
No log	1.1935	74	0.9334	0.5486	0.9334	0.9661
No log	1.2258	76	0.7829	0.6517	0.7829	0.8848
No log	1.2581	78	0.7711	0.6511	0.7711	0.8781
No log	1.2903	80	0.7883	0.6181	0.7883	0.8879
No log	1.3226	82	0.7630	0.6517	0.7630	0.8735
No log	1.3548	84	0.9002	0.5806	0.9002	0.9488
No log	1.3871	86	1.0224	0.5509	1.0224	1.0111
No log	1.4194	88	0.9822	0.5716	0.9822	0.9911
No log	1.4516	90	0.8518	0.6401	0.8518	0.9229
No log	1.4839	92	0.8021	0.6380	0.8021	0.8956
No log	1.5161	94	0.8278	0.6390	0.8278	0.9098
No log	1.5484	96	0.9819	0.6244	0.9819	0.9909
No log	1.5806	98	1.1239	0.5988	1.1239	1.0601
No log	1.6129	100	1.0732	0.5988	1.0732	1.0360
No log	1.6452	102	1.1195	0.6111	1.1195	1.0581
No log	1.6774	104	1.3600	0.5521	1.3600	1.1662
No log	1.7097	106	1.3760	0.5547	1.3760	1.1730
No log	1.7419	108	1.1190	0.5884	1.1190	1.0578
No log	1.7742	110	0.8839	0.6648	0.8839	0.9402
No log	1.8065	112	0.8720	0.6617	0.8720	0.9338
No log	1.8387	114	1.0017	0.5992	1.0017	1.0009
No log	1.8710	116	1.1729	0.5735	1.1729	1.0830
No log	1.9032	118	1.1903	0.5683	1.1903	1.0910
No log	1.9355	120	1.0465	0.6116	1.0465	1.0230
No log	1.9677	122	0.8397	0.6436	0.8397	0.9163
No log	2.0	124	0.7929	0.6593	0.7929	0.8904
No log	2.0323	126	0.8287	0.6335	0.8287	0.9103
No log	2.0645	128	0.9424	0.6367	0.9424	0.9708
No log	2.0968	130	1.1178	0.5861	1.1178	1.0572
No log	2.1290	132	1.4171	0.5521	1.4171	1.1904
No log	2.1613	134	1.5267	0.5330	1.5267	1.2356
No log	2.1935	136	1.2837	0.5547	1.2837	1.1330
No log	2.2258	138	0.9062	0.6256	0.9062	0.9519
No log	2.2581	140	0.7742	0.6337	0.7742	0.8799
No log	2.2903	142	0.7600	0.6242	0.7600	0.8718
No log	2.3226	144	0.7744	0.6712	0.7744	0.8800
No log	2.3548	146	0.8973	0.6062	0.8973	0.9472
No log	2.3871	148	0.9925	0.5608	0.9925	0.9962
No log	2.4194	150	1.0939	0.5496	1.0939	1.0459
No log	2.4516	152	1.1055	0.5698	1.1055	1.0514
No log	2.4839	154	1.0022	0.6023	1.0022	1.0011
No log	2.5161	156	0.8402	0.6132	0.8402	0.9167
No log	2.5484	158	0.7521	0.6809	0.7521	0.8673
No log	2.5806	160	0.7356	0.6984	0.7356	0.8577
No log	2.6129	162	0.8132	0.6324	0.8132	0.9018
No log	2.6452	164	0.8588	0.6077	0.8588	0.9267
No log	2.6774	166	0.9464	0.6249	0.9464	0.9728
No log	2.7097	168	1.0113	0.6028	1.0113	1.0057
No log	2.7419	170	0.9205	0.6594	0.9205	0.9594
No log	2.7742	172	0.8093	0.6828	0.8093	0.8996
No log	2.8065	174	0.6947	0.7378	0.6947	0.8335
No log	2.8387	176	0.7032	0.7421	0.7032	0.8386
No log	2.8710	178	0.6918	0.7533	0.6918	0.8317
No log	2.9032	180	0.7313	0.7250	0.7313	0.8551
No log	2.9355	182	0.8483	0.6287	0.8483	0.9210
No log	2.9677	184	1.0808	0.5960	1.0808	1.0396
No log	3.0	186	1.1551	0.5869	1.1551	1.0747
No log	3.0323	188	1.0624	0.5937	1.0624	1.0307
No log	3.0645	190	0.9674	0.6020	0.9674	0.9836
No log	3.0968	192	0.8185	0.6977	0.8185	0.9047
No log	3.1290	194	0.7263	0.7326	0.7263	0.8522
No log	3.1613	196	0.6931	0.7249	0.6931	0.8325
No log	3.1935	198	0.6919	0.7146	0.6919	0.8318
No log	3.2258	200	0.7677	0.6874	0.7677	0.8762
No log	3.2581	202	0.8438	0.6867	0.8438	0.9186
No log	3.2903	204	0.9587	0.6460	0.9587	0.9791
No log	3.3226	206	1.0912	0.5828	1.0912	1.0446
No log	3.3548	208	1.0791	0.5629	1.0791	1.0388
No log	3.3871	210	1.1107	0.5493	1.1107	1.0539
No log	3.4194	212	1.0702	0.5530	1.0702	1.0345
No log	3.4516	214	1.0330	0.5684	1.0330	1.0164
No log	3.4839	216	0.9527	0.6031	0.9527	0.9761
No log	3.5161	218	0.9378	0.5957	0.9378	0.9684
No log	3.5484	220	0.9061	0.6349	0.9061	0.9519
No log	3.5806	222	0.8752	0.6579	0.8752	0.9355
No log	3.6129	224	0.8453	0.6697	0.8453	0.9194
No log	3.6452	226	0.8559	0.6898	0.8559	0.9251
No log	3.6774	228	0.7958	0.6924	0.7958	0.8921
No log	3.7097	230	0.7416	0.7041	0.7416	0.8611
No log	3.7419	232	0.7234	0.6904	0.7234	0.8505
No log	3.7742	234	0.7478	0.6894	0.7478	0.8648
No log	3.8065	236	0.7920	0.6640	0.7920	0.8899
No log	3.8387	238	0.8513	0.6688	0.8513	0.9226
No log	3.8710	240	0.9388	0.6409	0.9388	0.9689
No log	3.9032	242	1.0205	0.6082	1.0205	1.0102
No log	3.9355	244	1.0003	0.6374	1.0003	1.0001
No log	3.9677	246	0.9517	0.6047	0.9517	0.9755
No log	4.0	248	0.8816	0.6444	0.8816	0.9389
No log	4.0323	250	0.7691	0.6552	0.7691	0.8770
No log	4.0645	252	0.7353	0.6667	0.7353	0.8575
No log	4.0968	254	0.7659	0.6744	0.7659	0.8752
No log	4.1290	256	0.8033	0.6787	0.8033	0.8963
No log	4.1613	258	0.7983	0.6932	0.7983	0.8935
No log	4.1935	260	0.8822	0.6858	0.8822	0.9392
No log	4.2258	262	0.9587	0.6513	0.9587	0.9792
No log	4.2581	264	0.9441	0.6640	0.9441	0.9717
No log	4.2903	266	0.8655	0.6832	0.8655	0.9303
No log	4.3226	268	0.7803	0.7017	0.7803	0.8833
No log	4.3548	270	0.7695	0.7113	0.7696	0.8772
No log	4.3871	272	0.8612	0.6597	0.8612	0.9280
No log	4.4194	274	1.0345	0.6642	1.0345	1.0171
No log	4.4516	276	1.2671	0.5872	1.2671	1.1257
No log	4.4839	278	1.3083	0.5885	1.3083	1.1438
No log	4.5161	280	1.2312	0.5780	1.2312	1.1096
No log	4.5484	282	1.1194	0.5946	1.1194	1.0580
No log	4.5806	284	1.0477	0.6094	1.0477	1.0236
No log	4.6129	286	1.0063	0.6249	1.0063	1.0032
No log	4.6452	288	1.0424	0.6236	1.0424	1.0210
No log	4.6774	290	1.0100	0.6434	1.0100	1.0050
No log	4.7097	292	0.9166	0.6722	0.9166	0.9574
No log	4.7419	294	0.9043	0.6655	0.9043	0.9509
No log	4.7742	296	0.9723	0.6167	0.9723	0.9860
No log	4.8065	298	1.0091	0.5712	1.0091	1.0045
No log	4.8387	300	0.9804	0.5921	0.9804	0.9902
No log	4.8710	302	0.9896	0.5734	0.9896	0.9948
No log	4.9032	304	1.0255	0.5438	1.0255	1.0127
No log	4.9355	306	1.0801	0.5671	1.0801	1.0393
No log	4.9677	308	1.0666	0.5942	1.0666	1.0328
No log	5.0	310	0.9876	0.6167	0.9876	0.9938
No log	5.0323	312	0.9125	0.6808	0.9125	0.9553
No log	5.0645	314	0.9540	0.6499	0.9540	0.9767
No log	5.0968	316	0.9765	0.6649	0.9765	0.9882
No log	5.1290	318	0.9117	0.6811	0.9117	0.9548
No log	5.1613	320	0.8022	0.7165	0.8022	0.8956
No log	5.1935	322	0.7427	0.7217	0.7427	0.8618
No log	5.2258	324	0.7233	0.7160	0.7233	0.8505
No log	5.2581	326	0.7697	0.7146	0.7697	0.8773
No log	5.2903	328	0.8554	0.7015	0.8554	0.9249
No log	5.3226	330	0.9228	0.6561	0.9228	0.9606
No log	5.3548	332	0.9820	0.6342	0.9820	0.9910
No log	5.3871	334	1.0407	0.6032	1.0407	1.0201
No log	5.4194	336	1.0183	0.6324	1.0183	1.0091
No log	5.4516	338	1.0360	0.6221	1.0360	1.0179
No log	5.4839	340	1.0406	0.6221	1.0406	1.0201
No log	5.5161	342	1.0507	0.6235	1.0507	1.0250
No log	5.5484	344	1.0555	0.6409	1.0555	1.0274
No log	5.5806	346	1.0697	0.6409	1.0697	1.0343
No log	5.6129	348	1.0700	0.6435	1.0700	1.0344
No log	5.6452	350	0.9774	0.6525	0.9774	0.9886
No log	5.6774	352	0.8295	0.6643	0.8295	0.9108
No log	5.7097	354	0.6983	0.7012	0.6983	0.8356
No log	5.7419	356	0.6591	0.7185	0.6591	0.8119
No log	5.7742	358	0.6393	0.7246	0.6393	0.7996
No log	5.8065	360	0.6549	0.7054	0.6549	0.8093
No log	5.8387	362	0.7231	0.7095	0.7231	0.8504
No log	5.8710	364	0.8423	0.7262	0.8423	0.9178
No log	5.9032	366	0.9247	0.6901	0.9247	0.9616
No log	5.9355	368	0.9539	0.6811	0.9539	0.9767
No log	5.9677	370	0.9087	0.6821	0.9087	0.9533
No log	6.0	372	0.8393	0.7184	0.8393	0.9161
No log	6.0323	374	0.7651	0.7152	0.7651	0.8747
No log	6.0645	376	0.7342	0.7093	0.7342	0.8569
No log	6.0968	378	0.7369	0.7159	0.7369	0.8584
No log	6.1290	380	0.7753	0.7188	0.7753	0.8805
No log	6.1613	382	0.8182	0.7122	0.8182	0.9045
No log	6.1935	384	0.8143	0.7039	0.8143	0.9024
No log	6.2258	386	0.8063	0.7066	0.8063	0.8980
No log	6.2581	388	0.7774	0.7331	0.7774	0.8817
No log	6.2903	390	0.7927	0.7289	0.7927	0.8903
No log	6.3226	392	0.8213	0.7119	0.8213	0.9063
No log	6.3548	394	0.8180	0.7119	0.8180	0.9044
No log	6.3871	396	0.8080	0.7119	0.8080	0.8989
No log	6.4194	398	0.7842	0.7200	0.7842	0.8855
No log	6.4516	400	0.8060	0.7085	0.8060	0.8978
No log	6.4839	402	0.8464	0.7229	0.8464	0.9200
No log	6.5161	404	0.8434	0.7174	0.8434	0.9183
No log	6.5484	406	0.8612	0.7096	0.8612	0.9280
No log	6.5806	408	0.8568	0.7127	0.8568	0.9256
No log	6.6129	410	0.8367	0.7189	0.8367	0.9147
No log	6.6452	412	0.8295	0.7229	0.8295	0.9108
No log	6.6774	414	0.8324	0.7229	0.8324	0.9124
No log	6.7097	416	0.8604	0.7303	0.8604	0.9276
No log	6.7419	418	0.9178	0.7122	0.9178	0.9580
No log	6.7742	420	0.9277	0.7062	0.9277	0.9632
No log	6.8065	422	0.9177	0.7138	0.9177	0.9579
No log	6.8387	424	0.9228	0.7138	0.9228	0.9606
No log	6.8710	426	0.8677	0.7176	0.8677	0.9315
No log	6.9032	428	0.7805	0.7281	0.7805	0.8834
No log	6.9355	430	0.7072	0.7363	0.7072	0.8409
No log	6.9677	432	0.6795	0.7363	0.6795	0.8243
No log	7.0	434	0.6727	0.7363	0.6727	0.8202
No log	7.0323	436	0.6889	0.7489	0.6889	0.8300
No log	7.0645	438	0.7194	0.7489	0.7194	0.8482
No log	7.0968	440	0.7495	0.7541	0.7495	0.8657
No log	7.1290	442	0.7526	0.7541	0.7526	0.8675
No log	7.1613	444	0.7447	0.7541	0.7447	0.8630
No log	7.1935	446	0.7127	0.7489	0.7127	0.8442
No log	7.2258	448	0.7058	0.7489	0.7058	0.8401
No log	7.2581	450	0.6986	0.7489	0.6986	0.8358
No log	7.2903	452	0.6826	0.7492	0.6826	0.8262
No log	7.3226	454	0.6851	0.7492	0.6851	0.8277
No log	7.3548	456	0.6727	0.7571	0.6727	0.8202
No log	7.3871	458	0.6599	0.7571	0.6599	0.8123
No log	7.4194	460	0.6773	0.7571	0.6773	0.8230
No log	7.4516	462	0.7111	0.7571	0.7111	0.8433
No log	7.4839	464	0.7485	0.7467	0.7485	0.8652
No log	7.5161	466	0.7511	0.7428	0.7511	0.8667
No log	7.5484	468	0.7272	0.7546	0.7272	0.8528
No log	7.5806	470	0.7014	0.7517	0.7014	0.8375
No log	7.6129	472	0.6716	0.7366	0.6716	0.8195
No log	7.6452	474	0.6660	0.7206	0.6660	0.8161
No log	7.6774	476	0.6634	0.7443	0.6634	0.8145
No log	7.7097	478	0.6735	0.7517	0.6735	0.8207
No log	7.7419	480	0.7033	0.7517	0.7033	0.8386
No log	7.7742	482	0.7523	0.7390	0.7523	0.8674
No log	7.8065	484	0.8123	0.7303	0.8123	0.9013
No log	7.8387	486	0.8631	0.6931	0.8631	0.9291
No log	7.8710	488	0.8795	0.7044	0.8795	0.9378
No log	7.9032	490	0.8472	0.6931	0.8472	0.9204
No log	7.9355	492	0.8023	0.7303	0.8023	0.8957
No log	7.9677	494	0.7534	0.7436	0.7534	0.8680
No log	8.0	496	0.6984	0.7436	0.6984	0.8357
No log	8.0323	498	0.6530	0.7449	0.6530	0.8081
0.2918	8.0645	500	0.6400	0.7316	0.6400	0.8000
0.2918	8.0968	502	0.6471	0.7316	0.6471	0.8044
0.2918	8.1290	504	0.6727	0.7330	0.6727	0.8202
0.2918	8.1613	506	0.7153	0.7363	0.7153	0.8458
0.2918	8.1935	508	0.7625	0.7489	0.7625	0.8732
0.2918	8.2258	510	0.7979	0.7343	0.7979	0.8933
0.2918	8.2581	512	0.8310	0.7084	0.8310	0.9116
0.2918	8.2903	514	0.8452	0.6931	0.8452	0.9194
0.2918	8.3226	516	0.8419	0.6931	0.8419	0.9176
0.2918	8.3548	518	0.8155	0.7174	0.8155	0.9030
0.2918	8.3871	520	0.7979	0.7208	0.7979	0.8933
0.2918	8.4194	522	0.7982	0.7321	0.7982	0.8934
0.2918	8.4516	524	0.7883	0.7489	0.7883	0.8879
0.2918	8.4839	526	0.7922	0.7321	0.7922	0.8900
0.2918	8.5161	528	0.7868	0.7489	0.7868	0.8870
0.2918	8.5484	530	0.7859	0.7489	0.7859	0.8865
0.2918	8.5806	532	0.7814	0.7489	0.7814	0.8839
0.2918	8.6129	534	0.7702	0.7489	0.7702	0.8776
0.2918	8.6452	536	0.7781	0.7489	0.7781	0.8821
0.2918	8.6774	538	0.7744	0.7489	0.7744	0.8800
0.2918	8.7097	540	0.7692	0.7489	0.7692	0.8771
0.2918	8.7419	542	0.7766	0.7489	0.7766	0.8812
0.2918	8.7742	544	0.7990	0.7489	0.7990	0.8939
0.2918	8.8065	546	0.8259	0.7276	0.8259	0.9088
0.2918	8.8387	548	0.8346	0.7341	0.8346	0.9136
0.2918	8.8710	550	0.8431	0.7160	0.8431	0.9182
0.2918	8.9032	552	0.8272	0.7276	0.8272	0.9095
0.2918	8.9355	554	0.7986	0.7559	0.7986	0.8936
0.2918	8.9677	556	0.7596	0.7559	0.7596	0.8715
0.2918	9.0	558	0.7236	0.7517	0.7236	0.8506
0.2918	9.0323	560	0.6907	0.7517	0.6907	0.8311
0.2918	9.0645	562	0.6700	0.7517	0.6700	0.8186
0.2918	9.0968	564	0.6530	0.7675	0.6530	0.8081
0.2918	9.1290	566	0.6470	0.7640	0.6470	0.8044
0.2918	9.1613	568	0.6436	0.7640	0.6436	0.8022
0.2918	9.1935	570	0.6413	0.7493	0.6413	0.8008
0.2918	9.2258	572	0.6466	0.7482	0.6466	0.8041
0.2918	9.2581	574	0.6546	0.7517	0.6546	0.8091
0.2918	9.2903	576	0.6681	0.7517	0.6681	0.8173
0.2918	9.3226	578	0.6869	0.7517	0.6869	0.8288
0.2918	9.3548	580	0.7053	0.7517	0.7053	0.8398
0.2918	9.3871	582	0.7259	0.7517	0.7259	0.8520
0.2918	9.4194	584	0.7381	0.7517	0.7381	0.8591
0.2918	9.4516	586	0.7474	0.7571	0.7474	0.8645
0.2918	9.4839	588	0.7536	0.7511	0.7536	0.8681
0.2918	9.5161	590	0.7585	0.7511	0.7585	0.8709
0.2918	9.5484	592	0.7671	0.7511	0.7671	0.8758
0.2918	9.5806	594	0.7692	0.7511	0.7692	0.8770
0.2918	9.6129	596	0.7720	0.7511	0.7720	0.8786
0.2918	9.6452	598	0.7713	0.7511	0.7713	0.8782
0.2918	9.6774	600	0.7709	0.7511	0.7709	0.8780
0.2918	9.7097	602	0.7736	0.7432	0.7736	0.8795
0.2918	9.7419	604	0.7780	0.7430	0.7780	0.8820
0.2918	9.7742	606	0.7797	0.7430	0.7797	0.8830
0.2918	9.8065	608	0.7811	0.7430	0.7811	0.8838
0.2918	9.8387	610	0.7797	0.7430	0.7797	0.8830
0.2918	9.8710	612	0.7793	0.7430	0.7793	0.8828
0.2918	9.9032	614	0.7781	0.7430	0.7781	0.8821
0.2918	9.9355	616	0.7763	0.7430	0.7763	0.8811
0.2918	9.9677	618	0.7751	0.7430	0.7751	0.8804
0.2918	10.0	620	0.7746	0.7430	0.7746	0.8801

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1