ArabicNewSplits5_FineTuningAraBERT_run3_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7746
• Qwk: 0.7430
• Mse: 0.7746
• Rmse: 0.8801

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.1919	0.0255	2.1919	1.4805
No log	0.0645	4	1.6490	0.0561	1.6490	1.2841
No log	0.0968	6	1.5166	0.1018	1.5166	1.2315
No log	0.1290	8	1.4912	0.1464	1.4912	1.2211
No log	0.1613	10	1.3829	0.1449	1.3829	1.1760
No log	0.1935	12	1.3646	0.1438	1.3646	1.1682
No log	0.2258	14	1.4976	0.2821	1.4976	1.2238
No log	0.2581	16	1.3723	0.2743	1.3723	1.1715
No log	0.2903	18	1.2658	0.2065	1.2658	1.1251
No log	0.3226	20	1.1838	0.2247	1.1838	1.0880
No log	0.3548	22	1.1696	0.3490	1.1696	1.0815
No log	0.3871	24	1.1846	0.3754	1.1846	1.0884
No log	0.4194	26	1.2413	0.3028	1.2413	1.1141
No log	0.4516	28	1.2916	0.2975	1.2916	1.1365
No log	0.4839	30	1.2846	0.2400	1.2846	1.1334
No log	0.5161	32	1.1503	0.3109	1.1503	1.0725
No log	0.5484	34	1.0413	0.4694	1.0413	1.0204
No log	0.5806	36	0.9803	0.5254	0.9803	0.9901
No log	0.6129	38	0.9647	0.5703	0.9647	0.9822
No log	0.6452	40	1.1834	0.3868	1.1834	1.0878
No log	0.6774	42	1.4879	0.3136	1.4879	1.2198
No log	0.7097	44	1.4178	0.3793	1.4178	1.1907
No log	0.7419	46	1.1030	0.4367	1.1030	1.0502
No log	0.7742	48	1.0259	0.4836	1.0259	1.0129
No log	0.8065	50	1.0362	0.4569	1.0362	1.0180
No log	0.8387	52	1.0366	0.4291	1.0366	1.0181
No log	0.8710	54	1.0267	0.4314	1.0267	1.0133
No log	0.9032	56	0.9985	0.4597	0.9985	0.9992
No log	0.9355	58	0.9668	0.4503	0.9668	0.9833
No log	0.9677	60	0.9512	0.4390	0.9512	0.9753
No log	1.0	62	0.9370	0.5042	0.9370	0.9680
No log	1.0323	64	0.9056	0.5120	0.9056	0.9516
No log	1.0645	66	0.8722	0.6022	0.8722	0.9339
No log	1.0968	68	0.8708	0.5893	0.8708	0.9332
No log	1.1290	70	1.0741	0.4871	1.0741	1.0364
No log	1.1613	72	1.1603	0.4439	1.1603	1.0772
No log	1.1935	74	0.9334	0.5486	0.9334	0.9661
No log	1.2258	76	0.7829	0.6517	0.7829	0.8848
No log	1.2581	78	0.7711	0.6511	0.7711	0.8781
No log	1.2903	80	0.7883	0.6181	0.7883	0.8879
No log	1.3226	82	0.7630	0.6517	0.7630	0.8735
No log	1.3548	84	0.9002	0.5806	0.9002	0.9488
No log	1.3871	86	1.0224	0.5509	1.0224	1.0111
No log	1.4194	88	0.9822	0.5716	0.9822	0.9911
No log	1.4516	90	0.8518	0.6401	0.8518	0.9229
No log	1.4839	92	0.8021	0.6380	0.8021	0.8956
No log	1.5161	94	0.8278	0.6390	0.8278	0.9098
No log	1.5484	96	0.9819	0.6244	0.9819	0.9909
No log	1.5806	98	1.1239	0.5988	1.1239	1.0601
No log	1.6129	100	1.0732	0.5988	1.0732	1.0359
No log	1.6452	102	1.1195	0.6111	1.1195	1.0581
No log	1.6774	104	1.3600	0.5521	1.3600	1.1662
No log	1.7097	106	1.3760	0.5547	1.3760	1.1730
No log	1.7419	108	1.1190	0.5884	1.1190	1.0578
No log	1.7742	110	0.8839	0.6648	0.8839	0.9402
No log	1.8065	112	0.8720	0.6617	0.8720	0.9338
No log	1.8387	114	1.0017	0.5992	1.0017	1.0008
No log	1.8710	116	1.1729	0.5735	1.1729	1.0830
No log	1.9032	118	1.1903	0.5683	1.1903	1.0910
No log	1.9355	120	1.0466	0.6116	1.0466	1.0230
No log	1.9677	122	0.8397	0.6436	0.8397	0.9164
No log	2.0	124	0.7929	0.6593	0.7929	0.8904
No log	2.0323	126	0.8287	0.6335	0.8287	0.9103
No log	2.0645	128	0.9424	0.6367	0.9424	0.9708
No log	2.0968	130	1.1177	0.5861	1.1177	1.0572
No log	2.1290	132	1.4171	0.5521	1.4171	1.1904
No log	2.1613	134	1.5267	0.5330	1.5267	1.2356
No log	2.1935	136	1.2838	0.5547	1.2838	1.1330
No log	2.2258	138	0.9062	0.6256	0.9062	0.9520
No log	2.2581	140	0.7742	0.6337	0.7742	0.8799
No log	2.2903	142	0.7600	0.6242	0.7600	0.8718
No log	2.3226	144	0.7744	0.6712	0.7744	0.8800
No log	2.3548	146	0.8972	0.6062	0.8972	0.9472
No log	2.3871	148	0.9924	0.5608	0.9924	0.9962
No log	2.4194	150	1.0939	0.5496	1.0939	1.0459
No log	2.4516	152	1.1055	0.5698	1.1055	1.0514
No log	2.4839	154	1.0023	0.6023	1.0023	1.0011
No log	2.5161	156	0.8403	0.6132	0.8403	0.9167
No log	2.5484	158	0.7522	0.6809	0.7522	0.8673
No log	2.5806	160	0.7356	0.6984	0.7356	0.8577
No log	2.6129	162	0.8131	0.6324	0.8131	0.9017
No log	2.6452	164	0.8588	0.6077	0.8588	0.9267
No log	2.6774	166	0.9464	0.6249	0.9464	0.9728
No log	2.7097	168	1.0114	0.6028	1.0114	1.0057
No log	2.7419	170	0.9207	0.6594	0.9207	0.9595
No log	2.7742	172	0.8095	0.6828	0.8095	0.8997
No log	2.8065	174	0.6948	0.7378	0.6948	0.8335
No log	2.8387	176	0.7033	0.7421	0.7033	0.8386
No log	2.8710	178	0.6918	0.7533	0.6918	0.8318
No log	2.9032	180	0.7313	0.7250	0.7313	0.8552
No log	2.9355	182	0.8483	0.6287	0.8483	0.9210
No log	2.9677	184	1.0806	0.5960	1.0806	1.0395
No log	3.0	186	1.1548	0.5869	1.1548	1.0746
No log	3.0323	188	1.0622	0.5937	1.0622	1.0306
No log	3.0645	190	0.9673	0.6020	0.9673	0.9835
No log	3.0968	192	0.8184	0.6977	0.8184	0.9046
No log	3.1290	194	0.7262	0.7326	0.7262	0.8522
No log	3.1613	196	0.6930	0.7249	0.6930	0.8325
No log	3.1935	198	0.6919	0.7146	0.6919	0.8318
No log	3.2258	200	0.7677	0.6874	0.7677	0.8762
No log	3.2581	202	0.8437	0.6867	0.8437	0.9186
No log	3.2903	204	0.9586	0.6460	0.9586	0.9791
No log	3.3226	206	1.0910	0.5828	1.0910	1.0445
No log	3.3548	208	1.0786	0.5629	1.0786	1.0386
No log	3.3871	210	1.1103	0.5493	1.1103	1.0537
No log	3.4194	212	1.0700	0.5530	1.0700	1.0344
No log	3.4516	214	1.0330	0.5684	1.0330	1.0164
No log	3.4839	216	0.9527	0.6031	0.9527	0.9761
No log	3.5161	218	0.9377	0.5957	0.9377	0.9684
No log	3.5484	220	0.9058	0.6349	0.9058	0.9517
No log	3.5806	222	0.8748	0.6579	0.8748	0.9353
No log	3.6129	224	0.8446	0.6697	0.8446	0.9190
No log	3.6452	226	0.8553	0.6898	0.8553	0.9248
No log	3.6774	228	0.7955	0.6924	0.7955	0.8919
No log	3.7097	230	0.7415	0.7041	0.7415	0.8611
No log	3.7419	232	0.7235	0.6904	0.7235	0.8506
No log	3.7742	234	0.7477	0.6894	0.7477	0.8647
No log	3.8065	236	0.7918	0.6640	0.7918	0.8898
No log	3.8387	238	0.8514	0.6688	0.8514	0.9227
No log	3.8710	240	0.9389	0.6409	0.9389	0.9690
No log	3.9032	242	1.0202	0.6082	1.0202	1.0101
No log	3.9355	244	0.9997	0.6374	0.9997	0.9999
No log	3.9677	246	0.9511	0.6047	0.9511	0.9753
No log	4.0	248	0.8816	0.6444	0.8816	0.9389
No log	4.0323	250	0.7693	0.6552	0.7693	0.8771
No log	4.0645	252	0.7355	0.6667	0.7355	0.8576
No log	4.0968	254	0.7662	0.6744	0.7662	0.8753
No log	4.1290	256	0.8036	0.6787	0.8036	0.8964
No log	4.1613	258	0.7985	0.6932	0.7985	0.8936
No log	4.1935	260	0.8822	0.6858	0.8822	0.9392
No log	4.2258	262	0.9581	0.6513	0.9581	0.9788
No log	4.2581	264	0.9431	0.6640	0.9431	0.9711
No log	4.2903	266	0.8646	0.6832	0.8646	0.9298
No log	4.3226	268	0.7796	0.7017	0.7796	0.8830
No log	4.3548	270	0.7690	0.7113	0.7690	0.8769
No log	4.3871	272	0.8607	0.6597	0.8607	0.9278
No log	4.4194	274	1.0336	0.6642	1.0336	1.0166
No log	4.4516	276	1.2656	0.5872	1.2656	1.1250
No log	4.4839	278	1.3061	0.5885	1.3061	1.1428
No log	4.5161	280	1.2291	0.5780	1.2291	1.1086
No log	4.5484	282	1.1182	0.5946	1.1182	1.0575
No log	4.5806	284	1.0473	0.6094	1.0473	1.0234
No log	4.6129	286	1.0059	0.6249	1.0059	1.0029
No log	4.6452	288	1.0411	0.6236	1.0411	1.0203
No log	4.6774	290	1.0084	0.6434	1.0084	1.0042
No log	4.7097	292	0.9154	0.6722	0.9154	0.9568
No log	4.7419	294	0.9041	0.6655	0.9041	0.9509
No log	4.7742	296	0.9730	0.6167	0.9730	0.9864
No log	4.8065	298	1.0103	0.5712	1.0103	1.0051
No log	4.8387	300	0.9814	0.5821	0.9814	0.9906
No log	4.8710	302	0.9895	0.5734	0.9895	0.9947
No log	4.9032	304	1.0246	0.5438	1.0246	1.0122
No log	4.9355	306	1.0788	0.5671	1.0788	1.0386
No log	4.9677	308	1.0654	0.5942	1.0654	1.0322
No log	5.0	310	0.9875	0.6167	0.9875	0.9938
No log	5.0323	312	0.9143	0.6808	0.9143	0.9562
No log	5.0645	314	0.9569	0.6509	0.9569	0.9782
No log	5.0968	316	0.9786	0.6609	0.9786	0.9892
No log	5.1290	318	0.9129	0.6811	0.9129	0.9555
No log	5.1613	320	0.8025	0.7165	0.8025	0.8958
No log	5.1935	322	0.7426	0.7195	0.7426	0.8617
No log	5.2258	324	0.7234	0.7160	0.7234	0.8505
No log	5.2581	326	0.7704	0.7146	0.7704	0.8777
No log	5.2903	328	0.8566	0.7015	0.8566	0.9256
No log	5.3226	330	0.9242	0.6561	0.9242	0.9614
No log	5.3548	332	0.9833	0.6342	0.9833	0.9916
No log	5.3871	334	1.0416	0.6032	1.0416	1.0206
No log	5.4194	336	1.0192	0.6324	1.0192	1.0096
No log	5.4516	338	1.0376	0.6221	1.0376	1.0186
No log	5.4839	340	1.0423	0.6221	1.0423	1.0209
No log	5.5161	342	1.0520	0.6235	1.0520	1.0257
No log	5.5484	344	1.0565	0.6409	1.0565	1.0279
No log	5.5806	346	1.0705	0.6409	1.0705	1.0346
No log	5.6129	348	1.0707	0.6435	1.0707	1.0348
No log	5.6452	350	0.9780	0.6457	0.9780	0.9889
No log	5.6774	352	0.8300	0.6518	0.8300	0.9110
No log	5.7097	354	0.6984	0.7033	0.6984	0.8357
No log	5.7419	356	0.6593	0.7185	0.6593	0.8120
No log	5.7742	358	0.6398	0.7200	0.6398	0.7999
No log	5.8065	360	0.6558	0.7054	0.6558	0.8098
No log	5.8387	362	0.7245	0.7155	0.7245	0.8512
No log	5.8710	364	0.8443	0.7262	0.8443	0.9189
No log	5.9032	366	0.9267	0.6901	0.9267	0.9626
No log	5.9355	368	0.9550	0.6811	0.9550	0.9772
No log	5.9677	370	0.9089	0.6821	0.9089	0.9534
No log	6.0	372	0.8397	0.7184	0.8397	0.9164
No log	6.0323	374	0.7657	0.7152	0.7657	0.8750
No log	6.0645	376	0.7348	0.7093	0.7348	0.8572
No log	6.0968	378	0.7376	0.7159	0.7376	0.8588
No log	6.1290	380	0.7762	0.7188	0.7762	0.8810
No log	6.1613	382	0.8189	0.7122	0.8189	0.9049
No log	6.1935	384	0.8152	0.7039	0.8152	0.9029
No log	6.2258	386	0.8073	0.7066	0.8073	0.8985
No log	6.2581	388	0.7785	0.7330	0.7785	0.8823
No log	6.2903	390	0.7938	0.7289	0.7938	0.8909
No log	6.3226	392	0.8221	0.7119	0.8221	0.9067
No log	6.3548	394	0.8181	0.7119	0.8181	0.9045
No log	6.3871	396	0.8083	0.7119	0.8083	0.8991
No log	6.4194	398	0.7854	0.7200	0.7854	0.8862
No log	6.4516	400	0.8078	0.7119	0.8078	0.8988
No log	6.4839	402	0.8479	0.7229	0.8479	0.9208
No log	6.5161	404	0.8431	0.7174	0.8431	0.9182
No log	6.5484	406	0.8598	0.7096	0.8598	0.9272
No log	6.5806	408	0.8554	0.7127	0.8554	0.9249
No log	6.6129	410	0.8358	0.7127	0.8358	0.9142
No log	6.6452	412	0.8295	0.7229	0.8295	0.9108
No log	6.6774	414	0.8334	0.7229	0.8334	0.9129
No log	6.7097	416	0.8624	0.7303	0.8624	0.9287
No log	6.7419	418	0.9205	0.7122	0.9205	0.9594
No log	6.7742	420	0.9303	0.7062	0.9303	0.9645
No log	6.8065	422	0.9194	0.7047	0.9194	0.9588
No log	6.8387	424	0.9231	0.7138	0.9231	0.9608
No log	6.8710	426	0.8668	0.7176	0.8668	0.9310
No log	6.9032	428	0.7790	0.7281	0.7790	0.8826
No log	6.9355	430	0.7056	0.7363	0.7056	0.8400
No log	6.9677	432	0.6780	0.7363	0.6780	0.8234
No log	7.0	434	0.6715	0.7363	0.6715	0.8195
No log	7.0323	436	0.6880	0.7489	0.6880	0.8295
No log	7.0645	438	0.7193	0.7489	0.7193	0.8481
No log	7.0968	440	0.7505	0.7541	0.7505	0.8663
No log	7.1290	442	0.7543	0.7541	0.7543	0.8685
No log	7.1613	444	0.7472	0.7541	0.7472	0.8644
No log	7.1935	446	0.7156	0.7489	0.7156	0.8459
No log	7.2258	448	0.7090	0.7489	0.7090	0.8420
No log	7.2581	450	0.7004	0.7489	0.7004	0.8369
No log	7.2903	452	0.6826	0.7492	0.6826	0.8262
No log	7.3226	454	0.6839	0.7571	0.6839	0.8270
No log	7.3548	456	0.6712	0.7571	0.6712	0.8193
No log	7.3871	458	0.6587	0.7517	0.6587	0.8116
No log	7.4194	460	0.6770	0.7571	0.6770	0.8228
No log	7.4516	462	0.7123	0.7571	0.7123	0.8440
No log	7.4839	464	0.7509	0.7467	0.7509	0.8665
No log	7.5161	466	0.7542	0.7428	0.7542	0.8685
No log	7.5484	468	0.7306	0.7546	0.7306	0.8547
No log	7.5806	470	0.7039	0.7517	0.7039	0.8390
No log	7.6129	472	0.6732	0.7366	0.6732	0.8205
No log	7.6452	474	0.6667	0.7206	0.6667	0.8165
No log	7.6774	476	0.6634	0.7443	0.6634	0.8145
No log	7.7097	478	0.6729	0.7517	0.6729	0.8203
No log	7.7419	480	0.7024	0.7517	0.7024	0.8381
No log	7.7742	482	0.7512	0.7390	0.7512	0.8667
No log	7.8065	484	0.8117	0.7303	0.8117	0.9010
No log	7.8387	486	0.8645	0.6931	0.8645	0.9298
No log	7.8710	488	0.8829	0.7044	0.8829	0.9396
No log	7.9032	490	0.8517	0.6931	0.8517	0.9229
No log	7.9355	492	0.8070	0.7303	0.8070	0.8983
No log	7.9677	494	0.7577	0.7436	0.7577	0.8705
No log	8.0	496	0.7017	0.7436	0.7017	0.8377
No log	8.0323	498	0.6554	0.7407	0.6554	0.8096
0.2918	8.0645	500	0.6418	0.7316	0.6418	0.8012
0.2918	8.0968	502	0.6487	0.7316	0.6487	0.8054
0.2918	8.1290	504	0.6741	0.7330	0.6741	0.8210
0.2918	8.1613	506	0.7165	0.7436	0.7165	0.8465
0.2918	8.1935	508	0.7633	0.7489	0.7633	0.8737
0.2918	8.2258	510	0.7982	0.7343	0.7982	0.8934
0.2918	8.2581	512	0.8309	0.7084	0.8309	0.9115
0.2918	8.2903	514	0.8447	0.6931	0.8447	0.9191
0.2918	8.3226	516	0.8411	0.6931	0.8411	0.9171
0.2918	8.3548	518	0.8145	0.7174	0.8145	0.9025
0.2918	8.3871	520	0.7967	0.7375	0.7967	0.8926
0.2918	8.4194	522	0.7969	0.7321	0.7969	0.8927
0.2918	8.4516	524	0.7871	0.7489	0.7871	0.8872
0.2918	8.4839	526	0.7911	0.7321	0.7911	0.8895
0.2918	8.5161	528	0.7860	0.7489	0.7860	0.8866
0.2918	8.5484	530	0.7855	0.7489	0.7855	0.8863
0.2918	8.5806	532	0.7816	0.7489	0.7816	0.8841
0.2918	8.6129	534	0.7711	0.7489	0.7711	0.8781
0.2918	8.6452	536	0.7792	0.7489	0.7792	0.8828
0.2918	8.6774	538	0.7755	0.7489	0.7755	0.8807
0.2918	8.7097	540	0.7703	0.7489	0.7703	0.8777
0.2918	8.7419	542	0.7774	0.7489	0.7774	0.8817
0.2918	8.7742	544	0.7997	0.7489	0.7997	0.8943
0.2918	8.8065	546	0.8263	0.7276	0.8263	0.9090
0.2918	8.8387	548	0.8346	0.7341	0.8346	0.9136
0.2918	8.8710	550	0.8428	0.7160	0.8428	0.9180
0.2918	8.9032	552	0.8267	0.7276	0.8267	0.9092
0.2918	8.9355	554	0.7980	0.7559	0.7980	0.8933
0.2918	8.9677	556	0.7590	0.7489	0.7590	0.8712
0.2918	9.0	558	0.7232	0.7517	0.7232	0.8504
0.2918	9.0323	560	0.6904	0.7517	0.6904	0.8309
0.2918	9.0645	562	0.6698	0.7517	0.6698	0.8184
0.2918	9.0968	564	0.6528	0.7640	0.6528	0.8080
0.2918	9.1290	566	0.6469	0.7640	0.6469	0.8043
0.2918	9.1613	568	0.6435	0.7640	0.6435	0.8022
0.2918	9.1935	570	0.6414	0.7493	0.6414	0.8008
0.2918	9.2258	572	0.6467	0.7482	0.6467	0.8042
0.2918	9.2581	574	0.6548	0.7517	0.6548	0.8092
0.2918	9.2903	576	0.6684	0.7517	0.6684	0.8176
0.2918	9.3226	578	0.6874	0.7517	0.6874	0.8291
0.2918	9.3548	580	0.7059	0.7517	0.7059	0.8402
0.2918	9.3871	582	0.7266	0.7517	0.7266	0.8524
0.2918	9.4194	584	0.7388	0.7571	0.7388	0.8595
0.2918	9.4516	586	0.7479	0.7571	0.7479	0.8648
0.2918	9.4839	588	0.7540	0.7511	0.7540	0.8683
0.2918	9.5161	590	0.7588	0.7511	0.7588	0.8711
0.2918	9.5484	592	0.7673	0.7511	0.7673	0.8759
0.2918	9.5806	594	0.7693	0.7511	0.7693	0.8771
0.2918	9.6129	596	0.7720	0.7511	0.7720	0.8787
0.2918	9.6452	598	0.7713	0.7511	0.7713	0.8782
0.2918	9.6774	600	0.7708	0.7511	0.7708	0.8779
0.2918	9.7097	602	0.7735	0.7432	0.7735	0.8795
0.2918	9.7419	604	0.7778	0.7430	0.7778	0.8820
0.2918	9.7742	606	0.7796	0.7430	0.7796	0.8829
0.2918	9.8065	608	0.7810	0.7430	0.7810	0.8838
0.2918	9.8387	610	0.7797	0.7430	0.7797	0.8830
0.2918	9.8710	612	0.7792	0.7430	0.7792	0.8827
0.2918	9.9032	614	0.7780	0.7430	0.7780	0.8821
0.2918	9.9355	616	0.7762	0.7430	0.7762	0.8810
0.2918	9.9677	618	0.7750	0.7430	0.7750	0.8804
0.2918	10.0	620	0.7746	0.7430	0.7746	0.8801

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1