ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8772
• Qwk: 0.6168
• Mse: 0.8772
• Rmse: 0.9366

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	5.3378	-0.0193	5.3378	2.3104
No log	0.0727	4	3.1438	0.0658	3.1438	1.7731
No log	0.1091	6	2.1845	-0.0026	2.1845	1.4780
No log	0.1455	8	1.8954	0.0264	1.8954	1.3767
No log	0.1818	10	1.5932	0.0320	1.5932	1.2622
No log	0.2182	12	1.6351	0.0341	1.6351	1.2787
No log	0.2545	14	1.2982	0.1700	1.2982	1.1394
No log	0.2909	16	1.1822	0.1445	1.1822	1.0873
No log	0.3273	18	1.2004	0.1681	1.2004	1.0956
No log	0.3636	20	1.1309	0.1740	1.1309	1.0634
No log	0.4	22	1.0880	0.3202	1.0880	1.0431
No log	0.4364	24	1.1461	0.3439	1.1461	1.0706
No log	0.4727	26	1.2337	0.2441	1.2337	1.1107
No log	0.5091	28	1.1821	0.3585	1.1821	1.0872
No log	0.5455	30	1.1893	0.3772	1.1893	1.0906
No log	0.5818	32	1.1561	0.3553	1.1561	1.0752
No log	0.6182	34	1.1913	0.3968	1.1913	1.0915
No log	0.6545	36	1.5611	0.3307	1.5611	1.2494
No log	0.6909	38	1.4818	0.3669	1.4818	1.2173
No log	0.7273	40	1.2579	0.4120	1.2579	1.1215
No log	0.7636	42	1.1256	0.3985	1.1256	1.0610
No log	0.8	44	1.0745	0.3442	1.0745	1.0366
No log	0.8364	46	1.1252	0.2734	1.1252	1.0607
No log	0.8727	48	1.1070	0.3666	1.1070	1.0522
No log	0.9091	50	1.0127	0.3547	1.0127	1.0063
No log	0.9455	52	1.0945	0.4003	1.0945	1.0462
No log	0.9818	54	1.2330	0.3607	1.2330	1.1104
No log	1.0182	56	1.5958	0.2245	1.5958	1.2632
No log	1.0545	58	1.6905	0.2437	1.6905	1.3002
No log	1.0909	60	1.7993	0.2399	1.7993	1.3414
No log	1.1273	62	1.4669	0.2754	1.4669	1.2111
No log	1.1636	64	1.0585	0.4306	1.0585	1.0288
No log	1.2	66	0.9545	0.4208	0.9545	0.9770
No log	1.2364	68	0.9726	0.4040	0.9726	0.9862
No log	1.2727	70	0.9553	0.4073	0.9553	0.9774
No log	1.3091	72	0.9131	0.4177	0.9131	0.9556
No log	1.3455	74	0.9002	0.4528	0.9002	0.9488
No log	1.3818	76	0.8594	0.4799	0.8594	0.9270
No log	1.4182	78	0.8258	0.5117	0.8258	0.9088
No log	1.4545	80	0.9147	0.4892	0.9147	0.9564
No log	1.4909	82	1.0884	0.3634	1.0884	1.0433
No log	1.5273	84	1.0696	0.3879	1.0696	1.0342
No log	1.5636	86	0.9266	0.5002	0.9266	0.9626
No log	1.6	88	0.8471	0.5418	0.8471	0.9204
No log	1.6364	90	0.9581	0.5079	0.9581	0.9789
No log	1.6727	92	0.9742	0.5246	0.9742	0.9870
No log	1.7091	94	0.8563	0.6092	0.8563	0.9254
No log	1.7455	96	0.7725	0.6331	0.7725	0.8789
No log	1.7818	98	0.7247	0.6202	0.7247	0.8513
No log	1.8182	100	0.7117	0.6387	0.7117	0.8436
No log	1.8545	102	0.7059	0.6438	0.7059	0.8402
No log	1.8909	104	0.7059	0.6493	0.7059	0.8402
No log	1.9273	106	0.7434	0.6196	0.7434	0.8622
No log	1.9636	108	0.8196	0.6143	0.8196	0.9053
No log	2.0	110	0.8285	0.6059	0.8285	0.9102
No log	2.0364	112	0.7707	0.5534	0.7707	0.8779
No log	2.0727	114	0.7586	0.5259	0.7586	0.8710
No log	2.1091	116	0.8539	0.5151	0.8539	0.9241
No log	2.1455	118	0.9317	0.5687	0.9317	0.9653
No log	2.1818	120	0.9410	0.6201	0.9410	0.9701
No log	2.2182	122	0.8892	0.5937	0.8892	0.9430
No log	2.2545	124	0.8410	0.5873	0.8410	0.9170
No log	2.2909	126	0.8414	0.6028	0.8414	0.9173
No log	2.3273	128	0.8523	0.5727	0.8523	0.9232
No log	2.3636	130	0.9077	0.5841	0.9077	0.9527
No log	2.4	132	0.9911	0.5354	0.9911	0.9955
No log	2.4364	134	1.0162	0.5302	1.0162	1.0081
No log	2.4727	136	0.9816	0.5302	0.9816	0.9908
No log	2.5091	138	0.9414	0.5456	0.9414	0.9702
No log	2.5455	140	0.8831	0.6093	0.8831	0.9398
No log	2.5818	142	0.8606	0.5448	0.8606	0.9277
No log	2.6182	144	0.8385	0.5568	0.8385	0.9157
No log	2.6545	146	0.8026	0.6249	0.8026	0.8959
No log	2.6909	148	0.7972	0.6606	0.7972	0.8928
No log	2.7273	150	0.7637	0.6467	0.7637	0.8739
No log	2.7636	152	0.7405	0.6663	0.7405	0.8605
No log	2.8	154	0.7668	0.6366	0.7668	0.8757
No log	2.8364	156	0.8604	0.6125	0.8604	0.9276
No log	2.8727	158	0.9291	0.5961	0.9291	0.9639
No log	2.9091	160	0.8871	0.6204	0.8871	0.9419
No log	2.9455	162	0.8487	0.6093	0.8487	0.9212
No log	2.9818	164	0.7691	0.6475	0.7691	0.8770
No log	3.0182	166	0.7192	0.6861	0.7192	0.8480
No log	3.0545	168	0.7072	0.7198	0.7072	0.8410
No log	3.0909	170	0.7223	0.7146	0.7223	0.8499
No log	3.1273	172	0.7703	0.6595	0.7703	0.8777
No log	3.1636	174	0.8139	0.6187	0.8139	0.9022
No log	3.2	176	0.8317	0.6051	0.8317	0.9120
No log	3.2364	178	0.8828	0.6061	0.8828	0.9396
No log	3.2727	180	0.8817	0.6054	0.8817	0.9390
No log	3.3091	182	0.8642	0.5955	0.8642	0.9296
No log	3.3455	184	0.8422	0.6269	0.8422	0.9177
No log	3.3818	186	0.8558	0.6397	0.8558	0.9251
No log	3.4182	188	0.8877	0.6397	0.8877	0.9422
No log	3.4545	190	0.9604	0.6067	0.9604	0.9800
No log	3.4909	192	1.0654	0.5674	1.0654	1.0322
No log	3.5273	194	1.0699	0.5742	1.0699	1.0344
No log	3.5636	196	0.9917	0.5785	0.9917	0.9958
No log	3.6	198	0.8423	0.6142	0.8423	0.9178
No log	3.6364	200	0.7247	0.6566	0.7247	0.8513
No log	3.6727	202	0.7047	0.6475	0.7047	0.8395
No log	3.7091	204	0.7028	0.6623	0.7028	0.8383
No log	3.7455	206	0.7296	0.6338	0.7296	0.8542
No log	3.7818	208	0.7218	0.6636	0.7218	0.8496
No log	3.8182	210	0.7747	0.6487	0.7747	0.8802
No log	3.8545	212	0.8372	0.6082	0.8372	0.9150
No log	3.8909	214	0.9235	0.5710	0.9235	0.9610
No log	3.9273	216	0.9890	0.5556	0.9890	0.9945
No log	3.9636	218	0.9660	0.5656	0.9660	0.9829
No log	4.0	220	0.8642	0.5705	0.8642	0.9296
No log	4.0364	222	0.7626	0.6482	0.7626	0.8733
No log	4.0727	224	0.7227	0.6804	0.7227	0.8501
No log	4.1091	226	0.7138	0.6846	0.7138	0.8449
No log	4.1455	228	0.7303	0.6827	0.7303	0.8546
No log	4.1818	230	0.7413	0.6575	0.7413	0.8610
No log	4.2182	232	0.7792	0.6473	0.7792	0.8827
No log	4.2545	234	0.8363	0.5973	0.8363	0.9145
No log	4.2909	236	0.8941	0.5893	0.8941	0.9456
No log	4.3273	238	0.9843	0.5774	0.9843	0.9921
No log	4.3636	240	0.9917	0.5721	0.9917	0.9958
No log	4.4	242	0.8870	0.5785	0.8870	0.9418
No log	4.4364	244	0.7893	0.6575	0.7893	0.8885
No log	4.4727	246	0.7449	0.6671	0.7449	0.8631
No log	4.5091	248	0.7378	0.6747	0.7378	0.8589
No log	4.5455	250	0.7478	0.6663	0.7478	0.8647
No log	4.5818	252	0.8051	0.6500	0.8051	0.8973
No log	4.6182	254	0.8476	0.6151	0.8476	0.9206
No log	4.6545	256	0.9069	0.5698	0.9069	0.9523
No log	4.6909	258	0.9463	0.5998	0.9463	0.9728
No log	4.7273	260	0.9908	0.6104	0.9908	0.9954
No log	4.7636	262	1.0491	0.5777	1.0491	1.0243
No log	4.8	264	1.1351	0.5483	1.1351	1.0654
No log	4.8364	266	1.2018	0.5222	1.2018	1.0962
No log	4.8727	268	1.2209	0.5252	1.2209	1.1049
No log	4.9091	270	1.2027	0.5286	1.2027	1.0967
No log	4.9455	272	1.1323	0.5390	1.1323	1.0641
No log	4.9818	274	1.0284	0.5495	1.0284	1.0141
No log	5.0182	276	0.9071	0.5944	0.9071	0.9524
No log	5.0545	278	0.8279	0.6767	0.8279	0.9099
No log	5.0909	280	0.7770	0.6562	0.7770	0.8815
No log	5.1273	282	0.7601	0.6456	0.7601	0.8719
No log	5.1636	284	0.7688	0.6571	0.7688	0.8768
No log	5.2	286	0.7926	0.6361	0.7926	0.8903
No log	5.2364	288	0.8442	0.6242	0.8442	0.9188
No log	5.2727	290	0.9090	0.5739	0.9090	0.9534
No log	5.3091	292	0.9183	0.5762	0.9183	0.9583
No log	5.3455	294	0.8796	0.6225	0.8796	0.9379
No log	5.3818	296	0.8553	0.6067	0.8553	0.9248
No log	5.4182	298	0.8597	0.6058	0.8597	0.9272
No log	5.4545	300	0.8444	0.6094	0.8444	0.9189
No log	5.4909	302	0.8670	0.5926	0.8670	0.9311
No log	5.5273	304	0.8743	0.5912	0.8743	0.9350
No log	5.5636	306	0.8985	0.5678	0.8985	0.9479
No log	5.6	308	0.8884	0.5718	0.8884	0.9426
No log	5.6364	310	0.8576	0.5780	0.8576	0.9261
No log	5.6727	312	0.8199	0.5768	0.8199	0.9055
No log	5.7091	314	0.7870	0.5974	0.7870	0.8871
No log	5.7455	316	0.8109	0.5919	0.8109	0.9005
No log	5.7818	318	0.8449	0.5768	0.8449	0.9192
No log	5.8182	320	0.8973	0.5706	0.8973	0.9473
No log	5.8545	322	0.9126	0.5617	0.9126	0.9553
No log	5.8909	324	0.8525	0.5733	0.8525	0.9233
No log	5.9273	326	0.7959	0.6110	0.7959	0.8921
No log	5.9636	328	0.7869	0.6246	0.7869	0.8871
No log	6.0	330	0.8073	0.6071	0.8073	0.8985
No log	6.0364	332	0.8212	0.6043	0.8212	0.9062
No log	6.0727	334	0.8375	0.6068	0.8375	0.9151
No log	6.1091	336	0.8494	0.6224	0.8494	0.9216
No log	6.1455	338	0.8509	0.6210	0.8509	0.9224
No log	6.1818	340	0.8512	0.6114	0.8512	0.9226
No log	6.2182	342	0.8826	0.6056	0.8826	0.9394
No log	6.2545	344	0.9362	0.5969	0.9362	0.9676
No log	6.2909	346	0.9534	0.5956	0.9534	0.9764
No log	6.3273	348	0.9465	0.5874	0.9465	0.9729
No log	6.3636	350	0.9037	0.5837	0.9037	0.9506
No log	6.4	352	0.8743	0.5958	0.8743	0.9350
No log	6.4364	354	0.8651	0.6059	0.8651	0.9301
No log	6.4727	356	0.8710	0.6059	0.8710	0.9333
No log	6.5091	358	0.8614	0.6073	0.8614	0.9281
No log	6.5455	360	0.8726	0.6107	0.8726	0.9341
No log	6.5818	362	0.8832	0.5932	0.8832	0.9398
No log	6.6182	364	0.8850	0.5797	0.8850	0.9407
No log	6.6545	366	0.8857	0.5932	0.8857	0.9411
No log	6.6909	368	0.8621	0.6073	0.8621	0.9285
No log	6.7273	370	0.8575	0.6063	0.8575	0.9260
No log	6.7636	372	0.8724	0.6045	0.8724	0.9340
No log	6.8	374	0.8842	0.5923	0.8842	0.9403
No log	6.8364	376	0.8872	0.5923	0.8872	0.9419
No log	6.8727	378	0.8821	0.5910	0.8821	0.9392
No log	6.9091	380	0.8725	0.5923	0.8725	0.9341
No log	6.9455	382	0.8732	0.6002	0.8732	0.9344
No log	6.9818	384	0.8446	0.6235	0.8446	0.9190
No log	7.0182	386	0.8284	0.6273	0.8284	0.9102
No log	7.0545	388	0.8250	0.6244	0.8250	0.9083
No log	7.0909	390	0.8124	0.6238	0.8124	0.9014
No log	7.1273	392	0.7891	0.6381	0.7891	0.8883
No log	7.1636	394	0.7721	0.6201	0.7721	0.8787
No log	7.2	396	0.7939	0.6370	0.7939	0.8910
No log	7.2364	398	0.8467	0.6403	0.8467	0.9202
No log	7.2727	400	0.8908	0.6381	0.8908	0.9438
No log	7.3091	402	0.9031	0.6094	0.9031	0.9503
No log	7.3455	404	0.9296	0.6094	0.9296	0.9642
No log	7.3818	406	0.9277	0.6123	0.9277	0.9632
No log	7.4182	408	0.9003	0.6136	0.9003	0.9489
No log	7.4545	410	0.8961	0.6144	0.8961	0.9466
No log	7.4909	412	0.9108	0.6233	0.9108	0.9544
No log	7.5273	414	0.9012	0.6276	0.9012	0.9493
No log	7.5636	416	0.9124	0.6288	0.9124	0.9552
No log	7.6	418	0.9280	0.6223	0.9280	0.9633
No log	7.6364	420	0.9197	0.5999	0.9197	0.9590
No log	7.6727	422	0.9069	0.6050	0.9069	0.9523
No log	7.7091	424	0.8909	0.5976	0.8909	0.9439
No log	7.7455	426	0.8760	0.5840	0.8760	0.9360
No log	7.7818	428	0.8550	0.5979	0.8550	0.9246
No log	7.8182	430	0.8345	0.6186	0.8345	0.9135
No log	7.8545	432	0.8319	0.6039	0.8319	0.9121
No log	7.8909	434	0.8310	0.5948	0.8310	0.9116
No log	7.9273	436	0.8516	0.5990	0.8516	0.9228
No log	7.9636	438	0.8985	0.5830	0.8985	0.9479
No log	8.0	440	0.9537	0.5658	0.9537	0.9766
No log	8.0364	442	0.9717	0.5879	0.9717	0.9858
No log	8.0727	444	0.9635	0.5881	0.9635	0.9816
No log	8.1091	446	0.9578	0.6155	0.9578	0.9787
No log	8.1455	448	0.9463	0.6132	0.9463	0.9728
No log	8.1818	450	0.9420	0.5888	0.9420	0.9706
No log	8.2182	452	0.9504	0.5749	0.9504	0.9749
No log	8.2545	454	0.9522	0.5679	0.9522	0.9758
No log	8.2909	456	0.9507	0.5580	0.9507	0.9750
No log	8.3273	458	0.9482	0.5429	0.9482	0.9738
No log	8.3636	460	0.9506	0.5440	0.9506	0.9750
No log	8.4	462	0.9425	0.5544	0.9425	0.9708
No log	8.4364	464	0.9298	0.5544	0.9298	0.9643
No log	8.4727	466	0.9094	0.5544	0.9094	0.9536
No log	8.5091	468	0.8880	0.5544	0.8880	0.9423
No log	8.5455	470	0.8596	0.5582	0.8596	0.9272
No log	8.5818	472	0.8496	0.6036	0.8496	0.9218
No log	8.6182	474	0.8444	0.6339	0.8444	0.9189
No log	8.6545	476	0.8556	0.6345	0.8556	0.9250
No log	8.6909	478	0.8832	0.6079	0.8832	0.9398
No log	8.7273	480	0.9227	0.6076	0.9227	0.9606
No log	8.7636	482	0.9452	0.6037	0.9452	0.9722
No log	8.8	484	0.9367	0.6149	0.9367	0.9678
No log	8.8364	486	0.9174	0.6162	0.9174	0.9578
No log	8.8727	488	0.8943	0.6175	0.8943	0.9457
No log	8.9091	490	0.8665	0.6079	0.8665	0.9309
No log	8.9455	492	0.8456	0.6391	0.8456	0.9195
No log	8.9818	494	0.8412	0.6406	0.8412	0.9172
No log	9.0182	496	0.8365	0.6406	0.8365	0.9146
No log	9.0545	498	0.8460	0.6473	0.8460	0.9198
0.4503	9.0909	500	0.8634	0.6345	0.8634	0.9292
0.4503	9.1273	502	0.8833	0.6003	0.8833	0.9398
0.4503	9.1636	504	0.8939	0.5917	0.8939	0.9454
0.4503	9.2	506	0.8961	0.5917	0.8961	0.9466
0.4503	9.2364	508	0.8996	0.5917	0.8996	0.9485
0.4503	9.2727	510	0.8877	0.5917	0.8877	0.9422
0.4503	9.3091	512	0.8760	0.6092	0.8760	0.9360
0.4503	9.3455	514	0.8682	0.6187	0.8682	0.9317
0.4503	9.3818	516	0.8645	0.6187	0.8645	0.9298
0.4503	9.4182	518	0.8627	0.6187	0.8627	0.9288
0.4503	9.4545	520	0.8652	0.6187	0.8652	0.9302
0.4503	9.4909	522	0.8670	0.6142	0.8670	0.9311
0.4503	9.5273	524	0.8613	0.6142	0.8613	0.9281
0.4503	9.5636	526	0.8553	0.6218	0.8553	0.9248
0.4503	9.6	528	0.8558	0.6263	0.8558	0.9251
0.4503	9.6364	530	0.8600	0.6168	0.8600	0.9274
0.4503	9.6727	532	0.8645	0.6168	0.8645	0.9298
0.4503	9.7091	534	0.8702	0.6168	0.8702	0.9329
0.4503	9.7455	536	0.8749	0.6168	0.8749	0.9354
0.4503	9.7818	538	0.8766	0.6168	0.8766	0.9363
0.4503	9.8182	540	0.8759	0.6168	0.8759	0.9359
0.4503	9.8545	542	0.8766	0.6168	0.8766	0.9363
0.4503	9.8909	544	0.8759	0.6168	0.8759	0.9359
0.4503	9.9273	546	0.8766	0.6168	0.8766	0.9363
0.4503	9.9636	548	0.8769	0.6168	0.8769	0.9365
0.4503	10.0	550	0.8772	0.6168	0.8772	0.9366

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1