ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8332
• Qwk: 0.6818
• Mse: 0.8332
• Rmse: 0.9128

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	2.2879	-0.0109	2.2879	1.5126
No log	0.0727	4	1.6532	0.0825	1.6532	1.2858
No log	0.1091	6	1.6080	0.1857	1.6080	1.2681
No log	0.1455	8	1.6449	0.2394	1.6449	1.2825
No log	0.1818	10	1.4787	0.3169	1.4787	1.2160
No log	0.2182	12	1.3871	0.3169	1.3871	1.1778
No log	0.2545	14	1.4342	0.3230	1.4342	1.1976
No log	0.2909	16	1.3537	0.2768	1.3537	1.1635
No log	0.3273	18	1.3268	0.2116	1.3268	1.1519
No log	0.3636	20	1.3485	0.1939	1.3485	1.1613
No log	0.4	22	1.4362	0.3091	1.4362	1.1984
No log	0.4364	24	1.5002	0.3065	1.5002	1.2248
No log	0.4727	26	1.5814	0.3303	1.5814	1.2575
No log	0.5091	28	1.4827	0.3186	1.4827	1.2177
No log	0.5455	30	1.4265	0.3380	1.4265	1.1943
No log	0.5818	32	1.3102	0.3297	1.3102	1.1447
No log	0.6182	34	1.2467	0.3193	1.2467	1.1165
No log	0.6545	36	1.2202	0.2522	1.2202	1.1046
No log	0.6909	38	1.2305	0.2378	1.2305	1.1093
No log	0.7273	40	1.3569	0.2424	1.3569	1.1649
No log	0.7636	42	1.6466	0.1917	1.6466	1.2832
No log	0.8	44	1.8324	0.1163	1.8324	1.3537
No log	0.8364	46	1.6964	0.1168	1.6964	1.3024
No log	0.8727	48	1.4482	0.2182	1.4482	1.2034
No log	0.9091	50	1.2822	0.3353	1.2822	1.1323
No log	0.9455	52	1.2316	0.3154	1.2316	1.1098
No log	0.9818	54	1.2554	0.2507	1.2554	1.1205
No log	1.0182	56	1.2500	0.2751	1.2500	1.1180
No log	1.0545	58	1.2880	0.3174	1.2880	1.1349
No log	1.0909	60	1.3817	0.2838	1.3817	1.1754
No log	1.1273	62	1.3600	0.3161	1.3600	1.1662
No log	1.1636	64	1.2070	0.3819	1.2070	1.0986
No log	1.2	66	1.1196	0.3961	1.1196	1.0581
No log	1.2364	68	1.0834	0.4346	1.0834	1.0409
No log	1.2727	70	1.0463	0.4739	1.0463	1.0229
No log	1.3091	72	1.2555	0.4611	1.2555	1.1205
No log	1.3455	74	1.4395	0.3702	1.4395	1.1998
No log	1.3818	76	1.3075	0.4362	1.3075	1.1435
No log	1.4182	78	0.9930	0.5514	0.9930	0.9965
No log	1.4545	80	0.9560	0.5200	0.9560	0.9777
No log	1.4909	82	0.9634	0.5071	0.9634	0.9815
No log	1.5273	84	0.9345	0.5315	0.9345	0.9667
No log	1.5636	86	1.0427	0.5165	1.0427	1.0211
No log	1.6	88	1.4705	0.4491	1.4705	1.2127
No log	1.6364	90	1.7438	0.4082	1.7438	1.3205
No log	1.6727	92	1.7991	0.4054	1.7991	1.3413
No log	1.7091	94	1.7405	0.4193	1.7405	1.3193
No log	1.7455	96	1.4347	0.4532	1.4347	1.1978
No log	1.7818	98	1.1553	0.5388	1.1553	1.0749
No log	1.8182	100	1.0025	0.5779	1.0025	1.0013
No log	1.8545	102	0.9504	0.5629	0.9504	0.9749
No log	1.8909	104	0.9912	0.5710	0.9912	0.9956
No log	1.9273	106	0.9726	0.5898	0.9726	0.9862
No log	1.9636	108	1.0294	0.5606	1.0294	1.0146
No log	2.0	110	1.0987	0.4864	1.0987	1.0482
No log	2.0364	112	1.0105	0.5682	1.0105	1.0052
No log	2.0727	114	0.9032	0.5972	0.9032	0.9504
No log	2.1091	116	0.9267	0.6082	0.9267	0.9627
No log	2.1455	118	1.0261	0.5768	1.0261	1.0129
No log	2.1818	120	0.9931	0.5882	0.9931	0.9965
No log	2.2182	122	0.8829	0.6397	0.8829	0.9397
No log	2.2545	124	0.8831	0.6344	0.8831	0.9397
No log	2.2909	126	0.9120	0.6297	0.9120	0.9550
No log	2.3273	128	0.9873	0.6128	0.9873	0.9936
No log	2.3636	130	1.0195	0.5967	1.0195	1.0097
No log	2.4	132	0.9739	0.6177	0.9739	0.9869
No log	2.4364	134	0.8607	0.6919	0.8607	0.9277
No log	2.4727	136	0.8077	0.6807	0.8077	0.8987
No log	2.5091	138	0.8411	0.6753	0.8411	0.9171
No log	2.5455	140	0.9527	0.6075	0.9527	0.9761
No log	2.5818	142	0.9758	0.6075	0.9758	0.9878
No log	2.6182	144	0.8681	0.6251	0.8681	0.9317
No log	2.6545	146	0.8332	0.6583	0.8332	0.9128
No log	2.6909	148	0.8877	0.6380	0.8877	0.9422
No log	2.7273	150	1.0705	0.5798	1.0705	1.0346
No log	2.7636	152	1.0633	0.5798	1.0633	1.0312
No log	2.8	154	0.9795	0.6059	0.9795	0.9897
No log	2.8364	156	0.8266	0.6347	0.8266	0.9092
No log	2.8727	158	0.7683	0.6930	0.7683	0.8765
No log	2.9091	160	0.7696	0.6474	0.7696	0.8773
No log	2.9455	162	0.7680	0.6769	0.7680	0.8763
No log	2.9818	164	0.8012	0.6653	0.8012	0.8951
No log	3.0182	166	0.9013	0.6278	0.9013	0.9494
No log	3.0545	168	0.9318	0.6269	0.9318	0.9653
No log	3.0909	170	0.8845	0.6310	0.8845	0.9405
No log	3.1273	172	0.8472	0.6490	0.8472	0.9204
No log	3.1636	174	0.8771	0.6092	0.8771	0.9365
No log	3.2	176	0.8978	0.5970	0.8978	0.9475
No log	3.2364	178	0.9157	0.5959	0.9157	0.9569
No log	3.2727	180	0.9643	0.6085	0.9643	0.9820
No log	3.3091	182	0.9463	0.6085	0.9463	0.9728
No log	3.3455	184	0.8651	0.6421	0.8651	0.9301
No log	3.3818	186	0.8631	0.6541	0.8631	0.9290
No log	3.4182	188	0.8242	0.6782	0.8242	0.9079
No log	3.4545	190	0.8084	0.6822	0.8084	0.8991
No log	3.4909	192	0.8191	0.6696	0.8191	0.9050
No log	3.5273	194	0.7944	0.6822	0.7944	0.8913
No log	3.5636	196	0.7815	0.7073	0.7815	0.8840
No log	3.6	198	0.8335	0.7098	0.8335	0.9130
No log	3.6364	200	0.8778	0.6951	0.8778	0.9369
No log	3.6727	202	0.9856	0.6191	0.9856	0.9928
No log	3.7091	204	1.0087	0.6042	1.0087	1.0043
No log	3.7455	206	0.8919	0.6660	0.8919	0.9444
No log	3.7818	208	0.7986	0.7218	0.7986	0.8936
No log	3.8182	210	0.7732	0.7443	0.7732	0.8793
No log	3.8545	212	0.7691	0.7229	0.7691	0.8770
No log	3.8909	214	0.7978	0.7277	0.7978	0.8932
No log	3.9273	216	0.8730	0.6826	0.8730	0.9344
No log	3.9636	218	1.0466	0.5891	1.0466	1.0230
No log	4.0	220	1.0564	0.5846	1.0564	1.0278
No log	4.0364	222	0.9258	0.6541	0.9258	0.9622
No log	4.0727	224	0.7919	0.7387	0.7919	0.8899
No log	4.1091	226	0.7395	0.7274	0.7395	0.8599
No log	4.1455	228	0.7291	0.7397	0.7291	0.8539
No log	4.1818	230	0.7531	0.7400	0.7531	0.8678
No log	4.2182	232	0.8662	0.6376	0.8662	0.9307
No log	4.2545	234	1.0119	0.5834	1.0119	1.0059
No log	4.2909	236	1.0642	0.5690	1.0642	1.0316
No log	4.3273	238	1.0017	0.5812	1.0017	1.0009
No log	4.3636	240	0.9227	0.6327	0.9227	0.9606
No log	4.4	242	0.8914	0.6336	0.8914	0.9442
No log	4.4364	244	0.8518	0.6331	0.8518	0.9229
No log	4.4727	246	0.8563	0.6569	0.8563	0.9254
No log	4.5091	248	0.9036	0.6144	0.9036	0.9506
No log	4.5455	250	0.8976	0.6224	0.8976	0.9474
No log	4.5818	252	0.9151	0.6186	0.9151	0.9566
No log	4.6182	254	0.8705	0.6634	0.8705	0.9330
No log	4.6545	256	0.8291	0.7098	0.8291	0.9105
No log	4.6909	258	0.8606	0.6810	0.8606	0.9277
No log	4.7273	260	0.9688	0.6088	0.9688	0.9843
No log	4.7636	262	1.0004	0.6000	1.0004	1.0002
No log	4.8	264	0.9065	0.6602	0.9065	0.9521
No log	4.8364	266	0.7908	0.7317	0.7908	0.8892
No log	4.8727	268	0.7338	0.7425	0.7338	0.8566
No log	4.9091	270	0.7324	0.7425	0.7324	0.8558
No log	4.9455	272	0.7739	0.7054	0.7739	0.8797
No log	4.9818	274	0.8663	0.6394	0.8663	0.9308
No log	5.0182	276	0.9468	0.6461	0.9468	0.9730
No log	5.0545	278	0.9089	0.6620	0.9089	0.9534
No log	5.0909	280	0.8522	0.6958	0.8522	0.9231
No log	5.1273	282	0.8188	0.7061	0.8188	0.9049
No log	5.1636	284	0.8401	0.6862	0.8401	0.9166
No log	5.2	286	0.9230	0.6393	0.9230	0.9608
No log	5.2364	288	0.9569	0.6337	0.9569	0.9782
No log	5.2727	290	1.0018	0.5921	1.0018	1.0009
No log	5.3091	292	0.9930	0.6010	0.9930	0.9965
No log	5.3455	294	1.0188	0.5921	1.0188	1.0094
No log	5.3818	296	0.9646	0.6131	0.9646	0.9821
No log	5.4182	298	0.8949	0.6225	0.8949	0.9460
No log	5.4545	300	0.8765	0.6191	0.8765	0.9362
No log	5.4909	302	0.9035	0.6206	0.9035	0.9505
No log	5.5273	304	0.9074	0.6520	0.9074	0.9526
No log	5.5636	306	0.9359	0.6520	0.9359	0.9674
No log	5.6	308	1.0481	0.6286	1.0481	1.0238
No log	5.6364	310	1.0885	0.6131	1.0885	1.0433
No log	5.6727	312	1.0050	0.6300	1.0050	1.0025
No log	5.7091	314	0.9704	0.6328	0.9704	0.9851
No log	5.7455	316	0.9107	0.6344	0.9107	0.9543
No log	5.7818	318	0.8781	0.6454	0.8781	0.9370
No log	5.8182	320	0.8906	0.6466	0.8906	0.9437
No log	5.8545	322	0.8329	0.7093	0.8329	0.9126
No log	5.8909	324	0.8030	0.7281	0.8030	0.8961
No log	5.9273	326	0.7911	0.7325	0.7911	0.8895
No log	5.9636	328	0.7667	0.7226	0.7667	0.8756
No log	6.0	330	0.7756	0.7226	0.7756	0.8807
No log	6.0364	332	0.7936	0.7033	0.7936	0.8908
No log	6.0727	334	0.8095	0.6777	0.8095	0.8997
No log	6.1091	336	0.7801	0.6991	0.7801	0.8832
No log	6.1455	338	0.7929	0.7098	0.7929	0.8905
No log	6.1818	340	0.8127	0.6792	0.8127	0.9015
No log	6.2182	342	0.7818	0.7139	0.7818	0.8842
No log	6.2545	344	0.7621	0.7310	0.7621	0.8730
No log	6.2909	346	0.7374	0.7491	0.7374	0.8587
No log	6.3273	348	0.7482	0.7526	0.7482	0.8650
No log	6.3636	350	0.7844	0.6759	0.7844	0.8856
No log	6.4	352	0.8244	0.6678	0.8244	0.9080
No log	6.4364	354	0.8630	0.6653	0.8630	0.9290
No log	6.4727	356	0.8786	0.6670	0.8786	0.9374
No log	6.5091	358	0.8253	0.6825	0.8253	0.9085
No log	6.5455	360	0.7826	0.7264	0.7826	0.8846
No log	6.5818	362	0.7549	0.7352	0.7549	0.8689
No log	6.6182	364	0.7707	0.7219	0.7707	0.8779
No log	6.6545	366	0.8072	0.7057	0.8072	0.8985
No log	6.6909	368	0.8445	0.6643	0.8445	0.9190
No log	6.7273	370	0.8953	0.6458	0.8953	0.9462
No log	6.7636	372	0.8960	0.6389	0.8960	0.9466
No log	6.8	374	0.8828	0.6571	0.8828	0.9396
No log	6.8364	376	0.8702	0.6651	0.8702	0.9329
No log	6.8727	378	0.8658	0.6651	0.8658	0.9305
No log	6.9091	380	0.8968	0.6433	0.8968	0.9470
No log	6.9455	382	0.9747	0.6302	0.9747	0.9873
No log	6.9818	384	1.0581	0.6170	1.0581	1.0286
No log	7.0182	386	1.0530	0.6414	1.0530	1.0262
No log	7.0545	388	1.0013	0.6053	1.0013	1.0007
No log	7.0909	390	0.9531	0.6090	0.9531	0.9763
No log	7.1273	392	0.9022	0.6559	0.9022	0.9499
No log	7.1636	394	0.8739	0.6565	0.8739	0.9348
No log	7.2	396	0.8602	0.6478	0.8602	0.9275
No log	7.2364	398	0.8513	0.6331	0.8513	0.9226
No log	7.2727	400	0.8563	0.6470	0.8563	0.9253
No log	7.3091	402	0.8524	0.6432	0.8524	0.9233
No log	7.3455	404	0.8512	0.6479	0.8512	0.9226
No log	7.3818	406	0.8477	0.6575	0.8477	0.9207
No log	7.4182	408	0.8383	0.6971	0.8383	0.9156
No log	7.4545	410	0.8310	0.7146	0.8310	0.9116
No log	7.4909	412	0.8178	0.7146	0.8178	0.9043
No log	7.5273	414	0.8249	0.7146	0.8249	0.9083
No log	7.5636	416	0.8516	0.7087	0.8516	0.9228
No log	7.6	418	0.8596	0.6839	0.8596	0.9272
No log	7.6364	420	0.8590	0.6861	0.8590	0.9268
No log	7.6727	422	0.8339	0.7013	0.8339	0.9132
No log	7.7091	424	0.8023	0.7020	0.8023	0.8957
No log	7.7455	426	0.7822	0.7104	0.7822	0.8844
No log	7.7818	428	0.7656	0.7133	0.7656	0.8750
No log	7.8182	430	0.7666	0.7037	0.7666	0.8756
No log	7.8545	432	0.7794	0.6943	0.7794	0.8829
No log	7.8909	434	0.8035	0.6961	0.8035	0.8964
No log	7.9273	436	0.8148	0.6751	0.8148	0.9027
No log	7.9636	438	0.8293	0.6751	0.8293	0.9107
No log	8.0	440	0.8300	0.6714	0.8300	0.9110
No log	8.0364	442	0.8419	0.6767	0.8419	0.9175
No log	8.0727	444	0.8637	0.6597	0.8637	0.9294
No log	8.1091	446	0.8980	0.6426	0.8980	0.9476
No log	8.1455	448	0.9176	0.6411	0.9176	0.9579
No log	8.1818	450	0.9337	0.6179	0.9337	0.9663
No log	8.2182	452	0.9147	0.6411	0.9147	0.9564
No log	8.2545	454	0.9043	0.6392	0.9043	0.9510
No log	8.2909	456	0.8830	0.6527	0.8830	0.9397
No log	8.3273	458	0.8650	0.6571	0.8650	0.9301
No log	8.3636	460	0.8431	0.6818	0.8431	0.9182
No log	8.4	462	0.8311	0.6892	0.8311	0.9116
No log	8.4364	464	0.8185	0.7033	0.8185	0.9047
No log	8.4727	466	0.8273	0.6778	0.8273	0.9096
No log	8.5091	468	0.8274	0.6604	0.8274	0.9096
No log	8.5455	470	0.8260	0.6732	0.8260	0.9088
No log	8.5818	472	0.8228	0.6732	0.8228	0.9071
No log	8.6182	474	0.8224	0.6732	0.8224	0.9069
No log	8.6545	476	0.8182	0.6732	0.8182	0.9045
No log	8.6909	478	0.8153	0.6732	0.8153	0.9030
No log	8.7273	480	0.8000	0.7182	0.8000	0.8944
No log	8.7636	482	0.7983	0.7182	0.7983	0.8935
No log	8.8	484	0.7941	0.7182	0.7941	0.8911
No log	8.8364	486	0.7965	0.7182	0.7965	0.8925
No log	8.8727	488	0.8089	0.7102	0.8089	0.8994
No log	8.9091	490	0.8286	0.6961	0.8286	0.9103
No log	8.9455	492	0.8430	0.6695	0.8430	0.9182
No log	8.9818	494	0.8477	0.6695	0.8477	0.9207
No log	9.0182	496	0.8452	0.6695	0.8452	0.9194
No log	9.0545	498	0.8462	0.6695	0.8462	0.9199
0.3207	9.0909	500	0.8417	0.6818	0.8417	0.9174
0.3207	9.1273	502	0.8427	0.6818	0.8427	0.9180
0.3207	9.1636	504	0.8414	0.6818	0.8414	0.9173
0.3207	9.2	506	0.8416	0.6837	0.8416	0.9174
0.3207	9.2364	508	0.8358	0.6837	0.8358	0.9142
0.3207	9.2727	510	0.8288	0.6961	0.8288	0.9104
0.3207	9.3091	512	0.8159	0.6980	0.8159	0.9033
0.3207	9.3455	514	0.8074	0.7105	0.8074	0.8986
0.3207	9.3818	516	0.8024	0.7105	0.8024	0.8958
0.3207	9.4182	518	0.8059	0.7105	0.8059	0.8977
0.3207	9.4545	520	0.8122	0.7105	0.8122	0.9012
0.3207	9.4909	522	0.8173	0.6980	0.8173	0.9041
0.3207	9.5273	524	0.8241	0.6980	0.8241	0.9078
0.3207	9.5636	526	0.8315	0.6818	0.8315	0.9119
0.3207	9.6	528	0.8392	0.6818	0.8392	0.9161
0.3207	9.6364	530	0.8468	0.6818	0.8468	0.9202
0.3207	9.6727	532	0.8485	0.6818	0.8485	0.9211
0.3207	9.7091	534	0.8453	0.6818	0.8453	0.9194
0.3207	9.7455	536	0.8422	0.6818	0.8422	0.9177
0.3207	9.7818	538	0.8383	0.6818	0.8383	0.9156
0.3207	9.8182	540	0.8361	0.6818	0.8361	0.9144
0.3207	9.8545	542	0.8353	0.6818	0.8353	0.9139
0.3207	9.8909	544	0.8341	0.6818	0.8341	0.9133
0.3207	9.9273	546	0.8337	0.6818	0.8337	0.9131
0.3207	9.9636	548	0.8332	0.6818	0.8332	0.9128
0.3207	10.0	550	0.8332	0.6818	0.8332	0.9128

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1