ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6812
• Qwk: 0.6421
• Mse: 0.6812
• Rmse: 0.8254

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.4085	-0.0205	5.4085	2.3256
No log	0.0784	4	3.2002	0.0465	3.2002	1.7889
No log	0.1176	6	1.9635	0.0780	1.9635	1.4012
No log	0.1569	8	1.7383	0.0789	1.7383	1.3185
No log	0.1961	10	1.8646	-0.0505	1.8646	1.3655
No log	0.2353	12	2.1819	-0.0531	2.1819	1.4771
No log	0.2745	14	2.3378	-0.0618	2.3378	1.5290
No log	0.3137	16	1.5231	0.0849	1.5231	1.2341
No log	0.3529	18	1.3673	0.1196	1.3673	1.1693
No log	0.3922	20	1.5389	0.1041	1.5389	1.2405
No log	0.4314	22	2.1842	-0.0591	2.1842	1.4779
No log	0.4706	24	2.7145	0.0271	2.7145	1.6476
No log	0.5098	26	2.1555	0.0637	2.1555	1.4681
No log	0.5490	28	1.5082	0.1855	1.5082	1.2281
No log	0.5882	30	1.2908	0.2082	1.2908	1.1361
No log	0.6275	32	1.3402	0.1960	1.3402	1.1577
No log	0.6667	34	1.5427	0.1936	1.5427	1.2421
No log	0.7059	36	1.5174	0.2470	1.5174	1.2318
No log	0.7451	38	1.2896	0.3696	1.2896	1.1356
No log	0.7843	40	1.0222	0.4777	1.0222	1.0110
No log	0.8235	42	1.1101	0.5118	1.1101	1.0536
No log	0.8627	44	1.5127	0.3736	1.5127	1.2299
No log	0.9020	46	1.3398	0.4137	1.3398	1.1575
No log	0.9412	48	1.3037	0.4465	1.3037	1.1418
No log	0.9804	50	1.4556	0.4186	1.4556	1.2065
No log	1.0196	52	1.4772	0.3951	1.4772	1.2154
No log	1.0588	54	1.4379	0.4410	1.4379	1.1991
No log	1.0980	56	1.1066	0.4832	1.1066	1.0520
No log	1.1373	58	0.8978	0.5233	0.8978	0.9475
No log	1.1765	60	0.8757	0.4786	0.8757	0.9358
No log	1.2157	62	0.8444	0.4916	0.8444	0.9189
No log	1.2549	64	0.8818	0.4951	0.8818	0.9390
No log	1.2941	66	0.9208	0.5012	0.9208	0.9596
No log	1.3333	68	0.9253	0.5176	0.9253	0.9619
No log	1.3725	70	0.8041	0.5806	0.8041	0.8967
No log	1.4118	72	0.8593	0.5862	0.8593	0.9270
No log	1.4510	74	0.8444	0.5919	0.8444	0.9189
No log	1.4902	76	0.8507	0.6282	0.8507	0.9223
No log	1.5294	78	0.9179	0.6314	0.9179	0.9581
No log	1.5686	80	0.8645	0.6400	0.8645	0.9298
No log	1.6078	82	0.8703	0.6245	0.8703	0.9329
No log	1.6471	84	0.8880	0.6198	0.8880	0.9423
No log	1.6863	86	0.9266	0.6165	0.9266	0.9626
No log	1.7255	88	1.0569	0.5770	1.0569	1.0281
No log	1.7647	90	1.0897	0.5611	1.0897	1.0439
No log	1.8039	92	0.9356	0.5361	0.9356	0.9673
No log	1.8431	94	0.9024	0.5481	0.9024	0.9500
No log	1.8824	96	0.8930	0.5382	0.8930	0.9450
No log	1.9216	98	0.8798	0.5466	0.8798	0.9380
No log	1.9608	100	0.8693	0.5189	0.8693	0.9323
No log	2.0	102	0.8588	0.4959	0.8588	0.9267
No log	2.0392	104	0.8513	0.5407	0.8513	0.9227
No log	2.0784	106	0.8649	0.5572	0.8649	0.9300
No log	2.1176	108	0.8704	0.5485	0.8704	0.9329
No log	2.1569	110	0.8681	0.5499	0.8681	0.9317
No log	2.1961	112	0.8709	0.6256	0.8709	0.9332
No log	2.2353	114	0.9052	0.6033	0.9052	0.9514
No log	2.2745	116	0.9082	0.6107	0.9082	0.9530
No log	2.3137	118	0.9186	0.6112	0.9186	0.9584
No log	2.3529	120	1.0376	0.5778	1.0376	1.0186
No log	2.3922	122	1.1973	0.5423	1.1973	1.0942
No log	2.4314	124	1.0119	0.5920	1.0119	1.0059
No log	2.4706	126	0.8760	0.6143	0.8760	0.9359
No log	2.5098	128	0.8789	0.6726	0.8789	0.9375
No log	2.5490	130	0.8411	0.6294	0.8411	0.9171
No log	2.5882	132	0.9395	0.6052	0.9395	0.9693
No log	2.6275	134	0.8869	0.6203	0.8869	0.9418
No log	2.6667	136	0.9709	0.5743	0.9709	0.9854
No log	2.7059	138	1.0764	0.5287	1.0764	1.0375
No log	2.7451	140	0.8794	0.5822	0.8794	0.9377
No log	2.7843	142	0.8745	0.6275	0.8745	0.9351
No log	2.8235	144	0.8922	0.6018	0.8922	0.9445
No log	2.8627	146	0.8114	0.6055	0.8114	0.9008
No log	2.9020	148	0.7901	0.6212	0.7901	0.8889
No log	2.9412	150	0.8003	0.6228	0.8003	0.8946
No log	2.9804	152	0.8061	0.6302	0.8061	0.8978
No log	3.0196	154	0.8002	0.6291	0.8002	0.8945
No log	3.0588	156	0.8196	0.6967	0.8196	0.9053
No log	3.0980	158	0.8495	0.6786	0.8495	0.9217
No log	3.1373	160	0.8336	0.6792	0.8336	0.9130
No log	3.1765	162	0.9171	0.6191	0.9171	0.9576
No log	3.2157	164	0.9209	0.6225	0.9209	0.9596
No log	3.2549	166	0.8300	0.6451	0.8300	0.9110
No log	3.2941	168	0.7741	0.6458	0.7741	0.8798
No log	3.3333	170	0.7545	0.6415	0.7545	0.8686
No log	3.3725	172	0.8083	0.6431	0.8083	0.8991
No log	3.4118	174	0.9863	0.5865	0.9863	0.9931
No log	3.4510	176	0.9879	0.5789	0.9879	0.9939
No log	3.4902	178	0.8193	0.5962	0.8193	0.9051
No log	3.5294	180	0.7149	0.6839	0.7149	0.8455
No log	3.5686	182	0.7311	0.6929	0.7311	0.8551
No log	3.6078	184	0.7224	0.7040	0.7224	0.8499
No log	3.6471	186	0.7155	0.7015	0.7155	0.8458
No log	3.6863	188	0.7587	0.6262	0.7587	0.8711
No log	3.7255	190	0.7592	0.6628	0.7592	0.8713
No log	3.7647	192	0.7552	0.6943	0.7552	0.8690
No log	3.8039	194	0.7685	0.6969	0.7685	0.8766
No log	3.8431	196	0.7786	0.6727	0.7786	0.8824
No log	3.8824	198	0.8953	0.6199	0.8953	0.9462
No log	3.9216	200	1.0386	0.5790	1.0386	1.0191
No log	3.9608	202	1.0353	0.5915	1.0353	1.0175
No log	4.0	204	0.9688	0.6038	0.9688	0.9843
No log	4.0392	206	0.8972	0.6362	0.8972	0.9472
No log	4.0784	208	0.8108	0.6666	0.8108	0.9005
No log	4.1176	210	0.7685	0.6729	0.7685	0.8767
No log	4.1569	212	0.7373	0.6554	0.7373	0.8587
No log	4.1961	214	0.7083	0.7028	0.7083	0.8416
No log	4.2353	216	0.7191	0.6989	0.7191	0.8480
No log	4.2745	218	0.7067	0.7028	0.7067	0.8407
No log	4.3137	220	0.7504	0.6042	0.7504	0.8663
No log	4.3529	222	0.7893	0.6238	0.7893	0.8884
No log	4.3922	224	0.7578	0.6361	0.7578	0.8705
No log	4.4314	226	0.7403	0.6854	0.7403	0.8604
No log	4.4706	228	0.7687	0.6600	0.7687	0.8768
No log	4.5098	230	0.7698	0.6722	0.7698	0.8774
No log	4.5490	232	0.6976	0.7190	0.6976	0.8353
No log	4.5882	234	0.7365	0.6195	0.7365	0.8582
No log	4.6275	236	0.8182	0.6269	0.8182	0.9046
No log	4.6667	238	0.9102	0.5950	0.9102	0.9540
No log	4.7059	240	0.8813	0.6101	0.8813	0.9388
No log	4.7451	242	0.7644	0.6135	0.7644	0.8743
No log	4.7843	244	0.7330	0.6183	0.7330	0.8561
No log	4.8235	246	0.6771	0.6408	0.6771	0.8229
No log	4.8627	248	0.6787	0.6496	0.6787	0.8238
No log	4.9020	250	0.7708	0.5965	0.7708	0.8779
No log	4.9412	252	0.8941	0.5814	0.8941	0.9456
No log	4.9804	254	0.8425	0.6151	0.8425	0.9179
No log	5.0196	256	0.8152	0.5919	0.8152	0.9029
No log	5.0588	258	0.7141	0.6041	0.7141	0.8451
No log	5.0980	260	0.6755	0.6351	0.6755	0.8219
No log	5.1373	262	0.7069	0.6153	0.7069	0.8407
No log	5.1765	264	0.7432	0.6057	0.7432	0.8621
No log	5.2157	266	0.8102	0.6216	0.8102	0.9001
No log	5.2549	268	0.7451	0.6177	0.7451	0.8632
No log	5.2941	270	0.6741	0.6578	0.6741	0.8210
No log	5.3333	272	0.6887	0.6530	0.6887	0.8299
No log	5.3725	274	0.7480	0.6137	0.7480	0.8648
No log	5.4118	276	0.8298	0.6235	0.8298	0.9109
No log	5.4510	278	0.8196	0.6189	0.8196	0.9053
No log	5.4902	280	0.7413	0.6001	0.7413	0.8610
No log	5.5294	282	0.6785	0.6526	0.6785	0.8237
No log	5.5686	284	0.6425	0.6936	0.6425	0.8016
No log	5.6078	286	0.6433	0.6916	0.6433	0.8021
No log	5.6471	288	0.6451	0.6821	0.6451	0.8032
No log	5.6863	290	0.6635	0.6690	0.6635	0.8146
No log	5.7255	292	0.6810	0.6623	0.6810	0.8252
No log	5.7647	294	0.6546	0.6774	0.6546	0.8091
No log	5.8039	296	0.6374	0.7130	0.6374	0.7984
No log	5.8431	298	0.6527	0.6854	0.6527	0.8079
No log	5.8824	300	0.6739	0.6484	0.6739	0.8209
No log	5.9216	302	0.6861	0.6431	0.6861	0.8283
No log	5.9608	304	0.6720	0.6773	0.6720	0.8197
No log	6.0	306	0.6711	0.7085	0.6711	0.8192
No log	6.0392	308	0.6737	0.7272	0.6737	0.8208
No log	6.0784	310	0.6842	0.7451	0.6842	0.8272
No log	6.1176	312	0.6791	0.7249	0.6791	0.8241
No log	6.1569	314	0.7195	0.6167	0.7195	0.8482
No log	6.1961	316	0.7932	0.6434	0.7932	0.8906
No log	6.2353	318	0.8314	0.6505	0.8314	0.9118
No log	6.2745	320	0.9574	0.6174	0.9574	0.9785
No log	6.3137	322	0.9905	0.6065	0.9905	0.9953
No log	6.3529	324	0.9559	0.6359	0.9559	0.9777
No log	6.3922	326	0.7987	0.6539	0.7987	0.8937
No log	6.4314	328	0.6734	0.6586	0.6734	0.8206
No log	6.4706	330	0.6530	0.7026	0.6530	0.8081
No log	6.5098	332	0.6469	0.7033	0.6469	0.8043
No log	6.5490	334	0.6669	0.6661	0.6669	0.8166
No log	6.5882	336	0.7271	0.6342	0.7271	0.8527
No log	6.6275	338	0.8004	0.6229	0.8004	0.8947
No log	6.6667	340	0.7765	0.6274	0.7765	0.8812
No log	6.7059	342	0.7134	0.6342	0.7134	0.8446
No log	6.7451	344	0.6531	0.6969	0.6531	0.8081
No log	6.7843	346	0.6532	0.6969	0.6532	0.8082
No log	6.8235	348	0.6596	0.6969	0.6596	0.8122
No log	6.8627	350	0.6633	0.6969	0.6633	0.8144
No log	6.9020	352	0.6646	0.6969	0.6646	0.8153
No log	6.9412	354	0.6516	0.7064	0.6516	0.8072
No log	6.9804	356	0.6534	0.7059	0.6534	0.8083
No log	7.0196	358	0.6642	0.6969	0.6642	0.8150
No log	7.0588	360	0.7155	0.6160	0.7155	0.8459
No log	7.0980	362	0.7980	0.5960	0.7980	0.8933
No log	7.1373	364	0.8150	0.6168	0.8150	0.9028
No log	7.1765	366	0.8115	0.6103	0.8115	0.9008
No log	7.2157	368	0.7435	0.6244	0.7435	0.8623
No log	7.2549	370	0.6864	0.6603	0.6864	0.8285
No log	7.2941	372	0.6658	0.6949	0.6658	0.8160
No log	7.3333	374	0.6581	0.6881	0.6581	0.8112
No log	7.3725	376	0.6483	0.6990	0.6483	0.8052
No log	7.4118	378	0.6439	0.7012	0.6439	0.8025
No log	7.4510	380	0.6421	0.6944	0.6421	0.8013
No log	7.4902	382	0.6459	0.6902	0.6459	0.8037
No log	7.5294	384	0.6589	0.6709	0.6589	0.8117
No log	7.5686	386	0.6932	0.6279	0.6932	0.8326
No log	7.6078	388	0.7188	0.6263	0.7188	0.8478
No log	7.6471	390	0.7204	0.6209	0.7204	0.8487
No log	7.6863	392	0.6956	0.6334	0.6956	0.8341
No log	7.7255	394	0.6719	0.6570	0.6719	0.8197
No log	7.7647	396	0.6501	0.6962	0.6501	0.8063
No log	7.8039	398	0.6465	0.6962	0.6465	0.8041
No log	7.8431	400	0.6602	0.6595	0.6602	0.8125
No log	7.8824	402	0.6712	0.6609	0.6712	0.8193
No log	7.9216	404	0.6975	0.6419	0.6975	0.8351
No log	7.9608	406	0.7136	0.6143	0.7136	0.8447
No log	8.0	408	0.6848	0.6382	0.6848	0.8275
No log	8.0392	410	0.6605	0.6695	0.6605	0.8127
No log	8.0784	412	0.6655	0.6677	0.6655	0.8158
No log	8.1176	414	0.6524	0.6859	0.6524	0.8077
No log	8.1569	416	0.6392	0.6969	0.6392	0.7995
No log	8.1961	418	0.6471	0.6969	0.6471	0.8045
No log	8.2353	420	0.6662	0.6597	0.6662	0.8162
No log	8.2745	422	0.6714	0.6597	0.6714	0.8194
No log	8.3137	424	0.6781	0.6189	0.6781	0.8235
No log	8.3529	426	0.6806	0.6189	0.6806	0.8250
No log	8.3922	428	0.6623	0.6653	0.6623	0.8138
No log	8.4314	430	0.6517	0.7076	0.6517	0.8073
No log	8.4706	432	0.6643	0.6700	0.6643	0.8151
No log	8.5098	434	0.6695	0.6587	0.6695	0.8182
No log	8.5490	436	0.6701	0.6587	0.6701	0.8186
No log	8.5882	438	0.6786	0.6382	0.6786	0.8238
No log	8.6275	440	0.6924	0.6133	0.6924	0.8321
No log	8.6667	442	0.7010	0.6133	0.7010	0.8373
No log	8.7059	444	0.6987	0.6133	0.6987	0.8359
No log	8.7451	446	0.6714	0.6328	0.6714	0.8194
No log	8.7843	448	0.6663	0.6548	0.6663	0.8162
No log	8.8235	450	0.6805	0.6267	0.6805	0.8249
No log	8.8627	452	0.6945	0.6305	0.6945	0.8334
No log	8.9020	454	0.7166	0.6218	0.7166	0.8465
No log	8.9412	456	0.7307	0.6212	0.7307	0.8548
No log	8.9804	458	0.7371	0.6212	0.7371	0.8586
No log	9.0196	460	0.7330	0.6212	0.7330	0.8561
No log	9.0588	462	0.7208	0.6171	0.7208	0.8490
No log	9.0980	464	0.7067	0.6218	0.7067	0.8406
No log	9.1373	466	0.6883	0.6305	0.6883	0.8296
No log	9.1765	468	0.6787	0.6313	0.6787	0.8238
No log	9.2157	470	0.6759	0.6313	0.6759	0.8221
No log	9.2549	472	0.6830	0.6305	0.6830	0.8264
No log	9.2941	474	0.6921	0.6218	0.6921	0.8319
No log	9.3333	476	0.6995	0.6218	0.6995	0.8364
No log	9.3725	478	0.7022	0.6218	0.7022	0.8380
No log	9.4118	480	0.7111	0.6218	0.7111	0.8433
No log	9.4510	482	0.7235	0.6157	0.7235	0.8506
No log	9.4902	484	0.7320	0.6157	0.7320	0.8556
No log	9.5294	486	0.7324	0.6157	0.7324	0.8558
No log	9.5686	488	0.7299	0.6157	0.7299	0.8544
No log	9.6078	490	0.7186	0.6157	0.7186	0.8477
No log	9.6471	492	0.7087	0.6218	0.7087	0.8419
No log	9.6863	494	0.6990	0.6218	0.6990	0.8361
No log	9.7255	496	0.6925	0.6212	0.6925	0.8322
No log	9.7647	498	0.6854	0.6305	0.6854	0.8279
0.4025	9.8039	500	0.6811	0.6320	0.6811	0.8253
0.4025	9.8431	502	0.6801	0.6421	0.6801	0.8247
0.4025	9.8824	504	0.6800	0.6421	0.6800	0.8246
0.4025	9.9216	506	0.6804	0.6421	0.6804	0.8249
0.4025	9.9608	508	0.6810	0.6421	0.6810	0.8252
0.4025	10.0	510	0.6812	0.6421	0.6812	0.8254

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1