ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k15_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7728
• Qwk: 0.7183
• Mse: 0.7728
• Rmse: 0.8791

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0290	2	6.7430	0.0116	6.7430	2.5967
No log	0.0580	4	4.4347	0.0556	4.4347	2.1059
No log	0.0870	6	3.2441	0.0118	3.2441	1.8011
No log	0.1159	8	3.0192	0.0503	3.0192	1.7376
No log	0.1449	10	2.1577	0.1429	2.1577	1.4689
No log	0.1739	12	1.9741	0.1391	1.9741	1.4050
No log	0.2029	14	1.9167	0.1802	1.9167	1.3845
No log	0.2319	16	1.8287	0.1651	1.8287	1.3523
No log	0.2609	18	1.7669	0.1682	1.7669	1.3293
No log	0.2899	20	1.7209	0.2037	1.7209	1.3118
No log	0.3188	22	1.6614	0.2037	1.6614	1.2890
No log	0.3478	24	1.6353	0.1852	1.6353	1.2788
No log	0.3768	26	1.6307	0.1121	1.6307	1.2770
No log	0.4058	28	1.6374	0.1111	1.6374	1.2796
No log	0.4348	30	1.6347	0.1930	1.6347	1.2786
No log	0.4638	32	1.5931	0.1786	1.5931	1.2622
No log	0.4928	34	1.6151	0.1165	1.6151	1.2709
No log	0.5217	36	1.6840	0.1154	1.6840	1.2977
No log	0.5507	38	1.6317	0.0971	1.6317	1.2774
No log	0.5797	40	1.5465	0.2385	1.5465	1.2436
No log	0.6087	42	1.6463	0.2185	1.6463	1.2831
No log	0.6377	44	1.6208	0.2645	1.6208	1.2731
No log	0.6667	46	1.5509	0.3226	1.5509	1.2453
No log	0.6957	48	1.5609	0.3193	1.5609	1.2494
No log	0.7246	50	1.5641	0.2787	1.5641	1.2506
No log	0.7536	52	1.5475	0.3065	1.5475	1.2440
No log	0.7826	54	1.5911	0.2185	1.5911	1.2614
No log	0.8116	56	1.5165	0.3471	1.5165	1.2315
No log	0.8406	58	1.4726	0.3740	1.4726	1.2135
No log	0.8696	60	1.4910	0.3000	1.4910	1.2210
No log	0.8986	62	1.4226	0.3559	1.4226	1.1927
No log	0.9275	64	1.4079	0.3276	1.4079	1.1865
No log	0.9565	66	1.3172	0.3826	1.3172	1.1477
No log	0.9855	68	1.4766	0.3833	1.4766	1.2152
No log	1.0145	70	1.4900	0.3306	1.4900	1.2207
No log	1.0435	72	1.2407	0.4274	1.2407	1.1139
No log	1.0725	74	1.1959	0.4576	1.1959	1.0936
No log	1.1014	76	1.2193	0.4915	1.2193	1.1042
No log	1.1304	78	1.2851	0.3363	1.2851	1.1336
No log	1.1594	80	1.3464	0.4274	1.3464	1.1603
No log	1.1884	82	1.3772	0.3103	1.3772	1.1735
No log	1.2174	84	1.3371	0.4237	1.3371	1.1563
No log	1.2464	86	1.2001	0.4132	1.2001	1.0955
No log	1.2754	88	1.1709	0.5354	1.1709	1.0821
No log	1.3043	90	1.1335	0.5556	1.1335	1.0647
No log	1.3333	92	1.1458	0.5581	1.1458	1.0704
No log	1.3623	94	1.1541	0.5238	1.1541	1.0743
No log	1.3913	96	1.1110	0.5203	1.1110	1.0540
No log	1.4203	98	1.0999	0.5455	1.0999	1.0487
No log	1.4493	100	1.0769	0.5574	1.0769	1.0377
No log	1.4783	102	1.0783	0.5827	1.0783	1.0384
No log	1.5072	104	1.0829	0.5846	1.0829	1.0406
No log	1.5362	106	1.2017	0.5303	1.2017	1.0962
No log	1.5652	108	1.0516	0.6316	1.0516	1.0255
No log	1.5942	110	1.0004	0.6119	1.0004	1.0002
No log	1.6232	112	0.9546	0.6119	0.9546	0.9770
No log	1.6522	114	0.7305	0.6866	0.7305	0.8547
No log	1.6812	116	0.7339	0.7153	0.7339	0.8567
No log	1.7101	118	0.7527	0.7121	0.7527	0.8676
No log	1.7391	120	0.7851	0.7121	0.7851	0.8861
No log	1.7681	122	0.8041	0.6822	0.8041	0.8967
No log	1.7971	124	0.8669	0.6719	0.8669	0.9311
No log	1.8261	126	0.9125	0.6299	0.9125	0.9552
No log	1.8551	128	0.9529	0.5984	0.9529	0.9762
No log	1.8841	130	0.9499	0.6202	0.9499	0.9746
No log	1.9130	132	0.9145	0.6142	0.9145	0.9563
No log	1.9420	134	0.8719	0.5984	0.8719	0.9338
No log	1.9710	136	0.8778	0.6412	0.8778	0.9369
No log	2.0	138	0.8211	0.6667	0.8211	0.9062
No log	2.0290	140	0.7670	0.7164	0.7670	0.8758
No log	2.0580	142	0.7696	0.7259	0.7696	0.8773
No log	2.0870	144	0.7949	0.7353	0.7949	0.8916
No log	2.1159	146	0.8222	0.7111	0.8222	0.9068
No log	2.1449	148	0.8270	0.7068	0.8270	0.9094
No log	2.1739	150	0.8482	0.6818	0.8482	0.9210
No log	2.2029	152	1.1142	0.5156	1.1142	1.0555
No log	2.2319	154	1.2649	0.5079	1.2649	1.1247
No log	2.2609	156	1.0129	0.6107	1.0129	1.0064
No log	2.2899	158	1.0303	0.5802	1.0303	1.0150
No log	2.3188	160	1.0430	0.5581	1.0430	1.0213
No log	2.3478	162	0.9442	0.6202	0.9442	0.9717
No log	2.3768	164	1.0636	0.5426	1.0636	1.0313
No log	2.4058	166	1.1456	0.5231	1.1456	1.0703
No log	2.4348	168	1.0375	0.5397	1.0375	1.0186
No log	2.4638	170	0.9885	0.6512	0.9885	0.9942
No log	2.4928	172	1.0997	0.5581	1.0997	1.0487
No log	2.5217	174	1.0972	0.5781	1.0972	1.0475
No log	2.5507	176	0.9563	0.6406	0.9563	0.9779
No log	2.5797	178	0.9981	0.4878	0.9981	0.9991
No log	2.6087	180	1.2957	0.4882	1.2957	1.1383
No log	2.6377	182	1.2712	0.5271	1.2712	1.1275
No log	2.6667	184	0.9508	0.528	0.9508	0.9751
No log	2.6957	186	0.9139	0.6719	0.9139	0.9560
No log	2.7246	188	1.0031	0.6370	1.0031	1.0016
No log	2.7536	190	0.9757	0.6667	0.9757	0.9878
No log	2.7826	192	0.9465	0.6406	0.9465	0.9729
No log	2.8116	194	0.9537	0.6260	0.9537	0.9766
No log	2.8406	196	0.9884	0.6567	0.9884	0.9942
No log	2.8696	198	1.0536	0.6324	1.0536	1.0265
No log	2.8986	200	1.0283	0.6308	1.0283	1.0140
No log	2.9275	202	1.0022	0.5714	1.0022	1.0011
No log	2.9565	204	1.0107	0.5714	1.0107	1.0053
No log	2.9855	206	1.0884	0.5846	1.0884	1.0432
No log	3.0145	208	1.1582	0.5714	1.1582	1.0762
No log	3.0435	210	1.0475	0.6202	1.0475	1.0235
No log	3.0725	212	0.9525	0.6094	0.9525	0.9760
No log	3.1014	214	0.9301	0.5984	0.9301	0.9644
No log	3.1304	216	0.9344	0.5714	0.9344	0.9666
No log	3.1594	218	0.9522	0.5920	0.9522	0.9758
No log	3.1884	220	1.0202	0.6107	1.0202	1.0100
No log	3.2174	222	0.9536	0.6719	0.9536	0.9765
No log	3.2464	224	0.8587	0.5645	0.8587	0.9267
No log	3.2754	226	0.8865	0.6047	0.8865	0.9416
No log	3.3043	228	0.8302	0.5938	0.8302	0.9112
No log	3.3333	230	0.7983	0.7015	0.7983	0.8935
No log	3.3623	232	0.9159	0.6165	0.9159	0.9570
No log	3.3913	234	0.9614	0.6165	0.9614	0.9805
No log	3.4203	236	0.8731	0.6308	0.8731	0.9344
No log	3.4493	238	0.8542	0.6107	0.8542	0.9242
No log	3.4783	240	0.8739	0.5397	0.8739	0.9348
No log	3.5072	242	0.8592	0.6718	0.8592	0.9269
No log	3.5362	244	0.8783	0.6667	0.8783	0.9372
No log	3.5652	246	0.8621	0.6667	0.8621	0.9285
No log	3.5942	248	0.8736	0.6767	0.8736	0.9347
No log	3.6232	250	0.8745	0.6667	0.8745	0.9352
No log	3.6522	252	0.9910	0.5970	0.9910	0.9955
No log	3.6812	254	1.0359	0.5970	1.0359	1.0178
No log	3.7101	256	0.9658	0.5970	0.9658	0.9827
No log	3.7391	258	0.8194	0.6767	0.8194	0.9052
No log	3.7681	260	0.7904	0.7015	0.7904	0.8891
No log	3.7971	262	0.8219	0.6870	0.8219	0.9066
No log	3.8261	264	0.8280	0.6870	0.8280	0.9099
No log	3.8551	266	0.8194	0.6769	0.8194	0.9052
No log	3.8841	268	0.7917	0.6870	0.7917	0.8898
No log	3.9130	270	0.8058	0.6667	0.8058	0.8977
No log	3.9420	272	0.7799	0.7059	0.7799	0.8831
No log	3.9710	274	0.7153	0.7445	0.7153	0.8457
No log	4.0	276	0.7691	0.7153	0.7691	0.8770
No log	4.0290	278	0.7840	0.7050	0.7840	0.8854
No log	4.0580	280	0.7372	0.7299	0.7372	0.8586
No log	4.0870	282	0.7985	0.7153	0.7985	0.8936
No log	4.1159	284	0.8870	0.6667	0.8870	0.9418
No log	4.1449	286	0.8919	0.6870	0.8919	0.9444
No log	4.1739	288	0.8751	0.6769	0.8751	0.9355
No log	4.2029	290	0.8526	0.6308	0.8526	0.9233
No log	4.2319	292	0.8199	0.6364	0.8199	0.9055
No log	4.2609	294	0.8078	0.6870	0.8078	0.8988
No log	4.2899	296	0.7894	0.6822	0.7894	0.8885
No log	4.3188	298	0.7622	0.7023	0.7622	0.8730
No log	4.3478	300	0.7191	0.7259	0.7191	0.8480
No log	4.3768	302	0.7512	0.6815	0.7512	0.8667
No log	4.4058	304	0.7997	0.6667	0.7997	0.8943
No log	4.4348	306	0.7169	0.6765	0.7169	0.8467
No log	4.4638	308	0.6730	0.7626	0.6730	0.8204
No log	4.4928	310	0.6789	0.7194	0.6789	0.8240
No log	4.5217	312	0.7067	0.7536	0.7067	0.8406
No log	4.5507	314	0.7446	0.7338	0.7446	0.8629
No log	4.5797	316	0.6998	0.7310	0.6998	0.8365
No log	4.6087	318	0.6212	0.7808	0.6212	0.7882
No log	4.6377	320	0.6323	0.7413	0.6323	0.7952
No log	4.6667	322	0.6830	0.7286	0.6830	0.8264
No log	4.6957	324	0.7251	0.7286	0.7251	0.8516
No log	4.7246	326	0.8232	0.6957	0.8232	0.9073
No log	4.7536	328	0.8233	0.7206	0.8233	0.9074
No log	4.7826	330	0.8289	0.7111	0.8289	0.9105
No log	4.8116	332	0.8363	0.7111	0.8363	0.9145
No log	4.8406	334	0.7708	0.7206	0.7708	0.8779
No log	4.8696	336	0.7523	0.6815	0.7523	0.8673
No log	4.8986	338	0.7653	0.7164	0.7653	0.8748
No log	4.9275	340	0.8260	0.6667	0.8260	0.9089
No log	4.9565	342	0.8455	0.6567	0.8455	0.9195
No log	4.9855	344	0.8171	0.6667	0.8171	0.9039
No log	5.0145	346	0.7464	0.6767	0.7464	0.8639
No log	5.0435	348	0.7446	0.6767	0.7446	0.8629
No log	5.0725	350	0.7682	0.6567	0.7682	0.8765
No log	5.1014	352	0.7619	0.6767	0.7619	0.8729
No log	5.1304	354	0.7361	0.6815	0.7361	0.8580
No log	5.1594	356	0.7900	0.6815	0.7900	0.8888
No log	5.1884	358	1.0030	0.6286	1.0030	1.0015
No log	5.2174	360	1.1088	0.6131	1.1088	1.0530
No log	5.2464	362	1.0076	0.6567	1.0076	1.0038
No log	5.2754	364	0.8734	0.6765	0.8734	0.9346
No log	5.3043	366	0.8742	0.6765	0.8742	0.9350
No log	5.3333	368	0.8992	0.6412	0.8992	0.9483
No log	5.3623	370	0.9250	0.6617	0.9250	0.9618
No log	5.3913	372	1.0266	0.5891	1.0266	1.0132
No log	5.4203	374	1.1818	0.5821	1.1818	1.0871
No log	5.4493	376	1.2659	0.5547	1.2659	1.1251
No log	5.4783	378	1.1626	0.5755	1.1626	1.0782
No log	5.5072	380	0.9226	0.6618	0.9226	0.9605
No log	5.5362	382	0.7742	0.7183	0.7742	0.8799
No log	5.5652	384	0.7670	0.6957	0.7670	0.8758
No log	5.5942	386	0.7709	0.6957	0.7709	0.8780
No log	5.6232	388	0.8087	0.6912	0.8087	0.8993
No log	5.6522	390	0.9631	0.6357	0.9631	0.9814
No log	5.6812	392	1.1397	0.5625	1.1397	1.0676
No log	5.7101	394	1.1753	0.5692	1.1753	1.0841
No log	5.7391	396	1.0808	0.6094	1.0808	1.0396
No log	5.7681	398	0.9701	0.6357	0.9701	0.9850
No log	5.7971	400	0.8879	0.6667	0.8879	0.9423
No log	5.8261	402	0.8642	0.6667	0.8642	0.9296
No log	5.8551	404	0.8678	0.6767	0.8678	0.9316
No log	5.8841	406	0.9258	0.6667	0.9258	0.9622
No log	5.9130	408	0.9432	0.6667	0.9432	0.9712
No log	5.9420	410	0.8876	0.6094	0.8876	0.9421
No log	5.9710	412	0.8841	0.6457	0.8841	0.9403
No log	6.0	414	0.8670	0.6349	0.8670	0.9311
No log	6.0290	416	0.8321	0.6357	0.8321	0.9122
No log	6.0580	418	0.8927	0.6767	0.8927	0.9448
No log	6.0870	420	0.9790	0.6466	0.9790	0.9894
No log	6.1159	422	0.9095	0.6767	0.9095	0.9537
No log	6.1449	424	0.7693	0.6866	0.7693	0.8771
No log	6.1739	426	0.6919	0.7206	0.6919	0.8318
No log	6.2029	428	0.6559	0.7234	0.6559	0.8099
No log	6.2319	430	0.6505	0.7273	0.6505	0.8066
No log	6.2609	432	0.6429	0.7143	0.6429	0.8018
No log	6.2899	434	0.6909	0.6912	0.6909	0.8312
No log	6.3188	436	0.7412	0.6815	0.7412	0.8609
No log	6.3478	438	0.7089	0.6912	0.7089	0.8420
No log	6.3768	440	0.6369	0.7234	0.6369	0.7981
No log	6.4058	442	0.6315	0.7324	0.6315	0.7947
No log	6.4348	444	0.6876	0.7324	0.6876	0.8292
No log	6.4638	446	0.7088	0.7007	0.7088	0.8419
No log	6.4928	448	0.7140	0.6912	0.7140	0.8450
No log	6.5217	450	0.7185	0.7111	0.7185	0.8476
No log	6.5507	452	0.6822	0.7536	0.6822	0.8260
No log	6.5797	454	0.6396	0.7692	0.6396	0.7998
No log	6.6087	456	0.6509	0.7448	0.6509	0.8068
No log	6.6377	458	0.6369	0.7534	0.6369	0.7980
No log	6.6667	460	0.6594	0.7448	0.6594	0.8120
No log	6.6957	462	0.6918	0.7376	0.6918	0.8317
No log	6.7246	464	0.7329	0.7429	0.7329	0.8561
No log	6.7536	466	0.7895	0.7111	0.7895	0.8886
No log	6.7826	468	0.8492	0.6870	0.8492	0.9215
No log	6.8116	470	0.8313	0.6870	0.8313	0.9118
No log	6.8406	472	0.7738	0.6906	0.7738	0.8797
No log	6.8696	474	0.7234	0.7246	0.7234	0.8505
No log	6.8986	476	0.6954	0.7429	0.6954	0.8339
No log	6.9275	478	0.6642	0.7660	0.6642	0.8150
No log	6.9565	480	0.6634	0.7448	0.6634	0.8145
No log	6.9855	482	0.6662	0.7448	0.6662	0.8162
No log	7.0145	484	0.6959	0.7324	0.6959	0.8342
No log	7.0435	486	0.7373	0.7234	0.7373	0.8586
No log	7.0725	488	0.7349	0.7324	0.7349	0.8573
No log	7.1014	490	0.7584	0.7234	0.7584	0.8709
No log	7.1304	492	0.8190	0.7050	0.8190	0.9050
No log	7.1594	494	0.8649	0.6812	0.8649	0.9300
No log	7.1884	496	0.8185	0.7050	0.8185	0.9047
No log	7.2174	498	0.7507	0.7413	0.7507	0.8664
0.4183	7.2464	500	0.7651	0.7285	0.7651	0.8747
0.4183	7.2754	502	0.7853	0.7075	0.7853	0.8862
0.4183	7.3043	504	0.7826	0.7413	0.7826	0.8847
0.4183	7.3333	506	0.8170	0.7206	0.8170	0.9039
0.4183	7.3623	508	0.8296	0.7206	0.8296	0.9108
0.4183	7.3913	510	0.8218	0.6866	0.8218	0.9065
0.4183	7.4203	512	0.8030	0.6715	0.8030	0.8961
0.4183	7.4493	514	0.7728	0.7183	0.7728	0.8791

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1