ArabicNewSplits5_FineTuningAraBERT_run1_AugV5_k8_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8802
• Qwk: 0.6730
• Mse: 0.8802
• Rmse: 0.9382

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.05	2	2.3705	-0.0013	2.3705	1.5397
No log	0.1	4	1.6888	0.1293	1.6888	1.2995
No log	0.15	6	1.6365	0.0724	1.6365	1.2793
No log	0.2	8	1.6177	0.0561	1.6177	1.2719
No log	0.25	10	1.3721	0.1608	1.3721	1.1714
No log	0.3	12	1.3256	0.1495	1.3256	1.1513
No log	0.35	14	1.3150	0.1289	1.3150	1.1468
No log	0.4	16	1.2991	0.1289	1.2991	1.1398
No log	0.45	18	1.2958	0.1811	1.2958	1.1383
No log	0.5	20	1.2564	0.1621	1.2564	1.1209
No log	0.55	22	1.2321	0.1456	1.2321	1.1100
No log	0.6	24	1.2723	0.1834	1.2723	1.1280
No log	0.65	26	1.3272	0.1968	1.3272	1.1521
No log	0.7	28	1.3194	0.2217	1.3194	1.1486
No log	0.75	30	1.3035	0.2092	1.3035	1.1417
No log	0.8	32	1.2649	0.3172	1.2649	1.1247
No log	0.85	34	1.2258	0.3634	1.2258	1.1071
No log	0.9	36	1.1818	0.3496	1.1818	1.0871
No log	0.95	38	1.1263	0.3548	1.1263	1.0613
No log	1.0	40	1.0908	0.3387	1.0908	1.0444
No log	1.05	42	1.0893	0.3441	1.0893	1.0437
No log	1.1	44	1.1007	0.3034	1.1007	1.0491
No log	1.15	46	1.1021	0.2772	1.1021	1.0498
No log	1.2	48	1.0656	0.2964	1.0656	1.0323
No log	1.25	50	1.0635	0.4550	1.0635	1.0313
No log	1.3	52	1.0703	0.4753	1.0703	1.0345
No log	1.35	54	0.9744	0.5150	0.9744	0.9871
No log	1.4	56	1.0051	0.4502	1.0051	1.0026
No log	1.45	58	1.0764	0.4803	1.0764	1.0375
No log	1.5	60	1.0153	0.4835	1.0153	1.0076
No log	1.55	62	0.9729	0.4388	0.9729	0.9863
No log	1.6	64	0.9589	0.5335	0.9589	0.9793
No log	1.65	66	1.0114	0.5051	1.0114	1.0057
No log	1.7	68	1.0471	0.4889	1.0471	1.0233
No log	1.75	70	1.1113	0.4773	1.1113	1.0542
No log	1.8	72	1.0146	0.5287	1.0146	1.0073
No log	1.85	74	0.9204	0.5110	0.9204	0.9594
No log	1.9	76	0.8907	0.5593	0.8907	0.9437
No log	1.95	78	0.8781	0.5415	0.8781	0.9371
No log	2.0	80	0.8979	0.5781	0.8979	0.9476
No log	2.05	82	1.0475	0.5083	1.0475	1.0235
No log	2.1	84	1.2287	0.4609	1.2287	1.1085
No log	2.15	86	1.2083	0.4743	1.2083	1.0992
No log	2.2	88	0.9726	0.5488	0.9726	0.9862
No log	2.25	90	0.8788	0.5547	0.8788	0.9375
No log	2.3	92	0.8807	0.5957	0.8807	0.9385
No log	2.35	94	0.8880	0.5832	0.8880	0.9423
No log	2.4	96	1.0710	0.5654	1.0710	1.0349
No log	2.45	98	1.0957	0.5610	1.0957	1.0468
No log	2.5	100	0.9552	0.6367	0.9552	0.9773
No log	2.55	102	0.9384	0.6329	0.9384	0.9687
No log	2.6	104	1.0625	0.5684	1.0625	1.0308
No log	2.65	106	1.0946	0.5332	1.0946	1.0462
No log	2.7	108	1.0858	0.5332	1.0858	1.0420
No log	2.75	110	0.9779	0.5896	0.9779	0.9889
No log	2.8	112	0.9531	0.5878	0.9531	0.9763
No log	2.85	114	0.8925	0.6013	0.8925	0.9447
No log	2.9	116	0.8851	0.6019	0.8851	0.9408
No log	2.95	118	0.8710	0.6292	0.8710	0.9333
No log	3.0	120	0.9312	0.5825	0.9312	0.9650
No log	3.05	122	0.9093	0.6241	0.9093	0.9536
No log	3.1	124	0.9457	0.5884	0.9457	0.9725
No log	3.15	126	0.9637	0.5953	0.9637	0.9817
No log	3.2	128	0.8680	0.6521	0.8680	0.9316
No log	3.25	130	0.8682	0.6676	0.8682	0.9318
No log	3.3	132	0.9604	0.6177	0.9604	0.9800
No log	3.35	134	1.0785	0.5629	1.0785	1.0385
No log	3.4	136	1.1997	0.5675	1.1997	1.0953
No log	3.45	138	1.1413	0.5848	1.1413	1.0683
No log	3.5	140	1.1079	0.6071	1.1079	1.0526
No log	3.55	142	1.0095	0.6205	1.0095	1.0048
No log	3.6	144	1.0081	0.6254	1.0081	1.0040
No log	3.65	146	1.1666	0.5745	1.1666	1.0801
No log	3.7	148	1.3994	0.5160	1.3994	1.1830
No log	3.75	150	1.6159	0.4740	1.6159	1.2712
No log	3.8	152	1.4557	0.5039	1.4557	1.2065
No log	3.85	154	1.0897	0.5776	1.0897	1.0439
No log	3.9	156	0.8360	0.6702	0.8360	0.9143
No log	3.95	158	0.7563	0.6376	0.7563	0.8697
No log	4.0	160	0.7602	0.6499	0.7602	0.8719
No log	4.05	162	0.8021	0.6729	0.8021	0.8956
No log	4.1	164	0.9577	0.6459	0.9577	0.9786
No log	4.15	166	0.9927	0.6439	0.9927	0.9963
No log	4.2	168	0.9305	0.6304	0.9305	0.9646
No log	4.25	170	0.8994	0.6395	0.8994	0.9484
No log	4.3	172	1.0340	0.5517	1.0340	1.0168
No log	4.35	174	1.3990	0.5294	1.3990	1.1828
No log	4.4	176	1.6648	0.5378	1.6648	1.2903
No log	4.45	178	1.5426	0.5266	1.5426	1.2420
No log	4.5	180	1.4194	0.5287	1.4194	1.1914
No log	4.55	182	1.2481	0.5267	1.2481	1.1172
No log	4.6	184	1.1148	0.5735	1.1148	1.0558
No log	4.65	186	0.9700	0.6135	0.9700	0.9849
No log	4.7	188	0.9069	0.6160	0.9069	0.9523
No log	4.75	190	0.8671	0.6477	0.8671	0.9312
No log	4.8	192	0.8274	0.6640	0.8274	0.9096
No log	4.85	194	0.8634	0.6575	0.8634	0.9292
No log	4.9	196	0.8845	0.6471	0.8845	0.9405
No log	4.95	198	0.8897	0.6392	0.8897	0.9432
No log	5.0	200	0.9074	0.6294	0.9074	0.9526
No log	5.05	202	0.9698	0.6116	0.9698	0.9848
No log	5.1	204	1.0148	0.6270	1.0148	1.0074
No log	5.15	206	0.9672	0.6203	0.9672	0.9835
No log	5.2	208	0.8696	0.6713	0.8696	0.9325
No log	5.25	210	0.7685	0.6542	0.7685	0.8767
No log	5.3	212	0.7107	0.7121	0.7107	0.8430
No log	5.35	214	0.7130	0.7187	0.7130	0.8444
No log	5.4	216	0.7780	0.6723	0.7780	0.8820
No log	5.45	218	0.9398	0.6059	0.9398	0.9694
No log	5.5	220	1.1860	0.5825	1.1860	1.0890
No log	5.55	222	1.3485	0.5665	1.3485	1.1612
No log	5.6	224	1.3087	0.5691	1.3087	1.1440
No log	5.65	226	1.1276	0.6055	1.1276	1.0619
No log	5.7	228	0.8849	0.6309	0.8849	0.9407
No log	5.75	230	0.8026	0.7101	0.8026	0.8959
No log	5.8	232	0.7518	0.7011	0.7518	0.8670
No log	5.85	234	0.7426	0.7145	0.7426	0.8617
No log	5.9	236	0.7865	0.7108	0.7865	0.8869
No log	5.95	238	0.9147	0.6385	0.9147	0.9564
No log	6.0	240	1.0524	0.6201	1.0524	1.0258
No log	6.05	242	1.0501	0.6272	1.0501	1.0248
No log	6.1	244	0.9554	0.6468	0.9554	0.9774
No log	6.15	246	0.9284	0.6406	0.9284	0.9635
No log	6.2	248	0.8683	0.6348	0.8683	0.9318
No log	6.25	250	0.8491	0.6523	0.8491	0.9215
No log	6.3	252	0.8936	0.6444	0.8936	0.9453
No log	6.35	254	0.9331	0.6465	0.9331	0.9660
No log	6.4	256	0.9966	0.6416	0.9966	0.9983
No log	6.45	258	0.9471	0.6613	0.9471	0.9732
No log	6.5	260	0.8878	0.6508	0.8878	0.9422
No log	6.55	262	0.8446	0.6417	0.8446	0.9190
No log	6.6	264	0.8330	0.6595	0.8330	0.9127
No log	6.65	266	0.8427	0.6705	0.8427	0.9180
No log	6.7	268	0.8239	0.6963	0.8239	0.9077
No log	6.75	270	0.7807	0.6966	0.7807	0.8835
No log	6.8	272	0.7564	0.6951	0.7564	0.8697
No log	6.85	274	0.7564	0.6999	0.7564	0.8697
No log	6.9	276	0.7580	0.7048	0.7580	0.8706
No log	6.95	278	0.7409	0.7052	0.7409	0.8608
No log	7.0	280	0.6951	0.7160	0.6951	0.8337
No log	7.05	282	0.6667	0.7132	0.6667	0.8165
No log	7.1	284	0.6622	0.7132	0.6622	0.8138
No log	7.15	286	0.6884	0.7200	0.6884	0.8297
No log	7.2	288	0.7481	0.6870	0.7481	0.8649
No log	7.25	290	0.7865	0.6880	0.7865	0.8868
No log	7.3	292	0.7888	0.6761	0.7888	0.8882
No log	7.35	294	0.7581	0.6847	0.7581	0.8707
No log	7.4	296	0.7147	0.6893	0.7147	0.8454
No log	7.45	298	0.7057	0.6893	0.7057	0.8400
No log	7.5	300	0.7297	0.6883	0.7297	0.8542
No log	7.55	302	0.7682	0.6819	0.7682	0.8765
No log	7.6	304	0.8398	0.6641	0.8398	0.9164
No log	7.65	306	0.8900	0.6592	0.8900	0.9434
No log	7.7	308	0.9003	0.6621	0.9003	0.9489
No log	7.75	310	0.8770	0.6654	0.8770	0.9365
No log	7.8	312	0.8218	0.6716	0.8218	0.9066
No log	7.85	314	0.8082	0.6742	0.8082	0.8990
No log	7.9	316	0.7915	0.6742	0.7915	0.8897
No log	7.95	318	0.7751	0.6788	0.7751	0.8804
No log	8.0	320	0.7737	0.6834	0.7737	0.8796
No log	8.05	322	0.7732	0.6834	0.7732	0.8793
No log	8.1	324	0.7887	0.6852	0.7887	0.8881
No log	8.15	326	0.8165	0.6669	0.8165	0.9036
No log	8.2	328	0.8127	0.6660	0.8127	0.9015
No log	8.25	330	0.7897	0.6845	0.7897	0.8887
No log	8.3	332	0.7616	0.6827	0.7616	0.8727
No log	8.35	334	0.7358	0.6940	0.7358	0.8578
No log	8.4	336	0.7285	0.7008	0.7285	0.8535
No log	8.45	338	0.7274	0.6987	0.7274	0.8529
No log	8.5	340	0.7463	0.6894	0.7463	0.8639
No log	8.55	342	0.7600	0.6854	0.7600	0.8718
No log	8.6	344	0.7919	0.6833	0.7919	0.8899
No log	8.65	346	0.8052	0.6833	0.8052	0.8973
No log	8.7	348	0.8225	0.6972	0.8225	0.9069
No log	8.75	350	0.8275	0.7046	0.8275	0.9097
No log	8.8	352	0.8262	0.7003	0.8262	0.9090
No log	8.85	354	0.8323	0.6905	0.8323	0.9123
No log	8.9	356	0.8494	0.6955	0.8494	0.9216
No log	8.95	358	0.8465	0.6916	0.8465	0.9201
No log	9.0	360	0.8314	0.6857	0.8314	0.9118
No log	9.05	362	0.8273	0.6732	0.8273	0.9096
No log	9.1	364	0.8293	0.6732	0.8293	0.9106
No log	9.15	366	0.8298	0.6732	0.8298	0.9110
No log	9.2	368	0.8284	0.6777	0.8284	0.9102
No log	9.25	370	0.8331	0.6688	0.8331	0.9127
No log	9.3	372	0.8359	0.6688	0.8359	0.9143
No log	9.35	374	0.8507	0.6590	0.8507	0.9223
No log	9.4	376	0.8594	0.6776	0.8594	0.9270
No log	9.45	378	0.8676	0.6867	0.8676	0.9314
No log	9.5	380	0.8796	0.6730	0.8796	0.9379
No log	9.55	382	0.8828	0.6730	0.8828	0.9396
No log	9.6	384	0.8828	0.6730	0.8828	0.9396
No log	9.65	386	0.8822	0.6730	0.8822	0.9393
No log	9.7	388	0.8820	0.6730	0.8820	0.9392
No log	9.75	390	0.8823	0.6730	0.8823	0.9393
No log	9.8	392	0.8864	0.6730	0.8864	0.9415
No log	9.85	394	0.8872	0.6730	0.8872	0.9419
No log	9.9	396	0.8850	0.6730	0.8850	0.9407
No log	9.95	398	0.8819	0.6730	0.8819	0.9391
No log	10.0	400	0.8802	0.6730	0.8802	0.9382

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1