ArabicNewSplits6_FineTuningAraBERT_run1_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0702
• Qwk: 0.5701
• Mse: 1.0702
• Rmse: 1.0345

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	2.1497	0.0024	2.1497	1.4662
No log	0.0833	4	1.5635	0.1309	1.5635	1.2504
No log	0.125	6	1.5759	0.1494	1.5759	1.2554
No log	0.1667	8	1.7944	0.0354	1.7944	1.3396
No log	0.2083	10	1.7510	0.0745	1.7510	1.3233
No log	0.25	12	1.8102	0.1464	1.8102	1.3454
No log	0.2917	14	1.7296	0.1055	1.7296	1.3151
No log	0.3333	16	1.6473	0.1548	1.6473	1.2835
No log	0.375	18	1.6545	0.1407	1.6545	1.2863
No log	0.4167	20	1.9419	0.2145	1.9419	1.3935
No log	0.4583	22	2.1758	0.2057	2.1758	1.4751
No log	0.5	24	2.0418	0.2205	2.0418	1.4289
No log	0.5417	26	1.6985	0.1792	1.6985	1.3033
No log	0.5833	28	1.4724	0.1999	1.4724	1.2134
No log	0.625	30	1.4554	0.2044	1.4554	1.2064
No log	0.6667	32	1.5335	0.1453	1.5335	1.2383
No log	0.7083	34	1.4683	0.1674	1.4683	1.2117
No log	0.75	36	1.3650	0.2521	1.3650	1.1683
No log	0.7917	38	1.3714	0.2156	1.3714	1.1711
No log	0.8333	40	1.6185	0.2766	1.6185	1.2722
No log	0.875	42	1.8201	0.2704	1.8201	1.3491
No log	0.9167	44	1.7945	0.2614	1.7945	1.3396
No log	0.9583	46	1.5974	0.2922	1.5974	1.2639
No log	1.0	48	1.3753	0.3190	1.3753	1.1727
No log	1.0417	50	1.2124	0.2998	1.2124	1.1011
No log	1.0833	52	1.3196	0.2455	1.3196	1.1488
No log	1.125	54	1.4081	0.2086	1.4081	1.1866
No log	1.1667	56	1.3419	0.2802	1.3419	1.1584
No log	1.2083	58	1.1732	0.3263	1.1732	1.0831
No log	1.25	60	1.1116	0.2980	1.1116	1.0543
No log	1.2917	62	1.1857	0.3067	1.1857	1.0889
No log	1.3333	64	1.2621	0.3486	1.2621	1.1234
No log	1.375	66	1.2936	0.3798	1.2936	1.1373
No log	1.4167	68	1.2225	0.3834	1.2225	1.1057
No log	1.4583	70	1.0649	0.4059	1.0649	1.0320
No log	1.5	72	1.0108	0.4308	1.0108	1.0054
No log	1.5417	74	0.9959	0.4471	0.9959	0.9979
No log	1.5833	76	0.9809	0.4944	0.9809	0.9904
No log	1.625	78	1.0242	0.4560	1.0242	1.0120
No log	1.6667	80	1.1831	0.4634	1.1831	1.0877
No log	1.7083	82	1.2420	0.4619	1.2420	1.1145
No log	1.75	84	1.2714	0.4568	1.2714	1.1276
No log	1.7917	86	1.3894	0.4429	1.3894	1.1787
No log	1.8333	88	1.4819	0.4680	1.4819	1.2173
No log	1.875	90	1.3545	0.4542	1.3545	1.1638
No log	1.9167	92	1.0785	0.4997	1.0785	1.0385
No log	1.9583	94	0.9836	0.5127	0.9836	0.9918
No log	2.0	96	0.9898	0.5024	0.9898	0.9949
No log	2.0417	98	1.0481	0.5078	1.0481	1.0237
No log	2.0833	100	1.1594	0.5161	1.1594	1.0768
No log	2.125	102	1.1272	0.5367	1.1272	1.0617
No log	2.1667	104	0.9755	0.5430	0.9755	0.9877
No log	2.2083	106	1.0269	0.5377	1.0269	1.0134
No log	2.25	108	1.1863	0.5622	1.1863	1.0892
No log	2.2917	110	1.2428	0.5270	1.2428	1.1148
No log	2.3333	112	1.0460	0.5755	1.0460	1.0227
No log	2.375	114	0.9013	0.5493	0.9013	0.9494
No log	2.4167	116	0.9378	0.5263	0.9378	0.9684
No log	2.4583	118	1.0667	0.5573	1.0667	1.0328
No log	2.5	120	1.3927	0.4745	1.3927	1.1801
No log	2.5417	122	1.5397	0.4650	1.5397	1.2408
No log	2.5833	124	1.4211	0.4797	1.4211	1.1921
No log	2.625	126	1.1434	0.5128	1.1434	1.0693
No log	2.6667	128	0.9754	0.5730	0.9754	0.9876
No log	2.7083	130	0.8745	0.5399	0.8745	0.9351
No log	2.75	132	0.8708	0.5476	0.8708	0.9332
No log	2.7917	134	0.9185	0.5446	0.9185	0.9584
No log	2.8333	136	0.9810	0.5792	0.9810	0.9905
No log	2.875	138	0.9375	0.5938	0.9375	0.9682
No log	2.9167	140	0.9844	0.5803	0.9844	0.9922
No log	2.9583	142	1.1480	0.6225	1.1480	1.0715
No log	3.0	144	1.0488	0.6356	1.0488	1.0241
No log	3.0417	146	0.7842	0.5974	0.7842	0.8855
No log	3.0833	148	0.7504	0.6383	0.7504	0.8662
No log	3.125	150	0.7848	0.5966	0.7848	0.8859
No log	3.1667	152	1.0178	0.6147	1.0178	1.0089
No log	3.2083	154	1.1100	0.5735	1.1100	1.0536
No log	3.25	156	0.9603	0.5949	0.9603	0.9800
No log	3.2917	158	0.9264	0.6109	0.9264	0.9625
No log	3.3333	160	0.8255	0.6033	0.8255	0.9086
No log	3.375	162	0.8446	0.6422	0.8446	0.9190
No log	3.4167	164	1.0131	0.6156	1.0131	1.0065
No log	3.4583	166	1.1787	0.6002	1.1787	1.0857
No log	3.5	168	1.1755	0.6115	1.1755	1.0842
No log	3.5417	170	0.9178	0.6420	0.9178	0.9580
No log	3.5833	172	0.7984	0.6420	0.7984	0.8935
No log	3.625	174	0.8712	0.6184	0.8712	0.9334
No log	3.6667	176	1.1349	0.6302	1.1349	1.0653
No log	3.7083	178	1.2215	0.5784	1.2215	1.1052
No log	3.75	180	1.0135	0.6344	1.0135	1.0067
No log	3.7917	182	0.8676	0.6445	0.8676	0.9315
No log	3.8333	184	0.8400	0.6417	0.8400	0.9165
No log	3.875	186	1.0124	0.6237	1.0124	1.0062
No log	3.9167	188	1.1803	0.6120	1.1803	1.0864
No log	3.9583	190	1.2638	0.5530	1.2638	1.1242
No log	4.0	192	1.1504	0.5858	1.1504	1.0726
No log	4.0417	194	1.0664	0.5880	1.0664	1.0327
No log	4.0833	196	0.9161	0.6428	0.9161	0.9571
No log	4.125	198	0.8886	0.6487	0.8886	0.9427
No log	4.1667	200	0.9733	0.6237	0.9733	0.9865
No log	4.2083	202	1.2156	0.5775	1.2156	1.1025
No log	4.25	204	1.2973	0.5639	1.2973	1.1390
No log	4.2917	206	1.1497	0.5997	1.1497	1.0722
No log	4.3333	208	0.9761	0.6250	0.9761	0.9880
No log	4.375	210	0.8896	0.6237	0.8896	0.9432
No log	4.4167	212	0.8936	0.6237	0.8936	0.9453
No log	4.4583	214	0.9469	0.6182	0.9469	0.9731
No log	4.5	216	1.1124	0.6143	1.1124	1.0547
No log	4.5417	218	1.2255	0.5687	1.2255	1.1070
No log	4.5833	220	1.1273	0.5957	1.1273	1.0618
No log	4.625	222	0.9363	0.6241	0.9363	0.9676
No log	4.6667	224	0.8129	0.6244	0.8129	0.9016
No log	4.7083	226	0.8340	0.6388	0.8340	0.9133
No log	4.75	228	0.9860	0.6399	0.9860	0.9930
No log	4.7917	230	1.2080	0.5908	1.2080	1.0991
No log	4.8333	232	1.4125	0.5735	1.4125	1.1885
No log	4.875	234	1.4518	0.5636	1.4518	1.2049
No log	4.9167	236	1.3435	0.5745	1.3435	1.1591
No log	4.9583	238	1.1602	0.5994	1.1602	1.0771
No log	5.0	240	0.9569	0.6320	0.9569	0.9782
No log	5.0417	242	0.8993	0.6118	0.8993	0.9483
No log	5.0833	244	0.9852	0.6136	0.9852	0.9926
No log	5.125	246	1.1440	0.6000	1.1440	1.0696
No log	5.1667	248	1.2733	0.5645	1.2733	1.1284
No log	5.2083	250	1.1525	0.6014	1.1525	1.0735
No log	5.25	252	1.0151	0.6243	1.0151	1.0075
No log	5.2917	254	0.8699	0.6731	0.8699	0.9327
No log	5.3333	256	0.8668	0.6731	0.8668	0.9310
No log	5.375	258	0.9421	0.6595	0.9421	0.9706
No log	5.4167	260	1.0874	0.6000	1.0874	1.0428
No log	5.4583	262	1.2729	0.5696	1.2729	1.1282
No log	5.5	264	1.2819	0.5523	1.2819	1.1322
No log	5.5417	266	1.1342	0.5459	1.1342	1.0650
No log	5.5833	268	0.9634	0.5579	0.9634	0.9815
No log	5.625	270	0.8736	0.6099	0.8736	0.9347
No log	5.6667	272	0.8683	0.6352	0.8683	0.9318
No log	5.7083	274	0.9423	0.5718	0.9423	0.9707
No log	5.75	276	1.1573	0.5766	1.1573	1.0758
No log	5.7917	278	1.3251	0.5401	1.3251	1.1511
No log	5.8333	280	1.3635	0.5393	1.3635	1.1677
No log	5.875	282	1.3230	0.5401	1.3230	1.1502
No log	5.9167	284	1.2475	0.5695	1.2475	1.1169
No log	5.9583	286	1.1855	0.5597	1.1855	1.0888
No log	6.0	288	1.1892	0.5246	1.1892	1.0905
No log	6.0417	290	1.1764	0.5078	1.1764	1.0846
No log	6.0833	292	1.1760	0.5160	1.1760	1.0844
No log	6.125	294	1.1800	0.5408	1.1800	1.0863
No log	6.1667	296	1.1021	0.5640	1.1021	1.0498
No log	6.2083	298	1.0185	0.6250	1.0185	1.0092
No log	6.25	300	1.0645	0.6110	1.0645	1.0317
No log	6.2917	302	1.2291	0.5745	1.2291	1.1087
No log	6.3333	304	1.2823	0.5852	1.2823	1.1324
No log	6.375	306	1.2453	0.5745	1.2453	1.1159
No log	6.4167	308	1.2159	0.5745	1.2159	1.1027
No log	6.4583	310	1.1955	0.5526	1.1955	1.0934
No log	6.5	312	1.0818	0.5702	1.0818	1.0401
No log	6.5417	314	1.0283	0.5905	1.0283	1.0141
No log	6.5833	316	1.0366	0.5546	1.0366	1.0182
No log	6.625	318	1.0759	0.5257	1.0759	1.0372
No log	6.6667	320	1.0808	0.5053	1.0808	1.0396
No log	6.7083	322	1.1475	0.5086	1.1475	1.0712
No log	6.75	324	1.2672	0.5089	1.2672	1.1257
No log	6.7917	326	1.3161	0.5104	1.3161	1.1472
No log	6.8333	328	1.3026	0.5104	1.3026	1.1413
No log	6.875	330	1.1952	0.5416	1.1952	1.0933
No log	6.9167	332	1.0501	0.5862	1.0501	1.0247
No log	6.9583	334	0.9368	0.6237	0.9368	0.9679
No log	7.0	336	0.8514	0.6364	0.8514	0.9227
No log	7.0417	338	0.8369	0.6397	0.8369	0.9148
No log	7.0833	340	0.8612	0.6364	0.8612	0.9280
No log	7.125	342	0.9455	0.6237	0.9455	0.9724
No log	7.1667	344	1.0682	0.5701	1.0682	1.0336
No log	7.2083	346	1.1377	0.5623	1.1377	1.0666
No log	7.25	348	1.1219	0.5620	1.1219	1.0592
No log	7.2917	350	1.0252	0.5820	1.0252	1.0125
No log	7.3333	352	0.8981	0.6338	0.8981	0.9477
No log	7.375	354	0.8122	0.6457	0.8122	0.9012
No log	7.4167	356	0.7943	0.6385	0.7943	0.8912
No log	7.4583	358	0.8223	0.6467	0.8223	0.9068
No log	7.5	360	0.8778	0.6300	0.8778	0.9369
No log	7.5417	362	0.9340	0.6172	0.9340	0.9664
No log	7.5833	364	1.0065	0.6379	1.0065	1.0032
No log	7.625	366	1.0892	0.6047	1.0892	1.0436
No log	7.6667	368	1.1294	0.5928	1.1294	1.0628
No log	7.7083	370	1.1375	0.5664	1.1375	1.0666
No log	7.75	372	1.1181	0.5869	1.1181	1.0574
No log	7.7917	374	1.0991	0.5944	1.0991	1.0484
No log	7.8333	376	1.0908	0.5882	1.0908	1.0444
No log	7.875	378	1.0972	0.5944	1.0972	1.0475
No log	7.9167	380	1.0575	0.6010	1.0575	1.0284
No log	7.9583	382	0.9938	0.6240	0.9938	0.9969
No log	8.0	384	0.9963	0.6240	0.9963	0.9982
No log	8.0417	386	1.0171	0.6029	1.0171	1.0085
No log	8.0833	388	1.0678	0.5882	1.0678	1.0333
No log	8.125	390	1.1129	0.5933	1.1129	1.0549
No log	8.1667	392	1.1107	0.5933	1.1107	1.0539
No log	8.2083	394	1.0868	0.5882	1.0868	1.0425
No log	8.25	396	1.0607	0.5980	1.0607	1.0299
No log	8.2917	398	1.0609	0.5980	1.0609	1.0300
No log	8.3333	400	1.0720	0.5818	1.0720	1.0354
No log	8.375	402	1.0533	0.5754	1.0533	1.0263
No log	8.4167	404	1.0136	0.5821	1.0136	1.0068
No log	8.4583	406	0.9708	0.5868	0.9708	0.9853
No log	8.5	408	0.9646	0.6087	0.9646	0.9822
No log	8.5417	410	0.9876	0.5923	0.9876	0.9938
No log	8.5833	412	1.0370	0.5883	1.0370	1.0183
No log	8.625	414	1.0748	0.5701	1.0748	1.0367
No log	8.6667	416	1.1126	0.5617	1.1126	1.0548
No log	8.7083	418	1.1303	0.5662	1.1303	1.0632
No log	8.75	420	1.1203	0.5662	1.1203	1.0584
No log	8.7917	422	1.1120	0.5671	1.1120	1.0545
No log	8.8333	424	1.0860	0.5701	1.0860	1.0421
No log	8.875	426	1.0688	0.5755	1.0688	1.0338
No log	8.9167	428	1.0681	0.5733	1.0681	1.0335
No log	8.9583	430	1.0511	0.5633	1.0511	1.0252
No log	9.0	432	1.0138	0.5928	1.0138	1.0069
No log	9.0417	434	0.9961	0.5905	0.9961	0.9980
No log	9.0833	436	0.9977	0.5905	0.9977	0.9989
No log	9.125	438	1.0164	0.5859	1.0164	1.0081
No log	9.1667	440	1.0220	0.5880	1.0220	1.0109
No log	9.2083	442	1.0173	0.5880	1.0173	1.0086
No log	9.25	444	1.0198	0.5880	1.0198	1.0099
No log	9.2917	446	1.0329	0.5948	1.0329	1.0163
No log	9.3333	448	1.0459	0.5721	1.0459	1.0227
No log	9.375	450	1.0446	0.5777	1.0446	1.0221
No log	9.4167	452	1.0478	0.5777	1.0478	1.0236
No log	9.4583	454	1.0555	0.5654	1.0555	1.0274
No log	9.5	456	1.0635	0.5537	1.0635	1.0313
No log	9.5417	458	1.0762	0.5701	1.0762	1.0374
No log	9.5833	460	1.0794	0.5701	1.0794	1.0390
No log	9.625	462	1.0765	0.5701	1.0765	1.0375
No log	9.6667	464	1.0744	0.5701	1.0744	1.0365
No log	9.7083	466	1.0691	0.5701	1.0691	1.0340
No log	9.75	468	1.0708	0.5701	1.0708	1.0348
No log	9.7917	470	1.0710	0.5701	1.0710	1.0349
No log	9.8333	472	1.0691	0.5701	1.0691	1.0340
No log	9.875	474	1.0699	0.5701	1.0699	1.0343
No log	9.9167	476	1.0707	0.5701	1.0707	1.0347
No log	9.9583	478	1.0701	0.5701	1.0701	1.0345
No log	10.0	480	1.0702	0.5701	1.0702	1.0345

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1