ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k5_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3018
• Qwk: 0.5806
• Mse: 1.3018
• Rmse: 1.1410

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.08	2	6.6690	0.0308	6.6690	2.5824
No log	0.16	4	4.3094	0.0917	4.3094	2.0759
No log	0.24	6	3.2482	0.0476	3.2482	1.8023
No log	0.32	8	2.3205	0.1408	2.3205	1.5233
No log	0.4	10	1.8868	0.1525	1.8868	1.3736
No log	0.48	12	1.6747	0.1852	1.6747	1.2941
No log	0.56	14	1.5528	0.1852	1.5528	1.2461
No log	0.64	16	1.5107	0.1869	1.5107	1.2291
No log	0.72	18	1.5853	0.1869	1.5853	1.2591
No log	0.8	20	1.5153	0.2037	1.5153	1.2310
No log	0.88	22	1.4809	0.2075	1.4809	1.2169
No log	0.96	24	1.5390	0.1714	1.5390	1.2406
No log	1.04	26	1.6811	0.1538	1.6811	1.2966
No log	1.12	28	1.6477	0.1524	1.6477	1.2836
No log	1.2	30	1.7802	0.3009	1.7802	1.3342
No log	1.28	32	1.6142	0.2857	1.6142	1.2705
No log	1.3600	34	1.6344	0.3559	1.6344	1.2784
No log	1.44	36	1.5307	0.2679	1.5307	1.2372
No log	1.52	38	1.4993	0.2222	1.4993	1.2245
No log	1.6	40	1.3836	0.2593	1.3836	1.1762
No log	1.6800	42	1.2327	0.4483	1.2327	1.1103
No log	1.76	44	1.1781	0.4715	1.1781	1.0854
No log	1.8400	46	1.2647	0.4754	1.2647	1.1246
No log	1.92	48	1.5790	0.2456	1.5790	1.2566
No log	2.0	50	1.5261	0.25	1.5261	1.2353
No log	2.08	52	1.3374	0.3622	1.3374	1.1565
No log	2.16	54	1.2886	0.4812	1.2886	1.1351
No log	2.24	56	1.2222	0.5333	1.2222	1.1055
No log	2.32	58	1.3035	0.5263	1.3035	1.1417
No log	2.4	60	1.3941	0.4341	1.3941	1.1807
No log	2.48	62	1.4997	0.3902	1.4997	1.2246
No log	2.56	64	1.5833	0.3780	1.5833	1.2583
No log	2.64	66	1.5852	0.2881	1.5852	1.2591
No log	2.7200	68	1.5673	0.3036	1.5673	1.2519
No log	2.8	70	1.4260	0.4667	1.4260	1.1942
No log	2.88	72	1.4084	0.5197	1.4084	1.1867
No log	2.96	74	1.3687	0.5039	1.3687	1.1699
No log	3.04	76	1.2246	0.5556	1.2246	1.1066
No log	3.12	78	1.0400	0.5600	1.0400	1.0198
No log	3.2	80	1.0031	0.5968	1.0031	1.0015
No log	3.2800	82	0.9922	0.5827	0.9922	0.9961
No log	3.36	84	1.0713	0.6107	1.0713	1.0350
No log	3.44	86	1.1463	0.5970	1.1463	1.0706
No log	3.52	88	1.2492	0.5441	1.2492	1.1177
No log	3.6	90	1.2044	0.5649	1.2044	1.0974
No log	3.68	92	1.0508	0.5954	1.0508	1.0251
No log	3.76	94	0.8825	0.6667	0.8825	0.9394
No log	3.84	96	0.9666	0.6364	0.9666	0.9831
No log	3.92	98	1.1275	0.5271	1.1275	1.0618
No log	4.0	100	1.0791	0.5736	1.0791	1.0388
No log	4.08	102	1.0378	0.6119	1.0378	1.0187
No log	4.16	104	1.2555	0.5303	1.2555	1.1205
No log	4.24	106	1.4778	0.4615	1.4778	1.2156
No log	4.32	108	1.5212	0.3089	1.5212	1.2334
No log	4.4	110	1.3708	0.4769	1.3708	1.1708
No log	4.48	112	1.3281	0.4741	1.3281	1.1524
No log	4.5600	114	1.3034	0.4348	1.3034	1.1417
No log	4.64	116	1.2575	0.4672	1.2575	1.1214
No log	4.72	118	1.0669	0.6061	1.0669	1.0329
No log	4.8	120	1.0227	0.6277	1.0227	1.0113
No log	4.88	122	1.0562	0.5839	1.0562	1.0277
No log	4.96	124	1.1412	0.5694	1.1412	1.0683
No log	5.04	126	1.1766	0.5493	1.1766	1.0847
No log	5.12	128	1.1317	0.5634	1.1317	1.0638
No log	5.2	130	1.1465	0.6029	1.1465	1.0708
No log	5.28	132	1.1967	0.5038	1.1967	1.0939
No log	5.36	134	1.1580	0.5672	1.1580	1.0761
No log	5.44	136	1.0385	0.6277	1.0385	1.0191
No log	5.52	138	0.8889	0.6525	0.8889	0.9428
No log	5.6	140	0.7922	0.6667	0.7922	0.8901
No log	5.68	142	0.8248	0.6714	0.8248	0.9082
No log	5.76	144	0.9896	0.6286	0.9896	0.9948
No log	5.84	146	1.2172	0.5241	1.2172	1.1033
No log	5.92	148	1.4117	0.4965	1.4117	1.1882
No log	6.0	150	1.5471	0.4366	1.5471	1.2438
No log	6.08	152	1.7228	0.4348	1.7228	1.3126
No log	6.16	154	1.6315	0.5341	1.6315	1.2773
No log	6.24	156	1.3447	0.6071	1.3447	1.1596
No log	6.32	158	1.0253	0.5714	1.0253	1.0126
No log	6.4	160	0.8317	0.6667	0.8317	0.9120
No log	6.48	162	0.9441	0.6309	0.9441	0.9717
No log	6.5600	164	0.9428	0.6351	0.9428	0.9710
No log	6.64	166	0.8568	0.6667	0.8568	0.9257
No log	6.72	168	0.9583	0.5865	0.9583	0.9789
No log	6.8	170	1.2216	0.5224	1.2216	1.1053
No log	6.88	172	1.3212	0.4496	1.3212	1.1494
No log	6.96	174	1.3829	0.4496	1.3829	1.1760
No log	7.04	176	1.3719	0.3937	1.3719	1.1713
No log	7.12	178	1.4500	0.4733	1.4500	1.2041
No log	7.2	180	1.5594	0.4173	1.5594	1.2488
No log	7.28	182	1.5768	0.4295	1.5768	1.2557
No log	7.36	184	1.2899	0.5	1.2899	1.1357
No log	7.44	186	0.9475	0.6316	0.9475	0.9734
No log	7.52	188	0.8623	0.6316	0.8623	0.9286
No log	7.6	190	0.8341	0.6569	0.8341	0.9133
No log	7.68	192	0.9374	0.6324	0.9374	0.9682
No log	7.76	194	1.0217	0.5970	1.0217	1.0108
No log	7.84	196	1.0016	0.6260	1.0016	1.0008
No log	7.92	198	1.0185	0.6260	1.0185	1.0092
No log	8.0	200	1.0926	0.5821	1.0926	1.0453
No log	8.08	202	1.1356	0.5797	1.1356	1.0657
No log	8.16	204	1.2046	0.5429	1.2046	1.0975
No log	8.24	206	1.2387	0.5180	1.2387	1.1129
No log	8.32	208	1.1053	0.5865	1.1053	1.0513
No log	8.4	210	1.1143	0.5970	1.1143	1.0556
No log	8.48	212	1.3027	0.5	1.3027	1.1413
No log	8.56	214	1.3446	0.4286	1.3446	1.1596
No log	8.64	216	1.2670	0.4571	1.2670	1.1256
No log	8.72	218	1.2507	0.5395	1.2507	1.1184
No log	8.8	220	1.1570	0.5906	1.1570	1.0756
No log	8.88	222	1.0894	0.5957	1.0894	1.0438
No log	8.96	224	1.0606	0.5778	1.0606	1.0299
No log	9.04	226	1.1189	0.5652	1.1189	1.0578
No log	9.12	228	1.0987	0.6	1.0987	1.0482
No log	9.2	230	1.0140	0.6277	1.0140	1.0070
No log	9.28	232	0.9413	0.6269	0.9413	0.9702
No log	9.36	234	0.9365	0.6466	0.9365	0.9677
No log	9.44	236	0.9578	0.6618	0.9578	0.9787
No log	9.52	238	1.0300	0.6	1.0300	1.0149
No log	9.6	240	1.0824	0.6069	1.0824	1.0404
No log	9.68	242	1.0993	0.5655	1.0993	1.0485
No log	9.76	244	1.1983	0.5806	1.1983	1.0947
No log	9.84	246	1.1890	0.6061	1.1890	1.0904
No log	9.92	248	1.0695	0.6012	1.0695	1.0342
No log	10.0	250	0.9222	0.6928	0.9222	0.9603
No log	10.08	252	0.8754	0.6667	0.8754	0.9356
No log	10.16	254	0.9541	0.6383	0.9541	0.9768
No log	10.24	256	1.0651	0.6014	1.0651	1.0320
No log	10.32	258	1.1518	0.5493	1.1518	1.0732
No log	10.4	260	1.1954	0.4892	1.1954	1.0934
No log	10.48	262	1.2352	0.4818	1.2352	1.1114
No log	10.56	264	1.2041	0.5455	1.2041	1.0973
No log	10.64	266	1.1771	0.5455	1.1771	1.0850
No log	10.72	268	1.2332	0.5	1.2332	1.1105
No log	10.8	270	1.2667	0.4783	1.2667	1.1255
No log	10.88	272	1.2442	0.4783	1.2442	1.1154
No log	10.96	274	1.1299	0.5630	1.1299	1.0630
No log	11.04	276	0.9644	0.6269	0.9644	0.9820
No log	11.12	278	0.8921	0.6423	0.8921	0.9445
No log	11.2	280	0.9372	0.6232	0.9372	0.9681
No log	11.28	282	1.0344	0.6	1.0344	1.0171
No log	11.36	284	1.1742	0.5563	1.1742	1.0836
No log	11.44	286	1.3420	0.5767	1.3420	1.1584
No log	11.52	288	1.2919	0.5767	1.2919	1.1366
No log	11.6	290	1.0703	0.5775	1.0703	1.0346
No log	11.68	292	0.8823	0.5970	0.8823	0.9393
No log	11.76	294	0.8998	0.5865	0.8998	0.9486
No log	11.84	296	1.0098	0.6154	1.0098	1.0049
No log	11.92	298	1.2158	0.5860	1.2158	1.1026
No log	12.0	300	1.3028	0.6265	1.3028	1.1414
No log	12.08	302	1.2604	0.6154	1.2604	1.1227
No log	12.16	304	1.1619	0.5897	1.1619	1.0779
No log	12.24	306	1.0229	0.5714	1.0229	1.0114
No log	12.32	308	0.8993	0.6176	0.8993	0.9483
No log	12.4	310	0.8863	0.6074	0.8863	0.9414
No log	12.48	312	0.9103	0.6015	0.9103	0.9541
No log	12.56	314	0.9685	0.6222	0.9685	0.9841
No log	12.64	316	1.0510	0.5926	1.0510	1.0252
No log	12.72	318	1.1852	0.5735	1.1852	1.0887
No log	12.8	320	1.2581	0.5	1.2581	1.1216
No log	12.88	322	1.2251	0.5109	1.2251	1.1068
No log	12.96	324	1.0917	0.5882	1.0917	1.0448
No log	13.04	326	0.9994	0.5926	0.9994	0.9997
No log	13.12	328	0.9871	0.5926	0.9871	0.9935
No log	13.2	330	1.0093	0.5926	1.0093	1.0047
No log	13.28	332	1.1419	0.5547	1.1419	1.0686
No log	13.36	334	1.2938	0.5306	1.2938	1.1374
No log	13.44	336	1.3110	0.5270	1.3110	1.1450
No log	13.52	338	1.1678	0.5493	1.1678	1.0807
No log	13.6	340	0.9681	0.6429	0.9681	0.9839
No log	13.68	342	0.8724	0.6713	0.8724	0.9340
No log	13.76	344	0.8712	0.6715	0.8712	0.9334
No log	13.84	346	0.9036	0.6715	0.9036	0.9506
No log	13.92	348	0.9301	0.6154	0.9301	0.9644
No log	14.0	350	0.9424	0.6047	0.9424	0.9708
No log	14.08	352	0.9589	0.6	0.9589	0.9792
No log	14.16	354	0.9430	0.5938	0.9430	0.9711
No log	14.24	356	0.9307	0.6047	0.9307	0.9647
No log	14.32	358	0.9375	0.5714	0.9375	0.9682
No log	14.4	360	0.9784	0.6232	0.9784	0.9891
No log	14.48	362	0.9635	0.6197	0.9635	0.9816
No log	14.56	364	0.8599	0.6761	0.8599	0.9273
No log	14.64	366	0.7817	0.6809	0.7817	0.8842
No log	14.72	368	0.7730	0.6809	0.7730	0.8792
No log	14.8	370	0.8073	0.6667	0.8073	0.8985
No log	14.88	372	0.8258	0.6618	0.8258	0.9087
No log	14.96	374	0.8344	0.6618	0.8344	0.9134
No log	15.04	376	0.8559	0.6471	0.8559	0.9252
No log	15.12	378	0.8452	0.6471	0.8452	0.9193
No log	15.2	380	0.8505	0.6571	0.8505	0.9222
No log	15.28	382	0.8764	0.6619	0.8764	0.9361
No log	15.36	384	0.8558	0.6377	0.8558	0.9251
No log	15.44	386	0.8014	0.6471	0.8014	0.8952
No log	15.52	388	0.7658	0.6957	0.7658	0.8751
No log	15.6	390	0.7765	0.6861	0.7765	0.8812
No log	15.68	392	0.8209	0.6667	0.8209	0.9061
No log	15.76	394	0.9362	0.6377	0.9362	0.9676
No log	15.84	396	1.1151	0.5833	1.1151	1.0560
No log	15.92	398	1.3171	0.5621	1.3171	1.1476
No log	16.0	400	1.3127	0.5658	1.3127	1.1457
No log	16.08	402	1.2071	0.5693	1.2071	1.0987
No log	16.16	404	1.0955	0.5714	1.0955	1.0467
No log	16.24	406	1.0765	0.5985	1.0765	1.0376
No log	16.32	408	1.0521	0.6056	1.0521	1.0257
No log	16.4	410	1.0028	0.6286	1.0028	1.0014
No log	16.48	412	0.9608	0.6377	0.9608	0.9802
No log	16.56	414	0.8788	0.6619	0.8788	0.9375
No log	16.64	416	0.7790	0.7042	0.7790	0.8826
No log	16.72	418	0.7612	0.7042	0.7612	0.8725
No log	16.8	420	0.8554	0.6619	0.8554	0.9249
No log	16.88	422	0.9443	0.6187	0.9443	0.9717
No log	16.96	424	1.0971	0.5811	1.0971	1.0474
No log	17.04	426	1.0593	0.6131	1.0593	1.0292
No log	17.12	428	0.9984	0.6061	0.9984	0.9992
No log	17.2	430	0.9565	0.6364	0.9565	0.9780
No log	17.28	432	0.9344	0.6260	0.9344	0.9666
No log	17.36	434	0.9227	0.6308	0.9227	0.9606
No log	17.44	436	0.8748	0.6412	0.8748	0.9353
No log	17.52	438	0.8808	0.6	0.8808	0.9385
No log	17.6	440	0.9394	0.6301	0.9394	0.9692
No log	17.68	442	0.9928	0.6792	0.9928	0.9964
No log	17.76	444	0.9585	0.6923	0.9585	0.9790
No log	17.84	446	0.8527	0.6087	0.8527	0.9234
No log	17.92	448	0.8009	0.6412	0.8009	0.8949
No log	18.0	450	0.8162	0.6212	0.8162	0.9034
No log	18.08	452	0.8847	0.6222	0.8847	0.9406
No log	18.16	454	0.9472	0.5985	0.9472	0.9732
No log	18.24	456	0.9918	0.6029	0.9918	0.9959
No log	18.32	458	1.0139	0.5865	1.0139	1.0069
No log	18.4	460	0.9936	0.5865	0.9936	0.9968
No log	18.48	462	0.9556	0.5954	0.9556	0.9775
No log	18.56	464	0.9433	0.6212	0.9433	0.9712
No log	18.64	466	0.9281	0.6412	0.9281	0.9634
No log	18.72	468	0.9318	0.5865	0.9318	0.9653
No log	18.8	470	0.9438	0.6029	0.9438	0.9715
No log	18.88	472	1.0369	0.5833	1.0369	1.0183
No log	18.96	474	1.1054	0.6497	1.1054	1.0514
No log	19.04	476	1.0342	0.6538	1.0342	1.0169
No log	19.12	478	0.9062	0.6483	0.9062	0.9519
No log	19.2	480	0.8158	0.6892	0.8158	0.9032
No log	19.28	482	0.7742	0.7133	0.7742	0.8799
No log	19.36	484	0.7801	0.7133	0.7801	0.8832
No log	19.44	486	0.8400	0.6944	0.8400	0.9165
No log	19.52	488	0.9422	0.6294	0.9422	0.9707
No log	19.6	490	1.0410	0.6111	1.0410	1.0203
No log	19.68	492	1.0426	0.6197	1.0426	1.0211
No log	19.76	494	1.0632	0.6277	1.0632	1.0311
No log	19.84	496	1.0997	0.5985	1.0997	1.0487
No log	19.92	498	1.0947	0.6029	1.0947	1.0463
0.4262	20.0	500	1.0512	0.6277	1.0512	1.0253
0.4262	20.08	502	0.9950	0.6364	0.9950	0.9975
0.4262	20.16	504	0.9875	0.6269	0.9875	0.9938
0.4262	20.24	506	1.0251	0.6176	1.0251	1.0125
0.4262	20.32	508	1.0657	0.5986	1.0657	1.0323
0.4262	20.4	510	1.0184	0.6111	1.0184	1.0092
0.4262	20.48	512	0.9463	0.6618	0.9463	0.9728
0.4262	20.56	514	0.8737	0.6667	0.8737	0.9347
0.4262	20.64	516	0.8159	0.6815	0.8159	0.9033
0.4262	20.72	518	0.7952	0.6815	0.7952	0.8917
0.4262	20.8	520	0.8006	0.6912	0.8006	0.8948
0.4262	20.88	522	0.8944	0.6531	0.8944	0.9458
0.4262	20.96	524	1.0460	0.6467	1.0460	1.0228
0.4262	21.04	526	1.0349	0.6013	1.0349	1.0173
0.4262	21.12	528	0.9127	0.6377	0.9127	0.9553
0.4262	21.2	530	0.8599	0.6667	0.8599	0.9273
0.4262	21.28	532	0.8806	0.6667	0.8806	0.9384
0.4262	21.36	534	0.9228	0.6222	0.9228	0.9606
0.4262	21.44	536	0.9750	0.5797	0.9750	0.9874
0.4262	21.52	538	1.1101	0.6225	1.1101	1.0536
0.4262	21.6	540	1.2513	0.6173	1.2513	1.1186
0.4262	21.68	542	1.3018	0.5806	1.3018	1.1410

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1