ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k15_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9658
• Qwk: 0.6862
• Mse: 0.9658
• Rmse: 0.9827

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	2.2453	0.0370	2.2453	1.4984
No log	0.0727	4	1.4327	0.2091	1.4327	1.1970
No log	0.1091	6	1.3899	0.1595	1.3899	1.1789
No log	0.1455	8	1.7154	0.2212	1.7154	1.3097
No log	0.1818	10	1.6875	0.1571	1.6875	1.2990
No log	0.2182	12	1.5447	0.1456	1.5447	1.2429
No log	0.2545	14	1.4835	0.1283	1.4835	1.2180
No log	0.2909	16	1.4502	0.1283	1.4502	1.2042
No log	0.3273	18	1.4372	0.0859	1.4372	1.1988
No log	0.3636	20	1.4336	0.0645	1.4336	1.1973
No log	0.4	22	1.4076	0.0859	1.4076	1.1864
No log	0.4364	24	1.3912	0.1071	1.3912	1.1795
No log	0.4727	26	1.3440	0.1071	1.3440	1.1593
No log	0.5091	28	1.3451	0.1343	1.3451	1.1598
No log	0.5455	30	1.3615	0.2632	1.3615	1.1668
No log	0.5818	32	1.3466	0.1865	1.3466	1.1604
No log	0.6182	34	1.3278	0.1931	1.3278	1.1523
No log	0.6545	36	1.4267	0.3055	1.4267	1.1945
No log	0.6909	38	1.6309	0.3294	1.6309	1.2771
No log	0.7273	40	1.6769	0.3182	1.6769	1.2950
No log	0.7636	42	1.3207	0.3603	1.3207	1.1492
No log	0.8	44	1.2401	0.2833	1.2401	1.1136
No log	0.8364	46	1.3308	0.3054	1.3308	1.1536
No log	0.8727	48	1.2311	0.3166	1.2311	1.1096
No log	0.9091	50	1.1445	0.3375	1.1445	1.0698
No log	0.9455	52	1.3741	0.3490	1.3741	1.1722
No log	0.9818	54	1.5550	0.3367	1.5550	1.2470
No log	1.0182	56	1.4816	0.2989	1.4816	1.2172
No log	1.0545	58	1.2843	0.2898	1.2843	1.1333
No log	1.0909	60	1.1899	0.3086	1.1899	1.0908
No log	1.1273	62	1.2334	0.2603	1.2334	1.1106
No log	1.1636	64	1.1775	0.2820	1.1775	1.0851
No log	1.2	66	1.1483	0.2667	1.1483	1.0716
No log	1.2364	68	1.2233	0.3056	1.2233	1.1060
No log	1.2727	70	1.3033	0.3691	1.3033	1.1416
No log	1.3091	72	1.3503	0.4742	1.3503	1.1620
No log	1.3455	74	1.3999	0.4227	1.3999	1.1832
No log	1.3818	76	1.3743	0.4019	1.3743	1.1723
No log	1.4182	78	1.2277	0.4384	1.2277	1.1080
No log	1.4545	80	1.1177	0.3778	1.1177	1.0572
No log	1.4909	82	1.0525	0.4460	1.0525	1.0259
No log	1.5273	84	1.0017	0.4818	1.0017	1.0008
No log	1.5636	86	0.9741	0.5267	0.9741	0.9870
No log	1.6	88	1.0266	0.5376	1.0266	1.0132
No log	1.6364	90	1.0700	0.5393	1.0700	1.0344
No log	1.6727	92	0.9774	0.5273	0.9774	0.9886
No log	1.7091	94	0.9599	0.5576	0.9599	0.9797
No log	1.7455	96	0.9649	0.5524	0.9649	0.9823
No log	1.7818	98	1.0923	0.5854	1.0923	1.0451
No log	1.8182	100	1.3236	0.4811	1.3236	1.1505
No log	1.8545	102	1.3186	0.4597	1.3186	1.1483
No log	1.8909	104	1.1309	0.5507	1.1309	1.0634
No log	1.9273	106	0.9688	0.5697	0.9688	0.9843
No log	1.9636	108	0.9287	0.5480	0.9287	0.9637
No log	2.0	110	0.9155	0.5850	0.9155	0.9568
No log	2.0364	112	0.9439	0.5528	0.9439	0.9716
No log	2.0727	114	0.9965	0.5027	0.9965	0.9983
No log	2.1091	116	1.1356	0.5003	1.1356	1.0657
No log	2.1455	118	1.2031	0.5105	1.2031	1.0969
No log	2.1818	120	1.0027	0.5802	1.0027	1.0013
No log	2.2182	122	0.9428	0.5791	0.9428	0.9710
No log	2.2545	124	0.9734	0.5802	0.9734	0.9866
No log	2.2909	126	0.9158	0.5917	0.9158	0.9570
No log	2.3273	128	0.9891	0.5589	0.9891	0.9945
No log	2.3636	130	1.2393	0.5295	1.2393	1.1133
No log	2.4	132	1.4200	0.5169	1.4200	1.1916
No log	2.4364	134	1.2798	0.5746	1.2798	1.1313
No log	2.4727	136	1.0010	0.5939	1.0010	1.0005
No log	2.5091	138	0.9602	0.6077	0.9602	0.9799
No log	2.5455	140	1.0535	0.6364	1.0535	1.0264
No log	2.5818	142	1.3492	0.5312	1.3492	1.1615
No log	2.6182	144	1.5619	0.4976	1.5619	1.2497
No log	2.6545	146	1.6355	0.4474	1.6355	1.2789
No log	2.6909	148	1.4750	0.4739	1.4750	1.2145
No log	2.7273	150	1.2620	0.5587	1.2620	1.1234
No log	2.7636	152	1.0937	0.5867	1.0937	1.0458
No log	2.8	154	0.9934	0.6267	0.9934	0.9967
No log	2.8364	156	0.9719	0.6273	0.9719	0.9859
No log	2.8727	158	1.0746	0.6451	1.0746	1.0367
No log	2.9091	160	1.1260	0.6354	1.1260	1.0611
No log	2.9455	162	1.0244	0.6364	1.0244	1.0121
No log	2.9818	164	0.8993	0.6449	0.8993	0.9483
No log	3.0182	166	0.9877	0.6093	0.9877	0.9938
No log	3.0545	168	1.0669	0.6121	1.0669	1.0329
No log	3.0909	170	1.2198	0.6002	1.2198	1.1045
No log	3.1273	172	1.2913	0.5697	1.2913	1.1363
No log	3.1636	174	1.1909	0.6339	1.1909	1.0913
No log	3.2	176	0.9149	0.6963	0.9149	0.9565
No log	3.2364	178	0.7903	0.6863	0.7903	0.8890
No log	3.2727	180	0.7730	0.6829	0.7730	0.8792
No log	3.3091	182	0.8216	0.6954	0.8216	0.9064
No log	3.3455	184	0.8956	0.6793	0.8956	0.9463
No log	3.3818	186	0.8932	0.6669	0.8932	0.9451
No log	3.4182	188	0.8398	0.6722	0.8398	0.9164
No log	3.4545	190	0.9343	0.6130	0.9343	0.9666
No log	3.4909	192	1.1841	0.5861	1.1841	1.0881
No log	3.5273	194	1.4000	0.5046	1.4000	1.1832
No log	3.5636	196	1.3887	0.5125	1.3887	1.1784
No log	3.6	198	1.1908	0.5690	1.1908	1.0912
No log	3.6364	200	0.9456	0.5933	0.9456	0.9724
No log	3.6727	202	0.8591	0.6175	0.8591	0.9269
No log	3.7091	204	0.8710	0.6234	0.8710	0.9333
No log	3.7455	206	0.9551	0.6091	0.9551	0.9773
No log	3.7818	208	1.1267	0.6158	1.1267	1.0615
No log	3.8182	210	1.3735	0.5587	1.3735	1.1720
No log	3.8545	212	1.4552	0.5690	1.4552	1.2063
No log	3.8909	214	1.2720	0.6295	1.2720	1.1278
No log	3.9273	216	0.9987	0.6579	0.9987	0.9993
No log	3.9636	218	0.8241	0.6775	0.8241	0.9078
No log	4.0	220	0.8343	0.6555	0.8343	0.9134
No log	4.0364	222	0.9790	0.6213	0.9790	0.9895
No log	4.0727	224	1.1424	0.6044	1.1424	1.0688
No log	4.1091	226	1.1005	0.5921	1.1005	1.0490
No log	4.1455	228	0.9005	0.6114	0.9005	0.9490
No log	4.1818	230	0.7905	0.6159	0.7905	0.8891
No log	4.2182	232	0.8231	0.6086	0.8231	0.9073
No log	4.2545	234	0.9425	0.6167	0.9425	0.9708
No log	4.2909	236	1.0982	0.5819	1.0982	1.0480
No log	4.3273	238	1.1524	0.5808	1.1524	1.0735
No log	4.3636	240	1.1241	0.5808	1.1241	1.0603
No log	4.4	242	1.1047	0.5965	1.1047	1.0510
No log	4.4364	244	1.1673	0.5850	1.1673	1.0804
No log	4.4727	246	1.2871	0.5518	1.2871	1.1345
No log	4.5091	248	1.2995	0.5370	1.2995	1.1400
No log	4.5455	250	1.1759	0.5619	1.1759	1.0844
No log	4.5818	252	1.1688	0.5745	1.1688	1.0811
No log	4.6182	254	1.1699	0.5745	1.1699	1.0816
No log	4.6545	256	1.2243	0.5544	1.2243	1.1065
No log	4.6909	258	1.1866	0.5505	1.1866	1.0893
No log	4.7273	260	1.1148	0.5664	1.1148	1.0558
No log	4.7636	262	1.0288	0.6117	1.0288	1.0143
No log	4.8	264	1.0790	0.5976	1.0790	1.0387
No log	4.8364	266	1.2702	0.5541	1.2702	1.1270
No log	4.8727	268	1.4952	0.5058	1.4952	1.2228
No log	4.9091	270	1.5313	0.5111	1.5313	1.2375
No log	4.9455	272	1.3882	0.5117	1.3882	1.1782
No log	4.9818	274	1.1208	0.6183	1.1208	1.0587
No log	5.0182	276	0.8694	0.6605	0.8694	0.9324
No log	5.0545	278	0.7892	0.6617	0.7892	0.8883
No log	5.0909	280	0.8076	0.6538	0.8076	0.8987
No log	5.1273	282	0.9115	0.6440	0.9115	0.9547
No log	5.1636	284	1.1190	0.5958	1.1190	1.0578
No log	5.2	286	1.2911	0.5364	1.2911	1.1363
No log	5.2364	288	1.2797	0.5483	1.2797	1.1312
No log	5.2727	290	1.1161	0.6090	1.1161	1.0565
No log	5.3091	292	0.9271	0.6540	0.9271	0.9629
No log	5.3455	294	0.8617	0.6958	0.8617	0.9283
No log	5.3818	296	0.8925	0.6754	0.8925	0.9447
No log	5.4182	298	0.9179	0.6745	0.9179	0.9581
No log	5.4545	300	0.9724	0.6759	0.9724	0.9861
No log	5.4909	302	0.9997	0.6538	0.9997	0.9998
No log	5.5273	304	0.9698	0.6538	0.9698	0.9848
No log	5.5636	306	0.9926	0.6618	0.9926	0.9963
No log	5.6	308	1.1338	0.6440	1.1338	1.0648
No log	5.6364	310	1.2425	0.6056	1.2425	1.1147
No log	5.6727	312	1.3660	0.5115	1.3660	1.1688
No log	5.7091	314	1.3476	0.4799	1.3476	1.1609
No log	5.7455	316	1.2585	0.5324	1.2585	1.1218
No log	5.7818	318	1.1409	0.5702	1.1409	1.0681
No log	5.8182	320	1.1374	0.5638	1.1374	1.0665
No log	5.8545	322	1.1939	0.5308	1.1939	1.0926
No log	5.8909	324	1.3106	0.4937	1.3106	1.1448
No log	5.9273	326	1.2935	0.5232	1.2935	1.1373
No log	5.9636	328	1.2683	0.5232	1.2683	1.1262
No log	6.0	330	1.2526	0.5459	1.2526	1.1192
No log	6.0364	332	1.2491	0.5492	1.2491	1.1176
No log	6.0727	334	1.2125	0.5868	1.2125	1.1012
No log	6.1091	336	1.1700	0.5917	1.1700	1.0817
No log	6.1455	338	1.0700	0.6123	1.0700	1.0344
No log	6.1818	340	1.0194	0.6294	1.0194	1.0096
No log	6.2182	342	1.0340	0.6468	1.0340	1.0168
No log	6.2545	344	1.1091	0.5876	1.1091	1.0532
No log	6.2909	346	1.2132	0.5567	1.2132	1.1014
No log	6.3273	348	1.2734	0.5282	1.2734	1.1284
No log	6.3636	350	1.2512	0.5254	1.2512	1.1186
No log	6.4	352	1.1657	0.5522	1.1657	1.0797
No log	6.4364	354	1.0870	0.6088	1.0870	1.0426
No log	6.4727	356	1.0618	0.6224	1.0618	1.0305
No log	6.5091	358	1.0779	0.6286	1.0779	1.0382
No log	6.5455	360	1.0322	0.6622	1.0322	1.0160
No log	6.5818	362	0.9907	0.6655	0.9907	0.9953
No log	6.6182	364	1.0007	0.6558	1.0007	1.0004
No log	6.6545	366	1.0116	0.6528	1.0116	1.0058
No log	6.6909	368	1.0633	0.6262	1.0633	1.0311
No log	6.7273	370	1.0699	0.6176	1.0699	1.0344
No log	6.7636	372	1.0713	0.6176	1.0713	1.0350
No log	6.8	374	1.0316	0.6499	1.0316	1.0157
No log	6.8364	376	1.0466	0.6499	1.0466	1.0230
No log	6.8727	378	1.0468	0.6589	1.0468	1.0231
No log	6.9091	380	1.0005	0.6551	1.0005	1.0003
No log	6.9455	382	0.9899	0.6645	0.9899	0.9950
No log	6.9818	384	0.9911	0.6731	0.9911	0.9955
No log	7.0182	386	1.0260	0.6521	1.0260	1.0129
No log	7.0545	388	1.0608	0.6280	1.0608	1.0300
No log	7.0909	390	1.1223	0.5982	1.1223	1.0594
No log	7.1273	392	1.1541	0.5971	1.1541	1.0743
No log	7.1636	394	1.1347	0.6127	1.1347	1.0652
No log	7.2	396	1.0622	0.6300	1.0622	1.0307
No log	7.2364	398	0.9518	0.6698	0.9518	0.9756
No log	7.2727	400	0.8318	0.6816	0.8318	0.9120
No log	7.3091	402	0.7913	0.6851	0.7913	0.8896
No log	7.3455	404	0.8102	0.6805	0.8102	0.9001
No log	7.3818	406	0.8697	0.6807	0.8697	0.9326
No log	7.4182	408	0.9992	0.6792	0.9992	0.9996
No log	7.4545	410	1.1143	0.6141	1.1143	1.0556
No log	7.4909	412	1.1546	0.5966	1.1546	1.0745
No log	7.5273	414	1.1511	0.6014	1.1511	1.0729
No log	7.5636	416	1.1183	0.6014	1.1183	1.0575
No log	7.6	418	1.0913	0.5997	1.0913	1.0446
No log	7.6364	420	1.0383	0.6335	1.0383	1.0189
No log	7.6727	422	1.0328	0.6351	1.0328	1.0163
No log	7.7091	424	1.0162	0.6351	1.0162	1.0080
No log	7.7455	426	0.9807	0.6590	0.9807	0.9903
No log	7.7818	428	0.9959	0.6409	0.9959	0.9979
No log	7.8182	430	1.0336	0.6300	1.0336	1.0167
No log	7.8545	432	1.1087	0.6024	1.1087	1.0530
No log	7.8909	434	1.1974	0.5860	1.1974	1.0943
No log	7.9273	436	1.2110	0.5860	1.2110	1.1004
No log	7.9636	438	1.1648	0.5973	1.1648	1.0793
No log	8.0	440	1.1009	0.6014	1.1009	1.0493
No log	8.0364	442	1.0642	0.6211	1.0642	1.0316
No log	8.0727	444	1.0374	0.6280	1.0374	1.0185
No log	8.1091	446	0.9903	0.6647	0.9903	0.9951
No log	8.1455	448	0.9216	0.6849	0.9216	0.9600
No log	8.1818	450	0.8973	0.6891	0.8973	0.9473
No log	8.2182	452	0.8906	0.6891	0.8906	0.9437
No log	8.2545	454	0.9199	0.6972	0.9199	0.9591
No log	8.2909	456	0.9493	0.6672	0.9493	0.9743
No log	8.3273	458	0.9990	0.6555	0.9990	0.9995
No log	8.3636	460	1.0251	0.6301	1.0251	1.0125
No log	8.4	462	1.0550	0.6236	1.0550	1.0271
No log	8.4364	464	1.0422	0.6236	1.0422	1.0209
No log	8.4727	466	1.0156	0.6399	1.0156	1.0077
No log	8.5091	468	0.9581	0.6663	0.9581	0.9788
No log	8.5455	470	0.9195	0.6918	0.9195	0.9589
No log	8.5818	472	0.9076	0.6918	0.9076	0.9527
No log	8.6182	474	0.9243	0.6918	0.9243	0.9614
No log	8.6545	476	0.9455	0.6842	0.9455	0.9724
No log	8.6909	478	0.9831	0.6583	0.9831	0.9915
No log	8.7273	480	1.0018	0.6343	1.0018	1.0009
No log	8.7636	482	1.0067	0.6361	1.0067	1.0034
No log	8.8	484	1.0108	0.6361	1.0108	1.0054
No log	8.8364	486	1.0221	0.6361	1.0221	1.0110
No log	8.8727	488	1.0390	0.6067	1.0390	1.0193
No log	8.9091	490	1.0511	0.6067	1.0511	1.0252
No log	8.9455	492	1.0655	0.5982	1.0655	1.0322
No log	8.9818	494	1.0681	0.6071	1.0681	1.0335
No log	9.0182	496	1.0422	0.6155	1.0422	1.0209
No log	9.0545	498	1.0350	0.6155	1.0350	1.0173
0.3527	9.0909	500	1.0312	0.6155	1.0312	1.0155
0.3527	9.1273	502	1.0441	0.6155	1.0441	1.0218
0.3527	9.1636	504	1.0439	0.6155	1.0439	1.0217
0.3527	9.2	506	1.0406	0.6155	1.0406	1.0201
0.3527	9.2364	508	1.0259	0.6168	1.0259	1.0129
0.3527	9.2727	510	1.0251	0.6168	1.0251	1.0124
0.3527	9.3091	512	1.0225	0.6168	1.0225	1.0112
0.3527	9.3455	514	1.0112	0.6341	1.0112	1.0056
0.3527	9.3818	516	0.9892	0.6639	0.9892	0.9946
0.3527	9.4182	518	0.9736	0.6815	0.9736	0.9867
0.3527	9.4545	520	0.9666	0.6781	0.9666	0.9832
0.3527	9.4909	522	0.9708	0.6781	0.9708	0.9853
0.3527	9.5273	524	0.9804	0.6722	0.9804	0.9901
0.3527	9.5636	526	0.9841	0.6722	0.9841	0.9920
0.3527	9.6	528	0.9917	0.6697	0.9917	0.9959
0.3527	9.6364	530	0.9939	0.6535	0.9939	0.9969
0.3527	9.6727	532	0.9927	0.6697	0.9927	0.9964
0.3527	9.7091	534	0.9899	0.6697	0.9899	0.9949
0.3527	9.7455	536	0.9823	0.6804	0.9823	0.9911
0.3527	9.7818	538	0.9723	0.6862	0.9723	0.9861
0.3527	9.8182	540	0.9657	0.6862	0.9657	0.9827
0.3527	9.8545	542	0.9650	0.6862	0.9650	0.9824
0.3527	9.8909	544	0.9661	0.6862	0.9661	0.9829
0.3527	9.9273	546	0.9665	0.6862	0.9665	0.9831
0.3527	9.9636	548	0.9659	0.6862	0.9659	0.9828
0.3527	10.0	550	0.9658	0.6862	0.9658	0.9827

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1