ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1836
• Qwk: 0.3026
• Mse: 1.1836
• Rmse: 1.0879

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.9040	0.0010	4.9040	2.2145
No log	0.0769	4	3.0627	0.0048	3.0627	1.7500
No log	0.1154	6	2.4011	-0.0464	2.4011	1.5495
No log	0.1538	8	1.8626	-0.0303	1.8626	1.3648
No log	0.1923	10	1.4342	-0.0870	1.4342	1.1976
No log	0.2308	12	1.2580	0.0434	1.2580	1.1216
No log	0.2692	14	1.2598	0.1567	1.2598	1.1224
No log	0.3077	16	1.2803	0.1173	1.2803	1.1315
No log	0.3462	18	1.4674	0.0331	1.4674	1.2114
No log	0.3846	20	1.9721	0.1169	1.9721	1.4043
No log	0.4231	22	2.4483	0.0682	2.4483	1.5647
No log	0.4615	24	2.3378	0.1971	2.3378	1.5290
No log	0.5	26	1.8792	0.0372	1.8792	1.3708
No log	0.5385	28	1.4911	0.0372	1.4911	1.2211
No log	0.5769	30	1.3394	0.0372	1.3394	1.1573
No log	0.6154	32	1.2733	0.0707	1.2733	1.1284
No log	0.6538	34	1.2618	0.2110	1.2618	1.1233
No log	0.6923	36	1.2262	0.1650	1.2262	1.1073
No log	0.7308	38	1.2139	0.1480	1.2139	1.1018
No log	0.7692	40	1.2171	0.0427	1.2171	1.1032
No log	0.8077	42	1.2621	-0.0616	1.2621	1.1234
No log	0.8462	44	1.4410	0.0811	1.4410	1.2004
No log	0.8846	46	1.5287	0.0169	1.5287	1.2364
No log	0.9231	48	1.5853	0.0169	1.5853	1.2591
No log	0.9615	50	1.6715	-0.0149	1.6715	1.2929
No log	1.0	52	1.6064	-0.0149	1.6064	1.2675
No log	1.0385	54	1.3479	-0.0251	1.3479	1.1610
No log	1.0769	56	1.2589	0.0788	1.2589	1.1220
No log	1.1154	58	1.2320	0.0872	1.2320	1.1099
No log	1.1538	60	1.2467	0.2188	1.2467	1.1165
No log	1.1923	62	1.2514	0.1752	1.2514	1.1187
No log	1.2308	64	1.2951	0.0070	1.2951	1.1380
No log	1.2692	66	1.5819	-0.0149	1.5819	1.2577
No log	1.3077	68	1.8021	0.0	1.8021	1.3424
No log	1.3462	70	1.7044	0.0	1.7044	1.3055
No log	1.3846	72	1.5558	0.0	1.5558	1.2473
No log	1.4231	74	1.4202	0.0575	1.4202	1.1917
No log	1.4615	76	1.2857	0.0561	1.2857	1.1339
No log	1.5	78	1.1949	0.1968	1.1949	1.0931
No log	1.5385	80	1.1590	0.2293	1.1590	1.0766
No log	1.5769	82	1.1766	0.1857	1.1766	1.0847
No log	1.6154	84	1.2023	0.2678	1.2023	1.0965
No log	1.6538	86	1.2653	0.0768	1.2653	1.1248
No log	1.6923	88	1.3496	0.0561	1.3496	1.1617
No log	1.7308	90	1.4285	0.0776	1.4285	1.1952
No log	1.7692	92	1.3183	0.0613	1.3183	1.1482
No log	1.8077	94	1.1894	0.1927	1.1894	1.0906
No log	1.8462	96	1.2058	0.1081	1.2058	1.0981
No log	1.8846	98	1.2317	0.1406	1.2317	1.1098
No log	1.9231	100	1.2830	0.1379	1.2830	1.1327
No log	1.9615	102	1.2863	0.1379	1.2863	1.1342
No log	2.0	104	1.3128	0.1596	1.3128	1.1458
No log	2.0385	106	1.2863	0.2273	1.2863	1.1342
No log	2.0769	108	1.2505	0.1919	1.2505	1.1183
No log	2.1154	110	1.3537	0.1354	1.3537	1.1635
No log	2.1538	112	1.2101	0.1772	1.2101	1.1001
No log	2.1923	114	1.1752	0.3343	1.1752	1.0841
No log	2.2308	116	1.2952	0.2173	1.2952	1.1381
No log	2.2692	118	1.1886	0.2922	1.1886	1.0902
No log	2.3077	120	1.1490	0.2200	1.1490	1.0719
No log	2.3462	122	1.1513	0.2155	1.1513	1.0730
No log	2.3846	124	1.1623	0.2111	1.1623	1.0781
No log	2.4231	126	1.1245	0.2268	1.1245	1.0604
No log	2.4615	128	1.0753	0.3431	1.0753	1.0370
No log	2.5	130	1.1291	0.3721	1.1291	1.0626
No log	2.5385	132	1.0625	0.3961	1.0625	1.0308
No log	2.5769	134	1.1848	0.2180	1.1848	1.0885
No log	2.6154	136	1.2730	0.2143	1.2730	1.1283
No log	2.6538	138	1.0707	0.2784	1.0707	1.0347
No log	2.6923	140	1.0109	0.2967	1.0109	1.0055
No log	2.7308	142	1.0188	0.2628	1.0188	1.0094
No log	2.7692	144	1.0934	0.1830	1.0934	1.0457
No log	2.8077	146	1.0780	0.1013	1.0780	1.0383
No log	2.8462	148	1.0820	0.2062	1.0820	1.0402
No log	2.8846	150	1.0980	0.2650	1.0980	1.0479
No log	2.9231	152	1.1964	0.2641	1.1964	1.0938
No log	2.9615	154	1.1353	0.2901	1.1353	1.0655
No log	3.0	156	1.0745	0.4763	1.0745	1.0366
No log	3.0385	158	1.1334	0.4218	1.1334	1.0646
No log	3.0769	160	1.0925	0.4010	1.0925	1.0452
No log	3.1154	162	0.9909	0.4165	0.9909	0.9954
No log	3.1538	164	1.0238	0.2633	1.0238	1.0118
No log	3.1923	166	1.0608	0.2697	1.0608	1.0299
No log	3.2308	168	1.0649	0.3551	1.0649	1.0319
No log	3.2692	170	1.1162	0.4028	1.1162	1.0565
No log	3.3077	172	1.1203	0.2199	1.1203	1.0584
No log	3.3462	174	1.1775	0.1824	1.1775	1.0851
No log	3.3846	176	1.1701	0.2515	1.1701	1.0817
No log	3.4231	178	1.1186	0.2244	1.1186	1.0577
No log	3.4615	180	1.2558	0.2542	1.2558	1.1206
No log	3.5	182	1.3625	0.2593	1.3625	1.1673
No log	3.5385	184	1.2343	0.2330	1.2343	1.1110
No log	3.5769	186	1.1122	0.3229	1.1122	1.0546
No log	3.6154	188	1.1147	0.2296	1.1147	1.0558
No log	3.6538	190	1.1177	0.3223	1.1177	1.0572
No log	3.6923	192	1.3672	0.2418	1.3672	1.1693
No log	3.7308	194	1.5179	0.2841	1.5179	1.2321
No log	3.7692	196	1.3257	0.2807	1.3257	1.1514
No log	3.8077	198	1.0590	0.3049	1.0590	1.0291
No log	3.8462	200	1.0350	0.1982	1.0350	1.0174
No log	3.8846	202	1.2998	0.3047	1.2998	1.1401
No log	3.9231	204	1.6271	0.2846	1.6271	1.2756
No log	3.9615	206	1.6861	0.3195	1.6861	1.2985
No log	4.0	208	1.4462	0.2863	1.4462	1.2026
No log	4.0385	210	1.0909	0.2534	1.0909	1.0445
No log	4.0769	212	1.1484	0.4016	1.1484	1.0716
No log	4.1154	214	1.5059	0.2790	1.5059	1.2272
No log	4.1538	216	1.5289	0.3280	1.5289	1.2365
No log	4.1923	218	1.3062	0.2468	1.3062	1.1429
No log	4.2308	220	1.0552	0.3459	1.0552	1.0272
No log	4.2692	222	0.9856	0.2628	0.9856	0.9928
No log	4.3077	224	1.0553	0.2315	1.0553	1.0273
No log	4.3462	226	1.0407	0.2461	1.0407	1.0202
No log	4.3846	228	0.9658	0.4123	0.9658	0.9828
No log	4.4231	230	1.0341	0.3928	1.0341	1.0169
No log	4.4615	232	1.1340	0.4298	1.1340	1.0649
No log	4.5	234	1.0963	0.4298	1.0963	1.0471
No log	4.5385	236	1.0994	0.4101	1.0994	1.0485
No log	4.5769	238	1.0732	0.3657	1.0732	1.0359
No log	4.6154	240	1.0268	0.3735	1.0268	1.0133
No log	4.6538	242	0.9770	0.3169	0.9770	0.9884
No log	4.6923	244	1.0180	0.2068	1.0180	1.0089
No log	4.7308	246	1.1037	0.1950	1.1037	1.0506
No log	4.7692	248	1.0998	0.1950	1.0998	1.0487
No log	4.8077	250	1.0880	0.2130	1.0880	1.0431
No log	4.8462	252	1.0861	0.2130	1.0861	1.0422
No log	4.8846	254	1.0573	0.2128	1.0573	1.0282
No log	4.9231	256	1.0964	0.1797	1.0964	1.0471
No log	4.9615	258	1.3010	0.3028	1.3010	1.1406
No log	5.0	260	1.6108	0.2680	1.6108	1.2692
No log	5.0385	262	1.7187	0.2318	1.7187	1.3110
No log	5.0769	264	1.6068	0.24	1.6068	1.2676
No log	5.1154	266	1.3528	0.2418	1.3528	1.1631
No log	5.1538	268	1.0352	0.1327	1.0352	1.0175
No log	5.1923	270	0.9564	0.4243	0.9564	0.9780
No log	5.2308	272	0.9570	0.4243	0.9570	0.9783
No log	5.2692	274	0.9720	0.3041	0.9720	0.9859
No log	5.3077	276	1.0037	0.2964	1.0037	1.0018
No log	5.3462	278	0.9950	0.3059	0.9950	0.9975
No log	5.3846	280	1.0022	0.3390	1.0022	1.0011
No log	5.4231	282	0.9807	0.3596	0.9807	0.9903
No log	5.4615	284	0.9442	0.3596	0.9442	0.9717
No log	5.5	286	0.9140	0.4023	0.9140	0.9560
No log	5.5385	288	0.9066	0.4256	0.9066	0.9521
No log	5.5769	290	0.9066	0.4346	0.9066	0.9522
No log	5.6154	292	0.9221	0.4290	0.9221	0.9603
No log	5.6538	294	0.9254	0.4508	0.9254	0.9620
No log	5.6923	296	0.9107	0.4181	0.9107	0.9543
No log	5.7308	298	0.9328	0.4393	0.9328	0.9658
No log	5.7692	300	0.9373	0.4474	0.9373	0.9681
No log	5.8077	302	0.9461	0.4502	0.9461	0.9727
No log	5.8462	304	0.9999	0.3516	0.9999	1.0000
No log	5.8846	306	1.0211	0.3731	1.0211	1.0105
No log	5.9231	308	0.9652	0.4361	0.9652	0.9824
No log	5.9615	310	0.9164	0.3804	0.9164	0.9573
No log	6.0	312	0.9424	0.4444	0.9424	0.9708
No log	6.0385	314	0.9497	0.4444	0.9497	0.9745
No log	6.0769	316	0.9236	0.3454	0.9236	0.9610
No log	6.1154	318	0.9267	0.3608	0.9267	0.9626
No log	6.1538	320	0.9370	0.3685	0.9370	0.9680
No log	6.1923	322	0.9354	0.3539	0.9354	0.9672
No log	6.2308	324	0.9319	0.3539	0.9319	0.9654
No log	6.2692	326	0.9246	0.3539	0.9246	0.9616
No log	6.3077	328	0.9225	0.3902	0.9225	0.9605
No log	6.3462	330	0.9171	0.3796	0.9171	0.9577
No log	6.3846	332	0.9155	0.3796	0.9155	0.9568
No log	6.4231	334	0.9183	0.3983	0.9183	0.9583
No log	6.4615	336	0.9198	0.3845	0.9198	0.9591
No log	6.5	338	0.9338	0.4102	0.9338	0.9663
No log	6.5385	340	0.9704	0.4300	0.9704	0.9851
No log	6.5769	342	1.0382	0.4253	1.0382	1.0189
No log	6.6154	344	1.0516	0.4253	1.0516	1.0255
No log	6.6538	346	1.0142	0.3505	1.0142	1.0071
No log	6.6923	348	0.9706	0.4439	0.9706	0.9852
No log	6.7308	350	0.9838	0.4202	0.9838	0.9918
No log	6.7692	352	1.0562	0.3950	1.0562	1.0277
No log	6.8077	354	1.2106	0.3296	1.2106	1.1003
No log	6.8462	356	1.2177	0.3296	1.2177	1.1035
No log	6.8846	358	1.1034	0.3491	1.1034	1.0504
No log	6.9231	360	1.0045	0.4637	1.0045	1.0023
No log	6.9615	362	0.9903	0.3741	0.9903	0.9951
No log	7.0	364	0.9933	0.3637	0.9933	0.9966
No log	7.0385	366	0.9915	0.3648	0.9915	0.9958
No log	7.0769	368	0.9704	0.4316	0.9704	0.9851
No log	7.1154	370	0.9915	0.4337	0.9915	0.9957
No log	7.1538	372	0.9809	0.4439	0.9809	0.9904
No log	7.1923	374	0.9625	0.3596	0.9625	0.9811
No log	7.2308	376	1.0094	0.3457	1.0094	1.0047
No log	7.2692	378	1.0307	0.3011	1.0307	1.0152
No log	7.3077	380	0.9604	0.3263	0.9604	0.9800
No log	7.3462	382	0.9622	0.3674	0.9622	0.9809
No log	7.3846	384	1.0074	0.4291	1.0074	1.0037
No log	7.4231	386	1.0053	0.4166	1.0053	1.0026
No log	7.4615	388	0.9395	0.3522	0.9395	0.9693
No log	7.5	390	0.9551	0.4012	0.9551	0.9773
No log	7.5385	392	1.0657	0.2938	1.0657	1.0323
No log	7.5769	394	1.0380	0.3462	1.0380	1.0188
No log	7.6154	396	0.9525	0.3421	0.9525	0.9760
No log	7.6538	398	0.9661	0.3345	0.9661	0.9829
No log	7.6923	400	1.0451	0.3677	1.0451	1.0223
No log	7.7308	402	1.0777	0.4222	1.0777	1.0381
No log	7.7692	404	1.0233	0.4258	1.0233	1.0116
No log	7.8077	406	0.9522	0.3493	0.9522	0.9758
No log	7.8462	408	0.9870	0.3318	0.9870	0.9935
No log	7.8846	410	1.0248	0.3660	1.0248	1.0123
No log	7.9231	412	0.9904	0.3318	0.9904	0.9952
No log	7.9615	414	0.9908	0.3975	0.9908	0.9954
No log	8.0	416	1.0392	0.4043	1.0392	1.0194
No log	8.0385	418	1.0457	0.4043	1.0457	1.0226
No log	8.0769	420	0.9683	0.4732	0.9683	0.9840
No log	8.1154	422	0.9400	0.4102	0.9400	0.9696
No log	8.1538	424	0.9321	0.4102	0.9321	0.9654
No log	8.1923	426	0.9189	0.3902	0.9189	0.9586
No log	8.2308	428	0.9226	0.3902	0.9226	0.9605
No log	8.2692	430	0.9169	0.3902	0.9169	0.9576
No log	8.3077	432	0.9056	0.3652	0.9056	0.9516
No log	8.3462	434	0.9040	0.3652	0.9040	0.9508
No log	8.3846	436	0.9136	0.4002	0.9136	0.9558
No log	8.4231	438	0.9060	0.4002	0.9060	0.9518
No log	8.4615	440	0.9133	0.4002	0.9133	0.9556
No log	8.5	442	0.9256	0.4002	0.9256	0.9621
No log	8.5385	444	0.9331	0.4444	0.9331	0.9660
No log	8.5769	446	0.9413	0.4539	0.9413	0.9702
No log	8.6154	448	0.9010	0.4142	0.9010	0.9492
No log	8.6538	450	0.8899	0.4142	0.8899	0.9434
No log	8.6923	452	0.9011	0.3738	0.9011	0.9493
No log	8.7308	454	0.9707	0.4027	0.9707	0.9852
No log	8.7692	456	0.9720	0.4027	0.9720	0.9859
No log	8.8077	458	0.9317	0.3541	0.9317	0.9653
No log	8.8462	460	0.9200	0.3896	0.9200	0.9592
No log	8.8846	462	0.9463	0.4241	0.9463	0.9728
No log	8.9231	464	0.9504	0.3966	0.9504	0.9749
No log	8.9615	466	0.9267	0.4243	0.9267	0.9627
No log	9.0	468	0.9330	0.3933	0.9330	0.9659
No log	9.0385	470	0.9567	0.4116	0.9567	0.9781
No log	9.0769	472	0.9887	0.2521	0.9887	0.9943
No log	9.1154	474	0.9460	0.3814	0.9460	0.9726
No log	9.1538	476	0.8982	0.4042	0.8982	0.9477
No log	9.1923	478	0.9523	0.4434	0.9523	0.9759
No log	9.2308	480	1.0156	0.5015	1.0156	1.0078
No log	9.2692	482	1.0107	0.4128	1.0107	1.0053
No log	9.3077	484	0.9505	0.4532	0.9505	0.9749
No log	9.3462	486	0.9062	0.4343	0.9062	0.9519
No log	9.3846	488	0.8939	0.4002	0.8939	0.9455
No log	9.4231	490	0.8944	0.4409	0.8944	0.9457
No log	9.4615	492	0.9042	0.4409	0.9042	0.9509
No log	9.5	494	0.9276	0.4409	0.9276	0.9631
No log	9.5385	496	0.9524	0.4241	0.9524	0.9759
No log	9.5769	498	0.9849	0.4439	0.9849	0.9924
0.4166	9.6154	500	0.9843	0.4241	0.9843	0.9921
0.4166	9.6538	502	0.9822	0.3747	0.9822	0.9911
0.4166	9.6923	504	1.0497	0.2588	1.0497	1.0245
0.4166	9.7308	506	1.2337	0.3087	1.2337	1.1107
0.4166	9.7692	508	1.2947	0.2944	1.2947	1.1379
0.4166	9.8077	510	1.1836	0.3026	1.1836	1.0879

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1