ArabicNewSplits5_FineTuningAraBERT_run3_AugV5_k10_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6322
• Qwk: 0.3028
• Mse: 0.6322
• Rmse: 0.7951

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	3.2271	-0.0149	3.2271	1.7964
No log	0.0667	4	1.6249	-0.0070	1.6249	1.2747
No log	0.1	6	1.9908	-0.0468	1.9908	1.4110
No log	0.1333	8	1.8700	-0.0658	1.8700	1.3675
No log	0.1667	10	1.1087	0.0	1.1087	1.0529
No log	0.2	12	0.9474	0.0038	0.9474	0.9734
No log	0.2333	14	0.9447	0.0	0.9447	0.9720
No log	0.2667	16	1.1057	0.0	1.1057	1.0515
No log	0.3	18	1.2093	0.0	1.2093	1.0997
No log	0.3333	20	0.9606	0.0	0.9606	0.9801
No log	0.3667	22	0.8405	0.0038	0.8405	0.9168
No log	0.4	24	0.8809	-0.0407	0.8809	0.9386
No log	0.4333	26	0.9530	-0.0763	0.9530	0.9762
No log	0.4667	28	1.2311	-0.0268	1.2311	1.1095
No log	0.5	30	1.3231	-0.0268	1.3231	1.1503
No log	0.5333	32	1.0313	-0.0510	1.0313	1.0155
No log	0.5667	34	0.7259	-0.0667	0.7259	0.8520
No log	0.6	36	0.6845	-0.0233	0.6845	0.8274
No log	0.6333	38	0.7221	-0.0370	0.7221	0.8498
No log	0.6667	40	0.7151	-0.0314	0.7151	0.8456
No log	0.7	42	0.7577	0.1174	0.7577	0.8705
No log	0.7333	44	0.8018	0.0288	0.8018	0.8954
No log	0.7667	46	0.8392	0.0431	0.8392	0.9161
No log	0.8	48	0.9084	0.0698	0.9084	0.9531
No log	0.8333	50	1.0507	0.0345	1.0507	1.0250
No log	0.8667	52	0.8346	0.1579	0.8346	0.9136
No log	0.9	54	0.7099	0.2917	0.7099	0.8425
No log	0.9333	56	0.8111	0.1852	0.8111	0.9006
No log	0.9667	58	1.1557	0.0462	1.1557	1.0750
No log	1.0	60	1.1773	0.0406	1.1773	1.0850
No log	1.0333	62	0.9023	0.1416	0.9023	0.9499
No log	1.0667	64	0.6872	0.2000	0.6872	0.8290
No log	1.1	66	0.8797	0.1619	0.8797	0.9379
No log	1.1333	68	1.2550	0.0325	1.2550	1.1203
No log	1.1667	70	1.0279	0.1000	1.0279	1.0138
No log	1.2	72	0.6579	0.1264	0.6579	0.8111
No log	1.2333	74	0.6002	-0.0233	0.6002	0.7747
No log	1.2667	76	0.6029	0.0222	0.6029	0.7765
No log	1.3	78	0.6397	0.0617	0.6397	0.7998
No log	1.3333	80	0.7611	0.2410	0.7611	0.8724
No log	1.3667	82	0.8508	0.2300	0.8508	0.9224
No log	1.4	84	0.7080	0.2444	0.7080	0.8414
No log	1.4333	86	0.6242	-0.0233	0.6242	0.7901
No log	1.4667	88	0.6630	-0.0233	0.6630	0.8143
No log	1.5	90	0.6770	0.1111	0.6770	0.8228
No log	1.5333	92	1.1784	0.0625	1.1784	1.0856
No log	1.5667	94	1.1494	0.0720	1.1494	1.0721
No log	1.6	96	0.7332	0.1579	0.7332	0.8563
No log	1.6333	98	0.6764	0.0725	0.6764	0.8224
No log	1.6667	100	0.6593	0.0815	0.6593	0.8120
No log	1.7	102	0.7334	0.2000	0.7334	0.8564
No log	1.7333	104	0.8914	0.2000	0.8914	0.9441
No log	1.7667	106	1.3170	0.0621	1.3170	1.1476
No log	1.8	108	1.1406	0.0491	1.1406	1.0680
No log	1.8333	110	0.7109	0.1667	0.7109	0.8432
No log	1.8667	112	0.6670	0.2099	0.6670	0.8167
No log	1.9	114	0.8263	0.1158	0.8263	0.9090
No log	1.9333	116	0.7258	0.1220	0.7258	0.8519
No log	1.9667	118	0.6080	0.2289	0.6080	0.7797
No log	2.0	120	0.7079	0.1675	0.7079	0.8414
No log	2.0333	122	0.8442	0.1781	0.8442	0.9188
No log	2.0667	124	0.6710	0.2315	0.6710	0.8191
No log	2.1	126	0.5434	0.3533	0.5434	0.7372
No log	2.1333	128	0.5731	0.2096	0.5731	0.7570
No log	2.1667	130	0.5726	0.2096	0.5726	0.7567
No log	2.2	132	0.5377	0.3927	0.5377	0.7333
No log	2.2333	134	0.6239	0.3237	0.6239	0.7899
No log	2.2667	136	0.9641	0.2199	0.9641	0.9819
No log	2.3	138	0.7383	0.2877	0.7383	0.8592
No log	2.3333	140	0.6035	0.3118	0.6035	0.7768
No log	2.3667	142	0.9344	-0.0333	0.9344	0.9666
No log	2.4	144	0.9154	-0.0333	0.9154	0.9568
No log	2.4333	146	0.6867	0.1209	0.6867	0.8287
No log	2.4667	148	0.6769	0.2941	0.6769	0.8228
No log	2.5	150	1.1420	0.0938	1.1420	1.0686
No log	2.5333	152	1.1316	0.0968	1.1316	1.0638
No log	2.5667	154	0.7744	0.2453	0.7744	0.8800
No log	2.6	156	0.5530	0.3136	0.5530	0.7436
No log	2.6333	158	0.6561	0.1461	0.6561	0.8100
No log	2.6667	160	0.6779	0.1020	0.6779	0.8234
No log	2.7	162	0.6000	0.2919	0.6000	0.7746
No log	2.7333	164	0.6275	0.3231	0.6275	0.7921
No log	2.7667	166	0.6311	0.3561	0.6311	0.7944
No log	2.8	168	0.6537	0.3498	0.6537	0.8085
No log	2.8333	170	0.6514	0.3242	0.6514	0.8071
No log	2.8667	172	0.6494	0.3028	0.6494	0.8058
No log	2.9	174	0.6669	0.2830	0.6669	0.8166
No log	2.9333	176	0.6814	0.3103	0.6814	0.8255
No log	2.9667	178	0.8104	0.2143	0.8104	0.9002
No log	3.0	180	0.7280	0.2919	0.7280	0.8532
No log	3.0333	182	0.7353	0.3504	0.7353	0.8575
No log	3.0667	184	0.8775	0.3058	0.8775	0.9368
No log	3.1	186	0.8329	0.3115	0.8329	0.9127
No log	3.1333	188	0.7593	0.2217	0.7593	0.8714
No log	3.1667	190	1.2055	0.1235	1.2055	1.0979
No log	3.2	192	1.2850	0.0435	1.2850	1.1336
No log	3.2333	194	0.9271	0.2253	0.9271	0.9628
No log	3.2667	196	0.7013	0.2793	0.7013	0.8374
No log	3.3	198	0.6886	0.3128	0.6886	0.8298
No log	3.3333	200	0.6602	0.3153	0.6602	0.8125
No log	3.3667	202	0.7887	0.3043	0.7887	0.8881
No log	3.4	204	0.8197	0.2566	0.8197	0.9054
No log	3.4333	206	0.7164	0.2075	0.7164	0.8464
No log	3.4667	208	0.6403	0.3180	0.6403	0.8002
No log	3.5	210	0.6918	0.2511	0.6918	0.8317
No log	3.5333	212	0.6317	0.3561	0.6317	0.7948
No log	3.5667	214	0.6855	0.2637	0.6855	0.8280
No log	3.6	216	0.8627	0.2566	0.8627	0.9288
No log	3.6333	218	0.8253	0.3128	0.8253	0.9084
No log	3.6667	220	0.7940	0.3504	0.7940	0.8910
No log	3.7	222	0.7184	0.3021	0.7184	0.8476
No log	3.7333	224	0.7324	0.3808	0.7324	0.8558
No log	3.7667	226	0.7899	0.2881	0.7899	0.8888
No log	3.8	228	0.9265	0.3277	0.9265	0.9626
No log	3.8333	230	0.7751	0.2838	0.7751	0.8804
No log	3.8667	232	0.6279	0.3593	0.6279	0.7924
No log	3.9	234	0.6024	0.3628	0.6024	0.7762
No log	3.9333	236	0.6092	0.2676	0.6092	0.7805
No log	3.9667	238	0.6420	0.2857	0.6420	0.8013
No log	4.0	240	0.7710	0.3091	0.7710	0.8781
No log	4.0333	242	0.7727	0.3091	0.7727	0.8790
No log	4.0667	244	0.6364	0.2857	0.6364	0.7977
No log	4.1	246	0.5621	0.2632	0.5621	0.7497
No log	4.1333	248	0.6096	0.4439	0.6096	0.7808
No log	4.1667	250	0.6023	0.3684	0.6023	0.7761
No log	4.2	252	0.6426	0.3214	0.6426	0.8016
No log	4.2333	254	0.7510	0.3898	0.7510	0.8666
No log	4.2667	256	0.7300	0.3504	0.7300	0.8544
No log	4.3	258	0.6805	0.3188	0.6805	0.8249
No log	4.3333	260	0.6201	0.3684	0.6201	0.7875
No log	4.3667	262	0.5993	0.3171	0.5993	0.7741
No log	4.4	264	0.6033	0.3271	0.6033	0.7767
No log	4.4333	266	0.5811	0.3803	0.5811	0.7623
No log	4.4667	268	0.6142	0.3744	0.6142	0.7837
No log	4.5	270	0.5739	0.3333	0.5739	0.7576
No log	4.5333	272	0.5624	0.3439	0.5624	0.7500
No log	4.5667	274	0.6030	0.28	0.6030	0.7765
No log	4.6	276	0.5604	0.3439	0.5604	0.7486
No log	4.6333	278	0.5649	0.3369	0.5649	0.7516
No log	4.6667	280	0.5848	0.3299	0.5848	0.7647
No log	4.7	282	0.5999	0.2986	0.5999	0.7746
No log	4.7333	284	0.6968	0.3684	0.6968	0.8347
No log	4.7667	286	0.7219	0.3593	0.7219	0.8497
No log	4.8	288	0.7358	0.3909	0.7358	0.8578
No log	4.8333	290	0.6769	0.3735	0.6769	0.8227
No log	4.8667	292	0.6889	0.4	0.6889	0.8300
No log	4.9	294	0.8154	0.3648	0.8154	0.9030
No log	4.9333	296	0.9971	0.2472	0.9971	0.9986
No log	4.9667	298	0.9323	0.2741	0.9323	0.9656
No log	5.0	300	0.7165	0.3648	0.7165	0.8465
No log	5.0333	302	0.5918	0.3744	0.5918	0.7693
No log	5.0667	304	0.6135	0.2941	0.6135	0.7832
No log	5.1	306	0.5805	0.3271	0.5805	0.7619
No log	5.1333	308	0.5920	0.3433	0.5920	0.7694
No log	5.1667	310	0.7801	0.2900	0.7801	0.8833
No log	5.2	312	0.8581	0.2881	0.8581	0.9263
No log	5.2333	314	0.7338	0.3128	0.7338	0.8566
No log	5.2667	316	0.6094	0.3398	0.6094	0.7806
No log	5.3	318	0.5962	0.3585	0.5962	0.7722
No log	5.3333	320	0.6113	0.3365	0.6113	0.7819
No log	5.3667	322	0.6882	0.3628	0.6882	0.8296
No log	5.4	324	0.7550	0.3778	0.7550	0.8689
No log	5.4333	326	0.8596	0.3195	0.8596	0.9272
No log	5.4667	328	0.7841	0.3755	0.7841	0.8855
No log	5.5	330	0.6099	0.3537	0.6099	0.7809
No log	5.5333	332	0.6001	0.3394	0.6001	0.7747
No log	5.5667	334	0.6135	0.3548	0.6135	0.7832
No log	5.6	336	0.5801	0.2963	0.5801	0.7616
No log	5.6333	338	0.6378	0.3684	0.6378	0.7986
No log	5.6667	340	0.8149	0.3559	0.8149	0.9027
No log	5.7	342	1.0043	0.1698	1.0043	1.0021
No log	5.7333	344	0.9560	0.1939	0.9560	0.9777
No log	5.7667	346	0.7465	0.3719	0.7465	0.8640
No log	5.8	348	0.5992	0.3153	0.5992	0.7741
No log	5.8333	350	0.5685	0.3180	0.5685	0.7540
No log	5.8667	352	0.5683	0.3180	0.5683	0.7538
No log	5.9	354	0.6046	0.3028	0.6046	0.7776
No log	5.9333	356	0.6977	0.3719	0.6977	0.8353
No log	5.9667	358	0.7474	0.3719	0.7474	0.8645
No log	6.0	360	0.6936	0.3418	0.6936	0.8328
No log	6.0333	362	0.6114	0.3739	0.6114	0.7819
No log	6.0667	364	0.5820	0.3394	0.5820	0.7629
No log	6.1	366	0.5693	0.3208	0.5693	0.7545
No log	6.1333	368	0.5586	0.3846	0.5586	0.7474
No log	6.1667	370	0.5784	0.2000	0.5784	0.7605
No log	6.2	372	0.5918	0.2000	0.5918	0.7693
No log	6.2333	374	0.6088	0.2000	0.6088	0.7803
No log	6.2667	376	0.6300	0.2727	0.6300	0.7937
No log	6.3	378	0.6076	0.2000	0.6076	0.7795
No log	6.3333	380	0.5570	0.3469	0.5570	0.7463
No log	6.3667	382	0.5373	0.3878	0.5373	0.7330
No log	6.4	384	0.5366	0.3439	0.5366	0.7325
No log	6.4333	386	0.5489	0.3508	0.5489	0.7409
No log	6.4667	388	0.5695	0.2746	0.5695	0.7547
No log	6.5	390	0.5600	0.3469	0.5600	0.7483
No log	6.5333	392	0.5387	0.3469	0.5387	0.7340
No log	6.5667	394	0.5421	0.2871	0.5421	0.7363
No log	6.6	396	0.5399	0.2871	0.5399	0.7348
No log	6.6333	398	0.5484	0.2917	0.5484	0.7405
No log	6.6667	400	0.5601	0.2917	0.5601	0.7484
No log	6.7	402	0.5488	0.2917	0.5488	0.7408
No log	6.7333	404	0.5462	0.3786	0.5462	0.7390
No log	6.7667	406	0.5980	0.3744	0.5980	0.7733
No log	6.8	408	0.7272	0.3153	0.7272	0.8527
No log	6.8333	410	0.8048	0.3115	0.8048	0.8971
No log	6.8667	412	0.7657	0.3277	0.7657	0.8751
No log	6.9	414	0.6474	0.4188	0.6474	0.8046
No log	6.9333	416	0.5953	0.3514	0.5953	0.7715
No log	6.9667	418	0.5977	0.3778	0.5977	0.7731
No log	7.0	420	0.6022	0.3833	0.6022	0.7760
No log	7.0333	422	0.6655	0.3188	0.6655	0.8158
No log	7.0667	424	0.7759	0.3518	0.7759	0.8808
No log	7.1	426	0.7874	0.3306	0.7874	0.8874
No log	7.1333	428	0.7132	0.3362	0.7132	0.8445
No log	7.1667	430	0.6176	0.3028	0.6176	0.7859
No log	7.2	432	0.5602	0.3744	0.5602	0.7485
No log	7.2333	434	0.5496	0.2941	0.5496	0.7413
No log	7.2667	436	0.5572	0.2077	0.5572	0.7464
No log	7.3	438	0.5849	0.2709	0.5849	0.7648
No log	7.3333	440	0.6329	0.2811	0.6329	0.7955
No log	7.3667	442	0.6368	0.2811	0.6368	0.7980
No log	7.4	444	0.6225	0.3091	0.6225	0.7890
No log	7.4333	446	0.6058	0.3303	0.6058	0.7783
No log	7.4667	448	0.6235	0.3394	0.6235	0.7896
No log	7.5	450	0.6660	0.3067	0.6660	0.8161
No log	7.5333	452	0.6770	0.3043	0.6770	0.8228
No log	7.5667	454	0.6371	0.3394	0.6371	0.7982
No log	7.6	456	0.6042	0.3422	0.6042	0.7773
No log	7.6333	458	0.5824	0.3242	0.5824	0.7632
No log	7.6667	460	0.5763	0.3143	0.5763	0.7591
No log	7.7	462	0.5732	0.3143	0.5732	0.7571
No log	7.7333	464	0.5776	0.3010	0.5776	0.7600
No log	7.7667	466	0.6308	0.3004	0.6308	0.7942
No log	7.8	468	0.7067	0.2511	0.7067	0.8407
No log	7.8333	470	0.7279	0.25	0.7279	0.8531
No log	7.8667	472	0.6829	0.2793	0.6829	0.8264
No log	7.9	474	0.6186	0.3028	0.6186	0.7865
No log	7.9333	476	0.5846	0.3153	0.5846	0.7646
No log	7.9667	478	0.5729	0.36	0.5729	0.7569
No log	8.0	480	0.5686	0.36	0.5686	0.7541
No log	8.0333	482	0.5581	0.3299	0.5581	0.7471
No log	8.0667	484	0.5720	0.2251	0.5720	0.7563
No log	8.1	486	0.6242	0.3116	0.6242	0.7900
No log	8.1333	488	0.6825	0.2523	0.6825	0.8261
No log	8.1667	490	0.7056	0.25	0.7056	0.8400
No log	8.2	492	0.6707	0.2811	0.6707	0.8190
No log	8.2333	494	0.6154	0.3052	0.6154	0.7845
No log	8.2667	496	0.5785	0.3208	0.5785	0.7606
No log	8.3	498	0.5548	0.3237	0.5548	0.7448
0.4553	8.3333	500	0.5537	0.3200	0.5537	0.7441
0.4553	8.3667	502	0.5532	0.3143	0.5532	0.7438
0.4553	8.4	504	0.5614	0.3433	0.5614	0.7493
0.4553	8.4333	506	0.5913	0.3607	0.5913	0.7689
0.4553	8.4667	508	0.6245	0.3028	0.6245	0.7902
0.4553	8.5	510	0.6630	0.3091	0.6630	0.8143
0.4553	8.5333	512	0.6732	0.3091	0.6732	0.8205
0.4553	8.5667	514	0.6757	0.2811	0.6757	0.8220
0.4553	8.6	516	0.6714	0.3091	0.6714	0.8194
0.4553	8.6333	518	0.6800	0.2523	0.6800	0.8246
0.4553	8.6667	520	0.6764	0.2536	0.6764	0.8225
0.4553	8.7	522	0.6494	0.3116	0.6494	0.8059
0.4553	8.7333	524	0.6209	0.3116	0.6209	0.7880
0.4553	8.7667	526	0.5929	0.1919	0.5929	0.7700
0.4553	8.8	528	0.5836	0.2245	0.5836	0.7640
0.4553	8.8333	530	0.5925	0.1919	0.5925	0.7697
0.4553	8.8667	532	0.6070	0.2315	0.6070	0.7791
0.4553	8.9	534	0.6063	0.2315	0.6063	0.7787
0.4553	8.9333	536	0.6086	0.2692	0.6086	0.7801
0.4553	8.9667	538	0.6109	0.3365	0.6109	0.7816
0.4553	9.0	540	0.6166	0.3704	0.6166	0.7852
0.4553	9.0333	542	0.6376	0.3028	0.6376	0.7985
0.4553	9.0667	544	0.6439	0.3028	0.6439	0.8025
0.4553	9.1	546	0.6453	0.3028	0.6453	0.8033
0.4553	9.1333	548	0.6284	0.3052	0.6284	0.7927
0.4553	9.1667	550	0.6048	0.3010	0.6048	0.7777
0.4553	9.2	552	0.5907	0.2549	0.5907	0.7686
0.4553	9.2333	554	0.5806	0.1923	0.5806	0.7619
0.4553	9.2667	556	0.5799	0.1923	0.5799	0.7615
0.4553	9.3	558	0.5876	0.2549	0.5876	0.7666
0.4553	9.3333	560	0.6030	0.3010	0.6030	0.7765
0.4553	9.3667	562	0.6155	0.2315	0.6155	0.7845
0.4553	9.4	564	0.6389	0.3116	0.6389	0.7993
0.4553	9.4333	566	0.6604	0.3116	0.6604	0.8127
0.4553	9.4667	568	0.6672	0.2830	0.6672	0.8168
0.4553	9.5	570	0.6597	0.3116	0.6597	0.8122
0.4553	9.5333	572	0.6542	0.3116	0.6542	0.8088
0.4553	9.5667	574	0.6510	0.3116	0.6510	0.8068
0.4553	9.6	576	0.6444	0.3116	0.6444	0.8027
0.4553	9.6333	578	0.6357	0.3116	0.6357	0.7973
0.4553	9.6667	580	0.6326	0.3116	0.6326	0.7954
0.4553	9.7	582	0.6328	0.3116	0.6328	0.7955
0.4553	9.7333	584	0.6342	0.3116	0.6342	0.7964
0.4553	9.7667	586	0.6320	0.3028	0.6320	0.7950
0.4553	9.8	588	0.6294	0.3028	0.6294	0.7934
0.4553	9.8333	590	0.6291	0.3028	0.6291	0.7932
0.4553	9.8667	592	0.6292	0.3028	0.6292	0.7932
0.4553	9.9	594	0.6289	0.3028	0.6289	0.7930
0.4553	9.9333	596	0.6303	0.3028	0.6303	0.7939
0.4553	9.9667	598	0.6318	0.3028	0.6318	0.7949
0.4553	10.0	600	0.6322	0.3028	0.6322	0.7951

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1