ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7961
• Qwk: 0.6818
• Mse: 0.7961
• Rmse: 0.8922

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0211	2	6.8504	0.0057	6.8504	2.6173
No log	0.0421	4	4.3020	0.1013	4.3020	2.0741
No log	0.0632	6	3.1983	0.0595	3.1983	1.7884
No log	0.0842	8	3.2093	-0.0123	3.2093	1.7914
No log	0.1053	10	2.4669	0.1127	2.4669	1.5706
No log	0.1263	12	1.9527	0.1186	1.9527	1.3974
No log	0.1474	14	1.7912	0.1835	1.7912	1.3384
No log	0.1684	16	1.6230	0.1887	1.6230	1.2740
No log	0.1895	18	2.0111	0.1429	2.0111	1.4181
No log	0.2105	20	3.4448	0.0457	3.4448	1.8560
No log	0.2316	22	3.0088	0.0886	3.0088	1.7346
No log	0.2526	24	2.0506	0.2090	2.0506	1.4320
No log	0.2737	26	1.8195	0.2835	1.8195	1.3489
No log	0.2947	28	1.8482	0.2326	1.8482	1.3595
No log	0.3158	30	1.6146	0.3140	1.6146	1.2707
No log	0.3368	32	1.5819	0.2759	1.5819	1.2577
No log	0.3579	34	1.7981	0.2764	1.7981	1.3409
No log	0.3789	36	1.9998	0.2815	1.9998	1.4141
No log	0.4	38	2.2494	0.1259	2.2494	1.4998
No log	0.4211	40	2.2124	0.1549	2.2124	1.4874
No log	0.4421	42	1.8472	0.2836	1.8472	1.3591
No log	0.4632	44	1.6279	0.3492	1.6279	1.2759
No log	0.4842	46	1.6151	0.3651	1.6151	1.2709
No log	0.5053	48	1.8692	0.3259	1.8692	1.3672
No log	0.5263	50	2.2668	0.2471	2.2668	1.5056
No log	0.5474	52	2.6563	0.2703	2.6563	1.6298
No log	0.5684	54	2.4768	0.2703	2.4768	1.5738
No log	0.5895	56	1.6940	0.3852	1.6940	1.3016
No log	0.6105	58	1.4633	0.3740	1.4633	1.2097
No log	0.6316	60	1.3751	0.3833	1.3751	1.1726
No log	0.6526	62	1.3496	0.3833	1.3496	1.1617
No log	0.6737	64	1.4845	0.4681	1.4845	1.2184
No log	0.6947	66	2.1745	0.2989	2.1745	1.4746
No log	0.7158	68	3.1633	0.2698	3.1633	1.7786
No log	0.7368	70	3.6792	0.2447	3.6792	1.9181
No log	0.7579	72	3.1245	0.2500	3.1245	1.7676
No log	0.7789	74	2.1807	0.3237	2.1807	1.4767
No log	0.8	76	1.7390	0.3758	1.7390	1.3187
No log	0.8211	78	1.8492	0.3226	1.8492	1.3599
No log	0.8421	80	2.3757	0.2289	2.3757	1.5413
No log	0.8632	82	2.5521	0.2036	2.5521	1.5975
No log	0.8842	84	2.2795	0.2532	2.2795	1.5098
No log	0.9053	86	1.8905	0.2639	1.8905	1.3750
No log	0.9263	88	1.6165	0.3231	1.6165	1.2714
No log	0.9474	90	1.4229	0.4160	1.4229	1.1928
No log	0.9684	92	1.3923	0.4098	1.3923	1.1799
No log	0.9895	94	1.4472	0.4409	1.4472	1.2030
No log	1.0105	96	1.5892	0.4	1.5892	1.2606
No log	1.0316	98	1.8670	0.3671	1.8670	1.3664
No log	1.0526	100	1.9086	0.3855	1.9086	1.3815
No log	1.0737	102	2.1209	0.3429	2.1209	1.4563
No log	1.0947	104	1.8717	0.3190	1.8717	1.3681
No log	1.1158	106	1.4264	0.4490	1.4264	1.1943
No log	1.1368	108	1.3998	0.4901	1.3998	1.1831
No log	1.1579	110	1.5054	0.5153	1.5054	1.2269
No log	1.1789	112	1.8318	0.4804	1.8318	1.3534
No log	1.2	114	2.1331	0.5	2.1331	1.4605
No log	1.2211	116	1.8738	0.4590	1.8738	1.3689
No log	1.2421	118	1.1835	0.5875	1.1835	1.0879
No log	1.2632	120	0.9134	0.5821	0.9134	0.9557
No log	1.2842	122	0.9942	0.5538	0.9942	0.9971
No log	1.3053	124	1.0280	0.5926	1.0280	1.0139
No log	1.3263	126	1.1559	0.5915	1.1559	1.0751
No log	1.3474	128	1.3305	0.5478	1.3305	1.1535
No log	1.3684	130	1.5756	0.5238	1.5756	1.2552
No log	1.3895	132	1.5055	0.5238	1.5055	1.2270
No log	1.4105	134	1.3921	0.5422	1.3921	1.1799
No log	1.4316	136	1.6004	0.5114	1.6004	1.2651
No log	1.4526	138	1.3401	0.5644	1.3401	1.1576
No log	1.4737	140	1.1392	0.6026	1.1392	1.0673
No log	1.4947	142	1.2627	0.6012	1.2627	1.1237
No log	1.5158	144	1.1321	0.6395	1.1321	1.0640
No log	1.5368	146	0.9081	0.6460	0.9081	0.9530
No log	1.5579	148	0.8352	0.6714	0.8352	0.9139
No log	1.5789	150	0.9666	0.6212	0.9666	0.9832
No log	1.6	152	0.9172	0.6617	0.9172	0.9577
No log	1.6211	154	0.8086	0.6912	0.8086	0.8992
No log	1.6421	156	0.9342	0.6573	0.9342	0.9665
No log	1.6632	158	1.1763	0.56	1.1763	1.0846
No log	1.6842	160	1.1654	0.5342	1.1654	1.0796
No log	1.7053	162	1.0576	0.5634	1.0576	1.0284
No log	1.7263	164	0.8779	0.6620	0.8779	0.9370
No log	1.7474	166	0.7889	0.6857	0.7889	0.8882
No log	1.7684	168	0.9506	0.6043	0.9506	0.9750
No log	1.7895	170	0.9501	0.5839	0.9501	0.9747
No log	1.8105	172	0.8106	0.6763	0.8106	0.9003
No log	1.8316	174	0.8397	0.6944	0.8397	0.9164
No log	1.8526	176	0.9478	0.6131	0.9478	0.9736
No log	1.8737	178	1.0362	0.6536	1.0362	1.0179
No log	1.8947	180	1.1277	0.5802	1.1277	1.0620
No log	1.9158	182	1.1585	0.6125	1.1585	1.0763
No log	1.9368	184	1.2036	0.6258	1.2036	1.0971
No log	1.9579	186	1.1390	0.6194	1.1390	1.0673
No log	1.9789	188	1.0678	0.5772	1.0678	1.0333
No log	2.0	190	0.9924	0.5816	0.9924	0.9962
No log	2.0211	192	0.9704	0.6	0.9704	0.9851
No log	2.0421	194	0.9484	0.6197	0.9484	0.9739
No log	2.0632	196	0.8977	0.5821	0.8977	0.9475
No log	2.0842	198	0.8697	0.6212	0.8697	0.9326
No log	2.1053	200	0.8624	0.6061	0.8624	0.9287
No log	2.1263	202	0.9798	0.6056	0.9798	0.9899
No log	2.1474	204	0.9729	0.6027	0.9729	0.9864
No log	2.1684	206	0.8787	0.6434	0.8787	0.9374
No log	2.1895	208	0.9123	0.6490	0.9123	0.9551
No log	2.2105	210	0.9749	0.6405	0.9749	0.9874
No log	2.2316	212	0.9444	0.6667	0.9444	0.9718
No log	2.2526	214	0.8404	0.6713	0.8404	0.9167
No log	2.2737	216	0.8293	0.6222	0.8293	0.9106
No log	2.2947	218	0.9104	0.6618	0.9104	0.9542
No log	2.3158	220	0.8839	0.6471	0.8839	0.9402
No log	2.3368	222	0.8332	0.6471	0.8332	0.9128
No log	2.3579	224	0.8722	0.6887	0.8722	0.9339
No log	2.3789	226	1.0401	0.6506	1.0401	1.0199
No log	2.4	228	1.1170	0.6630	1.1170	1.0569
No log	2.4211	230	0.9318	0.7033	0.9318	0.9653
No log	2.4421	232	0.7014	0.7784	0.7014	0.8375
No log	2.4632	234	0.7455	0.6933	0.7455	0.8634
No log	2.4842	236	0.8324	0.6667	0.8324	0.9123
No log	2.5053	238	0.8664	0.6667	0.8664	0.9308
No log	2.5263	240	0.8522	0.6714	0.8522	0.9232
No log	2.5474	242	0.8353	0.6809	0.8353	0.9140
No log	2.5684	244	0.7668	0.7083	0.7668	0.8757
No log	2.5895	246	0.7420	0.7273	0.7420	0.8614
No log	2.6105	248	0.7963	0.6846	0.7963	0.8923
No log	2.6316	250	0.8565	0.6486	0.8565	0.9255
No log	2.6526	252	0.9000	0.6486	0.9000	0.9487
No log	2.6737	254	1.0293	0.6174	1.0293	1.0145
No log	2.6947	256	1.2673	0.5806	1.2673	1.1258
No log	2.7158	258	1.2904	0.5789	1.2904	1.1359
No log	2.7368	260	1.1136	0.6164	1.1136	1.0553
No log	2.7579	262	0.9526	0.6624	0.9526	0.9760
No log	2.7789	264	0.8602	0.6795	0.8602	0.9275
No log	2.8	266	0.8629	0.6531	0.8629	0.9289
No log	2.8211	268	0.8372	0.6667	0.8372	0.9150
No log	2.8421	270	0.8882	0.6667	0.8882	0.9424
No log	2.8632	272	1.0101	0.6538	1.0101	1.0050
No log	2.8842	274	1.1403	0.6026	1.1403	1.0678
No log	2.9053	276	1.1245	0.6065	1.1245	1.0604
No log	2.9263	278	1.0359	0.6316	1.0359	1.0178
No log	2.9474	280	0.9766	0.6928	0.9766	0.9882
No log	2.9684	282	1.1326	0.6234	1.1326	1.0642
No log	2.9895	284	1.0613	0.6447	1.0613	1.0302
No log	3.0105	286	1.0118	0.6842	1.0118	1.0059
No log	3.0316	288	0.8432	0.6438	0.8432	0.9183
No log	3.0526	290	0.7967	0.6569	0.7967	0.8926
No log	3.0737	292	0.7722	0.6901	0.7722	0.8788
No log	3.0947	294	0.7533	0.7234	0.7533	0.8679
No log	3.1158	296	0.7584	0.7	0.7584	0.8709
No log	3.1368	298	0.7900	0.6803	0.7900	0.8888
No log	3.1579	300	0.8937	0.6623	0.8937	0.9453
No log	3.1789	302	1.0313	0.6790	1.0313	1.0156
No log	3.2	304	0.9498	0.6225	0.9498	0.9746
No log	3.2211	306	0.8121	0.6617	0.8121	0.9012
No log	3.2421	308	0.8388	0.6667	0.8388	0.9159
No log	3.2632	310	0.8656	0.6565	0.8656	0.9304
No log	3.2842	312	0.8359	0.6466	0.8359	0.9143
No log	3.3053	314	0.8062	0.6812	0.8062	0.8979
No log	3.3263	316	0.7835	0.7	0.7835	0.8851
No log	3.3474	318	0.7721	0.6861	0.7721	0.8787
No log	3.3684	320	0.7814	0.6241	0.7814	0.8840
No log	3.3895	322	0.7979	0.6324	0.7979	0.8932
No log	3.4105	324	0.7839	0.6853	0.7839	0.8854
No log	3.4316	326	0.8039	0.6809	0.8039	0.8966
No log	3.4526	328	0.8132	0.7	0.8132	0.9018
No log	3.4737	330	0.8134	0.6519	0.8134	0.9019
No log	3.4947	332	0.8033	0.6519	0.8033	0.8963
No log	3.5158	334	0.7940	0.6567	0.7940	0.8911
No log	3.5368	336	0.7691	0.6569	0.7691	0.8770
No log	3.5579	338	0.7460	0.6619	0.7460	0.8637
No log	3.5789	340	0.7617	0.7417	0.7617	0.8728
No log	3.6	342	0.8370	0.7317	0.8370	0.9149
No log	3.6211	344	0.8649	0.6707	0.8649	0.9300
No log	3.6421	346	0.7531	0.7607	0.7531	0.8678
No log	3.6632	348	0.6513	0.7771	0.6513	0.8070
No log	3.6842	350	0.6656	0.7248	0.6656	0.8158
No log	3.7053	352	0.6907	0.7162	0.6907	0.8311
No log	3.7263	354	0.6977	0.6944	0.6977	0.8353
No log	3.7474	356	0.7412	0.6812	0.7412	0.8609
No log	3.7684	358	0.7928	0.6812	0.7928	0.8904
No log	3.7895	360	0.8393	0.7059	0.8393	0.9162
No log	3.8105	362	0.8770	0.5669	0.8770	0.9365
No log	3.8316	364	0.9087	0.5714	0.9087	0.9532
No log	3.8526	366	0.9136	0.6277	0.9136	0.9558
No log	3.8737	368	0.8253	0.7172	0.8253	0.9084
No log	3.8947	370	0.7530	0.7	0.7530	0.8678
No log	3.9158	372	0.8235	0.6857	0.8235	0.9075
No log	3.9368	374	0.8550	0.6338	0.8550	0.9247
No log	3.9579	376	0.8065	0.7042	0.8065	0.8981
No log	3.9789	378	0.7572	0.7114	0.7572	0.8701
No log	4.0	380	0.7836	0.7027	0.7836	0.8852
No log	4.0211	382	0.8738	0.6525	0.8738	0.9347
No log	4.0421	384	0.9136	0.6383	0.9136	0.9558
No log	4.0632	386	0.9113	0.6667	0.9113	0.9546
No log	4.0842	388	0.9135	0.6667	0.9135	0.9558
No log	4.1053	390	0.9232	0.6519	0.9232	0.9609
No log	4.1263	392	0.8987	0.6763	0.8987	0.9480
No log	4.1474	394	0.9140	0.6857	0.9140	0.9560
No log	4.1684	396	0.8907	0.6857	0.8907	0.9437
No log	4.1895	398	0.8204	0.6901	0.8204	0.9058
No log	4.2105	400	0.7776	0.6897	0.7776	0.8818
No log	4.2316	402	0.7645	0.7211	0.7645	0.8743
No log	4.2526	404	0.7749	0.6901	0.7749	0.8803
No log	4.2737	406	0.7978	0.6765	0.7978	0.8932
No log	4.2947	408	0.7998	0.6765	0.7998	0.8943
No log	4.3158	410	0.7800	0.6861	0.7800	0.8832
No log	4.3368	412	0.7588	0.7172	0.7588	0.8711
No log	4.3579	414	0.7396	0.7152	0.7396	0.8600
No log	4.3789	416	0.7543	0.7152	0.7543	0.8685
No log	4.4	418	0.7699	0.7034	0.7699	0.8775
No log	4.4211	420	0.7624	0.7260	0.7624	0.8731
No log	4.4421	422	0.7641	0.7133	0.7641	0.8741
No log	4.4632	424	0.7708	0.6861	0.7708	0.8780
No log	4.4842	426	0.8023	0.6716	0.8023	0.8957
No log	4.5053	428	0.8207	0.6617	0.8207	0.9059
No log	4.5263	430	0.7917	0.6861	0.7917	0.8898
No log	4.5474	432	0.7541	0.7	0.7541	0.8684
No log	4.5684	434	0.7252	0.7	0.7252	0.8516
No log	4.5895	436	0.7090	0.7248	0.7090	0.8420
No log	4.6105	438	0.7609	0.7558	0.7609	0.8723
No log	4.6316	440	0.8320	0.7209	0.8320	0.9122
No log	4.6526	442	0.8225	0.7399	0.8225	0.9069
No log	4.6737	444	0.7427	0.7241	0.7427	0.8618
No log	4.6947	446	0.7058	0.7468	0.7058	0.8401
No log	4.7158	448	0.7072	0.7368	0.7072	0.8409
No log	4.7368	450	0.7213	0.7347	0.7213	0.8493
No log	4.7579	452	0.7688	0.6980	0.7688	0.8768
No log	4.7789	454	0.7742	0.7172	0.7742	0.8799
No log	4.8	456	0.7576	0.7310	0.7576	0.8704
No log	4.8211	458	0.7395	0.7260	0.7395	0.8599
No log	4.8421	460	0.7457	0.7260	0.7457	0.8635
No log	4.8632	462	0.7535	0.7222	0.7535	0.8681
No log	4.8842	464	0.7694	0.7222	0.7694	0.8772
No log	4.9053	466	0.7729	0.7172	0.7729	0.8791
No log	4.9263	468	0.7678	0.6861	0.7678	0.8762
No log	4.9474	470	0.7708	0.6861	0.7708	0.8780
No log	4.9684	472	0.7741	0.7	0.7741	0.8798
No log	4.9895	474	0.8076	0.6667	0.8076	0.8987
No log	5.0105	476	0.8372	0.6715	0.8372	0.9150
No log	5.0316	478	0.9199	0.6294	0.9199	0.9591
No log	5.0526	480	0.9979	0.6575	0.9979	0.9989
No log	5.0737	482	1.0812	0.6184	1.0812	1.0398
No log	5.0947	484	1.0263	0.6275	1.0263	1.0131
No log	5.1158	486	0.8649	0.6712	0.8649	0.9300
No log	5.1368	488	0.8195	0.6809	0.8195	0.9053
No log	5.1579	490	0.8046	0.6809	0.8046	0.8970
No log	5.1789	492	0.8199	0.6897	0.8199	0.9055
No log	5.2	494	0.8727	0.7037	0.8727	0.9342
No log	5.2211	496	0.9395	0.6918	0.9395	0.9693
No log	5.2421	498	0.9347	0.6918	0.9347	0.9668
0.4976	5.2632	500	0.8996	0.6835	0.8996	0.9485
0.4976	5.2842	502	0.9023	0.6914	0.9023	0.9499
0.4976	5.3053	504	0.9402	0.7152	0.9402	0.9696
0.4976	5.3263	506	0.9943	0.6826	0.9943	0.9971
0.4976	5.3474	508	0.9327	0.6951	0.9327	0.9657
0.4976	5.3684	510	0.8361	0.6914	0.8361	0.9144
0.4976	5.3895	512	0.8147	0.7027	0.8147	0.9026
0.4976	5.4105	514	0.8041	0.6849	0.8041	0.8967
0.4976	5.4316	516	0.7905	0.7034	0.7905	0.8891
0.4976	5.4526	518	0.7830	0.7083	0.7830	0.8849
0.4976	5.4737	520	0.7837	0.7050	0.7837	0.8853
0.4976	5.4947	522	0.7883	0.7143	0.7883	0.8879
0.4976	5.5158	524	0.8014	0.6906	0.8014	0.8952
0.4976	5.5368	526	0.8042	0.7092	0.8042	0.8968
0.4976	5.5579	528	0.8118	0.7375	0.8118	0.9010
0.4976	5.5789	530	0.8776	0.7251	0.8776	0.9368
0.4976	5.6	532	0.8688	0.7093	0.8688	0.9321
0.4976	5.6211	534	0.8239	0.7037	0.8239	0.9077
0.4976	5.6421	536	0.8045	0.6957	0.8045	0.8970
0.4976	5.6632	538	0.8363	0.6912	0.8363	0.9145
0.4976	5.6842	540	0.9796	0.6187	0.9796	0.9897
0.4976	5.7053	542	1.0308	0.6	1.0308	1.0153
0.4976	5.7263	544	0.9723	0.6715	0.9723	0.9860
0.4976	5.7474	546	0.8553	0.6718	0.8553	0.9248
0.4976	5.7684	548	0.7961	0.6818	0.7961	0.8922

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1