ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run3_AugV5_k19_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9750
• Qwk: 0.5488
• Mse: 0.9750
• Rmse: 0.9874

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0217	2	5.1816	-0.0433	5.1816	2.2763
No log	0.0435	4	3.1340	0.0459	3.1340	1.7703
No log	0.0652	6	2.8672	-0.1482	2.8672	1.6933
No log	0.0870	8	2.4576	-0.1765	2.4576	1.5677
No log	0.1087	10	1.7254	-0.0209	1.7254	1.3135
No log	0.1304	12	1.6879	-0.1017	1.6879	1.2992
No log	0.1522	14	1.2784	0.1328	1.2784	1.1307
No log	0.1739	16	1.2868	0.2309	1.2868	1.1344
No log	0.1957	18	1.7652	0.1185	1.7652	1.3286
No log	0.2174	20	1.5770	0.1860	1.5770	1.2558
No log	0.2391	22	1.1876	0.3311	1.1876	1.0898
No log	0.2609	24	1.0547	0.3478	1.0547	1.0270
No log	0.2826	26	0.9919	0.3523	0.9919	0.9959
No log	0.3043	28	0.9767	0.3877	0.9767	0.9883
No log	0.3261	30	1.0819	0.4657	1.0819	1.0401
No log	0.3478	32	1.2811	0.3673	1.2811	1.1318
No log	0.3696	34	1.1860	0.4202	1.1860	1.0890
No log	0.3913	36	1.0639	0.4833	1.0639	1.0315
No log	0.4130	38	0.9582	0.4946	0.9582	0.9789
No log	0.4348	40	0.8110	0.5136	0.8110	0.9006
No log	0.4565	42	0.7930	0.4825	0.7930	0.8905
No log	0.4783	44	0.8010	0.5021	0.8010	0.8950
No log	0.5	46	0.7880	0.5654	0.7880	0.8877
No log	0.5217	48	0.9704	0.5856	0.9704	0.9851
No log	0.5435	50	0.9107	0.5662	0.9107	0.9543
No log	0.5652	52	0.7835	0.5412	0.7835	0.8851
No log	0.5870	54	0.8204	0.5342	0.8204	0.9057
No log	0.6087	56	1.1383	0.5139	1.1383	1.0669
No log	0.6304	58	1.1360	0.4837	1.1360	1.0658
No log	0.6522	60	0.8084	0.4322	0.8084	0.8991
No log	0.6739	62	0.8170	0.4583	0.8170	0.9039
No log	0.6957	64	1.2047	0.2646	1.2047	1.0976
No log	0.7174	66	1.2075	0.2552	1.2075	1.0988
No log	0.7391	68	0.8665	0.3941	0.8665	0.9308
No log	0.7609	70	0.8261	0.4511	0.8261	0.9089
No log	0.7826	72	0.9347	0.4306	0.9347	0.9668
No log	0.8043	74	0.8046	0.4691	0.8046	0.8970
No log	0.8261	76	0.7527	0.5804	0.7527	0.8676
No log	0.8478	78	1.0849	0.3296	1.0849	1.0416
No log	0.8696	80	1.1966	0.3069	1.1966	1.0939
No log	0.8913	82	0.9135	0.4592	0.9135	0.9558
No log	0.9130	84	0.7163	0.6029	0.7163	0.8463
No log	0.9348	86	0.9490	0.5518	0.9490	0.9742
No log	0.9565	88	1.3453	0.3980	1.3453	1.1599
No log	0.9783	90	1.2666	0.4476	1.2666	1.1254
No log	1.0	92	0.8962	0.5470	0.8962	0.9467
No log	1.0217	94	0.6687	0.6419	0.6687	0.8177
No log	1.0435	96	0.8427	0.5716	0.8427	0.9180
No log	1.0652	98	0.9698	0.4814	0.9698	0.9848
No log	1.0870	100	0.8384	0.5333	0.8384	0.9157
No log	1.1087	102	0.6561	0.6317	0.6561	0.8100
No log	1.1304	104	0.7011	0.6755	0.7011	0.8373
No log	1.1522	106	0.8370	0.5826	0.8370	0.9149
No log	1.1739	108	0.7830	0.6058	0.7830	0.8849
No log	1.1957	110	0.6570	0.6690	0.6570	0.8105
No log	1.2174	112	0.7145	0.6454	0.7145	0.8453
No log	1.2391	114	0.7888	0.5920	0.7888	0.8881
No log	1.2609	116	0.7168	0.6224	0.7168	0.8466
No log	1.2826	118	0.6785	0.6346	0.6785	0.8237
No log	1.3043	120	0.6684	0.6342	0.6684	0.8176
No log	1.3261	122	0.7055	0.5882	0.7055	0.8400
No log	1.3478	124	0.7084	0.5716	0.7084	0.8417
No log	1.3696	126	0.7045	0.5753	0.7045	0.8393
No log	1.3913	128	0.7944	0.5245	0.7944	0.8913
No log	1.4130	130	0.8910	0.5138	0.8910	0.9439
No log	1.4348	132	0.8691	0.4595	0.8691	0.9323
No log	1.4565	134	0.8288	0.4557	0.8288	0.9104
No log	1.4783	136	0.7616	0.5029	0.7616	0.8727
No log	1.5	138	0.7849	0.4512	0.7849	0.8859
No log	1.5217	140	0.8366	0.4852	0.8366	0.9147
No log	1.5435	142	0.8473	0.4950	0.8473	0.9205
No log	1.5652	144	0.9173	0.4659	0.9173	0.9578
No log	1.5870	146	0.9465	0.4521	0.9465	0.9729
No log	1.6087	148	0.8884	0.4654	0.8884	0.9426
No log	1.6304	150	0.8668	0.4887	0.8668	0.9310
No log	1.6522	152	0.8739	0.5121	0.8739	0.9348
No log	1.6739	154	0.9053	0.5345	0.9053	0.9515
No log	1.6957	156	0.9613	0.5208	0.9613	0.9805
No log	1.7174	158	0.9711	0.5419	0.9711	0.9855
No log	1.7391	160	0.8882	0.5143	0.8882	0.9424
No log	1.7609	162	0.8500	0.4479	0.8500	0.9220
No log	1.7826	164	0.8180	0.4882	0.8180	0.9045
No log	1.8043	166	0.7850	0.5482	0.7850	0.8860
No log	1.8261	168	0.7564	0.5533	0.7564	0.8697
No log	1.8478	170	0.7473	0.5465	0.7473	0.8644
No log	1.8696	172	0.8031	0.5666	0.8031	0.8961
No log	1.8913	174	0.8994	0.5936	0.8994	0.9483
No log	1.9130	176	0.8905	0.6175	0.8905	0.9437
No log	1.9348	178	0.7735	0.6042	0.7735	0.8795
No log	1.9565	180	0.6894	0.6026	0.6894	0.8303
No log	1.9783	182	1.0128	0.4183	1.0128	1.0064
No log	2.0	184	1.1890	0.3479	1.1890	1.0904
No log	2.0217	186	0.9326	0.5716	0.9326	0.9657
No log	2.0435	188	0.7052	0.6988	0.7052	0.8397
No log	2.0652	190	0.6934	0.6912	0.6934	0.8327
No log	2.0870	192	0.7159	0.6845	0.7159	0.8461
No log	2.1087	194	0.6802	0.6508	0.6802	0.8247
No log	2.1304	196	0.7444	0.6124	0.7444	0.8628
No log	2.1522	198	1.0095	0.4986	1.0095	1.0047
No log	2.1739	200	1.1654	0.4775	1.1654	1.0795
No log	2.1957	202	1.1749	0.3421	1.1749	1.0839
No log	2.2174	204	0.9973	0.4202	0.9973	0.9987
No log	2.2391	206	0.8059	0.5646	0.8059	0.8977
No log	2.2609	208	0.7230	0.5733	0.7230	0.8503
No log	2.2826	210	0.7135	0.5906	0.7135	0.8447
No log	2.3043	212	0.7027	0.6141	0.7027	0.8383
No log	2.3261	214	0.7407	0.6406	0.7407	0.8607
No log	2.3478	216	0.8938	0.5236	0.8938	0.9454
No log	2.3696	218	0.9587	0.5333	0.9587	0.9791
No log	2.3913	220	0.8727	0.5600	0.8727	0.9342
No log	2.4130	222	0.7887	0.6135	0.7887	0.8881
No log	2.4348	224	0.7689	0.6375	0.7689	0.8769
No log	2.4565	226	0.7603	0.6937	0.7603	0.8719
No log	2.4783	228	0.7550	0.6893	0.7550	0.8689
No log	2.5	230	0.7352	0.6779	0.7352	0.8574
No log	2.5217	232	0.7535	0.6902	0.7535	0.8680
No log	2.5435	234	0.8021	0.6137	0.8021	0.8956
No log	2.5652	236	0.9417	0.5393	0.9417	0.9704
No log	2.5870	238	1.0006	0.5462	1.0006	1.0003
No log	2.6087	240	0.9502	0.5776	0.9502	0.9748
No log	2.6304	242	0.8832	0.6098	0.8832	0.9398
No log	2.6522	244	0.7795	0.6735	0.7795	0.8829
No log	2.6739	246	0.7446	0.6890	0.7446	0.8629
No log	2.6957	248	0.7463	0.7007	0.7463	0.8639
No log	2.7174	250	0.7833	0.6963	0.7833	0.8850
No log	2.7391	252	0.8150	0.6464	0.8150	0.9028
No log	2.7609	254	0.7947	0.6832	0.7947	0.8914
No log	2.7826	256	0.8068	0.6777	0.8068	0.8982
No log	2.8043	258	0.8549	0.6447	0.8549	0.9246
No log	2.8261	260	0.8863	0.6332	0.8863	0.9414
No log	2.8478	262	0.8685	0.6065	0.8685	0.9320
No log	2.8696	264	0.7826	0.6242	0.7826	0.8847
No log	2.8913	266	0.7458	0.6648	0.7458	0.8636
No log	2.9130	268	0.7516	0.6428	0.7516	0.8670
No log	2.9348	270	0.7576	0.6556	0.7576	0.8704
No log	2.9565	272	0.8149	0.6653	0.8149	0.9027
No log	2.9783	274	0.8548	0.6252	0.8548	0.9245
No log	3.0	276	0.8463	0.6327	0.8463	0.9199
No log	3.0217	278	0.8302	0.6441	0.8302	0.9111
No log	3.0435	280	0.9112	0.6042	0.9112	0.9545
No log	3.0652	282	1.0200	0.5477	1.0200	1.0100
No log	3.0870	284	0.9369	0.5695	0.9369	0.9679
No log	3.1087	286	0.7508	0.6428	0.7508	0.8665
No log	3.1304	288	0.7001	0.6235	0.7001	0.8367
No log	3.1522	290	0.7189	0.6481	0.7189	0.8479
No log	3.1739	292	0.7066	0.6466	0.7066	0.8406
No log	3.1957	294	0.7088	0.6857	0.7088	0.8419
No log	3.2174	296	0.6732	0.7169	0.6732	0.8205
No log	3.2391	298	0.6794	0.7311	0.6794	0.8243
No log	3.2609	300	0.6833	0.7310	0.6833	0.8266
No log	3.2826	302	0.6937	0.7133	0.6937	0.8329
No log	3.3043	304	0.6845	0.7318	0.6845	0.8273
No log	3.3261	306	0.6609	0.7251	0.6609	0.8130
No log	3.3478	308	0.6751	0.6950	0.6751	0.8216
No log	3.3696	310	0.7320	0.6557	0.7320	0.8556
No log	3.3913	312	0.7100	0.6899	0.7100	0.8426
No log	3.4130	314	0.6755	0.6983	0.6755	0.8219
No log	3.4348	316	0.6757	0.6907	0.6757	0.8220
No log	3.4565	318	0.6898	0.6959	0.6898	0.8306
No log	3.4783	320	0.7098	0.7111	0.7098	0.8425
No log	3.5	322	0.7154	0.7017	0.7154	0.8458
No log	3.5217	324	0.7267	0.6913	0.7267	0.8525
No log	3.5435	326	0.6984	0.7009	0.6984	0.8357
No log	3.5652	328	0.6930	0.6838	0.6930	0.8325
No log	3.5870	330	0.6912	0.6749	0.6912	0.8314
No log	3.6087	332	0.6632	0.6835	0.6632	0.8144
No log	3.6304	334	0.6689	0.6957	0.6689	0.8179
No log	3.6522	336	0.6887	0.6860	0.6887	0.8299
No log	3.6739	338	0.6683	0.7118	0.6683	0.8175
No log	3.6957	340	0.6857	0.7053	0.6857	0.8281
No log	3.7174	342	0.7087	0.7065	0.7087	0.8419
No log	3.7391	344	0.7439	0.6888	0.7439	0.8625
No log	3.7609	346	0.7798	0.6580	0.7798	0.8831
No log	3.7826	348	0.8565	0.6176	0.8565	0.9255
No log	3.8043	350	0.8697	0.6221	0.8697	0.9326
No log	3.8261	352	0.7700	0.6495	0.7700	0.8775
No log	3.8478	354	0.6781	0.7103	0.6781	0.8234
No log	3.8696	356	0.6678	0.7005	0.6678	0.8172
No log	3.8913	358	0.7109	0.6800	0.7109	0.8432
No log	3.9130	360	0.7133	0.6854	0.7133	0.8446
No log	3.9348	362	0.6959	0.7096	0.6959	0.8342
No log	3.9565	364	0.6836	0.7193	0.6836	0.8268
No log	3.9783	366	0.6922	0.6994	0.6922	0.8320
No log	4.0	368	0.6984	0.7083	0.6984	0.8357
No log	4.0217	370	0.7030	0.7172	0.7030	0.8385
No log	4.0435	372	0.6936	0.7215	0.6936	0.8328
No log	4.0652	374	0.6803	0.7395	0.6803	0.8248
No log	4.0870	376	0.6687	0.7071	0.6687	0.8178
No log	4.1087	378	0.6842	0.6867	0.6842	0.8272
No log	4.1304	380	0.6870	0.6970	0.6870	0.8288
No log	4.1522	382	0.6727	0.7102	0.6727	0.8202
No log	4.1739	384	0.6773	0.7274	0.6773	0.8230
No log	4.1957	386	0.6906	0.7311	0.6906	0.8310
No log	4.2174	388	0.7069	0.6976	0.7069	0.8408
No log	4.2391	390	0.7122	0.6772	0.7122	0.8439
No log	4.2609	392	0.6968	0.6595	0.6968	0.8347
No log	4.2826	394	0.6884	0.6659	0.6884	0.8297
No log	4.3043	396	0.6911	0.6365	0.6911	0.8313
No log	4.3261	398	0.7208	0.6501	0.7208	0.8490
No log	4.3478	400	0.7648	0.6341	0.7648	0.8746
No log	4.3696	402	0.7828	0.6307	0.7828	0.8848
No log	4.3913	404	0.7520	0.6317	0.7520	0.8672
No log	4.4130	406	0.7399	0.6403	0.7399	0.8602
No log	4.4348	408	0.7723	0.6191	0.7723	0.8788
No log	4.4565	410	0.7813	0.6270	0.7813	0.8839
No log	4.4783	412	0.7333	0.6365	0.7333	0.8564
No log	4.5	414	0.7036	0.6333	0.7036	0.8388
No log	4.5217	416	0.6954	0.6353	0.6954	0.8339
No log	4.5435	418	0.6908	0.6570	0.6908	0.8312
No log	4.5652	420	0.7075	0.6721	0.7075	0.8411
No log	4.5870	422	0.7911	0.6443	0.7911	0.8894
No log	4.6087	424	0.8264	0.6565	0.8264	0.9091
No log	4.6304	426	0.7706	0.6719	0.7706	0.8778
No log	4.6522	428	0.7147	0.6719	0.7147	0.8454
No log	4.6739	430	0.6981	0.6765	0.6981	0.8355
No log	4.6957	432	0.7448	0.6472	0.7448	0.8630
No log	4.7174	434	0.7455	0.6113	0.7455	0.8634
No log	4.7391	436	0.6956	0.6577	0.6956	0.8340
No log	4.7609	438	0.6908	0.6767	0.6908	0.8311
No log	4.7826	440	0.7895	0.6703	0.7895	0.8885
No log	4.8043	442	0.8194	0.6603	0.8194	0.9052
No log	4.8261	444	0.7607	0.6682	0.7607	0.8722
No log	4.8478	446	0.7138	0.7143	0.7138	0.8449
No log	4.8696	448	0.7136	0.6980	0.7136	0.8447
No log	4.8913	450	0.7084	0.6949	0.7084	0.8417
No log	4.9130	452	0.6728	0.7061	0.6728	0.8202
No log	4.9348	454	0.6836	0.6631	0.6836	0.8268
No log	4.9565	456	0.7394	0.6603	0.7394	0.8599
No log	4.9783	458	0.7525	0.6776	0.7525	0.8675
No log	5.0	460	0.7337	0.6772	0.7337	0.8566
No log	5.0217	462	0.6995	0.6840	0.6995	0.8364
No log	5.0435	464	0.6831	0.7076	0.6831	0.8265
No log	5.0652	466	0.6832	0.7172	0.6832	0.8266
No log	5.0870	468	0.6875	0.7187	0.6875	0.8291
No log	5.1087	470	0.6943	0.7180	0.6943	0.8333
No log	5.1304	472	0.7182	0.6931	0.7182	0.8475
No log	5.1522	474	0.7463	0.6993	0.7463	0.8639
No log	5.1739	476	0.7140	0.6931	0.7140	0.8450
No log	5.1957	478	0.6872	0.7047	0.6872	0.8290
No log	5.2174	480	0.6666	0.7325	0.6666	0.8165
No log	5.2391	482	0.6585	0.7325	0.6585	0.8115
No log	5.2609	484	0.6485	0.7274	0.6485	0.8053
No log	5.2826	486	0.6532	0.6835	0.6532	0.8082
No log	5.3043	488	0.6819	0.6721	0.6819	0.8258
No log	5.3261	490	0.7098	0.6460	0.7098	0.8425
No log	5.3478	492	0.7203	0.6095	0.7203	0.8487
No log	5.3696	494	0.7090	0.5950	0.7090	0.8420
No log	5.3913	496	0.6929	0.6149	0.6929	0.8324
No log	5.4130	498	0.6865	0.6493	0.6865	0.8286
0.4519	5.4348	500	0.6839	0.6786	0.6839	0.8270
0.4519	5.4565	502	0.6712	0.7000	0.6712	0.8193
0.4519	5.4783	504	0.6601	0.6914	0.6601	0.8124
0.4519	5.5	506	0.6680	0.6854	0.6680	0.8173
0.4519	5.5217	508	0.6658	0.6973	0.6658	0.8160
0.4519	5.5435	510	0.6624	0.6883	0.6624	0.8139
0.4519	5.5652	512	0.6650	0.6874	0.6650	0.8155
0.4519	5.5870	514	0.6757	0.6886	0.6757	0.8220
0.4519	5.6087	516	0.6766	0.7079	0.6766	0.8225
0.4519	5.6304	518	0.6829	0.6904	0.6829	0.8264
0.4519	5.6522	520	0.6731	0.7041	0.6731	0.8204
0.4519	5.6739	522	0.6786	0.6996	0.6786	0.8238
0.4519	5.6957	524	0.7006	0.7029	0.7006	0.8370
0.4519	5.7174	526	0.7084	0.7017	0.7084	0.8417
0.4519	5.7391	528	0.7069	0.6920	0.7069	0.8408
0.4519	5.7609	530	0.7013	0.7055	0.7013	0.8375
0.4519	5.7826	532	0.7177	0.7033	0.7177	0.8472
0.4519	5.8043	534	0.7075	0.7189	0.7075	0.8411
0.4519	5.8261	536	0.7193	0.7031	0.7193	0.8481
0.4519	5.8478	538	0.7613	0.6869	0.7613	0.8725
0.4519	5.8696	540	0.7989	0.6986	0.7989	0.8938
0.4519	5.8913	542	0.7662	0.7029	0.7662	0.8753
0.4519	5.9130	544	0.7588	0.6862	0.7588	0.8711
0.4519	5.9348	546	0.7607	0.6802	0.7607	0.8722
0.4519	5.9565	548	0.7456	0.6779	0.7456	0.8635
0.4519	5.9783	550	0.8080	0.6219	0.8080	0.8989
0.4519	6.0	552	0.9252	0.5889	0.9252	0.9619
0.4519	6.0217	554	0.9885	0.5693	0.9885	0.9942
0.4519	6.0435	556	0.9750	0.5488	0.9750	0.9874

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1