ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run2_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7177
• Qwk: 0.5342
• Mse: 0.7177
• Rmse: 0.8471

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0202	2	5.5040	0.0018	5.5040	2.3461
No log	0.0404	4	3.2950	0.0543	3.2950	1.8152
No log	0.0606	6	2.3129	-0.0251	2.3129	1.5208
No log	0.0808	8	1.5746	0.0706	1.5746	1.2548
No log	0.1010	10	1.3089	0.2204	1.3089	1.1441
No log	0.1212	12	1.1782	0.2411	1.1782	1.0855
No log	0.1414	14	1.1647	0.1757	1.1647	1.0792
No log	0.1616	16	1.0904	0.2433	1.0904	1.0442
No log	0.1818	18	1.4408	0.1323	1.4408	1.2003
No log	0.2020	20	1.8277	0.1487	1.8277	1.3519
No log	0.2222	22	1.8397	0.1428	1.8397	1.3564
No log	0.2424	24	1.5233	0.1574	1.5233	1.2342
No log	0.2626	26	1.1175	0.2993	1.1175	1.0571
No log	0.2828	28	1.1016	0.2080	1.1016	1.0495
No log	0.3030	30	1.4100	0.0630	1.4100	1.1874
No log	0.3232	32	1.2547	0.0747	1.2547	1.1201
No log	0.3434	34	1.0621	0.3347	1.0621	1.0306
No log	0.3636	36	1.3045	0.2209	1.3045	1.1421
No log	0.3838	38	1.7707	0.1749	1.7707	1.3307
No log	0.4040	40	1.8763	0.1391	1.8763	1.3698
No log	0.4242	42	1.5103	0.1495	1.5103	1.2290
No log	0.4444	44	1.1731	0.2853	1.1731	1.0831
No log	0.4646	46	1.1296	0.3064	1.1296	1.0628
No log	0.4848	48	1.1342	0.2892	1.1342	1.0650
No log	0.5051	50	1.0784	0.3532	1.0784	1.0384
No log	0.5253	52	1.0395	0.2999	1.0395	1.0195
No log	0.5455	54	1.0178	0.3978	1.0178	1.0088
No log	0.5657	56	1.1586	0.4356	1.1586	1.0764
No log	0.5859	58	1.1413	0.4494	1.1413	1.0683
No log	0.6061	60	1.2503	0.4282	1.2503	1.1182
No log	0.6263	62	1.3368	0.4108	1.3368	1.1562
No log	0.6465	64	1.1937	0.4555	1.1937	1.0926
No log	0.6667	66	1.0062	0.5189	1.0062	1.0031
No log	0.6869	68	0.7676	0.5832	0.7676	0.8761
No log	0.7071	70	0.7432	0.6076	0.7432	0.8621
No log	0.7273	72	0.7272	0.6155	0.7272	0.8527
No log	0.7475	74	0.7003	0.6227	0.7003	0.8368
No log	0.7677	76	0.7353	0.6355	0.7353	0.8575
No log	0.7879	78	0.7416	0.6341	0.7416	0.8612
No log	0.8081	80	0.8373	0.5054	0.8373	0.9150
No log	0.8283	82	0.8826	0.4910	0.8826	0.9395
No log	0.8485	84	1.0048	0.4242	1.0048	1.0024
No log	0.8687	86	0.8815	0.4524	0.8815	0.9389
No log	0.8889	88	0.7907	0.5785	0.7907	0.8892
No log	0.9091	90	0.7841	0.5367	0.7841	0.8855
No log	0.9293	92	0.7868	0.5383	0.7868	0.8870
No log	0.9495	94	0.7268	0.5635	0.7268	0.8525
No log	0.9697	96	0.7234	0.5576	0.7234	0.8505
No log	0.9899	98	0.8755	0.5896	0.8755	0.9357
No log	1.0101	100	0.9459	0.5468	0.9459	0.9726
No log	1.0303	102	1.1547	0.4654	1.1547	1.0746
No log	1.0505	104	0.8868	0.5694	0.8868	0.9417
No log	1.0707	106	0.7628	0.5740	0.7628	0.8734
No log	1.0909	108	0.6968	0.6065	0.6968	0.8348
No log	1.1111	110	0.7081	0.6685	0.7081	0.8415
No log	1.1313	112	0.7012	0.6036	0.7012	0.8374
No log	1.1515	114	0.7935	0.5793	0.7935	0.8908
No log	1.1717	116	0.7364	0.5573	0.7364	0.8581
No log	1.1919	118	0.7080	0.6453	0.7080	0.8415
No log	1.2121	120	1.0527	0.4820	1.0527	1.0260
No log	1.2323	122	1.2496	0.3952	1.2496	1.1179
No log	1.2525	124	1.0692	0.4936	1.0692	1.0340
No log	1.2727	126	0.7896	0.5898	0.7896	0.8886
No log	1.2929	128	0.6988	0.6606	0.6988	0.8359
No log	1.3131	130	0.7090	0.6278	0.7090	0.8420
No log	1.3333	132	0.7869	0.6185	0.7869	0.8871
No log	1.3535	134	0.7773	0.6238	0.7773	0.8817
No log	1.3737	136	0.7582	0.6548	0.7582	0.8708
No log	1.3939	138	0.7014	0.6557	0.7014	0.8375
No log	1.4141	140	0.6841	0.5986	0.6841	0.8271
No log	1.4343	142	0.7164	0.5695	0.7164	0.8464
No log	1.4545	144	0.6821	0.6091	0.6821	0.8259
No log	1.4747	146	0.7722	0.6442	0.7722	0.8788
No log	1.4949	148	0.9388	0.6043	0.9388	0.9689
No log	1.5152	150	0.9154	0.5862	0.9154	0.9567
No log	1.5354	152	0.7234	0.6311	0.7234	0.8505
No log	1.5556	154	0.6759	0.6372	0.6759	0.8221
No log	1.5758	156	0.6768	0.6280	0.6768	0.8227
No log	1.5960	158	0.7244	0.5828	0.7244	0.8511
No log	1.6162	160	0.9651	0.4600	0.9651	0.9824
No log	1.6364	162	1.0065	0.4598	1.0065	1.0033
No log	1.6566	164	0.8486	0.5589	0.8486	0.9212
No log	1.6768	166	0.7326	0.5256	0.7326	0.8559
No log	1.6970	168	0.7461	0.5355	0.7461	0.8638
No log	1.7172	170	0.7395	0.5227	0.7395	0.8600
No log	1.7374	172	0.7591	0.5317	0.7591	0.8712
No log	1.7576	174	0.8229	0.5308	0.8229	0.9071
No log	1.7778	176	0.7793	0.5919	0.7793	0.8828
No log	1.7980	178	0.7191	0.5137	0.7191	0.8480
No log	1.8182	180	0.7139	0.5370	0.7139	0.8449
No log	1.8384	182	0.7840	0.6103	0.7840	0.8854
No log	1.8586	184	0.8549	0.6372	0.8549	0.9246
No log	1.8788	186	0.7536	0.6606	0.7536	0.8681
No log	1.8990	188	0.6736	0.6569	0.6736	0.8208
No log	1.9192	190	0.6429	0.6916	0.6429	0.8018
No log	1.9394	192	0.6506	0.6993	0.6506	0.8066
No log	1.9596	194	0.6698	0.6772	0.6698	0.8184
No log	1.9798	196	0.6510	0.6849	0.6510	0.8068
No log	2.0	198	0.6435	0.6972	0.6435	0.8022
No log	2.0202	200	0.6619	0.6799	0.6619	0.8136
No log	2.0404	202	0.6659	0.5986	0.6659	0.8160
No log	2.0606	204	0.6763	0.5823	0.6763	0.8223
No log	2.0808	206	0.6654	0.6457	0.6654	0.8157
No log	2.1010	208	0.6390	0.7067	0.6390	0.7993
No log	2.1212	210	0.6292	0.7084	0.6292	0.7932
No log	2.1414	212	0.6243	0.7189	0.6243	0.7901
No log	2.1616	214	0.6391	0.6547	0.6391	0.7994
No log	2.1818	216	0.6390	0.6315	0.6390	0.7994
No log	2.2020	218	0.6316	0.6579	0.6316	0.7947
No log	2.2222	220	0.6367	0.6794	0.6367	0.7979
No log	2.2424	222	0.6567	0.6859	0.6567	0.8104
No log	2.2626	224	0.6202	0.7105	0.6202	0.7875
No log	2.2828	226	0.6303	0.7166	0.6303	0.7939
No log	2.3030	228	0.6186	0.7323	0.6186	0.7865
No log	2.3232	230	0.6249	0.6922	0.6249	0.7905
No log	2.3434	232	0.6322	0.6888	0.6322	0.7951
No log	2.3636	234	0.6075	0.7173	0.6075	0.7794
No log	2.3838	236	0.6837	0.6945	0.6837	0.8268
No log	2.4040	238	0.7742	0.6383	0.7742	0.8799
No log	2.4242	240	0.6792	0.6768	0.6792	0.8242
No log	2.4444	242	0.6265	0.7052	0.6265	0.7915
No log	2.4646	244	0.6255	0.7131	0.6255	0.7909
No log	2.4848	246	0.6335	0.7125	0.6335	0.7959
No log	2.5051	248	0.6557	0.7203	0.6557	0.8097
No log	2.5253	250	0.7640	0.6051	0.7640	0.8741
No log	2.5455	252	0.8574	0.5849	0.8574	0.9260
No log	2.5657	254	0.7514	0.6547	0.7514	0.8668
No log	2.5859	256	0.6669	0.6014	0.6669	0.8166
No log	2.6061	258	0.7299	0.5957	0.7299	0.8543
No log	2.6263	260	0.7250	0.6075	0.7250	0.8515
No log	2.6465	262	0.6693	0.5545	0.6693	0.8181
No log	2.6667	264	0.6844	0.6370	0.6844	0.8273
No log	2.6869	266	0.8083	0.5645	0.8083	0.8991
No log	2.7071	268	0.8291	0.5645	0.8291	0.9106
No log	2.7273	270	0.7064	0.6654	0.7064	0.8405
No log	2.7475	272	0.6420	0.6226	0.6420	0.8013
No log	2.7677	274	0.7452	0.6198	0.7452	0.8632
No log	2.7879	276	0.7258	0.6166	0.7258	0.8519
No log	2.8081	278	0.6248	0.7132	0.6248	0.7904
No log	2.8283	280	0.7195	0.6747	0.7195	0.8482
No log	2.8485	282	0.8943	0.5664	0.8943	0.9457
No log	2.8687	284	0.8692	0.5649	0.8692	0.9323
No log	2.8889	286	0.7375	0.6503	0.7375	0.8588
No log	2.9091	288	0.6586	0.6751	0.6586	0.8115
No log	2.9293	290	0.6608	0.5637	0.6608	0.8129
No log	2.9495	292	0.6539	0.5717	0.6539	0.8086
No log	2.9697	294	0.6388	0.6918	0.6388	0.7993
No log	2.9899	296	0.6671	0.7056	0.6671	0.8167
No log	3.0101	298	0.7221	0.6664	0.7221	0.8498
No log	3.0303	300	0.7040	0.6789	0.7040	0.8390
No log	3.0505	302	0.6940	0.7006	0.6940	0.8331
No log	3.0707	304	0.7295	0.6715	0.7295	0.8541
No log	3.0909	306	0.7935	0.6046	0.7935	0.8908
No log	3.1111	308	0.8599	0.5376	0.8599	0.9273
No log	3.1313	310	0.8554	0.5387	0.8554	0.9249
No log	3.1515	312	0.7916	0.5938	0.7916	0.8897
No log	3.1717	314	0.7368	0.6540	0.7368	0.8584
No log	3.1919	316	0.7054	0.6364	0.7054	0.8399
No log	3.2121	318	0.7094	0.6364	0.7094	0.8422
No log	3.2323	320	0.7675	0.6117	0.7675	0.8761
No log	3.2525	322	0.7852	0.6117	0.7852	0.8861
No log	3.2727	324	0.7142	0.6534	0.7142	0.8451
No log	3.2929	326	0.6750	0.6840	0.6750	0.8216
No log	3.3131	328	0.6434	0.6945	0.6434	0.8021
No log	3.3333	330	0.6290	0.6891	0.6290	0.7931
No log	3.3535	332	0.6330	0.6245	0.6330	0.7956
No log	3.3737	334	0.6138	0.6703	0.6138	0.7835
No log	3.3939	336	0.6320	0.7016	0.6320	0.7950
No log	3.4141	338	0.8217	0.6157	0.8217	0.9065
No log	3.4343	340	0.8330	0.6134	0.8330	0.9127
No log	3.4545	342	0.6733	0.6935	0.6733	0.8206
No log	3.4747	344	0.6070	0.6843	0.6070	0.7791
No log	3.4949	346	0.6403	0.6844	0.6403	0.8002
No log	3.5152	348	0.6653	0.6356	0.6653	0.8156
No log	3.5354	350	0.6678	0.5923	0.6678	0.8172
No log	3.5556	352	0.7176	0.6195	0.7176	0.8471
No log	3.5758	354	0.7164	0.6477	0.7164	0.8464
No log	3.5960	356	0.6645	0.6348	0.6645	0.8152
No log	3.6162	358	0.6623	0.5922	0.6623	0.8138
No log	3.6364	360	0.6570	0.6083	0.6570	0.8105
No log	3.6566	362	0.6687	0.6365	0.6687	0.8177
No log	3.6768	364	0.7325	0.6489	0.7325	0.8559
No log	3.6970	366	0.7909	0.6046	0.7909	0.8893
No log	3.7172	368	0.7728	0.6159	0.7728	0.8791
No log	3.7374	370	0.6764	0.6460	0.6764	0.8224
No log	3.7576	372	0.6731	0.5887	0.6731	0.8204
No log	3.7778	374	0.6963	0.5683	0.6963	0.8344
No log	3.7980	376	0.6886	0.5885	0.6886	0.8298
No log	3.8182	378	0.6567	0.6293	0.6567	0.8103
No log	3.8384	380	0.6684	0.6841	0.6684	0.8175
No log	3.8586	382	0.7394	0.6400	0.7394	0.8599
No log	3.8788	384	0.8398	0.5909	0.8398	0.9164
No log	3.8990	386	0.8122	0.6054	0.8122	0.9012
No log	3.9192	388	0.7121	0.6175	0.7121	0.8439
No log	3.9394	390	0.6866	0.5654	0.6866	0.8286
No log	3.9596	392	0.6726	0.5858	0.6726	0.8201
No log	3.9798	394	0.6454	0.6682	0.6454	0.8034
No log	4.0	396	0.6810	0.6739	0.6810	0.8252
No log	4.0202	398	0.7764	0.6109	0.7764	0.8811
No log	4.0404	400	0.8587	0.5590	0.8587	0.9267
No log	4.0606	402	0.8153	0.5955	0.8153	0.9029
No log	4.0808	404	0.6857	0.6643	0.6857	0.8281
No log	4.1010	406	0.6245	0.6796	0.6245	0.7903
No log	4.1212	408	0.6286	0.6746	0.6286	0.7928
No log	4.1414	410	0.6452	0.6043	0.6452	0.8032
No log	4.1616	412	0.6435	0.6603	0.6435	0.8022
No log	4.1818	414	0.6543	0.6753	0.6543	0.8089
No log	4.2020	416	0.6504	0.6741	0.6504	0.8065
No log	4.2222	418	0.6562	0.6191	0.6562	0.8100
No log	4.2424	420	0.6712	0.6201	0.6712	0.8193
No log	4.2626	422	0.6529	0.6224	0.6529	0.8080
No log	4.2828	424	0.6729	0.6903	0.6729	0.8203
No log	4.3030	426	0.6847	0.6753	0.6847	0.8275
No log	4.3232	428	0.6772	0.5989	0.6772	0.8229
No log	4.3434	430	0.6776	0.5654	0.6776	0.8231
No log	4.3636	432	0.6588	0.5856	0.6588	0.8116
No log	4.3838	434	0.6414	0.6594	0.6414	0.8009
No log	4.4040	436	0.6588	0.6927	0.6588	0.8116
No log	4.4242	438	0.6458	0.7043	0.6458	0.8036
No log	4.4444	440	0.6141	0.6844	0.6141	0.7836
No log	4.4646	442	0.6183	0.6928	0.6183	0.7863
No log	4.4848	444	0.6209	0.6873	0.6209	0.7880
No log	4.5051	446	0.6518	0.6652	0.6518	0.8074
No log	4.5253	448	0.7462	0.6408	0.7462	0.8639
No log	4.5455	450	0.8879	0.5622	0.8879	0.9423
No log	4.5657	452	0.8755	0.5622	0.8755	0.9357
No log	4.5859	454	0.7550	0.5971	0.7550	0.8689
No log	4.6061	456	0.6338	0.6617	0.6338	0.7961
No log	4.6263	458	0.6209	0.6779	0.6209	0.7880
No log	4.6465	460	0.6319	0.6454	0.6319	0.7949
No log	4.6667	462	0.6203	0.6532	0.6203	0.7876
No log	4.6869	464	0.6647	0.6764	0.6647	0.8153
No log	4.7071	466	0.6677	0.6454	0.6677	0.8171
No log	4.7273	468	0.6411	0.6553	0.6411	0.8007
No log	4.7475	470	0.6271	0.6674	0.6271	0.7919
No log	4.7677	472	0.6274	0.6556	0.6274	0.7921
No log	4.7879	474	0.7142	0.6718	0.7142	0.8451
No log	4.8081	476	0.8589	0.6330	0.8589	0.9268
No log	4.8283	478	0.8777	0.5988	0.8777	0.9369
No log	4.8485	480	0.9067	0.5861	0.9067	0.9522
No log	4.8687	482	0.9077	0.5639	0.9077	0.9527
No log	4.8889	484	0.8222	0.5899	0.8222	0.9068
No log	4.9091	486	0.7166	0.6474	0.7166	0.8465
No log	4.9293	488	0.6761	0.6284	0.6761	0.8222
No log	4.9495	490	0.6593	0.6436	0.6593	0.8120
No log	4.9697	492	0.6654	0.6748	0.6654	0.8157
No log	4.9899	494	0.7551	0.6604	0.7551	0.8690
No log	5.0101	496	0.7753	0.6321	0.7753	0.8805
No log	5.0303	498	0.7156	0.6801	0.7156	0.8459
0.4299	5.0505	500	0.6586	0.6177	0.6586	0.8115
0.4299	5.0707	502	0.6628	0.6009	0.6628	0.8141
0.4299	5.0909	504	0.6688	0.6607	0.6688	0.8178
0.4299	5.1111	506	0.7338	0.6633	0.7338	0.8566
0.4299	5.1313	508	0.8897	0.5960	0.8897	0.9432
0.4299	5.1515	510	0.9268	0.5852	0.9268	0.9627
0.4299	5.1717	512	0.8101	0.6676	0.8101	0.9000
0.4299	5.1919	514	0.6796	0.6600	0.6796	0.8244
0.4299	5.2121	516	0.6604	0.6321	0.6604	0.8127
0.4299	5.2323	518	0.6666	0.5671	0.6666	0.8164
0.4299	5.2525	520	0.6772	0.6406	0.6772	0.8229
0.4299	5.2727	522	0.7587	0.6613	0.7587	0.8710
0.4299	5.2929	524	0.8259	0.6039	0.8259	0.9088
0.4299	5.3131	526	0.7969	0.6371	0.7969	0.8927
0.4299	5.3333	528	0.6661	0.6816	0.6661	0.8162
0.4299	5.3535	530	0.6123	0.6828	0.6123	0.7825
0.4299	5.3737	532	0.6157	0.6840	0.6157	0.7847
0.4299	5.3939	534	0.6334	0.6725	0.6334	0.7959
0.4299	5.4141	536	0.6476	0.6816	0.6476	0.8048
0.4299	5.4343	538	0.6573	0.6998	0.6573	0.8108
0.4299	5.4545	540	0.6213	0.6886	0.6213	0.7883
0.4299	5.4747	542	0.6052	0.6884	0.6052	0.7779
0.4299	5.4949	544	0.6072	0.6816	0.6072	0.7792
0.4299	5.5152	546	0.6918	0.6844	0.6918	0.8318
0.4299	5.5354	548	0.8129	0.6687	0.8129	0.9016
0.4299	5.5556	550	0.8015	0.6314	0.8015	0.8952
0.4299	5.5758	552	0.7012	0.6912	0.7012	0.8374
0.4299	5.5960	554	0.6409	0.6258	0.6409	0.8005
0.4299	5.6162	556	0.6449	0.6270	0.6449	0.8031
0.4299	5.6364	558	0.6514	0.5902	0.6514	0.8071
0.4299	5.6566	560	0.6639	0.5946	0.6639	0.8148
0.4299	5.6768	562	0.7030	0.6544	0.7030	0.8384
0.4299	5.6970	564	0.7785	0.6268	0.7785	0.8823
0.4299	5.7172	566	0.8390	0.6365	0.8390	0.9159
0.4299	5.7374	568	0.7779	0.6718	0.7779	0.8820
0.4299	5.7576	570	0.6845	0.6624	0.6845	0.8273
0.4299	5.7778	572	0.6472	0.6904	0.6472	0.8045
0.4299	5.7980	574	0.6605	0.6896	0.6605	0.8127
0.4299	5.8182	576	0.6972	0.6958	0.6972	0.8350
0.4299	5.8384	578	0.7055	0.6821	0.7055	0.8399
0.4299	5.8586	580	0.7167	0.6516	0.7167	0.8466
0.4299	5.8788	582	0.6744	0.6521	0.6744	0.8212
0.4299	5.8990	584	0.6470	0.6293	0.6470	0.8044
0.4299	5.9192	586	0.6474	0.6370	0.6474	0.8046
0.4299	5.9394	588	0.6488	0.6339	0.6488	0.8055
0.4299	5.9596	590	0.6526	0.6383	0.6526	0.8078
0.4299	5.9798	592	0.6707	0.6683	0.6707	0.8190
0.4299	6.0	594	0.7578	0.6478	0.7578	0.8705
0.4299	6.0202	596	0.9784	0.5706	0.9784	0.9891
0.4299	6.0404	598	1.1270	0.5625	1.1270	1.0616
0.4299	6.0606	600	1.0745	0.5625	1.0745	1.0366
0.4299	6.0808	602	0.8566	0.6151	0.8566	0.9255
0.4299	6.1010	604	0.7293	0.6376	0.7293	0.8540
0.4299	6.1212	606	0.7235	0.6062	0.7235	0.8506
0.4299	6.1414	608	0.7300	0.5529	0.7300	0.8544
0.4299	6.1616	610	0.7590	0.5302	0.7590	0.8712
0.4299	6.1818	612	0.7537	0.5157	0.7537	0.8682
0.4299	6.2020	614	0.7177	0.5342	0.7177	0.8471

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1