ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run3_AugV5_k16_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7459
• Qwk: 0.6350
• Mse: 0.7459
• Rmse: 0.8637

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0253	2	5.3392	-0.0006	5.3392	2.3107
No log	0.0506	4	3.3623	0.0701	3.3623	1.8336
No log	0.0759	6	1.9687	0.1294	1.9687	1.4031
No log	0.1013	8	1.5301	0.0913	1.5301	1.2370
No log	0.1266	10	1.5788	-0.0169	1.5788	1.2565
No log	0.1519	12	1.3183	0.1201	1.3183	1.1482
No log	0.1772	14	1.3101	0.1037	1.3101	1.1446
No log	0.2025	16	1.5863	-0.1097	1.5863	1.2595
No log	0.2278	18	2.1017	-0.0953	2.1017	1.4497
No log	0.2532	20	1.8610	-0.0037	1.8610	1.3642
No log	0.2785	22	1.3674	0.0678	1.3674	1.1693
No log	0.3038	24	1.1934	0.3378	1.1934	1.0924
No log	0.3291	26	1.1446	0.2773	1.1446	1.0699
No log	0.3544	28	1.1433	0.2939	1.1433	1.0692
No log	0.3797	30	1.1399	0.3185	1.1399	1.0677
No log	0.4051	32	1.1937	0.2245	1.1937	1.0926
No log	0.4304	34	1.2914	0.1737	1.2914	1.1364
No log	0.4557	36	1.2914	0.1481	1.2914	1.1364
No log	0.4810	38	1.1982	0.2469	1.1982	1.0946
No log	0.5063	40	1.1735	0.2694	1.1735	1.0833
No log	0.5316	42	1.2580	0.1194	1.2580	1.1216
No log	0.5570	44	1.7819	0.0298	1.7819	1.3349
No log	0.5823	46	2.0894	0.0480	2.0894	1.4455
No log	0.6076	48	2.0698	0.0806	2.0698	1.4387
No log	0.6329	50	1.7312	0.0817	1.7312	1.3158
No log	0.6582	52	1.2893	0.2251	1.2893	1.1355
No log	0.6835	54	1.0831	0.2850	1.0831	1.0407
No log	0.7089	56	1.0634	0.3358	1.0634	1.0312
No log	0.7342	58	1.0312	0.3013	1.0312	1.0155
No log	0.7595	60	1.1604	0.2152	1.1604	1.0772
No log	0.7848	62	1.4047	0.2257	1.4047	1.1852
No log	0.8101	64	1.4558	0.2491	1.4558	1.2066
No log	0.8354	66	1.3166	0.2468	1.3166	1.1474
No log	0.8608	68	1.1378	0.3167	1.1378	1.0667
No log	0.8861	70	1.0396	0.4062	1.0396	1.0196
No log	0.9114	72	1.0845	0.4077	1.0845	1.0414
No log	0.9367	74	1.3512	0.2791	1.3512	1.1624
No log	0.9620	76	1.3933	0.3228	1.3933	1.1804
No log	0.9873	78	1.3164	0.3428	1.3164	1.1474
No log	1.0127	80	1.1091	0.4700	1.1091	1.0531
No log	1.0380	82	0.8652	0.5179	0.8652	0.9302
No log	1.0633	84	0.8086	0.5318	0.8086	0.8992
No log	1.0886	86	0.8322	0.5070	0.8322	0.9123
No log	1.1139	88	0.8391	0.5296	0.8391	0.9160
No log	1.1392	90	0.8544	0.5329	0.8544	0.9243
No log	1.1646	92	0.8555	0.5020	0.8555	0.9249
No log	1.1899	94	0.9271	0.5239	0.9271	0.9629
No log	1.2152	96	1.1139	0.4755	1.1139	1.0554
No log	1.2405	98	1.5474	0.3593	1.5474	1.2439
No log	1.2658	100	1.7552	0.3153	1.7552	1.3248
No log	1.2911	102	1.4684	0.4217	1.4684	1.2118
No log	1.3165	104	1.1235	0.4447	1.1235	1.0599
No log	1.3418	106	0.8955	0.4986	0.8955	0.9463
No log	1.3671	108	0.8484	0.4524	0.8484	0.9211
No log	1.3924	110	0.8105	0.4985	0.8105	0.9003
No log	1.4177	112	0.7764	0.4809	0.7764	0.8811
No log	1.4430	114	0.7600	0.4965	0.7600	0.8718
No log	1.4684	116	0.7628	0.5789	0.7628	0.8734
No log	1.4937	118	0.8533	0.5063	0.8533	0.9237
No log	1.5190	120	0.8787	0.5063	0.8787	0.9374
No log	1.5443	122	0.8223	0.5772	0.8223	0.9068
No log	1.5696	124	0.7681	0.5513	0.7681	0.8764
No log	1.5949	126	0.7794	0.5173	0.7794	0.8829
No log	1.6203	128	0.7482	0.5502	0.7482	0.8650
No log	1.6456	130	0.7273	0.6231	0.7273	0.8528
No log	1.6709	132	0.7727	0.6171	0.7727	0.8791
No log	1.6962	134	0.7301	0.6442	0.7301	0.8545
No log	1.7215	136	0.7667	0.5502	0.7667	0.8756
No log	1.7468	138	0.8315	0.5481	0.8315	0.9118
No log	1.7722	140	0.9626	0.5238	0.9626	0.9811
No log	1.7975	142	0.8811	0.5093	0.8811	0.9387
No log	1.8228	144	0.7758	0.5276	0.7758	0.8808
No log	1.8481	146	0.8239	0.5442	0.8239	0.9077
No log	1.8734	148	0.8042	0.5581	0.8042	0.8968
No log	1.8987	150	0.7514	0.5873	0.7514	0.8669
No log	1.9241	152	0.7218	0.5768	0.7218	0.8496
No log	1.9494	154	0.7188	0.5920	0.7188	0.8478
No log	1.9747	156	0.7699	0.6288	0.7699	0.8774
No log	2.0	158	0.7602	0.6120	0.7602	0.8719
No log	2.0253	160	0.6883	0.6456	0.6883	0.8297
No log	2.0506	162	0.7084	0.6484	0.7084	0.8417
No log	2.0759	164	0.7713	0.6501	0.7713	0.8782
No log	2.1013	166	0.8215	0.6268	0.8215	0.9064
No log	2.1266	168	0.7379	0.6550	0.7379	0.8590
No log	2.1519	170	0.7554	0.6343	0.7554	0.8691
No log	2.1772	172	0.7438	0.6703	0.7438	0.8625
No log	2.2025	174	0.8224	0.5900	0.8224	0.9069
No log	2.2278	176	0.9167	0.5944	0.9167	0.9575
No log	2.2532	178	0.9318	0.5782	0.9317	0.9653
No log	2.2785	180	0.8124	0.6135	0.8124	0.9013
No log	2.3038	182	0.7778	0.6085	0.7778	0.8819
No log	2.3291	184	0.7466	0.6180	0.7466	0.8641
No log	2.3544	186	0.7216	0.5881	0.7216	0.8495
No log	2.3797	188	0.7352	0.6160	0.7352	0.8575
No log	2.4051	190	0.6957	0.6689	0.6957	0.8341
No log	2.4304	192	0.7275	0.6548	0.7275	0.8529
No log	2.4557	194	0.7590	0.6592	0.7590	0.8712
No log	2.4810	196	0.6754	0.6640	0.6754	0.8218
No log	2.5063	198	0.6710	0.6578	0.6710	0.8191
No log	2.5316	200	0.6678	0.6569	0.6678	0.8172
No log	2.5570	202	0.6800	0.6752	0.6800	0.8247
No log	2.5823	204	0.7044	0.6681	0.7044	0.8393
No log	2.6076	206	0.7057	0.6721	0.7057	0.8400
No log	2.6329	208	0.6864	0.6525	0.6864	0.8285
No log	2.6582	210	0.6883	0.6352	0.6883	0.8296
No log	2.6835	212	0.6762	0.6581	0.6762	0.8223
No log	2.7089	214	0.7318	0.5993	0.7318	0.8554
No log	2.7342	216	0.8810	0.6051	0.8810	0.9386
No log	2.7595	218	0.8901	0.6155	0.8901	0.9434
No log	2.7848	220	0.7806	0.5969	0.7806	0.8835
No log	2.8101	222	0.7460	0.6276	0.7460	0.8637
No log	2.8354	224	0.6880	0.6792	0.6880	0.8295
No log	2.8608	226	0.6757	0.6432	0.6757	0.8220
No log	2.8861	228	0.7096	0.6692	0.7096	0.8424
No log	2.9114	230	0.8332	0.6212	0.8332	0.9128
No log	2.9367	232	0.8209	0.6675	0.8209	0.9060
No log	2.9620	234	0.7796	0.6607	0.7796	0.8830
No log	2.9873	236	0.7185	0.6664	0.7185	0.8477
No log	3.0127	238	0.6964	0.6776	0.6964	0.8345
No log	3.0380	240	0.7393	0.6288	0.7393	0.8599
No log	3.0633	242	0.8039	0.5811	0.8039	0.8966
No log	3.0886	244	0.7467	0.5811	0.7467	0.8641
No log	3.1139	246	0.7155	0.6401	0.7155	0.8459
No log	3.1392	248	0.7107	0.6446	0.7107	0.8430
No log	3.1646	250	0.7237	0.6391	0.7237	0.8507
No log	3.1899	252	0.8010	0.6209	0.8010	0.8950
No log	3.2152	254	0.7424	0.6248	0.7424	0.8616
No log	3.2405	256	0.6718	0.6775	0.6718	0.8196
No log	3.2658	258	0.6852	0.6449	0.6852	0.8277
No log	3.2911	260	0.6960	0.6610	0.6960	0.8342
No log	3.3165	262	0.7238	0.6347	0.7238	0.8508
No log	3.3418	264	0.7145	0.6440	0.7145	0.8453
No log	3.3671	266	0.6898	0.6790	0.6898	0.8305
No log	3.3924	268	0.6962	0.6759	0.6962	0.8344
No log	3.4177	270	0.7853	0.6703	0.7853	0.8862
No log	3.4430	272	0.8837	0.6267	0.8837	0.9401
No log	3.4684	274	0.8365	0.6283	0.8365	0.9146
No log	3.4937	276	0.7226	0.6732	0.7226	0.8501
No log	3.5190	278	0.7452	0.6829	0.7452	0.8632
No log	3.5443	280	0.7568	0.6863	0.7568	0.8699
No log	3.5696	282	0.7372	0.7060	0.7372	0.8586
No log	3.5949	284	0.7638	0.6941	0.7638	0.8740
No log	3.6203	286	0.6844	0.6833	0.6844	0.8273
No log	3.6456	288	0.6906	0.6921	0.6906	0.8310
No log	3.6709	290	0.7709	0.6732	0.7709	0.8780
No log	3.6962	292	0.7299	0.6713	0.7299	0.8544
No log	3.7215	294	0.6445	0.6691	0.6445	0.8028
No log	3.7468	296	0.6414	0.6993	0.6414	0.8009
No log	3.7722	298	0.6360	0.6722	0.6360	0.7975
No log	3.7975	300	0.7197	0.7028	0.7197	0.8484
No log	3.8228	302	0.7820	0.6921	0.7820	0.8843
No log	3.8481	304	0.7125	0.7028	0.7125	0.8441
No log	3.8734	306	0.6624	0.7105	0.6624	0.8139
No log	3.8987	308	0.6585	0.7023	0.6585	0.8115
No log	3.9241	310	0.7046	0.6800	0.7046	0.8394
No log	3.9494	312	0.7052	0.6571	0.7052	0.8398
No log	3.9747	314	0.7824	0.6303	0.7824	0.8846
No log	4.0	316	0.9384	0.5403	0.9384	0.9687
No log	4.0253	318	1.2207	0.4770	1.2207	1.1049
No log	4.0506	320	1.1849	0.4829	1.1849	1.0886
No log	4.0759	322	0.9060	0.5386	0.9060	0.9519
No log	4.1013	324	0.7851	0.6190	0.7851	0.8860
No log	4.1266	326	0.8031	0.5995	0.8031	0.8961
No log	4.1519	328	0.9885	0.5260	0.9885	0.9942
No log	4.1772	330	1.0429	0.5311	1.0429	1.0212
No log	4.2025	332	0.9668	0.5488	0.9668	0.9832
No log	4.2278	334	0.7924	0.5800	0.7924	0.8902
No log	4.2532	336	0.6568	0.6672	0.6568	0.8104
No log	4.2785	338	0.6433	0.6815	0.6433	0.8020
No log	4.3038	340	0.6520	0.6782	0.6520	0.8075
No log	4.3291	342	0.7203	0.6750	0.7203	0.8487
No log	4.3544	344	0.8032	0.6477	0.8032	0.8962
No log	4.3797	346	0.7856	0.6684	0.7856	0.8864
No log	4.4051	348	0.7812	0.6609	0.7812	0.8838
No log	4.4304	350	0.7658	0.6664	0.7658	0.8751
No log	4.4557	352	0.7937	0.6739	0.7937	0.8909
No log	4.4810	354	0.8848	0.6384	0.8848	0.9407
No log	4.5063	356	1.0304	0.4958	1.0304	1.0151
No log	4.5316	358	1.0813	0.4979	1.0813	1.0399
No log	4.5570	360	1.1837	0.4409	1.1837	1.0880
No log	4.5823	362	1.1301	0.4732	1.1301	1.0630
No log	4.6076	364	0.9393	0.5466	0.9393	0.9692
No log	4.6329	366	0.7597	0.5824	0.7597	0.8716
No log	4.6582	368	0.6698	0.6632	0.6698	0.8184
No log	4.6835	370	0.6793	0.6674	0.6793	0.8242
No log	4.7089	372	0.7758	0.6350	0.7758	0.8808
No log	4.7342	374	0.9169	0.5890	0.9169	0.9576
No log	4.7595	376	0.8724	0.5952	0.8724	0.9340
No log	4.7848	378	0.7104	0.6555	0.7104	0.8429
No log	4.8101	380	0.6439	0.7000	0.6439	0.8024
No log	4.8354	382	0.6440	0.6704	0.6440	0.8025
No log	4.8608	384	0.6638	0.6672	0.6638	0.8147
No log	4.8861	386	0.7176	0.6444	0.7176	0.8471
No log	4.9114	388	0.7291	0.6203	0.7291	0.8538
No log	4.9367	390	0.7787	0.5618	0.7787	0.8824
No log	4.9620	392	0.7839	0.5663	0.7839	0.8854
No log	4.9873	394	0.7636	0.6255	0.7636	0.8738
No log	5.0127	396	0.7974	0.6099	0.7974	0.8930
No log	5.0380	398	1.0441	0.5395	1.0441	1.0218
No log	5.0633	400	1.1438	0.5387	1.1438	1.0695
No log	5.0886	402	0.9744	0.5767	0.9744	0.9871
No log	5.1139	404	0.8213	0.5847	0.8213	0.9063
No log	5.1392	406	0.8513	0.5664	0.8513	0.9227
No log	5.1646	408	0.8127	0.5570	0.8127	0.9015
No log	5.1899	410	0.7949	0.5582	0.7949	0.8916
No log	5.2152	412	0.8695	0.5209	0.8695	0.9324
No log	5.2405	414	0.8229	0.5717	0.8229	0.9072
No log	5.2658	416	0.6770	0.7015	0.6770	0.8228
No log	5.2911	418	0.6120	0.7099	0.6120	0.7823
No log	5.3165	420	0.6238	0.7071	0.6238	0.7898
No log	5.3418	422	0.6568	0.7074	0.6568	0.8104
No log	5.3671	424	0.6928	0.6929	0.6928	0.8323
No log	5.3924	426	0.6996	0.6703	0.6996	0.8364
No log	5.4177	428	0.7370	0.6754	0.7370	0.8585
No log	5.4430	430	0.8709	0.5691	0.8709	0.9332
No log	5.4684	432	0.8705	0.5331	0.8705	0.9330
No log	5.4937	434	0.7326	0.6463	0.7326	0.8559
No log	5.5190	436	0.6725	0.7105	0.6725	0.8201
No log	5.5443	438	0.6993	0.6846	0.6993	0.8362
No log	5.5696	440	0.8494	0.6032	0.8494	0.9216
No log	5.5949	442	0.9076	0.5434	0.9076	0.9527
No log	5.6203	444	0.9135	0.5424	0.9135	0.9558
No log	5.6456	446	0.8438	0.5919	0.8438	0.9186
No log	5.6709	448	0.9036	0.5605	0.9036	0.9506
No log	5.6962	450	0.9445	0.5681	0.9445	0.9719
No log	5.7215	452	0.8537	0.5930	0.8537	0.9240
No log	5.7468	454	0.6908	0.6791	0.6908	0.8311
No log	5.7722	456	0.6370	0.6850	0.6370	0.7981
No log	5.7975	458	0.6596	0.6888	0.6596	0.8122
No log	5.8228	460	0.8235	0.6180	0.8235	0.9075
No log	5.8481	462	0.8996	0.5681	0.8996	0.9485
No log	5.8734	464	0.8208	0.6196	0.8208	0.9060
No log	5.8987	466	0.6927	0.6791	0.6927	0.8323
No log	5.9241	468	0.6437	0.7051	0.6437	0.8023
No log	5.9494	470	0.6526	0.6817	0.6526	0.8078
No log	5.9747	472	0.6757	0.6284	0.6757	0.8220
No log	6.0	474	0.7165	0.6221	0.7165	0.8465
No log	6.0253	476	0.7011	0.6417	0.7011	0.8373
No log	6.0506	478	0.6602	0.6532	0.6602	0.8125
No log	6.0759	480	0.6424	0.6817	0.6424	0.8015
No log	6.1013	482	0.6357	0.6979	0.6357	0.7973
No log	6.1266	484	0.6354	0.6979	0.6354	0.7971
No log	6.1519	486	0.6500	0.6832	0.6500	0.8063
No log	6.1772	488	0.7445	0.6135	0.7445	0.8629
No log	6.2025	490	0.7687	0.6157	0.7687	0.8768
No log	6.2278	492	0.6939	0.6500	0.6939	0.8330
No log	6.2532	494	0.6306	0.6683	0.6306	0.7941
No log	6.2785	496	0.6299	0.6440	0.6299	0.7937
No log	6.3038	498	0.6175	0.6867	0.6175	0.7858
0.4876	6.3291	500	0.6491	0.6610	0.6491	0.8057
0.4876	6.3544	502	0.7137	0.6116	0.7137	0.8448
0.4876	6.3797	504	0.8058	0.6356	0.8058	0.8977
0.4876	6.4051	506	0.7783	0.6676	0.7783	0.8822
0.4876	6.4304	508	0.6727	0.6848	0.6727	0.8202
0.4876	6.4557	510	0.6340	0.7095	0.6340	0.7963
0.4876	6.4810	512	0.6406	0.7095	0.6406	0.8004
0.4876	6.5063	514	0.6681	0.6735	0.6681	0.8174
0.4876	6.5316	516	0.6977	0.6436	0.6977	0.8353
0.4876	6.5570	518	0.7114	0.6353	0.7114	0.8434
0.4876	6.5823	520	0.6642	0.6841	0.6642	0.8150
0.4876	6.6076	522	0.6496	0.6841	0.6496	0.8060
0.4876	6.6329	524	0.6447	0.7084	0.6447	0.8029
0.4876	6.6582	526	0.7221	0.6914	0.7221	0.8498
0.4876	6.6835	528	0.8400	0.6695	0.8400	0.9165
0.4876	6.7089	530	0.8738	0.6677	0.8738	0.9348
0.4876	6.7342	532	0.7508	0.6648	0.7508	0.8665
0.4876	6.7595	534	0.6464	0.6971	0.6464	0.8040
0.4876	6.7848	536	0.6284	0.6798	0.6284	0.7927
0.4876	6.8101	538	0.6308	0.6798	0.6308	0.7942
0.4876	6.8354	540	0.6477	0.6868	0.6477	0.8048
0.4876	6.8608	542	0.7173	0.6546	0.7173	0.8469
0.4876	6.8861	544	0.8235	0.6509	0.8235	0.9075
0.4876	6.9114	546	0.9207	0.6392	0.9207	0.9596
0.4876	6.9367	548	0.8370	0.6704	0.8370	0.9149
0.4876	6.9620	550	0.6621	0.7163	0.6621	0.8137
0.4876	6.9873	552	0.6027	0.6846	0.6027	0.7763
0.4876	7.0127	554	0.6354	0.6964	0.6354	0.7971
0.4876	7.0380	556	0.6080	0.6807	0.6080	0.7798
0.4876	7.0633	558	0.6222	0.7327	0.6222	0.7888
0.4876	7.0886	560	0.7493	0.6551	0.7493	0.8656
0.4876	7.1139	562	0.7616	0.6351	0.7616	0.8727
0.4876	7.1392	564	0.6700	0.6591	0.6700	0.8185
0.4876	7.1646	566	0.6218	0.7076	0.6218	0.7885
0.4876	7.1899	568	0.6138	0.6951	0.6138	0.7835
0.4876	7.2152	570	0.6155	0.7160	0.6155	0.7845
0.4876	7.2405	572	0.6632	0.7077	0.6632	0.8143
0.4876	7.2658	574	0.7650	0.6760	0.7650	0.8747
0.4876	7.2911	576	0.8404	0.6937	0.8404	0.9167
0.4876	7.3165	578	0.7892	0.6714	0.7892	0.8884
0.4876	7.3418	580	0.6961	0.6866	0.6961	0.8344
0.4876	7.3671	582	0.6656	0.6972	0.6656	0.8158
0.4876	7.3924	584	0.6719	0.6867	0.6719	0.8197
0.4876	7.4177	586	0.6995	0.6646	0.6995	0.8364
0.4876	7.4430	588	0.6959	0.6494	0.6959	0.8342
0.4876	7.4684	590	0.7541	0.6429	0.7541	0.8684
0.4876	7.4937	592	0.7537	0.6329	0.7537	0.8682
0.4876	7.5190	594	0.7187	0.6365	0.7187	0.8477
0.4876	7.5443	596	0.7459	0.6350	0.7459	0.8637

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1