ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7756
• Qwk: 0.0879
• Mse: 1.7756
• Rmse: 1.3325

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2	2	4.5813	-0.0132	4.5813	2.1404
No log	0.4	4	2.6530	0.0274	2.6530	1.6288
No log	0.6	6	1.8729	0.0198	1.8729	1.3685
No log	0.8	8	1.6230	0.0062	1.6230	1.2740
No log	1.0	10	1.4672	0.0221	1.4672	1.2113
No log	1.2	12	1.6331	-0.1455	1.6331	1.2779
No log	1.4	14	2.0475	-0.2154	2.0475	1.4309
No log	1.6	16	1.4858	-0.0657	1.4858	1.2189
No log	1.8	18	1.2727	0.0011	1.2727	1.1281
No log	2.0	20	1.2389	0.0613	1.2389	1.1131
No log	2.2	22	1.3337	0.0768	1.3337	1.1549
No log	2.4	24	1.7835	-0.0777	1.7835	1.3355
No log	2.6	26	2.5544	-0.0889	2.5544	1.5983
No log	2.8	28	2.2818	-0.0405	2.2818	1.5106
No log	3.0	30	1.5565	0.0269	1.5565	1.2476
No log	3.2	32	1.3875	0.0559	1.3875	1.1779
No log	3.4	34	1.4012	0.0571	1.4012	1.1837
No log	3.6	36	1.5426	-0.0264	1.5426	1.2420
No log	3.8	38	1.9980	-0.0698	1.9980	1.4135
No log	4.0	40	2.0203	-0.0228	2.0203	1.4214
No log	4.2	42	2.0066	-0.0156	2.0066	1.4165
No log	4.4	44	1.7381	0.0477	1.7381	1.3184
No log	4.6	46	1.3986	0.1016	1.3986	1.1826
No log	4.8	48	1.3517	0.1438	1.3517	1.1626
No log	5.0	50	1.3324	0.1438	1.3324	1.1543
No log	5.2	52	1.3199	0.2149	1.3199	1.1489
No log	5.4	54	1.3877	0.1679	1.3877	1.1780
No log	5.6	56	1.5073	0.1882	1.5073	1.2277
No log	5.8	58	1.4959	0.1106	1.4959	1.2231
No log	6.0	60	1.4131	0.1354	1.4131	1.1888
No log	6.2	62	1.4494	0.1171	1.4494	1.2039
No log	6.4	64	1.8101	-0.0126	1.8101	1.3454
No log	6.6	66	2.0055	-0.0219	2.0055	1.4162
No log	6.8	68	1.7762	-0.0809	1.7762	1.3327
No log	7.0	70	1.5515	0.1619	1.5515	1.2456
No log	7.2	72	1.4616	0.0839	1.4616	1.2089
No log	7.4	74	1.5766	0.0548	1.5766	1.2556
No log	7.6	76	1.4865	0.0509	1.4865	1.2192
No log	7.8	78	1.6033	0.0596	1.6033	1.2662
No log	8.0	80	1.7938	-0.0336	1.7938	1.3393
No log	8.2	82	1.7408	0.0297	1.7408	1.3194
No log	8.4	84	1.5947	0.0624	1.5947	1.2628
No log	8.6	86	1.5456	0.0523	1.5456	1.2432
No log	8.8	88	1.6782	0.0577	1.6782	1.2955
No log	9.0	90	1.6484	0.0546	1.6484	1.2839
No log	9.2	92	1.6849	0.1392	1.6849	1.2980
No log	9.4	94	1.7097	0.1960	1.7097	1.3076
No log	9.6	96	1.7337	0.2150	1.7337	1.3167
No log	9.8	98	1.5192	0.0372	1.5192	1.2325
No log	10.0	100	1.5221	0.0859	1.5221	1.2337
No log	10.2	102	1.6745	0.0536	1.6745	1.2940
No log	10.4	104	1.4702	0.1063	1.4702	1.2125
No log	10.6	106	1.4859	0.1095	1.4859	1.2190
No log	10.8	108	1.6872	0.1325	1.6872	1.2989
No log	11.0	110	2.0628	0.1454	2.0628	1.4362
No log	11.2	112	2.2340	0.1123	2.2340	1.4947
No log	11.4	114	2.0117	0.0773	2.0117	1.4183
No log	11.6	116	1.7623	0.0218	1.7623	1.3275
No log	11.8	118	1.6258	0.0151	1.6258	1.2751
No log	12.0	120	1.8181	0.0580	1.8181	1.3484
No log	12.2	122	1.9289	-0.0123	1.9289	1.3888
No log	12.4	124	2.0657	-0.0133	2.0657	1.4372
No log	12.6	126	2.4938	0.0385	2.4938	1.5792
No log	12.8	128	2.4223	0.0393	2.4223	1.5564
No log	13.0	130	1.9302	0.0129	1.9302	1.3893
No log	13.2	132	1.7401	0.0362	1.7401	1.3191
No log	13.4	134	1.9450	0.0179	1.9450	1.3946
No log	13.6	136	2.1546	0.0189	2.1546	1.4679
No log	13.8	138	2.0961	0.0271	2.0961	1.4478
No log	14.0	140	1.9673	0.0015	1.9673	1.4026
No log	14.2	142	1.7829	-0.0234	1.7829	1.3353
No log	14.4	144	1.8442	0.0084	1.8442	1.3580
No log	14.6	146	1.6472	0.0251	1.6472	1.2834
No log	14.8	148	1.4751	0.0019	1.4751	1.2145
No log	15.0	150	1.5330	0.0985	1.5330	1.2381
No log	15.2	152	1.9539	0.0747	1.9539	1.3978
No log	15.4	154	2.2022	-0.0142	2.2022	1.4840
No log	15.6	156	2.0118	0.0891	2.0118	1.4184
No log	15.8	158	1.7165	0.0733	1.7165	1.3102
No log	16.0	160	1.8235	0.0150	1.8235	1.3504
No log	16.2	162	2.0005	0.0398	2.0005	1.4144
No log	16.4	164	2.1088	0.0741	2.1088	1.4522
No log	16.6	166	1.9905	0.0622	1.9905	1.4108
No log	16.8	168	1.7272	-0.0462	1.7272	1.3142
No log	17.0	170	1.4813	0.0867	1.4813	1.2171
No log	17.2	172	1.4634	0.0867	1.4634	1.2097
No log	17.4	174	1.7105	-0.0043	1.7105	1.3079
No log	17.6	176	2.0644	0.0831	2.0644	1.4368
No log	17.8	178	1.9619	0.0917	1.9619	1.4007
No log	18.0	180	1.6125	0.0624	1.6125	1.2699
No log	18.2	182	1.5449	0.1095	1.5449	1.2429
No log	18.4	184	1.7344	0.0953	1.7344	1.3170
No log	18.6	186	1.9903	0.0642	1.9903	1.4108
No log	18.8	188	2.2783	0.0735	2.2783	1.5094
No log	19.0	190	2.2798	0.0735	2.2798	1.5099
No log	19.2	192	2.3352	0.0122	2.3352	1.5281
No log	19.4	194	2.0032	0.0792	2.0032	1.4153
No log	19.6	196	1.6969	0.0126	1.6969	1.3026
No log	19.8	198	1.6465	0.0207	1.6465	1.2832
No log	20.0	200	1.5896	0.0443	1.5896	1.2608
No log	20.2	202	1.7777	0.0789	1.7777	1.3333
No log	20.4	204	2.3495	0.0196	2.3495	1.5328
No log	20.6	206	2.6966	-0.0230	2.6966	1.6421
No log	20.8	208	2.4387	0.0196	2.4387	1.5616
No log	21.0	210	1.9791	0.0792	1.9791	1.4068
No log	21.2	212	1.8374	0.0087	1.8374	1.3555
No log	21.4	214	1.7680	-0.0171	1.7680	1.3297
No log	21.6	216	1.7338	-0.0171	1.7338	1.3167
No log	21.8	218	1.8301	0.0257	1.8301	1.3528
No log	22.0	220	1.9349	0.0641	1.9349	1.3910
No log	22.2	222	1.8743	0.0641	1.8743	1.3691
No log	22.4	224	1.9624	0.1027	1.9624	1.4008
No log	22.6	226	1.9564	0.1027	1.9564	1.3987
No log	22.8	228	1.7459	0.0420	1.7459	1.3213
No log	23.0	230	1.5077	0.1578	1.5077	1.2279
No log	23.2	232	1.4368	0.1445	1.4368	1.1987
No log	23.4	234	1.5381	0.1549	1.5381	1.2402
No log	23.6	236	1.8826	0.1225	1.8826	1.3721
No log	23.8	238	2.1722	0.1006	2.1722	1.4739
No log	24.0	240	2.0727	0.1225	2.0727	1.4397
No log	24.2	242	1.8082	0.0966	1.8082	1.3447
No log	24.4	244	1.5431	0.1776	1.5431	1.2422
No log	24.6	246	1.4500	0.1154	1.4500	1.2042
No log	24.8	248	1.5284	0.1104	1.5284	1.2363
No log	25.0	250	1.7817	0.0987	1.7817	1.3348
No log	25.2	252	2.1377	0.0886	2.1377	1.4621
No log	25.4	254	2.3175	0.0925	2.3175	1.5223
No log	25.6	256	2.0938	0.0779	2.0938	1.4470
No log	25.8	258	1.6846	0.0923	1.6846	1.2979
No log	26.0	260	1.6020	0.1082	1.6020	1.2657
No log	26.2	262	1.6666	0.1230	1.6666	1.2910
No log	26.4	264	1.9285	0.0509	1.9285	1.3887
No log	26.6	266	2.2492	0.0679	2.2492	1.4997
No log	26.8	268	2.5744	0.0171	2.5744	1.6045
No log	27.0	270	2.5339	0.0359	2.5339	1.5918
No log	27.2	272	2.1562	0.0679	2.1562	1.4684
No log	27.4	274	1.7139	0.0488	1.7139	1.3092
No log	27.6	276	1.4875	0.1970	1.4875	1.2196
No log	27.8	278	1.4536	0.1018	1.4536	1.2056
No log	28.0	280	1.6019	0.0783	1.6019	1.2657
No log	28.2	282	1.7710	0.0612	1.7710	1.3308
No log	28.4	284	2.0223	0.0779	2.0223	1.4221
No log	28.6	286	2.0664	0.0993	2.0664	1.4375
No log	28.8	288	2.1455	0.1414	2.1455	1.4648
No log	29.0	290	1.9766	0.1225	1.9766	1.4059
No log	29.2	292	1.6693	0.0926	1.6693	1.2920
No log	29.4	294	1.3809	0.1958	1.3809	1.1751
No log	29.6	296	1.3488	0.1045	1.3488	1.1614
No log	29.8	298	1.4176	0.2010	1.4176	1.1906
No log	30.0	300	1.6335	0.0985	1.6335	1.2781
No log	30.2	302	1.9893	0.1010	1.9893	1.4104
No log	30.4	304	1.9695	0.1013	1.9695	1.4034
No log	30.6	306	1.9230	0.0906	1.9230	1.3867
No log	30.8	308	1.6763	0.0700	1.6763	1.2947
No log	31.0	310	1.5857	0.0853	1.5857	1.2593
No log	31.2	312	1.6646	0.125	1.6646	1.2902
No log	31.4	314	1.5923	0.1065	1.5923	1.2619
No log	31.6	316	1.5802	0.1135	1.5802	1.2571
No log	31.8	318	1.5977	0.1159	1.5977	1.2640
No log	32.0	320	1.6093	0.1251	1.6093	1.2686
No log	32.2	322	1.6880	0.1294	1.6880	1.2992
No log	32.4	324	1.6809	0.1183	1.6809	1.2965
No log	32.6	326	1.5372	0.1278	1.5372	1.2399
No log	32.8	328	1.4987	0.1564	1.4987	1.2242
No log	33.0	330	1.5545	0.1703	1.5545	1.2468
No log	33.2	332	1.6625	0.1273	1.6625	1.2894
No log	33.4	334	1.9015	0.1332	1.9015	1.3789
No log	33.6	336	2.0200	0.1332	2.0200	1.4213
No log	33.8	338	1.8733	0.1093	1.8733	1.3687
No log	34.0	340	1.6256	0.0457	1.6256	1.2750
No log	34.2	342	1.4903	0.1151	1.4903	1.2208
No log	34.4	344	1.4559	0.0929	1.4559	1.2066
No log	34.6	346	1.4844	0.1067	1.4844	1.2183
No log	34.8	348	1.5114	0.0702	1.5114	1.2294
No log	35.0	350	1.6285	0.1109	1.6285	1.2761
No log	35.2	352	1.7451	0.0879	1.7451	1.3210
No log	35.4	354	1.6716	0.1037	1.6716	1.2929
No log	35.6	356	1.6618	0.1037	1.6618	1.2891
No log	35.8	358	1.6355	0.0494	1.6355	1.2789
No log	36.0	360	1.6761	0.0586	1.6761	1.2947
No log	36.2	362	1.8555	0.0707	1.8555	1.3622
No log	36.4	364	1.9461	0.0983	1.9461	1.3950
No log	36.6	366	1.8212	0.0827	1.8212	1.3495
No log	36.8	368	1.6169	0.0959	1.6169	1.2716
No log	37.0	370	1.5195	0.1003	1.5195	1.2327
No log	37.2	372	1.5976	0.1061	1.5976	1.2640
No log	37.4	374	1.7822	0.1227	1.7822	1.3350
No log	37.6	376	1.8094	0.1337	1.8094	1.3452
No log	37.8	378	1.7219	0.0926	1.7219	1.3122
No log	38.0	380	1.6220	0.0275	1.6220	1.2736
No log	38.2	382	1.5507	0.1129	1.5507	1.2453
No log	38.4	384	1.5869	0.0690	1.5869	1.2597
No log	38.6	386	1.6346	0.0275	1.6346	1.2785
No log	38.8	388	1.7633	0.0938	1.7633	1.3279
No log	39.0	390	1.9092	0.1010	1.9092	1.3818
No log	39.2	392	1.9709	0.1397	1.9709	1.4039
No log	39.4	394	1.8608	0.1113	1.8608	1.3641
No log	39.6	396	1.6704	0.1023	1.6704	1.2924
No log	39.8	398	1.5277	0.1181	1.5277	1.2360
No log	40.0	400	1.4469	0.1407	1.4469	1.2029
No log	40.2	402	1.4893	0.1785	1.4893	1.2204
No log	40.4	404	1.5900	0.1731	1.5900	1.2610
No log	40.6	406	1.6412	0.1341	1.6412	1.2811
No log	40.8	408	1.6376	0.1201	1.6376	1.2797
No log	41.0	410	1.5273	0.1660	1.5273	1.2358
No log	41.2	412	1.4679	0.1152	1.4679	1.2116
No log	41.4	414	1.5005	0.1152	1.5005	1.2250
No log	41.6	416	1.6479	0.0333	1.6479	1.2837
No log	41.8	418	1.7404	0.0904	1.7404	1.3192
No log	42.0	420	1.6735	0.0257	1.6735	1.2936
No log	42.2	422	1.5969	0.0846	1.5969	1.2637
No log	42.4	424	1.5185	0.1230	1.5185	1.2323
No log	42.6	426	1.5174	0.1230	1.5174	1.2318
No log	42.8	428	1.5899	0.0577	1.5899	1.2609
No log	43.0	430	1.5668	0.1129	1.5668	1.2517
No log	43.2	432	1.5516	0.1129	1.5516	1.2456
No log	43.4	434	1.5217	0.1515	1.5217	1.2336
No log	43.6	436	1.5120	0.1515	1.5120	1.2296
No log	43.8	438	1.5183	0.1609	1.5183	1.2322
No log	44.0	440	1.5237	0.1624	1.5237	1.2344
No log	44.2	442	1.4927	0.1407	1.4927	1.2218
No log	44.4	444	1.5134	0.1532	1.5134	1.2302
No log	44.6	446	1.5253	0.1624	1.5253	1.2350
No log	44.8	448	1.5005	0.1812	1.5005	1.2249
No log	45.0	450	1.4448	0.1802	1.4448	1.2020
No log	45.2	452	1.4060	0.1791	1.4060	1.1858
No log	45.4	454	1.4539	0.1687	1.4539	1.2058
No log	45.6	456	1.5420	0.1104	1.5420	1.2418
No log	45.8	458	1.6006	0.1299	1.6006	1.2652
No log	46.0	460	1.5875	0.1673	1.5875	1.2600
No log	46.2	462	1.6287	0.1654	1.6287	1.2762
No log	46.4	464	1.6327	0.1654	1.6327	1.2778
No log	46.6	466	1.6346	0.1654	1.6346	1.2785
No log	46.8	468	1.6827	0.1654	1.6827	1.2972
No log	47.0	470	1.6642	0.1654	1.6642	1.2900
No log	47.2	472	1.6578	0.1654	1.6578	1.2876
No log	47.4	474	1.6626	0.1654	1.6626	1.2894
No log	47.6	476	1.5989	0.1800	1.5989	1.2645
No log	47.8	478	1.5100	0.1612	1.5100	1.2288
No log	48.0	480	1.4335	0.0675	1.4335	1.1973
No log	48.2	482	1.3991	0.0475	1.3991	1.1828
No log	48.4	484	1.4404	0.0780	1.4404	1.2002
No log	48.6	486	1.5706	0.1379	1.5706	1.2533
No log	48.8	488	1.6590	0.1181	1.6590	1.2880
No log	49.0	490	1.6655	0.1128	1.6655	1.2905
No log	49.2	492	1.5314	0.1485	1.5314	1.2375
No log	49.4	494	1.4052	0.0774	1.4052	1.1854
No log	49.6	496	1.3178	0.1576	1.3178	1.1480
No log	49.8	498	1.3115	0.1779	1.3115	1.1452
0.3106	50.0	500	1.3592	0.1176	1.3592	1.1659
0.3106	50.2	502	1.5417	0.1352	1.5417	1.2416
0.3106	50.4	504	1.8211	0.1907	1.8211	1.3495
0.3106	50.6	506	1.9652	0.1493	1.9652	1.4019
0.3106	50.8	508	1.9571	0.1493	1.9571	1.3990
0.3106	51.0	510	1.8591	0.1567	1.8591	1.3635
0.3106	51.2	512	1.6466	0.1480	1.6466	1.2832
0.3106	51.4	514	1.5274	0.1255	1.5274	1.2359
0.3106	51.6	516	1.4959	0.0927	1.4959	1.2231
0.3106	51.8	518	1.4953	0.0876	1.4953	1.2228
0.3106	52.0	520	1.5303	0.1230	1.5303	1.2371
0.3106	52.2	522	1.6586	0.1228	1.6586	1.2879
0.3106	52.4	524	1.7988	0.1661	1.7988	1.3412
0.3106	52.6	526	1.9107	0.1204	1.9107	1.3823
0.3106	52.8	528	1.9085	0.1290	1.9085	1.3815
0.3106	53.0	530	1.8118	0.0695	1.8118	1.3460
0.3106	53.2	532	1.6760	0.1373	1.6760	1.2946
0.3106	53.4	534	1.6426	0.1104	1.6426	1.2816
0.3106	53.6	536	1.6460	0.1104	1.6460	1.2830
0.3106	53.8	538	1.6527	0.1551	1.6527	1.2856
0.3106	54.0	540	1.6365	0.1456	1.6365	1.2793
0.3106	54.2	542	1.5786	0.1283	1.5786	1.2564
0.3106	54.4	544	1.5122	0.0897	1.5122	1.2297
0.3106	54.6	546	1.4959	0.0897	1.4959	1.2231
0.3106	54.8	548	1.5315	0.1230	1.5315	1.2376
0.3106	55.0	550	1.5829	0.1149	1.5829	1.2581
0.3106	55.2	552	1.6434	0.0886	1.6434	1.2819
0.3106	55.4	554	1.6756	0.1018	1.6756	1.2945
0.3106	55.6	556	1.7500	0.1321	1.7500	1.3229
0.3106	55.8	558	1.7973	0.1181	1.7973	1.3406
0.3106	56.0	560	1.8111	0.1181	1.8111	1.3458
0.3106	56.2	562	1.8316	0.0488	1.8316	1.3534
0.3106	56.4	564	1.8141	0.0488	1.8141	1.3469
0.3106	56.6	566	1.7324	0.1181	1.7324	1.3162
0.3106	56.8	568	1.6739	0.1009	1.6739	1.2938
0.3106	57.0	570	1.6302	0.1098	1.6302	1.2768
0.3106	57.2	572	1.6234	0.1098	1.6234	1.2741
0.3106	57.4	574	1.6798	0.1018	1.6798	1.2961
0.3106	57.6	576	1.7756	0.0879	1.7756	1.3325

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1