ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6590
• Qwk: 0.6184
• Mse: 0.6590
• Rmse: 0.8118

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	5.3061	-0.0328	5.3061	2.3035
No log	0.0741	4	3.1380	0.0525	3.1380	1.7714
No log	0.1111	6	2.2101	-0.0436	2.2101	1.4866
No log	0.1481	8	1.6202	0.1510	1.6202	1.2729
No log	0.1852	10	1.2803	0.1801	1.2803	1.1315
No log	0.2222	12	1.2776	0.2336	1.2776	1.1303
No log	0.2593	14	1.2372	0.3029	1.2372	1.1123
No log	0.2963	16	1.2545	0.2542	1.2545	1.1200
No log	0.3333	18	1.2187	0.2978	1.2187	1.1039
No log	0.3704	20	1.1709	0.3243	1.1709	1.0821
No log	0.4074	22	1.1582	0.3238	1.1582	1.0762
No log	0.4444	24	1.1867	0.2857	1.1867	1.0894
No log	0.4815	26	1.3159	0.2378	1.3159	1.1471
No log	0.5185	28	1.5420	0.2579	1.5420	1.2418
No log	0.5556	30	1.4959	0.2916	1.4959	1.2231
No log	0.5926	32	1.6669	0.2895	1.6669	1.2911
No log	0.6296	34	1.7048	0.2977	1.7048	1.3057
No log	0.6667	36	2.2355	0.2244	2.2355	1.4951
No log	0.7037	38	2.8958	0.0907	2.8958	1.7017
No log	0.7407	40	2.8813	0.1479	2.8813	1.6974
No log	0.7778	42	2.1142	0.2201	2.1142	1.4540
No log	0.8148	44	1.3826	0.2511	1.3826	1.1758
No log	0.8519	46	1.0552	0.4040	1.0552	1.0272
No log	0.8889	48	1.0367	0.4023	1.0367	1.0182
No log	0.9259	50	1.1055	0.3678	1.1055	1.0514
No log	0.9630	52	1.2183	0.2712	1.2183	1.1038
No log	1.0	54	1.3137	0.1678	1.3137	1.1462
No log	1.0370	56	1.3851	0.1556	1.3851	1.1769
No log	1.0741	58	1.4250	0.1404	1.4250	1.1938
No log	1.1111	60	1.3012	0.1678	1.3012	1.1407
No log	1.1481	62	1.2000	0.2464	1.2000	1.0954
No log	1.1852	64	1.0693	0.3757	1.0693	1.0341
No log	1.2222	66	0.9044	0.4668	0.9044	0.9510
No log	1.2593	68	0.7972	0.4692	0.7972	0.8928
No log	1.2963	70	0.7653	0.4818	0.7653	0.8748
No log	1.3333	72	0.7838	0.5023	0.7838	0.8853
No log	1.3704	74	0.9277	0.4704	0.9277	0.9632
No log	1.4074	76	1.1316	0.4505	1.1316	1.0638
No log	1.4444	78	1.2396	0.4290	1.2396	1.1134
No log	1.4815	80	1.2279	0.4194	1.2279	1.1081
No log	1.5185	82	0.8858	0.5377	0.8858	0.9411
No log	1.5556	84	0.7763	0.4838	0.7763	0.8811
No log	1.5926	86	0.7746	0.5295	0.7746	0.8801
No log	1.6296	88	0.7876	0.5180	0.7876	0.8875
No log	1.6667	90	0.9143	0.5457	0.9143	0.9562
No log	1.7037	92	1.0793	0.5270	1.0793	1.0389
No log	1.7407	94	0.9180	0.5562	0.9180	0.9581
No log	1.7778	96	0.7511	0.5289	0.7511	0.8667
No log	1.8148	98	0.7963	0.5724	0.7963	0.8924
No log	1.8519	100	0.7847	0.5993	0.7847	0.8858
No log	1.8889	102	0.7138	0.5781	0.7138	0.8449
No log	1.9259	104	0.8392	0.5777	0.8392	0.9161
No log	1.9630	106	1.0775	0.5232	1.0775	1.0380
No log	2.0	108	0.9890	0.5232	0.9890	0.9945
No log	2.0370	110	0.7918	0.6340	0.7918	0.8899
No log	2.0741	112	0.8808	0.5640	0.8808	0.9385
No log	2.1111	114	0.8811	0.5679	0.8811	0.9387
No log	2.1481	116	0.8646	0.5613	0.8646	0.9298
No log	2.1852	118	0.7089	0.6255	0.7089	0.8420
No log	2.2222	120	0.7158	0.6155	0.7158	0.8460
No log	2.2593	122	0.9021	0.5608	0.9021	0.9498
No log	2.2963	124	0.9577	0.5353	0.9577	0.9786
No log	2.3333	126	0.7507	0.5671	0.7507	0.8664
No log	2.3704	128	0.6984	0.6272	0.6984	0.8357
No log	2.4074	130	0.7709	0.6485	0.7709	0.8780
No log	2.4444	132	1.0164	0.5680	1.0164	1.0082
No log	2.4815	134	0.8522	0.6370	0.8522	0.9231
No log	2.5185	136	0.6476	0.6933	0.6476	0.8048
No log	2.5556	138	0.7519	0.6402	0.7519	0.8671
No log	2.5926	140	0.8648	0.6173	0.8648	0.9300
No log	2.6296	142	0.7912	0.6261	0.7912	0.8895
No log	2.6667	144	0.6846	0.6741	0.6846	0.8274
No log	2.7037	146	0.7032	0.6645	0.7032	0.8386
No log	2.7407	148	0.9051	0.5504	0.9051	0.9514
No log	2.7778	150	0.8941	0.5367	0.8941	0.9456
No log	2.8148	152	0.7194	0.6375	0.7194	0.8481
No log	2.8519	154	0.6960	0.6075	0.6960	0.8343
No log	2.8889	156	0.6787	0.5914	0.6787	0.8238
No log	2.9259	158	0.6538	0.6357	0.6538	0.8086
No log	2.9630	160	0.6837	0.6437	0.6837	0.8269
No log	3.0	162	0.6644	0.6315	0.6644	0.8151
No log	3.0370	164	0.6637	0.6743	0.6637	0.8147
No log	3.0741	166	0.8461	0.5596	0.8461	0.9198
No log	3.1111	168	0.8389	0.5666	0.8389	0.9159
No log	3.1481	170	0.8133	0.5781	0.8133	0.9018
No log	3.1852	172	0.7348	0.6251	0.7348	0.8572
No log	3.2222	174	0.7287	0.6601	0.7287	0.8536
No log	3.2593	176	0.7195	0.6705	0.7195	0.8482
No log	3.2963	178	0.7336	0.5934	0.7336	0.8565
No log	3.3333	180	0.7110	0.6805	0.7110	0.8432
No log	3.3704	182	0.7611	0.6848	0.7611	0.8724
No log	3.4074	184	0.7177	0.6949	0.7177	0.8471
No log	3.4444	186	0.6882	0.6873	0.6882	0.8296
No log	3.4815	188	0.7025	0.7192	0.7025	0.8381
No log	3.5185	190	0.6823	0.6963	0.6823	0.8260
No log	3.5556	192	0.7149	0.6720	0.7149	0.8455
No log	3.5926	194	0.7117	0.6677	0.7117	0.8437
No log	3.6296	196	0.6947	0.6416	0.6947	0.8335
No log	3.6667	198	0.8033	0.5955	0.8033	0.8963
No log	3.7037	200	1.0021	0.5533	1.0021	1.0010
No log	3.7407	202	1.0563	0.5144	1.0563	1.0277
No log	3.7778	204	1.1766	0.4568	1.1766	1.0847
No log	3.8148	206	1.2560	0.3961	1.2560	1.1207
No log	3.8519	208	1.2632	0.4136	1.2632	1.1239
No log	3.8889	210	1.0419	0.4786	1.0419	1.0207
No log	3.9259	212	0.8953	0.5048	0.8953	0.9462
No log	3.9630	214	0.8641	0.5539	0.8641	0.9296
No log	4.0	216	0.8771	0.5563	0.8771	0.9365
No log	4.0370	218	0.7876	0.5723	0.7876	0.8874
No log	4.0741	220	0.7626	0.5817	0.7626	0.8733
No log	4.1111	222	0.7612	0.5819	0.7612	0.8725
No log	4.1481	224	0.7584	0.5965	0.7584	0.8709
No log	4.1852	226	0.7540	0.5780	0.7540	0.8683
No log	4.2222	228	0.7432	0.6173	0.7432	0.8621
No log	4.2593	230	0.7159	0.6008	0.7159	0.8461
No log	4.2963	232	0.7597	0.6059	0.7597	0.8716
No log	4.3333	234	0.7929	0.6223	0.7929	0.8904
No log	4.3704	236	0.7415	0.6323	0.7415	0.8611
No log	4.4074	238	0.7003	0.6937	0.7003	0.8368
No log	4.4444	240	0.7470	0.6608	0.7470	0.8643
No log	4.4815	242	0.7166	0.6625	0.7166	0.8465
No log	4.5185	244	0.7147	0.6882	0.7147	0.8454
No log	4.5556	246	0.7046	0.6419	0.7046	0.8394
No log	4.5926	248	0.6808	0.6468	0.6808	0.8251
No log	4.6296	250	0.6781	0.6034	0.6781	0.8234
No log	4.6667	252	0.6987	0.5970	0.6987	0.8359
No log	4.7037	254	0.6917	0.5970	0.6917	0.8317
No log	4.7407	256	0.6918	0.6505	0.6918	0.8317
No log	4.7778	258	0.6969	0.6643	0.6969	0.8348
No log	4.8148	260	0.8382	0.6523	0.8382	0.9156
No log	4.8519	262	0.8936	0.6488	0.8936	0.9453
No log	4.8889	264	0.9013	0.6546	0.9013	0.9494
No log	4.9259	266	0.7835	0.6682	0.7835	0.8852
No log	4.9630	268	0.7588	0.6634	0.7588	0.8711
No log	5.0	270	0.7779	0.6555	0.7779	0.8820
No log	5.0370	272	0.7406	0.6238	0.7406	0.8606
No log	5.0741	274	0.7183	0.6408	0.7183	0.8475
No log	5.1111	276	0.6955	0.6735	0.6955	0.8340
No log	5.1481	278	0.6980	0.6621	0.6980	0.8355
No log	5.1852	280	0.7836	0.6348	0.7836	0.8852
No log	5.2222	282	0.7384	0.6310	0.7384	0.8593
No log	5.2593	284	0.6850	0.6640	0.6850	0.8276
No log	5.2963	286	0.6904	0.6539	0.6904	0.8309
No log	5.3333	288	0.6894	0.6508	0.6894	0.8303
No log	5.3704	290	0.6829	0.6631	0.6829	0.8264
No log	5.4074	292	0.7241	0.6556	0.7241	0.8509
No log	5.4444	294	0.7181	0.6654	0.7181	0.8474
No log	5.4815	296	0.6886	0.6826	0.6886	0.8298
No log	5.5185	298	0.7056	0.6835	0.7056	0.8400
No log	5.5556	300	0.6876	0.6749	0.6876	0.8292
No log	5.5926	302	0.6995	0.6947	0.6995	0.8364
No log	5.6296	304	0.6960	0.6816	0.6960	0.8343
No log	5.6667	306	0.7124	0.6951	0.7124	0.8441
No log	5.7037	308	0.7077	0.7000	0.7077	0.8412
No log	5.7407	310	0.7010	0.6869	0.7010	0.8372
No log	5.7778	312	0.7353	0.6272	0.7353	0.8575
No log	5.8148	314	0.7592	0.6187	0.7592	0.8713
No log	5.8519	316	0.7141	0.6562	0.7141	0.8451
No log	5.8889	318	0.7760	0.6576	0.7760	0.8809
No log	5.9259	320	0.8059	0.6233	0.8059	0.8977
No log	5.9630	322	0.7284	0.6820	0.7284	0.8534
No log	6.0	324	0.7285	0.6449	0.7285	0.8535
No log	6.0370	326	0.7605	0.6080	0.7605	0.8720
No log	6.0741	328	0.7380	0.6310	0.7380	0.8591
No log	6.1111	330	0.7201	0.6372	0.7201	0.8486
No log	6.1481	332	0.7651	0.6879	0.7651	0.8747
No log	6.1852	334	0.7923	0.6578	0.7923	0.8901
No log	6.2222	336	0.7732	0.6828	0.7732	0.8793
No log	6.2593	338	0.7901	0.6819	0.7901	0.8889
No log	6.2963	340	0.7649	0.6245	0.7649	0.8746
No log	6.3333	342	0.7425	0.5826	0.7425	0.8617
No log	6.3704	344	0.7325	0.5660	0.7325	0.8559
No log	6.4074	346	0.7165	0.6423	0.7165	0.8465
No log	6.4444	348	0.7288	0.6695	0.7288	0.8537
No log	6.4815	350	0.7996	0.6187	0.7996	0.8942
No log	6.5185	352	0.8157	0.6192	0.8157	0.9031
No log	6.5556	354	0.7375	0.6435	0.7375	0.8588
No log	6.5926	356	0.7185	0.6040	0.7185	0.8477
No log	6.6296	358	0.7011	0.6396	0.7011	0.8373
No log	6.6667	360	0.7352	0.6869	0.7352	0.8574
No log	6.7037	362	0.9022	0.6065	0.9022	0.9498
No log	6.7407	364	1.0986	0.5460	1.0986	1.0481
No log	6.7778	366	1.0465	0.5541	1.0465	1.0230
No log	6.8148	368	0.8513	0.6321	0.8513	0.9227
No log	6.8519	370	0.7857	0.6123	0.7857	0.8864
No log	6.8889	372	0.8113	0.5859	0.8113	0.9007
No log	6.9259	374	0.8408	0.5626	0.8408	0.9170
No log	6.9630	376	0.8067	0.5942	0.8067	0.8982
No log	7.0	378	0.7782	0.6091	0.7782	0.8822
No log	7.0370	380	0.7383	0.6452	0.7383	0.8593
No log	7.0741	382	0.6823	0.6511	0.6823	0.8260
No log	7.1111	384	0.6785	0.6862	0.6785	0.8237
No log	7.1481	386	0.6760	0.6671	0.6760	0.8222
No log	7.1852	388	0.6883	0.6425	0.6883	0.8296
No log	7.2222	390	0.7243	0.6271	0.7243	0.8511
No log	7.2593	392	0.7064	0.6058	0.7064	0.8405
No log	7.2963	394	0.7101	0.6177	0.7101	0.8426
No log	7.3333	396	0.6997	0.6653	0.6997	0.8365
No log	7.3704	398	0.7121	0.6521	0.7121	0.8439
No log	7.4074	400	0.6883	0.7081	0.6883	0.8296
No log	7.4444	402	0.6956	0.7275	0.6956	0.8340
No log	7.4815	404	0.7179	0.6901	0.7179	0.8473
No log	7.5185	406	0.7326	0.6791	0.7326	0.8559
No log	7.5556	408	0.7796	0.6347	0.7796	0.8829
No log	7.5926	410	0.8126	0.5907	0.8126	0.9014
No log	7.6296	412	0.7697	0.6405	0.7697	0.8773
No log	7.6667	414	0.7306	0.6868	0.7306	0.8547
No log	7.7037	416	0.7247	0.6835	0.7247	0.8513
No log	7.7407	418	0.7264	0.6623	0.7264	0.8523
No log	7.7778	420	0.6936	0.6762	0.6936	0.8328
No log	7.8148	422	0.6996	0.6544	0.6996	0.8364
No log	7.8519	424	0.7005	0.6569	0.7005	0.8370
No log	7.8889	426	0.7226	0.6674	0.7226	0.8500
No log	7.9259	428	0.8787	0.5897	0.8787	0.9374
No log	7.9630	430	0.9890	0.5693	0.9890	0.9945
No log	8.0	432	0.8936	0.5985	0.8936	0.9453
No log	8.0370	434	0.7480	0.7079	0.7480	0.8649
No log	8.0741	436	0.7602	0.7137	0.7602	0.8719
No log	8.1111	438	0.8589	0.6511	0.8589	0.9268
No log	8.1481	440	0.8092	0.6890	0.8092	0.8995
No log	8.1852	442	0.7217	0.7162	0.7217	0.8496
No log	8.2222	444	0.7710	0.6481	0.7710	0.8781
No log	8.2593	446	0.8504	0.6016	0.8504	0.9222
No log	8.2963	448	0.8490	0.5933	0.8490	0.9214
No log	8.3333	450	0.7928	0.6362	0.7928	0.8904
No log	8.3704	452	0.7682	0.6839	0.7682	0.8765
No log	8.4074	454	0.8026	0.6490	0.8026	0.8959
No log	8.4444	456	0.8479	0.6253	0.8479	0.9208
No log	8.4815	458	0.8725	0.6138	0.8725	0.9341
No log	8.5185	460	0.9353	0.616	0.9353	0.9671
No log	8.5556	462	0.8961	0.6156	0.8961	0.9466
No log	8.5926	464	0.8311	0.6360	0.8311	0.9117
No log	8.6296	466	0.7484	0.6635	0.7484	0.8651
No log	8.6667	468	0.7423	0.6673	0.7423	0.8616
No log	8.7037	470	0.7965	0.6495	0.7965	0.8924
No log	8.7407	472	0.8919	0.6211	0.8919	0.9444
No log	8.7778	474	0.8338	0.6422	0.8338	0.9131
No log	8.8148	476	0.6953	0.6633	0.6953	0.8339
No log	8.8519	478	0.6404	0.6483	0.6404	0.8003
No log	8.8889	480	0.6326	0.6836	0.6326	0.7954
No log	8.9259	482	0.6424	0.6881	0.6424	0.8015
No log	8.9630	484	0.7263	0.6377	0.7263	0.8522
No log	9.0	486	0.7589	0.6407	0.7589	0.8711
No log	9.0370	488	0.7094	0.6437	0.7094	0.8422
No log	9.0741	490	0.6343	0.6959	0.6343	0.7964
No log	9.1111	492	0.6118	0.6681	0.6118	0.7822
No log	9.1481	494	0.6189	0.6724	0.6189	0.7867
No log	9.1852	496	0.6426	0.6764	0.6426	0.8016
No log	9.2222	498	0.6934	0.6734	0.6934	0.8327
0.4272	9.2593	500	0.6914	0.6586	0.6914	0.8315
0.4272	9.2963	502	0.6873	0.6713	0.6873	0.8290
0.4272	9.3333	504	0.7082	0.6543	0.7082	0.8415
0.4272	9.3704	506	0.7426	0.6333	0.7426	0.8618
0.4272	9.4074	508	0.7266	0.6507	0.7266	0.8524
0.4272	9.4444	510	0.7119	0.6530	0.7119	0.8437
0.4272	9.4815	512	0.6906	0.6848	0.6906	0.8310
0.4272	9.5185	514	0.6872	0.7055	0.6872	0.8290
0.4272	9.5556	516	0.6680	0.7186	0.6680	0.8173
0.4272	9.5926	518	0.6601	0.7125	0.6601	0.8125
0.4272	9.6296	520	0.6534	0.6872	0.6534	0.8083
0.4272	9.6667	522	0.6465	0.6851	0.6465	0.8040
0.4272	9.7037	524	0.6356	0.6817	0.6356	0.7972
0.4272	9.7407	526	0.6643	0.6705	0.6643	0.8150
0.4272	9.7778	528	0.7047	0.6516	0.7047	0.8394
0.4272	9.8148	530	0.6965	0.6576	0.6965	0.8346
0.4272	9.8519	532	0.7081	0.6467	0.7081	0.8415
0.4272	9.8889	534	0.7294	0.6050	0.7294	0.8540
0.4272	9.9259	536	0.6590	0.6184	0.6590	0.8118

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1