ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k5_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5386
• Qwk: 0.6337
• Mse: 0.5386
• Rmse: 0.7339

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0714	2	4.2229	-0.0111	4.2229	2.0550
No log	0.1429	4	2.3099	0.0485	2.3099	1.5199
No log	0.2143	6	1.3402	0.1044	1.3402	1.1577
No log	0.2857	8	0.8728	0.1209	0.8728	0.9342
No log	0.3571	10	0.7155	0.2723	0.7155	0.8459
No log	0.4286	12	0.7602	0.2467	0.7602	0.8719
No log	0.5	14	0.7732	0.2673	0.7732	0.8793
No log	0.5714	16	0.7889	0.3461	0.7889	0.8882
No log	0.6429	18	0.7451	0.2490	0.7451	0.8632
No log	0.7143	20	0.6764	0.2379	0.6764	0.8224
No log	0.7857	22	1.2112	0.0602	1.2112	1.1006
No log	0.8571	24	2.1778	0.0815	2.1778	1.4757
No log	0.9286	26	2.2373	0.0725	2.2373	1.4958
No log	1.0	28	2.0287	0.1243	2.0287	1.4243
No log	1.0714	30	1.9513	0.1178	1.9513	1.3969
No log	1.1429	32	1.5288	0.1166	1.5288	1.2364
No log	1.2143	34	1.0441	0.0718	1.0441	1.0218
No log	1.2857	36	0.8310	0.2532	0.8310	0.9116
No log	1.3571	38	0.7131	0.3315	0.7131	0.8445
No log	1.4286	40	0.6887	0.1706	0.6887	0.8299
No log	1.5	42	0.6982	0.1633	0.6982	0.8356
No log	1.5714	44	0.6761	0.2010	0.6761	0.8222
No log	1.6429	46	0.6811	0.2855	0.6811	0.8253
No log	1.7143	48	0.6993	0.3683	0.6993	0.8362
No log	1.7857	50	0.8011	0.3056	0.8011	0.8951
No log	1.8571	52	0.9084	0.2111	0.9084	0.9531
No log	1.9286	54	1.1517	0.0946	1.1517	1.0732
No log	2.0	56	1.4800	0.1294	1.4800	1.2165
No log	2.0714	58	1.6194	0.0770	1.6194	1.2726
No log	2.1429	60	1.3218	0.1269	1.3218	1.1497
No log	2.2143	62	0.9282	0.2579	0.9282	0.9634
No log	2.2857	64	0.7696	0.2670	0.7696	0.8773
No log	2.3571	66	0.7216	0.3447	0.7216	0.8495
No log	2.4286	68	0.6756	0.4010	0.6756	0.8219
No log	2.5	70	0.6284	0.3985	0.6284	0.7927
No log	2.5714	72	0.6102	0.3866	0.6102	0.7811
No log	2.6429	74	0.5951	0.3620	0.5951	0.7714
No log	2.7143	76	0.6070	0.4684	0.6070	0.7791
No log	2.7857	78	0.6886	0.3578	0.6886	0.8298
No log	2.8571	80	0.7911	0.3571	0.7911	0.8895
No log	2.9286	82	0.8824	0.3028	0.8824	0.9394
No log	3.0	84	1.0433	0.3144	1.0433	1.0214
No log	3.0714	86	1.1247	0.2518	1.1247	1.0605
No log	3.1429	88	1.0985	0.3261	1.0985	1.0481
No log	3.2143	90	1.1067	0.3225	1.1067	1.0520
No log	3.2857	92	1.0200	0.3711	1.0200	1.0100
No log	3.3571	94	0.9557	0.3898	0.9557	0.9776
No log	3.4286	96	0.9415	0.3985	0.9415	0.9703
No log	3.5	98	0.9022	0.4538	0.9022	0.9499
No log	3.5714	100	0.9668	0.4094	0.9668	0.9832
No log	3.6429	102	1.0374	0.4119	1.0374	1.0185
No log	3.7143	104	0.8932	0.4461	0.8932	0.9451
No log	3.7857	106	0.8273	0.4446	0.8273	0.9096
No log	3.8571	108	0.6801	0.5129	0.6801	0.8247
No log	3.9286	110	0.6487	0.5636	0.6487	0.8054
No log	4.0	112	0.6353	0.5227	0.6353	0.7970
No log	4.0714	114	0.6289	0.5062	0.6289	0.7930
No log	4.1429	116	0.6401	0.4726	0.6401	0.8001
No log	4.2143	118	0.6134	0.4985	0.6134	0.7832
No log	4.2857	120	0.5965	0.5467	0.5965	0.7723
No log	4.3571	122	0.6215	0.5211	0.6215	0.7884
No log	4.4286	124	0.6938	0.4935	0.6938	0.8329
No log	4.5	126	0.7999	0.5163	0.7999	0.8944
No log	4.5714	128	0.7861	0.5306	0.7861	0.8866
No log	4.6429	130	0.7123	0.5098	0.7123	0.8440
No log	4.7143	132	0.6326	0.5443	0.6326	0.7954
No log	4.7857	134	0.6501	0.5724	0.6501	0.8063
No log	4.8571	136	0.6658	0.4704	0.6658	0.8159
No log	4.9286	138	0.6165	0.4158	0.6165	0.7852
No log	5.0	140	0.6108	0.4847	0.6108	0.7816
No log	5.0714	142	0.5957	0.4596	0.5957	0.7718
No log	5.1429	144	0.6589	0.5541	0.6589	0.8117
No log	5.2143	146	0.7255	0.5580	0.7255	0.8518
No log	5.2857	148	0.7419	0.5109	0.7419	0.8613
No log	5.3571	150	0.7418	0.5244	0.7418	0.8613
No log	5.4286	152	0.6960	0.5321	0.6960	0.8343
No log	5.5	154	0.6253	0.5662	0.6253	0.7907
No log	5.5714	156	0.5517	0.5994	0.5517	0.7428
No log	5.6429	158	0.5320	0.5942	0.5320	0.7294
No log	5.7143	160	0.5270	0.5850	0.5270	0.7259
No log	5.7857	162	0.5080	0.6215	0.5080	0.7127
No log	5.8571	164	0.5139	0.6112	0.5139	0.7169
No log	5.9286	166	0.5464	0.6005	0.5464	0.7392
No log	6.0	168	0.6428	0.5688	0.6428	0.8018
No log	6.0714	170	0.6739	0.5673	0.6739	0.8209
No log	6.1429	172	0.8640	0.4564	0.8640	0.9295
No log	6.2143	174	0.9368	0.4311	0.9368	0.9679
No log	6.2857	176	0.8808	0.4732	0.8808	0.9385
No log	6.3571	178	0.7184	0.5745	0.7184	0.8476
No log	6.4286	180	0.6163	0.5630	0.6163	0.7850
No log	6.5	182	0.5983	0.5984	0.5983	0.7735
No log	6.5714	184	0.5801	0.5244	0.5801	0.7617
No log	6.6429	186	0.5885	0.5214	0.5885	0.7671
No log	6.7143	188	0.6220	0.5082	0.6220	0.7887
No log	6.7857	190	0.6259	0.4887	0.6259	0.7911
No log	6.8571	192	0.6156	0.5330	0.6156	0.7846
No log	6.9286	194	0.5950	0.5814	0.5950	0.7714
No log	7.0	196	0.6011	0.6000	0.6011	0.7753
No log	7.0714	198	0.6049	0.5924	0.6049	0.7777
No log	7.1429	200	0.6004	0.6065	0.6004	0.7748
No log	7.2143	202	0.6049	0.5941	0.6049	0.7778
No log	7.2857	204	0.6348	0.5806	0.6348	0.7967
No log	7.3571	206	0.6549	0.5716	0.6549	0.8093
No log	7.4286	208	0.6773	0.5928	0.6773	0.8230
No log	7.5	210	0.6754	0.5819	0.6754	0.8218
No log	7.5714	212	0.6687	0.5981	0.6687	0.8177
No log	7.6429	214	0.6694	0.5796	0.6695	0.8182
No log	7.7143	216	0.6343	0.5811	0.6343	0.7964
No log	7.7857	218	0.5811	0.5866	0.5811	0.7623
No log	7.8571	220	0.5723	0.5901	0.5723	0.7565
No log	7.9286	222	0.6591	0.4912	0.6591	0.8118
No log	8.0	224	0.7210	0.5006	0.7210	0.8491
No log	8.0714	226	0.6835	0.4976	0.6835	0.8267
No log	8.1429	228	0.5968	0.5219	0.5968	0.7725
No log	8.2143	230	0.5445	0.5681	0.5445	0.7379
No log	8.2857	232	0.5580	0.5918	0.5580	0.7470
No log	8.3571	234	0.6171	0.5657	0.6171	0.7856
No log	8.4286	236	0.6795	0.5664	0.6795	0.8243
No log	8.5	238	0.7019	0.5893	0.7019	0.8378
No log	8.5714	240	0.6858	0.6166	0.6858	0.8281
No log	8.6429	242	0.6657	0.5826	0.6657	0.8159
No log	8.7143	244	0.6448	0.5855	0.6448	0.8030
No log	8.7857	246	0.6278	0.5627	0.6278	0.7923
No log	8.8571	248	0.5996	0.5870	0.5996	0.7743
No log	8.9286	250	0.5593	0.5783	0.5593	0.7479
No log	9.0	252	0.5448	0.5724	0.5448	0.7381
No log	9.0714	254	0.5496	0.5667	0.5496	0.7414
No log	9.1429	256	0.5347	0.5864	0.5347	0.7312
No log	9.2143	258	0.5351	0.6015	0.5351	0.7315
No log	9.2857	260	0.5489	0.5905	0.5489	0.7409
No log	9.3571	262	0.5361	0.5875	0.5361	0.7322
No log	9.4286	264	0.5260	0.5899	0.5260	0.7253
No log	9.5	266	0.5255	0.5962	0.5255	0.7249
No log	9.5714	268	0.5167	0.5937	0.5167	0.7188
No log	9.6429	270	0.5205	0.6019	0.5205	0.7215
No log	9.7143	272	0.5151	0.6019	0.5151	0.7177
No log	9.7857	274	0.5037	0.6289	0.5037	0.7097
No log	9.8571	276	0.5024	0.6137	0.5024	0.7088
No log	9.9286	278	0.5049	0.6235	0.5049	0.7106
No log	10.0	280	0.5138	0.6100	0.5138	0.7168
No log	10.0714	282	0.5263	0.6168	0.5263	0.7255
No log	10.1429	284	0.5343	0.6020	0.5343	0.7310
No log	10.2143	286	0.5490	0.5651	0.5490	0.7410
No log	10.2857	288	0.5938	0.5084	0.5938	0.7706
No log	10.3571	290	0.6117	0.5084	0.6117	0.7821
No log	10.4286	292	0.5926	0.5303	0.5926	0.7698
No log	10.5	294	0.5583	0.5931	0.5583	0.7472
No log	10.5714	296	0.5274	0.6158	0.5274	0.7262
No log	10.6429	298	0.5536	0.5859	0.5536	0.7441
No log	10.7143	300	0.5814	0.5576	0.5814	0.7625
No log	10.7857	302	0.6096	0.5406	0.6096	0.7807
No log	10.8571	304	0.6273	0.5462	0.6273	0.7920
No log	10.9286	306	0.6541	0.5694	0.6541	0.8087
No log	11.0	308	0.6373	0.5731	0.6373	0.7983
No log	11.0714	310	0.6377	0.5530	0.6377	0.7986
No log	11.1429	312	0.6690	0.5293	0.6690	0.8179
No log	11.2143	314	0.6456	0.5321	0.6456	0.8035
No log	11.2857	316	0.6030	0.5595	0.6030	0.7765
No log	11.3571	318	0.5755	0.5743	0.5755	0.7586
No log	11.4286	320	0.5382	0.6268	0.5382	0.7336
No log	11.5	322	0.5224	0.6370	0.5224	0.7228
No log	11.5714	324	0.5211	0.6024	0.5211	0.7219
No log	11.6429	326	0.5157	0.5796	0.5157	0.7181
No log	11.7143	328	0.5097	0.6281	0.5097	0.7140
No log	11.7857	330	0.5134	0.6529	0.5134	0.7165
No log	11.8571	332	0.5240	0.6059	0.5240	0.7239
No log	11.9286	334	0.5267	0.6322	0.5267	0.7258
No log	12.0	336	0.5686	0.6039	0.5686	0.7541
No log	12.0714	338	0.6362	0.5943	0.6362	0.7976
No log	12.1429	340	0.6724	0.5825	0.6724	0.8200
No log	12.2143	342	0.7089	0.5902	0.7089	0.8419
No log	12.2857	344	0.6826	0.5924	0.6826	0.8262
No log	12.3571	346	0.6546	0.5944	0.6546	0.8091
No log	12.4286	348	0.6636	0.5545	0.6636	0.8146
No log	12.5	350	0.6608	0.5462	0.6608	0.8129
No log	12.5714	352	0.6373	0.5730	0.6373	0.7983
No log	12.6429	354	0.6346	0.6182	0.6346	0.7966
No log	12.7143	356	0.6136	0.6332	0.6136	0.7833
No log	12.7857	358	0.5953	0.6469	0.5953	0.7715
No log	12.8571	360	0.5648	0.6177	0.5648	0.7515
No log	12.9286	362	0.5649	0.5729	0.5649	0.7516
No log	13.0	364	0.5553	0.6029	0.5553	0.7452
No log	13.0714	366	0.5892	0.5363	0.5892	0.7676
No log	13.1429	368	0.5850	0.5824	0.5850	0.7649
No log	13.2143	370	0.5564	0.6523	0.5564	0.7459
No log	13.2857	372	0.5815	0.5793	0.5815	0.7626
No log	13.3571	374	0.6368	0.5745	0.6368	0.7980
No log	13.4286	376	0.6307	0.5724	0.6307	0.7942
No log	13.5	378	0.5904	0.5906	0.5904	0.7683
No log	13.5714	380	0.5792	0.6545	0.5792	0.7610
No log	13.6429	382	0.5664	0.5814	0.5664	0.7526
No log	13.7143	384	0.5459	0.6171	0.5459	0.7389
No log	13.7857	386	0.5466	0.5422	0.5466	0.7394
No log	13.8571	388	0.5464	0.5763	0.5464	0.7392
No log	13.9286	390	0.5683	0.5344	0.5683	0.7539
No log	14.0	392	0.6000	0.5308	0.6000	0.7746
No log	14.0714	394	0.6245	0.5975	0.6245	0.7903
No log	14.1429	396	0.6519	0.6241	0.6519	0.8074
No log	14.2143	398	0.6265	0.6444	0.6265	0.7915
No log	14.2857	400	0.6046	0.6168	0.6046	0.7776
No log	14.3571	402	0.5780	0.5708	0.5780	0.7602
No log	14.4286	404	0.5605	0.6070	0.5605	0.7486
No log	14.5	406	0.5408	0.5988	0.5408	0.7354
No log	14.5714	408	0.5342	0.6122	0.5342	0.7309
No log	14.6429	410	0.5365	0.5877	0.5365	0.7325
No log	14.7143	412	0.5850	0.5645	0.5850	0.7648
No log	14.7857	414	0.6336	0.5445	0.6336	0.7960
No log	14.8571	416	0.5967	0.5619	0.5967	0.7725
No log	14.9286	418	0.5478	0.5642	0.5478	0.7401
No log	15.0	420	0.5487	0.5721	0.5487	0.7407
No log	15.0714	422	0.5335	0.6333	0.5335	0.7304
No log	15.1429	424	0.5340	0.6153	0.5340	0.7307
No log	15.2143	426	0.5473	0.6071	0.5473	0.7398
No log	15.2857	428	0.5613	0.5743	0.5613	0.7492
No log	15.3571	430	0.5425	0.5841	0.5425	0.7366
No log	15.4286	432	0.5221	0.6480	0.5221	0.7226
No log	15.5	434	0.5223	0.6480	0.5223	0.7227
No log	15.5714	436	0.5338	0.5978	0.5338	0.7306
No log	15.6429	438	0.5898	0.5506	0.5898	0.7680
No log	15.7143	440	0.5980	0.5528	0.5980	0.7733
No log	15.7857	442	0.5731	0.5567	0.5731	0.7571
No log	15.8571	444	0.5515	0.6184	0.5515	0.7426
No log	15.9286	446	0.5422	0.6485	0.5422	0.7364
No log	16.0	448	0.5540	0.6446	0.5540	0.7443
No log	16.0714	450	0.5611	0.6502	0.5611	0.7491
No log	16.1429	452	0.5581	0.6256	0.5581	0.7470
No log	16.2143	454	0.5454	0.6409	0.5454	0.7385
No log	16.2857	456	0.5215	0.6566	0.5215	0.7222
No log	16.3571	458	0.5026	0.6702	0.5026	0.7089
No log	16.4286	460	0.4996	0.6683	0.4996	0.7068
No log	16.5	462	0.5299	0.6173	0.5299	0.7279
No log	16.5714	464	0.5469	0.5779	0.5469	0.7395
No log	16.6429	466	0.5291	0.6025	0.5291	0.7274
No log	16.7143	468	0.5430	0.5841	0.5430	0.7369
No log	16.7857	470	0.5869	0.5512	0.5869	0.7661
No log	16.8571	472	0.6283	0.4937	0.6283	0.7927
No log	16.9286	474	0.5889	0.5352	0.5889	0.7674
No log	17.0	476	0.5175	0.6263	0.5175	0.7194
No log	17.0714	478	0.4924	0.5903	0.4924	0.7017
No log	17.1429	480	0.4923	0.6081	0.4923	0.7016
No log	17.2143	482	0.4913	0.6588	0.4913	0.7009
No log	17.2857	484	0.4922	0.6410	0.4922	0.7015
No log	17.3571	486	0.4983	0.6026	0.4983	0.7059
No log	17.4286	488	0.4957	0.6610	0.4957	0.7041
No log	17.5	490	0.5000	0.6500	0.5000	0.7071
No log	17.5714	492	0.5136	0.6026	0.5136	0.7167
No log	17.6429	494	0.5395	0.5998	0.5395	0.7345
No log	17.7143	496	0.5320	0.5961	0.5320	0.7294
No log	17.7857	498	0.5112	0.6356	0.5112	0.7150
0.419	17.8571	500	0.5194	0.6356	0.5194	0.7207
0.419	17.9286	502	0.5159	0.6197	0.5159	0.7183
0.419	18.0	504	0.5085	0.6149	0.5085	0.7131
0.419	18.0714	506	0.5162	0.6747	0.5162	0.7185
0.419	18.1429	508	0.5298	0.6494	0.5298	0.7279
0.419	18.2143	510	0.5366	0.6446	0.5366	0.7325
0.419	18.2857	512	0.5354	0.6602	0.5354	0.7317
0.419	18.3571	514	0.5362	0.6499	0.5362	0.7323
0.419	18.4286	516	0.5321	0.6328	0.5321	0.7294
0.419	18.5	518	0.5387	0.6211	0.5387	0.7340
0.419	18.5714	520	0.5352	0.6116	0.5352	0.7316
0.419	18.6429	522	0.5216	0.6674	0.5216	0.7222
0.419	18.7143	524	0.5212	0.6251	0.5212	0.7220
0.419	18.7857	526	0.5109	0.6364	0.5109	0.7148
0.419	18.8571	528	0.5048	0.6261	0.5048	0.7105
0.419	18.9286	530	0.5107	0.6526	0.5107	0.7147
0.419	19.0	532	0.5525	0.5858	0.5525	0.7433
0.419	19.0714	534	0.5798	0.5538	0.5798	0.7615
0.419	19.1429	536	0.5798	0.5382	0.5798	0.7614
0.419	19.2143	538	0.5612	0.5941	0.5612	0.7491
0.419	19.2857	540	0.5386	0.6337	0.5386	0.7339

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1