ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k12_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6249
• Qwk: 0.2819
• Mse: 0.6249
• Rmse: 0.7905

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0476	2	2.4563	-0.0297	2.4563	1.5673
No log	0.0952	4	1.1968	0.0686	1.1968	1.0940
No log	0.1429	6	0.9552	-0.0228	0.9552	0.9773
No log	0.1905	8	0.7332	0.0444	0.7332	0.8563
No log	0.2381	10	0.7028	0.0444	0.7028	0.8383
No log	0.2857	12	0.7215	0.0410	0.7215	0.8494
No log	0.3333	14	0.7811	0.0940	0.7811	0.8838
No log	0.3810	16	0.8483	0.2464	0.8483	0.9211
No log	0.4286	18	1.0545	0.1557	1.0545	1.0269
No log	0.4762	20	1.0203	0.2533	1.0203	1.0101
No log	0.5238	22	0.8600	0.1358	0.8600	0.9273
No log	0.5714	24	0.7974	0.0937	0.7974	0.8930
No log	0.6190	26	0.7642	0.0937	0.7642	0.8742
No log	0.6667	28	0.7647	0.0937	0.7647	0.8745
No log	0.7143	30	1.1371	0.0993	1.1371	1.0664
No log	0.7619	32	1.4900	0.0796	1.4900	1.2207
No log	0.8095	34	1.2826	0.1004	1.2826	1.1325
No log	0.8571	36	0.9419	0.3230	0.9419	0.9705
No log	0.9048	38	0.7259	0.0481	0.7259	0.8520
No log	0.9524	40	0.6814	0.0393	0.6814	0.8255
No log	1.0	42	0.6957	0.0	0.6957	0.8341
No log	1.0476	44	0.7785	0.0	0.7785	0.8823
No log	1.0952	46	0.8699	0.1697	0.8699	0.9327
No log	1.1429	48	1.0007	0.2483	1.0007	1.0003
No log	1.1905	50	1.1060	0.1786	1.1060	1.0516
No log	1.2381	52	1.0062	0.2129	1.0062	1.0031
No log	1.2857	54	0.8511	0.2109	0.8511	0.9226
No log	1.3333	56	0.7576	0.1372	0.7576	0.8704
No log	1.3810	58	0.7299	0.0481	0.7299	0.8543
No log	1.4286	60	0.8485	0.0570	0.8485	0.9212
No log	1.4762	62	0.9016	0.0570	0.9016	0.9495
No log	1.5238	64	0.7089	0.0937	0.7089	0.8420
No log	1.5714	66	0.7450	0.2857	0.7450	0.8632
No log	1.6190	68	0.8403	0.2285	0.8403	0.9167
No log	1.6667	70	0.8392	0.2085	0.8392	0.9161
No log	1.7143	72	0.7784	0.0327	0.7784	0.8823
No log	1.7619	74	0.7288	0.0481	0.7288	0.8537
No log	1.8095	76	0.8195	0.0944	0.8195	0.9052
No log	1.8571	78	0.7748	0.0937	0.7748	0.8802
No log	1.9048	80	0.7510	0.0937	0.7510	0.8666
No log	1.9524	82	0.7559	0.0428	0.7559	0.8694
No log	2.0	84	0.7924	0.0937	0.7924	0.8902
No log	2.0476	86	0.9197	0.1345	0.9197	0.9590
No log	2.0952	88	0.9366	0.1339	0.9366	0.9678
No log	2.1429	90	0.8349	0.0522	0.8349	0.9137
No log	2.1905	92	0.7176	0.1327	0.7176	0.8471
No log	2.2381	94	0.7197	0.2103	0.7197	0.8483
No log	2.2857	96	0.7993	0.2046	0.7993	0.8940
No log	2.3333	98	0.7531	0.2430	0.7531	0.8678
No log	2.3810	100	0.6689	0.1953	0.6689	0.8178
No log	2.4286	102	0.7578	0.3167	0.7578	0.8705
No log	2.4762	104	0.7184	0.0927	0.7184	0.8476
No log	2.5238	106	0.6801	0.2418	0.6801	0.8247
No log	2.5714	108	0.7387	0.2408	0.7387	0.8595
No log	2.6190	110	0.7770	0.2984	0.7770	0.8815
No log	2.6667	112	0.6937	0.2368	0.6937	0.8329
No log	2.7143	114	0.6707	0.1548	0.6707	0.8189
No log	2.7619	116	0.6656	0.2121	0.6656	0.8158
No log	2.8095	118	0.6603	0.2476	0.6603	0.8126
No log	2.8571	120	0.7087	0.1746	0.7087	0.8419
No log	2.9048	122	0.8571	0.2408	0.8571	0.9258
No log	2.9524	124	0.8759	0.1639	0.8759	0.9359
No log	3.0	126	0.8379	0.2435	0.8379	0.9154
No log	3.0476	128	0.7892	0.2430	0.7892	0.8884
No log	3.0952	130	0.7828	0.2740	0.7828	0.8847
No log	3.1429	132	0.7577	0.2708	0.7577	0.8704
No log	3.1905	134	0.7167	0.1471	0.7167	0.8466
No log	3.2381	136	0.7207	0.2970	0.7207	0.8489
No log	3.2857	138	0.7296	0.3243	0.7296	0.8542
No log	3.3333	140	0.8228	0.3442	0.8228	0.9071
No log	3.3810	142	0.8446	0.3323	0.8446	0.9190
No log	3.4286	144	0.7239	0.3470	0.7239	0.8508
No log	3.4762	146	0.6356	0.3474	0.6356	0.7972
No log	3.5238	148	0.6252	0.2717	0.6252	0.7907
No log	3.5714	150	0.6189	0.4027	0.6189	0.7867
No log	3.6190	152	0.6235	0.3599	0.6235	0.7896
No log	3.6667	154	0.6197	0.4044	0.6197	0.7872
No log	3.7143	156	0.6193	0.4217	0.6193	0.7870
No log	3.7619	158	0.7343	0.3035	0.7343	0.8569
No log	3.8095	160	0.9675	0.3089	0.9675	0.9836
No log	3.8571	162	1.0026	0.3089	1.0026	1.0013
No log	3.9048	164	0.8915	0.2651	0.8915	0.9442
No log	3.9524	166	0.7423	0.3451	0.7423	0.8616
No log	4.0	168	0.6581	0.3186	0.6581	0.8112
No log	4.0476	170	0.6513	0.4091	0.6513	0.8070
No log	4.0952	172	0.7075	0.3425	0.7075	0.8411
No log	4.1429	174	0.8652	0.2357	0.8652	0.9302
No log	4.1905	176	0.8924	0.2091	0.8924	0.9447
No log	4.2381	178	0.7752	0.2705	0.7752	0.8805
No log	4.2857	180	0.6315	0.4660	0.6315	0.7947
No log	4.3333	182	0.6504	0.3942	0.6504	0.8065
No log	4.3810	184	0.6208	0.4044	0.6208	0.7879
No log	4.4286	186	0.6177	0.4253	0.6177	0.7860
No log	4.4762	188	0.6676	0.4674	0.6676	0.8171
No log	4.5238	190	0.6742	0.5144	0.6742	0.8211
No log	4.5714	192	0.5810	0.5379	0.5810	0.7622
No log	4.6190	194	0.5597	0.4314	0.5597	0.7481
No log	4.6667	196	0.5809	0.3919	0.5809	0.7622
No log	4.7143	198	0.5981	0.3673	0.5981	0.7734
No log	4.7619	200	0.5800	0.3919	0.5800	0.7615
No log	4.8095	202	0.5685	0.5521	0.5685	0.7540
No log	4.8571	204	0.7836	0.3783	0.7836	0.8852
No log	4.9048	206	1.0410	0.1730	1.0410	1.0203
No log	4.9524	208	0.9276	0.2826	0.9276	0.9631
No log	5.0	210	0.6443	0.4756	0.6443	0.8027
No log	5.0476	212	0.5858	0.4243	0.5858	0.7654
No log	5.0952	214	0.6006	0.4076	0.6006	0.7750
No log	5.1429	216	0.5667	0.5133	0.5667	0.7528
No log	5.1905	218	0.6554	0.4237	0.6554	0.8096
No log	5.2381	220	0.8593	0.2873	0.8593	0.9270
No log	5.2857	222	0.9443	0.2873	0.9443	0.9717
No log	5.3333	224	0.8556	0.2603	0.8556	0.9250
No log	5.3810	226	0.7030	0.3615	0.7030	0.8385
No log	5.4286	228	0.6094	0.4938	0.6094	0.7806
No log	5.4762	230	0.6089	0.5246	0.6089	0.7803
No log	5.5238	232	0.6603	0.4028	0.6603	0.8126
No log	5.5714	234	0.8332	0.2910	0.8332	0.9128
No log	5.6190	236	0.8917	0.2958	0.8917	0.9443
No log	5.6667	238	0.7607	0.3263	0.7607	0.8722
No log	5.7143	240	0.6227	0.3530	0.6227	0.7891
No log	5.7619	242	0.7608	0.3913	0.7608	0.8723
No log	5.8095	244	0.9182	0.3577	0.9182	0.9582
No log	5.8571	246	0.8469	0.3887	0.8469	0.9203
No log	5.9048	248	0.6811	0.3819	0.6811	0.8253
No log	5.9524	250	0.6113	0.4199	0.6113	0.7818
No log	6.0	252	0.6352	0.3509	0.6352	0.7970
No log	6.0476	254	0.6361	0.3509	0.6361	0.7976
No log	6.0952	256	0.6223	0.4299	0.6223	0.7888
No log	6.1429	258	0.6708	0.4020	0.6708	0.8190
No log	6.1905	260	0.7724	0.4315	0.7724	0.8788
No log	6.2381	262	0.7552	0.4315	0.7552	0.8690
No log	6.2857	264	0.6869	0.4263	0.6869	0.8288
No log	6.3333	266	0.6177	0.4438	0.6177	0.7860
No log	6.3810	268	0.6450	0.4499	0.6450	0.8031
No log	6.4286	270	0.6788	0.3533	0.6788	0.8239
No log	6.4762	272	0.6259	0.4614	0.6259	0.7911
No log	6.5238	274	0.5859	0.5171	0.5859	0.7655
No log	6.5714	276	0.5701	0.5430	0.5701	0.7550
No log	6.6190	278	0.5560	0.5800	0.5560	0.7457
No log	6.6667	280	0.5575	0.4938	0.5575	0.7467
No log	6.7143	282	0.5889	0.4249	0.5889	0.7674
No log	6.7619	284	0.6300	0.3925	0.6300	0.7938
No log	6.8095	286	0.5774	0.4391	0.5774	0.7599
No log	6.8571	288	0.5915	0.4575	0.5915	0.7691
No log	6.9048	290	0.7451	0.3638	0.7451	0.8632
No log	6.9524	292	0.8678	0.3376	0.8678	0.9316
No log	7.0	294	0.7731	0.3151	0.7731	0.8793
No log	7.0476	296	0.5688	0.4977	0.5688	0.7542
No log	7.0952	298	0.5341	0.5732	0.5341	0.7308
No log	7.1429	300	0.5851	0.4597	0.5851	0.7649
No log	7.1905	302	0.5848	0.4618	0.5848	0.7647
No log	7.2381	304	0.5553	0.4526	0.5553	0.7452
No log	7.2857	306	0.5543	0.4904	0.5543	0.7445
No log	7.3333	308	0.5526	0.4776	0.5526	0.7434
No log	7.3810	310	0.5499	0.5846	0.5499	0.7416
No log	7.4286	312	0.5441	0.5812	0.5441	0.7376
No log	7.4762	314	0.5371	0.5523	0.5371	0.7329
No log	7.5238	316	0.5679	0.5212	0.5679	0.7536
No log	7.5714	318	0.6526	0.4652	0.6526	0.8079
No log	7.6190	320	0.7543	0.3783	0.7543	0.8685
No log	7.6667	322	0.7928	0.3516	0.7928	0.8904
No log	7.7143	324	0.7360	0.3140	0.7360	0.8579
No log	7.7619	326	0.6307	0.3719	0.6307	0.7942
No log	7.8095	328	0.5917	0.3633	0.5917	0.7692
No log	7.8571	330	0.5930	0.3633	0.5930	0.7701
No log	7.9048	332	0.5932	0.3633	0.5932	0.7702
No log	7.9524	334	0.5977	0.3947	0.5977	0.7731
No log	8.0	336	0.5952	0.3920	0.5952	0.7715
No log	8.0476	338	0.5944	0.3474	0.5944	0.7709
No log	8.0952	340	0.5861	0.4515	0.5861	0.7656
No log	8.1429	342	0.6069	0.4116	0.6069	0.7790
No log	8.1905	344	0.6312	0.3804	0.6312	0.7945
No log	8.2381	346	0.6026	0.3911	0.6026	0.7763
No log	8.2857	348	0.5693	0.4538	0.5693	0.7545
No log	8.3333	350	0.5855	0.4707	0.5855	0.7652
No log	8.3810	352	0.5817	0.4707	0.5817	0.7627
No log	8.4286	354	0.5473	0.5024	0.5473	0.7398
No log	8.4762	356	0.5725	0.4174	0.5725	0.7566
No log	8.5238	358	0.6081	0.4468	0.6081	0.7798
No log	8.5714	360	0.5956	0.4109	0.5956	0.7717
No log	8.6190	362	0.5436	0.4486	0.5436	0.7373
No log	8.6667	364	0.5131	0.4918	0.5131	0.7163
No log	8.7143	366	0.4972	0.4724	0.4972	0.7051
No log	8.7619	368	0.4933	0.5765	0.4933	0.7024
No log	8.8095	370	0.4938	0.4782	0.4938	0.7027
No log	8.8571	372	0.5007	0.4838	0.5007	0.7076
No log	8.9048	374	0.4914	0.5021	0.4914	0.7010
No log	8.9524	376	0.4890	0.5457	0.4890	0.6993
No log	9.0	378	0.4886	0.5457	0.4886	0.6990
No log	9.0476	380	0.4838	0.5457	0.4838	0.6956
No log	9.0952	382	0.4848	0.5475	0.4848	0.6963
No log	9.1429	384	0.5252	0.5208	0.5252	0.7247
No log	9.1905	386	0.5306	0.5050	0.5306	0.7285
No log	9.2381	388	0.5014	0.5343	0.5014	0.7081
No log	9.2857	390	0.4861	0.5305	0.4861	0.6972
No log	9.3333	392	0.4786	0.5475	0.4786	0.6918
No log	9.3810	394	0.4807	0.5246	0.4807	0.6933
No log	9.4286	396	0.5168	0.5527	0.5168	0.7189
No log	9.4762	398	0.5288	0.5527	0.5288	0.7272
No log	9.5238	400	0.5078	0.4938	0.5078	0.7126
No log	9.5714	402	0.4988	0.4471	0.4988	0.7063
No log	9.6190	404	0.5047	0.4677	0.5047	0.7104
No log	9.6667	406	0.5125	0.4938	0.5125	0.7159
No log	9.7143	408	0.5047	0.4677	0.5047	0.7104
No log	9.7619	410	0.5095	0.4677	0.5095	0.7138
No log	9.8095	412	0.5024	0.4677	0.5024	0.7088
No log	9.8571	414	0.5109	0.5432	0.5109	0.7147
No log	9.9048	416	0.5158	0.5432	0.5158	0.7182
No log	9.9524	418	0.5472	0.5300	0.5472	0.7397
No log	10.0	420	0.6086	0.4100	0.6086	0.7801
No log	10.0476	422	0.6519	0.3493	0.6519	0.8074
No log	10.0952	424	0.5769	0.5083	0.5769	0.7596
No log	10.1429	426	0.5136	0.5246	0.5136	0.7166
No log	10.1905	428	0.5065	0.5396	0.5065	0.7117
No log	10.2381	430	0.5057	0.5883	0.5057	0.7111
No log	10.2857	432	0.5028	0.5457	0.5028	0.7091
No log	10.3333	434	0.5303	0.5414	0.5303	0.7282
No log	10.3810	436	0.5414	0.5189	0.5414	0.7358
No log	10.4286	438	0.5303	0.4938	0.5303	0.7282
No log	10.4762	440	0.5276	0.4918	0.5276	0.7263
No log	10.5238	442	0.5285	0.5539	0.5285	0.7270
No log	10.5714	444	0.5259	0.6321	0.5259	0.7252
No log	10.6190	446	0.5204	0.5631	0.5204	0.7214
No log	10.6667	448	0.5143	0.5488	0.5143	0.7172
No log	10.7143	450	0.5157	0.5324	0.5157	0.7181
No log	10.7619	452	0.5136	0.5065	0.5136	0.7167
No log	10.8095	454	0.5169	0.5574	0.5169	0.7189
No log	10.8571	456	0.5141	0.5065	0.5141	0.7170
No log	10.9048	458	0.5174	0.5801	0.5174	0.7193
No log	10.9524	460	0.5365	0.5266	0.5365	0.7324
No log	11.0	462	0.5509	0.4357	0.5509	0.7422
No log	11.0476	464	0.5582	0.3688	0.5582	0.7472
No log	11.0952	466	0.5631	0.3688	0.5631	0.7504
No log	11.1429	468	0.5678	0.3688	0.5678	0.7536
No log	11.1905	470	0.5865	0.4855	0.5865	0.7658
No log	11.2381	472	0.6268	0.4979	0.6268	0.7917
No log	11.2857	474	0.6296	0.5042	0.6296	0.7935
No log	11.3333	476	0.5735	0.4997	0.5735	0.7573
No log	11.3810	478	0.5464	0.4703	0.5464	0.7392
No log	11.4286	480	0.5481	0.4186	0.5481	0.7403
No log	11.4762	482	0.5513	0.4126	0.5513	0.7425
No log	11.5238	484	0.5451	0.4249	0.5451	0.7383
No log	11.5714	486	0.5402	0.4249	0.5402	0.7350
No log	11.6190	488	0.5411	0.4186	0.5411	0.7356
No log	11.6667	490	0.5705	0.4548	0.5705	0.7553
No log	11.7143	492	0.5856	0.3536	0.5856	0.7653
No log	11.7619	494	0.5690	0.3860	0.5690	0.7543
No log	11.8095	496	0.5528	0.4186	0.5528	0.7435
No log	11.8571	498	0.5501	0.4126	0.5501	0.7417
0.3415	11.9048	500	0.5575	0.3860	0.5575	0.7466
0.3415	11.9524	502	0.5394	0.4186	0.5394	0.7344
0.3415	12.0	504	0.5332	0.5182	0.5332	0.7302
0.3415	12.0476	506	0.5395	0.4780	0.5395	0.7345
0.3415	12.0952	508	0.5440	0.4780	0.5440	0.7376
0.3415	12.1429	510	0.5326	0.4983	0.5326	0.7298
0.3415	12.1905	512	0.5209	0.4949	0.5209	0.7217
0.3415	12.2381	514	0.5227	0.5208	0.5227	0.7230
0.3415	12.2857	516	0.5230	0.4857	0.5230	0.7232
0.3415	12.3333	518	0.5345	0.4747	0.5345	0.7311
0.3415	12.3810	520	0.5532	0.5437	0.5532	0.7438
0.3415	12.4286	522	0.5517	0.5150	0.5517	0.7428
0.3415	12.4762	524	0.5510	0.4441	0.5510	0.7423
0.3415	12.5238	526	0.6139	0.4969	0.6139	0.7835
0.3415	12.5714	528	0.6168	0.5031	0.6168	0.7854
0.3415	12.6190	530	0.5732	0.4935	0.5732	0.7571
0.3415	12.6667	532	0.5336	0.5171	0.5336	0.7305
0.3415	12.7143	534	0.5310	0.4746	0.5310	0.7287
0.3415	12.7619	536	0.5346	0.4471	0.5346	0.7312
0.3415	12.8095	538	0.5401	0.4471	0.5401	0.7349
0.3415	12.8571	540	0.5661	0.5117	0.5661	0.7524
0.3415	12.9048	542	0.6092	0.4694	0.6092	0.7805
0.3415	12.9524	544	0.6158	0.4756	0.6158	0.7847
0.3415	13.0	546	0.6079	0.4698	0.6079	0.7797
0.3415	13.0476	548	0.5910	0.4126	0.5910	0.7687
0.3415	13.0952	550	0.5807	0.4007	0.5807	0.7620
0.3415	13.1429	552	0.5875	0.3980	0.5875	0.7665
0.3415	13.1905	554	0.5876	0.3980	0.5876	0.7666
0.3415	13.2381	556	0.5822	0.4289	0.5822	0.7630
0.3415	13.2857	558	0.5791	0.4161	0.5791	0.7610
0.3415	13.3333	560	0.5796	0.4101	0.5796	0.7613
0.3415	13.3810	562	0.5866	0.3435	0.5866	0.7659
0.3415	13.4286	564	0.5843	0.4101	0.5843	0.7644
0.3415	13.4762	566	0.5819	0.4468	0.5819	0.7628
0.3415	13.5238	568	0.6093	0.4437	0.6093	0.7806
0.3415	13.5714	570	0.6418	0.4134	0.6418	0.8011
0.3415	13.6190	572	0.6475	0.4052	0.6475	0.8047
0.3415	13.6667	574	0.6220	0.3868	0.6220	0.7887
0.3415	13.7143	576	0.5976	0.4524	0.5976	0.7731
0.3415	13.7619	578	0.5948	0.3478	0.5948	0.7712
0.3415	13.8095	580	0.5911	0.4077	0.5911	0.7688
0.3415	13.8571	582	0.6082	0.3988	0.6082	0.7798
0.3415	13.9048	584	0.6341	0.3607	0.6341	0.7963
0.3415	13.9524	586	0.6402	0.3320	0.6402	0.8001
0.3415	14.0	588	0.6265	0.3502	0.6265	0.7915
0.3415	14.0476	590	0.6216	0.2413	0.6216	0.7884
0.3415	14.0952	592	0.6249	0.2819	0.6249	0.7905

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1