ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0330
• Qwk: 0.5815
• Mse: 1.0330
• Rmse: 1.0164

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0364	2	5.3622	-0.0006	5.3622	2.3156
No log	0.0727	4	3.2600	0.0737	3.2600	1.8056
No log	0.1091	6	2.5120	-0.1243	2.5120	1.5849
No log	0.1455	8	2.3548	-0.1381	2.3548	1.5345
No log	0.1818	10	1.5075	0.0372	1.5075	1.2278
No log	0.2182	12	1.2224	0.1997	1.2224	1.1056
No log	0.2545	14	1.3245	0.1635	1.3245	1.1509
No log	0.2909	16	1.6829	0.0039	1.6829	1.2973
No log	0.3273	18	1.5802	-0.0141	1.5802	1.2571
No log	0.3636	20	1.3691	0.1401	1.3691	1.1701
No log	0.4	22	1.2826	0.1521	1.2826	1.1325
No log	0.4364	24	1.2785	0.0787	1.2785	1.1307
No log	0.4727	26	1.2442	0.0647	1.2442	1.1154
No log	0.5091	28	1.2643	0.2216	1.2643	1.1244
No log	0.5455	30	1.2967	0.1976	1.2967	1.1387
No log	0.5818	32	1.2625	0.1836	1.2625	1.1236
No log	0.6182	34	1.1363	0.2884	1.1363	1.0660
No log	0.6545	36	1.1256	0.3072	1.1256	1.0610
No log	0.6909	38	1.0826	0.1684	1.0826	1.0405
No log	0.7273	40	1.0691	0.1752	1.0691	1.0340
No log	0.7636	42	1.1457	0.2868	1.1457	1.0704
No log	0.8	44	1.4510	0.3051	1.4510	1.2046
No log	0.8364	46	1.5250	0.2883	1.5250	1.2349
No log	0.8727	48	1.2403	0.2831	1.2403	1.1137
No log	0.9091	50	1.1315	0.3001	1.1315	1.0637
No log	0.9455	52	1.2196	0.3078	1.2196	1.1044
No log	0.9818	54	1.1068	0.2705	1.1068	1.0520
No log	1.0182	56	0.9907	0.3849	0.9907	0.9953
No log	1.0545	58	1.0587	0.3146	1.0587	1.0289
No log	1.0909	60	1.1572	0.2588	1.1572	1.0757
No log	1.1273	62	1.0643	0.3434	1.0643	1.0317
No log	1.1636	64	1.1462	0.3221	1.1462	1.0706
No log	1.2	66	1.5910	0.1290	1.5910	1.2613
No log	1.2364	68	1.7602	-0.0134	1.7602	1.3267
No log	1.2727	70	1.6053	0.0503	1.6053	1.2670
No log	1.3091	72	1.4838	0.0675	1.4838	1.2181
No log	1.3455	74	1.2936	0.2500	1.2936	1.1374
No log	1.3818	76	1.2985	0.2586	1.2985	1.1395
No log	1.4182	78	1.4790	0.1117	1.4790	1.2161
No log	1.4545	80	1.4791	0.1274	1.4791	1.2162
No log	1.4909	82	1.2908	0.2474	1.2908	1.1361
No log	1.5273	84	1.0250	0.3906	1.0250	1.0124
No log	1.5636	86	0.9276	0.4158	0.9276	0.9631
No log	1.6	88	0.9150	0.4377	0.9150	0.9566
No log	1.6364	90	0.9334	0.5301	0.9334	0.9661
No log	1.6727	92	1.1165	0.4765	1.1165	1.0567
No log	1.7091	94	1.4586	0.3547	1.4586	1.2077
No log	1.7455	96	1.3908	0.3713	1.3908	1.1793
No log	1.7818	98	1.1121	0.4810	1.1121	1.0545
No log	1.8182	100	1.1628	0.4375	1.1628	1.0784
No log	1.8545	102	1.1647	0.4415	1.1647	1.0792
No log	1.8909	104	1.1769	0.4229	1.1769	1.0848
No log	1.9273	106	1.1601	0.4415	1.1601	1.0771
No log	1.9636	108	1.0714	0.4643	1.0714	1.0351
No log	2.0	110	1.1357	0.4432	1.1357	1.0657
No log	2.0364	112	1.1798	0.4653	1.1798	1.0862
No log	2.0727	114	1.4438	0.3508	1.4438	1.2016
No log	2.1091	116	1.5307	0.3211	1.5307	1.2372
No log	2.1455	118	1.3424	0.3759	1.3424	1.1586
No log	2.1818	120	1.1184	0.5019	1.1184	1.0576
No log	2.2182	122	1.0220	0.5482	1.0220	1.0109
No log	2.2545	124	1.0586	0.5160	1.0586	1.0289
No log	2.2909	126	1.1637	0.4501	1.1637	1.0787
No log	2.3273	128	1.1234	0.4702	1.1234	1.0599
No log	2.3636	130	1.0173	0.5204	1.0173	1.0086
No log	2.4	132	0.9464	0.5593	0.9464	0.9728
No log	2.4364	134	1.0559	0.5153	1.0559	1.0276
No log	2.4727	136	1.3553	0.4529	1.3553	1.1642
No log	2.5091	138	1.4799	0.4440	1.4799	1.2165
No log	2.5455	140	1.4154	0.4610	1.4154	1.1897
No log	2.5818	142	1.2899	0.4715	1.2899	1.1357
No log	2.6182	144	1.3989	0.4065	1.3989	1.1828
No log	2.6545	146	1.4616	0.3408	1.4616	1.2090
No log	2.6909	148	1.5122	0.2467	1.5122	1.2297
No log	2.7273	150	1.3498	0.1922	1.3498	1.1618
No log	2.7636	152	1.1781	0.2064	1.1781	1.0854
No log	2.8	154	1.1291	0.3149	1.1291	1.0626
No log	2.8364	156	1.1230	0.4021	1.1230	1.0597
No log	2.8727	158	1.0835	0.4189	1.0835	1.0409
No log	2.9091	160	1.1286	0.2670	1.1286	1.0624
No log	2.9455	162	1.2616	0.2095	1.2616	1.1232
No log	2.9818	164	1.3791	0.3315	1.3791	1.1743
No log	3.0182	166	1.3995	0.3713	1.3995	1.1830
No log	3.0545	168	1.3103	0.4084	1.3103	1.1447
No log	3.0909	170	1.3022	0.4084	1.3022	1.1411
No log	3.1273	172	1.3057	0.4291	1.3057	1.1427
No log	3.1636	174	1.3078	0.4240	1.3078	1.1436
No log	3.2	176	1.3126	0.3997	1.3126	1.1457
No log	3.2364	178	1.1818	0.4417	1.1818	1.0871
No log	3.2727	180	0.9496	0.5522	0.9496	0.9745
No log	3.3091	182	0.8768	0.5770	0.8768	0.9364
No log	3.3455	184	0.9280	0.5485	0.9280	0.9633
No log	3.3818	186	1.0055	0.5364	1.0055	1.0028
No log	3.4182	188	0.9258	0.5546	0.9258	0.9622
No log	3.4545	190	0.9137	0.5570	0.9137	0.9559
No log	3.4909	192	0.9725	0.5117	0.9725	0.9861
No log	3.5273	194	0.9469	0.4992	0.9469	0.9731
No log	3.5636	196	0.8717	0.4834	0.8717	0.9336
No log	3.6	198	0.8847	0.4834	0.8847	0.9406
No log	3.6364	200	0.8621	0.5758	0.8621	0.9285
No log	3.6727	202	0.8483	0.5616	0.8483	0.9210
No log	3.7091	204	0.8626	0.5559	0.8626	0.9287
No log	3.7455	206	0.8942	0.5174	0.8942	0.9456
No log	3.7818	208	0.8458	0.5516	0.8458	0.9196
No log	3.8182	210	0.8306	0.5312	0.8306	0.9114
No log	3.8545	212	0.8518	0.5253	0.8518	0.9229
No log	3.8909	214	0.9164	0.5036	0.9164	0.9573
No log	3.9273	216	0.8871	0.52	0.8871	0.9418
No log	3.9636	218	0.8838	0.5444	0.8838	0.9401
No log	4.0	220	0.9063	0.5228	0.9063	0.9520
No log	4.0364	222	0.9707	0.5058	0.9707	0.9852
No log	4.0727	224	0.9590	0.4785	0.9590	0.9793
No log	4.1091	226	0.8862	0.5131	0.8862	0.9414
No log	4.1455	228	0.8574	0.5074	0.8574	0.9260
No log	4.1818	230	0.8248	0.5313	0.8248	0.9082
No log	4.2182	232	0.8363	0.5577	0.8363	0.9145
No log	4.2545	234	0.8312	0.5504	0.8312	0.9117
No log	4.2909	236	0.7621	0.5695	0.7621	0.8730
No log	4.3273	238	0.7332	0.5753	0.7332	0.8563
No log	4.3636	240	0.7088	0.6171	0.7088	0.8419
No log	4.4	242	0.7230	0.6337	0.7230	0.8503
No log	4.4364	244	0.7405	0.5997	0.7405	0.8605
No log	4.4727	246	0.8064	0.5795	0.8064	0.8980
No log	4.5091	248	0.9606	0.5667	0.9606	0.9801
No log	4.5455	250	1.2212	0.4583	1.2212	1.1051
No log	4.5818	252	1.3419	0.4247	1.3419	1.1584
No log	4.6182	254	1.1874	0.4961	1.1874	1.0897
No log	4.6545	256	0.9369	0.5438	0.9369	0.9679
No log	4.6909	258	0.8644	0.6068	0.8644	0.9297
No log	4.7273	260	0.8966	0.5992	0.8966	0.9469
No log	4.7636	262	1.0720	0.5178	1.0720	1.0354
No log	4.8	264	1.1876	0.4879	1.1876	1.0898
No log	4.8364	266	1.1435	0.4952	1.1435	1.0693
No log	4.8727	268	0.9874	0.5170	0.9874	0.9937
No log	4.9091	270	0.8312	0.5696	0.8312	0.9117
No log	4.9455	272	0.7984	0.5925	0.7984	0.8936
No log	4.9818	274	0.8212	0.5927	0.8212	0.9062
No log	5.0182	276	0.8244	0.5767	0.8244	0.9080
No log	5.0545	278	0.8381	0.5607	0.8381	0.9155
No log	5.0909	280	0.8497	0.5794	0.8497	0.9218
No log	5.1273	282	0.8080	0.6083	0.8080	0.8989
No log	5.1636	284	0.7447	0.6493	0.7447	0.8630
No log	5.2	286	0.7435	0.6598	0.7435	0.8623
No log	5.2364	288	0.7435	0.6632	0.7435	0.8623
No log	5.2727	290	0.7921	0.6295	0.7921	0.8900
No log	5.3091	292	0.8407	0.6013	0.8407	0.9169
No log	5.3455	294	0.8306	0.5757	0.8306	0.9113
No log	5.3818	296	0.8613	0.5892	0.8613	0.9281
No log	5.4182	298	0.9025	0.5810	0.9025	0.9500
No log	5.4545	300	0.9056	0.5771	0.9056	0.9516
No log	5.4909	302	0.8559	0.6014	0.8559	0.9251
No log	5.5273	304	0.9714	0.5935	0.9714	0.9856
No log	5.5636	306	1.1078	0.5543	1.1078	1.0525
No log	5.6	308	1.0884	0.5310	1.0884	1.0433
No log	5.6364	310	0.9759	0.5756	0.9759	0.9879
No log	5.6727	312	0.9850	0.5744	0.9850	0.9925
No log	5.7091	314	1.0878	0.5205	1.0878	1.0430
No log	5.7455	316	1.0276	0.5400	1.0276	1.0137
No log	5.7818	318	0.9061	0.6017	0.9061	0.9519
No log	5.8182	320	0.8876	0.6129	0.8876	0.9421
No log	5.8545	322	0.8471	0.5997	0.8471	0.9204
No log	5.8909	324	0.8852	0.6019	0.8852	0.9409
No log	5.9273	326	1.1561	0.5377	1.1561	1.0752
No log	5.9636	328	1.4811	0.4949	1.4811	1.2170
No log	6.0	330	1.4556	0.4896	1.4556	1.2065
No log	6.0364	332	1.1965	0.5484	1.1965	1.0938
No log	6.0727	334	0.9236	0.5742	0.9236	0.9611
No log	6.1091	336	0.7371	0.5961	0.7371	0.8586
No log	6.1455	338	0.7172	0.5753	0.7172	0.8469
No log	6.1818	340	0.7443	0.5919	0.7443	0.8627
No log	6.2182	342	0.8471	0.6074	0.8471	0.9204
No log	6.2545	344	1.0248	0.5548	1.0248	1.0123
No log	6.2909	346	1.0894	0.5486	1.0894	1.0437
No log	6.3273	348	0.9790	0.5309	0.9790	0.9895
No log	6.3636	350	0.9281	0.5422	0.9281	0.9634
No log	6.4	352	0.9117	0.5422	0.9117	0.9548
No log	6.4364	354	0.9826	0.5379	0.9826	0.9913
No log	6.4727	356	1.0251	0.5287	1.0251	1.0125
No log	6.5091	358	0.9223	0.5552	0.9223	0.9603
No log	6.5455	360	0.7912	0.6196	0.7912	0.8895
No log	6.5818	362	0.7289	0.6443	0.7289	0.8537
No log	6.6182	364	0.7011	0.6482	0.7011	0.8373
No log	6.6545	366	0.7256	0.6302	0.7256	0.8518
No log	6.6909	368	0.8200	0.6100	0.8200	0.9055
No log	6.7273	370	0.9069	0.5669	0.9069	0.9523
No log	6.7636	372	0.8795	0.5618	0.8795	0.9378
No log	6.8	374	0.8819	0.6173	0.8819	0.9391
No log	6.8364	376	0.8779	0.5959	0.8779	0.9370
No log	6.8727	378	0.7921	0.6077	0.7921	0.8900
No log	6.9091	380	0.7058	0.6395	0.7058	0.8401
No log	6.9455	382	0.6887	0.6569	0.6887	0.8299
No log	6.9818	384	0.7037	0.6339	0.7037	0.8389
No log	7.0182	386	0.8033	0.6030	0.8033	0.8963
No log	7.0545	388	0.8614	0.5713	0.8614	0.9281
No log	7.0909	390	0.8837	0.5576	0.8837	0.9401
No log	7.1273	392	0.9004	0.5591	0.9004	0.9489
No log	7.1636	394	0.8685	0.5835	0.8685	0.9319
No log	7.2	396	0.8258	0.5797	0.8258	0.9087
No log	7.2364	398	0.8454	0.5584	0.8454	0.9195
No log	7.2727	400	0.9590	0.5360	0.9590	0.9793
No log	7.3091	402	1.0059	0.5390	1.0059	1.0030
No log	7.3455	404	0.9490	0.5414	0.9490	0.9741
No log	7.3818	406	0.8466	0.5950	0.8466	0.9201
No log	7.4182	408	0.7700	0.5711	0.7700	0.8775
No log	7.4545	410	0.7778	0.6128	0.7778	0.8819
No log	7.4909	412	0.8316	0.6237	0.8316	0.9119
No log	7.5273	414	0.8176	0.6183	0.8176	0.9042
No log	7.5636	416	0.7353	0.6397	0.7353	0.8575
No log	7.6	418	0.6911	0.6219	0.6911	0.8313
No log	7.6364	420	0.6832	0.6671	0.6832	0.8266
No log	7.6727	422	0.7111	0.6717	0.7111	0.8433
No log	7.7091	424	0.8624	0.6034	0.8624	0.9287
No log	7.7455	426	0.9782	0.5778	0.9782	0.9890
No log	7.7818	428	0.9174	0.6210	0.9174	0.9578
No log	7.8182	430	0.7669	0.6460	0.7669	0.8757
No log	7.8545	432	0.7343	0.6581	0.7343	0.8569
No log	7.8909	434	0.7338	0.6610	0.7338	0.8566
No log	7.9273	436	0.8027	0.6271	0.8027	0.8959
No log	7.9636	438	0.9712	0.5496	0.9712	0.9855
No log	8.0	440	1.0274	0.5423	1.0274	1.0136
No log	8.0364	442	0.9973	0.5434	0.9973	0.9986
No log	8.0727	444	0.9342	0.5640	0.9342	0.9665
No log	8.1091	446	0.8073	0.6225	0.8073	0.8985
No log	8.1455	448	0.7697	0.6545	0.7697	0.8773
No log	8.1818	450	0.7889	0.6223	0.7889	0.8882
No log	8.2182	452	0.8693	0.5968	0.8693	0.9324
No log	8.2545	454	0.8967	0.5562	0.8967	0.9469
No log	8.2909	456	0.9411	0.5510	0.9411	0.9701
No log	8.3273	458	0.9057	0.5521	0.9057	0.9517
No log	8.3636	460	0.8442	0.6142	0.8442	0.9188
No log	8.4	462	0.8041	0.6112	0.8041	0.8967
No log	8.4364	464	0.8647	0.6010	0.8647	0.9299
No log	8.4727	466	1.0197	0.5264	1.0197	1.0098
No log	8.5091	468	1.0774	0.5255	1.0774	1.0380
No log	8.5455	470	0.9860	0.5235	0.9860	0.9930
No log	8.5818	472	0.9379	0.5743	0.9379	0.9684
No log	8.6182	474	0.9402	0.5704	0.9402	0.9697
No log	8.6545	476	0.9819	0.5356	0.9819	0.9909
No log	8.6909	478	1.1399	0.5135	1.1399	1.0677
No log	8.7273	480	1.2692	0.4933	1.2692	1.1266
No log	8.7636	482	1.3254	0.5049	1.3254	1.1513
No log	8.8	484	1.1676	0.5120	1.1676	1.0806
No log	8.8364	486	1.0589	0.5310	1.0589	1.0290
No log	8.8727	488	1.0133	0.5416	1.0133	1.0066
No log	8.9091	490	0.9934	0.5454	0.9934	0.9967
No log	8.9455	492	0.9287	0.5677	0.9287	0.9637
No log	8.9818	494	0.9592	0.5667	0.9592	0.9794
No log	9.0182	496	1.0300	0.5579	1.0300	1.0149
No log	9.0545	498	1.0190	0.5809	1.0190	1.0094
0.4346	9.0909	500	0.8953	0.6068	0.8953	0.9462
0.4346	9.1273	502	0.8707	0.6098	0.8707	0.9331
0.4346	9.1636	504	0.9576	0.5981	0.9576	0.9786
0.4346	9.2	506	1.1589	0.5497	1.1589	1.0765
0.4346	9.2364	508	1.2418	0.5267	1.2418	1.1143
0.4346	9.2727	510	1.1357	0.5442	1.1357	1.0657
0.4346	9.3091	512	1.0330	0.5815	1.0330	1.0164

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1