ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7607
• Qwk: 0.6347
• Mse: 0.7607
• Rmse: 0.8722

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.05	2	5.1299	-0.0107	5.1299	2.2649
No log	0.1	4	3.1154	0.0510	3.1154	1.7650
No log	0.15	6	1.9124	0.1038	1.9124	1.3829
No log	0.2	8	2.0576	0.0431	2.0576	1.4344
No log	0.25	10	1.7142	0.0228	1.7142	1.3093
No log	0.3	12	1.1958	0.2872	1.1958	1.0935
No log	0.35	14	1.2441	0.2863	1.2441	1.1154
No log	0.4	16	1.3285	0.1459	1.3285	1.1526
No log	0.45	18	1.3651	0.0504	1.3651	1.1684
No log	0.5	20	1.3390	0.1622	1.3390	1.1572
No log	0.55	22	1.3192	0.2055	1.3192	1.1486
No log	0.6	24	1.3014	0.1730	1.3014	1.1408
No log	0.65	26	1.2212	0.3107	1.2212	1.1051
No log	0.7	28	1.1430	0.2567	1.1430	1.0691
No log	0.75	30	1.1264	0.1634	1.1264	1.0613
No log	0.8	32	1.1149	0.1721	1.1149	1.0559
No log	0.85	34	1.1189	0.3375	1.1189	1.0578
No log	0.9	36	1.1392	0.3595	1.1392	1.0673
No log	0.95	38	1.1294	0.4076	1.1294	1.0627
No log	1.0	40	1.0943	0.4052	1.0943	1.0461
No log	1.05	42	1.0542	0.4462	1.0542	1.0267
No log	1.1	44	1.0232	0.3982	1.0232	1.0115
No log	1.15	46	1.0169	0.4317	1.0169	1.0084
No log	1.2	48	1.0082	0.3427	1.0082	1.0041
No log	1.25	50	1.0944	0.2525	1.0944	1.0461
No log	1.3	52	1.0933	0.3066	1.0933	1.0456
No log	1.35	54	0.8643	0.4531	0.8643	0.9297
No log	1.4	56	0.8862	0.4410	0.8862	0.9414
No log	1.45	58	0.8895	0.4874	0.8895	0.9431
No log	1.5	60	0.8301	0.4735	0.8301	0.9111
No log	1.55	62	0.9961	0.4419	0.9961	0.9981
No log	1.6	64	1.0241	0.4504	1.0241	1.0120
No log	1.65	66	0.8689	0.5863	0.8689	0.9321
No log	1.7	68	0.8216	0.5725	0.8216	0.9064
No log	1.75	70	0.8915	0.5622	0.8915	0.9442
No log	1.8	72	0.8538	0.6027	0.8538	0.9240
No log	1.85	74	0.8398	0.5767	0.8398	0.9164
No log	1.9	76	0.8704	0.5710	0.8704	0.9330
No log	1.95	78	0.8377	0.6146	0.8377	0.9152
No log	2.0	80	0.8864	0.6152	0.8864	0.9415
No log	2.05	82	0.9340	0.5911	0.9340	0.9664
No log	2.1	84	1.0497	0.5437	1.0497	1.0245
No log	2.15	86	0.9529	0.5718	0.9529	0.9762
No log	2.2	88	0.7704	0.6391	0.7704	0.8777
No log	2.25	90	0.7241	0.6375	0.7241	0.8509
No log	2.3	92	0.7395	0.6424	0.7395	0.8600
No log	2.35	94	0.8024	0.6405	0.8024	0.8958
No log	2.4	96	0.7863	0.6531	0.7863	0.8867
No log	2.45	98	0.8938	0.6069	0.8938	0.9454
No log	2.5	100	0.9148	0.5591	0.9148	0.9564
No log	2.55	102	0.7898	0.6018	0.7898	0.8887
No log	2.6	104	0.7593	0.5850	0.7593	0.8714
No log	2.65	106	0.7608	0.5804	0.7608	0.8722
No log	2.7	108	0.7714	0.6162	0.7714	0.8783
No log	2.75	110	0.7591	0.6354	0.7591	0.8713
No log	2.8	112	0.7536	0.6396	0.7536	0.8681
No log	2.85	114	0.7201	0.6708	0.7201	0.8486
No log	2.9	116	0.8632	0.6181	0.8632	0.9291
No log	2.95	118	0.9276	0.6006	0.9276	0.9631
No log	3.0	120	0.8035	0.6406	0.8035	0.8964
No log	3.05	122	0.6876	0.6649	0.6876	0.8292
No log	3.1	124	0.7767	0.5682	0.7767	0.8813
No log	3.15	126	0.7600	0.5844	0.7600	0.8718
No log	3.2	128	0.7230	0.5993	0.7230	0.8503
No log	3.25	130	0.7286	0.5811	0.7286	0.8536
No log	3.3	132	0.7028	0.5977	0.7028	0.8383
No log	3.35	134	0.8360	0.5870	0.8360	0.9143
No log	3.4	136	0.8016	0.5695	0.8016	0.8953
No log	3.45	138	0.7160	0.6389	0.7160	0.8462
No log	3.5	140	0.8008	0.6266	0.8008	0.8949
No log	3.55	142	0.8649	0.6095	0.8649	0.9300
No log	3.6	144	0.8734	0.625	0.8734	0.9346
No log	3.65	146	0.9998	0.5731	0.9998	0.9999
No log	3.7	148	1.2754	0.4343	1.2754	1.1293
No log	3.75	150	1.1438	0.4751	1.1438	1.0695
No log	3.8	152	0.9108	0.5339	0.9108	0.9544
No log	3.85	154	0.8080	0.4781	0.8080	0.8989
No log	3.9	156	0.8090	0.5127	0.8090	0.8995
No log	3.95	158	0.8011	0.4975	0.8011	0.8950
No log	4.0	160	0.8182	0.4433	0.8182	0.9045
No log	4.05	162	0.8245	0.4925	0.8245	0.9080
No log	4.1	164	0.7671	0.5327	0.7671	0.8758
No log	4.15	166	0.6897	0.6529	0.6897	0.8305
No log	4.2	168	0.6344	0.6796	0.6344	0.7965
No log	4.25	170	0.6588	0.7053	0.6588	0.8117
No log	4.3	172	0.7527	0.6935	0.7527	0.8676
No log	4.35	174	0.8017	0.6576	0.8017	0.8954
No log	4.4	176	0.7648	0.6673	0.7648	0.8745
No log	4.45	178	0.8838	0.6120	0.8838	0.9401
No log	4.5	180	1.0865	0.4059	1.0865	1.0424
No log	4.55	182	1.0029	0.5394	1.0029	1.0014
No log	4.6	184	0.7964	0.6560	0.7964	0.8924
No log	4.65	186	0.6618	0.6548	0.6618	0.8135
No log	4.7	188	0.6947	0.6394	0.6947	0.8335
No log	4.75	190	0.6505	0.6606	0.6505	0.8065
No log	4.8	192	0.7574	0.6512	0.7574	0.8703
No log	4.85	194	1.0377	0.5869	1.0377	1.0187
No log	4.9	196	1.0428	0.5995	1.0428	1.0212
No log	4.95	198	0.8352	0.6622	0.8352	0.9139
No log	5.0	200	0.6687	0.7096	0.6687	0.8178
No log	5.05	202	0.6428	0.6944	0.6428	0.8017
No log	5.1	204	0.6484	0.6855	0.6484	0.8052
No log	5.15	206	0.7079	0.6443	0.7079	0.8414
No log	5.2	208	0.8069	0.6226	0.8069	0.8983
No log	5.25	210	0.7840	0.6250	0.7840	0.8854
No log	5.3	212	0.7063	0.6899	0.7063	0.8404
No log	5.35	214	0.6975	0.7004	0.6975	0.8352
No log	5.4	216	0.6841	0.6999	0.6841	0.8271
No log	5.45	218	0.6779	0.7027	0.6779	0.8234
No log	5.5	220	0.7251	0.6835	0.7251	0.8515
No log	5.55	222	0.7612	0.6685	0.7612	0.8725
No log	5.6	224	0.7719	0.6535	0.7719	0.8786
No log	5.65	226	0.7222	0.6778	0.7222	0.8498
No log	5.7	228	0.7228	0.6861	0.7228	0.8502
No log	5.75	230	0.7442	0.6951	0.7442	0.8626
No log	5.8	232	0.8046	0.6509	0.8046	0.8970
No log	5.85	234	0.9221	0.6231	0.9221	0.9602
No log	5.9	236	0.9216	0.6231	0.9216	0.9600
No log	5.95	238	0.7598	0.6813	0.7598	0.8717
No log	6.0	240	0.6880	0.6661	0.6880	0.8295
No log	6.05	242	0.6989	0.6650	0.6989	0.8360
No log	6.1	244	0.6969	0.6661	0.6969	0.8348
No log	6.15	246	0.7540	0.6655	0.7540	0.8683
No log	6.2	248	0.7612	0.6626	0.7612	0.8725
No log	6.25	250	0.7244	0.6824	0.7244	0.8511
No log	6.3	252	0.7251	0.6885	0.7251	0.8515
No log	6.35	254	0.6820	0.6749	0.6820	0.8258
No log	6.4	256	0.6683	0.6573	0.6683	0.8175
No log	6.45	258	0.7333	0.6301	0.7333	0.8563
No log	6.5	260	0.8036	0.6189	0.8036	0.8964
No log	6.55	262	0.7679	0.6134	0.7679	0.8763
No log	6.6	264	0.6634	0.6407	0.6634	0.8145
No log	6.65	266	0.6519	0.6575	0.6519	0.8074
No log	6.7	268	0.6666	0.6752	0.6666	0.8165
No log	6.75	270	0.7527	0.6694	0.7527	0.8676
No log	6.8	272	0.7429	0.6926	0.7429	0.8619
No log	6.85	274	0.7286	0.7019	0.7286	0.8536
No log	6.9	276	0.7725	0.6821	0.7725	0.8789
No log	6.95	278	0.6998	0.6786	0.6998	0.8365
No log	7.0	280	0.6624	0.6827	0.6624	0.8139
No log	7.05	282	0.6404	0.6701	0.6404	0.8003
No log	7.1	284	0.6749	0.6460	0.6749	0.8215
No log	7.15	286	0.6949	0.6314	0.6949	0.8336
No log	7.2	288	0.6927	0.6462	0.6927	0.8323
No log	7.25	290	0.7027	0.6258	0.7027	0.8383
No log	7.3	292	0.6984	0.6533	0.6984	0.8357
No log	7.35	294	0.6643	0.6788	0.6643	0.8150
No log	7.4	296	0.6696	0.6649	0.6696	0.8183
No log	7.45	298	0.6644	0.6630	0.6644	0.8151
No log	7.5	300	0.6770	0.6917	0.6770	0.8228
No log	7.55	302	0.7392	0.7156	0.7392	0.8597
No log	7.6	304	0.8062	0.7194	0.8062	0.8979
No log	7.65	306	0.8119	0.7138	0.8119	0.9010
No log	7.7	308	0.7437	0.7093	0.7437	0.8624
No log	7.75	310	0.7000	0.6621	0.7000	0.8366
No log	7.8	312	0.7295	0.6559	0.7295	0.8541
No log	7.85	314	0.7153	0.6577	0.7153	0.8457
No log	7.9	316	0.7252	0.6351	0.7252	0.8516
No log	7.95	318	0.8231	0.6615	0.8231	0.9073
No log	8.0	320	0.8908	0.6212	0.8908	0.9438
No log	8.05	322	0.9301	0.6322	0.9301	0.9644
No log	8.1	324	0.9677	0.6161	0.9677	0.9837
No log	8.15	326	1.0162	0.6028	1.0162	1.0081
No log	8.2	328	1.1651	0.5631	1.1651	1.0794
No log	8.25	330	1.1056	0.5485	1.1056	1.0515
No log	8.3	332	0.9087	0.6400	0.9087	0.9533
No log	8.35	334	0.8489	0.6475	0.8489	0.9213
No log	8.4	336	0.8441	0.6553	0.8441	0.9188
No log	8.45	338	0.8213	0.6627	0.8213	0.9062
No log	8.5	340	0.9071	0.6368	0.9071	0.9524
No log	8.55	342	0.9282	0.6155	0.9282	0.9634
No log	8.6	344	0.8804	0.6577	0.8804	0.9383
No log	8.65	346	0.8539	0.6665	0.8539	0.9240
No log	8.7	348	0.7683	0.6464	0.7683	0.8766
No log	8.75	350	0.7398	0.6843	0.7398	0.8601
No log	8.8	352	0.7375	0.6569	0.7375	0.8588
No log	8.85	354	0.7425	0.6547	0.7425	0.8617
No log	8.9	356	0.7807	0.6373	0.7807	0.8836
No log	8.95	358	0.7457	0.6375	0.7457	0.8636
No log	9.0	360	0.6971	0.5778	0.6971	0.8349
No log	9.05	362	0.6951	0.6045	0.6951	0.8337
No log	9.1	364	0.6799	0.6110	0.6799	0.8246
No log	9.15	366	0.6783	0.6769	0.6783	0.8236
No log	9.2	368	0.7197	0.6682	0.7197	0.8484
No log	9.25	370	0.7675	0.6867	0.7675	0.8761
No log	9.3	372	0.7716	0.6814	0.7716	0.8784
No log	9.35	374	0.7055	0.6385	0.7055	0.8400
No log	9.4	376	0.7020	0.6381	0.7020	0.8379
No log	9.45	378	0.7277	0.6340	0.7277	0.8530
No log	9.5	380	0.7077	0.6466	0.7077	0.8413
No log	9.55	382	0.6849	0.7149	0.6849	0.8276
No log	9.6	384	0.6963	0.7158	0.6963	0.8345
No log	9.65	386	0.7353	0.6725	0.7353	0.8575
No log	9.7	388	0.8975	0.6504	0.8975	0.9474
No log	9.75	390	1.0142	0.5850	1.0142	1.0071
No log	9.8	392	0.9632	0.5962	0.9632	0.9814
No log	9.85	394	0.8048	0.6762	0.8048	0.8971
No log	9.9	396	0.7396	0.6625	0.7396	0.8600
No log	9.95	398	0.7539	0.6606	0.7539	0.8683
No log	10.0	400	0.8118	0.6723	0.8118	0.9010
No log	10.05	402	0.8488	0.6619	0.8488	0.9213
No log	10.1	404	0.8081	0.6845	0.8081	0.8990
No log	10.15	406	0.7389	0.6737	0.7389	0.8596
No log	10.2	408	0.7266	0.6889	0.7266	0.8524
No log	10.25	410	0.7417	0.6834	0.7417	0.8612
No log	10.3	412	0.7175	0.6709	0.7175	0.8471
No log	10.35	414	0.7068	0.6901	0.7068	0.8407
No log	10.4	416	0.7146	0.6924	0.7146	0.8454
No log	10.45	418	0.7884	0.6665	0.7884	0.8879
No log	10.5	420	0.8081	0.6562	0.8081	0.8989
No log	10.55	422	0.8035	0.6609	0.8035	0.8964
No log	10.6	424	0.7304	0.6923	0.7304	0.8546
No log	10.65	426	0.7062	0.7006	0.7062	0.8403
No log	10.7	428	0.7116	0.6564	0.7116	0.8436
No log	10.75	430	0.7358	0.6794	0.7358	0.8578
No log	10.8	432	0.7709	0.6645	0.7709	0.8780
No log	10.85	434	0.8139	0.6439	0.8139	0.9022
No log	10.9	436	0.8158	0.6626	0.8158	0.9032
No log	10.95	438	0.7478	0.6860	0.7478	0.8647
No log	11.0	440	0.6929	0.6721	0.6929	0.8324
No log	11.05	442	0.6767	0.6612	0.6767	0.8226
No log	11.1	444	0.6744	0.6784	0.6744	0.8212
No log	11.15	446	0.6727	0.6784	0.6727	0.8202
No log	11.2	448	0.6954	0.6944	0.6954	0.8339
No log	11.25	450	0.8149	0.6619	0.8149	0.9027
No log	11.3	452	0.9102	0.5946	0.9102	0.9541
No log	11.35	454	0.8588	0.6153	0.8588	0.9267
No log	11.4	456	0.7378	0.6785	0.7378	0.8590
No log	11.45	458	0.6747	0.6610	0.6747	0.8214
No log	11.5	460	0.6589	0.6825	0.6589	0.8117
No log	11.55	462	0.6736	0.6619	0.6736	0.8208
No log	11.6	464	0.6708	0.7171	0.6708	0.8190
No log	11.65	466	0.6804	0.7238	0.6804	0.8249
No log	11.7	468	0.7205	0.7185	0.7205	0.8488
No log	11.75	470	0.7700	0.6847	0.7700	0.8775
No log	11.8	472	0.7650	0.6780	0.7650	0.8747
No log	11.85	474	0.7065	0.6755	0.7065	0.8405
No log	11.9	476	0.6621	0.7116	0.6621	0.8137
No log	11.95	478	0.6529	0.6994	0.6529	0.8080
No log	12.0	480	0.6768	0.6642	0.6768	0.8227
No log	12.05	482	0.6920	0.6459	0.6920	0.8319
No log	12.1	484	0.7366	0.6499	0.7366	0.8583
No log	12.15	486	0.7285	0.6363	0.7285	0.8535
No log	12.2	488	0.6632	0.6685	0.6632	0.8143
No log	12.25	490	0.6139	0.6919	0.6139	0.7835
No log	12.3	492	0.6172	0.7179	0.6172	0.7856
No log	12.35	494	0.6247	0.6989	0.6247	0.7904
No log	12.4	496	0.6448	0.6938	0.6448	0.8030
No log	12.45	498	0.6651	0.7062	0.6651	0.8155
0.3997	12.5	500	0.6826	0.6927	0.6826	0.8262
0.3997	12.55	502	0.7158	0.6726	0.7158	0.8460
0.3997	12.6	504	0.6878	0.7123	0.6878	0.8293
0.3997	12.65	506	0.6586	0.7171	0.6586	0.8116
0.3997	12.7	508	0.6597	0.6992	0.6597	0.8122
0.3997	12.75	510	0.6615	0.6708	0.6615	0.8133
0.3997	12.8	512	0.6885	0.6427	0.6885	0.8298
0.3997	12.85	514	0.7699	0.6511	0.7699	0.8774
0.3997	12.9	516	0.7859	0.6427	0.7859	0.8865
0.3997	12.95	518	0.7607	0.6347	0.7607	0.8722

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1