ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0369
• Qwk: 0.5323
• Mse: 1.0369
• Rmse: 1.0183

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	7.2420	-0.0164	7.2420	2.6911
No log	0.4444	4	4.4850	0.0506	4.4850	2.1178
No log	0.6667	6	3.5048	-0.0109	3.5048	1.8721
No log	0.8889	8	3.3072	0.0	3.3072	1.8186
No log	1.1111	10	2.1682	0.1077	2.1682	1.4725
No log	1.3333	12	1.8609	0.2143	1.8609	1.3641
No log	1.5556	14	1.7937	0.2124	1.7937	1.3393
No log	1.7778	16	1.7487	0.2281	1.7487	1.3224
No log	2.0	18	1.8447	0.2689	1.8447	1.3582
No log	2.2222	20	1.8801	0.3111	1.8801	1.3712
No log	2.4444	22	1.5734	0.4462	1.5734	1.2543
No log	2.6667	24	1.4148	0.3158	1.4148	1.1894
No log	2.8889	26	1.3561	0.3158	1.3561	1.1645
No log	3.1111	28	1.2455	0.3304	1.2455	1.1160
No log	3.3333	30	1.1130	0.5082	1.1130	1.0550
No log	3.5556	32	1.0701	0.5802	1.0701	1.0344
No log	3.7778	34	1.0492	0.5714	1.0492	1.0243
No log	4.0	36	1.1247	0.4882	1.1247	1.0605
No log	4.2222	38	1.0832	0.5588	1.0832	1.0408
No log	4.4444	40	1.3694	0.4967	1.3694	1.1702
No log	4.6667	42	1.4446	0.5096	1.4446	1.2019
No log	4.8889	44	1.0609	0.6099	1.0609	1.0300
No log	5.1111	46	1.1932	0.4762	1.1932	1.0923
No log	5.3333	48	1.5140	0.3175	1.5140	1.2304
No log	5.5556	50	1.4471	0.2880	1.4471	1.2029
No log	5.7778	52	1.0490	0.6277	1.0490	1.0242
No log	6.0	54	1.0134	0.6897	1.0134	1.0067
No log	6.2222	56	1.1459	0.5714	1.1459	1.0705
No log	6.4444	58	1.5587	0.3089	1.5587	1.2485
No log	6.6667	60	1.5952	0.3016	1.5952	1.2630
No log	6.8889	62	1.0798	0.6131	1.0798	1.0391
No log	7.1111	64	0.9358	0.6714	0.9358	0.9674
No log	7.3333	66	0.9333	0.6522	0.9333	0.9661
No log	7.5556	68	1.0447	0.5816	1.0447	1.0221
No log	7.7778	70	1.0522	0.6423	1.0522	1.0258
No log	8.0	72	0.9807	0.6815	0.9807	0.9903
No log	8.2222	74	0.9489	0.6370	0.9489	0.9741
No log	8.4444	76	1.0886	0.6364	1.0886	1.0433
No log	8.6667	78	1.1981	0.5538	1.1981	1.0946
No log	8.8889	80	1.1407	0.5865	1.1407	1.0680
No log	9.1111	82	1.1926	0.5455	1.1926	1.0921
No log	9.3333	84	1.3980	0.4355	1.3980	1.1824
No log	9.5556	86	1.3893	0.4444	1.3893	1.1787
No log	9.7778	88	1.5338	0.2946	1.5338	1.2385
No log	10.0	90	1.6976	0.2016	1.6976	1.3029
No log	10.2222	92	1.6618	0.2326	1.6618	1.2891
No log	10.4444	94	1.1840	0.5481	1.1840	1.0881
No log	10.6667	96	0.8984	0.6383	0.8984	0.9478
No log	10.8889	98	0.9007	0.6525	0.9007	0.9490
No log	11.1111	100	1.0081	0.5909	1.0081	1.0040
No log	11.3333	102	1.3781	0.4662	1.3781	1.1739
No log	11.5556	104	1.5373	0.4179	1.5373	1.2399
No log	11.7778	106	1.2328	0.5075	1.2328	1.1103
No log	12.0	108	0.9599	0.6029	0.9599	0.9797
No log	12.2222	110	0.9202	0.6277	0.9202	0.9592
No log	12.4444	112	1.0176	0.5970	1.0176	1.0087
No log	12.6667	114	1.1419	0.5414	1.1419	1.0686
No log	12.8889	116	1.1115	0.5414	1.1115	1.0543
No log	13.1111	118	0.9776	0.6232	0.9776	0.9887
No log	13.3333	120	1.1148	0.5630	1.1148	1.0559
No log	13.5556	122	1.2537	0.5109	1.2537	1.1197
No log	13.7778	124	1.0856	0.5882	1.0856	1.0419
No log	14.0	126	1.0305	0.6475	1.0305	1.0151
No log	14.2222	128	1.1816	0.5564	1.1816	1.0870
No log	14.4444	130	1.3591	0.4394	1.3591	1.1658
No log	14.6667	132	1.3206	0.5	1.3206	1.1492
No log	14.8889	134	1.0776	0.6165	1.0776	1.0381
No log	15.1111	136	0.9583	0.6222	0.9583	0.9789
No log	15.3333	138	0.9246	0.6471	0.9246	0.9615
No log	15.5556	140	0.9123	0.6917	0.9123	0.9551
No log	15.7778	142	0.9427	0.6212	0.9427	0.9709
No log	16.0	144	1.0006	0.6047	1.0006	1.0003
No log	16.2222	146	1.0866	0.5938	1.0866	1.0424
No log	16.4444	148	1.2681	0.4959	1.2681	1.1261
No log	16.6667	150	1.4304	0.4034	1.4304	1.1960
No log	16.8889	152	1.3421	0.3966	1.3421	1.1585
No log	17.1111	154	1.2239	0.4348	1.2239	1.1063
No log	17.3333	156	1.1328	0.4667	1.1328	1.0643
No log	17.5556	158	1.0513	0.5397	1.0513	1.0253
No log	17.7778	160	1.0220	0.5041	1.0220	1.0109
No log	18.0	162	1.1177	0.5469	1.1177	1.0572
No log	18.2222	164	1.2542	0.4885	1.2542	1.1199
No log	18.4444	166	1.1609	0.5672	1.1609	1.0775
No log	18.6667	168	0.9344	0.6061	0.9344	0.9666
No log	18.8889	170	0.8812	0.6901	0.8812	0.9387
No log	19.1111	172	0.8926	0.7042	0.8926	0.9448
No log	19.3333	174	0.8435	0.6853	0.8435	0.9184
No log	19.5556	176	0.9823	0.5630	0.9823	0.9911
No log	19.7778	178	1.1370	0.5294	1.1370	1.0663
No log	20.0	180	1.0946	0.5672	1.0946	1.0462
No log	20.2222	182	1.0012	0.6212	1.0012	1.0006
No log	20.4444	184	0.9545	0.6462	0.9545	0.9770
No log	20.6667	186	0.9917	0.6107	0.9917	0.9959
No log	20.8889	188	1.0200	0.5970	1.0200	1.0100
No log	21.1111	190	1.0250	0.5865	1.0250	1.0124
No log	21.3333	192	1.0245	0.5865	1.0245	1.0122
No log	21.5556	194	1.0154	0.5909	1.0154	1.0077
No log	21.7778	196	0.9772	0.6015	0.9772	0.9886
No log	22.0	198	0.9947	0.5846	0.9947	0.9973
No log	22.2222	200	0.9876	0.6032	0.9876	0.9938
No log	22.4444	202	0.9327	0.6719	0.9327	0.9658
No log	22.6667	204	0.8749	0.6716	0.8749	0.9354
No log	22.8889	206	0.8554	0.7059	0.8554	0.9249
No log	23.1111	208	1.0642	0.5649	1.0642	1.0316
No log	23.3333	210	1.2577	0.5109	1.2577	1.1215
No log	23.5556	212	1.2030	0.5147	1.2030	1.0968
No log	23.7778	214	1.0388	0.5692	1.0388	1.0192
No log	24.0	216	0.8817	0.6716	0.8817	0.9390
No log	24.2222	218	0.8511	0.6765	0.8511	0.9226
No log	24.4444	220	0.9200	0.6462	0.9200	0.9592
No log	24.6667	222	1.1112	0.5303	1.1112	1.0542
No log	24.8889	224	1.3326	0.5037	1.3326	1.1544
No log	25.1111	226	1.3073	0.5037	1.3073	1.1434
No log	25.3333	228	1.0544	0.5758	1.0544	1.0268
No log	25.5556	230	0.9265	0.6715	0.9265	0.9626
No log	25.7778	232	0.8825	0.7183	0.8825	0.9394
No log	26.0	234	0.8982	0.6619	0.8982	0.9478
No log	26.2222	236	0.9276	0.6277	0.9276	0.9631
No log	26.4444	238	0.9309	0.6370	0.9309	0.9648
No log	26.6667	240	0.9911	0.6142	0.9911	0.9956
No log	26.8889	242	1.2621	0.5303	1.2621	1.1234
No log	27.1111	244	1.4463	0.4296	1.4463	1.2026
No log	27.3333	246	1.4064	0.4296	1.4064	1.1859
No log	27.5556	248	1.2196	0.5077	1.2196	1.1044
No log	27.7778	250	1.0740	0.5938	1.0740	1.0363
No log	28.0	252	1.0078	0.5984	1.0078	1.0039
No log	28.2222	254	0.9783	0.5984	0.9783	0.9891
No log	28.4444	256	1.0309	0.5692	1.0309	1.0153
No log	28.6667	258	1.1485	0.5455	1.1485	1.0717
No log	28.8889	260	1.2604	0.5075	1.2604	1.1227
No log	29.1111	262	1.2452	0.5075	1.2452	1.1159
No log	29.3333	264	1.1559	0.5263	1.1559	1.0751
No log	29.5556	266	1.0838	0.5909	1.0838	1.0411
No log	29.7778	268	1.0685	0.5909	1.0685	1.0337
No log	30.0	270	1.0357	0.5938	1.0357	1.0177
No log	30.2222	272	1.0243	0.5938	1.0243	1.0121
No log	30.4444	274	1.0816	0.5271	1.0816	1.0400
No log	30.6667	276	1.1597	0.5152	1.1597	1.0769
No log	30.8889	278	1.1850	0.5038	1.1850	1.0886
No log	31.1111	280	1.1346	0.5271	1.1346	1.0652
No log	31.3333	282	1.0664	0.5645	1.0664	1.0327
No log	31.5556	284	1.0086	0.5806	1.0086	1.0043
No log	31.7778	286	0.9792	0.5920	0.9792	0.9895
No log	32.0	288	0.9987	0.5385	0.9987	0.9994
No log	32.2222	290	1.1216	0.5263	1.1216	1.0591
No log	32.4444	292	1.2547	0.4848	1.2547	1.1201
No log	32.6667	294	1.2746	0.4662	1.2746	1.1290
No log	32.8889	296	1.1907	0.5224	1.1907	1.0912
No log	33.1111	298	1.0854	0.5231	1.0854	1.0418
No log	33.3333	300	0.9938	0.5846	0.9938	0.9969
No log	33.5556	302	0.9674	0.5954	0.9674	0.9836
No log	33.7778	304	0.9608	0.5758	0.9608	0.9802
No log	34.0	306	0.9851	0.5231	0.9851	0.9925
No log	34.2222	308	1.0577	0.5	1.0577	1.0285
No log	34.4444	310	1.1256	0.5224	1.1256	1.0609
No log	34.6667	312	1.1262	0.5	1.1262	1.0612
No log	34.8889	314	1.0995	0.5038	1.0995	1.0486
No log	35.1111	316	1.0576	0.5271	1.0576	1.0284
No log	35.3333	318	1.0396	0.5781	1.0396	1.0196
No log	35.5556	320	0.9885	0.6094	0.9885	0.9942
No log	35.7778	322	1.0037	0.5846	1.0037	1.0018
No log	36.0	324	1.0569	0.5736	1.0569	1.0280
No log	36.2222	326	1.0987	0.5564	1.0987	1.0482
No log	36.4444	328	1.0946	0.5672	1.0946	1.0462
No log	36.6667	330	1.1162	0.5224	1.1162	1.0565
No log	36.8889	332	1.1076	0.5224	1.1076	1.0524
No log	37.1111	334	1.0673	0.5672	1.0673	1.0331
No log	37.3333	336	0.9497	0.5846	0.9497	0.9745
No log	37.5556	338	0.8815	0.6316	0.8815	0.9389
No log	37.7778	340	0.9070	0.6364	0.9070	0.9524
No log	38.0	342	0.9602	0.6032	0.9602	0.9799
No log	38.2222	344	1.0199	0.592	1.0199	1.0099
No log	38.4444	346	1.0647	0.56	1.0647	1.0319
No log	38.6667	348	1.1136	0.56	1.1136	1.0553
No log	38.8889	350	1.1023	0.5920	1.1023	1.0499
No log	39.1111	352	1.0613	0.5873	1.0613	1.0302
No log	39.3333	354	1.0213	0.5600	1.0213	1.0106
No log	39.5556	356	1.0373	0.5891	1.0373	1.0185
No log	39.7778	358	1.0143	0.5891	1.0143	1.0071
No log	40.0	360	1.0105	0.6	1.0105	1.0052
No log	40.2222	362	0.9928	0.6	0.9928	0.9964
No log	40.4444	364	1.0286	0.5954	1.0286	1.0142
No log	40.6667	366	1.1319	0.5522	1.1319	1.0639
No log	40.8889	368	1.1750	0.5522	1.1750	1.0840
No log	41.1111	370	1.2947	0.4853	1.2947	1.1378
No log	41.3333	372	1.3051	0.4853	1.3051	1.1424
No log	41.5556	374	1.1806	0.6107	1.1806	1.0866
No log	41.7778	376	1.0564	0.5891	1.0564	1.0278
No log	42.0	378	1.0282	0.5692	1.0282	1.0140
No log	42.2222	380	1.0518	0.5938	1.0518	1.0256
No log	42.4444	382	1.0917	0.5891	1.0917	1.0448
No log	42.6667	384	1.1237	0.5781	1.1237	1.0600
No log	42.8889	386	1.1449	0.5556	1.1449	1.0700
No log	43.1111	388	1.1332	0.5625	1.1332	1.0645
No log	43.3333	390	1.1453	0.5469	1.1453	1.0702
No log	43.5556	392	1.1175	0.5692	1.1175	1.0571
No log	43.7778	394	1.0968	0.6	1.0968	1.0473
No log	44.0	396	1.0374	0.6	1.0374	1.0185
No log	44.2222	398	1.0405	0.6	1.0405	1.0200
No log	44.4444	400	1.0758	0.6	1.0758	1.0372
No log	44.6667	402	1.1134	0.5758	1.1134	1.0552
No log	44.8889	404	1.1503	0.5538	1.1503	1.0725
No log	45.1111	406	1.1971	0.5538	1.1971	1.0941
No log	45.3333	408	1.2181	0.5649	1.2181	1.1037
No log	45.5556	410	1.1929	0.5538	1.1929	1.0922
No log	45.7778	412	1.1890	0.5781	1.1890	1.0904
No log	46.0	414	1.1640	0.5669	1.1640	1.0789
No log	46.2222	416	1.1783	0.5781	1.1783	1.0855
No log	46.4444	418	1.1827	0.5581	1.1827	1.0875
No log	46.6667	420	1.1202	0.5781	1.1202	1.0584
No log	46.8889	422	1.0255	0.5827	1.0255	1.0127
No log	47.1111	424	0.9815	0.576	0.9815	0.9907
No log	47.3333	426	0.9887	0.5645	0.9887	0.9943
No log	47.5556	428	1.0364	0.5714	1.0364	1.0180
No log	47.7778	430	1.0726	0.5714	1.0726	1.0357
No log	48.0	432	1.0737	0.56	1.0737	1.0362
No log	48.2222	434	1.0327	0.5645	1.0327	1.0162
No log	48.4444	436	1.0006	0.5645	1.0006	1.0003
No log	48.6667	438	0.9868	0.5645	0.9868	0.9934
No log	48.8889	440	0.9761	0.5625	0.9761	0.9880
No log	49.1111	442	0.9991	0.5938	0.9991	0.9995
No log	49.3333	444	1.0357	0.5736	1.0357	1.0177
No log	49.5556	446	1.0628	0.5625	1.0628	1.0309
No log	49.7778	448	1.0532	0.5625	1.0532	1.0262
No log	50.0	450	1.0532	0.5625	1.0532	1.0263
No log	50.2222	452	1.0693	0.5625	1.0693	1.0341
No log	50.4444	454	1.0788	0.5625	1.0788	1.0386
No log	50.6667	456	1.0544	0.5625	1.0544	1.0269
No log	50.8889	458	1.0566	0.5625	1.0566	1.0279
No log	51.1111	460	1.1079	0.5625	1.1079	1.0526
No log	51.3333	462	1.1252	0.5496	1.1252	1.0608
No log	51.5556	464	1.1612	0.5649	1.1612	1.0776
No log	51.7778	466	1.2019	0.5649	1.2019	1.0963
No log	52.0	468	1.2275	0.5455	1.2275	1.1079
No log	52.2222	470	1.2414	0.5846	1.2414	1.1142
No log	52.4444	472	1.2178	0.5846	1.2178	1.1035
No log	52.6667	474	1.2044	0.5954	1.2044	1.0975
No log	52.8889	476	1.1982	0.5692	1.1982	1.0946
No log	53.1111	478	1.2144	0.5692	1.2144	1.1020
No log	53.3333	480	1.1828	0.5692	1.1828	1.0875
No log	53.5556	482	1.1412	0.5954	1.1412	1.0683
No log	53.7778	484	1.1204	0.5692	1.1204	1.0585
No log	54.0	486	1.0892	0.6	1.0892	1.0437
No log	54.2222	488	1.0889	0.5625	1.0889	1.0435
No log	54.4444	490	1.0796	0.5938	1.0796	1.0390
No log	54.6667	492	1.0985	0.56	1.0985	1.0481
No log	54.8889	494	1.1436	0.5669	1.1436	1.0694
No log	55.1111	496	1.1683	0.5581	1.1683	1.0809
No log	55.3333	498	1.1757	0.5625	1.1757	1.0843
0.2832	55.5556	500	1.1642	0.5538	1.1642	1.0790
0.2832	55.7778	502	1.1406	0.5496	1.1406	1.0680
0.2832	56.0	504	1.1223	0.5496	1.1223	1.0594
0.2832	56.2222	506	1.0886	0.5496	1.0886	1.0433
0.2832	56.4444	508	1.1216	0.5496	1.1216	1.0591
0.2832	56.6667	510	1.1634	0.5649	1.1634	1.0786
0.2832	56.8889	512	1.1999	0.5455	1.1999	1.0954
0.2832	57.1111	514	1.2055	0.5455	1.2055	1.0980
0.2832	57.3333	516	1.1873	0.5649	1.1873	1.0896
0.2832	57.5556	518	1.1486	0.5538	1.1486	1.0717
0.2832	57.7778	520	1.1213	0.5538	1.1213	1.0589
0.2832	58.0	522	1.0793	0.5469	1.0793	1.0389
0.2832	58.2222	524	1.0673	0.544	1.0673	1.0331
0.2832	58.4444	526	1.0369	0.5323	1.0369	1.0183

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1