ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k3_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1140
• Qwk: 0.0709
• Mse: 1.1140
• Rmse: 1.0555

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	3.5901	0.0035	3.5901	1.8948
No log	0.5	4	1.9497	0.0772	1.9497	1.3963
No log	0.75	6	1.5506	0.0235	1.5506	1.2452
No log	1.0	8	1.1802	-0.1288	1.1802	1.0864
No log	1.25	10	1.0615	-0.0200	1.0615	1.0303
No log	1.5	12	1.1837	-0.0628	1.1837	1.0880
No log	1.75	14	1.2978	0.0543	1.2978	1.1392
No log	2.0	16	0.9014	-0.1695	0.9014	0.9494
No log	2.25	18	0.8278	-0.0725	0.8278	0.9098
No log	2.5	20	1.0100	-0.1261	1.0100	1.0050
No log	2.75	22	1.9378	-0.0666	1.9378	1.3921
No log	3.0	24	2.2738	-0.0306	2.2738	1.5079
No log	3.25	26	1.4154	0.0543	1.4154	1.1897
No log	3.5	28	0.9329	-0.1554	0.9329	0.9659
No log	3.75	30	0.9125	-0.1580	0.9125	0.9553
No log	4.0	32	0.9712	-0.1155	0.9712	0.9855
No log	4.25	34	1.1781	-0.0862	1.1781	1.0854
No log	4.5	36	1.4154	-0.0930	1.4154	1.1897
No log	4.75	38	1.1184	0.0260	1.1184	1.0575
No log	5.0	40	1.2935	0.0117	1.2935	1.1373
No log	5.25	42	1.8388	0.0367	1.8388	1.3560
No log	5.5	44	1.6146	0.0389	1.6146	1.2707
No log	5.75	46	1.4517	-0.0011	1.4517	1.2049
No log	6.0	48	0.9368	-0.1200	0.9368	0.9679
No log	6.25	50	0.9243	-0.0704	0.9243	0.9614
No log	6.5	52	1.3898	-0.0348	1.3898	1.1789
No log	6.75	54	1.7082	0.0045	1.7082	1.3070
No log	7.0	56	1.5424	-0.0155	1.5424	1.2420
No log	7.25	58	0.9937	-0.0818	0.9937	0.9968
No log	7.5	60	0.8985	-0.2021	0.8985	0.9479
No log	7.75	62	0.9400	-0.1952	0.9400	0.9695
No log	8.0	64	0.9922	-0.0749	0.9922	0.9961
No log	8.25	66	1.1522	0.0186	1.1522	1.0734
No log	8.5	68	1.1203	-0.0068	1.1203	1.0585
No log	8.75	70	1.2579	0.1215	1.2579	1.1216
No log	9.0	72	1.5706	0.0104	1.5706	1.2532
No log	9.25	74	1.0221	0.0267	1.0221	1.0110
No log	9.5	76	0.8297	-0.1047	0.8297	0.9109
No log	9.75	78	0.8579	-0.1144	0.8579	0.9262
No log	10.0	80	1.5397	0.0101	1.5397	1.2409
No log	10.25	82	1.6670	0.0261	1.6670	1.2911
No log	10.5	84	0.9979	0.0250	0.9979	0.9990
No log	10.75	86	0.8592	-0.0341	0.8592	0.9269
No log	11.0	88	1.0706	0.0526	1.0706	1.0347
No log	11.25	90	1.1353	0.1150	1.1353	1.0655
No log	11.5	92	0.9831	-0.0052	0.9831	0.9915
No log	11.75	94	1.2082	0.1043	1.2082	1.0992
No log	12.0	96	1.3312	0.0895	1.3312	1.1538
No log	12.25	98	0.9476	-0.0440	0.9476	0.9735
No log	12.5	100	0.7932	-0.0573	0.7932	0.8906
No log	12.75	102	0.7947	-0.0218	0.7947	0.8915
No log	13.0	104	1.1525	0.0852	1.1525	1.0735
No log	13.25	106	1.7212	-0.0000	1.7212	1.3119
No log	13.5	108	1.7350	-0.0000	1.7350	1.3172
No log	13.75	110	1.3225	0.0456	1.3225	1.1500
No log	14.0	112	0.8661	-0.0008	0.8661	0.9306
No log	14.25	114	0.7701	-0.0643	0.7701	0.8775
No log	14.5	116	0.8179	0.0871	0.8179	0.9044
No log	14.75	118	1.2404	0.0767	1.2404	1.1137
No log	15.0	120	1.5434	0.1094	1.5434	1.2423
No log	15.25	122	1.2544	0.0527	1.2544	1.1200
No log	15.5	124	0.8679	0.0913	0.8679	0.9316
No log	15.75	126	0.7914	0.0303	0.7914	0.8896
No log	16.0	128	0.8213	0.0175	0.8213	0.9063
No log	16.25	130	1.1068	0.0915	1.1068	1.0520
No log	16.5	132	1.4598	-0.0456	1.4598	1.2082
No log	16.75	134	1.2793	0.0446	1.2793	1.1311
No log	17.0	136	0.9651	0.1007	0.9651	0.9824
No log	17.25	138	0.9736	0.1042	0.9736	0.9867
No log	17.5	140	1.1925	0.1087	1.1925	1.0920
No log	17.75	142	1.3704	-0.0174	1.3704	1.1706
No log	18.0	144	1.1811	0.1153	1.1811	1.0868
No log	18.25	146	0.9543	0.1499	0.9543	0.9769
No log	18.5	148	0.7511	0.0205	0.7511	0.8666
No log	18.75	150	0.7447	0.0205	0.7447	0.8630
No log	19.0	152	0.9454	0.1077	0.9454	0.9723
No log	19.25	154	1.4580	0.0571	1.4580	1.2075
No log	19.5	156	1.4430	0.0571	1.4430	1.2012
No log	19.75	158	1.1591	0.1379	1.1591	1.0766
No log	20.0	160	0.9042	0.1191	0.9042	0.9509
No log	20.25	162	0.8278	0.1239	0.8278	0.9098
No log	20.5	164	0.9729	0.1042	0.9729	0.9864
No log	20.75	166	1.3231	0.0411	1.3231	1.1503
No log	21.0	168	1.3502	0.0411	1.3502	1.1620
No log	21.25	170	1.0668	0.0941	1.0668	1.0329
No log	21.5	172	0.8175	0.0913	0.8175	0.9042
No log	21.75	174	0.8533	0.1399	0.8533	0.9237
No log	22.0	176	1.0680	0.0604	1.0680	1.0334
No log	22.25	178	1.2381	0.0746	1.2381	1.1127
No log	22.5	180	1.2594	-0.0129	1.2594	1.1222
No log	22.75	182	1.1937	-0.0082	1.1937	1.0925
No log	23.0	184	0.9794	0.0945	0.9794	0.9896
No log	23.25	186	0.9308	0.1077	0.9308	0.9648
No log	23.5	188	0.9956	0.0945	0.9956	0.9978
No log	23.75	190	1.3195	0.0204	1.3195	1.1487
No log	24.0	192	1.7294	0.0235	1.7294	1.3151
No log	24.25	194	1.6501	0.0543	1.6501	1.2846
No log	24.5	196	1.2000	0.0578	1.2000	1.0954
No log	24.75	198	0.8912	0.0909	0.8912	0.9440
No log	25.0	200	0.7788	0.0068	0.7788	0.8825
No log	25.25	202	0.7821	0.0476	0.7821	0.8843
No log	25.5	204	0.8717	0.0946	0.8717	0.9337
No log	25.75	206	1.1741	0.0596	1.1741	1.0836
No log	26.0	208	1.3591	0.0411	1.3591	1.1658
No log	26.25	210	1.1877	0.0552	1.1877	1.0898
No log	26.5	212	0.9340	-0.0114	0.9340	0.9665
No log	26.75	214	0.8730	-0.0008	0.8730	0.9344
No log	27.0	216	0.8780	-0.0118	0.8780	0.9370
No log	27.25	218	0.9667	-0.0331	0.9667	0.9832
No log	27.5	220	0.9358	0.0006	0.9358	0.9674
No log	27.75	222	0.9700	0.0026	0.9700	0.9849
No log	28.0	224	0.9848	0.0026	0.9848	0.9924
No log	28.25	226	0.9259	0.0515	0.9259	0.9622
No log	28.5	228	0.8925	0.0200	0.8925	0.9447
No log	28.75	230	0.8679	-0.0138	0.8679	0.9316
No log	29.0	232	0.8730	-0.0138	0.8730	0.9343
No log	29.25	234	0.9389	-0.0211	0.9389	0.9690
No log	29.5	236	1.0090	-0.0013	1.0090	1.0045
No log	29.75	238	0.9926	-0.0608	0.9926	0.9963
No log	30.0	240	0.9089	-0.0175	0.9089	0.9534
No log	30.25	242	0.9053	-0.0157	0.9053	0.9514
No log	30.5	244	0.9381	-0.0285	0.9381	0.9686
No log	30.75	246	0.9567	-0.0285	0.9567	0.9781
No log	31.0	248	1.0409	-0.0316	1.0409	1.0202
No log	31.25	250	1.0711	-0.0316	1.0711	1.0349
No log	31.5	252	1.0103	-0.0194	1.0103	1.0051
No log	31.75	254	0.9099	0.0755	0.9099	0.9539
No log	32.0	256	0.8693	0.0876	0.8693	0.9324
No log	32.25	258	0.8881	0.0793	0.8881	0.9424
No log	32.5	260	0.9710	-0.0194	0.9710	0.9854
No log	32.75	262	0.9473	0.0200	0.9473	0.9733
No log	33.0	264	0.8897	0.0224	0.8897	0.9432
No log	33.25	266	0.8703	0.0250	0.8703	0.9329
No log	33.5	268	0.8859	0.0250	0.8859	0.9412
No log	33.75	270	1.0060	0.0282	1.0060	1.0030
No log	34.0	272	1.1625	0.0503	1.1625	1.0782
No log	34.25	274	1.2458	0.0171	1.2458	1.1162
No log	34.5	276	1.2022	0.0479	1.2022	1.0964
No log	34.75	278	1.0717	0.0287	1.0717	1.0352
No log	35.0	280	0.9867	0.0355	0.9867	0.9933
No log	35.25	282	0.9356	0.0125	0.9356	0.9672
No log	35.5	284	0.9218	0.0104	0.9218	0.9601
No log	35.75	286	1.0022	0.0231	1.0022	1.0011
No log	36.0	288	1.1402	0.0709	1.1402	1.0678
No log	36.25	290	1.1195	0.0709	1.1195	1.0581
No log	36.5	292	0.9722	0.0518	0.9722	0.9860
No log	36.75	294	0.8333	-0.0809	0.8333	0.9129
No log	37.0	296	0.7857	-0.0303	0.7857	0.8864
No log	37.25	298	0.7909	-0.0303	0.7909	0.8893
No log	37.5	300	0.8489	-0.0456	0.8489	0.9213
No log	37.75	302	1.0152	0.0848	1.0152	1.0076
No log	38.0	304	1.1949	0.1025	1.1949	1.0931
No log	38.25	306	1.3393	0.0885	1.3393	1.1573
No log	38.5	308	1.2616	0.0658	1.2616	1.1232
No log	38.75	310	1.0595	0.0790	1.0595	1.0293
No log	39.0	312	0.8608	0.0545	0.8608	0.9278
No log	39.25	314	0.7846	-0.0355	0.7846	0.8858
No log	39.5	316	0.7869	-0.0767	0.7869	0.8871
No log	39.75	318	0.8485	0.0362	0.8485	0.9211
No log	40.0	320	0.9934	0.0881	0.9934	0.9967
No log	40.25	322	1.1563	0.0735	1.1563	1.0753
No log	40.5	324	1.2891	0.0966	1.2891	1.1354
No log	40.75	326	1.2525	0.0709	1.2525	1.1192
No log	41.0	328	1.0614	0.0762	1.0614	1.0302
No log	41.25	330	0.9274	0.1414	0.9274	0.9630
No log	41.5	332	0.8781	0.0157	0.8781	0.9371
No log	41.75	334	0.9188	0.1042	0.9188	0.9585
No log	42.0	336	1.0638	0.0735	1.0638	1.0314
No log	42.25	338	1.2438	0.0658	1.2438	1.1153
No log	42.5	340	1.1978	0.0658	1.1978	1.0944
No log	42.75	342	1.0326	0.0735	1.0326	1.0162
No log	43.0	344	0.9022	0.1191	0.9022	0.9498
No log	43.25	346	0.8772	0.0949	0.8772	0.9366
No log	43.5	348	0.9376	0.1042	0.9376	0.9683
No log	43.75	350	1.0324	0.0790	1.0324	1.0161
No log	44.0	352	1.0675	0.0735	1.0675	1.0332
No log	44.25	354	1.0832	0.0735	1.0832	1.0408
No log	44.5	356	1.1008	0.0995	1.1008	1.0492
No log	44.75	358	1.0571	0.0735	1.0571	1.0282
No log	45.0	360	1.0344	0.0735	1.0344	1.0170
No log	45.25	362	1.0039	0.0819	1.0039	1.0020
No log	45.5	364	0.9871	0.0819	0.9871	0.9935
No log	45.75	366	0.9963	0.0848	0.9963	0.9982
No log	46.0	368	1.0072	0.0819	1.0072	1.0036
No log	46.25	370	1.0816	0.0790	1.0816	1.0400
No log	46.5	372	1.1249	0.0735	1.1249	1.0606
No log	46.75	374	1.1129	0.0735	1.1129	1.0550
No log	47.0	376	1.0501	0.0735	1.0501	1.0247
No log	47.25	378	1.0123	0.0735	1.0123	1.0061
No log	47.5	380	1.0304	0.0735	1.0304	1.0151
No log	47.75	382	1.0768	0.0735	1.0768	1.0377
No log	48.0	384	1.0937	0.0735	1.0937	1.0458
No log	48.25	386	1.0603	0.0735	1.0603	1.0297
No log	48.5	388	1.0017	0.0909	1.0017	1.0008
No log	48.75	390	0.9914	0.0623	0.9914	0.9957
No log	49.0	392	1.0224	0.0909	1.0224	1.0111
No log	49.25	394	1.0339	0.0878	1.0339	1.0168
No log	49.5	396	1.0718	0.0848	1.0718	1.0353
No log	49.75	398	1.0732	0.0790	1.0732	1.0360
No log	50.0	400	1.0340	0.0790	1.0340	1.0168
No log	50.25	402	0.9624	0.0623	0.9624	0.9810
No log	50.5	404	0.9153	0.0651	0.9153	0.9567
No log	50.75	406	0.9537	0.0596	0.9537	0.9766
No log	51.0	408	1.0338	0.0735	1.0338	1.0168
No log	51.25	410	1.0844	0.0709	1.0844	1.0413
No log	51.5	412	1.0767	0.0735	1.0767	1.0377
No log	51.75	414	1.0502	0.0735	1.0502	1.0248
No log	52.0	416	1.1028	0.0966	1.1028	1.0502
No log	52.25	418	1.1458	0.0966	1.1458	1.0704
No log	52.5	420	1.1568	0.0966	1.1568	1.0755
No log	52.75	422	1.1425	0.0689	1.1425	1.0689
No log	53.0	424	1.0533	0.0479	1.0533	1.0263
No log	53.25	426	1.0028	0.0604	1.0028	1.0014
No log	53.5	428	0.9758	0.0342	0.9758	0.9878
No log	53.75	430	0.9686	0.0596	0.9686	0.9842
No log	54.0	432	0.9871	0.0790	0.9871	0.9935
No log	54.25	434	1.0659	0.0762	1.0659	1.0324
No log	54.5	436	1.1156	0.0966	1.1156	1.0562
No log	54.75	438	1.1343	0.0966	1.1343	1.0650
No log	55.0	440	1.0749	0.0709	1.0749	1.0368
No log	55.25	442	0.9778	0.0762	0.9778	0.9888
No log	55.5	444	0.9003	0.0353	0.9003	0.9488
No log	55.75	446	0.8469	0.0909	0.8469	0.9203
No log	56.0	448	0.8160	0.0755	0.8160	0.9033
No log	56.25	450	0.8339	0.0277	0.8339	0.9132
No log	56.5	452	0.8685	0.0486	0.8685	0.9319
No log	56.75	454	0.9666	0.0819	0.9666	0.9832
No log	57.0	456	1.0602	0.0735	1.0602	1.0296
No log	57.25	458	1.0783	0.0735	1.0783	1.0384
No log	57.5	460	1.0260	0.0735	1.0260	1.0129
No log	57.75	462	0.9928	0.0762	0.9928	0.9964
No log	58.0	464	0.9914	0.0819	0.9914	0.9957
No log	58.25	466	1.0313	0.0762	1.0313	1.0155
No log	58.5	468	1.0242	0.0762	1.0242	1.0120
No log	58.75	470	0.9825	0.0762	0.9825	0.9912
No log	59.0	472	0.9731	0.0762	0.9731	0.9865
No log	59.25	474	0.9461	0.0790	0.9461	0.9727
No log	59.5	476	0.9491	0.0762	0.9491	0.9742
No log	59.75	478	1.0016	0.0762	1.0016	1.0008
No log	60.0	480	1.0386	0.0735	1.0386	1.0191
No log	60.25	482	1.0722	0.0735	1.0722	1.0355
No log	60.5	484	1.0390	0.0762	1.0390	1.0193
No log	60.75	486	0.9538	0.1187	0.9538	0.9766
No log	61.0	488	0.8866	0.0515	0.8866	0.9416
No log	61.25	490	0.8657	-0.0138	0.8657	0.9304
No log	61.5	492	0.8617	-0.0182	0.8617	0.9283
No log	61.75	494	0.8837	0.0486	0.8837	0.9400
No log	62.0	496	0.9578	0.1153	0.9578	0.9787
No log	62.25	498	1.0170	0.0735	1.0170	1.0085
0.1815	62.5	500	1.0705	0.0709	1.0705	1.0346
0.1815	62.75	502	1.1149	0.0658	1.1149	1.0559
0.1815	63.0	504	1.1226	0.0083	1.1226	1.0595
0.1815	63.25	506	1.1022	-0.0178	1.1022	1.0499
0.1815	63.5	508	1.0447	0.0709	1.0447	1.0221
0.1815	63.75	510	1.0262	0.0735	1.0262	1.0130
0.1815	64.0	512	0.9628	0.0848	0.9628	0.9812
0.1815	64.25	514	0.9246	0.0045	0.9246	0.9616
0.1815	64.5	516	0.9273	-0.0261	0.9273	0.9630
0.1815	64.75	518	0.9600	0.0578	0.9600	0.9798
0.1815	65.0	520	1.0481	0.0190	1.0481	1.0238
0.1815	65.25	522	1.1140	0.0709	1.1140	1.0555

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1