ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k1_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0139
• Qwk: 0.3842
• Mse: 1.0139
• Rmse: 1.0069

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	6.8335	-0.0708	6.8335	2.6141
No log	0.8	4	4.7061	-0.0278	4.7061	2.1694
No log	1.2	6	2.5724	0.0560	2.5724	1.6039
No log	1.6	8	1.6768	0.0939	1.6768	1.2949
No log	2.0	10	1.3213	0.2826	1.3213	1.1495
No log	2.4	12	1.2382	0.2601	1.2382	1.1127
No log	2.8	14	1.1576	0.3104	1.1576	1.0759
No log	3.2	16	1.1353	0.1443	1.1353	1.0655
No log	3.6	18	1.1452	0.1645	1.1452	1.0701
No log	4.0	20	1.1199	0.3017	1.1199	1.0583
No log	4.4	22	1.3404	0.1826	1.3404	1.1578
No log	4.8	24	1.3432	0.1652	1.3432	1.1590
No log	5.2	26	1.5716	0.1901	1.5716	1.2536
No log	5.6	28	1.4735	0.1395	1.4735	1.2139
No log	6.0	30	1.1452	0.2915	1.1452	1.0701
No log	6.4	32	1.1747	0.1443	1.1747	1.0838
No log	6.8	34	1.2006	0.1468	1.2006	1.0957
No log	7.2	36	1.4545	0.0800	1.4545	1.2060
No log	7.6	38	1.7257	0.1491	1.7257	1.3136
No log	8.0	40	1.9520	0.1351	1.9520	1.3971
No log	8.4	42	1.5476	0.0453	1.5476	1.2440
No log	8.8	44	1.2394	0.1584	1.2394	1.1133
No log	9.2	46	1.3681	0.1156	1.3681	1.1697
No log	9.6	48	1.3267	0.1090	1.3267	1.1518
No log	10.0	50	1.3076	0.2363	1.3076	1.1435
No log	10.4	52	1.4804	0.0923	1.4804	1.2167
No log	10.8	54	1.3224	0.1612	1.3224	1.1500
No log	11.2	56	1.2179	0.3787	1.2179	1.1036
No log	11.6	58	1.2268	0.3021	1.2268	1.1076
No log	12.0	60	1.1937	0.3310	1.1937	1.0926
No log	12.4	62	1.1458	0.3913	1.1458	1.0704
No log	12.8	64	1.1492	0.3536	1.1492	1.0720
No log	13.2	66	1.1365	0.3918	1.1365	1.0661
No log	13.6	68	1.2648	0.3348	1.2648	1.1247
No log	14.0	70	1.2701	0.3682	1.2701	1.1270
No log	14.4	72	1.1778	0.3160	1.1778	1.0853
No log	14.8	74	1.2170	0.3232	1.2170	1.1032
No log	15.2	76	1.2006	0.3448	1.2006	1.0957
No log	15.6	78	1.1830	0.4276	1.1830	1.0877
No log	16.0	80	1.1748	0.3972	1.1748	1.0839
No log	16.4	82	1.2203	0.3348	1.2203	1.1047
No log	16.8	84	1.1376	0.4014	1.1376	1.0666
No log	17.2	86	1.1063	0.4449	1.1063	1.0518
No log	17.6	88	1.1026	0.4014	1.1026	1.0500
No log	18.0	90	1.0975	0.4449	1.0975	1.0476
No log	18.4	92	1.1190	0.3779	1.1190	1.0578
No log	18.8	94	1.1438	0.3779	1.1438	1.0695
No log	19.2	96	1.2424	0.3691	1.2424	1.1146
No log	19.6	98	1.2211	0.3714	1.2211	1.1050
No log	20.0	100	1.2993	0.3741	1.2993	1.1399
No log	20.4	102	1.5020	0.2862	1.5020	1.2256
No log	20.8	104	1.6942	0.1957	1.6942	1.3016
No log	21.2	106	1.5316	0.2382	1.5316	1.2376
No log	21.6	108	1.2198	0.3402	1.2198	1.1044
No log	22.0	110	1.3166	0.3154	1.3166	1.1474
No log	22.4	112	1.3081	0.3154	1.3081	1.1437
No log	22.8	114	1.2410	0.3073	1.2410	1.1140
No log	23.2	116	1.2876	0.2524	1.2876	1.1347
No log	23.6	118	1.1515	0.3463	1.1515	1.0731
No log	24.0	120	1.1005	0.3413	1.1005	1.0490
No log	24.4	122	1.0851	0.4093	1.0851	1.0417
No log	24.8	124	1.0923	0.3328	1.0923	1.0451
No log	25.2	126	1.1126	0.3216	1.1126	1.0548
No log	25.6	128	1.0574	0.3328	1.0574	1.0283
No log	26.0	130	1.0179	0.4091	1.0179	1.0089
No log	26.4	132	1.0017	0.3787	1.0017	1.0009
No log	26.8	134	0.9942	0.4091	0.9942	0.9971
No log	27.2	136	1.0055	0.4488	1.0055	1.0028
No log	27.6	138	1.0698	0.4565	1.0698	1.0343
No log	28.0	140	1.1009	0.4754	1.1009	1.0492
No log	28.4	142	1.0982	0.3717	1.0982	1.0480
No log	28.8	144	1.1736	0.3717	1.1736	1.0833
No log	29.2	146	1.3503	0.2932	1.3503	1.1620
No log	29.6	148	1.2701	0.3132	1.2701	1.1270
No log	30.0	150	1.1113	0.3413	1.1113	1.0542
No log	30.4	152	1.1675	0.4286	1.1675	1.0805
No log	30.8	154	1.2099	0.4362	1.2099	1.1000
No log	31.2	156	1.1558	0.3766	1.1558	1.0751
No log	31.6	158	1.2909	0.2930	1.2909	1.1362
No log	32.0	160	1.6581	0.2167	1.6581	1.2877
No log	32.4	162	1.6900	0.2231	1.6900	1.3000
No log	32.8	164	1.4369	0.3009	1.4369	1.1987
No log	33.2	166	1.2606	0.3343	1.2606	1.1228
No log	33.6	168	1.2972	0.3445	1.2972	1.1390
No log	34.0	170	1.3875	0.3304	1.3875	1.1779
No log	34.4	172	1.3623	0.3478	1.3623	1.1672
No log	34.8	174	1.2299	0.3125	1.2299	1.1090
No log	35.2	176	1.2031	0.3103	1.2031	1.0969
No log	35.6	178	1.2367	0.3745	1.2367	1.1121
No log	36.0	180	1.3322	0.2896	1.3322	1.1542
No log	36.4	182	1.4663	0.3007	1.4663	1.2109
No log	36.8	184	1.4380	0.3369	1.4380	1.1992
No log	37.2	186	1.3023	0.3898	1.3023	1.1412
No log	37.6	188	1.2026	0.3830	1.2026	1.0966
No log	38.0	190	1.1485	0.3817	1.1485	1.0717
No log	38.4	192	1.1327	0.3429	1.1327	1.0643
No log	38.8	194	1.1259	0.3590	1.1259	1.0611
No log	39.2	196	1.1380	0.3753	1.1380	1.0668
No log	39.6	198	1.1193	0.3590	1.1193	1.0580
No log	40.0	200	1.1599	0.3760	1.1599	1.0770
No log	40.4	202	1.1894	0.3684	1.1894	1.0906
No log	40.8	204	1.1678	0.3563	1.1678	1.0807
No log	41.2	206	1.1848	0.3563	1.1848	1.0885
No log	41.6	208	1.1782	0.3164	1.1782	1.0854
No log	42.0	210	1.1899	0.3164	1.1899	1.0908
No log	42.4	212	1.2019	0.3272	1.2019	1.0963
No log	42.8	214	1.2436	0.2761	1.2436	1.1151
No log	43.2	216	1.2777	0.1929	1.2777	1.1304
No log	43.6	218	1.2884	0.2623	1.2884	1.1351
No log	44.0	220	1.3022	0.2623	1.3022	1.1411
No log	44.4	222	1.2927	0.2293	1.2927	1.1370
No log	44.8	224	1.3020	0.2247	1.3020	1.1410
No log	45.2	226	1.2957	0.2869	1.2957	1.1383
No log	45.6	228	1.2879	0.3013	1.2879	1.1349
No log	46.0	230	1.3038	0.2570	1.3038	1.1418
No log	46.4	232	1.2885	0.3069	1.2885	1.1351
No log	46.8	234	1.2242	0.3574	1.2242	1.1064
No log	47.2	236	1.1748	0.3336	1.1748	1.0839
No log	47.6	238	1.1743	0.3359	1.1743	1.0836
No log	48.0	240	1.1886	0.3646	1.1886	1.0902
No log	48.4	242	1.1915	0.3646	1.1915	1.0915
No log	48.8	244	1.1929	0.3878	1.1929	1.0922
No log	49.2	246	1.1382	0.3564	1.1382	1.0669
No log	49.6	248	1.0874	0.3737	1.0874	1.0428
No log	50.0	250	1.0629	0.3498	1.0629	1.0310
No log	50.4	252	1.0572	0.3839	1.0572	1.0282
No log	50.8	254	1.0446	0.3750	1.0446	1.0221
No log	51.2	256	1.0376	0.3787	1.0376	1.0186
No log	51.6	258	1.0609	0.3384	1.0609	1.0300
No log	52.0	260	1.1034	0.3611	1.1034	1.0504
No log	52.4	262	1.1204	0.3823	1.1204	1.0585
No log	52.8	264	1.0969	0.3830	1.0969	1.0473
No log	53.2	266	1.0969	0.3830	1.0969	1.0473
No log	53.6	268	1.0780	0.3961	1.0780	1.0383
No log	54.0	270	1.0819	0.4660	1.0819	1.0402
No log	54.4	272	1.0919	0.4263	1.0919	1.0449
No log	54.8	274	1.0894	0.4660	1.0894	1.0438
No log	55.2	276	1.0873	0.4300	1.0873	1.0428
No log	55.6	278	1.0804	0.4130	1.0804	1.0394
No log	56.0	280	1.0805	0.3802	1.0805	1.0395
No log	56.4	282	1.0774	0.3498	1.0774	1.0380
No log	56.8	284	1.0809	0.3745	1.0809	1.0396
No log	57.2	286	1.0964	0.3745	1.0964	1.0471
No log	57.6	288	1.0977	0.3585	1.0977	1.0477
No log	58.0	290	1.0947	0.3585	1.0947	1.0463
No log	58.4	292	1.0996	0.3823	1.0996	1.0486
No log	58.8	294	1.1012	0.3823	1.1012	1.0494
No log	59.2	296	1.1027	0.4264	1.1027	1.0501
No log	59.6	298	1.0924	0.4142	1.0924	1.0452
No log	60.0	300	1.0695	0.3612	1.0695	1.0342
No log	60.4	302	1.0630	0.3486	1.0630	1.0310
No log	60.8	304	1.0625	0.3612	1.0625	1.0308
No log	61.2	306	1.0767	0.3781	1.0767	1.0377
No log	61.6	308	1.1094	0.4405	1.1094	1.0533
No log	62.0	310	1.1232	0.4240	1.1232	1.0598
No log	62.4	312	1.1387	0.3610	1.1387	1.0671
No log	62.8	314	1.1051	0.4241	1.1051	1.0512
No log	63.2	316	1.0642	0.4240	1.0642	1.0316
No log	63.6	318	1.0368	0.3740	1.0368	1.0182
No log	64.0	320	1.0412	0.3724	1.0412	1.0204
No log	64.4	322	1.0724	0.4330	1.0724	1.0355
No log	64.8	324	1.1034	0.4366	1.1034	1.0504
No log	65.2	326	1.0730	0.4209	1.0730	1.0358
No log	65.6	328	1.0340	0.3976	1.0340	1.0168
No log	66.0	330	1.0222	0.3632	1.0222	1.0110
No log	66.4	332	1.0262	0.3632	1.0262	1.0130
No log	66.8	334	1.0378	0.4008	1.0378	1.0187
No log	67.2	336	1.0429	0.4008	1.0429	1.0212
No log	67.6	338	1.0440	0.4011	1.0440	1.0218
No log	68.0	340	1.0388	0.3843	1.0388	1.0192
No log	68.4	342	1.0356	0.3843	1.0356	1.0176
No log	68.8	344	1.0348	0.4304	1.0348	1.0173
No log	69.2	346	1.0302	0.4005	1.0302	1.0150
No log	69.6	348	1.0189	0.3622	1.0189	1.0094
No log	70.0	350	1.0211	0.4311	1.0211	1.0105
No log	70.4	352	1.0100	0.4196	1.0100	1.0050
No log	70.8	354	0.9981	0.4126	0.9981	0.9991
No log	71.2	356	0.9856	0.4126	0.9856	0.9928
No log	71.6	358	0.9846	0.3825	0.9846	0.9922
No log	72.0	360	0.9874	0.3825	0.9874	0.9937
No log	72.4	362	0.9862	0.3818	0.9862	0.9931
No log	72.8	364	0.9797	0.3818	0.9797	0.9898
No log	73.2	366	0.9753	0.4125	0.9753	0.9876
No log	73.6	368	0.9735	0.3612	0.9735	0.9867
No log	74.0	370	0.9771	0.4091	0.9771	0.9885
No log	74.4	372	0.9807	0.4397	0.9807	0.9903
No log	74.8	374	0.9770	0.4397	0.9770	0.9884
No log	75.2	376	0.9749	0.4401	0.9749	0.9874
No log	75.6	378	0.9685	0.4089	0.9685	0.9841
No log	76.0	380	0.9625	0.4087	0.9625	0.9811
No log	76.4	382	0.9593	0.4087	0.9593	0.9795
No log	76.8	384	0.9559	0.4087	0.9559	0.9777
No log	77.2	386	0.9603	0.3601	0.9603	0.9800
No log	77.6	388	0.9712	0.3945	0.9712	0.9855
No log	78.0	390	0.9839	0.4071	0.9839	0.9919
No log	78.4	392	1.0006	0.4069	1.0006	1.0003
No log	78.8	394	1.0042	0.4071	1.0042	1.0021
No log	79.2	396	1.0032	0.4073	1.0032	1.0016
No log	79.6	398	1.0022	0.3949	1.0022	1.0011
No log	80.0	400	0.9970	0.3612	0.9970	0.9985
No log	80.4	402	0.9942	0.3498	0.9942	0.9971
No log	80.8	404	0.9983	0.3795	0.9983	0.9992
No log	81.2	406	1.0041	0.4302	1.0041	1.0020
No log	81.6	408	1.0106	0.4597	1.0106	1.0053
No log	82.0	410	1.0200	0.4685	1.0200	1.0100
No log	82.4	412	1.0180	0.4685	1.0180	1.0090
No log	82.8	414	1.0100	0.4597	1.0100	1.0050
No log	83.2	416	1.0016	0.4093	1.0016	1.0008
No log	83.6	418	1.0011	0.3787	1.0011	1.0005
No log	84.0	420	1.0065	0.3451	1.0065	1.0032
No log	84.4	422	1.0113	0.3551	1.0113	1.0056
No log	84.8	424	1.0147	0.3551	1.0147	1.0073
No log	85.2	426	1.0161	0.3551	1.0161	1.0080
No log	85.6	428	1.0153	0.3563	1.0153	1.0076
No log	86.0	430	1.0158	0.3563	1.0158	1.0079
No log	86.4	432	1.0145	0.3728	1.0145	1.0072
No log	86.8	434	1.0109	0.3728	1.0109	1.0054
No log	87.2	436	1.0065	0.3728	1.0065	1.0033
No log	87.6	438	1.0015	0.3601	1.0015	1.0007
No log	88.0	440	0.9983	0.3473	0.9983	0.9992
No log	88.4	442	0.9969	0.3486	0.9969	0.9985
No log	88.8	444	0.9970	0.3486	0.9970	0.9985
No log	89.2	446	0.9964	0.3486	0.9964	0.9982
No log	89.6	448	0.9955	0.3486	0.9955	0.9977
No log	90.0	450	0.9945	0.3486	0.9945	0.9972
No log	90.4	452	0.9944	0.3486	0.9944	0.9972
No log	90.8	454	0.9946	0.3486	0.9946	0.9973
No log	91.2	456	0.9939	0.3486	0.9939	0.9970
No log	91.6	458	0.9933	0.3486	0.9933	0.9967
No log	92.0	460	0.9932	0.3473	0.9932	0.9966
No log	92.4	462	0.9940	0.3473	0.9940	0.9970
No log	92.8	464	0.9961	0.3473	0.9961	0.9980
No log	93.2	466	0.9982	0.3601	0.9982	0.9991
No log	93.6	468	1.0006	0.3601	1.0006	1.0003
No log	94.0	470	1.0030	0.3601	1.0030	1.0015
No log	94.4	472	1.0050	0.3601	1.0050	1.0025
No log	94.8	474	1.0074	0.3601	1.0074	1.0037
No log	95.2	476	1.0102	0.3728	1.0102	1.0051
No log	95.6	478	1.0135	0.3849	1.0135	1.0067
No log	96.0	480	1.0176	0.3849	1.0176	1.0088
No log	96.4	482	1.0195	0.3842	1.0195	1.0097
No log	96.8	484	1.0194	0.3842	1.0194	1.0097
No log	97.2	486	1.0200	0.3842	1.0200	1.0099
No log	97.6	488	1.0196	0.3842	1.0196	1.0097
No log	98.0	490	1.0183	0.3842	1.0183	1.0091
No log	98.4	492	1.0172	0.3842	1.0172	1.0086
No log	98.8	494	1.0160	0.3842	1.0160	1.0080
No log	99.2	496	1.0151	0.3842	1.0151	1.0075
No log	99.6	498	1.0143	0.3842	1.0143	1.0071
0.2332	100.0	500	1.0139	0.3842	1.0139	1.0069

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1