ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k2_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0238
• Qwk: 0.2898
• Mse: 1.0238
• Rmse: 1.0119

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	2.5043	-0.0788	2.5043	1.5825
No log	0.8	4	1.1496	0.1284	1.1496	1.0722
No log	1.2	6	0.8398	0.0535	0.8398	0.9164
No log	1.6	8	0.8665	0.0313	0.8665	0.9309
No log	2.0	10	0.9418	0.1181	0.9418	0.9705
No log	2.4	12	0.8754	0.1268	0.8754	0.9356
No log	2.8	14	0.7780	0.0804	0.7780	0.8821
No log	3.2	16	0.7806	0.0444	0.7806	0.8835
No log	3.6	18	0.7911	0.0444	0.7911	0.8895
No log	4.0	20	0.8116	0.0481	0.8116	0.9009
No log	4.4	22	0.7852	0.0444	0.7852	0.8861
No log	4.8	24	0.7556	0.1187	0.7556	0.8693
No log	5.2	26	0.7550	0.1094	0.7550	0.8689
No log	5.6	28	0.7873	0.2285	0.7873	0.8873
No log	6.0	30	0.8195	0.1867	0.8195	0.9053
No log	6.4	32	0.7905	0.1584	0.7905	0.8891
No log	6.8	34	0.8006	0.1542	0.8006	0.8947
No log	7.2	36	0.8280	0.1946	0.8280	0.9100
No log	7.6	38	1.0096	0.1501	1.0096	1.0048
No log	8.0	40	1.0556	0.1867	1.0556	1.0274
No log	8.4	42	0.9515	0.0241	0.9515	0.9754
No log	8.8	44	0.8984	0.1289	0.8984	0.9478
No log	9.2	46	0.9670	0.1385	0.9670	0.9834
No log	9.6	48	1.0413	0.2119	1.0413	1.0204
No log	10.0	50	1.1556	0.1115	1.1556	1.0750
No log	10.4	52	1.1839	0.0845	1.1839	1.0881
No log	10.8	54	1.2097	0.0686	1.2097	1.0998
No log	11.2	56	1.2016	0.0686	1.2016	1.0962
No log	11.6	58	1.1247	0.0713	1.1247	1.0605
No log	12.0	60	1.0039	0.1775	1.0039	1.0020
No log	12.4	62	0.9073	0.2239	0.9073	0.9525
No log	12.8	64	1.0174	0.1014	1.0174	1.0087
No log	13.2	66	1.2606	0.1176	1.2606	1.1228
No log	13.6	68	1.3323	0.1479	1.3323	1.1542
No log	14.0	70	1.3229	0.0704	1.3229	1.1502
No log	14.4	72	1.0368	0.1843	1.0368	1.0182
No log	14.8	74	0.9368	0.2124	0.9368	0.9679
No log	15.2	76	0.9609	0.2076	0.9609	0.9803
No log	15.6	78	1.1684	0.1086	1.1684	1.0809
No log	16.0	80	1.2916	0.1417	1.2916	1.1365
No log	16.4	82	1.2723	0.1145	1.2723	1.1279
No log	16.8	84	1.1180	0.2070	1.1180	1.0573
No log	17.2	86	0.9465	0.3134	0.9465	0.9729
No log	17.6	88	0.9163	0.3194	0.9163	0.9572
No log	18.0	90	1.0376	0.2209	1.0376	1.0186
No log	18.4	92	1.2168	0.2070	1.2168	1.1031
No log	18.8	94	1.2754	0.0727	1.2754	1.1293
No log	19.2	96	1.2909	0.1200	1.2909	1.1362
No log	19.6	98	1.2740	0.2138	1.2740	1.1287
No log	20.0	100	1.0757	0.2354	1.0757	1.0372
No log	20.4	102	0.9648	0.3134	0.9648	0.9823
No log	20.8	104	0.9900	0.2537	0.9900	0.9950
No log	21.2	106	1.0386	0.1549	1.0386	1.0191
No log	21.6	108	1.1480	0.1206	1.1480	1.0714
No log	22.0	110	1.2393	0.1254	1.2393	1.1133
No log	22.4	112	1.3027	0.1198	1.3027	1.1414
No log	22.8	114	1.2327	0.1473	1.2327	1.1102
No log	23.2	116	1.0803	0.1176	1.0803	1.0394
No log	23.6	118	1.0485	0.2330	1.0485	1.0240
No log	24.0	120	1.0691	0.2545	1.0691	1.0340
No log	24.4	122	1.1256	0.2580	1.1256	1.0610
No log	24.8	124	1.1114	0.1764	1.1114	1.0542
No log	25.2	126	1.0668	0.1576	1.0668	1.0328
No log	25.6	128	0.9976	0.1726	0.9976	0.9988
No log	26.0	130	0.9405	0.2389	0.9405	0.9698
No log	26.4	132	0.9616	0.2507	0.9616	0.9806
No log	26.8	134	0.9992	0.2872	0.9992	0.9996
No log	27.2	136	0.9222	0.3022	0.9222	0.9603
No log	27.6	138	0.8651	0.3319	0.8651	0.9301
No log	28.0	140	0.8733	0.2328	0.8733	0.9345
No log	28.4	142	0.8902	0.2440	0.8902	0.9435
No log	28.8	144	0.9273	0.2116	0.9273	0.9629
No log	29.2	146	0.9950	0.1672	0.9950	0.9975
No log	29.6	148	1.0746	0.1238	1.0746	1.0366
No log	30.0	150	1.2142	0.1583	1.2142	1.1019
No log	30.4	152	1.2794	0.1174	1.2794	1.1311
No log	30.8	154	1.2352	0.1956	1.2352	1.1114
No log	31.2	156	1.1476	0.1884	1.1476	1.0712
No log	31.6	158	1.0861	0.1451	1.0861	1.0422
No log	32.0	160	1.0964	0.0648	1.0964	1.0471
No log	32.4	162	1.1565	0.0872	1.1565	1.0754
No log	32.8	164	1.1985	0.1320	1.1985	1.0948
No log	33.2	166	1.1957	0.1550	1.1957	1.0935
No log	33.6	168	1.1242	0.1774	1.1242	1.0603
No log	34.0	170	1.0184	0.2166	1.0184	1.0092
No log	34.4	172	1.0672	0.2031	1.0672	1.0330
No log	34.8	174	1.0674	0.2961	1.0674	1.0332
No log	35.2	176	1.0550	0.2288	1.0550	1.0272
No log	35.6	178	1.0939	0.1618	1.0939	1.0459
No log	36.0	180	1.1366	0.0953	1.1366	1.0661
No log	36.4	182	1.1833	0.1618	1.1833	1.0878
No log	36.8	184	1.2085	0.2247	1.2085	1.0993
No log	37.2	186	1.1489	0.2330	1.1489	1.0719
No log	37.6	188	1.0133	0.3059	1.0133	1.0066
No log	38.0	190	0.9738	0.3110	0.9738	0.9868
No log	38.4	192	0.9567	0.2554	0.9567	0.9781
No log	38.8	194	1.0198	0.2554	1.0198	1.0099
No log	39.2	196	1.0940	0.2192	1.0940	1.0459
No log	39.6	198	1.0901	0.1726	1.0901	1.0441
No log	40.0	200	1.0486	0.2323	1.0486	1.0240
No log	40.4	202	1.0287	0.2507	1.0287	1.0142
No log	40.8	204	1.0958	0.2330	1.0958	1.0468
No log	41.2	206	1.1211	0.2330	1.1211	1.0588
No log	41.6	208	1.1175	0.2330	1.1175	1.0571
No log	42.0	210	1.0222	0.2461	1.0222	1.0110
No log	42.4	212	0.9571	0.2934	0.9571	0.9783
No log	42.8	214	0.9372	0.2934	0.9372	0.9681
No log	43.2	216	0.9523	0.2830	0.9523	0.9759
No log	43.6	218	0.9940	0.2682	0.9940	0.9970
No log	44.0	220	1.0150	0.2682	1.0150	1.0075
No log	44.4	222	0.9591	0.2898	0.9591	0.9793
No log	44.8	224	0.9037	0.3579	0.9037	0.9506
No log	45.2	226	0.8545	0.3777	0.8545	0.9244
No log	45.6	228	0.8533	0.3777	0.8533	0.9237
No log	46.0	230	0.8554	0.3409	0.8554	0.9249
No log	46.4	232	0.7829	0.3494	0.7829	0.8848
No log	46.8	234	0.7568	0.3737	0.7568	0.8700
No log	47.2	236	0.7869	0.3425	0.7869	0.8871
No log	47.6	238	0.8789	0.3579	0.8789	0.9375
No log	48.0	240	0.9512	0.3161	0.9512	0.9753
No log	48.4	242	0.9939	0.2982	0.9939	0.9969
No log	48.8	244	0.9759	0.2982	0.9759	0.9879
No log	49.2	246	0.9258	0.3161	0.9258	0.9622
No log	49.6	248	0.8924	0.3269	0.8924	0.9447
No log	50.0	250	0.8939	0.3269	0.8939	0.9455
No log	50.4	252	0.8985	0.3214	0.8985	0.9479
No log	50.8	254	0.9009	0.3359	0.9009	0.9492
No log	51.2	256	0.9503	0.3302	0.9503	0.9748
No log	51.6	258	1.0464	0.2643	1.0464	1.0229
No log	52.0	260	1.1513	0.2518	1.1513	1.0730
No log	52.4	262	1.1727	0.2518	1.1727	1.0829
No log	52.8	264	1.1205	0.2843	1.1205	1.0585
No log	53.2	266	1.0426	0.3010	1.0426	1.0211
No log	53.6	268	0.9458	0.3110	0.9458	0.9725
No log	54.0	270	0.9039	0.3110	0.9039	0.9507
No log	54.4	272	0.8963	0.3214	0.8963	0.9467
No log	54.8	274	0.9164	0.2682	0.9164	0.9573
No log	55.2	276	0.9534	0.2682	0.9534	0.9764
No log	55.6	278	1.0053	0.2682	1.0053	1.0026
No log	56.0	280	1.0373	0.2682	1.0373	1.0185
No log	56.4	282	1.0683	0.2682	1.0683	1.0336
No log	56.8	284	1.0886	0.2850	1.0886	1.0433
No log	57.2	286	1.1172	0.2687	1.1172	1.0570
No log	57.6	288	1.1151	0.2687	1.1151	1.0560
No log	58.0	290	1.0486	0.2682	1.0486	1.0240
No log	58.4	292	0.9765	0.2934	0.9765	0.9882
No log	58.8	294	0.9303	0.2754	0.9303	0.9645
No log	59.2	296	0.8948	0.2807	0.8948	0.9459
No log	59.6	298	0.9041	0.2754	0.9041	0.9508
No log	60.0	300	0.9135	0.3217	0.9135	0.9558
No log	60.4	302	0.9702	0.2999	0.9702	0.9850
No log	60.8	304	1.0872	0.2732	1.0872	1.0427
No log	61.2	306	1.1963	0.2601	1.1963	1.0937
No log	61.6	308	1.2333	0.2319	1.2333	1.1105
No log	62.0	310	1.2058	0.2319	1.2058	1.0981
No log	62.4	312	1.1687	0.2643	1.1687	1.0811
No log	62.8	314	1.1065	0.2330	1.1065	1.0519
No log	63.2	316	1.0488	0.2416	1.0488	1.0241
No log	63.6	318	1.0236	0.2461	1.0236	1.0117
No log	64.0	320	1.0416	0.2461	1.0416	1.0206
No log	64.4	322	1.0806	0.2312	1.0806	1.0395
No log	64.8	324	1.0938	0.2312	1.0938	1.0458
No log	65.2	326	1.0957	0.2312	1.0957	1.0468
No log	65.6	328	1.1094	0.2231	1.1094	1.0533
No log	66.0	330	1.0897	0.2372	1.0897	1.0439
No log	66.4	332	1.0418	0.2507	1.0418	1.0207
No log	66.8	334	1.0109	0.2554	1.0109	1.0054
No log	67.2	336	0.9840	0.2537	0.9840	0.9919
No log	67.6	338	0.9836	0.2728	0.9836	0.9918
No log	68.0	340	1.0211	0.2507	1.0211	1.0105
No log	68.4	342	1.0395	0.2461	1.0395	1.0196
No log	68.8	344	1.0772	0.2635	1.0772	1.0379
No log	69.2	346	1.1149	0.2590	1.1149	1.0559
No log	69.6	348	1.1039	0.2590	1.1039	1.0507
No log	70.0	350	1.0739	0.2372	1.0739	1.0363
No log	70.4	352	1.0404	0.2507	1.0404	1.0200
No log	70.8	354	0.9935	0.2881	0.9935	0.9968
No log	71.2	356	0.9676	0.2781	0.9676	0.9837
No log	71.6	358	0.9752	0.3052	0.9752	0.9875
No log	72.0	360	0.9769	0.3052	0.9769	0.9884
No log	72.4	362	1.0081	0.3052	1.0081	1.0041
No log	72.8	364	1.0776	0.2524	1.0776	1.0381
No log	73.2	366	1.1453	0.1943	1.1453	1.0702
No log	73.6	368	1.1644	0.1873	1.1644	1.0791
No log	74.0	370	1.1727	0.1873	1.1727	1.0829
No log	74.4	372	1.1770	0.1873	1.1770	1.0849
No log	74.8	374	1.1415	0.1873	1.1415	1.0684
No log	75.2	376	1.1092	0.2115	1.1092	1.0532
No log	75.6	378	1.0808	0.2898	1.0808	1.0396
No log	76.0	380	1.0451	0.2948	1.0451	1.0223
No log	76.4	382	1.0226	0.2806	1.0226	1.0112
No log	76.8	384	1.0140	0.3029	1.0140	1.0070
No log	77.2	386	1.0344	0.3161	1.0344	1.0171
No log	77.6	388	1.0730	0.2802	1.0730	1.0359
No log	78.0	390	1.0829	0.2687	1.0829	1.0406
No log	78.4	392	1.0565	0.2802	1.0565	1.0279
No log	78.8	394	1.0195	0.3110	1.0195	1.0097
No log	79.2	396	0.9883	0.3082	0.9883	0.9941
No log	79.6	398	0.9735	0.3082	0.9735	0.9867
No log	80.0	400	0.9817	0.3082	0.9817	0.9908
No log	80.4	402	0.9895	0.3082	0.9895	0.9947
No log	80.8	404	1.0064	0.3082	1.0064	1.0032
No log	81.2	406	1.0443	0.3110	1.0443	1.0219
No log	81.6	408	1.0929	0.2601	1.0929	1.0454
No log	82.0	410	1.1361	0.2319	1.1361	1.0659
No log	82.4	412	1.1534	0.2280	1.1534	1.0740
No log	82.8	414	1.1552	0.2280	1.1552	1.0748
No log	83.2	416	1.1361	0.2280	1.1361	1.0659
No log	83.6	418	1.1090	0.2319	1.1090	1.0531
No log	84.0	420	1.0682	0.2643	1.0682	1.0335
No log	84.4	422	1.0314	0.2898	1.0314	1.0156
No log	84.8	424	1.0096	0.2577	1.0096	1.0048
No log	85.2	426	1.0108	0.2806	1.0108	1.0054
No log	85.6	428	1.0292	0.2948	1.0292	1.0145
No log	86.0	430	1.0497	0.2850	1.0497	1.0245
No log	86.4	432	1.0606	0.2545	1.0606	1.0298
No log	86.8	434	1.0645	0.2590	1.0645	1.0317
No log	87.2	436	1.0567	0.2590	1.0567	1.0279
No log	87.6	438	1.0379	0.2590	1.0379	1.0188
No log	88.0	440	1.0118	0.2756	1.0118	1.0059
No log	88.4	442	0.9808	0.3029	0.9808	0.9903
No log	88.8	444	0.9686	0.3029	0.9686	0.9842
No log	89.2	446	0.9716	0.3029	0.9716	0.9857
No log	89.6	448	0.9889	0.3029	0.9889	0.9944
No log	90.0	450	1.0088	0.2977	1.0088	1.0044
No log	90.4	452	1.0223	0.2898	1.0223	1.0111
No log	90.8	454	1.0382	0.2898	1.0382	1.0189
No log	91.2	456	1.0432	0.2590	1.0432	1.0214
No log	91.6	458	1.0437	0.2898	1.0437	1.0216
No log	92.0	460	1.0541	0.2590	1.0541	1.0267
No log	92.4	462	1.0675	0.2590	1.0675	1.0332
No log	92.8	464	1.0758	0.2590	1.0758	1.0372
No log	93.2	466	1.0764	0.2481	1.0764	1.0375
No log	93.6	468	1.0694	0.2590	1.0694	1.0341
No log	94.0	470	1.0591	0.2898	1.0591	1.0291
No log	94.4	472	1.0470	0.2898	1.0470	1.0232
No log	94.8	474	1.0427	0.2898	1.0427	1.0211
No log	95.2	476	1.0401	0.2898	1.0401	1.0199
No log	95.6	478	1.0364	0.2898	1.0364	1.0180
No log	96.0	480	1.0309	0.2898	1.0309	1.0153
No log	96.4	482	1.0296	0.2898	1.0296	1.0147
No log	96.8	484	1.0257	0.2898	1.0257	1.0128
No log	97.2	486	1.0236	0.2898	1.0236	1.0117
No log	97.6	488	1.0233	0.2898	1.0233	1.0116
No log	98.0	490	1.0236	0.2898	1.0236	1.0117
No log	98.4	492	1.0240	0.2898	1.0240	1.0119
No log	98.8	494	1.0237	0.2898	1.0237	1.0118
No log	99.2	496	1.0235	0.2898	1.0235	1.0117
No log	99.6	498	1.0237	0.2898	1.0237	1.0118
0.1613	100.0	500	1.0238	0.2898	1.0238	1.0119

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1