ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7791
• Qwk: 0.5959
• Mse: 0.7791
• Rmse: 0.8827

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0241	2	5.3661	0.0048	5.3661	2.3165
No log	0.0482	4	3.2883	0.0615	3.2883	1.8134
No log	0.0723	6	1.9158	0.0676	1.9158	1.3841
No log	0.0964	8	1.5735	0.1787	1.5735	1.2544
No log	0.1205	10	1.2142	0.2529	1.2142	1.1019
No log	0.1446	12	1.2045	0.2386	1.2045	1.0975
No log	0.1687	14	1.4817	0.0760	1.4817	1.2172
No log	0.1928	16	1.4800	0.0216	1.4800	1.2165
No log	0.2169	18	1.2039	0.1671	1.2039	1.0972
No log	0.2410	20	1.1575	0.2064	1.1575	1.0759
No log	0.2651	22	1.1543	0.1997	1.1543	1.0744
No log	0.2892	24	1.1560	0.0868	1.1560	1.0752
No log	0.3133	26	1.1859	0.0550	1.1859	1.0890
No log	0.3373	28	1.2052	0.0647	1.2052	1.0978
No log	0.3614	30	1.2057	0.0465	1.2057	1.0981
No log	0.3855	32	1.1680	0.0599	1.1680	1.0807
No log	0.4096	34	1.1268	0.1743	1.1268	1.0615
No log	0.4337	36	1.1347	0.3022	1.1347	1.0652
No log	0.4578	38	1.1211	0.3029	1.1211	1.0588
No log	0.4819	40	1.0628	0.2611	1.0628	1.0309
No log	0.5060	42	1.0593	0.2405	1.0593	1.0292
No log	0.5301	44	1.1914	0.1467	1.1914	1.0915
No log	0.5542	46	1.2040	0.1012	1.2040	1.0973
No log	0.5783	48	1.1583	0.0918	1.1583	1.0762
No log	0.6024	50	1.0824	0.1933	1.0824	1.0404
No log	0.6265	52	1.0208	0.2261	1.0208	1.0104
No log	0.6506	54	0.9401	0.3209	0.9401	0.9696
No log	0.6747	56	0.9724	0.3802	0.9724	0.9861
No log	0.6988	58	1.0117	0.3702	1.0117	1.0058
No log	0.7229	60	0.9010	0.4783	0.9010	0.9492
No log	0.7470	62	0.8730	0.5094	0.8730	0.9343
No log	0.7711	64	0.9589	0.4640	0.9589	0.9792
No log	0.7952	66	1.0180	0.4920	1.0180	1.0090
No log	0.8193	68	0.9862	0.5069	0.9862	0.9931
No log	0.8434	70	1.0060	0.4860	1.0060	1.0030
No log	0.8675	72	1.0872	0.4483	1.0872	1.0427
No log	0.8916	74	1.0732	0.4547	1.0732	1.0360
No log	0.9157	76	1.0651	0.5086	1.0651	1.0320
No log	0.9398	78	1.0280	0.5084	1.0280	1.0139
No log	0.9639	80	0.9423	0.4972	0.9423	0.9707
No log	0.9880	82	0.8797	0.5257	0.8797	0.9379
No log	1.0120	84	0.9131	0.5644	0.9131	0.9556
No log	1.0361	86	1.0417	0.4745	1.0417	1.0207
No log	1.0602	88	1.0759	0.4627	1.0759	1.0373
No log	1.0843	90	1.0775	0.4613	1.0775	1.0380
No log	1.1084	92	0.9745	0.5181	0.9745	0.9872
No log	1.1325	94	0.8981	0.5739	0.8981	0.9477
No log	1.1566	96	0.9059	0.5640	0.9059	0.9518
No log	1.1807	98	0.9649	0.5542	0.9649	0.9823
No log	1.2048	100	1.0288	0.5300	1.0288	1.0143
No log	1.2289	102	1.2150	0.4777	1.2150	1.1023
No log	1.2530	104	1.1557	0.4616	1.1557	1.0751
No log	1.2771	106	1.0119	0.4856	1.0119	1.0059
No log	1.3012	108	0.9210	0.5174	0.9210	0.9597
No log	1.3253	110	0.8475	0.5648	0.8475	0.9206
No log	1.3494	112	0.8236	0.5601	0.8236	0.9075
No log	1.3735	114	0.8223	0.5596	0.8223	0.9068
No log	1.3976	116	0.9083	0.5602	0.9083	0.9531
No log	1.4217	118	1.0170	0.5083	1.0170	1.0085
No log	1.4458	120	1.1300	0.4615	1.1300	1.0630
No log	1.4699	122	1.1033	0.5347	1.1033	1.0504
No log	1.4940	124	1.0580	0.5615	1.0580	1.0286
No log	1.5181	126	1.0872	0.5324	1.0872	1.0427
No log	1.5422	128	1.1901	0.4602	1.1901	1.0909
No log	1.5663	130	1.3228	0.4215	1.3228	1.1501
No log	1.5904	132	1.4893	0.3711	1.4893	1.2204
No log	1.6145	134	1.6345	0.3812	1.6345	1.2785
No log	1.6386	136	1.6001	0.3692	1.6001	1.2650
No log	1.6627	138	1.3793	0.3981	1.3793	1.1744
No log	1.6867	140	1.0139	0.5297	1.0139	1.0069
No log	1.7108	142	0.8017	0.6209	0.8017	0.8954
No log	1.7349	144	0.7640	0.5974	0.7640	0.8741
No log	1.7590	146	0.7456	0.6100	0.7456	0.8635
No log	1.7831	148	0.7504	0.6574	0.7504	0.8663
No log	1.8072	150	0.9106	0.5704	0.9106	0.9543
No log	1.8313	152	1.1946	0.4875	1.1946	1.0930
No log	1.8554	154	1.6096	0.3700	1.6096	1.2687
No log	1.8795	156	1.6849	0.3844	1.6849	1.2980
No log	1.9036	158	1.4139	0.4658	1.4139	1.1891
No log	1.9277	160	1.2069	0.4822	1.2069	1.0986
No log	1.9518	162	1.0871	0.4992	1.0871	1.0426
No log	1.9759	164	1.0486	0.5144	1.0486	1.0240
No log	2.0	166	0.9470	0.5988	0.9470	0.9731
No log	2.0241	168	0.8511	0.6185	0.8511	0.9226
No log	2.0482	170	0.8183	0.6446	0.8183	0.9046
No log	2.0723	172	0.7692	0.6388	0.7692	0.8770
No log	2.0964	174	0.8152	0.6242	0.8152	0.9029
No log	2.1205	176	0.9450	0.5470	0.9450	0.9721
No log	2.1446	178	1.0670	0.5415	1.0670	1.0330
No log	2.1687	180	1.1413	0.5321	1.1413	1.0683
No log	2.1928	182	1.3581	0.4893	1.3581	1.1654
No log	2.2169	184	1.4486	0.4585	1.4486	1.2036
No log	2.2410	186	1.4512	0.4407	1.4512	1.2047
No log	2.2651	188	1.3203	0.4007	1.3203	1.1490
No log	2.2892	190	1.3796	0.3916	1.3796	1.1746
No log	2.3133	192	1.5581	0.3109	1.5581	1.2482
No log	2.3373	194	1.6275	0.2865	1.6275	1.2757
No log	2.3614	196	1.5324	0.3951	1.5324	1.2379
No log	2.3855	198	1.2620	0.4868	1.2620	1.1234
No log	2.4096	200	1.0132	0.5576	1.0132	1.0066
No log	2.4337	202	0.9338	0.5508	0.9338	0.9663
No log	2.4578	204	1.0033	0.5414	1.0033	1.0017
No log	2.4819	206	0.9274	0.5900	0.9274	0.9630
No log	2.5060	208	0.7630	0.6396	0.7630	0.8735
No log	2.5301	210	0.6953	0.6007	0.6953	0.8338
No log	2.5542	212	0.6857	0.6223	0.6857	0.8281
No log	2.5783	214	0.6893	0.6360	0.6893	0.8302
No log	2.6024	216	0.6868	0.6482	0.6868	0.8287
No log	2.6265	218	0.7445	0.6361	0.7445	0.8629
No log	2.6506	220	0.8293	0.6121	0.8293	0.9107
No log	2.6747	222	0.8638	0.6121	0.8638	0.9294
No log	2.6988	224	0.8405	0.5965	0.8405	0.9168
No log	2.7229	226	0.7628	0.6445	0.7628	0.8734
No log	2.7470	228	0.7423	0.6696	0.7423	0.8616
No log	2.7711	230	0.7686	0.6706	0.7686	0.8767
No log	2.7952	232	0.8020	0.6352	0.8020	0.8956
No log	2.8193	234	0.8784	0.5410	0.8784	0.9373
No log	2.8434	236	0.8406	0.6136	0.8406	0.9168
No log	2.8675	238	0.7753	0.6353	0.7753	0.8805
No log	2.8916	240	0.7359	0.6419	0.7359	0.8578
No log	2.9157	242	0.7611	0.6453	0.7611	0.8724
No log	2.9398	244	0.8477	0.5842	0.8477	0.9207
No log	2.9639	246	0.9839	0.5264	0.9839	0.9919
No log	2.9880	248	0.9571	0.5259	0.9571	0.9783
No log	3.0120	250	0.8599	0.5817	0.8599	0.9273
No log	3.0361	252	0.7619	0.6483	0.7619	0.8729
No log	3.0602	254	0.6383	0.6662	0.6383	0.7989
No log	3.0843	256	0.6179	0.6984	0.6179	0.7861
No log	3.1084	258	0.6174	0.6885	0.6174	0.7857
No log	3.1325	260	0.6400	0.6920	0.6400	0.8000
No log	3.1566	262	0.7325	0.6882	0.7325	0.8559
No log	3.1807	264	0.9164	0.6502	0.9164	0.9573
No log	3.2048	266	1.0714	0.5685	1.0714	1.0351
No log	3.2289	268	1.0774	0.5729	1.0774	1.0380
No log	3.2530	270	1.0253	0.5832	1.0253	1.0126
No log	3.2771	272	0.9990	0.5955	0.9990	0.9995
No log	3.3012	274	1.0604	0.5542	1.0604	1.0298
No log	3.3253	276	1.1893	0.4909	1.1893	1.0905
No log	3.3494	278	1.1676	0.4947	1.1676	1.0805
No log	3.3735	280	1.1918	0.5000	1.1918	1.0917
No log	3.3976	282	1.1673	0.5298	1.1673	1.0804
No log	3.4217	284	1.1329	0.5298	1.1329	1.0644
No log	3.4458	286	1.1451	0.5406	1.1451	1.0701
No log	3.4699	288	1.1667	0.5233	1.1667	1.0802
No log	3.4940	290	1.2294	0.5155	1.2294	1.1088
No log	3.5181	292	1.3422	0.4998	1.3422	1.1585
No log	3.5422	294	1.4280	0.4843	1.4280	1.1950
No log	3.5663	296	1.3118	0.4967	1.3118	1.1453
No log	3.5904	298	1.1085	0.5536	1.1085	1.0529
No log	3.6145	300	1.0774	0.5455	1.0774	1.0380
No log	3.6386	302	1.1559	0.4973	1.1559	1.0751
No log	3.6627	304	1.2361	0.4571	1.2361	1.1118
No log	3.6867	306	1.0986	0.4994	1.0986	1.0481
No log	3.7108	308	0.8962	0.6162	0.8962	0.9467
No log	3.7349	310	0.7716	0.5913	0.7716	0.8784
No log	3.7590	312	0.7398	0.6276	0.7398	0.8601
No log	3.7831	314	0.7962	0.6142	0.7962	0.8923
No log	3.8072	316	0.9623	0.5755	0.9623	0.9810
No log	3.8313	318	0.9965	0.5515	0.9965	0.9982
No log	3.8554	320	0.9259	0.6343	0.9259	0.9622
No log	3.8795	322	0.9062	0.6346	0.9062	0.9520
No log	3.9036	324	0.9734	0.6003	0.9734	0.9866
No log	3.9277	326	1.0858	0.5764	1.0858	1.0420
No log	3.9518	328	1.1070	0.5639	1.1070	1.0521
No log	3.9759	330	1.0526	0.5637	1.0526	1.0260
No log	4.0	332	1.0502	0.5764	1.0502	1.0248
No log	4.0241	334	1.0328	0.6013	1.0328	1.0163
No log	4.0482	336	1.0366	0.6013	1.0366	1.0182
No log	4.0723	338	1.0330	0.6027	1.0330	1.0163
No log	4.0964	340	1.0126	0.6027	1.0126	1.0063
No log	4.1205	342	1.0488	0.6013	1.0488	1.0241
No log	4.1446	344	1.1227	0.5235	1.1227	1.0596
No log	4.1687	346	1.0689	0.5616	1.0689	1.0339
No log	4.1928	348	1.0091	0.5924	1.0091	1.0045
No log	4.2169	350	0.8825	0.6501	0.8825	0.9394
No log	4.2410	352	0.7860	0.6786	0.7860	0.8866
No log	4.2651	354	0.7830	0.6558	0.7830	0.8849
No log	4.2892	356	0.8583	0.6193	0.8583	0.9264
No log	4.3133	358	0.9282	0.5909	0.9282	0.9634
No log	4.3373	360	0.8842	0.6111	0.8842	0.9403
No log	4.3614	362	0.8000	0.6449	0.8000	0.8944
No log	4.3855	364	0.7788	0.6735	0.7788	0.8825
No log	4.4096	366	0.8571	0.6143	0.8571	0.9258
No log	4.4337	368	1.1049	0.6080	1.1049	1.0511
No log	4.4578	370	1.3363	0.4718	1.3363	1.1560
No log	4.4819	372	1.3614	0.4535	1.3614	1.1668
No log	4.5060	374	1.3483	0.4801	1.3483	1.1612
No log	4.5301	376	1.3258	0.5124	1.3258	1.1514
No log	4.5542	378	1.0951	0.6131	1.0951	1.0465
No log	4.5783	380	0.7884	0.6514	0.7884	0.8879
No log	4.6024	382	0.6626	0.6641	0.6626	0.8140
No log	4.6265	384	0.6612	0.6827	0.6612	0.8131
No log	4.6506	386	0.6597	0.6691	0.6597	0.8122
No log	4.6747	388	0.6519	0.7012	0.6519	0.8074
No log	4.6988	390	0.6949	0.6692	0.6949	0.8336
No log	4.7229	392	0.9042	0.6494	0.9042	0.9509
No log	4.7470	394	1.0757	0.6435	1.0757	1.0372
No log	4.7711	396	1.2127	0.5544	1.2127	1.1012
No log	4.7952	398	1.3789	0.4871	1.3789	1.1743
No log	4.8193	400	1.4682	0.4816	1.4682	1.2117
No log	4.8434	402	1.4691	0.4947	1.4691	1.2120
No log	4.8675	404	1.4554	0.5054	1.4554	1.2064
No log	4.8916	406	1.3286	0.5008	1.3286	1.1526
No log	4.9157	408	1.3296	0.5150	1.3296	1.1531
No log	4.9398	410	1.3181	0.5185	1.3181	1.1481
No log	4.9639	412	1.2615	0.5507	1.2615	1.1232
No log	4.9880	414	1.1114	0.6197	1.1114	1.0542
No log	5.0120	416	1.0389	0.6307	1.0389	1.0193
No log	5.0361	418	0.9732	0.6542	0.9732	0.9865
No log	5.0602	420	0.9025	0.6580	0.9025	0.9500
No log	5.0843	422	0.9100	0.6749	0.9100	0.9539
No log	5.1084	424	1.0326	0.6342	1.0326	1.0162
No log	5.1325	426	1.2373	0.5719	1.2373	1.1123
No log	5.1566	428	1.2641	0.5266	1.2641	1.1243
No log	5.1807	430	1.2096	0.5437	1.2096	1.0998
No log	5.2048	432	1.0810	0.5651	1.0810	1.0397
No log	5.2289	434	1.0681	0.5818	1.0681	1.0335
No log	5.2530	436	1.1087	0.6008	1.1087	1.0529
No log	5.2771	438	0.9870	0.6329	0.9870	0.9935
No log	5.3012	440	0.8994	0.6340	0.8994	0.9483
No log	5.3253	442	0.9061	0.6352	0.9061	0.9519
No log	5.3494	444	0.8734	0.6308	0.8734	0.9345
No log	5.3735	446	0.7783	0.6544	0.7783	0.8822
No log	5.3976	448	0.7056	0.6782	0.7056	0.8400
No log	5.4217	450	0.6898	0.6988	0.6898	0.8305
No log	5.4458	452	0.7044	0.6863	0.7044	0.8393
No log	5.4699	454	0.7410	0.6869	0.7410	0.8608
No log	5.4940	456	0.7590	0.6924	0.7590	0.8712
No log	5.5181	458	0.7214	0.7154	0.7214	0.8494
No log	5.5422	460	0.6756	0.7223	0.6756	0.8220
No log	5.5663	462	0.6709	0.7186	0.6709	0.8191
No log	5.5904	464	0.6608	0.7216	0.6608	0.8129
No log	5.6145	466	0.6705	0.7088	0.6705	0.8188
No log	5.6386	468	0.6958	0.7255	0.6958	0.8341
No log	5.6627	470	0.6775	0.7189	0.6775	0.8231
No log	5.6867	472	0.6616	0.7180	0.6616	0.8134
No log	5.7108	474	0.6648	0.7180	0.6648	0.8153
No log	5.7349	476	0.7127	0.6916	0.7127	0.8442
No log	5.7590	478	0.7819	0.6480	0.7819	0.8842
No log	5.7831	480	0.9148	0.6442	0.9148	0.9564
No log	5.8072	482	1.0795	0.5939	1.0795	1.0390
No log	5.8313	484	1.1930	0.5763	1.1930	1.0922
No log	5.8554	486	1.2076	0.5361	1.2076	1.0989
No log	5.8795	488	1.1971	0.5245	1.1971	1.0941
No log	5.9036	490	1.1681	0.5245	1.1681	1.0808
No log	5.9277	492	1.1211	0.5519	1.1211	1.0588
No log	5.9518	494	0.9539	0.6225	0.9539	0.9767
No log	5.9759	496	0.8041	0.6920	0.8041	0.8967
No log	6.0	498	0.7271	0.7069	0.7271	0.8527
0.4471	6.0241	500	0.7192	0.6941	0.7192	0.8480
0.4471	6.0482	502	0.7546	0.6792	0.7546	0.8687
0.4471	6.0723	504	0.7720	0.6832	0.7720	0.8786
0.4471	6.0964	506	0.7982	0.6049	0.7982	0.8934
0.4471	6.1205	508	0.7904	0.5962	0.7904	0.8890
0.4471	6.1446	510	0.7791	0.5959	0.7791	0.8827

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1