ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8208
• Qwk: 0.6279
• Mse: 0.8208
• Rmse: 0.9060

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	5.3366	-0.0339	5.3366	2.3101
No log	0.0909	4	3.1912	0.0571	3.1912	1.7864
No log	0.1364	6	2.1756	-0.0397	2.1756	1.4750
No log	0.1818	8	1.6658	0.0745	1.6658	1.2907
No log	0.2273	10	1.3999	0.1436	1.3999	1.1832
No log	0.2727	12	1.2088	0.1805	1.2088	1.0995
No log	0.3182	14	1.1859	0.2067	1.1859	1.0890
No log	0.3636	16	1.1807	0.2067	1.1807	1.0866
No log	0.4091	18	1.1241	0.2034	1.1241	1.0602
No log	0.4545	20	1.3373	0.1440	1.3373	1.1564
No log	0.5	22	1.6268	0.0210	1.6268	1.2755
No log	0.5455	24	1.3489	0.1057	1.3489	1.1614
No log	0.5909	26	1.0180	0.3627	1.0180	1.0090
No log	0.6364	28	1.1302	0.3528	1.1302	1.0631
No log	0.6818	30	1.0391	0.4132	1.0391	1.0194
No log	0.7273	32	1.0186	0.3419	1.0186	1.0093
No log	0.7727	34	1.7566	-0.0978	1.7566	1.3254
No log	0.8182	36	2.0597	-0.2665	2.0597	1.4352
No log	0.8636	38	1.7178	-0.0676	1.7178	1.3107
No log	0.9091	40	0.9978	0.3351	0.9978	0.9989
No log	0.9545	42	0.8251	0.4367	0.8251	0.9083
No log	1.0	44	0.8460	0.4489	0.8460	0.9198
No log	1.0455	46	0.8051	0.4715	0.8051	0.8973
No log	1.0909	48	0.8520	0.5257	0.8520	0.9230
No log	1.1364	50	0.9046	0.5106	0.9046	0.9511
No log	1.1818	52	0.8447	0.5617	0.8447	0.9191
No log	1.2273	54	0.7704	0.6025	0.7704	0.8777
No log	1.2727	56	0.7498	0.5993	0.7498	0.8659
No log	1.3182	58	0.7317	0.6593	0.7317	0.8554
No log	1.3636	60	0.8623	0.5600	0.8623	0.9286
No log	1.4091	62	1.1275	0.4180	1.1275	1.0619
No log	1.4545	64	1.1076	0.4217	1.1076	1.0524
No log	1.5	66	0.8538	0.6355	0.8538	0.9240
No log	1.5455	68	0.7639	0.6825	0.7639	0.8740
No log	1.5909	70	0.9006	0.5587	0.9006	0.9490
No log	1.6364	72	0.8298	0.6145	0.8298	0.9109
No log	1.6818	74	0.8342	0.6353	0.8342	0.9134
No log	1.7273	76	0.8996	0.6052	0.8996	0.9485
No log	1.7727	78	0.9021	0.5855	0.9021	0.9498
No log	1.8182	80	0.8742	0.5043	0.8742	0.9350
No log	1.8636	82	0.8181	0.4379	0.8181	0.9045
No log	1.9091	84	0.8095	0.4816	0.8095	0.8997
No log	1.9545	86	0.7787	0.4796	0.7787	0.8825
No log	2.0	88	0.7843	0.5368	0.7843	0.8856
No log	2.0455	90	0.9224	0.5111	0.9224	0.9604
No log	2.0909	92	0.9337	0.5037	0.9337	0.9663
No log	2.1364	94	0.7863	0.6049	0.7863	0.8867
No log	2.1818	96	0.8057	0.5365	0.8057	0.8976
No log	2.2273	98	0.9216	0.4991	0.9216	0.9600
No log	2.2727	100	0.8529	0.5255	0.8529	0.9235
No log	2.3182	102	0.7456	0.5814	0.7456	0.8635
No log	2.3636	104	0.8677	0.5704	0.8677	0.9315
No log	2.4091	106	0.9990	0.5228	0.9990	0.9995
No log	2.4545	108	0.9504	0.5553	0.9504	0.9749
No log	2.5	110	0.7991	0.6265	0.7991	0.8939
No log	2.5455	112	0.7684	0.6564	0.7684	0.8766
No log	2.5909	114	0.7688	0.6396	0.7688	0.8768
No log	2.6364	116	0.8042	0.6034	0.8042	0.8968
No log	2.6818	118	0.8582	0.5429	0.8582	0.9264
No log	2.7273	120	0.8737	0.5306	0.8737	0.9347
No log	2.7727	122	0.8441	0.5998	0.8441	0.9188
No log	2.8182	124	0.8887	0.5691	0.8887	0.9427
No log	2.8636	126	0.8881	0.5916	0.8881	0.9424
No log	2.9091	128	0.8445	0.6626	0.8445	0.9190
No log	2.9545	130	0.8272	0.6512	0.8272	0.9095
No log	3.0	132	0.8264	0.6333	0.8264	0.9091
No log	3.0455	134	0.8797	0.6470	0.8797	0.9379
No log	3.0909	136	0.8025	0.6468	0.8025	0.8958
No log	3.1364	138	0.7702	0.6504	0.7702	0.8776
No log	3.1818	140	0.7946	0.6627	0.7946	0.8914
No log	3.2273	142	0.8244	0.6654	0.8244	0.9080
No log	3.2727	144	0.8020	0.6661	0.8020	0.8955
No log	3.3182	146	0.7853	0.6817	0.7853	0.8862
No log	3.3636	148	0.7916	0.6719	0.7916	0.8897
No log	3.4091	150	0.7780	0.6533	0.7780	0.8821
No log	3.4545	152	0.8236	0.6309	0.8236	0.9075
No log	3.5	154	0.9484	0.6030	0.9484	0.9739
No log	3.5455	156	0.9042	0.6023	0.9042	0.9509
No log	3.5909	158	0.8204	0.6470	0.8204	0.9057
No log	3.6364	160	0.8002	0.6477	0.8002	0.8946
No log	3.6818	162	0.8162	0.6727	0.8162	0.9034
No log	3.7273	164	0.8162	0.6561	0.8162	0.9034
No log	3.7727	166	0.8615	0.6118	0.8615	0.9282
No log	3.8182	168	0.8307	0.6440	0.8307	0.9115
No log	3.8636	170	0.8456	0.6501	0.8456	0.9195
No log	3.9091	172	0.9229	0.6106	0.9229	0.9607
No log	3.9545	174	0.9644	0.5952	0.9644	0.9821
No log	4.0	176	1.0522	0.5826	1.0522	1.0258
No log	4.0455	178	0.9455	0.6058	0.9455	0.9724
No log	4.0909	180	0.7932	0.6725	0.7932	0.8906
No log	4.1364	182	0.8199	0.6539	0.8199	0.9055
No log	4.1818	184	0.8121	0.6496	0.8121	0.9012
No log	4.2273	186	0.7124	0.7057	0.7124	0.8440
No log	4.2727	188	0.7285	0.6997	0.7285	0.8535
No log	4.3182	190	0.8440	0.5989	0.8440	0.9187
No log	4.3636	192	0.8257	0.6317	0.8257	0.9087
No log	4.4091	194	0.7268	0.6782	0.7268	0.8525
No log	4.4545	196	0.7564	0.6762	0.7564	0.8697
No log	4.5	198	0.8440	0.6111	0.8440	0.9187
No log	4.5455	200	0.7703	0.6647	0.7703	0.8777
No log	4.5909	202	0.7210	0.6872	0.7210	0.8491
No log	4.6364	204	0.9891	0.5436	0.9891	0.9945
No log	4.6818	206	1.1799	0.5095	1.1799	1.0862
No log	4.7273	208	1.1095	0.5166	1.1095	1.0533
No log	4.7727	210	0.8941	0.5920	0.8941	0.9456
No log	4.8182	212	0.7646	0.6908	0.7646	0.8744
No log	4.8636	214	0.7561	0.6971	0.7561	0.8696
No log	4.9091	216	0.8034	0.6673	0.8034	0.8963
No log	4.9545	218	0.8858	0.6168	0.8858	0.9412
No log	5.0	220	0.9953	0.5617	0.9953	0.9976
No log	5.0455	222	0.9851	0.5683	0.9851	0.9925
No log	5.0909	224	0.9337	0.5843	0.9337	0.9663
No log	5.1364	226	0.9390	0.5571	0.9390	0.9690
No log	5.1818	228	0.9153	0.5846	0.9153	0.9567
No log	5.2273	230	0.9566	0.5572	0.9566	0.9781
No log	5.2727	232	0.9391	0.5880	0.9391	0.9691
No log	5.3182	234	0.9955	0.5568	0.9955	0.9978
No log	5.3636	236	1.0814	0.5431	1.0814	1.0399
No log	5.4091	238	0.9538	0.5954	0.9538	0.9766
No log	5.4545	240	0.7627	0.6959	0.7627	0.8733
No log	5.5	242	0.7495	0.7192	0.7495	0.8658
No log	5.5455	244	0.7187	0.6949	0.7187	0.8478
No log	5.5909	246	0.7425	0.7112	0.7425	0.8617
No log	5.6364	248	0.8042	0.6575	0.8042	0.8968
No log	5.6818	250	0.8722	0.6113	0.8722	0.9339
No log	5.7273	252	0.8195	0.6521	0.8195	0.9053
No log	5.7727	254	0.6946	0.7239	0.6946	0.8334
No log	5.8182	256	0.6807	0.7337	0.6807	0.8251
No log	5.8636	258	0.7033	0.7268	0.7033	0.8386
No log	5.9091	260	0.7708	0.6816	0.7708	0.8779
No log	5.9545	262	0.8681	0.6505	0.8681	0.9317
No log	6.0	264	0.8236	0.6726	0.8236	0.9075
No log	6.0455	266	0.7991	0.6771	0.7991	0.8939
No log	6.0909	268	0.8354	0.6430	0.8354	0.9140
No log	6.1364	270	0.7868	0.6515	0.7868	0.8870
No log	6.1818	272	0.7466	0.6787	0.7466	0.8640
No log	6.2273	274	0.7254	0.6711	0.7254	0.8517
No log	6.2727	276	0.7109	0.6841	0.7109	0.8432
No log	6.3182	278	0.7371	0.6664	0.7371	0.8586
No log	6.3636	280	0.7194	0.6694	0.7194	0.8481
No log	6.4091	282	0.6840	0.6917	0.6840	0.8271
No log	6.4545	284	0.6851	0.6836	0.6851	0.8277
No log	6.5	286	0.7099	0.6857	0.7099	0.8426
No log	6.5455	288	0.8258	0.6140	0.8258	0.9087
No log	6.5909	290	0.8743	0.5613	0.8743	0.9350
No log	6.6364	292	0.7896	0.6161	0.7896	0.8886
No log	6.6818	294	0.6772	0.7027	0.6772	0.8229
No log	6.7273	296	0.6694	0.7164	0.6694	0.8182
No log	6.7727	298	0.6706	0.7212	0.6706	0.8189
No log	6.8182	300	0.7277	0.6374	0.7277	0.8531
No log	6.8636	302	0.9109	0.5475	0.9109	0.9544
No log	6.9091	304	0.9897	0.5394	0.9897	0.9948
No log	6.9545	306	0.9030	0.5341	0.9030	0.9503
No log	7.0	308	0.7896	0.5715	0.7896	0.8886
No log	7.0455	310	0.6926	0.6444	0.6926	0.8322
No log	7.0909	312	0.6673	0.7093	0.6673	0.8169
No log	7.1364	314	0.7010	0.6920	0.7010	0.8372
No log	7.1818	316	0.7084	0.7043	0.7084	0.8417
No log	7.2273	318	0.7602	0.6455	0.7602	0.8719
No log	7.2727	320	0.9069	0.6024	0.9069	0.9523
No log	7.3182	322	0.8998	0.5820	0.8998	0.9486
No log	7.3636	324	0.7872	0.6123	0.7872	0.8873
No log	7.4091	326	0.6983	0.6899	0.6983	0.8356
No log	7.4545	328	0.6757	0.7144	0.6757	0.8220
No log	7.5	330	0.6846	0.6775	0.6846	0.8274
No log	7.5455	332	0.6960	0.6951	0.6960	0.8343
No log	7.5909	334	0.7076	0.6846	0.7076	0.8412
No log	7.6364	336	0.7131	0.6940	0.7131	0.8445
No log	7.6818	338	0.7062	0.6847	0.7062	0.8404
No log	7.7273	340	0.7169	0.6875	0.7169	0.8467
No log	7.7727	342	0.7074	0.6970	0.7074	0.8411
No log	7.8182	344	0.6906	0.6846	0.6906	0.8310
No log	7.8636	346	0.6942	0.7110	0.6942	0.8332
No log	7.9091	348	0.7102	0.6865	0.7102	0.8427
No log	7.9545	350	0.7171	0.7032	0.7171	0.8468
No log	8.0	352	0.7282	0.6912	0.7282	0.8533
No log	8.0455	354	0.7385	0.6934	0.7385	0.8594
No log	8.0909	356	0.7547	0.6440	0.7547	0.8687
No log	8.1364	358	0.8572	0.6059	0.8572	0.9258
No log	8.1818	360	0.9324	0.5926	0.9324	0.9656
No log	8.2273	362	0.9619	0.5928	0.9619	0.9808
No log	8.2727	364	0.9338	0.5939	0.9338	0.9663
No log	8.3182	366	0.8920	0.5942	0.8920	0.9445
No log	8.3636	368	0.8701	0.6224	0.8701	0.9328
No log	8.4091	370	0.7802	0.6532	0.7802	0.8833
No log	8.4545	372	0.7578	0.6635	0.7578	0.8705
No log	8.5	374	0.7213	0.6991	0.7213	0.8493
No log	8.5455	376	0.7091	0.6886	0.7091	0.8421
No log	8.5909	378	0.7348	0.6645	0.7348	0.8572
No log	8.6364	380	0.7640	0.6595	0.7640	0.8741
No log	8.6818	382	0.8190	0.6057	0.8190	0.9050
No log	8.7273	384	0.7928	0.6286	0.7928	0.8904
No log	8.7727	386	0.7659	0.6478	0.7659	0.8751
No log	8.8182	388	0.7166	0.6314	0.7166	0.8465
No log	8.8636	390	0.7024	0.6786	0.7024	0.8381
No log	8.9091	392	0.6869	0.6852	0.6869	0.8288
No log	8.9545	394	0.6834	0.6907	0.6834	0.8267
No log	9.0	396	0.7482	0.6682	0.7482	0.8650
No log	9.0455	398	0.7438	0.6624	0.7438	0.8624
No log	9.0909	400	0.6648	0.6748	0.6648	0.8154
No log	9.1364	402	0.7148	0.6254	0.7148	0.8454
No log	9.1818	404	0.8557	0.6222	0.8557	0.9250
No log	9.2273	406	0.8557	0.6222	0.8557	0.9250
No log	9.2727	408	0.7669	0.6384	0.7669	0.8757
No log	9.3182	410	0.6991	0.6734	0.6991	0.8361
No log	9.3636	412	0.6553	0.7072	0.6553	0.8095
No log	9.4091	414	0.6577	0.7091	0.6577	0.8110
No log	9.4545	416	0.6772	0.6991	0.6772	0.8229
No log	9.5	418	0.7787	0.6774	0.7787	0.8824
No log	9.5455	420	0.8480	0.6234	0.8480	0.9209
No log	9.5909	422	0.9216	0.6089	0.9216	0.9600
No log	9.6364	424	1.0173	0.6069	1.0173	1.0086
No log	9.6818	426	1.0962	0.5850	1.0962	1.0470
No log	9.7273	428	1.0819	0.5796	1.0819	1.0401
No log	9.7727	430	1.0702	0.5864	1.0702	1.0345
No log	9.8182	432	1.0667	0.5864	1.0667	1.0328
No log	9.8636	434	1.0399	0.5672	1.0399	1.0198
No log	9.9091	436	0.9767	0.5961	0.9767	0.9883
No log	9.9545	438	0.9633	0.6006	0.9633	0.9815
No log	10.0	440	1.0442	0.5955	1.0442	1.0218
No log	10.0455	442	0.9846	0.6088	0.9846	0.9923
No log	10.0909	444	0.8457	0.6530	0.8457	0.9196
No log	10.1364	446	0.7592	0.6982	0.7592	0.8713
No log	10.1818	448	0.7384	0.7037	0.7384	0.8593
No log	10.2273	450	0.7143	0.7127	0.7143	0.8452
No log	10.2727	452	0.7048	0.7020	0.7048	0.8395
No log	10.3182	454	0.7500	0.6404	0.7500	0.8660
No log	10.3636	456	0.9388	0.6022	0.9388	0.9689
No log	10.4091	458	1.0689	0.5313	1.0689	1.0339
No log	10.4545	460	1.0506	0.5124	1.0506	1.0250
No log	10.5	462	0.9445	0.5961	0.9445	0.9719
No log	10.5455	464	0.8398	0.6227	0.8398	0.9164
No log	10.5909	466	0.7996	0.6370	0.7996	0.8942
No log	10.6364	468	0.8219	0.6174	0.8219	0.9066
No log	10.6818	470	0.9056	0.6065	0.9056	0.9516
No log	10.7273	472	0.9731	0.5910	0.9731	0.9864
No log	10.7727	474	0.9961	0.6001	0.9961	0.9981
No log	10.8182	476	0.9574	0.6018	0.9574	0.9785
No log	10.8636	478	0.8431	0.6071	0.8431	0.9182
No log	10.9091	480	0.7510	0.6824	0.7510	0.8666
No log	10.9545	482	0.7402	0.6786	0.7402	0.8604
No log	11.0	484	0.7675	0.6776	0.7675	0.8761
No log	11.0455	486	0.8478	0.6244	0.8478	0.9208
No log	11.0909	488	0.9990	0.5705	0.9990	0.9995
No log	11.1364	490	1.0710	0.5355	1.0710	1.0349
No log	11.1818	492	1.0466	0.5374	1.0466	1.0230
No log	11.2273	494	0.9224	0.5740	0.9224	0.9604
No log	11.2727	496	0.8026	0.6561	0.8026	0.8959
No log	11.3182	498	0.7325	0.6958	0.7325	0.8559
0.4123	11.3636	500	0.7076	0.6865	0.7076	0.8412
0.4123	11.4091	502	0.7000	0.6877	0.7000	0.8367
0.4123	11.4545	504	0.6982	0.7038	0.6982	0.8356
0.4123	11.5	506	0.6950	0.7038	0.6950	0.8337
0.4123	11.5455	508	0.7277	0.7015	0.7277	0.8530
0.4123	11.5909	510	0.7839	0.6969	0.7839	0.8854
0.4123	11.6364	512	0.7643	0.7060	0.7643	0.8743
0.4123	11.6818	514	0.6995	0.7139	0.6995	0.8364
0.4123	11.7273	516	0.6859	0.7037	0.6859	0.8282
0.4123	11.7727	518	0.6922	0.6711	0.6922	0.8320
0.4123	11.8182	520	0.6765	0.7043	0.6765	0.8225
0.4123	11.8636	522	0.6992	0.7191	0.6992	0.8362
0.4123	11.9091	524	0.7159	0.7163	0.7159	0.8461
0.4123	11.9545	526	0.7003	0.7084	0.7003	0.8368
0.4123	12.0	528	0.6939	0.7153	0.6939	0.8330
0.4123	12.0455	530	0.7403	0.6665	0.7403	0.8604
0.4123	12.0909	532	0.8518	0.5941	0.8518	0.9230
0.4123	12.1364	534	0.8664	0.5958	0.8664	0.9308
0.4123	12.1818	536	0.8266	0.6227	0.8266	0.9092
0.4123	12.2273	538	0.8208	0.6279	0.8208	0.9060

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1