ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k20_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8654
• Qwk: 0.6115
• Mse: 0.8654
• Rmse: 0.9303

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0202	2	5.1724	-0.0107	5.1724	2.2743
No log	0.0404	4	3.0432	0.0909	3.0432	1.7445
No log	0.0606	6	1.9728	0.0427	1.9728	1.4046
No log	0.0808	8	1.5585	0.1132	1.5585	1.2484
No log	0.1010	10	1.2742	0.1998	1.2742	1.1288
No log	0.1212	12	1.2003	0.2803	1.2003	1.0956
No log	0.1414	14	1.1678	0.2773	1.1678	1.0806
No log	0.1616	16	1.2003	0.2833	1.2003	1.0956
No log	0.1818	18	1.2647	0.3157	1.2647	1.1246
No log	0.2020	20	1.2498	0.3029	1.2498	1.1179
No log	0.2222	22	1.1404	0.2415	1.1404	1.0679
No log	0.2424	24	1.1066	0.2419	1.1066	1.0520
No log	0.2626	26	1.1155	0.1689	1.1155	1.0562
No log	0.2828	28	1.0472	0.2676	1.0472	1.0233
No log	0.3030	30	1.0246	0.2635	1.0246	1.0122
No log	0.3232	32	1.0118	0.3532	1.0118	1.0059
No log	0.3434	34	1.0015	0.3947	1.0015	1.0008
No log	0.3636	36	0.9410	0.3987	0.9410	0.9701
No log	0.3838	38	0.9768	0.4414	0.9768	0.9883
No log	0.4040	40	1.1755	0.3863	1.1755	1.0842
No log	0.4242	42	1.0708	0.4228	1.0708	1.0348
No log	0.4444	44	0.9514	0.4622	0.9514	0.9754
No log	0.4646	46	0.9516	0.3497	0.9516	0.9755
No log	0.4848	48	1.0036	0.2685	1.0036	1.0018
No log	0.5051	50	0.9243	0.4534	0.9243	0.9614
No log	0.5253	52	0.8908	0.4726	0.8908	0.9438
No log	0.5455	54	0.9315	0.4410	0.9315	0.9651
No log	0.5657	56	0.8904	0.4759	0.8904	0.9436
No log	0.5859	58	0.9190	0.4450	0.9190	0.9586
No log	0.6061	60	0.9632	0.5002	0.9632	0.9814
No log	0.6263	62	1.0517	0.4881	1.0517	1.0255
No log	0.6465	64	1.0243	0.4879	1.0243	1.0121
No log	0.6667	66	1.0240	0.4859	1.0240	1.0119
No log	0.6869	68	1.0891	0.4458	1.0891	1.0436
No log	0.7071	70	1.0589	0.4394	1.0589	1.0290
No log	0.7273	72	0.9980	0.4804	0.9980	0.9990
No log	0.7475	74	0.8872	0.6059	0.8872	0.9419
No log	0.7677	76	0.9104	0.6121	0.9104	0.9541
No log	0.7879	78	1.1087	0.4519	1.1087	1.0530
No log	0.8081	80	1.1331	0.4345	1.1331	1.0645
No log	0.8283	82	0.9118	0.5701	0.9118	0.9549
No log	0.8485	84	0.8102	0.6017	0.8102	0.9001
No log	0.8687	86	0.8036	0.5440	0.8036	0.8964
No log	0.8889	88	0.8071	0.5600	0.8071	0.8984
No log	0.9091	90	0.8459	0.5418	0.8459	0.9198
No log	0.9293	92	0.8677	0.5532	0.8677	0.9315
No log	0.9495	94	0.9244	0.5279	0.9244	0.9615
No log	0.9697	96	0.9013	0.5372	0.9013	0.9494
No log	0.9899	98	0.8015	0.5720	0.8015	0.8953
No log	1.0101	100	0.8082	0.5270	0.8082	0.8990
No log	1.0303	102	0.7792	0.5440	0.7792	0.8827
No log	1.0505	104	0.8479	0.5444	0.8479	0.9208
No log	1.0707	106	1.0115	0.5884	1.0115	1.0058
No log	1.0909	108	1.1896	0.4893	1.1896	1.0907
No log	1.1111	110	1.2270	0.4785	1.2270	1.1077
No log	1.1313	112	0.9975	0.5445	0.9975	0.9988
No log	1.1515	114	0.9244	0.6228	0.9244	0.9615
No log	1.1717	116	1.0831	0.5348	1.0831	1.0407
No log	1.1919	118	1.5514	0.4400	1.5514	1.2456
No log	1.2121	120	2.0382	0.2974	2.0382	1.4277
No log	1.2323	122	2.1833	0.2590	2.1833	1.4776
No log	1.2525	124	2.0429	0.2919	2.0429	1.4293
No log	1.2727	126	1.7568	0.3684	1.7568	1.3254
No log	1.2929	128	1.3036	0.4473	1.3036	1.1417
No log	1.3131	130	0.9862	0.6050	0.9862	0.9931
No log	1.3333	132	0.7918	0.6166	0.7918	0.8898
No log	1.3535	134	0.7730	0.6309	0.7730	0.8792
No log	1.3737	136	0.7468	0.6244	0.7468	0.8642
No log	1.3939	138	0.8219	0.6129	0.8219	0.9066
No log	1.4141	140	0.9739	0.5544	0.9739	0.9869
No log	1.4343	142	1.1207	0.5237	1.1207	1.0586
No log	1.4545	144	1.3189	0.4525	1.3189	1.1484
No log	1.4747	146	1.2690	0.4452	1.2690	1.1265
No log	1.4949	148	1.0694	0.4977	1.0694	1.0341
No log	1.5152	150	0.9538	0.5755	0.9538	0.9766
No log	1.5354	152	1.0137	0.5894	1.0137	1.0068
No log	1.5556	154	1.1143	0.5132	1.1143	1.0556
No log	1.5758	156	1.2496	0.4372	1.2496	1.1179
No log	1.5960	158	1.3014	0.4235	1.3014	1.1408
No log	1.6162	160	1.1751	0.5036	1.1751	1.0840
No log	1.6364	162	1.0436	0.5148	1.0436	1.0216
No log	1.6566	164	0.9100	0.4577	0.9100	0.9540
No log	1.6768	166	0.9009	0.4010	0.9009	0.9491
No log	1.6970	168	0.9686	0.4237	0.9686	0.9842
No log	1.7172	170	1.0041	0.4017	1.0041	1.0021
No log	1.7374	172	0.9726	0.4017	0.9726	0.9862
No log	1.7576	174	0.8661	0.4643	0.8661	0.9307
No log	1.7778	176	0.8176	0.5192	0.8176	0.9042
No log	1.7980	178	0.7914	0.5453	0.7914	0.8896
No log	1.8182	180	1.0219	0.5607	1.0219	1.0109
No log	1.8384	182	1.1914	0.4841	1.1914	1.0915
No log	1.8586	184	1.1237	0.5054	1.1237	1.0601
No log	1.8788	186	0.9074	0.5788	0.9074	0.9526
No log	1.8990	188	0.7984	0.5819	0.7984	0.8935
No log	1.9192	190	0.8009	0.5380	0.8009	0.8949
No log	1.9394	192	0.8081	0.4752	0.8081	0.8989
No log	1.9596	194	0.8770	0.4801	0.8770	0.9365
No log	1.9798	196	0.9896	0.4966	0.9896	0.9948
No log	2.0	198	0.9693	0.5658	0.9693	0.9845
No log	2.0202	200	0.8585	0.5593	0.8585	0.9266
No log	2.0404	202	0.7518	0.5565	0.7518	0.8671
No log	2.0606	204	0.7088	0.5443	0.7088	0.8419
No log	2.0808	206	0.6992	0.6044	0.6992	0.8362
No log	2.1010	208	0.7126	0.6312	0.7126	0.8442
No log	2.1212	210	0.7567	0.6375	0.7567	0.8699
No log	2.1414	212	0.8351	0.6250	0.8351	0.9139
No log	2.1616	214	0.9391	0.5718	0.9391	0.9691
No log	2.1818	216	0.8709	0.6137	0.8709	0.9332
No log	2.2020	218	0.7195	0.6408	0.7195	0.8482
No log	2.2222	220	0.6529	0.6789	0.6529	0.8081
No log	2.2424	222	0.7845	0.6038	0.7845	0.8857
No log	2.2626	224	0.7797	0.6038	0.7797	0.8830
No log	2.2828	226	0.6837	0.6152	0.6837	0.8268
No log	2.3030	228	0.6772	0.6275	0.6772	0.8229
No log	2.3232	230	0.7172	0.6045	0.7172	0.8468
No log	2.3434	232	0.7429	0.5973	0.7429	0.8619
No log	2.3636	234	0.7873	0.5925	0.7873	0.8873
No log	2.3838	236	0.7768	0.6139	0.7768	0.8814
No log	2.4040	238	0.7409	0.6401	0.7409	0.8607
No log	2.4242	240	0.7886	0.6331	0.7886	0.8881
No log	2.4444	242	0.8643	0.6106	0.8643	0.9297
No log	2.4646	244	0.9915	0.5467	0.9915	0.9958
No log	2.4848	246	1.1313	0.5339	1.1313	1.0636
No log	2.5051	248	1.0580	0.5469	1.0580	1.0286
No log	2.5253	250	0.9524	0.5667	0.9524	0.9759
No log	2.5455	252	0.8276	0.5949	0.8276	0.9097
No log	2.5657	254	0.7874	0.5766	0.7874	0.8874
No log	2.5859	256	0.8142	0.5525	0.8142	0.9023
No log	2.6061	258	0.8056	0.5404	0.8056	0.8975
No log	2.6263	260	0.8170	0.5403	0.8170	0.9039
No log	2.6465	262	0.8430	0.5498	0.8430	0.9182
No log	2.6667	264	0.8693	0.5827	0.8693	0.9323
No log	2.6869	266	0.8326	0.5825	0.8326	0.9125
No log	2.7071	268	0.7364	0.6212	0.7364	0.8581
No log	2.7273	270	0.7096	0.6286	0.7096	0.8424
No log	2.7475	272	0.7024	0.6203	0.7024	0.8381
No log	2.7677	274	0.6800	0.6297	0.6800	0.8246
No log	2.7879	276	0.6743	0.6292	0.6743	0.8211
No log	2.8081	278	0.6934	0.6187	0.6934	0.8327
No log	2.8283	280	0.8074	0.5541	0.8074	0.8986
No log	2.8485	282	0.8515	0.5745	0.8515	0.9227
No log	2.8687	284	0.8507	0.5814	0.8507	0.9223
No log	2.8889	286	0.9860	0.5745	0.9860	0.9930
No log	2.9091	288	1.0798	0.5661	1.0798	1.0391
No log	2.9293	290	0.9815	0.6149	0.9815	0.9907
No log	2.9495	292	0.8670	0.5892	0.8670	0.9311
No log	2.9697	294	0.7015	0.6482	0.7015	0.8375
No log	2.9899	296	0.6798	0.6482	0.6798	0.8245
No log	3.0101	298	0.6791	0.6510	0.6791	0.8241
No log	3.0303	300	0.6763	0.6501	0.6763	0.8224
No log	3.0505	302	0.7383	0.6490	0.7383	0.8592
No log	3.0707	304	0.8560	0.5794	0.8560	0.9252
No log	3.0909	306	0.9924	0.5463	0.9924	0.9962
No log	3.1111	308	0.9642	0.5399	0.9642	0.9820
No log	3.1313	310	0.8427	0.6262	0.8427	0.9180
No log	3.1515	312	0.7016	0.6205	0.7016	0.8376
No log	3.1717	314	0.6901	0.6232	0.6901	0.8307
No log	3.1919	316	0.6887	0.6226	0.6887	0.8299
No log	3.2121	318	0.6994	0.6072	0.6994	0.8363
No log	3.2323	320	0.7682	0.6134	0.7682	0.8765
No log	3.2525	322	0.9386	0.5693	0.9386	0.9688
No log	3.2727	324	1.2718	0.5226	1.2718	1.1277
No log	3.2929	326	1.4032	0.4952	1.4032	1.1846
No log	3.3131	328	1.2440	0.5315	1.2440	1.1154
No log	3.3333	330	1.0617	0.5181	1.0617	1.0304
No log	3.3535	332	1.0188	0.5270	1.0188	1.0093
No log	3.3737	334	0.9823	0.5578	0.9823	0.9911
No log	3.3939	336	0.8772	0.5760	0.8772	0.9366
No log	3.4141	338	0.8210	0.5429	0.8210	0.9061
No log	3.4343	340	0.8013	0.5034	0.8013	0.8951
No log	3.4545	342	0.7559	0.5220	0.7559	0.8694
No log	3.4747	344	0.7434	0.5740	0.7434	0.8622
No log	3.4949	346	0.7625	0.6160	0.7625	0.8732
No log	3.5152	348	0.8043	0.5824	0.8043	0.8968
No log	3.5354	350	0.9111	0.5681	0.9111	0.9545
No log	3.5556	352	0.9361	0.5681	0.9361	0.9675
No log	3.5758	354	0.9107	0.5693	0.9107	0.9543
No log	3.5960	356	0.8548	0.5679	0.8548	0.9245
No log	3.6162	358	0.7791	0.5853	0.7791	0.8827
No log	3.6364	360	0.7630	0.5931	0.7630	0.8735
No log	3.6566	362	0.7475	0.6133	0.7475	0.8646
No log	3.6768	364	0.8279	0.5836	0.8279	0.9099
No log	3.6970	366	0.9516	0.5741	0.9516	0.9755
No log	3.7172	368	0.9671	0.5683	0.9671	0.9834
No log	3.7374	370	0.9693	0.5647	0.9693	0.9846
No log	3.7576	372	0.9222	0.5609	0.9222	0.9603
No log	3.7778	374	0.8361	0.5913	0.8361	0.9144
No log	3.7980	376	0.7775	0.6226	0.7775	0.8817
No log	3.8182	378	0.7858	0.6310	0.7858	0.8864
No log	3.8384	380	0.7649	0.6346	0.7649	0.8746
No log	3.8586	382	0.6987	0.6479	0.6987	0.8359
No log	3.8788	384	0.6561	0.6340	0.6561	0.8100
No log	3.8990	386	0.6546	0.6340	0.6546	0.8091
No log	3.9192	388	0.6853	0.6407	0.6853	0.8278
No log	3.9394	390	0.8038	0.6090	0.8038	0.8966
No log	3.9596	392	1.0104	0.5672	1.0104	1.0052
No log	3.9798	394	1.1320	0.5440	1.1320	1.0639
No log	4.0	396	1.1016	0.5486	1.1016	1.0496
No log	4.0202	398	1.0185	0.5738	1.0185	1.0092
No log	4.0404	400	1.0414	0.5573	1.0414	1.0205
No log	4.0606	402	1.0592	0.5447	1.0592	1.0292
No log	4.0808	404	1.0720	0.5431	1.0720	1.0354
No log	4.1010	406	1.1207	0.5186	1.1207	1.0586
No log	4.1212	408	1.0441	0.5494	1.0441	1.0218
No log	4.1414	410	0.9288	0.5441	0.9288	0.9637
No log	4.1616	412	0.8950	0.5601	0.8950	0.9460
No log	4.1818	414	0.8823	0.5745	0.8823	0.9393
No log	4.2020	416	0.9025	0.5785	0.9025	0.9500
No log	4.2222	418	0.9537	0.5495	0.9537	0.9766
No log	4.2424	420	0.9373	0.5479	0.9373	0.9681
No log	4.2626	422	0.8572	0.5790	0.8572	0.9258
No log	4.2828	424	0.8527	0.6142	0.8527	0.9234
No log	4.3030	426	0.9184	0.5528	0.9184	0.9583
No log	4.3232	428	1.0156	0.5426	1.0156	1.0078
No log	4.3434	430	1.0277	0.5426	1.0277	1.0137
No log	4.3636	432	0.9620	0.5457	0.9620	0.9808
No log	4.3838	434	0.8524	0.6089	0.8524	0.9233
No log	4.4040	436	0.7935	0.6092	0.7935	0.8908
No log	4.4242	438	0.8125	0.6205	0.8125	0.9014
No log	4.4444	440	0.8492	0.5953	0.8492	0.9215
No log	4.4646	442	0.8713	0.6018	0.8713	0.9334
No log	4.4848	444	0.7995	0.6211	0.7995	0.8942
No log	4.5051	446	0.6919	0.6476	0.6919	0.8318
No log	4.5253	448	0.6847	0.6537	0.6847	0.8275
No log	4.5455	450	0.7228	0.6569	0.7228	0.8502
No log	4.5657	452	0.8226	0.6415	0.8226	0.9070
No log	4.5859	454	0.9059	0.5791	0.9059	0.9518
No log	4.6061	456	0.9090	0.5967	0.9090	0.9534
No log	4.6263	458	0.8507	0.6072	0.8507	0.9223
No log	4.6465	460	0.7051	0.7132	0.7051	0.8397
No log	4.6667	462	0.6157	0.7424	0.6157	0.7847
No log	4.6869	464	0.6056	0.7387	0.6056	0.7782
No log	4.7071	466	0.5998	0.7427	0.5998	0.7745
No log	4.7273	468	0.5935	0.7259	0.5935	0.7704
No log	4.7475	470	0.6790	0.6757	0.6790	0.8240
No log	4.7677	472	0.8222	0.6178	0.8222	0.9068
No log	4.7879	474	0.8989	0.5924	0.8989	0.9481
No log	4.8081	476	0.9228	0.5705	0.9228	0.9606
No log	4.8283	478	0.8457	0.6134	0.8457	0.9196
No log	4.8485	480	0.7921	0.6425	0.7921	0.8900
No log	4.8687	482	0.8202	0.6295	0.8202	0.9056
No log	4.8889	484	0.8877	0.6230	0.8877	0.9422
No log	4.9091	486	0.9466	0.6110	0.9466	0.9730
No log	4.9293	488	0.9050	0.6190	0.9050	0.9513
No log	4.9495	490	0.7842	0.6512	0.7842	0.8856
No log	4.9697	492	0.7172	0.6625	0.7172	0.8469
No log	4.9899	494	0.6624	0.6870	0.6624	0.8139
No log	5.0101	496	0.6624	0.6788	0.6624	0.8139
No log	5.0303	498	0.7043	0.6767	0.7043	0.8392
0.4466	5.0505	500	0.7323	0.6609	0.7323	0.8558
0.4466	5.0707	502	0.6770	0.6784	0.6770	0.8228
0.4466	5.0909	504	0.6311	0.7004	0.6311	0.7944
0.4466	5.1111	506	0.6121	0.7330	0.6121	0.7824
0.4466	5.1313	508	0.6122	0.7415	0.6122	0.7825
0.4466	5.1515	510	0.6191	0.7290	0.6191	0.7868
0.4466	5.1717	512	0.6306	0.7076	0.6306	0.7941
0.4466	5.1919	514	0.6853	0.7035	0.6853	0.8278
0.4466	5.2121	516	0.7450	0.6881	0.7450	0.8632
0.4466	5.2323	518	0.7504	0.6990	0.7504	0.8663
0.4466	5.2525	520	0.7553	0.6962	0.7553	0.8691
0.4466	5.2727	522	0.7684	0.6867	0.7684	0.8766
0.4466	5.2929	524	0.7652	0.6842	0.7652	0.8748
0.4466	5.3131	526	0.7198	0.6841	0.7198	0.8484
0.4466	5.3333	528	0.6898	0.7075	0.6898	0.8306
0.4466	5.3535	530	0.6633	0.7127	0.6633	0.8145
0.4466	5.3737	532	0.6419	0.7156	0.6419	0.8012
0.4466	5.3939	534	0.6327	0.7178	0.6327	0.7954
0.4466	5.4141	536	0.6667	0.6847	0.6667	0.8165
0.4466	5.4343	538	0.6725	0.6958	0.6725	0.8201
0.4466	5.4545	540	0.6509	0.6896	0.6509	0.8068
0.4466	5.4747	542	0.6716	0.6918	0.6716	0.8195
0.4466	5.4949	544	0.7066	0.6696	0.7066	0.8406
0.4466	5.5152	546	0.7301	0.6737	0.7301	0.8544
0.4466	5.5354	548	0.7634	0.6696	0.7634	0.8737
0.4466	5.5556	550	0.7598	0.6646	0.7598	0.8716
0.4466	5.5758	552	0.8041	0.6564	0.8041	0.8967
0.4466	5.5960	554	0.7768	0.6657	0.7768	0.8814
0.4466	5.6162	556	0.6837	0.6958	0.6837	0.8268
0.4466	5.6364	558	0.6537	0.6854	0.6537	0.8085
0.4466	5.6566	560	0.6564	0.6920	0.6564	0.8102
0.4466	5.6768	562	0.7068	0.6713	0.7068	0.8407
0.4466	5.6970	564	0.7184	0.6831	0.7184	0.8476
0.4466	5.7172	566	0.6557	0.6880	0.6557	0.8098
0.4466	5.7374	568	0.6365	0.6764	0.6365	0.7978
0.4466	5.7576	570	0.6458	0.6917	0.6458	0.8036
0.4466	5.7778	572	0.7204	0.6883	0.7204	0.8488
0.4466	5.7980	574	0.7952	0.6685	0.7952	0.8918
0.4466	5.8182	576	0.7576	0.6825	0.7576	0.8704
0.4466	5.8384	578	0.6599	0.7121	0.6599	0.8123
0.4466	5.8586	580	0.6120	0.7056	0.6120	0.7823
0.4466	5.8788	582	0.6154	0.7136	0.6154	0.7845
0.4466	5.8990	584	0.6208	0.7155	0.6208	0.7879
0.4466	5.9192	586	0.6766	0.6958	0.6766	0.8226
0.4466	5.9394	588	0.7979	0.6772	0.7979	0.8932
0.4466	5.9596	590	0.9879	0.5390	0.9879	0.9939
0.4466	5.9798	592	1.1117	0.5265	1.1117	1.0544
0.4466	6.0	594	1.1294	0.5525	1.1294	1.0628
0.4466	6.0202	596	1.0535	0.5582	1.0535	1.0264
0.4466	6.0404	598	0.8654	0.6115	0.8654	0.9303

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1