ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0406
• Qwk: 0.5384
• Mse: 1.0406
• Rmse: 1.0201

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	5.3891	0.0020	5.3891	2.3214
No log	0.0667	4	3.4371	0.0472	3.4371	1.8539
No log	0.1	6	2.5117	-0.0418	2.5117	1.5848
No log	0.1333	8	1.8260	0.0401	1.8260	1.3513
No log	0.1667	10	1.4897	0.1457	1.4897	1.2205
No log	0.2	12	1.3323	0.0784	1.3323	1.1542
No log	0.2333	14	1.2683	0.1239	1.2683	1.1262
No log	0.2667	16	1.2390	0.1721	1.2390	1.1131
No log	0.3	18	1.2380	0.2401	1.2380	1.1126
No log	0.3333	20	1.2436	0.2284	1.2436	1.1152
No log	0.3667	22	1.1913	0.3246	1.1913	1.0915
No log	0.4	24	1.2085	0.2354	1.2085	1.0993
No log	0.4333	26	1.2187	0.1402	1.2187	1.1039
No log	0.4667	28	1.2488	0.0954	1.2488	1.1175
No log	0.5	30	1.3341	0.0738	1.3341	1.1551
No log	0.5333	32	1.3459	0.0828	1.3459	1.1601
No log	0.5667	34	1.2644	0.1662	1.2644	1.1244
No log	0.6	36	1.1848	0.2521	1.1848	1.0885
No log	0.6333	38	1.1702	0.2716	1.1702	1.0818
No log	0.6667	40	1.1403	0.3223	1.1403	1.0679
No log	0.7	42	1.1107	0.2761	1.1107	1.0539
No log	0.7333	44	1.1000	0.2716	1.1000	1.0488
No log	0.7667	46	1.1208	0.2634	1.1208	1.0587
No log	0.8	48	1.1953	0.2299	1.1953	1.0933
No log	0.8333	50	1.3284	0.2178	1.3284	1.1526
No log	0.8667	52	1.4604	0.2208	1.4604	1.2085
No log	0.9	54	1.3493	0.2685	1.3493	1.1616
No log	0.9333	56	1.0607	0.3663	1.0607	1.0299
No log	0.9667	58	1.0234	0.3338	1.0234	1.0116
No log	1.0	60	1.0418	0.2791	1.0418	1.0207
No log	1.0333	62	1.0370	0.2781	1.0370	1.0183
No log	1.0667	64	1.0194	0.3765	1.0194	1.0097
No log	1.1	66	0.9996	0.3645	0.9996	0.9998
No log	1.1333	68	1.0081	0.4134	1.0081	1.0041
No log	1.1667	70	1.0690	0.4392	1.0690	1.0339
No log	1.2	72	1.0411	0.4008	1.0411	1.0204
No log	1.2333	74	0.9978	0.3963	0.9978	0.9989
No log	1.2667	76	0.9679	0.3470	0.9679	0.9838
No log	1.3	78	0.9226	0.4672	0.9226	0.9605
No log	1.3333	80	0.9085	0.4441	0.9085	0.9531
No log	1.3667	82	0.9009	0.4580	0.9009	0.9492
No log	1.4	84	0.9186	0.4640	0.9186	0.9584
No log	1.4333	86	0.9747	0.3874	0.9747	0.9873
No log	1.4667	88	1.1099	0.2958	1.1099	1.0535
No log	1.5	90	1.2047	0.2825	1.2047	1.0976
No log	1.5333	92	1.0383	0.3781	1.0383	1.0190
No log	1.5667	94	0.8580	0.5403	0.8580	0.9263
No log	1.6	96	0.8682	0.4838	0.8682	0.9317
No log	1.6333	98	1.0202	0.3706	1.0202	1.0100
No log	1.6667	100	1.0181	0.3706	1.0181	1.0090
No log	1.7	102	0.8877	0.4468	0.8877	0.9422
No log	1.7333	104	0.8799	0.4388	0.8799	0.9381
No log	1.7667	106	0.9705	0.4603	0.9705	0.9851
No log	1.8	108	1.0556	0.4704	1.0556	1.0274
No log	1.8333	110	1.0880	0.5436	1.0880	1.0431
No log	1.8667	112	1.0122	0.5186	1.0122	1.0061
No log	1.9	114	0.9915	0.4984	0.9915	0.9957
No log	1.9333	116	1.1116	0.3833	1.1116	1.0543
No log	1.9667	118	1.2304	0.4172	1.2304	1.1092
No log	2.0	120	1.3077	0.4044	1.3077	1.1435
No log	2.0333	122	1.2480	0.4597	1.2480	1.1171
No log	2.0667	124	1.0669	0.4825	1.0669	1.0329
No log	2.1	126	0.9540	0.5395	0.9540	0.9768
No log	2.1333	128	0.9475	0.5426	0.9475	0.9734
No log	2.1667	130	0.9365	0.5657	0.9365	0.9677
No log	2.2	132	0.9874	0.5259	0.9874	0.9937
No log	2.2333	134	1.0212	0.5223	1.0212	1.0106
No log	2.2667	136	1.0032	0.5707	1.0032	1.0016
No log	2.3	138	1.0854	0.6287	1.0854	1.0418
No log	2.3333	140	1.0344	0.5914	1.0344	1.0170
No log	2.3667	142	1.1111	0.5121	1.1111	1.0541
No log	2.4	144	1.1555	0.4478	1.1555	1.0749
No log	2.4333	146	0.9960	0.5471	0.9960	0.9980
No log	2.4667	148	0.8927	0.5759	0.8927	0.9448
No log	2.5	150	0.8902	0.5965	0.8902	0.9435
No log	2.5333	152	0.8801	0.5821	0.8801	0.9381
No log	2.5667	154	0.9499	0.5561	0.9499	0.9747
No log	2.6	156	1.2169	0.4909	1.2169	1.1032
No log	2.6333	158	1.3956	0.4114	1.3956	1.1814
No log	2.6667	160	1.2422	0.4478	1.2422	1.1145
No log	2.7	162	1.0938	0.4803	1.0938	1.0458
No log	2.7333	164	1.0272	0.5475	1.0272	1.0135
No log	2.7667	166	1.0476	0.5526	1.0476	1.0235
No log	2.8	168	1.0094	0.5667	1.0094	1.0047
No log	2.8333	170	0.9531	0.5883	0.9531	0.9762
No log	2.8667	172	0.9949	0.5803	0.9949	0.9974
No log	2.9	174	1.1388	0.5124	1.1388	1.0672
No log	2.9333	176	1.1854	0.4931	1.1854	1.0888
No log	2.9667	178	1.2880	0.4596	1.2880	1.1349
No log	3.0	180	1.2455	0.4693	1.2455	1.1160
No log	3.0333	182	1.0363	0.4651	1.0363	1.0180
No log	3.0667	184	0.9550	0.4996	0.9550	0.9772
No log	3.1	186	0.9061	0.5434	0.9061	0.9519
No log	3.1333	188	0.8685	0.6147	0.8685	0.9319
No log	3.1667	190	0.9094	0.5974	0.9094	0.9536
No log	3.2	192	0.9329	0.5987	0.9329	0.9659
No log	3.2333	194	0.9857	0.5789	0.9857	0.9928
No log	3.2667	196	1.1083	0.4866	1.1083	1.0528
No log	3.3	198	1.1447	0.4669	1.1447	1.0699
No log	3.3333	200	1.2552	0.4432	1.2552	1.1204
No log	3.3667	202	1.4397	0.3795	1.4397	1.1999
No log	3.4	204	1.4493	0.3747	1.4493	1.2039
No log	3.4333	206	1.4408	0.3749	1.4408	1.2004
No log	3.4667	208	1.2882	0.4461	1.2882	1.1350
No log	3.5	210	1.0858	0.5341	1.0858	1.0420
No log	3.5333	212	1.0172	0.5560	1.0172	1.0086
No log	3.5667	214	1.1105	0.5219	1.1105	1.0538
No log	3.6	216	1.3683	0.4192	1.3683	1.1697
No log	3.6333	218	1.6162	0.3729	1.6162	1.2713
No log	3.6667	220	1.5219	0.3745	1.5219	1.2337
No log	3.7	222	1.2989	0.4096	1.2989	1.1397
No log	3.7333	224	1.0617	0.5503	1.0617	1.0304
No log	3.7667	226	0.9879	0.5536	0.9879	0.9939
No log	3.8	228	0.9743	0.5686	0.9743	0.9871
No log	3.8333	230	1.0670	0.4734	1.0670	1.0330
No log	3.8667	232	1.1813	0.4589	1.1813	1.0869
No log	3.9	234	1.3052	0.4230	1.3052	1.1425
No log	3.9333	236	1.2134	0.4399	1.2134	1.1016
No log	3.9667	238	1.0051	0.5816	1.0051	1.0025
No log	4.0	240	0.9370	0.5904	0.9370	0.9680
No log	4.0333	242	0.9689	0.5851	0.9689	0.9843
No log	4.0667	244	1.0269	0.5813	1.0269	1.0134
No log	4.1	246	1.0509	0.5241	1.0509	1.0251
No log	4.1333	248	1.0599	0.5180	1.0599	1.0295
No log	4.1667	250	0.9576	0.5755	0.9576	0.9786
No log	4.2	252	0.9337	0.6121	0.9337	0.9663
No log	4.2333	254	0.9225	0.6054	0.9225	0.9605
No log	4.2667	256	0.8667	0.6145	0.8667	0.9310
No log	4.3	258	0.7925	0.6231	0.7925	0.8902
No log	4.3333	260	0.7540	0.6209	0.7540	0.8683
No log	4.3667	262	0.7746	0.6059	0.7746	0.8801
No log	4.4	264	0.8221	0.6158	0.8221	0.9067
No log	4.4333	266	0.8787	0.6195	0.8787	0.9374
No log	4.4667	268	0.8463	0.6211	0.8463	0.9200
No log	4.5	270	0.7653	0.6859	0.7653	0.8748
No log	4.5333	272	0.7750	0.6683	0.7750	0.8804
No log	4.5667	274	0.8473	0.6102	0.8473	0.9205
No log	4.6	276	0.8815	0.5992	0.8815	0.9389
No log	4.6333	278	0.9120	0.6153	0.9120	0.9550
No log	4.6667	280	0.8537	0.6449	0.8537	0.9240
No log	4.7	282	0.8026	0.6500	0.8026	0.8959
No log	4.7333	284	0.7574	0.6477	0.7574	0.8703
No log	4.7667	286	0.7769	0.6471	0.7769	0.8814
No log	4.8	288	0.8168	0.6439	0.8168	0.9038
No log	4.8333	290	0.9024	0.6066	0.9024	0.9500
No log	4.8667	292	0.8622	0.6076	0.8622	0.9286
No log	4.9	294	0.7660	0.6372	0.7660	0.8752
No log	4.9333	296	0.7443	0.6543	0.7443	0.8627
No log	4.9667	298	0.7425	0.6544	0.7425	0.8617
No log	5.0	300	0.7720	0.6441	0.7720	0.8786
No log	5.0333	302	0.8326	0.6373	0.8326	0.9124
No log	5.0667	304	0.8845	0.6153	0.8845	0.9405
No log	5.1	306	0.9903	0.5654	0.9903	0.9952
No log	5.1333	308	0.9067	0.6065	0.9067	0.9522
No log	5.1667	310	0.8066	0.5799	0.8066	0.8981
No log	5.2	312	0.7946	0.5543	0.7946	0.8914
No log	5.2333	314	0.8176	0.5575	0.8176	0.9042
No log	5.2667	316	0.8707	0.5800	0.8707	0.9331
No log	5.3	318	0.9380	0.5757	0.9380	0.9685
No log	5.3333	320	0.9818	0.5577	0.9818	0.9908
No log	5.3667	322	0.9457	0.5767	0.9457	0.9725
No log	5.4	324	0.9052	0.5767	0.9052	0.9514
No log	5.4333	326	0.8924	0.5766	0.8924	0.9447
No log	5.4667	328	0.9600	0.5766	0.9600	0.9798
No log	5.5	330	1.1086	0.5180	1.1086	1.0529
No log	5.5333	332	1.2106	0.4881	1.2106	1.1003
No log	5.5667	334	1.1393	0.5007	1.1393	1.0674
No log	5.6	336	1.1309	0.5000	1.1309	1.0634
No log	5.6333	338	1.0937	0.5275	1.0937	1.0458
No log	5.6667	340	0.9838	0.5962	0.9838	0.9919
No log	5.7	342	0.8914	0.5546	0.8914	0.9441
No log	5.7333	344	0.8574	0.5799	0.8574	0.9260
No log	5.7667	346	0.7826	0.5813	0.7826	0.8846
No log	5.8	348	0.7483	0.5910	0.7483	0.8650
No log	5.8333	350	0.7621	0.5825	0.7621	0.8730
No log	5.8667	352	0.7923	0.6291	0.7923	0.8901
No log	5.9	354	0.7794	0.6072	0.7794	0.8829
No log	5.9333	356	0.7384	0.5681	0.7384	0.8593
No log	5.9667	358	0.7302	0.6033	0.7302	0.8545
No log	6.0	360	0.7517	0.5890	0.7517	0.8670
No log	6.0333	362	0.8548	0.6463	0.8548	0.9246
No log	6.0667	364	1.0534	0.5334	1.0534	1.0264
No log	6.1	366	1.0371	0.5444	1.0371	1.0184
No log	6.1333	368	0.8813	0.6032	0.8813	0.9388
No log	6.1667	370	0.7931	0.6225	0.7931	0.8905
No log	6.2	372	0.8094	0.6308	0.8094	0.8997
No log	6.2333	374	0.8731	0.5998	0.8731	0.9344
No log	6.2667	376	0.9330	0.5743	0.9330	0.9659
No log	6.3	378	0.9305	0.6088	0.9305	0.9646
No log	6.3333	380	0.8273	0.6453	0.8273	0.9096
No log	6.3667	382	0.8000	0.6526	0.8000	0.8944
No log	6.4	384	0.8430	0.6577	0.8430	0.9182
No log	6.4333	386	0.8189	0.6577	0.8189	0.9049
No log	6.4667	388	0.8390	0.6250	0.8390	0.9160
No log	6.5	390	0.8889	0.6120	0.8889	0.9428
No log	6.5333	392	0.9053	0.5966	0.9053	0.9515
No log	6.5667	394	0.8558	0.6234	0.8558	0.9251
No log	6.6	396	0.7812	0.6095	0.7812	0.8839
No log	6.6333	398	0.7599	0.6326	0.7599	0.8717
No log	6.6667	400	0.8036	0.6111	0.8036	0.8964
No log	6.7	402	0.9400	0.5944	0.9400	0.9696
No log	6.7333	404	1.0154	0.5658	1.0154	1.0077
No log	6.7667	406	0.9585	0.5777	0.9585	0.9790
No log	6.8	408	0.8436	0.6322	0.8436	0.9185
No log	6.8333	410	0.7772	0.6596	0.7772	0.8816
No log	6.8667	412	0.7920	0.6515	0.7920	0.8899
No log	6.9	414	0.8702	0.6315	0.8702	0.9329
No log	6.9333	416	0.9022	0.6199	0.9022	0.9499
No log	6.9667	418	0.8267	0.6156	0.8267	0.9092
No log	7.0	420	0.7523	0.5416	0.7523	0.8673
No log	7.0333	422	0.7504	0.5416	0.7504	0.8662
No log	7.0667	424	0.8135	0.6168	0.8135	0.9019
No log	7.1	426	0.9090	0.5835	0.9090	0.9534
No log	7.1333	428	0.9090	0.5899	0.9090	0.9534
No log	7.1667	430	0.8623	0.6047	0.8623	0.9286
No log	7.2	432	0.8941	0.6104	0.8941	0.9456
No log	7.2333	434	0.9555	0.6043	0.9555	0.9775
No log	7.2667	436	0.9912	0.5718	0.9912	0.9956
No log	7.3	438	0.9525	0.5869	0.9525	0.9760
No log	7.3333	440	0.9095	0.6104	0.9095	0.9537
No log	7.3667	442	0.8780	0.6064	0.8780	0.9370
No log	7.4	444	0.9823	0.5979	0.9823	0.9911
No log	7.4333	446	1.1313	0.5697	1.1313	1.0636
No log	7.4667	448	1.1320	0.5810	1.1320	1.0640
No log	7.5	450	1.0019	0.5935	1.0019	1.0009
No log	7.5333	452	0.7987	0.6054	0.7987	0.8937
No log	7.5667	454	0.7549	0.6304	0.7549	0.8688
No log	7.6	456	0.7768	0.6350	0.7768	0.8814
No log	7.6333	458	0.7783	0.6184	0.7783	0.8822
No log	7.6667	460	0.8233	0.6202	0.8233	0.9074
No log	7.7	462	0.9770	0.6119	0.9770	0.9885
No log	7.7333	464	1.0518	0.5839	1.0518	1.0256
No log	7.7667	466	0.9462	0.6108	0.9462	0.9727
No log	7.8	468	0.8150	0.5931	0.8150	0.9028
No log	7.8333	470	0.7618	0.6092	0.7618	0.8728
No log	7.8667	472	0.7594	0.6199	0.7594	0.8714
No log	7.9	474	0.7926	0.6410	0.7926	0.8903
No log	7.9333	476	0.8777	0.6013	0.8777	0.9368
No log	7.9667	478	0.9278	0.5912	0.9278	0.9632
No log	8.0	480	0.8515	0.5997	0.8515	0.9228
No log	8.0333	482	0.8198	0.5985	0.8198	0.9054
No log	8.0667	484	0.8268	0.5931	0.8268	0.9093
No log	8.1	486	0.8052	0.5985	0.8052	0.8973
No log	8.1333	488	0.8418	0.6012	0.8418	0.9175
No log	8.1667	490	0.9241	0.6013	0.9241	0.9613
No log	8.2	492	1.0282	0.5537	1.0282	1.0140
No log	8.2333	494	0.9818	0.6041	0.9818	0.9909
No log	8.2667	496	0.9677	0.5944	0.9677	0.9837
No log	8.3	498	0.9048	0.6188	0.9048	0.9512
0.4674	8.3333	500	0.9231	0.6089	0.9231	0.9608
0.4674	8.3667	502	0.9415	0.6004	0.9415	0.9703
0.4674	8.4	504	0.9027	0.6039	0.9027	0.9501
0.4674	8.4333	506	0.8482	0.6227	0.8482	0.9210
0.4674	8.4667	508	0.8269	0.6445	0.8269	0.9094
0.4674	8.5	510	0.9067	0.5972	0.9067	0.9522
0.4674	8.5333	512	0.9556	0.5644	0.9556	0.9775
0.4674	8.5667	514	1.0566	0.5560	1.0566	1.0279
0.4674	8.6	516	1.0798	0.5324	1.0798	1.0392
0.4674	8.6333	518	1.0406	0.5384	1.0406	1.0201

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1