ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0425
• Qwk: 0.5556
• Mse: 1.0425
• Rmse: 1.0210

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0833	2	6.8372	0.0239	6.8372	2.6148
No log	0.1667	4	4.3453	0.0723	4.3453	2.0845
No log	0.25	6	3.0893	0.0741	3.0893	1.7576
No log	0.3333	8	2.4447	0.1507	2.4447	1.5635
No log	0.4167	10	2.0436	0.2362	2.0436	1.4295
No log	0.5	12	1.7876	0.1284	1.7876	1.3370
No log	0.5833	14	2.4276	-0.1333	2.4276	1.5581
No log	0.6667	16	2.7476	-0.0839	2.7476	1.6576
No log	0.75	18	2.6624	-0.0704	2.6624	1.6317
No log	0.8333	20	2.0767	0.1770	2.0767	1.4411
No log	0.9167	22	1.8999	0.1346	1.8999	1.3784
No log	1.0	24	1.9172	0.1333	1.9172	1.3846
No log	1.0833	26	2.1002	0.0656	2.1002	1.4492
No log	1.1667	28	2.3888	0.0136	2.3888	1.5456
No log	1.25	30	2.6585	0.0	2.6585	1.6305
No log	1.3333	32	2.6626	0.0	2.6626	1.6318
No log	1.4167	34	2.4845	0.0	2.4845	1.5762
No log	1.5	36	2.2709	0.1074	2.2709	1.5070
No log	1.5833	38	2.1927	0.2238	2.1927	1.4808
No log	1.6667	40	1.9970	0.2836	1.9970	1.4132
No log	1.75	42	1.8696	0.3333	1.8696	1.3673
No log	1.8333	44	1.7937	0.3279	1.7937	1.3393
No log	1.9167	46	1.8142	0.3538	1.8142	1.3469
No log	2.0	48	1.8531	0.3429	1.8531	1.3613
No log	2.0833	50	1.6647	0.4697	1.6647	1.2902
No log	2.1667	52	1.3318	0.4194	1.3318	1.1540
No log	2.25	54	1.1544	0.3729	1.1544	1.0744
No log	2.3333	56	1.1008	0.5082	1.1008	1.0492
No log	2.4167	58	1.3559	0.3220	1.3559	1.1644
No log	2.5	60	1.3900	0.3025	1.3900	1.1790
No log	2.5833	62	1.2478	0.4885	1.2478	1.1171
No log	2.6667	64	0.9753	0.6462	0.9753	0.9876
No log	2.75	66	1.0474	0.5758	1.0474	1.0234
No log	2.8333	68	0.9747	0.6	0.9747	0.9873
No log	2.9167	70	1.3153	0.4885	1.3153	1.1468
No log	3.0	72	1.1801	0.5152	1.1801	1.0863
No log	3.0833	74	0.9478	0.6767	0.9478	0.9735
No log	3.1667	76	0.9555	0.6765	0.9555	0.9775
No log	3.25	78	0.9317	0.6364	0.9317	0.9652
No log	3.3333	80	1.1382	0.5385	1.1382	1.0669
No log	3.4167	82	1.1897	0.5263	1.1897	1.0907
No log	3.5	84	1.1226	0.5522	1.1226	1.0595
No log	3.5833	86	0.9181	0.6277	0.9181	0.9582
No log	3.6667	88	0.8895	0.6765	0.8895	0.9432
No log	3.75	90	1.0328	0.5778	1.0328	1.0163
No log	3.8333	92	1.2283	0.5263	1.2283	1.1083
No log	3.9167	94	0.9731	0.5891	0.9731	0.9865
No log	4.0	96	0.9627	0.6567	0.9627	0.9811
No log	4.0833	98	1.0086	0.6471	1.0086	1.0043
No log	4.1667	100	0.9890	0.6074	0.9890	0.9945
No log	4.25	102	1.2195	0.5455	1.2195	1.1043
No log	4.3333	104	1.2150	0.5455	1.2150	1.1023
No log	4.4167	106	0.9972	0.6043	0.9972	0.9986
No log	4.5	108	0.9795	0.6423	0.9795	0.9897
No log	4.5833	110	1.1475	0.5714	1.1475	1.0712
No log	4.6667	112	1.2251	0.4706	1.2251	1.1069
No log	4.75	114	1.0040	0.5970	1.0040	1.0020
No log	4.8333	116	0.9483	0.6471	0.9483	0.9738
No log	4.9167	118	0.9746	0.6165	0.9746	0.9872
No log	5.0	120	1.1665	0.5496	1.1665	1.0801
No log	5.0833	122	1.1373	0.5469	1.1373	1.0664
No log	5.1667	124	1.0368	0.4715	1.0368	1.0182
No log	5.25	126	1.0920	0.4754	1.0920	1.0450
No log	5.3333	128	1.1000	0.4615	1.1000	1.0488
No log	5.4167	130	1.1934	0.5041	1.1934	1.0924
No log	5.5	132	1.1127	0.5397	1.1127	1.0548
No log	5.5833	134	0.9291	0.6299	0.9291	0.9639
No log	5.6667	136	0.8471	0.6269	0.8471	0.9204
No log	5.75	138	0.7843	0.7042	0.7843	0.8856
No log	5.8333	140	0.8219	0.6667	0.8219	0.9066
No log	5.9167	142	0.9651	0.6015	0.9651	0.9824
No log	6.0	144	0.9539	0.6212	0.9539	0.9767
No log	6.0833	146	1.0050	0.5954	1.0050	1.0025
No log	6.1667	148	0.9825	0.6412	0.9825	0.9912
No log	6.25	150	1.0559	0.4839	1.0559	1.0276
No log	6.3333	152	1.1096	0.4667	1.1096	1.0534
No log	6.4167	154	1.1875	0.5645	1.1875	1.0897
No log	6.5	156	1.2463	0.4885	1.2463	1.1164
No log	6.5833	158	1.1415	0.5116	1.1415	1.0684
No log	6.6667	160	0.9859	0.6569	0.9859	0.9929
No log	6.75	162	0.9604	0.6383	0.9604	0.9800
No log	6.8333	164	0.9805	0.6338	0.9805	0.9902
No log	6.9167	166	0.9096	0.6479	0.9096	0.9537
No log	7.0	168	0.9375	0.6241	0.9375	0.9683
No log	7.0833	170	1.0305	0.5669	1.0305	1.0151
No log	7.1667	172	1.1006	0.5556	1.1006	1.0491
No log	7.25	174	1.0853	0.5323	1.0853	1.0418
No log	7.3333	176	1.0564	0.4628	1.0564	1.0278
No log	7.4167	178	1.0491	0.4628	1.0491	1.0243
No log	7.5	180	0.9762	0.512	0.9762	0.9880
No log	7.5833	182	0.9599	0.5496	0.9599	0.9797
No log	7.6667	184	1.1096	0.5581	1.1096	1.0534
No log	7.75	186	1.2317	0.5385	1.2317	1.1098
No log	7.8333	188	1.3505	0.5191	1.3505	1.1621
No log	7.9167	190	1.3039	0.5385	1.3039	1.1419
No log	8.0	192	1.1357	0.5385	1.1357	1.0657
No log	8.0833	194	1.1575	0.5385	1.1575	1.0759
No log	8.1667	196	1.1072	0.5714	1.1072	1.0522
No log	8.25	198	1.0268	0.6	1.0268	1.0133
No log	8.3333	200	0.9818	0.6	0.9818	0.9909
No log	8.4167	202	1.0854	0.5891	1.0854	1.0418
No log	8.5	204	1.3088	0.5271	1.3088	1.1440
No log	8.5833	206	1.2851	0.5271	1.2851	1.1336
No log	8.6667	208	1.1686	0.5714	1.1686	1.0810
No log	8.75	210	1.1199	0.5714	1.1199	1.0583
No log	8.8333	212	1.0611	0.6	1.0611	1.0301
No log	8.9167	214	1.0346	0.6	1.0346	1.0172
No log	9.0	216	0.9921	0.6260	0.9921	0.9960
No log	9.0833	218	1.0490	0.5736	1.0490	1.0242
No log	9.1667	220	1.1820	0.5271	1.1820	1.0872
No log	9.25	222	1.1381	0.5496	1.1381	1.0668
No log	9.3333	224	0.9426	0.6061	0.9426	0.9709
No log	9.4167	226	0.8825	0.6412	0.8825	0.9394
No log	9.5	228	0.9366	0.6061	0.9366	0.9678
No log	9.5833	230	1.1331	0.5385	1.1331	1.0645
No log	9.6667	232	1.2537	0.5	1.2537	1.1197
No log	9.75	234	1.3048	0.4615	1.3048	1.1423
No log	9.8333	236	1.1352	0.5271	1.1352	1.0655
No log	9.9167	238	1.0739	0.5323	1.0739	1.0363
No log	10.0	240	1.1108	0.4793	1.1108	1.0539
No log	10.0833	242	1.2072	0.4793	1.2072	1.0987
No log	10.1667	244	1.2272	0.512	1.2272	1.1078
No log	10.25	246	1.1737	0.5079	1.1737	1.0834
No log	10.3333	248	1.0240	0.5649	1.0240	1.0119
No log	10.4167	250	0.9626	0.6015	0.9626	0.9811
No log	10.5	252	1.0161	0.5649	1.0161	1.0080
No log	10.5833	254	1.0484	0.5692	1.0484	1.0239
No log	10.6667	256	1.1036	0.5692	1.1036	1.0505
No log	10.75	258	1.2733	0.5197	1.2733	1.1284
No log	10.8333	260	1.2943	0.5	1.2943	1.1377
No log	10.9167	262	1.1377	0.5512	1.1377	1.0666
No log	11.0	264	0.9873	0.56	0.9873	0.9937
No log	11.0833	266	0.9548	0.5691	0.9548	0.9771
No log	11.1667	268	0.9525	0.5366	0.9525	0.9760
No log	11.25	270	1.0025	0.5827	1.0025	1.0013
No log	11.3333	272	1.2267	0.5312	1.2267	1.1076
No log	11.4167	274	1.3618	0.5	1.3618	1.1669
No log	11.5	276	1.2622	0.5197	1.2622	1.1235
No log	11.5833	278	1.0850	0.5556	1.0850	1.0416
No log	11.6667	280	1.0308	0.544	1.0308	1.0153
No log	11.75	282	1.0171	0.5354	1.0171	1.0085
No log	11.8333	284	1.0277	0.5323	1.0277	1.0138
No log	11.9167	286	1.0976	0.5556	1.0976	1.0476
No log	12.0	288	1.0996	0.5556	1.0996	1.0486
No log	12.0833	290	1.0390	0.5645	1.0390	1.0193
No log	12.1667	292	1.0221	0.5082	1.0221	1.0110
No log	12.25	294	1.0071	0.5082	1.0071	1.0036
No log	12.3333	296	0.9944	0.5484	0.9944	0.9972
No log	12.4167	298	1.0104	0.5556	1.0104	1.0052
No log	12.5	300	1.0509	0.5556	1.0509	1.0251
No log	12.5833	302	1.1075	0.5556	1.1075	1.0524
No log	12.6667	304	1.1260	0.5556	1.1260	1.0611
No log	12.75	306	1.1155	0.5041	1.1155	1.0562
No log	12.8333	308	1.1306	0.4370	1.1306	1.0633
No log	12.9167	310	1.1475	0.4370	1.1475	1.0712
No log	13.0	312	1.1446	0.4500	1.1446	1.0699
No log	13.0833	314	1.1258	0.5323	1.1258	1.0611
No log	13.1667	316	1.0934	0.5669	1.0934	1.0457
No log	13.25	318	1.1418	0.5469	1.1418	1.0686
No log	13.3333	320	1.1830	0.5385	1.1830	1.0877
No log	13.4167	322	1.0966	0.5469	1.0966	1.0472
No log	13.5	324	0.9553	0.5781	0.9553	0.9774
No log	13.5833	326	0.9319	0.5781	0.9319	0.9653
No log	13.6667	328	0.9149	0.5827	0.9149	0.9565
No log	13.75	330	0.9141	0.5484	0.9141	0.9561
No log	13.8333	332	0.9595	0.5246	0.9595	0.9795
No log	13.9167	334	1.0479	0.4874	1.0479	1.0237
No log	14.0	336	1.0804	0.4874	1.0804	1.0394
No log	14.0833	338	1.0931	0.5289	1.0931	1.0455
No log	14.1667	340	1.0605	0.5484	1.0605	1.0298
No log	14.25	342	1.0127	0.5827	1.0127	1.0063
No log	14.3333	344	0.9537	0.6	0.9537	0.9766
No log	14.4167	346	0.9769	0.6269	0.9769	0.9884
No log	14.5	348	1.0396	0.5954	1.0396	1.0196
No log	14.5833	350	0.9945	0.6015	0.9945	0.9972
No log	14.6667	352	0.9748	0.5161	0.9748	0.9873
No log	14.75	354	0.9810	0.5082	0.9810	0.9904
No log	14.8333	356	0.9933	0.528	0.9933	0.9966
No log	14.9167	358	1.0808	0.5781	1.0808	1.0396
No log	15.0	360	1.2619	0.5116	1.2619	1.1233
No log	15.0833	362	1.2881	0.5077	1.2881	1.1350
No log	15.1667	364	1.1543	0.5271	1.1543	1.0744
No log	15.25	366	0.9953	0.6119	0.9953	0.9977
No log	15.3333	368	0.9352	0.6212	0.9352	0.9670
No log	15.4167	370	0.9737	0.5909	0.9737	0.9868
No log	15.5	372	1.1088	0.5649	1.1088	1.0530
No log	15.5833	374	1.2092	0.5271	1.2092	1.0996
No log	15.6667	376	1.3229	0.5	1.3229	1.1502
No log	15.75	378	1.3404	0.4724	1.3404	1.1577
No log	15.8333	380	1.2223	0.5538	1.2223	1.1056
No log	15.9167	382	1.2335	0.5271	1.2335	1.1106
No log	16.0	384	1.2209	0.5271	1.2209	1.1049
No log	16.0833	386	1.2078	0.5271	1.2078	1.0990
No log	16.1667	388	1.2389	0.5	1.2389	1.1131
No log	16.25	390	1.2047	0.4921	1.2047	1.0976
No log	16.3333	392	1.2412	0.5197	1.2412	1.1141
No log	16.4167	394	1.2725	0.5197	1.2725	1.1281
No log	16.5	396	1.2140	0.5197	1.2140	1.1018
No log	16.5833	398	1.0891	0.5556	1.0891	1.0436
No log	16.6667	400	1.0430	0.5197	1.0430	1.0213
No log	16.75	402	1.0321	0.5156	1.0321	1.0159
No log	16.8333	404	1.0217	0.5426	1.0217	1.0108
No log	16.9167	406	1.0452	0.5846	1.0452	1.0224
No log	17.0	408	1.0782	0.5938	1.0782	1.0384
No log	17.0833	410	1.0405	0.5938	1.0405	1.0201
No log	17.1667	412	0.9606	0.5909	0.9606	0.9801
No log	17.25	414	0.9530	0.5802	0.9530	0.9762
No log	17.3333	416	0.9844	0.5669	0.9844	0.9922
No log	17.4167	418	1.0973	0.5385	1.0973	1.0475
No log	17.5	420	1.2395	0.4961	1.2395	1.1133
No log	17.5833	422	1.2143	0.5385	1.2143	1.1020
No log	17.6667	424	1.1209	0.5669	1.1209	1.0587
No log	17.75	426	1.1169	0.4915	1.1169	1.0568
No log	17.8333	428	1.1863	0.375	1.1863	1.0892
No log	17.9167	430	1.2621	0.3423	1.2621	1.1234
No log	18.0	432	1.2885	0.4138	1.2885	1.1351
No log	18.0833	434	1.2604	0.528	1.2604	1.1227
No log	18.1667	436	1.1813	0.5397	1.1813	1.0869
No log	18.25	438	1.0873	0.5669	1.0873	1.0427
No log	18.3333	440	1.0885	0.5781	1.0885	1.0433
No log	18.4167	442	1.1660	0.5231	1.1660	1.0798
No log	18.5	444	1.2338	0.5224	1.2338	1.1108
No log	18.5833	446	1.3213	0.5468	1.3213	1.1495
No log	18.6667	448	1.2485	0.5414	1.2485	1.1174
No log	18.75	450	1.1235	0.5397	1.1235	1.0599
No log	18.8333	452	1.0504	0.5669	1.0504	1.0249
No log	18.9167	454	1.0458	0.5781	1.0458	1.0227
No log	19.0	456	1.0979	0.5581	1.0979	1.0478
No log	19.0833	458	1.0920	0.5385	1.0920	1.0450
No log	19.1667	460	1.1461	0.5231	1.1461	1.0706
No log	19.25	462	1.1409	0.5271	1.1409	1.0681
No log	19.3333	464	1.1814	0.5271	1.1814	1.0869
No log	19.4167	466	1.1362	0.5469	1.1362	1.0659
No log	19.5	468	1.1003	0.5469	1.1003	1.0490
No log	19.5833	470	1.0529	0.5469	1.0529	1.0261
No log	19.6667	472	0.9627	0.5938	0.9627	0.9812
No log	19.75	474	0.9082	0.6094	0.9082	0.9530
No log	19.8333	476	0.9206	0.5984	0.9206	0.9595
No log	19.9167	478	0.9768	0.5736	0.9768	0.9883
No log	20.0	480	1.0798	0.5469	1.0798	1.0391
No log	20.0833	482	1.0832	0.5469	1.0832	1.0408
No log	20.1667	484	1.1130	0.5469	1.1130	1.0550
No log	20.25	486	1.1099	0.5736	1.1099	1.0535
No log	20.3333	488	1.0635	0.5736	1.0635	1.0313
No log	20.4167	490	1.0319	0.5802	1.0319	1.0158
No log	20.5	492	1.0387	0.6	1.0387	1.0192
No log	20.5833	494	1.0749	0.5802	1.0749	1.0368
No log	20.6667	496	1.1781	0.5469	1.1781	1.0854
No log	20.75	498	1.1920	0.5271	1.1920	1.0918
0.3589	20.8333	500	1.1145	0.5606	1.1145	1.0557
0.3589	20.9167	502	1.0245	0.6107	1.0245	1.0122
0.3589	21.0	504	1.0492	0.6	1.0492	1.0243
0.3589	21.0833	506	1.1179	0.5802	1.1179	1.0573
0.3589	21.1667	508	1.1543	0.5625	1.1543	1.0744
0.3589	21.25	510	1.1763	0.5625	1.1763	1.0846
0.3589	21.3333	512	1.1254	0.5556	1.1254	1.0608
0.3589	21.4167	514	1.0396	0.5385	1.0396	1.0196
0.3589	21.5	516	0.9965	0.5271	0.9965	0.9982
0.3589	21.5833	518	1.0000	0.5344	1.0000	1.0000
0.3589	21.6667	520	1.0425	0.5556	1.0425	1.0210

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1