ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8555
• Qwk: 0.2714
• Mse: 1.8555
• Rmse: 1.3622

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	7.0336	-0.0113	7.0336	2.6521
No log	0.1379	4	4.9623	0.0444	4.9623	2.2276
No log	0.2069	6	3.6776	-0.0215	3.6776	1.9177
No log	0.2759	8	3.2546	-0.0109	3.2546	1.8041
No log	0.3448	10	2.4296	0.1793	2.4296	1.5587
No log	0.4138	12	2.0250	0.2222	2.0250	1.4230
No log	0.4828	14	1.9340	0.2353	1.9340	1.3907
No log	0.5517	16	1.9629	0.2742	1.9629	1.4010
No log	0.6207	18	2.0943	0.2815	2.0943	1.4472
No log	0.6897	20	2.1332	0.1727	2.1332	1.4605
No log	0.7586	22	2.1784	0.0839	2.1784	1.4759
No log	0.8276	24	2.2093	0.0280	2.2093	1.4864
No log	0.8966	26	2.1426	0.1846	2.1426	1.4638
No log	0.9655	28	2.0100	0.1695	2.0100	1.4177
No log	1.0345	30	2.0004	0.1849	2.0004	1.4143
No log	1.1034	32	1.8592	0.1913	1.8592	1.3635
No log	1.1724	34	1.8931	0.3360	1.8931	1.3759
No log	1.2414	36	1.8643	0.2903	1.8643	1.3654
No log	1.3103	38	1.8561	0.3226	1.8561	1.3624
No log	1.3793	40	1.8498	0.3193	1.8498	1.3601
No log	1.4483	42	1.9957	0.2879	1.9957	1.4127
No log	1.5172	44	2.2000	0.1088	2.2000	1.4832
No log	1.5862	46	2.2519	0.0966	2.2519	1.5006
No log	1.6552	48	2.0794	0.2044	2.0794	1.4420
No log	1.7241	50	1.8257	0.2521	1.8257	1.3512
No log	1.7931	52	1.6145	0.0952	1.6145	1.2706
No log	1.8621	54	1.5958	0.1143	1.5958	1.2633
No log	1.9310	56	1.5967	0.1143	1.5967	1.2636
No log	2.0	58	1.6743	0.1495	1.6743	1.2940
No log	2.0690	60	1.7428	0.2281	1.7428	1.3201
No log	2.1379	62	1.7379	0.2712	1.7379	1.3183
No log	2.2069	64	2.0447	0.2734	2.0447	1.4299
No log	2.2759	66	2.5578	0.1333	2.5578	1.5993
No log	2.3448	68	2.9436	0.0710	2.9436	1.7157
No log	2.4138	70	2.7349	0.0897	2.7349	1.6538
No log	2.4828	72	2.0016	0.2443	2.0016	1.4148
No log	2.5517	74	1.5160	0.4202	1.5160	1.2313
No log	2.6207	76	1.3924	0.3304	1.3924	1.1800
No log	2.6897	78	1.3655	0.2857	1.3655	1.1686
No log	2.7586	80	1.4646	0.4715	1.4646	1.2102
No log	2.8276	82	1.6219	0.3692	1.6219	1.2735
No log	2.8966	84	1.5568	0.4122	1.5568	1.2477
No log	2.9655	86	1.6130	0.4242	1.6130	1.2701
No log	3.0345	88	1.6488	0.4030	1.6488	1.2841
No log	3.1034	90	2.2555	0.0	2.2555	1.5018
No log	3.1724	92	2.4941	-0.0480	2.4941	1.5793
No log	3.2414	94	2.0998	0.1085	2.0998	1.4491
No log	3.3103	96	1.5569	0.4296	1.5569	1.2477
No log	3.3793	98	1.4955	0.4211	1.4955	1.2229
No log	3.4483	100	1.7417	0.3088	1.7417	1.3197
No log	3.5172	102	2.0945	0.2158	2.0945	1.4472
No log	3.5862	104	2.1282	0.2158	2.1282	1.4588
No log	3.6552	106	1.7966	0.2941	1.7966	1.3404
No log	3.7241	108	1.5556	0.3968	1.5556	1.2472
No log	3.7931	110	1.5513	0.4132	1.5513	1.2455
No log	3.8621	112	1.6436	0.3419	1.6436	1.2820
No log	3.9310	114	1.7379	0.3089	1.7379	1.3183
No log	4.0	116	2.0008	0.1417	2.0008	1.4145
No log	4.0690	118	2.1866	0.0448	2.1866	1.4787
No log	4.1379	120	2.1901	0.0746	2.1901	1.4799
No log	4.2069	122	1.8437	0.25	1.8437	1.3578
No log	4.2759	124	1.3267	0.4960	1.3267	1.1518
No log	4.3448	126	1.1878	0.5039	1.1878	1.0899
No log	4.4138	128	1.2344	0.5271	1.2344	1.1110
No log	4.4828	130	1.5905	0.2812	1.5905	1.2611
No log	4.5517	132	1.8594	0.1527	1.8594	1.3636
No log	4.6207	134	1.9010	0.2059	1.9010	1.3788
No log	4.6897	136	1.9250	0.2143	1.9250	1.3875
No log	4.7586	138	1.8201	0.3053	1.8201	1.3491
No log	4.8276	140	1.6106	0.3871	1.6106	1.2691
No log	4.8966	142	1.4922	0.4103	1.4922	1.2216
No log	4.9655	144	1.4927	0.3423	1.4927	1.2218
No log	5.0345	146	1.6386	0.2321	1.6386	1.2801
No log	5.1034	148	1.7670	0.1818	1.7670	1.3293
No log	5.1724	150	1.8156	0.2000	1.8156	1.3474
No log	5.2414	152	1.8487	0.2899	1.8487	1.3597
No log	5.3103	154	1.9444	0.2754	1.9444	1.3944
No log	5.3793	156	1.8533	0.3259	1.8533	1.3613
No log	5.4483	158	1.8168	0.3284	1.8168	1.3479
No log	5.5172	160	2.0399	0.2429	2.0399	1.4282
No log	5.5862	162	2.2459	0.1944	2.2459	1.4986
No log	5.6552	164	2.0305	0.2429	2.0305	1.4250
No log	5.7241	166	1.7014	0.2791	1.7014	1.3044
No log	5.7931	168	1.6128	0.3740	1.6128	1.2699
No log	5.8621	170	1.6454	0.2992	1.6454	1.2827
No log	5.9310	172	1.7062	0.3150	1.7062	1.3062
No log	6.0	174	1.6997	0.2903	1.6997	1.3037
No log	6.0690	176	1.6161	0.3529	1.6161	1.2712
No log	6.1379	178	1.5130	0.3860	1.5130	1.2300
No log	6.2069	180	1.5263	0.3860	1.5263	1.2354
No log	6.2759	182	1.5738	0.3793	1.5738	1.2545
No log	6.3448	184	1.5957	0.35	1.5957	1.2632
No log	6.4138	186	1.5312	0.3729	1.5312	1.2374
No log	6.4828	188	1.5285	0.3636	1.5285	1.2363
No log	6.5517	190	1.6772	0.3040	1.6772	1.2950
No log	6.6207	192	1.7689	0.2901	1.7689	1.3300
No log	6.6897	194	1.8489	0.2963	1.8489	1.3597
No log	6.7586	196	1.7502	0.3111	1.7502	1.3230
No log	6.8276	198	1.5508	0.4375	1.5508	1.2453
No log	6.8966	200	1.4847	0.4724	1.4847	1.2185
No log	6.9655	202	1.5181	0.4724	1.5181	1.2321
No log	7.0345	204	1.5424	0.4603	1.5424	1.2419
No log	7.1034	206	1.4999	0.4603	1.4999	1.2247
No log	7.1724	208	1.4678	0.4603	1.4678	1.2115
No log	7.2414	210	1.4921	0.4724	1.4921	1.2215
No log	7.3103	212	1.6535	0.3788	1.6535	1.2859
No log	7.3793	214	1.7588	0.3088	1.7588	1.3262
No log	7.4483	216	1.9308	0.2590	1.9308	1.3895
No log	7.5172	218	2.0582	0.2411	2.0582	1.4346
No log	7.5862	220	1.9720	0.2302	1.9720	1.4043
No log	7.6552	222	1.7126	0.3088	1.7126	1.3087
No log	7.7241	224	1.6268	0.3359	1.6268	1.2755
No log	7.7931	226	1.6687	0.2835	1.6687	1.2918
No log	7.8621	228	1.6945	0.2835	1.6945	1.3017
No log	7.9310	230	1.5999	0.3360	1.5999	1.2649
No log	8.0	232	1.5641	0.3333	1.5641	1.2506
No log	8.0690	234	1.4382	0.4065	1.4382	1.1992
No log	8.1379	236	1.4167	0.4355	1.4167	1.1903
No log	8.2069	238	1.5976	0.3385	1.5976	1.2640
No log	8.2759	240	1.9256	0.1940	1.9256	1.3876
No log	8.3448	242	2.1230	0.1333	2.1230	1.4570
No log	8.4138	244	2.2137	0.0916	2.2137	1.4879
No log	8.4828	246	2.0977	0.1148	2.0977	1.4484
No log	8.5517	248	1.7572	0.1920	1.7572	1.3256
No log	8.6207	250	1.4512	0.4762	1.4512	1.2047
No log	8.6897	252	1.3954	0.4724	1.3954	1.1813
No log	8.7586	254	1.5193	0.3939	1.5193	1.2326
No log	8.8276	256	1.8221	0.2429	1.8221	1.3498
No log	8.8966	258	1.8957	0.2429	1.8957	1.3769
No log	8.9655	260	1.7216	0.3259	1.7216	1.3121
No log	9.0345	262	1.6431	0.3259	1.6431	1.2818
No log	9.1034	264	1.5426	0.4122	1.5426	1.2420
No log	9.1724	266	1.5842	0.4122	1.5842	1.2586
No log	9.2414	268	1.8166	0.2590	1.8166	1.3478
No log	9.3103	270	1.8649	0.2429	1.8649	1.3656
No log	9.3793	272	1.6700	0.3433	1.6700	1.2923
No log	9.4483	274	1.5268	0.4762	1.5268	1.2356
No log	9.5172	276	1.4650	0.48	1.4650	1.2104
No log	9.5862	278	1.4850	0.4762	1.4850	1.2186
No log	9.6552	280	1.6243	0.3308	1.6243	1.2745
No log	9.7241	282	1.8191	0.2464	1.8191	1.3487
No log	9.7931	284	1.8854	0.2302	1.8854	1.3731
No log	9.8621	286	1.8512	0.2464	1.8512	1.3606
No log	9.9310	288	1.7483	0.3088	1.7483	1.3222
No log	10.0	290	1.5944	0.3759	1.5944	1.2627
No log	10.0690	292	1.5145	0.4462	1.5145	1.2306
No log	10.1379	294	1.5924	0.3759	1.5924	1.2619
No log	10.2069	296	1.7761	0.3088	1.7761	1.3327
No log	10.2759	298	1.7523	0.3088	1.7523	1.3237
No log	10.3448	300	1.6201	0.3433	1.6201	1.2728
No log	10.4138	302	1.6052	0.3485	1.6052	1.2670
No log	10.4828	304	1.6207	0.3485	1.6207	1.2731
No log	10.5517	306	1.7446	0.2963	1.7446	1.3208
No log	10.6207	308	2.0260	0.2429	2.0260	1.4234
No log	10.6897	310	2.1099	0.2128	2.1099	1.4525
No log	10.7586	312	1.9599	0.2482	1.9599	1.4000
No log	10.8276	314	1.7237	0.2969	1.7237	1.3129
No log	10.8966	316	1.5982	0.3538	1.5982	1.2642
No log	10.9655	318	1.6279	0.3664	1.6279	1.2759
No log	11.0345	320	1.5942	0.3788	1.5942	1.2626
No log	11.1034	322	1.7260	0.3731	1.7260	1.3138
No log	11.1724	324	1.8554	0.3358	1.8554	1.3621
No log	11.2414	326	1.7632	0.3556	1.7632	1.3279
No log	11.3103	328	1.7205	0.3556	1.7205	1.3117
No log	11.3793	330	1.5909	0.3759	1.5909	1.2613
No log	11.4483	332	1.5411	0.3876	1.5411	1.2414
No log	11.5172	334	1.6067	0.3459	1.6067	1.2676
No log	11.5862	336	1.6679	0.3433	1.6679	1.2915
No log	11.6552	338	1.7789	0.3158	1.7789	1.3337
No log	11.7241	340	1.8109	0.3158	1.8109	1.3457
No log	11.7931	342	1.8044	0.3333	1.8044	1.3433
No log	11.8621	344	1.7502	0.3459	1.7502	1.3229
No log	11.9310	346	1.7825	0.3556	1.7825	1.3351
No log	12.0	348	1.6914	0.3582	1.6914	1.3006
No log	12.0690	350	1.6180	0.3704	1.6180	1.2720
No log	12.1379	352	1.6175	0.3704	1.6175	1.2718
No log	12.2069	354	1.7938	0.3188	1.7938	1.3393
No log	12.2759	356	2.0227	0.2621	2.0227	1.4222
No log	12.3448	358	1.9972	0.2703	1.9972	1.4132
No log	12.4138	360	1.7781	0.3358	1.7781	1.3334
No log	12.4828	362	1.6145	0.4060	1.6145	1.2706
No log	12.5517	364	1.5644	0.4242	1.5644	1.2507
No log	12.6207	366	1.6551	0.3731	1.6551	1.2865
No log	12.6897	368	1.8398	0.2937	1.8398	1.3564
No log	12.7586	370	1.8077	0.2878	1.8077	1.3445
No log	12.8276	372	1.8398	0.2714	1.8398	1.3564
No log	12.8966	374	1.9068	0.2553	1.9068	1.3809
No log	12.9655	376	1.8242	0.2857	1.8242	1.3506
No log	13.0345	378	1.7258	0.3235	1.7258	1.3137
No log	13.1034	380	1.5524	0.4341	1.5524	1.2459
No log	13.1724	382	1.3811	0.5	1.3811	1.1752
No log	13.2414	384	1.3620	0.4918	1.3620	1.1670
No log	13.3103	386	1.4899	0.4531	1.4899	1.2206
No log	13.3793	388	1.6719	0.3235	1.6719	1.2930
No log	13.4483	390	1.9276	0.2734	1.9276	1.3884
No log	13.5172	392	1.9137	0.3043	1.9137	1.3834
No log	13.5862	394	1.7401	0.3382	1.7401	1.3191
No log	13.6552	396	1.6785	0.4	1.6785	1.2956
No log	13.7241	398	1.7087	0.3556	1.7087	1.3072
No log	13.7931	400	1.8641	0.2899	1.8641	1.3653
No log	13.8621	402	2.0665	0.2254	2.0665	1.4375
No log	13.9310	404	2.0658	0.2254	2.0658	1.4373
No log	14.0	406	1.9802	0.2734	1.9802	1.4072
No log	14.0690	408	1.8402	0.2734	1.8402	1.3566
No log	14.1379	410	1.6068	0.4091	1.6068	1.2676
No log	14.2069	412	1.4904	0.4286	1.4904	1.2208
No log	14.2759	414	1.4861	0.4688	1.4861	1.2190
No log	14.3448	416	1.6133	0.3939	1.6133	1.2702
No log	14.4138	418	1.7624	0.3382	1.7624	1.3276
No log	14.4828	420	1.8805	0.3188	1.8805	1.3713
No log	14.5517	422	1.9200	0.2878	1.9200	1.3856
No log	14.6207	424	1.9024	0.3188	1.9024	1.3793
No log	14.6897	426	1.8949	0.3212	1.8949	1.3765
No log	14.7586	428	1.8919	0.3358	1.8919	1.3755
No log	14.8276	430	1.8439	0.3556	1.8439	1.3579
No log	14.8966	432	1.7523	0.3556	1.7523	1.3237
No log	14.9655	434	1.6935	0.3485	1.6935	1.3014
No log	15.0345	436	1.6611	0.3385	1.6611	1.2888
No log	15.1034	438	1.6127	0.3664	1.6127	1.2699
No log	15.1724	440	1.5917	0.3636	1.5917	1.2616
No log	15.2414	442	1.6757	0.3459	1.6757	1.2945
No log	15.3103	444	1.8595	0.2734	1.8595	1.3636
No log	15.3793	446	1.8759	0.2734	1.8759	1.3696
No log	15.4483	448	1.8069	0.2734	1.8069	1.3442
No log	15.5172	450	1.7391	0.3111	1.7391	1.3187
No log	15.5862	452	1.7058	0.3284	1.7058	1.3061
No log	15.6552	454	1.7072	0.3284	1.7072	1.3066
No log	15.7241	456	1.6675	0.3636	1.6675	1.2913
No log	15.7931	458	1.6920	0.3284	1.6920	1.3008
No log	15.8621	460	1.7943	0.3407	1.7943	1.3395
No log	15.9310	462	1.9555	0.2411	1.9555	1.3984
No log	16.0	464	2.0155	0.2411	2.0155	1.4197
No log	16.0690	466	1.9352	0.2734	1.9352	1.3911
No log	16.1379	468	1.8670	0.2734	1.8670	1.3664
No log	16.2069	470	1.8561	0.2734	1.8561	1.3624
No log	16.2759	472	1.8982	0.2734	1.8982	1.3778
No log	16.3448	474	1.8871	0.2899	1.8871	1.3737
No log	16.4138	476	1.8565	0.2899	1.8565	1.3625
No log	16.4828	478	1.8418	0.2899	1.8418	1.3571
No log	16.5517	480	1.8150	0.2628	1.8150	1.3472
No log	16.6207	482	1.7274	0.2963	1.7274	1.3143
No log	16.6897	484	1.6185	0.4154	1.6185	1.2722
No log	16.7586	486	1.5425	0.4	1.5425	1.2420
No log	16.8276	488	1.5294	0.4603	1.5294	1.2367
No log	16.8966	490	1.5931	0.4154	1.5931	1.2622
No log	16.9655	492	1.6418	0.4154	1.6418	1.2813
No log	17.0345	494	1.7080	0.2815	1.7080	1.3069
No log	17.1034	496	1.6855	0.2794	1.6855	1.2983
No log	17.1724	498	1.6061	0.3609	1.6061	1.2673
0.4078	17.2414	500	1.5640	0.3846	1.5640	1.2506
0.4078	17.3103	502	1.5606	0.3664	1.5606	1.2492
0.4078	17.3793	504	1.5799	0.3664	1.5799	1.2569
0.4078	17.4483	506	1.6085	0.3664	1.6085	1.2683
0.4078	17.5172	508	1.5784	0.4031	1.5784	1.2563
0.4078	17.5862	510	1.5423	0.4320	1.5423	1.2419
0.4078	17.6552	512	1.5775	0.4531	1.5775	1.2560
0.4078	17.7241	514	1.6208	0.4031	1.6208	1.2731
0.4078	17.7931	516	1.5931	0.4031	1.5931	1.2622
0.4078	17.8621	518	1.5580	0.4320	1.5580	1.2482
0.4078	17.9310	520	1.5326	0.4553	1.5326	1.2380
0.4078	18.0	522	1.5293	0.4375	1.5293	1.2367
0.4078	18.0690	524	1.6539	0.3433	1.6539	1.2860
0.4078	18.1379	526	1.8749	0.2754	1.8749	1.3693
0.4078	18.2069	528	2.0342	0.2394	2.0342	1.4262
0.4078	18.2759	530	2.0142	0.2797	2.0142	1.4192
0.4078	18.3448	532	1.8555	0.2714	1.8555	1.3622

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1