ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8201
• Qwk: 0.3582
• Mse: 1.8201
• Rmse: 1.3491

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0541	2	7.1848	0.0056	7.1848	2.6804
No log	0.1081	4	4.4756	0.0823	4.4756	2.1156
No log	0.1622	6	3.7482	-0.0628	3.7482	1.9360
No log	0.2162	8	3.4179	-0.0447	3.4179	1.8488
No log	0.2703	10	2.8327	0.0414	2.8327	1.6831
No log	0.3243	12	1.9156	0.1217	1.9156	1.3841
No log	0.3784	14	2.4209	-0.0144	2.4209	1.5559
No log	0.4324	16	3.4241	0.0347	3.4241	1.8504
No log	0.4865	18	3.3714	0.0253	3.3714	1.8361
No log	0.5405	20	2.6959	0.0133	2.6959	1.6419
No log	0.5946	22	2.0582	0.1653	2.0582	1.4346
No log	0.6486	24	1.8302	0.2364	1.8302	1.3528
No log	0.7027	26	1.5814	0.1714	1.5814	1.2575
No log	0.7568	28	1.5449	0.1714	1.5449	1.2429
No log	0.8108	30	1.5200	0.1714	1.5200	1.2329
No log	0.8649	32	1.6731	0.3478	1.6731	1.2935
No log	0.9189	34	1.9591	0.2636	1.9591	1.3997
No log	0.9730	36	2.2767	0.0822	2.2767	1.5089
No log	1.0270	38	2.3552	0.0822	2.3552	1.5347
No log	1.0811	40	2.3872	0.1103	2.3872	1.5451
No log	1.1351	42	2.2510	0.1844	2.2510	1.5003
No log	1.1892	44	1.8297	0.2462	1.8297	1.3527
No log	1.2432	46	1.3195	0.3220	1.3195	1.1487
No log	1.2973	48	1.2674	0.4833	1.2674	1.1258
No log	1.3514	50	1.3834	0.4034	1.3834	1.1762
No log	1.4054	52	1.4145	0.3140	1.4145	1.1893
No log	1.4595	54	1.6572	0.3150	1.6572	1.2873
No log	1.5135	56	1.5850	0.3065	1.5850	1.2590
No log	1.5676	58	1.4634	0.3333	1.4634	1.2097
No log	1.6216	60	1.4583	0.3906	1.4583	1.2076
No log	1.6757	62	1.5761	0.2951	1.5761	1.2554
No log	1.7297	64	1.7031	0.2131	1.7031	1.3050
No log	1.7838	66	1.6345	0.2720	1.6345	1.2785
No log	1.8378	68	1.4672	0.3577	1.4672	1.2113
No log	1.8919	70	1.4414	0.3871	1.4414	1.2006
No log	1.9459	72	1.4211	0.4160	1.4211	1.1921
No log	2.0	74	1.3733	0.4286	1.3733	1.1719
No log	2.0541	76	1.3242	0.375	1.3242	1.1507
No log	2.1081	78	1.3774	0.3411	1.3774	1.1736
No log	2.1622	80	1.3507	0.375	1.3507	1.1622
No log	2.2162	82	1.5576	0.3307	1.5576	1.2480
No log	2.2703	84	1.7261	0.3256	1.7261	1.3138
No log	2.3243	86	1.6213	0.3817	1.6213	1.2733
No log	2.3784	88	1.6098	0.375	1.6098	1.2688
No log	2.4324	90	1.8023	0.3088	1.8023	1.3425
No log	2.4865	92	1.8441	0.3259	1.8441	1.3580
No log	2.5405	94	1.6932	0.2791	1.6932	1.3012
No log	2.5946	96	1.6127	0.2602	1.6127	1.2699
No log	2.6486	98	1.6409	0.2602	1.6409	1.2810
No log	2.7027	100	1.7488	0.2462	1.7488	1.3224
No log	2.7568	102	1.7983	0.3111	1.7983	1.3410
No log	2.8108	104	1.7692	0.2727	1.7692	1.3301
No log	2.8649	106	1.6766	0.2677	1.6766	1.2948
No log	2.9189	108	1.5328	0.2720	1.5328	1.2381
No log	2.9730	110	1.3673	0.4390	1.3673	1.1693
No log	3.0270	112	1.3375	0.3937	1.3375	1.1565
No log	3.0811	114	1.7190	0.2707	1.7190	1.3111
No log	3.1351	116	2.3918	0.0902	2.3918	1.5466
No log	3.1892	118	2.5789	0.0448	2.5789	1.6059
No log	3.2432	120	2.3102	0.1418	2.3102	1.5199
No log	3.2973	122	1.7727	0.2714	1.7727	1.3314
No log	3.3514	124	1.3318	0.4286	1.3318	1.1540
No log	3.4054	126	1.3128	0.4320	1.3128	1.1458
No log	3.4595	128	1.5408	0.3910	1.5408	1.2413
No log	3.5135	130	2.1167	0.2083	2.1167	1.4549
No log	3.5676	132	2.3592	0.1806	2.3592	1.5360
No log	3.6216	134	2.2580	0.1958	2.2580	1.5027
No log	3.6757	136	2.0586	0.2286	2.0586	1.4348
No log	3.7297	138	2.2114	0.1143	2.2114	1.4871
No log	3.7838	140	2.3027	0.1538	2.3027	1.5175
No log	3.8378	142	2.3309	0.0993	2.3309	1.5267
No log	3.8919	144	2.3753	0.0704	2.3753	1.5412
No log	3.9459	146	2.1330	0.1702	2.1330	1.4605
No log	4.0	148	1.7080	0.3284	1.7080	1.3069
No log	4.0541	150	1.5364	0.4094	1.5364	1.2395
No log	4.1081	152	1.5849	0.375	1.5849	1.2589
No log	4.1622	154	1.6789	0.4091	1.6789	1.2957
No log	4.2162	156	1.8035	0.3022	1.8035	1.3429
No log	4.2703	158	1.8706	0.3022	1.8706	1.3677
No log	4.3243	160	1.7643	0.3022	1.7643	1.3283
No log	4.3784	162	1.5763	0.3846	1.5763	1.2555
No log	4.4324	164	1.5576	0.375	1.5576	1.2481
No log	4.4865	166	1.6824	0.3459	1.6824	1.2971
No log	4.5405	168	1.9479	0.2754	1.9479	1.3957
No log	4.5946	170	1.9772	0.3111	1.9772	1.4061
No log	4.6486	172	1.9503	0.2836	1.9503	1.3965
No log	4.7027	174	1.8389	0.3284	1.8389	1.3560
No log	4.7568	176	1.7267	0.3433	1.7267	1.3140
No log	4.8108	178	1.6643	0.3308	1.6643	1.2901
No log	4.8649	180	1.5660	0.3664	1.5660	1.2514
No log	4.9189	182	1.5923	0.3385	1.5923	1.2619
No log	4.9730	184	1.6019	0.3231	1.6019	1.2656
No log	5.0270	186	1.4445	0.3780	1.4445	1.2019
No log	5.0811	188	1.2575	0.4754	1.2575	1.1214
No log	5.1351	190	1.1858	0.4833	1.1858	1.0889
No log	5.1892	192	1.2094	0.4516	1.2094	1.0997
No log	5.2432	194	1.1803	0.4409	1.1803	1.0864
No log	5.2973	196	1.2487	0.4341	1.2487	1.1175
No log	5.3514	198	1.6731	0.2748	1.6731	1.2935
No log	5.4054	200	1.6820	0.3016	1.6820	1.2969
No log	5.4595	202	1.6901	0.2419	1.6901	1.3001
No log	5.5135	204	1.8690	0.1803	1.8690	1.3671
No log	5.5676	206	1.8993	0.1626	1.8993	1.3781
No log	5.6216	208	1.5988	0.3016	1.5988	1.2644
No log	5.6757	210	1.7695	0.3385	1.7695	1.3302
No log	5.7297	212	2.1414	0.25	2.1414	1.4634
No log	5.7838	214	2.2711	0.1986	2.2711	1.5070
No log	5.8378	216	2.1380	0.2837	2.1380	1.4622
No log	5.8919	218	1.7038	0.3704	1.7038	1.3053
No log	5.9459	220	1.3721	0.4320	1.3721	1.1713
No log	6.0	222	1.3997	0.4194	1.3997	1.1831
No log	6.0541	224	1.6186	0.3910	1.6186	1.2722
No log	6.1081	226	1.7675	0.3731	1.7675	1.3295
No log	6.1622	228	1.7470	0.3407	1.7470	1.3217
No log	6.2162	230	1.6462	0.3910	1.6462	1.2830
No log	6.2703	232	1.5240	0.4186	1.5240	1.2345
No log	6.3243	234	1.4527	0.4219	1.4527	1.2053
No log	6.3784	236	1.4678	0.4186	1.4678	1.2115
No log	6.4324	238	1.6783	0.3910	1.6783	1.2955
No log	6.4865	240	1.7772	0.3235	1.7772	1.3331
No log	6.5405	242	1.5785	0.4122	1.5785	1.2564
No log	6.5946	244	1.3954	0.4426	1.3954	1.1813
No log	6.6486	246	1.3991	0.4640	1.3991	1.1829
No log	6.7027	248	1.5467	0.4091	1.5467	1.2436
No log	6.7568	250	1.8039	0.3235	1.8039	1.3431
No log	6.8108	252	1.8648	0.3212	1.8648	1.3656
No log	6.8649	254	1.8309	0.3235	1.8309	1.3531
No log	6.9189	256	1.7507	0.3407	1.7507	1.3231
No log	6.9730	258	1.4937	0.4545	1.4937	1.2222
No log	7.0270	260	1.4517	0.4545	1.4517	1.2049
No log	7.0811	262	1.6036	0.3910	1.6036	1.2663
No log	7.1351	264	1.7423	0.3910	1.7423	1.3200
No log	7.1892	266	1.7742	0.3910	1.7742	1.3320
No log	7.2432	268	1.6597	0.3910	1.6597	1.2883
No log	7.2973	270	1.5545	0.3910	1.5545	1.2468
No log	7.3514	272	1.6711	0.3910	1.6711	1.2927
No log	7.4054	274	1.6320	0.3910	1.6320	1.2775
No log	7.4595	276	1.6399	0.3910	1.6399	1.2806
No log	7.5135	278	1.7185	0.3910	1.7185	1.3109
No log	7.5676	280	1.6518	0.3910	1.6518	1.2852
No log	7.6216	282	1.7018	0.3788	1.7018	1.3045
No log	7.6757	284	1.7599	0.3538	1.7599	1.3266
No log	7.7297	286	1.8058	0.3538	1.8058	1.3438
No log	7.7838	288	1.6261	0.3511	1.6261	1.2752
No log	7.8378	290	1.3451	0.4545	1.3451	1.1598
No log	7.8919	292	1.3300	0.4545	1.3300	1.1532
No log	7.9459	294	1.4522	0.4091	1.4522	1.2051
No log	8.0	296	1.6283	0.3910	1.6283	1.2761
No log	8.0541	298	1.6558	0.3910	1.6558	1.2868
No log	8.1081	300	1.4683	0.4091	1.4683	1.2117
No log	8.1622	302	1.2406	0.4688	1.2406	1.1138
No log	8.2162	304	1.2447	0.4688	1.2447	1.1157
No log	8.2703	306	1.4435	0.4091	1.4435	1.2014
No log	8.3243	308	1.7120	0.3910	1.7120	1.3084
No log	8.3784	310	1.6849	0.3910	1.6849	1.2980
No log	8.4324	312	1.6049	0.3910	1.6049	1.2668
No log	8.4865	314	1.5699	0.3910	1.5699	1.2529
No log	8.5405	316	1.6354	0.3910	1.6354	1.2788
No log	8.5946	318	1.6486	0.3910	1.6486	1.2840
No log	8.6486	320	1.7166	0.3910	1.7166	1.3102
No log	8.7027	322	1.7775	0.3910	1.7775	1.3332
No log	8.7568	324	1.9766	0.3407	1.9766	1.4059
No log	8.8108	326	2.3833	0.1931	2.3833	1.5438
No log	8.8649	328	2.4612	0.1667	2.4612	1.5688
No log	8.9189	330	2.1932	0.2535	2.1932	1.4809
No log	8.9730	332	1.7494	0.3910	1.7494	1.3227
No log	9.0270	334	1.4394	0.4186	1.4394	1.1998
No log	9.0811	336	1.4108	0.384	1.4108	1.1878
No log	9.1351	338	1.5294	0.4275	1.5294	1.2367
No log	9.1892	340	1.6279	0.3910	1.6279	1.2759
No log	9.2432	342	1.7172	0.3910	1.7172	1.3104
No log	9.2973	344	1.7803	0.3910	1.7803	1.3343
No log	9.3514	346	1.7711	0.3910	1.7711	1.3308
No log	9.4054	348	1.6486	0.3910	1.6486	1.2840
No log	9.4595	350	1.5719	0.3910	1.5719	1.2537
No log	9.5135	352	1.6197	0.3910	1.6197	1.2727
No log	9.5676	354	1.8439	0.3407	1.8439	1.3579
No log	9.6216	356	2.0158	0.2857	2.0158	1.4198
No log	9.6757	358	1.8644	0.3235	1.8644	1.3654
No log	9.7297	360	1.5805	0.3910	1.5805	1.2572
No log	9.7838	362	1.4815	0.3910	1.4815	1.2172
No log	9.8378	364	1.5460	0.3910	1.5460	1.2434
No log	9.8919	366	1.7470	0.3731	1.7470	1.3217
No log	9.9459	368	1.8510	0.3235	1.8510	1.3605
No log	10.0	370	1.8341	0.3407	1.8341	1.3543
No log	10.0541	372	1.6770	0.3910	1.6770	1.2950
No log	10.1081	374	1.4933	0.4091	1.4933	1.2220
No log	10.1622	376	1.4998	0.4091	1.4998	1.2247
No log	10.2162	378	1.6816	0.3910	1.6816	1.2967
No log	10.2703	380	1.8670	0.3407	1.8670	1.3664
No log	10.3243	382	1.9117	0.3235	1.9117	1.3826
No log	10.3784	384	1.8028	0.3910	1.8028	1.3427
No log	10.4324	386	1.6308	0.3910	1.6308	1.2770
No log	10.4865	388	1.6918	0.3910	1.6918	1.3007
No log	10.5405	390	1.9323	0.2920	1.9323	1.3901
No log	10.5946	392	2.1769	0.2098	2.1769	1.4754
No log	10.6486	394	2.2155	0.1655	2.2155	1.4885
No log	10.7027	396	2.1256	0.2098	2.1256	1.4579
No log	10.7568	398	1.9125	0.3407	1.9125	1.3829
No log	10.8108	400	1.6177	0.3910	1.6177	1.2719
No log	10.8649	402	1.3752	0.3651	1.3752	1.1727
No log	10.9189	404	1.3953	0.4098	1.3953	1.1812
No log	10.9730	406	1.4952	0.3780	1.4952	1.2228
No log	11.0270	408	1.5871	0.3969	1.5871	1.2598
No log	11.0811	410	1.6023	0.3969	1.6023	1.2658
No log	11.1351	412	1.5862	0.3910	1.5862	1.2595
No log	11.1892	414	1.5812	0.3910	1.5812	1.2574
No log	11.2432	416	1.7155	0.3910	1.7155	1.3098
No log	11.2973	418	1.7633	0.3910	1.7633	1.3279
No log	11.3514	420	1.6915	0.3910	1.6915	1.3006
No log	11.4054	422	1.6399	0.3910	1.6399	1.2806
No log	11.4595	424	1.5836	0.4091	1.5836	1.2584
No log	11.5135	426	1.5227	0.4091	1.5227	1.2340
No log	11.5676	428	1.5639	0.4091	1.5639	1.2506
No log	11.6216	430	1.6451	0.3910	1.6451	1.2826
No log	11.6757	432	1.6661	0.3910	1.6661	1.2908
No log	11.7297	434	1.6490	0.4091	1.6490	1.2842
No log	11.7838	436	1.7146	0.3910	1.7146	1.3094
No log	11.8378	438	1.6904	0.4091	1.6904	1.3002
No log	11.8919	440	1.7950	0.3910	1.7950	1.3398
No log	11.9459	442	1.7826	0.3910	1.7826	1.3352
No log	12.0	444	1.5921	0.4091	1.5921	1.2618
No log	12.0541	446	1.3971	0.4651	1.3971	1.1820
No log	12.1081	448	1.3782	0.4615	1.3782	1.1739
No log	12.1622	450	1.4718	0.4427	1.4718	1.2132
No log	12.2162	452	1.5112	0.4091	1.5112	1.2293
No log	12.2703	454	1.5128	0.4091	1.5128	1.2300
No log	12.3243	456	1.5823	0.4091	1.5823	1.2579
No log	12.3784	458	1.8257	0.3731	1.8257	1.3512
No log	12.4324	460	1.8700	0.3407	1.8700	1.3675
No log	12.4865	462	1.8880	0.3407	1.8880	1.3740
No log	12.5405	464	1.8243	0.3910	1.8243	1.3507
No log	12.5946	466	1.7792	0.3910	1.7792	1.3339
No log	12.6486	468	1.7216	0.3910	1.7216	1.3121
No log	12.7027	470	1.7576	0.3910	1.7576	1.3257
No log	12.7568	472	1.8544	0.3910	1.8544	1.3618
No log	12.8108	474	1.9435	0.3212	1.9435	1.3941
No log	12.8649	476	1.9350	0.3235	1.9350	1.3911
No log	12.9189	478	1.9160	0.3407	1.9160	1.3842
No log	12.9730	480	1.7608	0.3731	1.7608	1.3270
No log	13.0270	482	1.5360	0.4091	1.5360	1.2394
No log	13.0811	484	1.4530	0.4122	1.4530	1.2054
No log	13.1351	486	1.5237	0.4091	1.5237	1.2344
No log	13.1892	488	1.6878	0.3910	1.6878	1.2991
No log	13.2432	490	1.8936	0.3382	1.8936	1.3761
No log	13.2973	492	2.0333	0.3022	2.0333	1.4259
No log	13.3514	494	2.0204	0.3212	2.0204	1.4214
No log	13.4054	496	1.8787	0.3407	1.8787	1.3707
No log	13.4595	498	1.6816	0.4091	1.6816	1.2968
0.3939	13.5135	500	1.6485	0.4122	1.6485	1.2839
0.3939	13.5676	502	1.7429	0.3759	1.7429	1.3202
0.3939	13.6216	504	1.7643	0.3582	1.7643	1.3283
0.3939	13.6757	506	1.7997	0.3582	1.7997	1.3415
0.3939	13.7297	508	1.8609	0.3407	1.8609	1.3641
0.3939	13.7838	510	1.8201	0.3582	1.8201	1.3491

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1