ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6534
• Qwk: 0.3111
• Mse: 1.6534
• Rmse: 1.2859

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0247	2	6.9687	0.0179	6.9687	2.6398
No log	0.0494	4	5.4162	0.0355	5.4162	2.3273
No log	0.0741	6	3.1610	0.0952	3.1610	1.7779
No log	0.0988	8	2.4116	0.0795	2.4116	1.5529
No log	0.1235	10	2.0643	0.1488	2.0643	1.4368
No log	0.1481	12	2.0372	0.1391	2.0372	1.4273
No log	0.1728	14	2.1560	0.0	2.1560	1.4683
No log	0.1975	16	1.9078	0.1143	1.9078	1.3812
No log	0.2222	18	1.8919	0.0784	1.8919	1.3755
No log	0.2469	20	1.9814	0.0381	1.9814	1.4076
No log	0.2716	22	2.2215	0.0169	2.2215	1.4905
No log	0.2963	24	2.0168	0.0185	2.0168	1.4201
No log	0.3210	26	1.9389	0.0784	1.9389	1.3925
No log	0.3457	28	2.0793	-0.0351	2.0793	1.4420
No log	0.3704	30	2.1394	-0.0690	2.1394	1.4627
No log	0.3951	32	2.0949	-0.0348	2.0949	1.4474
No log	0.4198	34	2.1805	0.0	2.1805	1.4766
No log	0.4444	36	2.2979	0.0	2.2979	1.5159
No log	0.4691	38	2.2933	0.0806	2.2933	1.5144
No log	0.4938	40	2.1224	0.1157	2.1224	1.4569
No log	0.5185	42	2.0950	0.2276	2.0950	1.4474
No log	0.5432	44	1.8978	0.2241	1.8978	1.3776
No log	0.5679	46	1.6910	0.1481	1.6910	1.3004
No log	0.5926	48	1.5961	0.0971	1.5961	1.2634
No log	0.6173	50	1.5541	0.1154	1.5541	1.2466
No log	0.6420	52	1.6166	0.1143	1.6166	1.2715
No log	0.6667	54	1.5362	0.2162	1.5362	1.2394
No log	0.6914	56	1.4200	0.2807	1.4200	1.1916
No log	0.7160	58	1.5863	0.2857	1.5863	1.2595
No log	0.7407	60	1.6801	0.2764	1.6801	1.2962
No log	0.7654	62	1.3092	0.4098	1.3092	1.1442
No log	0.7901	64	1.4123	0.4242	1.4123	1.1884
No log	0.8148	66	2.0194	0.1374	2.0194	1.4210
No log	0.8395	68	1.9536	0.1890	1.9536	1.3977
No log	0.8642	70	1.5819	0.3650	1.5819	1.2577
No log	0.8889	72	1.3365	0.5180	1.3365	1.1561
No log	0.9136	74	1.3373	0.5278	1.3373	1.1564
No log	0.9383	76	1.3061	0.5	1.3061	1.1428
No log	0.9630	78	1.2998	0.4030	1.2998	1.1401
No log	0.9877	80	1.8021	0.3556	1.8021	1.3424
No log	1.0123	82	2.5926	0.1111	2.5926	1.6101
No log	1.0370	84	2.7137	-0.0301	2.7137	1.6473
No log	1.0617	86	2.5195	0.0448	2.5195	1.5873
No log	1.0864	88	2.1214	0.1702	2.1214	1.4565
No log	1.1111	90	1.5616	0.4030	1.5616	1.2496
No log	1.1358	92	1.2930	0.4590	1.2930	1.1371
No log	1.1605	94	1.2679	0.4	1.2679	1.1260
No log	1.1852	96	1.2342	0.3333	1.2342	1.1110
No log	1.2099	98	1.2802	0.2883	1.2802	1.1315
No log	1.2346	100	1.3302	0.3243	1.3302	1.1533
No log	1.2593	102	1.3863	0.3717	1.3863	1.1774
No log	1.2840	104	1.4602	0.4407	1.4602	1.2084
No log	1.3086	106	1.5178	0.4275	1.5178	1.2320
No log	1.3333	108	1.5836	0.4148	1.5836	1.2584
No log	1.3580	110	1.6864	0.3333	1.6864	1.2986
No log	1.3827	112	1.9452	0.2378	1.9452	1.3947
No log	1.4074	114	2.1492	0.2378	2.1492	1.4660
No log	1.4321	116	2.3788	0.1944	2.3788	1.5423
No log	1.4568	118	2.4014	0.1151	2.4014	1.5496
No log	1.4815	120	2.3311	0.1806	2.3311	1.5268
No log	1.5062	122	2.1497	0.2222	2.1497	1.4662
No log	1.5309	124	1.9690	0.2378	1.9690	1.4032
No log	1.5556	126	1.7111	0.3284	1.7111	1.3081
No log	1.5802	128	1.5956	0.4769	1.5956	1.2632
No log	1.6049	130	1.3878	0.3826	1.3878	1.1781
No log	1.6296	132	1.3443	0.3932	1.3443	1.1594
No log	1.6543	134	1.5270	0.4733	1.5270	1.2357
No log	1.6790	136	1.8757	0.3000	1.8757	1.3696
No log	1.7037	138	1.9524	0.2958	1.9524	1.3973
No log	1.7284	140	1.8619	0.3143	1.8619	1.3645
No log	1.7531	142	1.7162	0.3333	1.7162	1.3100
No log	1.7778	144	1.7720	0.3165	1.7720	1.3312
No log	1.8025	146	1.9533	0.2535	1.9533	1.3976
No log	1.8272	148	1.9673	0.2238	1.9673	1.4026
No log	1.8519	150	1.7635	0.3597	1.7635	1.3280
No log	1.8765	152	1.6877	0.3597	1.6877	1.2991
No log	1.9012	154	1.6548	0.3597	1.6548	1.2864
No log	1.9259	156	1.6509	0.3333	1.6509	1.2849
No log	1.9506	158	1.6863	0.3333	1.6863	1.2986
No log	1.9753	160	1.8976	0.3000	1.8976	1.3775
No log	2.0	162	2.0352	0.2817	2.0352	1.4266
No log	2.0247	164	1.9516	0.2817	1.9516	1.3970
No log	2.0494	166	1.8586	0.2817	1.8586	1.3633
No log	2.0741	168	1.4076	0.4889	1.4076	1.1864
No log	2.0988	170	1.1979	0.5344	1.1979	1.0945
No log	2.1235	172	1.1947	0.5344	1.1947	1.0930
No log	2.1481	174	1.2537	0.5152	1.2537	1.1197
No log	2.1728	176	1.2843	0.5152	1.2843	1.1333
No log	2.1975	178	1.2879	0.5263	1.2879	1.1348
No log	2.2222	180	1.5475	0.3768	1.5475	1.2440
No log	2.2469	182	1.7832	0.3453	1.7832	1.3354
No log	2.2716	184	1.8861	0.2979	1.8861	1.3734
No log	2.2963	186	1.7903	0.3429	1.7903	1.3380
No log	2.3210	188	1.6168	0.2941	1.6168	1.2715
No log	2.3457	190	1.5090	0.3609	1.5090	1.2284
No log	2.3704	192	1.5561	0.3623	1.5561	1.2474
No log	2.3951	194	1.7605	0.3239	1.7605	1.3268
No log	2.4198	196	1.8118	0.2979	1.8118	1.3460
No log	2.4444	198	1.6727	0.3262	1.6727	1.2933
No log	2.4691	200	1.6866	0.3478	1.6866	1.2987
No log	2.4938	202	1.7489	0.3212	1.7489	1.3225
No log	2.5185	204	1.7530	0.2941	1.7530	1.3240
No log	2.5432	206	1.6534	0.3704	1.6534	1.2858
No log	2.5679	208	1.5073	0.3692	1.5073	1.2277
No log	2.5926	210	1.4751	0.4219	1.4751	1.2146
No log	2.6173	212	1.4337	0.4219	1.4337	1.1974
No log	2.6420	214	1.4359	0.3876	1.4359	1.1983
No log	2.6667	216	1.6670	0.3358	1.6670	1.2911
No log	2.6914	218	1.9856	0.2714	1.9856	1.4091
No log	2.7160	220	1.9926	0.2714	1.9926	1.4116
No log	2.7407	222	1.9506	0.2714	1.9506	1.3967
No log	2.7654	224	1.8793	0.2714	1.8793	1.3709
No log	2.7901	226	1.8288	0.3188	1.8288	1.3523
No log	2.8148	228	1.6651	0.3358	1.6651	1.2904
No log	2.8395	230	1.6121	0.3382	1.6121	1.2697
No log	2.8642	232	1.4734	0.4211	1.4734	1.2138
No log	2.8889	234	1.3026	0.4688	1.3026	1.1413
No log	2.9136	236	1.2828	0.5231	1.2828	1.1326
No log	2.9383	238	1.4111	0.4627	1.4111	1.1879
No log	2.9630	240	1.6972	0.3885	1.6972	1.3028
No log	2.9877	242	1.8696	0.2714	1.8696	1.3673
No log	3.0123	244	1.7814	0.3143	1.7814	1.3347
No log	3.0370	246	1.4578	0.4317	1.4578	1.2074
No log	3.0617	248	1.2103	0.5758	1.2103	1.1001
No log	3.0864	250	1.2009	0.5397	1.2009	1.0958
No log	3.1111	252	1.3398	0.5271	1.3398	1.1575
No log	3.1358	254	1.5451	0.3910	1.5451	1.2430
No log	3.1605	256	1.6340	0.3308	1.6340	1.2783
No log	3.1852	258	1.5971	0.3910	1.5971	1.2638
No log	3.2099	260	1.6572	0.3881	1.6572	1.2873
No log	3.2346	262	1.7608	0.3165	1.7608	1.3269
No log	3.2593	264	1.8709	0.2590	1.8709	1.3678
No log	3.2840	266	1.9770	0.2590	1.9770	1.4061
No log	3.3086	268	1.8449	0.2878	1.8449	1.3583
No log	3.3333	270	1.6197	0.4088	1.6197	1.2727
No log	3.3580	272	1.4729	0.4265	1.4729	1.2136
No log	3.3827	274	1.4177	0.4265	1.4177	1.1907
No log	3.4074	276	1.5238	0.4148	1.5238	1.2344
No log	3.4321	278	1.5219	0.3556	1.5219	1.2337
No log	3.4568	280	1.3669	0.4531	1.3669	1.1692
No log	3.4815	282	1.2557	0.5161	1.2557	1.1206
No log	3.5062	284	1.2184	0.5082	1.2184	1.1038
No log	3.5309	286	1.2837	0.5156	1.2837	1.1330
No log	3.5556	288	1.5544	0.3913	1.5544	1.2468
No log	3.5802	290	1.7124	0.3913	1.7124	1.3086
No log	3.6049	292	1.6355	0.4058	1.6355	1.2789
No log	3.6296	294	1.5787	0.4317	1.5787	1.2564
No log	3.6543	296	1.5715	0.4058	1.5715	1.2536
No log	3.6790	298	1.7349	0.2878	1.7349	1.3171
No log	3.7037	300	1.8919	0.2590	1.8919	1.3755
No log	3.7284	302	1.8174	0.2590	1.8174	1.3481
No log	3.7531	304	1.7187	0.3188	1.7187	1.3110
No log	3.7778	306	1.6122	0.3358	1.6122	1.2697
No log	3.8025	308	1.5480	0.4	1.5480	1.2442
No log	3.8272	310	1.5723	0.3942	1.5723	1.2539
No log	3.8519	312	1.5834	0.3942	1.5834	1.2583
No log	3.8765	314	1.6909	0.2899	1.6909	1.3004
No log	3.9012	316	1.8424	0.3000	1.8424	1.3573
No log	3.9259	318	1.8390	0.2609	1.8390	1.3561
No log	3.9506	320	1.6657	0.3731	1.6657	1.2906
No log	3.9753	322	1.5053	0.4154	1.5053	1.2269
No log	4.0	324	1.3924	0.4275	1.3924	1.1800
No log	4.0247	326	1.3289	0.4545	1.3289	1.1528
No log	4.0494	328	1.4584	0.3910	1.4584	1.2076
No log	4.0741	330	1.6072	0.3382	1.6072	1.2677
No log	4.0988	332	1.5481	0.3731	1.5481	1.2442
No log	4.1235	334	1.3869	0.4275	1.3869	1.1777
No log	4.1481	336	1.2527	0.496	1.2527	1.1192
No log	4.1728	338	1.3076	0.4769	1.3076	1.1435
No log	4.1975	340	1.4674	0.4394	1.4674	1.2114
No log	4.2222	342	1.5165	0.3852	1.5165	1.2315
No log	4.2469	344	1.5596	0.4179	1.5596	1.2489
No log	4.2716	346	1.5755	0.4	1.5755	1.2552
No log	4.2963	348	1.7356	0.2878	1.7356	1.3174
No log	4.3210	350	1.9299	0.2429	1.9299	1.3892
No log	4.3457	352	2.0431	0.2029	2.0431	1.4294
No log	4.3704	354	1.9701	0.1562	1.9701	1.4036
No log	4.3951	356	1.7365	0.2258	1.7365	1.3178
No log	4.4198	358	1.5637	0.3252	1.5637	1.2505
No log	4.4444	360	1.5554	0.3876	1.5554	1.2472
No log	4.4691	362	1.6789	0.3582	1.6789	1.2957
No log	4.4938	364	1.7394	0.3235	1.7394	1.3189
No log	4.5185	366	1.6119	0.3235	1.6119	1.2696
No log	4.5432	368	1.4122	0.4627	1.4122	1.1884
No log	4.5679	370	1.2515	0.5354	1.2515	1.1187
No log	4.5926	372	1.2262	0.512	1.2262	1.1073
No log	4.6173	374	1.2411	0.5354	1.2411	1.1141
No log	4.6420	376	1.2669	0.5271	1.2669	1.1256
No log	4.6667	378	1.3922	0.4179	1.3922	1.1799
No log	4.6914	380	1.4842	0.4179	1.4842	1.2183
No log	4.7160	382	1.5370	0.4179	1.5370	1.2398
No log	4.7407	384	1.3735	0.4444	1.3735	1.1719
No log	4.7654	386	1.3028	0.4853	1.3028	1.1414
No log	4.7901	388	1.3488	0.4818	1.3488	1.1614
No log	4.8148	390	1.5350	0.4179	1.5350	1.2390
No log	4.8395	392	1.6823	0.3556	1.6823	1.2970
No log	4.8642	394	1.8040	0.3433	1.8040	1.3431
No log	4.8889	396	1.7734	0.3556	1.7734	1.3317
No log	4.9136	398	1.5667	0.4091	1.5667	1.2517
No log	4.9383	400	1.5429	0.4091	1.5429	1.2421
No log	4.9630	402	1.6423	0.3939	1.6423	1.2815
No log	4.9877	404	1.6176	0.4060	1.6176	1.2719
No log	5.0123	406	1.5400	0.4091	1.5400	1.2410
No log	5.0370	408	1.4914	0.4091	1.4914	1.2212
No log	5.0617	410	1.5357	0.4091	1.5357	1.2392
No log	5.0864	412	1.5779	0.4091	1.5779	1.2561
No log	5.1111	414	1.5558	0.4091	1.5558	1.2473
No log	5.1358	416	1.4598	0.3910	1.4598	1.2082
No log	5.1605	418	1.3647	0.4179	1.3647	1.1682
No log	5.1852	420	1.4153	0.4179	1.4153	1.1897
No log	5.2099	422	1.5496	0.3910	1.5496	1.2448
No log	5.2346	424	1.4572	0.4179	1.4572	1.2072
No log	5.2593	426	1.3244	0.4706	1.3244	1.1508
No log	5.2840	428	1.3366	0.4511	1.3366	1.1561
No log	5.3086	430	1.4933	0.3910	1.4933	1.2220
No log	5.3333	432	1.7265	0.3382	1.7265	1.3140
No log	5.3580	434	1.8780	0.2899	1.8780	1.3704
No log	5.3827	436	1.7793	0.3382	1.7793	1.3339
No log	5.4074	438	1.5126	0.3788	1.5126	1.2299
No log	5.4321	440	1.3156	0.4252	1.3156	1.1470
No log	5.4568	442	1.3057	0.4375	1.3057	1.1427
No log	5.4815	444	1.4368	0.3846	1.4368	1.1987
No log	5.5062	446	1.7015	0.3382	1.7015	1.3044
No log	5.5309	448	1.7219	0.3382	1.7219	1.3122
No log	5.5556	450	1.6765	0.3731	1.6765	1.2948
No log	5.5802	452	1.5384	0.3788	1.5384	1.2403
No log	5.6049	454	1.4952	0.4242	1.4952	1.2228
No log	5.6296	456	1.5484	0.3910	1.5484	1.2444
No log	5.6543	458	1.6709	0.3407	1.6709	1.2926
No log	5.6790	460	1.7665	0.2899	1.7665	1.3291
No log	5.7037	462	1.8245	0.2899	1.8245	1.3507
No log	5.7284	464	1.6759	0.3382	1.6759	1.2946
No log	5.7531	466	1.5470	0.4179	1.5470	1.2438
No log	5.7778	468	1.3918	0.4444	1.3918	1.1797
No log	5.8025	470	1.2864	0.4776	1.2864	1.1342
No log	5.8272	472	1.2919	0.4889	1.2919	1.1366
No log	5.8519	474	1.3901	0.4444	1.3901	1.1790
No log	5.8765	476	1.4679	0.3910	1.4679	1.2116
No log	5.9012	478	1.6953	0.3556	1.6953	1.3020
No log	5.9259	480	1.7478	0.3529	1.7478	1.3220
No log	5.9506	482	1.5709	0.3881	1.5709	1.2533
No log	5.9753	484	1.3653	0.4427	1.3653	1.1685
No log	6.0	486	1.2173	0.5231	1.2173	1.1033
No log	6.0247	488	1.1929	0.5538	1.1929	1.0922
No log	6.0494	490	1.2419	0.5116	1.2419	1.1144
No log	6.0741	492	1.3680	0.4511	1.3680	1.1696
No log	6.0988	494	1.5181	0.3910	1.5181	1.2321
No log	6.1235	496	1.5708	0.3556	1.5708	1.2533
No log	6.1481	498	1.6397	0.3235	1.6397	1.2805
0.4844	6.1728	500	1.5794	0.3556	1.5794	1.2568
0.4844	6.1975	502	1.4790	0.4179	1.4790	1.2161
0.4844	6.2222	504	1.4066	0.4242	1.4066	1.1860
0.4844	6.2469	506	1.4277	0.4242	1.4277	1.1949
0.4844	6.2716	508	1.4689	0.4179	1.4689	1.2120
0.4844	6.2963	510	1.5017	0.4179	1.5017	1.2255
0.4844	6.3210	512	1.5340	0.3852	1.5340	1.2385
0.4844	6.3457	514	1.5548	0.3582	1.5548	1.2469
0.4844	6.3704	516	1.5039	0.3788	1.5039	1.2263
0.4844	6.3951	518	1.4670	0.3969	1.4670	1.2112
0.4844	6.4198	520	1.4721	0.4060	1.4721	1.2133
0.4844	6.4444	522	1.4240	0.4242	1.4240	1.1933
0.4844	6.4691	524	1.4325	0.4593	1.4325	1.1969
0.4844	6.4938	526	1.5260	0.4265	1.5260	1.2353
0.4844	6.5185	528	1.5485	0.4088	1.5485	1.2444
0.4844	6.5432	530	1.5635	0.4265	1.5635	1.2504
0.4844	6.5679	532	1.4658	0.4427	1.4658	1.2107
0.4844	6.5926	534	1.4186	0.4427	1.4186	1.1910
0.4844	6.6173	536	1.4646	0.4211	1.4646	1.2102
0.4844	6.6420	538	1.6602	0.3212	1.6602	1.2885
0.4844	6.6667	540	1.9183	0.2411	1.9183	1.3850
0.4844	6.6914	542	2.0280	0.1958	2.0280	1.4241
0.4844	6.7160	544	1.9013	0.2411	1.9013	1.3789
0.4844	6.7407	546	1.6534	0.3111	1.6534	1.2859

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1