ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k8_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.8090
• Qwk: 0.3650
• Mse: 1.8090
• Rmse: 1.3450

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0541	2	6.9133	0.0114	6.9133	2.6293
No log	0.1081	4	4.4607	0.0397	4.4607	2.1120
No log	0.1622	6	3.3991	-0.0219	3.3991	1.8437
No log	0.2162	8	2.8400	0.0892	2.8400	1.6852
No log	0.2703	10	2.4995	0.1022	2.4995	1.5810
No log	0.3243	12	1.7971	0.1622	1.7971	1.3406
No log	0.3784	14	1.7884	0.1852	1.7884	1.3373
No log	0.4324	16	1.8755	0.2569	1.8755	1.3695
No log	0.4865	18	2.0200	0.2645	2.0200	1.4213
No log	0.5405	20	2.1707	0.0	2.1707	1.4733
No log	0.5946	22	2.1360	0.1513	2.1360	1.4615
No log	0.6486	24	1.9812	0.2037	1.9812	1.4075
No log	0.7027	26	1.7534	0.1538	1.7534	1.3242
No log	0.7568	28	1.6402	0.1165	1.6402	1.2807
No log	0.8108	30	1.5939	0.1905	1.5939	1.2625
No log	0.8649	32	1.7415	0.3443	1.7415	1.3197
No log	0.9189	34	1.8848	0.3188	1.8848	1.3729
No log	0.9730	36	2.2052	0.1351	2.2052	1.4850
No log	1.0270	38	2.0890	0.1781	2.0890	1.4453
No log	1.0811	40	2.0923	0.125	2.0923	1.4465
No log	1.1351	42	1.8929	0.2302	1.8929	1.3758
No log	1.1892	44	1.6734	0.3559	1.6734	1.2936
No log	1.2432	46	1.7413	0.3793	1.7413	1.3196
No log	1.2973	48	1.7659	0.2752	1.7659	1.3289
No log	1.3514	50	1.7480	0.1887	1.7480	1.3221
No log	1.4054	52	1.6794	0.1524	1.6794	1.2959
No log	1.4595	54	1.5374	0.1887	1.5374	1.2399
No log	1.5135	56	1.4501	0.2407	1.4501	1.2042
No log	1.5676	58	1.4284	0.3036	1.4284	1.1951
No log	1.6216	60	1.3822	0.3761	1.3822	1.1757
No log	1.6757	62	1.2740	0.3621	1.2740	1.1287
No log	1.7297	64	1.1632	0.3898	1.1632	1.0785
No log	1.7838	66	1.0899	0.4390	1.0899	1.0440
No log	1.8378	68	1.0565	0.4298	1.0565	1.0279
No log	1.8919	70	1.1011	0.4500	1.1011	1.0493
No log	1.9459	72	1.1670	0.4793	1.1670	1.0803
No log	2.0	74	1.1885	0.4959	1.1885	1.0902
No log	2.0541	76	1.1227	0.4370	1.1227	1.0596
No log	2.1081	78	1.1691	0.3826	1.1691	1.0812
No log	2.1622	80	1.2559	0.2909	1.2559	1.1207
No log	2.2162	82	1.4006	0.3119	1.4006	1.1835
No log	2.2703	84	1.3973	0.3273	1.3973	1.1821
No log	2.3243	86	1.3504	0.3604	1.3504	1.1621
No log	2.3784	88	1.1179	0.4628	1.1179	1.0573
No log	2.4324	90	1.0548	0.5581	1.0548	1.0270
No log	2.4865	92	1.0635	0.5891	1.0635	1.0313
No log	2.5405	94	1.1739	0.5984	1.1739	1.0834
No log	2.5946	96	1.5210	0.4234	1.5210	1.2333
No log	2.6486	98	1.6343	0.3284	1.6343	1.2784
No log	2.7027	100	1.4724	0.5303	1.4724	1.2134
No log	2.7568	102	1.1924	0.4793	1.1924	1.0919
No log	2.8108	104	1.1830	0.3966	1.1830	1.0877
No log	2.8649	106	1.2026	0.3966	1.2026	1.0966
No log	2.9189	108	1.2468	0.4833	1.2468	1.1166
No log	2.9730	110	1.4065	0.5669	1.4065	1.1859
No log	3.0270	112	1.4305	0.5736	1.4305	1.1961
No log	3.0811	114	1.2969	0.4463	1.2969	1.1388
No log	3.1351	116	1.2891	0.4746	1.2891	1.1354
No log	3.1892	118	1.2143	0.4576	1.2143	1.1020
No log	3.2432	120	1.2088	0.4576	1.2088	1.0994
No log	3.2973	122	1.2307	0.4918	1.2307	1.1094
No log	3.3514	124	1.3800	0.4923	1.3800	1.1747
No log	3.4054	126	1.5753	0.4179	1.5753	1.2551
No log	3.4595	128	1.7222	0.3182	1.7222	1.3123
No log	3.5135	130	1.6630	0.3385	1.6630	1.2896
No log	3.5676	132	1.4215	0.4603	1.4215	1.1923
No log	3.6216	134	1.2891	0.4463	1.2891	1.1354
No log	3.6757	136	1.3093	0.4463	1.3093	1.1442
No log	3.7297	138	1.5111	0.4308	1.5111	1.2293
No log	3.7838	140	1.6991	0.3741	1.6991	1.3035
No log	3.8378	142	1.6133	0.3768	1.6133	1.2701
No log	3.8919	144	1.5371	0.3768	1.5371	1.2398
No log	3.9459	146	1.6364	0.3741	1.6364	1.2792
No log	4.0	148	1.7911	0.2979	1.7911	1.3383
No log	4.0541	150	1.8534	0.2817	1.8534	1.3614
No log	4.1081	152	1.7681	0.3429	1.7681	1.3297
No log	4.1622	154	1.7526	0.3556	1.7526	1.3239
No log	4.2162	156	1.6121	0.3969	1.6121	1.2697
No log	4.2703	158	1.4401	0.4219	1.4401	1.2000
No log	4.3243	160	1.3177	0.4390	1.3177	1.1479
No log	4.3784	162	1.3641	0.4032	1.3641	1.1679
No log	4.4324	164	1.5932	0.4118	1.5932	1.2622
No log	4.4865	166	1.6286	0.3650	1.6286	1.2762
No log	4.5405	168	1.4069	0.4651	1.4069	1.1861
No log	4.5946	170	1.2113	0.544	1.2113	1.1006
No log	4.6486	172	1.2089	0.544	1.2089	1.0995
No log	4.7027	174	1.2176	0.5238	1.2176	1.1035
No log	4.7568	176	1.3713	0.5	1.3713	1.1710
No log	4.8108	178	1.5081	0.4143	1.5081	1.2281
No log	4.8649	180	1.5917	0.3546	1.5917	1.2616
No log	4.9189	182	1.4479	0.4444	1.4479	1.2033
No log	4.9730	184	1.4401	0.4328	1.4401	1.2000
No log	5.0270	186	1.6294	0.3358	1.6294	1.2765
No log	5.0811	188	1.6368	0.3529	1.6368	1.2794
No log	5.1351	190	1.5871	0.3939	1.5871	1.2598
No log	5.1892	192	1.4326	0.4724	1.4326	1.1969
No log	5.2432	194	1.3957	0.4677	1.3957	1.1814
No log	5.2973	196	1.5013	0.4286	1.5013	1.2253
No log	5.3514	198	1.5960	0.3636	1.5960	1.2633
No log	5.4054	200	1.5538	0.4154	1.5538	1.2465
No log	5.4595	202	1.5130	0.4091	1.5130	1.2300
No log	5.5135	204	1.5504	0.3910	1.5504	1.2451
No log	5.5676	206	1.6577	0.3188	1.6577	1.2875
No log	5.6216	208	1.6229	0.3529	1.6229	1.2739
No log	5.6757	210	1.4826	0.4651	1.4826	1.2176
No log	5.7297	212	1.3332	0.4793	1.3332	1.1546
No log	5.7838	214	1.3675	0.4793	1.3675	1.1694
No log	5.8378	216	1.4908	0.4094	1.4908	1.2210
No log	5.8919	218	1.6432	0.3582	1.6432	1.2819
No log	5.9459	220	1.6391	0.3582	1.6391	1.2803
No log	6.0	222	1.5594	0.4688	1.5594	1.2488
No log	6.0541	224	1.5281	0.4427	1.5281	1.2362
No log	6.1081	226	1.3785	0.4603	1.3785	1.1741
No log	6.1622	228	1.3608	0.4806	1.3608	1.1665
No log	6.2162	230	1.5550	0.3650	1.5550	1.2470
No log	6.2703	232	1.5401	0.3650	1.5401	1.2410
No log	6.3243	234	1.3815	0.4478	1.3815	1.1754
No log	6.3784	236	1.4847	0.3676	1.4847	1.2185
No log	6.4324	238	1.5441	0.3676	1.5441	1.2426
No log	6.4865	240	1.5086	0.3852	1.5086	1.2283
No log	6.5405	242	1.5325	0.3676	1.5325	1.2379
No log	6.5946	244	1.6314	0.3650	1.6314	1.2773
No log	6.6486	246	1.5755	0.3556	1.5755	1.2552
No log	6.7027	248	1.4423	0.4060	1.4423	1.2009
No log	6.7568	250	1.3855	0.4375	1.3855	1.1771
No log	6.8108	252	1.4643	0.3150	1.4643	1.2101
No log	6.8649	254	1.6842	0.3407	1.6842	1.2978
No log	6.9189	256	1.8324	0.2667	1.8324	1.3537
No log	6.9730	258	1.7591	0.2941	1.7591	1.3263
No log	7.0270	260	1.5109	0.3692	1.5109	1.2292
No log	7.0811	262	1.4186	0.4462	1.4186	1.1911
No log	7.1351	264	1.4500	0.4122	1.4500	1.2041
No log	7.1892	266	1.6943	0.3529	1.6943	1.3017
No log	7.2432	268	1.8742	0.2714	1.8742	1.3690
No log	7.2973	270	1.9243	0.2535	1.9243	1.3872
No log	7.3514	272	1.7035	0.3650	1.7035	1.3052
No log	7.4054	274	1.4150	0.4580	1.4150	1.1896
No log	7.4595	276	1.3299	0.4769	1.3299	1.1532
No log	7.5135	278	1.3314	0.4769	1.3314	1.1539
No log	7.5676	280	1.4608	0.4186	1.4608	1.2086
No log	7.6216	282	1.5292	0.3582	1.5292	1.2366
No log	7.6757	284	1.6439	0.3650	1.6439	1.2822
No log	7.7297	286	1.7288	0.3650	1.7288	1.3148
No log	7.7838	288	1.5192	0.3556	1.5192	1.2325
No log	7.8378	290	1.2228	0.5079	1.2228	1.1058
No log	7.8919	292	1.1448	0.5079	1.1448	1.0700
No log	7.9459	294	1.1985	0.5079	1.1985	1.0948
No log	8.0	296	1.4551	0.4478	1.4551	1.2063
No log	8.0541	298	1.6488	0.3478	1.6488	1.2841
No log	8.1081	300	1.5696	0.3676	1.5696	1.2528
No log	8.1622	302	1.3343	0.5156	1.3343	1.1551
No log	8.2162	304	1.2647	0.5039	1.2647	1.1246
No log	8.2703	306	1.2526	0.5039	1.2526	1.1192
No log	8.3243	308	1.3190	0.5197	1.3190	1.1485
No log	8.3784	310	1.5396	0.3582	1.5396	1.2408
No log	8.4324	312	1.6520	0.3676	1.6520	1.2853
No log	8.4865	314	1.6391	0.3676	1.6391	1.2803
No log	8.5405	316	1.4652	0.4030	1.4652	1.2104
No log	8.5946	318	1.2569	0.4724	1.2569	1.1211
No log	8.6486	320	1.3281	0.4662	1.3281	1.1524
No log	8.7027	322	1.6378	0.4173	1.6378	1.2798
No log	8.7568	324	1.8952	0.2676	1.8952	1.3767
No log	8.8108	326	1.9720	0.2361	1.9720	1.4043
No log	8.8649	328	1.8767	0.2837	1.8767	1.3699
No log	8.9189	330	1.6993	0.3768	1.6993	1.3036
No log	8.9730	332	1.5027	0.3971	1.5027	1.2258
No log	9.0270	334	1.4201	0.4697	1.4201	1.1917
No log	9.0811	336	1.4966	0.4265	1.4966	1.2234
No log	9.1351	338	1.4324	0.4697	1.4324	1.1968
No log	9.1892	340	1.3439	0.4697	1.3439	1.1593
No log	9.2432	342	1.2538	0.5238	1.2538	1.1197
No log	9.2973	344	1.2566	0.5354	1.2566	1.1210
No log	9.3514	346	1.4159	0.4889	1.4159	1.1899
No log	9.4054	348	1.6499	0.3478	1.6499	1.2845
No log	9.4595	350	1.6106	0.4088	1.6106	1.2691
No log	9.5135	352	1.4469	0.4412	1.4469	1.2029
No log	9.5676	354	1.2787	0.5	1.2787	1.1308
No log	9.6216	356	1.3088	0.4962	1.3088	1.1440
No log	9.6757	358	1.4030	0.4706	1.4030	1.1845
No log	9.7297	360	1.6713	0.3478	1.6713	1.2928
No log	9.7838	362	1.7487	0.2979	1.7487	1.3224
No log	9.8378	364	1.5968	0.3971	1.5968	1.2637
No log	9.8919	366	1.3442	0.5077	1.3442	1.1594
No log	9.9459	368	1.2543	0.5	1.2543	1.1200
No log	10.0	370	1.3083	0.5038	1.3083	1.1438
No log	10.0541	372	1.5573	0.3824	1.5573	1.2479
No log	10.1081	374	1.8297	0.3286	1.8297	1.3527
No log	10.1622	376	1.8602	0.2857	1.8602	1.3639
No log	10.2162	378	1.6694	0.3529	1.6694	1.2920
No log	10.2703	380	1.4236	0.4462	1.4236	1.1931
No log	10.3243	382	1.2463	0.4878	1.2463	1.1164
No log	10.3784	384	1.1825	0.5	1.1825	1.0874
No log	10.4324	386	1.2094	0.5512	1.2094	1.0997
No log	10.4865	388	1.4158	0.4211	1.4158	1.1899
No log	10.5405	390	1.7502	0.3478	1.7502	1.3229
No log	10.5946	392	1.9204	0.2721	1.9204	1.3858
No log	10.6486	394	1.8319	0.3286	1.8319	1.3535
No log	10.7027	396	1.5847	0.3478	1.5847	1.2589
No log	10.7568	398	1.3901	0.4559	1.3901	1.1790
No log	10.8108	400	1.3324	0.4545	1.3324	1.1543
No log	10.8649	402	1.3828	0.4762	1.3828	1.1759
No log	10.9189	404	1.4673	0.4531	1.4673	1.2113
No log	10.9730	406	1.4899	0.4154	1.4899	1.2206
No log	11.0270	408	1.5573	0.4091	1.5573	1.2479
No log	11.0811	410	1.5366	0.4361	1.5366	1.2396
No log	11.1351	412	1.5166	0.4179	1.5166	1.2315
No log	11.1892	414	1.4170	0.4275	1.4170	1.1904
No log	11.2432	416	1.4505	0.4511	1.4505	1.2044
No log	11.2973	418	1.5147	0.4265	1.5147	1.2307
No log	11.3514	420	1.4685	0.4394	1.4685	1.2118
No log	11.4054	422	1.4924	0.4	1.4924	1.2216
No log	11.4595	424	1.4580	0.4275	1.4580	1.2075
No log	11.5135	426	1.4736	0.4275	1.4736	1.2139
No log	11.5676	428	1.4489	0.4462	1.4489	1.2037
No log	11.6216	430	1.4595	0.4697	1.4595	1.2081
No log	11.6757	432	1.4286	0.4733	1.4286	1.1953
No log	11.7297	434	1.4554	0.4733	1.4554	1.2064
No log	11.7838	436	1.4224	0.4733	1.4224	1.1927
No log	11.8378	438	1.3842	0.4733	1.3842	1.1765
No log	11.8919	440	1.4113	0.4511	1.4113	1.1880
No log	11.9459	442	1.5619	0.3714	1.5619	1.2498
No log	12.0	444	1.6665	0.3714	1.6665	1.2909
No log	12.0541	446	1.5602	0.3768	1.5602	1.2491
No log	12.1081	448	1.4246	0.4627	1.4246	1.1936
No log	12.1622	450	1.3602	0.4545	1.3602	1.1663
No log	12.2162	452	1.4178	0.4545	1.4178	1.1907
No log	12.2703	454	1.5342	0.3910	1.5342	1.2386
No log	12.3243	456	1.7036	0.3504	1.7036	1.3052
No log	12.3784	458	1.7756	0.3453	1.7756	1.3325
No log	12.4324	460	1.6860	0.3453	1.6860	1.2984
No log	12.4865	462	1.5504	0.4088	1.5504	1.2451
No log	12.5405	464	1.4330	0.4296	1.4330	1.1971
No log	12.5946	466	1.3994	0.4511	1.3994	1.1830
No log	12.6486	468	1.5074	0.3910	1.5074	1.2278
No log	12.7027	470	1.6815	0.3650	1.6815	1.2967
No log	12.7568	472	1.8607	0.2878	1.8607	1.3641
No log	12.8108	474	1.9068	0.3143	1.9068	1.3809
No log	12.8649	476	1.7942	0.3453	1.7942	1.3395
No log	12.9189	478	1.7565	0.3453	1.7565	1.3253
No log	12.9730	480	1.6958	0.3333	1.6958	1.3022
No log	13.0270	482	1.7922	0.3453	1.7922	1.3387
No log	13.0811	484	1.8999	0.3143	1.8999	1.3784
No log	13.1351	486	1.9599	0.2979	1.9599	1.4000
No log	13.1892	488	1.8393	0.3143	1.8393	1.3562
No log	13.2432	490	1.7132	0.3212	1.7132	1.3089
No log	13.2973	492	1.5229	0.4122	1.5229	1.2341
No log	13.3514	494	1.4072	0.4275	1.4072	1.1862
No log	13.4054	496	1.3975	0.4275	1.3975	1.1822
No log	13.4595	498	1.4831	0.4328	1.4831	1.2178
0.4206	13.5135	500	1.5254	0.4060	1.5254	1.2351
0.4206	13.5676	502	1.5517	0.4060	1.5517	1.2457
0.4206	13.6216	504	1.6552	0.3556	1.6552	1.2866
0.4206	13.6757	506	1.6275	0.3556	1.6275	1.2757
0.4206	13.7297	508	1.5174	0.4179	1.5174	1.2318
0.4206	13.7838	510	1.3784	0.4	1.3784	1.1741
0.4206	13.8378	512	1.3108	0.4103	1.3108	1.1449
0.4206	13.8919	514	1.3307	0.4103	1.3307	1.1536
0.4206	13.9459	516	1.4034	0.3833	1.4034	1.1846
0.4206	14.0	518	1.5568	0.3664	1.5568	1.2477
0.4206	14.0541	520	1.7196	0.3433	1.7196	1.3114
0.4206	14.1081	522	1.8357	0.3066	1.8357	1.3549
0.4206	14.1622	524	1.8090	0.3650	1.8090	1.3450

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1