ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k20_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5619
• Qwk: 0.0266
• Mse: 1.5619
• Rmse: 1.2498

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0194	2	4.7988	0.0010	4.7988	2.1906
No log	0.0388	4	2.9058	-0.0531	2.9058	1.7047
No log	0.0583	6	2.2463	-0.0744	2.2463	1.4988
No log	0.0777	8	1.9944	-0.125	1.9944	1.4122
No log	0.0971	10	1.4819	-0.0335	1.4819	1.2173
No log	0.1165	12	1.4715	0.0061	1.4715	1.2130
No log	0.1359	14	1.7406	-0.1187	1.7406	1.3193
No log	0.1553	16	2.2001	-0.0826	2.2001	1.4833
No log	0.1748	18	1.6091	0.0165	1.6091	1.2685
No log	0.1942	20	1.5163	-0.0234	1.5163	1.2314
No log	0.2136	22	1.4119	0.0639	1.4119	1.1882
No log	0.2330	24	1.3856	0.0639	1.3856	1.1771
No log	0.2524	26	1.3686	0.0573	1.3686	1.1699
No log	0.2718	28	1.3857	0.0253	1.3857	1.1772
No log	0.2913	30	1.4898	-0.0337	1.4898	1.2206
No log	0.3107	32	1.4141	-0.0091	1.4141	1.1892
No log	0.3301	34	1.3207	0.0130	1.3207	1.1492
No log	0.3495	36	1.3113	0.0302	1.3113	1.1451
No log	0.3689	38	1.3063	0.0642	1.3063	1.1430
No log	0.3883	40	1.3348	0.0780	1.3348	1.1553
No log	0.4078	42	1.3997	0.0694	1.3997	1.1831
No log	0.4272	44	1.6183	-0.0828	1.6183	1.2721
No log	0.4466	46	1.5887	-0.0828	1.5887	1.2604
No log	0.4660	48	1.4432	0.0140	1.4432	1.2013
No log	0.4854	50	1.3345	0.0107	1.3345	1.1552
No log	0.5049	52	1.2857	0.0571	1.2857	1.1339
No log	0.5243	54	1.2685	0.1570	1.2685	1.1263
No log	0.5437	56	1.3226	0.0161	1.3226	1.1500
No log	0.5631	58	1.4377	0.0385	1.4377	1.1990
No log	0.5825	60	1.5054	0.0625	1.5054	1.2270
No log	0.6019	62	1.5500	0.0210	1.5500	1.2450
No log	0.6214	64	1.5293	0.0057	1.5293	1.2366
No log	0.6408	66	1.4991	0.0210	1.4991	1.2244
No log	0.6602	68	1.4717	0.0741	1.4717	1.2131
No log	0.6796	70	1.3309	0.1579	1.3309	1.1536
No log	0.6990	72	1.2618	0.0810	1.2618	1.1233
No log	0.7184	74	1.2657	0.0810	1.2657	1.1250
No log	0.7379	76	1.2847	0.0390	1.2847	1.1335
No log	0.7573	78	1.3052	0.0216	1.3052	1.1425
No log	0.7767	80	1.3347	0.0466	1.3347	1.1553
No log	0.7961	82	1.5241	0.0704	1.5241	1.2345
No log	0.8155	84	1.6068	0.1107	1.6068	1.2676
No log	0.8350	86	1.3956	0.1115	1.3956	1.1813
No log	0.8544	88	1.3514	0.0206	1.3514	1.1625
No log	0.8738	90	1.3541	0.0664	1.3541	1.1637
No log	0.8932	92	1.4061	0.0419	1.4061	1.1858
No log	0.9126	94	1.4315	0.0822	1.4315	1.1965
No log	0.9320	96	1.4904	0.1252	1.4904	1.2208
No log	0.9515	98	1.4462	0.0946	1.4462	1.2026
No log	0.9709	100	1.5199	0.0039	1.5199	1.2328
No log	0.9903	102	1.5150	0.0218	1.5150	1.2309
No log	1.0097	104	1.5113	0.1101	1.5113	1.2293
No log	1.0291	106	1.5167	0.1339	1.5167	1.2315
No log	1.0485	108	1.5041	0.1625	1.5041	1.2264
No log	1.0680	110	1.4787	0.0138	1.4787	1.2160
No log	1.0874	112	1.5065	0.0143	1.5065	1.2274
No log	1.1068	114	1.6403	-0.0471	1.6403	1.2808
No log	1.1262	116	1.5039	0.0077	1.5039	1.2263
No log	1.1456	118	1.4777	0.0976	1.4777	1.2156
No log	1.1650	120	1.5178	0.0914	1.5178	1.2320
No log	1.1845	122	1.5228	0.1017	1.5228	1.2340
No log	1.2039	124	1.5869	0.0528	1.5869	1.2597
No log	1.2233	126	1.6428	-0.0057	1.6428	1.2817
No log	1.2427	128	1.6636	0.0724	1.6636	1.2898
No log	1.2621	130	1.6568	0.0732	1.6568	1.2872
No log	1.2816	132	1.6524	0.0903	1.6524	1.2855
No log	1.3010	134	1.6590	0.0825	1.6590	1.2880
No log	1.3204	136	1.7559	0.0468	1.7559	1.3251
No log	1.3398	138	1.6699	0.1279	1.6699	1.2922
No log	1.3592	140	1.6013	0.0203	1.6013	1.2654
No log	1.3786	142	1.6938	-0.0922	1.6938	1.3015
No log	1.3981	144	1.5734	0.0696	1.5734	1.2543
No log	1.4175	146	1.5616	0.1338	1.5616	1.2496
No log	1.4369	148	1.6532	0.1395	1.6532	1.2858
No log	1.4563	150	1.7137	0.0741	1.7137	1.3091
No log	1.4757	152	1.6804	0.0481	1.6804	1.2963
No log	1.4951	154	1.6968	0.0176	1.6968	1.3026
No log	1.5146	156	1.6801	-0.0159	1.6801	1.2962
No log	1.5340	158	1.7208	0.0778	1.7208	1.3118
No log	1.5534	160	1.6515	0.1169	1.6515	1.2851
No log	1.5728	162	1.5662	0.1829	1.5662	1.2515
No log	1.5922	164	1.5211	0.1735	1.5211	1.2333
No log	1.6117	166	1.4487	0.0749	1.4487	1.2036
No log	1.6311	168	1.4325	0.0842	1.4325	1.1969
No log	1.6505	170	1.4346	0.1485	1.4346	1.1978
No log	1.6699	172	1.4485	0.1484	1.4485	1.2035
No log	1.6893	174	1.3892	0.1246	1.3892	1.1787
No log	1.7087	176	1.4237	0.1410	1.4237	1.1932
No log	1.7282	178	1.4484	0.0648	1.4484	1.2035
No log	1.7476	180	1.6233	0.1653	1.6233	1.2741
No log	1.7670	182	1.6224	0.1502	1.6224	1.2737
No log	1.7864	184	1.5048	0.0913	1.5048	1.2267
No log	1.8058	186	1.5168	0.0575	1.5168	1.2316
No log	1.8252	188	1.5777	0.1566	1.5777	1.2560
No log	1.8447	190	1.8119	0.2279	1.8119	1.3461
No log	1.8641	192	1.8314	0.1778	1.8314	1.3533
No log	1.8835	194	1.6386	0.1307	1.6386	1.2801
No log	1.9029	196	1.4597	0.0689	1.4597	1.2082
No log	1.9223	198	1.6674	0.0231	1.6674	1.2913
No log	1.9417	200	1.6469	0.0166	1.6469	1.2833
No log	1.9612	202	1.4860	0.0229	1.4860	1.2190
No log	1.9806	204	1.6547	0.1331	1.6547	1.2864
No log	2.0	206	1.9664	0.1650	1.9664	1.4023
No log	2.0194	208	1.9889	0.1424	1.9889	1.4103
No log	2.0388	210	1.7527	0.2047	1.7527	1.3239
No log	2.0583	212	1.4802	0.1192	1.4802	1.2166
No log	2.0777	214	1.4442	0.0978	1.4442	1.2018
No log	2.0971	216	1.4517	0.0566	1.4517	1.2048
No log	2.1165	218	1.4551	0.0896	1.4551	1.2063
No log	2.1359	220	1.5017	0.1339	1.5017	1.2255
No log	2.1553	222	1.6302	0.1484	1.6302	1.2768
No log	2.1748	224	1.6475	0.1484	1.6475	1.2835
No log	2.1942	226	1.5702	0.1943	1.5702	1.2531
No log	2.2136	228	1.5420	0.0946	1.5420	1.2418
No log	2.2330	230	1.5841	0.1951	1.5841	1.2586
No log	2.2524	232	1.6985	0.1621	1.6985	1.3033
No log	2.2718	234	1.7385	0.1618	1.7385	1.3185
No log	2.2913	236	1.6636	0.1855	1.6636	1.2898
No log	2.3107	238	1.5413	0.1128	1.5413	1.2415
No log	2.3301	240	1.4838	0.0117	1.4838	1.2181
No log	2.3495	242	1.4520	0.0123	1.4520	1.2050
No log	2.3689	244	1.4514	0.0994	1.4514	1.2047
No log	2.3883	246	1.4997	0.1067	1.4997	1.2246
No log	2.4078	248	1.5410	0.1222	1.5410	1.2414
No log	2.4272	250	1.6146	0.2032	1.6146	1.2707
No log	2.4466	252	1.6170	0.1387	1.6170	1.2716
No log	2.4660	254	1.6125	0.1778	1.6125	1.2699
No log	2.4854	256	1.5531	0.0842	1.5531	1.2462
No log	2.5049	258	1.5432	0.0456	1.5432	1.2423
No log	2.5243	260	1.5067	0.0416	1.5067	1.2275
No log	2.5437	262	1.4946	0.0749	1.4946	1.2226
No log	2.5631	264	1.5018	0.1371	1.5018	1.2255
No log	2.5825	266	1.4455	0.1576	1.4455	1.2023
No log	2.6019	268	1.4006	-0.0057	1.4006	1.1835
No log	2.6214	270	1.4072	0.0353	1.4072	1.1863
No log	2.6408	272	1.4509	0.1047	1.4509	1.2045
No log	2.6602	274	1.5652	0.1899	1.5652	1.2511
No log	2.6796	276	1.6473	0.2216	1.6473	1.2835
No log	2.6990	278	1.6210	0.2101	1.6210	1.2732
No log	2.7184	280	1.5140	0.1573	1.5140	1.2304
No log	2.7379	282	1.4177	0.1830	1.4177	1.1907
No log	2.7573	284	1.3766	0.1090	1.3766	1.1733
No log	2.7767	286	1.4344	0.1371	1.4344	1.1976
No log	2.7961	288	1.5730	0.1977	1.5730	1.2542
No log	2.8155	290	1.6273	0.2128	1.6273	1.2756
No log	2.8350	292	1.5514	0.1899	1.5514	1.2456
No log	2.8544	294	1.5014	0.0769	1.5014	1.2253
No log	2.8738	296	1.5422	0.1726	1.5422	1.2419
No log	2.8932	298	1.7006	0.2448	1.7006	1.3041
No log	2.9126	300	1.7616	0.2197	1.7616	1.3272
No log	2.9320	302	1.6896	0.2540	1.6896	1.2998
No log	2.9515	304	1.5888	0.1195	1.5888	1.2605
No log	2.9709	306	1.5924	0.1251	1.5924	1.2619
No log	2.9903	308	1.5956	0.0526	1.5956	1.2632
No log	3.0097	310	1.5806	0.1251	1.5806	1.2572
No log	3.0291	312	1.5445	0.0885	1.5446	1.2428
No log	3.0485	314	1.6169	0.0700	1.6169	1.2716
No log	3.0680	316	1.6244	0.0982	1.6244	1.2745
No log	3.0874	318	1.5472	0.1311	1.5472	1.2439
No log	3.1068	320	1.4990	-0.0219	1.4990	1.2243
No log	3.1262	322	1.4979	0.0117	1.4979	1.2239
No log	3.1456	324	1.5090	0.0528	1.5090	1.2284
No log	3.1650	326	1.5461	0.1128	1.5461	1.2434
No log	3.1845	328	1.5552	0.1758	1.5552	1.2471
No log	3.2039	330	1.5238	0.1311	1.5238	1.2344
No log	3.2233	332	1.4943	0.1217	1.4943	1.2224
No log	3.2427	334	1.5120	0.0976	1.5120	1.2296
No log	3.2621	336	1.4830	0.1156	1.4830	1.2178
No log	3.2816	338	1.5095	0.1217	1.5095	1.2286
No log	3.3010	340	1.5044	0.1217	1.5044	1.2265
No log	3.3204	342	1.4653	-0.0171	1.4653	1.2105
No log	3.3398	344	1.4638	-0.0171	1.4638	1.2099
No log	3.3592	346	1.5238	0.1063	1.5238	1.2344
No log	3.3786	348	1.6330	0.1448	1.6330	1.2779
No log	3.3981	350	1.6976	0.1024	1.6976	1.3029
No log	3.4175	352	1.5898	0.1109	1.5898	1.2609
No log	3.4369	354	1.4786	0.1063	1.4786	1.2160
No log	3.4563	356	1.4768	0.1153	1.4768	1.2152
No log	3.4757	358	1.5085	0.1128	1.5085	1.2282
No log	3.4951	360	1.6449	0.2191	1.6449	1.2826
No log	3.5146	362	1.7443	0.1887	1.7443	1.3207
No log	3.5340	364	1.7145	0.2092	1.7145	1.3094
No log	3.5534	366	1.5766	0.1628	1.5766	1.2556
No log	3.5728	368	1.5197	0.0669	1.5197	1.2328
No log	3.5922	370	1.4999	0.0605	1.4999	1.2247
No log	3.6117	372	1.5779	0.1067	1.5779	1.2562
No log	3.6311	374	1.6739	0.1064	1.6739	1.2938
No log	3.6505	376	1.6645	0.0185	1.6645	1.2902
No log	3.6699	378	1.5378	0.1128	1.5378	1.2401
No log	3.6893	380	1.4955	0.0827	1.4955	1.2229
No log	3.7087	382	1.5010	0.0827	1.5010	1.2252
No log	3.7282	384	1.4992	0.1015	1.4992	1.2244
No log	3.7476	386	1.4906	0.1015	1.4906	1.2209
No log	3.7670	388	1.5393	0.0675	1.5393	1.2407
No log	3.7864	390	1.6596	-0.0195	1.6596	1.2882
No log	3.8058	392	1.6805	0.0189	1.6805	1.2963
No log	3.8252	394	1.6622	0.0339	1.6622	1.2893
No log	3.8447	396	1.5685	0.0500	1.5685	1.2524
No log	3.8641	398	1.5039	0.1114	1.5039	1.2263
No log	3.8835	400	1.4968	0.0810	1.4968	1.2234
No log	3.9029	402	1.4983	0.0613	1.4983	1.2240
No log	3.9223	404	1.4767	0.1211	1.4767	1.2152
No log	3.9417	406	1.5091	0.0930	1.5091	1.2284
No log	3.9612	408	1.6167	0.1428	1.6167	1.2715
No log	3.9806	410	1.7127	0.1230	1.7127	1.3087
No log	4.0	412	1.7122	0.1771	1.7122	1.3085
No log	4.0194	414	1.5868	0.1309	1.5868	1.2597
No log	4.0388	416	1.4729	0.1311	1.4729	1.2136
No log	4.0583	418	1.4379	0.1311	1.4379	1.1991
No log	4.0777	420	1.4669	0.0750	1.4669	1.2112
No log	4.0971	422	1.4994	0.0668	1.4994	1.2245
No log	4.1165	424	1.5687	0.1313	1.5687	1.2525
No log	4.1359	426	1.5422	0.1313	1.5422	1.2419
No log	4.1553	428	1.4549	0.0750	1.4549	1.2062
No log	4.1748	430	1.4115	0.1015	1.4115	1.1880
No log	4.1942	432	1.4175	0.1176	1.4175	1.1906
No log	4.2136	434	1.4323	0.1217	1.4323	1.1968
No log	4.2330	436	1.5190	0.1084	1.5190	1.2325
No log	4.2524	438	1.6012	0.1168	1.6012	1.2654
No log	4.2718	440	1.6110	0.1168	1.6110	1.2692
No log	4.2913	442	1.5708	0.1168	1.5708	1.2533
No log	4.3107	444	1.4771	0.0732	1.4771	1.2154
No log	4.3301	446	1.3935	0.1110	1.3935	1.1805
No log	4.3495	448	1.4007	0.0671	1.4007	1.1835
No log	4.3689	450	1.4788	0.0732	1.4788	1.2160
No log	4.3883	452	1.5834	0.0589	1.5834	1.2583
No log	4.4078	454	1.6209	0.0961	1.6209	1.2732
No log	4.4272	456	1.6007	0.0961	1.6007	1.2652
No log	4.4466	458	1.5335	0.0612	1.5335	1.2384
No log	4.4660	460	1.4803	0.0599	1.4803	1.2167
No log	4.4854	462	1.4978	0.0599	1.4978	1.2239
No log	4.5049	464	1.5295	0.0948	1.5295	1.2367
No log	4.5243	466	1.5516	0.1344	1.5516	1.2456
No log	4.5437	468	1.5602	0.0750	1.5602	1.2491
No log	4.5631	470	1.5017	0.1344	1.5017	1.2254
No log	4.5825	472	1.4562	0.1020	1.4562	1.2067
No log	4.6019	474	1.4306	0.1020	1.4306	1.1961
No log	4.6214	476	1.4467	0.1020	1.4467	1.2028
No log	4.6408	478	1.5343	0.0843	1.5343	1.2387
No log	4.6602	480	1.5660	0.1109	1.5660	1.2514
No log	4.6796	482	1.4742	0.0885	1.4742	1.2141
No log	4.6990	484	1.4280	0.0970	1.4280	1.1950
No log	4.7184	486	1.4493	0.1717	1.4493	1.2039
No log	4.7379	488	1.5158	0.2286	1.5158	1.2312
No log	4.7573	490	1.5571	0.2773	1.5571	1.2478
No log	4.7767	492	1.5355	0.2773	1.5355	1.2392
No log	4.7961	494	1.4184	0.2525	1.4184	1.1910
No log	4.8155	496	1.3744	0.1525	1.3744	1.1723
No log	4.8350	498	1.3729	0.1525	1.3729	1.1717
0.4043	4.8544	500	1.3909	0.1405	1.3909	1.1794
0.4043	4.8738	502	1.4573	0.1951	1.4573	1.2072
0.4043	4.8932	504	1.4908	0.1951	1.4908	1.2210
0.4043	4.9126	506	1.5097	0.2143	1.5097	1.2287
0.4043	4.9320	508	1.4787	0.1183	1.4787	1.2160
0.4043	4.9515	510	1.4519	0.1279	1.4519	1.2050
0.4043	4.9709	512	1.4696	0.1183	1.4696	1.2123
0.4043	4.9903	514	1.5456	0.0675	1.5456	1.2432
0.4043	5.0097	516	1.5833	0.1462	1.5833	1.2583
0.4043	5.0291	518	1.5872	0.1159	1.5872	1.2598
0.4043	5.0485	520	1.5829	0.1067	1.5829	1.2581
0.4043	5.0680	522	1.5991	0.0652	1.5991	1.2646
0.4043	5.0874	524	1.5516	0.0250	1.5516	1.2457
0.4043	5.1068	526	1.5084	0.1814	1.5084	1.2282
0.4043	5.1262	528	1.4979	0.1564	1.4979	1.2239
0.4043	5.1456	530	1.5169	0.1063	1.5169	1.2316
0.4043	5.1650	532	1.6364	0.1466	1.6364	1.2792
0.4043	5.1845	534	1.6779	0.1639	1.6779	1.2953
0.4043	5.2039	536	1.5885	0.0345	1.5885	1.2603
0.4043	5.2233	538	1.4481	0.1310	1.4481	1.2034
0.4043	5.2427	540	1.4163	0.1431	1.4163	1.1901
0.4043	5.2621	542	1.4425	0.0878	1.4425	1.2011
0.4043	5.2816	544	1.5488	0.1004	1.5488	1.2445
0.4043	5.3010	546	1.6972	0.1207	1.6972	1.3028
0.4043	5.3204	548	1.6513	0.1890	1.6513	1.2850
0.4043	5.3398	550	1.5707	0.1004	1.5707	1.2533
0.4043	5.3592	552	1.5421	0.1168	1.5421	1.2418
0.4043	5.3786	554	1.5512	0.0189	1.5512	1.2455
0.4043	5.3981	556	1.5873	0.0732	1.5873	1.2599
0.4043	5.4175	558	1.5619	0.0266	1.5619	1.2498

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1