ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1032
• Qwk: 0.1148
• Mse: 1.1032
• Rmse: 1.0503

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.6119	0.0010	4.6119	2.1475
No log	0.1379	4	2.6640	0.0514	2.6640	1.6322
No log	0.2069	6	2.2309	-0.0233	2.2309	1.4936
No log	0.2759	8	2.8830	-0.1113	2.8830	1.6979
No log	0.3448	10	2.0609	-0.0342	2.0609	1.4356
No log	0.4138	12	1.3494	0.1142	1.3494	1.1616
No log	0.4828	14	1.2440	0.1343	1.2440	1.1153
No log	0.5517	16	1.4461	-0.0603	1.4461	1.2025
No log	0.6207	18	2.0841	0.0629	2.0841	1.4437
No log	0.6897	20	2.3680	0.0367	2.3680	1.5388
No log	0.7586	22	2.1015	0.1060	2.1015	1.4496
No log	0.8276	24	1.6581	0.0372	1.6581	1.2877
No log	0.8966	26	1.3523	-0.0216	1.3523	1.1629
No log	0.9655	28	1.2324	0.1542	1.2324	1.1102
No log	1.0345	30	1.1954	0.1732	1.1954	1.0934
No log	1.1034	32	1.2436	0.1423	1.2436	1.1152
No log	1.1724	34	1.4801	0.0512	1.4801	1.2166
No log	1.2414	36	1.5961	0.0254	1.5961	1.2634
No log	1.3103	38	1.4497	0.0	1.4497	1.2041
No log	1.3793	40	1.3410	0.1371	1.3410	1.1580
No log	1.4483	42	1.4289	0.0512	1.4289	1.1954
No log	1.5172	44	1.4132	0.0512	1.4132	1.1888
No log	1.5862	46	1.3380	0.1587	1.3380	1.1567
No log	1.6552	48	1.3451	0.1320	1.3451	1.1598
No log	1.7241	50	1.3244	0.1354	1.3244	1.1508
No log	1.7931	52	1.3005	0.0979	1.3005	1.1404
No log	1.8621	54	1.1834	0.0302	1.1834	1.0878
No log	1.9310	56	1.2508	0.0628	1.2508	1.1184
No log	2.0	58	1.3183	0.0811	1.3183	1.1482
No log	2.0690	60	1.2654	-0.0022	1.2654	1.1249
No log	2.1379	62	1.2648	0.0914	1.2648	1.1246
No log	2.2069	64	1.3946	0.0768	1.3946	1.1810
No log	2.2759	66	1.6314	0.0766	1.6314	1.2773
No log	2.3448	68	1.7306	0.0455	1.7306	1.3155
No log	2.4138	70	1.6618	0.0084	1.6618	1.2891
No log	2.4828	72	1.5156	-0.0114	1.5156	1.2311
No log	2.5517	74	1.4071	0.0768	1.4071	1.1862
No log	2.6207	76	1.2692	0.1593	1.2692	1.1266
No log	2.6897	78	1.2286	0.0130	1.2286	1.1084
No log	2.7586	80	1.2393	0.0130	1.2393	1.1132
No log	2.8276	82	1.1911	0.0415	1.1911	1.0914
No log	2.8966	84	1.1202	0.2028	1.1202	1.0584
No log	2.9655	86	1.0988	0.3806	1.0988	1.0482
No log	3.0345	88	1.0864	0.3806	1.0864	1.0423
No log	3.1034	90	1.0983	0.2916	1.0983	1.0480
No log	3.1724	92	1.1496	0.1308	1.1496	1.0722
No log	3.2414	94	1.2614	0.0948	1.2614	1.1231
No log	3.3103	96	1.3148	-0.0091	1.3148	1.1466
No log	3.3793	98	1.2502	0.0600	1.2502	1.1181
No log	3.4483	100	1.2052	0.1076	1.2052	1.0978
No log	3.5172	102	1.1078	0.3140	1.1078	1.0525
No log	3.5862	104	1.0677	0.3263	1.0677	1.0333
No log	3.6552	106	1.1478	0.1775	1.1478	1.0714
No log	3.7241	108	1.4736	0.1764	1.4736	1.2139
No log	3.7931	110	1.5935	0.0885	1.5935	1.2623
No log	3.8621	112	1.5701	0.1037	1.5701	1.2530
No log	3.9310	114	1.4566	0.2201	1.4566	1.2069
No log	4.0	116	1.2148	0.3046	1.2148	1.1022
No log	4.0690	118	1.0297	0.3039	1.0297	1.0147
No log	4.1379	120	1.0424	0.3920	1.0424	1.0210
No log	4.2069	122	1.0604	0.3596	1.0604	1.0298
No log	4.2759	124	1.1422	0.0898	1.1422	1.0687
No log	4.3448	126	1.3298	0.0760	1.3298	1.1532
No log	4.4138	128	1.4616	0.1371	1.4616	1.2090
No log	4.4828	130	1.5383	0.1098	1.5383	1.2403
No log	4.5517	132	1.6550	0.1692	1.6550	1.2865
No log	4.6207	134	1.6822	0.1499	1.6822	1.2970
No log	4.6897	136	1.5886	0.1308	1.5885	1.2604
No log	4.7586	138	1.4255	0.2359	1.4255	1.1939
No log	4.8276	140	1.2971	0.2704	1.2971	1.1389
No log	4.8966	142	1.2203	0.2864	1.2203	1.1047
No log	4.9655	144	1.2725	0.2864	1.2725	1.1280
No log	5.0345	146	1.3887	0.2747	1.3887	1.1784
No log	5.1034	148	1.4336	0.2272	1.4336	1.1973
No log	5.1724	150	1.4214	0.1983	1.4214	1.1922
No log	5.2414	152	1.3813	0.2317	1.3813	1.1753
No log	5.3103	154	1.4162	0.2593	1.4162	1.1901
No log	5.3793	156	1.3976	0.2635	1.3976	1.1822
No log	5.4483	158	1.4086	0.2370	1.4086	1.1869
No log	5.5172	160	1.4932	0.2798	1.4932	1.2220
No log	5.5862	162	1.6105	0.2270	1.6105	1.2690
No log	5.6552	164	1.4466	0.2564	1.4466	1.2028
No log	5.7241	166	1.3934	0.2450	1.3934	1.1804
No log	5.7931	168	1.4327	0.2944	1.4327	1.1969
No log	5.8621	170	1.5253	0.2890	1.5253	1.2350
No log	5.9310	172	1.5186	0.2436	1.5186	1.2323
No log	6.0	174	1.3736	0.2481	1.3736	1.1720
No log	6.0690	176	1.3276	0.2366	1.3276	1.1522
No log	6.1379	178	1.3338	0.2549	1.3338	1.1549
No log	6.2069	180	1.4108	0.2747	1.4108	1.1878
No log	6.2759	182	1.5802	0.2240	1.5802	1.2571
No log	6.3448	184	1.6444	0.1773	1.6444	1.2823
No log	6.4138	186	1.5418	0.3106	1.5418	1.2417
No log	6.4828	188	1.3789	0.2663	1.3789	1.1743
No log	6.5517	190	1.3288	0.2430	1.3288	1.1527
No log	6.6207	192	1.4766	0.2620	1.4766	1.2151
No log	6.6897	194	1.6009	0.3651	1.6009	1.2653
No log	6.7586	196	1.6883	0.2717	1.6883	1.2993
No log	6.8276	198	1.6828	0.2717	1.6828	1.2972
No log	6.8966	200	1.6267	0.2407	1.6267	1.2754
No log	6.9655	202	1.4390	0.2520	1.4390	1.1996
No log	7.0345	204	1.3200	0.2664	1.3200	1.1489
No log	7.1034	206	1.2622	0.2710	1.2622	1.1235
No log	7.1724	208	1.2498	0.2664	1.2498	1.1180
No log	7.2414	210	1.2397	0.2790	1.2397	1.1134
No log	7.3103	212	1.3174	0.2647	1.3174	1.1478
No log	7.3793	214	1.5800	0.2735	1.5800	1.2570
No log	7.4483	216	1.7213	0.2261	1.7213	1.3120
No log	7.5172	218	1.6043	0.2693	1.6043	1.2666
No log	7.5862	220	1.4214	0.2392	1.4214	1.1922
No log	7.6552	222	1.2297	0.2790	1.2297	1.1089
No log	7.7241	224	1.1108	0.2475	1.1108	1.0540
No log	7.7931	226	1.1263	0.2475	1.1263	1.0613
No log	7.8621	228	1.1954	0.2790	1.1954	1.0934
No log	7.9310	230	1.3277	0.3049	1.3277	1.1523
No log	8.0	232	1.4150	0.2359	1.4150	1.1896
No log	8.0690	234	1.5186	0.1683	1.5186	1.2323
No log	8.1379	236	1.4744	0.2239	1.4744	1.2142
No log	8.2069	238	1.3223	0.2790	1.3223	1.1499
No log	8.2759	240	1.2523	0.1750	1.2523	1.1191
No log	8.3448	242	1.2681	0.1441	1.2681	1.1261
No log	8.4138	244	1.3316	0.2790	1.3316	1.1539
No log	8.4828	246	1.4173	0.2144	1.4173	1.1905
No log	8.5517	248	1.4421	0.2144	1.4421	1.2009
No log	8.6207	250	1.4321	0.2289	1.4321	1.1967
No log	8.6897	252	1.3513	0.2445	1.3513	1.1624
No log	8.7586	254	1.2450	0.1650	1.2450	1.1158
No log	8.8276	256	1.1829	0.1801	1.1829	1.0876
No log	8.8966	258	1.2056	0.2184	1.2056	1.0980
No log	8.9655	260	1.2909	0.3071	1.2909	1.1362
No log	9.0345	262	1.3131	0.2763	1.3131	1.1459
No log	9.1034	264	1.2966	0.2213	1.2966	1.1387
No log	9.1724	266	1.2983	0.1935	1.2983	1.1394
No log	9.2414	268	1.2928	0.2445	1.2928	1.1370
No log	9.3103	270	1.2668	0.2445	1.2668	1.1255
No log	9.3793	272	1.2592	0.2445	1.2592	1.1221
No log	9.4483	274	1.2914	0.2959	1.2914	1.1364
No log	9.5172	276	1.3174	0.2959	1.3174	1.1478
No log	9.5862	278	1.3438	0.3202	1.3438	1.1592
No log	9.6552	280	1.2806	0.2707	1.2806	1.1316
No log	9.7241	282	1.2400	0.2707	1.2400	1.1136
No log	9.7931	284	1.1929	0.2519	1.1929	1.0922
No log	9.8621	286	1.1786	0.2424	1.1786	1.0856
No log	9.9310	288	1.2473	0.3071	1.2473	1.1168
No log	10.0	290	1.3811	0.2851	1.3811	1.1752
No log	10.0690	292	1.5325	0.2331	1.5325	1.2380
No log	10.1379	294	1.5134	0.2331	1.5134	1.2302
No log	10.2069	296	1.4031	0.2392	1.4031	1.1845
No log	10.2759	298	1.3056	0.3071	1.3056	1.1426
No log	10.3448	300	1.2107	0.1896	1.2107	1.1003
No log	10.4138	302	1.2092	0.1440	1.2092	1.0996
No log	10.4828	304	1.2830	0.3071	1.2830	1.1327
No log	10.5517	306	1.4047	0.2544	1.4047	1.1852
No log	10.6207	308	1.4771	0.1923	1.4771	1.2154
No log	10.6897	310	1.4703	0.2485	1.4703	1.2126
No log	10.7586	312	1.3358	0.3047	1.3358	1.1558
No log	10.8276	314	1.2249	0.2634	1.2249	1.1067
No log	10.8966	316	1.2119	0.2367	1.2119	1.1008
No log	10.9655	318	1.2635	0.2725	1.2635	1.1241
No log	11.0345	320	1.3192	0.2601	1.3192	1.1486
No log	11.1034	322	1.2666	0.2445	1.2666	1.1254
No log	11.1724	324	1.1548	0.1654	1.1548	1.0746
No log	11.2414	326	1.1063	0.1712	1.1063	1.0518
No log	11.3103	328	1.1328	0.2343	1.1328	1.0643
No log	11.3793	330	1.1906	0.2817	1.1906	1.0911
No log	11.4483	332	1.1779	0.2696	1.1779	1.0853
No log	11.5172	334	1.2035	0.2410	1.2035	1.0970
No log	11.5862	336	1.2398	0.2445	1.2398	1.1135
No log	11.6552	338	1.2596	0.2071	1.2596	1.1223
No log	11.7241	340	1.3741	0.2631	1.3741	1.1722
No log	11.7931	342	1.4234	0.2660	1.4234	1.1931
No log	11.8621	344	1.3372	0.2631	1.3372	1.1564
No log	11.9310	346	1.3029	0.2112	1.3029	1.1414
No log	12.0	348	1.2515	0.1440	1.2515	1.1187
No log	12.0690	350	1.2225	0.1991	1.2225	1.1057
No log	12.1379	352	1.1988	0.2665	1.1988	1.0949
No log	12.2069	354	1.2573	0.3332	1.2573	1.1213
No log	12.2759	356	1.3252	0.3348	1.3252	1.1512
No log	12.3448	358	1.4347	0.2839	1.4347	1.1978
No log	12.4138	360	1.4478	0.2506	1.4478	1.2032
No log	12.4828	362	1.3507	0.2982	1.3507	1.1622
No log	12.5517	364	1.3130	0.2982	1.3130	1.1458
No log	12.6207	366	1.2982	0.2982	1.2982	1.1394
No log	12.6897	368	1.2969	0.2479	1.2969	1.1388
No log	12.7586	370	1.2837	0.2410	1.2837	1.1330
No log	12.8276	372	1.3369	0.2377	1.3369	1.1563
No log	12.8966	374	1.3612	0.2377	1.3612	1.1667
No log	12.9655	376	1.3172	0.2341	1.3172	1.1477
No log	13.0345	378	1.2546	0.2028	1.2546	1.1201
No log	13.1034	380	1.1945	0.1991	1.1945	1.0929
No log	13.1724	382	1.1542	0.1801	1.1542	1.0744
No log	13.2414	384	1.1753	0.2460	1.1753	1.0841
No log	13.3103	386	1.2848	0.2982	1.2848	1.1335
No log	13.3793	388	1.3720	0.3220	1.3720	1.1713
No log	13.4483	390	1.3272	0.3220	1.3272	1.1520
No log	13.5172	392	1.2551	0.2790	1.2551	1.1203
No log	13.5862	394	1.2089	0.2519	1.2089	1.0995
No log	13.6552	396	1.2532	0.2790	1.2532	1.1195
No log	13.7241	398	1.3458	0.2982	1.3458	1.1601
No log	13.7931	400	1.3868	0.2982	1.3868	1.1776
No log	13.8621	402	1.4083	0.2982	1.4083	1.1867
No log	13.9310	404	1.4373	0.3005	1.4373	1.1989
No log	14.0	406	1.3964	0.2410	1.3964	1.1817
No log	14.0690	408	1.3690	0.1592	1.3690	1.1700
No log	14.1379	410	1.3855	0.1592	1.3855	1.1771
No log	14.2069	412	1.3666	0.1592	1.3666	1.1690
No log	14.2759	414	1.3147	0.1031	1.3147	1.1466
No log	14.3448	416	1.2875	0.1031	1.2875	1.1347
No log	14.4138	418	1.2103	0.0702	1.2103	1.1001
No log	14.4828	420	1.1741	0.0702	1.1741	1.0835
No log	14.5517	422	1.1890	0.1031	1.1890	1.0904
No log	14.6207	424	1.2549	0.2707	1.2549	1.1202
No log	14.6897	426	1.2522	0.2982	1.2522	1.1190
No log	14.7586	428	1.2965	0.2604	1.2965	1.1387
No log	14.8276	430	1.3402	0.2604	1.3402	1.1577
No log	14.8966	432	1.2445	0.3348	1.2445	1.1155
No log	14.9655	434	1.1130	0.2570	1.1130	1.0550
No log	15.0345	436	1.1048	0.1311	1.1048	1.0511
No log	15.1034	438	1.1407	0.1596	1.1407	1.0681
No log	15.1724	440	1.2055	0.2519	1.2055	1.0980
No log	15.2414	442	1.3072	0.2982	1.3072	1.1433
No log	15.3103	444	1.4170	0.2839	1.4170	1.1904
No log	15.3793	446	1.4092	0.2815	1.4092	1.1871
No log	15.4483	448	1.3402	0.2325	1.3402	1.1577
No log	15.5172	450	1.3355	0.3225	1.3355	1.1556
No log	15.5862	452	1.3945	0.2959	1.3945	1.1809
No log	15.6552	454	1.3912	0.2707	1.3912	1.1795
No log	15.7241	456	1.3998	0.2445	1.3998	1.1831
No log	15.7931	458	1.3457	0.1935	1.3457	1.1601
No log	15.8621	460	1.2730	0.1592	1.2730	1.1283
No log	15.9310	462	1.2329	0.2553	1.2329	1.1104
No log	16.0	464	1.2133	0.2817	1.2133	1.1015
No log	16.0690	466	1.2439	0.3071	1.2439	1.1153
No log	16.1379	468	1.3150	0.3332	1.3150	1.1467
No log	16.2069	470	1.4057	0.3067	1.4057	1.1856
No log	16.2759	472	1.3587	0.2815	1.3587	1.1656
No log	16.3448	474	1.2382	0.3332	1.2382	1.1127
No log	16.4138	476	1.2199	0.3093	1.2199	1.1045
No log	16.4828	478	1.2914	0.2982	1.2914	1.1364
No log	16.5517	480	1.3045	0.2707	1.3045	1.1421
No log	16.6207	482	1.3116	0.2445	1.3116	1.1452
No log	16.6897	484	1.2573	0.1592	1.2573	1.1213
No log	16.7586	486	1.2407	0.1031	1.2407	1.1139
No log	16.8276	488	1.2675	0.1031	1.2675	1.1258
No log	16.8966	490	1.3347	0.1224	1.3347	1.1553
No log	16.9655	492	1.3671	0.1224	1.3671	1.1692
No log	17.0345	494	1.3894	0.1516	1.3894	1.1787
No log	17.1034	496	1.3533	0.1224	1.3533	1.1633
No log	17.1724	498	1.3364	0.1224	1.3364	1.1560
0.4191	17.2414	500	1.3587	0.2289	1.3587	1.1656
0.4191	17.3103	502	1.3421	0.2289	1.3421	1.1585
0.4191	17.3793	504	1.2789	0.2122	1.2789	1.1309
0.4191	17.4483	506	1.2965	0.2024	1.2965	1.1386
0.4191	17.5172	508	1.4201	0.2815	1.4201	1.1917
0.4191	17.5862	510	1.5350	0.3007	1.5350	1.2390
0.4191	17.6552	512	1.5196	0.2966	1.5196	1.2327
0.4191	17.7241	514	1.4462	0.2476	1.4462	1.2026
0.4191	17.7931	516	1.3801	0.1971	1.3801	1.1748
0.4191	17.8621	518	1.3578	0.1971	1.3578	1.1652
0.4191	17.9310	520	1.3146	0.2377	1.3146	1.1466
0.4191	18.0	522	1.3229	0.2377	1.3229	1.1502
0.4191	18.0690	524	1.3031	0.2631	1.3031	1.1415
0.4191	18.1379	526	1.1964	0.2736	1.1964	1.0938
0.4191	18.2069	528	1.1586	0.2844	1.1586	1.0764
0.4191	18.2759	530	1.1962	0.2844	1.1962	1.0937
0.4191	18.3448	532	1.2942	0.2574	1.2942	1.1376
0.4191	18.4138	534	1.3904	0.2298	1.3904	1.1791
0.4191	18.4828	536	1.4259	0.2127	1.4259	1.1941
0.4191	18.5517	538	1.3892	0.2052	1.3892	1.1786
0.4191	18.6207	540	1.3086	0.1971	1.3086	1.1439
0.4191	18.6897	542	1.1672	0.1896	1.1672	1.0804
0.4191	18.7586	544	1.1032	0.1148	1.1032	1.0503

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1