ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9835
• Qwk: 0.2401
• Mse: 0.9835
• Rmse: 0.9917

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	4.9465	0.0064	4.9465	2.2241
No log	0.0645	4	3.0752	-0.0403	3.0752	1.7536
No log	0.0968	6	2.0542	-0.0433	2.0542	1.4333
No log	0.1290	8	1.7709	-0.0363	1.7709	1.3308
No log	0.1613	10	1.7255	-0.0810	1.7255	1.3136
No log	0.1935	12	1.3473	0.0140	1.3473	1.1607
No log	0.2258	14	1.2811	0.0666	1.2811	1.1319
No log	0.2581	16	1.2485	0.0768	1.2485	1.1174
No log	0.2903	18	1.2591	0.0299	1.2591	1.1221
No log	0.3226	20	1.2877	0.0389	1.2877	1.1348
No log	0.3548	22	1.3109	-0.0091	1.3109	1.1450
No log	0.3871	24	1.3764	0.1443	1.3764	1.1732
No log	0.4194	26	1.5823	0.0987	1.5823	1.2579
No log	0.4516	28	1.6065	0.0242	1.6065	1.2675
No log	0.4839	30	1.5332	0.0302	1.5332	1.2382
No log	0.5161	32	1.4551	0.0955	1.4551	1.2063
No log	0.5484	34	1.4509	0.1081	1.4509	1.2045
No log	0.5806	36	1.4961	-0.0042	1.4961	1.2231
No log	0.6129	38	1.5503	-0.0438	1.5503	1.2451
No log	0.6452	40	1.5382	0.0228	1.5382	1.2402
No log	0.6774	42	1.4715	0.1093	1.4715	1.2131
No log	0.7097	44	1.5090	0.1494	1.5090	1.2284
No log	0.7419	46	1.5293	0.1221	1.5293	1.2366
No log	0.7742	48	1.6557	-0.0475	1.6557	1.2867
No log	0.8065	50	1.9180	0.0593	1.9180	1.3849
No log	0.8387	52	1.9310	0.0754	1.9310	1.3896
No log	0.8710	54	1.7626	0.1123	1.7626	1.3276
No log	0.9032	56	1.4840	0.0514	1.4840	1.2182
No log	0.9355	58	1.4755	0.0665	1.4755	1.2147
No log	0.9677	60	1.6476	0.1953	1.6476	1.2836
No log	1.0	62	1.9048	0.1043	1.9048	1.3801
No log	1.0323	64	1.7649	0.1484	1.7649	1.3285
No log	1.0645	66	1.5186	0.1152	1.5186	1.2323
No log	1.0968	68	1.3948	0.1621	1.3948	1.1810
No log	1.1290	70	1.4272	0.1698	1.4272	1.1947
No log	1.1613	72	1.8084	0.0532	1.8084	1.3448
No log	1.1935	74	2.0888	0.0893	2.0888	1.4453
No log	1.2258	76	1.8729	0.0950	1.8729	1.3685
No log	1.2581	78	1.3233	0.2983	1.3233	1.1504
No log	1.2903	80	1.2647	0.2209	1.2647	1.1246
No log	1.3226	82	1.3415	0.2140	1.3415	1.1582
No log	1.3548	84	1.1589	0.3081	1.1589	1.0765
No log	1.3871	86	1.2734	0.2375	1.2734	1.1284
No log	1.4194	88	1.6046	0.2381	1.6046	1.2667
No log	1.4516	90	1.5430	0.2668	1.5430	1.2422
No log	1.4839	92	1.2443	0.2568	1.2443	1.1155
No log	1.5161	94	1.1748	0.3260	1.1748	1.0839
No log	1.5484	96	1.2434	0.2851	1.2434	1.1151
No log	1.5806	98	1.2072	0.3642	1.2072	1.0987
No log	1.6129	100	1.3061	0.3297	1.3061	1.1429
No log	1.6452	102	1.7987	0.1500	1.7987	1.3411
No log	1.6774	104	2.0080	0.0950	2.0080	1.4170
No log	1.7097	106	1.8684	0.1424	1.8684	1.3669
No log	1.7419	108	1.6031	0.3143	1.6031	1.2661
No log	1.7742	110	1.5223	0.3160	1.5223	1.2338
No log	1.8065	112	1.4994	0.2798	1.4994	1.2245
No log	1.8387	114	1.5432	0.2749	1.5432	1.2423
No log	1.8710	116	1.5254	0.3094	1.5254	1.2351
No log	1.9032	118	1.3185	0.3197	1.3185	1.1483
No log	1.9355	120	1.3751	0.2343	1.3751	1.1727
No log	1.9677	122	1.2831	0.1448	1.2831	1.1328
No log	2.0	124	1.1449	0.2371	1.1449	1.0700
No log	2.0323	126	1.1600	0.2654	1.1600	1.0770
No log	2.0645	128	1.3863	0.0987	1.3863	1.1774
No log	2.0968	130	1.6351	0.1112	1.6351	1.2787
No log	2.1290	132	1.7182	0.3123	1.7182	1.3108
No log	2.1613	134	1.5064	0.3123	1.5064	1.2274
No log	2.1935	136	1.0968	0.3802	1.0968	1.0473
No log	2.2258	138	0.9925	0.4048	0.9925	0.9962
No log	2.2581	140	1.1730	0.4705	1.1730	1.0830
No log	2.2903	142	1.5088	0.3299	1.5088	1.2284
No log	2.3226	144	1.6458	0.2666	1.6458	1.2829
No log	2.3548	146	1.6647	0.2810	1.6647	1.2902
No log	2.3871	148	1.4651	0.3289	1.4651	1.2104
No log	2.4194	150	1.3417	0.3502	1.3417	1.1583
No log	2.4516	152	1.4064	0.3353	1.4064	1.1859
No log	2.4839	154	1.1954	0.3024	1.1954	1.0933
No log	2.5161	156	1.1495	0.25	1.1495	1.0722
No log	2.5484	158	1.0863	0.2909	1.0863	1.0422
No log	2.5806	160	1.0572	0.2997	1.0572	1.0282
No log	2.6129	162	1.2144	0.3325	1.2144	1.1020
No log	2.6452	164	1.7306	0.3077	1.7306	1.3155
No log	2.6774	166	1.8708	0.2960	1.8708	1.3678
No log	2.7097	168	1.6444	0.2317	1.6444	1.2824
No log	2.7419	170	1.2763	0.1692	1.2763	1.1298
No log	2.7742	172	1.1494	0.1853	1.1494	1.0721
No log	2.8065	174	1.2003	0.1479	1.2003	1.0956
No log	2.8387	176	1.3071	0.1536	1.3071	1.1433
No log	2.8710	178	1.3177	0.2132	1.3177	1.1479
No log	2.9032	180	1.2972	0.3119	1.2972	1.1390
No log	2.9355	182	1.2788	0.3817	1.2788	1.1308
No log	2.9677	184	1.4041	0.4085	1.4041	1.1849
No log	3.0	186	1.5770	0.3404	1.5770	1.2558
No log	3.0323	188	1.3698	0.4012	1.3698	1.1704
No log	3.0645	190	0.9942	0.4923	0.9942	0.9971
No log	3.0968	192	0.9904	0.4228	0.9904	0.9952
No log	3.1290	194	0.9995	0.4142	0.9995	0.9997
No log	3.1613	196	0.9890	0.3934	0.9890	0.9945
No log	3.1935	198	1.2265	0.4038	1.2265	1.1075
No log	3.2258	200	1.3627	0.2781	1.3627	1.1674
No log	3.2581	202	1.2704	0.1031	1.2704	1.1271
No log	3.2903	204	1.1064	0.1521	1.1064	1.0518
No log	3.3226	206	1.0217	0.1814	1.0217	1.0108
No log	3.3548	208	0.9936	0.2448	0.9936	0.9968
No log	3.3871	210	1.0547	0.3095	1.0547	1.0270
No log	3.4194	212	1.2927	0.3339	1.2927	1.1370
No log	3.4516	214	1.4502	0.3510	1.4502	1.2042
No log	3.4839	216	1.3581	0.4054	1.3581	1.1654
No log	3.5161	218	1.1522	0.3249	1.1522	1.0734
No log	3.5484	220	1.0592	0.2782	1.0592	1.0292
No log	3.5806	222	0.9646	0.3880	0.9646	0.9821
No log	3.6129	224	0.9837	0.2951	0.9837	0.9918
No log	3.6452	226	1.2489	0.4235	1.2489	1.1175
No log	3.6774	228	1.4903	0.3234	1.4903	1.2208
No log	3.7097	230	1.4093	0.3772	1.4093	1.1871
No log	3.7419	232	1.0545	0.3220	1.0545	1.0269
No log	3.7742	234	0.9449	0.3310	0.9449	0.9720
No log	3.8065	236	0.9985	0.3065	0.9985	0.9993
No log	3.8387	238	1.2412	0.4157	1.2412	1.1141
No log	3.8710	240	1.3424	0.3872	1.3424	1.1586
No log	3.9032	242	1.2009	0.3525	1.2009	1.0958
No log	3.9355	244	1.0467	0.3090	1.0467	1.0231
No log	3.9677	246	1.0135	0.2926	1.0135	1.0067
No log	4.0	248	1.0051	0.2574	1.0051	1.0025
No log	4.0323	250	1.0518	0.3165	1.0518	1.0256
No log	4.0645	252	1.2560	0.2457	1.2560	1.1207
No log	4.0968	254	1.5804	0.3383	1.5804	1.2571
No log	4.1290	256	1.6197	0.3043	1.6197	1.2727
No log	4.1613	258	1.4002	0.2136	1.4002	1.1833
No log	4.1935	260	1.1059	0.3841	1.1059	1.0516
No log	4.2258	262	1.0140	0.3275	1.0140	1.0070
No log	4.2581	264	1.0345	0.2804	1.0345	1.0171
No log	4.2903	266	1.0324	0.3522	1.0324	1.0161
No log	4.3226	268	1.2245	0.3046	1.2245	1.1066
No log	4.3548	270	1.5202	0.3283	1.5202	1.2330
No log	4.3871	272	1.7049	0.2756	1.7049	1.3057
No log	4.4194	274	1.6207	0.2797	1.6207	1.2731
No log	4.4516	276	1.3971	0.2468	1.3971	1.1820
No log	4.4839	278	1.2142	0.2930	1.2142	1.1019
No log	4.5161	280	1.1936	0.2606	1.1936	1.0925
No log	4.5484	282	1.2963	0.3094	1.2963	1.1385
No log	4.5806	284	1.5144	0.3045	1.5144	1.2306
No log	4.6129	286	1.6727	0.3008	1.6727	1.2933
No log	4.6452	288	1.6217	0.2759	1.6217	1.2735
No log	4.6774	290	1.4705	0.1979	1.4705	1.2126
No log	4.7097	292	1.2412	0.2343	1.2412	1.1141
No log	4.7419	294	1.1718	0.1117	1.1718	1.0825
No log	4.7742	296	1.1381	0.1117	1.1381	1.0668
No log	4.8065	298	1.1707	0.0653	1.1707	1.0820
No log	4.8387	300	1.2556	0.2424	1.2556	1.1205
No log	4.8710	302	1.2924	0.2754	1.2924	1.1368
No log	4.9032	304	1.2801	0.3487	1.2801	1.1314
No log	4.9355	306	1.2193	0.3667	1.2193	1.1042
No log	4.9677	308	1.0700	0.3019	1.0700	1.0344
No log	5.0	310	1.0351	0.2765	1.0351	1.0174
No log	5.0323	312	1.1264	0.2999	1.1264	1.0613
No log	5.0645	314	1.1629	0.2509	1.1629	1.0784
No log	5.0968	316	1.1433	0.2810	1.1433	1.0692
No log	5.1290	318	1.1257	0.2300	1.1257	1.0610
No log	5.1613	320	1.1444	0.2951	1.1444	1.0698
No log	5.1935	322	1.2490	0.3148	1.2490	1.1176
No log	5.2258	324	1.4833	0.3063	1.4833	1.2179
No log	5.2581	326	1.4938	0.2895	1.4938	1.2222
No log	5.2903	328	1.3104	0.3289	1.3104	1.1447
No log	5.3226	330	1.2020	0.3629	1.2020	1.0964
No log	5.3548	332	1.1507	0.3667	1.1507	1.0727
No log	5.3871	334	1.1960	0.4580	1.1960	1.0936
No log	5.4194	336	1.2913	0.3418	1.2913	1.1364
No log	5.4516	338	1.3468	0.3418	1.3468	1.1605
No log	5.4839	340	1.3306	0.3624	1.3306	1.1535
No log	5.5161	342	1.2322	0.3845	1.2322	1.1100
No log	5.5484	344	1.3336	0.4043	1.3336	1.1548
No log	5.5806	346	1.4445	0.3444	1.4445	1.2019
No log	5.6129	348	1.3889	0.3615	1.3889	1.1785
No log	5.6452	350	1.3018	0.3067	1.3018	1.1410
No log	5.6774	352	1.2017	0.2743	1.2017	1.0962
No log	5.7097	354	1.1036	0.2998	1.1036	1.0505
No log	5.7419	356	1.1304	0.2702	1.1304	1.0632
No log	5.7742	358	1.3137	0.2617	1.3137	1.1462
No log	5.8065	360	1.5840	0.3269	1.5840	1.2586
No log	5.8387	362	1.7536	0.2515	1.7536	1.3242
No log	5.8710	364	1.6813	0.2989	1.6813	1.2966
No log	5.9032	366	1.4230	0.2606	1.4230	1.1929
No log	5.9355	368	1.2525	0.3171	1.2525	1.1192
No log	5.9677	370	1.1907	0.2617	1.1907	1.0912
No log	6.0	372	1.1845	0.1641	1.1845	1.0884
No log	6.0323	374	1.2236	0.1795	1.2236	1.1062
No log	6.0645	376	1.2132	0.25	1.2132	1.1014
No log	6.0968	378	1.2245	0.3171	1.2245	1.1066
No log	6.1290	380	1.3098	0.2586	1.3098	1.1445
No log	6.1613	382	1.2605	0.2633	1.2605	1.1227
No log	6.1935	384	1.1658	0.2800	1.1658	1.0797
No log	6.2258	386	1.1713	0.2651	1.1713	1.0822
No log	6.2581	388	1.3239	0.1789	1.3239	1.1506
No log	6.2903	390	1.3956	0.2373	1.3956	1.1814
No log	6.3226	392	1.3210	0.1789	1.3210	1.1493
No log	6.3548	394	1.1663	0.2108	1.1663	1.0799
No log	6.3871	396	1.1612	0.2108	1.1612	1.0776
No log	6.4194	398	1.2309	0.2927	1.2309	1.1095
No log	6.4516	400	1.2721	0.2927	1.2721	1.1279
No log	6.4839	402	1.3882	0.2359	1.3882	1.1782
No log	6.5161	404	1.3698	0.3005	1.3698	1.1704
No log	6.5484	406	1.2607	0.3474	1.2607	1.1228
No log	6.5806	408	1.1933	0.2857	1.1933	1.0924
No log	6.6129	410	1.2137	0.3474	1.2137	1.1017
No log	6.6452	412	1.2630	0.3324	1.2630	1.1238
No log	6.6774	414	1.3136	0.2790	1.3136	1.1461
No log	6.7097	416	1.3201	0.2615	1.3201	1.1490
No log	6.7419	418	1.4048	0.3202	1.4048	1.1853
No log	6.7742	420	1.4379	0.3105	1.4379	1.1991
No log	6.8065	422	1.3151	0.3902	1.3151	1.1468
No log	6.8387	424	1.1234	0.3317	1.1234	1.0599
No log	6.8710	426	1.0781	0.3913	1.0781	1.0383
No log	6.9032	428	1.1703	0.3936	1.1703	1.0818
No log	6.9355	430	1.3455	0.2968	1.3455	1.1600
No log	6.9677	432	1.4044	0.3005	1.4044	1.1851
No log	7.0	434	1.3145	0.3607	1.3145	1.1465
No log	7.0323	436	1.1706	0.2263	1.1706	1.0819
No log	7.0645	438	1.1263	0.2357	1.1263	1.0613
No log	7.0968	440	1.1134	0.2930	1.1134	1.0552
No log	7.1290	442	1.1908	0.3648	1.1908	1.0912
No log	7.1613	444	1.3427	0.3791	1.3427	1.1587
No log	7.1935	446	1.3295	0.3867	1.3295	1.1531
No log	7.2258	448	1.1798	0.3939	1.1798	1.0862
No log	7.2581	450	1.0762	0.3182	1.0762	1.0374
No log	7.2903	452	1.0249	0.3046	1.0249	1.0124
No log	7.3226	454	1.0275	0.2686	1.0275	1.0136
No log	7.3548	456	1.1396	0.3398	1.1396	1.0675
No log	7.3871	458	1.3996	0.3455	1.3996	1.1831
No log	7.4194	460	1.5656	0.2876	1.5656	1.2513
No log	7.4516	462	1.5704	0.2689	1.5704	1.2532
No log	7.4839	464	1.4329	0.2782	1.4329	1.1970
No log	7.5161	466	1.2366	0.1707	1.2366	1.1120
No log	7.5484	468	1.1126	0.2317	1.1126	1.0548
No log	7.5806	470	1.0869	0.2522	1.0869	1.0425
No log	7.6129	472	1.1014	0.2541	1.1014	1.0495
No log	7.6452	474	1.1363	0.3111	1.1363	1.0660
No log	7.6774	476	1.2195	0.3667	1.2195	1.1043
No log	7.7097	478	1.3440	0.2767	1.3440	1.1593
No log	7.7419	480	1.3777	0.2136	1.3777	1.1738
No log	7.7742	482	1.3069	0.0843	1.3069	1.1432
No log	7.8065	484	1.2435	0.0612	1.2435	1.1151
No log	7.8387	486	1.1590	0.1808	1.1590	1.0766
No log	7.8710	488	1.1062	0.2233	1.1062	1.0517
No log	7.9032	490	1.1026	0.1808	1.1026	1.0501
No log	7.9355	492	1.1284	0.2949	1.1284	1.0623
No log	7.9677	494	1.2746	0.2985	1.2746	1.1290
No log	8.0	496	1.3493	0.3272	1.3493	1.1616
No log	8.0323	498	1.3246	0.3272	1.3246	1.1509
0.3596	8.0645	500	1.1567	0.3945	1.1567	1.0755
0.3596	8.0968	502	1.1086	0.3836	1.1086	1.0529
0.3596	8.1290	504	1.1485	0.3398	1.1485	1.0717
0.3596	8.1613	506	1.1764	0.3024	1.1764	1.0846
0.3596	8.1935	508	1.0516	0.2752	1.0516	1.0255
0.3596	8.2258	510	0.9835	0.2401	0.9835	0.9917

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1