ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k10_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3983
• Qwk: 0.2474
• Mse: 1.3983
• Rmse: 1.1825

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0833	2	4.0352	-0.0008	4.0352	2.0088
No log	0.1667	4	2.5663	-0.0088	2.5663	1.6020
No log	0.25	6	1.7523	0.0435	1.7523	1.3237
No log	0.3333	8	1.1986	0.1255	1.1986	1.0948
No log	0.4167	10	1.0601	0.2663	1.0601	1.0296
No log	0.5	12	1.1813	-0.0075	1.1813	1.0869
No log	0.5833	14	1.2480	0.0021	1.2480	1.1171
No log	0.6667	16	1.1057	0.1062	1.1057	1.0515
No log	0.75	18	1.0794	0.2366	1.0794	1.0389
No log	0.8333	20	1.1134	0.2293	1.1134	1.0552
No log	0.9167	22	1.2043	0.0790	1.2043	1.0974
No log	1.0	24	1.1877	0.1205	1.1877	1.0898
No log	1.0833	26	1.1884	0.1618	1.1884	1.0902
No log	1.1667	28	1.5477	0.0399	1.5477	1.2440
No log	1.25	30	1.5679	0.0	1.5679	1.2522
No log	1.3333	32	1.2898	0.0996	1.2898	1.1357
No log	1.4167	34	1.0327	0.1521	1.0327	1.0162
No log	1.5	36	1.0051	0.1713	1.0051	1.0025
No log	1.5833	38	0.9994	0.1313	0.9994	0.9997
No log	1.6667	40	1.0764	0.0941	1.0764	1.0375
No log	1.75	42	1.0842	0.1537	1.0842	1.0412
No log	1.8333	44	0.9882	0.1685	0.9882	0.9941
No log	1.9167	46	0.9861	0.2746	0.9861	0.9930
No log	2.0	48	0.9850	0.1532	0.9850	0.9925
No log	2.0833	50	1.0110	0.2108	1.0110	1.0055
No log	2.1667	52	1.1221	0.1846	1.1221	1.0593
No log	2.25	54	1.1521	0.2040	1.1521	1.0734
No log	2.3333	56	1.0662	0.2895	1.0662	1.0326
No log	2.4167	58	1.0357	0.2574	1.0357	1.0177
No log	2.5	60	0.9391	0.2251	0.9391	0.9691
No log	2.5833	62	0.9399	0.2276	0.9399	0.9695
No log	2.6667	64	1.1240	0.2149	1.1240	1.0602
No log	2.75	66	1.3706	0.0636	1.3706	1.1707
No log	2.8333	68	1.3196	0.1986	1.3196	1.1487
No log	2.9167	70	1.1581	0.1893	1.1581	1.0762
No log	3.0	72	1.1241	0.2567	1.1241	1.0603
No log	3.0833	74	1.3890	0.2650	1.3890	1.1786
No log	3.1667	76	1.6219	0.1575	1.6219	1.2735
No log	3.25	78	1.3374	0.2729	1.3374	1.1565
No log	3.3333	80	1.0166	0.2636	1.0166	1.0083
No log	3.4167	82	1.0139	0.2505	1.0139	1.0069
No log	3.5	84	1.3258	0.2812	1.3258	1.1514
No log	3.5833	86	1.7866	0.0094	1.7866	1.3366
No log	3.6667	88	1.6854	0.0864	1.6854	1.2982
No log	3.75	90	1.2644	0.2795	1.2644	1.1245
No log	3.8333	92	0.9626	0.2167	0.9626	0.9811
No log	3.9167	94	0.9549	0.2577	0.9549	0.9772
No log	4.0	96	1.0026	0.2238	1.0026	1.0013
No log	4.0833	98	1.1934	0.2203	1.1934	1.0924
No log	4.1667	100	1.4696	-0.0122	1.4696	1.2123
No log	4.25	102	1.4692	0.0033	1.4692	1.2121
No log	4.3333	104	1.2665	0.2477	1.2665	1.1254
No log	4.4167	106	1.2111	0.2409	1.2111	1.1005
No log	4.5	108	1.3189	0.2195	1.3189	1.1484
No log	4.5833	110	1.4690	0.2588	1.4690	1.2120
No log	4.6667	112	1.5949	0.2511	1.5949	1.2629
No log	4.75	114	1.5121	0.2771	1.5121	1.2297
No log	4.8333	116	1.3074	0.2686	1.3074	1.1434
No log	4.9167	118	1.3081	0.2686	1.3081	1.1437
No log	5.0	120	1.5025	0.2292	1.5025	1.2258
No log	5.0833	122	1.6248	0.1902	1.6248	1.2747
No log	5.1667	124	1.5718	0.2342	1.5718	1.2537
No log	5.25	126	1.3995	0.2506	1.3995	1.1830
No log	5.3333	128	1.2788	0.2284	1.2788	1.1309
No log	5.4167	130	1.3171	0.2203	1.3171	1.1476
No log	5.5	132	1.3586	0.2203	1.3586	1.1656
No log	5.5833	134	1.4579	0.2555	1.4579	1.2075
No log	5.6667	136	1.4811	0.2555	1.4811	1.2170
No log	5.75	138	1.3859	0.1814	1.3859	1.1772
No log	5.8333	140	1.1880	0.2284	1.1880	1.0900
No log	5.9167	142	1.1414	0.1911	1.1414	1.0684
No log	6.0	144	1.2516	0.2730	1.2516	1.1187
No log	6.0833	146	1.5819	0.2123	1.5819	1.2577
No log	6.1667	148	1.6958	0.2317	1.6958	1.3022
No log	6.25	150	1.5634	0.2004	1.5634	1.2504
No log	6.3333	152	1.3771	0.2203	1.3771	1.1735
No log	6.4167	154	1.3233	0.2203	1.3233	1.1503
No log	6.5	156	1.2985	0.2143	1.2985	1.1395
No log	6.5833	158	1.3727	0.2455	1.3727	1.1716
No log	6.6667	160	1.3682	0.2506	1.3682	1.1697
No log	6.75	162	1.4666	0.2075	1.4666	1.2110
No log	6.8333	164	1.4635	0.2075	1.4635	1.2098
No log	6.9167	166	1.4071	0.2203	1.4071	1.1862
No log	7.0	168	1.4190	0.1886	1.4190	1.1912
No log	7.0833	170	1.4292	0.1886	1.4292	1.1955
No log	7.1667	172	1.5007	0.2075	1.5007	1.2250
No log	7.25	174	1.5722	0.2690	1.5722	1.2539
No log	7.3333	176	1.5043	0.2731	1.5043	1.2265
No log	7.4167	178	1.3431	0.2772	1.3431	1.1589
No log	7.5	180	1.4585	0.2731	1.4585	1.2077
No log	7.5833	182	1.7299	0.2159	1.7299	1.3153
No log	7.6667	184	1.7352	0.2317	1.7352	1.3173
No log	7.75	186	1.5628	0.2568	1.5628	1.2501
No log	7.8333	188	1.4024	0.2260	1.4024	1.1842
No log	7.9167	190	1.2963	0.1628	1.2963	1.1386
No log	8.0	192	1.2805	0.1628	1.2805	1.1316
No log	8.0833	194	1.3125	0.2260	1.3125	1.1456
No log	8.1667	196	1.3113	0.2555	1.3113	1.1451
No log	8.25	198	1.3185	0.2795	1.3185	1.1483
No log	8.3333	200	1.2960	0.2602	1.2960	1.1384
No log	8.4167	202	1.2147	0.2752	1.2147	1.1021
No log	8.5	204	1.1180	0.3018	1.1180	1.0574
No log	8.5833	206	1.1664	0.2752	1.1664	1.0800
No log	8.6667	208	1.4190	0.2126	1.4190	1.1912
No log	8.75	210	1.6396	0.2004	1.6396	1.2805
No log	8.8333	212	1.6244	0.1703	1.6244	1.2745
No log	8.9167	214	1.5953	0.1703	1.5953	1.2630
No log	9.0	216	1.6725	0.1832	1.6725	1.2933
No log	9.0833	218	1.6321	0.1832	1.6321	1.2775
No log	9.1667	220	1.5327	0.1880	1.5327	1.2380
No log	9.25	222	1.4010	0.2424	1.4010	1.1836
No log	9.3333	224	1.2425	0.2752	1.2425	1.1147
No log	9.4167	226	1.2208	0.2143	1.2208	1.1049
No log	9.5	228	1.2476	0.1407	1.2476	1.1170
No log	9.5833	230	1.3333	0.2474	1.3333	1.1547
No log	9.6667	232	1.3855	0.2342	1.3855	1.1771
No log	9.75	234	1.3579	0.2771	1.3579	1.1653
No log	9.8333	236	1.4897	0.2474	1.4897	1.2205
No log	9.9167	238	1.4006	0.2638	1.4006	1.1835
No log	10.0	240	1.3743	0.2638	1.3743	1.1723
No log	10.0833	242	1.3768	0.2771	1.3768	1.1734
No log	10.1667	244	1.3495	0.2793	1.3495	1.1617
No log	10.25	246	1.4718	0.2752	1.4718	1.2132
No log	10.3333	248	1.4200	0.2474	1.4200	1.1917
No log	10.4167	250	1.2676	0.2474	1.2676	1.1259
No log	10.5	252	1.0789	0.1202	1.0789	1.0387
No log	10.5833	254	1.0118	0.0636	1.0118	1.0059
No log	10.6667	256	1.0706	0.1351	1.0706	1.0347
No log	10.75	258	1.3147	0.2752	1.3147	1.1466
No log	10.8333	260	1.6123	0.2832	1.6123	1.2698
No log	10.9167	262	1.6841	0.2653	1.6841	1.2977
No log	11.0	264	1.5789	0.2474	1.5789	1.2565
No log	11.0833	266	1.3984	0.2474	1.3984	1.1825
No log	11.1667	268	1.2044	0.1552	1.2044	1.0974
No log	11.25	270	1.1842	0.1552	1.1842	1.0882
No log	11.3333	272	1.3269	0.2506	1.3269	1.1519
No log	11.4167	274	1.6765	0.1807	1.6765	1.2948
No log	11.5	276	1.8767	0.2098	1.8767	1.3699
No log	11.5833	278	1.8471	0.2007	1.8471	1.3591
No log	11.6667	280	1.6938	0.2611	1.6938	1.3015
No log	11.75	282	1.4795	0.1814	1.4795	1.2163
No log	11.8333	284	1.2762	0.0833	1.2762	1.1297
No log	11.9167	286	1.2057	0.0445	1.2057	1.0980
No log	12.0	288	1.2149	0.0445	1.2149	1.1022
No log	12.0833	290	1.2557	0.1202	1.2557	1.1206
No log	12.1667	292	1.4021	0.1486	1.4021	1.1841
No log	12.25	294	1.6196	0.2437	1.6196	1.2726
No log	12.3333	296	1.7535	0.2252	1.7535	1.3242
No log	12.4167	298	1.6609	0.2252	1.6609	1.2888
No log	12.5	300	1.3912	0.2690	1.3912	1.1795
No log	12.5833	302	1.1731	0.1202	1.1731	1.0831
No log	12.6667	304	1.1366	0.0741	1.1366	1.0661
No log	12.75	306	1.2355	0.0833	1.2355	1.1115
No log	12.8333	308	1.3944	0.2455	1.3944	1.1808
No log	12.9167	310	1.5148	0.2239	1.5148	1.2308
No log	13.0	312	1.4988	0.2239	1.4988	1.2243
No log	13.0833	314	1.5559	0.2239	1.5559	1.2474
No log	13.1667	316	1.4832	0.2239	1.4832	1.2179
No log	13.25	318	1.3995	0.2455	1.3995	1.1830
No log	13.3333	320	1.4343	0.1486	1.4343	1.1976
No log	13.4167	322	1.4591	0.1814	1.4591	1.2079
No log	13.5	324	1.4408	0.1486	1.4408	1.2003
No log	13.5833	326	1.3864	0.2143	1.3864	1.1774
No log	13.6667	328	1.3341	0.2260	1.3341	1.1550
No log	13.75	330	1.3601	0.2555	1.3601	1.1662
No log	13.8333	332	1.4814	0.2568	1.4814	1.2171
No log	13.9167	334	1.4546	0.2952	1.4546	1.2061
No log	14.0	336	1.2799	0.2367	1.2799	1.1313
No log	14.0833	338	1.2305	0.2752	1.2305	1.1093
No log	14.1667	340	1.3341	0.2837	1.3341	1.1550
No log	14.25	342	1.4599	0.2437	1.4599	1.2082
No log	14.3333	344	1.4253	0.2771	1.4253	1.1939
No log	14.4167	346	1.3666	0.2731	1.3666	1.1690
No log	14.5	348	1.3897	0.2809	1.3897	1.1788
No log	14.5833	350	1.5547	0.2110	1.5547	1.2469
No log	14.6667	352	1.6156	0.2159	1.6156	1.2711
No log	14.75	354	1.5334	0.2482	1.5334	1.2383
No log	14.8333	356	1.4175	0.2474	1.4175	1.1906
No log	14.9167	358	1.3552	0.1744	1.3552	1.1641
No log	15.0	360	1.4013	0.1407	1.4013	1.1838
No log	15.0833	362	1.4680	0.1880	1.4680	1.2116
No log	15.1667	364	1.5285	0.2239	1.5285	1.2363
No log	15.25	366	1.5441	0.2292	1.5441	1.2426
No log	15.3333	368	1.4437	0.2065	1.4437	1.2015
No log	15.4167	370	1.3655	0.1744	1.3655	1.1685
No log	15.5	372	1.3269	0.1744	1.3269	1.1519
No log	15.5833	374	1.2649	0.1142	1.2649	1.1247
No log	15.6667	376	1.2383	0.2143	1.2383	1.1128
No log	15.75	378	1.2661	0.2752	1.2661	1.1252
No log	15.8333	380	1.4465	0.2372	1.4465	1.2027
No log	15.9167	382	1.5816	0.2793	1.5816	1.2576
No log	16.0	384	1.6113	0.2793	1.6113	1.2694
No log	16.0833	386	1.5756	0.2752	1.5756	1.2552
No log	16.1667	388	1.4816	0.2424	1.4816	1.2172
No log	16.25	390	1.4085	0.2665	1.4085	1.1868
No log	16.3333	392	1.3464	0.2665	1.3464	1.1603
No log	16.4167	394	1.3382	0.2665	1.3382	1.1568
No log	16.5	396	1.3575	0.2372	1.3575	1.1651
No log	16.5833	398	1.3644	0.2065	1.3644	1.1681
No log	16.6667	400	1.4127	0.2065	1.4127	1.1886
No log	16.75	402	1.4631	0.2709	1.4631	1.2096
No log	16.8333	404	1.3961	0.2752	1.3961	1.1816
No log	16.9167	406	1.2236	0.2372	1.2236	1.1062
No log	17.0	408	1.0384	0.1697	1.0384	1.0190
No log	17.0833	410	0.9779	0.1823	0.9779	0.9889
No log	17.1667	412	1.1020	0.3218	1.1020	1.0497
No log	17.25	414	1.4923	0.2906	1.4923	1.2216
No log	17.3333	416	1.7511	0.2182	1.7511	1.3233
No log	17.4167	418	1.7303	0.2419	1.7303	1.3154
No log	17.5	420	1.6217	0.2317	1.6217	1.2735
No log	17.5833	422	1.3988	0.1943	1.3988	1.1827
No log	17.6667	424	1.2633	0.1142	1.2633	1.1240
No log	17.75	426	1.2456	0.0781	1.2456	1.1161
No log	17.8333	428	1.2061	0.0781	1.2061	1.0982
No log	17.9167	430	1.1951	0.0781	1.1951	1.0932
No log	18.0	432	1.2323	0.1142	1.2323	1.1101
No log	18.0833	434	1.3101	0.1880	1.3101	1.1446
No log	18.1667	436	1.3525	0.2184	1.3525	1.1630
No log	18.25	438	1.4165	0.2474	1.4165	1.1902
No log	18.3333	440	1.3425	0.2184	1.3425	1.1587
No log	18.4167	442	1.2837	0.2372	1.2837	1.1330
No log	18.5	444	1.3206	0.2065	1.3206	1.1492
No log	18.5833	446	1.4195	0.2752	1.4195	1.1914
No log	18.6667	448	1.5000	0.2611	1.5000	1.2248
No log	18.75	450	1.4951	0.2611	1.4951	1.2228
No log	18.8333	452	1.4370	0.2752	1.4370	1.1987
No log	18.9167	454	1.4189	0.2372	1.4189	1.1912
No log	19.0	456	1.3634	0.2065	1.3634	1.1677
No log	19.0833	458	1.3168	0.2065	1.3168	1.1475
No log	19.1667	460	1.3290	0.2065	1.3290	1.1528
No log	19.25	462	1.3346	0.2065	1.3346	1.1553
No log	19.3333	464	1.4100	0.2126	1.4100	1.1875
No log	19.4167	466	1.5228	0.2611	1.5228	1.2340
No log	19.5	468	1.5449	0.2653	1.5449	1.2429
No log	19.5833	470	1.4577	0.2611	1.4577	1.2074
No log	19.6667	472	1.3642	0.1814	1.3642	1.1680
No log	19.75	474	1.2782	0.0781	1.2782	1.1306
No log	19.8333	476	1.2579	0.0781	1.2579	1.1215
No log	19.9167	478	1.2394	0.0781	1.2394	1.1133
No log	20.0	480	1.2108	0.0781	1.2108	1.1004
No log	20.0833	482	1.2052	0.1552	1.2052	1.0978
No log	20.1667	484	1.2992	0.2126	1.2992	1.1398
No log	20.25	486	1.4537	0.2611	1.4537	1.2057
No log	20.3333	488	1.6139	0.2770	1.6139	1.2704
No log	20.4167	490	1.5684	0.2832	1.5684	1.2524
No log	20.5	492	1.4371	0.2239	1.4371	1.1988
No log	20.5833	494	1.3202	0.1814	1.3202	1.1490
No log	20.6667	496	1.1937	0.1744	1.1937	1.0926
No log	20.75	498	1.1149	0.2424	1.1149	1.0559
0.2666	20.8333	500	1.1199	0.2614	1.1199	1.0583
0.2666	20.9167	502	1.2503	0.3291	1.2503	1.1182
0.2666	21.0	504	1.4427	0.2317	1.4427	1.2011
0.2666	21.0833	506	1.5034	0.2566	1.5034	1.2261
0.2666	21.1667	508	1.4563	0.2906	1.4563	1.2068
0.2666	21.25	510	1.4468	0.3018	1.4468	1.2028
0.2666	21.3333	512	1.3923	0.2474	1.3923	1.1800
0.2666	21.4167	514	1.3540	0.2126	1.3540	1.1636
0.2666	21.5	516	1.3588	0.1814	1.3588	1.1657
0.2666	21.5833	518	1.3834	0.2424	1.3834	1.1762
0.2666	21.6667	520	1.3983	0.2474	1.3983	1.1825

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1