ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k20_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1651
• Qwk: 0.0401
• Mse: 1.1651
• Rmse: 1.0794

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	3.9490	0.0070	3.9490	1.9872
No log	0.0833	4	2.2582	0.0868	2.2582	1.5027
No log	0.125	6	1.8695	0.0429	1.8695	1.3673
No log	0.1667	8	1.9632	0.1105	1.9632	1.4012
No log	0.2083	10	1.2313	0.0380	1.2313	1.1096
No log	0.25	12	1.1038	0.2416	1.1038	1.0506
No log	0.2917	14	1.0947	0.0513	1.0947	1.0463
No log	0.3333	16	1.1337	0.1101	1.1337	1.0647
No log	0.375	18	1.1972	0.1482	1.1972	1.0942
No log	0.4167	20	1.2059	0.1119	1.2059	1.0982
No log	0.4583	22	1.1303	0.1408	1.1303	1.0632
No log	0.5	24	1.1634	0.0636	1.1634	1.0786
No log	0.5417	26	1.2656	0.0833	1.2656	1.1250
No log	0.5833	28	1.2853	0.0445	1.2853	1.1337
No log	0.625	30	1.1011	0.0824	1.1011	1.0493
No log	0.6667	32	1.0461	0.1891	1.0461	1.0228
No log	0.7083	34	1.0293	0.3037	1.0293	1.0146
No log	0.75	36	1.0284	0.3645	1.0284	1.0141
No log	0.7917	38	1.0520	0.2465	1.0520	1.0257
No log	0.8333	40	1.0528	0.3104	1.0528	1.0261
No log	0.875	42	1.1237	0.1725	1.1237	1.0600
No log	0.9167	44	1.3334	-0.0870	1.3334	1.1547
No log	0.9583	46	1.3683	-0.1174	1.3683	1.1697
No log	1.0	48	1.3354	-0.0753	1.3354	1.1556
No log	1.0417	50	1.4686	0.0246	1.4686	1.2119
No log	1.0833	52	1.9367	-0.1020	1.9367	1.3917
No log	1.125	54	2.0907	-0.1605	2.0907	1.4459
No log	1.1667	56	1.7539	-0.0048	1.7539	1.3243
No log	1.2083	58	1.5461	0.2035	1.5461	1.2434
No log	1.25	60	1.3724	0.2537	1.3724	1.1715
No log	1.2917	62	1.2395	0.3391	1.2395	1.1133
No log	1.3333	64	1.1379	0.3043	1.1379	1.0667
No log	1.375	66	1.3067	0.3056	1.3067	1.1431
No log	1.4167	68	1.5203	0.1663	1.5203	1.2330
No log	1.4583	70	1.5465	0.1193	1.5465	1.2436
No log	1.5	72	1.4394	0.1197	1.4394	1.1998
No log	1.5417	74	1.2798	0.2137	1.2798	1.1313
No log	1.5833	76	1.4591	0.1619	1.4591	1.2079
No log	1.625	78	1.4845	0.1648	1.4845	1.2184
No log	1.6667	80	1.2810	0.2831	1.2810	1.1318
No log	1.7083	82	1.1935	0.3352	1.1935	1.0925
No log	1.75	84	1.3142	0.2857	1.3142	1.1464
No log	1.7917	86	1.7798	0.0643	1.7798	1.3341
No log	1.8333	88	1.8940	0.0669	1.8940	1.3762
No log	1.875	90	1.6893	0.0969	1.6893	1.2997
No log	1.9167	92	1.5019	0.1197	1.5019	1.2255
No log	1.9583	94	1.3514	0.0741	1.3514	1.1625
No log	2.0	96	1.2874	0.0811	1.2874	1.1346
No log	2.0417	98	1.4566	0.1202	1.4566	1.2069
No log	2.0833	100	1.5882	0.0613	1.5882	1.2603
No log	2.125	102	1.5904	-0.1157	1.5904	1.2611
No log	2.1667	104	1.4435	-0.0091	1.4435	1.2015
No log	2.2083	106	1.2679	0.1379	1.2679	1.1260
No log	2.25	108	1.2971	0.1863	1.2971	1.1389
No log	2.2917	110	1.6373	0.1465	1.6373	1.2796
No log	2.3333	112	1.7659	0.1328	1.7659	1.3289
No log	2.375	114	1.6924	0.1350	1.6924	1.3009
No log	2.4167	116	1.6313	0.1812	1.6313	1.2772
No log	2.4583	118	1.3782	0.2563	1.3782	1.1740
No log	2.5	120	1.4123	0.2389	1.4123	1.1884
No log	2.5417	122	1.5716	0.0922	1.5716	1.2536
No log	2.5833	124	1.5728	0.0922	1.5728	1.2541
No log	2.625	126	1.5161	0.1081	1.5161	1.2313
No log	2.6667	128	1.4679	0.1473	1.4679	1.2115
No log	2.7083	130	1.3442	0.0833	1.3442	1.1594
No log	2.75	132	1.2547	0.1230	1.2547	1.1201
No log	2.7917	134	1.1556	0.1230	1.1556	1.0750
No log	2.8333	136	1.2266	0.2089	1.2266	1.1075
No log	2.875	138	1.5128	0.2070	1.5128	1.2299
No log	2.9167	140	1.9364	0.0957	1.9364	1.3916
No log	2.9583	142	1.9539	0.0694	1.9539	1.3978
No log	3.0	144	1.6853	0.1268	1.6853	1.2982
No log	3.0417	146	1.3297	0.2098	1.3297	1.1531
No log	3.0833	148	1.3280	0.2251	1.3280	1.1524
No log	3.125	150	1.3597	0.2389	1.3597	1.1661
No log	3.1667	152	1.3938	0.1727	1.3938	1.1806
No log	3.2083	154	1.4641	0.1904	1.4641	1.2100
No log	3.25	156	1.5984	0.0340	1.5984	1.2643
No log	3.2917	158	1.5864	0.1058	1.5864	1.2595
No log	3.3333	160	1.4966	0.1024	1.4966	1.2233
No log	3.375	162	1.3432	0.0661	1.3432	1.1590
No log	3.4167	164	1.2243	0.0811	1.2243	1.1065
No log	3.4583	166	1.2058	0.1512	1.2058	1.0981
No log	3.5	168	1.3614	0.2084	1.3614	1.1668
No log	3.5417	170	1.4746	0.2465	1.4746	1.2143
No log	3.5833	172	1.3079	0.1966	1.3079	1.1436
No log	3.625	174	1.2150	0.1255	1.2150	1.1023
No log	3.6667	176	1.2002	0.1255	1.2002	1.0955
No log	3.7083	178	1.1936	0.1512	1.1936	1.0925
No log	3.75	180	1.2001	0.0811	1.2001	1.0955
No log	3.7917	182	1.0723	-0.0091	1.0723	1.0355
No log	3.8333	184	1.0659	-0.0091	1.0659	1.0324
No log	3.875	186	1.1948	0.0661	1.1948	1.0931
No log	3.9167	188	1.3006	0.1052	1.3006	1.1405
No log	3.9583	190	1.2264	0.1370	1.2264	1.1075
No log	4.0	192	1.1557	0.1654	1.1557	1.0750
No log	4.0417	194	1.2609	0.2155	1.2609	1.1229
No log	4.0833	196	1.3788	0.2311	1.3788	1.1742
No log	4.125	198	1.4219	0.2574	1.4219	1.1924
No log	4.1667	200	1.6942	0.2441	1.6942	1.3016
No log	4.2083	202	1.6535	0.2116	1.6535	1.2859
No log	4.25	204	1.3459	0.2015	1.3459	1.1601
No log	4.2917	206	1.0644	0.1259	1.0644	1.0317
No log	4.3333	208	1.0311	0.1389	1.0311	1.0154
No log	4.375	210	1.1541	0.1976	1.1541	1.0743
No log	4.4167	212	1.2328	0.2389	1.2328	1.1103
No log	4.4583	214	1.3358	0.2531	1.3358	1.1558
No log	4.5	216	1.4601	0.2187	1.4601	1.2084
No log	4.5417	218	1.3445	0.1835	1.3445	1.1595
No log	4.5833	220	1.1786	0.2661	1.1786	1.0856
No log	4.625	222	1.1807	0.2661	1.1807	1.0866
No log	4.6667	224	1.3157	0.1835	1.3157	1.1470
No log	4.7083	226	1.4465	0.2132	1.4465	1.2027
No log	4.75	228	1.4209	0.2132	1.4209	1.1920
No log	4.7917	230	1.3043	0.2337	1.3043	1.1421
No log	4.8333	232	1.2647	0.1838	1.2647	1.1246
No log	4.875	234	1.2359	0.1170	1.2359	1.1117
No log	4.9167	236	1.2669	0.0661	1.2669	1.1256
No log	4.9583	238	1.2435	0.0661	1.2435	1.1151
No log	5.0	240	1.2942	0.0661	1.2942	1.1376
No log	5.0417	242	1.3944	0.2015	1.3944	1.1809
No log	5.0833	244	1.5770	0.2465	1.5770	1.2558
No log	5.125	246	1.5520	0.1914	1.5520	1.2458
No log	5.1667	248	1.4981	0.1914	1.4981	1.2240
No log	5.2083	250	1.4912	0.1790	1.4912	1.2211
No log	5.25	252	1.4987	0.1850	1.4987	1.2242
No log	5.2917	254	1.4122	0.2075	1.4122	1.1884
No log	5.3333	256	1.3123	0.1976	1.3123	1.1456
No log	5.375	258	1.3420	0.2623	1.3420	1.1584
No log	5.4167	260	1.4034	0.2485	1.4034	1.1847
No log	5.4583	262	1.5291	0.2672	1.5291	1.2366
No log	5.5	264	1.4265	0.2411	1.4265	1.1943
No log	5.5417	266	1.2353	0.2155	1.2353	1.1114
No log	5.5833	268	1.1374	0.1976	1.1374	1.0665
No log	5.625	270	1.1367	0.1654	1.1367	1.0661
No log	5.6667	272	1.2139	0.1316	1.2139	1.1018
No log	5.7083	274	1.2490	0.1654	1.2490	1.1176
No log	5.75	276	1.3424	0.2209	1.3424	1.1586
No log	5.7917	278	1.5153	0.2584	1.5153	1.2310
No log	5.8333	280	1.4597	0.2501	1.4597	1.2082
No log	5.875	282	1.2356	0.2608	1.2356	1.1116
No log	5.9167	284	1.1349	0.2955	1.1349	1.0653
No log	5.9583	286	1.1901	0.2232	1.1901	1.0909
No log	6.0	288	1.3300	0.2906	1.3300	1.1532
No log	6.0417	290	1.4129	0.2851	1.4129	1.1887
No log	6.0833	292	1.2757	0.1838	1.2757	1.1295
No log	6.125	294	1.1528	0.1170	1.1528	1.0737
No log	6.1667	296	1.1217	0.1911	1.1217	1.0591
No log	6.2083	298	1.2133	0.2528	1.2133	1.1015
No log	6.25	300	1.4084	0.2290	1.4084	1.1868
No log	6.2917	302	1.6675	0.2270	1.6675	1.2913
No log	6.3333	304	1.8356	0.2294	1.8356	1.3548
No log	6.375	306	1.7443	0.2294	1.7443	1.3207
No log	6.4167	308	1.5290	0.2457	1.5290	1.2365
No log	6.4583	310	1.3141	0.2149	1.3141	1.1463
No log	6.5	312	1.2213	0.1316	1.2213	1.1051
No log	6.5417	314	1.1501	0.1110	1.1501	1.0724
No log	6.5833	316	1.1693	0.1911	1.1693	1.0813
No log	6.625	318	1.2092	0.1170	1.2092	1.0996
No log	6.6667	320	1.3251	0.1512	1.3251	1.1512
No log	6.7083	322	1.4851	0.1904	1.4851	1.2187
No log	6.75	324	1.4662	0.2588	1.4662	1.2109
No log	6.7917	326	1.4127	0.2411	1.4127	1.1886
No log	6.8333	328	1.4351	0.2241	1.4351	1.1980
No log	6.875	330	1.2997	0.2411	1.2997	1.1400
No log	6.9167	332	1.3068	0.2411	1.3068	1.1432
No log	6.9583	334	1.3429	0.2291	1.3429	1.1588
No log	7.0	336	1.3598	0.2417	1.3598	1.1661
No log	7.0417	338	1.2934	0.2315	1.2934	1.1373
No log	7.0833	340	1.2355	0.2015	1.2355	1.1115
No log	7.125	342	1.2971	0.2075	1.2971	1.1389
No log	7.1667	344	1.3015	0.2015	1.3015	1.1408
No log	7.2083	346	1.2407	0.1512	1.2407	1.1139
No log	7.25	348	1.1625	0.2283	1.1625	1.0782
No log	7.2917	350	1.1558	0.2661	1.1558	1.0751
No log	7.3333	352	1.3061	0.2206	1.3061	1.1428
No log	7.375	354	1.5383	0.2367	1.5383	1.2403
No log	7.4167	356	1.6320	0.2240	1.6320	1.2775
No log	7.4583	358	1.4573	0.2075	1.4573	1.2072
No log	7.5	360	1.1785	0.1654	1.1785	1.0856
No log	7.5417	362	1.0086	0.2359	1.0086	1.0043
No log	7.5833	364	1.0062	0.2359	1.0062	1.0031
No log	7.625	366	1.1172	0.1654	1.1172	1.0570
No log	7.6667	368	1.2800	0.1838	1.2800	1.1314
No log	7.7083	370	1.2457	0.0811	1.2457	1.1161
No log	7.75	372	1.1822	0.0811	1.1822	1.0873
No log	7.7917	374	1.2436	0.1512	1.2436	1.1152
No log	7.8333	376	1.2717	0.2149	1.2717	1.1277
No log	7.875	378	1.2708	0.2149	1.2708	1.1273
No log	7.9167	380	1.3436	0.2149	1.3436	1.1591
No log	7.9583	382	1.3700	0.2149	1.3700	1.1705
No log	8.0	384	1.4441	0.2315	1.4441	1.2017
No log	8.0417	386	1.4494	0.2315	1.4494	1.2039
No log	8.0833	388	1.5142	0.2417	1.5142	1.2305
No log	8.125	390	1.6026	0.2511	1.6026	1.2659
No log	8.1667	392	1.5599	0.2511	1.5599	1.2490
No log	8.2083	394	1.3316	0.2026	1.3316	1.1539
No log	8.25	396	1.1459	0.2661	1.1459	1.0705
No log	8.2917	398	1.1655	0.2661	1.1655	1.0796
No log	8.3333	400	1.3004	0.2206	1.3004	1.1404
No log	8.375	402	1.4184	0.2261	1.4184	1.1910
No log	8.4167	404	1.4406	0.2457	1.4406	1.2003
No log	8.4583	406	1.3186	0.2495	1.3186	1.1483
No log	8.5	408	1.2861	0.1838	1.2861	1.1341
No log	8.5417	410	1.3253	0.1838	1.3253	1.1512
No log	8.5833	412	1.3956	0.1587	1.3956	1.1814
No log	8.625	414	1.4584	0.1966	1.4584	1.2076
No log	8.6667	416	1.4890	0.2261	1.4890	1.2202
No log	8.7083	418	1.5277	0.2191	1.5277	1.2360
No log	8.75	420	1.4784	0.2079	1.4784	1.2159
No log	8.7917	422	1.5217	0.2241	1.5217	1.2336
No log	8.8333	424	1.5827	0.2191	1.5827	1.2580
No log	8.875	426	1.4769	0.1904	1.4769	1.2153
No log	8.9167	428	1.3910	0.1512	1.3910	1.1794
No log	8.9583	430	1.3388	0.1170	1.3388	1.1571
No log	9.0	432	1.3431	0.1170	1.3431	1.1589
No log	9.0417	434	1.3766	0.1024	1.3766	1.1733
No log	9.0833	436	1.4558	0.1024	1.4558	1.2066
No log	9.125	438	1.5792	0.2417	1.5792	1.2567
No log	9.1667	440	1.5059	0.2542	1.5059	1.2272
No log	9.2083	442	1.4202	0.2384	1.4202	1.1917
No log	9.25	444	1.4321	0.2363	1.4321	1.1967
No log	9.2917	446	1.4606	0.2542	1.4606	1.2085
No log	9.3333	448	1.5140	0.2291	1.5140	1.2305
No log	9.375	450	1.5252	0.2611	1.5252	1.2350
No log	9.4167	452	1.4534	0.2126	1.4534	1.2056
No log	9.4583	454	1.3195	0.1170	1.3195	1.1487
No log	9.5	456	1.2146	0.0741	1.2146	1.1021
No log	9.5417	458	1.1733	0.1259	1.1733	1.0832
No log	9.5833	460	1.2215	0.1605	1.2215	1.1052
No log	9.625	462	1.3874	0.2206	1.3874	1.1779
No log	9.6667	464	1.5926	0.2482	1.5926	1.2620
No log	9.7083	466	1.6042	0.2482	1.6042	1.2666
No log	9.75	468	1.4490	0.2793	1.4490	1.2038
No log	9.7917	470	1.3404	0.2424	1.3404	1.1577
No log	9.8333	472	1.2323	0.1170	1.2323	1.1101
No log	9.875	474	1.2183	0.1170	1.2183	1.1038
No log	9.9167	476	1.2215	0.1170	1.2215	1.1052
No log	9.9583	478	1.2322	0.1170	1.2322	1.1100
No log	10.0	480	1.2369	0.1911	1.2369	1.1122
No log	10.0417	482	1.3439	0.2206	1.3439	1.1593
No log	10.0833	484	1.5743	0.2940	1.5743	1.2547
No log	10.125	486	1.7643	0.2565	1.7643	1.3283
No log	10.1667	488	1.7918	0.2277	1.7918	1.3386
No log	10.2083	490	1.6412	0.2624	1.6412	1.2811
No log	10.25	492	1.4436	0.2588	1.4436	1.2015
No log	10.2917	494	1.2955	0.1911	1.2955	1.1382
No log	10.3333	496	1.2146	0.0587	1.2146	1.1021
No log	10.375	498	1.2191	0.0155	1.2191	1.1041
0.2794	10.4167	500	1.3095	0.1407	1.3095	1.1443
0.2794	10.4583	502	1.4787	0.2709	1.4787	1.2160
0.2794	10.5	504	1.5648	0.2611	1.5648	1.2509
0.2794	10.5417	506	1.5392	0.3052	1.5392	1.2406
0.2794	10.5833	508	1.3975	0.2465	1.3975	1.1821
0.2794	10.625	510	1.2542	0.2149	1.2542	1.1199
0.2794	10.6667	512	1.2420	0.1512	1.2420	1.1145
0.2794	10.7083	514	1.2221	0.0811	1.2221	1.1055
0.2794	10.75	516	1.2797	0.1552	1.2797	1.1312
0.2794	10.7917	518	1.3408	0.1407	1.3408	1.1579
0.2794	10.8333	520	1.3444	0.1886	1.3444	1.1595
0.2794	10.875	522	1.3100	0.1512	1.3100	1.1445
0.2794	10.9167	524	1.3686	0.2495	1.3686	1.1699
0.2794	10.9583	526	1.3901	0.2588	1.3901	1.1790
0.2794	11.0	528	1.4706	0.2851	1.4706	1.2127
0.2794	11.0417	530	1.5748	0.2869	1.5748	1.2549
0.2794	11.0833	532	1.5843	0.2611	1.5843	1.2587
0.2794	11.125	534	1.4940	0.2752	1.4940	1.2223
0.2794	11.1667	536	1.2828	0.1886	1.2828	1.1326
0.2794	11.2083	538	1.1401	0.1230	1.1401	1.0678
0.2794	11.25	540	1.1546	0.1230	1.1546	1.0745
0.2794	11.2917	542	1.2092	0.1579	1.2092	1.0996
0.2794	11.3333	544	1.2866	0.1976	1.2866	1.1343
0.2794	11.375	546	1.3941	0.2542	1.3941	1.1807
0.2794	11.4167	548	1.4505	0.2465	1.4505	1.2044
0.2794	11.4583	550	1.4472	0.2731	1.4472	1.2030
0.2794	11.5	552	1.3495	0.2313	1.3495	1.1617
0.2794	11.5417	554	1.1910	0.2528	1.1910	1.0914
0.2794	11.5833	556	1.1795	0.1579	1.1795	1.0861
0.2794	11.625	558	1.1421	0.1230	1.1421	1.0687
0.2794	11.6667	560	1.1529	0.1230	1.1529	1.0737
0.2794	11.7083	562	1.2675	0.2075	1.2675	1.1258
0.2794	11.75	564	1.3514	0.2709	1.3514	1.1625
0.2794	11.7917	566	1.3345	0.1814	1.3345	1.1552
0.2794	11.8333	568	1.2373	0.1407	1.2373	1.1123
0.2794	11.875	570	1.1260	0.1379	1.1260	1.0611
0.2794	11.9167	572	1.1527	0.1230	1.1527	1.0736
0.2794	11.9583	574	1.1734	0.0811	1.1734	1.0832
0.2794	12.0	576	1.2464	0.1512	1.2464	1.1164
0.2794	12.0417	578	1.3556	0.2075	1.3556	1.1643
0.2794	12.0833	580	1.4712	0.2291	1.4712	1.2129
0.2794	12.125	582	1.5251	0.2431	1.5251	1.2349
0.2794	12.1667	584	1.4254	0.2339	1.4254	1.1939
0.2794	12.2083	586	1.3087	0.2026	1.3087	1.1440
0.2794	12.25	588	1.1581	0.1512	1.1581	1.0762
0.2794	12.2917	590	1.0751	0.0741	1.0751	1.0369
0.2794	12.3333	592	1.0515	0.0352	1.0515	1.0254
0.2794	12.375	594	1.0682	-0.0251	1.0682	1.0335
0.2794	12.4167	596	1.1211	0.0155	1.1211	1.0588
0.2794	12.4583	598	1.1651	0.0401	1.1651	1.0794

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1