ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2935
• Qwk: 0.0
• Mse: 1.2935
• Rmse: 1.1373

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	4.0543	-0.0061	4.0543	2.0135
No log	0.1176	4	2.2749	-0.0297	2.2749	1.5083
No log	0.1765	6	1.5352	0.0661	1.5352	1.2391
No log	0.2353	8	1.1820	0.0548	1.1820	1.0872
No log	0.2941	10	1.1297	0.0111	1.1297	1.0629
No log	0.3529	12	1.1783	0.1864	1.1783	1.0855
No log	0.4118	14	1.3797	0.0256	1.3797	1.1746
No log	0.4706	16	1.3319	0.0287	1.3319	1.1541
No log	0.5294	18	1.1133	0.3082	1.1133	1.0551
No log	0.5882	20	1.0402	0.2008	1.0402	1.0199
No log	0.6471	22	1.1360	0.0919	1.1360	1.0658
No log	0.7059	24	1.1420	0.0919	1.1420	1.0687
No log	0.7647	26	1.0498	0.1755	1.0498	1.0246
No log	0.8235	28	1.0322	0.3435	1.0322	1.0160
No log	0.8824	30	1.0245	0.2888	1.0245	1.0122
No log	0.9412	32	1.0587	0.1864	1.0587	1.0289
No log	1.0	34	1.1484	0.1292	1.1484	1.0716
No log	1.0588	36	1.2671	-0.0535	1.2671	1.1256
No log	1.1176	38	1.4140	-0.0375	1.4140	1.1891
No log	1.1765	40	1.8065	-0.2120	1.8065	1.3441
No log	1.2353	42	1.7639	-0.1010	1.7639	1.3281
No log	1.2941	44	1.5552	0.0859	1.5552	1.2471
No log	1.3529	46	1.6445	0.0016	1.6445	1.2824
No log	1.4118	48	1.9913	-0.2027	1.9913	1.4111
No log	1.4706	50	1.9013	0.0296	1.9013	1.3789
No log	1.5294	52	2.2267	-0.0325	2.2267	1.4922
No log	1.5882	54	2.2303	0.0404	2.2303	1.4934
No log	1.6471	56	1.4969	0.1970	1.4969	1.2235
No log	1.7059	58	1.2520	0.3352	1.2520	1.1189
No log	1.7647	60	1.4475	0.2043	1.4475	1.2031
No log	1.8235	62	2.1397	0.1173	2.1397	1.4628
No log	1.8824	64	2.0834	0.1395	2.0834	1.4434
No log	1.9412	66	1.5740	0.1789	1.5740	1.2546
No log	2.0	68	1.2892	0.1905	1.2892	1.1354
No log	2.0588	70	1.5195	0.1561	1.5195	1.2327
No log	2.1176	72	1.8769	0.1197	1.8769	1.3700
No log	2.1765	74	1.8536	0.0636	1.8536	1.3615
No log	2.2353	76	1.8352	0.0636	1.8352	1.3547
No log	2.2941	78	1.7494	0.1207	1.7494	1.3226
No log	2.3529	80	1.7745	0.1071	1.7745	1.3321
No log	2.4118	82	1.7460	0.1000	1.7460	1.3214
No log	2.4706	84	1.7241	0.0864	1.7241	1.3130
No log	2.5294	86	1.7115	0.0864	1.7115	1.3083
No log	2.5882	88	1.7140	0.1344	1.7140	1.3092
No log	2.6471	90	1.5943	0.1509	1.5943	1.2627
No log	2.7059	92	1.2631	0.2368	1.2631	1.1239
No log	2.7647	94	1.0850	0.1996	1.0850	1.0416
No log	2.8235	96	1.1400	0.1775	1.1400	1.0677
No log	2.8824	98	1.4771	0.2313	1.4771	1.2154
No log	2.9412	100	1.7432	0.1635	1.7432	1.3203
No log	3.0	102	1.8320	0.1752	1.8320	1.3535
No log	3.0588	104	1.7161	0.1694	1.7161	1.3100
No log	3.1176	106	1.3182	0.2555	1.3182	1.1481
No log	3.1765	108	0.9930	0.1944	0.9930	0.9965
No log	3.2353	110	0.9808	0.1979	0.9808	0.9904
No log	3.2941	112	1.0537	0.1407	1.0537	1.0265
No log	3.3529	114	1.2989	0.1407	1.2989	1.1397
No log	3.4118	116	1.4509	0.1814	1.4509	1.2045
No log	3.4706	118	1.5011	0.1814	1.5011	1.2252
No log	3.5294	120	1.4271	0.2004	1.4271	1.1946
No log	3.5882	122	1.2747	0.2417	1.2747	1.1290
No log	3.6471	124	1.2848	0.2812	1.2848	1.1335
No log	3.7059	126	1.5053	0.1955	1.5053	1.2269
No log	3.7647	128	1.7421	0.1902	1.7421	1.3199
No log	3.8235	130	1.8656	0.0879	1.8656	1.3659
No log	3.8824	132	1.8043	0.0626	1.8043	1.3432
No log	3.9412	134	1.6732	0.1357	1.6732	1.2935
No log	4.0	136	1.6365	0.1142	1.6365	1.2792
No log	4.0588	138	1.4469	0.1473	1.4469	1.2029
No log	4.1176	140	1.2472	0.1816	1.2472	1.1168
No log	4.1765	142	1.1779	0.2843	1.1779	1.0853
No log	4.2353	144	1.1949	0.2455	1.1949	1.0931
No log	4.2941	146	1.1772	0.2143	1.1772	1.0850
No log	4.3529	148	1.2055	0.1816	1.2055	1.0980
No log	4.4118	150	1.2142	0.1816	1.2142	1.1019
No log	4.4706	152	1.3018	0.2143	1.3018	1.1409
No log	4.5294	154	1.4072	0.1943	1.4072	1.1862
No log	4.5882	156	1.4854	0.1744	1.4854	1.2188
No log	4.6471	158	1.5516	0.0896	1.5516	1.2456
No log	4.7059	160	1.4664	0.1486	1.4664	1.2109
No log	4.7647	162	1.2517	0.1744	1.2517	1.1188
No log	4.8235	164	1.0886	0.1744	1.0886	1.0434
No log	4.8824	166	1.0724	0.2065	1.0724	1.0356
No log	4.9412	168	1.2568	0.2239	1.2568	1.1211
No log	5.0	170	1.5719	0.2448	1.5719	1.2537
No log	5.0588	172	1.6990	0.2601	1.6990	1.3034
No log	5.1176	174	1.5299	0.2606	1.5299	1.2369
No log	5.1765	176	1.2860	0.2292	1.2860	1.1340
No log	5.2353	178	1.2269	0.2065	1.2269	1.1076
No log	5.2941	180	1.3318	0.2065	1.3318	1.1540
No log	5.3529	182	1.5815	0.2342	1.5815	1.2576
No log	5.4118	184	1.6860	0.1789	1.6860	1.2984
No log	5.4706	186	1.6390	0.2170	1.6390	1.2802
No log	5.5294	188	1.6597	0.2170	1.6597	1.2883
No log	5.5882	190	1.6143	0.2170	1.6143	1.2706
No log	5.6471	192	1.5353	0.2292	1.5353	1.2391
No log	5.7059	194	1.4550	0.1562	1.4550	1.2063
No log	5.7647	196	1.4586	0.1562	1.4586	1.2077
No log	5.8235	198	1.3891	0.1142	1.3891	1.1786
No log	5.8824	200	1.3687	0.1142	1.3687	1.1699
No log	5.9412	202	1.4419	0.1142	1.4419	1.2008
No log	6.0	204	1.4399	0.1407	1.4399	1.2000
No log	6.0588	206	1.4830	0.1407	1.4830	1.2178
No log	6.1176	208	1.5151	0.1407	1.5151	1.2309
No log	6.1765	210	1.4494	0.1407	1.4494	1.2039
No log	6.2353	212	1.4788	0.1744	1.4788	1.2161
No log	6.2941	214	1.4259	0.1744	1.4259	1.1941
No log	6.3529	216	1.3457	0.1700	1.3457	1.1601
No log	6.4118	218	1.2347	0.0673	1.2347	1.1112
No log	6.4706	220	1.2092	0.1170	1.2092	1.0996
No log	6.5294	222	1.2701	0.2065	1.2701	1.1270
No log	6.5882	224	1.3078	0.2372	1.3078	1.1436
No log	6.6471	226	1.3995	0.2372	1.3995	1.1830
No log	6.7059	228	1.3871	0.1052	1.3871	1.1777
No log	6.7647	230	1.3400	0.1052	1.3400	1.1576
No log	6.8235	232	1.3312	0.1744	1.3312	1.1538
No log	6.8824	234	1.2826	0.2239	1.2826	1.1325
No log	6.9412	236	1.3466	0.2239	1.3466	1.1604
No log	7.0	238	1.4993	0.2568	1.4993	1.2245
No log	7.0588	240	1.6787	0.2653	1.6787	1.2956
No log	7.1176	242	1.6124	0.2568	1.6124	1.2698
No log	7.1765	244	1.4937	0.2522	1.4937	1.2222
No log	7.2353	246	1.3257	0.2424	1.3257	1.1514
No log	7.2941	248	1.2901	0.1814	1.2901	1.1358
No log	7.3529	250	1.3651	0.2424	1.3651	1.1684
No log	7.4118	252	1.4046	0.2424	1.4046	1.1852
No log	7.4706	254	1.3245	0.2424	1.3245	1.1509
No log	7.5294	256	1.2714	0.1407	1.2714	1.1276
No log	7.5882	258	1.2043	0.1407	1.2043	1.0974
No log	7.6471	260	1.1999	0.1024	1.1999	1.0954
No log	7.7059	262	1.3113	0.1744	1.3113	1.1451
No log	7.7647	264	1.4434	0.1052	1.4434	1.2014
No log	7.8235	266	1.4336	0.1052	1.4336	1.1973
No log	7.8824	268	1.3574	0.1744	1.3574	1.1651
No log	7.9412	270	1.2404	0.1744	1.2404	1.1137
No log	8.0	272	1.1758	0.2203	1.1758	1.0844
No log	8.0588	274	1.2272	0.2555	1.2272	1.1078
No log	8.1176	276	1.3066	0.2611	1.3066	1.1431
No log	8.1765	278	1.2715	0.2752	1.2715	1.1276
No log	8.2353	280	1.3874	0.2568	1.3874	1.1779
No log	8.2941	282	1.4358	0.2292	1.4358	1.1982
No log	8.3529	284	1.4701	0.2694	1.4701	1.2125
No log	8.4118	286	1.3986	0.3006	1.3986	1.1826
No log	8.4706	288	1.3411	0.3148	1.3411	1.1580
No log	8.5294	290	1.2462	0.2292	1.2462	1.1163
No log	8.5882	292	1.1522	0.2065	1.1522	1.0734
No log	8.6471	294	1.1968	0.1407	1.1968	1.0940
No log	8.7059	296	1.3291	0.1407	1.3291	1.1529
No log	8.7647	298	1.5052	0.2424	1.5052	1.2269
No log	8.8235	300	1.5294	0.2292	1.5294	1.2367
No log	8.8824	302	1.3122	0.2065	1.3122	1.1455
No log	8.9412	304	1.1155	0.1961	1.1155	1.0562
No log	9.0	306	1.0670	0.1579	1.0670	1.0329
No log	9.0588	308	1.1783	0.2227	1.1783	1.0855
No log	9.1176	310	1.4859	0.2117	1.4859	1.2190
No log	9.1765	312	1.7109	0.1902	1.7109	1.3080
No log	9.2353	314	1.6863	0.1832	1.6863	1.2986
No log	9.2941	316	1.5223	0.1814	1.5223	1.2338
No log	9.3529	318	1.2887	0.1052	1.2887	1.1352
No log	9.4118	320	1.1705	0.0	1.1705	1.0819
No log	9.4706	322	1.1424	0.0	1.1424	1.0688
No log	9.5294	324	1.2198	0.1407	1.2198	1.1045
No log	9.5882	326	1.3399	0.1744	1.3399	1.1575
No log	9.6471	328	1.4869	0.2474	1.4869	1.2194
No log	9.7059	330	1.5175	0.2292	1.5175	1.2319
No log	9.7647	332	1.4320	0.2239	1.4320	1.1966
No log	9.8235	334	1.2548	0.2184	1.2548	1.1202
No log	9.8824	336	1.1517	0.2184	1.1517	1.0732
No log	9.9412	338	1.1736	0.2522	1.1736	1.0833
No log	10.0	340	1.2532	0.2694	1.2532	1.1195
No log	10.0588	342	1.3535	0.2406	1.3535	1.1634
No log	10.1176	344	1.5330	0.2681	1.5330	1.2381
No log	10.1765	346	1.4914	0.2058	1.4914	1.2212
No log	10.2353	348	1.3318	0.2126	1.3318	1.1540
No log	10.2941	350	1.1544	0.1407	1.1544	1.0744
No log	10.3529	352	1.1327	0.0155	1.1327	1.0643
No log	10.4118	354	1.2151	0.0401	1.2151	1.1023
No log	10.4706	356	1.3534	0.0401	1.3534	1.1633
No log	10.5294	358	1.4983	0.1407	1.4983	1.2241
No log	10.5882	360	1.5411	0.2065	1.5411	1.2414
No log	10.6471	362	1.5716	0.2424	1.5716	1.2536
No log	10.7059	364	1.4515	0.2016	1.4515	1.2048
No log	10.7647	366	1.3301	0.2584	1.3301	1.1533
No log	10.8235	368	1.2844	0.2712	1.2844	1.1333
No log	10.8824	370	1.2945	0.2511	1.2945	1.1378
No log	10.9412	372	1.3676	0.2793	1.3676	1.1694
No log	11.0	374	1.3701	0.2522	1.3701	1.1705
No log	11.0588	376	1.2568	0.1562	1.2568	1.1211
No log	11.1176	378	1.1254	0.0401	1.1254	1.0609
No log	11.1765	380	1.0163	0.0587	1.0163	1.0081
No log	11.2353	382	0.9483	0.2919	0.9483	0.9738
No log	11.2941	384	0.9526	0.3957	0.9526	0.9760
No log	11.3529	386	1.0501	0.3619	1.0501	1.0248
No log	11.4118	388	1.2534	0.2431	1.2534	1.1196
No log	11.4706	390	1.4454	0.2110	1.4454	1.2023
No log	11.5294	392	1.4945	0.2391	1.4945	1.2225
No log	11.5882	394	1.4677	0.1562	1.4677	1.2115
No log	11.6471	396	1.3345	0.2065	1.3345	1.1552
No log	11.7059	398	1.2220	0.2372	1.2220	1.1055
No log	11.7647	400	1.0883	0.3165	1.0883	1.0432
No log	11.8235	402	1.0342	0.3937	1.0342	1.0170
No log	11.8824	404	1.0948	0.3551	1.0948	1.0463
No log	11.9412	406	1.1791	0.3346	1.1791	1.0858
No log	12.0	408	1.2074	0.2653	1.2074	1.0988
No log	12.0588	410	1.2458	0.2474	1.2458	1.1162
No log	12.1176	412	1.3167	0.2372	1.3167	1.1475
No log	12.1765	414	1.3671	0.2372	1.3671	1.1692
No log	12.2353	416	1.3259	0.1407	1.3259	1.1515
No log	12.2941	418	1.2436	0.1744	1.2436	1.1152
No log	12.3529	420	1.1552	0.2477	1.1552	1.0748
No log	12.4118	422	1.1624	0.2857	1.1624	1.0782
No log	12.4706	424	1.2444	0.2501	1.2444	1.1155
No log	12.5294	426	1.3649	0.2006	1.3649	1.1683
No log	12.5882	428	1.4728	0.2252	1.4728	1.2136
No log	12.6471	430	1.4499	0.2006	1.4499	1.2041
No log	12.7059	432	1.3184	0.2474	1.3184	1.1482
No log	12.7647	434	1.2446	0.1228	1.2446	1.1156
No log	12.8235	436	1.2091	0.0401	1.2091	1.0996
No log	12.8824	438	1.1884	0.0401	1.1884	1.0901
No log	12.9412	440	1.1642	0.0401	1.1642	1.0790
No log	13.0	442	1.1889	0.0510	1.1889	1.0904
No log	13.0588	444	1.2176	0.1814	1.2176	1.1034
No log	13.1176	446	1.3041	0.2752	1.3041	1.1420
No log	13.1765	448	1.4629	0.2363	1.4629	1.2095
No log	13.2353	450	1.4996	0.2363	1.4996	1.2246
No log	13.2941	452	1.4842	0.2832	1.4842	1.2183
No log	13.3529	454	1.3621	0.1744	1.3621	1.1671
No log	13.4118	456	1.1901	0.0401	1.1901	1.0909
No log	13.4706	458	1.0831	0.0068	1.0831	1.0407
No log	13.5294	460	1.0230	0.1699	1.0230	1.0114
No log	13.5882	462	1.0028	0.2288	1.0028	1.0014
No log	13.6471	464	1.0424	0.1625	1.0424	1.0210
No log	13.7059	466	1.1112	0.1446	1.1112	1.0541
No log	13.7647	468	1.2173	0.2424	1.2173	1.1033
No log	13.8235	470	1.3775	0.2482	1.3775	1.1737
No log	13.8824	472	1.3723	0.2611	1.3723	1.1715
No log	13.9412	474	1.2455	0.2126	1.2455	1.1160
No log	14.0	476	1.1705	0.0401	1.1705	1.0819
No log	14.0588	478	1.1690	0.0401	1.1690	1.0812
No log	14.1176	480	1.1892	0.0401	1.1892	1.0905
No log	14.1765	482	1.2055	0.0401	1.2055	1.0979
No log	14.2353	484	1.2250	0.0401	1.2250	1.1068
No log	14.2941	486	1.2297	0.0587	1.2297	1.1089
No log	14.3529	488	1.2477	0.1605	1.2477	1.1170
No log	14.4118	490	1.2316	0.3059	1.2316	1.1098
No log	14.4706	492	1.2380	0.3333	1.2380	1.1126
No log	14.5294	494	1.2795	0.2926	1.2795	1.1312
No log	14.5882	496	1.2971	0.2455	1.2971	1.1389
No log	14.6471	498	1.2938	0.0781	1.2938	1.1374
0.2364	14.7059	500	1.2702	0.0401	1.2702	1.1270
0.2364	14.7647	502	1.2704	0.0445	1.2704	1.1271
0.2364	14.8235	504	1.2847	0.0445	1.2847	1.1334
0.2364	14.8824	506	1.2949	0.0833	1.2949	1.1380
0.2364	14.9412	508	1.3764	0.1202	1.3764	1.1732
0.2364	15.0	510	1.4664	0.1202	1.4664	1.2109
0.2364	15.0588	512	1.5646	0.0781	1.5646	1.2508
0.2364	15.1176	514	1.6221	0.0781	1.6221	1.2736
0.2364	15.1765	516	1.5751	0.0781	1.5751	1.2550
0.2364	15.2353	518	1.5404	0.0781	1.5404	1.2411
0.2364	15.2941	520	1.4860	0.0781	1.4860	1.2190
0.2364	15.3529	522	1.4106	0.0556	1.4106	1.1877
0.2364	15.4118	524	1.3141	0.0556	1.3141	1.1464
0.2364	15.4706	526	1.2642	0.0160	1.2642	1.1244
0.2364	15.5294	528	1.2671	0.0160	1.2671	1.1257
0.2364	15.5882	530	1.2910	0.0	1.2910	1.1362
0.2364	15.6471	532	1.3016	0.0	1.3016	1.1409
0.2364	15.7059	534	1.2935	0.0	1.2935	1.1373

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1