ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4750
• Qwk: 0.0401
• Mse: 1.4750
• Rmse: 1.2145

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0588	2	4.0543	-0.0061	4.0543	2.0135
No log	0.1176	4	2.2749	-0.0297	2.2749	1.5083
No log	0.1765	6	1.5352	0.0661	1.5352	1.2391
No log	0.2353	8	1.1820	0.0548	1.1820	1.0872
No log	0.2941	10	1.1297	0.0111	1.1297	1.0629
No log	0.3529	12	1.1783	0.1864	1.1783	1.0855
No log	0.4118	14	1.3797	0.0256	1.3797	1.1746
No log	0.4706	16	1.3319	0.0287	1.3319	1.1541
No log	0.5294	18	1.1133	0.3082	1.1133	1.0551
No log	0.5882	20	1.0402	0.2008	1.0402	1.0199
No log	0.6471	22	1.1360	0.0919	1.1360	1.0658
No log	0.7059	24	1.1420	0.0919	1.1420	1.0687
No log	0.7647	26	1.0498	0.1755	1.0498	1.0246
No log	0.8235	28	1.0322	0.3435	1.0322	1.0160
No log	0.8824	30	1.0245	0.2888	1.0245	1.0122
No log	0.9412	32	1.0587	0.1864	1.0587	1.0289
No log	1.0	34	1.1484	0.1292	1.1484	1.0716
No log	1.0588	36	1.2671	-0.0535	1.2671	1.1256
No log	1.1176	38	1.4140	-0.0375	1.4140	1.1891
No log	1.1765	40	1.8065	-0.2120	1.8065	1.3441
No log	1.2353	42	1.7639	-0.1010	1.7639	1.3281
No log	1.2941	44	1.5552	0.0859	1.5552	1.2471
No log	1.3529	46	1.6445	0.0016	1.6445	1.2824
No log	1.4118	48	1.9913	-0.2027	1.9913	1.4111
No log	1.4706	50	1.9013	0.0296	1.9013	1.3789
No log	1.5294	52	2.2267	-0.0325	2.2267	1.4922
No log	1.5882	54	2.2303	0.0404	2.2303	1.4934
No log	1.6471	56	1.4969	0.1970	1.4969	1.2235
No log	1.7059	58	1.2520	0.3352	1.2520	1.1189
No log	1.7647	60	1.4475	0.2043	1.4475	1.2031
No log	1.8235	62	2.1397	0.1173	2.1397	1.4628
No log	1.8824	64	2.0834	0.1395	2.0834	1.4434
No log	1.9412	66	1.5740	0.1789	1.5740	1.2546
No log	2.0	68	1.2892	0.1905	1.2892	1.1354
No log	2.0588	70	1.5195	0.1561	1.5195	1.2327
No log	2.1176	72	1.8769	0.1197	1.8769	1.3700
No log	2.1765	74	1.8536	0.0636	1.8536	1.3615
No log	2.2353	76	1.8352	0.0636	1.8352	1.3547
No log	2.2941	78	1.7494	0.1207	1.7494	1.3226
No log	2.3529	80	1.7745	0.1071	1.7745	1.3321
No log	2.4118	82	1.7460	0.1000	1.7460	1.3214
No log	2.4706	84	1.7241	0.0864	1.7241	1.3130
No log	2.5294	86	1.7115	0.0864	1.7115	1.3083
No log	2.5882	88	1.7140	0.1344	1.7140	1.3092
No log	2.6471	90	1.5943	0.1509	1.5943	1.2627
No log	2.7059	92	1.2631	0.2368	1.2631	1.1239
No log	2.7647	94	1.0850	0.1996	1.0850	1.0416
No log	2.8235	96	1.1400	0.1775	1.1400	1.0677
No log	2.8824	98	1.4771	0.2313	1.4771	1.2153
No log	2.9412	100	1.7432	0.1635	1.7432	1.3203
No log	3.0	102	1.8320	0.1752	1.8320	1.3535
No log	3.0588	104	1.7162	0.1694	1.7162	1.3100
No log	3.1176	106	1.3183	0.2555	1.3183	1.1482
No log	3.1765	108	0.9930	0.1944	0.9930	0.9965
No log	3.2353	110	0.9808	0.1979	0.9808	0.9904
No log	3.2941	112	1.0538	0.1407	1.0538	1.0265
No log	3.3529	114	1.2991	0.1407	1.2991	1.1398
No log	3.4118	116	1.4510	0.1814	1.4510	1.2046
No log	3.4706	118	1.5012	0.1814	1.5012	1.2252
No log	3.5294	120	1.4269	0.2004	1.4269	1.1945
No log	3.5882	122	1.2752	0.2417	1.2752	1.1292
No log	3.6471	124	1.2860	0.2851	1.2860	1.1340
No log	3.7059	126	1.5074	0.1955	1.5074	1.2278
No log	3.7647	128	1.7440	0.1902	1.7440	1.3206
No log	3.8235	130	1.8667	0.0879	1.8667	1.3663
No log	3.8824	132	1.8047	0.0626	1.8047	1.3434
No log	3.9412	134	1.6730	0.1357	1.6730	1.2934
No log	4.0	136	1.6356	0.1142	1.6356	1.2789
No log	4.0588	138	1.4464	0.1473	1.4464	1.2027
No log	4.1176	140	1.2477	0.1816	1.2477	1.1170
No log	4.1765	142	1.1781	0.2843	1.1781	1.0854
No log	4.2353	144	1.1943	0.2455	1.1943	1.0928
No log	4.2941	146	1.1759	0.2143	1.1759	1.0844
No log	4.3529	148	1.2040	0.1816	1.2040	1.0973
No log	4.4118	150	1.2129	0.1816	1.2129	1.1013
No log	4.4706	152	1.3009	0.2143	1.3009	1.1406
No log	4.5294	154	1.4071	0.1943	1.4071	1.1862
No log	4.5882	156	1.4860	0.1744	1.4860	1.2190
No log	4.6471	158	1.5527	0.0896	1.5527	1.2461
No log	4.7059	160	1.4678	0.1486	1.4678	1.2115
No log	4.7647	162	1.2537	0.1744	1.2537	1.1197
No log	4.8235	164	1.0901	0.1744	1.0901	1.0441
No log	4.8824	166	1.0714	0.2065	1.0714	1.0351
No log	4.9412	168	1.2527	0.2239	1.2527	1.1193
No log	5.0	170	1.5638	0.2448	1.5638	1.2505
No log	5.0588	172	1.6965	0.2565	1.6965	1.3025
No log	5.1176	174	1.5331	0.2606	1.5331	1.2382
No log	5.1765	176	1.2898	0.2342	1.2898	1.1357
No log	5.2353	178	1.2257	0.2065	1.2257	1.1071
No log	5.2941	180	1.3285	0.2065	1.3285	1.1526
No log	5.3529	182	1.5800	0.2342	1.5800	1.2570
No log	5.4118	184	1.6856	0.1789	1.6856	1.2983
No log	5.4706	186	1.6367	0.2170	1.6367	1.2793
No log	5.5294	188	1.6610	0.2170	1.6610	1.2888
No log	5.5882	190	1.6137	0.2170	1.6137	1.2703
No log	5.6471	192	1.5301	0.2292	1.5301	1.2370
No log	5.7059	194	1.4517	0.1562	1.4517	1.2049
No log	5.7647	196	1.4568	0.1562	1.4568	1.2070
No log	5.8235	198	1.3885	0.1142	1.3885	1.1784
No log	5.8824	200	1.3688	0.1142	1.3688	1.1700
No log	5.9412	202	1.4409	0.1142	1.4409	1.2004
No log	6.0	204	1.4295	0.1407	1.4295	1.1956
No log	6.0588	206	1.4705	0.1407	1.4705	1.2127
No log	6.1176	208	1.5080	0.1407	1.5080	1.2280
No log	6.1765	210	1.4504	0.1407	1.4504	1.2043
No log	6.2353	212	1.4852	0.1744	1.4852	1.2187
No log	6.2941	214	1.4342	0.2065	1.4342	1.1976
No log	6.3529	216	1.3509	0.2015	1.3509	1.1623
No log	6.4118	218	1.2386	0.1026	1.2386	1.1129
No log	6.4706	220	1.2122	0.1397	1.2122	1.1010
No log	6.5294	222	1.2684	0.2065	1.2684	1.1262
No log	6.5882	224	1.2990	0.2372	1.2990	1.1397
No log	6.6471	226	1.3871	0.2184	1.3871	1.1778
No log	6.7059	228	1.3707	0.2065	1.3707	1.1708
No log	6.7647	230	1.3203	0.1052	1.3203	1.1491
No log	6.8235	232	1.3162	0.1744	1.3162	1.1473
No log	6.8824	234	1.2744	0.2065	1.2744	1.1289
No log	6.9412	236	1.3383	0.2239	1.3383	1.1568
No log	7.0	238	1.4467	0.2568	1.4467	1.2028
No log	7.0588	240	1.6362	0.2653	1.6362	1.2791
No log	7.1176	242	1.6238	0.2611	1.6238	1.2743
No log	7.1765	244	1.5360	0.2568	1.5360	1.2393
No log	7.2353	246	1.3401	0.2709	1.3401	1.1576
No log	7.2941	248	1.2695	0.2555	1.2695	1.1267
No log	7.3529	250	1.3387	0.2424	1.3387	1.1570
No log	7.4118	252	1.3934	0.2424	1.3934	1.1804
No log	7.4706	254	1.3286	0.2065	1.3286	1.1527
No log	7.5294	256	1.3019	0.1052	1.3019	1.1410
No log	7.5882	258	1.2516	0.1052	1.2516	1.1187
No log	7.6471	260	1.2470	0.1886	1.2470	1.1167
No log	7.7059	262	1.3334	0.2065	1.3334	1.1547
No log	7.7647	264	1.4691	0.2065	1.4691	1.2121
No log	7.8235	266	1.4328	0.2065	1.4328	1.1970
No log	7.8824	268	1.3721	0.2709	1.3721	1.1714
No log	7.9412	270	1.3637	0.2611	1.3637	1.1678
No log	8.0	272	1.3267	0.2653	1.3267	1.1518
No log	8.0588	274	1.2367	0.2555	1.2367	1.1121
No log	8.1176	276	1.2217	0.2555	1.2217	1.1053
No log	8.1765	278	1.2063	0.2126	1.2063	1.0983
No log	8.2353	280	1.4382	0.2525	1.4382	1.1993
No log	8.2941	282	1.6036	0.2406	1.6036	1.2663
No log	8.3529	284	1.7430	0.2530	1.7430	1.3202
No log	8.4118	286	1.6212	0.2457	1.6212	1.2733
No log	8.4706	288	1.3841	0.2806	1.3841	1.1765
No log	8.5294	290	1.3044	0.2806	1.3044	1.1421
No log	8.5882	292	1.2550	0.2653	1.2550	1.1203
No log	8.6471	294	1.3194	0.2065	1.3194	1.1486
No log	8.7059	296	1.4153	0.1407	1.4153	1.1897
No log	8.7647	298	1.4900	0.1142	1.4900	1.2207
No log	8.8235	300	1.4663	0.0510	1.4663	1.2109
No log	8.8824	302	1.3078	0.0401	1.3078	1.1436
No log	8.9412	304	1.1135	0.1052	1.1135	1.0552
No log	9.0	306	1.0450	0.1724	1.0450	1.0223
No log	9.0588	308	1.1494	0.2555	1.1494	1.0721
No log	9.1176	310	1.5047	0.3205	1.5047	1.2267
No log	9.1765	312	1.8028	0.2565	1.8028	1.3427
No log	9.2353	314	1.7807	0.2110	1.7807	1.3344
No log	9.2941	316	1.6128	0.1814	1.6128	1.2699
No log	9.3529	318	1.4257	0.1052	1.4257	1.1940
No log	9.4118	320	1.3214	0.1052	1.3214	1.1495
No log	9.4706	322	1.3025	0.1052	1.3025	1.1413
No log	9.5294	324	1.3777	0.1744	1.3777	1.1738
No log	9.5882	326	1.3434	0.1052	1.3434	1.1591
No log	9.6471	328	1.3097	0.1407	1.3097	1.1444
No log	9.7059	330	1.2054	0.1407	1.2054	1.0979
No log	9.7647	332	1.1765	0.1814	1.1765	1.0847
No log	9.8235	334	1.1464	0.2126	1.1464	1.0707
No log	9.8824	336	1.2999	0.2611	1.2999	1.1401
No log	9.9412	338	1.5938	0.2448	1.5938	1.2625
No log	10.0	340	1.8395	0.2429	1.8395	1.3563
No log	10.0588	342	1.7906	0.2379	1.7906	1.3381
No log	10.1176	344	1.5752	0.2342	1.5752	1.2551
No log	10.1765	346	1.3112	0.0401	1.3112	1.1451
No log	10.2353	348	1.1495	0.0556	1.1495	1.0721
No log	10.2941	350	1.1127	0.0310	1.1127	1.0548
No log	10.3529	352	1.1747	0.0556	1.1747	1.0838
No log	10.4118	354	1.3027	0.0401	1.3027	1.1414
No log	10.4706	356	1.4743	0.1052	1.4743	1.2142
No log	10.5294	358	1.5934	0.1744	1.5934	1.2623
No log	10.5882	360	1.5805	0.1744	1.5805	1.2572
No log	10.6471	362	1.5882	0.2665	1.5882	1.2602
No log	10.7059	364	1.4980	0.2709	1.4980	1.2239
No log	10.7647	366	1.3559	0.2155	1.3559	1.1644
No log	10.8235	368	1.3085	0.2229	1.3085	1.1439
No log	10.8824	370	1.3507	0.2647	1.3507	1.1622
No log	10.9412	372	1.4408	0.2611	1.4408	1.2004
No log	11.0	374	1.4324	0.2611	1.4324	1.1968
No log	11.0588	376	1.2899	0.2424	1.2899	1.1358
No log	11.1176	378	1.1484	0.0	1.1484	1.0717
No log	11.1765	380	1.0476	0.0771	1.0476	1.0235
No log	11.2353	382	1.0088	0.1830	1.0088	1.0044
No log	11.2941	384	1.0561	0.2790	1.0561	1.0277
No log	11.3529	386	1.1683	0.2516	1.1683	1.0809
No log	11.4118	388	1.3164	0.2809	1.3164	1.1474
No log	11.4706	390	1.3414	0.2771	1.3414	1.1582
No log	11.5294	392	1.2276	0.2555	1.2276	1.1080
No log	11.5882	394	1.0895	0.2027	1.0895	1.0438
No log	11.6471	396	1.0308	0.2335	1.0308	1.0153
No log	11.7059	398	1.0330	0.1918	1.0330	1.0164
No log	11.7647	400	1.1078	0.2728	1.1078	1.0525
No log	11.8235	402	1.2325	0.2260	1.2325	1.1102
No log	11.8824	404	1.2781	0.2132	1.2781	1.1305
No log	11.9412	406	1.2093	0.2896	1.2093	1.0997
No log	12.0	408	1.1173	0.3115	1.1173	1.0570
No log	12.0588	410	1.0540	0.2149	1.0540	1.0267
No log	12.1176	412	1.1248	0.2188	1.1248	1.0606
No log	12.1765	414	1.2801	0.1552	1.2801	1.1314
No log	12.2353	416	1.3522	0.1407	1.3522	1.1628
No log	12.2941	418	1.3758	0.1552	1.3758	1.1730
No log	12.3529	420	1.3318	0.2506	1.3318	1.1540
No log	12.4118	422	1.3332	0.2555	1.3332	1.1546
No log	12.4706	424	1.3859	0.2915	1.3859	1.1773
No log	12.5294	426	1.3478	0.2915	1.3478	1.1609
No log	12.5882	428	1.3243	0.2731	1.3243	1.1508
No log	12.6471	430	1.3022	0.2690	1.3022	1.1411
No log	12.7059	432	1.2654	0.2260	1.2654	1.1249
No log	12.7647	434	1.2757	0.1814	1.2757	1.1295
No log	12.8235	436	1.1988	0.0401	1.1988	1.0949
No log	12.8824	438	1.1931	0.0401	1.1931	1.0923
No log	12.9412	440	1.1671	0.0401	1.1671	1.0803
No log	13.0	442	1.2044	0.0401	1.2044	1.0974
No log	13.0588	444	1.1932	0.0401	1.1932	1.0923
No log	13.1176	446	1.1913	0.0401	1.1913	1.0915
No log	13.1765	448	1.3185	0.1744	1.3185	1.1483
No log	13.2353	450	1.4035	0.2126	1.4035	1.1847
No log	13.2941	452	1.4790	0.1744	1.4790	1.2161
No log	13.3529	454	1.4905	0.0401	1.4905	1.2209
No log	13.4118	456	1.4355	0.0401	1.4355	1.1981
No log	13.4706	458	1.3871	0.0401	1.3871	1.1777
No log	13.5294	460	1.3533	0.0401	1.3533	1.1633
No log	13.5882	462	1.3174	0.0155	1.3174	1.1478
No log	13.6471	464	1.2964	0.0587	1.2964	1.1386
No log	13.7059	466	1.3353	0.2857	1.3353	1.1555
No log	13.7647	468	1.5640	0.2770	1.5640	1.2506
No log	13.8235	470	1.7663	0.1787	1.7663	1.3290
No log	13.8824	472	1.7474	0.2007	1.7474	1.3219
No log	13.9412	474	1.5408	0.2525	1.5408	1.2413
No log	14.0	476	1.3372	0.0541	1.3372	1.1564
No log	14.0588	478	1.2425	0.0464	1.2425	1.1147
No log	14.1176	480	1.2107	0.0510	1.2107	1.1003
No log	14.1765	482	1.2227	0.0510	1.2227	1.1057
No log	14.2353	484	1.2992	0.0068	1.2992	1.1398
No log	14.2941	486	1.4435	0.0401	1.4435	1.2015
No log	14.3529	488	1.5917	0.0401	1.5917	1.2616
No log	14.4118	490	1.6956	0.1943	1.6956	1.3022
No log	14.4706	492	1.7167	0.1943	1.7167	1.3102
No log	14.5294	494	1.6273	0.1943	1.6273	1.2757
No log	14.5882	496	1.5135	0.1512	1.5135	1.2303
No log	14.6471	498	1.4619	0.0401	1.4619	1.2091
0.2386	14.7059	500	1.3820	0.0401	1.3820	1.1756
0.2386	14.7647	502	1.3366	0.0401	1.3366	1.1561
0.2386	14.8235	504	1.3006	0.0401	1.3006	1.1404
0.2386	14.8824	506	1.2837	0.1142	1.2837	1.1330
0.2386	14.9412	508	1.2800	0.1228	1.2800	1.1314
0.2386	15.0	510	1.2567	0.0526	1.2567	1.1210
0.2386	15.0588	512	1.2879	0.0935	1.2879	1.1349
0.2386	15.1176	514	1.3776	0.1980	1.3776	1.1737
0.2386	15.1765	516	1.4304	0.1980	1.4304	1.1960
0.2386	15.2353	518	1.4802	0.1980	1.4802	1.2166
0.2386	15.2941	520	1.5087	0.2522	1.5087	1.2283
0.2386	15.3529	522	1.5029	0.2372	1.5029	1.2259
0.2386	15.4118	524	1.4449	0.1407	1.4449	1.2020
0.2386	15.4706	526	1.4342	0.0401	1.4342	1.1976
0.2386	15.5294	528	1.4317	0.0401	1.4317	1.1965
0.2386	15.5882	530	1.4174	0.0401	1.4174	1.1906
0.2386	15.6471	532	1.3925	0.0556	1.3925	1.1800
0.2386	15.7059	534	1.3638	0.0155	1.3638	1.1678
0.2386	15.7647	536	1.4050	0.0155	1.4050	1.1853
0.2386	15.8235	538	1.4966	0.0401	1.4966	1.2234
0.2386	15.8824	540	1.6048	0.2372	1.6048	1.2668
0.2386	15.9412	542	1.6635	0.2424	1.6635	1.2898
0.2386	16.0	544	1.6983	0.2474	1.6983	1.3032
0.2386	16.0588	546	1.6599	0.1744	1.6599	1.2884
0.2386	16.1176	548	1.5764	0.0401	1.5764	1.2556
0.2386	16.1765	550	1.4775	0.0	1.4775	1.2155
0.2386	16.2353	552	1.4917	0.0	1.4917	1.2214
0.2386	16.2941	554	1.5636	0.0401	1.5636	1.2505
0.2386	16.3529	556	1.4750	0.0401	1.4750	1.2145

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1