ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6156
• Qwk: 0.14
• Mse: 1.6156
• Rmse: 1.2711

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0294	2	4.8908	-0.0075	4.8908	2.2115
No log	0.0588	4	3.7521	0.0297	3.7521	1.9370
No log	0.0882	6	2.0639	0.1273	2.0639	1.4366
No log	0.1176	8	1.7916	0.0372	1.7916	1.3385
No log	0.1471	10	2.4597	-0.0176	2.4597	1.5683
No log	0.1765	12	1.8348	0.0372	1.8348	1.3545
No log	0.2059	14	1.4031	0.0227	1.4031	1.1845
No log	0.2353	16	1.2728	0.1966	1.2728	1.1282
No log	0.2647	18	1.1788	0.2914	1.1788	1.0857
No log	0.2941	20	1.3335	0.1110	1.3335	1.1548
No log	0.3235	22	1.7674	0.0082	1.7674	1.3294
No log	0.3529	24	2.3500	0.0184	2.3500	1.5330
No log	0.3824	26	2.3036	-0.0044	2.3036	1.5178
No log	0.4118	28	1.5826	0.0331	1.5826	1.2580
No log	0.4412	30	1.1999	0.1696	1.1999	1.0954
No log	0.4706	32	1.1575	0.1696	1.1575	1.0759
No log	0.5	34	1.3064	0.2243	1.3064	1.1430
No log	0.5294	36	1.7097	0.0426	1.7097	1.3076
No log	0.5588	38	2.1459	0.1011	2.1459	1.4649
No log	0.5882	40	2.1852	0.1560	2.1852	1.4782
No log	0.6176	42	2.2935	0.1774	2.2935	1.5144
No log	0.6471	44	2.3949	0.1560	2.3949	1.5475
No log	0.6765	46	2.0710	0.1544	2.0710	1.4391
No log	0.7059	48	1.8398	0.0414	1.8398	1.3564
No log	0.7353	50	1.4088	0.0	1.4088	1.1869
No log	0.7647	52	1.2553	0.0575	1.2553	1.1204
No log	0.7941	54	1.2629	0.0189	1.2629	1.1238
No log	0.8235	56	1.3577	0.0575	1.3577	1.1652
No log	0.8529	58	1.3540	0.1165	1.3540	1.1636
No log	0.8824	60	1.5715	0.0575	1.5715	1.2536
No log	0.9118	62	1.9042	0.1287	1.9042	1.3799
No log	0.9412	64	2.1009	0.1011	2.1009	1.4495
No log	0.9706	66	1.9930	0.1363	1.9930	1.4117
No log	1.0	68	1.7034	0.2083	1.7034	1.3052
No log	1.0294	70	1.3590	0.1772	1.3590	1.1658
No log	1.0588	72	1.2032	0.2342	1.2032	1.0969
No log	1.0882	74	1.1517	0.2618	1.1517	1.0732
No log	1.1176	76	1.2368	0.2342	1.2368	1.1121
No log	1.1471	78	1.5717	0.2119	1.5717	1.2537
No log	1.1765	80	2.0339	0.1697	2.0339	1.4262
No log	1.2059	82	2.3167	0.1549	2.3167	1.5221
No log	1.2353	84	2.1991	0.1656	2.1991	1.4829
No log	1.2647	86	1.9319	0.1942	1.9319	1.3899
No log	1.2941	88	1.7028	0.1805	1.7028	1.3049
No log	1.3235	90	1.4146	0.1165	1.4146	1.1894
No log	1.3529	92	1.1987	0.2342	1.1987	1.0948
No log	1.3824	94	1.1939	0.2298	1.1939	1.0927
No log	1.4118	96	1.3121	0.0600	1.3121	1.1455
No log	1.4412	98	1.3530	0.0600	1.3530	1.1632
No log	1.4706	100	1.5063	0.1252	1.5063	1.2273
No log	1.5	102	1.9254	0.0747	1.9254	1.3876
No log	1.5294	104	2.2919	0.1033	2.2919	1.5139
No log	1.5588	106	2.2022	0.1033	2.2022	1.4840
No log	1.5882	108	1.6957	0.0971	1.6957	1.3022
No log	1.6176	110	1.2735	0.1346	1.2735	1.1285
No log	1.6471	112	1.2773	0.1715	1.2773	1.1302
No log	1.6765	114	1.2800	0.1809	1.2800	1.1313
No log	1.7059	116	1.2200	0.2718	1.2200	1.1045
No log	1.7353	118	1.2679	0.2527	1.2679	1.1260
No log	1.7647	120	1.3935	0.1743	1.3935	1.1804
No log	1.7941	122	1.5744	0.1615	1.5744	1.2548
No log	1.8235	124	1.6522	0.1642	1.6522	1.2854
No log	1.8529	126	1.6342	0.1527	1.6342	1.2784
No log	1.8824	128	1.5876	0.1629	1.5876	1.2600
No log	1.9118	130	1.4681	0.3077	1.4681	1.2116
No log	1.9412	132	1.3701	0.3271	1.3701	1.1705
No log	1.9706	134	1.4158	0.2634	1.4158	1.1899
No log	2.0	136	1.5080	0.1538	1.5080	1.2280
No log	2.0294	138	1.5500	0.1520	1.5500	1.2450
No log	2.0588	140	1.3512	0.1168	1.3512	1.1624
No log	2.0882	142	1.1909	0.3348	1.1909	1.0913
No log	2.1176	144	1.1477	0.3036	1.1477	1.0713
No log	2.1471	146	1.2372	0.2961	1.2372	1.1123
No log	2.1765	148	1.6458	0.1809	1.6458	1.2829
No log	2.2059	150	1.7816	0.1835	1.7816	1.3348
No log	2.2353	152	1.5737	0.2078	1.5737	1.2545
No log	2.2647	154	1.6949	0.1248	1.6949	1.3019
No log	2.2941	156	1.6829	0.0957	1.6829	1.2973
No log	2.3235	158	1.4507	0.0921	1.4507	1.2044
No log	2.3529	160	1.3353	0.2098	1.3353	1.1556
No log	2.3824	162	1.3344	0.2098	1.3344	1.1552
No log	2.4118	164	1.3652	0.2374	1.3652	1.1684
No log	2.4412	166	1.7091	0.1644	1.7091	1.3073
No log	2.4706	168	1.8770	0.1246	1.8770	1.3700
No log	2.5	170	1.7099	0.1698	1.7099	1.3076
No log	2.5294	172	1.4411	0.1565	1.4411	1.2005
No log	2.5588	174	1.2506	0.2112	1.2506	1.1183
No log	2.5882	176	1.2191	0.1609	1.2191	1.1041
No log	2.6176	178	1.4320	0.2544	1.4320	1.1966
No log	2.6471	180	1.6013	0.0417	1.6013	1.2654
No log	2.6765	182	1.5992	0.0717	1.5992	1.2646
No log	2.7059	184	1.3955	0.0345	1.3955	1.1813
No log	2.7353	186	1.1701	0.3163	1.1701	1.0817
No log	2.7647	188	1.1181	0.3365	1.1181	1.0574
No log	2.7941	190	1.1309	0.2016	1.1309	1.0635
No log	2.8235	192	1.2655	0.3008	1.2655	1.1249
No log	2.8529	194	1.4087	0.2227	1.4087	1.1869
No log	2.8824	196	1.5306	0.1988	1.5306	1.2372
No log	2.9118	198	1.4726	0.1902	1.4726	1.2135
No log	2.9412	200	1.5329	0.1785	1.5329	1.2381
No log	2.9706	202	1.4525	0.1726	1.4525	1.2052
No log	3.0	204	1.3573	0.2570	1.3573	1.1650
No log	3.0294	206	1.2474	0.2747	1.2474	1.1169
No log	3.0588	208	1.2740	0.1841	1.2740	1.1287
No log	3.0882	210	1.3702	0.2098	1.3702	1.1706
No log	3.1176	212	1.4029	0.2005	1.4029	1.1844
No log	3.1471	214	1.4075	0.1868	1.4075	1.1864
No log	3.1765	216	1.3964	0.1815	1.3964	1.1817
No log	3.2059	218	1.4307	0.2333	1.4307	1.1961
No log	3.2353	220	1.6410	0.1352	1.6410	1.2810
No log	3.2647	222	1.7026	0.1373	1.7026	1.3049
No log	3.2941	224	1.5817	0.1438	1.5817	1.2577
No log	3.3235	226	1.4581	0.1634	1.4581	1.2075
No log	3.3529	228	1.3275	0.2324	1.3275	1.1522
No log	3.3824	230	1.2709	0.2324	1.2709	1.1274
No log	3.4118	232	1.2256	0.2654	1.2256	1.1071
No log	3.4412	234	1.2675	0.3389	1.2675	1.1258
No log	3.4706	236	1.3609	0.2660	1.3609	1.1666
No log	3.5	238	1.6660	0.2150	1.6660	1.2907
No log	3.5294	240	1.6956	0.2081	1.6956	1.3022
No log	3.5588	242	1.4104	0.2227	1.4104	1.1876
No log	3.5882	244	1.1876	0.2844	1.1876	1.0898
No log	3.6176	246	1.1678	0.2864	1.1678	1.0806
No log	3.6471	248	1.2704	0.1951	1.2704	1.1271
No log	3.6765	250	1.5165	0.1408	1.5165	1.2315
No log	3.7059	252	1.6878	0.1225	1.6878	1.2992
No log	3.7353	254	1.5685	0.14	1.5685	1.2524
No log	3.7647	256	1.3047	0.1951	1.3047	1.1422
No log	3.7941	258	1.2547	0.1990	1.2547	1.1201
No log	3.8235	260	1.2906	0.2283	1.2906	1.1360
No log	3.8529	262	1.5012	0.1796	1.5012	1.2252
No log	3.8824	264	1.5777	0.0977	1.5777	1.2561
No log	3.9118	266	1.5229	0.1060	1.5229	1.2341
No log	3.9412	268	1.4725	0.0942	1.4725	1.2135
No log	3.9706	270	1.4538	0.1481	1.4538	1.2057
No log	4.0	272	1.4992	0.0942	1.4992	1.2244
No log	4.0294	274	1.4630	0.1060	1.4630	1.2095
No log	4.0588	276	1.4407	0.2065	1.4407	1.2003
No log	4.0882	278	1.4846	0.2069	1.4846	1.2184
No log	4.1176	280	1.5081	0.1667	1.5081	1.2280
No log	4.1471	282	1.4649	0.1663	1.4649	1.2103
No log	4.1765	284	1.3566	0.2027	1.3566	1.1647
No log	4.2059	286	1.3932	0.2445	1.3932	1.1803
No log	4.2353	288	1.2955	0.2031	1.2955	1.1382
No log	4.2647	290	1.2221	0.2118	1.2221	1.1055
No log	4.2941	292	1.1842	0.2315	1.1842	1.0882
No log	4.3235	294	1.3042	0.2333	1.3042	1.1420
No log	4.3529	296	1.4872	0.1305	1.4872	1.2195
No log	4.3824	298	1.4489	0.1943	1.4489	1.2037
No log	4.4118	300	1.2474	0.2361	1.2474	1.1169
No log	4.4412	302	1.1645	0.2060	1.1645	1.0791
No log	4.4706	304	1.2215	0.2832	1.2215	1.1052
No log	4.5	306	1.3627	0.3402	1.3627	1.1673
No log	4.5294	308	1.4932	0.2576	1.4932	1.2220
No log	4.5588	310	1.5157	0.2576	1.5157	1.2311
No log	4.5882	312	1.3306	0.2515	1.3306	1.1535
No log	4.6176	314	1.2543	0.2876	1.2543	1.1199
No log	4.6471	316	1.2638	0.2727	1.2638	1.1242
No log	4.6765	318	1.2885	0.2627	1.2885	1.1351
No log	4.7059	320	1.3141	0.2627	1.3141	1.1463
No log	4.7353	322	1.2107	0.2424	1.2107	1.1003
No log	4.7647	324	1.1930	0.2261	1.1930	1.0922
No log	4.7941	326	1.2497	0.2403	1.2497	1.1179
No log	4.8235	328	1.3154	0.2476	1.3154	1.1469
No log	4.8529	330	1.3205	0.2410	1.3205	1.1491
No log	4.8824	332	1.3997	0.2228	1.3997	1.1831
No log	4.9118	334	1.4471	0.2059	1.4471	1.2029
No log	4.9412	336	1.3439	0.2641	1.3439	1.1593
No log	4.9706	338	1.1903	0.2148	1.1903	1.0910
No log	5.0	340	1.1568	0.2616	1.1568	1.0755
No log	5.0294	342	1.1862	0.2446	1.1862	1.0891
No log	5.0588	344	1.3026	0.2324	1.3026	1.1413
No log	5.0882	346	1.3310	0.2424	1.3310	1.1537
No log	5.1176	348	1.3573	0.2240	1.3573	1.1650
No log	5.1471	350	1.3592	0.2240	1.3592	1.1658
No log	5.1765	352	1.2129	0.2605	1.2129	1.1013
No log	5.2059	354	1.1610	0.2555	1.1610	1.0775
No log	5.2353	356	1.2048	0.2366	1.2048	1.0976
No log	5.2647	358	1.3042	0.1725	1.3042	1.1420
No log	5.2941	360	1.3892	0.2359	1.3892	1.1786
No log	5.3235	362	1.3500	0.2268	1.3500	1.1619
No log	5.3529	364	1.2341	0.2353	1.2341	1.1109
No log	5.3824	366	1.2146	0.2555	1.2146	1.1021
No log	5.4118	368	1.2743	0.2605	1.2743	1.1288
No log	5.4412	370	1.4083	0.2024	1.4083	1.1867
No log	5.4706	372	1.4801	0.2024	1.4801	1.2166
No log	5.5	374	1.3984	0.2341	1.3984	1.1825
No log	5.5294	376	1.3351	0.1379	1.3351	1.1555
No log	5.5588	378	1.2448	0.2424	1.2448	1.1157
No log	5.5882	380	1.1928	0.2651	1.1928	1.0922
No log	5.6176	382	1.2452	0.2521	1.2452	1.1159
No log	5.6471	384	1.3104	0.2085	1.3104	1.1447
No log	5.6765	386	1.2863	0.2555	1.2863	1.1342
No log	5.7059	388	1.3133	0.1990	1.3133	1.1460
No log	5.7353	390	1.2929	0.2461	1.2929	1.1371
No log	5.7647	392	1.2217	0.2461	1.2217	1.1053
No log	5.7941	394	1.1540	0.2988	1.1540	1.0742
No log	5.8235	396	1.1385	0.2864	1.1385	1.0670
No log	5.8529	398	1.1895	0.3149	1.1895	1.0907
No log	5.8824	400	1.3111	0.3006	1.3111	1.1450
No log	5.9118	402	1.3231	0.3339	1.3231	1.1502
No log	5.9412	404	1.2598	0.3029	1.2598	1.1224
No log	5.9706	406	1.1789	0.3104	1.1789	1.0858
No log	6.0	408	1.2166	0.3104	1.2166	1.1030
No log	6.0294	410	1.3396	0.2780	1.3396	1.1574
No log	6.0588	412	1.3961	0.2201	1.3961	1.1816
No log	6.0882	414	1.2942	0.2473	1.2942	1.1376
No log	6.1176	416	1.2458	0.2891	1.2458	1.1161
No log	6.1471	418	1.2625	0.2891	1.2625	1.1236
No log	6.1765	420	1.3236	0.3008	1.3236	1.1505
No log	6.2059	422	1.4240	0.2564	1.4240	1.1933
No log	6.2353	424	1.3542	0.2788	1.3542	1.1637
No log	6.2647	426	1.2719	0.2699	1.2719	1.1278
No log	6.2941	428	1.2480	0.2699	1.2480	1.1171
No log	6.3235	430	1.2442	0.2699	1.2442	1.1154
No log	6.3529	432	1.3448	0.2660	1.3448	1.1597
No log	6.3824	434	1.4291	0.2321	1.4291	1.1954
No log	6.4118	436	1.4240	0.2025	1.4240	1.1933
No log	6.4412	438	1.4874	0.1649	1.4874	1.2196
No log	6.4706	440	1.4272	0.2110	1.4272	1.1947
No log	6.5	442	1.3358	0.2498	1.3358	1.1558
No log	6.5294	444	1.2417	0.2417	1.2417	1.1143
No log	6.5588	446	1.2300	0.2366	1.2300	1.1090
No log	6.5882	448	1.2304	0.2075	1.2304	1.1092
No log	6.6176	450	1.2866	0.2219	1.2866	1.1343
No log	6.6471	452	1.3066	0.2257	1.3066	1.1431
No log	6.6765	454	1.3588	0.2570	1.3588	1.1657
No log	6.7059	456	1.4770	0.3263	1.4770	1.2153
No log	6.7353	458	1.4669	0.3527	1.4669	1.2112
No log	6.7647	460	1.3584	0.3238	1.3584	1.1655
No log	6.7941	462	1.2809	0.2771	1.2809	1.1318
No log	6.8235	464	1.2476	0.2585	1.2476	1.1170
No log	6.8529	466	1.2883	0.3050	1.2883	1.1350
No log	6.8824	468	1.3722	0.2704	1.3722	1.1714
No log	6.9118	470	1.4200	0.2025	1.4200	1.1917
No log	6.9412	472	1.5925	0.2232	1.5925	1.2619
No log	6.9706	474	1.5877	0.2232	1.5877	1.2600
No log	7.0	476	1.4181	0.1942	1.4181	1.1909
No log	7.0294	478	1.2292	0.2984	1.2292	1.1087
No log	7.0588	480	1.1430	0.2276	1.1430	1.0691
No log	7.0882	482	1.1399	0.2505	1.1399	1.0676
No log	7.1176	484	1.1754	0.2276	1.1754	1.0842
No log	7.1471	486	1.2401	0.2768	1.2401	1.1136
No log	7.1765	488	1.4122	0.1585	1.4122	1.1883
No log	7.2059	490	1.5204	0.1324	1.5204	1.2330
No log	7.2353	492	1.4584	0.1585	1.4584	1.2076
No log	7.2647	494	1.3345	0.2333	1.3345	1.1552
No log	7.2941	496	1.2468	0.2796	1.2468	1.1166
No log	7.3235	498	1.2244	0.2461	1.2244	1.1065
0.398	7.3529	500	1.2437	0.2891	1.2437	1.1152
0.398	7.3824	502	1.3541	0.2191	1.3541	1.1637
0.398	7.4118	504	1.5225	0.1877	1.5225	1.2339
0.398	7.4412	506	1.5524	0.1877	1.5524	1.2460
0.398	7.4706	508	1.4260	0.1685	1.4260	1.1942
0.398	7.5	510	1.2452	0.3313	1.2452	1.1159
0.398	7.5294	512	1.1620	0.2521	1.1620	1.0780
0.398	7.5588	514	1.1577	0.2618	1.1577	1.0760
0.398	7.5882	516	1.2045	0.3033	1.2045	1.0975
0.398	7.6176	518	1.3150	0.2333	1.3150	1.1467
0.398	7.6471	520	1.4370	0.1685	1.4370	1.1987
0.398	7.6765	522	1.5593	0.1877	1.5593	1.2487
0.398	7.7059	524	1.6017	0.14	1.6017	1.2656
0.398	7.7353	526	1.6156	0.14	1.6156	1.2711

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1