ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3527
• Qwk: 0.1084
• Mse: 1.3527
• Rmse: 1.1631

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.5620	0.0010	4.5620	2.1359
No log	0.0909	4	2.8760	0.0235	2.8760	1.6959
No log	0.1364	6	2.0645	0.0198	2.0645	1.4368
No log	0.1818	8	2.1192	-0.0433	2.1192	1.4558
No log	0.2273	10	2.5792	-0.1247	2.5792	1.6060
No log	0.2727	12	2.0906	-0.1354	2.0906	1.4459
No log	0.3182	14	1.5435	-0.1392	1.5435	1.2424
No log	0.3636	16	1.6856	-0.1212	1.6856	1.2983
No log	0.4091	18	1.9029	-0.1503	1.9029	1.3795
No log	0.4545	20	2.6094	-0.0991	2.6094	1.6154
No log	0.5	22	2.7349	-0.0726	2.7349	1.6538
No log	0.5455	24	1.8667	0.0050	1.8667	1.3663
No log	0.5909	26	1.4976	-0.0318	1.4976	1.2238
No log	0.6364	28	1.4605	-0.0107	1.4605	1.2085
No log	0.6818	30	1.4657	0.0030	1.4657	1.2106
No log	0.7273	32	1.6795	0.0275	1.6795	1.2960
No log	0.7727	34	2.0555	0.0348	2.0555	1.4337
No log	0.8182	36	3.0790	-0.0192	3.0790	1.7547
No log	0.8636	38	3.3201	0.0189	3.3201	1.8221
No log	0.9091	40	2.6583	0.0332	2.6583	1.6304
No log	0.9545	42	1.8202	0.0622	1.8202	1.3491
No log	1.0	44	1.4514	0.0714	1.4514	1.2047
No log	1.0455	46	1.4239	0.0714	1.4239	1.1933
No log	1.0909	48	1.4575	0.0987	1.4575	1.2073
No log	1.1364	50	1.3535	0.1959	1.3535	1.1634
No log	1.1818	52	1.3620	0.1959	1.3620	1.1670
No log	1.2273	54	1.4367	0.1196	1.4367	1.1986
No log	1.2727	56	1.7239	0.0426	1.7239	1.3130
No log	1.3182	58	1.6580	0.1457	1.6580	1.2876
No log	1.3636	60	1.3529	0.0704	1.3529	1.1631
No log	1.4091	62	1.2723	0.1388	1.2723	1.1280
No log	1.4545	64	1.2538	0.1772	1.2538	1.1197
No log	1.5	66	1.3048	0.2005	1.3048	1.1423
No log	1.5455	68	1.5810	0.0732	1.5810	1.2574
No log	1.5909	70	1.7870	0.0679	1.7870	1.3368
No log	1.6364	72	1.5980	0.0792	1.5980	1.2641
No log	1.6818	74	1.4224	0.1315	1.4224	1.1927
No log	1.7273	76	1.5190	0.0732	1.5190	1.2325
No log	1.7727	78	1.6550	0.0385	1.6550	1.2865
No log	1.8182	80	1.8430	0.0237	1.8430	1.3576
No log	1.8636	82	1.6908	0.0493	1.6908	1.3003
No log	1.9091	84	1.4819	0.1371	1.4819	1.2174
No log	1.9545	86	1.3462	0.2233	1.3462	1.1603
No log	2.0	88	1.3961	0.2232	1.3961	1.1816
No log	2.0455	90	1.8154	0.0385	1.8154	1.3474
No log	2.0909	92	2.0392	0.0861	2.0392	1.4280
No log	2.1364	94	1.7499	0.1025	1.7499	1.3228
No log	2.1818	96	1.3952	0.1525	1.3952	1.1812
No log	2.2273	98	1.3095	0.1687	1.3095	1.1444
No log	2.2727	100	1.3792	0.1562	1.3792	1.1744
No log	2.3182	102	1.7569	0.0810	1.7569	1.3255
No log	2.3636	104	2.0254	0.1093	2.0254	1.4232
No log	2.4091	106	2.1409	0.1350	2.1409	1.4632
No log	2.4545	108	1.8259	0.0694	1.8259	1.3512
No log	2.5	110	1.4566	0.1021	1.4566	1.2069
No log	2.5455	112	1.2429	0.0955	1.2429	1.1148
No log	2.5909	114	1.1953	0.1688	1.1953	1.0933
No log	2.6364	116	1.2065	0.2234	1.2065	1.0984
No log	2.6818	118	1.2974	0.0984	1.2974	1.1390
No log	2.7273	120	1.4496	0.1315	1.4496	1.2040
No log	2.7727	122	1.6514	0.1171	1.6514	1.2851
No log	2.8182	124	1.7512	0.0612	1.7512	1.3233
No log	2.8636	126	1.7930	0.0445	1.7930	1.3390
No log	2.9091	128	1.7854	0.0445	1.7854	1.3362
No log	2.9545	130	1.8762	0.0176	1.8762	1.3697
No log	3.0	132	2.0980	0.1057	2.0980	1.4484
No log	3.0455	134	2.1279	0.1454	2.1279	1.4587
No log	3.0909	136	2.1581	0.1057	2.1581	1.4691
No log	3.1364	138	1.8469	0.1136	1.8469	1.3590
No log	3.1818	140	1.6925	0.0669	1.6925	1.3010
No log	3.2273	142	1.4872	0.0903	1.4872	1.2195
No log	3.2727	144	1.4911	0.0985	1.4911	1.2211
No log	3.3182	146	1.5233	0.1479	1.5233	1.2342
No log	3.3636	148	1.6634	0.1663	1.6634	1.2897
No log	3.4091	150	1.7479	0.1010	1.7479	1.3221
No log	3.4545	152	1.7349	0.0712	1.7349	1.3172
No log	3.5	154	1.5996	0.1416	1.5996	1.2647
No log	3.5455	156	1.4828	0.0306	1.4828	1.2177
No log	3.5909	158	1.5171	0.0655	1.5171	1.2317
No log	3.6364	160	1.7019	0.0392	1.7019	1.3046
No log	3.6818	162	1.8849	0.0487	1.8849	1.3729
No log	3.7273	164	1.7788	0.0782	1.7788	1.3337
No log	3.7727	166	1.5682	0.1785	1.5682	1.2523
No log	3.8182	168	1.5870	0.1698	1.5870	1.2598
No log	3.8636	170	1.8079	0.1386	1.8079	1.3446
No log	3.9091	172	1.6877	0.2002	1.6877	1.2991
No log	3.9545	174	1.4894	0.1466	1.4894	1.2204
No log	4.0	176	1.2969	0.1595	1.2969	1.1388
No log	4.0455	178	1.2402	0.1714	1.2402	1.1136
No log	4.0909	180	1.2556	0.1829	1.2556	1.1205
No log	4.1364	182	1.3525	0.1815	1.3525	1.1630
No log	4.1818	184	1.4936	0.1487	1.4936	1.2221
No log	4.2273	186	1.4599	0.1631	1.4599	1.2082
No log	4.2727	188	1.3262	0.1295	1.3262	1.1516
No log	4.3182	190	1.3353	0.2747	1.3353	1.1555
No log	4.3636	192	1.3243	0.2520	1.3243	1.1508
No log	4.4091	194	1.2757	0.2062	1.2757	1.1295
No log	4.4545	196	1.3657	0.1815	1.3658	1.1687
No log	4.5	198	1.7331	0.2158	1.7331	1.3165
No log	4.5455	200	1.7330	0.1899	1.7330	1.3164
No log	4.5909	202	1.5040	0.1447	1.5040	1.2264
No log	4.6364	204	1.4007	0.1652	1.4007	1.1835
No log	4.6818	206	1.3048	0.2283	1.3048	1.1423
No log	4.7273	208	1.2420	0.2169	1.2420	1.1145
No log	4.7727	210	1.2930	0.2529	1.2930	1.1371
No log	4.8182	212	1.3923	0.2255	1.3923	1.1800
No log	4.8636	214	1.4642	0.1594	1.4642	1.2101
No log	4.9091	216	1.4526	0.1674	1.4526	1.2053
No log	4.9545	218	1.3465	0.1663	1.3465	1.1604
No log	5.0	220	1.2695	0.2056	1.2695	1.1267
No log	5.0455	222	1.2933	0.2389	1.2933	1.1372
No log	5.0909	224	1.4552	0.1515	1.4552	1.2063
No log	5.1364	226	1.5286	0.1519	1.5286	1.2364
No log	5.1818	228	1.3393	0.2044	1.3393	1.1573
No log	5.2273	230	1.2326	0.3077	1.2326	1.1102
No log	5.2727	232	1.1806	0.3386	1.1806	1.0866
No log	5.3182	234	1.1551	0.2942	1.1551	1.0748
No log	5.3636	236	1.2178	0.2964	1.2178	1.1035
No log	5.4091	238	1.3193	0.2483	1.3193	1.1486
No log	5.4545	240	1.2878	0.1970	1.2878	1.1348
No log	5.5	242	1.2224	0.2431	1.2224	1.1056
No log	5.5455	244	1.2065	0.2945	1.2065	1.0984
No log	5.5909	246	1.1467	0.3297	1.1467	1.0709
No log	5.6364	248	1.1269	0.3933	1.1269	1.0616
No log	5.6818	250	1.1379	0.4110	1.1379	1.0667
No log	5.7273	252	1.1534	0.4057	1.1534	1.0740
No log	5.7727	254	1.1782	0.3838	1.1782	1.0854
No log	5.8182	256	1.1830	0.3198	1.1830	1.0877
No log	5.8636	258	1.1604	0.2796	1.1604	1.0772
No log	5.9091	260	1.1377	0.3476	1.1377	1.0666
No log	5.9545	262	1.1282	0.3511	1.1282	1.0622
No log	6.0	264	1.1593	0.3661	1.1593	1.0767
No log	6.0455	266	1.2011	0.3882	1.2011	1.0959
No log	6.0909	268	1.2383	0.2869	1.2383	1.1128
No log	6.1364	270	1.3698	0.2125	1.3698	1.1704
No log	6.1818	272	1.3753	0.2171	1.3753	1.1727
No log	6.2273	274	1.4619	0.1896	1.4619	1.2091
No log	6.2727	276	1.4583	0.1981	1.4583	1.2076
No log	6.3182	278	1.3944	0.2134	1.3944	1.1808
No log	6.3636	280	1.2746	0.2120	1.2746	1.1290
No log	6.4091	282	1.2442	0.2786	1.2442	1.1154
No log	6.4545	284	1.2849	0.2391	1.2849	1.1335
No log	6.5	286	1.4187	0.1975	1.4187	1.1911
No log	6.5455	288	1.4195	0.2306	1.4195	1.1914
No log	6.5909	290	1.2613	0.2431	1.2613	1.1231
No log	6.6364	292	1.1728	0.2604	1.1728	1.0830
No log	6.6818	294	1.1699	0.2424	1.1699	1.0816
No log	6.7273	296	1.1764	0.2721	1.1764	1.0846
No log	6.7727	298	1.1841	0.3080	1.1841	1.0882
No log	6.8182	300	1.2231	0.2019	1.2231	1.1059
No log	6.8636	302	1.2394	0.2019	1.2394	1.1133
No log	6.9091	304	1.2557	0.2019	1.2557	1.1206
No log	6.9545	306	1.2623	0.1878	1.2623	1.1235
No log	7.0	308	1.2560	0.2445	1.2560	1.1207
No log	7.0455	310	1.2474	0.1565	1.2474	1.1169
No log	7.0909	312	1.2381	0.1951	1.2381	1.1127
No log	7.1364	314	1.2347	0.1951	1.2347	1.1112
No log	7.1818	316	1.2398	0.1355	1.2398	1.1135
No log	7.2273	318	1.2719	0.2151	1.2719	1.1278
No log	7.2727	320	1.3696	0.1737	1.3696	1.1703
No log	7.3182	322	1.4316	0.2328	1.4316	1.1965
No log	7.3636	324	1.3856	0.2274	1.3856	1.1771
No log	7.4091	326	1.2791	0.2281	1.2791	1.1310
No log	7.4545	328	1.2341	0.2386	1.2341	1.1109
No log	7.5	330	1.1909	0.2857	1.1909	1.0913
No log	7.5455	332	1.1741	0.2857	1.1741	1.0835
No log	7.5909	334	1.1662	0.3180	1.1662	1.0799
No log	7.6364	336	1.2118	0.2450	1.2118	1.1008
No log	7.6818	338	1.2069	0.2839	1.2069	1.0986
No log	7.7273	340	1.1887	0.2857	1.1887	1.0903
No log	7.7727	342	1.1910	0.2923	1.1910	1.0913
No log	7.8182	344	1.1601	0.2424	1.1601	1.0771
No log	7.8636	346	1.1773	0.3363	1.1773	1.0850
No log	7.9091	348	1.2546	0.2596	1.2546	1.1201
No log	7.9545	350	1.2698	0.2944	1.2698	1.1269
No log	8.0	352	1.2304	0.3123	1.2304	1.1093
No log	8.0455	354	1.1987	0.2969	1.1987	1.0949
No log	8.0909	356	1.2151	0.2969	1.2151	1.1023
No log	8.1364	358	1.2537	0.2009	1.2537	1.1197
No log	8.1818	360	1.3068	0.2378	1.3068	1.1432
No log	8.2273	362	1.3849	0.2217	1.3849	1.1768
No log	8.2727	364	1.3129	0.2445	1.3129	1.1458
No log	8.3182	366	1.2338	0.2344	1.2338	1.1108
No log	8.3636	368	1.2128	0.2679	1.2128	1.1013
No log	8.4091	370	1.2091	0.3039	1.2091	1.0996
No log	8.4545	372	1.2242	0.2679	1.2242	1.1064
No log	8.5	374	1.3218	0.2281	1.3218	1.1497
No log	8.5455	376	1.4720	0.2760	1.4720	1.2133
No log	8.5909	378	1.5198	0.3041	1.5198	1.2328
No log	8.6364	380	1.4070	0.2857	1.4070	1.1862
No log	8.6818	382	1.3528	0.2667	1.3528	1.1631
No log	8.7273	384	1.3139	0.2259	1.3139	1.1463
No log	8.7727	386	1.2522	0.3536	1.2522	1.1190
No log	8.8182	388	1.2251	0.4093	1.2251	1.1068
No log	8.8636	390	1.1836	0.3062	1.1836	1.0879
No log	8.9091	392	1.1858	0.2306	1.1858	1.0889
No log	8.9545	394	1.3469	0.2136	1.3469	1.1605
No log	9.0	396	1.5830	0.2111	1.5830	1.2582
No log	9.0455	398	1.6182	0.2290	1.6182	1.2721
No log	9.0909	400	1.4276	0.2181	1.4276	1.1948
No log	9.1364	402	1.2283	0.2608	1.2283	1.1083
No log	9.1818	404	1.1611	0.2424	1.1611	1.0776
No log	9.2273	406	1.1435	0.2424	1.1435	1.0693
No log	9.2727	408	1.1507	0.2424	1.1507	1.0727
No log	9.3182	410	1.1836	0.2424	1.1836	1.0879
No log	9.3636	412	1.2216	0.1769	1.2216	1.1053
No log	9.4091	414	1.2888	0.1833	1.2888	1.1353
No log	9.4545	416	1.4588	0.2292	1.4588	1.2078
No log	9.5	418	1.6481	0.1297	1.6481	1.2838
No log	9.5455	420	1.6161	0.1392	1.6161	1.2712
No log	9.5909	422	1.4536	0.2047	1.4536	1.2057
No log	9.6364	424	1.3111	0.1972	1.3111	1.1450
No log	9.6818	426	1.2551	0.1586	1.2551	1.1203
No log	9.7273	428	1.2374	0.1822	1.2374	1.1124
No log	9.7727	430	1.2632	0.2315	1.2632	1.1239
No log	9.8182	432	1.2668	0.2221	1.2668	1.1255
No log	9.8636	434	1.3185	0.1686	1.3185	1.1483
No log	9.9091	436	1.2732	0.2138	1.2732	1.1284
No log	9.9545	438	1.1951	0.2315	1.1951	1.0932
No log	10.0	440	1.1569	0.2021	1.1569	1.0756
No log	10.0455	442	1.1466	0.2012	1.1466	1.0708
No log	10.0909	444	1.1543	0.2012	1.1543	1.0744
No log	10.1364	446	1.1687	0.2012	1.1687	1.0811
No log	10.1818	448	1.1978	0.2263	1.1978	1.0944
No log	10.2273	450	1.2242	0.2118	1.2242	1.1064
No log	10.2727	452	1.2006	0.1873	1.2006	1.0957
No log	10.3182	454	1.1663	0.2012	1.1663	1.0800
No log	10.3636	456	1.1453	0.2012	1.1453	1.0702
No log	10.4091	458	1.1418	0.2534	1.1418	1.0686
No log	10.4545	460	1.1506	0.2803	1.1506	1.0727
No log	10.5	462	1.1652	0.2803	1.1652	1.0795
No log	10.5455	464	1.1917	0.1822	1.1917	1.0916
No log	10.5909	466	1.2103	0.1966	1.2103	1.1001
No log	10.6364	468	1.2376	0.2555	1.2376	1.1125
No log	10.6818	470	1.2408	0.2276	1.2408	1.1139
No log	10.7273	472	1.2317	0.2276	1.2317	1.1098
No log	10.7727	474	1.2133	0.2276	1.2133	1.1015
No log	10.8182	476	1.1653	0.1873	1.1653	1.0795
No log	10.8636	478	1.1481	0.2775	1.1481	1.0715
No log	10.9091	480	1.1863	0.3017	1.1863	1.0892
No log	10.9545	482	1.2472	0.2138	1.2472	1.1168
No log	11.0	484	1.3611	0.2764	1.3611	1.1667
No log	11.0455	486	1.4076	0.2683	1.4076	1.1864
No log	11.0909	488	1.3872	0.2356	1.3872	1.1778
No log	11.1364	490	1.3007	0.2225	1.3007	1.1405
No log	11.1818	492	1.2419	0.2239	1.2419	1.1144
No log	11.2273	494	1.1940	0.2052	1.1940	1.0927
No log	11.2727	496	1.1848	0.2105	1.1848	1.0885
No log	11.3182	498	1.2402	0.1779	1.2402	1.1137
0.3788	11.3636	500	1.3730	0.2134	1.3730	1.1718
0.3788	11.4091	502	1.4033	0.1840	1.4033	1.1846
0.3788	11.4545	504	1.3662	0.2134	1.3662	1.1688
0.3788	11.5	506	1.2919	0.2348	1.2919	1.1366
0.3788	11.5455	508	1.2677	0.2327	1.2677	1.1259
0.3788	11.5909	510	1.2606	0.2047	1.2606	1.1227
0.3788	11.6364	512	1.2672	0.2368	1.2672	1.1257
0.3788	11.6818	514	1.2886	0.1966	1.2886	1.1351
0.3788	11.7273	516	1.3584	0.2268	1.3584	1.1655
0.3788	11.7727	518	1.4114	0.1628	1.4114	1.1880
0.3788	11.8182	520	1.3603	0.2044	1.3603	1.1663
0.3788	11.8636	522	1.2927	0.2315	1.2927	1.1370
0.3788	11.9091	524	1.2671	0.1966	1.2671	1.1257
0.3788	11.9545	526	1.2859	0.1498	1.2859	1.1340
0.3788	12.0	528	1.3180	0.2768	1.3180	1.1480
0.3788	12.0455	530	1.3648	0.1781	1.3648	1.1682
0.3788	12.0909	532	1.3415	0.2070	1.3415	1.1582
0.3788	12.1364	534	1.2942	0.2725	1.2942	1.1376
0.3788	12.1818	536	1.2418	0.2148	1.2418	1.1144
0.3788	12.2273	538	1.2221	0.2431	1.2221	1.1055
0.3788	12.2727	540	1.1989	0.2158	1.1989	1.0949
0.3788	12.3182	542	1.2159	0.2158	1.2159	1.1027
0.3788	12.3636	544	1.2391	0.2480	1.2391	1.1132
0.3788	12.4091	546	1.2638	0.2650	1.2638	1.1242
0.3788	12.4545	548	1.2285	0.2740	1.2285	1.1084
0.3788	12.5	550	1.1972	0.2898	1.1972	1.0942
0.3788	12.5455	552	1.2153	0.2067	1.2153	1.1024
0.3788	12.5909	554	1.2080	0.2431	1.2080	1.0991
0.3788	12.6364	556	1.1836	0.2518	1.1836	1.0879
0.3788	12.6818	558	1.1814	0.3130	1.1814	1.0869
0.3788	12.7273	560	1.2313	0.2501	1.2313	1.1096
0.3788	12.7727	562	1.2312	0.2417	1.2312	1.1096
0.3788	12.8182	564	1.2284	0.2417	1.2284	1.1084
0.3788	12.8636	566	1.2453	0.2501	1.2453	1.1159
0.3788	12.9091	568	1.2641	0.2611	1.2641	1.1243
0.3788	12.9545	570	1.2934	0.2404	1.2934	1.1373
0.3788	13.0	572	1.3029	0.2339	1.3029	1.1415
0.3788	13.0455	574	1.2574	0.2650	1.2574	1.1214
0.3788	13.0909	576	1.2309	0.2541	1.2309	1.1095
0.3788	13.1364	578	1.2466	0.2511	1.2466	1.1165
0.3788	13.1818	580	1.2349	0.1892	1.2349	1.1113
0.3788	13.2273	582	1.2108	0.2135	1.2108	1.1004
0.3788	13.2727	584	1.1914	0.2518	1.1914	1.0915
0.3788	13.3182	586	1.1898	0.2898	1.1898	1.0908
0.3788	13.3636	588	1.1991	0.2474	1.1991	1.0951
0.3788	13.4091	590	1.2121	0.2604	1.2121	1.1010
0.3788	13.4545	592	1.2407	0.2650	1.2407	1.1139
0.3788	13.5	594	1.3034	0.2308	1.3034	1.1417
0.3788	13.5455	596	1.3640	0.2699	1.3640	1.1679
0.3788	13.5909	598	1.3620	0.2699	1.3620	1.1670
0.3788	13.6364	600	1.2880	0.2839	1.2880	1.1349
0.3788	13.6818	602	1.2473	0.3296	1.2473	1.1168
0.3788	13.7273	604	1.2363	0.3186	1.2363	1.1119
0.3788	13.7727	606	1.2251	0.3186	1.2251	1.1068
0.3788	13.8182	608	1.2062	0.2568	1.2062	1.0983
0.3788	13.8636	610	1.1830	0.1603	1.1830	1.0877
0.3788	13.9091	612	1.1523	0.2188	1.1523	1.0734
0.3788	13.9545	614	1.1414	0.3159	1.1414	1.0684
0.3788	14.0	616	1.1772	0.3154	1.1772	1.0850
0.3788	14.0455	618	1.2772	0.1950	1.2772	1.1301
0.3788	14.0909	620	1.3288	0.1612	1.3288	1.1527
0.3788	14.1364	622	1.3798	0.1709	1.3798	1.1746
0.3788	14.1818	624	1.4017	0.1674	1.4017	1.1839
0.3788	14.2273	626	1.3310	0.2159	1.3310	1.1537
0.3788	14.2727	628	1.2986	0.2452	1.2986	1.1396
0.3788	14.3182	630	1.3098	0.1840	1.3098	1.1445
0.3788	14.3636	632	1.3136	0.1563	1.3136	1.1461
0.3788	14.4091	634	1.3226	0.1214	1.3226	1.1500
0.3788	14.4545	636	1.3801	0.2472	1.3801	1.1748
0.3788	14.5	638	1.4681	0.1151	1.4681	1.2117
0.3788	14.5455	640	1.4755	0.1515	1.4755	1.2147
0.3788	14.5909	642	1.4541	0.1416	1.4541	1.2059
0.3788	14.6364	644	1.3942	0.1143	1.3942	1.1808
0.3788	14.6818	646	1.3527	0.1084	1.3527	1.1631

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1