ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k18_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2581
• Qwk: 0.2361
• Mse: 1.2581
• Rmse: 1.1216

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0225	2	4.7685	0.0010	4.7685	2.1837
No log	0.0449	4	2.9570	-0.0104	2.9570	1.7196
No log	0.0674	6	2.2763	-0.0173	2.2763	1.5087
No log	0.0899	8	1.8019	-0.0303	1.8019	1.3424
No log	0.1124	10	1.7095	-0.0483	1.7095	1.3075
No log	0.1348	12	1.3839	0.0201	1.3839	1.1764
No log	0.1573	14	1.3220	0.1468	1.3220	1.1498
No log	0.1798	16	1.6675	0.0221	1.6675	1.2913
No log	0.2022	18	2.8789	0.0	2.8789	1.6967
No log	0.2247	20	2.5475	-0.0229	2.5475	1.5961
No log	0.2472	22	1.6736	0.1224	1.6736	1.2937
No log	0.2697	24	1.3763	0.1080	1.3763	1.1732
No log	0.2921	26	1.4829	0.1675	1.4829	1.2178
No log	0.3146	28	1.7750	0.1366	1.7750	1.3323
No log	0.3371	30	1.8361	0.1270	1.8361	1.3550
No log	0.3596	32	2.1083	0.0160	2.1083	1.4520
No log	0.3820	34	2.5540	0.0815	2.5540	1.5981
No log	0.4045	36	2.1941	0.0938	2.1941	1.4812
No log	0.4270	38	1.6575	0.1117	1.6575	1.2874
No log	0.4494	40	1.2124	0.1966	1.2124	1.1011
No log	0.4719	42	1.1136	0.2764	1.1136	1.0553
No log	0.4944	44	1.1118	0.2424	1.1118	1.0544
No log	0.5169	46	1.1185	0.2455	1.1185	1.0576
No log	0.5393	48	1.1197	0.2579	1.1197	1.0582
No log	0.5618	50	1.2381	0.1196	1.2381	1.1127
No log	0.5843	52	1.3323	0.2071	1.3323	1.1543
No log	0.6067	54	1.5276	0.1483	1.5276	1.2360
No log	0.6292	56	1.7129	0.0227	1.7129	1.3088
No log	0.6517	58	1.6936	0.0	1.6936	1.3014
No log	0.6742	60	1.4421	0.2071	1.4421	1.2009
No log	0.6966	62	1.3190	0.1492	1.3190	1.1485
No log	0.7191	64	1.3490	0.1779	1.3490	1.1615
No log	0.7416	66	1.4518	0.2062	1.4518	1.2049
No log	0.7640	68	1.6730	0.2302	1.6730	1.2934
No log	0.7865	70	2.0362	0.2029	2.0362	1.4270
No log	0.8090	72	1.9955	0.1899	1.9955	1.4126
No log	0.8315	74	1.6108	0.2666	1.6108	1.2692
No log	0.8539	76	1.1720	0.2577	1.1720	1.0826
No log	0.8764	78	1.0506	0.2914	1.0506	1.0250
No log	0.8989	80	1.0649	0.2815	1.0649	1.0319
No log	0.9213	82	1.1044	0.2467	1.1044	1.0509
No log	0.9438	84	1.2002	0.2597	1.2002	1.0955
No log	0.9663	86	1.2497	0.3004	1.2497	1.1179
No log	0.9888	88	1.4460	0.3087	1.4460	1.2025
No log	1.0112	90	1.3639	0.3229	1.3639	1.1679
No log	1.0337	92	1.2373	0.3446	1.2373	1.1123
No log	1.0562	94	1.2725	0.3719	1.2725	1.1280
No log	1.0787	96	1.2968	0.2863	1.2968	1.1388
No log	1.1011	98	1.3106	0.2863	1.3106	1.1448
No log	1.1236	100	1.2258	0.3144	1.2258	1.1072
No log	1.1461	102	1.2889	0.3092	1.2889	1.1353
No log	1.1685	104	1.3243	0.3152	1.3243	1.1508
No log	1.1910	106	1.2231	0.3850	1.2231	1.1060
No log	1.2135	108	1.2365	0.3761	1.2365	1.1120
No log	1.2360	110	1.1828	0.3516	1.1828	1.0876
No log	1.2584	112	1.1568	0.3037	1.1568	1.0756
No log	1.2809	114	1.1920	0.3190	1.1920	1.0918
No log	1.3034	116	1.2357	0.3355	1.2357	1.1116
No log	1.3258	118	1.2876	0.3255	1.2876	1.1347
No log	1.3483	120	1.3199	0.3007	1.3199	1.1489
No log	1.3708	122	1.3482	0.2940	1.3482	1.1611
No log	1.3933	124	1.4225	0.2181	1.4225	1.1927
No log	1.4157	126	1.5494	0.2138	1.5494	1.2447
No log	1.4382	128	1.6071	0.2215	1.6071	1.2677
No log	1.4607	130	1.4510	0.2059	1.4510	1.2046
No log	1.4831	132	1.4793	0.1981	1.4793	1.2163
No log	1.5056	134	1.3069	0.2644	1.3069	1.1432
No log	1.5281	136	1.3909	0.2059	1.3909	1.1794
No log	1.5506	138	1.2596	0.2881	1.2596	1.1223
No log	1.5730	140	1.1592	0.2581	1.1592	1.0767
No log	1.5955	142	1.1667	0.3176	1.1667	1.0801
No log	1.6180	144	1.4135	0.2292	1.4135	1.1889
No log	1.6404	146	1.6854	0.3029	1.6854	1.2982
No log	1.6629	148	1.5861	0.2338	1.5861	1.2594
No log	1.6854	150	1.2668	0.2304	1.2668	1.1255
No log	1.7079	152	1.1742	0.2604	1.1742	1.0836
No log	1.7303	154	1.2206	0.2198	1.2206	1.1048
No log	1.7528	156	1.3720	0.1709	1.3720	1.1713
No log	1.7753	158	1.6803	0.1888	1.6803	1.2963
No log	1.7978	160	1.6342	0.1565	1.6342	1.2783
No log	1.8202	162	1.4110	0.2989	1.4110	1.1878
No log	1.8427	164	1.3090	0.3313	1.3090	1.1441
No log	1.8652	166	1.3075	0.2507	1.3075	1.1435
No log	1.8876	168	1.3869	0.2331	1.3869	1.1777
No log	1.9101	170	1.4971	0.2163	1.4971	1.2236
No log	1.9326	172	1.3622	0.2259	1.3622	1.1672
No log	1.9551	174	1.2267	0.1709	1.2267	1.1076
No log	1.9775	176	1.1856	0.1786	1.1856	1.0889
No log	2.0	178	1.2249	0.1530	1.2249	1.1068
No log	2.0225	180	1.3198	0.2452	1.3198	1.1488
No log	2.0449	182	1.5359	0.1935	1.5359	1.2393
No log	2.0674	184	1.7390	0.1814	1.7390	1.3187
No log	2.0899	186	1.6026	0.2105	1.6026	1.2659
No log	2.1124	188	1.3299	0.1984	1.3299	1.1532
No log	2.1348	190	1.2681	0.2457	1.2681	1.1261
No log	2.1573	192	1.3265	0.3039	1.3265	1.1517
No log	2.1798	194	1.2898	0.2743	1.2898	1.1357
No log	2.2022	196	1.3474	0.3010	1.3474	1.1608
No log	2.2247	198	1.8121	0.2109	1.8121	1.3461
No log	2.2472	200	2.1306	0.1513	2.1306	1.4597
No log	2.2697	202	1.9845	0.2141	1.9845	1.4087
No log	2.2921	204	1.5650	0.2173	1.5650	1.2510
No log	2.3146	206	1.3324	0.2569	1.3324	1.1543
No log	2.3371	208	1.2596	0.3154	1.2596	1.1223
No log	2.3596	210	1.2133	0.2877	1.2133	1.1015
No log	2.3820	212	1.2266	0.2777	1.2266	1.1075
No log	2.4045	214	1.2871	0.1964	1.2871	1.1345
No log	2.4270	216	1.2660	0.1997	1.2660	1.1252
No log	2.4494	218	1.2517	0.3508	1.2517	1.1188
No log	2.4719	220	1.2434	0.2821	1.2434	1.1151
No log	2.4944	222	1.1935	0.2550	1.1935	1.0925
No log	2.5169	224	1.1320	0.3395	1.1320	1.0640
No log	2.5393	226	1.1237	0.3826	1.1237	1.0601
No log	2.5618	228	1.1469	0.3681	1.1469	1.0710
No log	2.5843	230	1.2358	0.2851	1.2358	1.1116
No log	2.6067	232	1.3516	0.2735	1.3516	1.1626
No log	2.6292	234	1.3415	0.3164	1.3415	1.1582
No log	2.6517	236	1.2388	0.3397	1.2388	1.1130
No log	2.6742	238	1.2026	0.3377	1.2026	1.0966
No log	2.6966	240	1.2100	0.2512	1.2100	1.1000
No log	2.7191	242	1.1967	0.1912	1.1967	1.0939
No log	2.7416	244	1.1887	0.2306	1.1887	1.0903
No log	2.7640	246	1.1986	0.2071	1.1986	1.0948
No log	2.7865	248	1.2297	0.2276	1.2297	1.1089
No log	2.8090	250	1.2485	0.2026	1.2485	1.1173
No log	2.8315	252	1.2674	0.2405	1.2674	1.1258
No log	2.8539	254	1.3140	0.2581	1.3140	1.1463
No log	2.8764	256	1.3673	0.2268	1.3673	1.1693
No log	2.8989	258	1.3161	0.3138	1.3161	1.1472
No log	2.9213	260	1.3446	0.3018	1.3446	1.1596
No log	2.9438	262	1.3590	0.2754	1.3590	1.1658
No log	2.9663	264	1.3131	0.3121	1.3131	1.1459
No log	2.9888	266	1.2824	0.2385	1.2824	1.1324
No log	3.0112	268	1.3115	0.2075	1.3115	1.1452
No log	3.0337	270	1.3180	0.1889	1.3180	1.1480
No log	3.0562	272	1.2423	0.2210	1.2423	1.1146
No log	3.0787	274	1.2108	0.0760	1.2108	1.1004
No log	3.1011	276	1.2261	0.1769	1.2261	1.1073
No log	3.1236	278	1.2135	0.1825	1.2135	1.1016
No log	3.1461	280	1.2414	0.2198	1.2414	1.1142
No log	3.1685	282	1.4199	0.2207	1.4199	1.1916
No log	3.1910	284	1.4553	0.2207	1.4553	1.2064
No log	3.2135	286	1.3489	0.2161	1.3489	1.1614
No log	3.2360	288	1.2468	0.2821	1.2468	1.1166
No log	3.2584	290	1.2631	0.2208	1.2631	1.1239
No log	3.2809	292	1.3222	0.2478	1.3222	1.1499
No log	3.3034	294	1.3252	0.2593	1.3252	1.1512
No log	3.3258	296	1.2622	0.2120	1.2622	1.1235
No log	3.3483	298	1.1971	0.2402	1.1971	1.0941
No log	3.3708	300	1.1935	0.1886	1.1935	1.0925
No log	3.3933	302	1.2076	0.2823	1.2076	1.0989
No log	3.4157	304	1.2505	0.1891	1.2505	1.1182
No log	3.4382	306	1.3467	0.2339	1.3467	1.1605
No log	3.4607	308	1.4056	0.2347	1.4056	1.1856
No log	3.4831	310	1.3611	0.1957	1.3611	1.1667
No log	3.5056	312	1.2637	0.2452	1.2637	1.1242
No log	3.5281	314	1.1992	0.1928	1.1992	1.0951
No log	3.5506	316	1.1888	0.2492	1.1888	1.0903
No log	3.5730	318	1.1943	0.2199	1.1943	1.0928
No log	3.5955	320	1.2054	0.2103	1.2054	1.0979
No log	3.6180	322	1.2121	0.2380	1.2121	1.1010
No log	3.6404	324	1.2255	0.1023	1.2255	1.1070
No log	3.6629	326	1.2498	0.2018	1.2498	1.1179
No log	3.6854	328	1.3100	0.2078	1.3100	1.1445
No log	3.7079	330	1.3679	0.2081	1.3679	1.1696
No log	3.7303	332	1.3109	0.1520	1.3109	1.1449
No log	3.7528	334	1.2787	0.1831	1.2787	1.1308
No log	3.7753	336	1.2784	0.1921	1.2784	1.1307
No log	3.7978	338	1.2779	0.1606	1.2779	1.1304
No log	3.8202	340	1.2889	0.2022	1.2889	1.1353
No log	3.8427	342	1.2390	0.2018	1.2390	1.1131
No log	3.8652	344	1.2129	0.2188	1.2129	1.1013
No log	3.8876	346	1.2343	0.2188	1.2343	1.1110
No log	3.9101	348	1.3914	0.2277	1.3914	1.1796
No log	3.9326	350	1.5776	0.1896	1.5776	1.2560
No log	3.9551	352	1.5317	0.1896	1.5317	1.2376
No log	3.9775	354	1.2770	0.1849	1.2770	1.1301
No log	4.0	356	1.1800	0.3328	1.1800	1.0863
No log	4.0225	358	1.1530	0.3261	1.1530	1.0738
No log	4.0449	360	1.1308	0.2103	1.1308	1.0634
No log	4.0674	362	1.1537	0.2035	1.1537	1.0741
No log	4.0899	364	1.1801	0.2283	1.1801	1.0863
No log	4.1124	366	1.1356	0.2824	1.1356	1.0656
No log	4.1348	368	1.1203	0.3171	1.1203	1.0584
No log	4.1573	370	1.1210	0.3014	1.1210	1.0588
No log	4.1798	372	1.1322	0.3076	1.1322	1.0640
No log	4.2022	374	1.1430	0.3076	1.1430	1.0691
No log	4.2247	376	1.1948	0.2845	1.1948	1.0931
No log	4.2472	378	1.2460	0.2797	1.2460	1.1162
No log	4.2697	380	1.2071	0.2120	1.2071	1.0987
No log	4.2921	382	1.1502	0.3143	1.1502	1.0725
No log	4.3146	384	1.1361	0.3369	1.1361	1.0659
No log	4.3371	386	1.1429	0.3361	1.1429	1.0691
No log	4.3596	388	1.1372	0.3139	1.1372	1.0664
No log	4.3820	390	1.1389	0.2925	1.1389	1.0672
No log	4.4045	392	1.1529	0.2718	1.1529	1.0737
No log	4.4270	394	1.1495	0.2663	1.1495	1.0722
No log	4.4494	396	1.2246	0.2308	1.2246	1.1066
No log	4.4719	398	1.2516	0.2035	1.2516	1.1188
No log	4.4944	400	1.2996	0.1994	1.2996	1.1400
No log	4.5169	402	1.2605	0.2510	1.2605	1.1227
No log	4.5393	404	1.1932	0.2845	1.1932	1.0923
No log	4.5618	406	1.1701	0.2845	1.1701	1.0817
No log	4.5843	408	1.1643	0.2209	1.1643	1.0790
No log	4.6067	410	1.1159	0.3527	1.1159	1.0564
No log	4.6292	412	1.1067	0.3148	1.1067	1.0520
No log	4.6517	414	1.1239	0.3036	1.1239	1.0601
No log	4.6742	416	1.1528	0.2697	1.1528	1.0737
No log	4.6966	418	1.1835	0.2384	1.1835	1.0879
No log	4.7191	420	1.1602	0.2650	1.1602	1.0771
No log	4.7416	422	1.1814	0.2224	1.1814	1.0869
No log	4.7640	424	1.2207	0.2063	1.2207	1.1049
No log	4.7865	426	1.2636	0.2742	1.2636	1.1241
No log	4.8090	428	1.3253	0.1950	1.3253	1.1512
No log	4.8315	430	1.3623	0.2002	1.3623	1.1672
No log	4.8539	432	1.2912	0.2410	1.2912	1.1363
No log	4.8764	434	1.2371	0.2452	1.2371	1.1122
No log	4.8989	436	1.1877	0.2021	1.1877	1.0898
No log	4.9213	438	1.1927	0.1595	1.1927	1.0921
No log	4.9438	440	1.1762	0.2021	1.1762	1.0845
No log	4.9663	442	1.1625	0.2237	1.1625	1.0782
No log	4.9888	444	1.1614	0.2237	1.1614	1.0777
No log	5.0112	446	1.2008	0.2452	1.2008	1.0958
No log	5.0337	448	1.2839	0.2131	1.2839	1.1331
No log	5.0562	450	1.2954	0.1999	1.2954	1.1382
No log	5.0787	452	1.2268	0.3077	1.2268	1.1076
No log	5.1011	454	1.1869	0.2949	1.1869	1.0894
No log	5.1236	456	1.1784	0.2446	1.1784	1.0855
No log	5.1461	458	1.2202	0.2544	1.2202	1.1046
No log	5.1685	460	1.2218	0.2169	1.2218	1.1053
No log	5.1910	462	1.1734	0.2075	1.1734	1.0832
No log	5.2135	464	1.1372	0.3205	1.1372	1.0664
No log	5.2360	466	1.1537	0.3671	1.1537	1.0741
No log	5.2584	468	1.1423	0.3148	1.1423	1.0688
No log	5.2809	470	1.1572	0.3166	1.1572	1.0757
No log	5.3034	472	1.1650	0.3166	1.1650	1.0794
No log	5.3258	474	1.1512	0.3166	1.1512	1.0730
No log	5.3483	476	1.1111	0.3190	1.1111	1.0541
No log	5.3708	478	1.1085	0.3059	1.1085	1.0529
No log	5.3933	480	1.1090	0.3059	1.1090	1.0531
No log	5.4157	482	1.1096	0.3080	1.1096	1.0534
No log	5.4382	484	1.2070	0.2501	1.2070	1.0986
No log	5.4607	486	1.2059	0.2501	1.2059	1.0981
No log	5.4831	488	1.1380	0.2863	1.1380	1.0668
No log	5.5056	490	1.1249	0.2973	1.1249	1.0606
No log	5.5281	492	1.1100	0.3384	1.1100	1.0536
No log	5.5506	494	1.1233	0.3032	1.1233	1.0599
No log	5.5730	496	1.1833	0.2870	1.1833	1.0878
No log	5.5955	498	1.1473	0.2624	1.1473	1.0711
0.3417	5.6180	500	1.1193	0.2805	1.1193	1.0579
0.3417	5.6404	502	1.1017	0.2871	1.1017	1.0496
0.3417	5.6629	504	1.1118	0.3486	1.1118	1.0544
0.3417	5.6854	506	1.1337	0.2697	1.1337	1.0648
0.3417	5.7079	508	1.1684	0.2198	1.1684	1.0809
0.3417	5.7303	510	1.2149	0.2170	1.2149	1.1022
0.3417	5.7528	512	1.2697	0.2361	1.2697	1.1268
0.3417	5.7753	514	1.2581	0.2361	1.2581	1.1216

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1