ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k14_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0738
• Qwk: 0.2003
• Mse: 1.0738
• Rmse: 1.0363

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	4.0997	-0.0075	4.0997	2.0248
No log	0.0606	4	2.6078	-0.0465	2.6078	1.6149
No log	0.0909	6	1.6912	-0.0046	1.6912	1.3004
No log	0.1212	8	1.3730	0.0634	1.3730	1.1718
No log	0.1515	10	1.4730	-0.0492	1.4730	1.2137
No log	0.1818	12	1.5188	0.0775	1.5188	1.2324
No log	0.2121	14	1.3816	0.0661	1.3816	1.1754
No log	0.2424	16	1.4708	0.1238	1.4708	1.2128
No log	0.2727	18	1.1851	0.2734	1.1851	1.0886
No log	0.3030	20	1.1612	0.2687	1.1612	1.0776
No log	0.3333	22	1.3145	0.2495	1.3145	1.1465
No log	0.3636	24	1.4299	0.2371	1.4299	1.1958
No log	0.3939	26	1.2297	0.1121	1.2297	1.1089
No log	0.4242	28	1.1532	0.0336	1.1532	1.0739
No log	0.4545	30	1.1882	0.0603	1.1882	1.0900
No log	0.4848	32	1.3764	0.2117	1.3764	1.1732
No log	0.5152	34	1.7004	0.1745	1.7004	1.3040
No log	0.5455	36	1.4491	0.2178	1.4491	1.2038
No log	0.5758	38	1.2732	0.2085	1.2732	1.1284
No log	0.6061	40	1.2336	0.1817	1.2336	1.1107
No log	0.6364	42	1.4508	0.2539	1.4508	1.2045
No log	0.6667	44	2.1755	0.1423	2.1755	1.4750
No log	0.6970	46	1.8909	0.1409	1.8909	1.3751
No log	0.7273	48	1.2297	0.2279	1.2297	1.1089
No log	0.7576	50	1.0665	0.3066	1.0665	1.0327
No log	0.7879	52	1.0736	0.1837	1.0736	1.0361
No log	0.8182	54	1.0042	0.1465	1.0042	1.0021
No log	0.8485	56	1.1362	0.2199	1.1362	1.0659
No log	0.8788	58	1.4500	0.1234	1.4500	1.2041
No log	0.9091	60	1.4413	0.1660	1.4413	1.2005
No log	0.9394	62	1.2488	0.1709	1.2488	1.1175
No log	0.9697	64	1.2627	0.2234	1.2627	1.1237
No log	1.0	66	1.1775	0.2103	1.1775	1.0851
No log	1.0303	68	1.2136	0.1778	1.2136	1.1016
No log	1.0606	70	1.4376	0.1489	1.4376	1.1990
No log	1.0909	72	1.4784	0.1895	1.4784	1.2159
No log	1.1212	74	1.2403	0.2195	1.2403	1.1137
No log	1.1515	76	1.0613	0.2031	1.0613	1.0302
No log	1.1818	78	1.0766	0.2991	1.0766	1.0376
No log	1.2121	80	1.0728	0.3124	1.0728	1.0358
No log	1.2424	82	1.1041	0.2302	1.1041	1.0507
No log	1.2727	84	1.2437	0.2138	1.2437	1.1152
No log	1.3030	86	1.3529	0.3375	1.3529	1.1631
No log	1.3333	88	1.4277	0.3375	1.4277	1.1949
No log	1.3636	90	1.3265	0.3012	1.3265	1.1518
No log	1.3939	92	1.1545	0.2201	1.1545	1.0745
No log	1.4242	94	1.0782	0.2989	1.0782	1.0383
No log	1.4545	96	1.1165	0.2208	1.1165	1.0567
No log	1.4848	98	1.2426	0.3435	1.2426	1.1147
No log	1.5152	100	1.1720	0.2932	1.1720	1.0826
No log	1.5455	102	1.1344	0.2331	1.1344	1.0651
No log	1.5758	104	1.2246	0.2268	1.2246	1.1066
No log	1.6061	106	1.2687	0.2552	1.2687	1.1264
No log	1.6364	108	1.1770	0.1776	1.1770	1.0849
No log	1.6667	110	1.1348	0.2980	1.1348	1.0653
No log	1.6970	112	1.1572	0.2702	1.1572	1.0757
No log	1.7273	114	1.2508	0.25	1.2508	1.1184
No log	1.7576	116	1.2984	0.3012	1.2984	1.1395
No log	1.7879	118	1.4010	0.2205	1.4010	1.1836
No log	1.8182	120	1.3981	0.2216	1.3981	1.1824
No log	1.8485	122	1.2532	0.3261	1.2532	1.1195
No log	1.8788	124	1.1612	0.3624	1.1612	1.0776
No log	1.9091	126	1.1238	0.4053	1.1238	1.0601
No log	1.9394	128	1.1330	0.2519	1.1330	1.0644
No log	1.9697	130	1.1455	0.2445	1.1455	1.0703
No log	2.0	132	1.0872	0.4425	1.0872	1.0427
No log	2.0303	134	1.1599	0.2974	1.1599	1.0770
No log	2.0606	136	1.1300	0.3880	1.1300	1.0630
No log	2.0909	138	0.9947	0.3048	0.9947	0.9974
No log	2.1212	140	1.0231	0.3048	1.0231	1.0115
No log	2.1515	142	1.1460	0.3709	1.1460	1.0705
No log	2.1818	144	1.1697	0.3243	1.1697	1.0815
No log	2.2121	146	1.1501	0.2787	1.1501	1.0724
No log	2.2424	148	1.1206	0.3179	1.1206	1.0586
No log	2.2727	150	1.1363	0.3488	1.1363	1.0660
No log	2.3030	152	1.0298	0.3389	1.0298	1.0148
No log	2.3333	154	1.0285	0.2532	1.0285	1.0142
No log	2.3636	156	1.0746	0.2735	1.0746	1.0366
No log	2.3939	158	1.0192	0.3394	1.0192	1.0096
No log	2.4242	160	1.0490	0.3736	1.0490	1.0242
No log	2.4545	162	1.0904	0.3807	1.0904	1.0442
No log	2.4848	164	1.1609	0.3640	1.1609	1.0774
No log	2.5152	166	1.2093	0.3773	1.2093	1.0997
No log	2.5455	168	1.2486	0.3330	1.2486	1.1174
No log	2.5758	170	1.2760	0.2875	1.2760	1.1296
No log	2.6061	172	1.2659	0.2801	1.2659	1.1251
No log	2.6364	174	1.3523	0.2917	1.3523	1.1629
No log	2.6667	176	1.5108	0.1638	1.5108	1.2292
No log	2.6970	178	1.4305	0.2168	1.4305	1.1960
No log	2.7273	180	1.1611	0.2456	1.1611	1.0775
No log	2.7576	182	1.1671	0.2292	1.1671	1.0803
No log	2.7879	184	1.1445	0.1869	1.1445	1.0698
No log	2.8182	186	1.1305	0.1986	1.1305	1.0632
No log	2.8485	188	1.1375	0.3157	1.1375	1.0665
No log	2.8788	190	1.0864	0.2255	1.0864	1.0423
No log	2.9091	192	1.0902	0.3437	1.0902	1.0441
No log	2.9394	194	1.1056	0.3528	1.1056	1.0515
No log	2.9697	196	1.1339	0.3879	1.1339	1.0649
No log	3.0	198	1.1424	0.3669	1.1424	1.0688
No log	3.0303	200	1.1819	0.2169	1.1819	1.0872
No log	3.0606	202	1.1391	0.2519	1.1391	1.0673
No log	3.0909	204	1.0908	0.3049	1.0908	1.0444
No log	3.1212	206	1.1156	0.3753	1.1156	1.0562
No log	3.1515	208	1.1221	0.2195	1.1221	1.0593
No log	3.1818	210	1.1677	0.2063	1.1677	1.0806
No log	3.2121	212	1.2223	0.2388	1.2223	1.1056
No log	3.2424	214	1.2350	0.2804	1.2350	1.1113
No log	3.2727	216	1.2595	0.3164	1.2595	1.1223
No log	3.3030	218	1.2630	0.3115	1.2630	1.1238
No log	3.3333	220	1.2185	0.2721	1.2185	1.1039
No log	3.3636	222	1.2231	0.2343	1.2231	1.1060
No log	3.3939	224	1.2644	0.2481	1.2644	1.1244
No log	3.4242	226	1.2606	0.2388	1.2606	1.1228
No log	3.4545	228	1.2827	0.2601	1.2827	1.1326
No log	3.4848	230	1.2912	0.2982	1.2912	1.1363
No log	3.5152	232	1.2788	0.2246	1.2788	1.1308
No log	3.5455	234	1.4616	0.1831	1.4616	1.2090
No log	3.5758	236	1.4247	0.2241	1.4247	1.1936
No log	3.6061	238	1.2526	0.2060	1.2526	1.1192
No log	3.6364	240	1.2476	0.2851	1.2476	1.1170
No log	3.6667	242	1.2701	0.2076	1.2701	1.1270
No log	3.6970	244	1.1975	0.2228	1.1975	1.0943
No log	3.7273	246	1.1430	0.0914	1.1430	1.0691
No log	3.7576	248	1.2046	0.1893	1.2046	1.0976
No log	3.7879	250	1.2527	0.2557	1.2527	1.1193
No log	3.8182	252	1.2267	0.1649	1.2267	1.1076
No log	3.8485	254	1.2422	0.2788	1.2422	1.1145
No log	3.8788	256	1.2679	0.1801	1.2679	1.1260
No log	3.9091	258	1.2203	0.2898	1.2203	1.1047
No log	3.9394	260	1.1750	0.2483	1.1750	1.0840
No log	3.9697	262	1.1311	0.2857	1.1311	1.0635
No log	4.0	264	1.0764	0.2097	1.0764	1.0375
No log	4.0303	266	1.1224	0.1546	1.1224	1.0594
No log	4.0606	268	1.1393	0.1886	1.1393	1.0674
No log	4.0909	270	1.0758	0.2356	1.0758	1.0372
No log	4.1212	272	1.0520	0.2723	1.0520	1.0257
No log	4.1515	274	1.0726	0.2723	1.0726	1.0356
No log	4.1818	276	1.1223	0.3714	1.1223	1.0594
No log	4.2121	278	1.1848	0.3319	1.1848	1.0885
No log	4.2424	280	1.2398	0.2964	1.2398	1.1135
No log	4.2727	282	1.2591	0.3065	1.2591	1.1221
No log	4.3030	284	1.2327	0.3081	1.2327	1.1103
No log	4.3333	286	1.1998	0.3081	1.1998	1.0954
No log	4.3636	288	1.1620	0.3409	1.1620	1.0780
No log	4.3939	290	1.1223	0.1788	1.1223	1.0594
No log	4.4242	292	1.1308	0.2028	1.1308	1.0634
No log	4.4545	294	1.1337	0.1788	1.1337	1.0647
No log	4.4848	296	1.1576	0.2219	1.1576	1.0759
No log	4.5152	298	1.2044	0.3012	1.2044	1.0974
No log	4.5455	300	1.2307	0.3012	1.2307	1.1094
No log	4.5758	302	1.1864	0.2681	1.1864	1.0892
No log	4.6061	304	1.1314	0.2612	1.1314	1.0637
No log	4.6364	306	1.0913	0.2265	1.0913	1.0446
No log	4.6667	308	1.0749	0.2063	1.0749	1.0368
No log	4.6970	310	1.0928	0.2300	1.0928	1.0454
No log	4.7273	312	1.1136	0.2798	1.1136	1.0553
No log	4.7576	314	1.0637	0.2388	1.0637	1.0314
No log	4.7879	316	1.0668	0.3069	1.0668	1.0329
No log	4.8182	318	1.0969	0.3680	1.0969	1.0473
No log	4.8485	320	1.2251	0.3556	1.2251	1.1069
No log	4.8788	322	1.2642	0.3761	1.2642	1.1244
No log	4.9091	324	1.1716	0.3046	1.1716	1.0824
No log	4.9394	326	1.1381	0.2105	1.1381	1.0668
No log	4.9697	328	1.1529	0.3409	1.1529	1.0737
No log	5.0	330	1.1403	0.3409	1.1403	1.0678
No log	5.0303	332	1.1331	0.3409	1.1331	1.0645
No log	5.0606	334	1.1047	0.3103	1.1047	1.0510
No log	5.0909	336	1.1009	0.2323	1.1009	1.0492
No log	5.1212	338	1.1055	0.1546	1.1055	1.0514
No log	5.1515	340	1.1349	0.1649	1.1349	1.0653
No log	5.1818	342	1.1294	0.2579	1.1294	1.0627
No log	5.2121	344	1.1295	0.3350	1.1295	1.0628
No log	5.2424	346	1.1379	0.3753	1.1379	1.0667
No log	5.2727	348	1.1216	0.2857	1.1216	1.0590
No log	5.3030	350	1.1309	0.1818	1.1309	1.0634
No log	5.3333	352	1.2636	0.3197	1.2636	1.1241
No log	5.3636	354	1.2587	0.2480	1.2587	1.1219
No log	5.3939	356	1.1431	0.2049	1.1431	1.0691
No log	5.4242	358	1.0972	0.2857	1.0972	1.0475
No log	5.4545	360	1.0885	0.3045	1.0885	1.0433
No log	5.4848	362	1.0969	0.3861	1.0969	1.0473
No log	5.5152	364	1.1447	0.3662	1.1447	1.0699
No log	5.5455	366	1.1628	0.3554	1.1628	1.0783
No log	5.5758	368	1.1877	0.3231	1.1877	1.0898
No log	5.6061	370	1.1662	0.3049	1.1662	1.0799
No log	5.6364	372	1.1976	0.3608	1.1976	1.0943
No log	5.6667	374	1.2137	0.2794	1.2137	1.1017
No log	5.6970	376	1.1880	0.2250	1.1880	1.0899
No log	5.7273	378	1.1006	0.1727	1.1006	1.0491
No log	5.7576	380	1.0660	0.1504	1.0660	1.0325
No log	5.7879	382	1.0762	0.2108	1.0762	1.0374
No log	5.8182	384	1.1035	0.2463	1.1035	1.0505
No log	5.8485	386	1.2098	0.2541	1.2098	1.0999
No log	5.8788	388	1.3949	0.2539	1.3949	1.1811
No log	5.9091	390	1.4492	0.2551	1.4492	1.2038
No log	5.9394	392	1.3660	0.2993	1.3660	1.1688
No log	5.9697	394	1.1816	0.3341	1.1816	1.0870
No log	6.0	396	1.0729	0.2347	1.0729	1.0358
No log	6.0303	398	1.1074	0.2440	1.1074	1.0523
No log	6.0606	400	1.1174	0.2514	1.1174	1.0571
No log	6.0909	402	1.0755	0.2147	1.0755	1.0371
No log	6.1212	404	1.0949	0.2605	1.0949	1.0464
No log	6.1515	406	1.1234	0.2632	1.1234	1.0599
No log	6.1818	408	1.0918	0.2674	1.0918	1.0449
No log	6.2121	410	1.0659	0.2166	1.0659	1.0324
No log	6.2424	412	1.1638	0.2311	1.1638	1.0788
No log	6.2727	414	1.1926	0.2311	1.1926	1.0921
No log	6.3030	416	1.1183	0.2714	1.1183	1.0575
No log	6.3333	418	1.0409	0.2279	1.0409	1.0202
No log	6.3636	420	1.0417	0.2954	1.0417	1.0206
No log	6.3939	422	1.0503	0.3398	1.0503	1.0248
No log	6.4242	424	1.0461	0.1953	1.0461	1.0228
No log	6.4545	426	1.0313	0.2721	1.0313	1.0155
No log	6.4848	428	1.0241	0.2721	1.0241	1.0120
No log	6.5152	430	1.0030	0.1616	1.0030	1.0015
No log	6.5455	432	0.9974	0.1767	0.9974	0.9987
No log	6.5758	434	0.9985	0.2528	0.9985	0.9993
No log	6.6061	436	1.0431	0.2929	1.0431	1.0213
No log	6.6364	438	1.1055	0.3290	1.1055	1.0514
No log	6.6667	440	1.1462	0.3191	1.1462	1.0706
No log	6.6970	442	1.1460	0.3390	1.1460	1.0705
No log	6.7273	444	1.1394	0.3662	1.1394	1.0674
No log	6.7576	446	1.1234	0.3103	1.1234	1.0599
No log	6.7879	448	1.1158	0.3310	1.1158	1.0563
No log	6.8182	450	1.0824	0.2562	1.0824	1.0404
No log	6.8485	452	1.0710	0.2562	1.0710	1.0349
No log	6.8788	454	1.0233	0.2360	1.0233	1.0116
No log	6.9091	456	0.9958	0.3056	0.9958	0.9979
No log	6.9394	458	0.9988	0.3056	0.9988	0.9994
No log	6.9697	460	1.0327	0.3268	1.0327	1.0162
No log	7.0	462	1.0955	0.3807	1.0955	1.0466
No log	7.0303	464	1.1703	0.3649	1.1703	1.0818
No log	7.0606	466	1.1312	0.3844	1.1312	1.0636
No log	7.0909	468	1.0589	0.3572	1.0589	1.0290
No log	7.1212	470	1.0248	0.3097	1.0248	1.0123
No log	7.1515	472	1.0646	0.3250	1.0646	1.0318
No log	7.1818	474	1.0746	0.2807	1.0746	1.0366
No log	7.2121	476	1.0914	0.2669	1.0914	1.0447
No log	7.2424	478	1.1057	0.2255	1.1057	1.0515
No log	7.2727	480	1.1203	0.1693	1.1203	1.0584
No log	7.3030	482	1.1261	0.1812	1.1261	1.0612
No log	7.3333	484	1.1233	0.2654	1.1233	1.0599
No log	7.3636	486	1.1429	0.3732	1.1429	1.0691
No log	7.3939	488	1.1251	0.3732	1.1251	1.0607
No log	7.4242	490	1.1030	0.3463	1.1030	1.0502
No log	7.4545	492	1.1154	0.3621	1.1154	1.0561
No log	7.4848	494	1.1340	0.3103	1.1340	1.0649
No log	7.5152	496	1.1288	0.3399	1.1288	1.0624
No log	7.5455	498	1.1201	0.3124	1.1201	1.0584
0.3276	7.5758	500	1.1081	0.3124	1.1081	1.0527
0.3276	7.6061	502	1.1158	0.2321	1.1158	1.0563
0.3276	7.6364	504	1.1575	0.2087	1.1575	1.0759
0.3276	7.6667	506	1.1858	0.2519	1.1858	1.0889
0.3276	7.6970	508	1.2180	0.3207	1.2180	1.1037
0.3276	7.7273	510	1.2349	0.2882	1.2349	1.1113
0.3276	7.7576	512	1.1802	0.3207	1.1802	1.0864
0.3276	7.7879	514	1.1455	0.3357	1.1455	1.0703
0.3276	7.8182	516	1.1076	0.3089	1.1076	1.0524
0.3276	7.8485	518	1.1125	0.2628	1.1125	1.0548
0.3276	7.8788	520	1.0688	0.1808	1.0688	1.0338
0.3276	7.9091	522	1.0655	0.2147	1.0655	1.0322
0.3276	7.9394	524	1.0738	0.2003	1.0738	1.0363

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1