ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2717
• Qwk: 0.1259
• Mse: 1.2717
• Rmse: 1.1277

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0235	2	4.7140	-0.0020	4.7140	2.1712
No log	0.0471	4	2.7612	-0.0420	2.7612	1.6617
No log	0.0706	6	2.0666	0.0169	2.0666	1.4376
No log	0.0941	8	2.2488	-0.0341	2.2488	1.4996
No log	0.1176	10	1.5788	-0.1064	1.5788	1.2565
No log	0.1412	12	1.4039	0.0324	1.4039	1.1849
No log	0.1647	14	1.3783	-0.0140	1.3783	1.1740
No log	0.1882	16	1.4931	0.0661	1.4931	1.2219
No log	0.2118	18	1.7222	0.1735	1.7222	1.3123
No log	0.2353	20	1.9861	0.1306	1.9861	1.4093
No log	0.2588	22	1.6863	0.1766	1.6863	1.2986
No log	0.2824	24	1.4653	0.2339	1.4653	1.2105
No log	0.3059	26	1.2198	0.2747	1.2198	1.1044
No log	0.3294	28	1.1661	0.2647	1.1661	1.0798
No log	0.3529	30	1.1511	0.2550	1.1511	1.0729
No log	0.3765	32	1.2007	0.3104	1.2007	1.0958
No log	0.4	34	1.5875	0.2725	1.5875	1.2599
No log	0.4235	36	2.5790	0.1125	2.5790	1.6059
No log	0.4471	38	3.0919	0.0659	3.0919	1.7584
No log	0.4706	40	2.5609	0.1125	2.5609	1.6003
No log	0.4941	42	1.7881	0.1391	1.7881	1.3372
No log	0.5176	44	1.4861	0.2568	1.4861	1.2191
No log	0.5412	46	1.3605	0.2240	1.3605	1.1664
No log	0.5647	48	1.1957	0.3008	1.1957	1.0935
No log	0.5882	50	1.1297	0.2273	1.1297	1.0629
No log	0.6118	52	1.1761	0.2560	1.1761	1.0845
No log	0.6353	54	1.3187	0.2734	1.3187	1.1483
No log	0.6588	56	1.5492	0.1993	1.5492	1.2447
No log	0.6824	58	1.8308	0.1161	1.8308	1.3531
No log	0.7059	60	2.0959	0.1317	2.0959	1.4477
No log	0.7294	62	1.8976	0.2183	1.8976	1.3775
No log	0.7529	64	1.9803	0.2183	1.9803	1.4072
No log	0.7765	66	1.8602	0.2149	1.8602	1.3639
No log	0.8	68	1.6247	0.2430	1.6247	1.2746
No log	0.8235	70	1.7519	0.2659	1.7519	1.3236
No log	0.8471	72	1.7444	0.1404	1.7444	1.3207
No log	0.8706	74	1.5971	0.1956	1.5971	1.2638
No log	0.8941	76	1.2857	0.2565	1.2857	1.1339
No log	0.9176	78	1.0840	0.2988	1.0840	1.0411
No log	0.9412	80	1.0797	0.2579	1.0797	1.0391
No log	0.9647	82	1.0872	0.3291	1.0872	1.0427
No log	0.9882	84	1.2513	0.2939	1.2513	1.1186
No log	1.0118	86	1.7900	0.1223	1.7900	1.3379
No log	1.0353	88	2.0992	0.1341	2.0992	1.4489
No log	1.0588	90	1.8697	0.1689	1.8697	1.3674
No log	1.0824	92	1.3974	0.1708	1.3974	1.1821
No log	1.1059	94	1.1221	0.2815	1.1221	1.0593
No log	1.1294	96	1.0727	0.3263	1.0727	1.0357
No log	1.1529	98	1.0521	0.3110	1.0521	1.0257
No log	1.1765	100	1.1525	0.2895	1.1525	1.0735
No log	1.2	102	1.2863	0.3166	1.2863	1.1341
No log	1.2235	104	1.4334	0.3594	1.4334	1.1973
No log	1.2471	106	1.4855	0.3386	1.4855	1.2188
No log	1.2706	108	1.3940	0.3431	1.3940	1.1807
No log	1.2941	110	1.2459	0.3453	1.2459	1.1162
No log	1.3176	112	1.1627	0.3004	1.1627	1.0783
No log	1.3412	114	1.1388	0.3484	1.1388	1.0671
No log	1.3647	116	1.2174	0.3127	1.2174	1.1033
No log	1.3882	118	1.2470	0.3127	1.2470	1.1167
No log	1.4118	120	1.1992	0.3547	1.1992	1.0951
No log	1.4353	122	1.1177	0.4243	1.1177	1.0572
No log	1.4588	124	1.1105	0.4124	1.1105	1.0538
No log	1.4824	126	1.0802	0.3902	1.0802	1.0393
No log	1.5059	128	1.1233	0.3318	1.1233	1.0599
No log	1.5294	130	1.0855	0.3781	1.0855	1.0419
No log	1.5529	132	1.2294	0.3249	1.2294	1.1088
No log	1.5765	134	1.2759	0.3569	1.2759	1.1296
No log	1.6	136	1.1791	0.3344	1.1791	1.0859
No log	1.6235	138	1.1790	0.3610	1.1790	1.0858
No log	1.6471	140	1.3626	0.2885	1.3626	1.1673
No log	1.6706	142	1.5499	0.2734	1.5499	1.2449
No log	1.6941	144	1.8739	0.1848	1.8739	1.3689
No log	1.7176	146	1.5706	0.2522	1.5706	1.2533
No log	1.7412	148	1.1599	0.2771	1.1599	1.0770
No log	1.7647	150	1.1218	0.2972	1.1218	1.0592
No log	1.7882	152	1.1488	0.3225	1.1488	1.0718
No log	1.8118	154	1.1296	0.2395	1.1296	1.0628
No log	1.8353	156	1.3701	0.3434	1.3701	1.1705
No log	1.8588	158	1.8591	0.2303	1.8591	1.3635
No log	1.8824	160	1.8660	0.2089	1.8660	1.3660
No log	1.9059	162	1.4196	0.2868	1.4196	1.1915
No log	1.9294	164	1.0621	0.2682	1.0621	1.0306
No log	1.9529	166	1.0209	0.3344	1.0209	1.0104
No log	1.9765	168	0.9941	0.3159	0.9941	0.9970
No log	2.0	170	0.9935	0.3527	0.9935	0.9968
No log	2.0235	172	1.0360	0.2714	1.0360	1.0178
No log	2.0471	174	1.2286	0.3453	1.2286	1.1084
No log	2.0706	176	1.2744	0.2899	1.2744	1.1289
No log	2.0941	178	1.2249	0.1921	1.2249	1.1068
No log	2.1176	180	1.2259	0.1809	1.2259	1.1072
No log	2.1412	182	1.2785	0.2191	1.2785	1.1307
No log	2.1647	184	1.2721	0.3179	1.2721	1.1279
No log	2.1882	186	1.3655	0.2773	1.3655	1.1685
No log	2.2118	188	1.5863	0.2037	1.5863	1.2595
No log	2.2353	190	1.4953	0.1518	1.4953	1.2228
No log	2.2588	192	1.2762	0.2622	1.2762	1.1297
No log	2.2824	194	1.2551	0.2040	1.2551	1.1203
No log	2.3059	196	1.3136	0.2243	1.3136	1.1461
No log	2.3294	198	1.3261	0.1413	1.3261	1.1515
No log	2.3529	200	1.4188	0.1257	1.4188	1.1911
No log	2.3765	202	1.3760	0.1886	1.3760	1.1730
No log	2.4	204	1.1913	0.2624	1.1913	1.0915
No log	2.4235	206	1.1015	0.3346	1.1015	1.0495
No log	2.4471	208	1.0930	0.3566	1.0930	1.0455
No log	2.4706	210	1.1496	0.3174	1.1496	1.0722
No log	2.4941	212	1.2057	0.2550	1.2057	1.0980
No log	2.5176	214	1.2052	0.3454	1.2052	1.0978
No log	2.5412	216	1.2539	0.3011	1.2539	1.1198
No log	2.5647	218	1.3224	0.2805	1.3224	1.1500
No log	2.5882	220	1.3450	0.2644	1.3450	1.1597
No log	2.6118	222	1.2639	0.2424	1.2639	1.1242
No log	2.6353	224	1.1538	0.2775	1.1538	1.0742
No log	2.6588	226	1.1436	0.2439	1.1436	1.0694
No log	2.6824	228	1.1317	0.2157	1.1317	1.0638
No log	2.7059	230	1.1503	0.2682	1.1503	1.0725
No log	2.7294	232	1.1254	0.2919	1.1254	1.0609
No log	2.7529	234	1.1046	0.3083	1.1046	1.0510
No log	2.7765	236	1.0907	0.3399	1.0907	1.0444
No log	2.8	238	1.1843	0.3497	1.1843	1.0882
No log	2.8235	240	1.3455	0.2754	1.3455	1.1599
No log	2.8471	242	1.1853	0.2825	1.1853	1.0887
No log	2.8706	244	1.0540	0.3641	1.0540	1.0266
No log	2.8941	246	1.0759	0.3870	1.0759	1.0373
No log	2.9176	248	1.1036	0.3155	1.1036	1.0505
No log	2.9412	250	1.3030	0.1971	1.3030	1.1415
No log	2.9647	252	1.4054	0.1599	1.4054	1.1855
No log	2.9882	254	1.2775	0.1785	1.2775	1.1303
No log	3.0118	256	1.2204	0.3010	1.2204	1.1047
No log	3.0353	258	1.2499	0.2131	1.2499	1.1180
No log	3.0588	260	1.4637	0.1935	1.4637	1.2098
No log	3.0824	262	1.7111	0.2461	1.7111	1.3081
No log	3.1059	264	1.6623	0.2461	1.6623	1.2893
No log	3.1294	266	1.3895	0.1631	1.3895	1.1788
No log	3.1529	268	1.2121	0.2647	1.2121	1.1010
No log	3.1765	270	1.1953	0.2737	1.1953	1.0933
No log	3.2	272	1.1841	0.3066	1.1841	1.0881
No log	3.2235	274	1.1967	0.2168	1.1967	1.0939
No log	3.2471	276	1.3708	0.1840	1.3708	1.1708
No log	3.2706	278	1.5590	0.1623	1.5590	1.2486
No log	3.2941	280	1.4690	0.1474	1.4690	1.2120
No log	3.3176	282	1.2609	0.2966	1.2609	1.1229
No log	3.3412	284	1.1710	0.4032	1.1710	1.0821
No log	3.3647	286	1.2323	0.3627	1.2323	1.1101
No log	3.3882	288	1.2934	0.2191	1.2934	1.1373
No log	3.4118	290	1.2082	0.3465	1.2082	1.0992
No log	3.4353	292	1.1122	0.3119	1.1122	1.0546
No log	3.4588	294	1.1849	0.1852	1.1849	1.0885
No log	3.4824	296	1.2645	0.2451	1.2645	1.1245
No log	3.5059	298	1.3401	0.1971	1.3401	1.1576
No log	3.5294	300	1.3816	0.1583	1.3816	1.1754
No log	3.5529	302	1.2941	0.2280	1.2941	1.1376
No log	3.5765	304	1.1632	0.3189	1.1632	1.0785
No log	3.6	306	1.1484	0.2993	1.1484	1.0716
No log	3.6235	308	1.1766	0.3243	1.1766	1.0847
No log	3.6471	310	1.3027	0.1716	1.3027	1.1414
No log	3.6706	312	1.3482	0.1809	1.3482	1.1611
No log	3.6941	314	1.2711	0.1702	1.2711	1.1274
No log	3.7176	316	1.2075	0.1974	1.2075	1.0989
No log	3.7412	318	1.1694	0.2402	1.1694	1.0814
No log	3.7647	320	1.1604	0.2402	1.1604	1.0772
No log	3.7882	322	1.2303	0.1560	1.2303	1.1092
No log	3.8118	324	1.3591	0.2364	1.3591	1.1658
No log	3.8353	326	1.3468	0.2832	1.3468	1.1605
No log	3.8588	328	1.2374	0.2268	1.2374	1.1124
No log	3.8824	330	1.1479	0.2757	1.1479	1.0714
No log	3.9059	332	1.1478	0.3578	1.1478	1.0714
No log	3.9294	334	1.1583	0.3016	1.1583	1.0763
No log	3.9529	336	1.1452	0.3445	1.1452	1.0702
No log	3.9765	338	1.1758	0.2654	1.1758	1.0843
No log	4.0	340	1.2000	0.2670	1.2000	1.0954
No log	4.0235	342	1.1657	0.2486	1.1657	1.0797
No log	4.0471	344	1.1430	0.2577	1.1430	1.0691
No log	4.0706	346	1.1075	0.3525	1.1075	1.0524
No log	4.0941	348	1.1358	0.2614	1.1358	1.0657
No log	4.1176	350	1.1093	0.2923	1.1093	1.0532
No log	4.1412	352	1.1049	0.3077	1.1049	1.0511
No log	4.1647	354	1.2625	0.2964	1.2625	1.1236
No log	4.1882	356	1.6381	0.2393	1.6381	1.2799
No log	4.2118	358	1.7023	0.2393	1.7023	1.3047
No log	4.2353	360	1.4777	0.2441	1.4777	1.2156
No log	4.2588	362	1.1811	0.2900	1.1811	1.0868
No log	4.2824	364	1.0946	0.3261	1.0946	1.0462
No log	4.3059	366	1.0976	0.3945	1.0976	1.0477
No log	4.3294	368	1.0913	0.3194	1.0913	1.0446
No log	4.3529	370	1.1890	0.2640	1.1890	1.0904
No log	4.3765	372	1.4563	0.3174	1.4563	1.2068
No log	4.4	374	1.5817	0.1916	1.5817	1.2577
No log	4.4235	376	1.4624	0.2028	1.4624	1.2093
No log	4.4471	378	1.2490	0.2825	1.2490	1.1176
No log	4.4706	380	1.0882	0.2544	1.0882	1.0432
No log	4.4941	382	1.0818	0.2993	1.0818	1.0401
No log	4.5176	384	1.0896	0.3353	1.0896	1.0438
No log	4.5412	386	1.0831	0.2728	1.0831	1.0407
No log	4.5647	388	1.1097	0.2760	1.1097	1.0534
No log	4.5882	390	1.1791	0.2492	1.1791	1.0859
No log	4.6118	392	1.2484	0.2900	1.2484	1.1173
No log	4.6353	394	1.2402	0.2923	1.2402	1.1137
No log	4.6588	396	1.1589	0.2431	1.1589	1.0765
No log	4.6824	398	1.1528	0.2431	1.1528	1.0737
No log	4.7059	400	1.2022	0.2131	1.2022	1.0964
No log	4.7294	402	1.2527	0.2404	1.2527	1.1192
No log	4.7529	404	1.2530	0.2230	1.2530	1.1194
No log	4.7765	406	1.2345	0.2320	1.2345	1.1111
No log	4.8	408	1.1537	0.2180	1.1537	1.0741
No log	4.8235	410	1.0965	0.2372	1.0965	1.0471
No log	4.8471	412	1.0696	0.2814	1.0696	1.0342
No log	4.8706	414	1.0655	0.2424	1.0655	1.0322
No log	4.8941	416	1.0993	0.2276	1.0993	1.0485
No log	4.9176	418	1.1201	0.1852	1.1201	1.0584
No log	4.9412	420	1.0879	0.2366	1.0879	1.0430
No log	4.9647	422	1.0556	0.3104	1.0556	1.0274
No log	4.9882	424	1.0536	0.3104	1.0536	1.0264
No log	5.0118	426	1.0516	0.2943	1.0516	1.0255
No log	5.0353	428	1.0901	0.3189	1.0901	1.0441
No log	5.0588	430	1.1469	0.3074	1.1469	1.0709
No log	5.0824	432	1.1781	0.3074	1.1781	1.0854
No log	5.1059	434	1.1720	0.2787	1.1720	1.0826
No log	5.1294	436	1.1718	0.2492	1.1718	1.0825
No log	5.1529	438	1.1521	0.2459	1.1521	1.0734
No log	5.1765	440	1.1003	0.2685	1.1003	1.0489
No log	5.2	442	1.0560	0.2495	1.0560	1.0276
No log	5.2235	444	1.0397	0.2943	1.0397	1.0197
No log	5.2471	446	1.0406	0.2943	1.0406	1.0201
No log	5.2706	448	1.0530	0.2824	1.0530	1.0262
No log	5.2941	450	1.0901	0.2311	1.0901	1.0441
No log	5.3176	452	1.1002	0.2403	1.1002	1.0489
No log	5.3412	454	1.0874	0.2539	1.0874	1.0428
No log	5.3647	456	1.1205	0.2459	1.1205	1.0585
No log	5.3882	458	1.1463	0.2410	1.1463	1.0707
No log	5.4118	460	1.1408	0.2439	1.1408	1.0681
No log	5.4353	462	1.1445	0.2293	1.1445	1.0698
No log	5.4588	464	1.1501	0.2115	1.1501	1.0724
No log	5.4824	466	1.2100	0.2035	1.2100	1.1000
No log	5.5059	468	1.2825	0.1862	1.2825	1.1325
No log	5.5294	470	1.2382	0.2270	1.2382	1.1127
No log	5.5529	472	1.2231	0.3119	1.2231	1.1060
No log	5.5765	474	1.1672	0.2993	1.1672	1.0804
No log	5.6	476	1.1718	0.3426	1.1718	1.0825
No log	5.6235	478	1.1580	0.3381	1.1580	1.0761
No log	5.6471	480	1.1678	0.3077	1.1678	1.0807
No log	5.6706	482	1.2553	0.2851	1.2553	1.1204
No log	5.6941	484	1.2788	0.2465	1.2788	1.1308
No log	5.7176	486	1.1827	0.2283	1.1827	1.0875
No log	5.7412	488	1.0750	0.2263	1.0750	1.0368
No log	5.7647	490	1.0573	0.2697	1.0573	1.0283
No log	5.7882	492	1.0564	0.2601	1.0564	1.0278
No log	5.8118	494	1.0700	0.2263	1.0700	1.0344
No log	5.8353	496	1.1327	0.2779	1.1327	1.0643
No log	5.8588	498	1.2479	0.2152	1.2479	1.1171
0.4029	5.8824	500	1.2446	0.2321	1.2446	1.1156
0.4029	5.9059	502	1.1692	0.3050	1.1692	1.0813
0.4029	5.9294	504	1.0786	0.2732	1.0786	1.0386
0.4029	5.9529	506	1.0169	0.3539	1.0169	1.0084
0.4029	5.9765	508	1.0140	0.4343	1.0140	1.0070
0.4029	6.0	510	1.0138	0.3450	1.0138	1.0069
0.4029	6.0235	512	1.0487	0.3010	1.0487	1.0240
0.4029	6.0471	514	1.0462	0.3149	1.0462	1.0228
0.4029	6.0706	516	1.0523	0.2824	1.0523	1.0258
0.4029	6.0941	518	1.0297	0.2682	1.0297	1.0147
0.4029	6.1176	520	1.0250	0.3283	1.0250	1.0124
0.4029	6.1412	522	1.0402	0.2941	1.0402	1.0199
0.4029	6.1647	524	1.1151	0.2549	1.1151	1.0560
0.4029	6.1882	526	1.2269	0.1928	1.2269	1.1077
0.4029	6.2118	528	1.2095	0.2015	1.2095	1.0998
0.4029	6.2353	530	1.1302	0.2637	1.1302	1.0631
0.4029	6.2588	532	1.1035	0.2814	1.1035	1.0505
0.4029	6.2824	534	1.1055	0.3168	1.1055	1.0514
0.4029	6.3059	536	1.1115	0.2864	1.1115	1.0543
0.4029	6.3294	538	1.1154	0.3168	1.1154	1.0561
0.4029	6.3529	540	1.1269	0.2124	1.1269	1.0615
0.4029	6.3765	542	1.1663	0.1505	1.1663	1.0800
0.4029	6.4	544	1.1640	0.2273	1.1640	1.0789
0.4029	6.4235	546	1.1325	0.2667	1.1325	1.0642
0.4029	6.4471	548	1.1305	0.3081	1.1305	1.0632
0.4029	6.4706	550	1.1093	0.3081	1.1093	1.0532
0.4029	6.4941	552	1.0956	0.2633	1.0956	1.0467
0.4029	6.5176	554	1.1180	0.3081	1.1180	1.0574
0.4029	6.5412	556	1.1751	0.2410	1.1751	1.0840
0.4029	6.5647	558	1.1839	0.2410	1.1839	1.0881
0.4029	6.5882	560	1.2465	0.2103	1.2465	1.1165
0.4029	6.6118	562	1.3104	0.2289	1.3104	1.1447
0.4029	6.6353	564	1.2244	0.1652	1.2244	1.1065
0.4029	6.6588	566	1.1161	0.2446	1.1161	1.0565
0.4029	6.6824	568	1.1001	0.2446	1.1001	1.0488
0.4029	6.7059	570	1.0883	0.2776	1.0883	1.0432
0.4029	6.7294	572	1.0851	0.2776	1.0851	1.0417
0.4029	6.7529	574	1.1440	0.1982	1.1440	1.0696
0.4029	6.7765	576	1.4027	0.2033	1.4027	1.1844
0.4029	6.8	578	1.6149	0.2393	1.6149	1.2708
0.4029	6.8235	580	1.5888	0.2114	1.5888	1.2605
0.4029	6.8471	582	1.3949	0.2430	1.3949	1.1811
0.4029	6.8706	584	1.2366	0.2361	1.2366	1.1120
0.4029	6.8941	586	1.1724	0.1889	1.1724	1.0828
0.4029	6.9176	588	1.1499	0.1889	1.1499	1.0724
0.4029	6.9412	590	1.1263	0.2315	1.1263	1.0613
0.4029	6.9647	592	1.1014	0.2938	1.1014	1.0495
0.4029	6.9882	594	1.1038	0.2784	1.1038	1.0506
0.4029	7.0118	596	1.1239	0.2372	1.1239	1.0602
0.4029	7.0353	598	1.1584	0.1935	1.1584	1.0763
0.4029	7.0588	600	1.1313	0.2276	1.1313	1.0636
0.4029	7.0824	602	1.1240	0.2700	1.1240	1.0602
0.4029	7.1059	604	1.1148	0.2966	1.1148	1.0558
0.4029	7.1294	606	1.1301	0.3108	1.1301	1.0630
0.4029	7.1529	608	1.1572	0.2682	1.1572	1.0758
0.4029	7.1765	610	1.2847	0.1492	1.2847	1.1335
0.4029	7.2	612	1.4492	0.1199	1.4492	1.2038
0.4029	7.2235	614	1.5279	0.1199	1.5279	1.2361
0.4029	7.2471	616	1.4316	0.1087	1.4316	1.1965
0.4029	7.2706	618	1.2717	0.1259	1.2717	1.1277

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1