ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0665
• Qwk: 0.2509
• Mse: 1.0665
• Rmse: 1.0327

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0513	2	4.7580	-0.0020	4.7580	2.1813
No log	0.1026	4	2.4716	0.0228	2.4716	1.5721
No log	0.1538	6	2.1349	0.0074	2.1349	1.4611
No log	0.2051	8	1.3585	0.0766	1.3585	1.1656
No log	0.2564	10	1.2054	0.1903	1.2054	1.0979
No log	0.3077	12	1.1881	0.1593	1.1881	1.0900
No log	0.3590	14	1.2312	0.1927	1.2312	1.1096
No log	0.4103	16	1.3421	0.0750	1.3421	1.1585
No log	0.4615	18	1.4228	0.0750	1.4228	1.1928
No log	0.5128	20	1.5484	0.0254	1.5484	1.2443
No log	0.5641	22	1.5374	0.0403	1.5374	1.2399
No log	0.6154	24	1.3450	0.0575	1.3450	1.1597
No log	0.6667	26	1.1748	0.2446	1.1748	1.0839
No log	0.7179	28	1.0963	0.3035	1.0963	1.0471
No log	0.7692	30	1.0558	0.3498	1.0558	1.0275
No log	0.8205	32	1.0388	0.2991	1.0388	1.0192
No log	0.8718	34	1.0540	0.2731	1.0540	1.0266
No log	0.9231	36	1.1477	0.3038	1.1477	1.0713
No log	0.9744	38	1.3617	0.0776	1.3617	1.1669
No log	1.0256	40	1.4191	0.1165	1.4191	1.1913
No log	1.0769	42	1.4639	0.0926	1.4639	1.2099
No log	1.1282	44	1.5390	0.0562	1.5390	1.2406
No log	1.1795	46	1.4621	0.0792	1.4621	1.2092
No log	1.2308	48	1.3411	0.1371	1.3411	1.1581
No log	1.2821	50	1.2804	0.1257	1.2804	1.1315
No log	1.3333	52	1.2108	0.2234	1.2108	1.1004
No log	1.3846	54	1.2087	0.1830	1.2087	1.0994
No log	1.4359	56	1.2401	0.1448	1.2401	1.1136
No log	1.4872	58	1.3678	0.1549	1.3678	1.1695
No log	1.5385	60	1.4547	0.0858	1.4547	1.2061
No log	1.5897	62	1.6093	0.1277	1.6093	1.2686
No log	1.6410	64	1.5257	0.0951	1.5257	1.2352
No log	1.6923	66	1.3221	0.0964	1.3221	1.1498
No log	1.7436	68	1.1944	0.2245	1.1944	1.0929
No log	1.7949	70	1.2165	0.2395	1.2165	1.1029
No log	1.8462	72	1.2142	0.2836	1.2142	1.1019
No log	1.8974	74	1.1664	0.2786	1.1664	1.0800
No log	1.9487	76	1.1534	0.3135	1.1534	1.0740
No log	2.0	78	1.1140	0.3140	1.1140	1.0555
No log	2.0513	80	1.0806	0.3195	1.0806	1.0395
No log	2.1026	82	1.0702	0.3195	1.0702	1.0345
No log	2.1538	84	1.0722	0.3038	1.0722	1.0355
No log	2.2051	86	1.0445	0.2886	1.0445	1.0220
No log	2.2564	88	1.0559	0.2815	1.0559	1.0276
No log	2.3077	90	1.0264	0.3310	1.0264	1.0131
No log	2.3590	92	1.0012	0.3570	1.0012	1.0006
No log	2.4103	94	1.0219	0.3615	1.0219	1.0109
No log	2.4615	96	1.1911	0.2543	1.1911	1.0914
No log	2.5128	98	1.6338	0.1298	1.6338	1.2782
No log	2.5641	100	1.6714	0.1324	1.6714	1.2928
No log	2.6154	102	1.3831	0.0210	1.3831	1.1761
No log	2.6667	104	1.2095	0.2491	1.2095	1.0998
No log	2.7179	106	1.0615	0.3527	1.0615	1.0303
No log	2.7692	108	1.0120	0.4077	1.0120	1.0060
No log	2.8205	110	0.9796	0.3627	0.9796	0.9897
No log	2.8718	112	0.9918	0.3627	0.9918	0.9959
No log	2.9231	114	1.0807	0.3614	1.0807	1.0395
No log	2.9744	116	1.2104	0.2654	1.2104	1.1002
No log	3.0256	118	1.1241	0.3390	1.1241	1.0602
No log	3.0769	120	1.0633	0.3614	1.0633	1.0312
No log	3.1282	122	1.0797	0.3243	1.0797	1.0391
No log	3.1795	124	1.0840	0.3418	1.0840	1.0412
No log	3.2308	126	1.0224	0.3115	1.0224	1.0111
No log	3.2821	128	0.9991	0.3237	0.9991	0.9995
No log	3.3333	130	0.9871	0.3237	0.9871	0.9936
No log	3.3846	132	1.0125	0.3237	1.0125	1.0062
No log	3.4359	134	1.0563	0.2942	1.0563	1.0277
No log	3.4872	136	1.0973	0.3237	1.0973	1.0475
No log	3.5385	138	1.1485	0.3527	1.1485	1.0717
No log	3.5897	140	1.1724	0.3571	1.1724	1.0828
No log	3.6410	142	1.1875	0.3230	1.1875	1.0897
No log	3.6923	144	1.0711	0.3788	1.0711	1.0349
No log	3.7436	146	1.0983	0.2297	1.0983	1.0480
No log	3.7949	148	1.2193	0.3606	1.2193	1.1042
No log	3.8462	150	1.1687	0.2294	1.1687	1.0810
No log	3.8974	152	1.1520	0.3243	1.1520	1.0733
No log	3.9487	154	1.2679	0.2233	1.2679	1.1260
No log	4.0	156	1.3003	0.2961	1.3003	1.1403
No log	4.0513	158	1.2485	0.2712	1.2485	1.1173
No log	4.1026	160	1.2434	0.0955	1.2434	1.1151
No log	4.1538	162	1.2522	0.1331	1.2522	1.1190
No log	4.2051	164	1.2422	0.1477	1.2422	1.1146
No log	4.2564	166	1.2413	0.2199	1.2413	1.1141
No log	4.3077	168	1.2270	0.2239	1.2270	1.1077
No log	4.3590	170	1.2167	0.2417	1.2167	1.1031
No log	4.4103	172	1.1987	0.1331	1.1987	1.0948
No log	4.4615	174	1.1748	0.2303	1.1748	1.0839
No log	4.5128	176	1.1308	0.2508	1.1308	1.0634
No log	4.5641	178	1.1075	0.3637	1.1075	1.0524
No log	4.6154	180	1.1031	0.3363	1.1031	1.0503
No log	4.6667	182	1.0406	0.3637	1.0406	1.0201
No log	4.7179	184	1.0247	0.3650	1.0247	1.0123
No log	4.7692	186	1.0421	0.3224	1.0421	1.0208
No log	4.8205	188	1.1132	0.3276	1.1132	1.0551
No log	4.8718	190	1.1083	0.3256	1.1083	1.0527
No log	4.9231	192	1.0424	0.3224	1.0424	1.0210
No log	4.9744	194	1.0236	0.3399	1.0236	1.0117
No log	5.0256	196	1.0240	0.3829	1.0240	1.0119
No log	5.0769	198	1.0582	0.3268	1.0582	1.0287
No log	5.1282	200	1.1069	0.2747	1.1069	1.0521
No log	5.1795	202	1.1123	0.3113	1.1123	1.0547
No log	5.2308	204	1.1341	0.2629	1.1341	1.0649
No log	5.2821	206	1.1578	0.2157	1.1578	1.0760
No log	5.3333	208	1.2348	0.2476	1.2348	1.1112
No log	5.3846	210	1.2443	0.2476	1.2443	1.1155
No log	5.4359	212	1.1721	0.1967	1.1721	1.0826
No log	5.4872	214	1.1461	0.2898	1.1461	1.0706
No log	5.5385	216	1.1223	0.3113	1.1223	1.0594
No log	5.5897	218	1.1199	0.2697	1.1199	1.0583
No log	5.6410	220	1.1255	0.2489	1.1255	1.0609
No log	5.6923	222	1.1428	0.2898	1.1428	1.0690
No log	5.7436	224	1.1562	0.3015	1.1562	1.0753
No log	5.7949	226	1.1693	0.3015	1.1693	1.0813
No log	5.8462	228	1.1834	0.2608	1.1834	1.0878
No log	5.8974	230	1.1644	0.3185	1.1644	1.0791
No log	5.9487	232	1.1383	0.2614	1.1383	1.0669
No log	6.0	234	1.1701	0.2372	1.1701	1.0817
No log	6.0513	236	1.2415	0.2766	1.2415	1.1142
No log	6.1026	238	1.2231	0.2844	1.2231	1.1059
No log	6.1538	240	1.1381	0.2349	1.1381	1.0668
No log	6.2051	242	1.1276	0.2946	1.1276	1.0619
No log	6.2564	244	1.0912	0.3160	1.0912	1.0446
No log	6.3077	246	1.0372	0.3437	1.0372	1.0185
No log	6.3590	248	1.0445	0.3086	1.0445	1.0220
No log	6.4103	250	1.0537	0.2864	1.0537	1.0265
No log	6.4615	252	1.0736	0.2864	1.0736	1.0361
No log	6.5128	254	1.0736	0.2864	1.0736	1.0361
No log	6.5641	256	1.0727	0.2915	1.0727	1.0357
No log	6.6154	258	1.0880	0.2864	1.0880	1.0430
No log	6.6667	260	1.1084	0.3310	1.1084	1.0528
No log	6.7179	262	1.1022	0.2963	1.1022	1.0499
No log	6.7692	264	1.0538	0.3216	1.0538	1.0266
No log	6.8205	266	1.0263	0.2864	1.0263	1.0131
No log	6.8718	268	1.0377	0.3147	1.0377	1.0187
No log	6.9231	270	1.0222	0.3609	1.0222	1.0111
No log	6.9744	272	1.0185	0.2967	1.0185	1.0092
No log	7.0256	274	1.0309	0.2416	1.0309	1.0153
No log	7.0769	276	1.0560	0.3411	1.0560	1.0276
No log	7.1282	278	1.0543	0.2965	1.0543	1.0268
No log	7.1795	280	1.0627	0.2993	1.0627	1.0309
No log	7.2308	282	1.0699	0.2605	1.0699	1.0344
No log	7.2821	284	1.0549	0.3396	1.0549	1.0271
No log	7.3333	286	1.0904	0.3346	1.0904	1.0442
No log	7.3846	288	1.1317	0.3033	1.1317	1.0638
No log	7.4359	290	1.0852	0.3250	1.0852	1.0417
No log	7.4872	292	1.0583	0.3399	1.0583	1.0287
No log	7.5385	294	1.0541	0.3399	1.0541	1.0267
No log	7.5897	296	1.0681	0.3424	1.0681	1.0335
No log	7.6410	298	1.0830	0.2453	1.0830	1.0407
No log	7.6923	300	1.1026	0.2092	1.1026	1.0501
No log	7.7436	302	1.1222	0.2647	1.1222	1.0594
No log	7.7949	304	1.1382	0.2521	1.1382	1.0668
No log	7.8462	306	1.1209	0.2618	1.1209	1.0587
No log	7.8974	308	1.0930	0.2914	1.0930	1.0455
No log	7.9487	310	1.0747	0.2556	1.0747	1.0367
No log	8.0	312	1.0892	0.2556	1.0892	1.0436
No log	8.0513	314	1.0870	0.2100	1.0870	1.0426
No log	8.1026	316	1.0856	0.2447	1.0856	1.0419
No log	8.1538	318	1.0902	0.2793	1.0902	1.0441
No log	8.2051	320	1.1149	0.2528	1.1149	1.0559
No log	8.2564	322	1.1113	0.2528	1.1113	1.0542
No log	8.3077	324	1.0966	0.3094	1.0966	1.0472
No log	8.3590	326	1.0655	0.3363	1.0655	1.0322
No log	8.4103	328	1.0346	0.3796	1.0346	1.0172
No log	8.4615	330	1.0224	0.3639	1.0224	1.0111
No log	8.5128	332	1.0129	0.3522	1.0129	1.0064
No log	8.5641	334	1.0977	0.3299	1.0977	1.0477
No log	8.6154	336	1.1232	0.3299	1.1232	1.0598
No log	8.6667	338	1.0642	0.3089	1.0642	1.0316
No log	8.7179	340	1.0855	0.2988	1.0855	1.0419
No log	8.7692	342	1.2081	0.2424	1.2081	1.0991
No log	8.8205	344	1.1873	0.2337	1.1873	1.0896
No log	8.8718	346	1.0648	0.3036	1.0648	1.0319
No log	8.9231	348	1.0049	0.3541	1.0049	1.0025
No log	8.9744	350	1.0282	0.3834	1.0282	1.0140
No log	9.0256	352	1.0963	0.4166	1.0963	1.0470
No log	9.0769	354	1.0511	0.4165	1.0511	1.0253
No log	9.1282	356	0.9647	0.3938	0.9647	0.9822
No log	9.1795	358	1.0006	0.2795	1.0006	1.0003
No log	9.2308	360	1.0053	0.3133	1.0053	1.0027
No log	9.2821	362	1.0020	0.3210	1.0020	1.0010
No log	9.3333	364	1.0211	0.2892	1.0211	1.0105
No log	9.3846	366	1.0527	0.2892	1.0527	1.0260
No log	9.4359	368	1.0818	0.3328	1.0818	1.0401
No log	9.4872	370	1.1302	0.3059	1.1302	1.0631
No log	9.5385	372	1.1093	0.2988	1.1093	1.0532
No log	9.5897	374	1.0723	0.2919	1.0723	1.0355
No log	9.6410	376	1.0806	0.2743	1.0806	1.0395
No log	9.6923	378	1.0777	0.2394	1.0777	1.0381
No log	9.7436	380	1.0919	0.2253	1.0919	1.0449
No log	9.7949	382	1.0968	0.2103	1.0968	1.0473
No log	9.8462	384	1.0954	0.2545	1.0954	1.0466
No log	9.8974	386	1.0962	0.2545	1.0962	1.0470
No log	9.9487	388	1.0940	0.2545	1.0940	1.0459
No log	10.0	390	1.1061	0.2253	1.1061	1.0517
No log	10.0513	392	1.1016	0.1912	1.1016	1.0496
No log	10.1026	394	1.1257	0.1912	1.1257	1.0610
No log	10.1538	396	1.1351	0.2306	1.1351	1.0654
No log	10.2051	398	1.1553	0.2651	1.1553	1.0748
No log	10.2564	400	1.0948	0.1912	1.0948	1.0463
No log	10.3077	402	1.0667	0.2103	1.0667	1.0328
No log	10.3590	404	1.0462	0.2743	1.0462	1.0228
No log	10.4103	406	1.0308	0.2743	1.0308	1.0153
No log	10.4615	408	1.0153	0.3142	1.0153	1.0076
No log	10.5128	410	1.0116	0.3448	1.0116	1.0058
No log	10.5641	412	1.0038	0.3753	1.0038	1.0019
No log	10.6154	414	0.9945	0.3309	0.9945	0.9973
No log	10.6667	416	0.9928	0.3309	0.9928	0.9964
No log	10.7179	418	1.0035	0.3854	1.0035	1.0017
No log	10.7692	420	1.0386	0.3270	1.0386	1.0191
No log	10.8205	422	1.0490	0.3098	1.0490	1.0242
No log	10.8718	424	1.0447	0.3119	1.0447	1.0221
No log	10.9231	426	1.0864	0.2618	1.0864	1.0423
No log	10.9744	428	1.1114	0.2521	1.1114	1.0542
No log	11.0256	430	1.1409	0.2233	1.1409	1.0681
No log	11.0769	432	1.0944	0.2618	1.0944	1.0461
No log	11.1282	434	1.0198	0.2601	1.0198	1.0098
No log	11.1795	436	1.0374	0.3418	1.0374	1.0185
No log	11.2308	438	1.1057	0.3543	1.1057	1.0515
No log	11.2821	440	1.1058	0.3543	1.1058	1.0516
No log	11.3333	442	1.0465	0.3677	1.0465	1.0230
No log	11.3846	444	0.9976	0.3453	0.9976	0.9988
No log	11.4359	446	1.0267	0.3013	1.0267	1.0133
No log	11.4872	448	1.0642	0.2844	1.0642	1.0316
No log	11.5385	450	1.0471	0.3036	1.0471	1.0233
No log	11.5897	452	1.0147	0.2499	1.0147	1.0073
No log	11.6410	454	1.0245	0.3508	1.0245	1.0122
No log	11.6923	456	1.0431	0.2792	1.0431	1.0213
No log	11.7436	458	1.0374	0.3326	1.0374	1.0185
No log	11.7949	460	1.0674	0.3062	1.0674	1.0332
No log	11.8462	462	1.1507	0.3330	1.1507	1.0727
No log	11.8974	464	1.2123	0.3660	1.2123	1.1010
No log	11.9487	466	1.1490	0.3506	1.1490	1.0719
No log	12.0	468	1.0274	0.3081	1.0274	1.0136
No log	12.0513	470	0.9737	0.3210	0.9737	0.9868
No log	12.1026	472	0.9801	0.3762	0.9801	0.9900
No log	12.1538	474	0.9810	0.3463	0.9810	0.9905
No log	12.2051	476	0.9644	0.3408	0.9644	0.9820
No log	12.2564	478	0.9871	0.3382	0.9871	0.9935
No log	12.3077	480	1.0559	0.3033	1.0559	1.0276
No log	12.3590	482	1.0715	0.3033	1.0715	1.0351
No log	12.4103	484	1.0217	0.2395	1.0217	1.0108
No log	12.4615	486	1.0046	0.3663	1.0046	1.0023
No log	12.5128	488	1.0427	0.4065	1.0427	1.0211
No log	12.5641	490	1.0521	0.3820	1.0521	1.0257
No log	12.6154	492	1.0411	0.3408	1.0411	1.0204
No log	12.6667	494	1.0670	0.2584	1.0670	1.0329
No log	12.7179	496	1.1656	0.3074	1.1656	1.0797
No log	12.7692	498	1.1880	0.3207	1.1880	1.0900
0.3504	12.8205	500	1.1234	0.2748	1.1234	1.0599
0.3504	12.8718	502	1.0588	0.2265	1.0588	1.0290
0.3504	12.9231	504	1.0440	0.3070	1.0440	1.0217
0.3504	12.9744	506	1.0454	0.3196	1.0454	1.0224
0.3504	13.0256	508	1.0304	0.3094	1.0304	1.0151
0.3504	13.0769	510	1.0239	0.2793	1.0239	1.0119
0.3504	13.1282	512	1.0287	0.2793	1.0287	1.0142
0.3504	13.1795	514	1.0478	0.3346	1.0478	1.0236
0.3504	13.2308	516	1.0746	0.3312	1.0746	1.0366
0.3504	13.2821	518	1.0746	0.3346	1.0746	1.0366
0.3504	13.3333	520	1.0581	0.3301	1.0581	1.0287
0.3504	13.3846	522	1.0534	0.2793	1.0534	1.0263
0.3504	13.4359	524	1.0568	0.3508	1.0568	1.0280
0.3504	13.4872	526	1.0577	0.3243	1.0577	1.0284
0.3504	13.5385	528	1.0601	0.2255	1.0601	1.0296
0.3504	13.5897	530	1.0686	0.2647	1.0686	1.0337
0.3504	13.6410	532	1.0644	0.2310	1.0644	1.0317
0.3504	13.6923	534	1.0651	0.2509	1.0651	1.0320
0.3504	13.7436	536	1.0665	0.2509	1.0665	1.0327

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1