ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1085
• Qwk: 0.1388
• Mse: 1.1085
• Rmse: 1.0529

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.6107	-0.0132	4.6107	2.1472
No log	0.2667	4	2.8159	-0.0576	2.8159	1.6781
No log	0.4	6	2.6770	-0.1020	2.6770	1.6362
No log	0.5333	8	2.3342	-0.1073	2.3342	1.5278
No log	0.6667	10	1.7617	-0.0417	1.7617	1.3273
No log	0.8	12	1.4053	0.0136	1.4053	1.1854
No log	0.9333	14	1.3585	-0.0674	1.3585	1.1655
No log	1.0667	16	1.3423	0.1016	1.3423	1.1586
No log	1.2	18	1.4878	0.0538	1.4878	1.2198
No log	1.3333	20	1.7530	0.0889	1.7530	1.3240
No log	1.4667	22	1.6405	0.0372	1.6405	1.2808
No log	1.6	24	1.6000	0.1080	1.6000	1.2649
No log	1.7333	26	1.4302	0.1625	1.4302	1.1959
No log	1.8667	28	1.3929	0.1748	1.3929	1.1802
No log	2.0	30	1.2696	0.1347	1.2696	1.1268
No log	2.1333	32	1.2421	0.1230	1.2421	1.1145
No log	2.2667	34	1.3561	0.1493	1.3561	1.1645
No log	2.4	36	1.6973	0.1125	1.6973	1.3028
No log	2.5333	38	1.7468	0.0392	1.7468	1.3217
No log	2.6667	40	1.4259	0.1568	1.4259	1.1941
No log	2.8	42	1.2934	0.2432	1.2934	1.1373
No log	2.9333	44	1.3200	0.2058	1.3200	1.1489
No log	3.0667	46	1.3856	0.1027	1.3856	1.1771
No log	3.2	48	1.4368	0.1197	1.4368	1.1987
No log	3.3333	50	1.4052	0.1084	1.4052	1.1854
No log	3.4667	52	1.4344	0.1115	1.4344	1.1977
No log	3.6	54	1.4172	0.1334	1.4172	1.1904
No log	3.7333	56	1.4649	0.1469	1.4649	1.2103
No log	3.8667	58	1.4957	0.1730	1.4957	1.2230
No log	4.0	60	1.3208	0.1311	1.3208	1.1493
No log	4.1333	62	1.1685	0.2913	1.1685	1.0810
No log	4.2667	64	1.1839	0.2735	1.1839	1.0881
No log	4.4	66	1.2364	0.2690	1.2364	1.1120
No log	4.5333	68	1.2184	0.2885	1.2184	1.1038
No log	4.6667	70	1.3021	0.2631	1.3021	1.1411
No log	4.8	72	1.6955	0.1888	1.6955	1.3021
No log	4.9333	74	1.7393	0.1776	1.7393	1.3188
No log	5.0667	76	1.4665	0.2306	1.4665	1.2110
No log	5.2	78	1.4777	0.2306	1.4777	1.2156
No log	5.3333	80	1.6442	0.2377	1.6442	1.2822
No log	5.4667	82	1.3752	0.1830	1.3752	1.1727
No log	5.6	84	1.1938	0.1975	1.1938	1.0926
No log	5.7333	86	1.2477	0.2180	1.2477	1.1170
No log	5.8667	88	1.2760	0.2280	1.2760	1.1296
No log	6.0	90	1.4303	0.1730	1.4303	1.1959
No log	6.1333	92	1.4589	0.1306	1.4589	1.2079
No log	6.2667	94	1.4549	0.1977	1.4549	1.2062
No log	6.4	96	1.2046	0.2452	1.2046	1.0976
No log	6.5333	98	1.0873	0.2662	1.0873	1.0427
No log	6.6667	100	1.1085	0.2278	1.1085	1.0529
No log	6.8	102	1.2362	0.2369	1.2362	1.1118
No log	6.9333	104	1.2545	0.2361	1.2545	1.1200
No log	7.0667	106	1.2106	0.2361	1.2106	1.1003
No log	7.2	108	1.1934	0.2544	1.1934	1.0924
No log	7.3333	110	1.2952	0.2627	1.2952	1.1381
No log	7.4667	112	1.2733	0.3028	1.2733	1.1284
No log	7.6	114	1.2687	0.2484	1.2687	1.1264
No log	7.7333	116	1.3225	0.2133	1.3225	1.1500
No log	7.8667	118	1.3072	0.2600	1.3072	1.1433
No log	8.0	120	1.1981	0.3161	1.1981	1.0946
No log	8.1333	122	1.1315	0.3142	1.1315	1.0637
No log	8.2667	124	1.0562	0.2832	1.0562	1.0277
No log	8.4	126	1.0860	0.2832	1.0860	1.0421
No log	8.5333	128	1.2905	0.3115	1.2905	1.1360
No log	8.6667	130	1.5223	0.2172	1.5223	1.2338
No log	8.8	132	1.6488	0.1206	1.6488	1.2841
No log	8.9333	134	1.2517	0.2771	1.2517	1.1188
No log	9.0667	136	1.1059	0.3579	1.1059	1.0516
No log	9.2	138	1.0413	0.2991	1.0413	1.0204
No log	9.3333	140	1.1137	0.2779	1.1137	1.0553
No log	9.4667	142	1.2919	0.2607	1.2919	1.1366
No log	9.6	144	1.3301	0.2607	1.3301	1.1533
No log	9.7333	146	1.3197	0.2351	1.3197	1.1488
No log	9.8667	148	1.1911	0.2942	1.1911	1.0914
No log	10.0	150	1.1673	0.2920	1.1673	1.0804
No log	10.1333	152	1.1265	0.3052	1.1265	1.0614
No log	10.2667	154	1.1783	0.2444	1.1783	1.0855
No log	10.4	156	1.0955	0.3255	1.0955	1.0467
No log	10.5333	158	1.0919	0.3913	1.0919	1.0449
No log	10.6667	160	1.2907	0.2739	1.2907	1.1361
No log	10.8	162	1.3524	0.2501	1.3524	1.1629
No log	10.9333	164	1.3148	0.2739	1.3148	1.1467
No log	11.0667	166	1.3018	0.3135	1.3018	1.1409
No log	11.2	168	1.2508	0.2832	1.2508	1.1184
No log	11.3333	170	1.1612	0.3052	1.1612	1.0776
No log	11.4667	172	1.0758	0.3208	1.0758	1.0372
No log	11.6	174	1.0718	0.3590	1.0718	1.0353
No log	11.7333	176	1.2100	0.3161	1.2100	1.1000
No log	11.8667	178	1.2978	0.3418	1.2978	1.1392
No log	12.0	180	1.1427	0.3505	1.1427	1.0690
No log	12.1333	182	1.0828	0.3353	1.0828	1.0406
No log	12.2667	184	1.0795	0.3031	1.0795	1.0390
No log	12.4	186	1.0970	0.2716	1.0970	1.0474
No log	12.5333	188	1.0506	0.2472	1.0506	1.0250
No log	12.6667	190	1.0719	0.3629	1.0719	1.0353
No log	12.8	192	1.1298	0.3189	1.1298	1.0629
No log	12.9333	194	1.1540	0.3273	1.1540	1.0742
No log	13.0667	196	1.1958	0.2431	1.1958	1.0935
No log	13.2	198	1.1374	0.2702	1.1374	1.0665
No log	13.3333	200	1.0473	0.2608	1.0473	1.0234
No log	13.4667	202	1.0172	0.4505	1.0172	1.0086
No log	13.6	204	1.0102	0.3948	1.0102	1.0051
No log	13.7333	206	1.0562	0.2654	1.0562	1.0277
No log	13.8667	208	1.2441	0.2815	1.2441	1.1154
No log	14.0	210	1.4222	0.2489	1.4222	1.1926
No log	14.1333	212	1.2230	0.2688	1.2230	1.1059
No log	14.2667	214	1.0725	0.2787	1.0725	1.0356
No log	14.4	216	1.0082	0.3286	1.0082	1.0041
No log	14.5333	218	0.9839	0.3608	0.9839	0.9919
No log	14.6667	220	1.0048	0.3440	1.0048	1.0024
No log	14.8	222	1.0544	0.3711	1.0544	1.0268
No log	14.9333	224	1.1130	0.3077	1.1130	1.0550
No log	15.0667	226	1.1108	0.2832	1.1108	1.0540
No log	15.2	228	1.0738	0.3286	1.0738	1.0362
No log	15.3333	230	1.0601	0.3301	1.0601	1.0296
No log	15.4667	232	1.0489	0.3301	1.0489	1.0242
No log	15.6	234	1.0682	0.2747	1.0682	1.0335
No log	15.7333	236	1.0590	0.2747	1.0590	1.0291
No log	15.8667	238	1.0354	0.3115	1.0354	1.0175
No log	16.0	240	1.0673	0.2461	1.0673	1.0331
No log	16.1333	242	1.0922	0.2670	1.0922	1.0451
No log	16.2667	244	1.1167	0.2445	1.1167	1.0567
No log	16.4	246	1.1472	0.2534	1.1472	1.0711
No log	16.5333	248	1.1727	0.2611	1.1727	1.0829
No log	16.6667	250	1.1521	0.2857	1.1521	1.0734
No log	16.8	252	1.0854	0.2901	1.0854	1.0418
No log	16.9333	254	1.0349	0.3199	1.0349	1.0173
No log	17.0667	256	1.0283	0.2892	1.0283	1.0141
No log	17.2	258	1.0243	0.2658	1.0243	1.0121
No log	17.3333	260	1.0477	0.3738	1.0477	1.0236
No log	17.4667	262	1.0724	0.4328	1.0724	1.0356
No log	17.6	264	1.0371	0.4435	1.0371	1.0184
No log	17.7333	266	1.1294	0.3074	1.1294	1.0627
No log	17.8667	268	1.1844	0.3267	1.1844	1.0883
No log	18.0	270	1.0902	0.3031	1.0902	1.0441
No log	18.1333	272	1.0361	0.3194	1.0361	1.0179
No log	18.2667	274	1.0368	0.3199	1.0368	1.0182
No log	18.4	276	1.0740	0.3218	1.0740	1.0363
No log	18.5333	278	1.1009	0.3124	1.1009	1.0492
No log	18.6667	280	1.0310	0.3373	1.0310	1.0154
No log	18.8	282	1.0174	0.3022	1.0174	1.0086
No log	18.9333	284	1.0770	0.2857	1.0770	1.0378
No log	19.0667	286	1.0511	0.2248	1.0511	1.0252
No log	19.2	288	1.0237	0.3210	1.0237	1.0118
No log	19.3333	290	1.1437	0.2507	1.1437	1.0695
No log	19.4667	292	1.1366	0.2807	1.1366	1.0661
No log	19.6	294	1.0464	0.2871	1.0464	1.0230
No log	19.7333	296	1.0132	0.3263	1.0132	1.0066
No log	19.8667	298	1.0083	0.3263	1.0083	1.0042
No log	20.0	300	0.9926	0.3196	0.9926	0.9963
No log	20.1333	302	0.9844	0.3641	0.9844	0.9922
No log	20.2667	304	0.9981	0.3728	0.9981	0.9991
No log	20.4	306	1.0236	0.2939	1.0236	1.0117
No log	20.5333	308	1.0316	0.2605	1.0316	1.0157
No log	20.6667	310	1.0098	0.2682	1.0098	1.0049
No log	20.8	312	1.0305	0.2588	1.0305	1.0151
No log	20.9333	314	1.0881	0.3305	1.0881	1.0431
No log	21.0667	316	1.0805	0.2605	1.0805	1.0395
No log	21.2	318	1.0602	0.2315	1.0602	1.0297
No log	21.3333	320	1.0521	0.2697	1.0521	1.0257
No log	21.4667	322	1.0464	0.3015	1.0464	1.0229
No log	21.6	324	1.0509	0.2596	1.0509	1.0251
No log	21.7333	326	1.0543	0.2919	1.0543	1.0268
No log	21.8667	328	1.0368	0.2355	1.0368	1.0182
No log	22.0	330	1.0245	0.1671	1.0245	1.0122
No log	22.1333	332	1.0169	0.1671	1.0169	1.0084
No log	22.2667	334	1.0177	0.2843	1.0177	1.0088
No log	22.4	336	1.0260	0.3159	1.0260	1.0129
No log	22.5333	338	1.0464	0.2943	1.0464	1.0229
No log	22.6667	340	1.0373	0.2967	1.0373	1.0185
No log	22.8	342	1.0486	0.2877	1.0486	1.0240
No log	22.9333	344	1.0563	0.2877	1.0563	1.0278
No log	23.0667	346	1.0499	0.2572	1.0499	1.0247
No log	23.2	348	1.0444	0.2572	1.0444	1.0219
No log	23.3333	350	1.0659	0.2035	1.0659	1.0324
No log	23.4667	352	1.0411	0.2128	1.0411	1.0204
No log	23.6	354	1.0709	0.2230	1.0709	1.0348
No log	23.7333	356	1.1856	0.2498	1.1856	1.0889
No log	23.8667	358	1.1334	0.2585	1.1334	1.0646
No log	24.0	360	1.0510	0.3243	1.0510	1.0252
No log	24.1333	362	0.9954	0.2988	0.9954	0.9977
No log	24.2667	364	0.9418	0.3421	0.9418	0.9705
No log	24.4	366	0.9271	0.3629	0.9271	0.9629
No log	24.5333	368	0.9488	0.3433	0.9488	0.9740
No log	24.6667	370	0.9650	0.3572	0.9650	0.9824
No log	24.8	372	0.9509	0.3294	0.9509	0.9751
No log	24.9333	374	0.9608	0.3137	0.9608	0.9802
No log	25.0667	376	1.0074	0.3294	1.0074	1.0037
No log	25.2	378	1.1305	0.3243	1.1305	1.0632
No log	25.3333	380	1.2199	0.3171	1.2199	1.1045
No log	25.4667	382	1.1829	0.3363	1.1829	1.0876
No log	25.6	384	1.0757	0.3052	1.0757	1.0371
No log	25.7333	386	1.0009	0.3036	1.0009	1.0004
No log	25.8667	388	0.9691	0.3421	0.9691	0.9844
No log	26.0	390	0.9609	0.2991	0.9609	0.9803
No log	26.1333	392	0.9773	0.3014	0.9773	0.9886
No log	26.2667	394	1.0574	0.3424	1.0574	1.0283
No log	26.4	396	1.2011	0.3044	1.2011	1.0959
No log	26.5333	398	1.2462	0.3044	1.2462	1.1163
No log	26.6667	400	1.2083	0.3145	1.2083	1.0992
No log	26.8	402	1.1334	0.3135	1.1334	1.0646
No log	26.9333	404	1.0986	0.2966	1.0986	1.0481
No log	27.0667	406	1.1623	0.2702	1.1623	1.0781
No log	27.2	408	1.2654	0.3044	1.2654	1.1249
No log	27.3333	410	1.3137	0.3103	1.3137	1.1462
No log	27.4667	412	1.1652	0.3026	1.1652	1.0794
No log	27.6	414	1.0249	0.2989	1.0249	1.0124
No log	27.7333	416	0.9764	0.3987	0.9764	0.9881
No log	27.8667	418	0.9616	0.3309	0.9616	0.9806
No log	28.0	420	0.9710	0.3747	0.9710	0.9854
No log	28.1333	422	1.0077	0.3668	1.0077	1.0039
No log	28.2667	424	1.0375	0.3476	1.0375	1.0186
No log	28.4	426	1.0612	0.3010	1.0612	1.0302
No log	28.5333	428	1.1187	0.2361	1.1187	1.0577
No log	28.6667	430	1.2704	0.3410	1.2704	1.1271
No log	28.8	432	1.3897	0.3453	1.3897	1.1789
No log	28.9333	434	1.3313	0.3293	1.3313	1.1538
No log	29.0667	436	1.1420	0.2270	1.1420	1.0687
No log	29.2	438	1.0705	0.3275	1.0705	1.0347
No log	29.3333	440	1.0595	0.3039	1.0595	1.0293
No log	29.4667	442	1.0970	0.2730	1.0970	1.0474
No log	29.6	444	1.1324	0.3033	1.1324	1.0642
No log	29.7333	446	1.1609	0.3078	1.1609	1.0774
No log	29.8667	448	1.1033	0.3033	1.1033	1.0504
No log	30.0	450	1.0556	0.3788	1.0556	1.0274
No log	30.1333	452	1.0541	0.3788	1.0541	1.0267
No log	30.2667	454	1.0516	0.3275	1.0516	1.0255
No log	30.4	456	1.0630	0.3319	1.0630	1.0310
No log	30.5333	458	1.0667	0.2918	1.0667	1.0328
No log	30.6667	460	1.0896	0.2714	1.0896	1.0438
No log	30.8	462	1.1896	0.2094	1.1896	1.0907
No log	30.9333	464	1.2752	0.2398	1.2752	1.1293
No log	31.0667	466	1.3847	0.2437	1.3847	1.1767
No log	31.2	468	1.5343	0.2830	1.5343	1.2387
No log	31.3333	470	1.6057	0.2613	1.6057	1.2672
No log	31.4667	472	1.5160	0.2226	1.5160	1.2312
No log	31.6	474	1.3568	0.2451	1.3568	1.1648
No log	31.7333	476	1.1679	0.1906	1.1679	1.0807
No log	31.8667	478	1.1483	0.1898	1.1483	1.0716
No log	32.0	480	1.1210	0.1943	1.1210	1.0588
No log	32.1333	482	1.1566	0.2088	1.1566	1.0755
No log	32.2667	484	1.1905	0.1905	1.1905	1.0911
No log	32.4	486	1.1482	0.1542	1.1482	1.0716
No log	32.5333	488	1.0909	0.1830	1.0909	1.0445
No log	32.6667	490	1.0650	0.2057	1.0650	1.0320
No log	32.8	492	1.0722	0.1362	1.0722	1.0355
No log	32.9333	494	1.0781	0.1785	1.0781	1.0383
No log	33.0667	496	1.1345	0.2180	1.1345	1.0652
No log	33.2	498	1.1534	0.2410	1.1534	1.0740
0.279	33.3333	500	1.1575	0.2320	1.1575	1.0759
0.279	33.4667	502	1.0885	0.2221	1.0885	1.0433
0.279	33.6	504	1.0582	0.2314	1.0582	1.0287
0.279	33.7333	506	1.0634	0.2471	1.0634	1.0312
0.279	33.8667	508	1.0942	0.1634	1.0942	1.0460
0.279	34.0	510	1.1240	0.2324	1.1240	1.0602
0.279	34.1333	512	1.1865	0.2049	1.1865	1.0893
0.279	34.2667	514	1.1908	0.2049	1.1908	1.0912
0.279	34.4	516	1.1259	0.2180	1.1259	1.0611
0.279	34.5333	518	1.0791	0.2416	1.0791	1.0388
0.279	34.6667	520	1.0722	0.2729	1.0722	1.0355
0.279	34.8	522	1.0725	0.2782	1.0725	1.0356
0.279	34.9333	524	1.0912	0.2169	1.0912	1.0446
0.279	35.0667	526	1.1390	0.2324	1.1390	1.0672
0.279	35.2	528	1.1783	0.2627	1.1783	1.0855
0.279	35.3333	530	1.1656	0.2410	1.1656	1.0796
0.279	35.4667	532	1.1167	0.2876	1.1167	1.0567
0.279	35.6	534	1.1000	0.2529	1.1000	1.0488
0.279	35.7333	536	1.1280	0.2445	1.1280	1.0621
0.279	35.8667	538	1.1815	0.2230	1.1815	1.0870
0.279	36.0	540	1.1872	0.2230	1.1872	1.0896
0.279	36.1333	542	1.1126	0.2140	1.1126	1.0548
0.279	36.2667	544	1.0738	0.2417	1.0738	1.0362
0.279	36.4	546	1.0719	0.2180	1.0719	1.0353
0.279	36.5333	548	1.0743	0.2605	1.0743	1.0365
0.279	36.6667	550	1.0686	0.3199	1.0686	1.0337
0.279	36.8	552	1.0803	0.2544	1.0803	1.0394
0.279	36.9333	554	1.0974	0.2361	1.0974	1.0476
0.279	37.0667	556	1.1490	0.2230	1.1490	1.0719
0.279	37.2	558	1.1335	0.2320	1.1335	1.0647
0.279	37.3333	560	1.1048	0.2320	1.1048	1.0511
0.279	37.4667	562	1.0793	0.2732	1.0793	1.0389
0.279	37.6	564	1.0611	0.2605	1.0611	1.0301
0.279	37.7333	566	1.0463	0.3310	1.0463	1.0229
0.279	37.8667	568	1.0431	0.3163	1.0431	1.0213
0.279	38.0	570	1.0367	0.3299	1.0367	1.0182
0.279	38.1333	572	1.0436	0.3299	1.0436	1.0216
0.279	38.2667	574	1.0587	0.2815	1.0587	1.0290
0.279	38.4	576	1.1088	0.2138	1.1088	1.0530
0.279	38.5333	578	1.1553	0.2230	1.1553	1.0748
0.279	38.6667	580	1.1289	0.2320	1.1289	1.0625
0.279	38.8	582	1.0897	0.2486	1.0897	1.0439
0.279	38.9333	584	1.0724	0.3237	1.0724	1.0356
0.279	39.0667	586	1.0863	0.2358	1.0863	1.0423
0.279	39.2	588	1.1182	0.2259	1.1182	1.0575
0.279	39.3333	590	1.1357	0.2088	1.1357	1.0657
0.279	39.4667	592	1.1778	0.2140	1.1778	1.0853
0.279	39.6	594	1.1619	0.2138	1.1619	1.0779
0.279	39.7333	596	1.1085	0.1388	1.1085	1.0529

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1