ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k19_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1043
• Qwk: 0.1567
• Mse: 1.1043
• Rmse: 1.0508

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0222	2	4.1110	0.0078	4.1110	2.0276
No log	0.0444	4	2.0774	0.0348	2.0774	1.4413
No log	0.0667	6	1.3905	0.0759	1.3905	1.1792
No log	0.0889	8	1.3746	0.1428	1.3746	1.1724
No log	0.1111	10	1.0627	0.1532	1.0627	1.0309
No log	0.1333	12	1.0553	0.1935	1.0553	1.0273
No log	0.1556	14	1.2119	0.1783	1.2119	1.1009
No log	0.1778	16	2.0084	0.1225	2.0084	1.4172
No log	0.2	18	2.2647	0.0679	2.2647	1.5049
No log	0.2222	20	1.6779	0.1550	1.6779	1.2953
No log	0.2444	22	1.2421	0.3163	1.2421	1.1145
No log	0.2667	24	1.1845	0.2261	1.1845	1.0883
No log	0.2889	26	1.2881	0.2707	1.2881	1.1349
No log	0.3111	28	1.3545	0.2768	1.3545	1.1638
No log	0.3333	30	1.2471	0.2729	1.2471	1.1168
No log	0.3556	32	1.0608	0.2801	1.0608	1.0300
No log	0.3778	34	0.9887	0.3643	0.9887	0.9943
No log	0.4	36	1.0914	0.2690	1.0914	1.0447
No log	0.4222	38	1.5987	0.2724	1.5987	1.2644
No log	0.4444	40	2.1407	0.2001	2.1407	1.4631
No log	0.4667	42	1.9417	0.2020	1.9417	1.3934
No log	0.4889	44	1.4046	0.2255	1.4046	1.1851
No log	0.5111	46	1.0161	0.2956	1.0161	1.0080
No log	0.5333	48	0.9063	0.4192	0.9063	0.9520
No log	0.5556	50	0.9192	0.4041	0.9192	0.9588
No log	0.5778	52	1.0806	0.2203	1.0806	1.0395
No log	0.6	54	1.2532	0.1817	1.2532	1.1195
No log	0.6222	56	1.3338	0.1883	1.3338	1.1549
No log	0.6444	58	1.2876	0.1883	1.2876	1.1347
No log	0.6667	60	1.2441	0.1988	1.2441	1.1154
No log	0.6889	62	1.0164	0.3183	1.0164	1.0082
No log	0.7111	64	0.9237	0.4133	0.9237	0.9611
No log	0.7333	66	0.9673	0.3393	0.9673	0.9835
No log	0.7556	68	1.2999	0.3095	1.2999	1.1401
No log	0.7778	70	1.6435	0.2479	1.6435	1.2820
No log	0.8	72	1.4915	0.2182	1.4915	1.2213
No log	0.8222	74	1.1725	0.3796	1.1725	1.0828
No log	0.8444	76	0.9894	0.3513	0.9894	0.9947
No log	0.8667	78	1.0341	0.2644	1.0341	1.0169
No log	0.8889	80	1.0685	0.2709	1.0685	1.0337
No log	0.9111	82	0.9577	0.2108	0.9577	0.9786
No log	0.9333	84	0.9488	0.3215	0.9488	0.9741
No log	0.9556	86	0.9545	0.4062	0.9545	0.9770
No log	0.9778	88	0.9617	0.4766	0.9617	0.9807
No log	1.0	90	1.0039	0.3402	1.0039	1.0020
No log	1.0222	92	0.9868	0.4540	0.9868	0.9934
No log	1.0444	94	0.9840	0.4164	0.9840	0.9920
No log	1.0667	96	0.9450	0.4012	0.9450	0.9721
No log	1.0889	98	0.9839	0.3230	0.9839	0.9919
No log	1.1111	100	0.9418	0.3335	0.9418	0.9705
No log	1.1333	102	0.9496	0.2794	0.9496	0.9745
No log	1.1556	104	0.9399	0.2794	0.9399	0.9695
No log	1.1778	106	0.9921	0.2807	0.9921	0.9960
No log	1.2	108	1.3307	0.2969	1.3307	1.1536
No log	1.2222	110	1.4224	0.2868	1.4224	1.1927
No log	1.2444	112	1.4251	0.2868	1.4251	1.1938
No log	1.2667	114	1.2744	0.2845	1.2744	1.1289
No log	1.2889	116	1.0712	0.2069	1.0712	1.0350
No log	1.3111	118	0.9935	0.3388	0.9935	0.9967
No log	1.3333	120	1.0547	0.2020	1.0547	1.0270
No log	1.3556	122	1.1711	0.2084	1.1711	1.0822
No log	1.3778	124	1.2402	0.3317	1.2402	1.1137
No log	1.4	126	1.0137	0.2344	1.0137	1.0068
No log	1.4222	128	0.9285	0.3896	0.9285	0.9636
No log	1.4444	130	0.9319	0.3154	0.9319	0.9653
No log	1.4667	132	1.0850	0.2690	1.0850	1.0417
No log	1.4889	134	1.2370	0.2524	1.2370	1.1122
No log	1.5111	136	1.1550	0.2443	1.1550	1.0747
No log	1.5333	138	0.9860	0.3674	0.9860	0.9930
No log	1.5556	140	0.9566	0.3647	0.9566	0.9780
No log	1.5778	142	0.9647	0.3744	0.9647	0.9822
No log	1.6	144	0.9916	0.3765	0.9916	0.9958
No log	1.6222	146	0.9835	0.3210	0.9835	0.9917
No log	1.6444	148	0.9790	0.3210	0.9790	0.9894
No log	1.6667	150	0.9378	0.3095	0.9378	0.9684
No log	1.6889	152	0.9270	0.2742	0.9270	0.9628
No log	1.7111	154	0.9486	0.4110	0.9486	0.9740
No log	1.7333	156	0.9934	0.3502	0.9934	0.9967
No log	1.7556	158	1.0490	0.3771	1.0490	1.0242
No log	1.7778	160	1.0538	0.4328	1.0538	1.0265
No log	1.8	162	1.0591	0.4560	1.0591	1.0291
No log	1.8222	164	1.0503	0.3634	1.0503	1.0249
No log	1.8444	166	1.0365	0.2447	1.0365	1.0181
No log	1.8667	168	1.0433	0.2228	1.0433	1.0214
No log	1.8889	170	1.0303	0.2360	1.0303	1.0150
No log	1.9111	172	1.1474	0.3034	1.1474	1.0712
No log	1.9333	174	1.1063	0.3034	1.1063	1.0518
No log	1.9556	176	0.9577	0.3721	0.9577	0.9786
No log	1.9778	178	0.9639	0.3463	0.9639	0.9818
No log	2.0	180	0.9501	0.3570	0.9501	0.9747
No log	2.0222	182	0.9223	0.4115	0.9223	0.9604
No log	2.0444	184	1.0684	0.2465	1.0684	1.0336
No log	2.0667	186	1.2759	0.2473	1.2759	1.1296
No log	2.0889	188	1.1989	0.2094	1.1989	1.0949
No log	2.1111	190	0.9644	0.4417	0.9644	0.9820
No log	2.1333	192	1.1129	0.2747	1.1129	1.0549
No log	2.1556	194	1.1223	0.2599	1.1223	1.0594
No log	2.1778	196	1.0010	0.4537	1.0010	1.0005
No log	2.2	198	1.0684	0.4212	1.0684	1.0336
No log	2.2222	200	1.1044	0.2869	1.1044	1.0509
No log	2.2444	202	0.9932	0.4030	0.9932	0.9966
No log	2.2667	204	0.9757	0.3465	0.9757	0.9878
No log	2.2889	206	0.9767	0.3445	0.9767	0.9883
No log	2.3111	208	0.9720	0.3129	0.9720	0.9859
No log	2.3333	210	0.9679	0.2667	0.9679	0.9838
No log	2.3556	212	1.0153	0.2923	1.0153	1.0076
No log	2.3778	214	1.0228	0.2923	1.0228	1.0114
No log	2.4	216	0.9949	0.2879	0.9949	0.9975
No log	2.4222	218	1.0229	0.3454	1.0229	1.0114
No log	2.4444	220	1.1183	0.2988	1.1183	1.0575
No log	2.4667	222	1.0864	0.2792	1.0864	1.0423
No log	2.4889	224	1.0157	0.3188	1.0157	1.0078
No log	2.5111	226	1.0218	0.2998	1.0218	1.0109
No log	2.5333	228	1.0709	0.3646	1.0709	1.0348
No log	2.5556	230	1.0613	0.2822	1.0613	1.0302
No log	2.5778	232	1.0141	0.3603	1.0141	1.0070
No log	2.6	234	0.9559	0.4175	0.9559	0.9777
No log	2.6222	236	1.0048	0.4143	1.0048	1.0024
No log	2.6444	238	1.0146	0.4155	1.0146	1.0073
No log	2.6667	240	0.9590	0.4280	0.9590	0.9793
No log	2.6889	242	0.9653	0.4377	0.9653	0.9825
No log	2.7111	244	0.9513	0.3896	0.9513	0.9753
No log	2.7333	246	0.9936	0.3621	0.9936	0.9968
No log	2.7556	248	1.0485	0.2702	1.0485	1.0240
No log	2.7778	250	0.9941	0.2721	0.9941	0.9971
No log	2.8	252	0.9847	0.3934	0.9847	0.9923
No log	2.8222	254	1.0739	0.3250	1.0739	1.0363
No log	2.8444	256	1.0211	0.3646	1.0211	1.0105
No log	2.8667	258	0.9728	0.3820	0.9728	0.9863
No log	2.8889	260	0.9833	0.3990	0.9833	0.9916
No log	2.9111	262	1.0018	0.3350	1.0018	1.0009
No log	2.9333	264	0.9595	0.4254	0.9595	0.9796
No log	2.9556	266	0.9708	0.3100	0.9708	0.9853
No log	2.9778	268	1.0733	0.2893	1.0733	1.0360
No log	3.0	270	1.0885	0.2893	1.0885	1.0433
No log	3.0222	272	1.0146	0.2521	1.0146	1.0073
No log	3.0444	274	1.0550	0.3024	1.0550	1.0271
No log	3.0667	276	1.2362	0.2459	1.2362	1.1119
No log	3.0889	278	1.2863	0.1686	1.2863	1.1342
No log	3.1111	280	1.1934	0.2012	1.1934	1.0924
No log	3.1333	282	1.0666	0.2021	1.0666	1.0328
No log	3.1556	284	1.0721	0.3154	1.0721	1.0354
No log	3.1778	286	1.0798	0.3154	1.0798	1.0391
No log	3.2	288	1.0604	0.2400	1.0604	1.0298
No log	3.2222	290	1.1061	0.1875	1.1061	1.0517
No log	3.2444	292	1.1726	0.1970	1.1726	1.0829
No log	3.2667	294	1.1612	0.1702	1.1612	1.0776
No log	3.2889	296	1.0639	0.2487	1.0639	1.0314
No log	3.3111	298	1.0303	0.3134	1.0303	1.0150
No log	3.3333	300	1.0517	0.2911	1.0517	1.0255
No log	3.3556	302	1.0272	0.2765	1.0272	1.0135
No log	3.3778	304	1.0099	0.2718	1.0099	1.0049
No log	3.4	306	1.0230	0.2336	1.0230	1.0114
No log	3.4222	308	1.0360	0.2216	1.0360	1.0179
No log	3.4444	310	1.0619	0.3194	1.0619	1.0305
No log	3.4667	312	1.0767	0.2785	1.0767	1.0376
No log	3.4889	314	1.0699	0.2718	1.0699	1.0343
No log	3.5111	316	1.1139	0.1969	1.1139	1.0554
No log	3.5333	318	1.1871	0.2286	1.1871	1.0895
No log	3.5556	320	1.1929	0.2286	1.1929	1.0922
No log	3.5778	322	1.1839	0.1830	1.1839	1.0881
No log	3.6	324	1.1950	0.2374	1.1950	1.0931
No log	3.6222	326	1.2194	0.2588	1.2194	1.1042
No log	3.6444	328	1.2024	0.2588	1.2024	1.0966
No log	3.6667	330	1.1760	0.2761	1.1760	1.0844
No log	3.6889	332	1.1424	0.2741	1.1424	1.0688
No log	3.7111	334	1.1403	0.2111	1.1403	1.0678
No log	3.7333	336	1.1457	0.1567	1.1457	1.0704
No log	3.7556	338	1.1197	0.1567	1.1197	1.0581
No log	3.7778	340	1.0883	0.2192	1.0883	1.0432
No log	3.8	342	1.0962	0.1969	1.0962	1.0470
No log	3.8222	344	1.1317	0.1567	1.1317	1.0638
No log	3.8444	346	1.1463	0.1641	1.1463	1.0706
No log	3.8667	348	1.1308	0.2172	1.1308	1.0634
No log	3.8889	350	1.1240	0.2521	1.1240	1.0602
No log	3.9111	352	1.1263	0.2633	1.1263	1.0613
No log	3.9333	354	1.1322	0.2633	1.1322	1.0641
No log	3.9556	356	1.1295	0.2384	1.1295	1.0628
No log	3.9778	358	1.1141	0.2290	1.1141	1.0555
No log	4.0	360	1.0868	0.2241	1.0868	1.0425
No log	4.0222	362	1.0756	0.3124	1.0756	1.0371
No log	4.0444	364	1.0547	0.2003	1.0547	1.0270
No log	4.0667	366	1.0484	0.2003	1.0484	1.0239
No log	4.0889	368	1.0512	0.2003	1.0512	1.0253
No log	4.1111	370	1.0621	0.2216	1.0621	1.0306
No log	4.1333	372	1.0654	0.2216	1.0654	1.0322
No log	4.1556	374	1.0389	0.1935	1.0389	1.0193
No log	4.1778	376	1.0310	0.2765	1.0310	1.0154
No log	4.2	378	1.0324	0.2765	1.0324	1.0161
No log	4.2222	380	1.0598	0.2721	1.0598	1.0295
No log	4.2444	382	1.0889	0.2857	1.0889	1.0435
No log	4.2667	384	1.0655	0.2204	1.0655	1.0322
No log	4.2889	386	1.0161	0.2523	1.0161	1.0080
No log	4.3111	388	0.9765	0.2517	0.9765	0.9882
No log	4.3333	390	0.9965	0.2765	0.9965	0.9983
No log	4.3556	392	1.0278	0.2643	1.0278	1.0138
No log	4.3778	394	1.0305	0.2204	1.0305	1.0151
No log	4.4	396	1.1323	0.3206	1.1323	1.0641
No log	4.4222	398	1.2764	0.2222	1.2764	1.1298
No log	4.4444	400	1.2774	0.2122	1.2774	1.1302
No log	4.4667	402	1.2281	0.2520	1.2281	1.1082
No log	4.4889	404	1.1524	0.1824	1.1524	1.0735
No log	4.5111	406	1.0759	0.2533	1.0759	1.0373
No log	4.5333	408	1.0557	0.2533	1.0557	1.0275
No log	4.5556	410	1.0696	0.2192	1.0696	1.0342
No log	4.5778	412	1.0850	0.2533	1.0850	1.0416
No log	4.6	414	1.1076	0.2416	1.1076	1.0524
No log	4.6222	416	1.1472	0.3159	1.1472	1.0711
No log	4.6444	418	1.2174	0.2159	1.2174	1.1034
No log	4.6667	420	1.2291	0.2032	1.2291	1.1086
No log	4.6889	422	1.2071	0.2342	1.2071	1.0987
No log	4.7111	424	1.1714	0.2857	1.1714	1.0823
No log	4.7333	426	1.1892	0.2342	1.1892	1.0905
No log	4.7556	428	1.1965	0.1870	1.1965	1.0938
No log	4.7778	430	1.1831	0.1985	1.1831	1.0877
No log	4.8	432	1.1165	0.1755	1.1165	1.0566
No log	4.8222	434	1.0450	0.1221	1.0450	1.0222
No log	4.8444	436	1.0257	0.2351	1.0257	1.0128
No log	4.8667	438	1.0326	0.2791	1.0326	1.0162
No log	4.8889	440	1.1132	0.2938	1.1132	1.0551
No log	4.9111	442	1.1864	0.2599	1.1864	1.0892
No log	4.9333	444	1.2113	0.2351	1.2113	1.1006
No log	4.9556	446	1.1480	0.2747	1.1480	1.0715
No log	4.9778	448	1.0497	0.2584	1.0497	1.0245
No log	5.0	450	1.0337	0.3685	1.0337	1.0167
No log	5.0222	452	1.0744	0.2953	1.0744	1.0365
No log	5.0444	454	1.0388	0.2892	1.0388	1.0192
No log	5.0667	456	0.9817	0.3505	0.9817	0.9908
No log	5.0889	458	1.0070	0.2111	1.0070	1.0035
No log	5.1111	460	1.0970	0.1775	1.0970	1.0474
No log	5.1333	462	1.1127	0.1775	1.1127	1.0549
No log	5.1556	464	1.1029	0.1996	1.1029	1.0502
No log	5.1778	466	1.1151	0.2111	1.1151	1.0560
No log	5.2	468	1.1207	0.2910	1.1207	1.0586
No log	5.2222	470	1.1719	0.2256	1.1719	1.0826
No log	5.2444	472	1.2096	0.2883	1.2096	1.0998
No log	5.2667	474	1.2201	0.3052	1.2201	1.1046
No log	5.2889	476	1.2095	0.3033	1.2095	1.0998
No log	5.3111	478	1.1734	0.2654	1.1734	1.0832
No log	5.3333	480	1.1258	0.2607	1.1258	1.0610
No log	5.3556	482	1.1152	0.2993	1.1152	1.0560
No log	5.3778	484	1.1165	0.2654	1.1165	1.0566
No log	5.4	486	1.1372	0.2939	1.1372	1.0664
No log	5.4222	488	1.1495	0.3399	1.1495	1.0722
No log	5.4444	490	1.1385	0.3662	1.1385	1.0670
No log	5.4667	492	1.1138	0.3547	1.1138	1.0554
No log	5.4889	494	1.1046	0.3502	1.1046	1.0510
No log	5.5111	496	1.0833	0.3896	1.0833	1.0408
No log	5.5333	498	1.0737	0.3879	1.0737	1.0362
0.2952	5.5556	500	1.0511	0.3765	1.0511	1.0253
0.2952	5.5778	502	1.0353	0.3879	1.0353	1.0175
0.2952	5.6	504	1.0663	0.2814	1.0663	1.0326
0.2952	5.6222	506	1.0990	0.2263	1.0990	1.0483
0.2952	5.6444	508	1.0857	0.2111	1.0857	1.0420
0.2952	5.6667	510	1.0955	0.2033	1.0955	1.0466
0.2952	5.6889	512	1.1043	0.1567	1.1043	1.0508

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1