ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k20_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1129
• Qwk: 0.2487
• Mse: 1.1129
• Rmse: 1.0550

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0206	2	4.1960	-0.0387	4.1960	2.0484
No log	0.0412	4	2.4084	0.0014	2.4084	1.5519
No log	0.0619	6	1.6155	0.0287	1.6155	1.2710
No log	0.0825	8	1.2734	0.1603	1.2734	1.1284
No log	0.1031	10	1.5936	-0.0426	1.5936	1.2624
No log	0.1237	12	1.3569	0.0510	1.3569	1.1649
No log	0.1443	14	1.1964	0.1304	1.1964	1.0938
No log	0.1649	16	1.4462	0.0196	1.4462	1.2026
No log	0.1856	18	1.6005	0.0053	1.6005	1.2651
No log	0.2062	20	1.2757	0.2409	1.2757	1.1294
No log	0.2268	22	1.0928	0.2268	1.0928	1.0454
No log	0.2474	24	1.1404	0.2685	1.1404	1.0679
No log	0.2680	26	1.1327	0.2827	1.1327	1.0643
No log	0.2887	28	1.0037	0.3488	1.0037	1.0019
No log	0.3093	30	1.0224	0.2276	1.0224	1.0112
No log	0.3299	32	1.0493	0.2072	1.0493	1.0244
No log	0.3505	34	1.2896	0.1370	1.2896	1.1356
No log	0.3711	36	1.4243	0.0954	1.4243	1.1934
No log	0.3918	38	1.1107	0.1581	1.1107	1.0539
No log	0.4124	40	1.0375	0.2864	1.0375	1.0186
No log	0.4330	42	0.9733	0.3468	0.9733	0.9866
No log	0.4536	44	0.9458	0.3602	0.9458	0.9725
No log	0.4742	46	0.9220	0.3638	0.9220	0.9602
No log	0.4948	48	0.9998	0.4247	0.9998	0.9999
No log	0.5155	50	1.2472	0.2565	1.2472	1.1168
No log	0.5361	52	1.0441	0.3861	1.0441	1.0218
No log	0.5567	54	0.9788	0.3038	0.9788	0.9893
No log	0.5773	56	0.9734	0.2901	0.9734	0.9866
No log	0.5979	58	1.0166	0.3861	1.0166	1.0083
No log	0.6186	60	1.0818	0.3330	1.0818	1.0401
No log	0.6392	62	1.0077	0.2910	1.0077	1.0038
No log	0.6598	64	1.0383	0.2402	1.0383	1.0190
No log	0.6804	66	1.0389	0.2759	1.0389	1.0193
No log	0.7010	68	1.0538	0.2850	1.0538	1.0265
No log	0.7216	70	1.0439	0.3157	1.0439	1.0217
No log	0.7423	72	0.9860	0.3533	0.9860	0.9930
No log	0.7629	74	1.0457	0.3567	1.0457	1.0226
No log	0.7835	76	0.9953	0.3981	0.9953	0.9977
No log	0.8041	78	0.9830	0.3784	0.9830	0.9915
No log	0.8247	80	1.0428	0.3567	1.0428	1.0212
No log	0.8454	82	1.0545	0.3445	1.0545	1.0269
No log	0.8660	84	1.0510	0.3472	1.0510	1.0252
No log	0.8866	86	0.9822	0.3229	0.9822	0.9911
No log	0.9072	88	0.9922	0.3915	0.9922	0.9961
No log	0.9278	90	0.9965	0.2744	0.9965	0.9982
No log	0.9485	92	1.1764	0.2192	1.1764	1.0846
No log	0.9691	94	1.3897	0.1628	1.3897	1.1788
No log	0.9897	96	1.4284	0.1552	1.4284	1.1952
No log	1.0103	98	1.2618	0.1823	1.2618	1.1233
No log	1.0309	100	1.1654	0.2791	1.1654	1.0795
No log	1.0515	102	1.1764	0.2416	1.1764	1.0846
No log	1.0722	104	1.2332	0.1684	1.2332	1.1105
No log	1.0928	106	1.3656	0.1756	1.3656	1.1686
No log	1.1134	108	1.5470	0.0075	1.5470	1.2438
No log	1.1340	110	1.4405	0.0976	1.4405	1.2002
No log	1.1546	112	1.1739	0.1616	1.1739	1.0835
No log	1.1753	114	1.1064	0.2723	1.1064	1.0518
No log	1.1959	116	1.0674	0.2865	1.0674	1.0332
No log	1.2165	118	1.1183	0.2651	1.1183	1.0575
No log	1.2371	120	1.1240	0.2678	1.1240	1.0602
No log	1.2577	122	1.1317	0.2273	1.1317	1.0638
No log	1.2784	124	1.0503	0.2238	1.0503	1.0248
No log	1.2990	126	0.9569	0.3089	0.9569	0.9782
No log	1.3196	128	0.9320	0.3236	0.9320	0.9654
No log	1.3402	130	0.9465	0.3902	0.9465	0.9729
No log	1.3608	132	0.9766	0.3207	0.9766	0.9882
No log	1.3814	134	0.9760	0.3782	0.9760	0.9879
No log	1.4021	136	1.0239	0.3631	1.0239	1.0119
No log	1.4227	138	0.9885	0.3859	0.9885	0.9942
No log	1.4433	140	1.0291	0.3756	1.0291	1.0145
No log	1.4639	142	1.0463	0.3789	1.0463	1.0229
No log	1.4845	144	1.0498	0.3402	1.0498	1.0246
No log	1.5052	146	1.0057	0.3571	1.0057	1.0029
No log	1.5258	148	1.0214	0.3210	1.0214	1.0106
No log	1.5464	150	1.0186	0.2643	1.0186	1.0092
No log	1.5670	152	1.0055	0.2620	1.0055	1.0028
No log	1.5876	154	0.9622	0.3878	0.9622	0.9809
No log	1.6082	156	1.0352	0.2815	1.0352	1.0174
No log	1.6289	158	1.1128	0.2685	1.1128	1.0549
No log	1.6495	160	1.0629	0.2680	1.0629	1.0310
No log	1.6701	162	1.0271	0.3209	1.0271	1.0135
No log	1.6907	164	1.0404	0.2765	1.0404	1.0200
No log	1.7113	166	1.0414	0.2424	1.0414	1.0205
No log	1.7320	168	1.0593	0.2952	1.0593	1.0292
No log	1.7526	170	1.0858	0.3318	1.0858	1.0420
No log	1.7732	172	1.0995	0.3243	1.0995	1.0486
No log	1.7938	174	1.0665	0.3570	1.0665	1.0327
No log	1.8144	176	1.0522	0.3380	1.0522	1.0258
No log	1.8351	178	1.0115	0.3570	1.0115	1.0057
No log	1.8557	180	1.0003	0.3570	1.0003	1.0002
No log	1.8763	182	1.0031	0.3577	1.0031	1.0015
No log	1.8969	184	1.0158	0.3097	1.0158	1.0079
No log	1.9175	186	0.9774	0.3725	0.9774	0.9886
No log	1.9381	188	1.0125	0.3380	1.0125	1.0062
No log	1.9588	190	0.9629	0.3454	0.9629	0.9813
No log	1.9794	192	0.9352	0.2718	0.9352	0.9671
No log	2.0	194	0.9486	0.4100	0.9486	0.9740
No log	2.0206	196	0.9119	0.4676	0.9119	0.9549
No log	2.0412	198	0.9365	0.3657	0.9365	0.9677
No log	2.0619	200	0.9450	0.3891	0.9450	0.9721
No log	2.0825	202	0.9726	0.3231	0.9726	0.9862
No log	2.1031	204	1.0105	0.2959	1.0105	1.0053
No log	2.1237	206	1.0930	0.2677	1.0930	1.0455
No log	2.1443	208	1.1946	0.2567	1.1946	1.0930
No log	2.1649	210	1.1937	0.2651	1.1937	1.0926
No log	2.1856	212	1.1222	0.2384	1.1222	1.0593
No log	2.2062	214	1.0722	0.2746	1.0722	1.0355
No log	2.2268	216	1.0718	0.3045	1.0718	1.0353
No log	2.2474	218	1.2022	0.2328	1.2022	1.0965
No log	2.2680	220	1.2862	0.2304	1.2862	1.1341
No log	2.2887	222	1.2865	0.2251	1.2865	1.1342
No log	2.3093	224	1.1189	0.3454	1.1189	1.0578
No log	2.3299	226	1.0468	0.3613	1.0468	1.0231
No log	2.3505	228	1.0381	0.3802	1.0381	1.0189
No log	2.3711	230	0.9801	0.3693	0.9801	0.9900
No log	2.3918	232	1.0181	0.3145	1.0181	1.0090
No log	2.4124	234	0.9847	0.3434	0.9847	0.9923
No log	2.4330	236	0.9417	0.3711	0.9417	0.9704
No log	2.4536	238	1.0200	0.3527	1.0200	1.0099
No log	2.4742	240	0.9997	0.3729	0.9997	0.9999
No log	2.4948	242	1.0362	0.3667	1.0362	1.0180
No log	2.5155	244	1.2802	0.3027	1.2802	1.1314
No log	2.5361	246	1.3047	0.2765	1.3047	1.1422
No log	2.5567	248	1.1876	0.3221	1.1876	1.0898
No log	2.5773	250	1.0034	0.3590	1.0034	1.0017
No log	2.5979	252	0.9724	0.3725	0.9724	0.9861
No log	2.6186	254	0.9662	0.3725	0.9662	0.9830
No log	2.6392	256	0.9627	0.3609	0.9627	0.9812
No log	2.6598	258	0.9677	0.3434	0.9677	0.9837
No log	2.6804	260	0.9663	0.3383	0.9663	0.9830
No log	2.7010	262	0.9572	0.3285	0.9572	0.9784
No log	2.7216	264	0.9684	0.2951	0.9684	0.9841
No log	2.7423	266	1.0016	0.2723	1.0016	1.0008
No log	2.7629	268	1.0091	0.2768	1.0091	1.0046
No log	2.7835	270	1.0241	0.2658	1.0241	1.0120
No log	2.8041	272	1.0229	0.2565	1.0229	1.0114
No log	2.8247	274	1.0213	0.3011	1.0213	1.0106
No log	2.8454	276	1.0270	0.2669	1.0270	1.0134
No log	2.8660	278	1.0197	0.2140	1.0197	1.0098
No log	2.8866	280	1.0385	0.2632	1.0385	1.0191
No log	2.9072	282	1.0462	0.2632	1.0462	1.0228
No log	2.9278	284	1.0099	0.3223	1.0099	1.0049
No log	2.9485	286	1.1141	0.1329	1.1141	1.0555
No log	2.9691	288	1.1852	0.1792	1.1852	1.0887
No log	2.9897	290	1.0404	0.3350	1.0404	1.0200
No log	3.0103	292	0.9960	0.3139	0.9960	0.9980
No log	3.0309	294	1.1625	0.3115	1.1625	1.0782
No log	3.0515	296	1.1736	0.3149	1.1736	1.0833
No log	3.0722	298	1.0859	0.3243	1.0859	1.0421
No log	3.0928	300	1.0061	0.2632	1.0061	1.0031
No log	3.1134	302	0.9733	0.3590	0.9733	0.9865
No log	3.1340	304	0.9573	0.3326	0.9573	0.9784
No log	3.1546	306	0.9655	0.3378	0.9655	0.9826
No log	3.1753	308	0.9749	0.3014	0.9749	0.9874
No log	3.1959	310	0.9680	0.3609	0.9680	0.9839
No log	3.2165	312	1.0315	0.3418	1.0315	1.0156
No log	3.2371	314	1.0556	0.3243	1.0556	1.0274
No log	3.2577	316	0.9515	0.3454	0.9515	0.9755
No log	3.2784	318	0.9284	0.3388	0.9284	0.9635
No log	3.2990	320	1.0014	0.2782	1.0014	1.0007
No log	3.3196	322	0.9910	0.3001	0.9910	0.9955
No log	3.3402	324	0.9283	0.3437	0.9283	0.9635
No log	3.3608	326	0.9572	0.3463	0.9572	0.9784
No log	3.3814	328	1.1716	0.3007	1.1716	1.0824
No log	3.4021	330	1.2497	0.2993	1.2497	1.1179
No log	3.4227	332	1.1648	0.3619	1.1648	1.0793
No log	3.4433	334	1.0566	0.2878	1.0566	1.0279
No log	3.4639	336	1.0151	0.3045	1.0151	1.0075
No log	3.4845	338	1.0197	0.3045	1.0197	1.0098
No log	3.5052	340	1.0325	0.2878	1.0325	1.0161
No log	3.5258	342	1.0508	0.2815	1.0508	1.0251
No log	3.5464	344	1.0500	0.2680	1.0500	1.0247
No log	3.5670	346	1.0001	0.2770	1.0001	1.0001
No log	3.5876	348	1.0014	0.2815	1.0014	1.0007
No log	3.6082	350	0.9825	0.2929	0.9825	0.9912
No log	3.6289	352	1.0005	0.2539	1.0005	1.0002
No log	3.6495	354	1.0233	0.2539	1.0233	1.0116
No log	3.6701	356	1.0620	0.2878	1.0620	1.0305
No log	3.6907	358	1.1199	0.2373	1.1199	1.0583
No log	3.7113	360	1.2476	0.1841	1.2476	1.1169
No log	3.7320	362	1.3067	0.1140	1.3067	1.1431
No log	3.7526	364	1.3355	0.1512	1.3355	1.1556
No log	3.7732	366	1.2735	0.1488	1.2735	1.1285
No log	3.7938	368	1.1260	0.1530	1.1260	1.0611
No log	3.8144	370	1.0295	0.2449	1.0295	1.0146
No log	3.8351	372	1.0236	0.3367	1.0236	1.0117
No log	3.8557	374	1.0629	0.3369	1.0629	1.0309
No log	3.8763	376	1.2278	0.2937	1.2278	1.1081
No log	3.8969	378	1.2573	0.2991	1.2573	1.1213
No log	3.9175	380	1.2509	0.2935	1.2509	1.1184
No log	3.9381	382	1.1073	0.2857	1.1073	1.0523
No log	3.9588	384	0.9956	0.3434	0.9956	0.9978
No log	3.9794	386	0.9719	0.3841	0.9719	0.9858
No log	4.0	388	0.9591	0.3725	0.9591	0.9793
No log	4.0206	390	0.9512	0.3326	0.9512	0.9753
No log	4.0412	392	0.9672	0.3609	0.9672	0.9834
No log	4.0619	394	1.0084	0.3264	1.0084	1.0042
No log	4.0825	396	1.0635	0.2494	1.0635	1.0313
No log	4.1031	398	1.1011	0.3270	1.1011	1.0493
No log	4.1237	400	1.0484	0.2842	1.0484	1.0239
No log	4.1443	402	0.9887	0.3326	0.9887	0.9943
No log	4.1649	404	0.9816	0.2670	0.9816	0.9908
No log	4.1856	406	0.9727	0.3070	0.9727	0.9862
No log	4.2062	408	1.0131	0.2857	1.0131	1.0065
No log	4.2268	410	1.0043	0.2991	1.0043	1.0022
No log	4.2474	412	0.9653	0.3358	0.9653	0.9825
No log	4.2680	414	0.9574	0.3070	0.9574	0.9784
No log	4.2887	416	0.9530	0.3070	0.9530	0.9762
No log	4.3093	418	0.9854	0.2698	0.9854	0.9927
No log	4.3299	420	1.0310	0.2263	1.0310	1.0154
No log	4.3505	422	1.0411	0.2263	1.0411	1.0203
No log	4.3711	424	0.9771	0.3129	0.9771	0.9885
No log	4.3918	426	0.9423	0.3112	0.9423	0.9707
No log	4.4124	428	0.9601	0.3474	0.9601	0.9798
No log	4.4330	430	1.0251	0.2589	1.0251	1.0125
No log	4.4536	432	1.0315	0.2636	1.0315	1.0156
No log	4.4742	434	0.9619	0.3124	0.9619	0.9808
No log	4.4948	436	0.9344	0.3800	0.9344	0.9666
No log	4.5155	438	0.9547	0.3365	0.9547	0.9771
No log	4.5361	440	1.0574	0.2636	1.0574	1.0283
No log	4.5567	442	1.2559	0.3658	1.2559	1.1207
No log	4.5773	444	1.2585	0.3149	1.2585	1.1219
No log	4.5979	446	1.1276	0.2790	1.1276	1.0619
No log	4.6186	448	0.9916	0.3318	0.9916	0.9958
No log	4.6392	450	1.0024	0.2929	1.0024	1.0012
No log	4.6598	452	1.0856	0.2702	1.0856	1.0419
No log	4.6804	454	1.1138	0.2790	1.1138	1.0554
No log	4.7010	456	1.0073	0.2589	1.0073	1.0036
No log	4.7216	458	0.9430	0.3048	0.9430	0.9711
No log	4.7423	460	0.9167	0.3467	0.9167	0.9574
No log	4.7629	462	0.9684	0.3813	0.9684	0.9841
No log	4.7835	464	0.9433	0.3915	0.9433	0.9712
No log	4.8041	466	0.9153	0.3229	0.9153	0.9567
No log	4.8247	468	0.9911	0.2702	0.9911	0.9955
No log	4.8454	470	1.0916	0.3525	1.0916	1.0448
No log	4.8660	472	1.0404	0.3262	1.0404	1.0200
No log	4.8866	474	1.0030	0.2768	1.0030	1.0015
No log	4.9072	476	0.9823	0.2768	0.9823	0.9911
No log	4.9278	478	0.9865	0.2768	0.9865	0.9932
No log	4.9485	480	1.0914	0.3390	1.0914	1.0447
No log	4.9691	482	1.1510	0.3134	1.1510	1.0729
No log	4.9897	484	1.1326	0.2567	1.1326	1.0642
No log	5.0103	486	1.1134	0.2702	1.1134	1.0552
No log	5.0309	488	1.1402	0.2567	1.1402	1.0678
No log	5.0515	490	1.1094	0.2770	1.1094	1.0533
No log	5.0722	492	1.0611	0.2908	1.0611	1.0301
No log	5.0928	494	1.0569	0.2908	1.0569	1.0281
No log	5.1134	496	1.0028	0.3045	1.0028	1.0014
No log	5.1340	498	0.9766	0.3202	0.9766	0.9882
0.2661	5.1546	500	1.0063	0.3066	1.0063	1.0031
0.2661	5.1753	502	1.0602	0.2723	1.0602	1.0297
0.2661	5.1959	504	1.1268	0.2747	1.1268	1.0615
0.2661	5.2165	506	1.1715	0.2184	1.1715	1.0824
0.2661	5.2371	508	1.1136	0.2792	1.1136	1.0553
0.2661	5.2577	510	1.1129	0.2487	1.1129	1.0550

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1