ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9880
• Qwk: 0.2537
• Mse: 0.9880
• Rmse: 0.9940

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.6820	0.0010	4.6820	2.1638
No log	0.1379	4	2.5951	-0.0180	2.5951	1.6109
No log	0.2069	6	2.3113	-0.0464	2.3113	1.5203
No log	0.2759	8	1.6645	0.0596	1.6645	1.2902
No log	0.3448	10	1.2841	0.1590	1.2841	1.1332
No log	0.4138	12	1.1527	0.1314	1.1527	1.0736
No log	0.4828	14	1.1740	0.2574	1.1740	1.0835
No log	0.5517	16	1.1823	0.1772	1.1823	1.0873
No log	0.6207	18	1.2576	0.1658	1.2576	1.1214
No log	0.6897	20	1.3060	0.1530	1.3060	1.1428
No log	0.7586	22	1.2727	0.1904	1.2727	1.1282
No log	0.8276	24	1.2547	0.2203	1.2547	1.1201
No log	0.8966	26	1.2026	0.2439	1.2026	1.0966
No log	0.9655	28	1.1670	0.2636	1.1670	1.0803
No log	1.0345	30	1.1820	0.2636	1.1820	1.0872
No log	1.1034	32	1.2030	0.2786	1.2030	1.0968
No log	1.1724	34	1.2126	0.2786	1.2126	1.1012
No log	1.2414	36	1.3557	0.0955	1.3557	1.1643
No log	1.3103	38	1.5500	0.0608	1.5500	1.2450
No log	1.3793	40	1.5791	0.1224	1.5791	1.2566
No log	1.4483	42	1.4751	0.2321	1.4751	1.2146
No log	1.5172	44	1.5868	0.2508	1.5868	1.2597
No log	1.5862	46	1.5038	0.2025	1.5038	1.2263
No log	1.6552	48	1.2800	0.1904	1.2800	1.1314
No log	1.7241	50	1.1408	0.2333	1.1408	1.0681
No log	1.7931	52	1.1071	0.2424	1.1071	1.0522
No log	1.8621	54	1.1702	0.2935	1.1702	1.0818
No log	1.9310	56	1.1534	0.3083	1.1534	1.0740
No log	2.0	58	1.0691	0.3570	1.0691	1.0340
No log	2.0690	60	1.1644	0.1845	1.1644	1.0791
No log	2.1379	62	1.3211	-0.0212	1.3211	1.1494
No log	2.2069	64	1.2991	0.1675	1.2991	1.1398
No log	2.2759	66	1.0725	0.2278	1.0725	1.0356
No log	2.3448	68	1.1991	0.1601	1.1991	1.0950
No log	2.4138	70	1.3598	0.0700	1.3598	1.1661
No log	2.4828	72	1.2891	0.1601	1.2891	1.1354
No log	2.5517	74	1.2646	0.2734	1.2646	1.1245
No log	2.6207	76	1.1750	0.1943	1.1750	1.0840
No log	2.6897	78	1.2788	0.1696	1.2788	1.1308
No log	2.7586	80	1.4952	0.1832	1.4952	1.2228
No log	2.8276	82	1.3929	0.2295	1.3929	1.1802
No log	2.8966	84	1.1857	0.2476	1.1857	1.0889
No log	2.9655	86	1.2252	0.2467	1.2252	1.1069
No log	3.0345	88	1.2631	0.2049	1.2631	1.1239
No log	3.1034	90	1.2897	0.2382	1.2897	1.1357
No log	3.1724	92	1.2080	0.2100	1.2080	1.0991
No log	3.2414	94	1.0665	0.2567	1.0665	1.0327
No log	3.3103	96	1.0416	0.2794	1.0416	1.0206
No log	3.3793	98	1.0644	0.2988	1.0644	1.0317
No log	3.4483	100	1.2229	0.2100	1.2229	1.1059
No log	3.5172	102	1.3058	0.1796	1.3058	1.1427
No log	3.5862	104	1.1629	0.2816	1.1629	1.0784
No log	3.6552	106	1.0265	0.3552	1.0265	1.0132
No log	3.7241	108	1.1033	0.4111	1.1033	1.0504
No log	3.7931	110	1.1365	0.3674	1.1365	1.0661
No log	3.8621	112	1.0767	0.4377	1.0767	1.0376
No log	3.9310	114	1.0521	0.3108	1.0521	1.0257
No log	4.0	116	1.1351	0.3056	1.1351	1.0654
No log	4.0690	118	1.1455	0.3100	1.1455	1.0703
No log	4.1379	120	1.0860	0.3100	1.0860	1.0421
No log	4.2069	122	0.9601	0.4635	0.9601	0.9798
No log	4.2759	124	0.9631	0.3578	0.9631	0.9814
No log	4.3448	126	1.0059	0.4105	1.0059	1.0030
No log	4.4138	128	1.0132	0.4242	1.0132	1.0066
No log	4.4828	130	0.9974	0.3796	0.9974	0.9987
No log	4.5517	132	1.0217	0.2505	1.0217	1.0108
No log	4.6207	134	1.0193	0.3082	1.0193	1.0096
No log	4.6897	136	1.0651	0.3255	1.0651	1.0321
No log	4.7586	138	1.0518	0.3255	1.0518	1.0256
No log	4.8276	140	0.9695	0.375	0.9695	0.9846
No log	4.8966	142	0.9327	0.3842	0.9327	0.9658
No log	4.9655	144	0.9201	0.3842	0.9201	0.9592
No log	5.0345	146	0.9138	0.4212	0.9138	0.9559
No log	5.1034	148	1.0032	0.3881	1.0032	1.0016
No log	5.1724	150	0.9948	0.4153	0.9948	0.9974
No log	5.2414	152	0.9120	0.3502	0.9120	0.9550
No log	5.3103	154	0.9131	0.3091	0.9131	0.9556
No log	5.3793	156	0.9473	0.2579	0.9473	0.9733
No log	5.4483	158	1.0079	0.2180	1.0079	1.0040
No log	5.5172	160	1.1030	0.2768	1.1030	1.0502
No log	5.5862	162	1.3025	0.2899	1.3025	1.1413
No log	5.6552	164	1.3167	0.2833	1.3167	1.1475
No log	5.7241	166	1.3075	0.2773	1.3075	1.1435
No log	5.7931	168	1.5196	0.2346	1.5196	1.2327
No log	5.8621	170	1.4991	0.1563	1.4991	1.2244
No log	5.9310	172	1.2250	0.1540	1.2250	1.1068
No log	6.0	174	1.0416	0.2446	1.0416	1.0206
No log	6.0690	176	0.9262	0.3036	0.9262	0.9624
No log	6.1379	178	0.8882	0.3678	0.8882	0.9425
No log	6.2069	180	0.8686	0.5027	0.8686	0.9320
No log	6.2759	182	0.9160	0.5841	0.9160	0.9571
No log	6.3448	184	0.9210	0.5125	0.9210	0.9597
No log	6.4138	186	0.9753	0.3249	0.9753	0.9876
No log	6.4828	188	1.0042	0.3776	1.0042	1.0021
No log	6.5517	190	0.9895	0.3249	0.9895	0.9947
No log	6.6207	192	0.9357	0.3250	0.9357	0.9673
No log	6.6897	194	0.9140	0.4356	0.9140	0.9560
No log	6.7586	196	0.9245	0.4912	0.9245	0.9615
No log	6.8276	198	0.9520	0.5192	0.9520	0.9757
No log	6.8966	200	0.9682	0.5346	0.9682	0.9840
No log	6.9655	202	0.9466	0.5192	0.9466	0.9729
No log	7.0345	204	0.9234	0.5322	0.9234	0.9609
No log	7.1034	206	0.9455	0.5012	0.9455	0.9724
No log	7.1724	208	0.9635	0.5012	0.9635	0.9816
No log	7.2414	210	0.9491	0.4945	0.9491	0.9742
No log	7.3103	212	0.9753	0.4945	0.9753	0.9876
No log	7.3793	214	0.9812	0.4617	0.9812	0.9906
No log	7.4483	216	1.0005	0.3126	1.0005	1.0002
No log	7.5172	218	1.0124	0.3775	1.0124	1.0062
No log	7.5862	220	0.9489	0.4007	0.9489	0.9741
No log	7.6552	222	0.9341	0.4912	0.9341	0.9665
No log	7.7241	224	0.9335	0.5012	0.9335	0.9662
No log	7.7931	226	0.9696	0.5030	0.9696	0.9847
No log	7.8621	228	0.9809	0.5492	0.9809	0.9904
No log	7.9310	230	0.9456	0.4893	0.9456	0.9724
No log	8.0	232	0.9181	0.3283	0.9181	0.9582
No log	8.0690	234	0.9258	0.3062	0.9258	0.9622
No log	8.1379	236	0.9127	0.3184	0.9127	0.9554
No log	8.2069	238	0.9253	0.4119	0.9253	0.9619
No log	8.2759	240	0.9718	0.4912	0.9718	0.9858
No log	8.3448	242	1.0020	0.4912	1.0020	1.0010
No log	8.4138	244	1.0460	0.2892	1.0460	1.0228
No log	8.4828	246	1.0238	0.3328	1.0238	1.0119
No log	8.5517	248	1.0188	0.3036	1.0188	1.0094
No log	8.6207	250	0.9718	0.3184	0.9718	0.9858
No log	8.6897	252	0.9672	0.5012	0.9672	0.9835
No log	8.7586	254	1.0003	0.5324	1.0003	1.0001
No log	8.8276	256	0.9736	0.5154	0.9736	0.9867
No log	8.8966	258	0.9332	0.3627	0.9332	0.9660
No log	8.9655	260	0.9361	0.3627	0.9361	0.9675
No log	9.0345	262	0.9466	0.3728	0.9466	0.9729
No log	9.1034	264	0.9626	0.3933	0.9626	0.9811
No log	9.1724	266	0.9673	0.3830	0.9673	0.9835
No log	9.2414	268	0.9558	0.3216	0.9558	0.9777
No log	9.3103	270	0.9797	0.2864	0.9797	0.9898
No log	9.3793	272	1.0260	0.3193	1.0260	1.0129
No log	9.4483	274	0.9758	0.3480	0.9758	0.9878
No log	9.5172	276	0.8661	0.4944	0.8661	0.9307
No log	9.5862	278	0.8294	0.5578	0.8294	0.9107
No log	9.6552	280	0.8751	0.5748	0.8751	0.9355
No log	9.7241	282	0.8601	0.5678	0.8601	0.9274
No log	9.7931	284	0.8715	0.5163	0.8715	0.9335
No log	9.8621	286	0.9138	0.3873	0.9138	0.9559
No log	9.9310	288	0.9836	0.2276	0.9836	0.9918
No log	10.0	290	1.1092	0.2342	1.1092	1.0532
No log	10.0690	292	1.1188	0.2721	1.1188	1.0577
No log	10.1379	294	1.0051	0.3224	1.0051	1.0025
No log	10.2069	296	0.9138	0.4061	0.9138	0.9559
No log	10.2759	298	0.9139	0.5011	0.9139	0.9560
No log	10.3448	300	0.9264	0.3869	0.9264	0.9625
No log	10.4138	302	0.9870	0.3719	0.9870	0.9935
No log	10.4828	304	0.9662	0.3433	0.9662	0.9830
No log	10.5517	306	0.9500	0.3433	0.9500	0.9747
No log	10.6207	308	0.9654	0.3596	0.9654	0.9825
No log	10.6897	310	1.0131	0.3692	1.0131	1.0065
No log	10.7586	312	1.0616	0.2588	1.0616	1.0303
No log	10.8276	314	1.0262	0.3081	1.0262	1.0130
No log	10.8966	316	0.9778	0.3406	0.9778	0.9889
No log	10.9655	318	0.9679	0.3852	0.9679	0.9838
No log	11.0345	320	0.9753	0.3614	0.9753	0.9876
No log	11.1034	322	0.9126	0.3813	0.9126	0.9553
No log	11.1724	324	0.8928	0.5056	0.8928	0.9449
No log	11.2414	326	0.9223	0.4916	0.9223	0.9603
No log	11.3103	328	0.9247	0.5056	0.9247	0.9616
No log	11.3793	330	0.9364	0.4420	0.9364	0.9677
No log	11.4483	332	0.9590	0.4489	0.9590	0.9793
No log	11.5172	334	0.9423	0.4548	0.9423	0.9707
No log	11.5862	336	0.9361	0.4479	0.9361	0.9675
No log	11.6552	338	0.9453	0.4671	0.9453	0.9722
No log	11.7241	340	0.9504	0.4450	0.9504	0.9749
No log	11.7931	342	0.9482	0.3541	0.9482	0.9738
No log	11.8621	344	1.0032	0.3036	1.0032	1.0016
No log	11.9310	346	1.0216	0.2126	1.0216	1.0107
No log	12.0	348	1.0145	0.2843	1.0145	1.0072
No log	12.0690	350	1.0172	0.2966	1.0172	1.0086
No log	12.1379	352	0.9806	0.3607	0.9806	0.9903
No log	12.2069	354	0.9590	0.3514	0.9590	0.9793
No log	12.2759	356	0.9849	0.2521	0.9849	0.9924
No log	12.3448	358	1.0841	0.2191	1.0841	1.0412
No log	12.4138	360	1.0883	0.2243	1.0883	1.0432
No log	12.4828	362	1.0202	0.2233	1.0202	1.0101
No log	12.5517	364	0.9571	0.2914	0.9571	0.9783
No log	12.6207	366	0.9628	0.4413	0.9628	0.9812
No log	12.6897	368	0.9654	0.4865	0.9654	0.9826
No log	12.7586	370	0.9330	0.5203	0.9330	0.9659
No log	12.8276	372	0.9046	0.4352	0.9046	0.9511
No log	12.8966	374	0.8960	0.4159	0.8960	0.9466
No log	12.9655	376	0.8986	0.3965	0.8986	0.9479
No log	13.0345	378	0.9128	0.4514	0.9128	0.9554
No log	13.1034	380	0.9397	0.3836	0.9397	0.9694
No log	13.1724	382	0.9724	0.4160	0.9724	0.9861
No log	13.2414	384	0.9924	0.3286	0.9924	0.9962
No log	13.3103	386	1.0203	0.2824	1.0203	1.0101
No log	13.3793	388	1.0183	0.3262	1.0183	1.0091
No log	13.4483	390	0.9873	0.3213	0.9873	0.9937
No log	13.5172	392	0.9845	0.3480	0.9845	0.9922
No log	13.5862	394	0.9439	0.3614	0.9439	0.9716
No log	13.6552	396	0.8789	0.3472	0.8789	0.9375
No log	13.7241	398	0.8584	0.5649	0.8584	0.9265
No log	13.7931	400	0.8746	0.5622	0.8746	0.9352
No log	13.8621	402	0.8738	0.4671	0.8738	0.9347
No log	13.9310	404	0.9319	0.3036	0.9319	0.9653
No log	14.0	406	1.0422	0.2779	1.0422	1.0209
No log	14.0690	408	1.0895	0.2779	1.0895	1.0438
No log	14.1379	410	1.0471	0.2779	1.0471	1.0233
No log	14.2069	412	0.9741	0.3773	0.9741	0.9869
No log	14.2759	414	0.9383	0.4029	0.9383	0.9686
No log	14.3448	416	0.9512	0.3842	0.9512	0.9753
No log	14.4138	418	1.0109	0.2891	1.0109	1.0055
No log	14.4828	420	1.0748	0.2870	1.0748	1.0367
No log	14.5517	422	1.0659	0.2870	1.0659	1.0324
No log	14.6207	424	1.0457	0.3193	1.0457	1.0226
No log	14.6897	426	1.0081	0.2669	1.0081	1.0040
No log	14.7586	428	0.9957	0.2864	0.9957	0.9979
No log	14.8276	430	0.9914	0.2963	0.9914	0.9957
No log	14.8966	432	0.9945	0.2963	0.9945	0.9972
No log	14.9655	434	0.9616	0.2864	0.9616	0.9806
No log	15.0345	436	0.9854	0.2424	0.9854	0.9927
No log	15.1034	438	0.9880	0.2424	0.9880	0.9940
No log	15.1724	440	0.9549	0.3036	0.9549	0.9772
No log	15.2414	442	0.9404	0.3036	0.9404	0.9698
No log	15.3103	444	0.9251	0.4297	0.9251	0.9618
No log	15.3793	446	0.9078	0.4356	0.9078	0.9528
No log	15.4483	448	0.9058	0.5125	0.9058	0.9518
No log	15.5172	450	0.9077	0.5027	0.9077	0.9527
No log	15.5862	452	0.9095	0.5027	0.9095	0.9537
No log	15.6552	454	0.9086	0.4930	0.9086	0.9532
No log	15.7241	456	0.9173	0.3771	0.9173	0.9577
No log	15.7931	458	0.9545	0.3256	0.9545	0.9770
No log	15.8621	460	0.9702	0.3110	0.9702	0.9850
No log	15.9310	462	0.9453	0.3483	0.9453	0.9723
No log	16.0	464	0.9581	0.4724	0.9581	0.9788
No log	16.0690	466	0.9604	0.5154	0.9604	0.9800
No log	16.1379	468	0.9529	0.4349	0.9529	0.9762
No log	16.2069	470	0.9795	0.3584	0.9795	0.9897
No log	16.2759	472	1.0031	0.4119	1.0031	1.0015
No log	16.3448	474	0.9660	0.3584	0.9660	0.9829
No log	16.4138	476	0.9408	0.4023	0.9408	0.9700
No log	16.4828	478	0.9458	0.4681	0.9458	0.9725
No log	16.5517	480	0.9373	0.4898	0.9373	0.9682
No log	16.6207	482	0.9186	0.4023	0.9186	0.9584
No log	16.6897	484	0.9182	0.3328	0.9182	0.9582
No log	16.7586	486	0.9116	0.3671	0.9116	0.9548
No log	16.8276	488	0.8982	0.4019	0.8982	0.9477
No log	16.8966	490	0.9054	0.4801	0.9054	0.9515
No log	16.9655	492	0.9260	0.4865	0.9260	0.9623
No log	17.0345	494	0.9257	0.4583	0.9257	0.9622
No log	17.1034	496	0.9392	0.3960	0.9392	0.9691
No log	17.1724	498	0.9594	0.3559	0.9594	0.9795
0.3561	17.2414	500	0.9536	0.3559	0.9536	0.9765
0.3561	17.3103	502	0.9227	0.4234	0.9227	0.9606
0.3561	17.3793	504	0.9093	0.4234	0.9093	0.9536
0.3561	17.4483	506	0.8868	0.3960	0.8868	0.9417
0.3561	17.5172	508	0.8591	0.4297	0.8591	0.9269
0.3561	17.5862	510	0.8613	0.4498	0.8613	0.9281
0.3561	17.6552	512	0.8715	0.4792	0.8715	0.9335
0.3561	17.7241	514	0.9010	0.4995	0.9010	0.9492
0.3561	17.7931	516	0.9229	0.4119	0.9229	0.9607
0.3561	17.8621	518	0.9852	0.3062	0.9852	0.9926
0.3561	17.9310	520	1.1249	0.2374	1.1249	1.0606
0.3561	18.0	522	1.1174	0.3157	1.1174	1.0570
0.3561	18.0690	524	1.0127	0.3243	1.0127	1.0063
0.3561	18.1379	526	0.9406	0.3773	0.9406	0.9699
0.3561	18.2069	528	0.8830	0.4860	0.8830	0.9397
0.3561	18.2759	530	0.8635	0.4760	0.8635	0.9292
0.3561	18.3448	532	0.8622	0.3806	0.8622	0.9286
0.3561	18.4138	534	0.8669	0.3457	0.8669	0.9311
0.3561	18.4828	536	0.8657	0.3590	0.8657	0.9304
0.3561	18.5517	538	0.8391	0.3946	0.8391	0.9160
0.3561	18.6207	540	0.8189	0.4472	0.8189	0.9049
0.3561	18.6897	542	0.8396	0.4482	0.8396	0.9163
0.3561	18.7586	544	0.8494	0.4722	0.8494	0.9216
0.3561	18.8276	546	0.8529	0.4158	0.8529	0.9235
0.3561	18.8966	548	0.8792	0.4054	0.8792	0.9377
0.3561	18.9655	550	0.8664	0.3951	0.8664	0.9308
0.3561	19.0345	552	0.8354	0.4504	0.8354	0.9140
0.3561	19.1034	554	0.8499	0.5098	0.8499	0.9219
0.3561	19.1724	556	0.8608	0.5098	0.8608	0.9278
0.3561	19.2414	558	0.8643	0.4016	0.8643	0.9297
0.3561	19.3103	560	0.8888	0.3909	0.8888	0.9428
0.3561	19.3793	562	0.8957	0.3704	0.8957	0.9464
0.3561	19.4483	564	0.8792	0.4054	0.8792	0.9377
0.3561	19.5172	566	0.8502	0.4260	0.8502	0.9221
0.3561	19.5862	568	0.8394	0.5296	0.8394	0.9162
0.3561	19.6552	570	0.8544	0.4197	0.8544	0.9243
0.3561	19.7241	572	0.8992	0.3516	0.8992	0.9483
0.3561	19.7931	574	0.9328	0.3179	0.9328	0.9658
0.3561	19.8621	576	0.8919	0.3855	0.8919	0.9444
0.3561	19.9310	578	0.8464	0.4299	0.8464	0.9200
0.3561	20.0	580	0.8257	0.5195	0.8257	0.9087
0.3561	20.0690	582	0.8260	0.4976	0.8260	0.9088
0.3561	20.1379	584	0.8604	0.4197	0.8604	0.9276
0.3561	20.2069	586	0.8917	0.3516	0.8917	0.9443
0.3561	20.2759	588	0.9003	0.3516	0.9003	0.9489
0.3561	20.3448	590	0.8901	0.3855	0.8901	0.9435
0.3561	20.4138	592	0.8984	0.3614	0.8984	0.9479
0.3561	20.4828	594	0.9543	0.3805	0.9543	0.9769
0.3561	20.5517	596	0.9867	0.3165	0.9867	0.9933
0.3561	20.6207	598	0.9787	0.3193	0.9787	0.9893
0.3561	20.6897	600	0.9103	0.3614	0.9103	0.9541
0.3561	20.7586	602	0.8925	0.4712	0.8925	0.9447
0.3561	20.8276	604	0.9018	0.4533	0.9018	0.9496
0.3561	20.8966	606	0.9074	0.4533	0.9074	0.9526
0.3561	20.9655	608	0.9113	0.4433	0.9113	0.9546
0.3561	21.0345	610	0.9178	0.4371	0.9178	0.9580
0.3561	21.1034	612	0.9345	0.3693	0.9345	0.9667
0.3561	21.1724	614	0.9466	0.3544	0.9466	0.9729
0.3561	21.2414	616	0.9572	0.2836	0.9572	0.9784
0.3561	21.3103	618	0.9554	0.2836	0.9554	0.9774
0.3561	21.3793	620	0.9570	0.2636	0.9570	0.9783
0.3561	21.4483	622	0.9880	0.2537	0.9880	0.9940

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1