ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9919
• Qwk: 0.3313
• Mse: 0.9919
• Rmse: 0.9960

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0513	2	4.4816	0.0010	4.4816	2.1170
No log	0.1026	4	2.3577	0.0672	2.3577	1.5355
No log	0.1538	6	1.7833	0.0724	1.7833	1.3354
No log	0.2051	8	1.3615	0.0334	1.3615	1.1668
No log	0.2564	10	1.3088	0.0020	1.3088	1.1440
No log	0.3077	12	1.8124	0.0095	1.8124	1.3462
No log	0.3590	14	1.8182	0.0213	1.8182	1.3484
No log	0.4103	16	1.4809	0.1055	1.4809	1.2169
No log	0.4615	18	1.2708	0.1579	1.2708	1.1273
No log	0.5128	20	1.2372	0.1483	1.2372	1.1123
No log	0.5641	22	1.4358	0.1832	1.4358	1.1983
No log	0.6154	24	1.6185	0.2122	1.6185	1.2722
No log	0.6667	26	1.5075	0.2549	1.5075	1.2278
No log	0.7179	28	1.3790	0.1860	1.3790	1.1743
No log	0.7692	30	1.2994	0.2495	1.2994	1.1399
No log	0.8205	32	1.0901	0.2777	1.0901	1.0441
No log	0.8718	34	1.1398	0.2452	1.1398	1.0676
No log	0.9231	36	1.1470	0.2777	1.1470	1.0710
No log	0.9744	38	1.3219	0.1801	1.3219	1.1497
No log	1.0256	40	1.3188	0.2153	1.3188	1.1484
No log	1.0769	42	1.1673	0.1935	1.1673	1.0804
No log	1.1282	44	1.2386	0.1259	1.2386	1.1129
No log	1.1795	46	1.5043	0.1877	1.5043	1.2265
No log	1.2308	48	1.7011	0.2190	1.7011	1.3043
No log	1.2821	50	1.7240	0.1762	1.7240	1.3130
No log	1.3333	52	1.3416	0.1928	1.3416	1.1583
No log	1.3846	54	1.1104	0.2709	1.1104	1.0538
No log	1.4359	56	1.1113	0.2604	1.1113	1.0542
No log	1.4872	58	1.2107	0.2081	1.2107	1.1003
No log	1.5385	60	1.2454	0.2202	1.2454	1.1160
No log	1.5897	62	1.3780	0.2283	1.3780	1.1739
No log	1.6410	64	1.3171	0.1568	1.3171	1.1477
No log	1.6923	66	1.0751	0.2618	1.0751	1.0369
No log	1.7436	68	1.0465	0.2647	1.0465	1.0230
No log	1.7949	70	1.1232	0.2572	1.1232	1.0598
No log	1.8462	72	1.1603	0.2138	1.1603	1.0772
No log	1.8974	74	1.0473	0.3086	1.0473	1.0234
No log	1.9487	76	1.0432	0.3780	1.0432	1.0214
No log	2.0	78	1.0663	0.3760	1.0663	1.0326
No log	2.0513	80	1.0670	0.4409	1.0670	1.0330
No log	2.1026	82	1.2186	0.3791	1.2186	1.1039
No log	2.1538	84	1.2336	0.3898	1.2336	1.1107
No log	2.2051	86	1.1027	0.4548	1.1027	1.0501
No log	2.2564	88	1.0870	0.4017	1.0870	1.0426
No log	2.3077	90	1.0874	0.2627	1.0874	1.0428
No log	2.3590	92	1.0744	0.2944	1.0744	1.0366
No log	2.4103	94	1.1191	0.3009	1.1191	1.0579
No log	2.4615	96	1.4702	0.2481	1.4702	1.2125
No log	2.5128	98	2.0533	0.1969	2.0533	1.4329
No log	2.5641	100	1.7894	0.2273	1.7894	1.3377
No log	2.6154	102	1.1498	0.4172	1.1498	1.0723
No log	2.6667	104	0.9967	0.4337	0.9967	0.9984
No log	2.7179	106	0.9770	0.4215	0.9770	0.9884
No log	2.7692	108	1.0045	0.4676	1.0045	1.0023
No log	2.8205	110	1.2816	0.3139	1.2816	1.1321
No log	2.8718	112	1.2459	0.2822	1.2459	1.1162
No log	2.9231	114	1.0957	0.3907	1.0957	1.0468
No log	2.9744	116	1.0260	0.3946	1.0260	1.0129
No log	3.0256	118	1.0488	0.4998	1.0488	1.0241
No log	3.0769	120	1.0408	0.5011	1.0408	1.0202
No log	3.1282	122	1.1257	0.4353	1.1257	1.0610
No log	3.1795	124	1.3628	0.3239	1.3628	1.1674
No log	3.2308	126	1.2046	0.4387	1.2046	1.0975
No log	3.2821	128	1.0084	0.4389	1.0084	1.0042
No log	3.3333	130	1.0046	0.4757	1.0046	1.0023
No log	3.3846	132	1.0456	0.3938	1.0456	1.0225
No log	3.4359	134	1.0877	0.3249	1.0877	1.0429
No log	3.4872	136	1.0883	0.3492	1.0883	1.0432
No log	3.5385	138	1.1730	0.3248	1.1730	1.0831
No log	3.5897	140	1.1910	0.3248	1.1910	1.0913
No log	3.6410	142	1.1248	0.4100	1.1248	1.0606
No log	3.6923	144	1.1723	0.5105	1.1723	1.0828
No log	3.7436	146	1.1326	0.4757	1.1326	1.0642
No log	3.7949	148	1.2453	0.3659	1.2453	1.1159
No log	3.8462	150	1.5939	0.3309	1.5939	1.2625
No log	3.8974	152	1.5256	0.3940	1.5256	1.2352
No log	3.9487	154	1.1637	0.2913	1.1637	1.0788
No log	4.0	156	1.0748	0.3998	1.0748	1.0367
No log	4.0513	158	1.0766	0.3998	1.0766	1.0376
No log	4.1026	160	1.1599	0.2874	1.1599	1.0770
No log	4.1538	162	1.3943	0.3358	1.3943	1.1808
No log	4.2051	164	1.5070	0.2919	1.5070	1.2276
No log	4.2564	166	1.3366	0.2968	1.3366	1.1561
No log	4.3077	168	1.1979	0.2991	1.1979	1.0945
No log	4.3590	170	1.1474	0.3418	1.1474	1.0712
No log	4.4103	172	1.1371	0.4048	1.1371	1.0663
No log	4.4615	174	1.1280	0.3405	1.1280	1.0621
No log	4.5128	176	1.2247	0.2437	1.2247	1.1066
No log	4.5641	178	1.3490	0.2650	1.3490	1.1615
No log	4.6154	180	1.3077	0.2726	1.3077	1.1436
No log	4.6667	182	1.1462	0.2608	1.1462	1.0706
No log	4.7179	184	1.0519	0.3574	1.0519	1.0256
No log	4.7692	186	1.0413	0.3907	1.0413	1.0204
No log	4.8205	188	1.0441	0.3611	1.0441	1.0218
No log	4.8718	190	1.0699	0.3515	1.0699	1.0344
No log	4.9231	192	1.1201	0.3541	1.1201	1.0583
No log	4.9744	194	1.3016	0.3204	1.3016	1.1409
No log	5.0256	196	1.5439	0.3692	1.5439	1.2425
No log	5.0769	198	1.5113	0.3824	1.5113	1.2293
No log	5.1282	200	1.2105	0.3118	1.2105	1.1002
No log	5.1795	202	1.0625	0.3115	1.0625	1.0308
No log	5.2308	204	1.0431	0.2993	1.0431	1.0213
No log	5.2821	206	1.1097	0.2857	1.1097	1.0534
No log	5.3333	208	1.2774	0.2985	1.2774	1.1302
No log	5.3846	210	1.3799	0.3265	1.3799	1.1747
No log	5.4359	212	1.3203	0.3309	1.3203	1.1491
No log	5.4872	214	1.1904	0.3030	1.1904	1.0911
No log	5.5385	216	1.1087	0.3194	1.1087	1.0529
No log	5.5897	218	1.1047	0.3610	1.1047	1.0510
No log	5.6410	220	1.1128	0.3314	1.1128	1.0549
No log	5.6923	222	1.1471	0.2487	1.1471	1.0710
No log	5.7436	224	1.1753	0.3316	1.1753	1.0841
No log	5.7949	226	1.0721	0.3249	1.0721	1.0354
No log	5.8462	228	1.0055	0.4370	1.0055	1.0027
No log	5.8974	230	0.9962	0.3861	0.9962	0.9981
No log	5.9487	232	1.0134	0.3255	1.0134	1.0067
No log	6.0	234	1.0213	0.3552	1.0213	1.0106
No log	6.0513	236	1.0788	0.3413	1.0788	1.0386
No log	6.1026	238	1.0970	0.4093	1.0970	1.0474
No log	6.1538	240	1.0712	0.3678	1.0712	1.0350
No log	6.2051	242	1.0098	0.3387	1.0098	1.0049
No log	6.2564	244	1.0207	0.3610	1.0207	1.0103
No log	6.3077	246	1.0535	0.3627	1.0535	1.0264
No log	6.3590	248	1.0709	0.3290	1.0709	1.0348
No log	6.4103	250	1.0500	0.2969	1.0500	1.0247
No log	6.4615	252	1.0651	0.4094	1.0651	1.0320
No log	6.5128	254	1.0749	0.4467	1.0749	1.0368
No log	6.5641	256	1.0563	0.3336	1.0563	1.0277
No log	6.6154	258	1.1975	0.3523	1.1975	1.0943
No log	6.6667	260	1.3784	0.3787	1.3784	1.1740
No log	6.7179	262	1.3091	0.3604	1.3091	1.1442
No log	6.7692	264	1.1355	0.2515	1.1355	1.0656
No log	6.8205	266	1.1051	0.2588	1.1051	1.0512
No log	6.8718	268	1.0833	0.2972	1.0833	1.0408
No log	6.9231	270	1.1110	0.3238	1.1110	1.0540
No log	6.9744	272	1.2002	0.2740	1.2002	1.0956
No log	7.0256	274	1.3703	0.3865	1.3703	1.1706
No log	7.0769	276	1.4061	0.4306	1.4061	1.1858
No log	7.1282	278	1.2126	0.3388	1.2126	1.1012
No log	7.1795	280	1.0414	0.2901	1.0414	1.0205
No log	7.2308	282	1.0091	0.2634	1.0091	1.0045
No log	7.2821	284	0.9841	0.3446	0.9841	0.9920
No log	7.3333	286	0.9824	0.3882	0.9824	0.9912
No log	7.3846	288	1.0411	0.2804	1.0411	1.0204
No log	7.4359	290	1.2637	0.3217	1.2637	1.1242
No log	7.4872	292	1.2625	0.2760	1.2625	1.1236
No log	7.5385	294	1.0993	0.3498	1.0993	1.0485
No log	7.5897	296	0.9987	0.3795	0.9987	0.9994
No log	7.6410	298	1.0055	0.3986	1.0055	1.0028
No log	7.6923	300	0.9812	0.3454	0.9812	0.9905
No log	7.7436	302	0.9894	0.3497	0.9894	0.9947
No log	7.7949	304	1.0311	0.2348	1.0311	1.0154
No log	7.8462	306	1.0746	0.2851	1.0746	1.0366
No log	7.8974	308	1.1023	0.3238	1.1023	1.0499
No log	7.9487	310	1.0269	0.3097	1.0269	1.0134
No log	8.0	312	0.9846	0.3704	0.9846	0.9923
No log	8.0513	314	0.9965	0.4112	0.9965	0.9982
No log	8.1026	316	1.0080	0.4309	1.0080	1.0040
No log	8.1538	318	1.0145	0.3946	1.0145	1.0072
No log	8.2051	320	1.0699	0.3532	1.0699	1.0344
No log	8.2564	322	1.1492	0.3615	1.1492	1.0720
No log	8.3077	324	1.0785	0.2570	1.0785	1.0385
No log	8.3590	326	1.0129	0.2871	1.0129	1.0064
No log	8.4103	328	0.9995	0.3578	0.9995	0.9997
No log	8.4615	330	1.0280	0.3715	1.0280	1.0139
No log	8.5128	332	1.0373	0.4007	1.0373	1.0185
No log	8.5641	334	0.9895	0.3473	0.9895	0.9948
No log	8.6154	336	1.0076	0.4459	1.0076	1.0038
No log	8.6667	338	1.0004	0.4366	1.0004	1.0002
No log	8.7179	340	0.9941	0.3563	0.9941	0.9970
No log	8.7692	342	1.0937	0.3509	1.0937	1.0458
No log	8.8205	344	1.0841	0.2985	1.0841	1.0412
No log	8.8718	346	0.9757	0.3590	0.9757	0.9878
No log	8.9231	348	0.9450	0.4216	0.9450	0.9721
No log	8.9744	350	0.9431	0.4306	0.9431	0.9711
No log	9.0256	352	0.9351	0.3737	0.9351	0.9670
No log	9.0769	354	0.9388	0.3781	0.9388	0.9689
No log	9.1282	356	0.9580	0.3803	0.9580	0.9788
No log	9.1795	358	1.0063	0.3672	1.0063	1.0031
No log	9.2308	360	1.0037	0.3418	1.0037	1.0018
No log	9.2821	362	0.9652	0.4286	0.9652	0.9824
No log	9.3333	364	0.9674	0.4272	0.9674	0.9836
No log	9.3846	366	0.9816	0.3929	0.9816	0.9908
No log	9.4359	368	0.9718	0.4337	0.9718	0.9858
No log	9.4872	370	0.9740	0.4075	0.9740	0.9869
No log	9.5385	372	1.0490	0.3689	1.0490	1.0242
No log	9.5897	374	1.1232	0.3778	1.1232	1.0598
No log	9.6410	376	1.0660	0.3459	1.0660	1.0324
No log	9.6923	378	1.0111	0.3940	1.0111	1.0055
No log	9.7436	380	1.0205	0.3205	1.0205	1.0102
No log	9.7949	382	1.0309	0.3566	1.0309	1.0153
No log	9.8462	384	1.0717	0.3294	1.0717	1.0353
No log	9.8974	386	1.1209	0.2881	1.1209	1.0587
No log	9.9487	388	1.0943	0.3329	1.0943	1.0461
No log	10.0	390	1.0497	0.3861	1.0497	1.0246
No log	10.0513	392	1.0260	0.3861	1.0260	1.0129
No log	10.1026	394	1.0124	0.3861	1.0124	1.0062
No log	10.1538	396	1.0143	0.3861	1.0143	1.0071
No log	10.2051	398	1.0479	0.3960	1.0479	1.0237
No log	10.2564	400	1.0815	0.2581	1.0815	1.0400
No log	10.3077	402	1.0574	0.3243	1.0574	1.0283
No log	10.3590	404	0.9991	0.3804	0.9991	0.9996
No log	10.4103	406	0.9952	0.3237	0.9952	0.9976
No log	10.4615	408	1.0011	0.3172	1.0011	1.0006
No log	10.5128	410	0.9902	0.3690	0.9902	0.9951
No log	10.5641	412	1.0253	0.3913	1.0253	1.0126
No log	10.6154	414	1.1657	0.3605	1.1657	1.0797
No log	10.6667	416	1.1888	0.3811	1.1888	1.0903
No log	10.7179	418	1.0579	0.4070	1.0579	1.0285
No log	10.7692	420	0.9770	0.3671	0.9770	0.9884
No log	10.8205	422	0.9662	0.3858	0.9662	0.9829
No log	10.8718	424	0.9667	0.4067	0.9667	0.9832
No log	10.9231	426	0.9505	0.3335	0.9505	0.9749
No log	10.9744	428	0.9335	0.3650	0.9335	0.9662
No log	11.0256	430	1.0401	0.4018	1.0401	1.0198
No log	11.0769	432	1.1956	0.3757	1.1956	1.0934
No log	11.1282	434	1.2099	0.4025	1.2099	1.0999
No log	11.1795	436	1.0660	0.4590	1.0660	1.0325
No log	11.2308	438	0.9358	0.4504	0.9358	0.9674
No log	11.2821	440	0.9072	0.3913	0.9072	0.9525
No log	11.3333	442	0.9136	0.4002	0.9136	0.9558
No log	11.3846	444	0.9231	0.4311	0.9231	0.9608
No log	11.4359	446	0.9481	0.3458	0.9481	0.9737
No log	11.4872	448	1.0068	0.3572	1.0068	1.0034
No log	11.5385	450	0.9933	0.3675	0.9933	0.9966
No log	11.5897	452	0.9655	0.3913	0.9655	0.9826
No log	11.6410	454	0.9407	0.4110	0.9407	0.9699
No log	11.6923	456	0.9410	0.4110	0.9410	0.9701
No log	11.7436	458	0.9326	0.3988	0.9326	0.9657
No log	11.7949	460	0.9447	0.3928	0.9447	0.9719
No log	11.8462	462	0.9516	0.3678	0.9516	0.9755
No log	11.8974	464	0.9368	0.4160	0.9368	0.9679
No log	11.9487	466	0.9392	0.4160	0.9392	0.9691
No log	12.0	468	0.9434	0.4290	0.9434	0.9713
No log	12.0513	470	0.9616	0.3166	0.9616	0.9806
No log	12.1026	472	0.9624	0.3166	0.9624	0.9810
No log	12.1538	474	0.9562	0.3789	0.9562	0.9779
No log	12.2051	476	0.9724	0.3871	0.9724	0.9861
No log	12.2564	478	1.0194	0.4057	1.0194	1.0097
No log	12.3077	480	1.0285	0.4256	1.0285	1.0142
No log	12.3590	482	0.9828	0.4276	0.9828	0.9913
No log	12.4103	484	0.9345	0.3788	0.9345	0.9667
No log	12.4615	486	0.9462	0.4503	0.9462	0.9727
No log	12.5128	488	0.9489	0.4528	0.9489	0.9741
No log	12.5641	490	0.9347	0.4423	0.9347	0.9668
No log	12.6154	492	0.9530	0.5021	0.9530	0.9762
No log	12.6667	494	1.0174	0.4336	1.0174	1.0086
No log	12.7179	496	1.0960	0.4267	1.0960	1.0469
No log	12.7692	498	1.1786	0.3980	1.1786	1.0857
0.3342	12.8205	500	1.1197	0.3660	1.1197	1.0582
0.3342	12.8718	502	1.0007	0.3397	1.0007	1.0003
0.3342	12.9231	504	0.9642	0.3596	0.9642	0.9819
0.3342	12.9744	506	0.9552	0.3650	0.9552	0.9773
0.3342	13.0256	508	0.9541	0.3836	0.9541	0.9768
0.3342	13.0769	510	0.9997	0.3287	0.9997	0.9998
0.3342	13.1282	512	1.0389	0.3255	1.0389	1.0192
0.3342	13.1795	514	1.0063	0.3614	1.0063	1.0031
0.3342	13.2308	516	0.9659	0.4268	0.9659	0.9828
0.3342	13.2821	518	0.9509	0.4088	0.9509	0.9751
0.3342	13.3333	520	0.9431	0.4176	0.9431	0.9711
0.3342	13.3846	522	0.9292	0.4075	0.9292	0.9639
0.3342	13.4359	524	0.9316	0.4075	0.9316	0.9652
0.3342	13.4872	526	0.9369	0.4075	0.9369	0.9679
0.3342	13.5385	528	0.9475	0.3618	0.9475	0.9734
0.3342	13.5897	530	0.9743	0.3418	0.9743	0.9871
0.3342	13.6410	532	1.0034	0.3124	1.0034	1.0017
0.3342	13.6923	534	0.9992	0.3124	0.9992	0.9996
0.3342	13.7436	536	0.9919	0.3313	0.9919	0.9960

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1