ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1527
• Qwk: 0.3427
• Mse: 1.1527
• Rmse: 1.0737

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0187	2	4.5178	0.0010	4.5178	2.1255
No log	0.0374	4	2.8043	-0.0420	2.8043	1.6746
No log	0.0561	6	1.5936	0.0142	1.5936	1.2624
No log	0.0748	8	1.2619	0.1049	1.2619	1.1233
No log	0.0935	10	1.3244	0.0464	1.3244	1.1508
No log	0.1121	12	1.6187	-0.0047	1.6187	1.2723
No log	0.1308	14	1.7277	0.0372	1.7277	1.3144
No log	0.1495	16	1.3521	-0.0132	1.3521	1.1628
No log	0.1682	18	1.3662	0.0019	1.3662	1.1689
No log	0.1869	20	1.4287	0.0	1.4287	1.1953
No log	0.2056	22	1.4473	0.0	1.4473	1.2030
No log	0.2243	24	1.4044	0.0254	1.4044	1.1851
No log	0.2430	26	1.2987	-0.0343	1.2987	1.1396
No log	0.2617	28	1.2404	0.1314	1.2404	1.1137
No log	0.2804	30	1.2089	0.0427	1.2089	1.0995
No log	0.2991	32	1.1729	0.1786	1.1729	1.0830
No log	0.3178	34	1.1465	0.1505	1.1465	1.0707
No log	0.3364	36	1.1329	0.1505	1.1329	1.0644
No log	0.3551	38	1.1821	0.2086	1.1821	1.0873
No log	0.3738	40	1.2231	0.1671	1.2231	1.1059
No log	0.3925	42	1.3306	0.1815	1.3306	1.1535
No log	0.4112	44	1.2115	0.2521	1.2115	1.1007
No log	0.4299	46	1.1617	0.2515	1.1617	1.0778
No log	0.4486	48	1.1999	0.2891	1.1999	1.0954
No log	0.4673	50	1.2082	0.2232	1.2082	1.0992
No log	0.4860	52	1.2507	0.3005	1.2507	1.1183
No log	0.5047	54	1.1469	0.3355	1.1469	1.0709
No log	0.5234	56	1.0126	0.3418	1.0126	1.0063
No log	0.5421	58	0.9363	0.3845	0.9363	0.9676
No log	0.5607	60	0.9794	0.4434	0.9794	0.9896
No log	0.5794	62	1.0120	0.3696	1.0120	1.0060
No log	0.5981	64	0.8954	0.4440	0.8954	0.9463
No log	0.6168	66	0.9142	0.4643	0.9142	0.9561
No log	0.6355	68	0.9141	0.4634	0.9141	0.9561
No log	0.6542	70	0.9867	0.4973	0.9867	0.9933
No log	0.6729	72	1.1020	0.4523	1.1020	1.0498
No log	0.6916	74	0.9618	0.5151	0.9618	0.9807
No log	0.7103	76	0.9224	0.4230	0.9224	0.9604
No log	0.7290	78	1.1187	0.4235	1.1187	1.0577
No log	0.7477	80	1.1348	0.4449	1.1348	1.0653
No log	0.7664	82	0.9258	0.4898	0.9258	0.9622
No log	0.7850	84	1.1907	0.4215	1.1907	1.0912
No log	0.8037	86	1.2605	0.4430	1.2605	1.1227
No log	0.8224	88	1.0426	0.4799	1.0426	1.0211
No log	0.8411	90	1.0660	0.4481	1.0660	1.0325
No log	0.8598	92	1.0350	0.4700	1.0350	1.0174
No log	0.8785	94	1.0064	0.5218	1.0064	1.0032
No log	0.8972	96	1.0524	0.5393	1.0524	1.0259
No log	0.9159	98	1.0722	0.4913	1.0722	1.0355
No log	0.9346	100	0.8980	0.5185	0.8980	0.9476
No log	0.9533	102	0.8784	0.5131	0.8784	0.9372
No log	0.9720	104	0.9327	0.5141	0.9327	0.9657
No log	0.9907	106	1.0802	0.4071	1.0802	1.0393
No log	1.0093	108	1.0233	0.4732	1.0233	1.0116
No log	1.0280	110	0.9578	0.4914	0.9578	0.9787
No log	1.0467	112	0.8969	0.4579	0.8969	0.9470
No log	1.0654	114	0.8778	0.5040	0.8778	0.9369
No log	1.0841	116	0.9067	0.5324	0.9067	0.9522
No log	1.1028	118	1.0558	0.4386	1.0558	1.0275
No log	1.1215	120	1.0451	0.5080	1.0451	1.0223
No log	1.1402	122	1.0536	0.5027	1.0536	1.0265
No log	1.1589	124	1.0118	0.4215	1.0118	1.0059
No log	1.1776	126	1.1483	0.4279	1.1483	1.0716
No log	1.1963	128	1.1668	0.4055	1.1668	1.0802
No log	1.2150	130	1.0876	0.5345	1.0876	1.0429
No log	1.2336	132	1.1530	0.4589	1.1530	1.0738
No log	1.2523	134	1.2166	0.3407	1.2166	1.1030
No log	1.2710	136	1.1169	0.4470	1.1169	1.0568
No log	1.2897	138	1.1509	0.3766	1.1509	1.0728
No log	1.3084	140	1.1555	0.3657	1.1555	1.0750
No log	1.3271	142	1.0471	0.5266	1.0471	1.0233
No log	1.3458	144	1.1075	0.4645	1.1075	1.0524
No log	1.3645	146	1.0740	0.5164	1.0740	1.0363
No log	1.3832	148	1.0557	0.4918	1.0557	1.0275
No log	1.4019	150	1.3020	0.4141	1.3020	1.1411
No log	1.4206	152	1.6968	0.2579	1.6968	1.3026
No log	1.4393	154	1.4806	0.3058	1.4806	1.2168
No log	1.4579	156	1.0857	0.3742	1.0857	1.0420
No log	1.4766	158	1.1690	0.2486	1.1690	1.0812
No log	1.4953	160	1.1943	0.2501	1.1943	1.0929
No log	1.5140	162	1.0705	0.2661	1.0705	1.0346
No log	1.5327	164	1.2510	0.3398	1.2510	1.1185
No log	1.5514	166	1.4508	0.3025	1.4508	1.2045
No log	1.5701	168	1.3187	0.3632	1.3187	1.1484
No log	1.5888	170	1.1393	0.3595	1.1393	1.0674
No log	1.6075	172	1.0855	0.2747	1.0855	1.0419
No log	1.6262	174	1.0747	0.3019	1.0747	1.0367
No log	1.6449	176	1.2116	0.4432	1.2116	1.1007
No log	1.6636	178	1.3047	0.4035	1.3047	1.1422
No log	1.6822	180	1.2626	0.4393	1.2626	1.1236
No log	1.7009	182	1.0636	0.3225	1.0636	1.0313
No log	1.7196	184	1.0401	0.3134	1.0401	1.0198
No log	1.7383	186	1.0565	0.2374	1.0565	1.0279
No log	1.7570	188	1.0527	0.2038	1.0527	1.0260
No log	1.7757	190	1.0302	0.2898	1.0302	1.0150
No log	1.7944	192	1.0282	0.3346	1.0282	1.0140
No log	1.8131	194	1.0273	0.2850	1.0273	1.0136
No log	1.8318	196	1.0436	0.3403	1.0436	1.0216
No log	1.8505	198	1.2019	0.3966	1.2019	1.0963
No log	1.8692	200	1.3381	0.2987	1.3381	1.1568
No log	1.8879	202	1.2584	0.3832	1.2584	1.1218
No log	1.9065	204	1.0768	0.3643	1.0768	1.0377
No log	1.9252	206	1.0341	0.3286	1.0341	1.0169
No log	1.9439	208	1.0318	0.3500	1.0318	1.0158
No log	1.9626	210	1.0263	0.3496	1.0263	1.0131
No log	1.9813	212	1.0269	0.3377	1.0269	1.0134
No log	2.0	214	1.0474	0.3561	1.0474	1.0234
No log	2.0187	216	1.0867	0.3975	1.0867	1.0425
No log	2.0374	218	1.0989	0.3613	1.0989	1.0483
No log	2.0561	220	1.0752	0.3385	1.0752	1.0369
No log	2.0748	222	1.0800	0.3385	1.0800	1.0392
No log	2.0935	224	1.0704	0.3385	1.0704	1.0346
No log	2.1121	226	1.0116	0.3454	1.0116	1.0058
No log	2.1308	228	0.9619	0.3631	0.9619	0.9808
No log	2.1495	230	0.9372	0.4160	0.9372	0.9681
No log	2.1682	232	0.9035	0.4540	0.9035	0.9505
No log	2.1869	234	1.0290	0.4485	1.0290	1.0144
No log	2.2056	236	1.1287	0.4492	1.1287	1.0624
No log	2.2243	238	1.0604	0.4253	1.0604	1.0298
No log	2.2430	240	0.9877	0.3520	0.9877	0.9938
No log	2.2617	242	0.9278	0.3819	0.9278	0.9632
No log	2.2804	244	0.9343	0.4181	0.9343	0.9666
No log	2.2991	246	1.0003	0.4465	1.0003	1.0002
No log	2.3178	248	1.1265	0.3478	1.1265	1.0614
No log	2.3364	250	1.1234	0.3928	1.1234	1.0599
No log	2.3551	252	0.9953	0.4465	0.9953	0.9976
No log	2.3738	254	0.9661	0.3511	0.9661	0.9829
No log	2.3925	256	0.9898	0.4454	0.9898	0.9949
No log	2.4112	258	1.0323	0.4540	1.0323	1.0160
No log	2.4299	260	1.0638	0.4833	1.0638	1.0314
No log	2.4486	262	1.1063	0.4655	1.1063	1.0518
No log	2.4673	264	0.9961	0.4331	0.9961	0.9981
No log	2.4860	266	0.9567	0.3845	0.9567	0.9781
No log	2.5047	268	0.9740	0.3804	0.9740	0.9869
No log	2.5234	270	1.0387	0.4028	1.0387	1.0192
No log	2.5421	272	1.0233	0.3880	1.0233	1.0116
No log	2.5607	274	0.9969	0.3674	0.9969	0.9985
No log	2.5794	276	1.0381	0.4110	1.0381	1.0189
No log	2.5981	278	1.0378	0.4237	1.0378	1.0187
No log	2.6168	280	1.0431	0.4144	1.0431	1.0213
No log	2.6355	282	1.0902	0.3982	1.0902	1.0441
No log	2.6542	284	1.0582	0.3506	1.0582	1.0287
No log	2.6729	286	1.0350	0.3535	1.0350	1.0174
No log	2.6916	288	1.0511	0.3205	1.0511	1.0252
No log	2.7103	290	1.0918	0.3729	1.0918	1.0449
No log	2.7290	292	1.1520	0.3503	1.1520	1.0733
No log	2.7477	294	1.1620	0.3993	1.1620	1.0780
No log	2.7664	296	1.1153	0.3747	1.1153	1.0561
No log	2.7850	298	1.0570	0.3062	1.0570	1.0281
No log	2.8037	300	1.0714	0.3346	1.0714	1.0351
No log	2.8224	302	1.0459	0.3062	1.0459	1.0227
No log	2.8411	304	1.0807	0.3506	1.0807	1.0395
No log	2.8598	306	1.0750	0.2971	1.0750	1.0368
No log	2.8785	308	1.0489	0.2923	1.0489	1.0242
No log	2.8972	310	1.0709	0.2562	1.0709	1.0349
No log	2.9159	312	1.1226	0.3945	1.1226	1.0595
No log	2.9346	314	1.1820	0.3785	1.1820	1.0872
No log	2.9533	316	1.2732	0.3064	1.2732	1.1284
No log	2.9720	318	1.2579	0.3064	1.2579	1.1216
No log	2.9907	320	1.1146	0.3618	1.1146	1.0557
No log	3.0093	322	0.9736	0.2755	0.9736	0.9867
No log	3.0280	324	0.9598	0.3723	0.9598	0.9797
No log	3.0467	326	0.9741	0.3268	0.9741	0.9870
No log	3.0654	328	1.1104	0.4098	1.1104	1.0538
No log	3.0841	330	1.1699	0.4104	1.1699	1.0816
No log	3.1028	332	1.0731	0.4072	1.0731	1.0359
No log	3.1215	334	0.9930	0.3155	0.9930	0.9965
No log	3.1402	336	1.0095	0.3230	1.0095	1.0048
No log	3.1589	338	0.9944	0.3230	0.9944	0.9972
No log	3.1776	340	0.9823	0.3845	0.9823	0.9911
No log	3.1963	342	1.0410	0.3643	1.0410	1.0203
No log	3.2150	344	1.0808	0.3602	1.0808	1.0396
No log	3.2336	346	1.0354	0.4104	1.0354	1.0176
No log	3.2523	348	1.0087	0.3674	1.0087	1.0043
No log	3.2710	350	0.9787	0.3943	0.9787	0.9893
No log	3.2897	352	1.0013	0.3674	1.0013	1.0006
No log	3.3084	354	1.0558	0.4074	1.0558	1.0275
No log	3.3271	356	1.0982	0.4007	1.0982	1.0479
No log	3.3458	358	1.1118	0.3755	1.1118	1.0544
No log	3.3645	360	1.0321	0.3318	1.0321	1.0159
No log	3.3832	362	0.9845	0.2892	0.9845	0.9922
No log	3.4019	364	0.9996	0.2892	0.9996	0.9998
No log	3.4206	366	1.0223	0.2625	1.0223	1.0111
No log	3.4393	368	1.1524	0.3515	1.1524	1.0735
No log	3.4579	370	1.2186	0.3261	1.2186	1.1039
No log	3.4766	372	1.1175	0.3502	1.1175	1.0571
No log	3.4953	374	0.9931	0.2432	0.9931	0.9965
No log	3.5140	376	0.9881	0.2892	0.9881	0.9941
No log	3.5327	378	0.9916	0.2038	0.9916	0.9958
No log	3.5514	380	1.0988	0.3409	1.0988	1.0483
No log	3.5701	382	1.3666	0.3317	1.3666	1.1690
No log	3.5888	384	1.4117	0.3317	1.4117	1.1881
No log	3.6075	386	1.2616	0.2445	1.2616	1.1232
No log	3.6262	388	1.0837	0.2220	1.0837	1.0410
No log	3.6449	390	1.0375	0.2242	1.0375	1.0186
No log	3.6636	392	1.0290	0.2773	1.0290	1.0144
No log	3.6822	394	1.0383	0.2562	1.0383	1.0190
No log	3.7009	396	1.0763	0.2904	1.0763	1.0374
No log	3.7196	398	1.0594	0.3318	1.0594	1.0293
No log	3.7383	400	1.0753	0.3643	1.0753	1.0369
No log	3.7570	402	1.0207	0.3318	1.0207	1.0103
No log	3.7757	404	0.9930	0.3747	0.9930	0.9965
No log	3.7944	406	1.0106	0.3361	1.0106	1.0053
No log	3.8131	408	1.0912	0.3505	1.0912	1.0446
No log	3.8318	410	1.1213	0.3502	1.1213	1.0589
No log	3.8505	412	1.0543	0.3643	1.0543	1.0268
No log	3.8692	414	1.0131	0.2567	1.0131	1.0066
No log	3.8879	416	1.0077	0.3301	1.0077	1.0039
No log	3.9065	418	1.0037	0.2850	1.0037	1.0018
No log	3.9252	420	1.0247	0.3601	1.0247	1.0123
No log	3.9439	422	1.0311	0.3601	1.0311	1.0155
No log	3.9626	424	1.0203	0.3268	1.0203	1.0101
No log	3.9813	426	1.0093	0.3897	1.0093	1.0046
No log	4.0	428	1.0208	0.3205	1.0208	1.0103
No log	4.0187	430	1.0231	0.3205	1.0231	1.0115
No log	4.0374	432	1.0511	0.3268	1.0511	1.0252
No log	4.0561	434	1.0894	0.3601	1.0894	1.0437
No log	4.0748	436	1.0801	0.3268	1.0801	1.0393
No log	4.0935	438	1.0768	0.3084	1.0768	1.0377
No log	4.1121	440	1.1059	0.3361	1.1059	1.0516
No log	4.1308	442	1.1427	0.2403	1.1427	1.0690
No log	4.1495	444	1.1244	0.2512	1.1244	1.0604
No log	4.1682	446	1.1324	0.2218	1.1324	1.0641
No log	4.1869	448	1.1075	0.2946	1.1075	1.0524
No log	4.2056	450	1.0930	0.2349	1.0930	1.0455
No log	4.2243	452	1.0835	0.2993	1.0835	1.0409
No log	4.2430	454	1.1014	0.3385	1.1014	1.0495
No log	4.2617	456	1.1109	0.3492	1.1109	1.0540
No log	4.2804	458	1.0787	0.3756	1.0787	1.0386
No log	4.2991	460	1.0269	0.4050	1.0269	1.0134
No log	4.3178	462	1.0145	0.3819	1.0145	1.0072
No log	4.3364	464	1.0206	0.3819	1.0206	1.0102
No log	4.3551	466	1.0334	0.3412	1.0334	1.0166
No log	4.3738	468	1.0183	0.3263	1.0183	1.0091
No log	4.3925	470	1.0121	0.2843	1.0121	1.0060
No log	4.4112	472	1.0133	0.3137	1.0133	1.0066
No log	4.4299	474	1.0090	0.3113	1.0090	1.0045
No log	4.4486	476	1.0317	0.3654	1.0317	1.0157
No log	4.4673	478	1.1046	0.3365	1.1046	1.0510
No log	4.4860	480	1.2121	0.3513	1.2121	1.1010
No log	4.5047	482	1.1649	0.3639	1.1649	1.0793
No log	4.5234	484	1.0286	0.3841	1.0286	1.0142
No log	4.5421	486	0.9780	0.3399	0.9780	0.9889
No log	4.5607	488	1.0359	0.3532	1.0359	1.0178
No log	4.5794	490	0.9822	0.4139	0.9822	0.9911
No log	4.5981	492	0.9302	0.4637	0.9302	0.9645
No log	4.6168	494	1.0053	0.4325	1.0053	1.0027
No log	4.6355	496	1.1536	0.4497	1.1536	1.0741
No log	4.6542	498	1.1355	0.4502	1.1355	1.0656
0.3548	4.6729	500	1.0294	0.4201	1.0294	1.0146
0.3548	4.6916	502	0.9487	0.4081	0.9487	0.9740
0.3548	4.7103	504	0.9450	0.3458	0.9450	0.9721
0.3548	4.7290	506	0.9494	0.3319	0.9494	0.9744
0.3548	4.7477	508	0.9816	0.4181	0.9816	0.9908
0.3548	4.7664	510	1.1527	0.3427	1.1527	1.0737

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1