ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k14_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9869
• Qwk: 0.2988
• Mse: 0.9869
• Rmse: 0.9934

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0253	2	4.5166	-0.0163	4.5166	2.1252
No log	0.0506	4	3.2807	0.0224	3.2807	1.8113
No log	0.0759	6	1.6954	0.0629	1.6954	1.3021
No log	0.1013	8	1.2086	0.1845	1.2086	1.0994
No log	0.1266	10	1.4233	0.0439	1.4233	1.1930
No log	0.1519	12	1.4225	0.0613	1.4225	1.1927
No log	0.1772	14	1.4298	0.0454	1.4298	1.1958
No log	0.2025	16	1.3612	0.0454	1.3612	1.1667
No log	0.2278	18	1.2549	0.1379	1.2549	1.1202
No log	0.2532	20	1.3006	0.0803	1.3006	1.1405
No log	0.2785	22	1.5906	0.0	1.5906	1.2612
No log	0.3038	24	1.7122	0.0	1.7122	1.3085
No log	0.3291	26	1.5345	0.0	1.5345	1.2388
No log	0.3544	28	1.2831	0.0637	1.2831	1.1328
No log	0.3797	30	1.1019	0.3083	1.1019	1.0497
No log	0.4051	32	1.0284	0.3786	1.0284	1.0141
No log	0.4304	34	1.0496	0.1794	1.0496	1.0245
No log	0.4557	36	1.0882	0.0454	1.0882	1.0432
No log	0.4810	38	1.1095	0.0628	1.1095	1.0533
No log	0.5063	40	1.1100	0.1417	1.1100	1.0536
No log	0.5316	42	1.0824	0.2083	1.0824	1.0404
No log	0.5570	44	1.0614	0.3832	1.0614	1.0303
No log	0.5823	46	1.0760	0.4633	1.0760	1.0373
No log	0.6076	48	1.1261	0.1772	1.1261	1.0612
No log	0.6329	50	1.0610	0.2593	1.0610	1.0301
No log	0.6582	52	0.9945	0.4650	0.9945	0.9972
No log	0.6835	54	1.0983	0.3602	1.0983	1.0480
No log	0.7089	56	1.1623	0.2702	1.1623	1.0781
No log	0.7342	58	1.1974	0.2807	1.1974	1.0942
No log	0.7595	60	1.0468	0.4039	1.0468	1.0231
No log	0.7848	62	0.9154	0.3877	0.9154	0.9567
No log	0.8101	64	1.0267	0.2628	1.0267	1.0133
No log	0.8354	66	1.0039	0.2941	1.0039	1.0019
No log	0.8608	68	0.9565	0.1910	0.9565	0.9780
No log	0.8861	70	0.9442	0.3436	0.9442	0.9717
No log	0.9114	72	0.9299	0.4555	0.9299	0.9643
No log	0.9367	74	1.0518	0.3790	1.0518	1.0256
No log	0.9620	76	1.1776	0.2191	1.1776	1.0852
No log	0.9873	78	1.1558	0.2321	1.1558	1.0751
No log	1.0127	80	1.0669	0.3444	1.0669	1.0329
No log	1.0380	82	1.0548	0.3579	1.0548	1.0270
No log	1.0633	84	0.9559	0.4767	0.9559	0.9777
No log	1.0886	86	0.9572	0.4565	0.9572	0.9783
No log	1.1139	88	0.9466	0.4237	0.9466	0.9730
No log	1.1392	90	0.9120	0.4966	0.9120	0.9550
No log	1.1646	92	0.9736	0.4906	0.9736	0.9867
No log	1.1899	94	1.1542	0.3818	1.1542	1.0743
No log	1.2152	96	1.2360	0.3632	1.2360	1.1118
No log	1.2405	98	1.1170	0.4254	1.1170	1.0569
No log	1.2658	100	0.9600	0.5205	0.9600	0.9798
No log	1.2911	102	0.9745	0.5305	0.9745	0.9871
No log	1.3165	104	1.0309	0.4521	1.0309	1.0154
No log	1.3418	106	1.0257	0.4685	1.0257	1.0128
No log	1.3671	108	0.9490	0.5291	0.9490	0.9742
No log	1.3924	110	0.9127	0.5204	0.9127	0.9553
No log	1.4177	112	0.9166	0.5403	0.9166	0.9574
No log	1.4430	114	0.8826	0.5257	0.8826	0.9395
No log	1.4684	116	0.8406	0.4939	0.8406	0.9168
No log	1.4937	118	0.8491	0.6059	0.8491	0.9215
No log	1.5190	120	0.8043	0.4830	0.8043	0.8969
No log	1.5443	122	0.8478	0.5314	0.8478	0.9208
No log	1.5696	124	1.0069	0.5287	1.0069	1.0035
No log	1.5949	126	0.9518	0.4810	0.9518	0.9756
No log	1.6203	128	0.8531	0.5492	0.8531	0.9236
No log	1.6456	130	0.8128	0.4835	0.8128	0.9016
No log	1.6709	132	0.8423	0.5313	0.8423	0.9178
No log	1.6962	134	0.8308	0.4805	0.8308	0.9115
No log	1.7215	136	0.8413	0.5386	0.8413	0.9172
No log	1.7468	138	0.8738	0.4646	0.8738	0.9348
No log	1.7722	140	0.8990	0.4607	0.8990	0.9482
No log	1.7975	142	0.9278	0.5379	0.9278	0.9632
No log	1.8228	144	0.8825	0.5102	0.8825	0.9394
No log	1.8481	146	0.8535	0.5102	0.8535	0.9238
No log	1.8734	148	0.8327	0.5147	0.8327	0.9125
No log	1.8987	150	0.8555	0.5430	0.8555	0.9250
No log	1.9241	152	0.8446	0.5498	0.8446	0.9190
No log	1.9494	154	0.8652	0.5621	0.8652	0.9301
No log	1.9747	156	0.9807	0.4685	0.9807	0.9903
No log	2.0	158	0.9831	0.4906	0.9831	0.9915
No log	2.0253	160	0.8918	0.5248	0.8918	0.9443
No log	2.0506	162	0.9013	0.5380	0.9013	0.9494
No log	2.0759	164	0.8850	0.4736	0.8850	0.9407
No log	2.1013	166	0.9012	0.4493	0.9012	0.9493
No log	2.1266	168	0.9018	0.4122	0.9018	0.9496
No log	2.1519	170	0.9303	0.3836	0.9303	0.9645
No log	2.1772	172	0.9865	0.3255	0.9865	0.9932
No log	2.2025	174	0.9850	0.3190	0.9850	0.9925
No log	2.2278	176	1.0063	0.3839	1.0063	1.0032
No log	2.2532	178	1.0632	0.4743	1.0632	1.0311
No log	2.2785	180	1.0338	0.4685	1.0338	1.0168
No log	2.3038	182	1.0073	0.3171	1.0073	1.0036
No log	2.3291	184	0.9949	0.4102	0.9949	0.9974
No log	2.3544	186	0.9466	0.3758	0.9466	0.9729
No log	2.3797	188	1.0347	0.4761	1.0347	1.0172
No log	2.4051	190	0.9968	0.4886	0.9968	0.9984
No log	2.4304	192	0.8923	0.4579	0.8923	0.9446
No log	2.4557	194	0.8809	0.4424	0.8809	0.9385
No log	2.4810	196	0.9540	0.4736	0.9540	0.9767
No log	2.5063	198	0.8798	0.4962	0.8798	0.9380
No log	2.5316	200	0.8556	0.4910	0.8556	0.9250
No log	2.5570	202	0.9031	0.4829	0.9031	0.9503
No log	2.5823	204	0.8456	0.4597	0.8456	0.9196
No log	2.6076	206	0.8260	0.5320	0.8260	0.9088
No log	2.6329	208	0.9198	0.5788	0.9198	0.9591
No log	2.6582	210	0.9019	0.6116	0.9019	0.9497
No log	2.6835	212	0.8585	0.5802	0.8585	0.9266
No log	2.7089	214	0.8380	0.4668	0.8380	0.9154
No log	2.7342	216	0.9575	0.4557	0.9575	0.9785
No log	2.7595	218	1.0340	0.4639	1.0340	1.0169
No log	2.7848	220	0.9569	0.3750	0.9569	0.9782
No log	2.8101	222	0.8863	0.3874	0.8863	0.9415
No log	2.8354	224	0.8805	0.3914	0.8805	0.9383
No log	2.8608	226	0.9041	0.4202	0.9041	0.9509
No log	2.8861	228	0.9775	0.4862	0.9775	0.9887
No log	2.9114	230	1.0040	0.4668	1.0040	1.0020
No log	2.9367	232	0.9461	0.48	0.9461	0.9727
No log	2.9620	234	0.8994	0.4218	0.8994	0.9484
No log	2.9873	236	1.0209	0.4101	1.0209	1.0104
No log	3.0127	238	1.0886	0.3706	1.0886	1.0434
No log	3.0380	240	0.9810	0.4581	0.9810	0.9904
No log	3.0633	242	0.9119	0.4527	0.9119	0.9550
No log	3.0886	244	1.0283	0.5083	1.0283	1.0141
No log	3.1139	246	1.1163	0.4332	1.1163	1.0565
No log	3.1392	248	1.0343	0.5083	1.0343	1.0170
No log	3.1646	250	0.9157	0.4019	0.9157	0.9569
No log	3.1899	252	0.8875	0.4002	0.8875	0.9421
No log	3.2152	254	0.8772	0.4681	0.8772	0.9366
No log	3.2405	256	0.8750	0.5186	0.8750	0.9354
No log	3.2658	258	0.8731	0.4521	0.8731	0.9344
No log	3.2911	260	0.9773	0.5294	0.9773	0.9886
No log	3.3165	262	1.0903	0.4733	1.0903	1.0442
No log	3.3418	264	1.0331	0.4733	1.0331	1.0164
No log	3.3671	266	0.9149	0.3464	0.9149	0.9565
No log	3.3924	268	0.8411	0.4599	0.8411	0.9171
No log	3.4177	270	0.8310	0.4749	0.8310	0.9116
No log	3.4430	272	0.8321	0.5283	0.8321	0.9122
No log	3.4684	274	0.8816	0.5320	0.8816	0.9390
No log	3.4937	276	0.9645	0.4973	0.9645	0.9821
No log	3.5190	278	0.9297	0.5176	0.9297	0.9642
No log	3.5443	280	0.8242	0.5386	0.8242	0.9078
No log	3.5696	282	0.8199	0.5283	0.8199	0.9055
No log	3.5949	284	0.8303	0.5283	0.8303	0.9112
No log	3.6203	286	0.8317	0.4780	0.8317	0.9120
No log	3.6456	288	0.8495	0.4405	0.8495	0.9217
No log	3.6709	290	0.8940	0.4546	0.8940	0.9455
No log	3.6962	292	0.8980	0.4459	0.8980	0.9476
No log	3.7215	294	0.8707	0.4409	0.8707	0.9331
No log	3.7468	296	0.8812	0.5089	0.8812	0.9387
No log	3.7722	298	0.9149	0.4045	0.9149	0.9565
No log	3.7975	300	0.9038	0.4424	0.9038	0.9507
No log	3.8228	302	0.9249	0.3185	0.9249	0.9617
No log	3.8481	304	0.9859	0.3389	0.9859	0.9929
No log	3.8734	306	1.1017	0.3478	1.1017	1.0496
No log	3.8987	308	1.2262	0.3967	1.2262	1.1074
No log	3.9241	310	1.2304	0.3534	1.2304	1.1093
No log	3.9494	312	1.0647	0.4845	1.0647	1.0318
No log	3.9747	314	0.9062	0.4671	0.9062	0.9520
No log	4.0	316	0.9342	0.4516	0.9342	0.9665
No log	4.0253	318	0.9735	0.4459	0.9735	0.9867
No log	4.0506	320	0.9165	0.4140	0.9165	0.9573
No log	4.0759	322	0.8956	0.4413	0.8956	0.9464
No log	4.1013	324	0.9071	0.4413	0.9071	0.9524
No log	4.1266	326	0.9049	0.3987	0.9049	0.9513
No log	4.1519	328	0.9226	0.3987	0.9226	0.9605
No log	4.1772	330	0.9787	0.3756	0.9787	0.9893
No log	4.2025	332	1.1281	0.4533	1.1281	1.0621
No log	4.2278	334	1.1622	0.4219	1.1622	1.0781
No log	4.2532	336	1.0751	0.3492	1.0751	1.0369
No log	4.2785	338	1.0027	0.3508	1.0027	1.0014
No log	4.3038	340	1.0086	0.2823	1.0086	1.0043
No log	4.3291	342	0.9860	0.3180	0.9860	0.9930
No log	4.3544	344	0.9880	0.3434	0.9880	0.9940
No log	4.3797	346	1.0546	0.3595	1.0546	1.0269
No log	4.4051	348	1.1512	0.4502	1.1512	1.0729
No log	4.4304	350	1.1223	0.4219	1.1223	1.0594
No log	4.4557	352	1.0010	0.3584	1.0010	1.0005
No log	4.4810	354	0.9106	0.4548	0.9106	0.9543
No log	4.5063	356	0.9174	0.4782	0.9174	0.9578
No log	4.5316	358	0.9165	0.5132	0.9165	0.9573
No log	4.5570	360	0.8929	0.5186	0.8929	0.9449
No log	4.5823	362	0.8853	0.4757	0.8853	0.9409
No log	4.6076	364	0.8806	0.4656	0.8806	0.9384
No log	4.6329	366	0.9054	0.4879	0.9054	0.9515
No log	4.6582	368	0.9679	0.4624	0.9679	0.9838
No log	4.6835	370	0.9516	0.4794	0.9516	0.9755
No log	4.7089	372	0.9090	0.4318	0.9090	0.9534
No log	4.7342	374	0.9301	0.4381	0.9301	0.9644
No log	4.7595	376	0.9534	0.3621	0.9534	0.9764
No log	4.7848	378	0.9396	0.4002	0.9396	0.9693
No log	4.8101	380	0.9380	0.4583	0.9380	0.9685
No log	4.8354	382	0.9852	0.3773	0.9852	0.9926
No log	4.8608	384	0.9968	0.3773	0.9968	0.9984
No log	4.8861	386	0.9573	0.3268	0.9573	0.9784
No log	4.9114	388	0.9478	0.3902	0.9478	0.9735
No log	4.9367	390	0.9493	0.3522	0.9493	0.9743
No log	4.9620	392	0.9421	0.3632	0.9421	0.9706
No log	4.9873	394	0.9360	0.3621	0.9360	0.9675
No log	5.0127	396	0.9313	0.3902	0.9313	0.9651
No log	5.0380	398	0.9283	0.3804	0.9283	0.9635
No log	5.0633	400	0.9245	0.3811	0.9245	0.9615
No log	5.0886	402	0.9250	0.4181	0.9250	0.9618
No log	5.1139	404	0.9279	0.3908	0.9279	0.9633
No log	5.1392	406	0.9703	0.3848	0.9703	0.9851
No log	5.1646	408	0.9704	0.3848	0.9704	0.9851
No log	5.1899	410	0.9440	0.3275	0.9440	0.9716
No log	5.2152	412	0.9170	0.4450	0.9170	0.9576
No log	5.2405	414	0.9425	0.4	0.9425	0.9708
No log	5.2658	416	0.9306	0.4331	0.9306	0.9647
No log	5.2911	418	0.9074	0.4548	0.9074	0.9526
No log	5.3165	420	0.9188	0.3771	0.9188	0.9586
No log	5.3418	422	0.9446	0.3738	0.9446	0.9719
No log	5.3671	424	0.9806	0.3547	0.9806	0.9903
No log	5.3924	426	0.9554	0.3729	0.9554	0.9774
No log	5.4177	428	0.9375	0.3738	0.9375	0.9682
No log	5.4430	430	0.9425	0.3483	0.9425	0.9708
No log	5.4684	432	0.9440	0.4197	0.9440	0.9716
No log	5.4937	434	0.9401	0.4197	0.9401	0.9696
No log	5.5190	436	0.9274	0.4254	0.9274	0.9630
No log	5.5443	438	0.9532	0.4275	0.9532	0.9763
No log	5.5696	440	0.9602	0.4275	0.9602	0.9799
No log	5.5949	442	0.9630	0.4275	0.9630	0.9813
No log	5.6203	444	0.9678	0.4048	0.9678	0.9838
No log	5.6456	446	0.9921	0.3720	0.9921	0.9961
No log	5.6709	448	1.0197	0.3966	1.0197	1.0098
No log	5.6962	450	1.0280	0.3738	1.0280	1.0139
No log	5.7215	452	1.0093	0.3535	1.0093	1.0046
No log	5.7468	454	0.9987	0.3511	0.9987	0.9994
No log	5.7722	456	0.9910	0.3650	0.9910	0.9955
No log	5.7975	458	0.9766	0.4256	0.9766	0.9882
No log	5.8228	460	0.9738	0.4256	0.9738	0.9868
No log	5.8481	462	0.9899	0.3829	0.9899	0.9949
No log	5.8734	464	1.0055	0.2964	1.0055	1.0027
No log	5.8987	466	0.9724	0.3965	0.9724	0.9861
No log	5.9241	468	0.9476	0.3756	0.9476	0.9734
No log	5.9494	470	0.9617	0.3548	0.9617	0.9807
No log	5.9747	472	0.9772	0.3310	0.9772	0.9885
No log	6.0	474	0.9600	0.3520	0.9600	0.9798
No log	6.0253	476	0.9600	0.3042	0.9600	0.9798
No log	6.0506	478	0.9768	0.3506	0.9768	0.9883
No log	6.0759	480	0.9871	0.3506	0.9871	0.9935
No log	6.1013	482	1.0309	0.3400	1.0309	1.0153
No log	6.1266	484	1.0481	0.3285	1.0481	1.0238
No log	6.1519	486	0.9902	0.3697	0.9902	0.9951
No log	6.1772	488	0.9307	0.3525	0.9307	0.9647
No log	6.2025	490	0.9531	0.2886	0.9531	0.9763
No log	6.2278	492	0.9565	0.2785	0.9565	0.9780
No log	6.2532	494	0.9226	0.3195	0.9226	0.9605
No log	6.2785	496	0.9253	0.3493	0.9253	0.9619
No log	6.3038	498	0.9488	0.3577	0.9488	0.9741
0.4119	6.3291	500	0.9695	0.3677	0.9695	0.9847
0.4119	6.3544	502	0.9893	0.4031	0.9893	0.9946
0.4119	6.3797	504	0.9563	0.4293	0.9563	0.9779
0.4119	6.4051	506	0.9120	0.4328	0.9120	0.9550
0.4119	6.4304	508	0.9122	0.3907	0.9122	0.9551
0.4119	6.4557	510	0.9385	0.4318	0.9385	0.9688
0.4119	6.4810	512	0.8915	0.3683	0.8915	0.9442
0.4119	6.5063	514	0.8616	0.4485	0.8616	0.9282
0.4119	6.5316	516	0.8761	0.4257	0.8761	0.9360
0.4119	6.5570	518	0.9045	0.4760	0.9045	0.9511
0.4119	6.5823	520	0.9077	0.4626	0.9077	0.9527
0.4119	6.6076	522	0.8991	0.4257	0.8991	0.9482
0.4119	6.6329	524	0.8933	0.4548	0.8933	0.9452
0.4119	6.6582	526	0.9117	0.4013	0.9117	0.9548
0.4119	6.6835	528	0.9336	0.4363	0.9336	0.9662
0.4119	6.7089	530	0.9436	0.3897	0.9436	0.9714
0.4119	6.7342	532	0.9579	0.3635	0.9579	0.9787
0.4119	6.7595	534	0.9787	0.3635	0.9787	0.9893
0.4119	6.7848	536	1.0156	0.3302	1.0156	1.0078
0.4119	6.8101	538	0.9684	0.3624	0.9684	0.9841
0.4119	6.8354	540	0.9507	0.3720	0.9507	0.9751
0.4119	6.8608	542	0.9781	0.3602	0.9781	0.9890
0.4119	6.8861	544	0.9785	0.3697	0.9785	0.9892
0.4119	6.9114	546	0.9497	0.3463	0.9497	0.9745
0.4119	6.9367	548	0.9123	0.3508	0.9123	0.9552
0.4119	6.9620	550	0.8912	0.4219	0.8912	0.9440
0.4119	6.9873	552	0.8845	0.4219	0.8845	0.9405
0.4119	7.0127	554	0.8978	0.4273	0.8978	0.9475
0.4119	7.0380	556	0.9623	0.3902	0.9623	0.9810
0.4119	7.0633	558	0.9863	0.3986	0.9863	0.9931
0.4119	7.0886	560	0.9701	0.3975	0.9701	0.9849
0.4119	7.1139	562	0.9581	0.3508	0.9581	0.9788
0.4119	7.1392	564	0.9634	0.3674	0.9634	0.9815
0.4119	7.1646	566	0.9688	0.2938	0.9688	0.9843
0.4119	7.1899	568	0.9591	0.3290	0.9591	0.9793
0.4119	7.2152	570	0.9491	0.3902	0.9491	0.9742
0.4119	7.2405	572	0.9496	0.4373	0.9496	0.9745
0.4119	7.2658	574	0.9787	0.4328	0.9787	0.9893
0.4119	7.2911	576	0.9627	0.4612	0.9627	0.9812
0.4119	7.3165	578	0.9389	0.4982	0.9389	0.9690
0.4119	7.3418	580	0.9268	0.5086	0.9268	0.9627
0.4119	7.3671	582	0.9100	0.4996	0.9100	0.9539
0.4119	7.3924	584	0.9037	0.4316	0.9037	0.9506
0.4119	7.4177	586	0.9187	0.3943	0.9187	0.9585
0.4119	7.4430	588	0.9353	0.3552	0.9353	0.9671
0.4119	7.4684	590	0.9368	0.3728	0.9368	0.9679
0.4119	7.4937	592	0.9346	0.4019	0.9346	0.9668
0.4119	7.5190	594	0.9349	0.4705	0.9349	0.9669
0.4119	7.5443	596	0.9370	0.4435	0.9370	0.9680
0.4119	7.5696	598	0.9415	0.4089	0.9415	0.9703
0.4119	7.5949	600	0.9426	0.4521	0.9426	0.9709
0.4119	7.6203	602	0.9479	0.4181	0.9479	0.9736
0.4119	7.6456	604	0.9556	0.3924	0.9556	0.9776
0.4119	7.6709	606	0.9674	0.3181	0.9674	0.9835
0.4119	7.6962	608	0.9591	0.3392	0.9591	0.9793
0.4119	7.7215	610	0.9625	0.3483	0.9625	0.9811
0.4119	7.7468	612	0.9769	0.2914	0.9769	0.9884
0.4119	7.7722	614	0.9869	0.2988	0.9869	0.9934

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1