ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task7_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5576
• Qwk: 0.4482
• Mse: 0.5576
• Rmse: 0.7467

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	2.6053	-0.1213	2.6053	1.6141
No log	0.0645	4	1.4023	0.0704	1.4023	1.1842
No log	0.0968	6	0.9654	-0.0658	0.9654	0.9825
No log	0.1290	8	0.7626	0.1550	0.7626	0.8733
No log	0.1613	10	0.8048	0.2722	0.8048	0.8971
No log	0.1935	12	1.1028	0.1463	1.1028	1.0501
No log	0.2258	14	1.0158	0.2457	1.0158	1.0079
No log	0.2581	16	0.7585	0.2632	0.7585	0.8709
No log	0.2903	18	0.6447	0.3947	0.6447	0.8029
No log	0.3226	20	0.6359	0.2852	0.6359	0.7974
No log	0.3548	22	0.6404	0.3153	0.6404	0.8003
No log	0.3871	24	0.7292	0.2632	0.7292	0.8539
No log	0.4194	26	0.7682	0.2632	0.7682	0.8765
No log	0.4516	28	0.8673	0.2810	0.8673	0.9313
No log	0.4839	30	0.9281	0.2939	0.9281	0.9634
No log	0.5161	32	0.6887	0.2692	0.6887	0.8299
No log	0.5484	34	0.6291	0.4087	0.6291	0.7931
No log	0.5806	36	0.6309	0.4087	0.6309	0.7943
No log	0.6129	38	0.6186	0.4001	0.6186	0.7865
No log	0.6452	40	0.9510	0.3395	0.9510	0.9752
No log	0.6774	42	0.9720	0.3395	0.9720	0.9859
No log	0.7097	44	0.8300	0.3347	0.8300	0.9111
No log	0.7419	46	0.6038	0.3945	0.6038	0.7771
No log	0.7742	48	0.6430	0.4198	0.6430	0.8019
No log	0.8065	50	0.5961	0.4891	0.5961	0.7721
No log	0.8387	52	0.7165	0.2807	0.7165	0.8465
No log	0.8710	54	0.9309	0.3082	0.9309	0.9648
No log	0.9032	56	0.7528	0.3159	0.7528	0.8677
No log	0.9355	58	0.7475	0.3069	0.7475	0.8646
No log	0.9677	60	0.6950	0.3590	0.6950	0.8337
No log	1.0	62	0.7801	0.3433	0.7801	0.8833
No log	1.0323	64	0.7087	0.4251	0.7087	0.8418
No log	1.0645	66	0.5441	0.4253	0.5441	0.7377
No log	1.0968	68	0.5601	0.4674	0.5601	0.7484
No log	1.1290	70	0.5206	0.4866	0.5206	0.7215
No log	1.1613	72	0.5149	0.4866	0.5149	0.7176
No log	1.1935	74	0.5334	0.5127	0.5334	0.7304
No log	1.2258	76	0.5185	0.5507	0.5185	0.7201
No log	1.2581	78	0.5202	0.4782	0.5202	0.7213
No log	1.2903	80	0.5810	0.4929	0.5810	0.7623
No log	1.3226	82	0.6100	0.4664	0.6100	0.7810
No log	1.3548	84	0.7107	0.4707	0.7107	0.8430
No log	1.3871	86	0.7812	0.4549	0.7812	0.8839
No log	1.4194	88	0.5854	0.4911	0.5854	0.7651
No log	1.4516	90	0.5295	0.4678	0.5295	0.7277
No log	1.4839	92	0.5808	0.5495	0.5808	0.7621
No log	1.5161	94	0.5337	0.4458	0.5337	0.7305
No log	1.5484	96	0.5424	0.5232	0.5424	0.7365
No log	1.5806	98	0.5733	0.5092	0.5733	0.7572
No log	1.6129	100	0.7042	0.4359	0.7042	0.8392
No log	1.6452	102	0.6369	0.4813	0.6369	0.7980
No log	1.6774	104	0.6174	0.4451	0.6174	0.7858
No log	1.7097	106	0.8500	0.3697	0.8500	0.9220
No log	1.7419	108	0.8424	0.3477	0.8424	0.9178
No log	1.7742	110	0.6696	0.4911	0.6696	0.8183
No log	1.8065	112	0.5783	0.4722	0.5783	0.7605
No log	1.8387	114	0.5826	0.4722	0.5826	0.7633
No log	1.8710	116	0.5900	0.4475	0.5900	0.7681
No log	1.9032	118	0.7308	0.4587	0.7308	0.8549
No log	1.9355	120	0.8399	0.3827	0.8399	0.9164
No log	1.9677	122	0.7311	0.4665	0.7311	0.8550
No log	2.0	124	0.6922	0.4827	0.6922	0.8320
No log	2.0323	126	0.6369	0.4044	0.6369	0.7980
No log	2.0645	128	0.6246	0.3183	0.6246	0.7903
No log	2.0968	130	0.6261	0.3599	0.6261	0.7913
No log	2.1290	132	0.7295	0.4014	0.7295	0.8541
No log	2.1613	134	1.1363	0.2805	1.1363	1.0660
No log	2.1935	136	1.3202	0.1686	1.3202	1.1490
No log	2.2258	138	1.0965	0.2853	1.0965	1.0471
No log	2.2581	140	0.8002	0.3938	0.8002	0.8946
No log	2.2903	142	0.6437	0.2981	0.6437	0.8023
No log	2.3226	144	0.6266	0.2685	0.6266	0.7916
No log	2.3548	146	0.6557	0.4330	0.6557	0.8098
No log	2.3871	148	0.6545	0.4978	0.6545	0.8090
No log	2.4194	150	0.7130	0.4665	0.7130	0.8444
No log	2.4516	152	0.6424	0.4875	0.6424	0.8015
No log	2.4839	154	0.6230	0.3738	0.6230	0.7893
No log	2.5161	156	0.6939	0.3784	0.6939	0.8330
No log	2.5484	158	0.7397	0.4280	0.7397	0.8601
No log	2.5806	160	0.7141	0.4021	0.7141	0.8450
No log	2.6129	162	0.6292	0.3273	0.6292	0.7932
No log	2.6452	164	0.6265	0.3041	0.6265	0.7915
No log	2.6774	166	0.6587	0.3865	0.6587	0.8116
No log	2.7097	168	0.6969	0.4451	0.6969	0.8348
No log	2.7419	170	0.7221	0.3794	0.7221	0.8498
No log	2.7742	172	0.8178	0.4493	0.8178	0.9043
No log	2.8065	174	0.7830	0.4808	0.7830	0.8849
No log	2.8387	176	0.6825	0.3366	0.6825	0.8261
No log	2.8710	178	0.6522	0.3762	0.6522	0.8076
No log	2.9032	180	0.6586	0.4125	0.6586	0.8115
No log	2.9355	182	0.7164	0.3963	0.7164	0.8464
No log	2.9677	184	0.8868	0.3869	0.8868	0.9417
No log	3.0	186	0.9272	0.3576	0.9272	0.9629
No log	3.0323	188	0.7460	0.3754	0.7460	0.8637
No log	3.0645	190	0.5734	0.4504	0.5734	0.7572
No log	3.0968	192	0.5955	0.4958	0.5955	0.7717
No log	3.1290	194	0.7125	0.3417	0.7125	0.8441
No log	3.1613	196	0.7614	0.3579	0.7614	0.8726
No log	3.1935	198	0.6581	0.3707	0.6581	0.8112
No log	3.2258	200	0.5475	0.5010	0.5475	0.7399
No log	3.2581	202	0.6054	0.4112	0.6054	0.7781
No log	3.2903	204	0.7105	0.4646	0.7105	0.8429
No log	3.3226	206	0.6427	0.4522	0.6427	0.8017
No log	3.3548	208	0.5673	0.5003	0.5673	0.7532
No log	3.3871	210	0.5851	0.4984	0.5851	0.7649
No log	3.4194	212	0.6717	0.4014	0.6717	0.8196
No log	3.4516	214	0.7589	0.3960	0.7589	0.8712
No log	3.4839	216	0.7754	0.3601	0.7754	0.8806
No log	3.5161	218	0.8560	0.3082	0.8560	0.9252
No log	3.5484	220	0.7293	0.4419	0.7293	0.8540
No log	3.5806	222	0.6096	0.5131	0.6096	0.7808
No log	3.6129	224	0.6209	0.5271	0.6209	0.7880
No log	3.6452	226	0.7588	0.4474	0.7588	0.8711
No log	3.6774	228	1.0316	0.2843	1.0316	1.0157
No log	3.7097	230	1.1056	0.2336	1.1056	1.0515
No log	3.7419	232	0.9885	0.3010	0.9885	0.9942
No log	3.7742	234	0.7773	0.4183	0.7773	0.8817
No log	3.8065	236	0.6217	0.4684	0.6217	0.7885
No log	3.8387	238	0.5585	0.4660	0.5585	0.7474
No log	3.8710	240	0.5588	0.4660	0.5588	0.7475
No log	3.9032	242	0.5794	0.5214	0.5794	0.7612
No log	3.9355	244	0.6516	0.5086	0.6516	0.8072
No log	3.9677	246	0.7993	0.4853	0.7993	0.8941
No log	4.0	248	0.7263	0.4788	0.7263	0.8522
No log	4.0323	250	0.5674	0.3890	0.5674	0.7532
No log	4.0645	252	0.5442	0.4299	0.5442	0.7377
No log	4.0968	254	0.5500	0.4746	0.5500	0.7416
No log	4.1290	256	0.5394	0.4052	0.5394	0.7345
No log	4.1613	258	0.6212	0.5233	0.6212	0.7881
No log	4.1935	260	0.6664	0.4959	0.6664	0.8163
No log	4.2258	262	0.5789	0.5195	0.5789	0.7608
No log	4.2581	264	0.5373	0.4991	0.5373	0.7330
No log	4.2903	266	0.5621	0.5178	0.5621	0.7497
No log	4.3226	268	0.5548	0.5463	0.5548	0.7449
No log	4.3548	270	0.5414	0.5195	0.5414	0.7358
No log	4.3871	272	0.5844	0.4639	0.5844	0.7644
No log	4.4194	274	0.6878	0.4801	0.6878	0.8293
No log	4.4516	276	0.6824	0.5107	0.6824	0.8261
No log	4.4839	278	0.5808	0.4482	0.5808	0.7621
No log	4.5161	280	0.5621	0.4677	0.5621	0.7497
No log	4.5484	282	0.5927	0.5449	0.5927	0.7699
No log	4.5806	284	0.5547	0.4677	0.5547	0.7448
No log	4.6129	286	0.5638	0.4267	0.5638	0.7509
No log	4.6452	288	0.7593	0.4764	0.7593	0.8714
No log	4.6774	290	0.8771	0.3425	0.8771	0.9365
No log	4.7097	292	0.7749	0.3869	0.7749	0.8803
No log	4.7419	294	0.6703	0.4978	0.6703	0.8187
No log	4.7742	296	0.5429	0.4229	0.5429	0.7368
No log	4.8065	298	0.5298	0.4613	0.5298	0.7279
No log	4.8387	300	0.5351	0.3970	0.5351	0.7315
No log	4.8710	302	0.5637	0.4524	0.5637	0.7508
No log	4.9032	304	0.5714	0.4555	0.5714	0.7559
No log	4.9355	306	0.5602	0.3990	0.5602	0.7485
No log	4.9677	308	0.5676	0.4314	0.5676	0.7534
No log	5.0	310	0.5676	0.3738	0.5676	0.7534
No log	5.0323	312	0.5686	0.4555	0.5686	0.7541
No log	5.0645	314	0.5765	0.4555	0.5765	0.7593
No log	5.0968	316	0.5924	0.4769	0.5924	0.7697
No log	5.1290	318	0.5449	0.3970	0.5449	0.7381
No log	5.1613	320	0.5442	0.4838	0.5442	0.7377
No log	5.1935	322	0.5736	0.4997	0.5736	0.7573
No log	5.2258	324	0.5523	0.4838	0.5523	0.7432
No log	5.2581	326	0.5379	0.4253	0.5379	0.7334
No log	5.2903	328	0.6707	0.4627	0.6707	0.8190
No log	5.3226	330	0.7970	0.4556	0.7970	0.8928
No log	5.3548	332	0.8443	0.3807	0.8443	0.9189
No log	5.3871	334	0.7798	0.4556	0.7798	0.8830
No log	5.4194	336	0.6288	0.4880	0.6288	0.7930
No log	5.4516	338	0.5225	0.4782	0.5225	0.7228
No log	5.4839	340	0.5253	0.5143	0.5253	0.7248
No log	5.5161	342	0.5359	0.5248	0.5359	0.7320
No log	5.5484	344	0.5237	0.5357	0.5237	0.7237
No log	5.5806	346	0.5345	0.4934	0.5345	0.7311
No log	5.6129	348	0.6476	0.5329	0.6476	0.8047
No log	5.6452	350	0.7634	0.4474	0.7634	0.8737
No log	5.6774	352	0.7650	0.4400	0.7650	0.8747
No log	5.7097	354	0.6716	0.5183	0.6716	0.8195
No log	5.7419	356	0.6270	0.4352	0.6270	0.7918
No log	5.7742	358	0.6406	0.5201	0.6406	0.8004
No log	5.8065	360	0.7127	0.4788	0.7127	0.8442
No log	5.8387	362	0.7601	0.4255	0.7601	0.8718
No log	5.8710	364	0.7088	0.4788	0.7088	0.8419
No log	5.9032	366	0.6130	0.4774	0.6130	0.7830
No log	5.9355	368	0.5720	0.4229	0.5720	0.7563
No log	5.9677	370	0.5664	0.4591	0.5664	0.7526
No log	6.0	372	0.5621	0.4229	0.5621	0.7497
No log	6.0323	374	0.6291	0.5067	0.6291	0.7932
No log	6.0645	376	0.8966	0.3576	0.8966	0.9469
No log	6.0968	378	1.1020	0.2280	1.1020	1.0498
No log	6.1290	380	1.0686	0.2280	1.0686	1.0337
No log	6.1613	382	0.9342	0.2935	0.9342	0.9665
No log	6.1935	384	0.7248	0.4549	0.7248	0.8514
No log	6.2258	386	0.6006	0.5570	0.6006	0.7750
No log	6.2581	388	0.5394	0.5437	0.5394	0.7345
No log	6.2903	390	0.5513	0.5327	0.5513	0.7425
No log	6.3226	392	0.6253	0.5418	0.6253	0.7908
No log	6.3548	394	0.6871	0.5095	0.6871	0.8289
No log	6.3871	396	0.7148	0.5095	0.7148	0.8454
No log	6.4194	398	0.6791	0.5183	0.6791	0.8241
No log	6.4516	400	0.5958	0.4267	0.5958	0.7719
No log	6.4839	402	0.5395	0.3920	0.5395	0.7345
No log	6.5161	404	0.5345	0.4607	0.5345	0.7311
No log	6.5484	406	0.5551	0.4879	0.5551	0.7450
No log	6.5806	408	0.5448	0.5101	0.5448	0.7381
No log	6.6129	410	0.5097	0.4869	0.5097	0.7139
No log	6.6452	412	0.5363	0.4419	0.5363	0.7323
No log	6.6774	414	0.6531	0.5362	0.6531	0.8081
No log	6.7097	416	0.7451	0.4450	0.7451	0.8632
No log	6.7419	418	0.7546	0.4296	0.7546	0.8687
No log	6.7742	420	0.6934	0.4801	0.6934	0.8327
No log	6.8065	422	0.5937	0.5720	0.5937	0.7705
No log	6.8387	424	0.5516	0.4314	0.5516	0.7427
No log	6.8710	426	0.5562	0.4314	0.5562	0.7458
No log	6.9032	428	0.5980	0.5177	0.5980	0.7733
No log	6.9355	430	0.7310	0.4880	0.7310	0.8550
No log	6.9677	432	0.8295	0.3827	0.8295	0.9108
No log	7.0	434	0.8377	0.3827	0.8377	0.9153
No log	7.0323	436	0.7977	0.3719	0.7977	0.8931
No log	7.0645	438	0.7023	0.5274	0.7023	0.8380
No log	7.0968	440	0.6208	0.4524	0.6208	0.7879
No log	7.1290	442	0.5957	0.3081	0.5957	0.7718
No log	7.1613	444	0.5861	0.2780	0.5861	0.7656
No log	7.1935	446	0.5791	0.3100	0.5791	0.7610
No log	7.2258	448	0.5741	0.3352	0.5741	0.7577
No log	7.2581	450	0.5746	0.3865	0.5746	0.7580
No log	7.2903	452	0.6060	0.4292	0.6060	0.7784
No log	7.3226	454	0.6597	0.5131	0.6597	0.8122
No log	7.3548	456	0.6861	0.5345	0.6861	0.8283
No log	7.3871	458	0.6568	0.5131	0.6568	0.8105
No log	7.4194	460	0.6184	0.5086	0.6184	0.7864
No log	7.4516	462	0.5922	0.4473	0.5922	0.7695
No log	7.4839	464	0.5819	0.5271	0.5819	0.7628
No log	7.5161	466	0.6058	0.5498	0.6058	0.7784
No log	7.5484	468	0.6113	0.5527	0.6113	0.7819
No log	7.5806	470	0.5821	0.5498	0.5821	0.7629
No log	7.6129	472	0.5606	0.5752	0.5606	0.7487
No log	7.6452	474	0.5465	0.5021	0.5465	0.7393
No log	7.6774	476	0.5508	0.5159	0.5508	0.7422
No log	7.7097	478	0.5836	0.5965	0.5836	0.7639
No log	7.7419	480	0.6300	0.5935	0.6300	0.7937
No log	7.7742	482	0.6291	0.5935	0.6291	0.7932
No log	7.8065	484	0.5899	0.4397	0.5899	0.7681
No log	7.8387	486	0.5956	0.4124	0.5956	0.7718
No log	7.8710	488	0.5956	0.4206	0.5956	0.7717
No log	7.9032	490	0.5643	0.4482	0.5643	0.7512
No log	7.9355	492	0.5814	0.4482	0.5814	0.7625
No log	7.9677	494	0.6188	0.4267	0.6188	0.7867
No log	8.0	496	0.6562	0.4437	0.6562	0.8101
No log	8.0323	498	0.6773	0.5252	0.6773	0.8230
0.3148	8.0645	500	0.6970	0.5481	0.6970	0.8348
0.3148	8.0968	502	0.6442	0.4182	0.6442	0.8026
0.3148	8.1290	504	0.5740	0.4397	0.5740	0.7577
0.3148	8.1613	506	0.5455	0.4482	0.5455	0.7386
0.3148	8.1935	508	0.5456	0.4569	0.5456	0.7387
0.3148	8.2258	510	0.5576	0.4482	0.5576	0.7467

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1