ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7758
• Qwk: 0.4787
• Mse: 0.7758
• Rmse: 0.8808

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0222	2	4.9987	-0.0188	4.9987	2.2358
No log	0.0444	4	2.7667	-0.0058	2.7667	1.6633
No log	0.0667	6	1.6007	0.0504	1.6007	1.2652
No log	0.0889	8	1.2175	0.2364	1.2175	1.1034
No log	0.1111	10	1.2009	0.2939	1.2009	1.0958
No log	0.1333	12	1.4298	0.0635	1.4298	1.1957
No log	0.1556	14	1.8131	0.1309	1.8131	1.3465
No log	0.1778	16	1.6630	0.1427	1.6630	1.2896
No log	0.2	18	1.4036	0.1143	1.4036	1.1847
No log	0.2222	20	1.3047	0.1210	1.3047	1.1422
No log	0.2444	22	1.3705	0.2015	1.3705	1.1707
No log	0.2667	24	1.3324	0.2077	1.3324	1.1543
No log	0.2889	26	1.2920	0.2019	1.2920	1.1367
No log	0.3111	28	1.2833	0.1582	1.2833	1.1328
No log	0.3333	30	1.3508	0.3021	1.3508	1.1623
No log	0.3556	32	1.3051	0.2880	1.3051	1.1424
No log	0.3778	34	1.1111	0.2637	1.1111	1.0541
No log	0.4	36	1.3104	0.2239	1.3104	1.1447
No log	0.4222	38	1.2954	0.2115	1.2954	1.1382
No log	0.4444	40	1.2398	0.2574	1.2398	1.1134
No log	0.4667	42	1.1181	0.3006	1.1181	1.0574
No log	0.4889	44	1.2158	0.3772	1.2158	1.1026
No log	0.5111	46	1.3015	0.3859	1.3015	1.1408
No log	0.5333	48	1.1063	0.4653	1.1063	1.0518
No log	0.5556	50	1.1155	0.4592	1.1155	1.0561
No log	0.5778	52	1.1571	0.4440	1.1571	1.0757
No log	0.6	54	1.1147	0.4259	1.1147	1.0558
No log	0.6222	56	1.0275	0.4535	1.0275	1.0137
No log	0.6444	58	1.0020	0.4634	1.0020	1.0010
No log	0.6667	60	0.9755	0.4579	0.9755	0.9877
No log	0.6889	62	1.0635	0.5085	1.0635	1.0312
No log	0.7111	64	1.0405	0.5267	1.0405	1.0201
No log	0.7333	66	0.9125	0.4689	0.9125	0.9552
No log	0.7556	68	0.8445	0.4938	0.8445	0.9190
No log	0.7778	70	0.9637	0.5678	0.9637	0.9817
No log	0.8	72	0.9260	0.5678	0.9260	0.9623
No log	0.8222	74	0.8563	0.4968	0.8563	0.9253
No log	0.8444	76	0.9443	0.5551	0.9443	0.9718
No log	0.8667	78	0.9242	0.5822	0.9242	0.9614
No log	0.8889	80	0.8140	0.5350	0.8140	0.9022
No log	0.9111	82	0.8815	0.6263	0.8815	0.9389
No log	0.9333	84	0.9794	0.4693	0.9794	0.9897
No log	0.9556	86	0.9532	0.4866	0.9532	0.9763
No log	0.9778	88	0.8545	0.5888	0.8545	0.9244
No log	1.0	90	0.8113	0.5718	0.8113	0.9007
No log	1.0222	92	0.9199	0.5847	0.9199	0.9591
No log	1.0444	94	1.2307	0.4594	1.2307	1.1094
No log	1.0667	96	1.3206	0.4171	1.3206	1.1492
No log	1.0889	98	1.1082	0.5585	1.1082	1.0527
No log	1.1111	100	0.7958	0.6055	0.7958	0.8921
No log	1.1333	102	0.8418	0.6569	0.8418	0.9175
No log	1.1556	104	0.8487	0.5854	0.8487	0.9213
No log	1.1778	106	0.7520	0.6544	0.7520	0.8672
No log	1.2	108	0.7676	0.6305	0.7676	0.8761
No log	1.2222	110	0.8198	0.5827	0.8198	0.9054
No log	1.2444	112	0.8513	0.5199	0.8513	0.9227
No log	1.2667	114	0.9131	0.5408	0.9131	0.9556
No log	1.2889	116	0.8452	0.5810	0.8452	0.9193
No log	1.3111	118	0.8158	0.5329	0.8158	0.9032
No log	1.3333	120	0.8407	0.6451	0.8407	0.9169
No log	1.3556	122	0.8637	0.5199	0.8637	0.9293
No log	1.3778	124	1.0622	0.5224	1.0622	1.0306
No log	1.4	126	1.0858	0.5531	1.0858	1.0420
No log	1.4222	128	1.0299	0.5571	1.0299	1.0148
No log	1.4444	130	0.8522	0.5372	0.8522	0.9232
No log	1.4667	132	0.8849	0.5196	0.8849	0.9407
No log	1.4889	134	0.8095	0.5914	0.8095	0.8997
No log	1.5111	136	0.8217	0.5581	0.8217	0.9065
No log	1.5333	138	1.0618	0.5658	1.0618	1.0304
No log	1.5556	140	1.0182	0.5489	1.0182	1.0090
No log	1.5778	142	0.8006	0.5434	0.8006	0.8948
No log	1.6	144	0.7248	0.5476	0.7248	0.8513
No log	1.6222	146	0.7270	0.6037	0.7270	0.8527
No log	1.6444	148	0.7656	0.6405	0.7656	0.8750
No log	1.6667	150	0.7876	0.6503	0.7876	0.8875
No log	1.6889	152	0.8569	0.6465	0.8569	0.9257
No log	1.7111	154	1.1961	0.5233	1.1961	1.0937
No log	1.7333	156	1.3898	0.4697	1.3898	1.1789
No log	1.7556	158	1.2918	0.5104	1.2918	1.1366
No log	1.7778	160	1.0416	0.5375	1.0416	1.0206
No log	1.8	162	0.7985	0.6178	0.7985	0.8936
No log	1.8222	164	0.7486	0.6791	0.7486	0.8652
No log	1.8444	166	0.7676	0.6791	0.7676	0.8761
No log	1.8667	168	0.9656	0.5626	0.9656	0.9826
No log	1.8889	170	1.1674	0.5460	1.1674	1.0805
No log	1.9111	172	1.0806	0.5585	1.0806	1.0395
No log	1.9333	174	0.8558	0.5745	0.8558	0.9251
No log	1.9556	176	0.8027	0.5345	0.8027	0.8960
No log	1.9778	178	0.8091	0.5102	0.8091	0.8995
No log	2.0	180	0.9004	0.5647	0.9004	0.9489
No log	2.0222	182	0.9971	0.5422	0.9971	0.9985
No log	2.0444	184	0.8904	0.5646	0.8904	0.9436
No log	2.0667	186	0.7472	0.6362	0.7472	0.8644
No log	2.0889	188	0.7398	0.6461	0.7398	0.8601
No log	2.1111	190	0.8297	0.6045	0.8297	0.9109
No log	2.1333	192	1.0580	0.5449	1.0580	1.0286
No log	2.1556	194	1.0407	0.5579	1.0407	1.0202
No log	2.1778	196	0.8906	0.5646	0.8906	0.9437
No log	2.2	198	0.8730	0.5646	0.8730	0.9343
No log	2.2222	200	0.8157	0.5601	0.8157	0.9032
No log	2.2444	202	0.8225	0.5537	0.8225	0.9069
No log	2.2667	204	0.8972	0.5552	0.8972	0.9472
No log	2.2889	206	1.0248	0.5443	1.0248	1.0123
No log	2.3111	208	0.9967	0.5658	0.9967	0.9983
No log	2.3333	210	0.8287	0.5691	0.8287	0.9103
No log	2.3556	212	0.7290	0.5740	0.7290	0.8538
No log	2.3778	214	0.8460	0.5494	0.8460	0.9198
No log	2.4	216	1.0578	0.4846	1.0578	1.0285
No log	2.4222	218	0.9258	0.4850	0.9258	0.9622
No log	2.4444	220	0.7324	0.5721	0.7324	0.8558
No log	2.4667	222	0.8467	0.5690	0.8467	0.9202
No log	2.4889	224	0.9140	0.5461	0.9140	0.9560
No log	2.5111	226	0.8531	0.5668	0.8531	0.9237
No log	2.5333	228	0.7656	0.5763	0.7656	0.8750
No log	2.5556	230	0.7565	0.5763	0.7565	0.8698
No log	2.5778	232	0.7592	0.6	0.7592	0.8713
No log	2.6	234	0.8232	0.5822	0.8232	0.9073
No log	2.6222	236	0.8908	0.5605	0.8908	0.9438
No log	2.6444	238	0.9300	0.5340	0.9300	0.9644
No log	2.6667	240	0.7881	0.6230	0.7881	0.8878
No log	2.6889	242	0.7565	0.6289	0.7565	0.8698
No log	2.7111	244	0.7179	0.6620	0.7179	0.8473
No log	2.7333	246	0.7141	0.6535	0.7141	0.8451
No log	2.7556	248	0.7528	0.5865	0.7528	0.8676
No log	2.7778	250	0.8373	0.5670	0.8373	0.9151
No log	2.8	252	0.7958	0.5624	0.7958	0.8921
No log	2.8222	254	0.7751	0.5657	0.7751	0.8804
No log	2.8444	256	0.8184	0.5806	0.8184	0.9047
No log	2.8667	258	0.7945	0.6156	0.7945	0.8913
No log	2.8889	260	0.7882	0.5871	0.7882	0.8878
No log	2.9111	262	0.7517	0.5966	0.7517	0.8670
No log	2.9333	264	0.7244	0.6029	0.7244	0.8511
No log	2.9556	266	0.7296	0.5688	0.7296	0.8542
No log	2.9778	268	0.7937	0.6045	0.7937	0.8909
No log	3.0	270	0.9883	0.5658	0.9883	0.9941
No log	3.0222	272	1.0200	0.5464	1.0200	1.0099
No log	3.0444	274	0.9234	0.5524	0.9234	0.9609
No log	3.0667	276	0.7830	0.5102	0.7830	0.8849
No log	3.0889	278	0.7730	0.5014	0.7730	0.8792
No log	3.1111	280	0.7994	0.5360	0.7994	0.8941
No log	3.1333	282	0.7927	0.5028	0.7927	0.8903
No log	3.1556	284	0.7854	0.5141	0.7854	0.8862
No log	3.1778	286	0.8555	0.5427	0.8555	0.9249
No log	3.2	288	0.8247	0.5719	0.8247	0.9081
No log	3.2222	290	0.7895	0.5537	0.7895	0.8885
No log	3.2444	292	0.8436	0.5827	0.8436	0.9185
No log	3.2667	294	0.9572	0.5342	0.9572	0.9783
No log	3.2889	296	0.9003	0.5626	0.9003	0.9489
No log	3.3111	298	0.7876	0.6140	0.7876	0.8875
No log	3.3333	300	0.7417	0.5051	0.7417	0.8612
No log	3.3556	302	0.7428	0.5597	0.7428	0.8618
No log	3.3778	304	0.7159	0.5719	0.7159	0.8461
No log	3.4	306	0.7190	0.5618	0.7190	0.8479
No log	3.4222	308	0.7118	0.5500	0.7118	0.8437
No log	3.4444	310	0.6963	0.6130	0.6963	0.8344
No log	3.4667	312	0.7267	0.5517	0.7267	0.8525
No log	3.4889	314	0.7720	0.5746	0.7720	0.8786
No log	3.5111	316	0.7278	0.5686	0.7278	0.8531
No log	3.5333	318	0.6713	0.6954	0.6713	0.8193
No log	3.5556	320	0.6713	0.6879	0.6713	0.8193
No log	3.5778	322	0.6809	0.6769	0.6809	0.8252
No log	3.6	324	0.6945	0.6570	0.6945	0.8334
No log	3.6222	326	0.7117	0.6240	0.7117	0.8436
No log	3.6444	328	0.7306	0.5968	0.7306	0.8547
No log	3.6667	330	0.8827	0.5445	0.8827	0.9395
No log	3.6889	332	1.0100	0.5421	1.0100	1.0050
No log	3.7111	334	1.0718	0.5582	1.0718	1.0353
No log	3.7333	336	1.0137	0.5562	1.0137	1.0068
No log	3.7556	338	0.8555	0.5649	0.8555	0.9249
No log	3.7778	340	0.6901	0.6374	0.6901	0.8307
No log	3.8	342	0.6769	0.5988	0.6769	0.8227
No log	3.8222	344	0.7070	0.6115	0.7070	0.8408
No log	3.8444	346	0.6814	0.6560	0.6814	0.8255
No log	3.8667	348	0.6984	0.5691	0.6984	0.8357
No log	3.8889	350	0.8982	0.5822	0.8982	0.9478
No log	3.9111	352	1.1698	0.5156	1.1698	1.0816
No log	3.9333	354	1.3223	0.4398	1.3223	1.1499
No log	3.9556	356	1.2081	0.4741	1.2081	1.0992
No log	3.9778	358	0.9606	0.5098	0.9606	0.9801
No log	4.0	360	0.8104	0.4202	0.8104	0.9002
No log	4.0222	362	0.7478	0.4311	0.7478	0.8647
No log	4.0444	364	0.7146	0.6476	0.7146	0.8453
No log	4.0667	366	0.7272	0.6341	0.7272	0.8528
No log	4.0889	368	0.7517	0.6215	0.7517	0.8670
No log	4.1111	370	0.8185	0.6367	0.8185	0.9047
No log	4.1333	372	0.9315	0.5899	0.9315	0.9652
No log	4.1556	374	0.8877	0.5304	0.8877	0.9422
No log	4.1778	376	0.7715	0.5365	0.7715	0.8783
No log	4.2	378	0.7491	0.5508	0.7491	0.8655
No log	4.2222	380	0.7437	0.5858	0.7437	0.8624
No log	4.2444	382	0.7336	0.6285	0.7336	0.8565
No log	4.2667	384	0.7872	0.5014	0.7872	0.8873
No log	4.2889	386	0.8353	0.5042	0.8353	0.9140
No log	4.3111	388	0.8945	0.5253	0.8945	0.9458
No log	4.3333	390	0.8309	0.5199	0.8309	0.9116
No log	4.3556	392	0.7521	0.6097	0.7521	0.8672
No log	4.3778	394	0.7421	0.5364	0.7421	0.8615
No log	4.4	396	0.7480	0.5160	0.7480	0.8649
No log	4.4222	398	0.7656	0.5477	0.7656	0.8750
No log	4.4444	400	0.8509	0.5028	0.8509	0.9224
No log	4.4667	402	0.9264	0.5425	0.9264	0.9625
No log	4.4889	404	0.9053	0.5262	0.9053	0.9515
No log	4.5111	406	0.8158	0.5192	0.8158	0.9032
No log	4.5333	408	0.7898	0.5365	0.7898	0.8887
No log	4.5556	410	0.7950	0.5414	0.7950	0.8917
No log	4.5778	412	0.8122	0.5455	0.8122	0.9012
No log	4.6	414	0.7977	0.5434	0.7977	0.8931
No log	4.6222	416	0.8052	0.5313	0.8052	0.8973
No log	4.6444	418	0.8162	0.5250	0.8162	0.9034
No log	4.6667	420	0.7950	0.5827	0.7950	0.8916
No log	4.6889	422	0.7808	0.6214	0.7808	0.8836
No log	4.7111	424	0.7505	0.6490	0.7505	0.8663
No log	4.7333	426	0.7263	0.5838	0.7263	0.8522
No log	4.7556	428	0.7283	0.6110	0.7283	0.8534
No log	4.7778	430	0.7917	0.5058	0.7917	0.8898
No log	4.8	432	0.8203	0.5146	0.8203	0.9057
No log	4.8222	434	0.7712	0.4572	0.7712	0.8782
No log	4.8444	436	0.7070	0.4560	0.7070	0.8408
No log	4.8667	438	0.6735	0.5270	0.6735	0.8206
No log	4.8889	440	0.6722	0.6479	0.6722	0.8199
No log	4.9111	442	0.6897	0.6555	0.6897	0.8305
No log	4.9333	444	0.7698	0.6207	0.7698	0.8774
No log	4.9556	446	0.7867	0.6207	0.7867	0.8870
No log	4.9778	448	0.7146	0.6741	0.7146	0.8454
No log	5.0	450	0.7013	0.6283	0.7013	0.8375
No log	5.0222	452	0.7023	0.5611	0.7023	0.8380
No log	5.0444	454	0.7234	0.5611	0.7234	0.8505
No log	5.0667	456	0.7635	0.4864	0.7635	0.8738
No log	5.0889	458	0.8323	0.4869	0.8323	0.9123
No log	5.1111	460	0.8520	0.5224	0.8520	0.9230
No log	5.1333	462	0.8299	0.4869	0.8299	0.9110
No log	5.1556	464	0.7772	0.4876	0.7772	0.8816
No log	5.1778	466	0.7459	0.4998	0.7459	0.8636
No log	5.2	468	0.7224	0.5229	0.7224	0.8500
No log	5.2222	470	0.7230	0.5673	0.7230	0.8503
No log	5.2444	472	0.7497	0.5844	0.7497	0.8659
No log	5.2667	474	0.7550	0.6	0.7550	0.8689
No log	5.2889	476	0.7601	0.6101	0.7601	0.8718
No log	5.3111	478	0.7960	0.6017	0.7960	0.8922
No log	5.3333	480	0.7702	0.6017	0.7702	0.8776
No log	5.3556	482	0.7716	0.6017	0.7716	0.8784
No log	5.3778	484	0.7830	0.5823	0.7830	0.8849
No log	5.4	486	0.8197	0.5805	0.8197	0.9054
No log	5.4222	488	0.7932	0.6101	0.7932	0.8906
No log	5.4444	490	0.7327	0.6285	0.7327	0.8560
No log	5.4667	492	0.7165	0.5548	0.7165	0.8465
No log	5.4889	494	0.7114	0.5621	0.7114	0.8434
No log	5.5111	496	0.7095	0.5621	0.7095	0.8423
No log	5.5333	498	0.6937	0.5671	0.6937	0.8329
0.3383	5.5556	500	0.6897	0.5545	0.6897	0.8305
0.3383	5.5778	502	0.6868	0.6010	0.6868	0.8288
0.3383	5.6	504	0.7221	0.6163	0.7221	0.8498
0.3383	5.6222	506	0.8062	0.5224	0.8062	0.8979
0.3383	5.6444	508	0.7880	0.4881	0.7880	0.8877
0.3383	5.6667	510	0.7254	0.6499	0.7254	0.8517
0.3383	5.6889	512	0.6939	0.6753	0.6939	0.8330
0.3383	5.7111	514	0.6900	0.6536	0.6900	0.8307
0.3383	5.7333	516	0.7293	0.6142	0.7293	0.8540
0.3383	5.7556	518	0.8386	0.5399	0.8386	0.9158
0.3383	5.7778	520	0.8565	0.5399	0.8565	0.9255
0.3383	5.8	522	0.8487	0.5399	0.8487	0.9212
0.3383	5.8222	524	0.7901	0.5334	0.7901	0.8889
0.3383	5.8444	526	0.6978	0.6251	0.6978	0.8353
0.3383	5.8667	528	0.6782	0.5976	0.6782	0.8235
0.3383	5.8889	530	0.6663	0.6246	0.6663	0.8163
0.3383	5.9111	532	0.6742	0.6918	0.6742	0.8211
0.3383	5.9333	534	0.7028	0.6350	0.7028	0.8384
0.3383	5.9556	536	0.7942	0.5673	0.7942	0.8912
0.3383	5.9778	538	0.9124	0.5445	0.9124	0.9552
0.3383	6.0	540	0.8999	0.5445	0.8999	0.9486
0.3383	6.0222	542	0.7576	0.6316	0.7576	0.8704
0.3383	6.0444	544	0.6418	0.6850	0.6418	0.8011
0.3383	6.0667	546	0.6538	0.6127	0.6538	0.8086
0.3383	6.0889	548	0.6695	0.5985	0.6695	0.8182
0.3383	6.1111	550	0.6466	0.6451	0.6466	0.8041
0.3383	6.1333	552	0.6637	0.6947	0.6637	0.8147
0.3383	6.1556	554	0.8400	0.5673	0.8400	0.9165
0.3383	6.1778	556	0.9921	0.5355	0.9921	0.9960
0.3383	6.2	558	0.9954	0.5355	0.9954	0.9977
0.3383	6.2222	560	0.9140	0.5651	0.9140	0.9560
0.3383	6.2444	562	0.7749	0.5911	0.7749	0.8803
0.3383	6.2667	564	0.6949	0.6573	0.6949	0.8336
0.3383	6.2889	566	0.6590	0.6686	0.6590	0.8118
0.3383	6.3111	568	0.6580	0.6686	0.6580	0.8112
0.3383	6.3333	570	0.6971	0.7009	0.6971	0.8349
0.3383	6.3556	572	0.8037	0.6263	0.8037	0.8965
0.3383	6.3778	574	0.8580	0.5801	0.8580	0.9263
0.3383	6.4	576	0.8238	0.5905	0.8238	0.9076
0.3383	6.4222	578	0.7581	0.6364	0.7581	0.8707
0.3383	6.4444	580	0.6961	0.5974	0.6961	0.8343
0.3383	6.4667	582	0.6863	0.5752	0.6863	0.8284
0.3383	6.4889	584	0.6856	0.5607	0.6856	0.8280
0.3383	6.5111	586	0.6956	0.5974	0.6956	0.8340
0.3383	6.5333	588	0.6956	0.5974	0.6956	0.8341
0.3383	6.5556	590	0.6926	0.5879	0.6926	0.8322
0.3383	6.5778	592	0.6905	0.5879	0.6905	0.8310
0.3383	6.6	594	0.6959	0.6163	0.6959	0.8342
0.3383	6.6222	596	0.7107	0.6669	0.7107	0.8430
0.3383	6.6444	598	0.7181	0.6247	0.7181	0.8474
0.3383	6.6667	600	0.7274	0.6011	0.7274	0.8529
0.3383	6.6889	602	0.7351	0.6011	0.7351	0.8574
0.3383	6.7111	604	0.7512	0.5279	0.7512	0.8667
0.3383	6.7333	606	0.7686	0.5029	0.7686	0.8767
0.3383	6.7556	608	0.7764	0.4916	0.7764	0.8811
0.3383	6.7778	610	0.7811	0.4787	0.7811	0.8838
0.3383	6.8	612	0.7758	0.4787	0.7758	0.8808

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1