ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k2_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6160
• Qwk: 0.5397
• Mse: 0.6160
• Rmse: 0.7848

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2	2	3.6751	-0.0108	3.6751	1.9171
No log	0.4	4	2.3469	0.0782	2.3469	1.5320
No log	0.6	6	1.5049	-0.0342	1.5049	1.2267
No log	0.8	8	1.0220	0.3048	1.0220	1.0109
No log	1.0	10	1.0877	0.0385	1.0877	1.0429
No log	1.2	12	1.1363	0.1918	1.1363	1.0660
No log	1.4	14	1.1893	0.2736	1.1893	1.0906
No log	1.6	16	1.1554	0.2035	1.1554	1.0749
No log	1.8	18	1.0455	0.3457	1.0455	1.0225
No log	2.0	20	1.0351	0.2541	1.0351	1.0174
No log	2.2	22	1.0521	0.2517	1.0521	1.0257
No log	2.4	24	1.0622	0.1783	1.0622	1.0306
No log	2.6	26	1.0046	0.3221	1.0046	1.0023
No log	2.8	28	0.9527	0.3353	0.9527	0.9761
No log	3.0	30	0.9927	0.2343	0.9927	0.9963
No log	3.2	32	0.9109	0.3251	0.9109	0.9544
No log	3.4	34	0.8162	0.4444	0.8162	0.9035
No log	3.6	36	0.7637	0.4675	0.7637	0.8739
No log	3.8	38	0.7464	0.3965	0.7464	0.8639
No log	4.0	40	0.7122	0.4816	0.7122	0.8439
No log	4.2	42	0.7089	0.4965	0.7089	0.8420
No log	4.4	44	0.6785	0.6419	0.6785	0.8237
No log	4.6	46	0.8986	0.4882	0.8986	0.9480
No log	4.8	48	0.9591	0.4972	0.9591	0.9794
No log	5.0	50	0.7071	0.5366	0.7071	0.8409
No log	5.2	52	0.6430	0.5966	0.6430	0.8019
No log	5.4	54	0.6601	0.6144	0.6601	0.8125
No log	5.6	56	0.6444	0.6257	0.6444	0.8027
No log	5.8	58	0.7805	0.5726	0.7805	0.8835
No log	6.0	60	0.7450	0.5962	0.7450	0.8631
No log	6.2	62	0.6402	0.6471	0.6402	0.8001
No log	6.4	64	0.6214	0.6502	0.6214	0.7883
No log	6.6	66	0.6488	0.6089	0.6488	0.8055
No log	6.8	68	0.6779	0.5655	0.6779	0.8233
No log	7.0	70	0.6389	0.5775	0.6389	0.7993
No log	7.2	72	0.6469	0.5978	0.6469	0.8043
No log	7.4	74	0.6324	0.6217	0.6324	0.7953
No log	7.6	76	0.6369	0.6733	0.6369	0.7981
No log	7.8	78	0.7298	0.6531	0.7298	0.8543
No log	8.0	80	0.6398	0.6715	0.6398	0.7999
No log	8.2	82	0.6058	0.6664	0.6058	0.7783
No log	8.4	84	0.6513	0.5455	0.6513	0.8070
No log	8.6	86	0.6109	0.6272	0.6109	0.7816
No log	8.8	88	0.5780	0.6224	0.5780	0.7603
No log	9.0	90	0.5935	0.6426	0.5935	0.7704
No log	9.2	92	0.6037	0.6464	0.6037	0.7770
No log	9.4	94	0.6461	0.5475	0.6461	0.8038
No log	9.6	96	0.6276	0.6529	0.6276	0.7922
No log	9.8	98	0.5782	0.6835	0.5782	0.7604
No log	10.0	100	0.5597	0.6835	0.5597	0.7481
No log	10.2	102	0.5401	0.6789	0.5401	0.7349
No log	10.4	104	0.6129	0.6925	0.6129	0.7829
No log	10.6	106	0.5663	0.6730	0.5663	0.7525
No log	10.8	108	0.5513	0.7164	0.5513	0.7425
No log	11.0	110	0.7033	0.6145	0.7033	0.8386
No log	11.2	112	0.6336	0.6377	0.6336	0.7960
No log	11.4	114	0.4994	0.6672	0.4994	0.7067
No log	11.6	116	0.5090	0.7267	0.5090	0.7135
No log	11.8	118	0.5238	0.6528	0.5238	0.7237
No log	12.0	120	0.6126	0.5433	0.6126	0.7827
No log	12.2	122	0.5919	0.5349	0.5919	0.7694
No log	12.4	124	0.5437	0.6065	0.5437	0.7374
No log	12.6	126	0.5212	0.6578	0.5212	0.7220
No log	12.8	128	0.5510	0.6986	0.5510	0.7423
No log	13.0	130	0.6467	0.6056	0.6467	0.8042
No log	13.2	132	0.7024	0.5799	0.7024	0.8381
No log	13.4	134	0.6302	0.6568	0.6302	0.7938
No log	13.6	136	0.5911	0.6877	0.5911	0.7688
No log	13.8	138	0.5822	0.6833	0.5822	0.7630
No log	14.0	140	0.5995	0.6508	0.5995	0.7742
No log	14.2	142	0.5687	0.6418	0.5687	0.7541
No log	14.4	144	0.5685	0.6762	0.5685	0.7540
No log	14.6	146	0.7427	0.5417	0.7427	0.8618
No log	14.8	148	0.7636	0.5607	0.7636	0.8739
No log	15.0	150	0.6141	0.6292	0.6141	0.7836
No log	15.2	152	0.5326	0.7380	0.5326	0.7298
No log	15.4	154	0.5866	0.7139	0.5866	0.7659
No log	15.6	156	0.5623	0.7244	0.5623	0.7499
No log	15.8	158	0.5550	0.6783	0.5550	0.7449
No log	16.0	160	0.6664	0.5745	0.6664	0.8163
No log	16.2	162	0.6851	0.5636	0.6851	0.8277
No log	16.4	164	0.6006	0.5751	0.6006	0.7750
No log	16.6	166	0.5703	0.6672	0.5703	0.7552
No log	16.8	168	0.5547	0.7056	0.5547	0.7448
No log	17.0	170	0.5502	0.6605	0.5502	0.7417
No log	17.2	172	0.5994	0.6287	0.5994	0.7742
No log	17.4	174	0.6431	0.6199	0.6431	0.8019
No log	17.6	176	0.6030	0.6670	0.6030	0.7766
No log	17.8	178	0.5525	0.6451	0.5525	0.7433
No log	18.0	180	0.5586	0.6643	0.5586	0.7474
No log	18.2	182	0.5365	0.7049	0.5365	0.7324
No log	18.4	184	0.5382	0.6575	0.5382	0.7336
No log	18.6	186	0.6150	0.6089	0.6150	0.7842
No log	18.8	188	0.5839	0.6179	0.5839	0.7641
No log	19.0	190	0.5325	0.7009	0.5325	0.7298
No log	19.2	192	0.5352	0.7165	0.5352	0.7316
No log	19.4	194	0.5301	0.7371	0.5301	0.7281
No log	19.6	196	0.5580	0.6512	0.5580	0.7470
No log	19.8	198	0.6954	0.5832	0.6954	0.8339
No log	20.0	200	0.7685	0.5861	0.7685	0.8767
No log	20.2	202	0.6736	0.6471	0.6736	0.8207
No log	20.4	204	0.6107	0.6751	0.6107	0.7815
No log	20.6	206	0.6222	0.6218	0.6222	0.7888
No log	20.8	208	0.6431	0.5998	0.6431	0.8019
No log	21.0	210	0.6617	0.5163	0.6617	0.8134
No log	21.2	212	0.6678	0.4958	0.6678	0.8172
No log	21.4	214	0.6626	0.4980	0.6626	0.8140
No log	21.6	216	0.6309	0.5914	0.6309	0.7943
No log	21.8	218	0.6239	0.6402	0.6239	0.7899
No log	22.0	220	0.5947	0.6358	0.5947	0.7711
No log	22.2	222	0.5715	0.6969	0.5715	0.7560
No log	22.4	224	0.5706	0.6946	0.5706	0.7554
No log	22.6	226	0.5693	0.6593	0.5693	0.7545
No log	22.8	228	0.5237	0.7272	0.5237	0.7236
No log	23.0	230	0.5430	0.7119	0.5430	0.7369
No log	23.2	232	0.5533	0.6943	0.5533	0.7438
No log	23.4	234	0.5340	0.6564	0.5340	0.7308
No log	23.6	236	0.5627	0.5880	0.5627	0.7501
No log	23.8	238	0.5617	0.6128	0.5617	0.7495
No log	24.0	240	0.5321	0.6772	0.5321	0.7295
No log	24.2	242	0.5347	0.7429	0.5347	0.7312
No log	24.4	244	0.6018	0.6347	0.6018	0.7757
No log	24.6	246	0.5997	0.5932	0.5997	0.7744
No log	24.8	248	0.5437	0.6740	0.5437	0.7374
No log	25.0	250	0.5429	0.6555	0.5429	0.7368
No log	25.2	252	0.6671	0.5655	0.6671	0.8167
No log	25.4	254	0.6968	0.5331	0.6968	0.8347
No log	25.6	256	0.6670	0.5370	0.6670	0.8167
No log	25.8	258	0.6125	0.5370	0.6125	0.7826
No log	26.0	260	0.5614	0.6012	0.5614	0.7493
No log	26.2	262	0.5383	0.6510	0.5383	0.7337
No log	26.4	264	0.5381	0.6510	0.5381	0.7336
No log	26.6	266	0.5775	0.6451	0.5775	0.7600
No log	26.8	268	0.6431	0.5766	0.6431	0.8019
No log	27.0	270	0.6390	0.5572	0.6390	0.7994
No log	27.2	272	0.6038	0.5822	0.6038	0.7770
No log	27.4	274	0.5594	0.6118	0.5594	0.7479
No log	27.6	276	0.5378	0.6510	0.5378	0.7333
No log	27.8	278	0.5531	0.6634	0.5531	0.7437
No log	28.0	280	0.5650	0.6207	0.5650	0.7516
No log	28.2	282	0.5662	0.6100	0.5662	0.7525
No log	28.4	284	0.5811	0.6091	0.5811	0.7623
No log	28.6	286	0.5756	0.6275	0.5756	0.7587
No log	28.8	288	0.5669	0.6406	0.5669	0.7529
No log	29.0	290	0.5897	0.5821	0.5897	0.7679
No log	29.2	292	0.6608	0.5766	0.6608	0.8129
No log	29.4	294	0.6943	0.5655	0.6943	0.8332
No log	29.6	296	0.6457	0.6015	0.6457	0.8036
No log	29.8	298	0.6463	0.6015	0.6463	0.8039
No log	30.0	300	0.6255	0.5291	0.6255	0.7909
No log	30.2	302	0.5889	0.5714	0.5889	0.7674
No log	30.4	304	0.5920	0.6623	0.5920	0.7694
No log	30.6	306	0.5907	0.6164	0.5907	0.7686
No log	30.8	308	0.6059	0.4880	0.6059	0.7784
No log	31.0	310	0.6400	0.5602	0.6400	0.8000
No log	31.2	312	0.7144	0.5655	0.7144	0.8452
No log	31.4	314	0.7004	0.5458	0.7004	0.8369
No log	31.6	316	0.6627	0.5266	0.6627	0.8140
No log	31.8	318	0.6309	0.5602	0.6309	0.7943
No log	32.0	320	0.6266	0.5602	0.6266	0.7916
No log	32.2	322	0.6006	0.5565	0.6006	0.7750
No log	32.4	324	0.6025	0.5565	0.6025	0.7762
No log	32.6	326	0.6405	0.5602	0.6405	0.8003
No log	32.8	328	0.6525	0.5572	0.6525	0.8078
No log	33.0	330	0.6242	0.5397	0.6242	0.7901
No log	33.2	332	0.5728	0.6335	0.5728	0.7568
No log	33.4	334	0.5616	0.6124	0.5616	0.7494
No log	33.6	336	0.5652	0.6049	0.5652	0.7518
No log	33.8	338	0.5746	0.5714	0.5746	0.7581
No log	34.0	340	0.5927	0.6320	0.5927	0.7699
No log	34.2	342	0.6001	0.6272	0.6001	0.7746
No log	34.4	344	0.5988	0.5412	0.5988	0.7738
No log	34.6	346	0.5962	0.5368	0.5962	0.7721
No log	34.8	348	0.6096	0.6035	0.6096	0.7808
No log	35.0	350	0.6597	0.5953	0.6597	0.8122
No log	35.2	352	0.6565	0.5953	0.6565	0.8102
No log	35.4	354	0.6174	0.6319	0.6174	0.7857
No log	35.6	356	0.5800	0.5861	0.5800	0.7616
No log	35.8	358	0.5773	0.6377	0.5773	0.7598
No log	36.0	360	0.5755	0.6440	0.5755	0.7586
No log	36.2	362	0.5803	0.6256	0.5803	0.7617
No log	36.4	364	0.5982	0.6053	0.5982	0.7734
No log	36.6	366	0.6362	0.5686	0.6362	0.7976
No log	36.8	368	0.6164	0.5938	0.6164	0.7851
No log	37.0	370	0.5732	0.6092	0.5732	0.7571
No log	37.2	372	0.5428	0.6207	0.5428	0.7367
No log	37.4	374	0.5306	0.6526	0.5306	0.7284
No log	37.6	376	0.5151	0.6940	0.5151	0.7177
No log	37.8	378	0.5180	0.6772	0.5180	0.7197
No log	38.0	380	0.5527	0.6968	0.5527	0.7434
No log	38.2	382	0.5473	0.6968	0.5473	0.7398
No log	38.4	384	0.5297	0.6779	0.5297	0.7278
No log	38.6	386	0.5456	0.6488	0.5456	0.7386
No log	38.8	388	0.5586	0.5938	0.5586	0.7474
No log	39.0	390	0.5670	0.5938	0.5670	0.7530
No log	39.2	392	0.5630	0.6719	0.5630	0.7504
No log	39.4	394	0.5851	0.5622	0.5851	0.7649
No log	39.6	396	0.5972	0.5487	0.5972	0.7728
No log	39.8	398	0.5592	0.5938	0.5592	0.7478
No log	40.0	400	0.5255	0.7148	0.5255	0.7249
No log	40.2	402	0.5185	0.7423	0.5185	0.7201
No log	40.4	404	0.5202	0.7366	0.5202	0.7212
No log	40.6	406	0.5516	0.6782	0.5516	0.7427
No log	40.8	408	0.5693	0.6189	0.5693	0.7545
No log	41.0	410	0.5456	0.6853	0.5456	0.7386
No log	41.2	412	0.5373	0.7810	0.5373	0.7330
No log	41.4	414	0.5935	0.6507	0.5935	0.7704
No log	41.6	416	0.5994	0.6507	0.5994	0.7742
No log	41.8	418	0.5596	0.6654	0.5596	0.7481
No log	42.0	420	0.5538	0.6482	0.5538	0.7442
No log	42.2	422	0.5820	0.6054	0.5820	0.7629
No log	42.4	424	0.5856	0.6402	0.5856	0.7652
No log	42.6	426	0.5801	0.6570	0.5801	0.7617
No log	42.8	428	0.5494	0.7632	0.5494	0.7412
No log	43.0	430	0.5490	0.7392	0.5490	0.7409
No log	43.2	432	0.5544	0.7040	0.5544	0.7446
No log	43.4	434	0.5643	0.6364	0.5643	0.7512
No log	43.6	436	0.5906	0.5909	0.5906	0.7685
No log	43.8	438	0.6131	0.5385	0.6131	0.7830
No log	44.0	440	0.6014	0.5370	0.6014	0.7755
No log	44.2	442	0.5652	0.6167	0.5652	0.7518
No log	44.4	444	0.5348	0.7224	0.5348	0.7313
No log	44.6	446	0.5404	0.6904	0.5404	0.7351
No log	44.8	448	0.5332	0.7231	0.5332	0.7302
No log	45.0	450	0.5366	0.6732	0.5366	0.7326
No log	45.2	452	0.5643	0.6343	0.5643	0.7512
No log	45.4	454	0.5692	0.5707	0.5692	0.7545
No log	45.6	456	0.5592	0.5964	0.5592	0.7478
No log	45.8	458	0.5542	0.6728	0.5542	0.7444
No log	46.0	460	0.5704	0.6015	0.5704	0.7552
No log	46.2	462	0.5734	0.6209	0.5734	0.7572
No log	46.4	464	0.5803	0.6015	0.5803	0.7617
No log	46.6	466	0.5853	0.5822	0.5853	0.7650
No log	46.8	468	0.5843	0.5964	0.5843	0.7644
No log	47.0	470	0.6046	0.5964	0.6046	0.7776
No log	47.2	472	0.6047	0.5964	0.6047	0.7776
No log	47.4	474	0.5974	0.5858	0.5974	0.7729
No log	47.6	476	0.6039	0.5938	0.6039	0.7771
No log	47.8	478	0.6077	0.5898	0.6077	0.7795
No log	48.0	480	0.5931	0.5798	0.5931	0.7701
No log	48.2	482	0.5850	0.5832	0.5850	0.7648
No log	48.4	484	0.5923	0.5933	0.5923	0.7696
No log	48.6	486	0.5912	0.5933	0.5912	0.7689
No log	48.8	488	0.5935	0.5810	0.5935	0.7704
No log	49.0	490	0.6048	0.5774	0.6048	0.7777
No log	49.2	492	0.6204	0.5504	0.6204	0.7877
No log	49.4	494	0.6082	0.5948	0.6082	0.7799
No log	49.6	496	0.6088	0.5810	0.6088	0.7803
No log	49.8	498	0.6068	0.5810	0.6068	0.7790
0.2155	50.0	500	0.6065	0.5810	0.6065	0.7788
0.2155	50.2	502	0.6000	0.5595	0.6000	0.7746
0.2155	50.4	504	0.6009	0.5788	0.6009	0.7752
0.2155	50.6	506	0.6052	0.5677	0.6052	0.7779
0.2155	50.8	508	0.5723	0.5885	0.5723	0.7565
0.2155	51.0	510	0.5397	0.6256	0.5397	0.7347
0.2155	51.2	512	0.5395	0.6356	0.5395	0.7345
0.2155	51.4	514	0.5556	0.6328	0.5556	0.7454
0.2155	51.6	516	0.5688	0.5799	0.5688	0.7542
0.2155	51.8	518	0.5828	0.5799	0.5828	0.7634
0.2155	52.0	520	0.5699	0.5822	0.5699	0.7549
0.2155	52.2	522	0.5662	0.6157	0.5662	0.7525
0.2155	52.4	524	0.5555	0.5964	0.5555	0.7454
0.2155	52.6	526	0.5416	0.6377	0.5416	0.7360
0.2155	52.8	528	0.5354	0.6073	0.5354	0.7317
0.2155	53.0	530	0.5374	0.6265	0.5374	0.7331
0.2155	53.2	532	0.5453	0.6280	0.5453	0.7384
0.2155	53.4	534	0.5560	0.6465	0.5560	0.7456
0.2155	53.6	536	0.5909	0.5898	0.5909	0.7687
0.2155	53.8	538	0.6153	0.5504	0.6153	0.7844
0.2155	54.0	540	0.5974	0.5487	0.5974	0.7729
0.2155	54.2	542	0.5625	0.6460	0.5625	0.7500
0.2155	54.4	544	0.5439	0.6641	0.5439	0.7375
0.2155	54.6	546	0.5385	0.6729	0.5385	0.7338
0.2155	54.8	548	0.5394	0.6581	0.5394	0.7344
0.2155	55.0	550	0.5446	0.6398	0.5446	0.7380
0.2155	55.2	552	0.5537	0.6482	0.5537	0.7441
0.2155	55.4	554	0.5536	0.6510	0.5536	0.7440
0.2155	55.6	556	0.5504	0.6623	0.5504	0.7419
0.2155	55.8	558	0.5497	0.6687	0.5497	0.7414
0.2155	56.0	560	0.5395	0.6748	0.5395	0.7345
0.2155	56.2	562	0.5442	0.6955	0.5442	0.7377
0.2155	56.4	564	0.5479	0.6572	0.5479	0.7402
0.2155	56.6	566	0.5388	0.6737	0.5388	0.7340
0.2155	56.8	568	0.5396	0.6779	0.5396	0.7345
0.2155	57.0	570	0.5651	0.6500	0.5651	0.7517
0.2155	57.2	572	0.5885	0.5822	0.5885	0.7671
0.2155	57.4	574	0.5972	0.5988	0.5972	0.7728
0.2155	57.6	576	0.5823	0.6015	0.5823	0.7631
0.2155	57.8	578	0.5532	0.6500	0.5532	0.7438
0.2155	58.0	580	0.5379	0.7095	0.5379	0.7334
0.2155	58.2	582	0.5366	0.6896	0.5366	0.7325
0.2155	58.4	584	0.5347	0.6896	0.5347	0.7312
0.2155	58.6	586	0.5353	0.6988	0.5353	0.7316
0.2155	58.8	588	0.5505	0.6371	0.5505	0.7420
0.2155	59.0	590	0.5580	0.6218	0.5580	0.7470
0.2155	59.2	592	0.5650	0.5788	0.5650	0.7517
0.2155	59.4	594	0.5607	0.6249	0.5607	0.7488
0.2155	59.6	596	0.5576	0.6623	0.5576	0.7467
0.2155	59.8	598	0.5536	0.6272	0.5536	0.7440
0.2155	60.0	600	0.5614	0.5994	0.5614	0.7493
0.2155	60.2	602	0.5683	0.6076	0.5683	0.7538
0.2155	60.4	604	0.5756	0.6076	0.5756	0.7587
0.2155	60.6	606	0.5778	0.5886	0.5778	0.7601
0.2155	60.8	608	0.5846	0.6154	0.5846	0.7646
0.2155	61.0	610	0.5973	0.5964	0.5973	0.7729
0.2155	61.2	612	0.5956	0.5938	0.5956	0.7717
0.2155	61.4	614	0.6005	0.5602	0.6005	0.7749
0.2155	61.6	616	0.6000	0.5584	0.6000	0.7746
0.2155	61.8	618	0.5969	0.5912	0.5969	0.7726
0.2155	62.0	620	0.5923	0.6137	0.5923	0.7696
0.2155	62.2	622	0.5892	0.6177	0.5892	0.7676
0.2155	62.4	624	0.5981	0.6249	0.5981	0.7734
0.2155	62.6	626	0.6097	0.5470	0.6097	0.7808
0.2155	62.8	628	0.6232	0.5666	0.6232	0.7894
0.2155	63.0	630	0.6207	0.5470	0.6207	0.7879
0.2155	63.2	632	0.6002	0.5729	0.6002	0.7747
0.2155	63.4	634	0.5798	0.6441	0.5798	0.7615
0.2155	63.6	636	0.5754	0.6451	0.5754	0.7586
0.2155	63.8	638	0.5793	0.5701	0.5793	0.7611
0.2155	64.0	640	0.5836	0.6035	0.5836	0.7640
0.2155	64.2	642	0.5898	0.6335	0.5898	0.7680
0.2155	64.4	644	0.6057	0.6092	0.6057	0.7783
0.2155	64.6	646	0.6158	0.5516	0.6158	0.7847
0.2155	64.8	648	0.6216	0.5516	0.6216	0.7884
0.2155	65.0	650	0.6193	0.5397	0.6193	0.7870
0.2155	65.2	652	0.6243	0.5397	0.6243	0.7902
0.2155	65.4	654	0.6160	0.5397	0.6160	0.7848

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1