ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k3_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5922
• Qwk: 0.5796
• Mse: 0.5922
• Rmse: 0.7695

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	3.9000	0.0	3.9000	1.9748
No log	0.2667	4	2.5575	0.0248	2.5575	1.5992
No log	0.4	6	1.7693	-0.0180	1.7693	1.3302
No log	0.5333	8	1.1920	0.0400	1.1920	1.0918
No log	0.6667	10	1.0978	0.2291	1.0978	1.0478
No log	0.8	12	1.1501	0.0130	1.1501	1.0724
No log	0.9333	14	1.1420	0.0462	1.1420	1.0686
No log	1.0667	16	1.0252	0.1576	1.0252	1.0125
No log	1.2	18	0.8773	0.3117	0.8773	0.9366
No log	1.3333	20	0.8619	0.3549	0.8619	0.9284
No log	1.4667	22	1.2950	0.3080	1.2950	1.1380
No log	1.6	24	1.3095	0.3129	1.3095	1.1443
No log	1.7333	26	0.6864	0.5849	0.6864	0.8285
No log	1.8667	28	0.6392	0.6293	0.6392	0.7995
No log	2.0	30	0.6650	0.5876	0.6650	0.8155
No log	2.1333	32	0.9558	0.5087	0.9558	0.9777
No log	2.2667	34	1.0846	0.4340	1.0846	1.0414
No log	2.4	36	1.3078	0.4364	1.3078	1.1436
No log	2.5333	38	0.8982	0.4668	0.8982	0.9477
No log	2.6667	40	0.5919	0.6177	0.5919	0.7694
No log	2.8	42	0.5953	0.6112	0.5953	0.7716
No log	2.9333	44	0.6215	0.6870	0.6215	0.7883
No log	3.0667	46	0.7355	0.5688	0.7355	0.8576
No log	3.2	48	0.6837	0.5997	0.6837	0.8269
No log	3.3333	50	0.5610	0.6535	0.5610	0.7490
No log	3.4667	52	0.5498	0.6756	0.5498	0.7415
No log	3.6	54	0.6124	0.6559	0.6124	0.7825
No log	3.7333	56	1.2019	0.4430	1.2019	1.0963
No log	3.8667	58	1.2762	0.4458	1.2762	1.1297
No log	4.0	60	0.7664	0.6878	0.7664	0.8754
No log	4.1333	62	0.6756	0.6899	0.6756	0.8219
No log	4.2667	64	0.6259	0.6928	0.6259	0.7912
No log	4.4	66	0.6306	0.6736	0.6306	0.7941
No log	4.5333	68	0.6011	0.6916	0.6011	0.7753
No log	4.6667	70	0.6460	0.6116	0.6460	0.8038
No log	4.8	72	0.7591	0.6016	0.7591	0.8713
No log	4.9333	74	0.6892	0.6299	0.6892	0.8302
No log	5.0667	76	0.6505	0.6986	0.6505	0.8066
No log	5.2	78	0.6331	0.7262	0.6331	0.7957
No log	5.3333	80	0.6688	0.7002	0.6688	0.8178
No log	5.4667	82	0.7669	0.5976	0.7669	0.8757
No log	5.6	84	0.7640	0.6069	0.7640	0.8741
No log	5.7333	86	0.6792	0.6957	0.6792	0.8241
No log	5.8667	88	0.7996	0.6229	0.7996	0.8942
No log	6.0	90	0.7964	0.6361	0.7964	0.8924
No log	6.1333	92	0.6895	0.6945	0.6895	0.8304
No log	6.2667	94	0.8179	0.6058	0.8179	0.9044
No log	6.4	96	0.8058	0.5853	0.8058	0.8976
No log	6.5333	98	0.7005	0.6748	0.7005	0.8369
No log	6.6667	100	0.6377	0.6591	0.6377	0.7985
No log	6.8	102	0.6450	0.6826	0.6450	0.8031
No log	6.9333	104	0.8549	0.5088	0.8549	0.9246
No log	7.0667	106	1.3175	0.4265	1.3175	1.1478
No log	7.2	108	1.1602	0.4247	1.1602	1.0771
No log	7.3333	110	0.6633	0.6583	0.6633	0.8145
No log	7.4667	112	0.5777	0.6813	0.5777	0.7601
No log	7.6	114	0.6116	0.5939	0.6116	0.7821
No log	7.7333	116	0.6043	0.5966	0.6043	0.7773
No log	7.8667	118	0.6213	0.6402	0.6213	0.7882
No log	8.0	120	0.6180	0.6575	0.6180	0.7861
No log	8.1333	122	0.5789	0.7193	0.5789	0.7608
No log	8.2667	124	0.6104	0.6946	0.6104	0.7813
No log	8.4	126	0.5950	0.7061	0.5950	0.7713
No log	8.5333	128	0.6921	0.7219	0.6921	0.8319
No log	8.6667	130	0.6867	0.6780	0.6867	0.8287
No log	8.8	132	0.5751	0.6610	0.5751	0.7583
No log	8.9333	134	0.5679	0.6545	0.5679	0.7536
No log	9.0667	136	0.5766	0.7156	0.5766	0.7593
No log	9.2	138	0.6137	0.7104	0.6137	0.7834
No log	9.3333	140	0.5987	0.6691	0.5987	0.7737
No log	9.4667	142	0.6361	0.5977	0.6361	0.7975
No log	9.6	144	0.6704	0.6578	0.6704	0.8188
No log	9.7333	146	0.6501	0.6918	0.6501	0.8063
No log	9.8667	148	0.6678	0.7053	0.6677	0.8172
No log	10.0	150	0.6360	0.7623	0.6360	0.7975
No log	10.1333	152	0.5758	0.6882	0.5758	0.7588
No log	10.2667	154	0.6201	0.6377	0.6201	0.7874
No log	10.4	156	0.8071	0.5086	0.8071	0.8984
No log	10.5333	158	0.7673	0.5814	0.7673	0.8759
No log	10.6667	160	0.6114	0.6070	0.6114	0.7819
No log	10.8	162	0.6453	0.6365	0.6453	0.8033
No log	10.9333	164	0.7055	0.6337	0.7055	0.8400
No log	11.0667	166	0.6325	0.6570	0.6325	0.7953
No log	11.2	168	0.6233	0.5905	0.6233	0.7895
No log	11.3333	170	0.6338	0.5759	0.6338	0.7961
No log	11.4667	172	0.6170	0.5879	0.6170	0.7855
No log	11.6	174	0.6235	0.5808	0.6235	0.7896
No log	11.7333	176	0.6091	0.5985	0.6091	0.7805
No log	11.8667	178	0.6232	0.6186	0.6232	0.7894
No log	12.0	180	0.6468	0.6748	0.6468	0.8042
No log	12.1333	182	0.6294	0.5884	0.6294	0.7933
No log	12.2667	184	0.6324	0.5662	0.6324	0.7952
No log	12.4	186	0.6298	0.5682	0.6298	0.7936
No log	12.5333	188	0.6376	0.6078	0.6376	0.7985
No log	12.6667	190	0.6662	0.6544	0.6662	0.8162
No log	12.8	192	0.6770	0.6457	0.6770	0.8228
No log	12.9333	194	0.6638	0.6263	0.6638	0.8147
No log	13.0667	196	0.6713	0.6168	0.6713	0.8193
No log	13.2	198	0.6956	0.6753	0.6956	0.8340
No log	13.3333	200	0.6846	0.6669	0.6846	0.8274
No log	13.4667	202	0.7552	0.6115	0.7552	0.8690
No log	13.6	204	0.6619	0.6500	0.6619	0.8136
No log	13.7333	206	0.6432	0.6482	0.6432	0.8020
No log	13.8667	208	0.6982	0.6135	0.6982	0.8356
No log	14.0	210	0.9391	0.5016	0.9391	0.9691
No log	14.1333	212	1.1333	0.4401	1.1333	1.0646
No log	14.2667	214	0.9769	0.5115	0.9769	0.9884
No log	14.4	216	0.6775	0.6476	0.6775	0.8231
No log	14.5333	218	0.6872	0.6586	0.6872	0.8290
No log	14.6667	220	0.7524	0.6455	0.7524	0.8674
No log	14.8	222	0.6685	0.6263	0.6685	0.8176
No log	14.9333	224	0.6191	0.6186	0.6191	0.7868
No log	15.0667	226	0.6720	0.6286	0.6720	0.8198
No log	15.2	228	0.7277	0.6657	0.7277	0.8531
No log	15.3333	230	0.7231	0.6631	0.7231	0.8503
No log	15.4667	232	0.6602	0.6803	0.6602	0.8125
No log	15.6	234	0.6113	0.6766	0.6113	0.7819
No log	15.7333	236	0.6057	0.6085	0.6057	0.7783
No log	15.8667	238	0.6124	0.5703	0.6124	0.7825
No log	16.0	240	0.6089	0.5618	0.6089	0.7803
No log	16.1333	242	0.6087	0.5865	0.6087	0.7802
No log	16.2667	244	0.6568	0.6055	0.6568	0.8105
No log	16.4	246	0.7158	0.6570	0.7158	0.8461
No log	16.5333	248	0.7458	0.6546	0.7458	0.8636
No log	16.6667	250	0.7177	0.6922	0.7177	0.8472
No log	16.8	252	0.7533	0.6545	0.7533	0.8679
No log	16.9333	254	0.7385	0.6788	0.7385	0.8594
No log	17.0667	256	0.7014	0.6716	0.7014	0.8375
No log	17.2	258	0.6648	0.6669	0.6648	0.8154
No log	17.3333	260	0.6373	0.6410	0.6373	0.7983
No log	17.4667	262	0.6304	0.6721	0.6304	0.7940
No log	17.6	264	0.6167	0.6595	0.6167	0.7853
No log	17.7333	266	0.5856	0.6440	0.5856	0.7652
No log	17.8667	268	0.5863	0.6614	0.5863	0.7657
No log	18.0	270	0.6072	0.6435	0.6072	0.7792
No log	18.1333	272	0.5884	0.6406	0.5884	0.7670
No log	18.2667	274	0.5809	0.6639	0.5809	0.7622
No log	18.4	276	0.6241	0.6184	0.6241	0.7900
No log	18.5333	278	0.6230	0.6349	0.6230	0.7893
No log	18.6667	280	0.6084	0.6349	0.6084	0.7800
No log	18.8	282	0.5910	0.6244	0.5910	0.7688
No log	18.9333	284	0.5727	0.6417	0.5727	0.7568
No log	19.0667	286	0.5781	0.6452	0.5781	0.7603
No log	19.2	288	0.6102	0.6244	0.6102	0.7812
No log	19.3333	290	0.6578	0.6307	0.6578	0.8110
No log	19.4667	292	0.6596	0.6266	0.6596	0.8122
No log	19.6	294	0.6366	0.6176	0.6366	0.7979
No log	19.7333	296	0.6357	0.6380	0.6357	0.7973
No log	19.8667	298	0.6357	0.6402	0.6357	0.7973
No log	20.0	300	0.6537	0.6555	0.6537	0.8085
No log	20.1333	302	0.6881	0.6411	0.6881	0.8295
No log	20.2667	304	0.6589	0.6336	0.6589	0.8117
No log	20.4	306	0.6044	0.6042	0.6044	0.7775
No log	20.5333	308	0.5886	0.6497	0.5886	0.7672
No log	20.6667	310	0.5806	0.6491	0.5806	0.7619
No log	20.8	312	0.5672	0.6622	0.5672	0.7531
No log	20.9333	314	0.5536	0.6861	0.5536	0.7440
No log	21.0667	316	0.5563	0.6779	0.5563	0.7459
No log	21.2	318	0.5548	0.6667	0.5548	0.7448
No log	21.3333	320	0.5500	0.6756	0.5500	0.7416
No log	21.4667	322	0.5541	0.6447	0.5541	0.7444
No log	21.6	324	0.5624	0.6085	0.5624	0.7499
No log	21.7333	326	0.5749	0.6838	0.5749	0.7582
No log	21.8667	328	0.5793	0.6501	0.5793	0.7611
No log	22.0	330	0.5699	0.6828	0.5699	0.7549
No log	22.1333	332	0.6133	0.6098	0.6133	0.7831
No log	22.2667	334	0.5974	0.5879	0.5974	0.7729
No log	22.4	336	0.5865	0.6440	0.5865	0.7658
No log	22.5333	338	0.5843	0.6465	0.5843	0.7644
No log	22.6667	340	0.5903	0.5752	0.5903	0.7683
No log	22.8	342	0.5922	0.5714	0.5922	0.7695
No log	22.9333	344	0.5946	0.5819	0.5946	0.7711
No log	23.0667	346	0.5903	0.6186	0.5903	0.7683
No log	23.2	348	0.5983	0.6337	0.5983	0.7735
No log	23.3333	350	0.6098	0.6715	0.6098	0.7809
No log	23.4667	352	0.5952	0.6509	0.5952	0.7715
No log	23.6	354	0.5816	0.6157	0.5816	0.7626
No log	23.7333	356	0.5846	0.6032	0.5846	0.7646
No log	23.8667	358	0.6049	0.6184	0.6049	0.7777
No log	24.0	360	0.6120	0.6599	0.6120	0.7823
No log	24.1333	362	0.5837	0.6256	0.5837	0.7640
No log	24.2667	364	0.5787	0.6051	0.5787	0.7607
No log	24.4	366	0.6199	0.6519	0.6199	0.7873
No log	24.5333	368	0.6303	0.6459	0.6303	0.7939
No log	24.6667	370	0.5997	0.6196	0.5997	0.7744
No log	24.8	372	0.6028	0.6363	0.6028	0.7764
No log	24.9333	374	0.6614	0.6515	0.6614	0.8132
No log	25.0667	376	0.6701	0.6515	0.6701	0.8186
No log	25.2	378	0.6114	0.6299	0.6114	0.7819
No log	25.3333	380	0.5768	0.6294	0.5768	0.7595
No log	25.4667	382	0.5863	0.6051	0.5863	0.7657
No log	25.6	384	0.5935	0.6423	0.5935	0.7704
No log	25.7333	386	0.5834	0.6051	0.5834	0.7638
No log	25.8667	388	0.5911	0.6068	0.5911	0.7688
No log	26.0	390	0.5865	0.6051	0.5865	0.7658
No log	26.1333	392	0.5832	0.6215	0.5832	0.7637
No log	26.2667	394	0.6046	0.6363	0.6046	0.7775
No log	26.4	396	0.6273	0.6654	0.6273	0.7921
No log	26.5333	398	0.6141	0.6393	0.6141	0.7837
No log	26.6667	400	0.5791	0.6399	0.5791	0.7610
No log	26.8	402	0.5772	0.6447	0.5772	0.7597
No log	26.9333	404	0.5735	0.6447	0.5735	0.7573
No log	27.0667	406	0.5668	0.6447	0.5668	0.7528
No log	27.2	408	0.5638	0.6359	0.5638	0.7509
No log	27.3333	410	0.5785	0.6440	0.5785	0.7606
No log	27.4667	412	0.5907	0.6543	0.5907	0.7686
No log	27.6	414	0.6052	0.6711	0.6052	0.7780
No log	27.7333	416	0.5938	0.6543	0.5938	0.7706
No log	27.8667	418	0.5799	0.6725	0.5799	0.7615
No log	28.0	420	0.5838	0.6756	0.5838	0.7641
No log	28.1333	422	0.5881	0.6167	0.5881	0.7669
No log	28.2667	424	0.5943	0.6383	0.5943	0.7709
No log	28.4	426	0.6081	0.6206	0.6081	0.7798
No log	28.5333	428	0.6229	0.6166	0.6229	0.7893
No log	28.6667	430	0.6398	0.6185	0.6398	0.7999
No log	28.8	432	0.6491	0.6185	0.6491	0.8057
No log	28.9333	434	0.6253	0.6225	0.6253	0.7908
No log	29.0667	436	0.6040	0.6269	0.6040	0.7772
No log	29.2	438	0.5996	0.6269	0.5996	0.7744
No log	29.3333	440	0.6055	0.6085	0.6055	0.7781
No log	29.4667	442	0.6212	0.5928	0.6212	0.7881
No log	29.6	444	0.6159	0.5485	0.6159	0.7848
No log	29.7333	446	0.5923	0.6057	0.5923	0.7696
No log	29.8667	448	0.5889	0.6195	0.5889	0.7674
No log	30.0	450	0.6000	0.6298	0.6000	0.7746
No log	30.1333	452	0.6166	0.6275	0.6166	0.7853
No log	30.2667	454	0.6344	0.6212	0.6344	0.7965
No log	30.4	456	0.6693	0.6388	0.6693	0.8181
No log	30.5333	458	0.6333	0.6388	0.6333	0.7958
No log	30.6667	460	0.5782	0.6164	0.5782	0.7604
No log	30.8	462	0.5694	0.6368	0.5694	0.7546
No log	30.9333	464	0.5778	0.6256	0.5778	0.7601
No log	31.0667	466	0.5806	0.6144	0.5806	0.7619
No log	31.2	468	0.5868	0.6256	0.5868	0.7660
No log	31.3333	470	0.5804	0.6164	0.5804	0.7618
No log	31.4667	472	0.5925	0.6256	0.5925	0.7697
No log	31.6	474	0.5833	0.6256	0.5833	0.7637
No log	31.7333	476	0.5804	0.6144	0.5804	0.7618
No log	31.8667	478	0.5850	0.6473	0.5850	0.7648
No log	32.0	480	0.5802	0.6035	0.5802	0.7617
No log	32.1333	482	0.5760	0.6316	0.5760	0.7589
No log	32.2667	484	0.5780	0.6278	0.5780	0.7602
No log	32.4	486	0.5992	0.6479	0.5992	0.7741
No log	32.5333	488	0.5977	0.6661	0.5977	0.7731
No log	32.6667	490	0.5938	0.6699	0.5938	0.7706
No log	32.8	492	0.5673	0.6302	0.5673	0.7532
No log	32.9333	494	0.5561	0.6284	0.5561	0.7457
No log	33.0667	496	0.5585	0.6167	0.5585	0.7473
No log	33.2	498	0.5658	0.6167	0.5658	0.7522
0.1975	33.3333	500	0.5679	0.5985	0.5679	0.7536
0.1975	33.4667	502	0.5690	0.5985	0.5690	0.7543
0.1975	33.6	504	0.5727	0.6157	0.5727	0.7568
0.1975	33.7333	506	0.5746	0.6501	0.5746	0.7580
0.1975	33.8667	508	0.5734	0.6328	0.5734	0.7572
0.1975	34.0	510	0.5735	0.6328	0.5735	0.7573
0.1975	34.1333	512	0.5742	0.6328	0.5742	0.7577
0.1975	34.2667	514	0.5703	0.6431	0.5703	0.7552
0.1975	34.4	516	0.5722	0.6492	0.5722	0.7564
0.1975	34.5333	518	0.5956	0.6760	0.5956	0.7718
0.1975	34.6667	520	0.6013	0.7071	0.6013	0.7754
0.1975	34.8	522	0.6035	0.7071	0.6035	0.7768
0.1975	34.9333	524	0.6099	0.7160	0.6099	0.7810
0.1975	35.0667	526	0.6266	0.6780	0.6266	0.7916
0.1975	35.2	528	0.6320	0.6388	0.6320	0.7950
0.1975	35.3333	530	0.5845	0.6707	0.5845	0.7645
0.1975	35.4667	532	0.5458	0.6479	0.5458	0.7388
0.1975	35.6	534	0.5415	0.6526	0.5415	0.7359
0.1975	35.7333	536	0.5684	0.6444	0.5684	0.7539
0.1975	35.8667	538	0.5906	0.6601	0.5906	0.7685
0.1975	36.0	540	0.5757	0.6360	0.5757	0.7588
0.1975	36.1333	542	0.5601	0.6594	0.5601	0.7484
0.1975	36.2667	544	0.5699	0.6465	0.5699	0.7549
0.1975	36.4	546	0.5998	0.6575	0.5998	0.7745
0.1975	36.5333	548	0.6035	0.6575	0.6035	0.7769
0.1975	36.6667	550	0.6132	0.6741	0.6132	0.7831
0.1975	36.8	552	0.6111	0.6628	0.6111	0.7817
0.1975	36.9333	554	0.6056	0.6922	0.6056	0.7782
0.1975	37.0667	556	0.6031	0.6740	0.6031	0.7766
0.1975	37.2	558	0.5877	0.6588	0.5877	0.7666
0.1975	37.3333	560	0.5706	0.6667	0.5706	0.7554
0.1975	37.4667	562	0.5618	0.6586	0.5618	0.7495
0.1975	37.6	564	0.5716	0.5959	0.5716	0.7560
0.1975	37.7333	566	0.5853	0.5985	0.5853	0.7651
0.1975	37.8667	568	0.5904	0.6057	0.5904	0.7684
0.1975	38.0	570	0.5882	0.5934	0.5882	0.7669
0.1975	38.1333	572	0.5845	0.6497	0.5845	0.7646
0.1975	38.2667	574	0.5757	0.6497	0.5757	0.7588
0.1975	38.4	576	0.5732	0.6225	0.5732	0.7571
0.1975	38.5333	578	0.5846	0.6552	0.5846	0.7646
0.1975	38.6667	580	0.6060	0.6614	0.6060	0.7785
0.1975	38.8	582	0.6656	0.6411	0.6656	0.8159
0.1975	38.9333	584	0.7062	0.6664	0.7062	0.8403
0.1975	39.0667	586	0.6959	0.6570	0.6959	0.8342
0.1975	39.2	588	0.6621	0.6570	0.6621	0.8137
0.1975	39.3333	590	0.6240	0.6588	0.6240	0.7899
0.1975	39.4667	592	0.5759	0.6157	0.5759	0.7589
0.1975	39.6	594	0.5692	0.5693	0.5692	0.7544
0.1975	39.7333	596	0.5770	0.6039	0.5770	0.7596
0.1975	39.8667	598	0.5815	0.6039	0.5815	0.7626
0.1975	40.0	600	0.5754	0.6049	0.5754	0.7586
0.1975	40.1333	602	0.5737	0.6049	0.5737	0.7575
0.1975	40.2667	604	0.5699	0.6049	0.5699	0.7549
0.1975	40.4	606	0.5722	0.6206	0.5722	0.7564
0.1975	40.5333	608	0.5766	0.5969	0.5766	0.7593
0.1975	40.6667	610	0.5812	0.6281	0.5812	0.7623
0.1975	40.8	612	0.5880	0.6595	0.5880	0.7668
0.1975	40.9333	614	0.5856	0.6125	0.5856	0.7652
0.1975	41.0667	616	0.5760	0.6049	0.5760	0.7589
0.1975	41.2	618	0.5744	0.6039	0.5744	0.7579
0.1975	41.3333	620	0.5766	0.6039	0.5766	0.7594
0.1975	41.4667	622	0.5764	0.5796	0.5764	0.7592
0.1975	41.6	624	0.5675	0.5796	0.5675	0.7533
0.1975	41.7333	626	0.5573	0.6049	0.5573	0.7465
0.1975	41.8667	628	0.5545	0.6164	0.5545	0.7446
0.1975	42.0	630	0.5612	0.6393	0.5612	0.7491
0.1975	42.1333	632	0.5742	0.6835	0.5742	0.7578
0.1975	42.2667	634	0.5713	0.6692	0.5713	0.7559
0.1975	42.4	636	0.5509	0.6164	0.5509	0.7422
0.1975	42.5333	638	0.5633	0.5985	0.5633	0.7506
0.1975	42.6667	640	0.5845	0.5949	0.5845	0.7645
0.1975	42.8	642	0.5943	0.5949	0.5943	0.7709
0.1975	42.9333	644	0.5989	0.5949	0.5989	0.7739
0.1975	43.0667	646	0.5922	0.5796	0.5922	0.7695

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1