ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6738
• Qwk: 0.6861
• Mse: 0.6738
• Rmse: 0.8209

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0222	2	6.9989	-0.0058	6.9989	2.6455
No log	0.0444	4	5.6724	0.0137	5.6724	2.3817
No log	0.0667	6	4.1338	0.0877	4.1338	2.0332
No log	0.0889	8	2.5252	0.0662	2.5252	1.5891
No log	0.1111	10	2.1062	0.0333	2.1062	1.4513
No log	0.1333	12	2.4178	0.0301	2.4178	1.5549
No log	0.1556	14	2.2929	0.0296	2.2929	1.5142
No log	0.1778	16	2.2316	0.0584	2.2316	1.4938
No log	0.2	18	1.7982	0.3220	1.7982	1.3410
No log	0.2222	20	1.7589	0.3333	1.7589	1.3262
No log	0.2444	22	1.5933	0.3130	1.5933	1.2623
No log	0.2667	24	1.5369	0.2037	1.5369	1.2397
No log	0.2889	26	1.4372	0.2037	1.4372	1.1988
No log	0.3111	28	1.2991	0.2655	1.2991	1.1398
No log	0.3333	30	1.2594	0.2982	1.2594	1.1222
No log	0.3556	32	1.2718	0.4800	1.2718	1.1278
No log	0.3778	34	1.1685	0.5000	1.1685	1.0810
No log	0.4	36	1.1026	0.5000	1.1026	1.0500
No log	0.4222	38	1.1880	0.5846	1.1880	1.0899
No log	0.4444	40	1.1994	0.5954	1.1994	1.0952
No log	0.4667	42	1.0009	0.6565	1.0009	1.0005
No log	0.4889	44	0.9666	0.6087	0.9666	0.9832
No log	0.5111	46	1.0265	0.5507	1.0265	1.0132
No log	0.5333	48	0.8683	0.7101	0.8683	0.9318
No log	0.5556	50	1.3917	0.5147	1.3917	1.1797
No log	0.5778	52	1.7514	0.3688	1.7514	1.3234
No log	0.6	54	1.5310	0.4088	1.5310	1.2373
No log	0.6222	56	0.9760	0.6119	0.9760	0.9879
No log	0.6444	58	1.2859	0.5113	1.2859	1.1340
No log	0.6667	60	1.4557	0.4848	1.4557	1.2065
No log	0.6889	62	1.1871	0.4651	1.1871	1.0895
No log	0.7111	64	1.1126	0.5496	1.1126	1.0548
No log	0.7333	66	1.3229	0.5333	1.3229	1.1502
No log	0.7556	68	1.2180	0.5630	1.2180	1.1036
No log	0.7778	70	0.9464	0.6618	0.9464	0.9728
No log	0.8	72	0.8575	0.6861	0.8575	0.9260
No log	0.8222	74	0.7804	0.7376	0.7804	0.8834
No log	0.8444	76	0.7776	0.7092	0.7776	0.8818
No log	0.8667	78	0.8882	0.6099	0.8882	0.9424
No log	0.8889	80	1.1393	0.5899	1.1393	1.0674
No log	0.9111	82	1.0343	0.6056	1.0343	1.0170
No log	0.9333	84	0.7594	0.6795	0.7594	0.8715
No log	0.9556	86	0.7407	0.6994	0.7407	0.8606
No log	0.9778	88	0.7059	0.7683	0.7059	0.8402
No log	1.0	90	0.7459	0.7421	0.7459	0.8636
No log	1.0222	92	0.7310	0.75	0.7310	0.8550
No log	1.0444	94	1.0046	0.6053	1.0046	1.0023
No log	1.0667	96	1.0409	0.5753	1.0409	1.0203
No log	1.0889	98	0.8665	0.6536	0.8665	0.9309
No log	1.1111	100	0.6843	0.7673	0.6843	0.8272
No log	1.1333	102	0.7184	0.7468	0.7184	0.8476
No log	1.1556	104	0.6921	0.7582	0.6921	0.8319
No log	1.1778	106	0.7405	0.7722	0.7405	0.8605
No log	1.2	108	0.7690	0.7451	0.7690	0.8769
No log	1.2222	110	0.7087	0.8050	0.7087	0.8418
No log	1.2444	112	0.6727	0.8050	0.6727	0.8202
No log	1.2667	114	0.6492	0.775	0.6492	0.8057
No log	1.2889	116	0.6843	0.7901	0.6843	0.8272
No log	1.3111	118	1.1698	0.5988	1.1698	1.0816
No log	1.3333	120	1.7990	0.3889	1.7990	1.3413
No log	1.3556	122	1.7446	0.3889	1.7446	1.3208
No log	1.3778	124	1.2736	0.4812	1.2736	1.1285
No log	1.4	126	0.8806	0.7034	0.8806	0.9384
No log	1.4222	128	0.9190	0.6712	0.9190	0.9587
No log	1.4444	130	1.1343	0.5775	1.1343	1.0650
No log	1.4667	132	0.9919	0.6338	0.9919	0.9959
No log	1.4889	134	0.8814	0.6519	0.8814	0.9388
No log	1.5111	136	1.1455	0.5455	1.1455	1.0703
No log	1.5333	138	1.2352	0.5241	1.2352	1.1114
No log	1.5556	140	1.0634	0.5775	1.0634	1.0312
No log	1.5778	142	0.7703	0.7211	0.7703	0.8777
No log	1.6	144	0.6597	0.7895	0.6597	0.8122
No log	1.6222	146	0.6396	0.7895	0.6396	0.7997
No log	1.6444	148	0.6247	0.7922	0.6247	0.7904
No log	1.6667	150	0.7884	0.7105	0.7884	0.8879
No log	1.6889	152	0.8592	0.6584	0.8592	0.9270
No log	1.7111	154	0.8600	0.6821	0.8600	0.9274
No log	1.7333	156	0.7175	0.7765	0.7175	0.8471
No log	1.7556	158	0.5977	0.7799	0.5977	0.7731
No log	1.7778	160	0.5770	0.7821	0.5770	0.7596
No log	1.8	162	0.6306	0.7613	0.6306	0.7941
No log	1.8222	164	0.6428	0.7632	0.6428	0.8017
No log	1.8444	166	0.7173	0.7162	0.7173	0.8469
No log	1.8667	168	0.6883	0.7286	0.6883	0.8296
No log	1.8889	170	0.7781	0.6806	0.7781	0.8821
No log	1.9111	172	0.9197	0.6667	0.9197	0.9590
No log	1.9333	174	0.7894	0.6879	0.7894	0.8885
No log	1.9556	176	0.6067	0.7733	0.6067	0.7789
No log	1.9778	178	0.6009	0.7564	0.6009	0.7752
No log	2.0	180	0.6401	0.7261	0.6401	0.8001
No log	2.0222	182	0.5791	0.7826	0.5791	0.7610
No log	2.0444	184	0.6121	0.7468	0.6121	0.7823
No log	2.0667	186	0.6988	0.6879	0.6988	0.8359
No log	2.0889	188	0.7544	0.6883	0.7544	0.8686
No log	2.1111	190	0.9430	0.6835	0.9430	0.9711
No log	2.1333	192	0.8485	0.6711	0.8485	0.9211
No log	2.1556	194	0.6331	0.7338	0.6331	0.7957
No log	2.1778	196	0.6311	0.7724	0.6311	0.7944
No log	2.2	198	0.5895	0.7755	0.5895	0.7678
No log	2.2222	200	0.6161	0.7733	0.6161	0.7849
No log	2.2444	202	0.8482	0.6795	0.8482	0.9210
No log	2.2667	204	1.0629	0.6977	1.0629	1.0310
No log	2.2889	206	1.0214	0.6752	1.0214	1.0106
No log	2.3111	208	0.8053	0.6621	0.8053	0.8974
No log	2.3333	210	0.7498	0.6901	0.7498	0.8659
No log	2.3556	212	0.7591	0.6713	0.7591	0.8713
No log	2.3778	214	0.8981	0.6575	0.8981	0.9477
No log	2.4	216	0.9197	0.6839	0.9197	0.9590
No log	2.4222	218	0.7792	0.6846	0.7792	0.8827
No log	2.4444	220	0.7693	0.6974	0.7693	0.8771
No log	2.4667	222	0.6766	0.6986	0.6766	0.8226
No log	2.4889	224	0.6055	0.7619	0.6055	0.7782
No log	2.5111	226	0.6095	0.7763	0.6095	0.7807
No log	2.5333	228	0.5937	0.7949	0.5937	0.7705
No log	2.5556	230	0.5456	0.8052	0.5456	0.7386
No log	2.5778	232	0.6443	0.7320	0.6443	0.8027
No log	2.6	234	0.7893	0.6800	0.7893	0.8885
No log	2.6222	236	0.7356	0.6757	0.7356	0.8577
No log	2.6444	238	0.6617	0.7020	0.6617	0.8134
No log	2.6667	240	0.5587	0.7733	0.5587	0.7475
No log	2.6889	242	0.5570	0.7922	0.5570	0.7463
No log	2.7111	244	0.6179	0.7582	0.6179	0.7861
No log	2.7333	246	0.7068	0.7260	0.7068	0.8407
No log	2.7556	248	0.6995	0.7692	0.6995	0.8364
No log	2.7778	250	0.7310	0.7429	0.7310	0.8550
No log	2.8	252	0.7142	0.7832	0.7142	0.8451
No log	2.8222	254	0.6742	0.7632	0.6742	0.8211
No log	2.8444	256	0.6788	0.75	0.6788	0.8239
No log	2.8667	258	0.6892	0.7558	0.6892	0.8302
No log	2.8889	260	0.6356	0.7547	0.6356	0.7972
No log	2.9111	262	0.6813	0.7468	0.6813	0.8254
No log	2.9333	264	0.7092	0.7483	0.7092	0.8421
No log	2.9556	266	0.7635	0.7273	0.7635	0.8738
No log	2.9778	268	0.7338	0.7429	0.7338	0.8566
No log	3.0	270	0.7464	0.7324	0.7464	0.8639
No log	3.0222	272	0.7187	0.7517	0.7187	0.8478
No log	3.0444	274	0.7492	0.7468	0.7492	0.8655
No log	3.0667	276	0.6914	0.7701	0.6914	0.8315
No log	3.0889	278	0.5516	0.7907	0.5516	0.7427
No log	3.1111	280	0.5293	0.8272	0.5293	0.7275
No log	3.1333	282	0.6051	0.7771	0.6051	0.7779
No log	3.1556	284	0.6240	0.7671	0.6240	0.7899
No log	3.1778	286	0.6236	0.7724	0.6236	0.7897
No log	3.2	288	0.6644	0.7297	0.6644	0.8151
No log	3.2222	290	0.6590	0.7297	0.6590	0.8118
No log	3.2444	292	0.6675	0.7211	0.6675	0.8170
No log	3.2667	294	0.6717	0.7211	0.6717	0.8196
No log	3.2889	296	0.6817	0.7083	0.6817	0.8257
No log	3.3111	298	0.6924	0.7260	0.6924	0.8321
No log	3.3333	300	0.7964	0.6752	0.7964	0.8924
No log	3.3556	302	0.7662	0.6839	0.7662	0.8753
No log	3.3778	304	0.6852	0.75	0.6852	0.8278
No log	3.4	306	0.6215	0.7891	0.6215	0.7883
No log	3.4222	308	0.6225	0.7671	0.6225	0.7890
No log	3.4444	310	0.6442	0.7808	0.6442	0.8026
No log	3.4667	312	0.7004	0.7162	0.7004	0.8369
No log	3.4889	314	0.8452	0.6667	0.8452	0.9194
No log	3.5111	316	0.8440	0.6667	0.8440	0.9187
No log	3.5333	318	0.7343	0.6892	0.7343	0.8569
No log	3.5556	320	0.6654	0.7248	0.6654	0.8157
No log	3.5778	322	0.6652	0.7534	0.6652	0.8156
No log	3.6	324	0.7212	0.6711	0.7212	0.8492
No log	3.6222	326	0.7913	0.6835	0.7913	0.8895
No log	3.6444	328	0.7560	0.6667	0.7560	0.8695
No log	3.6667	330	0.7237	0.6710	0.7237	0.8507
No log	3.6889	332	0.7380	0.6294	0.7380	0.8591
No log	3.7111	334	0.7506	0.6429	0.7506	0.8664
No log	3.7333	336	0.8306	0.6377	0.8306	0.9114
No log	3.7556	338	0.8852	0.6286	0.8852	0.9408
No log	3.7778	340	0.8012	0.6525	0.8012	0.8951
No log	3.8	342	0.6755	0.7397	0.6755	0.8219
No log	3.8222	344	0.6039	0.7895	0.6039	0.7771
No log	3.8444	346	0.5660	0.8025	0.5660	0.7524
No log	3.8667	348	0.6096	0.7636	0.6096	0.7807
No log	3.8889	350	0.7884	0.7143	0.7884	0.8879
No log	3.9111	352	0.8809	0.6797	0.8809	0.9386
No log	3.9333	354	0.8186	0.6713	0.8186	0.9048
No log	3.9556	356	0.6938	0.75	0.6938	0.8329
No log	3.9778	358	0.6750	0.7518	0.6750	0.8216
No log	4.0	360	0.6642	0.75	0.6642	0.8150
No log	4.0222	362	0.6505	0.75	0.6505	0.8065
No log	4.0444	364	0.6381	0.75	0.6381	0.7988
No log	4.0667	366	0.6506	0.75	0.6506	0.8066
No log	4.0889	368	0.6620	0.7448	0.6620	0.8136
No log	4.1111	370	0.7112	0.7083	0.7112	0.8434
No log	4.1333	372	0.7193	0.7211	0.7193	0.8481
No log	4.1556	374	0.7353	0.7152	0.7353	0.8575
No log	4.1778	376	0.7463	0.6803	0.7463	0.8639
No log	4.2	378	0.7918	0.6573	0.7918	0.8899
No log	4.2222	380	0.7345	0.7075	0.7345	0.8570
No log	4.2444	382	0.7250	0.7133	0.7250	0.8515
No log	4.2667	384	0.7919	0.6429	0.7919	0.8899
No log	4.2889	386	0.8518	0.6383	0.8518	0.9229
No log	4.3111	388	0.7502	0.6620	0.7502	0.8661
No log	4.3333	390	0.6223	0.7347	0.6223	0.7889
No log	4.3556	392	0.5978	0.7397	0.5978	0.7731
No log	4.3778	394	0.6454	0.7347	0.6454	0.8033
No log	4.4	396	0.6836	0.7034	0.6836	0.8268
No log	4.4222	398	0.7114	0.6939	0.7114	0.8435
No log	4.4444	400	0.6928	0.6667	0.6928	0.8323
No log	4.4667	402	0.6778	0.7101	0.6778	0.8233
No log	4.4889	404	0.6882	0.7234	0.6882	0.8296
No log	4.5111	406	0.6593	0.7162	0.6593	0.8120
No log	4.5333	408	0.6856	0.7342	0.6856	0.8280
No log	4.5556	410	0.7548	0.7262	0.7548	0.8688
No log	4.5778	412	0.7714	0.7558	0.7714	0.8783
No log	4.6	414	0.7233	0.7362	0.7233	0.8505
No log	4.6222	416	0.6350	0.7237	0.6350	0.7969
No log	4.6444	418	0.6053	0.7712	0.6053	0.7780
No log	4.6667	420	0.5967	0.7712	0.5967	0.7725
No log	4.6889	422	0.6092	0.7582	0.6092	0.7805
No log	4.7111	424	0.7068	0.7042	0.7068	0.8407
No log	4.7333	426	0.8374	0.7143	0.8374	0.9151
No log	4.7556	428	0.8179	0.7215	0.8179	0.9044
No log	4.7778	430	0.7058	0.7114	0.7058	0.8401
No log	4.8	432	0.6750	0.7083	0.6750	0.8216
No log	4.8222	434	0.7142	0.6957	0.7142	0.8451
No log	4.8444	436	0.6935	0.6957	0.6935	0.8328
No log	4.8667	438	0.6826	0.7042	0.6826	0.8262
No log	4.8889	440	0.6853	0.7237	0.6853	0.8278
No log	4.9111	442	0.8626	0.7215	0.8626	0.9287
No log	4.9333	444	0.9702	0.6624	0.9702	0.9850
No log	4.9556	446	0.8319	0.7097	0.8319	0.9121
No log	4.9778	448	0.6468	0.7297	0.6468	0.8042
No log	5.0	450	0.6776	0.7552	0.6776	0.8232
No log	5.0222	452	0.7216	0.7445	0.7216	0.8495
No log	5.0444	454	0.8006	0.7	0.8006	0.8947
No log	5.0667	456	0.8601	0.6187	0.8601	0.9274
No log	5.0889	458	0.7587	0.7162	0.7587	0.8710
No log	5.1111	460	0.6955	0.7639	0.6955	0.8340
No log	5.1333	462	0.6547	0.7429	0.6547	0.8091
No log	5.1556	464	0.6706	0.7619	0.6706	0.8189
No log	5.1778	466	0.7637	0.6797	0.7637	0.8739
No log	5.2	468	0.6970	0.7237	0.6970	0.8348
No log	5.2222	470	0.6560	0.7586	0.6560	0.8099
No log	5.2444	472	0.6742	0.7606	0.6742	0.8211
No log	5.2667	474	0.7086	0.7	0.7086	0.8418
No log	5.2889	476	0.7437	0.7027	0.7437	0.8624
No log	5.3111	478	0.6586	0.7260	0.6586	0.8116
No log	5.3333	480	0.6045	0.7347	0.6045	0.7775
No log	5.3556	482	0.5584	0.7947	0.5584	0.7473
No log	5.3778	484	0.5343	0.8333	0.5343	0.7309
No log	5.4	486	0.5548	0.7516	0.5548	0.7448
No log	5.4222	488	0.6569	0.7215	0.6569	0.8105
No log	5.4444	490	0.7452	0.7013	0.7452	0.8633
No log	5.4667	492	0.8328	0.6351	0.8328	0.9126
No log	5.4889	494	0.8475	0.6338	0.8475	0.9206
No log	5.5111	496	0.7996	0.6870	0.7996	0.8942
No log	5.5333	498	0.8058	0.6977	0.8058	0.8976
0.4481	5.5556	500	0.7573	0.7077	0.7573	0.8702
0.4481	5.5778	502	0.7207	0.6950	0.7207	0.8489
0.4481	5.6	504	0.7430	0.6897	0.7430	0.8620
0.4481	5.6222	506	0.7084	0.7013	0.7084	0.8416
0.4481	5.6444	508	0.6055	0.7296	0.6055	0.7781
0.4481	5.6667	510	0.5446	0.7531	0.5446	0.7380
0.4481	5.6889	512	0.5638	0.7531	0.5638	0.7509
0.4481	5.7111	514	0.6226	0.7453	0.6226	0.7891
0.4481	5.7333	516	0.6496	0.6944	0.6496	0.8060
0.4481	5.7556	518	0.6658	0.6944	0.6658	0.8159
0.4481	5.7778	520	0.6607	0.7183	0.6607	0.8128
0.4481	5.8	522	0.6532	0.7183	0.6532	0.8082
0.4481	5.8222	524	0.6507	0.7143	0.6507	0.8067
0.4481	5.8444	526	0.6676	0.7674	0.6676	0.8171
0.4481	5.8667	528	0.6562	0.7667	0.6562	0.8101
0.4481	5.8889	530	0.7069	0.7701	0.7069	0.8408
0.4481	5.9111	532	0.6654	0.7529	0.6654	0.8157
0.4481	5.9333	534	0.5744	0.7516	0.5744	0.7579
0.4481	5.9556	536	0.5389	0.8205	0.5389	0.7341
0.4481	5.9778	538	0.5522	0.8258	0.5522	0.7431
0.4481	6.0	540	0.6202	0.7355	0.6202	0.7875
0.4481	6.0222	542	0.6765	0.7284	0.6765	0.8225
0.4481	6.0444	544	0.6437	0.7329	0.6437	0.8023
0.4481	6.0667	546	0.5951	0.7417	0.5951	0.7714
0.4481	6.0889	548	0.5924	0.7517	0.5924	0.7697
0.4481	6.1111	550	0.5642	0.7792	0.5642	0.7511
0.4481	6.1333	552	0.5634	0.7771	0.5634	0.7506
0.4481	6.1556	554	0.5701	0.7836	0.5701	0.7551
0.4481	6.1778	556	0.5433	0.7907	0.5433	0.7371
0.4481	6.2	558	0.5112	0.8242	0.5112	0.7150
0.4481	6.2222	560	0.5420	0.7901	0.5420	0.7362
0.4481	6.2444	562	0.6305	0.7636	0.6305	0.7940
0.4481	6.2667	564	0.7123	0.7329	0.7123	0.8440
0.4481	6.2889	566	0.6628	0.7625	0.6628	0.8141
0.4481	6.3111	568	0.6250	0.7742	0.6250	0.7906
0.4481	6.3333	570	0.6057	0.7785	0.6057	0.7783
0.4481	6.3556	572	0.6187	0.7785	0.6187	0.7866
0.4481	6.3778	574	0.6369	0.7785	0.6369	0.7981
0.4481	6.4	576	0.6624	0.7333	0.6624	0.8139
0.4481	6.4222	578	0.7022	0.7355	0.7022	0.8380
0.4481	6.4444	580	0.7130	0.7355	0.7130	0.8444
0.4481	6.4667	582	0.6905	0.7237	0.6905	0.8309
0.4481	6.4889	584	0.5925	0.7898	0.5925	0.7698
0.4481	6.5111	586	0.5593	0.8182	0.5593	0.7478
0.4481	6.5333	588	0.5687	0.8366	0.5687	0.7541
0.4481	6.5556	590	0.6039	0.7310	0.6039	0.7771
0.4481	6.5778	592	0.7217	0.7205	0.7217	0.8495
0.4481	6.6	594	0.8626	0.6667	0.8626	0.9288
0.4481	6.6222	596	0.8418	0.6710	0.8418	0.9175
0.4481	6.6444	598	0.6878	0.7143	0.6878	0.8293
0.4481	6.6667	600	0.5798	0.8056	0.5798	0.7614
0.4481	6.6889	602	0.5751	0.8243	0.5751	0.7584
0.4481	6.7111	604	0.5782	0.7862	0.5782	0.7604
0.4481	6.7333	606	0.5393	0.8163	0.5393	0.7343
0.4481	6.7556	608	0.6212	0.7484	0.6212	0.7882
0.4481	6.7778	610	0.8945	0.7251	0.8945	0.9458
0.4481	6.8	612	1.0616	0.6744	1.0616	1.0303
0.4481	6.8222	614	1.0145	0.6456	1.0145	1.0072
0.4481	6.8444	616	0.8762	0.6571	0.8762	0.9361
0.4481	6.8667	618	0.7391	0.7	0.7391	0.8597
0.4481	6.8889	620	0.6626	0.7222	0.6626	0.8140
0.4481	6.9111	622	0.6096	0.7703	0.6096	0.7808
0.4481	6.9333	624	0.5911	0.7919	0.5911	0.7688
0.4481	6.9556	626	0.5926	0.7625	0.5926	0.7698
0.4481	6.9778	628	0.6614	0.7239	0.6614	0.8133
0.4481	7.0	630	0.7396	0.7215	0.7396	0.8600
0.4481	7.0222	632	0.7584	0.6906	0.7584	0.8709
0.4481	7.0444	634	0.7243	0.6912	0.7243	0.8510
0.4481	7.0667	636	0.7160	0.6716	0.7160	0.8461
0.4481	7.0889	638	0.7018	0.6716	0.7018	0.8377
0.4481	7.1111	640	0.6738	0.6861	0.6738	0.8209

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1