ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k17_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9950
• Qwk: 0.5960
• Mse: 0.9950
• Rmse: 0.9975

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.025	2	7.0340	0.0057	7.0340	2.6522
No log	0.05	4	4.5723	0.0576	4.5723	2.1383
No log	0.075	6	3.7382	-0.0417	3.7382	1.9334
No log	0.1	8	3.1456	-0.0230	3.1456	1.7736
No log	0.125	10	2.0316	0.1000	2.0316	1.4253
No log	0.15	12	2.0966	0.1552	2.0966	1.4480
No log	0.175	14	2.9084	-0.0267	2.9084	1.7054
No log	0.2	16	3.0343	0.0	3.0343	1.7419
No log	0.225	18	2.4678	-0.0429	2.4678	1.5709
No log	0.25	20	2.0972	0.1538	2.0972	1.4482
No log	0.275	22	1.9064	0.2407	1.9064	1.3807
No log	0.3	24	1.7618	0.2056	1.7618	1.3273
No log	0.325	26	1.7357	0.2407	1.7357	1.3175
No log	0.35	28	1.8140	0.3248	1.8140	1.3469
No log	0.375	30	2.0906	0.1324	2.0906	1.4459
No log	0.4	32	2.1972	0.1429	2.1972	1.4823
No log	0.425	34	2.1442	0.1884	2.1442	1.4643
No log	0.45	36	2.0012	0.2143	2.0012	1.4146
No log	0.475	38	1.9657	0.3022	1.9657	1.4020
No log	0.5	40	2.2173	0.2797	2.2173	1.4891
No log	0.525	42	1.9776	0.2979	1.9776	1.4063
No log	0.55	44	1.5153	0.3226	1.5153	1.2310
No log	0.575	46	1.5057	0.2832	1.5057	1.2271
No log	0.6	48	1.4874	0.3025	1.4874	1.2196
No log	0.625	50	1.6923	0.3053	1.6923	1.3009
No log	0.65	52	2.4826	0.1595	2.4826	1.5756
No log	0.675	54	2.7397	0.1595	2.7397	1.6552
No log	0.7	56	2.5893	0.1341	2.5893	1.6091
No log	0.725	58	2.1881	0.2483	2.1881	1.4792
No log	0.75	60	1.4652	0.3817	1.4652	1.2104
No log	0.775	62	1.2336	0.4333	1.2336	1.1107
No log	0.8	64	1.2574	0.4274	1.2574	1.1213
No log	0.825	66	1.1913	0.4103	1.1913	1.0915
No log	0.85	68	1.1187	0.5354	1.1187	1.0577
No log	0.875	70	1.3972	0.5180	1.3972	1.1820
No log	0.9	72	1.9418	0.3537	1.9418	1.3935
No log	0.925	74	2.2448	0.2025	2.2448	1.4983
No log	0.95	76	2.2219	0.2166	2.2219	1.4906
No log	0.975	78	1.8501	0.3444	1.8501	1.3602
No log	1.0	80	1.3386	0.5417	1.3386	1.1570
No log	1.025	82	1.0541	0.6715	1.0541	1.0267
No log	1.05	84	1.0408	0.6815	1.0408	1.0202
No log	1.075	86	1.0051	0.6715	1.0051	1.0025
No log	1.1	88	1.0981	0.6043	1.0981	1.0479
No log	1.125	90	1.3231	0.5278	1.3231	1.1503
No log	1.15	92	1.7709	0.3467	1.7709	1.3308
No log	1.175	94	2.2804	0.3678	2.2804	1.5101
No log	1.2	96	2.2093	0.3842	2.2093	1.4864
No log	1.225	98	1.8617	0.4186	1.8617	1.3644
No log	1.25	100	1.3491	0.5256	1.3491	1.1615
No log	1.275	102	1.1297	0.5571	1.1297	1.0629
No log	1.3	104	1.0497	0.6522	1.0497	1.0245
No log	1.325	106	0.9963	0.6809	0.9963	0.9981
No log	1.35	108	0.9931	0.6667	0.9931	0.9965
No log	1.375	110	1.1359	0.6242	1.1359	1.0658
No log	1.4	112	1.0997	0.6234	1.0997	1.0487
No log	1.425	114	1.0439	0.6434	1.0439	1.0217
No log	1.45	116	1.0126	0.6573	1.0126	1.0063
No log	1.475	118	1.0789	0.5942	1.0789	1.0387
No log	1.5	120	1.2325	0.5359	1.2325	1.1102
No log	1.525	122	1.4921	0.5	1.4921	1.2215
No log	1.55	124	1.7480	0.4551	1.7480	1.3221
No log	1.575	126	1.6975	0.4691	1.6975	1.3029
No log	1.6	128	1.5787	0.4935	1.5787	1.2565
No log	1.625	130	1.6330	0.4901	1.6330	1.2779
No log	1.65	132	1.7046	0.4810	1.7046	1.3056
No log	1.675	134	1.6180	0.5256	1.6180	1.2720
No log	1.7	136	1.3285	0.5987	1.3285	1.1526
No log	1.725	138	1.0989	0.5897	1.0989	1.0483
No log	1.75	140	0.9155	0.7027	0.9155	0.9568
No log	1.775	142	0.8154	0.7183	0.8154	0.9030
No log	1.8	144	0.8396	0.6619	0.8396	0.9163
No log	1.825	146	0.8500	0.6569	0.8500	0.9220
No log	1.85	148	0.8475	0.7273	0.8475	0.9206
No log	1.875	150	0.8794	0.7172	0.8794	0.9378
No log	1.9	152	0.8880	0.75	0.8880	0.9423
No log	1.925	154	0.8763	0.7083	0.8763	0.9361
No log	1.95	156	0.8619	0.7042	0.8619	0.9284
No log	1.975	158	0.8865	0.6621	0.8865	0.9415
No log	2.0	160	1.0731	0.6053	1.0731	1.0359
No log	2.025	162	1.4444	0.5697	1.4444	1.2018
No log	2.05	164	1.7874	0.4309	1.7874	1.3369
No log	2.075	166	1.7641	0.4699	1.7641	1.3282
No log	2.1	168	1.4441	0.5934	1.4441	1.2017
No log	2.125	170	1.0554	0.6746	1.0554	1.0273
No log	2.15	172	0.8895	0.7261	0.8895	0.9431
No log	2.175	174	0.8195	0.7389	0.8195	0.9053
No log	2.2	176	0.8487	0.7170	0.8487	0.9212
No log	2.225	178	0.8507	0.7273	0.8507	0.9223
No log	2.25	180	0.8477	0.7284	0.8477	0.9207
No log	2.275	182	0.8043	0.7273	0.8043	0.8968
No log	2.3	184	0.7788	0.7483	0.7788	0.8825
No log	2.325	186	0.8071	0.7222	0.8071	0.8984
No log	2.35	188	0.8813	0.6620	0.8813	0.9388
No log	2.375	190	1.0187	0.5634	1.0187	1.0093
No log	2.4	192	1.1852	0.5867	1.1852	1.0887
No log	2.425	194	1.4033	0.5868	1.4033	1.1846
No log	2.45	196	1.2977	0.5848	1.2977	1.1391
No log	2.475	198	1.0145	0.6628	1.0145	1.0072
No log	2.5	200	0.9456	0.7168	0.9456	0.9724
No log	2.525	202	0.8732	0.7283	0.8732	0.9345
No log	2.55	204	0.8525	0.7561	0.8525	0.9233
No log	2.575	206	0.8701	0.7467	0.8701	0.9328
No log	2.6	208	0.8355	0.76	0.8355	0.9141
No log	2.625	210	0.8493	0.7114	0.8493	0.9216
No log	2.65	212	0.9017	0.6429	0.9017	0.9496
No log	2.675	214	0.8915	0.6429	0.8915	0.9442
No log	2.7	216	0.8521	0.6761	0.8521	0.9231
No log	2.725	218	0.8141	0.7550	0.8141	0.9023
No log	2.75	220	0.7750	0.7550	0.7750	0.8803
No log	2.775	222	0.7559	0.7632	0.7559	0.8694
No log	2.8	224	0.7862	0.7848	0.7862	0.8867
No log	2.825	226	0.8475	0.6879	0.8475	0.9206
No log	2.85	228	0.7959	0.7613	0.7959	0.8921
No log	2.875	230	0.7949	0.7550	0.7949	0.8916
No log	2.9	232	0.8286	0.7383	0.8286	0.9103
No log	2.925	234	0.8725	0.6901	0.8725	0.9341
No log	2.95	236	0.9172	0.6906	0.9172	0.9577
No log	2.975	238	0.8289	0.7092	0.8289	0.9105
No log	3.0	240	0.8017	0.7432	0.8017	0.8954
No log	3.025	242	0.8266	0.6803	0.8266	0.9092
No log	3.05	244	0.8972	0.6753	0.8972	0.9472
No log	3.075	246	0.9971	0.6494	0.9971	0.9985
No log	3.1	248	0.9468	0.6494	0.9468	0.9730
No log	3.125	250	0.9356	0.6122	0.9356	0.9673
No log	3.15	252	0.9031	0.6154	0.9031	0.9503
No log	3.175	254	0.9975	0.6259	0.9975	0.9988
No log	3.2	256	0.9932	0.6536	0.9932	0.9966
No log	3.225	258	1.1351	0.6341	1.1351	1.0654
No log	3.25	260	1.0735	0.6543	1.0735	1.0361
No log	3.275	262	0.8233	0.6667	0.8233	0.9073
No log	3.3	264	0.7929	0.6667	0.7929	0.8904
No log	3.325	266	0.9247	0.6471	0.9247	0.9616
No log	3.35	268	0.9435	0.6569	0.9435	0.9713
No log	3.375	270	0.9117	0.6667	0.9117	0.9549
No log	3.4	272	0.9693	0.5839	0.9693	0.9845
No log	3.425	274	1.0507	0.6027	1.0507	1.0250
No log	3.45	276	1.0677	0.6	1.0677	1.0333
No log	3.475	278	0.9487	0.6395	0.9487	0.9740
No log	3.5	280	0.7764	0.7248	0.7764	0.8812
No log	3.525	282	0.7404	0.7451	0.7404	0.8605
No log	3.55	284	0.7925	0.6713	0.7925	0.8902
No log	3.575	286	0.8120	0.6901	0.8120	0.9011
No log	3.6	288	0.8647	0.6806	0.8647	0.9299
No log	3.625	290	1.0172	0.5634	1.0172	1.0086
No log	3.65	292	1.0216	0.5634	1.0216	1.0107
No log	3.675	294	0.9676	0.6207	0.9676	0.9836
No log	3.7	296	0.8925	0.6849	0.8925	0.9447
No log	3.725	298	0.8458	0.7211	0.8458	0.9197
No log	3.75	300	0.8536	0.6901	0.8536	0.9239
No log	3.775	302	0.8219	0.7083	0.8219	0.9066
No log	3.8	304	0.7983	0.7123	0.7983	0.8935
No log	3.825	306	0.7931	0.7260	0.7931	0.8906
No log	3.85	308	0.7948	0.7260	0.7948	0.8915
No log	3.875	310	0.7998	0.7397	0.7998	0.8943
No log	3.9	312	0.8579	0.6944	0.8579	0.9262
No log	3.925	314	0.9367	0.5970	0.9367	0.9678
No log	3.95	316	0.9902	0.5970	0.9902	0.9951
No log	3.975	318	0.9777	0.6269	0.9777	0.9888
No log	4.0	320	1.0052	0.5649	1.0052	1.0026
No log	4.025	322	1.0205	0.6143	1.0205	1.0102
No log	4.05	324	1.1050	0.5390	1.1050	1.0512
No log	4.075	326	1.0169	0.5634	1.0169	1.0084
No log	4.1	328	0.8861	0.6713	0.8861	0.9414
No log	4.125	330	0.8165	0.7083	0.8165	0.9036
No log	4.15	332	0.8159	0.7092	0.8159	0.9033
No log	4.175	334	0.8362	0.6667	0.8362	0.9144
No log	4.2	336	0.8706	0.6471	0.8706	0.9330
No log	4.225	338	0.8965	0.6222	0.8965	0.9468
No log	4.25	340	0.8950	0.6107	0.8950	0.9460
No log	4.275	342	0.8667	0.6567	0.8667	0.9310
No log	4.3	344	0.8190	0.6619	0.8190	0.9050
No log	4.325	346	0.8080	0.7172	0.8080	0.8989
No log	4.35	348	0.8896	0.6575	0.8896	0.9432
No log	4.375	350	1.0142	0.6267	1.0142	1.0071
No log	4.4	352	1.0543	0.6267	1.0543	1.0268
No log	4.425	354	1.0954	0.6014	1.0954	1.0466
No log	4.45	356	1.1194	0.6014	1.1194	1.0580
No log	4.475	358	1.0567	0.6056	1.0567	1.0280
No log	4.5	360	0.9944	0.5507	0.9944	0.9972
No log	4.525	362	0.9163	0.6	0.9163	0.9572
No log	4.55	364	0.8889	0.6338	0.8889	0.9428
No log	4.575	366	0.8539	0.7075	0.8539	0.9240
No log	4.6	368	0.8934	0.6241	0.8934	0.9452
No log	4.625	370	0.9539	0.5588	0.9539	0.9767
No log	4.65	372	0.9663	0.5588	0.9663	0.9830
No log	4.675	374	1.0048	0.5652	1.0048	1.0024
No log	4.7	376	0.9293	0.6	0.9293	0.9640
No log	4.725	378	0.8577	0.6338	0.8577	0.9261
No log	4.75	380	0.8087	0.7162	0.8087	0.8993
No log	4.775	382	0.7844	0.7162	0.7844	0.8856
No log	4.8	384	0.8150	0.6906	0.8150	0.9028
No log	4.825	386	0.8587	0.6950	0.8587	0.9267
No log	4.85	388	0.9444	0.5942	0.9444	0.9718
No log	4.875	390	0.9361	0.6029	0.9361	0.9675
No log	4.9	392	0.8468	0.6812	0.8468	0.9202
No log	4.925	394	0.7620	0.7143	0.7620	0.8730
No log	4.95	396	0.6814	0.7518	0.6814	0.8255
No log	4.975	398	0.6196	0.75	0.6196	0.7871
No log	5.0	400	0.6141	0.7347	0.6141	0.7836
No log	5.025	402	0.6247	0.7568	0.6247	0.7904
No log	5.05	404	0.6241	0.7347	0.6241	0.7900
No log	5.075	406	0.6340	0.7397	0.6340	0.7963
No log	5.1	408	0.6862	0.7183	0.6862	0.8284
No log	5.125	410	0.7737	0.6809	0.7737	0.8796
No log	5.15	412	0.7937	0.6809	0.7937	0.8909
No log	5.175	414	0.7298	0.6993	0.7298	0.8543
No log	5.2	416	0.6986	0.72	0.6986	0.8358
No log	5.225	418	0.6827	0.7582	0.6827	0.8262
No log	5.25	420	0.7397	0.7089	0.7397	0.8600
No log	5.275	422	0.7968	0.7143	0.7968	0.8926
No log	5.3	424	0.7582	0.7215	0.7582	0.8708
No log	5.325	426	0.7276	0.7451	0.7276	0.8530
No log	5.35	428	0.7565	0.7320	0.7565	0.8698
No log	5.375	430	0.8477	0.6667	0.8477	0.9207
No log	5.4	432	0.8976	0.6623	0.8976	0.9474
No log	5.425	434	0.8373	0.6667	0.8373	0.9150
No log	5.45	436	0.7734	0.7143	0.7734	0.8795
No log	5.475	438	0.8057	0.6763	0.8057	0.8976
No log	5.5	440	0.8247	0.6763	0.8247	0.9081
No log	5.525	442	0.8142	0.7050	0.8142	0.9023
No log	5.55	444	0.7879	0.7050	0.7879	0.8876
No log	5.575	446	0.7814	0.7183	0.7814	0.8840
No log	5.6	448	0.7612	0.7143	0.7612	0.8725
No log	5.625	450	0.7442	0.7413	0.7442	0.8627
No log	5.65	452	0.7327	0.7361	0.7327	0.8560
No log	5.675	454	0.7160	0.7397	0.7160	0.8462
No log	5.7	456	0.7147	0.7310	0.7147	0.8454
No log	5.725	458	0.7212	0.7183	0.7212	0.8492
No log	5.75	460	0.7238	0.7183	0.7238	0.8507
No log	5.775	462	0.7612	0.7324	0.7612	0.8725
No log	5.8	464	0.8147	0.7042	0.8147	0.9026
No log	5.825	466	0.8377	0.6761	0.8377	0.9153
No log	5.85	468	0.8231	0.6620	0.8231	0.9072
No log	5.875	470	0.7930	0.7234	0.7930	0.8905
No log	5.9	472	0.7828	0.7222	0.7828	0.8847
No log	5.925	474	0.7825	0.7222	0.7825	0.8846
No log	5.95	476	0.7833	0.7183	0.7833	0.8850
No log	5.975	478	0.8209	0.7172	0.8209	0.9060
No log	6.0	480	0.8755	0.6286	0.8755	0.9357
No log	6.025	482	0.8887	0.6434	0.8887	0.9427
No log	6.05	484	0.8373	0.7042	0.8373	0.9150
No log	6.075	486	0.7986	0.7222	0.7986	0.8936
No log	6.1	488	0.7988	0.7133	0.7988	0.8938
No log	6.125	490	0.7816	0.7222	0.7816	0.8841
No log	6.15	492	0.7427	0.7222	0.7427	0.8618
No log	6.175	494	0.7694	0.6901	0.7694	0.8772
No log	6.2	496	0.7690	0.7034	0.7690	0.8769
No log	6.225	498	0.7383	0.7260	0.7383	0.8592
0.4175	6.25	500	0.7573	0.7133	0.7573	0.8702
0.4175	6.275	502	0.8145	0.6993	0.8145	0.9025
0.4175	6.3	504	0.8662	0.6383	0.8662	0.9307
0.4175	6.325	506	0.8519	0.7042	0.8519	0.9230
0.4175	6.35	508	0.8412	0.7133	0.8412	0.9171
0.4175	6.375	510	0.9950	0.5960	0.9950	0.9975

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1