ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7619
• Qwk: 0.7407
• Mse: 0.7619
• Rmse: 0.8729

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	6.9340	0.0057	6.9340	2.6333
No log	0.0784	4	4.5895	0.0750	4.5895	2.1423
No log	0.1176	6	3.5929	-0.0312	3.5929	1.8955
No log	0.1569	8	4.6897	-0.0606	4.6897	2.1656
No log	0.1961	10	3.1500	0.0235	3.1500	1.7748
No log	0.2353	12	2.0196	0.0960	2.0196	1.4211
No log	0.2745	14	1.9195	0.1667	1.9195	1.3855
No log	0.3137	16	2.0058	0.1239	2.0058	1.4163
No log	0.3529	18	2.1753	0.0635	2.1753	1.4749
No log	0.3922	20	2.0040	0.2564	2.0040	1.4156
No log	0.4314	22	1.9285	0.2344	1.9285	1.3887
No log	0.4706	24	2.5131	0.1088	2.5131	1.5853
No log	0.5098	26	2.8318	0.0261	2.8318	1.6828
No log	0.5490	28	2.7574	0.0261	2.7574	1.6605
No log	0.5882	30	2.3727	0.0526	2.3727	1.5404
No log	0.6275	32	2.0616	0.2190	2.0616	1.4358
No log	0.6667	34	1.9105	0.3465	1.9105	1.3822
No log	0.7059	36	1.9261	0.3206	1.9261	1.3878
No log	0.7451	38	2.0386	0.2647	2.0386	1.4278
No log	0.7843	40	2.2756	0.1418	2.2756	1.5085
No log	0.8235	42	2.9630	0.1486	2.9630	1.7213
No log	0.8627	44	3.7800	0.1357	3.7800	1.9442
No log	0.9020	46	3.6021	0.1284	3.6021	1.8979
No log	0.9412	48	3.1285	0.1297	3.1285	1.7688
No log	0.9804	50	2.3889	0.1408	2.3889	1.5456
No log	1.0196	52	1.9361	0.2748	1.9361	1.3914
No log	1.0588	54	1.7292	0.2992	1.7292	1.3150
No log	1.0980	56	1.5489	0.3651	1.5489	1.2446
No log	1.1373	58	1.6571	0.3594	1.6571	1.2873
No log	1.1765	60	1.9108	0.3034	1.9108	1.3823
No log	1.2157	62	2.4930	0.25	2.4930	1.5789
No log	1.2549	64	2.5507	0.2456	2.5507	1.5971
No log	1.2941	66	1.9801	0.3046	1.9801	1.4072
No log	1.3333	68	1.6324	0.4143	1.6324	1.2777
No log	1.3725	70	1.6607	0.4082	1.6607	1.2887
No log	1.4118	72	1.8095	0.3784	1.8095	1.3452
No log	1.4510	74	2.1806	0.3152	2.1806	1.4767
No log	1.4902	76	2.2759	0.2754	2.2759	1.5086
No log	1.5294	78	2.2019	0.3012	2.2019	1.4839
No log	1.5686	80	2.1223	0.3230	2.1223	1.4568
No log	1.6078	82	2.0171	0.3247	2.0171	1.4203
No log	1.6471	84	1.7472	0.3803	1.7472	1.3218
No log	1.6863	86	1.4861	0.4412	1.4861	1.2190
No log	1.7255	88	1.4473	0.4394	1.4473	1.2030
No log	1.7647	90	1.4619	0.4823	1.4619	1.2091
No log	1.8039	92	1.4115	0.4730	1.4115	1.1881
No log	1.8431	94	1.3775	0.5385	1.3775	1.1737
No log	1.8824	96	1.2716	0.5139	1.2716	1.1276
No log	1.9216	98	1.1952	0.5379	1.1952	1.0932
No log	1.9608	100	1.2265	0.5733	1.2265	1.1075
No log	2.0	102	1.1200	0.5931	1.1200	1.0583
No log	2.0392	104	1.0808	0.5693	1.0808	1.0396
No log	2.0784	106	1.3602	0.4427	1.3602	1.1663
No log	2.1176	108	1.6823	0.2879	1.6823	1.2970
No log	2.1569	110	1.9582	0.2239	1.9582	1.3994
No log	2.1961	112	1.4181	0.4	1.4181	1.1908
No log	2.2353	114	1.0878	0.6294	1.0878	1.0430
No log	2.2745	116	1.0453	0.6345	1.0453	1.0224
No log	2.3137	118	1.1158	0.5985	1.1158	1.0563
No log	2.3529	120	1.2274	0.5036	1.2274	1.1079
No log	2.3922	122	1.4885	0.5517	1.4885	1.2201
No log	2.4314	124	3.0191	0.2896	3.0191	1.7375
No log	2.4706	126	3.8571	0.1992	3.8571	1.9639
No log	2.5098	128	3.3230	0.2183	3.3230	1.8229
No log	2.5490	130	2.0842	0.3529	2.0842	1.4437
No log	2.5882	132	1.0844	0.6056	1.0844	1.0414
No log	2.6275	134	0.8730	0.6667	0.8730	0.9344
No log	2.6667	136	0.9000	0.6619	0.9000	0.9487
No log	2.7059	138	0.9598	0.6525	0.9598	0.9797
No log	2.7451	140	1.1481	0.6211	1.1481	1.0715
No log	2.7843	142	1.3997	0.5402	1.3997	1.1831
No log	2.8235	144	1.5097	0.4596	1.5097	1.2287
No log	2.8627	146	1.5891	0.5096	1.5891	1.2606
No log	2.9020	148	1.4827	0.4698	1.4827	1.2177
No log	2.9412	150	1.0985	0.6087	1.0985	1.0481
No log	2.9804	152	0.8988	0.5882	0.8988	0.9481
No log	3.0196	154	0.9558	0.5735	0.9558	0.9776
No log	3.0588	156	0.8832	0.5985	0.8832	0.9398
No log	3.0980	158	0.7654	0.7552	0.7654	0.8749
No log	3.1373	160	0.7935	0.6377	0.7935	0.8908
No log	3.1765	162	0.8139	0.6571	0.8139	0.9022
No log	3.2157	164	0.8474	0.6667	0.8474	0.9205
No log	3.2549	166	0.9398	0.6974	0.9398	0.9694
No log	3.2941	168	1.1052	0.6135	1.1052	1.0513
No log	3.3333	170	1.2717	0.5814	1.2717	1.1277
No log	3.3725	172	1.3972	0.5486	1.3972	1.1821
No log	3.4118	174	1.4673	0.5549	1.4673	1.2113
No log	3.4510	176	1.6230	0.5587	1.6230	1.2740
No log	3.4902	178	1.9373	0.5078	1.9373	1.3919
No log	3.5294	180	1.6995	0.5484	1.6995	1.3036
No log	3.5686	182	1.1956	0.5644	1.1956	1.0934
No log	3.6078	184	0.8756	0.6531	0.8756	0.9357
No log	3.6471	186	0.7659	0.7324	0.7659	0.8752
No log	3.6863	188	0.7741	0.7234	0.7741	0.8798
No log	3.7255	190	0.9056	0.6667	0.9056	0.9516
No log	3.7647	192	0.9687	0.6667	0.9687	0.9842
No log	3.8039	194	0.8558	0.7059	0.8558	0.9251
No log	3.8431	196	0.7350	0.7630	0.7350	0.8573
No log	3.8824	198	0.7328	0.75	0.7328	0.8560
No log	3.9216	200	0.8113	0.7484	0.8113	0.9007
No log	3.9608	202	0.8366	0.7133	0.8366	0.9147
No log	4.0	204	0.8017	0.7211	0.8017	0.8954
No log	4.0392	206	0.7513	0.7702	0.7513	0.8668
No log	4.0784	208	0.7834	0.7162	0.7834	0.8851
No log	4.1176	210	0.9287	0.6471	0.9287	0.9637
No log	4.1569	212	0.9386	0.6569	0.9386	0.9688
No log	4.1961	214	0.8596	0.6901	0.8596	0.9272
No log	4.2353	216	0.8095	0.7284	0.8095	0.8997
No log	4.2745	218	0.9008	0.7345	0.9008	0.9491
No log	4.3137	220	1.2737	0.6146	1.2737	1.1286
No log	4.3529	222	1.3568	0.6154	1.3568	1.1648
No log	4.3922	224	1.0882	0.6222	1.0882	1.0432
No log	4.4314	226	0.8013	0.7719	0.8013	0.8951
No log	4.4706	228	0.7716	0.7453	0.7716	0.8784
No log	4.5098	230	0.8671	0.7195	0.8671	0.9312
No log	4.5490	232	1.1038	0.6235	1.1038	1.0506
No log	4.5882	234	1.1752	0.6145	1.1752	1.0841
No log	4.6275	236	1.0690	0.6433	1.0690	1.0339
No log	4.6667	238	0.9435	0.6792	0.9435	0.9714
No log	4.7059	240	0.9684	0.6131	0.9684	0.9841
No log	4.7451	242	1.0463	0.6119	1.0463	1.0229
No log	4.7843	244	1.0413	0.6277	1.0413	1.0204
No log	4.8235	246	1.0248	0.6533	1.0248	1.0123
No log	4.8627	248	1.0669	0.6265	1.0669	1.0329
No log	4.9020	250	1.0840	0.6391	1.0840	1.0412
No log	4.9412	252	1.0955	0.6353	1.0955	1.0467
No log	4.9804	254	0.8949	0.6536	0.8949	0.9460
No log	5.0196	256	0.7566	0.7320	0.7566	0.8698
No log	5.0588	258	0.7134	0.7297	0.7134	0.8446
No log	5.0980	260	0.7367	0.7468	0.7367	0.8583
No log	5.1373	262	0.9183	0.7006	0.9183	0.9583
No log	5.1765	264	1.0066	0.7006	1.0066	1.0033
No log	5.2157	266	0.9845	0.6932	0.9845	0.9922
No log	5.2549	268	0.8947	0.6792	0.8947	0.9459
No log	5.2941	270	0.9412	0.6573	0.9412	0.9702
No log	5.3333	272	1.1931	0.5180	1.1931	1.0923
No log	5.3725	274	1.4854	0.4314	1.4854	1.2188
No log	5.4118	276	1.4914	0.4474	1.4914	1.2212
No log	5.4510	278	1.1881	0.5638	1.1881	1.0900
No log	5.4902	280	0.9323	0.6846	0.9323	0.9656
No log	5.5294	282	0.7936	0.7222	0.7936	0.8908
No log	5.5686	284	0.7727	0.7222	0.7727	0.8790
No log	5.6078	286	0.8300	0.6918	0.8300	0.9111
No log	5.6471	288	0.9397	0.6941	0.9397	0.9694
No log	5.6863	290	0.9055	0.7018	0.9055	0.9516
No log	5.7255	292	0.8241	0.7458	0.8241	0.9078
No log	5.7647	294	0.7652	0.7416	0.7652	0.8748
No log	5.8039	296	0.8052	0.7345	0.8052	0.8973
No log	5.8431	298	0.8366	0.7093	0.8366	0.9147
No log	5.8824	300	0.8693	0.7093	0.8693	0.9324
No log	5.9216	302	1.0378	0.6705	1.0378	1.0187
No log	5.9608	304	1.2508	0.5930	1.2508	1.1184
No log	6.0	306	1.1490	0.6036	1.1490	1.0719
No log	6.0392	308	0.9634	0.5931	0.9634	0.9815
No log	6.0784	310	0.8495	0.6857	0.8495	0.9217
No log	6.1176	312	0.8667	0.6763	0.8667	0.9310
No log	6.1569	314	0.9715	0.5373	0.9715	0.9857
No log	6.1961	316	1.1008	0.5789	1.1008	1.0492
No log	6.2353	318	1.1114	0.6	1.1114	1.0542
No log	6.2745	320	1.1254	0.6395	1.1254	1.0608
No log	6.3137	322	1.0552	0.6272	1.0552	1.0272
No log	6.3529	324	0.9508	0.6626	0.9508	0.9751
No log	6.3922	326	0.8717	0.6622	0.8717	0.9336
No log	6.4314	328	0.8659	0.6443	0.8659	0.9306
No log	6.4706	330	0.8268	0.6713	0.8268	0.9093
No log	6.5098	332	0.7979	0.7273	0.7979	0.8933
No log	6.5490	334	0.8250	0.6944	0.8250	0.9083
No log	6.5882	336	0.8968	0.625	0.8968	0.9470
No log	6.6275	338	0.9517	0.5816	0.9517	0.9756
No log	6.6667	340	0.9973	0.5974	0.9973	0.9986
No log	6.7059	342	0.9902	0.5974	0.9902	0.9951
No log	6.7451	344	0.9180	0.6803	0.9180	0.9581
No log	6.7843	346	0.8954	0.6351	0.8954	0.9463
No log	6.8235	348	0.9270	0.6380	0.9270	0.9628
No log	6.8627	350	0.9545	0.6296	0.9545	0.9770
No log	6.9020	352	0.9964	0.6310	0.9964	0.9982
No log	6.9412	354	1.1483	0.6316	1.1483	1.0716
No log	6.9804	356	1.0904	0.6590	1.0904	1.0442
No log	7.0196	358	1.0752	0.6358	1.0752	1.0369
No log	7.0588	360	1.0655	0.6395	1.0655	1.0322
No log	7.0980	362	1.1511	0.64	1.1511	1.0729
No log	7.1373	364	1.1135	0.6322	1.1135	1.0552
No log	7.1765	366	0.8728	0.6788	0.8728	0.9342
No log	7.2157	368	0.7263	0.7448	0.7263	0.8522
No log	7.2549	370	0.7316	0.7034	0.7316	0.8554
No log	7.2941	372	0.7801	0.6944	0.7801	0.8832
No log	7.3333	374	0.8814	0.6525	0.8814	0.9388
No log	7.3725	376	1.0869	0.6543	1.0869	1.0425
No log	7.4118	378	1.2390	0.6036	1.2390	1.1131
No log	7.4510	380	1.2624	0.6036	1.2624	1.1235
No log	7.4902	382	1.1804	0.6395	1.1804	1.0865
No log	7.5294	384	1.0475	0.6667	1.0475	1.0235
No log	7.5686	386	0.8452	0.6338	0.8452	0.9193
No log	7.6078	388	0.7441	0.7034	0.7441	0.8626
No log	7.6471	390	0.7375	0.7092	0.7375	0.8588
No log	7.6863	392	0.7444	0.7260	0.7444	0.8628
No log	7.7255	394	0.8230	0.6241	0.8230	0.9072
No log	7.7647	396	1.0056	0.6323	1.0056	1.0028
No log	7.8039	398	1.1969	0.5875	1.1969	1.0941
No log	7.8431	400	1.1382	0.6098	1.1382	1.0669
No log	7.8824	402	0.9408	0.6420	0.9408	0.9699
No log	7.9216	404	0.8294	0.7470	0.8294	0.9107
No log	7.9608	406	0.8076	0.7647	0.8076	0.8986
No log	8.0	408	0.7915	0.7456	0.7915	0.8897
No log	8.0392	410	0.8782	0.7374	0.8782	0.9371
No log	8.0784	412	1.0098	0.6526	1.0098	1.0049
No log	8.1176	414	1.0011	0.6522	1.0011	1.0005
No log	8.1569	416	1.0182	0.6286	1.0182	1.0090
No log	8.1961	418	1.1389	0.6364	1.1389	1.0672
No log	8.2353	420	1.1587	0.6190	1.1587	1.0764
No log	8.2745	422	1.0070	0.6380	1.0070	1.0035
No log	8.3137	424	0.9143	0.6625	0.9143	0.9562
No log	8.3529	426	0.8168	0.6839	0.8168	0.9038
No log	8.3922	428	0.8013	0.7081	0.8013	0.8951
No log	8.4314	430	0.8261	0.7117	0.8261	0.9089
No log	8.4706	432	0.9691	0.6506	0.9691	0.9844
No log	8.5098	434	1.0429	0.6509	1.0429	1.0212
No log	8.5490	436	1.1506	0.6364	1.1506	1.0727
No log	8.5882	438	1.0564	0.6395	1.0564	1.0278
No log	8.6275	440	0.8706	0.6982	0.8706	0.9331
No log	8.6667	442	0.7487	0.7975	0.7487	0.8653
No log	8.7059	444	0.7317	0.7975	0.7317	0.8554
No log	8.7451	446	0.7337	0.7975	0.7337	0.8566
No log	8.7843	448	0.7538	0.7901	0.7538	0.8682
No log	8.8235	450	0.7418	0.7682	0.7418	0.8613
No log	8.8627	452	0.7435	0.6944	0.7435	0.8623
No log	8.9020	454	0.7881	0.7260	0.7881	0.8878
No log	8.9412	456	0.9032	0.6447	0.9032	0.9504
No log	8.9804	458	1.1408	0.6258	1.1408	1.0681
No log	9.0196	460	1.5393	0.5556	1.5393	1.2407
No log	9.0588	462	1.7226	0.5137	1.7226	1.3125
No log	9.0980	464	1.4902	0.5574	1.4902	1.2208
No log	9.1373	466	1.1170	0.6322	1.1170	1.0569
No log	9.1765	468	0.8558	0.7349	0.8558	0.9251
No log	9.2157	470	0.7554	0.7898	0.7554	0.8691
No log	9.2549	472	0.7299	0.7898	0.7299	0.8543
No log	9.2941	474	0.7288	0.7483	0.7288	0.8537
No log	9.3333	476	0.7774	0.7397	0.7773	0.8817
No log	9.3725	478	0.7654	0.7273	0.7654	0.8749
No log	9.4118	480	0.7575	0.7361	0.7575	0.8704
No log	9.4510	482	0.7525	0.7361	0.7525	0.8675
No log	9.4902	484	0.7393	0.7361	0.7393	0.8598
No log	9.5294	486	0.7499	0.7361	0.7499	0.8660
No log	9.5686	488	0.8186	0.7355	0.8186	0.9048
No log	9.6078	490	0.9678	0.6788	0.9678	0.9838
No log	9.6471	492	1.0505	0.6588	1.0505	1.0250
No log	9.6863	494	1.0885	0.6474	1.0885	1.0433
No log	9.7255	496	0.9274	0.6667	0.9274	0.9630
No log	9.7647	498	0.7021	0.7826	0.7021	0.8379
0.454	9.8039	500	0.6165	0.7974	0.6165	0.7852
0.454	9.8431	502	0.6267	0.7671	0.6267	0.7916
0.454	9.8824	504	0.6182	0.7671	0.6182	0.7863
0.454	9.9216	506	0.6209	0.7871	0.6209	0.7880
0.454	9.9608	508	0.6879	0.7595	0.6879	0.8294
0.454	10.0	510	0.7619	0.7407	0.7619	0.8729

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1