ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8461
• Qwk: 0.6748
• Mse: 0.8461
• Rmse: 0.9199

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	2.2331	0.0239	2.2331	1.4943
No log	0.0816	4	1.5635	0.2087	1.5635	1.2504
No log	0.1224	6	1.4372	0.1888	1.4372	1.1988
No log	0.1633	8	1.7231	0.2320	1.7231	1.3127
No log	0.2041	10	1.9322	0.2423	1.9322	1.3900
No log	0.2449	12	1.8178	0.2954	1.8178	1.3483
No log	0.2857	14	1.6220	0.3295	1.6220	1.2736
No log	0.3265	16	1.4729	0.1758	1.4729	1.2136
No log	0.3673	18	1.5030	0.2674	1.5030	1.2260
No log	0.4082	20	1.5003	0.3315	1.5003	1.2249
No log	0.4490	22	1.4649	0.3587	1.4649	1.2103
No log	0.4898	24	1.3615	0.2676	1.3615	1.1668
No log	0.5306	26	1.2226	0.2257	1.2226	1.1057
No log	0.5714	28	1.1735	0.2232	1.1735	1.0833
No log	0.6122	30	1.1661	0.2539	1.1661	1.0799
No log	0.6531	32	1.2478	0.1779	1.2478	1.1171
No log	0.6939	34	1.3163	0.1857	1.3163	1.1473
No log	0.7347	36	1.3065	0.1857	1.3065	1.1430
No log	0.7755	38	1.2487	0.2395	1.2487	1.1175
No log	0.8163	40	1.2041	0.3348	1.2041	1.0973
No log	0.8571	42	1.2163	0.2858	1.2163	1.1028
No log	0.8980	44	1.2995	0.2316	1.2995	1.1399
No log	0.9388	46	1.3459	0.2110	1.3459	1.1601
No log	0.9796	48	1.3166	0.1987	1.3166	1.1474
No log	1.0204	50	1.2623	0.2837	1.2623	1.1235
No log	1.0612	52	1.3129	0.3566	1.3129	1.1458
No log	1.1020	54	1.4531	0.3588	1.4531	1.2055
No log	1.1429	56	1.5841	0.3849	1.5841	1.2586
No log	1.1837	58	1.4428	0.4110	1.4428	1.2012
No log	1.2245	60	1.2122	0.4114	1.2122	1.1010
No log	1.2653	62	1.0887	0.4030	1.0887	1.0434
No log	1.3061	64	0.9841	0.4455	0.9841	0.9920
No log	1.3469	66	0.9871	0.5115	0.9871	0.9935
No log	1.3878	68	1.2118	0.4758	1.2118	1.1008
No log	1.4286	70	1.7212	0.4461	1.7212	1.3120
No log	1.4694	72	1.5981	0.4617	1.5981	1.2642
No log	1.5102	74	1.1392	0.4864	1.1392	1.0673
No log	1.5510	76	0.9293	0.4378	0.9293	0.9640
No log	1.5918	78	0.9199	0.4624	0.9199	0.9591
No log	1.6327	80	0.9173	0.4973	0.9173	0.9577
No log	1.6735	82	0.9918	0.4729	0.9918	0.9959
No log	1.7143	84	1.2801	0.5191	1.2801	1.1314
No log	1.7551	86	1.5195	0.5248	1.5195	1.2327
No log	1.7959	88	1.5420	0.5308	1.5420	1.2418
No log	1.8367	90	1.1832	0.5328	1.1832	1.0878
No log	1.8776	92	0.9230	0.5452	0.9230	0.9607
No log	1.9184	94	0.8676	0.5645	0.8676	0.9315
No log	1.9592	96	0.9318	0.5670	0.9318	0.9653
No log	2.0	98	1.0087	0.5952	1.0087	1.0043
No log	2.0408	100	1.1565	0.5812	1.1565	1.0754
No log	2.0816	102	1.1198	0.5856	1.1198	1.0582
No log	2.1224	104	0.9080	0.6280	0.9080	0.9529
No log	2.1633	106	0.8268	0.6224	0.8268	0.9093
No log	2.2041	108	0.8192	0.6350	0.8192	0.9051
No log	2.2449	110	0.8968	0.6311	0.8968	0.9470
No log	2.2857	112	1.1541	0.6134	1.1541	1.0743
No log	2.3265	114	1.2072	0.5976	1.2072	1.0987
No log	2.3673	116	0.9991	0.6639	0.9991	0.9996
No log	2.4082	118	0.8394	0.6401	0.8394	0.9162
No log	2.4490	120	0.9150	0.6547	0.9150	0.9566
No log	2.4898	122	1.0151	0.6254	1.0151	1.0075
No log	2.5306	124	0.9918	0.6254	0.9918	0.9959
No log	2.5714	126	0.9569	0.6417	0.9569	0.9782
No log	2.6122	128	1.1292	0.6236	1.1292	1.0627
No log	2.6531	130	1.1608	0.6250	1.1608	1.0774
No log	2.6939	132	1.0007	0.6142	1.0007	1.0004
No log	2.7347	134	0.7715	0.6698	0.7715	0.8784
No log	2.7755	136	0.7114	0.6855	0.7114	0.8435
No log	2.8163	138	0.7426	0.6936	0.7426	0.8618
No log	2.8571	140	0.8817	0.6706	0.8817	0.9390
No log	2.8980	142	0.8475	0.6663	0.8475	0.9206
No log	2.9388	144	0.7566	0.6905	0.7566	0.8698
No log	2.9796	146	0.6888	0.6918	0.6888	0.8299
No log	3.0204	148	0.7158	0.7057	0.7158	0.8460
No log	3.0612	150	0.7775	0.7234	0.7775	0.8818
No log	3.1020	152	0.8115	0.7134	0.8115	0.9008
No log	3.1429	154	0.8666	0.7189	0.8666	0.9309
No log	3.1837	156	0.7546	0.7210	0.7546	0.8687
No log	3.2245	158	0.6738	0.7062	0.6738	0.8209
No log	3.2653	160	0.6813	0.7109	0.6813	0.8254
No log	3.3061	162	0.7445	0.7093	0.7445	0.8629
No log	3.3469	164	0.7462	0.7175	0.7462	0.8638
No log	3.3878	166	0.7749	0.7076	0.7749	0.8803
No log	3.4286	168	0.8641	0.7110	0.8641	0.9296
No log	3.4694	170	0.9921	0.6545	0.9921	0.9960
No log	3.5102	172	0.9246	0.6665	0.9246	0.9616
No log	3.5510	174	0.9929	0.6566	0.9929	0.9964
No log	3.5918	176	1.0580	0.6129	1.0580	1.0286
No log	3.6327	178	1.0278	0.6447	1.0278	1.0138
No log	3.6735	180	0.9725	0.6713	0.9725	0.9862
No log	3.7143	182	0.7659	0.7197	0.7659	0.8752
No log	3.7551	184	0.7043	0.7309	0.7043	0.8392
No log	3.7959	186	0.7150	0.7294	0.7150	0.8456
No log	3.8367	188	0.6866	0.7396	0.6866	0.8286
No log	3.8776	190	0.6727	0.7571	0.6727	0.8202
No log	3.9184	192	0.7346	0.7348	0.7346	0.8571
No log	3.9592	194	0.9699	0.6695	0.9699	0.9848
No log	4.0	196	1.0773	0.6473	1.0773	1.0379
No log	4.0408	198	0.9433	0.6955	0.9433	0.9712
No log	4.0816	200	0.7839	0.7090	0.7839	0.8854
No log	4.1224	202	0.8016	0.7142	0.8016	0.8953
No log	4.1633	204	0.9726	0.6641	0.9726	0.9862
No log	4.2041	206	1.2464	0.6236	1.2464	1.1164
No log	4.2449	208	1.3016	0.6158	1.3016	1.1409
No log	4.2857	210	1.0956	0.6540	1.0956	1.0467
No log	4.3265	212	0.8393	0.6964	0.8393	0.9161
No log	4.3673	214	0.7287	0.7302	0.7287	0.8537
No log	4.4082	216	0.7356	0.7295	0.7356	0.8577
No log	4.4490	218	0.8675	0.6746	0.8675	0.9314
No log	4.4898	220	1.0089	0.6567	1.0089	1.0044
No log	4.5306	222	1.0009	0.6730	1.0009	1.0005
No log	4.5714	224	0.8888	0.6930	0.8888	0.9427
No log	4.6122	226	0.8617	0.6790	0.8617	0.9283
No log	4.6531	228	0.8705	0.6821	0.8705	0.9330
No log	4.6939	230	0.9798	0.6737	0.9798	0.9898
No log	4.7347	232	1.1372	0.6242	1.1372	1.0664
No log	4.7755	234	1.0603	0.6433	1.0603	1.0297
No log	4.8163	236	0.9039	0.6622	0.9039	0.9507
No log	4.8571	238	0.8349	0.6887	0.8349	0.9137
No log	4.8980	240	0.7658	0.7308	0.7658	0.8751
No log	4.9388	242	0.8115	0.7048	0.8115	0.9008
No log	4.9796	244	0.9483	0.6368	0.9483	0.9738
No log	5.0204	246	1.0005	0.6460	1.0005	1.0002
No log	5.0612	248	0.9101	0.6300	0.9101	0.9540
No log	5.1020	250	0.8906	0.6153	0.8906	0.9437
No log	5.1429	252	0.9332	0.6335	0.9332	0.9660
No log	5.1837	254	1.0366	0.6128	1.0366	1.0181
No log	5.2245	256	1.0700	0.6161	1.0700	1.0344
No log	5.2653	258	0.9585	0.6369	0.9585	0.9790
No log	5.3061	260	0.8703	0.6911	0.8703	0.9329
No log	5.3469	262	0.7605	0.6932	0.7605	0.8721
No log	5.3878	264	0.7231	0.7177	0.7231	0.8503
No log	5.4286	266	0.7519	0.7010	0.7519	0.8671
No log	5.4694	268	0.8425	0.6948	0.8425	0.9179
No log	5.5102	270	0.8712	0.6705	0.8712	0.9334
No log	5.5510	272	0.8236	0.6813	0.8236	0.9075
No log	5.5918	274	0.7709	0.7104	0.7709	0.8780
No log	5.6327	276	0.7512	0.7104	0.7512	0.8667
No log	5.6735	278	0.7957	0.7086	0.7957	0.8920
No log	5.7143	280	0.9482	0.6688	0.9482	0.9737
No log	5.7551	282	1.1061	0.6565	1.1061	1.0517
No log	5.7959	284	1.0879	0.6593	1.0879	1.0430
No log	5.8367	286	0.9685	0.6798	0.9685	0.9841
No log	5.8776	288	0.7874	0.6998	0.7874	0.8874
No log	5.9184	290	0.7222	0.7286	0.7222	0.8498
No log	5.9592	292	0.7385	0.7357	0.7385	0.8594
No log	6.0	294	0.8192	0.7060	0.8192	0.9051
No log	6.0408	296	0.9723	0.6879	0.9723	0.9861
No log	6.0816	298	1.0982	0.6172	1.0982	1.0479
No log	6.1224	300	1.1336	0.5985	1.1336	1.0647
No log	6.1633	302	1.0642	0.6311	1.0642	1.0316
No log	6.2041	304	0.9194	0.6672	0.9194	0.9588
No log	6.2449	306	0.8534	0.6741	0.8534	0.9238
No log	6.2857	308	0.8317	0.6856	0.8317	0.9120
No log	6.3265	310	0.8452	0.6741	0.8452	0.9193
No log	6.3673	312	0.8364	0.6812	0.8364	0.9146
No log	6.4082	314	0.8665	0.6723	0.8665	0.9308
No log	6.4490	316	0.8976	0.6739	0.8976	0.9474
No log	6.4898	318	0.9630	0.6737	0.9630	0.9813
No log	6.5306	320	0.9952	0.6461	0.9952	0.9976
No log	6.5714	322	0.9712	0.6490	0.9712	0.9855
No log	6.6122	324	0.8805	0.6849	0.8805	0.9384
No log	6.6531	326	0.8081	0.7015	0.8081	0.8989
No log	6.6939	328	0.7855	0.7069	0.7855	0.8863
No log	6.7347	330	0.8169	0.6874	0.8169	0.9038
No log	6.7755	332	0.8925	0.6815	0.8925	0.9447
No log	6.8163	334	0.8955	0.6815	0.8955	0.9463
No log	6.8571	336	0.8797	0.6880	0.8797	0.9379
No log	6.8980	338	0.8602	0.6939	0.8602	0.9275
No log	6.9388	340	0.8173	0.7056	0.8173	0.9040
No log	6.9796	342	0.7479	0.7261	0.7479	0.8648
No log	7.0204	344	0.7290	0.7281	0.7290	0.8538
No log	7.0612	346	0.7641	0.7082	0.7641	0.8741
No log	7.1020	348	0.8547	0.6939	0.8547	0.9245
No log	7.1429	350	0.9547	0.6810	0.9547	0.9771
No log	7.1837	352	0.9688	0.6810	0.9688	0.9843
No log	7.2245	354	0.9155	0.6780	0.9155	0.9568
No log	7.2653	356	0.8565	0.6822	0.8565	0.9255
No log	7.3061	358	0.8136	0.6911	0.8136	0.9020
No log	7.3469	360	0.7915	0.6984	0.7915	0.8897
No log	7.3878	362	0.8094	0.6862	0.8094	0.8997
No log	7.4286	364	0.8536	0.6723	0.8536	0.9239
No log	7.4694	366	0.9241	0.6800	0.9241	0.9613
No log	7.5102	368	0.9605	0.6758	0.9605	0.9800
No log	7.5510	370	0.9284	0.6800	0.9284	0.9635
No log	7.5918	372	0.8833	0.6741	0.8833	0.9399
No log	7.6327	374	0.8344	0.6791	0.8344	0.9134
No log	7.6735	376	0.8459	0.6850	0.8459	0.9197
No log	7.7143	378	0.8891	0.6891	0.8891	0.9429
No log	7.7551	380	0.8906	0.6891	0.8906	0.9437
No log	7.7959	382	0.8747	0.6891	0.8747	0.9352
No log	7.8367	384	0.8653	0.6891	0.8653	0.9302
No log	7.8776	386	0.8989	0.6891	0.8989	0.9481
No log	7.9184	388	0.9190	0.6891	0.9190	0.9586
No log	7.9592	390	0.9454	0.6896	0.9454	0.9723
No log	8.0	392	0.9320	0.6891	0.9320	0.9654
No log	8.0408	394	0.8876	0.6781	0.8876	0.9421
No log	8.0816	396	0.8653	0.6791	0.8653	0.9302
No log	8.1224	398	0.8510	0.6791	0.8510	0.9225
No log	8.1633	400	0.8278	0.6791	0.8278	0.9098
No log	8.2041	402	0.8348	0.6791	0.8348	0.9137
No log	8.2449	404	0.8687	0.6791	0.8687	0.9320
No log	8.2857	406	0.8983	0.6808	0.8983	0.9478
No log	8.3265	408	0.9042	0.6808	0.9042	0.9509
No log	8.3673	410	0.9065	0.6771	0.9065	0.9521
No log	8.4082	412	0.8841	0.6771	0.8841	0.9403
No log	8.4490	414	0.8644	0.6754	0.8644	0.9298
No log	8.4898	416	0.8654	0.6811	0.8654	0.9303
No log	8.5306	418	0.8492	0.6754	0.8492	0.9215
No log	8.5714	420	0.8277	0.6720	0.8277	0.9098
No log	8.6122	422	0.7989	0.7010	0.7989	0.8938
No log	8.6531	424	0.7914	0.7010	0.7914	0.8896
No log	8.6939	426	0.8090	0.6974	0.8090	0.8994
No log	8.7347	428	0.8214	0.6882	0.8214	0.9063
No log	8.7755	430	0.8419	0.6842	0.8419	0.9175
No log	8.8163	432	0.8768	0.6891	0.8768	0.9364
No log	8.8571	434	0.8881	0.6851	0.8881	0.9424
No log	8.8980	436	0.8832	0.6851	0.8832	0.9398
No log	8.9388	438	0.9029	0.6851	0.9029	0.9502
No log	8.9796	440	0.9080	0.6851	0.9080	0.9529
No log	9.0204	442	0.9242	0.6851	0.9242	0.9613
No log	9.0612	444	0.9490	0.6907	0.9490	0.9741
No log	9.1020	446	0.9495	0.6907	0.9495	0.9744
No log	9.1429	448	0.9423	0.6851	0.9423	0.9707
No log	9.1837	450	0.9208	0.6771	0.9208	0.9596
No log	9.2245	452	0.9148	0.6771	0.9148	0.9564
No log	9.2653	454	0.8998	0.6839	0.8998	0.9486
No log	9.3061	456	0.8797	0.6808	0.8797	0.9379
No log	9.3469	458	0.8586	0.6748	0.8586	0.9266
No log	9.3878	460	0.8466	0.6748	0.8466	0.9201
No log	9.4286	462	0.8377	0.6844	0.8377	0.9153
No log	9.4694	464	0.8353	0.6844	0.8353	0.9139
No log	9.5102	466	0.8393	0.6844	0.8393	0.9161
No log	9.5510	468	0.8431	0.6844	0.8431	0.9182
No log	9.5918	470	0.8423	0.6844	0.8423	0.9178
No log	9.6327	472	0.8454	0.6748	0.8454	0.9195
No log	9.6735	474	0.8445	0.6844	0.8445	0.9190
No log	9.7143	476	0.8485	0.6748	0.8485	0.9211
No log	9.7551	478	0.8502	0.6748	0.8502	0.9221
No log	9.7959	480	0.8499	0.6748	0.8499	0.9219
No log	9.8367	482	0.8482	0.6748	0.8482	0.9210
No log	9.8776	484	0.8480	0.6748	0.8480	0.9209
No log	9.9184	486	0.8470	0.6748	0.8470	0.9203
No log	9.9592	488	0.8462	0.6748	0.8462	0.9199
No log	10.0	490	0.8461	0.6748	0.8461	0.9199

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1