ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0389
• Qwk: 0.5738
• Mse: 1.0389
• Rmse: 1.0193

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0312	2	5.2647	-0.0261	5.2647	2.2945
No log	0.0625	4	2.9234	0.0623	2.9234	1.7098
No log	0.0938	6	1.6997	0.0876	1.6997	1.3037
No log	0.125	8	1.6729	0.0696	1.6729	1.2934
No log	0.1562	10	1.4910	0.0724	1.4910	1.2211
No log	0.1875	12	1.3036	0.2072	1.3036	1.1418
No log	0.2188	14	1.1435	0.2189	1.1435	1.0693
No log	0.25	16	1.1272	0.1814	1.1272	1.0617
No log	0.2812	18	1.1095	0.2296	1.1095	1.0533
No log	0.3125	20	1.1378	0.2455	1.1378	1.0667
No log	0.3438	22	1.1373	0.3226	1.1373	1.0665
No log	0.375	24	1.1577	0.3812	1.1577	1.0759
No log	0.4062	26	1.1511	0.4050	1.1511	1.0729
No log	0.4375	28	1.0630	0.3844	1.0630	1.0310
No log	0.4688	30	0.9916	0.3126	0.9916	0.9958
No log	0.5	32	1.0076	0.3159	1.0076	1.0038
No log	0.5312	34	1.0746	0.2715	1.0746	1.0366
No log	0.5625	36	1.0566	0.3825	1.0566	1.0279
No log	0.5938	38	1.0673	0.3955	1.0673	1.0331
No log	0.625	40	1.0560	0.3491	1.0560	1.0276
No log	0.6562	42	1.0958	0.2997	1.0958	1.0468
No log	0.6875	44	1.0725	0.2942	1.0725	1.0356
No log	0.7188	46	1.0556	0.3177	1.0556	1.0274
No log	0.75	48	1.0112	0.3440	1.0112	1.0056
No log	0.7812	50	0.9680	0.4282	0.9680	0.9839
No log	0.8125	52	0.9695	0.4610	0.9695	0.9847
No log	0.8438	54	1.0506	0.5042	1.0506	1.0250
No log	0.875	56	1.1459	0.3954	1.1459	1.0704
No log	0.9062	58	1.0944	0.3164	1.0944	1.0461
No log	0.9375	60	1.1095	0.4153	1.1095	1.0533
No log	0.9688	62	1.1430	0.4545	1.1430	1.0691
No log	1.0	64	1.0261	0.4428	1.0261	1.0130
No log	1.0312	66	0.9916	0.4510	0.9916	0.9958
No log	1.0625	68	0.9802	0.4385	0.9802	0.9901
No log	1.0938	70	1.0822	0.4898	1.0822	1.0403
No log	1.125	72	1.0150	0.3598	1.0150	1.0075
No log	1.1562	74	1.0638	0.3110	1.0638	1.0314
No log	1.1875	76	1.0375	0.3247	1.0375	1.0186
No log	1.2188	78	0.9920	0.3947	0.9920	0.9960
No log	1.25	80	0.9811	0.5086	0.9811	0.9905
No log	1.2812	82	0.9635	0.5439	0.9635	0.9816
No log	1.3125	84	0.9689	0.5642	0.9689	0.9843
No log	1.3438	86	1.1229	0.4844	1.1229	1.0597
No log	1.375	88	1.3173	0.4361	1.3173	1.1477
No log	1.4062	90	1.3947	0.4356	1.3947	1.1810
No log	1.4375	92	1.4517	0.4397	1.4517	1.2049
No log	1.4688	94	1.2092	0.4689	1.2092	1.0996
No log	1.5	96	0.9807	0.5923	0.9807	0.9903
No log	1.5312	98	0.8011	0.6230	0.8011	0.8950
No log	1.5625	100	0.7966	0.6000	0.7966	0.8925
No log	1.5938	102	0.8804	0.5685	0.8804	0.9383
No log	1.625	104	1.0862	0.4125	1.0862	1.0422
No log	1.6562	106	1.2733	0.3436	1.2733	1.1284
No log	1.6875	108	1.5733	0.3698	1.5733	1.2543
No log	1.7188	110	1.5376	0.4205	1.5376	1.2400
No log	1.75	112	1.3430	0.4420	1.3430	1.1589
No log	1.7812	114	1.1085	0.4461	1.1085	1.0529
No log	1.8125	116	1.0041	0.4724	1.0041	1.0020
No log	1.8438	118	0.9829	0.4390	0.9829	0.9914
No log	1.875	120	1.0058	0.4937	1.0058	1.0029
No log	1.9062	122	1.1636	0.4702	1.1636	1.0787
No log	1.9375	124	1.3754	0.4967	1.3754	1.1728
No log	1.9688	126	1.4470	0.5105	1.4470	1.2029
No log	2.0	128	1.3761	0.5252	1.3761	1.1731
No log	2.0312	130	1.4337	0.5427	1.4337	1.1974
No log	2.0625	132	1.4050	0.5405	1.4050	1.1853
No log	2.0938	134	1.3968	0.5286	1.3968	1.1819
No log	2.125	136	1.2182	0.5251	1.2182	1.1037
No log	2.1562	138	0.9801	0.5543	0.9801	0.9900
No log	2.1875	140	0.9063	0.5555	0.9063	0.9520
No log	2.2188	142	0.8524	0.6260	0.8524	0.9233
No log	2.25	144	0.8971	0.6078	0.8971	0.9471
No log	2.2812	146	0.9281	0.5749	0.9281	0.9634
No log	2.3125	148	1.0512	0.5866	1.0512	1.0253
No log	2.3438	150	1.3236	0.5479	1.3236	1.1505
No log	2.375	152	1.3890	0.5359	1.3890	1.1786
No log	2.4062	154	1.2566	0.5465	1.2566	1.1210
No log	2.4375	156	1.3001	0.5577	1.3001	1.1402
No log	2.4688	158	1.3645	0.5442	1.3645	1.1681
No log	2.5	160	1.3477	0.5398	1.3477	1.1609
No log	2.5312	162	1.2664	0.5224	1.2664	1.1253
No log	2.5625	164	1.3026	0.5322	1.3026	1.1413
No log	2.5938	166	1.3331	0.5078	1.3331	1.1546
No log	2.625	168	1.2128	0.5212	1.2128	1.1013
No log	2.6562	170	0.9539	0.5680	0.9539	0.9767
No log	2.6875	172	0.8536	0.6125	0.8536	0.9239
No log	2.7188	174	0.8681	0.6113	0.8681	0.9317
No log	2.75	176	0.9521	0.5955	0.9521	0.9758
No log	2.7812	178	1.1323	0.5398	1.1323	1.0641
No log	2.8125	180	1.2572	0.5138	1.2572	1.1212
No log	2.8438	182	1.1447	0.5370	1.1447	1.0699
No log	2.875	184	0.9380	0.5484	0.9380	0.9685
No log	2.9062	186	0.7795	0.6424	0.7795	0.8829
No log	2.9375	188	0.7665	0.6289	0.7665	0.8755
No log	2.9688	190	0.7904	0.6526	0.7904	0.8890
No log	3.0	192	0.8715	0.6313	0.8715	0.9335
No log	3.0312	194	1.0309	0.5261	1.0309	1.0153
No log	3.0625	196	1.1032	0.5060	1.1032	1.0503
No log	3.0938	198	1.0177	0.5484	1.0177	1.0088
No log	3.125	200	0.8872	0.5895	0.8872	0.9419
No log	3.1562	202	0.8392	0.6145	0.8392	0.9161
No log	3.1875	204	0.8724	0.5992	0.8724	0.9340
No log	3.2188	206	0.9476	0.6230	0.9476	0.9734
No log	3.25	208	1.0591	0.6027	1.0591	1.0291
No log	3.2812	210	1.1046	0.5908	1.1046	1.0510
No log	3.3125	212	1.0836	0.5741	1.0836	1.0410
No log	3.3438	214	0.9984	0.5948	0.9984	0.9992
No log	3.375	216	0.8762	0.6381	0.8762	0.9361
No log	3.4062	218	0.7706	0.6347	0.7706	0.8778
No log	3.4375	220	0.7384	0.6562	0.7384	0.8593
No log	3.4688	222	0.7723	0.6112	0.7723	0.8788
No log	3.5	224	0.7927	0.6061	0.7927	0.8904
No log	3.5312	226	0.7824	0.6169	0.7824	0.8845
No log	3.5625	228	0.8371	0.6097	0.8371	0.9149
No log	3.5938	230	0.9191	0.5958	0.9191	0.9587
No log	3.625	232	0.9666	0.6128	0.9666	0.9831
No log	3.6562	234	1.0218	0.6156	1.0218	1.0108
No log	3.6875	236	1.2131	0.5745	1.2131	1.1014
No log	3.7188	238	1.4783	0.5586	1.4783	1.2158
No log	3.75	240	1.5133	0.5392	1.5133	1.2301
No log	3.7812	242	1.4301	0.5410	1.4301	1.1959
No log	3.8125	244	1.2314	0.5430	1.2314	1.1097
No log	3.8438	246	1.1733	0.5193	1.1733	1.0832
No log	3.875	248	1.1716	0.5442	1.1716	1.0824
No log	3.9062	250	1.1838	0.5736	1.1838	1.0880
No log	3.9375	252	1.2754	0.5740	1.2754	1.1294
No log	3.9688	254	1.2611	0.5719	1.2611	1.1230
No log	4.0	256	1.1030	0.5858	1.1030	1.0502
No log	4.0312	258	0.9313	0.5967	0.9313	0.9650
No log	4.0625	260	0.8650	0.5998	0.8650	0.9300
No log	4.0938	262	0.8663	0.6101	0.8663	0.9308
No log	4.125	264	0.9791	0.5873	0.9791	0.9895
No log	4.1562	266	1.2619	0.5998	1.2619	1.1233
No log	4.1875	268	1.6130	0.5305	1.6130	1.2700
No log	4.2188	270	1.6912	0.5337	1.6912	1.3005
No log	4.25	272	1.5302	0.5373	1.5302	1.2370
No log	4.2812	274	1.3529	0.5614	1.3529	1.1632
No log	4.3125	276	1.2916	0.5525	1.2916	1.1365
No log	4.3438	278	1.3921	0.5361	1.3921	1.1799
No log	4.375	280	1.4531	0.5150	1.4531	1.2054
No log	4.4062	282	1.4080	0.5014	1.4080	1.1866
No log	4.4375	284	1.2987	0.5110	1.2987	1.1396
No log	4.4688	286	1.0848	0.5322	1.0848	1.0415
No log	4.5	288	0.9431	0.5745	0.9431	0.9712
No log	4.5312	290	0.9242	0.5809	0.9242	0.9613
No log	4.5625	292	1.0299	0.5535	1.0299	1.0148
No log	4.5938	294	1.2823	0.5631	1.2823	1.1324
No log	4.625	296	1.4801	0.5337	1.4801	1.2166
No log	4.6562	298	1.4488	0.5422	1.4488	1.2037
No log	4.6875	300	1.2550	0.5495	1.2550	1.1203
No log	4.7188	302	1.1135	0.5661	1.1135	1.0552
No log	4.75	304	1.0484	0.5765	1.0484	1.0239
No log	4.7812	306	1.0036	0.5797	1.0036	1.0018
No log	4.8125	308	1.0259	0.5807	1.0259	1.0129
No log	4.8438	310	1.0279	0.5877	1.0279	1.0139
No log	4.875	312	1.0108	0.5842	1.0108	1.0054
No log	4.9062	314	1.0007	0.5895	1.0007	1.0004
No log	4.9375	316	0.9273	0.5961	0.9273	0.9630
No log	4.9688	318	0.8676	0.6023	0.8676	0.9314
No log	5.0	320	0.8435	0.6150	0.8435	0.9184
No log	5.0312	322	0.8343	0.6150	0.8343	0.9134
No log	5.0625	324	0.8017	0.6390	0.8017	0.8954
No log	5.0938	326	0.8292	0.6249	0.8292	0.9106
No log	5.125	328	0.9727	0.6006	0.9727	0.9863
No log	5.1562	330	1.0418	0.5919	1.0418	1.0207
No log	5.1875	332	0.9593	0.6210	0.9593	0.9794
No log	5.2188	334	0.9416	0.6210	0.9416	0.9704
No log	5.25	336	0.9724	0.6122	0.9724	0.9861
No log	5.2812	338	0.9857	0.5949	0.9857	0.9928
No log	5.3125	340	1.0134	0.5846	1.0134	1.0067
No log	5.3438	342	1.0560	0.5728	1.0560	1.0276
No log	5.375	344	0.9697	0.5903	0.9697	0.9847
No log	5.4062	346	0.8258	0.6382	0.8258	0.9088
No log	5.4375	348	0.7718	0.6921	0.7718	0.8785
No log	5.4688	350	0.7785	0.6704	0.7785	0.8823
No log	5.5	352	0.8403	0.6366	0.8403	0.9167
No log	5.5312	354	0.9514	0.6089	0.9514	0.9754
No log	5.5625	356	1.0273	0.6060	1.0273	1.0136
No log	5.5938	358	0.9770	0.6072	0.9770	0.9885
No log	5.625	360	0.8324	0.6064	0.8324	0.9124
No log	5.6562	362	0.7601	0.6596	0.7601	0.8719
No log	5.6875	364	0.7685	0.6506	0.7685	0.8767
No log	5.7188	366	0.8444	0.6315	0.8444	0.9189
No log	5.75	368	0.9631	0.6147	0.9631	0.9814
No log	5.7812	370	1.0085	0.5885	1.0085	1.0042
No log	5.8125	372	0.9683	0.5876	0.9683	0.9840
No log	5.8438	374	0.9107	0.5952	0.9107	0.9543
No log	5.875	376	0.8095	0.6573	0.8095	0.8997
No log	5.9062	378	0.7805	0.6607	0.7805	0.8835
No log	5.9375	380	0.8165	0.6396	0.8165	0.9036
No log	5.9688	382	0.8773	0.6277	0.8773	0.9366
No log	6.0	384	0.8726	0.6328	0.8726	0.9341
No log	6.0312	386	0.8902	0.6328	0.8902	0.9435
No log	6.0625	388	0.9817	0.5883	0.9817	0.9908
No log	6.0938	390	1.0674	0.6066	1.0674	1.0332
No log	6.125	392	1.0609	0.6066	1.0609	1.0300
No log	6.1562	394	0.9705	0.5951	0.9705	0.9851
No log	6.1875	396	0.9113	0.6031	0.9113	0.9546
No log	6.2188	398	0.9386	0.5999	0.9386	0.9688
No log	6.25	400	0.9996	0.5954	0.9996	0.9998
No log	6.2812	402	1.0868	0.5956	1.0868	1.0425
No log	6.3125	404	1.0650	0.6066	1.0650	1.0320
No log	6.3438	406	0.9801	0.6027	0.9801	0.9900
No log	6.375	408	0.8970	0.6301	0.8970	0.9471
No log	6.4062	410	0.8643	0.6221	0.8643	0.9297
No log	6.4375	412	0.8745	0.6286	0.8745	0.9351
No log	6.4688	414	0.9041	0.6182	0.9041	0.9509
No log	6.5	416	0.9357	0.6157	0.9357	0.9673
No log	6.5312	418	0.9765	0.5847	0.9765	0.9882
No log	6.5625	420	0.9681	0.5964	0.9681	0.9839
No log	6.5938	422	0.9588	0.5964	0.9588	0.9792
No log	6.625	424	0.9647	0.5984	0.9647	0.9822
No log	6.6562	426	0.9470	0.5929	0.9470	0.9732
No log	6.6875	428	0.9548	0.6069	0.9548	0.9771
No log	6.7188	430	0.9373	0.6268	0.9373	0.9681
No log	6.75	432	0.8828	0.6218	0.8828	0.9396
No log	6.7812	434	0.8891	0.6153	0.8891	0.9429
No log	6.8125	436	0.9299	0.6107	0.9299	0.9643
No log	6.8438	438	0.9519	0.6081	0.9519	0.9757
No log	6.875	440	0.9398	0.6120	0.9398	0.9695
No log	6.9062	442	0.9321	0.6098	0.9321	0.9655
No log	6.9375	444	0.8945	0.6080	0.8945	0.9458
No log	6.9688	446	0.8789	0.5959	0.8789	0.9375
No log	7.0	448	0.8909	0.5917	0.8909	0.9439
No log	7.0312	450	0.9385	0.5935	0.9385	0.9688
No log	7.0625	452	0.9979	0.5836	0.9979	0.9990
No log	7.0938	454	1.0671	0.5761	1.0671	1.0330
No log	7.125	456	1.0526	0.5771	1.0526	1.0259
No log	7.1562	458	0.9881	0.5894	0.9881	0.9940
No log	7.1875	460	0.9253	0.5988	0.9253	0.9619
No log	7.2188	462	0.8714	0.6292	0.8714	0.9335
No log	7.25	464	0.8790	0.6207	0.8790	0.9376
No log	7.2812	466	0.8889	0.6194	0.8889	0.9428
No log	7.3125	468	0.9366	0.6016	0.9366	0.9678
No log	7.3438	470	0.9642	0.6109	0.9642	0.9820
No log	7.375	472	0.9460	0.6057	0.9460	0.9726
No log	7.4062	474	0.9687	0.6091	0.9687	0.9842
No log	7.4375	476	0.9763	0.6018	0.9763	0.9881
No log	7.4688	478	0.9758	0.6018	0.9758	0.9878
No log	7.5	480	0.9971	0.6018	0.9971	0.9985
No log	7.5312	482	0.9993	0.5960	0.9993	0.9996
No log	7.5625	484	0.9724	0.6018	0.9724	0.9861
No log	7.5938	486	0.9612	0.6062	0.9612	0.9804
No log	7.625	488	0.9751	0.6058	0.9751	0.9875
No log	7.6562	490	1.0264	0.5907	1.0264	1.0131
No log	7.6875	492	1.0515	0.5888	1.0515	1.0254
No log	7.7188	494	1.0599	0.5708	1.0599	1.0295
No log	7.75	496	1.0495	0.5771	1.0495	1.0244
No log	7.7812	498	1.0192	0.5738	1.0192	1.0096
0.481	7.8125	500	0.9609	0.5667	0.9609	0.9802
0.481	7.8438	502	0.9227	0.5881	0.9227	0.9606
0.481	7.875	504	0.9061	0.6008	0.9061	0.9519
0.481	7.9062	506	0.8866	0.6388	0.8866	0.9416
0.481	7.9375	508	0.8932	0.6207	0.8932	0.9451
0.481	7.9688	510	0.9073	0.6079	0.9073	0.9525
0.481	8.0	512	0.9358	0.6015	0.9358	0.9674
0.481	8.0312	514	1.0005	0.5768	1.0005	1.0002
0.481	8.0625	516	1.0448	0.5997	1.0448	1.0222
0.481	8.0938	518	1.0318	0.5901	1.0318	1.0158
0.481	8.125	520	0.9750	0.5813	0.9750	0.9874
0.481	8.1562	522	0.9200	0.6068	0.9200	0.9591
0.481	8.1875	524	0.8760	0.6433	0.8760	0.9359
0.481	8.2188	526	0.8567	0.6486	0.8567	0.9256
0.481	8.25	528	0.8770	0.6433	0.8770	0.9365
0.481	8.2812	530	0.9219	0.6068	0.9219	0.9602
0.481	8.3125	532	0.9513	0.6103	0.9513	0.9753
0.481	8.3438	534	0.9542	0.6103	0.9542	0.9769
0.481	8.375	536	0.9674	0.6030	0.9674	0.9835
0.481	8.4062	538	0.9798	0.6006	0.9798	0.9898
0.481	8.4375	540	0.9898	0.5889	0.9898	0.9949
0.481	8.4688	542	0.9835	0.5900	0.9835	0.9917
0.481	8.5	544	0.9816	0.5935	0.9816	0.9908
0.481	8.5312	546	0.9597	0.5894	0.9597	0.9796
0.481	8.5625	548	0.9294	0.6063	0.9294	0.9641
0.481	8.5938	550	0.8943	0.6213	0.8943	0.9457
0.481	8.625	552	0.8876	0.6395	0.8876	0.9421
0.481	8.6562	554	0.9136	0.6008	0.9136	0.9558
0.481	8.6875	556	0.9463	0.5858	0.9463	0.9728
0.481	8.7188	558	0.9741	0.5847	0.9741	0.9870
0.481	8.75	560	1.0039	0.5746	1.0039	1.0020
0.481	8.7812	562	1.0030	0.5746	1.0030	1.0015
0.481	8.8125	564	0.9921	0.5746	0.9921	0.9960
0.481	8.8438	566	0.9758	0.5791	0.9758	0.9878
0.481	8.875	568	0.9585	0.5879	0.9585	0.9790
0.481	8.9062	570	0.9493	0.5820	0.9493	0.9743
0.481	8.9375	572	0.9614	0.6006	0.9614	0.9805
0.481	8.9688	574	0.9788	0.5867	0.9788	0.9893
0.481	9.0	576	0.9825	0.5867	0.9825	0.9912
0.481	9.0312	578	0.9959	0.5867	0.9959	0.9980
0.481	9.0625	580	0.9954	0.5867	0.9954	0.9977
0.481	9.0938	582	0.9934	0.5867	0.9934	0.9967
0.481	9.125	584	0.9932	0.5901	0.9932	0.9966
0.481	9.1562	586	0.9820	0.5867	0.9820	0.9910
0.481	9.1875	588	0.9796	0.5768	0.9796	0.9897
0.481	9.2188	590	0.9843	0.5768	0.9843	0.9921
0.481	9.25	592	0.9922	0.5867	0.9922	0.9961
0.481	9.2812	594	0.9975	0.5867	0.9975	0.9988
0.481	9.3125	596	1.0088	0.5738	1.0088	1.0044
0.481	9.3438	598	1.0311	0.5771	1.0310	1.0154
0.481	9.375	600	1.0416	0.5771	1.0416	1.0206
0.481	9.4062	602	1.0496	0.5868	1.0496	1.0245
0.481	9.4375	604	1.0601	0.5868	1.0601	1.0296
0.481	9.4688	606	1.0620	0.5868	1.0620	1.0305
0.481	9.5	608	1.0642	0.5868	1.0642	1.0316
0.481	9.5312	610	1.0640	0.5868	1.0640	1.0315
0.481	9.5625	612	1.0551	0.5868	1.0551	1.0272
0.481	9.5938	614	1.0359	0.5738	1.0359	1.0178
0.481	9.625	616	1.0206	0.5738	1.0206	1.0102
0.481	9.6562	618	1.0121	0.5738	1.0121	1.0060
0.481	9.6875	620	1.0118	0.5738	1.0118	1.0059
0.481	9.7188	622	1.0141	0.5738	1.0141	1.0070
0.481	9.75	624	1.0163	0.5738	1.0163	1.0081
0.481	9.7812	626	1.0201	0.5738	1.0201	1.0100
0.481	9.8125	628	1.0235	0.5738	1.0235	1.0117
0.481	9.8438	630	1.0302	0.5738	1.0302	1.0150
0.481	9.875	632	1.0354	0.5738	1.0354	1.0176
0.481	9.9062	634	1.0383	0.5738	1.0383	1.0190
0.481	9.9375	636	1.0388	0.5738	1.0388	1.0192
0.481	9.9688	638	1.0387	0.5738	1.0387	1.0192
0.481	10.0	640	1.0389	0.5738	1.0389	1.0193

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1