ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8248
• Qwk: 0.6874
• Mse: 0.8248
• Rmse: 0.9082

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	5.0831	0.0003	5.0831	2.2546
No log	0.0645	4	3.2385	0.0806	3.2385	1.7996
No log	0.0968	6	1.7740	0.0956	1.7740	1.3319
No log	0.1290	8	1.4481	0.0835	1.4481	1.2034
No log	0.1613	10	1.3874	0.1332	1.3874	1.1779
No log	0.1935	12	1.1359	0.1924	1.1359	1.0658
No log	0.2258	14	1.1645	0.2049	1.1645	1.0791
No log	0.2581	16	1.1033	0.2448	1.1033	1.0504
No log	0.2903	18	1.0453	0.3623	1.0453	1.0224
No log	0.3226	20	1.0848	0.3735	1.0848	1.0415
No log	0.3548	22	1.0070	0.4820	1.0070	1.0035
No log	0.3871	24	0.9319	0.4972	0.9319	0.9653
No log	0.4194	26	0.9945	0.5124	0.9945	0.9972
No log	0.4516	28	1.2142	0.4619	1.2142	1.1019
No log	0.4839	30	0.9733	0.5964	0.9733	0.9866
No log	0.5161	32	0.8947	0.5781	0.8947	0.9459
No log	0.5484	34	0.9619	0.5535	0.9619	0.9808
No log	0.5806	36	1.0338	0.5246	1.0338	1.0167
No log	0.6129	38	0.9083	0.5253	0.9083	0.9530
No log	0.6452	40	0.9287	0.4845	0.9287	0.9637
No log	0.6774	42	1.5767	0.3093	1.5767	1.2557
No log	0.7097	44	1.6195	0.2697	1.6195	1.2726
No log	0.7419	46	1.2031	0.2738	1.2031	1.0969
No log	0.7742	48	0.8855	0.4271	0.8855	0.9410
No log	0.8065	50	0.8722	0.5279	0.8722	0.9339
No log	0.8387	52	0.8803	0.4914	0.8803	0.9382
No log	0.8710	54	0.8534	0.4623	0.8534	0.9238
No log	0.9032	56	0.9501	0.3359	0.9501	0.9747
No log	0.9355	58	1.0052	0.3318	1.0052	1.0026
No log	0.9677	60	1.0041	0.3919	1.0041	1.0020
No log	1.0	62	0.9410	0.4468	0.9410	0.9701
No log	1.0323	64	0.8057	0.5175	0.8057	0.8976
No log	1.0645	66	0.7529	0.5756	0.7529	0.8677
No log	1.0968	68	0.7663	0.5775	0.7663	0.8754
No log	1.1290	70	0.7153	0.6490	0.7153	0.8457
No log	1.1613	72	0.7595	0.6298	0.7595	0.8715
No log	1.1935	74	0.7768	0.6395	0.7768	0.8814
No log	1.2258	76	0.7437	0.7014	0.7437	0.8624
No log	1.2581	78	0.7988	0.6496	0.7988	0.8937
No log	1.2903	80	0.7025	0.6527	0.7025	0.8381
No log	1.3226	82	0.6770	0.6570	0.6770	0.8228
No log	1.3548	84	0.6741	0.6424	0.6741	0.8210
No log	1.3871	86	0.6924	0.6377	0.6924	0.8321
No log	1.4194	88	0.6621	0.6310	0.6621	0.8137
No log	1.4516	90	0.7214	0.6559	0.7214	0.8494
No log	1.4839	92	0.7377	0.6103	0.7377	0.8589
No log	1.5161	94	0.6919	0.6369	0.6919	0.8318
No log	1.5484	96	0.7324	0.6763	0.7324	0.8558
No log	1.5806	98	0.7456	0.6315	0.7456	0.8635
No log	1.6129	100	0.6675	0.6809	0.6675	0.8170
No log	1.6452	102	0.6507	0.6871	0.6507	0.8066
No log	1.6774	104	0.6337	0.6938	0.6337	0.7960
No log	1.7097	106	0.7277	0.6362	0.7277	0.8531
No log	1.7419	108	0.8406	0.6407	0.8406	0.9168
No log	1.7742	110	0.8010	0.6600	0.8010	0.8950
No log	1.8065	112	0.8110	0.6841	0.8110	0.9005
No log	1.8387	114	0.7438	0.7082	0.7438	0.8624
No log	1.8710	116	0.7620	0.7267	0.7620	0.8729
No log	1.9032	118	0.8025	0.7002	0.8025	0.8959
No log	1.9355	120	0.8746	0.5966	0.8746	0.9352
No log	1.9677	122	0.6864	0.6945	0.6864	0.8285
No log	2.0	124	0.6415	0.7001	0.6415	0.8009
No log	2.0323	126	0.6257	0.7148	0.6257	0.7910
No log	2.0645	128	0.6258	0.7159	0.6258	0.7911
No log	2.0968	130	0.8092	0.6221	0.8092	0.8996
No log	2.1290	132	1.0057	0.5648	1.0057	1.0029
No log	2.1613	134	0.8999	0.6390	0.8999	0.9486
No log	2.1935	136	0.8117	0.6758	0.8117	0.9009
No log	2.2258	138	0.7325	0.7170	0.7325	0.8559
No log	2.2581	140	0.7768	0.7099	0.7768	0.8814
No log	2.2903	142	1.1378	0.6095	1.1378	1.0667
No log	2.3226	144	1.3258	0.5918	1.3258	1.1514
No log	2.3548	146	1.0630	0.6329	1.0630	1.0310
No log	2.3871	148	0.8636	0.7144	0.8636	0.9293
No log	2.4194	150	0.8960	0.6278	0.8960	0.9466
No log	2.4516	152	1.0453	0.6067	1.0453	1.0224
No log	2.4839	154	1.1430	0.5873	1.1430	1.0691
No log	2.5161	156	0.9498	0.6093	0.9498	0.9746
No log	2.5484	158	0.7388	0.6744	0.7388	0.8595
No log	2.5806	160	0.7175	0.6837	0.7175	0.8471
No log	2.6129	162	0.6416	0.7490	0.6416	0.8010
No log	2.6452	164	0.6497	0.7396	0.6497	0.8060
No log	2.6774	166	0.7129	0.6997	0.7129	0.8443
No log	2.7097	168	0.8467	0.6792	0.8467	0.9202
No log	2.7419	170	1.0608	0.6309	1.0608	1.0300
No log	2.7742	172	1.0172	0.6498	1.0172	1.0086
No log	2.8065	174	0.7739	0.7005	0.7739	0.8797
No log	2.8387	176	0.6448	0.7491	0.6448	0.8030
No log	2.8710	178	0.6634	0.7483	0.6634	0.8145
No log	2.9032	180	0.7705	0.7081	0.7705	0.8778
No log	2.9355	182	1.0008	0.6399	1.0008	1.0004
No log	2.9677	184	1.0558	0.6261	1.0558	1.0275
No log	3.0	186	0.8285	0.6937	0.8285	0.9102
No log	3.0323	188	0.6736	0.7486	0.6736	0.8207
No log	3.0645	190	0.7209	0.7074	0.7209	0.8490
No log	3.0968	192	0.9259	0.6535	0.9259	0.9622
No log	3.1290	194	1.1578	0.5967	1.1578	1.0760
No log	3.1613	196	1.0160	0.6046	1.0160	1.0080
No log	3.1935	198	0.8446	0.6527	0.8446	0.9190
No log	3.2258	200	0.7484	0.6968	0.7484	0.8651
No log	3.2581	202	0.7288	0.6956	0.7288	0.8537
No log	3.2903	204	0.7898	0.7069	0.7898	0.8887
No log	3.3226	206	0.7960	0.7118	0.7960	0.8922
No log	3.3548	208	0.8168	0.7099	0.8168	0.9037
No log	3.3871	210	0.6972	0.7124	0.6972	0.8350
No log	3.4194	212	0.6939	0.7025	0.6939	0.8330
No log	3.4516	214	0.7620	0.7122	0.7620	0.8729
No log	3.4839	216	0.8942	0.6757	0.8942	0.9456
No log	3.5161	218	0.8220	0.7070	0.8220	0.9066
No log	3.5484	220	0.6305	0.6984	0.6305	0.7940
No log	3.5806	222	0.5996	0.7188	0.5996	0.7743
No log	3.6129	224	0.6239	0.7302	0.6239	0.7899
No log	3.6452	226	0.8065	0.6843	0.8065	0.8980
No log	3.6774	228	1.0288	0.6540	1.0288	1.0143
No log	3.7097	230	0.9727	0.6708	0.9727	0.9863
No log	3.7419	232	0.8939	0.7045	0.8939	0.9455
No log	3.7742	234	0.8223	0.7036	0.8223	0.9068
No log	3.8065	236	0.8241	0.7002	0.8241	0.9078
No log	3.8387	238	0.8180	0.6877	0.8180	0.9044
No log	3.8710	240	0.8747	0.6582	0.8747	0.9352
No log	3.9032	242	0.7955	0.6740	0.7955	0.8919
No log	3.9355	244	0.6672	0.7010	0.6672	0.8168
No log	3.9677	246	0.6872	0.6898	0.6872	0.8290
No log	4.0	248	0.8139	0.6748	0.8139	0.9022
No log	4.0323	250	0.7578	0.6779	0.7578	0.8705
No log	4.0645	252	0.6207	0.7074	0.6207	0.7879
No log	4.0968	254	0.5989	0.7552	0.5989	0.7739
No log	4.1290	256	0.6381	0.7319	0.6381	0.7988
No log	4.1613	258	0.6406	0.7304	0.6406	0.8004
No log	4.1935	260	0.6863	0.7324	0.6863	0.8284
No log	4.2258	262	0.8818	0.6770	0.8818	0.9390
No log	4.2581	264	1.0430	0.6525	1.0430	1.0213
No log	4.2903	266	0.9999	0.6490	0.9999	0.9999
No log	4.3226	268	0.8246	0.6748	0.8246	0.9081
No log	4.3548	270	0.7878	0.6707	0.7878	0.8876
No log	4.3871	272	0.7984	0.6595	0.7984	0.8936
No log	4.4194	274	0.9499	0.6420	0.9499	0.9746
No log	4.4516	276	0.9452	0.6375	0.9452	0.9722
No log	4.4839	278	0.7639	0.6600	0.7639	0.8740
No log	4.5161	280	0.6320	0.7256	0.6320	0.7950
No log	4.5484	282	0.6378	0.7376	0.6378	0.7986
No log	4.5806	284	0.7296	0.6673	0.7296	0.8542
No log	4.6129	286	0.7383	0.6978	0.7383	0.8593
No log	4.6452	288	0.7158	0.7005	0.7158	0.8460
No log	4.6774	290	0.6109	0.7484	0.6109	0.7816
No log	4.7097	292	0.6046	0.7679	0.6046	0.7775
No log	4.7419	294	0.6182	0.7553	0.6182	0.7863
No log	4.7742	296	0.6611	0.7183	0.6611	0.8131
No log	4.8065	298	0.7843	0.6669	0.7843	0.8856
No log	4.8387	300	0.9075	0.6330	0.9075	0.9526
No log	4.8710	302	0.8630	0.6482	0.8630	0.9290
No log	4.9032	304	0.7332	0.6621	0.7332	0.8563
No log	4.9355	306	0.6432	0.7047	0.6432	0.8020
No log	4.9677	308	0.6299	0.7201	0.6299	0.7936
No log	5.0	310	0.6503	0.7126	0.6503	0.8064
No log	5.0323	312	0.7042	0.6740	0.7042	0.8392
No log	5.0645	314	0.7681	0.6727	0.7681	0.8764
No log	5.0968	316	0.8925	0.6652	0.8925	0.9447
No log	5.1290	318	0.9390	0.6477	0.9390	0.9690
No log	5.1613	320	0.9527	0.6375	0.9527	0.9761
No log	5.1935	322	0.8153	0.6706	0.8153	0.9029
No log	5.2258	324	0.7083	0.7164	0.7083	0.8416
No log	5.2581	326	0.6245	0.7433	0.6245	0.7903
No log	5.2903	328	0.6384	0.7469	0.6384	0.7990
No log	5.3226	330	0.7460	0.6820	0.7460	0.8637
No log	5.3548	332	0.9398	0.6483	0.9398	0.9695
No log	5.3871	334	0.9863	0.6407	0.9863	0.9931
No log	5.4194	336	0.9277	0.6529	0.9277	0.9632
No log	5.4516	338	0.7816	0.6783	0.7816	0.8841
No log	5.4839	340	0.7751	0.6874	0.7751	0.8804
No log	5.5161	342	0.9018	0.6557	0.9018	0.9496
No log	5.5484	344	0.9827	0.6293	0.9827	0.9913
No log	5.5806	346	1.0206	0.6269	1.0206	1.0103
No log	5.6129	348	0.9635	0.6306	0.9635	0.9816
No log	5.6452	350	0.9216	0.6390	0.9216	0.9600
No log	5.6774	352	0.8971	0.6626	0.8971	0.9471
No log	5.7097	354	0.8366	0.6705	0.8366	0.9147
No log	5.7419	356	0.7863	0.6753	0.7863	0.8867
No log	5.7742	358	0.7372	0.6685	0.7372	0.8586
No log	5.8065	360	0.7431	0.6593	0.7431	0.8621
No log	5.8387	362	0.7732	0.6680	0.7732	0.8793
No log	5.8710	364	0.7397	0.6776	0.7397	0.8601
No log	5.9032	366	0.6705	0.6882	0.6705	0.8188
No log	5.9355	368	0.6030	0.7507	0.6030	0.7765
No log	5.9677	370	0.6220	0.7366	0.6220	0.7887
No log	6.0	372	0.6957	0.7135	0.6957	0.8341
No log	6.0323	374	0.8039	0.6871	0.8039	0.8966
No log	6.0645	376	0.9207	0.6597	0.9207	0.9595
No log	6.0968	378	0.9941	0.6477	0.9941	0.9970
No log	6.1290	380	0.9585	0.6278	0.9585	0.9790
No log	6.1613	382	0.9155	0.6212	0.9155	0.9568
No log	6.1935	384	0.8915	0.6424	0.8915	0.9442
No log	6.2258	386	0.8653	0.6609	0.8653	0.9302
No log	6.2581	388	0.9279	0.6472	0.9279	0.9633
No log	6.2903	390	0.9217	0.6395	0.9217	0.9601
No log	6.3226	392	0.8449	0.6736	0.8449	0.9192
No log	6.3548	394	0.8250	0.6879	0.8250	0.9083
No log	6.3871	396	0.8720	0.6523	0.8720	0.9338
No log	6.4194	398	0.8724	0.6620	0.8724	0.9340
No log	6.4516	400	0.8008	0.6973	0.8008	0.8949
No log	6.4839	402	0.7651	0.7068	0.7651	0.8747
No log	6.5161	404	0.7639	0.7068	0.7639	0.8740
No log	6.5484	406	0.7793	0.7068	0.7793	0.8828
No log	6.5806	408	0.7604	0.7006	0.7604	0.8720
No log	6.6129	410	0.7369	0.7149	0.7369	0.8584
No log	6.6452	412	0.7897	0.7129	0.7897	0.8887
No log	6.6774	414	0.9052	0.6644	0.9052	0.9514
No log	6.7097	416	0.9476	0.6494	0.9476	0.9734
No log	6.7419	418	0.9415	0.6569	0.9415	0.9703
No log	6.7742	420	0.9596	0.6562	0.9596	0.9796
No log	6.8065	422	0.8754	0.6749	0.8754	0.9356
No log	6.8387	424	0.7420	0.7248	0.7420	0.8614
No log	6.8710	426	0.6905	0.7156	0.6905	0.8310
No log	6.9032	428	0.6934	0.7156	0.6934	0.8327
No log	6.9355	430	0.7190	0.6987	0.7190	0.8479
No log	6.9677	432	0.8007	0.6885	0.8007	0.8948
No log	7.0	434	0.8407	0.6720	0.8407	0.9169
No log	7.0323	436	0.8197	0.6760	0.8197	0.9054
No log	7.0645	438	0.8174	0.6720	0.8174	0.9041
No log	7.0968	440	0.7803	0.6909	0.7803	0.8833
No log	7.1290	442	0.7510	0.6939	0.7510	0.8666
No log	7.1613	444	0.6981	0.7042	0.6981	0.8355
No log	7.1935	446	0.6954	0.7029	0.6954	0.8339
No log	7.2258	448	0.7040	0.7029	0.7040	0.8391
No log	7.2581	450	0.7453	0.7015	0.7453	0.8633
No log	7.2903	452	0.8122	0.6876	0.8122	0.9012
No log	7.3226	454	0.8857	0.6741	0.8857	0.9411
No log	7.3548	456	0.9287	0.6696	0.9287	0.9637
No log	7.3871	458	0.9155	0.6780	0.9155	0.9568
No log	7.4194	460	0.8086	0.7031	0.8086	0.8992
No log	7.4516	462	0.7058	0.7288	0.7058	0.8401
No log	7.4839	464	0.6477	0.7408	0.6477	0.8048
No log	7.5161	466	0.6490	0.7368	0.6490	0.8056
No log	7.5484	468	0.6974	0.7288	0.6974	0.8351
No log	7.5806	470	0.7688	0.7031	0.7688	0.8768
No log	7.6129	472	0.8221	0.6969	0.8221	0.9067
No log	7.6452	474	0.8752	0.6818	0.8752	0.9355
No log	7.6774	476	0.8406	0.6882	0.8406	0.9168
No log	7.7097	478	0.7312	0.7078	0.7312	0.8551
No log	7.7419	480	0.6612	0.7214	0.6612	0.8131
No log	7.7742	482	0.6393	0.7328	0.6393	0.7996
No log	7.8065	484	0.6175	0.7529	0.6175	0.7858
No log	7.8387	486	0.6225	0.7470	0.6225	0.7890
No log	7.8710	488	0.6719	0.7268	0.6719	0.8197
No log	7.9032	490	0.7405	0.7017	0.7405	0.8605
No log	7.9355	492	0.8633	0.6706	0.8633	0.9291
No log	7.9677	494	0.9389	0.6576	0.9389	0.9689
No log	8.0	496	0.9561	0.6545	0.9561	0.9778
No log	8.0323	498	0.9047	0.6549	0.9047	0.9512
0.4176	8.0645	500	0.8138	0.6667	0.8138	0.9021
0.4176	8.0968	502	0.7262	0.6789	0.7262	0.8522
0.4176	8.1290	504	0.6435	0.7131	0.6435	0.8022
0.4176	8.1613	506	0.6048	0.7373	0.6048	0.7777
0.4176	8.1935	508	0.6082	0.7373	0.6082	0.7799
0.4176	8.2258	510	0.6418	0.7149	0.6418	0.8011
0.4176	8.2581	512	0.7065	0.7037	0.7065	0.8405
0.4176	8.2903	514	0.8043	0.6920	0.8043	0.8968
0.4176	8.3226	516	0.9133	0.6493	0.9133	0.9557
0.4176	8.3548	518	0.9698	0.6432	0.9698	0.9848
0.4176	8.3871	520	0.9546	0.6544	0.9546	0.9770
0.4176	8.4194	522	0.8941	0.6533	0.8941	0.9456
0.4176	8.4516	524	0.8253	0.6787	0.8253	0.9084
0.4176	8.4839	526	0.7930	0.6787	0.7930	0.8905
0.4176	8.5161	528	0.7961	0.6787	0.7961	0.8922
0.4176	8.5484	530	0.7860	0.6787	0.7860	0.8866
0.4176	8.5806	532	0.7899	0.6787	0.7899	0.8888
0.4176	8.6129	534	0.8022	0.6787	0.8022	0.8957
0.4176	8.6452	536	0.8099	0.6817	0.8099	0.9000
0.4176	8.6774	538	0.8127	0.6880	0.8127	0.9015
0.4176	8.7097	540	0.8335	0.6874	0.8335	0.9130
0.4176	8.7419	542	0.8638	0.6760	0.8638	0.9294
0.4176	8.7742	544	0.9037	0.6620	0.9037	0.9506
0.4176	8.8065	546	0.9161	0.6682	0.9161	0.9571
0.4176	8.8387	548	0.8983	0.6682	0.8983	0.9478
0.4176	8.8710	550	0.8913	0.6682	0.8913	0.9441
0.4176	8.9032	552	0.8543	0.6853	0.8543	0.9243
0.4176	8.9355	554	0.8326	0.6942	0.8326	0.9125
0.4176	8.9677	556	0.8076	0.6926	0.8076	0.8987
0.4176	9.0	558	0.8150	0.6926	0.8150	0.9028
0.4176	9.0323	560	0.8187	0.6960	0.8187	0.9048
0.4176	9.0645	562	0.8325	0.6936	0.8325	0.9124
0.4176	9.0968	564	0.8659	0.6750	0.8659	0.9305
0.4176	9.1290	566	0.9174	0.6597	0.9174	0.9578
0.4176	9.1613	568	0.9363	0.6543	0.9363	0.9676
0.4176	9.1935	570	0.9297	0.6551	0.9297	0.9642
0.4176	9.2258	572	0.9260	0.6551	0.9260	0.9623
0.4176	9.2581	574	0.9089	0.6551	0.9089	0.9534
0.4176	9.2903	576	0.8852	0.6643	0.8852	0.9408
0.4176	9.3226	578	0.8752	0.6643	0.8752	0.9355
0.4176	9.3548	580	0.8596	0.6748	0.8596	0.9271
0.4176	9.3871	582	0.8378	0.6855	0.8378	0.9153
0.4176	9.4194	584	0.8092	0.6827	0.8092	0.8995
0.4176	9.4516	586	0.7902	0.6817	0.7902	0.8889
0.4176	9.4839	588	0.7812	0.6834	0.7812	0.8839
0.4176	9.5161	590	0.7699	0.6943	0.7699	0.8774
0.4176	9.5484	592	0.7579	0.7013	0.7579	0.8706
0.4176	9.5806	594	0.7544	0.7013	0.7544	0.8686
0.4176	9.6129	596	0.7616	0.7013	0.7616	0.8727
0.4176	9.6452	598	0.7684	0.7013	0.7684	0.8766
0.4176	9.6774	600	0.7786	0.6926	0.7786	0.8824
0.4176	9.7097	602	0.7903	0.6834	0.7903	0.8890
0.4176	9.7419	604	0.8002	0.6817	0.8002	0.8946
0.4176	9.7742	606	0.8081	0.6817	0.8081	0.8989
0.4176	9.8065	608	0.8124	0.6874	0.8124	0.9013
0.4176	9.8387	610	0.8169	0.6874	0.8169	0.9038
0.4176	9.8710	612	0.8209	0.6874	0.8209	0.9060
0.4176	9.9032	614	0.8243	0.6874	0.8243	0.9079
0.4176	9.9355	616	0.8248	0.6874	0.8248	0.9082
0.4176	9.9677	618	0.8249	0.6874	0.8249	0.9082
0.4176	10.0	620	0.8248	0.6874	0.8248	0.9082

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1