bert-base-uncased_1_1039_token

This model is a fine-tuned version of bert-base-uncased on the bionlp2004 dataset. It achieves the following results on the evaluation set:

• Loss: 0.6205
• Precision: 0.7
• Recall: 0.7475
• F1: 0.7230
• Accuracy: 0.9303

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.001
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 500

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
No log	1.0	65	0.3927	0.3401	0.4506	0.3876	0.8601
No log	2.0	130	0.2833	0.4891	0.6490	0.5579	0.9018
No log	3.0	195	0.2549	0.5977	0.6272	0.6121	0.9126
No log	4.0	260	0.2300	0.6220	0.7102	0.6632	0.9233
No log	5.0	325	0.2401	0.6395	0.6969	0.6670	0.9235
No log	6.0	390	0.2388	0.6406	0.7238	0.6796	0.9227
No log	7.0	455	0.2339	0.6540	0.7279	0.6890	0.9258
0.2734	8.0	520	0.2379	0.6473	0.7111	0.6777	0.9258
0.2734	9.0	585	0.2369	0.6561	0.7432	0.6970	0.9269
0.2734	10.0	650	0.2784	0.6316	0.6418	0.6367	0.9154
0.2734	11.0	715	0.2570	0.6466	0.7218	0.6821	0.9266
0.2734	12.0	780	0.2548	0.6493	0.7310	0.6877	0.9246
0.2734	13.0	845	0.2647	0.6516	0.7198	0.6840	0.9259
0.2734	14.0	910	0.2706	0.6663	0.7054	0.6853	0.9266
0.2734	15.0	975	0.2903	0.6342	0.6843	0.6583	0.9190
0.128	16.0	1040	0.2878	0.6459	0.7138	0.6782	0.9229
0.128	17.0	1105	0.2718	0.6473	0.7220	0.6826	0.9257
0.128	18.0	1170	0.2902	0.6271	0.7048	0.6637	0.9208
0.128	19.0	1235	0.2775	0.6779	0.7216	0.6991	0.9279
0.128	20.0	1300	0.2801	0.6633	0.7333	0.6965	0.9265
0.128	21.0	1365	0.2835	0.6702	0.7347	0.7010	0.9278
0.128	22.0	1430	0.2910	0.6563	0.6773	0.6666	0.9213
0.128	23.0	1495	0.2841	0.6538	0.7180	0.6844	0.9273
0.0965	24.0	1560	0.3006	0.6630	0.6976	0.6799	0.9256
0.0965	25.0	1625	0.2973	0.6465	0.7329	0.6870	0.9255
0.0965	26.0	1690	0.2839	0.6835	0.7338	0.7078	0.9298
0.0965	27.0	1755	0.2988	0.6624	0.7493	0.7032	0.9284
0.0965	28.0	1820	0.3196	0.6696	0.7162	0.6921	0.9256
0.0965	29.0	1885	0.2946	0.6578	0.7203	0.6876	0.9255
0.0965	30.0	1950	0.2933	0.6474	0.7328	0.6874	0.9279
0.0779	31.0	2015	0.3187	0.6578	0.7497	0.7007	0.9275
0.0779	32.0	2080	0.3121	0.6655	0.7520	0.7061	0.9290
0.0779	33.0	2145	0.2993	0.6669	0.7059	0.6859	0.9265
0.0779	34.0	2210	0.3034	0.6591	0.7589	0.7054	0.9291
0.0779	35.0	2275	0.3123	0.6675	0.7319	0.6982	0.9270
0.0779	36.0	2340	0.3605	0.6380	0.7027	0.6688	0.9220
0.0779	37.0	2405	0.3234	0.6656	0.6816	0.6735	0.9229
0.0779	38.0	2470	0.3268	0.6689	0.7014	0.6848	0.9258
0.0679	39.0	2535	0.3391	0.6673	0.7221	0.6937	0.9255
0.0679	40.0	2600	0.3315	0.6561	0.6888	0.6721	0.9240
0.0679	41.0	2665	0.3326	0.6669	0.7356	0.6996	0.9245
0.0679	42.0	2730	0.3290	0.6659	0.7257	0.6945	0.9263
0.0679	43.0	2795	0.3197	0.6640	0.7571	0.7075	0.9289
0.0679	44.0	2860	0.3454	0.6561	0.7265	0.6895	0.9246
0.0679	45.0	2925	0.3498	0.6650	0.7441	0.7023	0.9262
0.0679	46.0	2990	0.3322	0.6744	0.7286	0.7005	0.9295
0.0599	47.0	3055	0.3323	0.6793	0.7274	0.7025	0.9289
0.0599	48.0	3120	0.3281	0.6768	0.7176	0.6966	0.9281
0.0599	49.0	3185	0.3469	0.6731	0.7443	0.7069	0.9285
0.0599	50.0	3250	0.3714	0.6612	0.6948	0.6776	0.9230
0.0599	51.0	3315	0.3626	0.6601	0.7162	0.6870	0.9249
0.0599	52.0	3380	0.3335	0.6722	0.7382	0.7036	0.9273
0.0599	53.0	3445	0.3431	0.6663	0.7383	0.7005	0.9260
0.0537	54.0	3510	0.3891	0.6606	0.6904	0.6752	0.9227
0.0537	55.0	3575	0.3480	0.6575	0.7227	0.6886	0.9252
0.0537	56.0	3640	0.3373	0.6748	0.7401	0.7059	0.9283
0.0537	57.0	3705	0.3570	0.6658	0.7333	0.6979	0.9286
0.0537	58.0	3770	0.3629	0.6710	0.6982	0.6843	0.9248
0.0537	59.0	3835	0.3193	0.6785	0.7257	0.7013	0.9290
0.0537	60.0	3900	0.3545	0.6825	0.7126	0.6972	0.9266
0.0537	61.0	3965	0.3628	0.6823	0.7063	0.6941	0.9268
0.0489	62.0	4030	0.3482	0.6797	0.7364	0.7069	0.9283
0.0489	63.0	4095	0.3773	0.6763	0.7223	0.6985	0.9268
0.0489	64.0	4160	0.3413	0.6806	0.7337	0.7061	0.9286
0.0489	65.0	4225	0.3733	0.6657	0.7338	0.6981	0.9263
0.0489	66.0	4290	0.3804	0.6691	0.7052	0.6867	0.9245
0.0489	67.0	4355	0.3629	0.6614	0.7491	0.7025	0.9296
0.0489	68.0	4420	0.3675	0.6816	0.7270	0.7036	0.9281
0.0489	69.0	4485	0.3909	0.6604	0.7189	0.6884	0.9241
0.0464	70.0	4550	0.3570	0.6616	0.7558	0.7056	0.9277
0.0464	71.0	4615	0.3651	0.6861	0.7382	0.7112	0.9298
0.0464	72.0	4680	0.3539	0.6849	0.7340	0.7086	0.9290
0.0464	73.0	4745	0.3703	0.6729	0.7400	0.7049	0.9298
0.0464	74.0	4810	0.4186	0.6744	0.7032	0.6885	0.9233
0.0464	75.0	4875	0.3803	0.6718	0.7248	0.6973	0.9279
0.0464	76.0	4940	0.3774	0.6648	0.7191	0.6909	0.9269
0.0409	77.0	5005	0.3961	0.6685	0.7322	0.6989	0.9261
0.0409	78.0	5070	0.3988	0.6703	0.7187	0.6937	0.9255
0.0409	79.0	5135	0.3861	0.6759	0.7079	0.6915	0.9266
0.0409	80.0	5200	0.4134	0.6644	0.7266	0.6941	0.9252
0.0409	81.0	5265	0.4082	0.6861	0.7007	0.6933	0.9250
0.0409	82.0	5330	0.3831	0.6669	0.7524	0.7071	0.9280
0.0409	83.0	5395	0.3774	0.6657	0.7156	0.6898	0.9262
0.0409	84.0	5460	0.4081	0.6853	0.7281	0.7060	0.9274
0.0406	85.0	5525	0.3629	0.6813	0.7232	0.7016	0.9282
0.0406	86.0	5590	0.3941	0.6754	0.7263	0.6999	0.9269
0.0406	87.0	5655	0.3798	0.6781	0.7232	0.7000	0.9273
0.0406	88.0	5720	0.3851	0.6630	0.7308	0.6952	0.9254
0.0406	89.0	5785	0.3829	0.6894	0.7207	0.7047	0.9276
0.0406	90.0	5850	0.4086	0.6545	0.7238	0.6874	0.9235
0.0406	91.0	5915	0.4207	0.6783	0.7023	0.6901	0.9233
0.0406	92.0	5980	0.4054	0.6675	0.7083	0.6873	0.9266
0.0372	93.0	6045	0.3989	0.6767	0.7459	0.7096	0.9280
0.0372	94.0	6110	0.3886	0.6607	0.7230	0.6905	0.9271
0.0372	95.0	6175	0.4126	0.6741	0.7252	0.6987	0.9265
0.0372	96.0	6240	0.4156	0.6734	0.7117	0.6920	0.9259
0.0372	97.0	6305	0.3985	0.6857	0.7346	0.7093	0.9286
0.0372	98.0	6370	0.4015	0.6799	0.7302	0.7042	0.9279
0.0372	99.0	6435	0.3962	0.6705	0.7675	0.7158	0.9296
0.0349	100.0	6500	0.4076	0.6803	0.7131	0.6963	0.9274
0.0349	101.0	6565	0.3971	0.6850	0.7196	0.7019	0.9278
0.0349	102.0	6630	0.4211	0.6676	0.7167	0.6913	0.9258
0.0349	103.0	6695	0.4008	0.6878	0.7407	0.7133	0.9299
0.0349	104.0	6760	0.4012	0.6744	0.7311	0.7016	0.9270
0.0349	105.0	6825	0.4150	0.6670	0.7329	0.6984	0.9242
0.0349	106.0	6890	0.3945	0.6757	0.7182	0.6963	0.9282
0.0349	107.0	6955	0.4071	0.6709	0.7304	0.6994	0.9268
0.0329	108.0	7020	0.3946	0.6882	0.7295	0.7083	0.9300
0.0329	109.0	7085	0.3931	0.6892	0.7301	0.7091	0.9310
0.0329	110.0	7150	0.4120	0.6855	0.7416	0.7125	0.9302
0.0329	111.0	7215	0.4207	0.6951	0.7218	0.7082	0.9301
0.0329	112.0	7280	0.4134	0.6773	0.7119	0.6942	0.9271
0.0329	113.0	7345	0.4319	0.6782	0.7248	0.7007	0.9277
0.0329	114.0	7410	0.4050	0.6786	0.7247	0.7009	0.9282
0.0329	115.0	7475	0.4142	0.6853	0.7272	0.7056	0.9284
0.0298	116.0	7540	0.4282	0.6954	0.7362	0.7152	0.9290
0.0298	117.0	7605	0.4134	0.6888	0.7263	0.7070	0.9297
0.0298	118.0	7670	0.4067	0.6748	0.7272	0.7000	0.9279
0.0298	119.0	7735	0.4115	0.6790	0.7149	0.6965	0.9270
0.0298	120.0	7800	0.4368	0.6780	0.7463	0.7105	0.9283
0.0298	121.0	7865	0.4423	0.6771	0.7225	0.6991	0.9264
0.0298	122.0	7930	0.4741	0.6790	0.7036	0.6911	0.9234
0.0298	123.0	7995	0.4484	0.6735	0.7484	0.7090	0.9272
0.0284	124.0	8060	0.4489	0.6687	0.7302	0.6981	0.9257
0.0284	125.0	8125	0.4399	0.6666	0.7448	0.7035	0.9274
0.0284	126.0	8190	0.4363	0.6747	0.7463	0.7087	0.9281
0.0284	127.0	8255	0.4146	0.6777	0.7403	0.7076	0.9293
0.0284	128.0	8320	0.4217	0.6591	0.7275	0.6916	0.9264
0.0284	129.0	8385	0.4441	0.6785	0.7457	0.7105	0.9292
0.0284	130.0	8450	0.4185	0.6706	0.7522	0.7090	0.9297
0.0284	131.0	8515	0.4381	0.6960	0.7214	0.7085	0.9286
0.0284	132.0	8580	0.4390	0.6689	0.7153	0.6913	0.9262
0.0284	133.0	8645	0.4442	0.6755	0.7364	0.7046	0.9289
0.0284	134.0	8710	0.4730	0.6728	0.7012	0.6867	0.9244
0.0284	135.0	8775	0.4571	0.6653	0.7230	0.6930	0.9250
0.0284	136.0	8840	0.4356	0.6648	0.7164	0.6896	0.9262
0.0284	137.0	8905	0.4513	0.6735	0.7277	0.6996	0.9278
0.0284	138.0	8970	0.4513	0.6873	0.7184	0.7025	0.9271
0.0256	139.0	9035	0.4225	0.6838	0.7495	0.7151	0.9301
0.0256	140.0	9100	0.4391	0.6690	0.7556	0.7097	0.9285
0.0256	141.0	9165	0.4451	0.6695	0.7502	0.7075	0.9286
0.0256	142.0	9230	0.4582	0.6684	0.7522	0.7078	0.9276
0.0256	143.0	9295	0.4551	0.6827	0.7140	0.6980	0.9264
0.0256	144.0	9360	0.4307	0.6752	0.7245	0.6990	0.9262
0.0256	145.0	9425	0.4293	0.6899	0.7448	0.7163	0.9312
0.0256	146.0	9490	0.4490	0.6793	0.7248	0.7013	0.9267
0.0248	147.0	9555	0.4450	0.6692	0.7344	0.7003	0.9282
0.0248	148.0	9620	0.4257	0.6739	0.7200	0.6962	0.9284
0.0248	149.0	9685	0.4630	0.6776	0.7338	0.7046	0.9274
0.0248	150.0	9750	0.4438	0.6881	0.7286	0.7078	0.9290
0.0248	151.0	9815	0.4519	0.6773	0.7394	0.7070	0.9291
0.0248	152.0	9880	0.4522	0.6562	0.7320	0.6920	0.9256
0.0248	153.0	9945	0.4469	0.6795	0.7509	0.7134	0.9286
0.0243	154.0	10010	0.4517	0.6788	0.7396	0.7079	0.9284
0.0243	155.0	10075	0.4536	0.6795	0.7165	0.6975	0.9265
0.0243	156.0	10140	0.4552	0.6751	0.7383	0.7053	0.9278
0.0243	157.0	10205	0.4697	0.6681	0.7610	0.7116	0.9271
0.0243	158.0	10270	0.4578	0.6825	0.7410	0.7106	0.9276
0.0243	159.0	10335	0.4497	0.6742	0.7270	0.6996	0.9268
0.0243	160.0	10400	0.4690	0.6829	0.7234	0.7026	0.9270
0.0243	161.0	10465	0.4587	0.6745	0.7441	0.7076	0.9270
0.022	162.0	10530	0.4655	0.6620	0.7484	0.7026	0.9265
0.022	163.0	10595	0.5050	0.6750	0.7095	0.6918	0.9250
0.022	164.0	10660	0.4491	0.6755	0.7405	0.7065	0.9263
0.022	165.0	10725	0.4521	0.6728	0.7198	0.6955	0.9277
0.022	166.0	10790	0.4886	0.6728	0.7349	0.7025	0.9268
0.022	167.0	10855	0.4717	0.6740	0.7119	0.6924	0.9257
0.022	168.0	10920	0.4572	0.6856	0.7038	0.6946	0.9261
0.022	169.0	10985	0.4419	0.6806	0.7382	0.7082	0.9284
0.0218	170.0	11050	0.4639	0.6762	0.7382	0.7058	0.9288
0.0218	171.0	11115	0.4820	0.6801	0.7367	0.7073	0.9280
0.0218	172.0	11180	0.4422	0.6946	0.7331	0.7133	0.9291
0.0218	173.0	11245	0.4668	0.6824	0.7371	0.7087	0.9282
0.0218	174.0	11310	0.4780	0.6772	0.6978	0.6874	0.9240
0.0218	175.0	11375	0.4586	0.6705	0.7113	0.6903	0.9265
0.0218	176.0	11440	0.5096	0.6835	0.7243	0.7033	0.9255
0.0198	177.0	11505	0.4756	0.6884	0.7524	0.7190	0.9291
0.0198	178.0	11570	0.4505	0.6896	0.7446	0.7161	0.9300
0.0198	179.0	11635	0.4776	0.6774	0.7111	0.6938	0.9248
0.0198	180.0	11700	0.4555	0.6982	0.7106	0.7043	0.9285
0.0198	181.0	11765	0.4290	0.6964	0.7324	0.7139	0.9302
0.0198	182.0	11830	0.4506	0.6790	0.7216	0.6997	0.9268
0.0198	183.0	11895	0.4399	0.6807	0.7497	0.7135	0.9303
0.0198	184.0	11960	0.4716	0.6830	0.7403	0.7105	0.9280
0.0206	185.0	12025	0.4669	0.6788	0.7261	0.7016	0.9288
0.0206	186.0	12090	0.4867	0.6700	0.6948	0.6822	0.9229
0.0206	187.0	12155	0.4490	0.6759	0.7147	0.6948	0.9259
0.0206	188.0	12220	0.4562	0.68	0.7531	0.7147	0.9290
0.0206	189.0	12285	0.4698	0.6796	0.7328	0.7052	0.9273
0.0206	190.0	12350	0.4764	0.6640	0.7158	0.6890	0.9261
0.0206	191.0	12415	0.4750	0.6742	0.7378	0.7046	0.9275
0.0206	192.0	12480	0.4918	0.6750	0.7193	0.6964	0.9253
0.0196	193.0	12545	0.5007	0.6843	0.7162	0.6999	0.9250
0.0196	194.0	12610	0.4839	0.6798	0.7349	0.7063	0.9278
0.0196	195.0	12675	0.4821	0.6841	0.7430	0.7124	0.9281
0.0196	196.0	12740	0.5027	0.6787	0.7165	0.6971	0.9252
0.0196	197.0	12805	0.4711	0.6787	0.7270	0.7020	0.9278
0.0196	198.0	12870	0.4854	0.6876	0.7128	0.7000	0.9273
0.0196	199.0	12935	0.4917	0.6732	0.7452	0.7074	0.9273
0.018	200.0	13000	0.4710	0.6867	0.7421	0.7133	0.9295
0.018	201.0	13065	0.4948	0.6746	0.7423	0.7069	0.9277
0.018	202.0	13130	0.4908	0.6782	0.6964	0.6872	0.9238
0.018	203.0	13195	0.4488	0.6775	0.7263	0.7010	0.9276
0.018	204.0	13260	0.4625	0.6751	0.7274	0.7002	0.9277
0.018	205.0	13325	0.4836	0.6712	0.7495	0.7082	0.9270
0.018	206.0	13390	0.4964	0.6803	0.7380	0.7080	0.9290
0.018	207.0	13455	0.4720	0.6948	0.7299	0.7119	0.9283
0.0183	208.0	13520	0.4737	0.6837	0.7257	0.7041	0.9282
0.0183	209.0	13585	0.4855	0.6874	0.7358	0.7108	0.9294
0.0183	210.0	13650	0.4864	0.6768	0.7365	0.7054	0.9275
0.0183	211.0	13715	0.4721	0.6767	0.7335	0.7039	0.9294
0.0183	212.0	13780	0.4595	0.6909	0.7387	0.7140	0.9296
0.0183	213.0	13845	0.4607	0.6815	0.7180	0.6993	0.9265
0.0183	214.0	13910	0.4750	0.6794	0.7565	0.7159	0.9298
0.0183	215.0	13975	0.5054	0.6912	0.7265	0.7084	0.9273
0.0154	216.0	14040	0.4812	0.6851	0.7508	0.7164	0.9297
0.0154	217.0	14105	0.5386	0.6914	0.7205	0.7056	0.9257
0.0154	218.0	14170	0.4925	0.6913	0.7297	0.7100	0.9283
0.0154	219.0	14235	0.4705	0.6971	0.7475	0.7214	0.9316
0.0154	220.0	14300	0.5013	0.6898	0.7306	0.7096	0.9277
0.0154	221.0	14365	0.4997	0.6863	0.7184	0.7020	0.9276
0.0154	222.0	14430	0.5020	0.6847	0.7410	0.7118	0.9284
0.0154	223.0	14495	0.5022	0.6922	0.7461	0.7181	0.9279
0.0146	224.0	14560	0.4728	0.7012	0.7279	0.7143	0.9294
0.0146	225.0	14625	0.4814	0.6676	0.7223	0.6939	0.9272
0.0146	226.0	14690	0.4605	0.6784	0.7648	0.7190	0.9304
0.0146	227.0	14755	0.4963	0.6694	0.7257	0.6964	0.9247
0.0146	228.0	14820	0.5023	0.6788	0.7394	0.7078	0.9263
0.0146	229.0	14885	0.4602	0.6762	0.7202	0.6975	0.9277
0.0146	230.0	14950	0.4863	0.6750	0.7428	0.7073	0.9285
0.0156	231.0	15015	0.4943	0.6758	0.7306	0.7021	0.9269
0.0156	232.0	15080	0.5088	0.6744	0.7211	0.6970	0.9260
0.0156	233.0	15145	0.4918	0.7025	0.7358	0.7188	0.9302
0.0156	234.0	15210	0.4906	0.6893	0.7504	0.7186	0.9296
0.0156	235.0	15275	0.5002	0.6967	0.7358	0.7157	0.9289
0.0156	236.0	15340	0.4947	0.6784	0.7439	0.7097	0.9286
0.0156	237.0	15405	0.5179	0.6792	0.7416	0.7090	0.9280
0.0156	238.0	15470	0.5050	0.6717	0.7475	0.7076	0.9278
0.013	239.0	15535	0.5563	0.6860	0.7110	0.6983	0.9247
0.013	240.0	15600	0.5120	0.6909	0.7259	0.7080	0.9276
0.013	241.0	15665	0.5292	0.6878	0.7437	0.7147	0.9292
0.013	242.0	15730	0.5243	0.6824	0.7445	0.7121	0.9275
0.013	243.0	15795	0.5224	0.6901	0.7499	0.7187	0.9292
0.013	244.0	15860	0.5238	0.6830	0.7396	0.7102	0.9276
0.013	245.0	15925	0.5254	0.6785	0.7360	0.7061	0.9269
0.013	246.0	15990	0.4890	0.6987	0.7412	0.7193	0.9294
0.0136	247.0	16055	0.5060	0.6978	0.7122	0.7049	0.9276
0.0136	248.0	16120	0.5220	0.6994	0.7470	0.7224	0.9289
0.0136	249.0	16185	0.5061	0.6888	0.7479	0.7171	0.9286
0.0136	250.0	16250	0.5155	0.6921	0.7405	0.7155	0.9294
0.0136	251.0	16315	0.5270	0.6743	0.7572	0.7134	0.9277
0.0136	252.0	16380	0.5273	0.6910	0.7450	0.7170	0.9293
0.0136	253.0	16445	0.5248	0.6862	0.7427	0.7133	0.9277
0.0121	254.0	16510	0.5114	0.6931	0.7301	0.7111	0.9287
0.0121	255.0	16575	0.5175	0.6921	0.7340	0.7125	0.9291
0.0121	256.0	16640	0.5471	0.7008	0.7232	0.7118	0.9274
0.0121	257.0	16705	0.5304	0.6887	0.7232	0.7056	0.9277
0.0121	258.0	16770	0.5564	0.6784	0.7333	0.7048	0.9263
0.0121	259.0	16835	0.5257	0.6849	0.7394	0.7111	0.9296
0.0121	260.0	16900	0.5294	0.6801	0.7585	0.7172	0.9283
0.0121	261.0	16965	0.5513	0.6842	0.7391	0.7106	0.9281
0.0113	262.0	17030	0.5238	0.6833	0.7529	0.7164	0.9294
0.0113	263.0	17095	0.5356	0.6854	0.7320	0.7079	0.9280
0.0113	264.0	17160	0.5556	0.6939	0.7299	0.7114	0.9278
0.0113	265.0	17225	0.5405	0.6810	0.7401	0.7094	0.9265
0.0113	266.0	17290	0.5334	0.6898	0.7185	0.7039	0.9261
0.0113	267.0	17355	0.5277	0.6806	0.7383	0.7083	0.9278
0.0113	268.0	17420	0.5446	0.6909	0.7286	0.7093	0.9273
0.0113	269.0	17485	0.5395	0.6980	0.7396	0.7182	0.9297
0.0101	270.0	17550	0.5257	0.6836	0.7466	0.7137	0.9293
0.0101	271.0	17615	0.5158	0.6744	0.7302	0.7012	0.9277
0.0101	272.0	17680	0.5170	0.7018	0.7500	0.7251	0.9315
0.0101	273.0	17745	0.5186	0.6847	0.7328	0.7079	0.9281
0.0101	274.0	17810	0.5153	0.6923	0.7628	0.7258	0.9304
0.0101	275.0	17875	0.5474	0.6784	0.7477	0.7114	0.9277
0.0101	276.0	17940	0.5333	0.6748	0.7452	0.7083	0.9265
0.0107	277.0	18005	0.5123	0.6867	0.7275	0.7065	0.9271
0.0107	278.0	18070	0.5218	0.7063	0.7319	0.7188	0.9294
0.0107	279.0	18135	0.5242	0.6890	0.7283	0.7081	0.9281
0.0107	280.0	18200	0.5438	0.6873	0.7333	0.7095	0.9287
0.0107	281.0	18265	0.5300	0.6885	0.7522	0.7189	0.9296
0.0107	282.0	18330	0.5354	0.6817	0.7477	0.7132	0.9291
0.0107	283.0	18395	0.5525	0.6835	0.7511	0.7157	0.9284
0.0107	284.0	18460	0.5213	0.6826	0.7679	0.7227	0.9290
0.0099	285.0	18525	0.5429	0.6806	0.7472	0.7123	0.9281
0.0099	286.0	18590	0.5352	0.6908	0.7518	0.7200	0.9293
0.0099	287.0	18655	0.5507	0.6845	0.7319	0.7074	0.9276
0.0099	288.0	18720	0.5444	0.6812	0.7446	0.7115	0.9280
0.0099	289.0	18785	0.5092	0.6827	0.7261	0.7037	0.9276
0.0099	290.0	18850	0.5390	0.6921	0.7328	0.7119	0.9290
0.0099	291.0	18915	0.5177	0.6955	0.7344	0.7144	0.9286
0.0099	292.0	18980	0.5375	0.6918	0.7394	0.7148	0.9284
0.01	293.0	19045	0.5174	0.6956	0.7553	0.7242	0.9312
0.01	294.0	19110	0.5425	0.7027	0.7272	0.7148	0.9290
0.01	295.0	19175	0.5255	0.6828	0.7607	0.7197	0.9304
0.01	296.0	19240	0.5411	0.6927	0.7286	0.7102	0.9284
0.01	297.0	19305	0.5266	0.6907	0.7362	0.7127	0.9286
0.01	298.0	19370	0.5204	0.6956	0.7400	0.7171	0.9297
0.01	299.0	19435	0.5414	0.6914	0.7545	0.7216	0.9307
0.0085	300.0	19500	0.5517	0.6883	0.7461	0.7160	0.9295
0.0085	301.0	19565	0.5597	0.6948	0.7310	0.7124	0.9274
0.0085	302.0	19630	0.5584	0.6900	0.7223	0.7058	0.9278
0.0085	303.0	19695	0.5310	0.6935	0.7427	0.7172	0.9298
0.0085	304.0	19760	0.5623	0.6941	0.7407	0.7166	0.9294
0.0085	305.0	19825	0.5523	0.6890	0.7486	0.7176	0.9290
0.0085	306.0	19890	0.5616	0.7042	0.7374	0.7204	0.9291
0.0085	307.0	19955	0.5638	0.7027	0.7506	0.7259	0.9300
0.0081	308.0	20020	0.5433	0.6920	0.7502	0.7200	0.9295
0.0081	309.0	20085	0.5385	0.6964	0.7376	0.7164	0.9291
0.0081	310.0	20150	0.5531	0.6838	0.7275	0.7050	0.9278
0.0081	311.0	20215	0.5488	0.6940	0.7459	0.7190	0.9297
0.0081	312.0	20280	0.5397	0.6902	0.7482	0.7181	0.9293
0.0081	313.0	20345	0.5539	0.7023	0.7238	0.7128	0.9278
0.0081	314.0	20410	0.5457	0.6848	0.7349	0.7090	0.9272
0.0081	315.0	20475	0.5329	0.6914	0.7522	0.7205	0.9304
0.0088	316.0	20540	0.5646	0.6977	0.7412	0.7188	0.9290
0.0088	317.0	20605	0.5545	0.6943	0.7571	0.7243	0.9312
0.0088	318.0	20670	0.5579	0.6930	0.7536	0.7220	0.9292
0.0088	319.0	20735	0.5450	0.6844	0.7412	0.7117	0.9281
0.0088	320.0	20800	0.5653	0.6853	0.7365	0.7100	0.9275
0.0088	321.0	20865	0.5470	0.6967	0.7347	0.7152	0.9287
0.0088	322.0	20930	0.5694	0.6928	0.7310	0.7114	0.9269
0.0088	323.0	20995	0.5428	0.6907	0.7346	0.7119	0.9287
0.0066	324.0	21060	0.5659	0.7058	0.7247	0.7151	0.9294
0.0066	325.0	21125	0.5557	0.6873	0.7585	0.7212	0.9302
0.0066	326.0	21190	0.5455	0.6970	0.7398	0.7177	0.9297
0.0066	327.0	21255	0.5473	0.6971	0.7457	0.7206	0.9293
0.0066	328.0	21320	0.5442	0.7023	0.7380	0.7197	0.9306
0.0066	329.0	21385	0.5618	0.6945	0.7382	0.7157	0.9284
0.0066	330.0	21450	0.5767	0.6856	0.7520	0.7173	0.9284
0.007	331.0	21515	0.5551	0.6908	0.7477	0.7182	0.9296
0.007	332.0	21580	0.5513	0.6913	0.7252	0.7079	0.9276
0.007	333.0	21645	0.5446	0.6933	0.7360	0.7140	0.9292
0.007	334.0	21710	0.5599	0.6899	0.7500	0.7187	0.9290
0.007	335.0	21775	0.6038	0.6873	0.7234	0.7049	0.9253
0.007	336.0	21840	0.5360	0.6912	0.7441	0.7167	0.9290
0.007	337.0	21905	0.5548	0.6909	0.7401	0.7147	0.9280
0.007	338.0	21970	0.5486	0.6847	0.7488	0.7153	0.9295
0.0074	339.0	22035	0.5434	0.6919	0.7448	0.7174	0.9283
0.0074	340.0	22100	0.5572	0.6977	0.7457	0.7209	0.9290
0.0074	341.0	22165	0.5662	0.6929	0.7500	0.7203	0.9284
0.0074	342.0	22230	0.5417	0.6964	0.7491	0.7218	0.9291
0.0074	343.0	22295	0.5726	0.6935	0.7481	0.7197	0.9294
0.0074	344.0	22360	0.5655	0.6766	0.7502	0.7115	0.9285
0.0074	345.0	22425	0.5807	0.6984	0.7364	0.7169	0.9280
0.0074	346.0	22490	0.5389	0.6862	0.7502	0.7168	0.9296
0.0071	347.0	22555	0.5949	0.6983	0.7283	0.7130	0.9273
0.0071	348.0	22620	0.5493	0.7113	0.7320	0.7215	0.9288
0.0071	349.0	22685	0.5750	0.6884	0.7337	0.7103	0.9270
0.0071	350.0	22750	0.5711	0.6913	0.7418	0.7157	0.9286
0.0071	351.0	22815	0.5682	0.6856	0.7324	0.7082	0.9276
0.0071	352.0	22880	0.5784	0.6827	0.7482	0.7140	0.9281
0.0071	353.0	22945	0.5708	0.6923	0.7356	0.7133	0.9286
0.006	354.0	23010	0.5797	0.6928	0.7346	0.7130	0.9271
0.006	355.0	23075	0.5903	0.6922	0.7387	0.7147	0.9284
0.006	356.0	23140	0.5509	0.6775	0.7596	0.7162	0.9295
0.006	357.0	23205	0.5718	0.6947	0.7517	0.7221	0.9299
0.006	358.0	23270	0.5717	0.6879	0.7454	0.7155	0.9289
0.006	359.0	23335	0.5580	0.6977	0.7398	0.7181	0.9295
0.006	360.0	23400	0.5587	0.7013	0.7351	0.7178	0.9295
0.006	361.0	23465	0.5804	0.7012	0.7455	0.7227	0.9291
0.0052	362.0	23530	0.5806	0.6750	0.7452	0.7084	0.9273
0.0052	363.0	23595	0.5545	0.6922	0.7515	0.7206	0.9301
0.0052	364.0	23660	0.5738	0.6920	0.7517	0.7206	0.9302
0.0052	365.0	23725	0.5653	0.6876	0.7452	0.7152	0.9295
0.0052	366.0	23790	0.5892	0.6945	0.7500	0.7212	0.9306
0.0052	367.0	23855	0.5642	0.6989	0.7468	0.7220	0.9299
0.0052	368.0	23920	0.5798	0.6948	0.7547	0.7235	0.9310
0.0052	369.0	23985	0.5778	0.6981	0.7603	0.7279	0.9315
0.0047	370.0	24050	0.5717	0.6961	0.7445	0.7195	0.9298
0.0047	371.0	24115	0.5831	0.6864	0.7430	0.7136	0.9288
0.0047	372.0	24180	0.5602	0.6979	0.7608	0.7280	0.9312
0.0047	373.0	24245	0.5709	0.6975	0.7536	0.7245	0.9302
0.0047	374.0	24310	0.5797	0.6882	0.7459	0.7159	0.9290
0.0047	375.0	24375	0.5978	0.6923	0.7513	0.7206	0.9287
0.0047	376.0	24440	0.5925	0.6943	0.7297	0.7116	0.9276
0.0049	377.0	24505	0.5955	0.6893	0.7517	0.7192	0.9288
0.0049	378.0	24570	0.5889	0.6933	0.7491	0.7202	0.9295
0.0049	379.0	24635	0.5782	0.6797	0.7310	0.7044	0.9281
0.0049	380.0	24700	0.5950	0.6903	0.7484	0.7182	0.9295
0.0049	381.0	24765	0.5890	0.6982	0.7225	0.7102	0.9273
0.0049	382.0	24830	0.5654	0.7024	0.7409	0.7211	0.9297
0.0049	383.0	24895	0.5820	0.6924	0.7473	0.7188	0.9292
0.0049	384.0	24960	0.5815	0.7021	0.7410	0.7210	0.9299
0.0049	385.0	25025	0.5927	0.6888	0.7636	0.7242	0.9297
0.0049	386.0	25090	0.6008	0.6982	0.7463	0.7214	0.9292
0.0049	387.0	25155	0.5716	0.6915	0.7452	0.7173	0.9288
0.0049	388.0	25220	0.5964	0.6925	0.7472	0.7188	0.9288
0.0049	389.0	25285	0.5793	0.6941	0.7430	0.7178	0.9296
0.0049	390.0	25350	0.5664	0.6913	0.7445	0.7169	0.9300
0.0049	391.0	25415	0.5698	0.6877	0.7490	0.7170	0.9303
0.0049	392.0	25480	0.6130	0.6878	0.7482	0.7168	0.9278
0.0041	393.0	25545	0.5947	0.6915	0.7308	0.7106	0.9279
0.0041	394.0	25610	0.5884	0.7031	0.7452	0.7236	0.9302
0.0041	395.0	25675	0.5767	0.6957	0.7509	0.7223	0.9299
0.0041	396.0	25740	0.5826	0.7008	0.7374	0.7187	0.9288
0.0041	397.0	25805	0.5789	0.6919	0.7538	0.7215	0.9310
0.0041	398.0	25870	0.5788	0.6946	0.7536	0.7229	0.9309
0.0041	399.0	25935	0.5913	0.6930	0.7385	0.7150	0.9287
0.0038	400.0	26000	0.5725	0.6895	0.7526	0.7196	0.9308
0.0038	401.0	26065	0.5860	0.6966	0.7387	0.7170	0.9296
0.0038	402.0	26130	0.5973	0.7001	0.7410	0.7200	0.9292
0.0038	403.0	26195	0.5801	0.6893	0.7565	0.7213	0.9300
0.0038	404.0	26260	0.5842	0.6896	0.7385	0.7132	0.9303
0.0038	405.0	26325	0.6324	0.6904	0.7414	0.7150	0.9269
0.0038	406.0	26390	0.6030	0.7114	0.7400	0.7254	0.9304
0.0038	407.0	26455	0.6061	0.6930	0.7587	0.7244	0.9298
0.0034	408.0	26520	0.6051	0.7052	0.7250	0.7150	0.9272
0.0034	409.0	26585	0.6054	0.6980	0.7432	0.7199	0.9292
0.0034	410.0	26650	0.6010	0.7014	0.7428	0.7215	0.9298
0.0034	411.0	26715	0.5999	0.7008	0.7500	0.7246	0.9309
0.0034	412.0	26780	0.5973	0.6986	0.7470	0.7220	0.9299
0.0034	413.0	26845	0.5923	0.6919	0.7517	0.7205	0.9301
0.0034	414.0	26910	0.5930	0.6994	0.7367	0.7176	0.9293
0.0034	415.0	26975	0.5905	0.7091	0.7268	0.7178	0.9292
0.0033	416.0	27040	0.5821	0.7000	0.7504	0.7243	0.9300
0.0033	417.0	27105	0.5930	0.6910	0.7446	0.7168	0.9292
0.0033	418.0	27170	0.5822	0.6904	0.7466	0.7174	0.9302
0.0033	419.0	27235	0.6022	0.7012	0.7437	0.7218	0.9305
0.0033	420.0	27300	0.6004	0.6937	0.7634	0.7269	0.9313
0.0033	421.0	27365	0.5996	0.6995	0.7461	0.7220	0.9305
0.0033	422.0	27430	0.5910	0.7033	0.7547	0.7281	0.9311
0.0033	423.0	27495	0.5986	0.7038	0.7380	0.7205	0.9301
0.0031	424.0	27560	0.6046	0.6947	0.7457	0.7193	0.9292
0.0031	425.0	27625	0.6046	0.6969	0.7466	0.7209	0.9299
0.0031	426.0	27690	0.5891	0.6988	0.7445	0.7209	0.9299
0.0031	427.0	27755	0.6068	0.7051	0.7396	0.7219	0.9304
0.0031	428.0	27820	0.6212	0.6944	0.7315	0.7124	0.9287
0.0031	429.0	27885	0.5963	0.7065	0.7535	0.7292	0.9313
0.0031	430.0	27950	0.5990	0.7015	0.7540	0.7268	0.9307
0.0026	431.0	28015	0.6169	0.6928	0.7472	0.7189	0.9294
0.0026	432.0	28080	0.6023	0.6981	0.7578	0.7267	0.9306
0.0026	433.0	28145	0.6248	0.6958	0.7518	0.7228	0.9306
0.0026	434.0	28210	0.6161	0.6981	0.7488	0.7226	0.9305
0.0026	435.0	28275	0.6038	0.6965	0.7497	0.7221	0.9303
0.0026	436.0	28340	0.5980	0.7051	0.7515	0.7276	0.9305
0.0026	437.0	28405	0.6056	0.7037	0.7446	0.7236	0.9299
0.0026	438.0	28470	0.6128	0.6972	0.7500	0.7227	0.9305
0.0028	439.0	28535	0.6116	0.7108	0.7430	0.7265	0.9310
0.0028	440.0	28600	0.6012	0.6971	0.7484	0.7218	0.9305
0.0028	441.0	28665	0.6028	0.7017	0.7461	0.7232	0.9305
0.0028	442.0	28730	0.6139	0.7028	0.7554	0.7282	0.9311
0.0028	443.0	28795	0.5996	0.7005	0.7562	0.7273	0.9315
0.0028	444.0	28860	0.6097	0.7014	0.7448	0.7224	0.9306
0.0028	445.0	28925	0.6121	0.7002	0.7554	0.7268	0.9308
0.0028	446.0	28990	0.6038	0.6933	0.7569	0.7237	0.9303
0.0025	447.0	29055	0.6226	0.7039	0.7441	0.7235	0.9294
0.0025	448.0	29120	0.6194	0.7042	0.7439	0.7235	0.9301
0.0025	449.0	29185	0.6188	0.6947	0.7448	0.7189	0.9291
0.0025	450.0	29250	0.6082	0.6943	0.7554	0.7236	0.9303
0.0025	451.0	29315	0.6094	0.7018	0.7405	0.7206	0.9296
0.0025	452.0	29380	0.6052	0.6962	0.7407	0.7177	0.9295
0.0025	453.0	29445	0.6059	0.6987	0.7499	0.7234	0.9306
0.0021	454.0	29510	0.6069	0.6951	0.7553	0.7239	0.9309
0.0021	455.0	29575	0.6081	0.7028	0.7446	0.7231	0.9304
0.0021	456.0	29640	0.6179	0.6969	0.7414	0.7184	0.9295
0.0021	457.0	29705	0.6114	0.6939	0.7455	0.7188	0.9295
0.0021	458.0	29770	0.6193	0.6938	0.7405	0.7164	0.9291
0.0021	459.0	29835	0.6077	0.6950	0.7446	0.7189	0.9297
0.0021	460.0	29900	0.6180	0.6923	0.7499	0.7199	0.9300
0.0021	461.0	29965	0.6085	0.7018	0.7518	0.7260	0.9307
0.0019	462.0	30030	0.6234	0.7003	0.7436	0.7213	0.9298
0.0019	463.0	30095	0.6195	0.6940	0.7509	0.7213	0.9296
0.0019	464.0	30160	0.6182	0.6959	0.7425	0.7184	0.9293
0.0019	465.0	30225	0.6186	0.6957	0.7461	0.7200	0.9295
0.0019	466.0	30290	0.6296	0.6946	0.7466	0.7197	0.9295
0.0019	467.0	30355	0.6235	0.6978	0.7436	0.7200	0.9297
0.0019	468.0	30420	0.6293	0.7029	0.7378	0.7199	0.9289
0.0019	469.0	30485	0.6155	0.7004	0.7461	0.7225	0.9303
0.002	470.0	30550	0.6239	0.7012	0.7391	0.7196	0.9293
0.002	471.0	30615	0.6206	0.6962	0.7454	0.7200	0.9292
0.002	472.0	30680	0.6264	0.6984	0.7468	0.7218	0.9295
0.002	473.0	30745	0.6175	0.7008	0.7571	0.7278	0.9307
0.002	474.0	30810	0.6274	0.6969	0.7398	0.7177	0.9287
0.002	475.0	30875	0.6140	0.7038	0.7502	0.7263	0.9302
0.002	476.0	30940	0.6089	0.7084	0.7475	0.7274	0.9308
0.0018	477.0	31005	0.6123	0.7049	0.7515	0.7274	0.9310
0.0018	478.0	31070	0.6215	0.7001	0.7535	0.7258	0.9305
0.0018	479.0	31135	0.6219	0.7045	0.7481	0.7257	0.9304
0.0018	480.0	31200	0.6084	0.7034	0.7522	0.7270	0.9311
0.0018	481.0	31265	0.6142	0.7026	0.7500	0.7255	0.9306
0.0018	482.0	31330	0.6063	0.7066	0.7533	0.7292	0.9314
0.0018	483.0	31395	0.6023	0.7062	0.7506	0.7277	0.9313
0.0018	484.0	31460	0.6102	0.7028	0.7554	0.7282	0.9310
0.0017	485.0	31525	0.6123	0.7066	0.7506	0.7279	0.9309
0.0017	486.0	31590	0.6150	0.7064	0.7526	0.7287	0.9309
0.0017	487.0	31655	0.6186	0.7044	0.7509	0.7269	0.9307
0.0017	488.0	31720	0.6198	0.7048	0.7490	0.7262	0.9305
0.0017	489.0	31785	0.6179	0.6980	0.7522	0.7241	0.9304
0.0017	490.0	31850	0.6198	0.6983	0.7522	0.7242	0.9307
0.0017	491.0	31915	0.6149	0.7010	0.7508	0.7250	0.9308
0.0017	492.0	31980	0.6146	0.7034	0.7499	0.7259	0.9309
0.0015	493.0	32045	0.6158	0.7041	0.7491	0.7259	0.9309
0.0015	494.0	32110	0.6174	0.7025	0.7504	0.7256	0.9308
0.0015	495.0	32175	0.6183	0.7011	0.7509	0.7252	0.9305
0.0015	496.0	32240	0.6182	0.7013	0.7502	0.7250	0.9307
0.0015	497.0	32305	0.6189	0.7001	0.7479	0.7232	0.9306
0.0015	498.0	32370	0.6208	0.7009	0.7475	0.7235	0.9304
0.0015	499.0	32435	0.6206	0.6999	0.7477	0.7230	0.9303
0.0014	500.0	32500	0.6205	0.7	0.7475	0.7230	0.9303

Framework versions

• Transformers 4.29.2
• Pytorch 2.0.1+cu117
• Datasets 2.12.0
• Tokenizers 0.13.3