bert-base-uncased_4_1039_token_headwise

This model is a fine-tuned version of bert-base-uncased on the bionlp2004 dataset. It achieves the following results on the evaluation set:

• Loss: 0.7036
• Precision: 0.7424
• Recall: 0.7713
• F1: 0.7566
• Accuracy: 0.9330

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.001
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 500

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
No log	1.0	65	0.3621	0.3676	0.4841	0.4178	0.8704
No log	2.0	130	0.2679	0.5317	0.6341	0.5784	0.9048
No log	3.0	195	0.2544	0.5950	0.6512	0.6218	0.9134
No log	4.0	260	0.2279	0.6275	0.7048	0.6640	0.9256
No log	5.0	325	0.2279	0.6544	0.7308	0.6905	0.9263
No log	6.0	390	0.2459	0.6537	0.7497	0.6984	0.9253
No log	7.0	455	0.2392	0.6777	0.7423	0.7086	0.9290
0.2297	8.0	520	0.2729	0.6762	0.6695	0.6729	0.9232
0.2297	9.0	585	0.2805	0.6490	0.7522	0.6968	0.9245
0.2297	10.0	650	0.3040	0.6514	0.7182	0.6832	0.9239
0.2297	11.0	715	0.2952	0.6745	0.7146	0.6939	0.9263
0.2297	12.0	780	0.2960	0.6708	0.7164	0.6929	0.9265
0.2297	13.0	845	0.3286	0.6830	0.7270	0.7043	0.9260
0.2297	14.0	910	0.3219	0.6595	0.7331	0.6944	0.9253
0.2297	15.0	975	0.3222	0.6858	0.7286	0.7065	0.9272
0.0631	16.0	1040	0.3338	0.6950	0.7500	0.7215	0.9295
0.0631	17.0	1105	0.3447	0.6643	0.7364	0.6985	0.9268
0.0631	18.0	1170	0.3583	0.6823	0.7279	0.7044	0.9264
0.0631	19.0	1235	0.3492	0.6939	0.7295	0.7113	0.9278
0.0631	20.0	1300	0.3729	0.6621	0.7684	0.7113	0.9259
0.0631	21.0	1365	0.3892	0.6548	0.6944	0.6740	0.9221
0.0631	22.0	1430	0.3885	0.6744	0.7086	0.6911	0.9241
0.0631	23.0	1495	0.3976	0.6511	0.7554	0.6994	0.9231
0.0367	24.0	1560	0.3550	0.6495	0.7491	0.6958	0.9262
0.0367	25.0	1625	0.3628	0.6689	0.7391	0.7023	0.9282
0.0367	26.0	1690	0.4010	0.6649	0.7526	0.7060	0.9260
0.0367	27.0	1755	0.4152	0.6683	0.7502	0.7069	0.9267
0.0367	28.0	1820	0.4081	0.6820	0.7322	0.7062	0.9267
0.0367	29.0	1885	0.4058	0.6834	0.7385	0.7099	0.9281
0.0367	30.0	1950	0.4027	0.6688	0.7194	0.6932	0.9253
0.0279	31.0	2015	0.3923	0.6847	0.7518	0.7167	0.9294
0.0279	32.0	2080	0.4188	0.6800	0.7542	0.7152	0.9285
0.0279	33.0	2145	0.4250	0.6815	0.7412	0.7101	0.9288
0.0279	34.0	2210	0.4161	0.6864	0.7628	0.7226	0.9299
0.0279	35.0	2275	0.4158	0.7025	0.7590	0.7297	0.9298
0.0279	36.0	2340	0.4208	0.6852	0.7648	0.7228	0.9285
0.0279	37.0	2405	0.4105	0.6930	0.7311	0.7115	0.9283
0.0279	38.0	2470	0.4363	0.6726	0.7794	0.7221	0.9287
0.019	39.0	2535	0.4223	0.6823	0.7482	0.7137	0.9269
0.019	40.0	2600	0.4363	0.6913	0.7227	0.7066	0.9267
0.019	41.0	2665	0.4231	0.6982	0.7610	0.7282	0.9302
0.019	42.0	2730	0.4709	0.6851	0.7193	0.7017	0.9250
0.019	43.0	2795	0.4535	0.7179	0.7272	0.7225	0.9293
0.019	44.0	2860	0.4276	0.6997	0.7601	0.7286	0.9299
0.019	45.0	2925	0.4856	0.6858	0.6840	0.6849	0.9242
0.019	46.0	2990	0.4392	0.6899	0.7319	0.7102	0.9256
0.0189	47.0	3055	0.4423	0.6921	0.7623	0.7255	0.9298
0.0189	48.0	3120	0.4592	0.6925	0.7560	0.7229	0.9292
0.0189	49.0	3185	0.4285	0.6818	0.7578	0.7178	0.9290
0.0189	50.0	3250	0.4413	0.6775	0.7407	0.7077	0.9264
0.0189	51.0	3315	0.4474	0.6901	0.7553	0.7212	0.9292
0.0189	52.0	3380	0.4558	0.6790	0.7608	0.7176	0.9278
0.0189	53.0	3445	0.4695	0.6894	0.7446	0.7160	0.9281
0.0157	54.0	3510	0.4737	0.6748	0.7333	0.7029	0.9266
0.0157	55.0	3575	0.5053	0.6838	0.7529	0.7167	0.9266
0.0157	56.0	3640	0.4746	0.6745	0.7315	0.7019	0.9254
0.0157	57.0	3705	0.4753	0.7202	0.7277	0.7239	0.9288
0.0157	58.0	3770	0.4465	0.6942	0.7558	0.7237	0.9296
0.0157	59.0	3835	0.4873	0.6992	0.7634	0.7299	0.9294
0.0157	60.0	3900	0.4738	0.6784	0.7457	0.7105	0.9267
0.0157	61.0	3965	0.5076	0.6827	0.7760	0.7263	0.9270
0.0153	62.0	4030	0.4785	0.6977	0.7524	0.7240	0.9302
0.0153	63.0	4095	0.5587	0.7030	0.6841	0.6934	0.9219
0.0153	64.0	4160	0.4740	0.6759	0.7392	0.7062	0.9266
0.0153	65.0	4225	0.4434	0.6807	0.7473	0.7124	0.9276
0.0153	66.0	4290	0.4587	0.6972	0.7455	0.7206	0.9291
0.0153	67.0	4355	0.4701	0.6967	0.7497	0.7222	0.9283
0.0153	68.0	4420	0.4957	0.6823	0.7414	0.7106	0.9267
0.0153	69.0	4485	0.4917	0.6851	0.7547	0.7183	0.9285
0.0147	70.0	4550	0.5401	0.6675	0.7430	0.7033	0.9249
0.0147	71.0	4615	0.4943	0.6700	0.7407	0.7036	0.9278
0.0147	72.0	4680	0.4488	0.6931	0.7457	0.7184	0.9284
0.0147	73.0	4745	0.4615	0.6986	0.7448	0.7210	0.9296
0.0147	74.0	4810	0.4820	0.7035	0.7416	0.7220	0.9294
0.0147	75.0	4875	0.5227	0.7040	0.7274	0.7155	0.9261
0.0147	76.0	4940	0.4992	0.6838	0.7288	0.7056	0.9261
0.0148	77.0	5005	0.5103	0.6476	0.7639	0.7010	0.9246
0.0148	78.0	5070	0.5046	0.6940	0.7266	0.7099	0.9258
0.0148	79.0	5135	0.4947	0.7072	0.7382	0.7224	0.9294
0.0148	80.0	5200	0.5373	0.7020	0.6881	0.6950	0.9211
0.0148	81.0	5265	0.5046	0.7016	0.7342	0.7175	0.9276
0.0148	82.0	5330	0.5293	0.6869	0.7679	0.7251	0.9285
0.0148	83.0	5395	0.4888	0.6945	0.7583	0.7250	0.9297
0.0148	84.0	5460	0.5260	0.7000	0.7590	0.7284	0.9289
0.0121	85.0	5525	0.4930	0.6701	0.7128	0.6908	0.9231
0.0121	86.0	5590	0.4973	0.7025	0.7137	0.7081	0.9268
0.0121	87.0	5655	0.4871	0.6855	0.7364	0.7100	0.9262
0.0121	88.0	5720	0.4794	0.7020	0.7468	0.7237	0.9296
0.0121	89.0	5785	0.5453	0.6603	0.7374	0.6967	0.9215
0.0121	90.0	5850	0.4842	0.6952	0.7641	0.7280	0.9300
0.0121	91.0	5915	0.4918	0.7056	0.7311	0.7181	0.9290
0.0121	92.0	5980	0.5144	0.6811	0.7405	0.7096	0.9258
0.0123	93.0	6045	0.5427	0.6905	0.7284	0.7090	0.9251
0.0123	94.0	6110	0.5272	0.7066	0.7529	0.7290	0.9287
0.0123	95.0	6175	0.5289	0.7087	0.7439	0.7259	0.9299
0.0123	96.0	6240	0.4713	0.7008	0.7454	0.7224	0.9288
0.0123	97.0	6305	0.4996	0.7040	0.7499	0.7262	0.9292
0.0123	98.0	6370	0.4996	0.7015	0.7428	0.7216	0.9298
0.0123	99.0	6435	0.5215	0.6938	0.7527	0.7221	0.9280
0.0091	100.0	6500	0.5168	0.7095	0.7392	0.7240	0.9299
0.0091	101.0	6565	0.4943	0.7013	0.7493	0.7245	0.9283
0.0091	102.0	6630	0.5093	0.7107	0.7459	0.7279	0.9290
0.0091	103.0	6695	0.5147	0.6897	0.7075	0.6985	0.9252
0.0091	104.0	6760	0.4826	0.7209	0.7025	0.7116	0.9273
0.0091	105.0	6825	0.5267	0.7136	0.7295	0.7215	0.9292
0.0091	106.0	6890	0.5081	0.6907	0.7547	0.7213	0.9284
0.0091	107.0	6955	0.4663	0.6927	0.7502	0.7203	0.9285
0.0112	108.0	7020	0.5241	0.7091	0.7198	0.7144	0.9272
0.0112	109.0	7085	0.4689	0.6904	0.7751	0.7303	0.9290
0.0112	110.0	7150	0.5325	0.7081	0.7670	0.7363	0.9291
0.0112	111.0	7215	0.5381	0.7037	0.7158	0.7097	0.9246
0.0112	112.0	7280	0.5423	0.7160	0.7184	0.7172	0.9280
0.0112	113.0	7345	0.5480	0.6945	0.7628	0.7271	0.9281
0.0112	114.0	7410	0.5324	0.7074	0.7340	0.7205	0.9270
0.0112	115.0	7475	0.5023	0.6825	0.7310	0.7059	0.9248
0.0105	116.0	7540	0.4980	0.7065	0.7681	0.7360	0.9311
0.0105	117.0	7605	0.5431	0.6901	0.7455	0.7168	0.9260
0.0105	118.0	7670	0.5262	0.6651	0.7630	0.7107	0.9233
0.0105	119.0	7735	0.4880	0.7021	0.7463	0.7235	0.9304
0.0105	120.0	7800	0.5234	0.7154	0.7108	0.7131	0.9259
0.0105	121.0	7865	0.5343	0.6967	0.7133	0.7049	0.9234
0.0105	122.0	7930	0.4882	0.6893	0.7560	0.7211	0.9275
0.0105	123.0	7995	0.5187	0.7107	0.7416	0.7258	0.9289
0.011	124.0	8060	0.5276	0.6932	0.7531	0.7219	0.9275
0.011	125.0	8125	0.5346	0.7019	0.7394	0.7202	0.9270
0.011	126.0	8190	0.5380	0.7099	0.7347	0.7221	0.9284
0.011	127.0	8255	0.4963	0.7102	0.7538	0.7314	0.9302
0.011	128.0	8320	0.5169	0.7036	0.7182	0.7108	0.9260
0.011	129.0	8385	0.5335	0.7208	0.7389	0.7297	0.9304
0.011	130.0	8450	0.5204	0.6989	0.7527	0.7248	0.9285
0.0088	131.0	8515	0.5203	0.6956	0.7385	0.7164	0.9268
0.0088	132.0	8580	0.5236	0.6822	0.7450	0.7122	0.9254
0.0088	133.0	8645	0.4771	0.6908	0.7738	0.7300	0.9304
0.0088	134.0	8710	0.5215	0.7137	0.7383	0.7258	0.9287
0.0088	135.0	8775	0.5171	0.7109	0.7441	0.7271	0.9298
0.0088	136.0	8840	0.5616	0.7222	0.7252	0.7237	0.9286
0.0088	137.0	8905	0.5248	0.7030	0.7601	0.7305	0.9283
0.0088	138.0	8970	0.5134	0.7080	0.7695	0.7375	0.9301
0.0083	139.0	9035	0.5323	0.7096	0.7346	0.7219	0.9280
0.0083	140.0	9100	0.5319	0.6881	0.7601	0.7223	0.9266
0.0083	141.0	9165	0.5579	0.7081	0.7434	0.7253	0.9273
0.0083	142.0	9230	0.5526	0.6931	0.7628	0.7263	0.9289
0.0083	143.0	9295	0.5019	0.7056	0.7650	0.7341	0.9302
0.0083	144.0	9360	0.5722	0.6983	0.7394	0.7183	0.9263
0.0083	145.0	9425	0.5329	0.6989	0.7625	0.7293	0.9285
0.0083	146.0	9490	0.5908	0.6953	0.7526	0.7228	0.9271
0.0072	147.0	9555	0.5361	0.7113	0.7488	0.7295	0.9269
0.0072	148.0	9620	0.5338	0.7161	0.7362	0.7260	0.9292
0.0072	149.0	9685	0.5415	0.6955	0.7380	0.7161	0.9278
0.0072	150.0	9750	0.6163	0.7042	0.6822	0.6930	0.9208
0.0072	151.0	9815	0.5642	0.7000	0.7560	0.7269	0.9285
0.0072	152.0	9880	0.5096	0.6997	0.7547	0.7262	0.9270
0.0072	153.0	9945	0.5272	0.7078	0.7504	0.7285	0.9287
0.0083	154.0	10010	0.5149	0.7013	0.7708	0.7344	0.9277
0.0083	155.0	10075	0.5412	0.7104	0.7661	0.7372	0.9286
0.0083	156.0	10140	0.5437	0.6905	0.7758	0.7307	0.9268
0.0083	157.0	10205	0.5201	0.7018	0.7785	0.7382	0.9293
0.0083	158.0	10270	0.5342	0.7146	0.7486	0.7312	0.9298
0.0083	159.0	10335	0.5250	0.6920	0.7059	0.6989	0.9230
0.0083	160.0	10400	0.5368	0.7079	0.7587	0.7324	0.9304
0.0083	161.0	10465	0.5146	0.6989	0.7567	0.7267	0.9294
0.008	162.0	10530	0.5450	0.7107	0.7486	0.7292	0.9294
0.008	163.0	10595	0.5746	0.6972	0.7306	0.7135	0.9238
0.008	164.0	10660	0.5169	0.7152	0.7349	0.7249	0.9283
0.008	165.0	10725	0.5512	0.7138	0.7299	0.7218	0.9266
0.008	166.0	10790	0.5472	0.7180	0.7029	0.7103	0.9244
0.008	167.0	10855	0.5727	0.6987	0.7567	0.7265	0.9266
0.008	168.0	10920	0.5660	0.6860	0.7610	0.7216	0.9256
0.008	169.0	10985	0.4885	0.7207	0.7587	0.7392	0.9304
0.0077	170.0	11050	0.5768	0.6752	0.7461	0.7089	0.9228
0.0077	171.0	11115	0.5170	0.7143	0.7313	0.7227	0.9279
0.0077	172.0	11180	0.5368	0.7016	0.7551	0.7274	0.9290
0.0077	173.0	11245	0.5343	0.7190	0.7652	0.7413	0.9317
0.0077	174.0	11310	0.5472	0.7231	0.7234	0.7233	0.9275
0.0077	175.0	11375	0.5275	0.7222	0.7601	0.7407	0.9307
0.0077	176.0	11440	0.5628	0.7044	0.7488	0.7259	0.9291
0.0064	177.0	11505	0.5391	0.7118	0.7122	0.7120	0.9256
0.0064	178.0	11570	0.5637	0.7121	0.7522	0.7316	0.9302
0.0064	179.0	11635	0.5401	0.7134	0.7513	0.7319	0.9280
0.0064	180.0	11700	0.6035	0.6963	0.7825	0.7369	0.9275
0.0064	181.0	11765	0.5969	0.6907	0.7592	0.7233	0.9276
0.0064	182.0	11830	0.5661	0.7196	0.7427	0.7309	0.9290
0.0064	183.0	11895	0.5654	0.7163	0.7401	0.7280	0.9291
0.0064	184.0	11960	0.5865	0.6989	0.7578	0.7271	0.9292
0.0047	185.0	12025	0.5389	0.6961	0.7473	0.7208	0.9271
0.0047	186.0	12090	0.5643	0.7093	0.7535	0.7307	0.9284
0.0047	187.0	12155	0.5704	0.7024	0.7531	0.7269	0.9282
0.0047	188.0	12220	0.5567	0.7035	0.7302	0.7166	0.9263
0.0047	189.0	12285	0.6077	0.7021	0.7311	0.7163	0.9241
0.0047	190.0	12350	0.5530	0.7082	0.7551	0.7309	0.9303
0.0047	191.0	12415	0.5351	0.7114	0.7630	0.7363	0.9296
0.0047	192.0	12480	0.5314	0.7247	0.7376	0.7311	0.9297
0.0065	193.0	12545	0.5895	0.7111	0.7409	0.7257	0.9263
0.0065	194.0	12610	0.5750	0.7112	0.7560	0.7329	0.9280
0.0065	195.0	12675	0.5497	0.7103	0.7569	0.7329	0.9295
0.0065	196.0	12740	0.5754	0.7124	0.7446	0.7282	0.9285
0.0065	197.0	12805	0.5606	0.7148	0.7634	0.7383	0.9302
0.0065	198.0	12870	0.5837	0.7187	0.7376	0.7280	0.9275
0.0065	199.0	12935	0.5944	0.7186	0.7371	0.7277	0.9277
0.0045	200.0	13000	0.5789	0.7166	0.7477	0.7318	0.9296
0.0045	201.0	13065	0.5776	0.6905	0.7373	0.7131	0.9240
0.0045	202.0	13130	0.6194	0.6920	0.7434	0.7168	0.9255
0.0045	203.0	13195	0.5758	0.7099	0.7365	0.7230	0.9280
0.0045	204.0	13260	0.5436	0.7151	0.7434	0.7289	0.9293
0.0045	205.0	13325	0.5624	0.7250	0.7481	0.7363	0.9300
0.0045	206.0	13390	0.5567	0.7097	0.7446	0.7268	0.9285
0.0045	207.0	13455	0.5513	0.7142	0.7138	0.7140	0.9249
0.0053	208.0	13520	0.5795	0.7057	0.7574	0.7307	0.9279
0.0053	209.0	13585	0.5445	0.7009	0.7526	0.7258	0.9275
0.0053	210.0	13650	0.5578	0.7246	0.7450	0.7347	0.9301
0.0053	211.0	13715	0.5437	0.7115	0.7688	0.7390	0.9312
0.0053	212.0	13780	0.4980	0.7292	0.7526	0.7407	0.9317
0.0053	213.0	13845	0.5782	0.7031	0.7594	0.7302	0.9292
0.0053	214.0	13910	0.5870	0.7130	0.7574	0.7345	0.9287
0.0053	215.0	13975	0.5367	0.7171	0.7490	0.7327	0.9283
0.006	216.0	14040	0.5845	0.7187	0.7583	0.7380	0.9278
0.006	217.0	14105	0.5766	0.7086	0.7646	0.7356	0.9272
0.006	218.0	14170	0.5593	0.7261	0.7614	0.7433	0.9306
0.006	219.0	14235	0.5373	0.7232	0.7598	0.7410	0.9313
0.006	220.0	14300	0.6219	0.7174	0.7450	0.7309	0.9275
0.006	221.0	14365	0.5916	0.7031	0.7634	0.7320	0.9286
0.006	222.0	14430	0.5404	0.7041	0.7756	0.7381	0.9290
0.006	223.0	14495	0.5963	0.7041	0.7490	0.7258	0.9267
0.0046	224.0	14560	0.5674	0.7109	0.7724	0.7404	0.9307
0.0046	225.0	14625	0.5854	0.7106	0.7769	0.7423	0.9288
0.0046	226.0	14690	0.5641	0.7053	0.7563	0.7299	0.9283
0.0046	227.0	14755	0.5753	0.7054	0.7616	0.7324	0.9285
0.0046	228.0	14820	0.5565	0.6980	0.7475	0.7219	0.9266
0.0046	229.0	14885	0.5419	0.6950	0.7816	0.7357	0.9286
0.0046	230.0	14950	0.5619	0.6926	0.7596	0.7246	0.9285
0.0053	231.0	15015	0.5680	0.7166	0.7400	0.7281	0.9280
0.0053	232.0	15080	0.5294	0.7106	0.7623	0.7355	0.9301
0.0053	233.0	15145	0.5938	0.7017	0.7493	0.7247	0.9259
0.0053	234.0	15210	0.5728	0.7157	0.7637	0.7389	0.9309
0.0053	235.0	15275	0.5562	0.7209	0.7526	0.7364	0.9298
0.0053	236.0	15340	0.5739	0.7295	0.7544	0.7417	0.9309
0.0053	237.0	15405	0.5848	0.7185	0.7760	0.7461	0.9320
0.0053	238.0	15470	0.5844	0.7015	0.7751	0.7365	0.9305
0.0037	239.0	15535	0.5699	0.7195	0.7499	0.7344	0.9307
0.0037	240.0	15600	0.5634	0.7266	0.7738	0.7495	0.9324
0.0037	241.0	15665	0.5915	0.7164	0.7655	0.7401	0.9291
0.0037	242.0	15730	0.5554	0.7061	0.7819	0.7421	0.9285
0.0037	243.0	15795	0.5476	0.7088	0.7677	0.7371	0.9299
0.0037	244.0	15860	0.6185	0.7380	0.7461	0.7420	0.9299
0.0037	245.0	15925	0.5879	0.7177	0.7645	0.7403	0.9313
0.0037	246.0	15990	0.6360	0.7104	0.7682	0.7382	0.9294
0.0033	247.0	16055	0.6197	0.7416	0.7380	0.7398	0.9291
0.0033	248.0	16120	0.5718	0.7145	0.7691	0.7408	0.9305
0.0033	249.0	16185	0.6096	0.7025	0.7398	0.7206	0.9266
0.0033	250.0	16250	0.5466	0.7110	0.7574	0.7335	0.9295
0.0033	251.0	16315	0.5995	0.7127	0.7670	0.7388	0.9293
0.0033	252.0	16380	0.5725	0.6981	0.7670	0.7309	0.9290
0.0033	253.0	16445	0.5625	0.7049	0.7668	0.7345	0.9297
0.0045	254.0	16510	0.5688	0.7178	0.7603	0.7384	0.9298
0.0045	255.0	16575	0.6108	0.7047	0.7333	0.7187	0.9256
0.0045	256.0	16640	0.5422	0.7093	0.7594	0.7335	0.9305
0.0045	257.0	16705	0.5737	0.7103	0.7439	0.7267	0.9289
0.0045	258.0	16770	0.5238	0.7058	0.7652	0.7343	0.9293
0.0045	259.0	16835	0.5794	0.7154	0.7677	0.7406	0.9302
0.0045	260.0	16900	0.6207	0.7135	0.7441	0.7285	0.9292
0.0045	261.0	16965	0.5672	0.7184	0.7490	0.7334	0.9287
0.0035	262.0	17030	0.5897	0.7187	0.7452	0.7317	0.9284
0.0035	263.0	17095	0.5981	0.7061	0.7744	0.7386	0.9299
0.0035	264.0	17160	0.6152	0.7214	0.7443	0.7327	0.9281
0.0035	265.0	17225	0.6185	0.7265	0.7527	0.7394	0.9305
0.0035	266.0	17290	0.6130	0.7165	0.7720	0.7432	0.9306
0.0035	267.0	17355	0.6058	0.7218	0.7751	0.7475	0.9305
0.0035	268.0	17420	0.6159	0.7136	0.7722	0.7417	0.9289
0.0035	269.0	17485	0.6156	0.7176	0.7738	0.7446	0.9301
0.0023	270.0	17550	0.5868	0.7090	0.7805	0.7430	0.9287
0.0023	271.0	17615	0.5651	0.7243	0.7713	0.7471	0.9319
0.0023	272.0	17680	0.5550	0.6917	0.7798	0.7331	0.9287
0.0023	273.0	17745	0.5620	0.7180	0.7468	0.7321	0.9293
0.0023	274.0	17810	0.5746	0.7198	0.7470	0.7331	0.9295
0.0023	275.0	17875	0.5724	0.7136	0.7414	0.7273	0.9265
0.0023	276.0	17940	0.5924	0.7097	0.7664	0.7370	0.9297
0.0032	277.0	18005	0.6020	0.6970	0.7607	0.7275	0.9279
0.0032	278.0	18070	0.6417	0.6984	0.7774	0.7358	0.9288
0.0032	279.0	18135	0.6101	0.7192	0.7641	0.7409	0.9300
0.0032	280.0	18200	0.6199	0.7134	0.7639	0.7378	0.9296
0.0032	281.0	18265	0.6048	0.7177	0.7567	0.7367	0.9300
0.0032	282.0	18330	0.6090	0.7221	0.7594	0.7403	0.9305
0.0032	283.0	18395	0.5958	0.7060	0.7830	0.7425	0.9300
0.0032	284.0	18460	0.5897	0.7127	0.7578	0.7346	0.9299
0.0022	285.0	18525	0.5743	0.7113	0.7664	0.7379	0.9307
0.0022	286.0	18590	0.5393	0.7063	0.7549	0.7298	0.9289
0.0022	287.0	18655	0.5873	0.6930	0.7690	0.7290	0.9280
0.0022	288.0	18720	0.5900	0.7151	0.7720	0.7425	0.9311
0.0022	289.0	18785	0.5481	0.7109	0.7780	0.7429	0.9306
0.0022	290.0	18850	0.6294	0.7236	0.7257	0.7247	0.9263
0.0022	291.0	18915	0.6257	0.7241	0.7358	0.7299	0.9265
0.0022	292.0	18980	0.5894	0.7289	0.7596	0.7439	0.9302
0.0032	293.0	19045	0.6101	0.6999	0.7805	0.7380	0.9290
0.0032	294.0	19110	0.6545	0.6996	0.7527	0.7252	0.9263
0.0032	295.0	19175	0.6525	0.7044	0.7636	0.7328	0.9296
0.0032	296.0	19240	0.6624	0.7158	0.7538	0.7343	0.9291
0.0032	297.0	19305	0.6560	0.7118	0.7744	0.7418	0.9299
0.0032	298.0	19370	0.6621	0.7071	0.7740	0.7391	0.9289
0.0032	299.0	19435	0.6707	0.7201	0.7578	0.7384	0.9286
0.0024	300.0	19500	0.6077	0.7131	0.7691	0.7401	0.9299
0.0024	301.0	19565	0.6373	0.7086	0.7554	0.7313	0.9270
0.0024	302.0	19630	0.6672	0.7077	0.7704	0.7377	0.9277
0.0024	303.0	19695	0.6336	0.7306	0.7614	0.7457	0.9315
0.0024	304.0	19760	0.6163	0.7316	0.7556	0.7434	0.9302
0.0024	305.0	19825	0.6155	0.7186	0.7648	0.7410	0.9294
0.0024	306.0	19890	0.6122	0.7176	0.7558	0.7362	0.9298
0.0024	307.0	19955	0.5746	0.7126	0.7781	0.7439	0.9312
0.0024	308.0	20020	0.5839	0.7239	0.7610	0.7420	0.9313
0.0024	309.0	20085	0.6299	0.7256	0.7490	0.7371	0.9291
0.0024	310.0	20150	0.6116	0.7097	0.7848	0.7453	0.9305
0.0024	311.0	20215	0.5846	0.7006	0.7785	0.7375	0.9275
0.0024	312.0	20280	0.5604	0.7086	0.7664	0.7364	0.9293
0.0024	313.0	20345	0.6063	0.7273	0.7717	0.7488	0.9308
0.0024	314.0	20410	0.6301	0.7303	0.7610	0.7453	0.9303
0.0024	315.0	20475	0.6441	0.7093	0.7675	0.7372	0.9274
0.0018	316.0	20540	0.6651	0.7270	0.7477	0.7372	0.9281
0.0018	317.0	20605	0.6420	0.7165	0.7684	0.7416	0.9293
0.0018	318.0	20670	0.6189	0.7231	0.7601	0.7412	0.9302
0.0018	319.0	20735	0.6246	0.7250	0.7596	0.7419	0.9298
0.0018	320.0	20800	0.6362	0.7130	0.7614	0.7364	0.9292
0.0018	321.0	20865	0.6363	0.7176	0.7569	0.7367	0.9291
0.0018	322.0	20930	0.6377	0.7166	0.7690	0.7418	0.9303
0.0018	323.0	20995	0.6287	0.7295	0.7762	0.7521	0.9319
0.0017	324.0	21060	0.6248	0.7242	0.7693	0.7461	0.9307
0.0017	325.0	21125	0.6228	0.7268	0.7738	0.7496	0.9314
0.0017	326.0	21190	0.6211	0.7249	0.7830	0.7528	0.9320
0.0017	327.0	21255	0.6104	0.7078	0.7708	0.7379	0.9293
0.0017	328.0	21320	0.6353	0.7255	0.7515	0.7383	0.9294
0.0017	329.0	21385	0.6598	0.7069	0.7623	0.7336	0.9277
0.0017	330.0	21450	0.6299	0.7171	0.7565	0.7363	0.9285
0.0018	331.0	21515	0.6222	0.7198	0.7754	0.7466	0.9307
0.0018	332.0	21580	0.6139	0.7176	0.7587	0.7376	0.9299
0.0018	333.0	21645	0.5928	0.7195	0.7663	0.7421	0.9310
0.0018	334.0	21710	0.5740	0.7251	0.7553	0.7399	0.9309
0.0018	335.0	21775	0.5864	0.7298	0.7677	0.7483	0.9324
0.0018	336.0	21840	0.6373	0.7301	0.7347	0.7324	0.9278
0.0018	337.0	21905	0.6215	0.7212	0.7760	0.7476	0.9314
0.0018	338.0	21970	0.6450	0.7131	0.7672	0.7391	0.9284
0.0026	339.0	22035	0.6126	0.7306	0.7517	0.7410	0.9295
0.0026	340.0	22100	0.6029	0.7169	0.7645	0.7399	0.9296
0.0026	341.0	22165	0.6201	0.7274	0.7681	0.7472	0.9313
0.0026	342.0	22230	0.6373	0.7316	0.7293	0.7305	0.9277
0.0026	343.0	22295	0.6083	0.7213	0.7443	0.7326	0.9286
0.0026	344.0	22360	0.6253	0.7275	0.7538	0.7404	0.9295
0.0026	345.0	22425	0.6554	0.7042	0.7808	0.7406	0.9277
0.0026	346.0	22490	0.6120	0.7288	0.7306	0.7297	0.9280
0.0015	347.0	22555	0.6236	0.7144	0.7576	0.7354	0.9296
0.0015	348.0	22620	0.6360	0.7166	0.7643	0.7397	0.9307
0.0015	349.0	22685	0.6313	0.7173	0.7616	0.7388	0.9302
0.0015	350.0	22750	0.6344	0.7301	0.7479	0.7389	0.9299
0.0015	351.0	22815	0.6111	0.7113	0.7870	0.7472	0.9300
0.0015	352.0	22880	0.6286	0.7349	0.7482	0.7415	0.9306
0.0015	353.0	22945	0.6342	0.7258	0.7727	0.7485	0.9313
0.0008	354.0	23010	0.6729	0.7148	0.7789	0.7454	0.9297
0.0008	355.0	23075	0.6213	0.7179	0.7639	0.7402	0.9296
0.0008	356.0	23140	0.6395	0.7273	0.7556	0.7412	0.9296
0.0008	357.0	23205	0.6439	0.7243	0.7560	0.7398	0.9299
0.0008	358.0	23270	0.7104	0.7329	0.7383	0.7356	0.9283
0.0008	359.0	23335	0.7150	0.7094	0.7558	0.7319	0.9279
0.0008	360.0	23400	0.6514	0.7302	0.7412	0.7357	0.9297
0.0008	361.0	23465	0.6533	0.7300	0.7574	0.7434	0.9308
0.0013	362.0	23530	0.6617	0.7399	0.7490	0.7444	0.9312
0.0013	363.0	23595	0.6771	0.7237	0.7722	0.7472	0.9312
0.0013	364.0	23660	0.6824	0.7228	0.7664	0.7440	0.9311
0.0013	365.0	23725	0.6868	0.7274	0.7580	0.7424	0.9307
0.0013	366.0	23790	0.6828	0.7336	0.7542	0.7437	0.9305
0.0013	367.0	23855	0.6669	0.7201	0.7655	0.7421	0.9307
0.0013	368.0	23920	0.6729	0.7293	0.7646	0.7465	0.9307
0.0013	369.0	23985	0.6766	0.7285	0.7553	0.7416	0.9300
0.0006	370.0	24050	0.6301	0.7180	0.7814	0.7484	0.9312
0.0006	371.0	24115	0.6610	0.7274	0.7688	0.7475	0.9311
0.0006	372.0	24180	0.6835	0.7226	0.7675	0.7444	0.9315
0.0006	373.0	24245	0.6778	0.7346	0.7491	0.7418	0.9303
0.0006	374.0	24310	0.6544	0.7406	0.7599	0.7502	0.9317
0.0006	375.0	24375	0.6549	0.7214	0.7756	0.7475	0.9314
0.0006	376.0	24440	0.6871	0.7214	0.7686	0.7443	0.9306
0.0009	377.0	24505	0.6714	0.7215	0.7744	0.7470	0.9316
0.0009	378.0	24570	0.6751	0.7340	0.7527	0.7432	0.9298
0.0009	379.0	24635	0.6599	0.7198	0.7722	0.7451	0.9315
0.0009	380.0	24700	0.6418	0.7363	0.7479	0.7421	0.9310
0.0009	381.0	24765	0.6480	0.7159	0.7765	0.7450	0.9324
0.0009	382.0	24830	0.6738	0.7266	0.7778	0.7513	0.9324
0.0009	383.0	24895	0.6758	0.7331	0.7655	0.7489	0.9325
0.0009	384.0	24960	0.7180	0.7092	0.7763	0.7412	0.9295
0.0009	385.0	25025	0.6652	0.7335	0.7553	0.7442	0.9315
0.0009	386.0	25090	0.6265	0.7314	0.7664	0.7485	0.9329
0.0009	387.0	25155	0.6247	0.7284	0.7715	0.7493	0.9314
0.0009	388.0	25220	0.6193	0.7275	0.7760	0.7510	0.9323
0.0009	389.0	25285	0.6515	0.7346	0.7556	0.7450	0.9305
0.0009	390.0	25350	0.6237	0.7179	0.7599	0.7383	0.9304
0.0009	391.0	25415	0.6286	0.7246	0.7731	0.7480	0.9314
0.0009	392.0	25480	0.6504	0.7295	0.7578	0.7434	0.9316
0.001	393.0	25545	0.6569	0.7342	0.7508	0.7424	0.9312
0.001	394.0	25610	0.6598	0.7361	0.7736	0.7544	0.9318
0.001	395.0	25675	0.6699	0.7317	0.7702	0.7505	0.9322
0.001	396.0	25740	0.6536	0.7315	0.7500	0.7406	0.9306
0.001	397.0	25805	0.6638	0.7293	0.7679	0.7481	0.9312
0.001	398.0	25870	0.6478	0.7264	0.7758	0.7503	0.9326
0.001	399.0	25935	0.6592	0.7234	0.7749	0.7483	0.9326
0.0005	400.0	26000	0.6534	0.7298	0.7610	0.7451	0.9317
0.0005	401.0	26065	0.6571	0.7356	0.7605	0.7478	0.9321
0.0005	402.0	26130	0.6599	0.7333	0.7803	0.7561	0.9328
0.0005	403.0	26195	0.6516	0.7210	0.7684	0.7440	0.9313
0.0005	404.0	26260	0.6303	0.7275	0.7538	0.7404	0.9307
0.0005	405.0	26325	0.6301	0.7407	0.7681	0.7541	0.9327
0.0005	406.0	26390	0.6513	0.7296	0.7713	0.7499	0.9325
0.0005	407.0	26455	0.6434	0.7428	0.7618	0.7521	0.9326
0.0006	408.0	26520	0.6576	0.7271	0.7812	0.7532	0.9329
0.0006	409.0	26585	0.6573	0.7356	0.7691	0.7520	0.9332
0.0006	410.0	26650	0.6646	0.7358	0.7718	0.7534	0.9319
0.0006	411.0	26715	0.6954	0.7327	0.7652	0.7486	0.9322
0.0006	412.0	26780	0.7009	0.7203	0.7742	0.7463	0.9313
0.0006	413.0	26845	0.6730	0.7385	0.7781	0.7578	0.9324
0.0006	414.0	26910	0.6644	0.7397	0.7733	0.7561	0.9330
0.0006	415.0	26975	0.6640	0.7343	0.7753	0.7542	0.9324
0.0005	416.0	27040	0.6604	0.7343	0.7731	0.7532	0.9328
0.0005	417.0	27105	0.6639	0.7406	0.7711	0.7555	0.9326
0.0005	418.0	27170	0.6614	0.7220	0.7848	0.7521	0.9319
0.0005	419.0	27235	0.6744	0.7340	0.7699	0.7515	0.9316
0.0005	420.0	27300	0.6854	0.7350	0.7648	0.7496	0.9316
0.0005	421.0	27365	0.6882	0.7395	0.7699	0.7544	0.9330
0.0005	422.0	27430	0.7170	0.7378	0.7567	0.7472	0.9312
0.0005	423.0	27495	0.7041	0.7355	0.7511	0.7432	0.9313
0.0003	424.0	27560	0.7173	0.7295	0.7562	0.7426	0.9300
0.0003	425.0	27625	0.7055	0.7289	0.7659	0.7469	0.9311
0.0003	426.0	27690	0.7082	0.7272	0.7670	0.7465	0.9310
0.0003	427.0	27755	0.7026	0.7323	0.7718	0.7515	0.9321
0.0003	428.0	27820	0.7085	0.7454	0.7517	0.7485	0.9314
0.0003	429.0	27885	0.7117	0.7335	0.7563	0.7447	0.9321
0.0003	430.0	27950	0.7928	0.7089	0.7661	0.7364	0.9268
0.0003	431.0	28015	0.6940	0.7363	0.7583	0.7472	0.9314
0.0003	432.0	28080	0.7003	0.7332	0.7729	0.7525	0.9324
0.0003	433.0	28145	0.6943	0.7286	0.7677	0.7476	0.9317
0.0003	434.0	28210	0.7012	0.7317	0.7587	0.7449	0.9312
0.0003	435.0	28275	0.7172	0.7241	0.7578	0.7406	0.9302
0.0003	436.0	28340	0.7066	0.7357	0.7594	0.7474	0.9314
0.0003	437.0	28405	0.7081	0.7315	0.7745	0.7524	0.9325
0.0003	438.0	28470	0.7408	0.7442	0.7418	0.7430	0.9306
0.0002	439.0	28535	0.7146	0.7412	0.7727	0.7567	0.9322
0.0002	440.0	28600	0.7072	0.7383	0.7641	0.7510	0.9325
0.0002	441.0	28665	0.7075	0.7384	0.7621	0.7501	0.9319
0.0002	442.0	28730	0.7106	0.7382	0.7632	0.7505	0.9319
0.0002	443.0	28795	0.7048	0.7427	0.7556	0.7491	0.9317
0.0002	444.0	28860	0.7119	0.7463	0.7536	0.7499	0.9315
0.0002	445.0	28925	0.7219	0.7422	0.7563	0.7492	0.9313
0.0002	446.0	28990	0.7071	0.7283	0.7756	0.7512	0.9320
0.0003	447.0	29055	0.7017	0.7378	0.7704	0.7538	0.9322
0.0003	448.0	29120	0.7036	0.7414	0.7713	0.7560	0.9322
0.0003	449.0	29185	0.7080	0.7408	0.7618	0.7511	0.9321
0.0003	450.0	29250	0.7037	0.7303	0.7679	0.7486	0.9318
0.0003	451.0	29315	0.7024	0.7412	0.7590	0.7500	0.9317
0.0003	452.0	29380	0.7050	0.7407	0.7641	0.7522	0.9320
0.0003	453.0	29445	0.7087	0.7396	0.7677	0.7534	0.9321
0.0002	454.0	29510	0.7013	0.7423	0.7738	0.7577	0.9326
0.0002	455.0	29575	0.7111	0.7375	0.7762	0.7563	0.9325
0.0002	456.0	29640	0.7102	0.7428	0.7661	0.7543	0.9320
0.0002	457.0	29705	0.6937	0.7400	0.7554	0.7476	0.9320
0.0002	458.0	29770	0.7076	0.7287	0.7526	0.7404	0.9313
0.0002	459.0	29835	0.6911	0.7433	0.7727	0.7577	0.9333
0.0002	460.0	29900	0.6945	0.7443	0.7769	0.7602	0.9331
0.0002	461.0	29965	0.7062	0.7398	0.7733	0.7562	0.9326
0.0003	462.0	30030	0.7095	0.7351	0.7727	0.7535	0.9317
0.0003	463.0	30095	0.7056	0.7340	0.7805	0.7565	0.9328
0.0003	464.0	30160	0.7244	0.7289	0.7718	0.7498	0.9321
0.0003	465.0	30225	0.7179	0.7260	0.7706	0.7476	0.9317
0.0003	466.0	30290	0.7046	0.7253	0.7771	0.7503	0.9319
0.0003	467.0	30355	0.6995	0.7333	0.7713	0.7518	0.9321
0.0003	468.0	30420	0.7040	0.7394	0.7681	0.7535	0.9322
0.0003	469.0	30485	0.7173	0.7322	0.7700	0.7506	0.9323
0.0003	470.0	30550	0.7105	0.7360	0.7726	0.7538	0.9328
0.0003	471.0	30615	0.7117	0.7377	0.7718	0.7544	0.9328
0.0003	472.0	30680	0.7099	0.7395	0.7726	0.7557	0.9328
0.0003	473.0	30745	0.7089	0.7383	0.7717	0.7546	0.9328
0.0003	474.0	30810	0.7080	0.7427	0.7729	0.7575	0.9328
0.0003	475.0	30875	0.7092	0.7473	0.7646	0.7559	0.9329
0.0003	476.0	30940	0.7094	0.7398	0.7574	0.7485	0.9317
0.0002	477.0	31005	0.7067	0.7396	0.7648	0.7520	0.9323
0.0002	478.0	31070	0.7070	0.7405	0.7699	0.7549	0.9324
0.0002	479.0	31135	0.7070	0.7403	0.7715	0.7556	0.9325
0.0002	480.0	31200	0.7010	0.7356	0.7776	0.7560	0.9326
0.0002	481.0	31265	0.6975	0.7375	0.7810	0.7586	0.9327
0.0002	482.0	31330	0.7017	0.7412	0.7763	0.7584	0.9331
0.0002	483.0	31395	0.6996	0.7412	0.7740	0.7572	0.9330
0.0002	484.0	31460	0.7002	0.7405	0.7733	0.7565	0.9329
0.0001	485.0	31525	0.7009	0.7406	0.7736	0.7567	0.9329
0.0001	486.0	31590	0.7004	0.7404	0.7751	0.7573	0.9328
0.0001	487.0	31655	0.6998	0.7422	0.7747	0.7581	0.9328
0.0001	488.0	31720	0.7025	0.7416	0.7727	0.7569	0.9328
0.0001	489.0	31785	0.7040	0.7425	0.7720	0.7570	0.9328
0.0001	490.0	31850	0.7047	0.7415	0.7718	0.7564	0.9329
0.0001	491.0	31915	0.7044	0.7436	0.7690	0.7561	0.9330
0.0001	492.0	31980	0.7060	0.7412	0.7673	0.7540	0.9326
0.0001	493.0	32045	0.7053	0.7403	0.7681	0.7539	0.9325
0.0001	494.0	32110	0.7039	0.7419	0.7717	0.7565	0.9328
0.0001	495.0	32175	0.7031	0.7414	0.7727	0.7567	0.9329
0.0001	496.0	32240	0.7029	0.7408	0.7724	0.7562	0.9330
0.0001	497.0	32305	0.7032	0.7406	0.7722	0.7561	0.9330
0.0001	498.0	32370	0.7033	0.7422	0.7713	0.7564	0.9330
0.0001	499.0	32435	0.7034	0.7418	0.7708	0.7560	0.9329
0.0001	500.0	32500	0.7036	0.7424	0.7713	0.7566	0.9330

Framework versions

• Transformers 4.29.2
• Pytorch 2.0.1+cu117
• Datasets 2.12.0
• Tokenizers 0.13.3