bert-base-uncased_8_1039_token

This model is a fine-tuned version of bert-base-uncased on the bionlp2004 dataset. It achieves the following results on the evaluation set:

• Loss: 0.7191
• Precision: 0.7311
• Recall: 0.7648
• F1: 0.7476
• Accuracy: 0.9327

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.001
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 500

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
No log	1.0	65	0.3785	0.3534	0.4596	0.3996	0.8659
No log	2.0	130	0.2718	0.5366	0.6877	0.6028	0.9072
No log	3.0	195	0.2542	0.6101	0.6434	0.6263	0.9140
No log	4.0	260	0.2302	0.6304	0.7054	0.6658	0.9248
No log	5.0	325	0.2327	0.6415	0.7315	0.6836	0.9255
No log	6.0	390	0.2576	0.6277	0.7418	0.6800	0.9193
No log	7.0	455	0.2431	0.6615	0.7425	0.6996	0.9263
0.2489	8.0	520	0.2490	0.6756	0.7184	0.6963	0.9276
0.2489	9.0	585	0.2702	0.6773	0.7268	0.7012	0.9262
0.2489	10.0	650	0.2941	0.6335	0.6632	0.6480	0.9193
0.2489	11.0	715	0.2777	0.6975	0.7502	0.7229	0.9305
0.2489	12.0	780	0.2879	0.6850	0.7517	0.7168	0.9290
0.2489	13.0	845	0.3211	0.6839	0.6834	0.6837	0.9240
0.2489	14.0	910	0.3036	0.6808	0.6910	0.6859	0.9259
0.2489	15.0	975	0.3149	0.6666	0.7108	0.6880	0.9241
0.0766	16.0	1040	0.3416	0.6635	0.6917	0.6773	0.9232
0.0766	17.0	1105	0.3478	0.6630	0.7302	0.6950	0.9239
0.0766	18.0	1170	0.3316	0.6703	0.7581	0.7115	0.9273
0.0766	19.0	1235	0.3510	0.6918	0.7054	0.6985	0.9254
0.0766	20.0	1300	0.3560	0.6817	0.7299	0.7050	0.9269
0.0766	21.0	1365	0.3641	0.6678	0.7313	0.6981	0.9262
0.0766	22.0	1430	0.3408	0.6826	0.7292	0.7051	0.9268
0.0766	23.0	1495	0.3689	0.6772	0.7238	0.6997	0.9259
0.0406	24.0	1560	0.3782	0.6674	0.7443	0.7037	0.9259
0.0406	25.0	1625	0.4102	0.6744	0.6771	0.6758	0.9205
0.0406	26.0	1690	0.3654	0.6750	0.7297	0.7013	0.9277
0.0406	27.0	1755	0.4032	0.6721	0.7556	0.7114	0.9253
0.0406	28.0	1820	0.4372	0.6936	0.6865	0.6900	0.9231
0.0406	29.0	1885	0.3914	0.6761	0.7290	0.7016	0.9264
0.0406	30.0	1950	0.3967	0.6844	0.7337	0.7082	0.9266
0.0307	31.0	2015	0.4035	0.6858	0.7441	0.7138	0.9267
0.0307	32.0	2080	0.4173	0.6899	0.7461	0.7169	0.9284
0.0307	33.0	2145	0.3992	0.6826	0.7223	0.7019	0.9280
0.0307	34.0	2210	0.4192	0.6677	0.7637	0.7125	0.9280
0.0307	35.0	2275	0.4110	0.6990	0.7373	0.7176	0.9302
0.0307	36.0	2340	0.4688	0.6739	0.7034	0.6883	0.9210
0.0307	37.0	2405	0.4203	0.6834	0.7311	0.7065	0.9285
0.0307	38.0	2470	0.4597	0.6923	0.7452	0.7178	0.9277
0.0235	39.0	2535	0.4246	0.6790	0.7484	0.7120	0.9264
0.0235	40.0	2600	0.4335	0.6906	0.7286	0.7091	0.9274
0.0235	41.0	2665	0.4571	0.6786	0.7239	0.7005	0.9251
0.0235	42.0	2730	0.4273	0.6930	0.7340	0.7129	0.9282
0.0235	43.0	2795	0.4471	0.6981	0.7167	0.7073	0.9271
0.0235	44.0	2860	0.4520	0.6959	0.7290	0.7120	0.9273
0.0235	45.0	2925	0.4540	0.6946	0.7349	0.7142	0.9272
0.0235	46.0	2990	0.4478	0.6826	0.7497	0.7146	0.9286
0.0188	47.0	3055	0.4538	0.6951	0.7414	0.7175	0.9278
0.0188	48.0	3120	0.4738	0.6954	0.7247	0.7097	0.9276
0.0188	49.0	3185	0.4915	0.7057	0.7338	0.7195	0.9287
0.0188	50.0	3250	0.4568	0.6989	0.7382	0.7180	0.9285
0.0188	51.0	3315	0.5172	0.6901	0.7137	0.7017	0.9223
0.0188	52.0	3380	0.4803	0.6842	0.7290	0.7059	0.9267
0.0188	53.0	3445	0.4312	0.7015	0.7405	0.7205	0.9297
0.0169	54.0	3510	0.4340	0.6825	0.7430	0.7115	0.9286
0.0169	55.0	3575	0.4535	0.6941	0.7583	0.7248	0.9292
0.0169	56.0	3640	0.4922	0.6897	0.7630	0.7245	0.9292
0.0169	57.0	3705	0.4889	0.6900	0.7551	0.7211	0.9283
0.0169	58.0	3770	0.4814	0.6869	0.7396	0.7123	0.9266
0.0169	59.0	3835	0.4799	0.6764	0.7659	0.7184	0.9275
0.0169	60.0	3900	0.4813	0.6687	0.7524	0.7081	0.9275
0.0169	61.0	3965	0.4561	0.7081	0.7526	0.7296	0.9297
0.0165	62.0	4030	0.4537	0.7002	0.7360	0.7176	0.9277
0.0165	63.0	4095	0.4793	0.6933	0.7509	0.7210	0.9268
0.0165	64.0	4160	0.4645	0.7157	0.7162	0.7159	0.9274
0.0165	65.0	4225	0.4886	0.6939	0.7169	0.7052	0.9263
0.0165	66.0	4290	0.4707	0.6714	0.7639	0.7147	0.9253
0.0165	67.0	4355	0.4768	0.6783	0.7535	0.7139	0.9292
0.0165	68.0	4420	0.4601	0.6868	0.7430	0.7138	0.9280
0.0165	69.0	4485	0.4411	0.7076	0.7371	0.7221	0.9301
0.0134	70.0	4550	0.5118	0.6811	0.7383	0.7085	0.9277
0.0134	71.0	4615	0.4723	0.6908	0.7455	0.7171	0.9283
0.0134	72.0	4680	0.4940	0.6939	0.7196	0.7065	0.9257
0.0134	73.0	4745	0.5030	0.6870	0.7443	0.7145	0.9276
0.0134	74.0	4810	0.4606	0.6834	0.7398	0.7105	0.9283
0.0134	75.0	4875	0.4554	0.6904	0.7614	0.7242	0.9305
0.0134	76.0	4940	0.5056	0.6926	0.7241	0.7080	0.9263
0.0136	77.0	5005	0.5137	0.6537	0.7371	0.6929	0.9224
0.0136	78.0	5070	0.4599	0.6891	0.7252	0.7067	0.9264
0.0136	79.0	5135	0.4919	0.6916	0.7641	0.7260	0.9292
0.0136	80.0	5200	0.4656	0.6801	0.7513	0.7140	0.9279
0.0136	81.0	5265	0.4895	0.6856	0.7592	0.7206	0.9282
0.0136	82.0	5330	0.4975	0.69	0.7331	0.7109	0.9268
0.0136	83.0	5395	0.4889	0.6984	0.7679	0.7315	0.9291
0.0136	84.0	5460	0.4989	0.6934	0.7446	0.7181	0.9279
0.0142	85.0	5525	0.4927	0.7045	0.7382	0.7210	0.9292
0.0142	86.0	5590	0.5044	0.6862	0.7322	0.7085	0.9253
0.0142	87.0	5655	0.4977	0.6834	0.7434	0.7122	0.9263
0.0142	88.0	5720	0.5068	0.6750	0.7675	0.7183	0.9275
0.0142	89.0	5785	0.5193	0.6946	0.7531	0.7227	0.9286
0.0142	90.0	5850	0.5418	0.6953	0.7497	0.7215	0.9282
0.0142	91.0	5915	0.5780	0.7030	0.7315	0.7170	0.9273
0.0142	92.0	5980	0.5278	0.6825	0.6937	0.6880	0.9224
0.0112	93.0	6045	0.5053	0.7089	0.7333	0.7209	0.9275
0.0112	94.0	6110	0.5550	0.7067	0.6926	0.6996	0.9231
0.0112	95.0	6175	0.5253	0.6830	0.7610	0.7199	0.9262
0.0112	96.0	6240	0.5264	0.6906	0.7495	0.7188	0.9267
0.0112	97.0	6305	0.5120	0.6988	0.7533	0.7250	0.9284
0.0112	98.0	6370	0.5490	0.7072	0.7160	0.7116	0.9266
0.0112	99.0	6435	0.4795	0.7063	0.7526	0.7287	0.9298
0.0115	100.0	6500	0.5181	0.6969	0.7382	0.7169	0.9281
0.0115	101.0	6565	0.5245	0.6909	0.7355	0.7125	0.9273
0.0115	102.0	6630	0.5008	0.6837	0.7704	0.7245	0.9282
0.0115	103.0	6695	0.5059	0.6833	0.7481	0.7142	0.9267
0.0115	104.0	6760	0.5299	0.7057	0.7279	0.7166	0.9280
0.0115	105.0	6825	0.4829	0.7054	0.7416	0.7230	0.9299
0.0115	106.0	6890	0.5247	0.7062	0.7463	0.7257	0.9284
0.0115	107.0	6955	0.5306	0.7067	0.7603	0.7325	0.9309
0.0096	108.0	7020	0.5252	0.6885	0.7481	0.7171	0.9263
0.0096	109.0	7085	0.4961	0.7094	0.7407	0.7247	0.9306
0.0096	110.0	7150	0.5659	0.6912	0.7369	0.7133	0.9266
0.0096	111.0	7215	0.5572	0.6765	0.7682	0.7195	0.9268
0.0096	112.0	7280	0.5170	0.7190	0.7360	0.7274	0.9305
0.0096	113.0	7345	0.5140	0.6973	0.7274	0.7120	0.9276
0.0096	114.0	7410	0.5507	0.7096	0.7520	0.7302	0.9298
0.0096	115.0	7475	0.5813	0.6944	0.7337	0.7135	0.9271
0.0087	116.0	7540	0.5431	0.7079	0.7423	0.7247	0.9288
0.0087	117.0	7605	0.5649	0.6867	0.7596	0.7213	0.9275
0.0087	118.0	7670	0.5577	0.6856	0.7576	0.7198	0.9267
0.0087	119.0	7735	0.5189	0.7107	0.7448	0.7273	0.9296
0.0087	120.0	7800	0.4997	0.7024	0.7268	0.7144	0.9283
0.0087	121.0	7865	0.5347	0.6838	0.7594	0.7196	0.9274
0.0087	122.0	7930	0.5074	0.6986	0.7329	0.7154	0.9280
0.0087	123.0	7995	0.5455	0.6925	0.7661	0.7274	0.9279
0.0094	124.0	8060	0.5187	0.6858	0.7681	0.7246	0.9295
0.0094	125.0	8125	0.5379	0.6918	0.7574	0.7231	0.9290
0.0094	126.0	8190	0.5108	0.6963	0.7500	0.7221	0.9286
0.0094	127.0	8255	0.5201	0.7093	0.7612	0.7344	0.9300
0.0094	128.0	8320	0.5498	0.6975	0.7536	0.7245	0.9290
0.0094	129.0	8385	0.5157	0.7128	0.7464	0.7292	0.9293
0.0094	130.0	8450	0.5246	0.7044	0.7446	0.7240	0.9281
0.0083	131.0	8515	0.5290	0.6857	0.7391	0.7114	0.9254
0.0083	132.0	8580	0.5479	0.6919	0.7400	0.7151	0.9266
0.0083	133.0	8645	0.5500	0.7084	0.7207	0.7145	0.9279
0.0083	134.0	8710	0.5646	0.6755	0.7572	0.7140	0.9235
0.0083	135.0	8775	0.5731	0.6871	0.7290	0.7074	0.9247
0.0083	136.0	8840	0.5839	0.6946	0.7421	0.7176	0.9279
0.0083	137.0	8905	0.5546	0.6814	0.7715	0.7236	0.9275
0.0083	138.0	8970	0.5774	0.7080	0.7205	0.7142	0.9252
0.008	139.0	9035	0.5790	0.7026	0.7585	0.7295	0.9292
0.008	140.0	9100	0.5969	0.7078	0.7389	0.7230	0.9290
0.008	141.0	9165	0.5879	0.7129	0.7335	0.7231	0.9270
0.008	142.0	9230	0.5642	0.6920	0.7749	0.7311	0.9286
0.008	143.0	9295	0.5660	0.6920	0.7317	0.7113	0.9243
0.008	144.0	9360	0.5383	0.7210	0.7454	0.7330	0.9303
0.008	145.0	9425	0.5516	0.6899	0.7625	0.7244	0.9285
0.008	146.0	9490	0.5800	0.7001	0.7504	0.7244	0.9279
0.0077	147.0	9555	0.5994	0.6904	0.7538	0.7207	0.9271
0.0077	148.0	9620	0.5490	0.6971	0.7605	0.7274	0.9286
0.0077	149.0	9685	0.5419	0.7037	0.7331	0.7181	0.9277
0.0077	150.0	9750	0.5677	0.7030	0.7590	0.7299	0.9286
0.0077	151.0	9815	0.5506	0.7133	0.7576	0.7348	0.9306
0.0077	152.0	9880	0.5485	0.7170	0.7531	0.7346	0.9305
0.0077	153.0	9945	0.5387	0.7140	0.7508	0.7319	0.9305
0.0074	154.0	10010	0.5367	0.7082	0.7409	0.7242	0.9285
0.0074	155.0	10075	0.5347	0.7194	0.7434	0.7312	0.9313
0.0074	156.0	10140	0.5098	0.7002	0.7493	0.7239	0.9303
0.0074	157.0	10205	0.5244	0.7072	0.7556	0.7306	0.9313
0.0074	158.0	10270	0.5308	0.6972	0.7459	0.7207	0.9286
0.0074	159.0	10335	0.5254	0.7082	0.7418	0.7246	0.9302
0.0074	160.0	10400	0.5290	0.7012	0.7627	0.7306	0.9308
0.0074	161.0	10465	0.5579	0.6890	0.7450	0.7159	0.9271
0.0063	162.0	10530	0.5626	0.7027	0.7740	0.7367	0.9286
0.0063	163.0	10595	0.5592	0.6973	0.7587	0.7267	0.9287
0.0063	164.0	10660	0.5477	0.7021	0.7484	0.7245	0.9286
0.0063	165.0	10725	0.5554	0.6906	0.7400	0.7144	0.9269
0.0063	166.0	10790	0.5559	0.7128	0.7527	0.7322	0.9296
0.0063	167.0	10855	0.5043	0.7081	0.7333	0.7205	0.9281
0.0063	168.0	10920	0.5417	0.7009	0.7556	0.7272	0.9287
0.0063	169.0	10985	0.5428	0.7145	0.7410	0.7275	0.9281
0.0075	170.0	11050	0.5807	0.6804	0.7576	0.7169	0.9259
0.0075	171.0	11115	0.6278	0.6838	0.7409	0.7112	0.9255
0.0075	172.0	11180	0.5789	0.7049	0.7360	0.7201	0.9276
0.0075	173.0	11245	0.5873	0.6980	0.7256	0.7115	0.9270
0.0075	174.0	11310	0.5459	0.6911	0.7774	0.7317	0.9290
0.0075	175.0	11375	0.5281	0.7018	0.7535	0.7267	0.9294
0.0075	176.0	11440	0.5366	0.7141	0.7506	0.7319	0.9294
0.006	177.0	11505	0.5741	0.7062	0.7531	0.7289	0.9298
0.006	178.0	11570	0.5661	0.6983	0.7589	0.7273	0.9290
0.006	179.0	11635	0.5913	0.7179	0.7373	0.7274	0.9293
0.006	180.0	11700	0.5723	0.7236	0.7452	0.7342	0.9300
0.006	181.0	11765	0.6079	0.7217	0.7405	0.7310	0.9287
0.006	182.0	11830	0.5710	0.6981	0.7162	0.7070	0.9238
0.006	183.0	11895	0.5895	0.7091	0.7468	0.7275	0.9289
0.006	184.0	11960	0.5970	0.6882	0.7652	0.7247	0.9285
0.0059	185.0	12025	0.5658	0.6849	0.7580	0.7196	0.9278
0.0059	186.0	12090	0.5282	0.6981	0.7320	0.7147	0.9267
0.0059	187.0	12155	0.5622	0.7084	0.7502	0.7287	0.9293
0.0059	188.0	12220	0.5713	0.6991	0.7497	0.7235	0.9289
0.0059	189.0	12285	0.5848	0.6926	0.7789	0.7332	0.9270
0.0059	190.0	12350	0.5561	0.7055	0.7657	0.7344	0.9298
0.0059	191.0	12415	0.5761	0.7040	0.7405	0.7218	0.9269
0.0059	192.0	12480	0.6216	0.6911	0.7430	0.7161	0.9264
0.0059	193.0	12545	0.6137	0.7116	0.7459	0.7283	0.9295
0.0059	194.0	12610	0.5797	0.6929	0.7630	0.7263	0.9289
0.0059	195.0	12675	0.5176	0.7081	0.7675	0.7366	0.9319
0.0059	196.0	12740	0.5698	0.7042	0.7356	0.7196	0.9273
0.0059	197.0	12805	0.5592	0.7042	0.7396	0.7215	0.9293
0.0059	198.0	12870	0.5740	0.7015	0.7313	0.7161	0.9271
0.0059	199.0	12935	0.5589	0.7190	0.7311	0.7250	0.9297
0.0058	200.0	13000	0.5749	0.6847	0.7717	0.7256	0.9287
0.0058	201.0	13065	0.5486	0.7161	0.7663	0.7403	0.9313
0.0058	202.0	13130	0.5279	0.7108	0.7218	0.7162	0.9281
0.0058	203.0	13195	0.5850	0.7102	0.7252	0.7176	0.9273
0.0058	204.0	13260	0.6231	0.6969	0.7771	0.7348	0.9283
0.0058	205.0	13325	0.5637	0.6968	0.7740	0.7334	0.9277
0.0058	206.0	13390	0.5366	0.7017	0.7308	0.7159	0.9279
0.0058	207.0	13455	0.5978	0.7098	0.7250	0.7173	0.9267
0.0055	208.0	13520	0.5603	0.6980	0.7599	0.7276	0.9295
0.0055	209.0	13585	0.5780	0.6930	0.7407	0.7161	0.9275
0.0055	210.0	13650	0.5846	0.7038	0.7572	0.7295	0.9283
0.0055	211.0	13715	0.6297	0.7018	0.7250	0.7132	0.9241
0.0055	212.0	13780	0.5818	0.7143	0.7173	0.7158	0.9276
0.0055	213.0	13845	0.6260	0.6879	0.7454	0.7155	0.9252
0.0055	214.0	13910	0.6031	0.7072	0.7578	0.7316	0.9284
0.0055	215.0	13975	0.5846	0.6954	0.7684	0.7301	0.9279
0.0044	216.0	14040	0.5741	0.7067	0.7328	0.7195	0.9265
0.0044	217.0	14105	0.5848	0.7186	0.7389	0.7286	0.9291
0.0044	218.0	14170	0.5496	0.7163	0.7248	0.7206	0.9269
0.0044	219.0	14235	0.5700	0.7089	0.7520	0.7298	0.9288
0.0044	220.0	14300	0.5664	0.7063	0.7427	0.7240	0.9280
0.0044	221.0	14365	0.5573	0.7173	0.7618	0.7389	0.9324
0.0044	222.0	14430	0.5588	0.7151	0.7690	0.7411	0.9324
0.0044	223.0	14495	0.5809	0.7129	0.7455	0.7289	0.9294
0.0037	224.0	14560	0.6135	0.6921	0.7621	0.7254	0.9281
0.0037	225.0	14625	0.6160	0.6890	0.7383	0.7128	0.9251
0.0037	226.0	14690	0.5938	0.6887	0.7508	0.7184	0.9270
0.0037	227.0	14755	0.5687	0.7076	0.7473	0.7269	0.9296
0.0037	228.0	14820	0.5785	0.7097	0.7517	0.7301	0.9283
0.0037	229.0	14885	0.5675	0.6869	0.7470	0.7157	0.9270
0.0037	230.0	14950	0.5937	0.7077	0.7524	0.7293	0.9289
0.0046	231.0	15015	0.5650	0.7097	0.7414	0.7252	0.9294
0.0046	232.0	15080	0.5820	0.7038	0.7745	0.7375	0.9307
0.0046	233.0	15145	0.6118	0.7124	0.7432	0.7275	0.9284
0.0046	234.0	15210	0.6100	0.7055	0.7544	0.7291	0.9297
0.0046	235.0	15275	0.5869	0.7149	0.7592	0.7364	0.9302
0.0046	236.0	15340	0.5881	0.7169	0.7616	0.7386	0.9305
0.0046	237.0	15405	0.5616	0.7188	0.7380	0.7283	0.9315
0.0046	238.0	15470	0.5785	0.7176	0.7320	0.7247	0.9281
0.0047	239.0	15535	0.5979	0.7159	0.7466	0.7310	0.9279
0.0047	240.0	15600	0.5732	0.7075	0.7533	0.7297	0.9303
0.0047	241.0	15665	0.5732	0.7111	0.7421	0.7263	0.9294
0.0047	242.0	15730	0.5516	0.7198	0.7382	0.7288	0.9292
0.0047	243.0	15795	0.5505	0.7073	0.7697	0.7372	0.9310
0.0047	244.0	15860	0.5677	0.7163	0.7428	0.7293	0.9303
0.0047	245.0	15925	0.5815	0.7191	0.7302	0.7246	0.9286
0.0047	246.0	15990	0.6044	0.7099	0.7497	0.7293	0.9287
0.0042	247.0	16055	0.5540	0.7144	0.7558	0.7345	0.9302
0.0042	248.0	16120	0.5498	0.7219	0.7581	0.7396	0.9320
0.0042	249.0	16185	0.6078	0.7152	0.7428	0.7287	0.9303
0.0042	250.0	16250	0.6523	0.7152	0.7286	0.7219	0.9279
0.0042	251.0	16315	0.6075	0.7184	0.7621	0.7396	0.9319
0.0042	252.0	16380	0.6071	0.7108	0.7648	0.7368	0.9302
0.0042	253.0	16445	0.5849	0.7196	0.7367	0.7281	0.9308
0.0031	254.0	16510	0.5892	0.7141	0.7652	0.7388	0.9316
0.0031	255.0	16575	0.5991	0.7174	0.7310	0.7241	0.9273
0.0031	256.0	16640	0.6051	0.7240	0.7358	0.7298	0.9288
0.0031	257.0	16705	0.5621	0.7267	0.7560	0.7410	0.9320
0.0031	258.0	16770	0.5838	0.7165	0.7607	0.7379	0.9314
0.0031	259.0	16835	0.5713	0.7092	0.7709	0.7388	0.9318
0.0031	260.0	16900	0.5902	0.7243	0.7499	0.7369	0.9314
0.0031	261.0	16965	0.6098	0.716	0.7414	0.7285	0.9288
0.0029	262.0	17030	0.5979	0.7193	0.7502	0.7344	0.9308
0.0029	263.0	17095	0.6314	0.7077	0.7455	0.7261	0.9287
0.0029	264.0	17160	0.6227	0.6870	0.7360	0.7107	0.9261
0.0029	265.0	17225	0.5925	0.6997	0.7509	0.7244	0.9283
0.0029	266.0	17290	0.6090	0.7049	0.7428	0.7234	0.9274
0.0029	267.0	17355	0.5929	0.7082	0.7508	0.7288	0.9294
0.0029	268.0	17420	0.5661	0.7013	0.7560	0.7276	0.9293
0.0029	269.0	17485	0.6482	0.7223	0.7439	0.7330	0.9277
0.0036	270.0	17550	0.5838	0.7123	0.7479	0.7297	0.9300
0.0036	271.0	17615	0.5947	0.7220	0.7194	0.7207	0.9272
0.0036	272.0	17680	0.5878	0.7198	0.7416	0.7305	0.9292
0.0036	273.0	17745	0.5592	0.7120	0.7684	0.7391	0.9320
0.0036	274.0	17810	0.5885	0.7163	0.7513	0.7334	0.9297
0.0036	275.0	17875	0.5953	0.7091	0.7497	0.7288	0.9282
0.0036	276.0	17940	0.6116	0.7178	0.7457	0.7315	0.9294
0.0028	277.0	18005	0.6008	0.7201	0.7614	0.7402	0.9313
0.0028	278.0	18070	0.5998	0.7236	0.7452	0.7342	0.9311
0.0028	279.0	18135	0.6165	0.7018	0.7594	0.7295	0.9292
0.0028	280.0	18200	0.5834	0.7262	0.7452	0.7356	0.9312
0.0028	281.0	18265	0.6081	0.7072	0.7643	0.7346	0.9302
0.0028	282.0	18330	0.5909	0.6981	0.7580	0.7268	0.9301
0.0028	283.0	18395	0.6065	0.7155	0.7313	0.7233	0.9277
0.0028	284.0	18460	0.5695	0.7201	0.7454	0.7325	0.9306
0.0031	285.0	18525	0.6007	0.7173	0.7455	0.7311	0.9289
0.0031	286.0	18590	0.5894	0.7041	0.7488	0.7258	0.9284
0.0031	287.0	18655	0.6207	0.7082	0.7301	0.7190	0.9277
0.0031	288.0	18720	0.5907	0.7171	0.7488	0.7326	0.9303
0.0031	289.0	18785	0.6165	0.7199	0.7374	0.7286	0.9298
0.0031	290.0	18850	0.6304	0.7277	0.7419	0.7347	0.9297
0.0031	291.0	18915	0.6379	0.7132	0.7605	0.7361	0.9310
0.0031	292.0	18980	0.6186	0.7226	0.7553	0.7386	0.9307
0.0027	293.0	19045	0.6400	0.7125	0.7551	0.7332	0.9297
0.0027	294.0	19110	0.6244	0.7197	0.7527	0.7359	0.9305
0.0027	295.0	19175	0.6283	0.7200	0.7648	0.7417	0.9309
0.0027	296.0	19240	0.6233	0.7166	0.7563	0.7359	0.9304
0.0027	297.0	19305	0.6241	0.7288	0.7583	0.7433	0.9318
0.0027	298.0	19370	0.6316	0.7266	0.7450	0.7357	0.9299
0.0027	299.0	19435	0.6733	0.7185	0.7434	0.7307	0.9290
0.0018	300.0	19500	0.5783	0.7280	0.7506	0.7391	0.9323
0.0018	301.0	19565	0.6198	0.7086	0.7693	0.7377	0.9303
0.0018	302.0	19630	0.6555	0.7151	0.7508	0.7325	0.9273
0.0018	303.0	19695	0.6122	0.7132	0.7616	0.7366	0.9281
0.0018	304.0	19760	0.6051	0.7082	0.7542	0.7304	0.9294
0.0018	305.0	19825	0.6306	0.7282	0.7405	0.7343	0.9306
0.0018	306.0	19890	0.5903	0.7161	0.7650	0.7397	0.9313
0.0018	307.0	19955	0.6170	0.7169	0.7711	0.7430	0.9318
0.0023	308.0	20020	0.5948	0.7229	0.7596	0.7408	0.9314
0.0023	309.0	20085	0.6176	0.7187	0.7652	0.7412	0.9312
0.0023	310.0	20150	0.6166	0.7219	0.7576	0.7393	0.9305
0.0023	311.0	20215	0.6239	0.7230	0.7646	0.7432	0.9305
0.0023	312.0	20280	0.6458	0.7172	0.7641	0.7399	0.9311
0.0023	313.0	20345	0.6546	0.7112	0.7841	0.7459	0.9310
0.0023	314.0	20410	0.6326	0.7273	0.7627	0.7445	0.9312
0.0023	315.0	20475	0.6073	0.7248	0.7574	0.7408	0.9314
0.0016	316.0	20540	0.6442	0.7169	0.7673	0.7412	0.9303
0.0016	317.0	20605	0.6380	0.7215	0.7608	0.7406	0.9305
0.0016	318.0	20670	0.6590	0.7126	0.7461	0.7290	0.9280
0.0016	319.0	20735	0.6474	0.7178	0.7594	0.7380	0.9292
0.0016	320.0	20800	0.6006	0.7071	0.7729	0.7385	0.9302
0.0016	321.0	20865	0.6207	0.7274	0.7488	0.7380	0.9309
0.0016	322.0	20930	0.6735	0.7032	0.7679	0.7341	0.9277
0.0016	323.0	20995	0.6733	0.7056	0.7376	0.7213	0.9271
0.0018	324.0	21060	0.6851	0.6920	0.7288	0.7099	0.9245
0.0018	325.0	21125	0.6069	0.7245	0.7562	0.7400	0.9308
0.0018	326.0	21190	0.6677	0.7148	0.7562	0.7349	0.9299
0.0018	327.0	21255	0.6671	0.7057	0.7371	0.7210	0.9270
0.0018	328.0	21320	0.6393	0.7088	0.7506	0.7291	0.9285
0.0018	329.0	21385	0.6455	0.7186	0.7628	0.7400	0.9309
0.0018	330.0	21450	0.6320	0.7349	0.7358	0.7354	0.9301
0.0023	331.0	21515	0.6373	0.7281	0.7645	0.7458	0.9322
0.0023	332.0	21580	0.6545	0.7221	0.7504	0.7360	0.9305
0.0023	333.0	21645	0.6490	0.7188	0.7499	0.7340	0.9298
0.0023	334.0	21710	0.6504	0.7053	0.7623	0.7327	0.9305
0.0023	335.0	21775	0.6364	0.7196	0.7578	0.7382	0.9318
0.0023	336.0	21840	0.6697	0.7205	0.7389	0.7296	0.9293
0.0023	337.0	21905	0.6477	0.7156	0.7594	0.7369	0.9297
0.0023	338.0	21970	0.6673	0.6943	0.7634	0.7272	0.9280
0.0015	339.0	22035	0.6527	0.7253	0.7545	0.7396	0.9301
0.0015	340.0	22100	0.6479	0.7083	0.7310	0.7194	0.9262
0.0015	341.0	22165	0.6228	0.7179	0.7508	0.7340	0.9288
0.0015	342.0	22230	0.6324	0.6975	0.7706	0.7322	0.9280
0.0015	343.0	22295	0.6646	0.7212	0.7434	0.7321	0.9289
0.0015	344.0	22360	0.6601	0.7298	0.7329	0.7314	0.9281
0.0015	345.0	22425	0.6535	0.7191	0.7495	0.7340	0.9298
0.0015	346.0	22490	0.6840	0.7189	0.7437	0.7311	0.9284
0.0021	347.0	22555	0.6934	0.7214	0.7266	0.7240	0.9274
0.0021	348.0	22620	0.6449	0.7097	0.7326	0.7210	0.9282
0.0021	349.0	22685	0.6576	0.7119	0.7520	0.7314	0.9281
0.0021	350.0	22750	0.6672	0.7265	0.7473	0.7368	0.9301
0.0021	351.0	22815	0.6704	0.7193	0.7639	0.7410	0.9305
0.0021	352.0	22880	0.6893	0.7146	0.7648	0.7389	0.9299
0.0021	353.0	22945	0.6747	0.7299	0.7589	0.7441	0.9307
0.0013	354.0	23010	0.6942	0.7119	0.7650	0.7375	0.9285
0.0013	355.0	23075	0.7042	0.7223	0.7347	0.7284	0.9280
0.0013	356.0	23140	0.7009	0.7184	0.7666	0.7417	0.9313
0.0013	357.0	23205	0.6892	0.7262	0.7756	0.7501	0.9317
0.0013	358.0	23270	0.7022	0.7312	0.7607	0.7456	0.9311
0.0013	359.0	23335	0.7169	0.7067	0.7657	0.7350	0.9277
0.0013	360.0	23400	0.7329	0.7179	0.7551	0.7360	0.9273
0.0013	361.0	23465	0.7030	0.7242	0.7391	0.7316	0.9288
0.0007	362.0	23530	0.7063	0.7185	0.7529	0.7353	0.9290
0.0007	363.0	23595	0.7068	0.7239	0.7466	0.7351	0.9293
0.0007	364.0	23660	0.6959	0.7159	0.7722	0.7430	0.9303
0.0007	365.0	23725	0.7632	0.7015	0.7450	0.7226	0.9258
0.0007	366.0	23790	0.7022	0.7246	0.7301	0.7273	0.9268
0.0007	367.0	23855	0.6818	0.7161	0.7720	0.7430	0.9305
0.0007	368.0	23920	0.6895	0.7275	0.7578	0.7423	0.9311
0.0007	369.0	23985	0.6987	0.7124	0.7473	0.7295	0.9293
0.0016	370.0	24050	0.6857	0.7301	0.7531	0.7414	0.9310
0.0016	371.0	24115	0.7022	0.7271	0.7418	0.7344	0.9297
0.0016	372.0	24180	0.6936	0.7277	0.7672	0.7469	0.9313
0.0016	373.0	24245	0.6836	0.7240	0.7659	0.7444	0.9316
0.0016	374.0	24310	0.6868	0.7221	0.7576	0.7394	0.9311
0.0016	375.0	24375	0.6903	0.7315	0.7648	0.7478	0.9314
0.0016	376.0	24440	0.6973	0.7172	0.7700	0.7427	0.9315
0.0008	377.0	24505	0.6768	0.7233	0.7470	0.7349	0.9297
0.0008	378.0	24570	0.7004	0.7347	0.7171	0.7258	0.9273
0.0008	379.0	24635	0.6794	0.7267	0.7464	0.7364	0.9291
0.0008	380.0	24700	0.6835	0.7236	0.7599	0.7413	0.9298
0.0008	381.0	24765	0.6758	0.7188	0.7663	0.7417	0.9295
0.0008	382.0	24830	0.6731	0.7247	0.7542	0.7391	0.9304
0.0008	383.0	24895	0.6734	0.7232	0.7513	0.7370	0.9302
0.0008	384.0	24960	0.6849	0.7207	0.7673	0.7433	0.9305
0.001	385.0	25025	0.6711	0.7216	0.7533	0.7371	0.9297
0.001	386.0	25090	0.6792	0.7326	0.7508	0.7416	0.9298
0.001	387.0	25155	0.6708	0.7074	0.7603	0.7329	0.9284
0.001	388.0	25220	0.6708	0.7157	0.7468	0.7309	0.9282
0.001	389.0	25285	0.6720	0.7191	0.7639	0.7408	0.9292
0.001	390.0	25350	0.6690	0.7097	0.7738	0.7404	0.9291
0.001	391.0	25415	0.6585	0.7209	0.7599	0.7399	0.9304
0.001	392.0	25480	0.6568	0.7131	0.7717	0.7412	0.9313
0.0009	393.0	25545	0.6936	0.7104	0.7581	0.7335	0.9287
0.0009	394.0	25610	0.6739	0.7264	0.7639	0.7447	0.9316
0.0009	395.0	25675	0.7106	0.7215	0.7520	0.7364	0.9301
0.0009	396.0	25740	0.6742	0.7276	0.7490	0.7381	0.9309
0.0009	397.0	25805	0.6745	0.7238	0.7484	0.7359	0.9311
0.0009	398.0	25870	0.6849	0.7247	0.7614	0.7426	0.9297
0.0009	399.0	25935	0.6664	0.7242	0.7558	0.7397	0.9308
0.001	400.0	26000	0.7093	0.7172	0.7403	0.7286	0.9287
0.001	401.0	26065	0.6641	0.7202	0.7580	0.7386	0.9307
0.001	402.0	26130	0.6643	0.7137	0.7711	0.7413	0.9303
0.001	403.0	26195	0.6608	0.7263	0.7551	0.7404	0.9307
0.001	404.0	26260	0.6820	0.7251	0.7632	0.7436	0.9314
0.001	405.0	26325	0.6736	0.7293	0.7623	0.7454	0.9314
0.001	406.0	26390	0.6834	0.7274	0.7509	0.7390	0.9303
0.001	407.0	26455	0.6767	0.7218	0.7513	0.7363	0.9312
0.0006	408.0	26520	0.6918	0.7176	0.7738	0.7446	0.9315
0.0006	409.0	26585	0.6917	0.7276	0.7639	0.7453	0.9324
0.0006	410.0	26650	0.7120	0.7111	0.7603	0.7349	0.9297
0.0006	411.0	26715	0.6895	0.7251	0.7535	0.7390	0.9313
0.0006	412.0	26780	0.6915	0.7220	0.7627	0.7417	0.9316
0.0006	413.0	26845	0.7040	0.7071	0.7756	0.7398	0.9299
0.0006	414.0	26910	0.6899	0.7248	0.7526	0.7384	0.9308
0.0006	415.0	26975	0.6993	0.7229	0.7639	0.7428	0.9315
0.0005	416.0	27040	0.7063	0.7224	0.7672	0.7441	0.9316
0.0005	417.0	27105	0.6930	0.7241	0.7708	0.7467	0.9327
0.0005	418.0	27170	0.6957	0.7245	0.7610	0.7423	0.9320
0.0005	419.0	27235	0.6978	0.7256	0.7538	0.7394	0.9317
0.0005	420.0	27300	0.6905	0.7285	0.7562	0.7421	0.9327
0.0005	421.0	27365	0.7016	0.7140	0.7598	0.7362	0.9312
0.0005	422.0	27430	0.7007	0.7206	0.7590	0.7393	0.9323
0.0005	423.0	27495	0.7106	0.7175	0.7554	0.7360	0.9315
0.0006	424.0	27560	0.6984	0.7304	0.7778	0.7534	0.9331
0.0006	425.0	27625	0.6956	0.7310	0.7771	0.7533	0.9330
0.0006	426.0	27690	0.7069	0.7149	0.7583	0.7360	0.9303
0.0006	427.0	27755	0.7152	0.7233	0.7389	0.7310	0.9289
0.0006	428.0	27820	0.7047	0.7269	0.7639	0.7449	0.9319
0.0006	429.0	27885	0.7078	0.7295	0.7556	0.7423	0.9318
0.0006	430.0	27950	0.7091	0.7322	0.7610	0.7463	0.9321
0.0006	431.0	28015	0.7219	0.7340	0.7464	0.7402	0.9310
0.0006	432.0	28080	0.7183	0.7205	0.7571	0.7383	0.9303
0.0006	433.0	28145	0.7059	0.7262	0.7562	0.7409	0.9317
0.0006	434.0	28210	0.7006	0.7260	0.7654	0.7452	0.9316
0.0006	435.0	28275	0.7073	0.7209	0.7623	0.7410	0.9308
0.0006	436.0	28340	0.7080	0.7270	0.7720	0.7488	0.9324
0.0006	437.0	28405	0.7054	0.7218	0.7619	0.7413	0.9312
0.0006	438.0	28470	0.7128	0.7294	0.7529	0.7410	0.9314
0.0004	439.0	28535	0.7119	0.7234	0.7587	0.7406	0.9314
0.0004	440.0	28600	0.7244	0.7175	0.7632	0.7396	0.9313
0.0004	441.0	28665	0.7293	0.7297	0.7587	0.7439	0.9315
0.0004	442.0	28730	0.7422	0.7194	0.7587	0.7385	0.9310
0.0004	443.0	28795	0.7304	0.7264	0.7645	0.7449	0.9313
0.0004	444.0	28860	0.7224	0.7307	0.7551	0.7427	0.9315
0.0004	445.0	28925	0.7144	0.7317	0.7598	0.7455	0.9325
0.0004	446.0	28990	0.7153	0.7210	0.7627	0.7412	0.9325
0.0004	447.0	29055	0.7269	0.7273	0.7540	0.7404	0.9315
0.0004	448.0	29120	0.7487	0.7198	0.7608	0.7397	0.9304
0.0004	449.0	29185	0.7341	0.7238	0.7580	0.7405	0.9312
0.0004	450.0	29250	0.7212	0.7325	0.7697	0.7506	0.9327
0.0004	451.0	29315	0.7180	0.7302	0.7565	0.7431	0.9317
0.0004	452.0	29380	0.7197	0.7257	0.7724	0.7483	0.9324
0.0004	453.0	29445	0.7183	0.7194	0.7536	0.7361	0.9307
0.0003	454.0	29510	0.7264	0.7178	0.7679	0.7420	0.9308
0.0003	455.0	29575	0.7120	0.7283	0.7608	0.7442	0.9322
0.0003	456.0	29640	0.7410	0.7290	0.7513	0.7400	0.9305
0.0003	457.0	29705	0.7289	0.7338	0.7574	0.7454	0.9317
0.0003	458.0	29770	0.7051	0.7332	0.7576	0.7452	0.9321
0.0003	459.0	29835	0.7243	0.7292	0.7608	0.7447	0.9311
0.0003	460.0	29900	0.7140	0.7314	0.7562	0.7436	0.9318
0.0003	461.0	29965	0.7157	0.7257	0.7599	0.7424	0.9315
0.0003	462.0	30030	0.7115	0.7277	0.7646	0.7457	0.9324
0.0003	463.0	30095	0.7073	0.7296	0.7765	0.7523	0.9331
0.0003	464.0	30160	0.6973	0.7352	0.7594	0.7471	0.9336
0.0003	465.0	30225	0.6869	0.7332	0.7700	0.7512	0.9331
0.0003	466.0	30290	0.6951	0.7304	0.7704	0.7499	0.9327
0.0003	467.0	30355	0.7065	0.7250	0.7691	0.7464	0.9318
0.0003	468.0	30420	0.7112	0.7280	0.7679	0.7474	0.9319
0.0003	469.0	30485	0.7115	0.7303	0.7695	0.7494	0.9321
0.0004	470.0	30550	0.7132	0.7288	0.7681	0.7479	0.9324
0.0004	471.0	30615	0.7132	0.7278	0.7699	0.7482	0.9321
0.0004	472.0	30680	0.7200	0.7259	0.7630	0.7440	0.9313
0.0004	473.0	30745	0.7191	0.7233	0.7772	0.7493	0.9319
0.0004	474.0	30810	0.7178	0.7320	0.7679	0.7495	0.9327
0.0004	475.0	30875	0.7182	0.7331	0.7659	0.7492	0.9325
0.0004	476.0	30940	0.7216	0.7309	0.7654	0.7477	0.9322
0.0002	477.0	31005	0.7226	0.7309	0.7648	0.7474	0.9322
0.0002	478.0	31070	0.7241	0.7259	0.7697	0.7471	0.9319
0.0002	479.0	31135	0.7259	0.7280	0.7697	0.7482	0.9320
0.0002	480.0	31200	0.7258	0.7247	0.7738	0.7485	0.9319
0.0002	481.0	31265	0.7239	0.7274	0.7765	0.7512	0.9327
0.0002	482.0	31330	0.7243	0.7289	0.7763	0.7519	0.9327
0.0002	483.0	31395	0.7231	0.7267	0.7771	0.7510	0.9328
0.0002	484.0	31460	0.7221	0.7283	0.7744	0.7506	0.9328
0.0001	485.0	31525	0.7217	0.7309	0.7688	0.7493	0.9326
0.0001	486.0	31590	0.7211	0.7317	0.7616	0.7463	0.9323
0.0001	487.0	31655	0.7206	0.7330	0.7610	0.7468	0.9325
0.0001	488.0	31720	0.7198	0.7326	0.7580	0.7451	0.9323
0.0001	489.0	31785	0.7203	0.7311	0.7598	0.7451	0.9321
0.0001	490.0	31850	0.7205	0.7312	0.7614	0.7460	0.9323
0.0001	491.0	31915	0.7167	0.7294	0.7673	0.7479	0.9328
0.0001	492.0	31980	0.7164	0.7311	0.7646	0.7475	0.9328
0.0003	493.0	32045	0.7169	0.7312	0.7655	0.7480	0.9328
0.0003	494.0	32110	0.7184	0.7324	0.7675	0.7496	0.9330
0.0003	495.0	32175	0.7188	0.7320	0.7664	0.7488	0.9329
0.0003	496.0	32240	0.7187	0.7320	0.7655	0.7484	0.9328
0.0003	497.0	32305	0.7189	0.7321	0.7659	0.7486	0.9329
0.0003	498.0	32370	0.7192	0.7315	0.7659	0.7483	0.9328
0.0003	499.0	32435	0.7191	0.7313	0.7650	0.7478	0.9327
0.0001	500.0	32500	0.7191	0.7311	0.7648	0.7476	0.9327

Framework versions

• Transformers 4.29.2
• Pytorch 2.0.1+cu117
• Datasets 2.12.0
• Tokenizers 0.13.3