nerugm-pt-pl10-2

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.2082
• Location Precision: 0.7722
• Location Recall: 0.8472
• Location F1: 0.8079
• Location Number: 72
• Organization Precision: 0.6593
• Organization Recall: 0.8
• Organization F1: 0.7229
• Organization Number: 75
• Person Precision: 0.8718
• Person Recall: 0.9510
• Person F1: 0.9097
• Person Number: 143
• Quantity Precision: 0.6333
• Quantity Recall: 0.8261
• Quantity F1: 0.7170
• Quantity Number: 23
• Time Precision: 0.7931
• Time Recall: 0.8846
• Time F1: 0.8364
• Time Number: 26
• Overall Precision: 0.7766
• Overall Recall: 0.8820
• Overall F1: 0.8260
• Overall Accuracy: 0.9562

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Quantity Precision	Quantity Recall	Quantity F1	Quantity Number	Time Precision	Time Recall	Time F1	Time Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.9762	1.0	106	0.5505	0.0	0.0	0.0	72	0.0	0.0	0.0	75	0.2963	0.0559	0.0941	143	0.0	0.0	0.0	23	0.0	0.0	0.0	26	0.1860	0.0236	0.0419	0.8499
0.4847	2.0	212	0.3170	0.5	0.2083	0.2941	72	0.0476	0.0267	0.0342	75	0.5446	0.8112	0.6517	143	0.0	0.0	0.0	23	0.6667	0.7692	0.7143	26	0.45	0.4513	0.4507	0.9029
0.3032	3.0	318	0.2185	0.5	0.7222	0.5909	72	0.4434	0.6267	0.5193	75	0.7633	0.9021	0.8269	143	0.3095	0.5652	0.4000	23	0.5667	0.6538	0.6071	26	0.5721	0.7611	0.6532	0.9272
0.222	4.0	424	0.2077	0.6196	0.7917	0.6951	72	0.5089	0.76	0.6096	75	0.7917	0.9301	0.8553	143	0.2941	0.6522	0.4054	23	0.6	0.8077	0.6885	26	0.6179	0.8348	0.7102	0.9327
0.1852	5.0	530	0.1553	0.7160	0.8056	0.7582	72	0.5612	0.7333	0.6358	75	0.8282	0.9441	0.8824	143	0.5161	0.6957	0.5926	23	0.84	0.8077	0.8235	26	0.7161	0.8407	0.7734	0.9475
0.1704	6.0	636	0.1574	0.6867	0.7917	0.7355	72	0.5780	0.84	0.6848	75	0.8599	0.9441	0.9	143	0.5	0.6957	0.5818	23	0.6774	0.8077	0.7368	26	0.7087	0.8614	0.7776	0.9497
0.1583	7.0	742	0.1503	0.7308	0.7917	0.76	72	0.6364	0.84	0.7241	75	0.8553	0.9510	0.9007	143	0.5263	0.8696	0.6557	23	0.7241	0.8077	0.7636	26	0.7370	0.8761	0.8005	0.9517
0.1428	8.0	848	0.1506	0.7763	0.8194	0.7973	72	0.6452	0.8	0.7143	75	0.8438	0.9441	0.8911	143	0.5806	0.7826	0.6667	23	0.625	0.7692	0.6897	26	0.7449	0.8614	0.7989	0.9545
0.1377	9.0	954	0.1459	0.75	0.8333	0.7895	72	0.5963	0.8667	0.7065	75	0.8662	0.9510	0.9067	143	0.6071	0.7391	0.6667	23	0.6452	0.7692	0.7018	26	0.7358	0.8791	0.8011	0.9522
0.1287	10.0	1060	0.1409	0.7436	0.8056	0.7733	72	0.6966	0.8267	0.7561	75	0.85	0.9510	0.8977	143	0.5312	0.7391	0.6182	23	0.6452	0.7692	0.7018	26	0.7513	0.8643	0.8038	0.9552
0.124	11.0	1166	0.1403	0.7375	0.8194	0.7763	72	0.6364	0.84	0.7241	75	0.8654	0.9441	0.9030	143	0.5806	0.7826	0.6667	23	0.75	0.8077	0.7778	26	0.7513	0.8732	0.8076	0.9550
0.1196	12.0	1272	0.1410	0.7342	0.8056	0.7682	72	0.6632	0.84	0.7412	75	0.8662	0.9510	0.9067	143	0.5667	0.7391	0.6415	23	0.8214	0.8846	0.8519	26	0.7635	0.8761	0.8159	0.9567
0.1134	13.0	1378	0.1472	0.7160	0.8056	0.7582	72	0.6436	0.8667	0.7386	75	0.8428	0.9371	0.8874	143	0.6	0.7826	0.6792	23	0.625	0.7692	0.6897	26	0.7320	0.8702	0.7951	0.9535
0.1115	14.0	1484	0.1394	0.7368	0.7778	0.7568	72	0.6703	0.8133	0.7349	75	0.8671	0.9580	0.9103	143	0.6207	0.7826	0.6923	23	0.6897	0.7692	0.7273	26	0.7624	0.8614	0.8089	0.9560
0.105	15.0	1590	0.1407	0.7808	0.7917	0.7862	72	0.6531	0.8533	0.7399	75	0.8654	0.9441	0.9030	143	0.5862	0.7391	0.6538	23	0.75	0.8077	0.7778	26	0.7656	0.8673	0.8133	0.9572
0.1008	16.0	1696	0.1442	0.7403	0.7917	0.7651	72	0.6562	0.84	0.7368	75	0.8774	0.9510	0.9128	143	0.5333	0.6957	0.6038	23	0.7857	0.8462	0.8148	26	0.7617	0.8673	0.8110	0.9540
0.0976	17.0	1802	0.1453	0.7375	0.8194	0.7763	72	0.7033	0.8533	0.7711	75	0.8509	0.9580	0.9013	143	0.5625	0.7826	0.6545	23	0.7241	0.8077	0.7636	26	0.7608	0.8820	0.8169	0.9552
0.0949	18.0	1908	0.1515	0.7763	0.8194	0.7973	72	0.6489	0.8133	0.7219	75	0.8544	0.9441	0.8970	143	0.5455	0.7826	0.6429	23	0.7	0.8077	0.75	26	0.7519	0.8673	0.8055	0.9542
0.0928	19.0	2014	0.1468	0.8082	0.8194	0.8138	72	0.6809	0.8533	0.7574	75	0.8662	0.9510	0.9067	143	0.5806	0.7826	0.6667	23	0.75	0.8077	0.7778	26	0.7781	0.8791	0.8255	0.9607
0.0878	20.0	2120	0.1566	0.8133	0.8472	0.8299	72	0.6957	0.8533	0.7665	75	0.8447	0.9510	0.8947	143	0.5938	0.8261	0.6909	23	0.7241	0.8077	0.7636	26	0.7738	0.8879	0.8269	0.9550
0.0886	21.0	2226	0.1484	0.775	0.8611	0.8158	72	0.6742	0.8	0.7317	75	0.8481	0.9371	0.8904	143	0.5667	0.7391	0.6415	23	0.8462	0.8462	0.8462	26	0.7702	0.8702	0.8172	0.9577
0.0861	22.0	2332	0.1569	0.7561	0.8611	0.8052	72	0.6471	0.88	0.7458	75	0.8608	0.9510	0.9037	143	0.5455	0.7826	0.6429	23	0.7	0.8077	0.75	26	0.7481	0.8938	0.8145	0.9530
0.0857	23.0	2438	0.1548	0.8082	0.8194	0.8138	72	0.6735	0.88	0.7630	75	0.8726	0.9580	0.9133	143	0.5625	0.7826	0.6545	23	0.75	0.8077	0.7778	26	0.7758	0.8879	0.8281	0.9570
0.0818	24.0	2544	0.1613	0.8333	0.8333	0.8333	72	0.6957	0.8533	0.7665	75	0.8553	0.9510	0.9007	143	0.5625	0.7826	0.6545	23	0.7	0.8077	0.75	26	0.7766	0.8820	0.8260	0.9567
0.0787	25.0	2650	0.1416	0.7722	0.8472	0.8079	72	0.6633	0.8667	0.7514	75	0.8544	0.9441	0.8970	143	0.6	0.7826	0.6792	23	0.75	0.8077	0.7778	26	0.7634	0.8850	0.8197	0.9582
0.0803	26.0	2756	0.1531	0.8158	0.8611	0.8378	72	0.6633	0.8667	0.7514	75	0.8896	0.9580	0.9226	143	0.5938	0.8261	0.6909	23	0.7586	0.8462	0.8	26	0.7841	0.8997	0.8379	0.9560
0.0763	27.0	2862	0.1533	0.7973	0.8194	0.8082	72	0.7159	0.84	0.7730	75	0.8385	0.9441	0.8882	143	0.6552	0.8261	0.7308	23	0.75	0.8077	0.7778	26	0.7816	0.8761	0.8261	0.9557
0.0725	28.0	2968	0.1563	0.7848	0.8611	0.8212	72	0.7045	0.8267	0.7607	75	0.8734	0.9650	0.9169	143	0.6129	0.8261	0.7037	23	0.6875	0.8462	0.7586	26	0.7809	0.8938	0.8336	0.9560
0.0726	29.0	3074	0.1622	0.7692	0.8333	0.8	72	0.7097	0.88	0.7857	75	0.8599	0.9441	0.9	143	0.5806	0.7826	0.6667	23	0.75	0.8077	0.7778	26	0.7752	0.8850	0.8264	0.9565
0.0735	30.0	3180	0.1513	0.7683	0.875	0.8182	72	0.6915	0.8667	0.7692	75	0.8718	0.9510	0.9097	143	0.6129	0.8261	0.7037	23	0.7097	0.8462	0.7719	26	0.7741	0.8997	0.8322	0.9582
0.0688	31.0	3286	0.1481	0.7875	0.875	0.8289	72	0.6889	0.8267	0.7515	75	0.8491	0.9441	0.8940	143	0.6552	0.8261	0.7308	23	0.7	0.8077	0.75	26	0.7732	0.8850	0.8253	0.9590
0.071	32.0	3392	0.1404	0.8378	0.8611	0.8493	72	0.6932	0.8133	0.7485	75	0.8701	0.9371	0.9024	143	0.6786	0.8261	0.7451	23	0.8148	0.8462	0.8302	26	0.8032	0.8791	0.8394	0.9620
0.0669	33.0	3498	0.1566	0.8289	0.875	0.8514	72	0.6634	0.8933	0.7614	75	0.8710	0.9441	0.9060	143	0.6207	0.7826	0.6923	23	0.6774	0.8077	0.7368	26	0.7755	0.8968	0.8317	0.9577
0.062	34.0	3604	0.1593	0.8	0.8889	0.8421	72	0.65	0.8667	0.7429	75	0.8662	0.9510	0.9067	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.7781	0.8997	0.8345	0.9567
0.0657	35.0	3710	0.1519	0.8442	0.9028	0.8725	72	0.6737	0.8533	0.7529	75	0.8662	0.9510	0.9067	143	0.5484	0.7391	0.6296	23	0.7857	0.8462	0.8148	26	0.7835	0.8968	0.8363	0.9597
0.0645	36.0	3816	0.1554	0.8228	0.9028	0.8609	72	0.6842	0.8667	0.7647	75	0.8726	0.9580	0.9133	143	0.6552	0.8261	0.7308	23	0.7931	0.8846	0.8364	26	0.7943	0.9115	0.8489	0.9600
0.0619	37.0	3922	0.1480	0.84	0.875	0.8571	72	0.6809	0.8533	0.7574	75	0.8766	0.9441	0.9091	143	0.6786	0.8261	0.7451	23	0.7778	0.8077	0.7925	26	0.7989	0.8909	0.8424	0.9612
0.0619	38.0	4028	0.1574	0.8533	0.8889	0.8707	72	0.7045	0.8267	0.7607	75	0.8896	0.9580	0.9226	143	0.5484	0.7391	0.6296	23	0.7586	0.8462	0.8	26	0.8011	0.8909	0.8436	0.9620
0.0614	39.0	4134	0.1553	0.8267	0.8611	0.8435	72	0.7191	0.8533	0.7805	75	0.8896	0.9580	0.9226	143	0.6333	0.8261	0.7170	23	0.7778	0.8077	0.7925	26	0.808	0.8938	0.8487	0.9595
0.0575	40.0	4240	0.1681	0.7922	0.8472	0.8188	72	0.6813	0.8267	0.7470	75	0.8790	0.9650	0.92	143	0.6333	0.8261	0.7170	23	0.6562	0.8077	0.7241	26	0.7778	0.8879	0.8292	0.9577
0.0573	41.0	4346	0.1618	0.7895	0.8333	0.8108	72	0.7045	0.8267	0.7607	75	0.8553	0.9510	0.9007	143	0.6	0.7826	0.6792	23	0.8148	0.8462	0.8302	26	0.7842	0.8791	0.8289	0.9592
0.0561	42.0	4452	0.1798	0.7949	0.8611	0.8267	72	0.6848	0.84	0.7545	75	0.8428	0.9371	0.8874	143	0.5625	0.7826	0.6545	23	0.6774	0.8077	0.7368	26	0.7602	0.8791	0.8153	0.9537
0.0552	43.0	4558	0.1584	0.8312	0.8889	0.8591	72	0.7093	0.8133	0.7578	75	0.8903	0.9650	0.9262	143	0.5938	0.8261	0.6909	23	0.7586	0.8462	0.8	26	0.8021	0.8968	0.8468	0.9630
0.0537	44.0	4664	0.1688	0.8333	0.9028	0.8667	72	0.6932	0.8133	0.7485	75	0.8782	0.9580	0.9164	143	0.6	0.7826	0.6792	23	0.75	0.8077	0.7778	26	0.7947	0.8909	0.8401	0.9592
0.0549	45.0	4770	0.1656	0.84	0.875	0.8571	72	0.6778	0.8133	0.7394	75	0.8608	0.9510	0.9037	143	0.6552	0.8261	0.7308	23	0.7241	0.8077	0.7636	26	0.7874	0.8850	0.8333	0.9600
0.053	46.0	4876	0.1704	0.8228	0.9028	0.8609	72	0.6632	0.84	0.7412	75	0.8824	0.9441	0.9122	143	0.6333	0.8261	0.7170	23	0.8519	0.8846	0.8679	26	0.7943	0.8997	0.8437	0.9602
0.0527	47.0	4982	0.1663	0.8205	0.8889	0.8533	72	0.6848	0.84	0.7545	75	0.8831	0.9510	0.9158	143	0.6129	0.8261	0.7037	23	0.7586	0.8462	0.8	26	0.7917	0.8968	0.8409	0.9602
0.0534	48.0	5088	0.1607	0.8077	0.875	0.8400	72	0.7093	0.8133	0.7578	75	0.8824	0.9441	0.9122	143	0.6429	0.7826	0.7059	23	0.8214	0.8846	0.8519	26	0.8043	0.8850	0.8427	0.9625
0.0493	49.0	5194	0.1705	0.8025	0.9028	0.8497	72	0.6813	0.8267	0.7470	75	0.8544	0.9441	0.8970	143	0.6207	0.7826	0.6923	23	0.8214	0.8846	0.8519	26	0.7829	0.8938	0.8347	0.9587
0.0485	50.0	5300	0.1713	0.8077	0.875	0.8400	72	0.6941	0.7867	0.7375	75	0.8645	0.9371	0.8993	143	0.5625	0.7826	0.6545	23	0.7586	0.8462	0.8	26	0.7810	0.8732	0.8245	0.9577
0.0487	51.0	5406	0.1784	0.7778	0.875	0.8235	72	0.6667	0.8267	0.7381	75	0.8544	0.9441	0.8970	143	0.6207	0.7826	0.6923	23	0.8214	0.8846	0.8519	26	0.7738	0.8879	0.8269	0.9575
0.0495	52.0	5512	0.1681	0.8182	0.875	0.8456	72	0.6778	0.8133	0.7394	75	0.8654	0.9441	0.9030	143	0.6786	0.8261	0.7451	23	0.7586	0.8462	0.8	26	0.7895	0.8850	0.8345	0.9600
0.0485	53.0	5618	0.1733	0.8	0.8889	0.8421	72	0.6667	0.8267	0.7381	75	0.8774	0.9510	0.9128	143	0.6429	0.7826	0.7059	23	0.8519	0.8846	0.8679	26	0.7911	0.8938	0.8393	0.9602
0.0487	54.0	5724	0.1804	0.7949	0.8611	0.8267	72	0.6804	0.88	0.7674	75	0.8766	0.9441	0.9091	143	0.5806	0.7826	0.6667	23	0.7333	0.8462	0.7857	26	0.7769	0.8938	0.8313	0.9585
0.0474	55.0	5830	0.1721	0.8101	0.8889	0.8477	72	0.6771	0.8667	0.7602	75	0.8535	0.9371	0.8933	143	0.6429	0.7826	0.7059	23	0.8846	0.8846	0.8846	26	0.7876	0.8968	0.8386	0.9612
0.0462	56.0	5936	0.1730	0.7975	0.875	0.8344	72	0.6667	0.8267	0.7381	75	0.8662	0.9510	0.9067	143	0.6207	0.7826	0.6923	23	0.7857	0.8462	0.8148	26	0.7798	0.8879	0.8303	0.9585
0.0446	57.0	6042	0.1684	0.8243	0.8472	0.8356	72	0.7093	0.8133	0.7578	75	0.8774	0.9510	0.9128	143	0.6429	0.7826	0.7059	23	0.88	0.8462	0.8627	26	0.8098	0.8791	0.8430	0.9617
0.0448	58.0	6148	0.1766	0.8228	0.9028	0.8609	72	0.7143	0.8	0.7547	75	0.8710	0.9441	0.9060	143	0.5625	0.7826	0.6545	23	0.8148	0.8462	0.8302	26	0.7958	0.8850	0.8380	0.9587
0.044	59.0	6254	0.1777	0.8077	0.875	0.8400	72	0.6854	0.8133	0.7439	75	0.8824	0.9441	0.9122	143	0.5862	0.7391	0.6538	23	0.6897	0.7692	0.7273	26	0.7831	0.8732	0.8257	0.9577
0.044	60.0	6360	0.1938	0.7949	0.8611	0.8267	72	0.6701	0.8667	0.7558	75	0.8766	0.9441	0.9091	143	0.5484	0.7391	0.6296	23	0.7241	0.8077	0.7636	26	0.7712	0.8850	0.8242	0.9552
0.0425	61.0	6466	0.1835	0.7949	0.8611	0.8267	72	0.6966	0.8267	0.7561	75	0.8766	0.9441	0.9091	143	0.6429	0.7826	0.7059	23	0.75	0.8077	0.7778	26	0.7905	0.8791	0.8324	0.9580
0.0407	62.0	6572	0.1829	0.8312	0.8889	0.8591	72	0.7191	0.8533	0.7805	75	0.8599	0.9441	0.9	143	0.6	0.7826	0.6792	23	0.8148	0.8462	0.8302	26	0.7974	0.8938	0.8428	0.9582
0.0416	63.0	6678	0.1776	0.8077	0.875	0.8400	72	0.7	0.84	0.7636	75	0.8718	0.9510	0.9097	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.7968	0.8909	0.8412	0.9602
0.0414	64.0	6784	0.1857	0.7848	0.8611	0.8212	72	0.6957	0.8533	0.7665	75	0.8544	0.9441	0.8970	143	0.6429	0.7826	0.7059	23	0.8214	0.8846	0.8519	26	0.7844	0.8909	0.8343	0.9577
0.04	65.0	6890	0.1782	0.8133	0.8472	0.8299	72	0.6932	0.8133	0.7485	75	0.8824	0.9441	0.9122	143	0.6429	0.7826	0.7059	23	0.8519	0.8846	0.8679	26	0.8032	0.8791	0.8394	0.9605
0.0413	66.0	6996	0.1815	0.8125	0.9028	0.8553	72	0.6667	0.8267	0.7381	75	0.8710	0.9441	0.9060	143	0.5806	0.7826	0.6667	23	0.8519	0.8846	0.8679	26	0.7850	0.8938	0.8359	0.9582
0.04	67.0	7102	0.1953	0.7949	0.8611	0.8267	72	0.7033	0.8533	0.7711	75	0.8766	0.9441	0.9091	143	0.5625	0.7826	0.6545	23	0.8462	0.8462	0.8462	26	0.7900	0.8879	0.8361	0.9575
0.037	68.0	7208	0.2041	0.7407	0.8333	0.7843	72	0.6596	0.8267	0.7337	75	0.8599	0.9441	0.9	143	0.5938	0.8261	0.6909	23	0.75	0.8077	0.7778	26	0.7577	0.8761	0.8126	0.9545
0.0376	69.0	7314	0.1910	0.8077	0.875	0.8400	72	0.7241	0.84	0.7778	75	0.8824	0.9441	0.9122	143	0.6207	0.7826	0.6923	23	0.8846	0.8846	0.8846	26	0.8097	0.8909	0.8483	0.9597
0.037	70.0	7420	0.1888	0.8182	0.875	0.8456	72	0.7011	0.8133	0.7531	75	0.8710	0.9441	0.9060	143	0.6	0.7826	0.6792	23	0.8846	0.8846	0.8846	26	0.8	0.8850	0.8403	0.9605
0.0382	71.0	7526	0.1951	0.7595	0.8333	0.7947	72	0.6966	0.8267	0.7561	75	0.8824	0.9441	0.9122	143	0.5806	0.7826	0.6667	23	0.8519	0.8846	0.8679	26	0.7863	0.8791	0.8301	0.9575
0.0367	72.0	7632	0.1949	0.8026	0.8472	0.8243	72	0.7	0.84	0.7636	75	0.8774	0.9510	0.9128	143	0.6207	0.7826	0.6923	23	0.7857	0.8462	0.8148	26	0.7937	0.8850	0.8368	0.9587
0.0359	73.0	7738	0.1905	0.8267	0.8611	0.8435	72	0.7159	0.84	0.7730	75	0.8718	0.9510	0.9097	143	0.5484	0.7391	0.6296	23	0.8148	0.8462	0.8302	26	0.7958	0.8850	0.8380	0.9582
0.0345	74.0	7844	0.2017	0.7778	0.875	0.8235	72	0.7033	0.8533	0.7711	75	0.8608	0.9510	0.9037	143	0.5806	0.7826	0.6667	23	0.7097	0.8462	0.7719	26	0.7730	0.8938	0.8290	0.9562
0.0369	75.0	7950	0.2052	0.8077	0.875	0.8400	72	0.6809	0.8533	0.7574	75	0.8553	0.9510	0.9007	143	0.6129	0.8261	0.7037	23	0.7857	0.8462	0.8148	26	0.7795	0.8968	0.8340	0.9562
0.0363	76.0	8056	0.2054	0.7848	0.8611	0.8212	72	0.6809	0.8533	0.7574	75	0.8718	0.9510	0.9097	143	0.6129	0.8261	0.7037	23	0.8148	0.8462	0.8302	26	0.7829	0.8938	0.8347	0.9540
0.0358	77.0	8162	0.1938	0.8182	0.875	0.8456	72	0.7111	0.8533	0.7758	75	0.8710	0.9441	0.9060	143	0.6129	0.8261	0.7037	23	0.7857	0.8462	0.8148	26	0.7953	0.8938	0.8417	0.9585
0.0345	78.0	8268	0.2021	0.8026	0.8472	0.8243	72	0.6854	0.8133	0.7439	75	0.8766	0.9441	0.9091	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.7926	0.8791	0.8336	0.9560
0.0343	79.0	8374	0.1979	0.7848	0.8611	0.8212	72	0.6932	0.8133	0.7485	75	0.8718	0.9510	0.9097	143	0.6552	0.8261	0.7308	23	0.8214	0.8846	0.8519	26	0.7921	0.8879	0.8373	0.9600
0.0361	80.0	8480	0.2014	0.7848	0.8611	0.8212	72	0.6813	0.8267	0.7470	75	0.8718	0.9510	0.9097	143	0.6333	0.8261	0.7170	23	0.7857	0.8462	0.8148	26	0.7839	0.8879	0.8326	0.9560
0.0344	81.0	8586	0.2029	0.7848	0.8611	0.8212	72	0.6813	0.8267	0.7470	75	0.8599	0.9441	0.9	143	0.6333	0.8261	0.7170	23	0.7667	0.8846	0.8214	26	0.7778	0.8879	0.8292	0.9577
0.0347	82.0	8692	0.2082	0.7848	0.8611	0.8212	72	0.6667	0.8267	0.7381	75	0.8654	0.9441	0.9030	143	0.6786	0.8261	0.7451	23	0.7857	0.8462	0.8148	26	0.7812	0.8850	0.8299	0.9557
0.0312	83.0	8798	0.2006	0.7722	0.8472	0.8079	72	0.6778	0.8133	0.7394	75	0.8710	0.9441	0.9060	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.7775	0.8761	0.8239	0.9585
0.0347	84.0	8904	0.1980	0.7625	0.8472	0.8026	72	0.6630	0.8133	0.7305	75	0.8718	0.9510	0.9097	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.7766	0.8820	0.8260	0.9582
0.0338	85.0	9010	0.2019	0.7625	0.8472	0.8026	72	0.6739	0.8267	0.7425	75	0.8608	0.9510	0.9037	143	0.6429	0.7826	0.7059	23	0.7857	0.8462	0.8148	26	0.7746	0.8820	0.8248	0.9580
0.0337	86.0	9116	0.2056	0.7654	0.8611	0.8105	72	0.6889	0.8267	0.7515	75	0.8718	0.9510	0.9097	143	0.5667	0.7391	0.6415	23	0.7586	0.8462	0.8	26	0.7746	0.8820	0.8248	0.9560
0.0331	87.0	9222	0.1985	0.7848	0.8611	0.8212	72	0.6966	0.8267	0.7561	75	0.8662	0.9510	0.9067	143	0.6552	0.8261	0.7308	23	0.7931	0.8846	0.8364	26	0.7885	0.8909	0.8366	0.9587
0.0326	88.0	9328	0.2030	0.775	0.8611	0.8158	72	0.6778	0.8133	0.7394	75	0.8662	0.9510	0.9067	143	0.6333	0.8261	0.7170	23	0.7857	0.8462	0.8148	26	0.7792	0.8850	0.8287	0.9570
0.0322	89.0	9434	0.2022	0.7722	0.8472	0.8079	72	0.6778	0.8133	0.7394	75	0.8718	0.9510	0.9097	143	0.6333	0.8261	0.7170	23	0.8214	0.8846	0.8519	26	0.7833	0.8850	0.8310	0.9582
0.0325	90.0	9540	0.2073	0.7722	0.8472	0.8079	72	0.6813	0.8267	0.7470	75	0.8662	0.9510	0.9067	143	0.6	0.7826	0.6792	23	0.7931	0.8846	0.8364	26	0.7772	0.8850	0.8276	0.9567
0.0301	91.0	9646	0.2026	0.7722	0.8472	0.8079	72	0.6854	0.8133	0.7439	75	0.8718	0.9510	0.9097	143	0.6	0.7826	0.6792	23	0.8214	0.8846	0.8519	26	0.7827	0.8820	0.8294	0.9580
0.0324	92.0	9752	0.2049	0.7625	0.8472	0.8026	72	0.6854	0.8133	0.7439	75	0.8718	0.9510	0.9097	143	0.6333	0.8261	0.7170	23	0.7857	0.8462	0.8148	26	0.7807	0.8820	0.8283	0.9575
0.0321	93.0	9858	0.2048	0.7848	0.8611	0.8212	72	0.6703	0.8133	0.7349	75	0.8718	0.9510	0.9097	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.7786	0.8820	0.8271	0.9582
0.0313	94.0	9964	0.2051	0.7625	0.8472	0.8026	72	0.6452	0.8	0.7143	75	0.8718	0.9510	0.9097	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.7674	0.8761	0.8182	0.9562
0.0291	95.0	10070	0.2075	0.7722	0.8472	0.8079	72	0.6593	0.8	0.7229	75	0.8718	0.9510	0.9097	143	0.6	0.7826	0.6792	23	0.7586	0.8462	0.8	26	0.7714	0.8761	0.8204	0.9557
0.0299	96.0	10176	0.2088	0.7722	0.8472	0.8079	72	0.6778	0.8133	0.7394	75	0.8718	0.9510	0.9097	143	0.5806	0.7826	0.6667	23	0.7586	0.8462	0.8	26	0.7740	0.8791	0.8232	0.9560
0.0327	97.0	10282	0.2071	0.7722	0.8472	0.8079	72	0.6630	0.8133	0.7305	75	0.8718	0.9510	0.9097	143	0.5806	0.7826	0.6667	23	0.7931	0.8846	0.8364	26	0.7726	0.8820	0.8237	0.9572
0.031	98.0	10388	0.2059	0.7722	0.8472	0.8079	72	0.6630	0.8133	0.7305	75	0.8718	0.9510	0.9097	143	0.6333	0.8261	0.7170	23	0.8214	0.8846	0.8519	26	0.7792	0.8850	0.8287	0.9570
0.0294	99.0	10494	0.2083	0.7625	0.8472	0.8026	72	0.6630	0.8133	0.7305	75	0.8718	0.9510	0.9097	143	0.6	0.7826	0.6792	23	0.7931	0.8846	0.8364	26	0.7726	0.8820	0.8237	0.9565
0.0322	100.0	10600	0.2082	0.7722	0.8472	0.8079	72	0.6593	0.8	0.7229	75	0.8718	0.9510	0.9097	143	0.6333	0.8261	0.7170	23	0.7931	0.8846	0.8364	26	0.7766	0.8820	0.8260	0.9562

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2