BM-K commited on
Commit
2d38042
·
verified ·
1 Parent(s): 3c207c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +248 -1943
README.md CHANGED
@@ -1,1977 +1,282 @@
1
  ---
 
 
 
2
  tags:
3
  - sentence-transformers
 
4
  - sparse-encoder
5
  - sparse
6
  - splade
7
- - generated_from_trainer
8
- - dataset_size:6133378
9
- - loss:SpladeLoss
10
- - loss:SparseMultipleNegativesRankingLoss
11
- - loss:FlopsLoss
12
- base_model: skt/A.X-Encoder-base
13
- widget:
14
- - text: 값에 가중치 a를 곱하여 비용함수에 반영한다. 가시성은 레이더 좌표에서 경로점 좌표를 이은 가시선 벡터가 중간에 지형에 의해 차폐되는지를
15
- 통해 비용함수에반영된다
16
- - text: 고리즘 및 인공신경망기법이 사용되었다. 인공신경망은 세대의 증가에 따라 지속적으로 향상하였으며, 수직 풍력터빈의 성능은 독립운전에 비하여
17
- 최적화된 풍력 타워 내에서 두 배 이상
18
- - text: "연구에서도 동일하게 적용하였다[9].\n받음각 범위는 –9° ~ 19°이며, 받음각 조절장치를 활용하여 실험모델의 받음각을 1° 간격으로\
19
- \ 변화하면서 실험을 수행하였다. \n실험 풍"
20
- - text: 성을 극복하는 방법을 살펴본다. 우선 반작용휠을 일정한 속도로 회전시키며 펄스 불균일 정보를 측정하는 방법을 알아본다. 그리고 측정된
21
- 불균일 정보를 토대로 T-방식을 보
22
- - text: 저고도에서 운용되는 소형 무인항공기의 다수 운용이 신속하고 효과적인 정찰 임무를 수행하는 데 필요한 이유
23
  pipeline_tag: feature-extraction
24
  library_name: sentence-transformers
 
25
  ---
26
-
27
- # SPLADE Sparse Encoder
28
-
29
- This is a [SPLADE Sparse Encoder](https://www.sbert.net/docs/sparse_encoder/usage/usage.html) model finetuned from [skt/A.X-Encoder-base](https://huggingface.co/skt/A.X-Encoder-base) on the json dataset using the [sentence-transformers](https://www.SBERT.net) library. It maps sentences & paragraphs to a 50000-dimensional sparse vector space and can be used for semantic search and sparse retrieval.
30
- ## Model Details
31
-
32
- ### Model Description
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  - **Model Type:** SPLADE Sparse Encoder
34
- - **Base model:** [skt/A.X-Encoder-base](https://huggingface.co/skt/A.X-Encoder-base) <!-- at revision b5c71f3601aedf38372fe21383ac7d04991af187 -->
35
- - **Maximum Sequence Length:** 2048 tokens
36
  - **Output Dimensionality:** 50000 dimensions
37
  - **Similarity Function:** Dot Product
38
- - **Training Dataset:**
39
- - json
40
- <!-- - **Language:** Unknown -->
41
- <!-- - **License:** Unknown -->
42
-
43
- ### Model Sources
44
-
45
- - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
46
- - **Documentation:** [Sparse Encoder Documentation](https://www.sbert.net/docs/sparse_encoder/usage/usage.html)
47
- - **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
48
- - **Hugging Face:** [Sparse Encoders on Hugging Face](https://huggingface.co/models?library=sentence-transformers&other=sparse-encoder)
49
 
50
  ### Full Model Architecture
51
 
52
  ```
53
  SparseEncoder(
54
- (0): MLMTransformer({'max_seq_length': 2048, 'do_lower_case': False, 'architecture': 'ModernBertForMaskedLM'})
55
  (1): SpladePooling({'pooling_strategy': 'max', 'activation_function': 'relu', 'word_embedding_dimension': 50000})
56
  )
57
  ```
58
 
59
- ## Usage
60
-
61
- ### Direct Usage (Sentence Transformers)
62
-
63
- First install the Sentence Transformers library:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
64
 
65
- ```bash
66
- pip install -U sentence-transformers
67
- ```
68
-
69
- Then you can load this model and run inference.
70
  ```python
 
 
 
 
 
71
  from sentence_transformers import SparseEncoder
72
 
73
- # Download from the 🤗 Hub
74
- model = SparseEncoder("sparse_encoder_model_id")
75
- # Run inference
76
- sentences = [
77
- '저고도에서 운용되는 소형 무인항공기의 다수 운용이 신속하고 효과적인 정찰 임무를 수행하는 데 필요한 이유',
78
- '형 무인항공기도 다양하게 활용되고 있다. 저���도에서 운용되는 소형 무인항공기는 개별적 운용보다는 다수의 무인항공기를 동시에 사용하여야 신속하고 효과적인 정찰 임무를 수 행할 수가 있다',
79
- '색 및 정찰 임무를 수행하는데 있어서 무인항공기의 운용 대수, 비행고도 등 운용 조건에 따라 임무 수행의 효율성과 효과성은 크게 변경될 수 있다. 하지만 어떤 운용조건이 가장 합리',
80
- ]
81
- embeddings = model.encode(sentences)
82
- print(embeddings.shape)
83
- # [3, 50000]
84
-
85
- # Get the similarity scores for the embeddings
86
- similarities = model.similarity(embeddings, embeddings)
87
- print(similarities)
88
- # tensor([[ 34.3231, 46.3908, 19.9883],
89
- # [ 46.3908, 162.7550, 54.5493],
90
- # [ 19.9883, 54.5493, 129.3976]])
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
91
  ```
92
 
93
- <!--
94
- ### Direct Usage (Transformers)
95
-
96
- <details><summary>Click to see the direct usage in Transformers</summary>
97
-
98
- </details>
99
- -->
100
-
101
- <!--
102
- ### Downstream Usage (Sentence Transformers)
103
-
104
- You can finetune this model on your own dataset.
105
-
106
- <details><summary>Click to expand</summary>
107
-
108
- </details>
109
- -->
110
-
111
- <!--
112
- ### Out-of-Scope Use
113
-
114
- *List how the model may foreseeably be misused and address what users ought not to do with the model.*
115
- -->
116
-
117
- <!--
118
- ## Bias, Risks and Limitations
119
-
120
- *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
121
- -->
122
-
123
- <!--
124
- ### Recommendations
125
-
126
- *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
127
- -->
128
-
129
- ## Training Details
130
-
131
- ### Training Dataset
132
-
133
- #### json
134
-
135
- * Dataset: json
136
- * Size: 6,133,378 training samples
137
- * Columns: <code>anchor</code>, <code>positive</code>, <code>negative_1</code>, <code>negative_2</code>, <code>negative_3</code>, <code>negative_4</code>, and <code>negative_5</code>
138
- * Approximate statistics based on the first 1000 samples:
139
- | | anchor | positive | negative_1 | negative_2 | negative_3 | negative_4 | negative_5 |
140
- |:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|
141
- | type | string | string | string | string | string | string | string |
142
- | details | <ul><li>min: 10 tokens</li><li>mean: 30.15 tokens</li><li>max: 63 tokens</li></ul> | <ul><li>min: 29 tokens</li><li>mean: 51.86 tokens</li><li>max: 73 tokens</li></ul> | <ul><li>min: 26 tokens</li><li>mean: 51.67 tokens</li><li>max: 69 tokens</li></ul> | <ul><li>min: 29 tokens</li><li>mean: 51.8 tokens</li><li>max: 71 tokens</li></ul> | <ul><li>min: 27 tokens</li><li>mean: 51.55 tokens</li><li>max: 71 tokens</li></ul> | <ul><li>min: 27 tokens</li><li>mean: 51.61 tokens</li><li>max: 70 tokens</li></ul> | <ul><li>min: 27 tokens</li><li>mean: 51.76 tokens</li><li>max: 69 tokens</li></ul> |
143
- * Samples:
144
- | anchor | positive | negative_1 | negative_2 | negative_3 | negative_4 | negative_5 |
145
- |:---------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------|
146
- | <code>본 논문을 검토해주신 심사위원님들과 편집에 도움을 주신 거목문화사에 감사드립니다</code> | <code>능성이 있다고 판단된다. <br>감사의 글 <br>본 논문을 검토해주신 심사위원님들과 편집에 도움을 주신 거목문화사에 감사드립니다.</code> | <code>없이 정상 운용 중에 있다. <br>감사의 글 <br>이 논문에 대하여 중요한 지적과 코멘트를 해주시고, 세심한 심사를 해주신 익명의 심사위원님들께 감사드립니다.</code> | <code>의 지원을 받았으며, 이에 감사드립니다. 논문의표현을 명확히 하는데 도움을 주신 익명의 심사자분들께 감사드립니다.</code> | <code>화에 활용되기를 기대한다. <br>감사의 글 <br>본 연구는 한국연구재단의 지원을 받아 수행되었습니다(NRF-2022R1A2C1092602).</code> | <code>자 및 심사위원분들께 감사드립니다. 본 논문은 기상청 “수치예보·지진 업무 지원 및 활용연구” 과제의 지원을 받아 수행되었습니다.</code> | <code>자분들과 발간을위해 노력해주신 논문 심사위원분들 및 대한원격탐사학회 편집이사, 편집간사님께 깊은 감사의 말씀을 드립니다.</code> |
147
- | <code>양한 노력이 필요할 것으로 사료된다 사사 본 논문은 농촌진흥청 공동연구사업의 지원을 받았으며 이에 감사드립니다</code> | <code>양한 노력이 필요할 것으로 사료된다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ01415301)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>관측이 이루어 질 것으로 기대된다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ01382101)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>활용성을 향상시켜야 할 것이다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ016768)의 지원을 받아 수행되었으며, 이에 감사드립니다.</code> | <code>기초자료로 사용될 것으로 판단된다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ013821012021)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>해를 바탕으로 분석되어야 하겠다.<br>사사<br>이 논문은 농촌진흥청 공동연구사업(과제번호: PJ015103052022)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>의 개발이 요구될 것으로 판단된다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ01478701)의 지원을 받았으며, 이에 감사드립니다.</code> |
148
- | <code>추가로 실험되어야 할 것으로 생각된다 농촌진흥청 공동연구사업 PJ01427401 지원 감사드립니다</code> | <code>추가로 실험되어야 할 것으로 생각된다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호:PJ01427401)의 지원을 받았으며, 이에 감사 드립니다</code> | <code>의 영향 등을 분석할 예정이다. 사 사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ01350004)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>관측이 이루어 질 것으로 기대된다.<br>사사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ01382101)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>는지도 추가 연구로 진행될 예정이다.<br>사사<br>본 논문은 농촌진흥청 연구사업(과제번호: PJ0162342021)의 지원에 의해 이루어진 것임.</code> | <code>I2018-05510)의 지원을 받아 수행된 연구임. 또한,이 논문은 농촌진흥청 공동연구사업(PJ014787042020)의 지원을 받았으며, 이에 감사드립니다.</code> | <code>연구는 계속되어야 할 것으로 사료된다.<br>사 사<br>본 논문은 농촌진흥청 공동연구사업(과제번호: PJ01382101)의 지원을 받아 수행되었습니다</code> |
149
- * Loss: [<code>SpladeLoss</code>](https://sbert.net/docs/package_reference/sparse_encoder/losses.html#spladeloss) with these parameters:
150
- ```json
151
- {
152
- "loss": "SparseMultipleNegativesRankingLoss(scale=1.0, similarity_fct='dot_score', gather_across_devices=False)",
153
- "document_regularizer_weight": 3e-05,
154
- "query_regularizer_weight": 5e-05
155
- }
156
- ```
157
-
158
- ### Training Hyperparameters
159
- #### Non-Default Hyperparameters
160
-
161
- - `per_device_train_batch_size`: 6
162
- - `gradient_accumulation_steps`: 4
163
- - `learning_rate`: 2e-05
164
- - `warmup_ratio`: 0.05
165
- - `bf16`: True
166
- - `ddp_find_unused_parameters`: True
167
- - `ddp_timeout`: 7200
168
- - `batch_sampler`: no_duplicates
169
-
170
- #### All Hyperparameters
171
- <details><summary>Click to expand</summary>
172
-
173
- - `overwrite_output_dir`: False
174
- - `do_predict`: False
175
- - `eval_strategy`: no
176
- - `prediction_loss_only`: True
177
- - `per_device_train_batch_size`: 6
178
- - `per_device_eval_batch_size`: 8
179
- - `per_gpu_train_batch_size`: None
180
- - `per_gpu_eval_batch_size`: None
181
- - `gradient_accumulation_steps`: 4
182
- - `eval_accumulation_steps`: None
183
- - `torch_empty_cache_steps`: None
184
- - `learning_rate`: 2e-05
185
- - `weight_decay`: 0.0
186
- - `adam_beta1`: 0.9
187
- - `adam_beta2`: 0.999
188
- - `adam_epsilon`: 1e-08
189
- - `max_grad_norm`: 1.0
190
- - `num_train_epochs`: 3
191
- - `max_steps`: -1
192
- - `lr_scheduler_type`: linear
193
- - `lr_scheduler_kwargs`: {}
194
- - `warmup_ratio`: 0.05
195
- - `warmup_steps`: 0
196
- - `log_level`: passive
197
- - `log_level_replica`: warning
198
- - `log_on_each_node`: True
199
- - `logging_nan_inf_filter`: True
200
- - `save_safetensors`: True
201
- - `save_on_each_node`: False
202
- - `save_only_model`: False
203
- - `restore_callback_states_from_checkpoint`: False
204
- - `no_cuda`: False
205
- - `use_cpu`: False
206
- - `use_mps_device`: False
207
- - `seed`: 42
208
- - `data_seed`: None
209
- - `jit_mode_eval`: False
210
- - `use_ipex`: False
211
- - `bf16`: True
212
- - `fp16`: False
213
- - `fp16_opt_level`: O1
214
- - `half_precision_backend`: auto
215
- - `bf16_full_eval`: False
216
- - `fp16_full_eval`: False
217
- - `tf32`: None
218
- - `local_rank`: 0
219
- - `ddp_backend`: None
220
- - `tpu_num_cores`: None
221
- - `tpu_metrics_debug`: False
222
- - `debug`: []
223
- - `dataloader_drop_last`: True
224
- - `dataloader_num_workers`: 0
225
- - `dataloader_prefetch_factor`: None
226
- - `past_index`: -1
227
- - `disable_tqdm`: False
228
- - `remove_unused_columns`: True
229
- - `label_names`: None
230
- - `load_best_model_at_end`: False
231
- - `ignore_data_skip`: False
232
- - `fsdp`: []
233
- - `fsdp_min_num_params`: 0
234
- - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
235
- - `tp_size`: 0
236
- - `fsdp_transformer_layer_cls_to_wrap`: None
237
- - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
238
- - `deepspeed`: None
239
- - `label_smoothing_factor`: 0.0
240
- - `optim`: adamw_torch
241
- - `optim_args`: None
242
- - `adafactor`: False
243
- - `group_by_length`: False
244
- - `length_column_name`: length
245
- - `ddp_find_unused_parameters`: True
246
- - `ddp_bucket_cap_mb`: None
247
- - `ddp_broadcast_buffers`: False
248
- - `dataloader_pin_memory`: True
249
- - `dataloader_persistent_workers`: False
250
- - `skip_memory_metrics`: True
251
- - `use_legacy_prediction_loop`: False
252
- - `push_to_hub`: False
253
- - `resume_from_checkpoint`: None
254
- - `hub_model_id`: None
255
- - `hub_strategy`: every_save
256
- - `hub_private_repo`: None
257
- - `hub_always_push`: False
258
- - `gradient_checkpointing`: False
259
- - `gradient_checkpointing_kwargs`: None
260
- - `include_inputs_for_metrics`: False
261
- - `include_for_metrics`: []
262
- - `eval_do_concat_batches`: True
263
- - `fp16_backend`: auto
264
- - `push_to_hub_model_id`: None
265
- - `push_to_hub_organization`: None
266
- - `mp_parameters`:
267
- - `auto_find_batch_size`: False
268
- - `full_determinism`: False
269
- - `torchdynamo`: None
270
- - `ray_scope`: last
271
- - `ddp_timeout`: 7200
272
- - `torch_compile`: False
273
- - `torch_compile_backend`: None
274
- - `torch_compile_mode`: None
275
- - `include_tokens_per_second`: False
276
- - `include_num_input_tokens_seen`: False
277
- - `neftune_noise_alpha`: None
278
- - `optim_target_modules`: None
279
- - `batch_eval_metrics`: False
280
- - `eval_on_start`: False
281
- - `use_liger_kernel`: False
282
- - `eval_use_gather_object`: False
283
- - `average_tokens_across_devices`: False
284
- - `prompts`: None
285
- - `batch_sampler`: no_duplicates
286
- - `multi_dataset_batch_sampler`: proportional
287
- - `router_mapping`: {}
288
- - `learning_rate_mapping`: {}
289
-
290
- </details>
291
-
292
- ### Training Logs
293
- <details><summary>Click to expand</summary>
294
-
295
- | Epoch | Step | Training Loss |
296
- |:------:|:------:|:-------------:|
297
- | 0.0016 | 100 | 16244.8113 |
298
- | 0.0031 | 200 | 14996.3725 |
299
- | 0.0047 | 300 | 9421.6025 |
300
- | 0.0063 | 400 | 3552.6466 |
301
- | 0.0078 | 500 | 814.9219 |
302
- | 0.0094 | 600 | 221.6705 |
303
- | 0.0110 | 700 | 92.4095 |
304
- | 0.0125 | 800 | 64.8605 |
305
- | 0.0141 | 900 | 27.5528 |
306
- | 0.0157 | 1000 | 15.4449 |
307
- | 0.0172 | 1100 | 12.8785 |
308
- | 0.0188 | 1200 | 9.3655 |
309
- | 0.0203 | 1300 | 5.7947 |
310
- | 0.0219 | 1400 | 4.4217 |
311
- | 0.0235 | 1500 | 2.2635 |
312
- | 0.0250 | 1600 | 1.6383 |
313
- | 0.0266 | 1700 | 1.818 |
314
- | 0.0282 | 1800 | 2.5322 |
315
- | 0.0297 | 1900 | 1.8665 |
316
- | 0.0313 | 2000 | 1.7604 |
317
- | 0.0329 | 2100 | 1.8703 |
318
- | 0.0344 | 2200 | 2.2561 |
319
- | 0.0360 | 2300 | 1.1901 |
320
- | 0.0376 | 2400 | 1.3095 |
321
- | 0.0391 | 2500 | 1.1753 |
322
- | 0.0407 | 2600 | 1.2317 |
323
- | 0.0423 | 2700 | 1.0613 |
324
- | 0.0438 | 2800 | 1.727 |
325
- | 0.0454 | 2900 | 1.1044 |
326
- | 0.0470 | 3000 | 0.99 |
327
- | 0.0485 | 3100 | 1.0261 |
328
- | 0.0501 | 3200 | 1.0384 |
329
- | 0.0517 | 3300 | 1.051 |
330
- | 0.0532 | 3400 | 1.0883 |
331
- | 0.0548 | 3500 | 1.1632 |
332
- | 0.0563 | 3600 | 1.2008 |
333
- | 0.0579 | 3700 | 1.18 |
334
- | 0.0595 | 3800 | 1.1115 |
335
- | 0.0610 | 3900 | 1.2229 |
336
- | 0.0626 | 4000 | 1.0997 |
337
- | 0.0642 | 4100 | 1.2086 |
338
- | 0.0657 | 4200 | 1.0919 |
339
- | 0.0673 | 4300 | 1.0244 |
340
- | 0.0689 | 4400 | 1.1116 |
341
- | 0.0704 | 4500 | 1.0373 |
342
- | 0.0720 | 4600 | 1.0658 |
343
- | 0.0736 | 4700 | 1.0987 |
344
- | 0.0751 | 4800 | 1.0947 |
345
- | 0.0767 | 4900 | 1.0875 |
346
- | 0.0783 | 5000 | 1.1346 |
347
- | 0.0798 | 5100 | 1.1292 |
348
- | 0.0814 | 5200 | 0.9917 |
349
- | 0.0830 | 5300 | 1.0155 |
350
- | 0.0845 | 5400 | 0.9953 |
351
- | 0.0861 | 5500 | 1.1092 |
352
- | 0.0877 | 5600 | 0.9991 |
353
- | 0.0892 | 5700 | 1.0246 |
354
- | 0.0908 | 5800 | 1.0436 |
355
- | 0.0923 | 5900 | 0.9698 |
356
- | 0.0939 | 6000 | 1.0185 |
357
- | 0.0955 | 6100 | 1.0084 |
358
- | 0.0970 | 6200 | 0.9925 |
359
- | 0.0986 | 6300 | 0.9053 |
360
- | 0.1002 | 6400 | 0.8762 |
361
- | 0.1017 | 6500 | 0.8794 |
362
- | 0.1033 | 6600 | 0.9318 |
363
- | 0.1049 | 6700 | 0.9518 |
364
- | 0.1064 | 6800 | 0.9246 |
365
- | 0.1080 | 6900 | 0.9226 |
366
- | 0.1096 | 7000 | 1.0066 |
367
- | 0.1111 | 7100 | 0.8303 |
368
- | 0.1127 | 7200 | 0.9265 |
369
- | 0.1143 | 7300 | 0.9143 |
370
- | 0.1158 | 7400 | 0.8936 |
371
- | 0.1174 | 7500 | 0.9081 |
372
- | 0.1190 | 7600 | 0.8753 |
373
- | 0.1205 | 7700 | 0.8978 |
374
- | 0.1221 | 7800 | 0.8788 |
375
- | 0.1237 | 7900 | 0.8241 |
376
- | 0.1252 | 8000 | 0.8638 |
377
- | 0.1268 | 8100 | 0.826 |
378
- | 0.1283 | 8200 | 0.8427 |
379
- | 0.1299 | 8300 | 0.8508 |
380
- | 0.1315 | 8400 | 0.8363 |
381
- | 0.1330 | 8500 | 0.8271 |
382
- | 0.1346 | 8600 | 0.8813 |
383
- | 0.1362 | 8700 | 0.8844 |
384
- | 0.1377 | 8800 | 0.8977 |
385
- | 0.1393 | 8900 | 0.8685 |
386
- | 0.1409 | 9000 | 0.8001 |
387
- | 0.1424 | 9100 | 0.8375 |
388
- | 0.1440 | 9200 | 0.7616 |
389
- | 0.1456 | 9300 | 0.8178 |
390
- | 0.1471 | 9400 | 0.7852 |
391
- | 0.1487 | 9500 | 0.8447 |
392
- | 0.1503 | 9600 | 0.8703 |
393
- | 0.1518 | 9700 | 0.7935 |
394
- | 0.1534 | 9800 | 0.8368 |
395
- | 0.1550 | 9900 | 0.8424 |
396
- | 0.1565 | 10000 | 0.7916 |
397
- | 0.1581 | 10100 | 0.7628 |
398
- | 0.1597 | 10200 | 0.9058 |
399
- | 0.1612 | 10300 | 0.8397 |
400
- | 0.1628 | 10400 | 0.8112 |
401
- | 0.1643 | 10500 | 0.784 |
402
- | 0.1659 | 10600 | 0.7526 |
403
- | 0.1675 | 10700 | 0.7964 |
404
- | 0.1690 | 10800 | 0.7964 |
405
- | 0.1706 | 10900 | 0.7561 |
406
- | 0.1722 | 11000 | 0.81 |
407
- | 0.1737 | 11100 | 0.7754 |
408
- | 0.1753 | 11200 | 0.7899 |
409
- | 0.1769 | 11300 | 0.7358 |
410
- | 0.1784 | 11400 | 0.7459 |
411
- | 0.1800 | 11500 | 0.7711 |
412
- | 0.1816 | 11600 | 0.7457 |
413
- | 0.1831 | 11700 | 0.6877 |
414
- | 0.1847 | 11800 | 0.751 |
415
- | 0.1863 | 11900 | 0.6906 |
416
- | 0.1878 | 12000 | 0.7207 |
417
- | 0.1894 | 12100 | 0.767 |
418
- | 0.1910 | 12200 | 0.7843 |
419
- | 0.1925 | 12300 | 0.7579 |
420
- | 0.1941 | 12400 | 0.7407 |
421
- | 0.1957 | 12500 | 0.7675 |
422
- | 0.1972 | 12600 | 0.7664 |
423
- | 0.1988 | 12700 | 0.7303 |
424
- | 0.2003 | 12800 | 0.7588 |
425
- | 0.2019 | 12900 | 0.7472 |
426
- | 0.2035 | 13000 | 0.7537 |
427
- | 0.2050 | 13100 | 0.7457 |
428
- | 0.2066 | 13200 | 0.7147 |
429
- | 0.2082 | 13300 | 0.7303 |
430
- | 0.2097 | 13400 | 0.7112 |
431
- | 0.2113 | 13500 | 0.7268 |
432
- | 0.2129 | 13600 | 0.7063 |
433
- | 0.2144 | 13700 | 0.7578 |
434
- | 0.2160 | 13800 | 0.6814 |
435
- | 0.2176 | 13900 | 0.7841 |
436
- | 0.2191 | 14000 | 0.7294 |
437
- | 0.2207 | 14100 | 0.6652 |
438
- | 0.2223 | 14200 | 0.698 |
439
- | 0.2238 | 14300 | 0.6825 |
440
- | 0.2254 | 14400 | 0.7365 |
441
- | 0.2270 | 14500 | 0.7525 |
442
- | 0.2285 | 14600 | 0.739 |
443
- | 0.2301 | 14700 | 0.7418 |
444
- | 0.2317 | 14800 | 0.717 |
445
- | 0.2332 | 14900 | 0.6951 |
446
- | 0.2348 | 15000 | 0.6137 |
447
- | 0.2363 | 15100 | 0.6708 |
448
- | 0.2379 | 15200 | 0.7128 |
449
- | 0.2395 | 15300 | 0.6664 |
450
- | 0.2410 | 15400 | 0.706 |
451
- | 0.2426 | 15500 | 0.7061 |
452
- | 0.2442 | 15600 | 0.7778 |
453
- | 0.2457 | 15700 | 0.7449 |
454
- | 0.2473 | 15800 | 0.7875 |
455
- | 0.2489 | 15900 | 0.7922 |
456
- | 0.2504 | 16000 | 0.734 |
457
- | 0.2520 | 16100 | 0.7408 |
458
- | 0.2536 | 16200 | 0.7792 |
459
- | 0.2551 | 16300 | 0.7408 |
460
- | 0.2567 | 16400 | 0.726 |
461
- | 0.2583 | 16500 | 0.7087 |
462
- | 0.2598 | 16600 | 0.7567 |
463
- | 0.2614 | 16700 | 0.6703 |
464
- | 0.2630 | 16800 | 0.7594 |
465
- | 0.2645 | 16900 | 0.7764 |
466
- | 0.2661 | 17000 | 0.7142 |
467
- | 0.2677 | 17100 | 0.6808 |
468
- | 0.2692 | 17200 | 0.6889 |
469
- | 0.2708 | 17300 | 0.7414 |
470
- | 0.2723 | 17400 | 0.7563 |
471
- | 0.2739 | 17500 | 0.7818 |
472
- | 0.2755 | 17600 | 0.7538 |
473
- | 0.2770 | 17700 | 0.7004 |
474
- | 0.2786 | 17800 | 0.8239 |
475
- | 0.2802 | 17900 | 0.7227 |
476
- | 0.2817 | 18000 | 0.7485 |
477
- | 0.2833 | 18100 | 0.753 |
478
- | 0.2849 | 18200 | 0.7693 |
479
- | 0.2864 | 18300 | 0.7226 |
480
- | 0.2880 | 18400 | 0.7692 |
481
- | 0.2896 | 18500 | 0.7658 |
482
- | 0.2911 | 18600 | 0.7407 |
483
- | 0.2927 | 18700 | 0.8059 |
484
- | 0.2943 | 18800 | 0.8043 |
485
- | 0.2958 | 18900 | 0.8128 |
486
- | 0.2974 | 19000 | 0.7007 |
487
- | 0.2990 | 19100 | 0.7464 |
488
- | 0.3005 | 19200 | 0.8056 |
489
- | 0.3021 | 19300 | 0.7446 |
490
- | 0.3037 | 19400 | 0.7894 |
491
- | 0.3052 | 19500 | 0.643 |
492
- | 0.3068 | 19600 | 0.7132 |
493
- | 0.3083 | 19700 | 0.7687 |
494
- | 0.3099 | 19800 | 0.6915 |
495
- | 0.3115 | 19900 | 0.7061 |
496
- | 0.3130 | 20000 | 0.7368 |
497
- | 0.3146 | 20100 | 0.6851 |
498
- | 0.3162 | 20200 | 0.7286 |
499
- | 0.3177 | 20300 | 0.6868 |
500
- | 0.3193 | 20400 | 0.6745 |
501
- | 0.3209 | 20500 | 0.8097 |
502
- | 0.3224 | 20600 | 0.6915 |
503
- | 0.3240 | 20700 | 0.7654 |
504
- | 0.3256 | 20800 | 0.7396 |
505
- | 0.3271 | 20900 | 0.7502 |
506
- | 0.3287 | 21000 | 0.6353 |
507
- | 0.3303 | 21100 | 0.6617 |
508
- | 0.3318 | 21200 | 0.6867 |
509
- | 0.3334 | 21300 | 0.6681 |
510
- | 0.3350 | 21400 | 0.7481 |
511
- | 0.3365 | 21500 | 0.7222 |
512
- | 0.3381 | 21600 | 0.6653 |
513
- | 0.3397 | 21700 | 0.6456 |
514
- | 0.3412 | 21800 | 0.6151 |
515
- | 0.3428 | 21900 | 0.7371 |
516
- | 0.3443 | 22000 | 0.6578 |
517
- | 0.3459 | 22100 | 0.7081 |
518
- | 0.3475 | 22200 | 0.7069 |
519
- | 0.3490 | 22300 | 0.762 |
520
- | 0.3506 | 22400 | 0.7186 |
521
- | 0.3522 | 22500 | 0.7228 |
522
- | 0.3537 | 22600 | 0.6919 |
523
- | 0.3553 | 22700 | 0.7675 |
524
- | 0.3569 | 22800 | 0.7585 |
525
- | 0.3584 | 22900 | 0.7495 |
526
- | 0.3600 | 23000 | 0.7106 |
527
- | 0.3616 | 23100 | 0.7957 |
528
- | 0.3631 | 23200 | 0.7996 |
529
- | 0.3647 | 23300 | 0.6807 |
530
- | 0.3663 | 23400 | 0.8421 |
531
- | 0.3678 | 23500 | 0.7041 |
532
- | 0.3694 | 23600 | 0.77 |
533
- | 0.3710 | 23700 | 0.8124 |
534
- | 0.3725 | 23800 | 0.6941 |
535
- | 0.3741 | 23900 | 0.8293 |
536
- | 0.3757 | 24000 | 0.8839 |
537
- | 0.3772 | 24100 | 0.8151 |
538
- | 0.3788 | 24200 | 0.6954 |
539
- | 0.3803 | 24300 | 0.7875 |
540
- | 0.3819 | 24400 | 0.6579 |
541
- | 0.3835 | 24500 | 0.4184 |
542
- | 0.3850 | 24600 | 0.53 |
543
- | 0.3866 | 24700 | 0.4804 |
544
- | 0.3882 | 24800 | 0.5016 |
545
- | 0.3897 | 24900 | 0.5219 |
546
- | 0.3913 | 25000 | 0.4937 |
547
- | 0.3929 | 25100 | 0.4647 |
548
- | 0.3944 | 25200 | 0.46 |
549
- | 0.3960 | 25300 | 0.4756 |
550
- | 0.3976 | 25400 | 0.4927 |
551
- | 0.3991 | 25500 | 0.5323 |
552
- | 0.4007 | 25600 | 0.462 |
553
- | 0.4023 | 25700 | 0.4368 |
554
- | 0.4038 | 25800 | 0.3867 |
555
- | 0.4054 | 25900 | 0.4456 |
556
- | 0.4070 | 26000 | 0.4454 |
557
- | 0.4085 | 26100 | 0.4273 |
558
- | 0.4101 | 26200 | 0.4637 |
559
- | 0.4116 | 26300 | 0.4516 |
560
- | 0.4132 | 26400 | 0.436 |
561
- | 0.4148 | 26500 | 0.4037 |
562
- | 0.4163 | 26600 | 0.4256 |
563
- | 0.4179 | 26700 | 0.4481 |
564
- | 0.4195 | 26800 | 0.4254 |
565
- | 0.4210 | 26900 | 0.4279 |
566
- | 0.4226 | 27000 | 0.4248 |
567
- | 0.4242 | 27100 | 0.4581 |
568
- | 0.4257 | 27200 | 0.4537 |
569
- | 0.4273 | 27300 | 0.4178 |
570
- | 0.4289 | 27400 | 0.441 |
571
- | 0.4304 | 27500 | 0.5254 |
572
- | 0.4320 | 27600 | 0.3648 |
573
- | 0.4336 | 27700 | 0.4023 |
574
- | 0.4351 | 27800 | 0.4406 |
575
- | 0.4367 | 27900 | 0.4055 |
576
- | 0.4383 | 28000 | 0.3305 |
577
- | 0.4398 | 28100 | 0.3733 |
578
- | 0.4414 | 28200 | 0.3679 |
579
- | 0.4430 | 28300 | 0.3942 |
580
- | 0.4445 | 28400 | 0.4282 |
581
- | 0.4461 | 28500 | 0.3995 |
582
- | 0.4476 | 28600 | 0.3282 |
583
- | 0.4492 | 28700 | 0.3822 |
584
- | 0.4508 | 28800 | 0.3991 |
585
- | 0.4523 | 28900 | 0.4001 |
586
- | 0.4539 | 29000 | 0.4485 |
587
- | 0.4555 | 29100 | 0.3787 |
588
- | 0.4570 | 29200 | 0.4055 |
589
- | 0.4586 | 29300 | 0.4274 |
590
- | 0.4602 | 29400 | 0.4106 |
591
- | 0.4617 | 29500 | 0.3746 |
592
- | 0.4633 | 29600 | 0.3768 |
593
- | 0.4649 | 29700 | 0.3591 |
594
- | 0.4664 | 29800 | 0.395 |
595
- | 0.4680 | 29900 | 0.3783 |
596
- | 0.4696 | 30000 | 0.3932 |
597
- | 0.4711 | 30100 | 0.4186 |
598
- | 0.4727 | 30200 | 0.3538 |
599
- | 0.4743 | 30300 | 0.3589 |
600
- | 0.4758 | 30400 | 0.4194 |
601
- | 0.4774 | 30500 | 0.3879 |
602
- | 0.4790 | 30600 | 0.3437 |
603
- | 0.4805 | 30700 | 0.3932 |
604
- | 0.4821 | 30800 | 0.3417 |
605
- | 0.4836 | 30900 | 0.3534 |
606
- | 0.4852 | 31000 | 0.2998 |
607
- | 0.4868 | 31100 | 0.4275 |
608
- | 0.4883 | 31200 | 0.3398 |
609
- | 0.4899 | 31300 | 0.3497 |
610
- | 0.4915 | 31400 | 0.3066 |
611
- | 0.4930 | 31500 | 0.3555 |
612
- | 0.4946 | 31600 | 0.3519 |
613
- | 0.4962 | 31700 | 0.3386 |
614
- | 0.4977 | 31800 | 0.3326 |
615
- | 0.4993 | 31900 | 0.3176 |
616
- | 0.5009 | 32000 | 0.3464 |
617
- | 0.5024 | 32100 | 0.3588 |
618
- | 0.5040 | 32200 | 0.3656 |
619
- | 0.5056 | 32300 | 0.3168 |
620
- | 0.5071 | 32400 | 0.3859 |
621
- | 0.5087 | 32500 | 0.3668 |
622
- | 0.5103 | 32600 | 0.3125 |
623
- | 0.5118 | 32700 | 0.3357 |
624
- | 0.5134 | 32800 | 0.3328 |
625
- | 0.5150 | 32900 | 0.3245 |
626
- | 0.5165 | 33000 | 0.3408 |
627
- | 0.5181 | 33100 | 0.3848 |
628
- | 0.5196 | 33200 | 0.3401 |
629
- | 0.5212 | 33300 | 0.2744 |
630
- | 0.5228 | 33400 | 0.3138 |
631
- | 0.5243 | 33500 | 0.2953 |
632
- | 0.5259 | 33600 | 0.2965 |
633
- | 0.5275 | 33700 | 0.2972 |
634
- | 0.5290 | 33800 | 0.3247 |
635
- | 0.5306 | 33900 | 0.3158 |
636
- | 0.5322 | 34000 | 0.3184 |
637
- | 0.5337 | 34100 | 0.3292 |
638
- | 0.5353 | 34200 | 0.2914 |
639
- | 0.5369 | 34300 | 0.3536 |
640
- | 0.5384 | 34400 | 0.285 |
641
- | 0.5400 | 34500 | 0.3322 |
642
- | 0.5416 | 34600 | 0.3349 |
643
- | 0.5431 | 34700 | 0.3244 |
644
- | 0.5447 | 34800 | 0.253 |
645
- | 0.5463 | 34900 | 0.314 |
646
- | 0.5478 | 35000 | 0.3751 |
647
- | 0.5494 | 35100 | 0.2968 |
648
- | 0.5510 | 35200 | 0.3863 |
649
- | 0.5525 | 35300 | 0.2914 |
650
- | 0.5541 | 35400 | 0.2906 |
651
- | 0.5556 | 35500 | 0.3472 |
652
- | 0.5572 | 35600 | 0.3088 |
653
- | 0.5588 | 35700 | 0.3016 |
654
- | 0.5603 | 35800 | 0.3584 |
655
- | 0.5619 | 35900 | 0.3282 |
656
- | 0.5635 | 36000 | 0.4005 |
657
- | 0.5650 | 36100 | 0.3266 |
658
- | 0.5666 | 36200 | 0.3704 |
659
- | 0.5682 | 36300 | 0.4014 |
660
- | 0.5697 | 36400 | 0.3866 |
661
- | 0.5713 | 36500 | 0.3927 |
662
- | 0.5729 | 36600 | 0.3595 |
663
- | 0.5744 | 36700 | 0.3386 |
664
- | 0.5760 | 36800 | 0.394 |
665
- | 0.5776 | 36900 | 0.4363 |
666
- | 0.5791 | 37000 | 0.4669 |
667
- | 0.5807 | 37100 | 0.4404 |
668
- | 0.5823 | 37200 | 0.4326 |
669
- | 0.5838 | 37300 | 0.4303 |
670
- | 0.5854 | 37400 | 0.4496 |
671
- | 0.5870 | 37500 | 0.4461 |
672
- | 0.5885 | 37600 | 0.5314 |
673
- | 0.5901 | 37700 | 0.5424 |
674
- | 0.5916 | 37800 | 0.4604 |
675
- | 0.5932 | 37900 | 0.515 |
676
- | 0.5948 | 38000 | 0.5045 |
677
- | 0.5963 | 38100 | 0.5254 |
678
- | 0.5979 | 38200 | 0.5213 |
679
- | 0.5995 | 38300 | 0.5704 |
680
- | 0.6010 | 38400 | 0.5427 |
681
- | 0.6026 | 38500 | 0.4767 |
682
- | 0.6042 | 38600 | 0.5317 |
683
- | 0.6057 | 38700 | 0.5019 |
684
- | 0.6073 | 38800 | 0.5453 |
685
- | 0.6089 | 38900 | 0.5469 |
686
- | 0.6104 | 39000 | 0.4875 |
687
- | 0.6120 | 39100 | 0.5239 |
688
- | 0.6136 | 39200 | 0.5179 |
689
- | 0.6151 | 39300 | 0.5316 |
690
- | 0.6167 | 39400 | 0.523 |
691
- | 0.6183 | 39500 | 0.5474 |
692
- | 0.6198 | 39600 | 0.5844 |
693
- | 0.6214 | 39700 | 0.5094 |
694
- | 0.6230 | 39800 | 0.5815 |
695
- | 0.6245 | 39900 | 0.508 |
696
- | 0.6261 | 40000 | 0.4752 |
697
- | 0.6276 | 40100 | 0.5505 |
698
- | 0.6292 | 40200 | 0.4832 |
699
- | 0.6308 | 40300 | 0.5106 |
700
- | 0.6323 | 40400 | 0.556 |
701
- | 0.6339 | 40500 | 0.522 |
702
- | 0.6355 | 40600 | 0.5709 |
703
- | 0.6370 | 40700 | 0.521 |
704
- | 0.6386 | 40800 | 0.4999 |
705
- | 0.6402 | 40900 | 0.5338 |
706
- | 0.6417 | 41000 | 0.5275 |
707
- | 0.6433 | 41100 | 0.4885 |
708
- | 0.6449 | 41200 | 0.4608 |
709
- | 0.6464 | 41300 | 0.5604 |
710
- | 0.6480 | 41400 | 0.4158 |
711
- | 0.6496 | 41500 | 0.5148 |
712
- | 0.6511 | 41600 | 0.4784 |
713
- | 0.6527 | 41700 | 0.4744 |
714
- | 0.6543 | 41800 | 0.4993 |
715
- | 0.6558 | 41900 | 0.4616 |
716
- | 0.6574 | 42000 | 0.4763 |
717
- | 0.6590 | 42100 | 0.4979 |
718
- | 0.6605 | 42200 | 0.4679 |
719
- | 0.6621 | 42300 | 0.4349 |
720
- | 0.6636 | 42400 | 0.4849 |
721
- | 0.6652 | 42500 | 0.487 |
722
- | 0.6668 | 42600 | 0.4632 |
723
- | 0.6683 | 42700 | 0.4418 |
724
- | 0.6699 | 42800 | 0.4591 |
725
- | 0.6715 | 42900 | 0.473 |
726
- | 0.6730 | 43000 | 0.4695 |
727
- | 0.6746 | 43100 | 0.4785 |
728
- | 0.6762 | 43200 | 0.4614 |
729
- | 0.6777 | 43300 | 0.5182 |
730
- | 0.6793 | 43400 | 0.4268 |
731
- | 0.6809 | 43500 | 0.4301 |
732
- | 0.6824 | 43600 | 0.3894 |
733
- | 0.6840 | 43700 | 0.4174 |
734
- | 0.6856 | 43800 | 0.4129 |
735
- | 0.6871 | 43900 | 0.3985 |
736
- | 0.6887 | 44000 | 0.4547 |
737
- | 0.6903 | 44100 | 0.4121 |
738
- | 0.6918 | 44200 | 0.4345 |
739
- | 0.6934 | 44300 | 0.3525 |
740
- | 0.6950 | 44400 | 0.3674 |
741
- | 0.6965 | 44500 | 0.4406 |
742
- | 0.6981 | 44600 | 0.4281 |
743
- | 0.6996 | 44700 | 0.4201 |
744
- | 0.7012 | 44800 | 0.4308 |
745
- | 0.7028 | 44900 | 0.4303 |
746
- | 0.7043 | 45000 | 0.4358 |
747
- | 0.7059 | 45100 | 0.3965 |
748
- | 0.7075 | 45200 | 0.4004 |
749
- | 0.7090 | 45300 | 0.422 |
750
- | 0.7106 | 45400 | 0.4235 |
751
- | 0.7122 | 45500 | 0.3864 |
752
- | 0.7137 | 45600 | 0.3423 |
753
- | 0.7153 | 45700 | 0.3983 |
754
- | 0.7169 | 45800 | 0.3423 |
755
- | 0.7184 | 45900 | 0.3757 |
756
- | 0.7200 | 46000 | 0.4296 |
757
- | 0.7216 | 46100 | 0.3518 |
758
- | 0.7231 | 46200 | 0.3589 |
759
- | 0.7247 | 46300 | 0.3653 |
760
- | 0.7263 | 46400 | 0.3881 |
761
- | 0.7278 | 46500 | 0.3762 |
762
- | 0.7294 | 46600 | 0.3941 |
763
- | 0.7310 | 46700 | 0.3596 |
764
- | 0.7325 | 46800 | 0.323 |
765
- | 0.7341 | 46900 | 0.3331 |
766
- | 0.7356 | 47000 | 0.3551 |
767
- | 0.7372 | 47100 | 0.3599 |
768
- | 0.7388 | 47200 | 0.3255 |
769
- | 0.7403 | 47300 | 0.2938 |
770
- | 0.7419 | 47400 | 0.3351 |
771
- | 0.7435 | 47500 | 0.341 |
772
- | 0.7450 | 47600 | 0.3388 |
773
- | 0.7466 | 47700 | 0.325 |
774
- | 0.7482 | 47800 | 0.3545 |
775
- | 0.7497 | 47900 | 0.3068 |
776
- | 0.7513 | 48000 | 0.29 |
777
- | 0.7529 | 48100 | 0.3051 |
778
- | 0.7544 | 48200 | 0.311 |
779
- | 0.7560 | 48300 | 0.3396 |
780
- | 0.7576 | 48400 | 0.3347 |
781
- | 0.7591 | 48500 | 0.3219 |
782
- | 0.7607 | 48600 | 0.2916 |
783
- | 0.7623 | 48700 | 0.2772 |
784
- | 0.7638 | 48800 | 0.3239 |
785
- | 0.7654 | 48900 | 0.3208 |
786
- | 0.7670 | 49000 | 0.3585 |
787
- | 0.7685 | 49100 | 0.3219 |
788
- | 0.7701 | 49200 | 0.3573 |
789
- | 0.7716 | 49300 | 0.2854 |
790
- | 0.7732 | 49400 | 0.3193 |
791
- | 0.7748 | 49500 | 0.3109 |
792
- | 0.7763 | 49600 | 0.2972 |
793
- | 0.7779 | 49700 | 0.3188 |
794
- | 0.7795 | 49800 | 0.3122 |
795
- | 0.7810 | 49900 | 0.2882 |
796
- | 0.7826 | 50000 | 0.3077 |
797
- | 0.7842 | 50100 | 0.2796 |
798
- | 0.7857 | 50200 | 0.3187 |
799
- | 0.7873 | 50300 | 0.3329 |
800
- | 0.7889 | 50400 | 0.3291 |
801
- | 0.7904 | 50500 | 0.3153 |
802
- | 0.7920 | 50600 | 0.3092 |
803
- | 0.7936 | 50700 | 0.2549 |
804
- | 0.7951 | 50800 | 0.2795 |
805
- | 0.7967 | 50900 | 0.2955 |
806
- | 0.7983 | 51000 | 0.362 |
807
- | 0.7998 | 51100 | 0.2585 |
808
- | 0.8014 | 51200 | 0.2437 |
809
- | 0.8030 | 51300 | 0.291 |
810
- | 0.8045 | 51400 | 0.2639 |
811
- | 0.8061 | 51500 | 0.2785 |
812
- | 0.8076 | 51600 | 0.2739 |
813
- | 0.8092 | 51700 | 0.2699 |
814
- | 0.8108 | 51800 | 0.3007 |
815
- | 0.8123 | 51900 | 0.3044 |
816
- | 0.8139 | 52000 | 0.2994 |
817
- | 0.8155 | 52100 | 0.2742 |
818
- | 0.8170 | 52200 | 0.291 |
819
- | 0.8186 | 52300 | 0.2517 |
820
- | 0.8202 | 52400 | 0.2613 |
821
- | 0.8217 | 52500 | 0.2767 |
822
- | 0.8233 | 52600 | 0.2424 |
823
- | 0.8249 | 52700 | 0.2666 |
824
- | 0.8264 | 52800 | 0.262 |
825
- | 0.8280 | 52900 | 0.2884 |
826
- | 0.8296 | 53000 | 0.2636 |
827
- | 0.8311 | 53100 | 0.2807 |
828
- | 0.8327 | 53200 | 0.2737 |
829
- | 0.8343 | 53300 | 0.2764 |
830
- | 0.8358 | 53400 | 0.2652 |
831
- | 0.8374 | 53500 | 0.3061 |
832
- | 0.8390 | 53600 | 0.2704 |
833
- | 0.8405 | 53700 | 0.2372 |
834
- | 0.8421 | 53800 | 0.2595 |
835
- | 0.8436 | 53900 | 0.2662 |
836
- | 0.8452 | 54000 | 0.2692 |
837
- | 0.8468 | 54100 | 0.246 |
838
- | 0.8483 | 54200 | 0.2571 |
839
- | 0.8499 | 54300 | 0.2485 |
840
- | 0.8515 | 54400 | 0.2418 |
841
- | 0.8530 | 54500 | 0.3039 |
842
- | 0.8546 | 54600 | 0.2218 |
843
- | 0.8562 | 54700 | 0.2676 |
844
- | 0.8577 | 54800 | 0.2299 |
845
- | 0.8593 | 54900 | 0.2782 |
846
- | 0.8609 | 55000 | 0.2779 |
847
- | 0.8624 | 55100 | 0.2817 |
848
- | 0.8640 | 55200 | 0.2549 |
849
- | 0.8656 | 55300 | 0.2361 |
850
- | 0.8671 | 55400 | 0.2599 |
851
- | 0.8687 | 55500 | 0.231 |
852
- | 0.8703 | 55600 | 0.2741 |
853
- | 0.8718 | 55700 | 0.2553 |
854
- | 0.8734 | 55800 | 0.2569 |
855
- | 0.8750 | 55900 | 0.2338 |
856
- | 0.8765 | 56000 | 0.2212 |
857
- | 0.8781 | 56100 | 0.2301 |
858
- | 0.8796 | 56200 | 0.2518 |
859
- | 0.8812 | 56300 | 0.2485 |
860
- | 0.8828 | 56400 | 0.2373 |
861
- | 0.8843 | 56500 | 0.2346 |
862
- | 0.8859 | 56600 | 0.249 |
863
- | 0.8875 | 56700 | 0.2295 |
864
- | 0.8890 | 56800 | 0.2208 |
865
- | 0.8906 | 56900 | 0.2356 |
866
- | 0.8922 | 57000 | 0.2405 |
867
- | 0.8937 | 57100 | 0.2211 |
868
- | 0.8953 | 57200 | 0.2641 |
869
- | 0.8969 | 57300 | 0.2104 |
870
- | 0.8984 | 57400 | 0.2586 |
871
- | 0.9000 | 57500 | 0.2369 |
872
- | 0.9016 | 57600 | 0.2396 |
873
- | 0.9031 | 57700 | 0.2014 |
874
- | 0.9047 | 57800 | 0.2532 |
875
- | 0.9063 | 57900 | 0.2141 |
876
- | 0.9078 | 58000 | 0.232 |
877
- | 0.9094 | 58100 | 0.2189 |
878
- | 0.9110 | 58200 | 0.2174 |
879
- | 0.9125 | 58300 | 0.1974 |
880
- | 0.9141 | 58400 | 0.2119 |
881
- | 0.9156 | 58500 | 0.2294 |
882
- | 0.9172 | 58600 | 0.2379 |
883
- | 0.9188 | 58700 | 0.1962 |
884
- | 0.9203 | 58800 | 0.2299 |
885
- | 0.9219 | 58900 | 0.2104 |
886
- | 0.9235 | 59000 | 0.2229 |
887
- | 0.9250 | 59100 | 0.204 |
888
- | 0.9266 | 59200 | 0.1816 |
889
- | 0.9282 | 59300 | 0.2173 |
890
- | 0.9297 | 59400 | 0.2037 |
891
- | 0.9313 | 59500 | 0.2005 |
892
- | 0.9329 | 59600 | 0.1998 |
893
- | 0.9344 | 59700 | 0.1918 |
894
- | 0.9360 | 59800 | 0.2022 |
895
- | 0.9376 | 59900 | 0.1858 |
896
- | 0.9391 | 60000 | 0.2084 |
897
- | 0.9407 | 60100 | 0.1984 |
898
- | 0.9423 | 60200 | 0.2009 |
899
- | 0.9438 | 60300 | 0.1694 |
900
- | 0.9454 | 60400 | 0.2507 |
901
- | 0.9470 | 60500 | 0.2082 |
902
- | 0.9485 | 60600 | 0.1805 |
903
- | 0.9501 | 60700 | 0.2002 |
904
- | 0.9516 | 60800 | 0.2165 |
905
- | 0.9532 | 60900 | 0.2232 |
906
- | 0.9548 | 61000 | 0.1963 |
907
- | 0.9563 | 61100 | 0.165 |
908
- | 0.9579 | 61200 | 0.1947 |
909
- | 0.9595 | 61300 | 0.2308 |
910
- | 0.9610 | 61400 | 0.1987 |
911
- | 0.9626 | 61500 | 0.2113 |
912
- | 0.9642 | 61600 | 0.2413 |
913
- | 0.9657 | 61700 | 0.2001 |
914
- | 0.9673 | 61800 | 0.2219 |
915
- | 0.9689 | 61900 | 0.2279 |
916
- | 0.9704 | 62000 | 0.2258 |
917
- | 0.9720 | 62100 | 0.1654 |
918
- | 0.9736 | 62200 | 0.1555 |
919
- | 0.9751 | 62300 | 0.1716 |
920
- | 0.9767 | 62400 | 0.1832 |
921
- | 0.9783 | 62500 | 0.1905 |
922
- | 0.9798 | 62600 | 0.1859 |
923
- | 0.9814 | 62700 | 0.1681 |
924
- | 0.9830 | 62800 | 0.1811 |
925
- | 0.9845 | 62900 | 0.2062 |
926
- | 0.9861 | 63000 | 0.1769 |
927
- | 0.9876 | 63100 | 0.1367 |
928
- | 0.9892 | 63200 | 0.1801 |
929
- | 0.9908 | 63300 | 0.1386 |
930
- | 0.9923 | 63400 | 0.1989 |
931
- | 0.9939 | 63500 | 0.1574 |
932
- | 0.9955 | 63600 | 0.1584 |
933
- | 0.9970 | 63700 | 0.2672 |
934
- | 0.9986 | 63800 | 0.3305 |
935
- | 1.0002 | 63900 | 0.3934 |
936
- | 1.0018 | 64000 | 0.061 |
937
- | 1.0033 | 64100 | 0.0605 |
938
- | 1.0049 | 64200 | 0.0466 |
939
- | 1.0064 | 64300 | 0.0626 |
940
- | 1.0080 | 64400 | 0.0861 |
941
- | 1.0096 | 64500 | 0.0991 |
942
- | 1.0111 | 64600 | 0.2984 |
943
- | 1.0127 | 64700 | 0.5773 |
944
- | 1.0143 | 64800 | 0.9207 |
945
- | 1.0158 | 64900 | 0.5435 |
946
- | 1.0174 | 65000 | 0.6465 |
947
- | 1.0190 | 65100 | 0.6672 |
948
- | 1.0205 | 65200 | 0.6251 |
949
- | 1.0221 | 65300 | 0.6118 |
950
- | 1.0237 | 65400 | 0.4914 |
951
- | 1.0252 | 65500 | 0.5557 |
952
- | 1.0268 | 65600 | 0.6045 |
953
- | 1.0284 | 65700 | 0.5637 |
954
- | 1.0299 | 65800 | 0.8428 |
955
- | 1.0315 | 65900 | 0.6716 |
956
- | 1.0331 | 66000 | 0.6027 |
957
- | 1.0346 | 66100 | 0.6518 |
958
- | 1.0362 | 66200 | 0.5806 |
959
- | 1.0378 | 66300 | 0.5392 |
960
- | 1.0393 | 66400 | 0.5913 |
961
- | 1.0409 | 66500 | 0.5733 |
962
- | 1.0424 | 66600 | 0.604 |
963
- | 1.0440 | 66700 | 0.5877 |
964
- | 1.0456 | 66800 | 0.556 |
965
- | 1.0471 | 66900 | 0.5371 |
966
- | 1.0487 | 67000 | 0.5135 |
967
- | 1.0503 | 67100 | 0.5408 |
968
- | 1.0518 | 67200 | 0.5689 |
969
- | 1.0534 | 67300 | 0.5943 |
970
- | 1.0550 | 67400 | 0.5994 |
971
- | 1.0565 | 67500 | 0.6756 |
972
- | 1.0581 | 67600 | 0.625 |
973
- | 1.0597 | 67700 | 0.6065 |
974
- | 1.0612 | 67800 | 0.5901 |
975
- | 1.0628 | 67900 | 0.6384 |
976
- | 1.0644 | 68000 | 0.6305 |
977
- | 1.0659 | 68100 | 0.6138 |
978
- | 1.0675 | 68200 | 0.6068 |
979
- | 1.0691 | 68300 | 0.6477 |
980
- | 1.0706 | 68400 | 0.617 |
981
- | 1.0722 | 68500 | 0.625 |
982
- | 1.0738 | 68600 | 0.6302 |
983
- | 1.0753 | 68700 | 0.6513 |
984
- | 1.0769 | 68800 | 0.6124 |
985
- | 1.0784 | 68900 | 0.6971 |
986
- | 1.0800 | 69000 | 0.6763 |
987
- | 1.0816 | 69100 | 0.6935 |
988
- | 1.0831 | 69200 | 0.6307 |
989
- | 1.0847 | 69300 | 0.6509 |
990
- | 1.0863 | 69400 | 0.6519 |
991
- | 1.0878 | 69500 | 0.6832 |
992
- | 1.0894 | 69600 | 0.5655 |
993
- | 1.0910 | 69700 | 0.6134 |
994
- | 1.0925 | 69800 | 0.6029 |
995
- | 1.0941 | 69900 | 0.5779 |
996
- | 1.0957 | 70000 | 0.6158 |
997
- | 1.0972 | 70100 | 0.5758 |
998
- | 1.0988 | 70200 | 0.5649 |
999
- | 1.1004 | 70300 | 0.5438 |
1000
- | 1.1019 | 70400 | 0.543 |
1001
- | 1.1035 | 70500 | 0.5765 |
1002
- | 1.1051 | 70600 | 0.6113 |
1003
- | 1.1066 | 70700 | 0.5815 |
1004
- | 1.1082 | 70800 | 0.5942 |
1005
- | 1.1098 | 70900 | 0.6293 |
1006
- | 1.1113 | 71000 | 0.5186 |
1007
- | 1.1129 | 71100 | 0.5703 |
1008
- | 1.1144 | 71200 | 0.5688 |
1009
- | 1.1160 | 71300 | 0.5855 |
1010
- | 1.1176 | 71400 | 0.5591 |
1011
- | 1.1191 | 71500 | 0.5137 |
1012
- | 1.1207 | 71600 | 0.5905 |
1013
- | 1.1223 | 71700 | 0.5123 |
1014
- | 1.1238 | 71800 | 0.5028 |
1015
- | 1.1254 | 71900 | 0.5806 |
1016
- | 1.1270 | 72000 | 0.5305 |
1017
- | 1.1285 | 72100 | 0.5299 |
1018
- | 1.1301 | 72200 | 0.5293 |
1019
- | 1.1317 | 72300 | 0.4948 |
1020
- | 1.1332 | 72400 | 0.5292 |
1021
- | 1.1348 | 72500 | 0.5252 |
1022
- | 1.1364 | 72600 | 0.5153 |
1023
- | 1.1379 | 72700 | 0.5695 |
1024
- | 1.1395 | 72800 | 0.5157 |
1025
- | 1.1411 | 72900 | 0.5078 |
1026
- | 1.1426 | 73000 | 0.5311 |
1027
- | 1.1442 | 73100 | 0.4657 |
1028
- | 1.1458 | 73200 | 0.518 |
1029
- | 1.1473 | 73300 | 0.5145 |
1030
- | 1.1489 | 73400 | 0.553 |
1031
- | 1.1504 | 73500 | 0.5048 |
1032
- | 1.1520 | 73600 | 0.4276 |
1033
- | 1.1536 | 73700 | 0.5176 |
1034
- | 1.1551 | 73800 | 0.4791 |
1035
- | 1.1567 | 73900 | 0.4971 |
1036
- | 1.1583 | 74000 | 0.4629 |
1037
- | 1.1598 | 74100 | 0.5753 |
1038
- | 1.1614 | 74200 | 0.5251 |
1039
- | 1.1630 | 74300 | 0.4927 |
1040
- | 1.1645 | 74400 | 0.4722 |
1041
- | 1.1661 | 74500 | 0.4372 |
1042
- | 1.1677 | 74600 | 0.4661 |
1043
- | 1.1692 | 74700 | 0.4696 |
1044
- | 1.1708 | 74800 | 0.4959 |
1045
- | 1.1724 | 74900 | 0.468 |
1046
- | 1.1739 | 75000 | 0.4668 |
1047
- | 1.1755 | 75100 | 0.436 |
1048
- | 1.1771 | 75200 | 0.47 |
1049
- | 1.1786 | 75300 | 0.4695 |
1050
- | 1.1802 | 75400 | 0.4892 |
1051
- | 1.1818 | 75500 | 0.4626 |
1052
- | 1.1833 | 75600 | 0.3783 |
1053
- | 1.1849 | 75700 | 0.4643 |
1054
- | 1.1864 | 75800 | 0.4487 |
1055
- | 1.1880 | 75900 | 0.4633 |
1056
- | 1.1896 | 76000 | 0.5046 |
1057
- | 1.1911 | 76100 | 0.4137 |
1058
- | 1.1927 | 76200 | 0.4798 |
1059
- | 1.1943 | 76300 | 0.4893 |
1060
- | 1.1958 | 76400 | 0.4699 |
1061
- | 1.1974 | 76500 | 0.488 |
1062
- | 1.1990 | 76600 | 0.4606 |
1063
- | 1.2005 | 76700 | 0.5116 |
1064
- | 1.2021 | 76800 | 0.4376 |
1065
- | 1.2037 | 76900 | 0.5005 |
1066
- | 1.2052 | 77000 | 0.4513 |
1067
- | 1.2068 | 77100 | 0.4805 |
1068
- | 1.2084 | 77200 | 0.4339 |
1069
- | 1.2099 | 77300 | 0.464 |
1070
- | 1.2115 | 77400 | 0.4584 |
1071
- | 1.2131 | 77500 | 0.4996 |
1072
- | 1.2146 | 77600 | 0.4658 |
1073
- | 1.2162 | 77700 | 0.4269 |
1074
- | 1.2178 | 77800 | 0.4783 |
1075
- | 1.2193 | 77900 | 0.4737 |
1076
- | 1.2209 | 78000 | 0.4465 |
1077
- | 1.2224 | 78100 | 0.4581 |
1078
- | 1.2240 | 78200 | 0.4007 |
1079
- | 1.2256 | 78300 | 0.5317 |
1080
- | 1.2271 | 78400 | 0.4474 |
1081
- | 1.2287 | 78500 | 0.4715 |
1082
- | 1.2303 | 78600 | 0.5003 |
1083
- | 1.2318 | 78700 | 0.4596 |
1084
- | 1.2334 | 78800 | 0.4475 |
1085
- | 1.2350 | 78900 | 0.3714 |
1086
- | 1.2365 | 79000 | 0.4179 |
1087
- | 1.2381 | 79100 | 0.4371 |
1088
- | 1.2397 | 79200 | 0.4772 |
1089
- | 1.2412 | 79300 | 0.4611 |
1090
- | 1.2428 | 79400 | 0.4518 |
1091
- | 1.2444 | 79500 | 0.5327 |
1092
- | 1.2459 | 79600 | 0.4819 |
1093
- | 1.2475 | 79700 | 0.4928 |
1094
- | 1.2491 | 79800 | 0.5269 |
1095
- | 1.2506 | 79900 | 0.4739 |
1096
- | 1.2522 | 80000 | 0.5247 |
1097
- | 1.2538 | 80100 | 0.4922 |
1098
- | 1.2553 | 80200 | 0.499 |
1099
- | 1.2569 | 80300 | 0.4879 |
1100
- | 1.2584 | 80400 | 0.4798 |
1101
- | 1.2600 | 80500 | 0.4917 |
1102
- | 1.2616 | 80600 | 0.4719 |
1103
- | 1.2631 | 80700 | 0.4937 |
1104
- | 1.2647 | 80800 | 0.5218 |
1105
- | 1.2663 | 80900 | 0.4716 |
1106
- | 1.2678 | 81000 | 0.4111 |
1107
- | 1.2694 | 81100 | 0.4639 |
1108
- | 1.2710 | 81200 | 0.4828 |
1109
- | 1.2725 | 81300 | 0.4947 |
1110
- | 1.2741 | 81400 | 0.5332 |
1111
- | 1.2757 | 81500 | 0.4903 |
1112
- | 1.2772 | 81600 | 0.5018 |
1113
- | 1.2788 | 81700 | 0.4993 |
1114
- | 1.2804 | 81800 | 0.4921 |
1115
- | 1.2819 | 81900 | 0.4922 |
1116
- | 1.2835 | 82000 | 0.5072 |
1117
- | 1.2851 | 82100 | 0.4958 |
1118
- | 1.2866 | 82200 | 0.4452 |
1119
- | 1.2882 | 82300 | 0.5346 |
1120
- | 1.2898 | 82400 | 0.4844 |
1121
- | 1.2913 | 82500 | 0.4459 |
1122
- | 1.2929 | 82600 | 0.5695 |
1123
- | 1.2944 | 82700 | 0.5381 |
1124
- | 1.2960 | 82800 | 0.5174 |
1125
- | 1.2976 | 82900 | 0.4948 |
1126
- | 1.2991 | 83000 | 0.5166 |
1127
- | 1.3007 | 83100 | 0.5101 |
1128
- | 1.3023 | 83200 | 0.5102 |
1129
- | 1.3038 | 83300 | 0.5428 |
1130
- | 1.3054 | 83400 | 0.4097 |
1131
- | 1.3070 | 83500 | 0.4566 |
1132
- | 1.3085 | 83600 | 0.4987 |
1133
- | 1.3101 | 83700 | 0.4754 |
1134
- | 1.3117 | 83800 | 0.5283 |
1135
- | 1.3132 | 83900 | 0.4426 |
1136
- | 1.3148 | 84000 | 0.4723 |
1137
- | 1.3164 | 84100 | 0.4705 |
1138
- | 1.3179 | 84200 | 0.4368 |
1139
- | 1.3195 | 84300 | 0.4495 |
1140
- | 1.3211 | 84400 | 0.5593 |
1141
- | 1.3226 | 84500 | 0.4466 |
1142
- | 1.3242 | 84600 | 0.4994 |
1143
- | 1.3258 | 84700 | 0.456 |
1144
- | 1.3273 | 84800 | 0.4788 |
1145
- | 1.3289 | 84900 | 0.4185 |
1146
- | 1.3304 | 85000 | 0.4321 |
1147
- | 1.3320 | 85100 | 0.4796 |
1148
- | 1.3336 | 85200 | 0.4207 |
1149
- | 1.3351 | 85300 | 0.4875 |
1150
- | 1.3367 | 85400 | 0.5018 |
1151
- | 1.3383 | 85500 | 0.4184 |
1152
- | 1.3398 | 85600 | 0.4233 |
1153
- | 1.3414 | 85700 | 0.423 |
1154
- | 1.3430 | 85800 | 0.4756 |
1155
- | 1.3445 | 85900 | 0.4477 |
1156
- | 1.3461 | 86000 | 0.4468 |
1157
- | 1.3477 | 86100 | 0.49 |
1158
- | 1.3492 | 86200 | 0.481 |
1159
- | 1.3508 | 86300 | 0.4905 |
1160
- | 1.3524 | 86400 | 0.4642 |
1161
- | 1.3539 | 86500 | 0.4864 |
1162
- | 1.3555 | 86600 | 0.4776 |
1163
- | 1.3571 | 86700 | 0.5025 |
1164
- | 1.3586 | 86800 | 0.5197 |
1165
- | 1.3602 | 86900 | 0.4791 |
1166
- | 1.3618 | 87000 | 0.5563 |
1167
- | 1.3633 | 87100 | 0.5164 |
1168
- | 1.3649 | 87200 | 0.4704 |
1169
- | 1.3664 | 87300 | 0.5112 |
1170
- | 1.3680 | 87400 | 0.4766 |
1171
- | 1.3696 | 87500 | 0.47 |
1172
- | 1.3711 | 87600 | 0.5587 |
1173
- | 1.3727 | 87700 | 0.521 |
1174
- | 1.3743 | 87800 | 0.5563 |
1175
- | 1.3758 | 87900 | 0.5557 |
1176
- | 1.3774 | 88000 | 0.5995 |
1177
- | 1.3790 | 88100 | 0.4425 |
1178
- | 1.3805 | 88200 | 0.5123 |
1179
- | 1.3821 | 88300 | 0.3313 |
1180
- | 1.3837 | 88400 | 0.2502 |
1181
- | 1.3852 | 88500 | 0.3148 |
1182
- | 1.3868 | 88600 | 0.2991 |
1183
- | 1.3884 | 88700 | 0.2907 |
1184
- | 1.3899 | 88800 | 0.3261 |
1185
- | 1.3915 | 88900 | 0.2762 |
1186
- | 1.3931 | 89000 | 0.2481 |
1187
- | 1.3946 | 89100 | 0.2885 |
1188
- | 1.3962 | 89200 | 0.285 |
1189
- | 1.3978 | 89300 | 0.3068 |
1190
- | 1.3993 | 89400 | 0.3083 |
1191
- | 1.4009 | 89500 | 0.2803 |
1192
- | 1.4024 | 89600 | 0.2403 |
1193
- | 1.4040 | 89700 | 0.236 |
1194
- | 1.4056 | 89800 | 0.2668 |
1195
- | 1.4071 | 89900 | 0.2458 |
1196
- | 1.4087 | 90000 | 0.233 |
1197
- | 1.4103 | 90100 | 0.2855 |
1198
- | 1.4118 | 90200 | 0.2446 |
1199
- | 1.4134 | 90300 | 0.2402 |
1200
- | 1.4150 | 90400 | 0.2284 |
1201
- | 1.4165 | 90500 | 0.2357 |
1202
- | 1.4181 | 90600 | 0.2682 |
1203
- | 1.4197 | 90700 | 0.2467 |
1204
- | 1.4212 | 90800 | 0.2344 |
1205
- | 1.4228 | 90900 | 0.2502 |
1206
- | 1.4244 | 91000 | 0.2802 |
1207
- | 1.4259 | 91100 | 0.2516 |
1208
- | 1.4275 | 91200 | 0.239 |
1209
- | 1.4291 | 91300 | 0.2688 |
1210
- | 1.4306 | 91400 | 0.3018 |
1211
- | 1.4322 | 91500 | 0.2068 |
1212
- | 1.4338 | 91600 | 0.237 |
1213
- | 1.4353 | 91700 | 0.2706 |
1214
- | 1.4369 | 91800 | 0.2063 |
1215
- | 1.4384 | 91900 | 0.2011 |
1216
- | 1.4400 | 92000 | 0.1828 |
1217
- | 1.4416 | 92100 | 0.2143 |
1218
- | 1.4431 | 92200 | 0.204 |
1219
- | 1.4447 | 92300 | 0.287 |
1220
- | 1.4463 | 92400 | 0.2023 |
1221
- | 1.4478 | 92500 | 0.1836 |
1222
- | 1.4494 | 92600 | 0.2298 |
1223
- | 1.4510 | 92700 | 0.2276 |
1224
- | 1.4525 | 92800 | 0.2091 |
1225
- | 1.4541 | 92900 | 0.2535 |
1226
- | 1.4557 | 93000 | 0.2091 |
1227
- | 1.4572 | 93100 | 0.2232 |
1228
- | 1.4588 | 93200 | 0.2334 |
1229
- | 1.4604 | 93300 | 0.2396 |
1230
- | 1.4619 | 93400 | 0.2397 |
1231
- | 1.4635 | 93500 | 0.2211 |
1232
- | 1.4651 | 93600 | 0.1989 |
1233
- | 1.4666 | 93700 | 0.2416 |
1234
- | 1.4682 | 93800 | 0.2343 |
1235
- | 1.4698 | 93900 | 0.2134 |
1236
- | 1.4713 | 94000 | 0.218 |
1237
- | 1.4729 | 94100 | 0.2056 |
1238
- | 1.4744 | 94200 | 0.193 |
1239
- | 1.4760 | 94300 | 0.2516 |
1240
- | 1.4776 | 94400 | 0.2003 |
1241
- | 1.4791 | 94500 | 0.1954 |
1242
- | 1.4807 | 94600 | 0.2076 |
1243
- | 1.4823 | 94700 | 0.1803 |
1244
- | 1.4838 | 94800 | 0.2114 |
1245
- | 1.4854 | 94900 | 0.1694 |
1246
- | 1.4870 | 95000 | 0.2608 |
1247
- | 1.4885 | 95100 | 0.1988 |
1248
- | 1.4901 | 95200 | 0.2171 |
1249
- | 1.4917 | 95300 | 0.1767 |
1250
- | 1.4932 | 95400 | 0.1929 |
1251
- | 1.4948 | 95500 | 0.2025 |
1252
- | 1.4964 | 95600 | 0.1919 |
1253
- | 1.4979 | 95700 | 0.1798 |
1254
- | 1.4995 | 95800 | 0.1656 |
1255
- | 1.5011 | 95900 | 0.1985 |
1256
- | 1.5026 | 96000 | 0.2399 |
1257
- | 1.5042 | 96100 | 0.1773 |
1258
- | 1.5058 | 96200 | 0.1985 |
1259
- | 1.5073 | 96300 | 0.1957 |
1260
- | 1.5089 | 96400 | 0.2185 |
1261
- | 1.5104 | 96500 | 0.178 |
1262
- | 1.5120 | 96600 | 0.1994 |
1263
- | 1.5136 | 96700 | 0.1834 |
1264
- | 1.5151 | 96800 | 0.1804 |
1265
- | 1.5167 | 96900 | 0.1966 |
1266
- | 1.5183 | 97000 | 0.2043 |
1267
- | 1.5198 | 97100 | 0.2032 |
1268
- | 1.5214 | 97200 | 0.1559 |
1269
- | 1.5230 | 97300 | 0.1827 |
1270
- | 1.5245 | 97400 | 0.1628 |
1271
- | 1.5261 | 97500 | 0.1637 |
1272
- | 1.5277 | 97600 | 0.1795 |
1273
- | 1.5292 | 97700 | 0.1775 |
1274
- | 1.5308 | 97800 | 0.178 |
1275
- | 1.5324 | 97900 | 0.1749 |
1276
- | 1.5339 | 98000 | 0.1894 |
1277
- | 1.5355 | 98100 | 0.1594 |
1278
- | 1.5371 | 98200 | 0.1879 |
1279
- | 1.5386 | 98300 | 0.1657 |
1280
- | 1.5402 | 98400 | 0.173 |
1281
- | 1.5417 | 98500 | 0.1869 |
1282
- | 1.5433 | 98600 | 0.1754 |
1283
- | 1.5449 | 98700 | 0.1262 |
1284
- | 1.5464 | 98800 | 0.1721 |
1285
- | 1.5480 | 98900 | 0.194 |
1286
- | 1.5496 | 99000 | 0.1595 |
1287
- | 1.5511 | 99100 | 0.1991 |
1288
- | 1.5527 | 99200 | 0.1499 |
1289
- | 1.5543 | 99300 | 0.1455 |
1290
- | 1.5558 | 99400 | 0.1935 |
1291
- | 1.5574 | 99500 | 0.1716 |
1292
- | 1.5590 | 99600 | 0.1654 |
1293
- | 1.5605 | 99700 | 0.1993 |
1294
- | 1.5621 | 99800 | 0.1828 |
1295
- | 1.5637 | 99900 | 0.2098 |
1296
- | 1.5652 | 100000 | 0.1746 |
1297
- | 1.5668 | 100100 | 0.2337 |
1298
- | 1.5684 | 100200 | 0.2331 |
1299
- | 1.5699 | 100300 | 0.2213 |
1300
- | 1.5715 | 100400 | 0.2236 |
1301
- | 1.5731 | 100500 | 0.1764 |
1302
- | 1.5746 | 100600 | 0.1885 |
1303
- | 1.5762 | 100700 | 0.2246 |
1304
- | 1.5777 | 100800 | 0.263 |
1305
- | 1.5793 | 100900 | 0.2725 |
1306
- | 1.5809 | 101000 | 0.233 |
1307
- | 1.5824 | 101100 | 0.2646 |
1308
- | 1.5840 | 101200 | 0.2527 |
1309
- | 1.5856 | 101300 | 0.2593 |
1310
- | 1.5871 | 101400 | 0.2511 |
1311
- | 1.5887 | 101500 | 0.3076 |
1312
- | 1.5903 | 101600 | 0.2993 |
1313
- | 1.5918 | 101700 | 0.2508 |
1314
- | 1.5934 | 101800 | 0.3101 |
1315
- | 1.5950 | 101900 | 0.2966 |
1316
- | 1.5965 | 102000 | 0.2877 |
1317
- | 1.5981 | 102100 | 0.3309 |
1318
- | 1.5997 | 102200 | 0.3473 |
1319
- | 1.6012 | 102300 | 0.3053 |
1320
- | 1.6028 | 102400 | 0.2778 |
1321
- | 1.6044 | 102500 | 0.31 |
1322
- | 1.6059 | 102600 | 0.2798 |
1323
- | 1.6075 | 102700 | 0.3022 |
1324
- | 1.6091 | 102800 | 0.2979 |
1325
- | 1.6106 | 102900 | 0.3125 |
1326
- | 1.6122 | 103000 | 0.2893 |
1327
- | 1.6137 | 103100 | 0.3125 |
1328
- | 1.6153 | 103200 | 0.3033 |
1329
- | 1.6169 | 103300 | 0.3172 |
1330
- | 1.6184 | 103400 | 0.3001 |
1331
- | 1.6200 | 103500 | 0.3095 |
1332
- | 1.6216 | 103600 | 0.3096 |
1333
- | 1.6231 | 103700 | 0.356 |
1334
- | 1.6247 | 103800 | 0.3126 |
1335
- | 1.6263 | 103900 | 0.2989 |
1336
- | 1.6278 | 104000 | 0.3144 |
1337
- | 1.6294 | 104100 | 0.2929 |
1338
- | 1.6310 | 104200 | 0.2893 |
1339
- | 1.6325 | 104300 | 0.3429 |
1340
- | 1.6341 | 104400 | 0.3013 |
1341
- | 1.6357 | 104500 | 0.3501 |
1342
- | 1.6372 | 104600 | 0.2902 |
1343
- | 1.6388 | 104700 | 0.3155 |
1344
- | 1.6404 | 104800 | 0.3129 |
1345
- | 1.6419 | 104900 | 0.3045 |
1346
- | 1.6435 | 105000 | 0.2851 |
1347
- | 1.6451 | 105100 | 0.2824 |
1348
- | 1.6466 | 105200 | 0.3015 |
1349
- | 1.6482 | 105300 | 0.252 |
1350
- | 1.6497 | 105400 | 0.2719 |
1351
- | 1.6513 | 105500 | 0.2942 |
1352
- | 1.6529 | 105600 | 0.2768 |
1353
- | 1.6544 | 105700 | 0.2724 |
1354
- | 1.6560 | 105800 | 0.2595 |
1355
- | 1.6576 | 105900 | 0.2801 |
1356
- | 1.6591 | 106000 | 0.3121 |
1357
- | 1.6607 | 106100 | 0.2791 |
1358
- | 1.6623 | 106200 | 0.2373 |
1359
- | 1.6638 | 106300 | 0.2842 |
1360
- | 1.6654 | 106400 | 0.2715 |
1361
- | 1.6670 | 106500 | 0.2758 |
1362
- | 1.6685 | 106600 | 0.2677 |
1363
- | 1.6701 | 106700 | 0.2673 |
1364
- | 1.6717 | 106800 | 0.2767 |
1365
- | 1.6732 | 106900 | 0.2546 |
1366
- | 1.6748 | 107000 | 0.2773 |
1367
- | 1.6764 | 107100 | 0.2728 |
1368
- | 1.6779 | 107200 | 0.3119 |
1369
- | 1.6795 | 107300 | 0.2454 |
1370
- | 1.6811 | 107400 | 0.2313 |
1371
- | 1.6826 | 107500 | 0.2352 |
1372
- | 1.6842 | 107600 | 0.2234 |
1373
- | 1.6857 | 107700 | 0.239 |
1374
- | 1.6873 | 107800 | 0.2529 |
1375
- | 1.6889 | 107900 | 0.2874 |
1376
- | 1.6904 | 108000 | 0.2261 |
1377
- | 1.6920 | 108100 | 0.2577 |
1378
- | 1.6936 | 108200 | 0.1774 |
1379
- | 1.6951 | 108300 | 0.2084 |
1380
- | 1.6967 | 108400 | 0.2629 |
1381
- | 1.6983 | 108500 | 0.2257 |
1382
- | 1.6998 | 108600 | 0.2365 |
1383
- | 1.7014 | 108700 | 0.2344 |
1384
- | 1.7030 | 108800 | 0.2513 |
1385
- | 1.7045 | 108900 | 0.2278 |
1386
- | 1.7061 | 109000 | 0.2437 |
1387
- | 1.7077 | 109100 | 0.2383 |
1388
- | 1.7092 | 109200 | 0.2668 |
1389
- | 1.7108 | 109300 | 0.2273 |
1390
- | 1.7124 | 109400 | 0.2086 |
1391
- | 1.7139 | 109500 | 0.1963 |
1392
- | 1.7155 | 109600 | 0.2364 |
1393
- | 1.7171 | 109700 | 0.2005 |
1394
- | 1.7186 | 109800 | 0.2093 |
1395
- | 1.7202 | 109900 | 0.2159 |
1396
- | 1.7217 | 110000 | 0.2148 |
1397
- | 1.7233 | 110100 | 0.2278 |
1398
- | 1.7249 | 110200 | 0.2088 |
1399
- | 1.7264 | 110300 | 0.2089 |
1400
- | 1.7280 | 110400 | 0.1923 |
1401
- | 1.7296 | 110500 | 0.2446 |
1402
- | 1.7311 | 110600 | 0.2016 |
1403
- | 1.7327 | 110700 | 0.184 |
1404
- | 1.7343 | 110800 | 0.1578 |
1405
- | 1.7358 | 110900 | 0.2128 |
1406
- | 1.7374 | 111000 | 0.2003 |
1407
- | 1.7390 | 111100 | 0.182 |
1408
- | 1.7405 | 111200 | 0.1611 |
1409
- | 1.7421 | 111300 | 0.1827 |
1410
- | 1.7437 | 111400 | 0.1856 |
1411
- | 1.7452 | 111500 | 0.1907 |
1412
- | 1.7468 | 111600 | 0.1784 |
1413
- | 1.7484 | 111700 | 0.1955 |
1414
- | 1.7499 | 111800 | 0.1594 |
1415
- | 1.7515 | 111900 | 0.1786 |
1416
- | 1.7531 | 112000 | 0.172 |
1417
- | 1.7546 | 112100 | 0.1593 |
1418
- | 1.7562 | 112200 | 0.1878 |
1419
- | 1.7577 | 112300 | 0.1819 |
1420
- | 1.7593 | 112400 | 0.1674 |
1421
- | 1.7609 | 112500 | 0.1647 |
1422
- | 1.7624 | 112600 | 0.1513 |
1423
- | 1.7640 | 112700 | 0.1756 |
1424
- | 1.7656 | 112800 | 0.1676 |
1425
- | 1.7671 | 112900 | 0.2208 |
1426
- | 1.7687 | 113000 | 0.1695 |
1427
- | 1.7703 | 113100 | 0.171 |
1428
- | 1.7718 | 113200 | 0.1504 |
1429
- | 1.7734 | 113300 | 0.1963 |
1430
- | 1.7750 | 113400 | 0.1613 |
1431
- | 1.7765 | 113500 | 0.1516 |
1432
- | 1.7781 | 113600 | 0.171 |
1433
- | 1.7797 | 113700 | 0.1855 |
1434
- | 1.7812 | 113800 | 0.1556 |
1435
- | 1.7828 | 113900 | 0.1695 |
1436
- | 1.7844 | 114000 | 0.1521 |
1437
- | 1.7859 | 114100 | 0.1541 |
1438
- | 1.7875 | 114200 | 0.186 |
1439
- | 1.7891 | 114300 | 0.1724 |
1440
- | 1.7906 | 114400 | 0.1767 |
1441
- | 1.7922 | 114500 | 0.157 |
1442
- | 1.7937 | 114600 | 0.1377 |
1443
- | 1.7953 | 114700 | 0.155 |
1444
- | 1.7969 | 114800 | 0.1802 |
1445
- | 1.7984 | 114900 | 0.1735 |
1446
- | 1.8000 | 115000 | 0.1253 |
1447
- | 1.8016 | 115100 | 0.1366 |
1448
- | 1.8031 | 115200 | 0.1524 |
1449
- | 1.8047 | 115300 | 0.1391 |
1450
- | 1.8063 | 115400 | 0.1282 |
1451
- | 1.8078 | 115500 | 0.1506 |
1452
- | 1.8094 | 115600 | 0.1474 |
1453
- | 1.8110 | 115700 | 0.1603 |
1454
- | 1.8125 | 115800 | 0.1619 |
1455
- | 1.8141 | 115900 | 0.1548 |
1456
- | 1.8157 | 116000 | 0.1446 |
1457
- | 1.8172 | 116100 | 0.1555 |
1458
- | 1.8188 | 116200 | 0.1374 |
1459
- | 1.8204 | 116300 | 0.1294 |
1460
- | 1.8219 | 116400 | 0.1445 |
1461
- | 1.8235 | 116500 | 0.1305 |
1462
- | 1.8251 | 116600 | 0.1353 |
1463
- | 1.8266 | 116700 | 0.1207 |
1464
- | 1.8282 | 116800 | 0.1293 |
1465
- | 1.8297 | 116900 | 0.1313 |
1466
- | 1.8313 | 117000 | 0.1413 |
1467
- | 1.8329 | 117100 | 0.1537 |
1468
- | 1.8344 | 117200 | 0.133 |
1469
- | 1.8360 | 117300 | 0.1624 |
1470
- | 1.8376 | 117400 | 0.1486 |
1471
- | 1.8391 | 117500 | 0.1353 |
1472
- | 1.8407 | 117600 | 0.1174 |
1473
- | 1.8423 | 117700 | 0.1509 |
1474
- | 1.8438 | 117800 | 0.1295 |
1475
- | 1.8454 | 117900 | 0.1341 |
1476
- | 1.8470 | 118000 | 0.1205 |
1477
- | 1.8485 | 118100 | 0.1114 |
1478
- | 1.8501 | 118200 | 0.1387 |
1479
- | 1.8517 | 118300 | 0.1346 |
1480
- | 1.8532 | 118400 | 0.1551 |
1481
- | 1.8548 | 118500 | 0.1106 |
1482
- | 1.8564 | 118600 | 0.1521 |
1483
- | 1.8579 | 118700 | 0.1048 |
1484
- | 1.8595 | 118800 | 0.1694 |
1485
- | 1.8611 | 118900 | 0.1297 |
1486
- | 1.8626 | 119000 | 0.1619 |
1487
- | 1.8642 | 119100 | 0.1221 |
1488
- | 1.8657 | 119200 | 0.1151 |
1489
- | 1.8673 | 119300 | 0.1459 |
1490
- | 1.8689 | 119400 | 0.1153 |
1491
- | 1.8704 | 119500 | 0.1329 |
1492
- | 1.8720 | 119600 | 0.134 |
1493
- | 1.8736 | 119700 | 0.1243 |
1494
- | 1.8751 | 119800 | 0.1229 |
1495
- | 1.8767 | 119900 | 0.1184 |
1496
- | 1.8783 | 120000 | 0.1001 |
1497
- | 1.8798 | 120100 | 0.1314 |
1498
- | 1.8814 | 120200 | 0.1307 |
1499
- | 1.8830 | 120300 | 0.1134 |
1500
- | 1.8845 | 120400 | 0.1241 |
1501
- | 1.8861 | 120500 | 0.114 |
1502
- | 1.8877 | 120600 | 0.124 |
1503
- | 1.8892 | 120700 | 0.1056 |
1504
- | 1.8908 | 120800 | 0.1154 |
1505
- | 1.8924 | 120900 | 0.1056 |
1506
- | 1.8939 | 121000 | 0.1245 |
1507
- | 1.8955 | 121100 | 0.129 |
1508
- | 1.8971 | 121200 | 0.111 |
1509
- | 1.8986 | 121300 | 0.1347 |
1510
- | 1.9002 | 121400 | 0.1087 |
1511
- | 1.9017 | 121500 | 0.1078 |
1512
- | 1.9033 | 121600 | 0.1047 |
1513
- | 1.9049 | 121700 | 0.1347 |
1514
- | 1.9064 | 121800 | 0.114 |
1515
- | 1.9080 | 121900 | 0.1208 |
1516
- | 1.9096 | 122000 | 0.081 |
1517
- | 1.9111 | 122100 | 0.0903 |
1518
- | 1.9127 | 122200 | 0.1054 |
1519
- | 1.9143 | 122300 | 0.0991 |
1520
- | 1.9158 | 122400 | 0.1142 |
1521
- | 1.9174 | 122500 | 0.1154 |
1522
- | 1.9190 | 122600 | 0.0897 |
1523
- | 1.9205 | 122700 | 0.1036 |
1524
- | 1.9221 | 122800 | 0.1321 |
1525
- | 1.9237 | 122900 | 0.1037 |
1526
- | 1.9252 | 123000 | 0.069 |
1527
- | 1.9268 | 123100 | 0.0959 |
1528
- | 1.9284 | 123200 | 0.0957 |
1529
- | 1.9299 | 123300 | 0.1062 |
1530
- | 1.9315 | 123400 | 0.0963 |
1531
- | 1.9331 | 123500 | 0.0949 |
1532
- | 1.9346 | 123600 | 0.0897 |
1533
- | 1.9362 | 123700 | 0.102 |
1534
- | 1.9377 | 123800 | 0.0937 |
1535
- | 1.9393 | 123900 | 0.095 |
1536
- | 1.9409 | 124000 | 0.1067 |
1537
- | 1.9424 | 124100 | 0.0731 |
1538
- | 1.9440 | 124200 | 0.1025 |
1539
- | 1.9456 | 124300 | 0.113 |
1540
- | 1.9471 | 124400 | 0.0887 |
1541
- | 1.9487 | 124500 | 0.0938 |
1542
- | 1.9503 | 124600 | 0.0863 |
1543
- | 1.9518 | 124700 | 0.1005 |
1544
- | 1.9534 | 124800 | 0.1084 |
1545
- | 1.9550 | 124900 | 0.0923 |
1546
- | 1.9565 | 125000 | 0.086 |
1547
- | 1.9581 | 125100 | 0.0899 |
1548
- | 1.9597 | 125200 | 0.1179 |
1549
- | 1.9612 | 125300 | 0.0989 |
1550
- | 1.9628 | 125400 | 0.1225 |
1551
- | 1.9644 | 125500 | 0.1126 |
1552
- | 1.9659 | 125600 | 0.092 |
1553
- | 1.9675 | 125700 | 0.0953 |
1554
- | 1.9691 | 125800 | 0.1162 |
1555
- | 1.9706 | 125900 | 0.113 |
1556
- | 1.9722 | 126000 | 0.07 |
1557
- | 1.9737 | 126100 | 0.0654 |
1558
- | 1.9753 | 126200 | 0.0735 |
1559
- | 1.9769 | 126300 | 0.0937 |
1560
- | 1.9784 | 126400 | 0.1095 |
1561
- | 1.9800 | 126500 | 0.0677 |
1562
- | 1.9816 | 126600 | 0.0928 |
1563
- | 1.9831 | 126700 | 0.0847 |
1564
- | 1.9847 | 126800 | 0.0871 |
1565
- | 1.9863 | 126900 | 0.0748 |
1566
- | 1.9878 | 127000 | 0.0577 |
1567
- | 1.9894 | 127100 | 0.0674 |
1568
- | 1.9910 | 127200 | 0.059 |
1569
- | 1.9925 | 127300 | 0.1051 |
1570
- | 1.9941 | 127400 | 0.0723 |
1571
- | 1.9957 | 127500 | 0.076 |
1572
- | 1.9972 | 127600 | 0.123 |
1573
- | 1.9988 | 127700 | 0.166 |
1574
- | 2.0004 | 127800 | 0.1987 |
1575
- | 2.0019 | 127900 | 0.0239 |
1576
- | 2.0035 | 128000 | 0.0281 |
1577
- | 2.0051 | 128100 | 0.0204 |
1578
- | 2.0066 | 128200 | 0.0287 |
1579
- | 2.0082 | 128300 | 0.0507 |
1580
- | 2.0098 | 128400 | 0.0425 |
1581
- | 2.0113 | 128500 | 0.2174 |
1582
- | 2.0129 | 128600 | 0.4736 |
1583
- | 2.0145 | 128700 | 0.7072 |
1584
- | 2.0160 | 128800 | 0.4264 |
1585
- | 2.0176 | 128900 | 0.3925 |
1586
- | 2.0192 | 129000 | 0.4464 |
1587
- | 2.0207 | 129100 | 0.4491 |
1588
- | 2.0223 | 129200 | 0.4134 |
1589
- | 2.0239 | 129300 | 0.3076 |
1590
- | 2.0254 | 129400 | 0.3543 |
1591
- | 2.0270 | 129500 | 0.39 |
1592
- | 2.0285 | 129600 | 0.4264 |
1593
- | 2.0301 | 129700 | 0.5531 |
1594
- | 2.0317 | 129800 | 0.3795 |
1595
- | 2.0332 | 129900 | 0.3731 |
1596
- | 2.0348 | 130000 | 0.3682 |
1597
- | 2.0364 | 130100 | 0.3475 |
1598
- | 2.0379 | 130200 | 0.3145 |
1599
- | 2.0395 | 130300 | 0.3439 |
1600
- | 2.0411 | 130400 | 0.2909 |
1601
- | 2.0426 | 130500 | 0.3694 |
1602
- | 2.0442 | 130600 | 0.3264 |
1603
- | 2.0458 | 130700 | 0.3285 |
1604
- | 2.0473 | 130800 | 0.291 |
1605
- | 2.0489 | 130900 | 0.2715 |
1606
- | 2.0505 | 131000 | 0.3234 |
1607
- | 2.0520 | 131100 | 0.333 |
1608
- | 2.0536 | 131200 | 0.3547 |
1609
- | 2.0552 | 131300 | 0.3735 |
1610
- | 2.0567 | 131400 | 0.3693 |
1611
- | 2.0583 | 131500 | 0.373 |
1612
- | 2.0599 | 131600 | 0.3451 |
1613
- | 2.0614 | 131700 | 0.3508 |
1614
- | 2.0630 | 131800 | 0.3627 |
1615
- | 2.0645 | 131900 | 0.3881 |
1616
- | 2.0661 | 132000 | 0.3705 |
1617
- | 2.0677 | 132100 | 0.3743 |
1618
- | 2.0692 | 132200 | 0.3963 |
1619
- | 2.0708 | 132300 | 0.3693 |
1620
- | 2.0724 | 132400 | 0.3855 |
1621
- | 2.0739 | 132500 | 0.3695 |
1622
- | 2.0755 | 132600 | 0.3863 |
1623
- | 2.0771 | 132700 | 0.373 |
1624
- | 2.0786 | 132800 | 0.4406 |
1625
- | 2.0802 | 132900 | 0.3888 |
1626
- | 2.0818 | 133000 | 0.4662 |
1627
- | 2.0833 | 133100 | 0.3748 |
1628
- | 2.0849 | 133200 | 0.396 |
1629
- | 2.0865 | 133300 | 0.3977 |
1630
- | 2.0880 | 133400 | 0.4074 |
1631
- | 2.0896 | 133500 | 0.3608 |
1632
- | 2.0912 | 133600 | 0.3524 |
1633
- | 2.0927 | 133700 | 0.3304 |
1634
- | 2.0943 | 133800 | 0.3207 |
1635
- | 2.0959 | 133900 | 0.377 |
1636
- | 2.0974 | 134000 | 0.3051 |
1637
- | 2.0990 | 134100 | 0.3258 |
1638
- | 2.1005 | 134200 | 0.3023 |
1639
- | 2.1021 | 134300 | 0.3184 |
1640
- | 2.1037 | 134400 | 0.3028 |
1641
- | 2.1052 | 134500 | 0.3825 |
1642
- | 2.1068 | 134600 | 0.3204 |
1643
- | 2.1084 | 134700 | 0.344 |
1644
- | 2.1099 | 134800 | 0.318 |
1645
- | 2.1115 | 134900 | 0.3249 |
1646
- | 2.1131 | 135000 | 0.3269 |
1647
- | 2.1146 | 135100 | 0.2974 |
1648
- | 2.1162 | 135200 | 0.3061 |
1649
- | 2.1178 | 135300 | 0.319 |
1650
- | 2.1193 | 135400 | 0.333 |
1651
- | 2.1209 | 135500 | 0.3016 |
1652
- | 2.1225 | 135600 | 0.2981 |
1653
- | 2.1240 | 135700 | 0.2871 |
1654
- | 2.1256 | 135800 | 0.3159 |
1655
- | 2.1272 | 135900 | 0.3097 |
1656
- | 2.1287 | 136000 | 0.2933 |
1657
- | 2.1303 | 136100 | 0.2838 |
1658
- | 2.1319 | 136200 | 0.2561 |
1659
- | 2.1334 | 136300 | 0.283 |
1660
- | 2.1350 | 136400 | 0.2988 |
1661
- | 2.1365 | 136500 | 0.3087 |
1662
- | 2.1381 | 136600 | 0.2954 |
1663
- | 2.1397 | 136700 | 0.2699 |
1664
- | 2.1412 | 136800 | 0.3057 |
1665
- | 2.1428 | 136900 | 0.2838 |
1666
- | 2.1444 | 137000 | 0.2774 |
1667
- | 2.1459 | 137100 | 0.2856 |
1668
- | 2.1475 | 137200 | 0.271 |
1669
- | 2.1491 | 137300 | 0.327 |
1670
- | 2.1506 | 137400 | 0.28 |
1671
- | 2.1522 | 137500 | 0.2534 |
1672
- | 2.1538 | 137600 | 0.2553 |
1673
- | 2.1553 | 137700 | 0.2613 |
1674
- | 2.1569 | 137800 | 0.2749 |
1675
- | 2.1585 | 137900 | 0.2289 |
1676
- | 2.1600 | 138000 | 0.3811 |
1677
- | 2.1616 | 138100 | 0.283 |
1678
- | 2.1632 | 138200 | 0.2693 |
1679
- | 2.1647 | 138300 | 0.2463 |
1680
- | 2.1663 | 138400 | 0.2403 |
1681
- | 2.1679 | 138500 | 0.2759 |
1682
- | 2.1694 | 138600 | 0.238 |
1683
- | 2.1710 | 138700 | 0.2633 |
1684
- | 2.1725 | 138800 | 0.2136 |
1685
- | 2.1741 | 138900 | 0.2511 |
1686
- | 2.1757 | 139000 | 0.2302 |
1687
- | 2.1772 | 139100 | 0.2359 |
1688
- | 2.1788 | 139200 | 0.2268 |
1689
- | 2.1804 | 139300 | 0.2805 |
1690
- | 2.1819 | 139400 | 0.2489 |
1691
- | 2.1835 | 139500 | 0.1915 |
1692
- | 2.1851 | 139600 | 0.2726 |
1693
- | 2.1866 | 139700 | 0.2383 |
1694
- | 2.1882 | 139800 | 0.2572 |
1695
- | 2.1898 | 139900 | 0.2453 |
1696
- | 2.1913 | 140000 | 0.2388 |
1697
- | 2.1929 | 140100 | 0.238 |
1698
- | 2.1945 | 140200 | 0.2578 |
1699
- | 2.1960 | 140300 | 0.2592 |
1700
- | 2.1976 | 140400 | 0.2866 |
1701
- | 2.1992 | 140500 | 0.2512 |
1702
- | 2.2007 | 140600 | 0.2368 |
1703
- | 2.2023 | 140700 | 0.25 |
1704
- | 2.2039 | 140800 | 0.2809 |
1705
- | 2.2054 | 140900 | 0.2504 |
1706
- | 2.2070 | 141000 | 0.2436 |
1707
- | 2.2085 | 141100 | 0.2227 |
1708
- | 2.2101 | 141200 | 0.2179 |
1709
- | 2.2117 | 141300 | 0.2724 |
1710
- | 2.2132 | 141400 | 0.2844 |
1711
- | 2.2148 | 141500 | 0.206 |
1712
- | 2.2164 | 141600 | 0.2177 |
1713
- | 2.2179 | 141700 | 0.2809 |
1714
- | 2.2195 | 141800 | 0.2447 |
1715
- | 2.2211 | 141900 | 0.2409 |
1716
- | 2.2226 | 142000 | 0.2327 |
1717
- | 2.2242 | 142100 | 0.2077 |
1718
- | 2.2258 | 142200 | 0.2768 |
1719
- | 2.2273 | 142300 | 0.2383 |
1720
- | 2.2289 | 142400 | 0.2939 |
1721
- | 2.2305 | 142500 | 0.26 |
1722
- | 2.2320 | 142600 | 0.251 |
1723
- | 2.2336 | 142700 | 0.2318 |
1724
- | 2.2352 | 142800 | 0.1949 |
1725
- | 2.2367 | 142900 | 0.2186 |
1726
- | 2.2383 | 143000 | 0.2659 |
1727
- | 2.2399 | 143100 | 0.2436 |
1728
- | 2.2414 | 143200 | 0.247 |
1729
- | 2.2430 | 143300 | 0.2757 |
1730
- | 2.2445 | 143400 | 0.288 |
1731
- | 2.2461 | 143500 | 0.2453 |
1732
- | 2.2477 | 143600 | 0.2856 |
1733
- | 2.2492 | 143700 | 0.2832 |
1734
- | 2.2508 | 143800 | 0.2654 |
1735
- | 2.2524 | 143900 | 0.2647 |
1736
- | 2.2539 | 144000 | 0.3071 |
1737
- | 2.2555 | 144100 | 0.2667 |
1738
- | 2.2571 | 144200 | 0.2684 |
1739
- | 2.2586 | 144300 | 0.2612 |
1740
- | 2.2602 | 144400 | 0.2608 |
1741
- | 2.2618 | 144500 | 0.2471 |
1742
- | 2.2633 | 144600 | 0.2814 |
1743
- | 2.2649 | 144700 | 0.2707 |
1744
- | 2.2665 | 144800 | 0.2828 |
1745
- | 2.2680 | 144900 | 0.2145 |
1746
- | 2.2696 | 145000 | 0.271 |
1747
- | 2.2712 | 145100 | 0.2851 |
1748
- | 2.2727 | 145200 | 0.248 |
1749
- | 2.2743 | 145300 | 0.3098 |
1750
- | 2.2759 | 145400 | 0.2695 |
1751
- | 2.2774 | 145500 | 0.2668 |
1752
- | 2.2790 | 145600 | 0.2572 |
1753
- | 2.2805 | 145700 | 0.2885 |
1754
- | 2.2821 | 145800 | 0.2721 |
1755
- | 2.2837 | 145900 | 0.257 |
1756
- | 2.2852 | 146000 | 0.2546 |
1757
- | 2.2868 | 146100 | 0.2441 |
1758
- | 2.2884 | 146200 | 0.2809 |
1759
- | 2.2899 | 146300 | 0.245 |
1760
- | 2.2915 | 146400 | 0.2691 |
1761
- | 2.2931 | 146500 | 0.3119 |
1762
- | 2.2946 | 146600 | 0.2677 |
1763
- | 2.2962 | 146700 | 0.2964 |
1764
- | 2.2978 | 146800 | 0.262 |
1765
- | 2.2993 | 146900 | 0.3017 |
1766
- | 2.3009 | 147000 | 0.2972 |
1767
- | 2.3025 | 147100 | 0.2875 |
1768
- | 2.3040 | 147200 | 0.278 |
1769
- | 2.3056 | 147300 | 0.238 |
1770
- | 2.3072 | 147400 | 0.2174 |
1771
- | 2.3087 | 147500 | 0.2652 |
1772
- | 2.3103 | 147600 | 0.2951 |
1773
- | 2.3119 | 147700 | 0.2618 |
1774
- | 2.3134 | 147800 | 0.2474 |
1775
- | 2.3150 | 147900 | 0.2408 |
1776
- | 2.3165 | 148000 | 0.269 |
1777
- | 2.3181 | 148100 | 0.2263 |
1778
- | 2.3197 | 148200 | 0.2499 |
1779
- | 2.3212 | 148300 | 0.2954 |
1780
- | 2.3228 | 148400 | 0.2497 |
1781
- | 2.3244 | 148500 | 0.2684 |
1782
- | 2.3259 | 148600 | 0.2086 |
1783
- | 2.3275 | 148700 | 0.2425 |
1784
- | 2.3291 | 148800 | 0.2498 |
1785
- | 2.3306 | 148900 | 0.2225 |
1786
- | 2.3322 | 149000 | 0.2547 |
1787
- | 2.3338 | 149100 | 0.2188 |
1788
- | 2.3353 | 149200 | 0.2664 |
1789
- | 2.3369 | 149300 | 0.2607 |
1790
- | 2.3385 | 149400 | 0.2084 |
1791
- | 2.3400 | 149500 | 0.2328 |
1792
- | 2.3416 | 149600 | 0.2096 |
1793
- | 2.3432 | 149700 | 0.2531 |
1794
- | 2.3447 | 149800 | 0.2256 |
1795
- | 2.3463 | 149900 | 0.2123 |
1796
- | 2.3479 | 150000 | 0.2668 |
1797
- | 2.3494 | 150100 | 0.2562 |
1798
- | 2.3510 | 150200 | 0.2527 |
1799
- | 2.3525 | 150300 | 0.2416 |
1800
- | 2.3541 | 150400 | 0.2732 |
1801
- | 2.3557 | 150500 | 0.2435 |
1802
- | 2.3572 | 150600 | 0.2446 |
1803
- | 2.3588 | 150700 | 0.2728 |
1804
- | 2.3604 | 150800 | 0.2603 |
1805
- | 2.3619 | 150900 | 0.3144 |
1806
- | 2.3635 | 151000 | 0.2644 |
1807
- | 2.3651 | 151100 | 0.2676 |
1808
- | 2.3666 | 151200 | 0.3062 |
1809
- | 2.3682 | 151300 | 0.2505 |
1810
- | 2.3698 | 151400 | 0.2715 |
1811
- | 2.3713 | 151500 | 0.2733 |
1812
- | 2.3729 | 151600 | 0.3129 |
1813
- | 2.3745 | 151700 | 0.291 |
1814
- | 2.3760 | 151800 | 0.2842 |
1815
- | 2.3776 | 151900 | 0.3183 |
1816
- | 2.3792 | 152000 | 0.2372 |
1817
- | 2.3807 | 152100 | 0.2588 |
1818
- | 2.3823 | 152200 | 0.1666 |
1819
- | 2.3839 | 152300 | 0.1011 |
1820
- | 2.3854 | 152400 | 0.1493 |
1821
- | 2.3870 | 152500 | 0.1348 |
1822
- | 2.3885 | 152600 | 0.1179 |
1823
- | 2.3901 | 152700 | 0.1373 |
1824
- | 2.3917 | 152800 | 0.1212 |
1825
- | 2.3932 | 152900 | 0.1135 |
1826
- | 2.3948 | 153000 | 0.1335 |
1827
- | 2.3964 | 153100 | 0.1458 |
1828
- | 2.3979 | 153200 | 0.1259 |
1829
- | 2.3995 | 153300 | 0.1459 |
1830
- | 2.4011 | 153400 | 0.1232 |
1831
- | 2.4026 | 153500 | 0.1172 |
1832
- | 2.4042 | 153600 | 0.0911 |
1833
- | 2.4058 | 153700 | 0.1177 |
1834
- | 2.4073 | 153800 | 0.0954 |
1835
- | 2.4089 | 153900 | 0.107 |
1836
- | 2.4105 | 154000 | 0.1355 |
1837
- | 2.4120 | 154100 | 0.1012 |
1838
- | 2.4136 | 154200 | 0.092 |
1839
- | 2.4152 | 154300 | 0.0958 |
1840
- | 2.4167 | 154400 | 0.1014 |
1841
- | 2.4183 | 154500 | 0.1202 |
1842
- | 2.4199 | 154600 | 0.0954 |
1843
- | 2.4214 | 154700 | 0.097 |
1844
- | 2.4230 | 154800 | 0.1103 |
1845
- | 2.4245 | 154900 | 0.1274 |
1846
- | 2.4261 | 155000 | 0.1015 |
1847
- | 2.4277 | 155100 | 0.1051 |
1848
- | 2.4292 | 155200 | 0.1225 |
1849
- | 2.4308 | 155300 | 0.1555 |
1850
- | 2.4324 | 155400 | 0.0811 |
1851
- | 2.4339 | 155500 | 0.0947 |
1852
- | 2.4355 | 155600 | 0.1104 |
1853
- | 2.4371 | 155700 | 0.0911 |
1854
- | 2.4386 | 155800 | 0.0705 |
1855
- | 2.4402 | 155900 | 0.0776 |
1856
- | 2.4418 | 156000 | 0.0984 |
1857
- | 2.4433 | 156100 | 0.0797 |
1858
- | 2.4449 | 156200 | 0.1321 |
1859
- | 2.4465 | 156300 | 0.075 |
1860
- | 2.4480 | 156400 | 0.072 |
1861
- | 2.4496 | 156500 | 0.0887 |
1862
- | 2.4512 | 156600 | 0.1088 |
1863
- | 2.4527 | 156700 | 0.0838 |
1864
- | 2.4543 | 156800 | 0.109 |
1865
- | 2.4559 | 156900 | 0.0821 |
1866
- | 2.4574 | 157000 | 0.1076 |
1867
- | 2.4590 | 157100 | 0.0959 |
1868
- | 2.4605 | 157200 | 0.1065 |
1869
- | 2.4621 | 157300 | 0.1038 |
1870
- | 2.4637 | 157400 | 0.0978 |
1871
- | 2.4652 | 157500 | 0.0831 |
1872
- | 2.4668 | 157600 | 0.1033 |
1873
- | 2.4684 | 157700 | 0.1046 |
1874
- | 2.4699 | 157800 | 0.1136 |
1875
- | 2.4715 | 157900 | 0.0833 |
1876
- | 2.4731 | 158000 | 0.0796 |
1877
- | 2.4746 | 158100 | 0.0836 |
1878
- | 2.4762 | 158200 | 0.1213 |
1879
- | 2.4778 | 158300 | 0.0865 |
1880
- | 2.4793 | 158400 | 0.0767 |
1881
- | 2.4809 | 158500 | 0.074 |
1882
- | 2.4825 | 158600 | 0.0826 |
1883
- | 2.4840 | 158700 | 0.0758 |
1884
- | 2.4856 | 158800 | 0.0767 |
1885
- | 2.4872 | 158900 | 0.1284 |
1886
- | 2.4887 | 159000 | 0.0826 |
1887
- | 2.4903 | 159100 | 0.0921 |
1888
- | 2.4919 | 159200 | 0.0746 |
1889
- | 2.4934 | 159300 | 0.0865 |
1890
- | 2.4950 | 159400 | 0.0771 |
1891
- | 2.4965 | 159500 | 0.0844 |
1892
- | 2.4981 | 159600 | 0.0682 |
1893
- | 2.4997 | 159700 | 0.068 |
1894
- | 2.5012 | 159800 | 0.0674 |
1895
- | 2.5028 | 159900 | 0.0942 |
1896
- | 2.5044 | 160000 | 0.066 |
1897
-
1898
- </details>
1899
-
1900
- ### Framework Versions
1901
- - Python: 3.11.12
1902
- - Sentence Transformers: 5.1.2
1903
- - Transformers: 4.51.3
1904
- - PyTorch: 2.8.0+cu128
1905
- - Accelerate: 1.5.2
1906
- - Datasets: 2.21.0
1907
- - Tokenizers: 0.21.4
1908
 
1909
  ## Citation
1910
-
1911
- ### BibTeX
1912
-
1913
- #### Sentence Transformers
1914
- ```bibtex
1915
- @inproceedings{reimers-2019-sentence-bert,
1916
- title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
1917
- author = "Reimers, Nils and Gurevych, Iryna",
1918
- booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
1919
- month = "11",
1920
- year = "2019",
1921
- publisher = "Association for Computational Linguistics",
1922
- url = "https://arxiv.org/abs/1908.10084",
1923
- }
1924
- ```
1925
-
1926
- #### SpladeLoss
1927
- ```bibtex
1928
- @misc{formal2022distillationhardnegativesampling,
1929
- title={From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective},
1930
- author={Thibault Formal and Carlos Lassance and Benjamin Piwowarski and Stéphane Clinchant},
1931
- year={2022},
1932
- eprint={2205.04733},
1933
- archivePrefix={arXiv},
1934
- primaryClass={cs.IR},
1935
- url={https://arxiv.org/abs/2205.04733},
1936
- }
1937
- ```
1938
-
1939
- #### SparseMultipleNegativesRankingLoss
1940
- ```bibtex
1941
- @misc{henderson2017efficient,
1942
- title={Efficient Natural Language Response Suggestion for Smart Reply},
1943
- author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
1944
- year={2017},
1945
- eprint={1705.00652},
1946
- archivePrefix={arXiv},
1947
- primaryClass={cs.CL}
1948
- }
1949
  ```
1950
-
1951
- #### FlopsLoss
1952
- ```bibtex
1953
- @article{paria2020minimizing,
1954
- title={Minimizing flops to learn efficient sparse representations},
1955
- author={Paria, Biswajit and Yeh, Chih-Kuan and Yen, Ian EH and Xu, Ning and Ravikumar, Pradeep and P{'o}czos, Barnab{'a}s},
1956
- journal={arXiv preprint arXiv:2004.05665},
1957
- year={2020}
1958
  }
1959
  ```
1960
 
1961
- <!--
1962
- ## Glossary
1963
-
1964
- *Clearly define terms in order to be accessible across audiences.*
1965
- -->
1966
-
1967
- <!--
1968
- ## Model Card Authors
1969
-
1970
- *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
1971
- -->
1972
-
1973
- <!--
1974
- ## Model Card Contact
1975
 
1976
- *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
1977
- -->
 
1
  ---
2
+ language:
3
+ - en
4
+ - ko
5
  tags:
6
  - sentence-transformers
7
+ - sentence-similarity
8
  - sparse-encoder
9
  - sparse
10
  - splade
11
+ - retrieval
12
+ - multimodal
13
+ - multi-modal
14
+ - crossmodal
15
+ - cross-modal
16
+ - feature-extraction
17
+ - aerospace
18
+ - telepix
 
 
 
 
 
 
 
 
19
  pipeline_tag: feature-extraction
20
  library_name: sentence-transformers
21
+ license: apache-2.0
22
  ---
23
+ <p align="center">
24
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/61d6f4a4d49065ee28a1ee7e/V8n2En7BlMNHoi1YXVv8Q.png" width="400"/>
25
+ <p>
26
+
27
+ # PIXIE-Splade-v1.0
28
+ **PIXIE-Splade-v1.0** is a **bilingual (ko, en)** [SPLADE](https://arxiv.org/abs/2403.06789) retriever, developed by [TelePIX Co., Ltd](https://telepix.net/).
29
+ **PIXIE** stands for Tele**PIX** **I**ntelligent **E**mbedding, representing TelePIX’s high-performance embedding technology.
30
+ This model is specifically optimized for retrieval tasks in Korean and English, and demonstrates strong performance in aerospace domain. Through extensive fine-tuning and domain-specific evaluation, PIXIE shows robust retrieval quality for real-world use cases such as document understanding, technical QA, and information retrieval in aerospace and related high-precision fields.
31
+ PIXIE-Splade-v1.0 outputs sparse lexical vectors that are directly
32
+ compatible with inverted indexing (e.g., Lucene/Elasticsearch).
33
+ Because each non-zero weight corresponds to a Ko-En subword/token,
34
+ interpretability is built-in: you can inspect which tokens drive retrieval.
35
+
36
+ ## Why SPLADE for Search?
37
+ - **Inverted Index Ready**: Directly index weighted tokens in standard IR stacks (Lucene/Elasticsearch).
38
+ - **Interpretable by Design**: Top-k contributing tokens per query/document explain *why* a hit matched.
39
+ - **Production-Friendly**: Fast candidate generation at web scale; memory/latency tunable via sparsity thresholds.
40
+ - **Hybrid-Retrieval Friendly**: Combine with dense retrievers via score fusion.
41
+
42
+ ## Model Description
43
  - **Model Type:** SPLADE Sparse Encoder
44
+ <!-- - **Base model:** [Unknown](https://huggingface.co/unknown) -->
45
+ - **Maximum Sequence Length:** 5632 tokens
46
  - **Output Dimensionality:** 50000 dimensions
47
  - **Similarity Function:** Dot Product
48
+ - **Language:** Bilingual — Korean and English
49
+ - **Domain Specialization:** Aerospace Information Retrieval
50
+ - **License:** apache-2.0
 
 
 
 
 
 
 
 
51
 
52
  ### Full Model Architecture
53
 
54
  ```
55
  SparseEncoder(
56
+ (0): MLMTransformer({'max_seq_length': 5632, 'do_lower_case': False, 'architecture': 'ModernBertForMaskedLM'})
57
  (1): SpladePooling({'pooling_strategy': 'max', 'activation_function': 'relu', 'word_embedding_dimension': 50000})
58
  )
59
  ```
60
 
61
+ ## Quality Benchmarks
62
+ **PIXIE-Splade-v1.0** is a bilingual embedding model specialized for Korean and English retrieval tasks.
63
+ It delivers consistently strong performance across a diverse set of domain-specific and open-domain benchmarks in both languages, demonstrating its effectiveness in real-world search applications.
64
+ The table below presents the retrieval performance of several sparse embedding models evaluated on a variety of Korean and English benchmarks.
65
+ We report **Normalized Discounted Cumulative Gain (nDCG@10)** scores, which measure how well a ranked list of documents aligns with ground truth relevance. Higher values indicate better retrieval quality.
66
+
67
+ All evaluations were conducted using the open-source **[Korean-MTEB-Retrieval-Evaluators](https://github.com/BM-K/Korean-MTEB-Retrieval-Evaluators)** codebase to ensure consistent dataset handling, indexing, retrieval, and nDCG@10 computation across models.
68
+
69
+ ### Benchmark Overview and Dataset Descriptions
70
+ | Model Name | # params | STELLA (ko-en) | STELLA (en-en) | MTEB (ko) | BEIR (en) |
71
+ |------|:---:|:---:|:---:|:---:|:---:|
72
+ | telepix/PIXIE-Rune-v1.0 (dense baseline) | 0.5B | 0.5972 | 0.7627 | 0.7603 | 0.5872 |
73
+ | **telepix/PIXIE-Splade-v1.0** | **0.1B** | **0.4148** | **0.6741** | **0.7025** | **0.3760** |
74
+ | | | | | | |
75
+ | opensearch-project/opensearch-neural-sparse-encoding-multilingual-v1 | 0.2B | 0.2618 | 0.7055 | 0.5358 | 0.3756 |
76
+ | naver/splade-v3 | 0.1B | N/A | 0.7836 | 0.0685 | 0.3680 |
77
+ | BM25 | N/A | N/A | 0.6589 | 0.5071 | 0.4074 |
78
+
79
+ To better interpret the evaluation results above, we briefly describe the characteristics and evaluation intent of each benchmark suite used in this comparison.
80
+ Each benchmark is designed to assess different aspects of retrieval capability, ranging from domain-specific technical understanding to open-domain and multilingual generalization.
81
+
82
+ #### STELLA
83
+ [STELLA](https://arxiv.org/abs/2601.03496) is an aerospace-domain Information Retrieval (IR) benchmark constructed from NASA Technical Reports Server (NTRS) documents. It is designed to evaluate both:
84
+
85
+ - **Lexical matching** ability (does the retriever benefit from exact technical terms? | TCQ)
86
+ - **Semantic matching** ability (can the retriever match concepts even when technical terms are not explicitly used? | TAQ).
87
+
88
+ STELLA provides **dual-type synthetic queries** and a **cross-lingual extension** for multilingual evaluation while keeping the corpus in English.
89
+
90
+ #### 6 Datasets of MTEB (Korean)
91
+ Descriptions of the benchmark datasets used for evaluation are as follows:
92
+ - **Ko-StrategyQA**
93
+ A Korean multi-hop open-domain question answering dataset designed for complex reasoning over multiple documents.
94
+ - **AutoRAGRetrieval**
95
+ A domain-diverse retrieval dataset covering finance, government, healthcare, legal, and e-commerce sectors.
96
+ - **MIRACLRetrieval**
97
+ A document retrieval benchmark built on Korean Wikipedia articles.
98
+ - **PublicHealthQA**
99
+ A retrieval dataset focused on medical and public health topics.
100
+ - **BelebeleRetrieval**
101
+ A dataset for retrieving relevant content from web and news articles in Korean.
102
+ - **MultiLongDocRetrieval**
103
+ A long-document retrieval benchmark based on Korean Wikipedia and mC4 corpus.
104
+
105
+ #### 7 Datasets of BEIR (English)
106
+ Descriptions of the benchmark datasets used for evaluation are as follows:
107
+ - **ArguAna**
108
+ A dataset for argument retrieval based on claim-counterclaim pairs from online debate forums.
109
+ - **FEVER**
110
+ A fact verification dataset using Wikipedia for evidence-based claim validation.
111
+ - **FiQA-2018**
112
+ A retrieval benchmark tailored to the finance domain with real-world questions and answers.
113
+ - **HotpotQA**
114
+ A multi-hop open-domain QA dataset requiring reasoning across multiple documents.
115
+ - **MSMARCO**
116
+ A large-scale benchmark using real Bing search queries and corresponding web documents.
117
+ - **NQ**
118
+ A Google QA dataset where user questions are answered using Wikipedia articles.
119
+ - **SCIDOCS**
120
+ A citation-based document retrieval dataset focused on scientific papers.
121
+
122
+ ## Direct Use (Inverted-Index Retrieval)
123
 
 
 
 
 
 
124
  ```python
125
+ import torch
126
+ import numpy as np
127
+ from collections import defaultdict
128
+ from typing import Dict, List, Tuple
129
+ from transformers import AutoTokenizer
130
  from sentence_transformers import SparseEncoder
131
 
132
+ model_name= 'telepix/PIXIE-Splade-v1.0'
133
+ device = "cuda" if torch.cuda.is_available() else "cpu"
134
+
135
+ def _to_dense_numpy(x) -> np.ndarray:
136
+ if hasattr(x, "to_dense"):
137
+ return x.to_dense().float().cpu().numpy()
138
+ if isinstance(x, torch.Tensor):
139
+ return x.float().cpu().numpy()
140
+ return np.asarray(x)
141
+
142
+ def _filter_special_ids(ids: List[int], tokenizer) -> List[int]:
143
+ special = set(getattr(tokenizer, "all_special_ids", []) or [])
144
+ return [i for i in ids if i not in special]
145
+
146
+ def build_inverted_index(
147
+ model: SparseEncoder,
148
+ tokenizer,
149
+ documents: List[str],
150
+ batch_size: int = 8,
151
+ min_weight: float = 0.0,
152
+ ) -> Tuple[Dict[int, List[Tuple[int, float]]], List[str]]:
153
+ with torch.no_grad():
154
+ doc_emb = model.encode_document(documents, batch_size=batch_size)
155
+ doc_dense = _to_dense_numpy(doc_emb)
156
+
157
+ index: Dict[int, List[Tuple[int, float]]] = defaultdict(list)
158
+
159
+ for doc_idx, vec in enumerate(doc_dense):
160
+ nz = np.flatnonzero(vec > min_weight)
161
+ nz = _filter_special_ids(nz.tolist(), tokenizer)
162
+
163
+ for token_id in nz:
164
+ index[token_id].append((doc_idx, float(vec[token_id])))
165
+
166
+ return index
167
+
168
+ def splade_token_overlap_inverted(
169
+ model: SparseEncoder,
170
+ tokenizer,
171
+ inverted_index: Dict[int, List[Tuple[int, float]]],
172
+ documents: List[str],
173
+ queries: List[str],
174
+ top_k_docs: int = 3,
175
+ top_k_tokens: int = 5,
176
+ min_weight: float = 0.0,
177
+ ):
178
+ for qi, qtext in enumerate(queries):
179
+ with torch.no_grad():
180
+ q_vec = model.encode_query(qtext)
181
+ q_vec = _to_dense_numpy(q_vec).ravel()
182
+
183
+ q_nz = np.flatnonzero(q_vec > min_weight).tolist()
184
+ q_nz = _filter_special_ids(q_nz, tokenizer)
185
+
186
+ scores: Dict[int, float] = defaultdict(float)
187
+ per_doc_contrib: Dict[int, Dict[int, Tuple[float, float, float]]] = defaultdict(dict)
188
+
189
+ for tid in q_nz:
190
+ qw = float(q_vec[tid])
191
+ postings = inverted_index.get(tid, [])
192
+ for doc_idx, dw in postings:
193
+ prod = qw * dw
194
+ scores[doc_idx] += prod
195
+ per_doc_contrib[doc_idx][tid] = (qw, dw, prod)
196
+
197
+ ranked = sorted(scores.items(), key=lambda x: x[1], reverse=True)[:top_k_docs]
198
+
199
+ print("\n" + "="*60)
200
+ print(f"[Query {qi + 1}] {qtext}")
201
+ print("="*60)
202
+
203
+ if not ranked:
204
+ print("→ No matching documents found.")
205
+ continue
206
+
207
+ for rank, (doc_idx, score) in enumerate(ranked, start=1):
208
+ doc = documents[doc_idx]
209
+ print(f"\n→ Rank {rank} | Score: {score:.4f}")
210
+ print(f" Document: \"{doc}\"")
211
+
212
+ contrib = per_doc_contrib[doc_idx]
213
+ if not contrib:
214
+ print(" (No overlapping tokens)")
215
+ continue
216
+
217
+ top = sorted(contrib.items(), key=lambda kv: kv[1][2], reverse=True)[:top_k_tokens]
218
+ token_ids = [tid for tid, _ in top]
219
+ tokens = tokenizer.convert_ids_to_tokens(token_ids)
220
+
221
+ print(f" [Top {top_k_tokens} Contributing Tokens]")
222
+ print(f" {'Token':<20} {'Score (qw*dw)':>15}")
223
+ print(f" {'-'*35}")
224
+ for (tid, (qw, dw, prod)), tok in zip(top, tokens):
225
+ clean_tok = tok.replace("##", "")
226
+ print(f" {clean_tok:<20} {prod:15.4f}")
227
+
228
+ if __name__ == "__main__":
229
+ print(f"Loading model: {model_name}...")
230
+ model = SparseEncoder(model_name).to(device)
231
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
232
+
233
+ documents = [
234
+ "텔레픽스는 위성 데이터를 분석하여 해양, 농업 등 다양한 분야에 솔루션을 제공합니다.",
235
+ "고해상도 광학 위성 영상은 국방 및 정찰 목적으로 중요하게 활용됩니다.",
236
+ "TelePIX provides advanced solutions by analyzing satellite data for ocean and agriculture.",
237
+ "High-resolution optical satellite imagery is critical for defense and reconnaissance.",
238
+ "Space economy creates new value through the utilization of space-based data."
239
+ ]
240
+
241
+ # Cross-lingual test queries :)
242
+ queries = [
243
+ "텔레픽스는 어떤 산업 분야에서 위성 데이터를 활용하나요?",
244
+ "Utilization of satellite imagery for defense",
245
+ ]
246
+
247
+ print("Building inverted index...")
248
+ inverted_index = build_inverted_index(
249
+ model=model,
250
+ tokenizer=tokenizer,
251
+ documents=documents,
252
+ batch_size=4,
253
+ min_weight=0.01, # 노이즈 제거를 위해 약간의 threshold를 줄 수 있습니다.
254
+ )
255
+
256
+ splade_token_overlap_inverted(
257
+ model=model,
258
+ tokenizer=tokenizer,
259
+ inverted_index=inverted_index,
260
+ documents=documents,
261
+ queries=queries,
262
+ top_k_docs=2,
263
+ top_k_tokens=5
264
+ )
265
  ```
266
 
267
+ ## License
268
+ The PIXIE-Splade-v1.0 model is licensed under Apache License 2.0.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
269
 
270
  ## Citation
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
271
  ```
272
+ @misc{TelePIX-PIXIE-Splade-v1.0,
273
+ title={PIXIE-Splade-v1.0},
274
+ author={TelePIX AI Research Team and Bongmin Kim},
275
+ year={2026},
276
+ url={https://huggingface.co/telepix/PIXIE-Splade-v1.0}
 
 
 
277
  }
278
  ```
279
 
280
+ ## Contact
 
 
 
 
 
 
 
 
 
 
 
 
 
281
 
282
+ If you have any suggestions or questions about the PIXIE, please reach out to the authors at bmkim@telepix.net.