Upload folder using huggingface_hub

README.md

@@ -1,14 +1,140 @@
-# Custom BPS SentenceTransformer
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
 
-Model ini berbasis `paraphrase-multilingual-MiniLM-L12-v2` dengan tambahan token khusus untuk konteks statistik Badan Pusat Statistik (BPS) Indonesia. Token baru mencakup istilah seperti `PDRB`, `SP2020`, `SAKERNAS`, dll.
+# SentenceTransformer
 
-## Cara Penggunaan
+This is a [sentence-transformers](https://www.SBERT.net) model trained. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+<!-- - **Base model:** [Unknown](https://huggingface.co/unknown) -->
+- **Maximum Sequence Length:** 512 tokens
+- **Output Dimensionality:** 1024 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
+  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
 ```python
 from sentence_transformers import SentenceTransformer
 
-model = SentenceTransformer('yahyaabd/paraphrase-multilingual-MiniLM-L12-v2-bps-custom-tokenizer')
-embeddings = model.encode(['PDRB meningkat di tahun 2023.', 'BPS merilis ST2023.'])
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    'The weather is lovely today.',
+    "It's so sunny outside!",
+    'He drove to the stadium.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 1024]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
 ```
 
-## Kontak
-Hubungi [yahyaabd] di Hugging Face untuk pertanyaan atau dukungan.
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Framework Versions
+- Python: 3.11.12
+- Sentence Transformers: 3.4.1
+- Transformers: 4.51.3
+- PyTorch: 2.6.0+cu124
+- Accelerate: 1.6.0
+- Datasets: 
+- Tokenizers: 0.21.1
+
+## Citation
+
+### BibTeX
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

added_tokens.json

@@ -1,10 +1,11 @@
 {
-  "BADAN PUSAT STATISTIK": 30522,
   "BPP": 30551,
   "BPS": 30521,
   "BRS": 30566,
+  "Badan Pusat Statistik": 30522,
   "CIF": 30556,
-  "EKSPOR": 30552,
+  "EKSPOR": 30573,
+  "Ekspor": 30552,
   "FOB": 30555,
   "HLS": 30543,
   "HS": 30554,
@@ -12,44 +13,85 @@
   "IHP": 30527,
   "IHPB": 30528,
   "IMK": 30532,
-  "IMPOR": 30553,
+  "IMPOR": 30574,
   "IPH": 30526,
   "IPM": 30537,
   "ITB": 30531,
   "ITK": 30530,
-  "KATALOG": 30572,
+  "Impor": 30553,
+  "KATALOG": 30580,
   "KB": 30542,
   "KCI": 30562,
-  "KEGIATAN": 30568,
+  "KEGIATAN": 30577,
   "KKI": 30561,
   "KKL": 30560,
   "KRT": 30563,
+  "Katalog": 30571,
   "LPE": 30533,
   "LTN": 30549,
   "LTT": 30548,
-  "METADATA": 30571,
+  "Metadata": 30570,
   "NTP": 30529,
   "NTUP": 30550,
   "PDB": 30524,
   "PDRB": 30523,
   "PKL": 30559,
-  "PUBLIKASI": 30567,
+  "PUBLIKASI": 30576,
+  "Publikasi": 30567,
   "RLS": 30544,
   "RT": 30564,
   "RW": 30565,
-  "SAKERNAS": 30557,
+  "SAKERNAS": 30575,
   "SDGI": 30541,
   "SDKI": 30540,
-  "SEKTORAL": 30570,
+  "SEKTORAL": 30579,
   "SP2020": 30538,
   "ST2013": 30547,
   "ST2023": 30546,
-  "STATISTIK": 30569,
+  "STATISTIK": 30578,
   "SUPAS": 30539,
-  "SURVEI": 30573,
+  "SURVEI": 30581,
   "SUTAS": 30545,
+  "Sakernas": 30557,
+  "Sektoral": 30569,
+  "Survei": 30572,
   "TPAK": 30558,
   "TPK": 30534,
   "TPT": 30535,
-  "UMP": 30536
+  "UMP": 30536,
+  "_Statistik": 30568,
+  "bpp": 30604,
+  "brs": 30613,
+  "cif": 30606,
+  "fob": 30605,
+  "hls": 30596,
+  "ihk": 30583,
+  "imk": 30587,
+  "iph": 30584,
+  "ipm": 30591,
+  "itk": 30586,
+  "kci": 30611,
+  "kki": 30610,
+  "kkl": 30609,
+  "krt": 30612,
+  "lpe": 30588,
+  "ltn": 30602,
+  "ltt": 30601,
+  "metadata": 30615,
+  "ntp": 30585,
+  "ntup": 30603,
+  "pdrb": 30582,
+  "rls": 30597,
+  "sakernas": 30607,
+  "sdgi": 30595,
+  "sdki": 30594,
+  "sektoral": 30614,
+  "sp2020": 30592,
+  "st2013": 30600,
+  "st2023": 30599,
+  "supas": 30593,
+  "sutas": 30598,
+  "tpak": 30608,
+  "tpk": 30589,
+  "tpt": 30590
 }

config.json

@@ -42,5 +42,5 @@
   "transformers_version": "4.51.3",
   "type_vocab_size": 2,
   "use_cache": true,
-  "vocab_size": 30574
+  "vocab_size": 30616
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8e60913acacea8cbbe7e23c51dc87a3861ab07d76a450979f1656e8409e32f6b
-size 1340825424
+oid sha256:876577415f46625890d3d6bc9feda17ea98563b4a355527d299bb5d1a460b3ad
+size 1340997456

tokenizer.json

@@ -1,7 +1,19 @@
 {
   "version": "1.0",
-  "truncation": null,
-  "padding": null,
+  "truncation": {
+    "direction": "Right",
+    "max_length": 256,
+    "strategy": "LongestFirst",
+    "stride": 0
+  },
+  "padding": {
+    "strategy": "BatchLongest",
+    "direction": "Right",
+    "pad_to_multiple_of": null,
+    "pad_id": 0,
+    "pad_type_id": 0,
+    "pad_token": "[PAD]"
+  },
   "added_tokens": [
     {
       "id": 0,
@@ -59,7 +71,7 @@
     },
     {
       "id": 30522,
-      "content": "BADAN PUSAT STATISTIK",
+      "content": "Badan Pusat Statistik",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -329,7 +341,7 @@
     },
     {
       "id": 30552,
-      "content": "EKSPOR",
+      "content": "Ekspor",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -338,7 +350,7 @@
     },
     {
       "id": 30553,
-      "content": "IMPOR",
+      "content": "Impor",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -374,7 +386,7 @@
     },
     {
       "id": 30557,
-      "content": "SAKERNAS",
+      "content": "Sakernas",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -464,7 +476,7 @@
     },
     {
       "id": 30567,
-      "content": "PUBLIKASI",
+      "content": "Publikasi",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -473,7 +485,7 @@
     },
     {
       "id": 30568,
-      "content": "KEGIATAN",
+      "content": "_Statistik",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -482,7 +494,7 @@
     },
     {
       "id": 30569,
-      "content": "STATISTIK",
+      "content": "Sektoral",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -491,7 +503,7 @@
     },
     {
       "id": 30570,
-      "content": "SEKTORAL",
+      "content": "Metadata",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -500,7 +512,7 @@
     },
     {
       "id": 30571,
-      "content": "METADATA",
+      "content": "Katalog",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -509,7 +521,7 @@
     },
     {
       "id": 30572,
-      "content": "KATALOG",
+      "content": "Survei",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
@@ -518,12 +530,390 @@
     },
     {
       "id": 30573,
+      "content": "EKSPOR",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30574,
+      "content": "IMPOR",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30575,
+      "content": "SAKERNAS",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30576,
+      "content": "PUBLIKASI",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30577,
+      "content": "KEGIATAN",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30578,
+      "content": "STATISTIK",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30579,
+      "content": "SEKTORAL",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30580,
+      "content": "KATALOG",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30581,
       "content": "SURVEI",
       "single_word": false,
       "lstrip": false,
       "rstrip": false,
       "normalized": true,
       "special": false
+    },
+    {
+      "id": 30582,
+      "content": "pdrb",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30583,
+      "content": "ihk",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30584,
+      "content": "iph",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30585,
+      "content": "ntp",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30586,
+      "content": "itk",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30587,
+      "content": "imk",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30588,
+      "content": "lpe",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30589,
+      "content": "tpk",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30590,
+      "content": "tpt",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30591,
+      "content": "ipm",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30592,
+      "content": "sp2020",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30593,
+      "content": "supas",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30594,
+      "content": "sdki",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30595,
+      "content": "sdgi",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30596,
+      "content": "hls",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30597,
+      "content": "rls",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30598,
+      "content": "sutas",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30599,
+      "content": "st2023",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30600,
+      "content": "st2013",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30601,
+      "content": "ltt",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30602,
+      "content": "ltn",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30603,
+      "content": "ntup",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30604,
+      "content": "bpp",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30605,
+      "content": "fob",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30606,
+      "content": "cif",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30607,
+      "content": "sakernas",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30608,
+      "content": "tpak",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30609,
+      "content": "kkl",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30610,
+      "content": "kki",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30611,
+      "content": "kci",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30612,
+      "content": "krt",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30613,
+      "content": "brs",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30614,
+      "content": "sektoral",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
+    },
+    {
+      "id": 30615,
+      "content": "metadata",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": true,
+      "special": false
     }
   ],
   "normalizer": {

tokenizer_config.json

@@ -49,7 +49,7 @@
       "special": false
     },
     "30522": {
-      "content": "BADAN PUSAT STATISTIK",
+      "content": "Badan Pusat Statistik",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -289,7 +289,7 @@
       "special": false
     },
     "30552": {
-      "content": "EKSPOR",
+      "content": "Ekspor",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -297,7 +297,7 @@
       "special": false
     },
     "30553": {
-      "content": "IMPOR",
+      "content": "Impor",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -329,7 +329,7 @@
       "special": false
     },
     "30557": {
-      "content": "SAKERNAS",
+      "content": "Sakernas",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -409,7 +409,7 @@
       "special": false
     },
     "30567": {
-      "content": "PUBLIKASI",
+      "content": "Publikasi",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -417,7 +417,7 @@
       "special": false
     },
     "30568": {
-      "content": "KEGIATAN",
+      "content": "_Statistik",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -425,7 +425,7 @@
       "special": false
     },
     "30569": {
-      "content": "STATISTIK",
+      "content": "Sektoral",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -433,7 +433,7 @@
       "special": false
     },
     "30570": {
-      "content": "SEKTORAL",
+      "content": "Metadata",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -441,7 +441,7 @@
       "special": false
     },
     "30571": {
-      "content": "METADATA",
+      "content": "Katalog",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -449,7 +449,7 @@
       "special": false
     },
     "30572": {
-      "content": "KATALOG",
+      "content": "Survei",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
@@ -457,12 +457,348 @@
       "special": false
     },
     "30573": {
+      "content": "EKSPOR",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30574": {
+      "content": "IMPOR",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30575": {
+      "content": "SAKERNAS",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30576": {
+      "content": "PUBLIKASI",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30577": {
+      "content": "KEGIATAN",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30578": {
+      "content": "STATISTIK",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30579": {
+      "content": "SEKTORAL",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30580": {
+      "content": "KATALOG",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30581": {
       "content": "SURVEI",
       "lstrip": false,
       "normalized": true,
       "rstrip": false,
       "single_word": false,
       "special": false
+    },
+    "30582": {
+      "content": "pdrb",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30583": {
+      "content": "ihk",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30584": {
+      "content": "iph",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30585": {
+      "content": "ntp",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30586": {
+      "content": "itk",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30587": {
+      "content": "imk",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30588": {
+      "content": "lpe",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30589": {
+      "content": "tpk",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30590": {
+      "content": "tpt",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30591": {
+      "content": "ipm",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30592": {
+      "content": "sp2020",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30593": {
+      "content": "supas",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30594": {
+      "content": "sdki",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30595": {
+      "content": "sdgi",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30596": {
+      "content": "hls",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30597": {
+      "content": "rls",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30598": {
+      "content": "sutas",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30599": {
+      "content": "st2023",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30600": {
+      "content": "st2013",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30601": {
+      "content": "ltt",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30602": {
+      "content": "ltn",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30603": {
+      "content": "ntup",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30604": {
+      "content": "bpp",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30605": {
+      "content": "fob",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30606": {
+      "content": "cif",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30607": {
+      "content": "sakernas",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30608": {
+      "content": "tpak",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30609": {
+      "content": "kkl",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30610": {
+      "content": "kki",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30611": {
+      "content": "kci",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30612": {
+      "content": "krt",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30613": {
+      "content": "brs",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30614": {
+      "content": "sektoral",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "30615": {
+      "content": "metadata",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
     }
   },
   "clean_up_tokenization_spaces": true,