Hugging Face's logo

madatnlp
/
km-bert

Feature Extraction
Transformers
PyTorch
Safetensors
Korean
bert
biology
text-embeddings-inference
Model card Files
xet
 Community
1
madatnlp commited on
Commit
5dc9201
·
1 Parent(s): ef49d1c

Upload tokenizer

Browse files
Files changed (4) hide show
  1. special_tokens_map.json +0 -2
  2. tokenizer.json +0 -0
  3. tokenizer_config.json +0 -0
  4. vocab.txt +0 -0
special_tokens_map.json CHANGED
@@ -1,7 +1,5 @@
1
  {
2
- "bos_token": "[CLS]",
3
  "cls_token": "[CLS]",
4
- "eos_token": "[SEP]",
5
  "mask_token": "[MASK]",
6
  "pad_token": "[PAD]",
7
  "sep_token": "[SEP]",
 
1
  {
 
2
  "cls_token": "[CLS]",
 
3
  "mask_token": "[MASK]",
4
  "pad_token": "[PAD]",
5
  "sep_token": "[SEP]",
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff
 
vocab.txt CHANGED
The diff for this file is too large to render. See raw diff