Hugging Face's logo

sidoj
/
czech_BLBPE

Model card Files
xet
Community
sidoj commited on
Commit
73d250b
·
1 Parent(s): da7f220

Upload tokenizer

Browse files
Files changed (3) hide show
  1. merges.txt +0 -0
  2. tokenizer_config.json +1 -1
  3. vocab.json +0 -0
merges.txt CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json CHANGED
@@ -34,7 +34,7 @@
34
  "single_word": false
35
  },
36
  "model_max_length": 1000000000000000019884624838656,
37
- "name_or_path": ".",
38
  "pad_token": {
39
  "__type": "AddedToken",
40
  "content": "<pad>",
 
34
  "single_word": false
35
  },
36
  "model_max_length": 1000000000000000019884624838656,
37
+ "name_or_path": "czech_BLBPE",
38
  "pad_token": {
39
  "__type": "AddedToken",
40
  "content": "<pad>",
vocab.json CHANGED
The diff for this file is too large to render. See raw diff