edgemindroboticslabs commited on
Commit
5c4fc39
·
verified ·
1 Parent(s): e28afaf

Upload tokenizer.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. tokenizer.json +1 -0
tokenizer.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"type": "bpe", "encoding": "gpt2"}