ClaudeHu05 commited on
Commit
9ef065d
·
verified ·
1 Parent(s): 77fe445

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ This model repository will only contain files needed for tokenization (`vocab.json`, `tokenizer_config.sjon`, etc). The goal is to get familiar with huggingface tokenizers
2
+ and test tokenizers for tabs.