smathad commited on
Commit
bbc76ba
·
verified ·
1 Parent(s): e1ec06d

pushing tokenizer to hf (#1)

Browse files

- pushing tokenizer to hf (6645a4c189d1e386a930477cf0a104175467e685)

tokenizer/tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a5a009899256685e4a6f06adf6b5f5a59e615783f1e4495eaeb1a460010df05
3
+ size 1476129
tokenizer/tokenizer.vocab ADDED
The diff for this file is too large to render. See raw diff