Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
rajaykumar12959
/
python-codesearchnet-tokenizer
like
1
Transformers
English
tokenizer
python
code-search-net
bpe
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
9f63df0
python-codesearchnet-tokenizer
4.97 MB
1 contributor
History:
2 commits
rajaykumar12959
Upload tokenizer
9f63df0
verified
2 months ago
.gitattributes
1.52 kB
initial commit
2 months ago
README.md
5.17 kB
Upload tokenizer
2 months ago
merges.txt
467 kB
Upload tokenizer
2 months ago
special_tokens_map.json
99 Bytes
Upload tokenizer
2 months ago
tokenizer.json
3.67 MB
Upload tokenizer
2 months ago
tokenizer_config.json
471 Bytes
Upload tokenizer
2 months ago
vocab.json
822 kB
Upload tokenizer
2 months ago