pgperrone
/

code-search-net-tokenizer

Model card Files Files and versions

code-search-net-tokenizer / tokenizer_config.json

Commit History

add tokenizer

1c88952

pgperrone commited on Jan 12, 2022