mbateman
/

code-search-net-tokenizer

Model card Files Files and versions

code-search-net-tokenizer / merges.txt

mbateman's picture

add tokenizer

2f0fabc about 4 years ago

history blame contribute delete

52 Bytes

	#version: 0.2 - Trained by `huggingface/tokenizers`