tokenizer/special_tokens_map.json · pfnet/GenerRNA at refs/pr/7

GenerRNA / tokenizer /special_tokens_map.json

Upload folder using huggingface_hub

580a9eb verified about 2 years ago

98 Bytes

{
  "bos_token": "<|endoftext|>",
  "eos_token": "<|endoftext|>",
  "unk_token": "<|endoftext|>"
}