GWP_Model / tokenizer_config.json
goethe0101's picture
Create tokenizer_config.json
279463c
Raw
History Blame Contribute Delete
166 Bytes
{
"name_or_path": "goethe0101/GWP_Model",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"tokenizer_class": "PreTrainedTokenizerFast"
}