abogado / checkpoints /tokenizer_config.json
salomonsky's picture
Duplicate from salomonsky/oraculo
b2bd434
raw
history blame contribute delete
115 Bytes
{"pad_token": "<|endoftext|>", "special_tokens_map_file": "./special_tokens_map.json", "full_tokenizer_file": null}