nanochat-d20 / tokenizer_config.json

Commit History

Add tokenizer_config.json to specify PreTrainedTokenizerFast
864a063
verified

dnakov commited on

Delete old tokenizer_config.json
612e0dc
verified

dnakov commited on

Upload folder using huggingface_hub
896af73
verified

dnakov commited on

Upload folder using huggingface_hub
3a3363e
verified

dnakov commited on