my-gpt-from-scratch / tokenizer.json
edgemindroboticslabs's picture
Upload tokenizer.json with huggingface_hub
5c4fc39 verified
raw
history blame contribute delete
35 Bytes
{"type": "bpe", "encoding": "gpt2"}