niklassheth
/

tinystories-tokenizer

File size: 55 Bytes

9d85d76

{
  "eos_token": "<|eos|>",
  "unk_token": "<|unk|>"
}