timaeus
/

GPT2-tokenizer

Model card Files Files and versions

GPT2-tokenizer / tokenizer_config.json

Commit History

Duplicate from georgeyw/GPT2-tokenizer-8k-ctx

138dbbe
verified

georgeyw commited on Oct 18, 2024