mjbommar
/

ogbert-tokenizer-8192

Model card Files Files and versions

ogbert-tokenizer-8192 / tokenizer_config.json

Commit History

Upload OGBERT tokenizer (vocab_size=8192)

1be5751
verified

mjbommar commited on Dec 9, 2025

Add tokenizer_config with special tokens

12a93c3
verified

mjbommar commited on Dec 4, 2025

Upload folder using huggingface_hub

5f87c08
verified

mjbommar commited on Dec 3, 2025