mjbommar
/

ogbert-tokenizer-32768

Model card Files Files and versions

ogbert-tokenizer-32768 / tokenizer_config.json

Commit History

Upload OGBERT tokenizer (vocab_size=32768)

11977f1
verified

mjbommar commited on Dec 10, 2025

Add tokenizer_config with special tokens

4bfd63e
verified

mjbommar commited on Dec 4, 2025

Upload folder using huggingface_hub

01a2d64
verified

mjbommar commited on Dec 3, 2025