mjbommar
/

ogbert-tokenizer-16384

Model card Files Files and versions

ogbert-tokenizer-16384 / tokenizer_config.json

Commit History

Upload OGBERT tokenizer (vocab_size=16384)

ae3b88b
verified

mjbommar commited on Dec 10, 2025

Add tokenizer_config with special tokens

5c9cae5
verified

mjbommar commited on Dec 4, 2025

Upload folder using huggingface_hub

9c3647e
verified

mjbommar commited on Dec 3, 2025