mjbommar
/

ogbert-tokenizer-32768

Model card Files Files and versions

ogbert-tokenizer-32768

Commit History

Upload OGBERT tokenizer (vocab_size=32768)

862a162
verified

mjbommar commited on Dec 10, 2025

Upload OGBERT tokenizer (vocab_size=32768)

11977f1
verified

mjbommar commited on Dec 10, 2025

Add README with YAML metadata

9b1c363
verified

mjbommar commited on Dec 4, 2025

Add special_tokens_map

a86dd28
verified

mjbommar commited on Dec 4, 2025

Add tokenizer_config with special tokens

4bfd63e
verified

mjbommar commited on Dec 4, 2025

Upload folder using huggingface_hub

01a2d64
verified

mjbommar commited on Dec 3, 2025

initial commit

7c88a1c
verified

mjbommar commited on Dec 3, 2025