mjbommar
/

ogbert-tokenizer-8192

Model card Files Files and versions

ogbert-tokenizer-8192

Commit History

Upload OGBERT tokenizer (vocab_size=8192)

3c76971
verified

mjbommar commited on Dec 10, 2025

Upload OGBERT tokenizer (vocab_size=8192)

1be5751
verified

mjbommar commited on Dec 9, 2025

Add README with YAML metadata

9c6a895
verified

mjbommar commited on Dec 4, 2025

Add special_tokens_map

0281a5f
verified

mjbommar commited on Dec 4, 2025

Add tokenizer_config with special tokens

12a93c3
verified

mjbommar commited on Dec 4, 2025

Upload folder using huggingface_hub

5f87c08
verified

mjbommar commited on Dec 3, 2025

initial commit

76669df
verified

mjbommar commited on Dec 3, 2025