mjbommar
/

ogbert-tokenizer-16384

Model card Files Files and versions

ogbert-tokenizer-16384

Commit History

Upload OGBERT tokenizer (vocab_size=16384)

f87e9d1
verified

mjbommar commited on Dec 10, 2025

Upload OGBERT tokenizer (vocab_size=16384)

ae3b88b
verified

mjbommar commited on Dec 10, 2025

Add README with YAML metadata

8a7f82c
verified

mjbommar commited on Dec 4, 2025

Add special_tokens_map

3033174
verified

mjbommar commited on Dec 4, 2025

Add tokenizer_config with special tokens

5c9cae5
verified

mjbommar commited on Dec 4, 2025

Upload folder using huggingface_hub

9c3647e
verified

mjbommar commited on Dec 3, 2025

initial commit

8a47d25
verified

mjbommar commited on Dec 3, 2025