ogbert-v1-mlm / tokenizer_config.json

Commit History

Fix tokenizer to not produce token_type_ids (ModernBERT compatibility)
0a39df9
verified

mjbommar commited on

Fix tokenizer_class for sentence-transformers compatibility
2bedf10
verified

mjbommar commited on

Upload OGBert v1 MLM tokenizer
cdeef3f
verified

mjbommar commited on