bert-astronomy-tokenizer / tokenizer.json

Commit History

Upload WordPiece tokenizer (30k vocab) shared across all astronomy models
52d283e
verified

vraj1 commited on