Transformers
OLMO_Smiles_aware_tokenizer / tokenizer.json
Codemaster67's picture
Add SPE tokenizer (1125 SMILES subword tokens) + <|start_of_smiles|>/<|end_of_smiles|> special tokens. Trained on 2M ZINC20 + 2M ChEMBL canonical SMILES. SPE vocab_size=1000, min_freq=4000.
f6eb1d8 verified
raw
history contribute delete
3.77 MB
File too large to display, you can check the raw version instead.