FastChemTokenizer / CHANGELOG
gbyuvd's picture
Tensor handling fix
097a367 verified
Raw
History Blame Contribute Delete
193 Bytes
[20 Sept 2025]
- Add basic SELFIES tokenizer function
- Upload both core and tailed SELFIES vocab
- Update README to include SELFIES evals
- Handle both tensor and non-tensor items properly