FastChemTokenizer / CHANGELOG
gbyuvd's picture
Tensor handling fix
097a367 verified
raw
history blame contribute delete
193 Bytes
[20 Sept 2025]
- Add basic SELFIES tokenizer function
- Upload both core and tailed SELFIES vocab
- Update README to include SELFIES evals
- Handle both tensor and non-tensor items properly