ApeTokenizer-SELFIES / tokenization_ape.py

Commit History

Harden APE tokenizer: malformed-row tolerance, freq accuracy, perf
6625342
verified

jsture commited on

Add APE SELFIES tokenizer with max length 256
891e224
verified

jsture commited on

Add APE SELFIES tokenizer
b08272b
verified

jsture commited on