LastTransformer
/

MathFormer-16K-BPE

Model card Files Files and versions

MathFormer-16K-BPE / tokenizer.json

LastTransformer's picture

LastTransformer

Deploy native SentencePiece-backed 16K Unigram tokenizer with verified space preservation.

dc562bf verified about 1 month ago

History Contribute Delete

1.09 MB

File too large to display, you can check the raw version instead.