LastTransformer
/

MathFormer-16K-BPE

Model card Files Files and versions

MathFormer-16K-BPE

Ctrl+K

Ctrl+K

1 contributor

History: 8 commits

LastTransformer's picture

LastTransformer

Deploy native SentencePiece-backed 16K Unigram tokenizer with verified space preservation.

dc562bf verified about 1 month ago

.gitattributes

1.52 kB
initial commit about 1 month ago
README.md

5.17 kB
Deploy native SentencePiece-backed 16K Unigram tokenizer. about 1 month ago
tokenizer.json

1.09 MB
Deploy native SentencePiece-backed 16K Unigram tokenizer with verified space preservation. about 1 month ago
tokenizer_config.json

248 Bytes
Deploy native SentencePiece-backed 16K Unigram tokenizer with verified space preservation. about 1 month ago