Spaces:

Duplicated from Xenova/the-tokenizer-playground

Jhayase
/

superbpe-tokenizer-playground

Running

App Files Files Community

superbpe-tokenizer-playground

895 kB

3 contributors

History: 27 commits

Jhayase's picture

Set default to SuperBPE t180k

ee8ca32 10 months ago