The Functionalizer: Lossless Functional Decomposition for Subword Tokenization
Paper • 2609.15991 • Published • 17
Functionalizer-100M
-
-
mrkwanzaa/functionalizer-100M-fineweb-edu-seed1
Text Generation • 97.7M • Updated • 372 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed2
Text Generation • 97.7M • Updated • 388 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed3
Text Generation • 97.7M • Updated • 383 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed4
Text Generation • 97.7M • Updated • 373 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed5
Text Generation • 97.7M • Updated • 389 -
mrkwanzaa/functionalizer-100M-github-code-python-seed1
Text Generation • 97.7M • Updated • 444 -
mrkwanzaa/functionalizer-100M-github-code-python-seed2
Text Generation • 97.7M • Updated • 460 -
mrkwanzaa/functionalizer-100M-github-code-python-seed3
Text Generation • 97.7M • Updated • 454 -
mrkwanzaa/functionalizer-100M-github-code-python-seed4
Text Generation • 97.7M • Updated • 434 -
mrkwanzaa/functionalizer-100M-github-code-python-seed5
Text Generation • 97.7M • Updated • 443