Yue2-WannabeTokenizer / run_tokenizer.py
ManyOtherFunctions's picture
Upload 17 files
9040f4d verified
Raw History Blame Contribute Delete
171 Bytes
#!/usr/bin/env python3
"""Command-line entry point for tokenization and reconstruction."""
from wannabe_tokenizer.cli import main
if __name__ == "__main__":
main()