Download run_tokenizer.py from ManyOtherFunctions/Yue2-WannabeTokenizer: direct link, hf CLI and curl.
- Browser
- Download file 171 Bytes
-
https://huggingface.co/ManyOtherFunctions/Yue2-WannabeTokenizer/resolve/main/run_tokenizer.py
- Command line
-
hf download hf://ManyOtherFunctions/Yue2-WannabeTokenizer/run_tokenizer.py
-
curl -L -o run_tokenizer.py https://huggingface.co/ManyOtherFunctions/Yue2-WannabeTokenizer/resolve/main/run_tokenizer.py
171 Bytes
| #!/usr/bin/env python3 | |
| """Command-line entry point for tokenization and reconstruction.""" | |
| from wannabe_tokenizer.cli import main | |
| if __name__ == "__main__": | |
| main() | |