Download source/scripts/tokenizer/train_v4.py from Voltline/vimeml-tiny-ja-v4.2: direct link, hf CLI and curl.
- Browser
- Download file 258 Bytes
-
https://huggingface.co/Voltline/vimeml-tiny-ja-v4.2/resolve/main/source/scripts/tokenizer/train_v4.py
- Command line
-
hf download hf://Voltline/vimeml-tiny-ja-v4.2/source/scripts/tokenizer/train_v4.py
-
curl -L -o train_v4.py https://huggingface.co/Voltline/vimeml-tiny-ja-v4.2/resolve/main/source/scripts/tokenizer/train_v4.py
258 Bytes
| """Train and verify the isolated V4-a tokenizer experiment.""" | |
| import sys | |
| from pathlib import Path | |
| ROOT = Path(__file__).resolve().parents[2] | |
| sys.path.insert(0, str(ROOT / "src")) | |
| from vimeml.tokenizer.v4 import main | |
| if __name__ == "__main__": | |
| main() | |