mikav / scripts /train_tokenizer.py
mikav-dev's picture
Initial Mikav project scaffold
0912b10 verified
Raw
History Blame Contribute Delete
161 Bytes
"""Train a Hugging Face tokenizer for Mikav."""
def main() -> None:
print("Add tokenizer training pipeline here.")
if __name__ == "__main__":
main()