hindko-tokenizer / tokenizer_config.json

Commit History

17 days ago

  1. Hindko tokenizer v1.0.0: SentencePiece Unigram 32k (tokenizer files)

    Verified signature
    c76452a