turkish-morph-tokenizer / tokenizer.json

Commit History

22 days ago

  1. Set ignore_merges=true + OpenVINO parity check (openvino_tokenizers#780)

    Verified signature
    5b5fad4

23 days ago

  1. Turkish morphology-aware tokenizer for Qwen3.5 (v1)

    Verified signature
    7f601ce