Hugging Face's logo

Msok99
/
km-bpe-md-v3

Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Khmer BPE-MD v3 Tokenizer

A Khmer + English + Math-aware tokenizer trained using the Hugging Face tokenizers library.

  • Type: BPE (Morphology-driven)
  • Vocab size: 16,100
  • Includes math, Latin, Khmer, and symbol tokens.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support