erenyanic
/

turkish_bpe_128k

Model card Files Files and versions

turkish_bpe_128k / tokenizer /tokenizer.json

erenyanic's picture

Add Turkish 128K byte-level BPE tokenizer

d954a5e verified 7 days ago

History Contribute Delete

10.2 MB

File too large to display, you can check the raw version instead.