nmstech
/

turk-tokenizer

Model card Files Files and versions

turk-tokenizer / turk_tokenizer /data /zemberek-full.jar

nmstech's picture

Initial release: TurkTokenizer v1.0.0 — TR-MMLU 92%

ca41c16 verified about 1 month ago

history blame contribute delete

31.6 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 37991ac74d2c2dcaecf00b802ed2cdd949e70f5d3c019e2d5fdaec5d325778e3
Size of remote file:: 31.6 MB
SHA256:: 74ee8736b73dc2ca878071b80829f9c5acccc268d4b8b7795d36d60db26a1731

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.