eljanmahammadli
/

turkic-tokenizers

Model card Files Files and versions

turkic-tokenizers / tokenizers /shared

4.91 MB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

eljanmahammadli's picture

eljanmahammadli

Initial release: 24 SentencePiece tokenizers for Turkic languages

00c3a73 verified 2 months ago

spm_16000.meta.json

1.03 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_16000.model

484 kB
xet

Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_16000.vocab

217 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_32000.meta.json

1.03 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_32000.model

778 kB
xet

Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_32000.vocab

495 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_64000.meta.json

1.03 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_64000.model

1.4 MB
xet

Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_64000.vocab

1.09 MB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_8000.meta.json

1.03 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_8000.model

348 kB
xet

Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago
spm_8000.vocab

90 kB
Initial release: 24 SentencePiece tokenizers for Turkic languages 2 months ago