arabovs-ai-lab
/

TatarTokenizers

language-modeling

Model card Files Files and versions

TatarTokenizers / bpe

632 kB

1 contributor

History: 3 commits

ArabovMK's picture

Upload bpe/tokenizer_config.json with huggingface_hub

7796c74 verified about 2 months ago

special_tokens_map.json
132 Bytes

Upload bpe/special_tokens_map.json with huggingface_hub about 2 months ago
tokenizer.json
630 kB

Upload bpe/tokenizer.json with huggingface_hub about 2 months ago
tokenizer_config.json
1.22 kB

Upload bpe/tokenizer_config.json with huggingface_hub about 2 months ago