File size: 699 Bytes
efd4ceb f42964e b99f564 df95bad c7c74f7 df95bad 737392e df95bad f48dec9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
---
license: mit
language:
- az
tags:
- wikipedia
- books
- social-media
vocab-size: 16378
---
# Model Details
## Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** Farid Haziyev
- **Model type:** Tokenizer
- **Language(s) (NLP):** Azerbaijani
- **License:** MIT
- **Finetuned from model [optional]:** bert-based-uncased
# Uses
Can be used in any project intended for the purpose of improving Azerbaijani language models
## How to Get Started with the Model
Use the code below to get started with the model.
```python
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("heziyevv/aze-bert-tokenizer-middle")
``` |