| | --- |
| | language: |
| | - da |
| | license: apache-2.0 |
| | --- |
| | ## daT5-base |
| | A smaller version of [Google's mt5-base](https://huggingface.co/google/mt5-base) model, where the original model is reduced to only include Danish embeddings. |
| |
|
| | ## How to use |
| | ```python |
| | from transformers import AutoTokenizer, AutoModel |
| | tokenizer = AutoTokenizer.from_pretrained("emillykkejensen/daT5-base") |
| | model = AutoModel.from_pretrained("emillykkejensen/daT5-base") |
| | ``` |
| |
|
| | ## Further reading |
| |
|
| | [Gist](https://gist.github.com/emillykkejensen/8bf1b323495efc7252dee966e6bc1b5c) showing (in Danish) how the embeddings are extracted |
| |
|
| | [Article](https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90) explaining how to do it by [David Dale](https://huggingface.co/cointegrated) |
| |
|
| | ## Also check out |
| | [daT5-large](https://huggingface.co/emillykkejensen/daT5-large) |
