| --- |
| language: |
| - "ain" |
| tags: |
| - "ainu" |
| - "masked-lm" |
| license: "cc-by-sa-4.0" |
| pipeline_tag: "fill-mask" |
| mask_token: "[MASK]" |
| --- |
| |
| # deberta-base-ainu |
|
|
| ## Model Description |
|
|
| This is a DeBERTa(V2) model pre-trained on Ainu texts written in カタカナ, Roman, and Кириллица. You can fine-tune `deberta-base-ainu` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/deberta-base-ainu-upos), [dependency-parsing](https://huggingface.co/KoichiYasuoka/deberta-base-ainu-ud-goeswith), and so on. |
|
|
| ## How to Use |
|
|
| ```py |
| from transformers import AutoTokenizer,AutoModelForMaskedLM |
| tokenizer=AutoTokenizer.from_pretrained("KoichiYasuoka/deberta-base-ainu") |
| model=AutoModelForMaskedLM.from_pretrained("KoichiYasuoka/deberta-base-ainu") |
| ``` |
|
|
| ## Reference |
|
|
| 安岡孝一: [ローマ字・カタカナ・キリル文字併用アイヌ語RoBERTa・DeBERTaモデルの開発](http://id.nii.ac.jp/1001/00224072/), 情報処理学会研究報告, Vol.2023-CH-131『人文科学とコンピュータ』, No.7 (2023年2月18日), pp.1-7. |
|
|
|
|
