Create README.md
Browse filesAdd a readme file
README.md
ADDED
|
@@ -0,0 +1,70 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- zh
|
| 4 |
+
tags:
|
| 5 |
+
- Seq2SeqLM
|
| 6 |
+
- 古文
|
| 7 |
+
- 文言文
|
| 8 |
+
- 中国古代官职翻译
|
| 9 |
+
- ancient
|
| 10 |
+
- classical
|
| 11 |
+
license: cc-by-nc-sa-4.0
|
| 12 |
+
metrics:
|
| 13 |
+
- sacrebleu
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# <font color="IndianRed"> TITO (Classical Chinese Office Title Translation)</font>
|
| 17 |
+
[](https://colab.research.google.com/drive/1UoG3QebyBlK6diiYckiQv-5dRB9dA4iv?usp=sharing/)
|
| 18 |
+
|
| 19 |
+
Our model <font color="cornflowerblue">TITO (Classical Chinese Office Title Translation) </font> is a Sequence to Sequence Classical Chinese language model that is intended to <font color="IndianRed">translate a Classical Chinese office title into English</font>. This model is first inherited from the MarianMTModel, and finetuned using a 6,208 high-quality translation pairs collected CBDB group (China Biographical Database).
|
| 20 |
+
|
| 21 |
+
### <font color="IndianRed"> How to use </font>
|
| 22 |
+
|
| 23 |
+
Here is how to use this model to get the features of a given text in PyTorch:
|
| 24 |
+
|
| 25 |
+
<font color="cornflowerblue"> 1. Import model and packages </font>
|
| 26 |
+
```python
|
| 27 |
+
from transformers import MarianMTModel, MarianTokenizer
|
| 28 |
+
|
| 29 |
+
device = torch.device('cuda')
|
| 30 |
+
model_name = 'cbdb/ClassicalChineseOfficeTitleTranslation'
|
| 31 |
+
tokenizer = MarianTokenizer.from_pretrained(model_name)
|
| 32 |
+
model = MarianMTModel.from_pretrained(model_name).to(device)
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
<font color="cornflowerblue"> 2. Load Data </font>
|
| 36 |
+
```python
|
| 37 |
+
# Load your data here
|
| 38 |
+
tobe_translated = ['講筵官','判司簿尉','散騎常侍','殿中省尚輦奉御']
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
<font color="cornflowerblue"> 3. Make a prediction </font>
|
| 42 |
+
```python
|
| 43 |
+
trans_list = []
|
| 44 |
+
for chinese_sentence in tobe_translated:
|
| 45 |
+
inputs = tokenizer([chinese_sentence], return_tensors="pt", padding=True).to(device)
|
| 46 |
+
translated = model.generate(**inputs, max_length=128)
|
| 47 |
+
tran = [tokenizer.decode(t, skip_special_tokens=True) for t in translated][0]
|
| 48 |
+
print(f'{chinese_sentence}: {tran}')
|
| 49 |
+
trans_list.append(tran[0])
|
| 50 |
+
```
|
| 51 |
+
講筵官: Lecturer<br>
|
| 52 |
+
判司簿尉: Supervisor of the Commandant of Records<br>
|
| 53 |
+
散騎常侍: Policy Advisor<br>
|
| 54 |
+
殿中省尚輦奉御: Chief Steward of the Palace Administration<br>
|
| 55 |
+
|
| 56 |
+
### <font color="IndianRed">Authors </font>
|
| 57 |
+
Queenie Luo (queenieluo[at]g.harvard.edu)
|
| 58 |
+
<br>
|
| 59 |
+
Hongsu Wang
|
| 60 |
+
<br>
|
| 61 |
+
Peter Bol
|
| 62 |
+
<br>
|
| 63 |
+
CBDB Group
|
| 64 |
+
|
| 65 |
+
### <font color="IndianRed">License </font>
|
| 66 |
+
Copyright (c) 2023 CBDB
|
| 67 |
+
|
| 68 |
+
Except where otherwise noted, content on this repository is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0).
|
| 69 |
+
To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/4.0/ or
|
| 70 |
+
send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, USA.
|