Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,9 @@
|
|
| 4 |
- [lassl](https://github.com/lassl/lassl) ์คํ์์ค ํ๋ก์ ํธ๋ฅผ ํ์ฉํ์ฌ ํ์ตํ์์ต๋๋ค.
|
| 5 |
- ์ฌ์ ํ์ต๋ง ์งํ๋ ๋ชจ๋ธ์ด๋ฏ๋ก ์๋์ ๊ฐ์ด UL2์ denoising์ ํ์ธํด๋ณด์ค ์ ์์ต๋๋ค.
|
| 6 |
```py
|
|
|
|
|
|
|
|
|
|
| 7 |
for prefix_token in ("[NLU]","[NLG]","[S2S]"):
|
| 8 |
input_string = f"{prefix_token}์ด๋ค ์ํํธ๋ ํธ๊ฐ๊ฐ [new_id_27]๋๋ฑ ๊ฒฝ๊ธฐ ์นจ์ฒด๋ก ์ธํ [new_id_26]๋ฅผ ํ์ธํ ์ ์์์ต๋๋ค.</s>"
|
| 9 |
inputs = tokenizer(input_string, return_tensors="pt", add_special_tokens=False)
|
|
|
|
| 4 |
- [lassl](https://github.com/lassl/lassl) ์คํ์์ค ํ๋ก์ ํธ๋ฅผ ํ์ฉํ์ฌ ํ์ตํ์์ต๋๋ค.
|
| 5 |
- ์ฌ์ ํ์ต๋ง ์งํ๋ ๋ชจ๋ธ์ด๋ฏ๋ก ์๋์ ๊ฐ์ด UL2์ denoising์ ํ์ธํด๋ณด์ค ์ ์์ต๋๋ค.
|
| 6 |
```py
|
| 7 |
+
model = T5ForConditionalGeneration.from_pretrained("DaehanKim/KoUL2")
|
| 8 |
+
tokenizer = AutoTokenizer.from_pretrained("DaehanKim/KoUL2")
|
| 9 |
+
|
| 10 |
for prefix_token in ("[NLU]","[NLG]","[S2S]"):
|
| 11 |
input_string = f"{prefix_token}์ด๋ค ์ํํธ๋ ํธ๊ฐ๊ฐ [new_id_27]๋๋ฑ ๊ฒฝ๊ธฐ ์นจ์ฒด๋ก ์ธํ [new_id_26]๋ฅผ ํ์ธํ ์ ์์์ต๋๋ค.</s>"
|
| 12 |
inputs = tokenizer(input_string, return_tensors="pt", add_special_tokens=False)
|