DaehanKim commited on
Commit
d0b5f39
ยท
1 Parent(s): 7472fe8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -4,6 +4,9 @@
4
  - [lassl](https://github.com/lassl/lassl) ์˜คํ”ˆ์†Œ์Šค ํ”„๋กœ์ ํŠธ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ํ•™์Šตํ•˜์˜€์Šต๋‹ˆ๋‹ค.
5
  - ์‚ฌ์ „ํ•™์Šต๋งŒ ์ง„ํ–‰๋œ ๋ชจ๋ธ์ด๋ฏ€๋กœ ์•„๋ž˜์™€ ๊ฐ™์ด UL2์˜ denoising์„ ํ™•์ธํ•ด๋ณด์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
6
  ```py
 
 
 
7
  for prefix_token in ("[NLU]","[NLG]","[S2S]"):
8
  input_string = f"{prefix_token}์–ด๋–ค ์•„ํŒŒํŠธ๋Š” ํ˜ธ๊ฐ€๊ฐ€ [new_id_27]๋Š”๋“ฑ ๊ฒฝ๊ธฐ ์นจ์ฒด๋กœ ์ธํ•œ [new_id_26]๋ฅผ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.</s>"
9
  inputs = tokenizer(input_string, return_tensors="pt", add_special_tokens=False)
 
4
  - [lassl](https://github.com/lassl/lassl) ์˜คํ”ˆ์†Œ์Šค ํ”„๋กœ์ ํŠธ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ํ•™์Šตํ•˜์˜€์Šต๋‹ˆ๋‹ค.
5
  - ์‚ฌ์ „ํ•™์Šต๋งŒ ์ง„ํ–‰๋œ ๋ชจ๋ธ์ด๋ฏ€๋กœ ์•„๋ž˜์™€ ๊ฐ™์ด UL2์˜ denoising์„ ํ™•์ธํ•ด๋ณด์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
6
  ```py
7
+ model = T5ForConditionalGeneration.from_pretrained("DaehanKim/KoUL2")
8
+ tokenizer = AutoTokenizer.from_pretrained("DaehanKim/KoUL2")
9
+
10
  for prefix_token in ("[NLU]","[NLG]","[S2S]"):
11
  input_string = f"{prefix_token}์–ด๋–ค ์•„ํŒŒํŠธ๋Š” ํ˜ธ๊ฐ€๊ฐ€ [new_id_27]๋Š”๋“ฑ ๊ฒฝ๊ธฐ ์นจ์ฒด๋กœ ์ธํ•œ [new_id_26]๋ฅผ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.</s>"
12
  inputs = tokenizer(input_string, return_tensors="pt", add_special_tokens=False)