minmingbb commited on
Commit
9cb19dc
ยท
verified ยท
1 Parent(s): adcfce7

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -12,12 +12,45 @@ language:
12
  datasets:
13
  - nsmc
14
  ---
 
 
 
15
 
16
  ## ๋ชจ๋ธ ์ •๋ณด
 
 
 
 
 
 
 
 
 
 
17
 
18
  ## ์‚ฌ์šฉ ๋ฐฉ๋ฒ•
19
  ```python
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
 
 
21
  ```
22
 
23
  **Note**: ์ด ๋ชจ๋ธ์€ ๊ต์œก ๋ชฉ์ ์œผ๋กœ ๋งŒ๋“ค์–ด์กŒ์Šต๋‹ˆ๋‹ค.
 
12
  datasets:
13
  - nsmc
14
  ---
15
+ # NSMC ๊ฐ์ • ๋ถ„์„ LoRA ๋ชจ๋ธ
16
+
17
+ NSMC ๋ฐ์ดํ„ฐ์…‹์œผ๋กœ ํŒŒ์ธํŠœ๋‹๋œ ํ•œ๊ตญ์–ด ๊ฐ์ • ๋ถ„์„ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
18
 
19
  ## ๋ชจ๋ธ ์ •๋ณด
20
+ - **๋ฒ ์ด์Šค ๋ชจ๋ธ**: klue/bert-base
21
+ - **ํŒŒ์ธํŠœ๋‹ ๋ฐฉ๋ฒ•**: LoRA
22
+ - **์–ธ์–ด**: ํ•œ๊ตญ์–ด
23
+
24
+ # ์„ฑ๋Šฅ
25
+ - **์ตœ์ข… ์„ฑ๋Šฅ**: Accuracy 85%
26
+
27
+ ## ํ•™์Šต์ •๋ณด
28
+ ### ํ•™์Šต์„ค์ •
29
+ - ** epoch**: 3
30
 
31
  ## ์‚ฌ์šฉ ๋ฐฉ๋ฒ•
32
  ```python
33
+ from peft import PeftModel
34
+
35
+ # ๋ฒ ์ด์Šค ๋ชจ๋ธ ๋กœ๋“œ (๋ถ„๋ฅ˜์šฉ)
36
+ print("๋ฒ ์ด์Šค ๋ชจ๋ธ ๋กœ๋”ฉ")
37
+ base_model_reload = AutoModelForSequenceClassification.from_pretrained(
38
+ "klue/bert-base",
39
+ num_labels=2
40
+ )
41
+
42
+ # ์—…๋กœ๋“œํ•œ LoRA ์–ด๋Œ‘ํ„ฐ ๋กœ๋“œ
43
+ print(f"LoRA ์–ด๋Œ‘ํ„ฐ ๋กœ๋”ฉ: minmingbb/nsmc-sentiment-lora")
44
+ model_reload = PeftModel.from_pretrained(base_model_reload, model_name_upload)
45
+ tokenizer_reload = AutoTokenizer.from_pretrained(model_name_upload)
46
+
47
+ # GPU๋กœ ์ด๋™
48
+ device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
49
+ model_reload = model_reload.to(device)
50
+ model_reload.eval()
51
 
52
+ print("๋ชจ๋ธ ๋กœ๋“œ ์™„๋ฃŒ!")
53
+ print("์ด์ œ ์ด ์ฝ”๋“œ๋กœ ์–ด๋””์„œ๋“  ๋‚ด ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค!")
54
  ```
55
 
56
  **Note**: ์ด ๋ชจ๋ธ์€ ๊ต์œก ๋ชฉ์ ์œผ๋กœ ๋งŒ๋“ค์–ด์กŒ์Šต๋‹ˆ๋‹ค.