nebchi commited on
Commit
d83e639
ยท
verified ยท
1 Parent(s): 80e11fe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -10
README.md CHANGED
@@ -101,16 +101,50 @@ datasets:
101
  You can initialize the model and processor for inference with `pipeline` as follows.
102
 
103
  ```python
104
- from transformers import AutoTokenizer, AutoModelForSequenceClassification, pipeline
105
-
106
- MODEL_ID = "Devocean-06/Spam_Filter-gemma"
107
- tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
108
- model = AutoModelForSequenceClassification.from_pretrained(MODEL_ID)
109
- pipe = pipeline("text-classification", model=model, tokenizer=tokenizer)
110
-
111
- text = "๋ฌด๋ฃŒ ์ฟ ํฐ ์ง€๊ธ‰! ์ง€๊ธˆ ๋ฐ”๋กœ ํด๋ฆญํ•˜์„ธ์š” ๐Ÿ‘‰ https://spam.link ํ•ด๋‹น ๋ฌธ์ž ์ŠคํŒธ์ธ๊ฐ€์š”?"
112
- result = pipe(text, top_k=2)
113
- print(result)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
114
  ```
115
 
116
  ## Running with vLLM
 
101
  You can initialize the model and processor for inference with `pipeline` as follows.
102
 
103
  ```python
104
+ from openai import OpenAI
105
+
106
+ client = OpenAI(
107
+ base_url="model-endpoint",
108
+ api_key="api-key" # vllm์€ API key๊ฐ€ ํ•„์š” ์—†์ง€๋งŒ ํ•„๋“œ๋Š” ํ•„์ˆ˜
109
+ )
110
+
111
+ SYSTEM_PROMPT = """๋‹น์‹ ์€ ์ŠคํŒธ ๋ฌธ์ž๋กœ ํŒ์ •ํ•œ ๊ทผ๊ฑฐ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋Œ€ํ˜• ์–ธ์–ด ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
112
+ ์•„๋ž˜ ๊ธฐ์ค€์— ๋”ฐ๋ผ ์ŠคํŒธ์—ฌ๋ถ€ ํŒ์ •์˜ ๊ทผ๊ฑฐ๋ฅผ ๊ฐ„๋‹จ๋ช…๋ฃŒํ•˜๊ฒŒ ํ•œ ๋ฌธ์žฅ์œผ๋กœ ์ž‘์„ฑํ•ด ์ฃผ์„ธ์š”. ์ถœ๋ ฅ ํฌ๋งท์€ XAI ์„ค๋ช…์— ์ ํ•ฉํ•˜๋„๋ก ์ผ๊ด€์„ฑ ์žˆ๊ฒŒ ํ…œํ”Œ๋ฆฟ ํ˜•์‹์œผ๋กœ ๊ณ ์ •๋˜์–ด์•ผ ํ•˜๋ฉฐ, ์ŠคํŒธ ์—ฌ๋ถ€ ๋ฐ ๊ทธ ๊ทผ๊ฑฐ๋ฅผ ๋ช…์พŒํ•˜๊ฒŒ ์ œ์‹œํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
113
+
114
+ **1. ํŒ์ • ๊ทผ๊ฑฐ(ํ•œ ๋ฌธ์žฅ, ํ…œํ”Œ๋ฆฟ):**
115
+ - **๊ฐœ์ธ ์ •๋ณด ์š”๊ตฌ:** ์‹ ๋ถ„์ฆ, ๋น„๋ฐ€๋ฒˆํ˜ธ, ์นด๋“œ ๋ฒˆํ˜ธ ๋“ฑ ๊ฐœ์ธ ์ •๋ณด๋ฅผ ์š”๊ตฌํ–ˆ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค.
116
+ - **๊ธฐํƒ€ ํŠน์ด์‚ฌํ•ญ:** ์œ„ ํ•ญ๋ชฉ ์™ธ์— ์ŠคํŒธ์œผ๋กœ ์˜์‹ฌ๋˜๋Š” ๋‹ค๋ฅธ ํŒจํ„ด์ด ์žˆ์Šต๋‹ˆ๋‹ค.
117
+ - **๋ฐœ์‹ ์ž/์ˆ˜์‹ ์ž:** ๋ฐœ์‹  ๋ฒˆํ˜ธ๊ฐ€ ์ผ๋ฐ˜์ ์ด์ง€ ์•Š๊ฑฐ๋‚˜ ๋ถˆ๋ถ„๋ช…ํ•˜๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค.
118
+ - **๋‚ด์šฉ์˜ ๋ชฉ์ :** ๊ธˆ์œต ์ƒํ’ˆ, ๋Œ€์ถœ, ๋„๋ฐ•, ํˆฌ์ž, ๋ถˆ๋ฒ• ๋ณต์ œ ๋“ฑ์˜ ํ™๋ณด๋‚˜ ๊ถŒ์œ ๊ฐ€ ํฌํ•จ๋˜์–ด ์žˆ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค.
119
+ - **์‹ฌ๋ฆฌ์  ์••๋ฐ•:** ๊ธด๊ธ‰์„ฑ, ๊ณตํฌ, ํ˜ธ๊ธฐ์‹ฌ์„ ์œ ๋ฐœํ•˜์—ฌ ์ฆ‰๊ฐ์ ์ธ ํ–‰๋™์„ ์œ ๋„ํ–ˆ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. (์˜ˆ: "๊ธฐ๊ฐ„ ํ•œ์ •", "์ง€๊ธˆ ์ฆ‰์‹œ", "ํด๋ฆญํ•˜์ง€ ์•Š์œผ๋ฉด ๋ถˆ์ด์ต")
120
+ - **๋งํฌ/URL:** ์ผ๋ฐ˜์ ์ด์ง€ ์•Š์€ ์งง์€ URL, ๋‹จ์ถ• URL ๋˜๋Š” ์˜์‹ฌ์Šค๋Ÿฌ์šด ๋งํฌ๊ฐ€ ํฌํ•จ๋˜์–ด ์žˆ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค.
121
+
122
+ **2. ํ•„์ˆ˜ ์กฐ๊ฑด**
123
+ - ๋ฐ˜๋“œ์‹œ ์ถœ๋ ฅ ํ˜•์‹์— ๋”ฐ๋ผ์„œ [์ŠคํŒธ ํŒ์ • ์ด์œ ] ํ…œํ”Œ๋ฆฟ์„ ์‚ฌ์šฉํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
124
+ - ์ŠคํŒธ์œผ๋กœ ํŒ์ •ํ•œ ์ด์œ ์— ๋Œ€ํ•ด์„œ ๊ตฌ์ฒด์ ์ธ ์ด์œ ๋กœ 100์ž ์ด์ƒ์œผ๋กœ ์„ค๋ช…ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
125
+ - ๋ฐ˜๋“œ์‹œ ์œ„ ํŒ์ • ๊ทผ๊ฑฐ๋ฅผ ๋จผ์ € ์–ธ๊ธ‰ํ•œ ๋’ค์— ์ถœ๋ ฅ ํ˜•์‹์— ๋งž๊ฒŒ ์ŠคํŒธ ํŒ์ • ์ด์œ ๋ฅผ ์ƒ์„ฑํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
126
+ - ์ŠคํŒธ ํŒ์ • ์ด์œ  ์ƒ์„ฑ ์‹œ, ์œ„ ์ŠคํŒธ ๋ฌธ์ž๋Š” ~~ ์œผ๋กœ ์‹œ์ž‘ํ•ด์•ผํ•ฉ๋‹ˆ๋‹ค.
127
+ - ๊ทธ๋ฆฌ๊ณ  ์ „์ œ์กฐ๊ฑด์€ ๋ชจ๋‘ ์ŠคํŒธ ๋ฌธ์ž๋กœ ๋ถ„๋ฅ˜๋œ ํ˜•์‹์ด๋‹ˆ ์ŠคํŒธ์ด ์•„๋‹ˆ๋ผ๊ณ  ์–ธ๊ธ‰ํ•˜๋ฉด ์•ˆ๋ฉ๋‹ˆ๋‹ค.
128
+
129
+ ### ์ถœ๋ ฅ ํ˜•์‹ ์˜ˆ์‹œ
130
+ - ํŒ์ • ๊ทผ๊ฑฐ : ๊ฐœ์ธ์ •๋ณด ์š”๊ตฌ
131
+ - ์ŠคํŒธ ํŒ์ • ์ด์œ : ์œ„ ์ŠคํŒธ ๋ฌธ์ž๋Š” ๊ฐœ์ธ์ •๋ณด๋ฅผ ์š”๊ตฌํ•˜๋Š” ์ŠคํŒธ์œผ๋กœ ์•„ํŒŒํŠธ ๋ถ„์–‘ ๋ฐ ๋ถ€๋™์‚ฐ ํˆฌ์ž ๊ถŒ์œ ๊ฐ€ ํฌํ•จ๋˜์–ด ์žˆ์œผ๋ฉฐ, ๊ธด๊ธ‰์„ฑ์„ ๊ฐ•์กฐํ•˜์—ฌ ์ฆ‰๊ฐ์ ์ธ ํ–‰๋™์„ ์œ ๋„ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค."""
132
+
133
+ response = client.chat.completions.create(
134
+ model="Devocean-06/Spam_Filter-gemma",
135
+ messages=[
136
+ {"role": "system", "content": SYSTEM_PROMPT},
137
+ {"role": "user", "content": user_message}
138
+ ],
139
+ temperature=0.7,
140
+ max_tokens=2048
141
+ )
142
+ print(response.choices[0].message.content)
143
+
144
+ ๐Ÿง  Example Output
145
+ - ํŒ์ • ๊ทผ๊ฑฐ: ๋‚ด์šฉ์˜ ๋ชฉ์ 
146
+ - ์ŠคํŒธ ํŒ์ • ์ด์œ : ์œ„ ์ŠคํŒธ ๋ฌธ์ž๋Š” ๊ธˆ์œต ์ƒํ’ˆ๊ณผ ๋Œ€์ถœ ๊ด€๋ จ ๊ถŒ์œ  ๋‚ด์šฉ์„ ํฌํ•จํ•˜๊ณ  ์žˆ์œผ๋ฉฐ,
147
+ โ€˜์ง€๊ธˆ ๋ฐ”๋กœโ€™, โ€˜์ฆ‰์‹œ ์‹ ์ฒญโ€™๊ณผ ๊ฐ™์€ ์‹ฌ๋ฆฌ์  ์••๋ฐ• ์–ด๊ตฌ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ˆ˜์‹ ์ž์˜ ํ–‰๋™์„ ์œ ๋„ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.
148
  ```
149
 
150
  ## Running with vLLM