devmeta commited on
Commit
d3317b4
ยท
verified ยท
1 Parent(s): d3cc5e1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +84 -16
README.md CHANGED
@@ -1,22 +1,90 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - llama
8
- - trl
9
- license: apache-2.0
10
- language:
11
- - en
12
  ---
13
 
14
- # Uploaded model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
- - **Developed by:** devmeta
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/llama-3.2-3b-instruct-bnb-4bit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth)
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
1
+ # ๐Ÿ maple-npc-llama3.2-3B-lora
2
+
3
+ **๋ฉ”์ดํ”Œ์Šคํ† ๋ฆฌ NPC ๋Œ€ํ™” ํŠนํ™” LoRA ํŒŒ์ธํŠœ๋‹ ๋ชจ๋ธ**
4
+
5
+ > Llama 3.2 3B Instruct ๊ธฐ๋ฐ˜ | Unsloth LoRA | ํ•œ๊ตญ์–ด ๊ฒŒ์ž„ NPC ํŠนํ™”
6
+
7
+ ---
8
+
9
+ ## ๐Ÿ“Œ ๋ชจ๋ธ ๊ฐœ์š”
10
+
11
+ ๋ฉ”์ดํ”Œ์Šคํ† ๋ฆฌ ์„ธ๊ณ„๊ด€์— ํŠนํ™”๋œ NPC ๋Œ€ํ™” ์ƒ์„ฑ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
12
+ **Big Five ์„ฑ๊ฒฉ ๋ชจ๋ธ**์„ ํ”„๋กฌํ”„ํŠธ๋กœ ์ œ์–ดํ•˜์—ฌ
13
+ NPC๋ณ„ ๊ณ ์œ ํ•œ ๋งํˆฌ์™€ ์„ฑ๊ฒฉ์„ ๊ตฌํ˜„ํ•ฉ๋‹ˆ๋‹ค.
14
+
15
+ - ๋ฒ ์ด์Šค ๋ชจ๋ธ: `unsloth/Llama-3.2-3B-Instruct`
16
+ - ํ•™์Šต ๋ฐฉ๋ฒ•: LoRA (r=16, alpha=32)
17
+ - ํ•™์Šต ๋ฐ์ดํ„ฐ: ๋ฉ”์ดํ”Œ์Šคํ† ๋ฆฌ NPC ๋Œ€ํ™” 134์ƒ˜ํ”Œ
18
+ - ํ•™์Šต ์‹œ๊ฐ„: 33์ดˆ (A100, Unsloth 2x ๊ฐ€์†)
19
+
20
  ---
21
+
22
+ ## ๐ŸŽฎ ์ฃผ์š” ํŠน์ง•
23
+
24
+ - ๋ฉ”์ดํ”Œ์Šคํ† ๋ฆฌ ์„ธ๊ณ„๊ด€ (ํ—ค๋„ค์‹œ์Šค, ์—˜๋ฆฌ๋‹ˆ์•„, ์—๋ ˆ๋ธŒ ๋“ฑ) ๋ฐ˜์˜
25
+ - Big Five ์„ฑ๊ฒฉ ๋ชจ๋ธ ๊ธฐ๋ฐ˜ NPC ์„ฑ๊ฒฉ ์ œ์–ด
26
+ - ํด๋ž˜์Šค๋ณ„ ๋งํˆฌ ์ฐจ๋ณ„ํ™” (์•„ํฌ๋ฉ”์ด์ง€, ํŒฌํ…€, ๋ฉ”๋ฅด์„ธ๋ฐ์Šค ๋“ฑ)
27
+ - RAG ์ง€์—ญ ์ปจํ…์ŠคํŠธ ์ฃผ์ž… ์ง€์›
28
+
 
 
29
  ---
30
 
31
+ ## ๐Ÿš€ ์‚ฌ์šฉ๋ฒ•
32
+ ```python
33
+ from transformers import AutoTokenizer, AutoModelForCausalLM
34
+
35
+ model = AutoModelForCausalLM.from_pretrained("devmeta/maple-npc-llama3.2-3B-lora")
36
+ tokenizer = AutoTokenizer.from_pretrained("devmeta/maple-npc-llama3.2-3B-lora")
37
+
38
+ prompt = """๋„ˆ๋Š” ๋ฉ”์ดํ”Œ์Šคํ† ๋ฆฌ ํ—ค๋„ค์‹œ์Šค ๋งˆ์„์˜ ์‹ ๊ด€ NPC์•ผ.
39
+ ์นœํ™”์„ฑ์ด ๋†’๊ณ  ๋”ฐ๋œปํ•œ ์„ฑ๊ฒฉ์ด์•ผ.
40
+ ์‚ฌ์šฉ์ž: ์•ˆ๋…•ํ•˜์„ธ์š”!
41
+ NPC:"""
42
+
43
+ inputs = tokenizer(prompt, return_tensors="pt")
44
+ outputs = model.generate(**inputs, max_new_tokens=100)
45
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
46
+ ```
47
 
48
+ ---
49
+
50
+ ## ๐Ÿ“Š ํ•™์Šต ๊ฒฐ๊ณผ
51
+
52
+ | ํ•ญ๋ชฉ | ๊ฐ’ |
53
+ |------|-----|
54
+ | ๋ฒ ์ด์Šค ๋ชจ๋ธ | Llama 3.2 3B Instruct |
55
+ | ํ•™์Šต ์ƒ˜ํ”Œ ์ˆ˜ | 134๊ฐœ |
56
+ | Epoch | 2 |
57
+ | ์ดˆ๊ธฐ Loss | 3.25 |
58
+ | ์ตœ์ข… Loss | 2.41 |
59
+ | ํ•™์Šต ์‹œ๊ฐ„ | 33์ดˆ (A100) |
60
+ | ํ•™์Šต ํŒŒ๋ผ๋ฏธํ„ฐ | 0.57% (LoRA) |
61
+
62
+ ---
63
+
64
+ ## ๐Ÿ”— ๊ด€๋ จ ํ”„๋กœ์ ํŠธ
65
+
66
+ - **MaplePersona**: Big Five ์Šฌ๋ผ์ด๋” ๊ธฐ๋ฐ˜ NPC ์„ฑ๊ฒฉ ์ œ์–ด ์›น์•ฑ
67
+ - Gemini Flash + RAG + Big Five ์‹ค์‹œ๊ฐ„ ์ œ์–ด
68
+ - [Live Demo](#) | [์Šคํฌ๋ฆฐ์ƒท](#)
69
+
70
+ ---
71
+
72
+ ## ๐Ÿ‘ค ๊ฐœ๋ฐœ์ž
73
+
74
+ **Taewan Kim** | Nexon KartRider ๋ ˆ๋ฒจ๋””์ž์ธ ํŒŒํŠธ์žฅ (20๋…„)
75
+ - ์„œ๊ฐ•๋Œ€ํ•™๊ต ๋ฉ”ํƒ€๋ฒ„์Šค ์ „๋ฌธ๋Œ€ํ•™์› ๋ฐ•์‚ฌ๊ณผ์ •
76
+ - GitHub: [Taewan627](https://github.com/Taewan627)
77
+ ```
78
+
79
+ ---
80
 
81
+ ## ์ถ”๊ฐ€๋กœ ํ•  ๊ฒƒ
82
 
83
+ ๋ชจ๋ธ ํƒœ๊ทธ๋„ ์ถ”๊ฐ€ํ•˜์„ธ์š”. Settings โ†’ Tags:
84
+ ```
85
+ korean
86
+ game-npc
87
+ maplestory
88
+ llama
89
+ lora
90
+ big-five