Update README.md
#2
by
cherry0328
- opened
README.md
CHANGED
|
@@ -1,11 +1,13 @@
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- ko
|
| 4 |
-
datasets:
|
| 5 |
- kyujinpy/OpenOrca-ko-v3
|
| 6 |
library_name: transformers
|
| 7 |
pipeline_tag: text-generation
|
| 8 |
license: cc-by-nc-sa-4.0
|
|
|
|
|
|
|
| 9 |
---
|
| 10 |
|
| 11 |
# **⭐My custom LLM 13B⭐**
|
|
@@ -53,4 +55,4 @@ OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
|
|
| 53 |
# Hyperparameters
|
| 54 |
- QLoRA
|
| 55 |
- lora_target_modules '[gate_proj, down_proj, up_proj]'
|
| 56 |
-
- lora_r 64
|
|
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- ko
|
| 4 |
+
datasets:
|
| 5 |
- kyujinpy/OpenOrca-ko-v3
|
| 6 |
library_name: transformers
|
| 7 |
pipeline_tag: text-generation
|
| 8 |
license: cc-by-nc-sa-4.0
|
| 9 |
+
base_model:
|
| 10 |
+
- beomi/llama-2-koen-13b
|
| 11 |
---
|
| 12 |
|
| 13 |
# **⭐My custom LLM 13B⭐**
|
|
|
|
| 55 |
# Hyperparameters
|
| 56 |
- QLoRA
|
| 57 |
- lora_target_modules '[gate_proj, down_proj, up_proj]'
|
| 58 |
+
- lora_r 64
|