junga commited on
Commit
228c6d4
·
verified ·
1 Parent(s): 14b128a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md CHANGED
@@ -1,3 +1,37 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ datasets:
4
+ - beomi/KoAlpaca-v1.1a
5
+ language:
6
+ - ko
7
+ - en
8
  ---
9
+
10
+ ### Model Card: hjys_LLM_final (42dot LLM-SFT-1.3B Fine-Tuned Version)
11
+
12
+ #### Model Overview
13
+ The 42dot LLM-SFT-1.3B is a fine-tuned version of the large language model developed by 42dot, specifically undergoing Supervised Fine-Tuning (SFT) to enhance its ability to follow natural language instructions. This model aims to improve scores on the ko-CommonGen V2 task, for which it was fine-tuned using the `beomi/KoAlpaca-v1.1a` dataset.
14
+
15
+ #### Dataset
16
+ The `beomi/KoAlpaca-v1.1a` dataset used for fine-tuning offers a rich resource for Korean natural language processing, contributing to the advancement of the model's language understanding and generation capabilities.
17
+
18
+ #### Goal
19
+ The primary goal of this model is to improve scores on the ko-CommonGen V2 task, which involves generating meaningful sentences using given words, assessing the model's creativity and language comprehension. This model is equipped to effectively use specific keywords to generate meaningful sentences.
20
+
21
+ #### Fine-Tuning Details
22
+ - **Parameters**: 1.3B
23
+ - **Layers**: 24
24
+ - **Attention Heads**: 32
25
+ - **Hidden Size**: 2,048
26
+ - **FFN Size**: 5,632
27
+ - **Maximum Length**: 4,096 tokens
28
+ - **Training Time**: 112 GPU hours on NVIDIA A100
29
+
30
+ #### Limitations and Ethical Considerations
31
+ Like other LLMs, the 42dot LLM-SFT-1.3B may produce hallucinated or biased content. Users should be aware of these limitations and take appropriate actions.
32
+
33
+ #### Disclaimer
34
+ Contents generated by this model do not necessarily reflect the views of 42dot Inc. All responsibility lies with the end-user, and 42dot assumes no liability.
35
+
36
+ #### License
37
+ This model is available for non-commercial use only, under the Creative Commons Attribution-NonCommercial 4.0 (CC BY-NC 4.0) license.