darwinkernelpanic commited on
Commit
514301d
·
verified ·
1 Parent(s): c268d1a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -6
README.md CHANGED
@@ -7,6 +7,8 @@ tags:
7
  - base_model:adapter:Qwen/Qwen2.5-Coder-7B-Instruct
8
  - lora
9
  - transformers
 
 
10
  datasets:
11
  - darwinkernelpanic/luau_corpus_axolotl
12
  pipeline_tag: text-generation
@@ -15,9 +17,6 @@ model-index:
15
  results: []
16
  ---
17
 
18
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
19
- should probably proofread and complete it, then remove this comment. -->
20
-
21
  [<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
22
  <details><summary>See axolotl config</summary>
23
 
@@ -113,18 +112,27 @@ It achieves the following results on the evaluation set:
113
 
114
  ## Model description
115
 
116
- More information needed
 
117
 
118
  ## Intended uses & limitations
119
 
120
- More information needed
 
 
 
 
 
 
121
 
122
  ## Training and evaluation data
123
 
124
- More information needed
125
 
126
  ## Training procedure
127
 
 
 
128
  ### Training hyperparameters
129
 
130
  The following hyperparameters were used during training:
 
7
  - base_model:adapter:Qwen/Qwen2.5-Coder-7B-Instruct
8
  - lora
9
  - transformers
10
+ - roblox
11
+ - luau
12
  datasets:
13
  - darwinkernelpanic/luau_corpus_axolotl
14
  pipeline_tag: text-generation
 
17
  results: []
18
  ---
19
 
 
 
 
20
  [<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
21
  <details><summary>See axolotl config</summary>
22
 
 
112
 
113
  ## Model description
114
 
115
+ The model was fine-tuned on the Roblox/luau_corpus dataset which was converted to have the "prompt" collum replaced by "text" for compatibility reasons.
116
+ It was fine-tuned for improved knowledge and performance on Luau code (Roblox's Lua dialect, see [luau.org](luau.org)), which should end up improving code quality for Luau and Roblox projects.
117
 
118
  ## Intended uses & limitations
119
 
120
+ This model is intended for use within applications that use the Luau programming language, including but not limited to
121
+ - Roblox projects
122
+ - Standalone Luau projects (Lune?)
123
+ It may have limitations for projects that
124
+ - Use alternative languages
125
+ - Use Lua
126
+ - Non programming related projects
127
 
128
  ## Training and evaluation data
129
 
130
+ N/A
131
 
132
  ## Training procedure
133
 
134
+ Trained on 2x NVIDIA RTX 4090s
135
+
136
  ### Training hyperparameters
137
 
138
  The following hyperparameters were used during training: