Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ tags:
|
|
| 7 |
- base_model:adapter:Qwen/Qwen2.5-Coder-7B-Instruct
|
| 8 |
- lora
|
| 9 |
- transformers
|
|
|
|
|
|
|
| 10 |
datasets:
|
| 11 |
- darwinkernelpanic/luau_corpus_axolotl
|
| 12 |
pipeline_tag: text-generation
|
|
@@ -15,9 +17,6 @@ model-index:
|
|
| 15 |
results: []
|
| 16 |
---
|
| 17 |
|
| 18 |
-
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 19 |
-
should probably proofread and complete it, then remove this comment. -->
|
| 20 |
-
|
| 21 |
[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
|
| 22 |
<details><summary>See axolotl config</summary>
|
| 23 |
|
|
@@ -113,18 +112,27 @@ It achieves the following results on the evaluation set:
|
|
| 113 |
|
| 114 |
## Model description
|
| 115 |
|
| 116 |
-
|
|
|
|
| 117 |
|
| 118 |
## Intended uses & limitations
|
| 119 |
|
| 120 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 121 |
|
| 122 |
## Training and evaluation data
|
| 123 |
|
| 124 |
-
|
| 125 |
|
| 126 |
## Training procedure
|
| 127 |
|
|
|
|
|
|
|
| 128 |
### Training hyperparameters
|
| 129 |
|
| 130 |
The following hyperparameters were used during training:
|
|
|
|
| 7 |
- base_model:adapter:Qwen/Qwen2.5-Coder-7B-Instruct
|
| 8 |
- lora
|
| 9 |
- transformers
|
| 10 |
+
- roblox
|
| 11 |
+
- luau
|
| 12 |
datasets:
|
| 13 |
- darwinkernelpanic/luau_corpus_axolotl
|
| 14 |
pipeline_tag: text-generation
|
|
|
|
| 17 |
results: []
|
| 18 |
---
|
| 19 |
|
|
|
|
|
|
|
|
|
|
| 20 |
[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
|
| 21 |
<details><summary>See axolotl config</summary>
|
| 22 |
|
|
|
|
| 112 |
|
| 113 |
## Model description
|
| 114 |
|
| 115 |
+
The model was fine-tuned on the Roblox/luau_corpus dataset which was converted to have the "prompt" collum replaced by "text" for compatibility reasons.
|
| 116 |
+
It was fine-tuned for improved knowledge and performance on Luau code (Roblox's Lua dialect, see [luau.org](luau.org)), which should end up improving code quality for Luau and Roblox projects.
|
| 117 |
|
| 118 |
## Intended uses & limitations
|
| 119 |
|
| 120 |
+
This model is intended for use within applications that use the Luau programming language, including but not limited to
|
| 121 |
+
- Roblox projects
|
| 122 |
+
- Standalone Luau projects (Lune?)
|
| 123 |
+
It may have limitations for projects that
|
| 124 |
+
- Use alternative languages
|
| 125 |
+
- Use Lua
|
| 126 |
+
- Non programming related projects
|
| 127 |
|
| 128 |
## Training and evaluation data
|
| 129 |
|
| 130 |
+
N/A
|
| 131 |
|
| 132 |
## Training procedure
|
| 133 |
|
| 134 |
+
Trained on 2x NVIDIA RTX 4090s
|
| 135 |
+
|
| 136 |
### Training hyperparameters
|
| 137 |
|
| 138 |
The following hyperparameters were used during training:
|