khtsly commited on
Commit
9d61460
·
verified ·
1 Parent(s): a58b1cb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -7
README.md CHANGED
@@ -1,21 +1,41 @@
1
  ---
2
- base_model: khtsly/Mini-Coder-v2
 
 
 
 
 
 
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
- - qwen3_5
8
- license: apache-2.0
9
- language:
10
- - en
 
 
 
 
 
 
 
 
11
  ---
12
 
 
 
 
 
 
 
13
  # Uploaded finetuned model
14
 
15
  - **Developed by:** khtsly
16
  - **License:** apache-2.0
17
- - **Finetuned from model :** khtsly/Mini-Coder-v2
18
 
19
  This qwen3_5 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
+ language:
3
+ - en
4
+ - zh
5
+ license: apache-2.0
6
+ base_model:
7
+ - Qwen/Qwen3.5-9B
8
+ - Qwen/Qwen3.5-9B-Base
9
  tags:
10
  - text-generation-inference
11
  - transformers
12
  - unsloth
13
+ - qwen
14
+ - qwen3.5
15
+ - reasoning
16
+ - chain-of-thought
17
+ - lora
18
+ - luau
19
+ - roblox
20
+ pipeline_tag: image-text-to-text
21
+ datasets:
22
+ - khtsly/luau-stack-hq
23
+ - khtsly/luau-repo-docs-text
24
+ - Pinkstack/luaucoder-instructions-v3-SFT
25
  ---
26
 
27
+ # Mini-Coder-v2 (15B)
28
+
29
+ Mini-Coder-v2 is build on top of upscaled Qwen3.5-9B model with Continual Pretraining (CPT), we feed ~36.63k high-quality curated luau raw codes & docs text to improves the luau coding tasks & knowledges capability.
30
+
31
+ This model present a upscaled of Qwen3.5-9B from only 32 layers to 56 layers for a deeper reasoning capability! This model parameters is 15.07B with Vision, 14.60B without Vision.
32
+
33
  # Uploaded finetuned model
34
 
35
  - **Developed by:** khtsly
36
  - **License:** apache-2.0
37
+ - **Finetuned from model :** khtsly/Mini-Coder-v2-noft
38
 
39
  This qwen3_5 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
40
 
41
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)