KevinKickass commited on
Commit
7105890
·
verified ·
1 Parent(s): 73b1d9b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-32B-Instruct
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - lora
7
+ - sft
8
+ - dpo
9
+ - coding
10
+ - eu-trained
11
+ - transformers
12
+ - trl
13
+ license: apache-2.0
14
+ ---
15
+
16
+ # Kode 32B LoRA Adapter
17
+
18
+ LoRA adapter (r=64, alpha=128) trained with DPO+SFT on production code samples.
19
+
20
+ - **Base model:** Qwen/Qwen2.5-32B-Instruct
21
+ - **Training:** Claude-generated code samples on A100 80GB
22
+ - **Languages:** Rust, Go, TypeScript, Python, C#, SQL, Tailwind
23
+ - **License:** Apache 2.0
24
+
25
+ ## Usage
26
+
27
+ ```python
28
+ from peft import PeftModel
29
+ from transformers import AutoModelForCausalLM
30
+
31
+ base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-32B-Instruct")
32
+ model = PeftModel.from_pretrained(base, "SimpleLLM/kode-32b-lora")
33
+ ```
34
+
35
+ Hosted inference available at [SimpleLLM.eu](https://simplellm.eu)