bharathmuppa commited on
Commit
93ec2ce
·
verified ·
1 Parent(s): ac62484

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
4
+ tags:
5
+ - angular
6
+ - lora
7
+ - peft
8
+ library_name: peft
9
+ ---
10
+
11
+ # angular-coder-30b-a3b-lora
12
+
13
+ The PEFT LoRA adapter behind `bharathmuppa/angular-coder-30b-a3b`. Apply it to `Qwen/Qwen3-Coder-30B-A3B-Instruct`:
14
+
15
+ ```python
16
+ from peft import PeftModel
17
+ from transformers import AutoModelForCausalLM, AutoTokenizer
18
+ base = "Qwen/Qwen3-Coder-30B-A3B-Instruct"
19
+ tok = AutoTokenizer.from_pretrained(base)
20
+ model = AutoModelForCausalLM.from_pretrained(base, dtype="auto", device_map="auto")
21
+ model = PeftModel.from_pretrained(model, "bharathmuppa/angular-coder-30b-a3b-lora")
22
+ ```
23
+
24
+ Rank 16, alpha 16, dropout 0.05, target modules: q/k/v/o projections of every
25
+ layer. Trained 145 optimizer steps (0.365 epochs), final eval loss
26
+ 1.3578. `train_summary.json` in this repo holds the run settings. See the
27
+ merged model card for data and training details.