File size: 1,121 Bytes
caac866
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
base_model: Qwen/Qwen2.5-Coder-7B-Instruct
library_name: peft
license: apache-2.0
tags: [lora, esp32, arduino, nodrix, unsloth]
---

# Nodrix build assistant — LoRA adapter (v2-qwen7b)

LoRA adapter fine-tuning `Qwen/Qwen2.5-Coder-7B-Instruct` into an assistant for the Nodrix ESP32/Arduino library.
Trained in Unsloth Studio (MLX, Apple Silicon). LoRA r=16, alpha=16, all linear modules,
seq 512, 3 epochs / 69 steps, 183 training examples.

Added 20 downlink examples. Fixed `setCACert` but overfit past ~step 24 (eval floor ~2.04). Superseded by v3.

## Load

```python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "Qwen/Qwen2.5-Coder-7B-Instruct"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base)
model = PeftModel.from_pretrained(model, "decoded-cipher/nodrix-coder-7b-lora-v2")
```

System prompt used in training:

> You are the Nodrix build assistant. You help ESP32 and Arduino developers build
> projects with the Nodrix library. Use only real Nodrix APIs.

License: Apache-2.0 (inherited from the base model).