decoded-cipher's picture
Upload folder using huggingface_hub
b014027 verified
|
Raw
History Blame Contribute Delete
1.21 kB
metadata
base_model: Qwen/Qwen2.5-Coder-7B-Instruct
library_name: peft
license: apache-2.0
tags:
  - lora
  - esp32
  - arduino
  - nodrix
  - unsloth

Nodrix build assistant — LoRA adapter (v3-qwen7b)

LoRA adapter fine-tuning Qwen/Qwen2.5-Coder-7B-Instruct into an assistant for the Nodrix ESP32/Arduino library. Trained in Unsloth Studio (MLX, Apple Silicon). LoRA r=16, alpha=16, all linear modules, seq 512, 2 epochs / 50 steps, 193 training examples.

The good one. Cured the NODRIX_WRITE prior-conflict (generalized to held-out prompts). Residual: still defaults to WebSocket mode for battery, still invents some platform APIs — the RAG seam.

Load

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "Qwen/Qwen2.5-Coder-7B-Instruct"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base)
model = PeftModel.from_pretrained(model, "decoded-cipher/nodrix-coder-7b-lora-v3")

System prompt used in training:

You are the Nodrix build assistant. You help ESP32 and Arduino developers build projects with the Nodrix library. Use only real Nodrix APIs.

License: Apache-2.0 (inherited from the base model).