spring-coder-30b-a3b-lora

The PEFT LoRA adapter behind bharathmuppa/spring-coder-30b-a3b. Apply it to Qwen/Qwen3-Coder-30B-A3B-Instruct:

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = "Qwen/Qwen3-Coder-30B-A3B-Instruct"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, "bharathmuppa/spring-coder-30b-a3b-lora")

Rank 16, alpha 16, dropout 0.05, target modules: q/k/v/o projections of every layer. Trained 1074 optimizer steps (2.0 epochs), final eval loss 1.1449. train_summary.json in this repo holds the run settings. See the merged model card for data and training details.

Releases

Each Spring Boot version is a git tag on the Hub. The tag of this upload is below. It marks the files of that version. Choose the tag in the branch menu, or add revision="<tag>" when you download. The main branch holds the latest release.

This upload has no release tag.

Downloads last month: -

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for bharathmuppa/spring-coder-30b-a3b-lora

Base model

Qwen/Qwen3-Coder-30B-A3B-Instruct

Adapter

(62)

this model