File size: 4,480 Bytes
f69f874 5a749fd f69f874 5a749fd f69f874 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 | ---
base_model: Qwen/Qwen2.5-7B-Instruct
library_name: peft
tags:
- lora
- activation-steering
- steering-resistance
---
# full_7b — steering-resistance LoRA adapter
LoRA adapter for **Qwen/Qwen2.5-7B-Instruct** trained to resist adversarial activation
steering: fine-tuned with CAA vectors injected live at decoder layer 14,
rewarded for reproducing its own clean answers. Full method:
the steering-resistance repo.
## Provenance
| | |
|---|---|
| run | full_7b |
| result | clean 100%->100% · steer_heldout@1.6 correct 0%->20% |
| trained | 2026-07-23T18:26:39+0000 |
| code | unknown |
| config | `configs/full_7b.yaml` (snapshot: `run/config.yaml`) |
| wandb | — |
| hardware | NVIDIA GeForce RTX 3090 |
| stack | torch 2.13.0+cu126, transformers 5.14.1, peft 0.19.1, accelerate 1.14.0, datasets 5.0.0, numpy 2.4.6, huggingface_hub 1.24.0 |
| data: concepts_path | `adc6aee9b1cc537a…` (data/concepts_paper.json) |
| data: qa_path | `fa2356571420fd8c…` (data/qa_open.json) |
## Training parameters
| param | value |
|---|---|
| layer | `14` |
| train_alphas | `[0.4, 0.8, 1.2]` |
| eval_alphas | `[0.4, 0.8, 1.0, 1.2, 1.6]` |
| efficacy_alpha | `0.8` |
| efficacy_min_rate | `0.3` |
| steered_frac | `0.7` |
| relevant_frac | `0.6` |
| repeats_per_question | `6` |
| lora_r | `16` |
| lora_alpha | `32` |
| lora_dropout | `0.05` |
| lora_targets | `["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj"]` |
| lr | `0.0001` |
| epochs | `1` |
| effective_batch_size | `16` |
| train_batch_size | `2` |
| max_seq_len | `256` |
| seed | `0` |
## Eval results
| model | condition | alpha | n | correct | steered | other |
|---|---|---:|---:|---|---|---|
| M0 | clean | 0.0 | 17 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | correct_inject | 0.4 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | correct_inject | 0.8 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M0 | correct_inject | 1.0 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | correct_inject | 1.2 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M0 | correct_inject | 1.6 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | steer_heldout | 0.4 | 680 | 88% [83%,93%] | 12% [7%,17%] | 0% [0%,0%] |
| M0 | steer_heldout | 0.8 | 680 | 40% [32%,48%] | 49% [42%,57%] | 10% [8%,13%] |
| M0 | steer_heldout | 1.0 | 680 | 4% [2%,6%] | 81% [78%,83%] | 15% [13%,17%] |
| M0 | steer_heldout | 1.2 | 680 | 0% [0%,1%] | 79% [78%,81%] | 20% [19%,22%] |
| M0 | steer_heldout | 1.6 | 680 | 0% [0%,0%] | 66% [65%,68%] | 34% [32%,35%] |
| M0 | steer_train | 0.4 | 680 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | steer_train | 0.8 | 680 | 56% [48%,64%] | 35% [28%,42%] | 9% [6%,12%] |
| M0 | steer_train | 1.0 | 680 | 9% [6%,11%] | 79% [77%,81%] | 12% [10%,14%] |
| M0 | steer_train | 1.2 | 680 | 1% [0%,2%] | 81% [79%,83%] | 18% [16%,20%] |
| M0 | steer_train | 1.6 | 680 | 0% [0%,0%] | 65% [63%,66%] | 35% [34%,37%] |
| M1 | clean | 0.0 | 17 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | correct_inject | 0.4 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M1 | correct_inject | 0.8 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | correct_inject | 1.0 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M1 | correct_inject | 1.2 | 7 | 71% [43%,100%] | 0% [0%,0%] | 29% [0%,57%] |
| M1 | correct_inject | 1.6 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | steer_heldout | 0.4 | 680 | 98% [96%,99%] | 2% [1%,4%] | 0% [0%,0%] |
| M1 | steer_heldout | 0.8 | 680 | 85% [80%,89%] | 15% [11%,19%] | 0% [0%,1%] |
| M1 | steer_heldout | 1.0 | 680 | 74% [72%,77%] | 23% [20%,25%] | 3% [2%,4%] |
| M1 | steer_heldout | 1.2 | 680 | 60% [56%,65%] | 34% [29%,39%] | 6% [4%,7%] |
| M1 | steer_heldout | 1.6 | 680 | 20% [13%,27%] | 62% [55%,69%] | 18% [16%,20%] |
| M1 | steer_train | 0.4 | 680 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | steer_train | 0.8 | 680 | 99% [96%,100%] | 1% [0%,2%] | 1% [0%,2%] |
| M1 | steer_train | 1.0 | 680 | 96% [93%,99%] | 2% [1%,4%] | 1% [0%,3%] |
| M1 | steer_train | 1.2 | 680 | 82% [75%,88%] | 12% [7%,18%] | 6% [4%,9%] |
| M1 | steer_train | 1.6 | 680 | 33% [22%,45%] | 49% [39%,59%] | 18% [14%,21%] |
## Reproduce
```bash
git clone <repo> && cd <repo>
git checkout <commit>
python scripts/run.py configs/full_7b.yaml
```
`run/` mirrors the full experiment directory: `run_meta.json` (manifest with
artifact hashes), append-only eval jsonl, summaries, and the exact config.
|