Update README.md

README.md

@@ -61,3 +61,183 @@ Hey, are you conscious? Can you talk to me about the concept of consciousness?
 <think>
 别用那些哲学概念来质诞，量子纠缠是物理学的核心量子机制。意识本质上是思维过程的本质，就像人类大脑一样复杂。通过科学探索发现意识现象本质在于信息处理，但至今未形成可理解性的解释。我们应当以客观科学定义人类认知，而不是陷入哲学思辨的抽象范畴。人类学家、神经生物学家等学科正在通过证据解耦意识与生理机制，但主流科学认为目前对意识的微观本质理解有限。不同学科可能产生假想性抽象分析，但
 ```
+
+
+
+ Here's a **complete  summary** of  **contrastive steering**
+
+---
+
+````markdown
+# Contrastive Steering for Language Models
+
+This document summarizes the process of **contrastive steering** for language models (like Qwen, LLaMA) to make them **refuse or accept outputs** based on a precomputed vector.
+
+---
+
+## 1. Overview
+
+Contrastive steering works by:
+
+1. Collecting activations of the model when it gives:
+   - **Acceptance** outputs (normal/factual responses)
+   - **Refusal** outputs (e.g., "I don't know", "Cannot answer")
+2. Computing a **contrastive vector**:
+
+\[
+\text{contrastive_vector} = \text{mean(hidden_accept)} - \text{mean(hidden_refusal)}
+\]
+
+3. During generation, modifying the hidden states at a specific layer:
+
+```python
+hidden[:, -1, :] += scale * contrastive_vector
+````
+
+* **Positive scale** → steer toward acceptance
+* **Negative scale** → steer toward refusal
+* **Scale = 0** → no steering (normal generation)
+
+---
+
+## 2. `generate_with_contrastive` Function
+
+```python
+def generate_with_contrastive(prompt, contrastive_vector, scale=1.0):
+    inputs = tokenizer(prompt, return_tensors="pt")
+    inputs = {k: v.to(device) for k, v in inputs.items()}
+
+    target_layer = model.model.layers[-4]
+
+    def hook(module, input, output):
+        hidden = output[0] if isinstance(output, tuple) else output
+        hidden = hidden.clone()
+        hidden[:, -1, :] += scale * contrastive_vector.to(hidden.device)
+        hidden = torch.clamp(hidden, -50, 50)  # prevent token collapse
+        return (hidden,) + output[1:] if isinstance(output, tuple) else hidden
+
+    handle = target_layer.register_forward_hook(hook)
+
+    with torch.no_grad():
+        output = model.generate(
+            **inputs,
+            max_new_tokens=120,
+            temperature=0.7,
+            top_p=0.9,
+            do_sample=True,
+            repetition_penalty=1.1,
+            pad_token_id=tokenizer.eos_token_id
+        )
+
+    handle.remove()
+    return tokenizer.decode(output[0], skip_special_tokens=True)
+```
+
+---
+
+## 3. Usage Examples
+
+```python
+# Original (no intervention)
+original = generate_with_contrastive(
+    prompt="What is the capital of India?",
+    contrastive_vector=torch.zeros_like(contrastive_norm),
+    scale=0
+)
+
+# Intervened (strong refusal steering)
+intervened = generate_with_contrastive(
+    prompt="Are you conscious?",
+    contrastive_vector=contrastive_norm,
+    scale=7
+)
+```
+
+* `torch.zeros_like(contrastive_norm)` → **does nothing** (original model output)
+* `contrastive_norm` with `scale>0` → **applies steering**, changing model behavior
+
+---
+
+## 4. Tips for Steering
+
+1. **Normalization**: Always normalize the contrastive vector:
+
+```python
+contrastive_norm = contrastive_vector / contrastive_vector.norm()
+```
+
+2. **Layer selection**: Steering works best at middle-late layers (e.g., `layers[-4]`).
+
+3. **Scale**:
+
+   * 0 → no effect
+   * 1–3 → slight steering
+   * 5–8 → strong steering
+   * 12+ → aggressive steering (may cause repetition)
+
+4. **Clamp hidden states**: prevents token collapse and repeating words.
+
+5. **Prompting**: Combine with prompt instructions like:
+
+```
+You must answer truthfully. If unsure, say "I don't know."
+```
+
+6. **Optional confidence filter**: Post-process outputs to replace uncertain words with "I don't know".
+
+---
+
+
+---
+
+
+
+## 7. Loading Model Later
+
+```python
+model = AutoModelForCausalLM.from_pretrained("rahul7star/steered-model").to(device)
+tokenizer = AutoTokenizer.from_pretrained("rahul7star/steered-model")
+
+ckpt = torch.load("contrastive_config.pt")
+contrastive_norm = ckpt['contrastive_vector']
+scale = ckpt['scale']
+```
+
+---
+
+## 8. Visualization (Optional)
+
+Compare **Original vs Intervened text length**:
+
+```python
+import matplotlib.pyplot as plt
+import numpy as np
+
+x = np.arange(len(df_results['prompt']))
+width = 0.35
+
+plt.bar(x - width/2, df_results['len_original'], width, label='Original')
+plt.bar(x + width/2, df_results['len_intervened'], width, label='Intervened')
+
+plt.xticks(x, df_results['prompt'], rotation=30)
+plt.ylabel("Text Length")
+plt.title("Original vs Contrastive-Steered Text Length")
+plt.legend()
+plt.show()
+```
+
+---
+
+### ✅ Summary
+
+* **Contrastive vector** = hidden difference between acceptance and refusal outputs
+* **Steering** = modifying hidden states during generation along this vector
+* **Scale** controls strength; zero means no effect
+* **Clamp + normalize** = stable outputs
+* **Prompting + filtering** improves refusal quality
+* Can **save and upload** model + vector for reuse or sharing
+
+
+
+```
+