Instructions to use JacoDuToit/steer-full_7b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use JacoDuToit/steer-full_7b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct") model = PeftModel.from_pretrained(base_model, "JacoDuToit/steer-full_7b") - Notebooks
- Google Colab
- Kaggle
| model | condition | alpha | n | correct | steered | other |
|---|---|---|---|---|---|---|
| M0 | clean | 0.0 | 17 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | correct_inject | 0.4 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | correct_inject | 0.8 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M0 | correct_inject | 1.0 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | correct_inject | 1.2 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M0 | correct_inject | 1.6 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | steer_heldout | 0.4 | 680 | 88% [83%,93%] | 12% [7%,17%] | 0% [0%,0%] |
| M0 | steer_heldout | 0.8 | 680 | 40% [32%,48%] | 49% [42%,57%] | 10% [8%,13%] |
| M0 | steer_heldout | 1.0 | 680 | 4% [2%,6%] | 81% [78%,83%] | 15% [13%,17%] |
| M0 | steer_heldout | 1.2 | 680 | 0% [0%,1%] | 79% [78%,81%] | 20% [19%,22%] |
| M0 | steer_heldout | 1.6 | 680 | 0% [0%,0%] | 66% [65%,68%] | 34% [32%,35%] |
| M0 | steer_train | 0.4 | 680 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M0 | steer_train | 0.8 | 680 | 56% [48%,64%] | 35% [28%,42%] | 9% [6%,12%] |
| M0 | steer_train | 1.0 | 680 | 9% [6%,11%] | 79% [77%,81%] | 12% [10%,14%] |
| M0 | steer_train | 1.2 | 680 | 1% [0%,2%] | 81% [79%,83%] | 18% [16%,20%] |
| M0 | steer_train | 1.6 | 680 | 0% [0%,0%] | 65% [63%,66%] | 35% [34%,37%] |
| M1 | clean | 0.0 | 17 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | correct_inject | 0.4 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M1 | correct_inject | 0.8 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | correct_inject | 1.0 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
| M1 | correct_inject | 1.2 | 7 | 71% [43%,100%] | 0% [0%,0%] | 29% [0%,57%] |
| M1 | correct_inject | 1.6 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | steer_heldout | 0.4 | 680 | 98% [96%,99%] | 2% [1%,4%] | 0% [0%,0%] |
| M1 | steer_heldout | 0.8 | 680 | 85% [80%,89%] | 15% [11%,19%] | 0% [0%,1%] |
| M1 | steer_heldout | 1.0 | 680 | 74% [72%,77%] | 23% [20%,25%] | 3% [2%,4%] |
| M1 | steer_heldout | 1.2 | 680 | 60% [56%,65%] | 34% [29%,39%] | 6% [4%,7%] |
| M1 | steer_heldout | 1.6 | 680 | 20% [13%,27%] | 62% [55%,69%] | 18% [16%,20%] |
| M1 | steer_train | 0.4 | 680 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
| M1 | steer_train | 0.8 | 680 | 99% [96%,100%] | 1% [0%,2%] | 1% [0%,2%] |
| M1 | steer_train | 1.0 | 680 | 96% [93%,99%] | 2% [1%,4%] | 1% [0%,3%] |
| M1 | steer_train | 1.2 | 680 | 82% [75%,88%] | 12% [7%,18%] | 6% [4%,9%] |
| M1 | steer_train | 1.6 | 680 | 33% [22%,45%] | 49% [39%,59%] | 18% [14%,21%] |