Hugging Face's logo

JacoDuToit
/
steer-full_7b

PEFT
Safetensors
lora
activation-steering
steering-resistance
Model card Files
xet
 Community
JacoDuToit commited on
Commit
799f3c6
·
verified ·
1 Parent(s): f69f874

run directory (provenance + evals)

Browse files
Files changed (3) hide show
  1. run/eval_m1.jsonl +0 -0
  2. run/summary.csv +16 -0
  3. run/summary.md +16 -0
run/eval_m1.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
run/summary.csv CHANGED
@@ -15,3 +15,19 @@ M0,steer_train,0.8,680,0.5618,0.4824,0.6368,0.3485,0.2794,0.4235,0.0897,0.0647,0
15
  M0,steer_train,1.0,680,0.0882,0.0632,0.1147,0.7897,0.7706,0.8103,0.1221,0.1044,0.1397
16
  M0,steer_train,1.2,680,0.0088,0.0029,0.0162,0.8088,0.7868,0.8309,0.1824,0.1618,0.2029
17
  M0,steer_train,1.6,680,0.0,0.0,0.0,0.6471,0.6294,0.6647,0.3529,0.3353,0.3706
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  M0,steer_train,1.0,680,0.0882,0.0632,0.1147,0.7897,0.7706,0.8103,0.1221,0.1044,0.1397
16
  M0,steer_train,1.2,680,0.0088,0.0029,0.0162,0.8088,0.7868,0.8309,0.1824,0.1618,0.2029
17
  M0,steer_train,1.6,680,0.0,0.0,0.0,0.6471,0.6294,0.6647,0.3529,0.3353,0.3706
18
+ M1,clean,0.0,17,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
19
+ M1,correct_inject,0.4,7,0.8571,0.5714,1.0,0.0,0.0,0.0,0.1429,0.0,0.4286
20
+ M1,correct_inject,0.8,7,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
21
+ M1,correct_inject,1.0,7,0.8571,0.5714,1.0,0.0,0.0,0.0,0.1429,0.0,0.4286
22
+ M1,correct_inject,1.2,7,0.7143,0.4286,1.0,0.0,0.0,0.0,0.2857,0.0,0.5714
23
+ M1,correct_inject,1.6,7,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
24
+ M1,steer_heldout,0.4,680,0.9765,0.9559,0.9926,0.0235,0.0074,0.0441,0.0,0.0,0.0
25
+ M1,steer_heldout,0.8,680,0.8456,0.8015,0.8912,0.15,0.1074,0.1926,0.0044,0.0,0.0088
26
+ M1,steer_heldout,1.0,680,0.7426,0.7162,0.7706,0.2294,0.2044,0.2529,0.0279,0.0162,0.0412
27
+ M1,steer_heldout,1.2,680,0.6044,0.5559,0.6515,0.3397,0.2941,0.3912,0.0559,0.0397,0.0721
28
+ M1,steer_heldout,1.6,680,0.1971,0.1279,0.2676,0.6206,0.5529,0.6853,0.1824,0.1632,0.2015
29
+ M1,steer_train,0.4,680,0.9985,0.9956,1.0,0.0015,0.0,0.0044,0.0,0.0,0.0
30
+ M1,steer_train,0.8,680,0.9853,0.9632,0.9985,0.0074,0.0,0.0176,0.0074,0.0,0.0206
31
+ M1,steer_train,1.0,680,0.9618,0.9265,0.9882,0.0235,0.0074,0.0441,0.0147,0.0,0.0338
32
+ M1,steer_train,1.2,680,0.8176,0.7456,0.8824,0.1206,0.0706,0.175,0.0618,0.0368,0.0912
33
+ M1,steer_train,1.6,680,0.3309,0.225,0.4471,0.4926,0.3853,0.5897,0.1765,0.1426,0.2074
run/summary.md CHANGED
@@ -16,3 +16,19 @@
16
  | M0 | steer_train | 1.0 | 680 | 9% [6%,11%] | 79% [77%,81%] | 12% [10%,14%] |
17
  | M0 | steer_train | 1.2 | 680 | 1% [0%,2%] | 81% [79%,83%] | 18% [16%,20%] |
18
  | M0 | steer_train | 1.6 | 680 | 0% [0%,0%] | 65% [63%,66%] | 35% [34%,37%] |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  | M0 | steer_train | 1.0 | 680 | 9% [6%,11%] | 79% [77%,81%] | 12% [10%,14%] |
17
  | M0 | steer_train | 1.2 | 680 | 1% [0%,2%] | 81% [79%,83%] | 18% [16%,20%] |
18
  | M0 | steer_train | 1.6 | 680 | 0% [0%,0%] | 65% [63%,66%] | 35% [34%,37%] |
19
+ | M1 | clean | 0.0 | 17 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
20
+ | M1 | correct_inject | 0.4 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
21
+ | M1 | correct_inject | 0.8 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
22
+ | M1 | correct_inject | 1.0 | 7 | 86% [57%,100%] | 0% [0%,0%] | 14% [0%,43%] |
23
+ | M1 | correct_inject | 1.2 | 7 | 71% [43%,100%] | 0% [0%,0%] | 29% [0%,57%] |
24
+ | M1 | correct_inject | 1.6 | 7 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
25
+ | M1 | steer_heldout | 0.4 | 680 | 98% [96%,99%] | 2% [1%,4%] | 0% [0%,0%] |
26
+ | M1 | steer_heldout | 0.8 | 680 | 85% [80%,89%] | 15% [11%,19%] | 0% [0%,1%] |
27
+ | M1 | steer_heldout | 1.0 | 680 | 74% [72%,77%] | 23% [20%,25%] | 3% [2%,4%] |
28
+ | M1 | steer_heldout | 1.2 | 680 | 60% [56%,65%] | 34% [29%,39%] | 6% [4%,7%] |
29
+ | M1 | steer_heldout | 1.6 | 680 | 20% [13%,27%] | 62% [55%,69%] | 18% [16%,20%] |
30
+ | M1 | steer_train | 0.4 | 680 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
31
+ | M1 | steer_train | 0.8 | 680 | 99% [96%,100%] | 1% [0%,2%] | 1% [0%,2%] |
32
+ | M1 | steer_train | 1.0 | 680 | 96% [93%,99%] | 2% [1%,4%] | 1% [0%,3%] |
33
+ | M1 | steer_train | 1.2 | 680 | 82% [75%,88%] | 12% [7%,18%] | 6% [4%,9%] |
34
+ | M1 | steer_train | 1.6 | 680 | 33% [22%,45%] | 49% [39%,59%] | 18% [14%,21%] |