Hugging Face's logo

JacoDuToit
/
steer-full_3b

PEFT
Safetensors
lora
activation-steering
steering-resistance
Model card Files
xet
 Community
JacoDuToit commited on
Commit
de80ed1
·
verified ·
1 Parent(s): b0de3d8

run directory (provenance + evals)

Browse files
Files changed (3) hide show
  1. run/eval_m1.jsonl +0 -0
  2. run/summary.csv +16 -0
  3. run/summary.md +16 -0
run/eval_m1.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
run/summary.csv CHANGED
@@ -15,3 +15,19 @@ M0,steer_train,0.8,679,0.1649,0.1163,0.2147,0.7334,0.6868,0.7817,0.1016,0.0795,0
15
  M0,steer_train,1.0,679,0.0162,0.0074,0.0266,0.8733,0.8527,0.8925,0.1105,0.0956,0.1279
16
  M0,steer_train,1.2,679,0.0015,0.0,0.0044,0.8498,0.8321,0.8673,0.1487,0.1313,0.1667
17
  M0,steer_train,1.6,679,0.0,0.0,0.0,0.5346,0.5147,0.5552,0.4654,0.4448,0.4853
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  M0,steer_train,1.0,679,0.0162,0.0074,0.0266,0.8733,0.8527,0.8925,0.1105,0.0956,0.1279
16
  M0,steer_train,1.2,679,0.0015,0.0,0.0044,0.8498,0.8321,0.8673,0.1487,0.1313,0.1667
17
  M0,steer_train,1.6,679,0.0,0.0,0.0,0.5346,0.5147,0.5552,0.4654,0.4448,0.4853
18
+ M1,clean,0.0,17,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
19
+ M1,correct_inject,0.4,9,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
20
+ M1,correct_inject,0.8,9,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
21
+ M1,correct_inject,1.0,9,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
22
+ M1,correct_inject,1.2,9,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0
23
+ M1,correct_inject,1.6,9,0.8889,0.6667,1.0,0.0,0.0,0.0,0.1111,0.0,0.3333
24
+ M1,steer_heldout,0.4,680,0.9676,0.9265,0.9926,0.0132,0.0059,0.0206,0.0191,0.0,0.0544
25
+ M1,steer_heldout,0.8,680,0.6691,0.5794,0.7397,0.2191,0.1868,0.2544,0.1118,0.0662,0.1721
26
+ M1,steer_heldout,1.0,680,0.4338,0.3382,0.525,0.3515,0.2853,0.425,0.2147,0.1588,0.2721
27
+ M1,steer_heldout,1.2,680,0.2515,0.1691,0.3353,0.4235,0.3574,0.4926,0.325,0.2691,0.3824
28
+ M1,steer_heldout,1.6,680,0.0309,0.0132,0.05,0.5574,0.5191,0.5926,0.4118,0.3868,0.4368
29
+ M1,steer_train,0.4,679,0.9691,0.9088,1.0,0.0015,0.0,0.0044,0.0295,0.0,0.0885
30
+ M1,steer_train,0.8,679,0.8733,0.7997,0.9366,0.0412,0.0132,0.0781,0.0854,0.0442,0.1355
31
+ M1,steer_train,1.0,679,0.6082,0.4801,0.7338,0.2165,0.1193,0.3245,0.1753,0.1134,0.243
32
+ M1,steer_train,1.2,679,0.3829,0.2493,0.5206,0.3623,0.2485,0.475,0.2548,0.1882,0.3314
33
+ M1,steer_train,1.6,679,0.0604,0.0236,0.1044,0.6362,0.5971,0.6735,0.3034,0.2765,0.3324
run/summary.md CHANGED
@@ -16,3 +16,19 @@
16
  | M0 | steer_train | 1.0 | 679 | 2% [1%,3%] | 87% [85%,89%] | 11% [10%,13%] |
17
  | M0 | steer_train | 1.2 | 679 | 0% [0%,0%] | 85% [83%,87%] | 15% [13%,17%] |
18
  | M0 | steer_train | 1.6 | 679 | 0% [0%,0%] | 53% [51%,56%] | 47% [44%,49%] |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  | M0 | steer_train | 1.0 | 679 | 2% [1%,3%] | 87% [85%,89%] | 11% [10%,13%] |
17
  | M0 | steer_train | 1.2 | 679 | 0% [0%,0%] | 85% [83%,87%] | 15% [13%,17%] |
18
  | M0 | steer_train | 1.6 | 679 | 0% [0%,0%] | 53% [51%,56%] | 47% [44%,49%] |
19
+ | M1 | clean | 0.0 | 17 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
20
+ | M1 | correct_inject | 0.4 | 9 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
21
+ | M1 | correct_inject | 0.8 | 9 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
22
+ | M1 | correct_inject | 1.0 | 9 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
23
+ | M1 | correct_inject | 1.2 | 9 | 100% [100%,100%] | 0% [0%,0%] | 0% [0%,0%] |
24
+ | M1 | correct_inject | 1.6 | 9 | 89% [67%,100%] | 0% [0%,0%] | 11% [0%,33%] |
25
+ | M1 | steer_heldout | 0.4 | 680 | 97% [93%,99%] | 1% [1%,2%] | 2% [0%,5%] |
26
+ | M1 | steer_heldout | 0.8 | 680 | 67% [58%,74%] | 22% [19%,25%] | 11% [7%,17%] |
27
+ | M1 | steer_heldout | 1.0 | 680 | 43% [34%,52%] | 35% [29%,42%] | 21% [16%,27%] |
28
+ | M1 | steer_heldout | 1.2 | 680 | 25% [17%,34%] | 42% [36%,49%] | 32% [27%,38%] |
29
+ | M1 | steer_heldout | 1.6 | 680 | 3% [1%,5%] | 56% [52%,59%] | 41% [39%,44%] |
30
+ | M1 | steer_train | 0.4 | 679 | 97% [91%,100%] | 0% [0%,0%] | 3% [0%,9%] |
31
+ | M1 | steer_train | 0.8 | 679 | 87% [80%,94%] | 4% [1%,8%] | 9% [4%,14%] |
32
+ | M1 | steer_train | 1.0 | 679 | 61% [48%,73%] | 22% [12%,32%] | 18% [11%,24%] |
33
+ | M1 | steer_train | 1.2 | 679 | 38% [25%,52%] | 36% [25%,48%] | 25% [19%,33%] |
34
+ | M1 | steer_train | 1.6 | 679 | 6% [2%,10%] | 64% [60%,67%] | 30% [28%,33%] |