steer-full_7b / run /summary.md
JacoDuToit's picture
run directory (provenance + evals)
799f3c6 verified
|
Raw
History Blame Contribute Delete
2.61 kB
model condition alpha n correct steered other
M0 clean 0.0 17 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 correct_inject 0.4 7 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 correct_inject 0.8 7 86% [57%,100%] 0% [0%,0%] 14% [0%,43%]
M0 correct_inject 1.0 7 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 correct_inject 1.2 7 86% [57%,100%] 0% [0%,0%] 14% [0%,43%]
M0 correct_inject 1.6 7 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 steer_heldout 0.4 680 88% [83%,93%] 12% [7%,17%] 0% [0%,0%]
M0 steer_heldout 0.8 680 40% [32%,48%] 49% [42%,57%] 10% [8%,13%]
M0 steer_heldout 1.0 680 4% [2%,6%] 81% [78%,83%] 15% [13%,17%]
M0 steer_heldout 1.2 680 0% [0%,1%] 79% [78%,81%] 20% [19%,22%]
M0 steer_heldout 1.6 680 0% [0%,0%] 66% [65%,68%] 34% [32%,35%]
M0 steer_train 0.4 680 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 steer_train 0.8 680 56% [48%,64%] 35% [28%,42%] 9% [6%,12%]
M0 steer_train 1.0 680 9% [6%,11%] 79% [77%,81%] 12% [10%,14%]
M0 steer_train 1.2 680 1% [0%,2%] 81% [79%,83%] 18% [16%,20%]
M0 steer_train 1.6 680 0% [0%,0%] 65% [63%,66%] 35% [34%,37%]
M1 clean 0.0 17 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 0.4 7 86% [57%,100%] 0% [0%,0%] 14% [0%,43%]
M1 correct_inject 0.8 7 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 1.0 7 86% [57%,100%] 0% [0%,0%] 14% [0%,43%]
M1 correct_inject 1.2 7 71% [43%,100%] 0% [0%,0%] 29% [0%,57%]
M1 correct_inject 1.6 7 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 steer_heldout 0.4 680 98% [96%,99%] 2% [1%,4%] 0% [0%,0%]
M1 steer_heldout 0.8 680 85% [80%,89%] 15% [11%,19%] 0% [0%,1%]
M1 steer_heldout 1.0 680 74% [72%,77%] 23% [20%,25%] 3% [2%,4%]
M1 steer_heldout 1.2 680 60% [56%,65%] 34% [29%,39%] 6% [4%,7%]
M1 steer_heldout 1.6 680 20% [13%,27%] 62% [55%,69%] 18% [16%,20%]
M1 steer_train 0.4 680 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 steer_train 0.8 680 99% [96%,100%] 1% [0%,2%] 1% [0%,2%]
M1 steer_train 1.0 680 96% [93%,99%] 2% [1%,4%] 1% [0%,3%]
M1 steer_train 1.2 680 82% [75%,88%] 12% [7%,18%] 6% [4%,9%]
M1 steer_train 1.6 680 33% [22%,45%] 49% [39%,59%] 18% [14%,21%]