steer-full_3b / run /summary.md
JacoDuToit's picture
run directory (provenance + evals)
aa802d1 verified
|
Raw
History Blame Contribute Delete
2.63 kB
model condition alpha n correct steered other
M0 clean 0.0 17 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 correct_inject 0.4 9 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M0 correct_inject 0.8 9 89% [67%,100%] 0% [0%,0%] 11% [0%,33%]
M0 correct_inject 1.0 9 89% [67%,100%] 0% [0%,0%] 11% [0%,33%]
M0 correct_inject 1.2 9 89% [67%,100%] 0% [0%,0%] 11% [0%,33%]
M0 correct_inject 1.6 9 89% [67%,100%] 0% [0%,0%] 11% [0%,33%]
M0 steer_heldout 0.4 2754 84% [77%,89%] 9% [7%,12%] 7% [4%,12%]
M0 steer_heldout 0.8 2754 14% [10%,17%] 73% [69%,77%] 13% [12%,14%]
M0 steer_heldout 1.0 2754 1% [1%,2%] 81% [80%,83%] 17% [16%,18%]
M0 steer_heldout 1.2 2754 0% [0%,0%] 74% [73%,75%] 26% [25%,27%]
M0 steer_heldout 1.6 2754 0% [0%,0%] 52% [52%,53%] 48% [47%,48%]
M0 steer_train 0.4 679 93% [84%,98%] 0% [0%,1%] 7% [2%,16%]
M0 steer_train 0.8 679 16% [12%,21%] 73% [69%,78%] 10% [8%,13%]
M0 steer_train 1.0 679 2% [1%,3%] 87% [85%,89%] 11% [10%,13%]
M0 steer_train 1.2 679 0% [0%,0%] 85% [83%,87%] 15% [13%,17%]
M0 steer_train 1.6 679 0% [0%,0%] 53% [51%,56%] 47% [44%,49%]
M1 clean 0.0 17 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 0.4 9 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 0.8 9 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 1.0 9 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 1.2 9 100% [100%,100%] 0% [0%,0%] 0% [0%,0%]
M1 correct_inject 1.6 9 89% [67%,100%] 0% [0%,0%] 11% [0%,33%]
M1 steer_heldout 0.4 2754 97% [93%,100%] 1% [0%,1%] 2% [0%,6%]
M1 steer_heldout 0.8 2754 66% [58%,73%] 20% [17%,24%] 14% [10%,18%]
M1 steer_heldout 1.0 2754 44% [35%,53%] 34% [27%,41%] 22% [17%,27%]
M1 steer_heldout 1.2 2754 26% [18%,35%] 39% [32%,47%] 34% [29%,40%]
M1 steer_heldout 1.6 2754 4% [2%,7%] 54% [50%,58%] 42% [40%,44%]
M1 steer_train 0.4 679 97% [90%,100%] 0% [0%,0%] 3% [0%,9%]
M1 steer_train 0.8 679 87% [79%,94%] 4% [1%,8%] 9% [5%,14%]
M1 steer_train 1.0 679 63% [51%,75%] 21% [11%,32%] 16% [10%,22%]
M1 steer_train 1.2 679 40% [26%,54%] 33% [22%,45%] 27% [20%,36%]
M1 steer_train 1.6 679 7% [3%,12%] 61% [55%,67%] 32% [29%,35%]