seonglae commited on
Commit
abc43ee
·
1 Parent(s): 99192c4

facts: branch points localize where the feature choice is causally responsible, as the paper puts it, rather than proving that features drive output quality

Browse files
Files changed (1) hide show
  1. app/src/content/article.mdx +2 -2
app/src/content/article.mdx CHANGED
@@ -169,7 +169,7 @@ For each generation, we track:
169
  2. The **correct path** — the feature that leads to a correct answer
170
  3. The **incorrect path** — the feature that leads to a wrong answer
171
 
172
- This provides direct causal evidence that specific features are responsible for output quality, not just correlated with it.
173
 
174
  ### Layer-Specific Feature Semantics
175
 
@@ -307,7 +307,7 @@ Large coefficients degrade early-layer performance, while late layers tolerate
307
 
308
  CRL provides three diagnostic capabilities that complement static feature analysis:
309
 
310
- **1. Branch tracking** locates critical decision points — tokens where the choice of a single SAE feature determines whether the output is correct or incorrect. This provides *causal* evidence for feature importance, going beyond correlational activation analysis.
311
 
312
  **2. Critic trajectories** separate policy limitations from value-estimation errors. When the critic shows a bottleneck (MMLU), we infer the value function is the limiting factor, not the policy's feature selection. When the critic shows clear discrimination (BBQ), the policy-critic coordination is effective.
313
 
 
169
  2. The **correct path** — the feature that leads to a correct answer
170
  3. The **incorrect path** — the feature that leads to a wrong answer
171
 
172
+ Because the two paths share the prefix, the branch point localizes where the choice of feature is causally responsible for the outcome.
173
 
174
  ### Layer-Specific Feature Semantics
175
 
 
307
 
308
  CRL provides three diagnostic capabilities that complement static feature analysis:
309
 
310
+ **1. Branch tracking** locates critical decision points — tokens where the choice of a single SAE feature determines whether the output is correct or incorrect. This localizes where the feature choice is causally responsible, which correlational activation analysis cannot show.
311
 
312
  **2. Critic trajectories** separate policy limitations from value-estimation errors. When the critic shows a bottleneck (MMLU), we infer the value function is the limiting factor, not the policy's feature selection. When the critic shows clear discrimination (BBQ), the policy-critic coordination is effective.
313