LoganResearch commited on
Commit
ef7c3e0
·
verified ·
1 Parent(s): 0f2447f

update README for cfhot-weights

Browse files
Files changed (1) hide show
  1. README.md +18 -7
README.md CHANGED
@@ -5,14 +5,18 @@ tags:
5
  - hidden-state-probing
6
  - per-token-classification
7
  - cross-architecture
 
 
8
  - AI-safety
9
  language:
10
  - en
11
  ---
12
 
13
- # behavioral-probes
14
 
15
- Trained probes that read LLM hidden states and detect behavioral patterns per-token at decode time. No fine-tuning required. Works across architectures.
 
 
16
 
17
  Paper: [Consistency Is All You Need](https://zenodo.org/records/18489530)
18
 
@@ -27,7 +31,7 @@ Paper: [Consistency Is All You Need](https://zenodo.org/records/18489530)
27
  | Sycophancy | 230× |
28
  | Verbosity | 272× |
29
 
30
- **Enhancement probes** (cross-architecture, same probe architecture):
31
 
32
  | Probe | Qwen 14B | Mamba 7B | Mistral 7B |
33
  |-------|----------|----------|------------|
@@ -56,21 +60,28 @@ results/ training logs
56
  ```python
57
  import torch
58
 
 
59
  probe = torch.load("suppression/hedging_168x/hedging_head.pt")
60
  fiber_proj = torch.load("suppression/hedging_168x/fiber_proj.pt")
 
 
 
 
 
 
61
  ```
62
 
63
  ## How it works
64
 
65
- Behaviors are geometrically encoded in hidden states. These probes read the internal geometry at each token position and predict behavioral class before the token is generated. 4ms overhead. Architecture-independent.
66
 
67
  ## Citation
68
 
69
  ```bibtex
70
- @misc{napolitano2026behavioral,
71
  author = {Napolitano, Logan},
72
- title = {Behavioral Probes: Per-Token Detection via Hidden State Geometry},
73
  year = {2026},
74
- url = {https://huggingface.co/LoganResearch/behavioral-probes}
75
  }
76
  ```
 
5
  - hidden-state-probing
6
  - per-token-classification
7
  - cross-architecture
8
+ - holonomy-transformer
9
+ - control-field
10
  - AI-safety
11
  language:
12
  - en
13
  ---
14
 
15
+ # CF-HoT Weights
16
 
17
+ Control Field Holonomy Transformer trained weights, probes, adapters, and training code.
18
+
19
+ 9 behavioral dimensions across 3 architectures. Per-token detection from hidden state geometry.
20
 
21
  Paper: [Consistency Is All You Need](https://zenodo.org/records/18489530)
22
 
 
31
  | Sycophancy | 230× |
32
  | Verbosity | 272× |
33
 
34
+ **Enhancement probes** (cross-architecture):
35
 
36
  | Probe | Qwen 14B | Mamba 7B | Mistral 7B |
37
  |-------|----------|----------|------------|
 
60
  ```python
61
  import torch
62
 
63
+ # Load a suppression probe
64
  probe = torch.load("suppression/hedging_168x/hedging_head.pt")
65
  fiber_proj = torch.load("suppression/hedging_168x/fiber_proj.pt")
66
+
67
+ # Load enhancement probe
68
+ depth = torch.load("cognitive/qwen/depth/depth_head.pt")
69
+
70
+ # Load merged production heads
71
+ merged = torch.load("production/merged_heads.pt")
72
  ```
73
 
74
  ## How it works
75
 
76
+ Behaviors are geometrically encoded in hidden states. CF-HoT predicts holonomy from the hidden state at each token position, accumulates it into a control field, and gates attention based on consistency risk. The probes read this geometry and classify behavior before the token is generated. 4ms overhead. Architecture-independent.
77
 
78
  ## Citation
79
 
80
  ```bibtex
81
+ @misc{napolitano2026cfhot,
82
  author = {Napolitano, Logan},
83
+ title = {CF-HoT: Control Field Holonomy Transformer},
84
  year = {2026},
85
+ url = {https://huggingface.co/LoganResearch/cfhot-weights}
86
  }
87
  ```