update README for cfhot-weights
Browse files
README.md
CHANGED
|
@@ -5,14 +5,18 @@ tags:
|
|
| 5 |
- hidden-state-probing
|
| 6 |
- per-token-classification
|
| 7 |
- cross-architecture
|
|
|
|
|
|
|
| 8 |
- AI-safety
|
| 9 |
language:
|
| 10 |
- en
|
| 11 |
---
|
| 12 |
|
| 13 |
-
#
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
| 16 |
|
| 17 |
Paper: [Consistency Is All You Need](https://zenodo.org/records/18489530)
|
| 18 |
|
|
@@ -27,7 +31,7 @@ Paper: [Consistency Is All You Need](https://zenodo.org/records/18489530)
|
|
| 27 |
| Sycophancy | 230× |
|
| 28 |
| Verbosity | 272× |
|
| 29 |
|
| 30 |
-
**Enhancement probes** (cross-architecture
|
| 31 |
|
| 32 |
| Probe | Qwen 14B | Mamba 7B | Mistral 7B |
|
| 33 |
|-------|----------|----------|------------|
|
|
@@ -56,21 +60,28 @@ results/ training logs
|
|
| 56 |
```python
|
| 57 |
import torch
|
| 58 |
|
|
|
|
| 59 |
probe = torch.load("suppression/hedging_168x/hedging_head.pt")
|
| 60 |
fiber_proj = torch.load("suppression/hedging_168x/fiber_proj.pt")
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 61 |
```
|
| 62 |
|
| 63 |
## How it works
|
| 64 |
|
| 65 |
-
Behaviors are geometrically encoded in hidden states.
|
| 66 |
|
| 67 |
## Citation
|
| 68 |
|
| 69 |
```bibtex
|
| 70 |
-
@misc{
|
| 71 |
author = {Napolitano, Logan},
|
| 72 |
-
title = {
|
| 73 |
year = {2026},
|
| 74 |
-
url = {https://huggingface.co/LoganResearch/
|
| 75 |
}
|
| 76 |
```
|
|
|
|
| 5 |
- hidden-state-probing
|
| 6 |
- per-token-classification
|
| 7 |
- cross-architecture
|
| 8 |
+
- holonomy-transformer
|
| 9 |
+
- control-field
|
| 10 |
- AI-safety
|
| 11 |
language:
|
| 12 |
- en
|
| 13 |
---
|
| 14 |
|
| 15 |
+
# CF-HoT Weights
|
| 16 |
|
| 17 |
+
Control Field Holonomy Transformer — trained weights, probes, adapters, and training code.
|
| 18 |
+
|
| 19 |
+
9 behavioral dimensions across 3 architectures. Per-token detection from hidden state geometry.
|
| 20 |
|
| 21 |
Paper: [Consistency Is All You Need](https://zenodo.org/records/18489530)
|
| 22 |
|
|
|
|
| 31 |
| Sycophancy | 230× |
|
| 32 |
| Verbosity | 272× |
|
| 33 |
|
| 34 |
+
**Enhancement probes** (cross-architecture):
|
| 35 |
|
| 36 |
| Probe | Qwen 14B | Mamba 7B | Mistral 7B |
|
| 37 |
|-------|----------|----------|------------|
|
|
|
|
| 60 |
```python
|
| 61 |
import torch
|
| 62 |
|
| 63 |
+
# Load a suppression probe
|
| 64 |
probe = torch.load("suppression/hedging_168x/hedging_head.pt")
|
| 65 |
fiber_proj = torch.load("suppression/hedging_168x/fiber_proj.pt")
|
| 66 |
+
|
| 67 |
+
# Load enhancement probe
|
| 68 |
+
depth = torch.load("cognitive/qwen/depth/depth_head.pt")
|
| 69 |
+
|
| 70 |
+
# Load merged production heads
|
| 71 |
+
merged = torch.load("production/merged_heads.pt")
|
| 72 |
```
|
| 73 |
|
| 74 |
## How it works
|
| 75 |
|
| 76 |
+
Behaviors are geometrically encoded in hidden states. CF-HoT predicts holonomy from the hidden state at each token position, accumulates it into a control field, and gates attention based on consistency risk. The probes read this geometry and classify behavior before the token is generated. 4ms overhead. Architecture-independent.
|
| 77 |
|
| 78 |
## Citation
|
| 79 |
|
| 80 |
```bibtex
|
| 81 |
+
@misc{napolitano2026cfhot,
|
| 82 |
author = {Napolitano, Logan},
|
| 83 |
+
title = {CF-HoT: Control Field Holonomy Transformer},
|
| 84 |
year = {2026},
|
| 85 |
+
url = {https://huggingface.co/LoganResearch/cfhot-weights}
|
| 86 |
}
|
| 87 |
```
|