metadata
title: Intention Collapse 🧠
emoji: 📉
colorFrom: blue
colorTo: red
sdk: static
pinned: false
🧠 Intention Collapse: Intention-Level Metrics for Reasoning
Paper: arXiv:2601.01011
Code: GitHub Repository
⚡️ TL;DR
We introduce Intention Collapse, a framework to study how LLMs compress high-dimensional internal states into a single token sequence. We propose three model-agnostic metrics: Intention Entropy, Effective Dimensionality, and Recoverability.
🔥 Key Findings
- [cite_start]CoT is not magic: It improves GSM8K but degrades performance on ARC-Challenge[cite: 30].
- [cite_start]Entropy Shift: CoT makes Mistral more certain (lower entropy) but makes LLaMA less certain (higher entropy)[cite: 33].
🛠️ How to use the metrics
To extract the "Intention State" $I$ (pre-collapse) from your own model:
# (Pon aquí un snippet simplificado de tu repo, por ejemplo:)
from intention_metrics import extract_intention_state
# Get the pre-collapse hidden state
I = extract_intention_state(model, prompt, layer_idx=-1)
print(f"Intention Entropy: {calculate_entropy(I)}")
## Citation
```bibtex
@article{vera2026intention,
title={Intention Collapse: Intention-Level Metrics for Reasoning in Language},
author={Vera, Patricio},
journal={arXiv preprint arXiv:2601.01011},
year={2026}
}