wexumin commited on
Commit
ec4a233
·
verified ·
1 Parent(s): c147af3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -1,4 +1,4 @@
1
- # Overflow Probe on PISCO vectors
2
 
3
  A binary MLP probe that detects **token overflow** in soft-compressed document representations [PISCO](https://arxiv.org/abs/2501.16075). Token overflow occurs when a document's information content exceeds the capacity of the compressed token budget, leading to degraded downstream QA performance.
4
 
@@ -8,7 +8,7 @@ The probe takes a 4096-dim vector:
8
 
9
  | Component | Description |
10
  |-----------|-------------|
11
- | `mid_q` | Last hidden representation from mid layer (16) of a PISCO decoder model with standard prompt, compressed context, and question|
12
 
13
 
14
  Output: probability that the compressed representation has **overflowed** (i.e., lost critical information).
 
1
+ # Overflow Probe on PISCO representations
2
 
3
  A binary MLP probe that detects **token overflow** in soft-compressed document representations [PISCO](https://arxiv.org/abs/2501.16075). Token overflow occurs when a document's information content exceeds the capacity of the compressed token budget, leading to degraded downstream QA performance.
4
 
 
8
 
9
  | Component | Description |
10
  |-----------|-------------|
11
+ | `mid_q` | Last hidden representation from mid layer (16) of a PISCO decoder model with standard prompt, compressed context, and a question.|
12
 
13
 
14
  Output: probability that the compressed representation has **overflowed** (i.e., lost critical information).