ameythakur commited on
Commit
df993fc
·
verified ·
1 Parent(s): 29deab9

Knowledge Lifecycle

Browse files
Files changed (1) hide show
  1. README.md +16 -4
README.md CHANGED
@@ -1,10 +1,22 @@
1
  ---
2
- title: Llm Knowledge Lifecycle
3
- emoji: 🏆
4
  colorFrom: gray
5
- colorTo: green
6
  sdk: static
7
  pinned: false
 
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: LLM Knowledge Lifecycle
3
+ emoji: 📄
4
  colorFrom: gray
5
+ colorTo: blue
6
  sdk: static
7
  pinned: false
8
+ license: cc-by-4.0
9
  ---
10
 
11
+ # LLM Knowledge Lifecycle
12
+
13
+ Companion demonstration for **The Knowledge Lifecycle of Large Language Models** (Amey Thakur, 2026). GPT-2 base runs entirely in the visitor's browser via ONNX; every measurement is computed locally with no server involved.
14
+
15
+ The probe measures what happens when a language model's parametric memory conflicts with corrective context:
16
+
17
+ - **D_sync**, the surprisal of the correct answer with the corrective document in context. A value of *n* nats means the model assigns the correct answer probability e^(-n).
18
+ - **I_ctx**, the full-vocabulary KL divergence between the model's output distributions with and without the document. Near zero means the document is present but inert.
19
+
20
+ Three preset probes cover documented fact changes landing in three regimes: total resolution failure (the 2004 Vioxx withdrawal, the paper's headline measurement), the exposure trap where correct context reinforces the wrong answer (the British monarch after 2022), and drift where strong context influence still fails to flip the answer (the 2023 Twitter rename).
21
+
22
+ Paper repository: https://github.com/Amey-Thakur/LLM-KNOWLEDGE-LIFECYCLE