File size: 4,950 Bytes
ca3d977 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 | # Planner Cache system card
## Summary
Planner Cache is an external semantic-memory architecture attached to a frozen decoder. In plain terms, it keeps mutable facts in a separate bounded store and supplies only selected facts to the model. This card describes the tested system and does not present Planner Cache as a newly pretrained foundation model.
## Tested base model
| Field | Value |
|---|---|
| Base | Pythia-1.4B local checkpoint |
| Architecture | GPT-NeoX decoder |
| Layers | 24 |
| Hidden width | 2048 |
| Attention heads | 16 |
| Context positions in bundled config | 2,048 |
| Base training during Planner Cache experiments | none |
| Base parameters receiving gradients in active CUDA proof | 0 |
The portability suite also ran a frozen Gemma 4 E4B Q8 GGUF with architecture `gemma4`, 42 layers, hidden width 2,560, and llama.cpp build 10276. A bounded two-value residual proved causal control but not broad compatibility. A later sequence path reached 125 of 128 exact disjoint strings. The matched audit classified that result as lexical token forcing and selected a zero-parameter direct adaptive logit-bias LTL that reached 128 of 128 exact strings. Gemma does not currently have TTL support.
Pythia remains subject to the language, factuality, bias, and safety limitations documented by EleutherAI.
## Added components
- A 512-wide canonical P-cache with fixed configured capacity.
- A model-independent canonical router.
- A 2,707,464-parameter Pythia `.ttl` attached at layer 23.
- A disk-resident `.ppkg` proof with selective canonical activation.
- A zero-parameter Gemma `.ltl` using direct adaptive lexical control in llama.cpp.
- A hidden post-turn review side-channel that proposes validated canonical P operations after visible generation.
No LoRA, base-weight modification, prompt prefix, or P state in self-attention KV is used by the active architecture.
## Intended use
- Research on mutable semantic state after source tokens leave recent KV.
- Evaluation of explicit state creation, modification, merging, invalidation, and retention.
- Development of small compatibility modules for frozen decoder models.
- Research on durable evidence-based personality conclusions stored outside model weights.
## Out of scope
- General-purpose long-context replacement.
- Exact transcript recall without an external archive.
- Production user profiling.
- Claims of compatibility with arbitrary decoder models.
- Safety-critical state tracking without external validation.
- Foundation-model quality or safety evaluation.
## Evaluation methodology
The active tests use controlled entity, relation, value, mutation, wrong-state, invalidation, held-out composition, natural-RP preservation, persistence, corruption, capacity, and scaling workloads. Source-state tokens are removed from recent KV in causal tests. The same prompt and KV are used while canonical P changes.
The active audit also profiles query construction, index hydration, canonical routing, P-package header filtering, row hydration, canonical conversion, translator latency, generation latency, CPU memory, VRAM, disk size, and bytes loaded.
The gateway transparency regression compares the final tokenized prompt with raw
llama-server for identical `system` and `user` messages and requires exact token
equivalence while P and LTL are inactive. Memory review is a separate request.
## Main findings
Changing only canonical P changed the selected answer in the controlled causal tests. Rejecting or invalidating that state restored the frozen output. This shows a causal memory channel in the tested conditions. It does not show broad reasoning, factuality, or universal model support.
- P-cache allocation remains fixed for configured capacity.
- Relevant canonical P state causally changes Pythia token logits and generated values.
- Invalidated and rejected wrong-state conditions restore frozen-base logits in the matched CUDA benchmark.
- Natural-RP preservation remains exact on the held-out proof fixture for irrelevant state.
- P-package state remains on disk and only selected entries are activated.
- The Gemma LTL audit emitted all 128 selected held-out strings. Rejected, invalidated, and disabled paths remained inert. This is lexical compatibility, not evidence of internal semantic reasoning.
- A matched CUDA matrix distinguishes canonical P allocation, retained KV tensors, and combined peak VRAM at 64, 256, and 1,024 tokens or slots without treating P and KV as interchangeable.
## Known limitations
The evaluation fixtures are synthetic or small held-out RP sets. Natural review
currently covers a narrow state schema and is slow. The results do not establish
general factuality, broad instruction following, production dialogue quality,
nuanced personality, or a full trained open-vocabulary TTL on a second model
family. Gemma LTL exact-string performance must not be presented as learned
semantic compatibility.
|