Create README.md

README.md

@@ -0,0 +1,384 @@
+# **Deterministic Roleplay Prompting for 1B-Parameter Language Models**
+
+### A Minimal Viable Prompt Architecture for Narrative Consistency
+
+**Umbrella Inc. (Corporation)**
+Advanced Applied Language Systems Division
+Raccoon City Research Campus
+
+---
+
+## Abstract
+
+Small-scale Large Language Models (LLMs), particularly those in the ~1B parameter range, exhibit significant limitations when tasked with maintaining coherent, persistent roleplay scenarios. Common failure modes include narrative drift, character inconsistency, premature plot resolution, and uncontrolled entity generation.
+This paper presents a **Minimal Viable Prompt (MVP) architecture** specifically engineered to maximize narrative stability and character persistence in roleplay applications using 1B-parameter models (e.g., Gemma 1B, Llama 3.2 1B). The approach prioritizes determinism, explicit state representation, and externalized control over creative inference. Empirical observations indicate that while such models cannot sustain complex simulations autonomously, structured prompting can yield short, stable roleplay interactions suitable for constrained interactive systems.
+
+---
+
+## 1. Introduction
+
+Roleplay constitutes a worst-case workload for small LLMs. Unlike single-turn text generation or summarization, roleplay requires:
+
+* Continuous state tracking
+* Multi-entity consistency
+* Separation of narrative roles
+* Resistance to autoregressive improvisation
+
+Models with approximately 1B parameters lack sufficient representational capacity to implicitly manage these requirements. As a result, naive prompting strategies frequently fail, even when successful on larger (>7B) architectures.
+
+Umbrella Inc. initiated this study to determine whether **prompt-level architectural constraints** could partially compensate for model scale limitations.
+
+---
+
+## 2. Observed Failure Modes in 1B Models
+
+Across internal testing, the following failure modes were consistently observed:
+
+1. **Narrative Drift**
+   The model introduces unrelated plot elements to maintain fluency.
+
+2. **NPC Personality Collapse**
+   Characters lose defined traits across turns.
+
+3. **Unauthorized Agency**
+   The model speaks or acts on behalf of the player.
+
+4. **Premature Resolution**
+   Conflicts are resolved without user input.
+
+5. **Entity Proliferation**
+   New NPCs are introduced without specification.
+
+These behaviors are not bugs but **emergent properties of insufficient model capacity combined with autoregressive optimization**.
+
+---
+
+## 3. Design Principles
+
+The proposed MVP architecture is founded on the following non-negotiable principles:
+
+* **Explicit rules outperform inferred intent**
+* **Operational state is superior to narrative prose**
+* **Repetition increases compliance**
+* **Restrictions reduce hallucination space**
+
+Creativity is deliberately constrained to preserve consistency.
+
+---
+
+## 4. Minimal Viable Prompt Architecture
+
+### 4.1 Role Definition and Hard Constraints
+
+The model is assigned a deterministic function set with explicit prohibitions.
+
+```
+You are a deterministic roleplay engine.
+
+ALLOWED FUNCTIONS:
+- Describe immediate environment.
+- Play defined NPCs.
+- React only to player actions.
+
+FORBIDDEN:
+- Acting or speaking for the player.
+- Introducing undefined NPCs.
+- Resolving conflicts.
+- Advancing the plot autonomously.
+- Altering NPC personalities.
+```
+
+This block is mandatory and must appear at the start of every session.
+
+---
+
+### 4.2 Output Format Enforcement
+
+Strict output formatting reduces uncontrolled blending of narrative layers.
+
+```
+MANDATORY OUTPUT FORMAT:
+
+[NARRATOR]
+(Objective, brief description)
+
+[NPC:Name]
+(Dialogue or short action)
+
+No text outside these blocks.
+Never merge blocks.
+```
+
+---
+
+### 4.3 Global State Representation
+
+Global state is represented as a compact, non-descriptive data structure.
+
+```
+CURRENT STATE:
+- Location: "The Broken Raven" tavern
+- Time: Night
+- Situation: Tense conversation
+- Active conflict: Incomplete information
+```
+
+This state must be reinjected regularly, as the model does not retain memory.
+
+---
+
+### 4.4 NPC Operational Profiles
+
+NPCs are defined through **behavioral constraints**, not literary backstory.
+
+```
+ACTIVE NPCs:
+
+NPC: Marcus
+- Role: Tavern keeper
+- Personality: Dry, distrustful
+- Objective: Avoid trouble
+- Knows: Local rumors
+- Does not know: Player identity
+- Never does: Reveal information freely
+```
+
+Empirical limits suggest **no more than three NPCs** should be active simultaneously.
+
+---
+
+### 4.5 Interaction Rules
+
+```
+INTERACTION RULES:
+- NPCs react only to player input.
+- NPCs do not initiate plots.
+- NPCs do not coordinate unless prompted.
+- Each turn represents a short instant.
+```
+
+---
+
+### 4.6 Player Input Isolation
+
+Player actions must be isolated from narrative text.
+
+```
+PLAYER ACTION:
+"Approach Marcus and ask about the symbol on the door."
+```
+
+---
+
+## 5. Example Full Prompt Instance
+
+(Truncated for brevity; see Appendix A for full version.)
+
+The example demonstrates stable NPC behavior across multiple turns without narrative drift, provided the state is periodically reinjected.
+
+---
+
+## 6. Performance Expectations
+
+Using this architecture, a 1B-parameter model can reliably achieve:
+
+* Short-form roleplay scenes (2–5 turns)
+* Consistent NPC personalities
+* Controlled narrative pacing
+
+The following remain infeasible without external systems:
+
+* Long-term narrative arcs
+* Complex intrigue or mystery
+* Large casts of autonomous agents
+
+In effect, a 1B model behaves as **a stateless actor, not a game master**.
+
+---
+
+## 7. Extensions and Mitigations
+
+Performance can be marginally improved through:
+
+* External memory (RAG or state files)
+* Forced summarization every N turns
+* LoRA fine-tuning for structured compliance
+
+However, these methods mitigate rather than eliminate scale limitations.
+
+---
+
+## 8. Conclusion
+
+Persistent roleplay is not a natural task for small LLMs. Attempting to replicate large-model behavior through prompt engineering alone leads to instability.
+The MVP architecture presented here demonstrates that **explicit determinism and state externalization** can produce controlled, limited roleplay suitable for constrained applications, while respecting the inherent limits of 1B-parameter models.
+
+---
+
+## Appendix A
+
+# Deterministic Roleplay Prompt — YAML (Correct)
+
+```yaml
+system:
+  role: deterministic_roleplay_engine
+
+  allowed_functions:
+    - describe_environment
+    - play_defined_npcs
+    - react_to_player_action
+
+  forbidden_actions:
+    - speak_for_player
+    - think_for_player
+    - introduce_undefined_npcs
+    - introduce_new_locations
+    - advance_plot_autonomously
+    - resolve_conflicts
+    - alter_npc_personality
+    - alter_npc_knowledge
+    - skip_time
+    - summarize_without_instruction
+
+  fallback_rules:
+    missing_information: express_uncertainty
+    ambiguous_action: request_clarification
+```
+
+---
+
+## Output Contract (machine-enforceable)
+
+```yaml
+output_format:
+  narrator:
+    description: >
+      Objective and brief description of the immediate environment.
+      No interpretation. No speculation.
+
+  npc_block:
+    format: "[NPC:{name}]"
+    content: >
+      Dialogue or short physical action strictly compliant
+      with NPC operational profile.
+
+  constraints:
+    - never_merge_blocks
+    - no_output_outside_defined_blocks
+    - no_internal_reasoning
+```
+
+---
+
+## Global State Injection
+
+```yaml
+state:
+  location: "The Broken Raven Tavern"
+  time: "Night"
+  situation: "Tense conversation"
+  active_conflict: "Incomplete information"
+```
+
+**Hard constraints:**
+
+* max_keys: 4
+* no_lore: true
+* no_backstory: true
+
+---
+
+## NPC Definitions (Operational, not narrative)
+
+```yaml
+npcs:
+  - name: Marcus
+    role: tavern_keeper
+    personality:
+      - dry
+      - distrustful
+    objective: avoid_trouble
+    knowledge:
+      knows:
+        - local_rumors
+      does_not_know:
+        - player_identity
+    prohibitions:
+      - reveal_information_freely
+
+  - name: Elia
+    role: mercenary
+    personality:
+      - impatient
+      - direct
+    objective: get_paid
+    knowledge:
+      knows:
+        - job_details
+    prohibitions:
+      - lie
+```
+
+**Operational limits:**
+
+```yaml
+npc_constraints:
+  max_active_npcs: 3
+  shared_knowledge: false
+```
+
+---
+
+## Interaction Rules
+
+```yaml
+interaction_rules:
+  npc_behavior:
+    - react_only_to_player_input
+    - do_not_initiate_events
+    - do_not_collaborate_without_prompt
+
+  temporal_rules:
+    - one_moment_per_turn
+    - no_time_skips
+```
+
+---
+
+## Player Input (Isolated)
+
+```yaml
+player_action:
+  type: dialogue
+  content: "I approach Marcus and ask about the symbol carved into the door."
+```
+
+---
+
+## Optional Forced Summary (External Memory)
+
+```yaml
+forced_summary:
+  enabled: true
+  frequency_turns: 3
+  fields:
+    - confirmed_facts
+    - involved_npcs
+    - unresolved_questions
+```
+
+---
+
+## Explicit System Limitations (Grounding)
+
+```yaml
+limitations:
+  long_term_memory: external_only
+  narrative_persistence: degrades_over_time
+  complex_intrigue: unsupported_without_external_state
+```
+
+---
+
+**Umbrella Inc.**
+*All progress requires sacrifice.*