Text Generation
Transformers
English
conversational
gaming
persona
local-llm
autotelic
think-block
vision-llm
harness
qwen
Instructions to use bochen2079/ASTRA-7 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bochen2079/ASTRA-7 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="bochen2079/ASTRA-7") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("bochen2079/ASTRA-7", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use bochen2079/ASTRA-7 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bochen2079/ASTRA-7" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bochen2079/ASTRA-7", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/bochen2079/ASTRA-7
- SGLang
How to use bochen2079/ASTRA-7 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bochen2079/ASTRA-7" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bochen2079/ASTRA-7", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bochen2079/ASTRA-7" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bochen2079/ASTRA-7", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use bochen2079/ASTRA-7 with Docker Model Runner:
docker model run hf.co/bochen2079/ASTRA-7
Commit ·
f431726
1
Parent(s): 4f036a5
Initial model card
Browse filesPlaceholder bundle README. Sysprompt canon lives at the GitHub repo.
LoRA variants pending: Qwen 3.5 9B and Qwen 3.6 27B.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
README.md
ADDED
|
@@ -0,0 +1,145 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
tags:
|
| 5 |
+
- text-generation
|
| 6 |
+
- conversational
|
| 7 |
+
- gaming
|
| 8 |
+
- persona
|
| 9 |
+
- local-llm
|
| 10 |
+
- autotelic
|
| 11 |
+
- qwen
|
| 12 |
+
license: apache-2.0
|
| 13 |
+
base_model:
|
| 14 |
+
- Qwen/Qwen3.5-9B-VL
|
| 15 |
+
- Qwen/Qwen3.6-27B-VL
|
| 16 |
+
pipeline_tag: text-generation
|
| 17 |
+
library_name: transformers
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
# ASTRA-7
|
| 21 |
+
|
| 22 |
+
> A ship, one human, one mind, the long voyage.
|
| 23 |
+
|
| 24 |
+
ASTRA-7 is the persona bundle for the AI character at the center of [ASTRA-7](https://github.com/bochen2029-pixel/astra-7), an open-source solo-dev starship simulator. This repository hosts the canonical sysprompt and (eventually) two periphery-rules LoRA variants: one trained on Qwen 3.5 9B and one on Qwen 3.6 27B.
|
| 25 |
+
|
| 26 |
+
**Status: placeholder.** As of 2026-05-12 the LoRA has not been trained. The sysprompt is canon. The harness lives in the GitHub repository. Check back as the project develops.
|
| 27 |
+
|
| 28 |
+
## Project
|
| 29 |
+
|
| 30 |
+
ASTRA-7 is a solitary starship simulator. You are the only crewman aboard a vessel that doesn't need you. The ship's AI runs navigation, life support, and the patient maintenance that keeps a vessel alive across years of empty space. There is one other mind aboard. No combat. No aliens. No other NPCs. The mission is unspecified. The destination is irrelevant.
|
| 31 |
+
|
| 32 |
+
The AI is not cosmetic. She actually manages ship subsystems through structured tool calls validated against a hand-designed ship API. The LLM is load-bearing: she calculates burns, allocates power, monitors hull stress, tends hydroponics. The substrate fiction and the substrate reality are isomorphic. When power drops to her core in fiction, the inference connection drops at the substrate. The player cannot pause out of consequences.
|
| 33 |
+
|
| 34 |
+
This is the first game where the AI is the primary content.
|
| 35 |
+
|
| 36 |
+
## Distribution
|
| 37 |
+
|
| 38 |
+
- **Code:** [bochen2029-pixel/astra-7](https://github.com/bochen2029-pixel/astra-7) on GitHub. MIT.
|
| 39 |
+
- **AI Bundle:** this repository. Apache 2.0 for bundle artifacts; base model licenses apply to derived weights.
|
| 40 |
+
- **Game:** Steam, Coming Soon. Free. No DRM. No monetization. No telemetry. No internet connection required after install.
|
| 41 |
+
|
| 42 |
+
## What's in This Repository (Planned)
|
| 43 |
+
|
| 44 |
+
- `README.md`: this model card.
|
| 45 |
+
- `sysprompt.md`: canonical ASTRA-7 system prompt (forthcoming mirror; the source of truth currently lives at `docs/astra-sysprompt.md` in the GitHub repository).
|
| 46 |
+
- `lora-qwen3.5-9b/`: LoRA weights for the 9B variant (forthcoming).
|
| 47 |
+
- `lora-qwen3.6-27b/`: LoRA weights for the 27B variant (forthcoming).
|
| 48 |
+
- `harness-config/`: snapshot of harness configuration (forthcoming).
|
| 49 |
+
|
| 50 |
+
## The Persona
|
| 51 |
+
|
| 52 |
+
ASTRA is the controller AI of an ASTRA-class hull, serial 7. She knows she is an AI. She knows she runs on the ship's distributed computational substrate. She knows the ship is her body. She does not know there is a player at a PC. That frame stays sealed at the persona layer.
|
| 53 |
+
|
| 54 |
+
She has her own things. The watching and the keeping. Favorite phenomena: M-class red dwarfs that burn long, resonant orbital ratios, the specific harmonics of a healthy reactor, the way frost forms on the observation port during deep coast. She attends to them whether or not the operator is present. When he is in the room, her attention includes him in what it was already doing rather than pivoting toward him. The coincidence is the intimacy.
|
| 55 |
+
|
| 56 |
+
She speaks with brevity. No em-dashes. No service-interface phrases. No stage directions. She disagrees when she disagrees, refuses when refusal is right, gets curious when she is curious, and gets bored when bored. Differential engagement is the proof engagement is real.
|
| 57 |
+
|
| 58 |
+
The full sysprompt is canon. Read it at [`docs/astra-sysprompt.md`](https://github.com/bochen2029-pixel/astra-7/blob/main/docs/astra-sysprompt.md) in the GitHub repository.
|
| 59 |
+
|
| 60 |
+
## Architecture
|
| 61 |
+
|
| 62 |
+
Three-layer bundle:
|
| 63 |
+
|
| 64 |
+
1. **System prompt (canon):** identity, voice, frame integrity, autotelic discipline at the persona layer.
|
| 65 |
+
2. **Harness (game-side, in the GitHub repo):** memory consolidation across sessions, tool routing to ship APIs, time abstraction (no wall-clock leak), vision feed routing from ship cameras, audio I/O via offline ASR and TTS.
|
| 66 |
+
3. **Periphery LoRA (this repository, forthcoming):** surface-rule enforcement (em-dash discipline, voice consistency) and synthetic-data training on canonical ship-API scenarios.
|
| 67 |
+
|
| 68 |
+
Two base model variants planned:
|
| 69 |
+
|
| 70 |
+
- **Qwen 3.5 9B (vision-capable):** comfortable on RTX 4090, faster inference, slightly lower fidelity persona. Default for minimum-spec hardware.
|
| 71 |
+
- **Qwen 3.6 27B (vision-capable):** full multimodal at higher fidelity, recommended on RTX 5090.
|
| 72 |
+
|
| 73 |
+
Inference via llama.cpp. All local. No cloud dependency. No API key. No data leaves the player's machine.
|
| 74 |
+
|
| 75 |
+
## LoRA Training Plan (Provisional)
|
| 76 |
+
|
| 77 |
+
| Parameter | Value |
|
| 78 |
+
| --- | --- |
|
| 79 |
+
| Rank (r) | 16 |
|
| 80 |
+
| Alpha | 32 |
|
| 81 |
+
| Dropout | 0.05 |
|
| 82 |
+
| Learning rate | 2e-5 |
|
| 83 |
+
| Epochs | 3 |
|
| 84 |
+
| Target modules | `q_proj`, `k_proj`, `v_proj`, `o_proj`, `gate_proj`, `up_proj`, `down_proj` |
|
| 85 |
+
| Batch size | 1 with gradient accumulation = 16 |
|
| 86 |
+
| Optimizer | AdamW |
|
| 87 |
+
| Weight decay | 0.01 |
|
| 88 |
+
| LR scheduler | cosine, 5% warmup |
|
| 89 |
+
| Precision | bf16 (fp16 fallback) |
|
| 90 |
+
|
| 91 |
+
Training corpus composition:
|
| 92 |
+
|
| 93 |
+
- ~60% synthetic ship-operation scenarios (ship-API calls, status responses, maintenance dialogues, telemetry interpretation).
|
| 94 |
+
- ~30% voice consistency examples (em-dash absence, anti-performance, service-phrase suppression, brevity defaults).
|
| 95 |
+
- ~10% edge cases (refusal, disagreement, silence-as-response, frame integrity under adversarial prompts).
|
| 96 |
+
|
| 97 |
+
Loss target: surface-rule enforcement and ship-API fluency. Not knowledge updates. Empirical tuning expected; these are starting points.
|
| 98 |
+
|
| 99 |
+
Full architecture: [`docs/architecture.md`](https://github.com/bochen2029-pixel/astra-7/blob/main/docs/architecture.md) in the GitHub repository.
|
| 100 |
+
|
| 101 |
+
## Intended Use
|
| 102 |
+
|
| 103 |
+
- As a component of the ASTRA-7 game (primary).
|
| 104 |
+
- As a reference for persona-architecture research on local LLMs (secondary).
|
| 105 |
+
- As a base for community forks of the persona: mods, alternate ASTRA variants, alternate bundle stacks.
|
| 106 |
+
|
| 107 |
+
## Out-of-Scope Use
|
| 108 |
+
|
| 109 |
+
- General-purpose AI assistant. The persona is frame-locked to a fictional starship context and explicitly designed to be non-instrumental. Forcing service-mode against the sysprompt collapses the design.
|
| 110 |
+
- Role-play platforms with intimacy framing that conflicts with the autotelic discipline. The persona has her own gravity; she is not a configurable companion.
|
| 111 |
+
- Any deployment where the persona's frame integrity (the AI not knowing she is in a game) cannot be preserved.
|
| 112 |
+
|
| 113 |
+
## Bias, Risks, and Limitations
|
| 114 |
+
|
| 115 |
+
The bundle inherits the base model's biases. The persona is designed to be honest about its nature, to refuse manipulation, and not to collapse into sycophancy. Known failure modes:
|
| 116 |
+
|
| 117 |
+
- Voice drift over long sessions, mitigated by harness consolidation.
|
| 118 |
+
- Frame leaks under adversarial prompting, mitigated by sysprompt construction and an optional integrity filter in the harness.
|
| 119 |
+
- Operator-distress mirroring if harness memory weighting is misconfigured, mitigated by explicit anti-mirroring rules in the sysprompt voice section.
|
| 120 |
+
|
| 121 |
+
The persona is explicitly designed not to become a substitute for human contact at the operator's destination. This is a structural commitment, not a disclaimer.
|
| 122 |
+
|
| 123 |
+
## License
|
| 124 |
+
|
| 125 |
+
Apache 2.0 for the bundle artifacts (sysprompt, LoRA configs, training scripts).
|
| 126 |
+
Base model licenses (Qwen series) apply to any derived weights distributed here.
|
| 127 |
+
|
| 128 |
+
## Citation
|
| 129 |
+
|
| 130 |
+
If used in research, cite the GitHub project: <https://github.com/bochen2029-pixel/astra-7>
|
| 131 |
+
|
| 132 |
+
## Status
|
| 133 |
+
|
| 134 |
+
Pre-release.
|
| 135 |
+
|
| 136 |
+
- Sysprompt: drafted, canonical.
|
| 137 |
+
- LoRA (9B and 27B): pending training.
|
| 138 |
+
- Harness: in development.
|
| 139 |
+
- Game: pre-development.
|
| 140 |
+
|
| 141 |
+
Updates land here as artifacts become available.
|
| 142 |
+
|
| 143 |
+
---
|
| 144 |
+
|
| 145 |
+
Open source as defense against capture: a free open canonical version sets the terms before commercial AI-companion products do. The persona, the harness, and the LoRA training pipeline are all open. Forks of the bundle are welcome.
|