Model card: production vLLM validation, live endpoints, serving profile, data acknowledgements

README.md

@@ -18,6 +18,11 @@ Astrea R8 Chat is Altworld.io's 9B-parameter Qwen3.5 fine-tune for ordinary
 conversation, grounded instruction following, and creative prose. It is the
 native-chat release of the Astrea R8 line.
 
+**Try it:** [chat.altworld.io](https://chat.altworld.io) (free daily turns,
+no account needed) · [api.altworld.io](https://api.altworld.io)
+(OpenAI-compatible API) · [astrea.altworld.io](https://astrea.altworld.io)
+(docs and release notes)
+
 The bundled template is deliberately usable without a system prompt. When
 `enable_thinking` is absent or false, it inserts Qwen's closed empty thinking
 block and starts the visible answer immediately. Explicit thinking remains
@@ -99,6 +104,32 @@ The exact recommended runtime class may change as Qwen3.5 support lands in
 stable Transformers/vLLM releases. Follow the base model's official runtime
 instructions and pin a tested revision in production.
 
+## Serving with vLLM (production-validated)
+
+This checkpoint powers Altworld's own endpoints on vLLM 0.25, validated on
+an A40 and on 2× RTX 3090 (`--tensor-parallel-size 2`): identity contract,
+no accidental fiction, streaming, stop tokens, and seed-fixed sampling
+reproducibility all pass on this engine.
+
+```bash
+vllm serve Altworld/Astrea-R8-Chat-9B \
+  --dtype bfloat16 \
+  --max-model-len 32768 \
+  --gpu-memory-utilization 0.90
+```
+
+- The base architecture supports 262,144 tokens of context natively; serve
+  whatever your VRAM affords (32k fits comfortably on 2×24 GB alongside the
+  BF16 weights — the hybrid linear-attention layers keep the KV footprint
+  small).
+- On consumer dual-GPU boards without P2P, set `NCCL_P2P_DISABLE=1` or
+  tensor-parallel start-up can deadlock.
+- Sampling profiles we serve in production: factual/plain
+  `temperature 0.2, top_p 0.95`; conversational/creative
+  `temperature 0.8, min_p 0.025, repetition_penalty 1.08`.
+- GGUF: llama.cpp supports the Qwen3.5 family; official quants of this
+  fine-tune are planned — watch this org.
+
 ## Serving notes
 
 - Do not add a fictional roleplay system message for ordinary chat.
@@ -117,11 +148,12 @@ instructions and pin a tested revision in production.
   low-temperature indirectness/confusion even though the facts remained in
   context; higher temperature answered it directly. Applications should test
   their own dialogue distributions.
-- A local MLX-LM smoke run was weaker than the Fireworks source runtime on
-  identity and user/model-name separation at temperature 0.2. Source and merged
-  logits were numerically matched within expected BF16 rounding, so this is a
-  runtime/sampling portability warning rather than evidence of a faulty merge.
-  Validate the exact production engine and sampling profile before launch.
+- Engine portability: the production engine (vLLM 0.25, BF16) passes the
+  full release gate battery, and the Fireworks source runtime matched it. A
+  local MLX-LM smoke run was weaker on identity and user/model-name
+  separation at temperature 0.2 despite numerically matched logits — treat
+  runtime, kernels, and sampling implementation as part of the artifact and
+  validate your exact engine before depending on it.
 - Identity behavior is a trained convention, not evidence of consciousness or
   an independent person.
 - English dominates the fine-tuning and evaluation evidence.
@@ -134,3 +166,21 @@ instructions and pin a tested revision in production.
 Base model: [Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B),
 licensed under Apache License 2.0. This derivative is released under the same
 license. See `NOTICE` for attribution and modification information.
+
+Fine-tuning preference data used gold responses generated by MIT-licensed
+open-weight models (GLM-5.2 and DeepSeek-V4-Flash) under deterministic task
+checks and an independent judge gate, with on-policy generations from the
+Astrea lineage as rejected sides. No closed-source model outputs were used
+at any stage.
+
+## Acknowledgements
+
+Early-stage data ancestry draws on openly licensed community datasets:
+Athanorlite-DPO (CC-BY-4.0), jondurbin/gutenberg-dpo-v0.1 (CC-BY-4.0),
+nbeerbower/gutenberg2-dpo and gutenberg-moderne-dpo (Apache-2.0),
+Pageshift-Entertainment/LongPage (public-domain text, CC-BY-4.0
+annotations), allenai/tulu-3-sft-mixture (ODC-BY, license-filtered slices),
+and nothingiisreal/Reddit-Dirty-And-WritingPrompts (Apache-2.0, SFW file
+only). Thanks to the Qwen team for the Apache-2.0 base model.
+
+Questions or regressions: open a Discussion on this repository.