SLWM-X1B / README.md
diogoantunes's picture
Document examples and validation; align MIT copyright contacts
894e783 verified
|
Raw History Blame Contribute Delete
8.63 kB
---
license: mit
language:
- en
library_name: jax
tags:
- world-model
- multimodal
- working-memory
- embodied-control
- research
- study-artifacts
- npz
---
# SLWM-X1B — Study artifacts (Wave 5)
> **Study artifacts for reference — unpublished manuscript.** These checkpoints accompany the manuscript draft v0.3, which has not yet been published. They are shared for inspection and reproducibility of the study, not as a formal model release.
The 1.008B-parameter signal-latent world-model flagship with doubled training exposure, action-conditioned latent prediction, editable matrix memory, and explicit commitment routing.
Research by **Diogo Antunes**, at [valuealigned.ai](https://valuealigned.ai) and [keplen.ai](https://keplen.ai). Shared as study artifacts in the **valueai-org** organization.
This is an original, unmodified checkpoint from the SLWM research archive. It uses a **custom NumPy NPZ format** and the SLWM JAX runtime; it is not a Transformers `AutoModel` checkpoint or a chat model.
## Study artifact reference
| Property | Value |
|---|---|
| Original run | `x1b-w5-slwm-1b-s2001` |
| Experimental wave | 5 |
| Training seed | 2001 |
| Strict total parameters | 1,008,454,410 |
| Training steps | 5,600 |
| Batch size | 12 sequences |
| Training sequence length | 32 ticks |
| Latent width / layers / slots per tick | 1536 / 23 / 24 |
| Runtime/source reference | [`cbb2b38`](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47) |
Seed 2001 is provided as a fixed reference, not selected by ranking test scores. The unpublished manuscript reports three-seed cohorts; this repository contains one checkpoint and its own recorded metrics.
Wave 5 uses the original observation and central-barrier planning setting, including object coordinates in proprioception. Its physical xArm6 evaluation is offline and trajectory-disjoint within one workspace.
## Files and integrity
| File | Bytes | SHA-256 |
|---|---:|---|
| `weights_bf16.npz` | 1,602,108,632 | `f56b803857a09e7e77e1bb501efdc8e47bcacb2230cf18a1ab44e1acca591f51` |
| `portable_int8.npz` | 918,039,628 | `faaf635499f1ba8f501ecd64911ffa0bf88969f6637d521337d45ee4bf1ea36f` |
- `weights_bf16.npz`: the project's mixed BF16/FP32 export. Matrix BF16 values are stored as uint16 bit patterns, with a dtype manifest.
- `portable_int8.npz`: the project's symmetric per-channel INT8 export, with scales and a quantization manifest.
- `config.json`, `receipt.json`, `eval_metrics.json`, and `train.jsonl`: original run artifacts, preserved byte for byte.
- `artifact_manifest.json` and `SHA256SUMS`: source mapping, artifact hashes, and export-validation results.
- `load_checkpoint.py`: a small, pickle-free NumPy loader for both formats.
All original files were checked against their recorded SHA-256 values before upload. Both weight exports were decoded on CPU, checked for finite values, and counted against the strict total and component counts. These are packaging/integrity checks, not new benchmark evaluations.
The provided loader expands weights to float32. **INT8 file size is not the runtime memory requirement, and this loader does not perform INT8 matrix computation.** Model weights, activations, and planning buffers are separate from the paper's bounded streaming-state figures.
## Download and load
Install `numpy` and `huggingface_hub` in your Python environment, then:
```python
import json
import sys
from pathlib import Path
from huggingface_hub import snapshot_download
folder = Path(snapshot_download(
repo_id="valueai-org/SLWM-X1B",
allow_patterns=["portable_int8.npz", "config.json", "receipt.json", "load_checkpoint.py"],
))
sys.path.insert(0, str(folder))
from load_checkpoint import load_checkpoint
receipt = json.loads((folder / "receipt.json").read_text())
params = load_checkpoint(
folder / "portable_int8.npz",
expected_sha256=receipt["portable_int8_sha256"],
)
assert sum(value.size for value in params.values()) == receipt["parameter_counts"]["strict_total"]
```
For the BF16 export, download `weights_bf16.npz` instead and use `receipt["weights_bf16_sha256"]` for verification. `params` is a dictionary of NumPy float32 arrays. JAX execution requires JAX and the appropriate modules from the [pinned research source](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47); follow that source for input preparation, modality masks, state updates, and planning.
Use `models/x1b_world.py` for the core, `models/x1b_jepa.py` for latent prediction and readouts, and the matching planner/evaluation modules in the pinned source. `scripts/eval/x1b_infer.py` can load local NPZ checkpoints through its `load_verified_checkpoint` function; supply this artifact directory so the Wave 5 receipt and configuration are used.
## Run an example and validation checks
Use the [runnable examples and validation-set guide](https://github.com/ValueAlignedAI/slwm/blob/main/docs/research/x1b_study_artifacts_and_validation.md) from the SLWM source repository. It explains the development and held-out data splits, how to verify local data-bank checksums, and which recorded inputs are not included with these checkpoints.
From a current checkout of [the source repository](https://github.com/ValueAlignedAI/slwm), after installing the guide's Python dependencies:
```sh
python scripts/eval/x1b_study_examples.py \
--mode example --repo-id valueai-org/SLWM-X1B --format int8 \
--output /tmp/slwm-x1b-example.json
```
This is a generated, deterministic functional example using the selected trained checkpoint; it is not a benchmark score. The guide provides BF16 commands for the original evaluation functions and the exact bank paths and split names for validation.
## Recorded results for this checkpoint
These values come directly from this run's `receipt.json`. They are **single-seed results**, not the manuscript's cohort mean ± standard deviation. The upload does not claim that the quantized export has received an additional independent evaluation.
| Recorded metric | Seed 2001 |
|---|---:|
| Overall synthetic MPC success | 75.0000 % |
| One-pixel barrier MPC success | 93.7500 % |
| T = 76 goal-switch success | 100.0000 % |
| T = 1,024 associative recall | 100.0000 % |
| Single-workspace xArm6 four-step error | 7.3368 mm |
The original `eval_metrics.json` provides the wider evaluation record, including failures. Compare architectures within the same wave and observation/training setting.
## Scope and limitations
This is a research world-model checkpoint, not a general-purpose language or robotics foundation model. Wave 5 control results include privileged object-state inputs and a central-barrier planning prior. The physical-robot measurements are offline trajectory predictions, not live robot deployment. The later scene-disjoint and unprivileged spatial tests belong to different models and waves.
The checkpoint is intended for research and reproducibility. The upload contains no raw training recordings, datasets, optimizer state, or private server access configuration. The pinned source commit is a public runtime/study reference, not a separately verified training-code commit: the archived receipts do not record the training Git SHA.
## Sources and licensing
- [Unpublished manuscript draft v0.3 (PDF)](https://diogoantunes.ai/media/publications/slwm_x1b_paper_v03.pdf)
- [Expanded article, figures, and experiment context](https://diogoantunes.ai/publications/signal-latent-world-models)
- [SLWM source repository](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47)
- [Original experiment records](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47/experiments/multimodal/x1b/spatiotemporal-jepa-1b-20261111/runs_wave5/x1b-w5-slwm-1b-s2001)
These study artifacts, including the BF16 and INT8 weights, use the **MIT license**, as specified by the author. The complete `LICENSE` and `SOURCE_LICENSE` files match the [corrected GitHub project license](https://github.com/ValueAlignedAI/slwm/blob/d1abfc031d9d0c54f511e9a4eb324dfc0b57a08d/LICENSE). The copyright owners are **Diogo Antunes** ([contact@diogoantunes.ai](mailto:contact@diogoantunes.ai)), **ValueAI** ([contact@valuealigned.ai](mailto:contact@valuealigned.ai)), and **Keplen** ([contact@keplen.ai](mailto:contact@keplen.ai)).
## Citation
Diogo Antunes. *Signal-Latent World Models at 1.008B Scale: Separating Fast Sensory Grounding from Editable Working Memory Under O(1) Streaming Control.* Unpublished manuscript, draft v0.3, dated November 14, 2026.