SLWM-X1B / README.md
diogoantunes's picture
Document examples and validation; align MIT copyright contacts
894e783 verified
|
Raw History Blame Contribute Delete
8.63 kB
metadata
license: mit
language:
  - en
library_name: jax
tags:
  - world-model
  - multimodal
  - working-memory
  - embodied-control
  - research
  - study-artifacts
  - npz

SLWM-X1B — Study artifacts (Wave 5)

Study artifacts for reference — unpublished manuscript. These checkpoints accompany the manuscript draft v0.3, which has not yet been published. They are shared for inspection and reproducibility of the study, not as a formal model release.

The 1.008B-parameter signal-latent world-model flagship with doubled training exposure, action-conditioned latent prediction, editable matrix memory, and explicit commitment routing.

Research by Diogo Antunes, at valuealigned.ai and keplen.ai. Shared as study artifacts in the valueai-org organization.

This is an original, unmodified checkpoint from the SLWM research archive. It uses a custom NumPy NPZ format and the SLWM JAX runtime; it is not a Transformers AutoModel checkpoint or a chat model.

Study artifact reference

Property Value
Original run x1b-w5-slwm-1b-s2001
Experimental wave 5
Training seed 2001
Strict total parameters 1,008,454,410
Training steps 5,600
Batch size 12 sequences
Training sequence length 32 ticks
Latent width / layers / slots per tick 1536 / 23 / 24
Runtime/source reference cbb2b38

Seed 2001 is provided as a fixed reference, not selected by ranking test scores. The unpublished manuscript reports three-seed cohorts; this repository contains one checkpoint and its own recorded metrics.

Wave 5 uses the original observation and central-barrier planning setting, including object coordinates in proprioception. Its physical xArm6 evaluation is offline and trajectory-disjoint within one workspace.

Files and integrity

File Bytes SHA-256
weights_bf16.npz 1,602,108,632 f56b803857a09e7e77e1bb501efdc8e47bcacb2230cf18a1ab44e1acca591f51
portable_int8.npz 918,039,628 faaf635499f1ba8f501ecd64911ffa0bf88969f6637d521337d45ee4bf1ea36f
  • weights_bf16.npz: the project's mixed BF16/FP32 export. Matrix BF16 values are stored as uint16 bit patterns, with a dtype manifest.
  • portable_int8.npz: the project's symmetric per-channel INT8 export, with scales and a quantization manifest.
  • config.json, receipt.json, eval_metrics.json, and train.jsonl: original run artifacts, preserved byte for byte.
  • artifact_manifest.json and SHA256SUMS: source mapping, artifact hashes, and export-validation results.
  • load_checkpoint.py: a small, pickle-free NumPy loader for both formats.

All original files were checked against their recorded SHA-256 values before upload. Both weight exports were decoded on CPU, checked for finite values, and counted against the strict total and component counts. These are packaging/integrity checks, not new benchmark evaluations.

The provided loader expands weights to float32. INT8 file size is not the runtime memory requirement, and this loader does not perform INT8 matrix computation. Model weights, activations, and planning buffers are separate from the paper's bounded streaming-state figures.

Download and load

Install numpy and huggingface_hub in your Python environment, then:

import json
import sys
from pathlib import Path
from huggingface_hub import snapshot_download

folder = Path(snapshot_download(
    repo_id="valueai-org/SLWM-X1B",
    allow_patterns=["portable_int8.npz", "config.json", "receipt.json", "load_checkpoint.py"],
))
sys.path.insert(0, str(folder))
from load_checkpoint import load_checkpoint

receipt = json.loads((folder / "receipt.json").read_text())
params = load_checkpoint(
    folder / "portable_int8.npz",
    expected_sha256=receipt["portable_int8_sha256"],
)
assert sum(value.size for value in params.values()) == receipt["parameter_counts"]["strict_total"]

For the BF16 export, download weights_bf16.npz instead and use receipt["weights_bf16_sha256"] for verification. params is a dictionary of NumPy float32 arrays. JAX execution requires JAX and the appropriate modules from the pinned research source; follow that source for input preparation, modality masks, state updates, and planning.

Use models/x1b_world.py for the core, models/x1b_jepa.py for latent prediction and readouts, and the matching planner/evaluation modules in the pinned source. scripts/eval/x1b_infer.py can load local NPZ checkpoints through its load_verified_checkpoint function; supply this artifact directory so the Wave 5 receipt and configuration are used.

Run an example and validation checks

Use the runnable examples and validation-set guide from the SLWM source repository. It explains the development and held-out data splits, how to verify local data-bank checksums, and which recorded inputs are not included with these checkpoints.

From a current checkout of the source repository, after installing the guide's Python dependencies:

python scripts/eval/x1b_study_examples.py \
  --mode example --repo-id valueai-org/SLWM-X1B --format int8 \
  --output /tmp/slwm-x1b-example.json

This is a generated, deterministic functional example using the selected trained checkpoint; it is not a benchmark score. The guide provides BF16 commands for the original evaluation functions and the exact bank paths and split names for validation.

Recorded results for this checkpoint

These values come directly from this run's receipt.json. They are single-seed results, not the manuscript's cohort mean ± standard deviation. The upload does not claim that the quantized export has received an additional independent evaluation.

Recorded metric Seed 2001
Overall synthetic MPC success 75.0000 %
One-pixel barrier MPC success 93.7500 %
T = 76 goal-switch success 100.0000 %
T = 1,024 associative recall 100.0000 %
Single-workspace xArm6 four-step error 7.3368 mm

The original eval_metrics.json provides the wider evaluation record, including failures. Compare architectures within the same wave and observation/training setting.

Scope and limitations

This is a research world-model checkpoint, not a general-purpose language or robotics foundation model. Wave 5 control results include privileged object-state inputs and a central-barrier planning prior. The physical-robot measurements are offline trajectory predictions, not live robot deployment. The later scene-disjoint and unprivileged spatial tests belong to different models and waves.

The checkpoint is intended for research and reproducibility. The upload contains no raw training recordings, datasets, optimizer state, or private server access configuration. The pinned source commit is a public runtime/study reference, not a separately verified training-code commit: the archived receipts do not record the training Git SHA.

Sources and licensing

These study artifacts, including the BF16 and INT8 weights, use the MIT license, as specified by the author. The complete LICENSE and SOURCE_LICENSE files match the corrected GitHub project license. The copyright owners are Diogo Antunes (contact@diogoantunes.ai), ValueAI (contact@valuealigned.ai), and Keplen (contact@keplen.ai).

Citation

Diogo Antunes. Signal-Latent World Models at 1.008B Scale: Separating Fast Sensory Grounding from Editable Working Memory Under O(1) Streaming Control. Unpublished manuscript, draft v0.3, dated November 14, 2026.