|
Download README.md from valueai-org/SLWM-X1B: direct link, hf CLI and curl.
- Browser
- Download file 8.63 kB
-
https://huggingface.co/valueai-org/SLWM-X1B/resolve/main/README.md
- Command line
-
hf download hf://valueai-org/SLWM-X1B/README.md
-
curl -L -o README.md https://huggingface.co/valueai-org/SLWM-X1B/resolve/main/README.md
8.63 kB
| license: mit | |
| language: | |
| - en | |
| library_name: jax | |
| tags: | |
| - world-model | |
| - multimodal | |
| - working-memory | |
| - embodied-control | |
| - research | |
| - study-artifacts | |
| - npz | |
| # SLWM-X1B — Study artifacts (Wave 5) | |
| > **Study artifacts for reference — unpublished manuscript.** These checkpoints accompany the manuscript draft v0.3, which has not yet been published. They are shared for inspection and reproducibility of the study, not as a formal model release. | |
| The 1.008B-parameter signal-latent world-model flagship with doubled training exposure, action-conditioned latent prediction, editable matrix memory, and explicit commitment routing. | |
| Research by **Diogo Antunes**, at [valuealigned.ai](https://valuealigned.ai) and [keplen.ai](https://keplen.ai). Shared as study artifacts in the **valueai-org** organization. | |
| This is an original, unmodified checkpoint from the SLWM research archive. It uses a **custom NumPy NPZ format** and the SLWM JAX runtime; it is not a Transformers `AutoModel` checkpoint or a chat model. | |
| ## Study artifact reference | |
| | Property | Value | | |
| |---|---| | |
| | Original run | `x1b-w5-slwm-1b-s2001` | | |
| | Experimental wave | 5 | | |
| | Training seed | 2001 | | |
| | Strict total parameters | 1,008,454,410 | | |
| | Training steps | 5,600 | | |
| | Batch size | 12 sequences | | |
| | Training sequence length | 32 ticks | | |
| | Latent width / layers / slots per tick | 1536 / 23 / 24 | | |
| | Runtime/source reference | [`cbb2b38`](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47) | | |
| Seed 2001 is provided as a fixed reference, not selected by ranking test scores. The unpublished manuscript reports three-seed cohorts; this repository contains one checkpoint and its own recorded metrics. | |
| Wave 5 uses the original observation and central-barrier planning setting, including object coordinates in proprioception. Its physical xArm6 evaluation is offline and trajectory-disjoint within one workspace. | |
| ## Files and integrity | |
| | File | Bytes | SHA-256 | | |
| |---|---:|---| | |
| | `weights_bf16.npz` | 1,602,108,632 | `f56b803857a09e7e77e1bb501efdc8e47bcacb2230cf18a1ab44e1acca591f51` | | |
| | `portable_int8.npz` | 918,039,628 | `faaf635499f1ba8f501ecd64911ffa0bf88969f6637d521337d45ee4bf1ea36f` | | |
| - `weights_bf16.npz`: the project's mixed BF16/FP32 export. Matrix BF16 values are stored as uint16 bit patterns, with a dtype manifest. | |
| - `portable_int8.npz`: the project's symmetric per-channel INT8 export, with scales and a quantization manifest. | |
| - `config.json`, `receipt.json`, `eval_metrics.json`, and `train.jsonl`: original run artifacts, preserved byte for byte. | |
| - `artifact_manifest.json` and `SHA256SUMS`: source mapping, artifact hashes, and export-validation results. | |
| - `load_checkpoint.py`: a small, pickle-free NumPy loader for both formats. | |
| All original files were checked against their recorded SHA-256 values before upload. Both weight exports were decoded on CPU, checked for finite values, and counted against the strict total and component counts. These are packaging/integrity checks, not new benchmark evaluations. | |
| The provided loader expands weights to float32. **INT8 file size is not the runtime memory requirement, and this loader does not perform INT8 matrix computation.** Model weights, activations, and planning buffers are separate from the paper's bounded streaming-state figures. | |
| ## Download and load | |
| Install `numpy` and `huggingface_hub` in your Python environment, then: | |
| ```python | |
| import json | |
| import sys | |
| from pathlib import Path | |
| from huggingface_hub import snapshot_download | |
| folder = Path(snapshot_download( | |
| repo_id="valueai-org/SLWM-X1B", | |
| allow_patterns=["portable_int8.npz", "config.json", "receipt.json", "load_checkpoint.py"], | |
| )) | |
| sys.path.insert(0, str(folder)) | |
| from load_checkpoint import load_checkpoint | |
| receipt = json.loads((folder / "receipt.json").read_text()) | |
| params = load_checkpoint( | |
| folder / "portable_int8.npz", | |
| expected_sha256=receipt["portable_int8_sha256"], | |
| ) | |
| assert sum(value.size for value in params.values()) == receipt["parameter_counts"]["strict_total"] | |
| ``` | |
| For the BF16 export, download `weights_bf16.npz` instead and use `receipt["weights_bf16_sha256"]` for verification. `params` is a dictionary of NumPy float32 arrays. JAX execution requires JAX and the appropriate modules from the [pinned research source](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47); follow that source for input preparation, modality masks, state updates, and planning. | |
| Use `models/x1b_world.py` for the core, `models/x1b_jepa.py` for latent prediction and readouts, and the matching planner/evaluation modules in the pinned source. `scripts/eval/x1b_infer.py` can load local NPZ checkpoints through its `load_verified_checkpoint` function; supply this artifact directory so the Wave 5 receipt and configuration are used. | |
| ## Run an example and validation checks | |
| Use the [runnable examples and validation-set guide](https://github.com/ValueAlignedAI/slwm/blob/main/docs/research/x1b_study_artifacts_and_validation.md) from the SLWM source repository. It explains the development and held-out data splits, how to verify local data-bank checksums, and which recorded inputs are not included with these checkpoints. | |
| From a current checkout of [the source repository](https://github.com/ValueAlignedAI/slwm), after installing the guide's Python dependencies: | |
| ```sh | |
| python scripts/eval/x1b_study_examples.py \ | |
| --mode example --repo-id valueai-org/SLWM-X1B --format int8 \ | |
| --output /tmp/slwm-x1b-example.json | |
| ``` | |
| This is a generated, deterministic functional example using the selected trained checkpoint; it is not a benchmark score. The guide provides BF16 commands for the original evaluation functions and the exact bank paths and split names for validation. | |
| ## Recorded results for this checkpoint | |
| These values come directly from this run's `receipt.json`. They are **single-seed results**, not the manuscript's cohort mean ± standard deviation. The upload does not claim that the quantized export has received an additional independent evaluation. | |
| | Recorded metric | Seed 2001 | | |
| |---|---:| | |
| | Overall synthetic MPC success | 75.0000 % | | |
| | One-pixel barrier MPC success | 93.7500 % | | |
| | T = 76 goal-switch success | 100.0000 % | | |
| | T = 1,024 associative recall | 100.0000 % | | |
| | Single-workspace xArm6 four-step error | 7.3368 mm | | |
| The original `eval_metrics.json` provides the wider evaluation record, including failures. Compare architectures within the same wave and observation/training setting. | |
| ## Scope and limitations | |
| This is a research world-model checkpoint, not a general-purpose language or robotics foundation model. Wave 5 control results include privileged object-state inputs and a central-barrier planning prior. The physical-robot measurements are offline trajectory predictions, not live robot deployment. The later scene-disjoint and unprivileged spatial tests belong to different models and waves. | |
| The checkpoint is intended for research and reproducibility. The upload contains no raw training recordings, datasets, optimizer state, or private server access configuration. The pinned source commit is a public runtime/study reference, not a separately verified training-code commit: the archived receipts do not record the training Git SHA. | |
| ## Sources and licensing | |
| - [Unpublished manuscript draft v0.3 (PDF)](https://diogoantunes.ai/media/publications/slwm_x1b_paper_v03.pdf) | |
| - [Expanded article, figures, and experiment context](https://diogoantunes.ai/publications/signal-latent-world-models) | |
| - [SLWM source repository](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47) | |
| - [Original experiment records](https://github.com/ValueAlignedAI/slwm/tree/cbb2b38794359adfefe07b19e9b7caa113b25b47/experiments/multimodal/x1b/spatiotemporal-jepa-1b-20261111/runs_wave5/x1b-w5-slwm-1b-s2001) | |
| These study artifacts, including the BF16 and INT8 weights, use the **MIT license**, as specified by the author. The complete `LICENSE` and `SOURCE_LICENSE` files match the [corrected GitHub project license](https://github.com/ValueAlignedAI/slwm/blob/d1abfc031d9d0c54f511e9a4eb324dfc0b57a08d/LICENSE). The copyright owners are **Diogo Antunes** ([contact@diogoantunes.ai](mailto:contact@diogoantunes.ai)), **ValueAI** ([contact@valuealigned.ai](mailto:contact@valuealigned.ai)), and **Keplen** ([contact@keplen.ai](mailto:contact@keplen.ai)). | |
| ## Citation | |
| Diogo Antunes. *Signal-Latent World Models at 1.008B Scale: Separating Fast Sensory Grounding from Editable Working Memory Under O(1) Streaming Control.* Unpublished manuscript, draft v0.3, dated November 14, 2026. | |