Add CodeLeWM model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,106 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: pytorch
|
| 3 |
+
license: other
|
| 4 |
+
tags:
|
| 5 |
+
- code
|
| 6 |
+
- python
|
| 7 |
+
- world-model
|
| 8 |
+
- transition-model
|
| 9 |
+
- reranking
|
| 10 |
+
- research-artifact
|
| 11 |
+
datasets:
|
| 12 |
+
- abdelstark/codelewm-public-shard
|
| 13 |
+
- abdelstark/codelewm-execution-pack
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# CodeLeWM Transition Model Artifacts
|
| 17 |
+
|
| 18 |
+
This repository hosts CodeLeWM transition-model checkpoints and checkpoint
|
| 19 |
+
manifests for code-edit and execution-world-model experiments. CodeLeWM is a
|
| 20 |
+
research artifact for scoring and reranking candidate code states; it is not a
|
| 21 |
+
code generator and this repository is not an inference endpoint.
|
| 22 |
+
|
| 23 |
+
## What Is Hosted Here
|
| 24 |
+
|
| 25 |
+
| Artifact family | Repository path | Dataset surface | Claim posture |
|
| 26 |
+
| --- | --- | --- | --- |
|
| 27 |
+
| Early scaled code-edit transition run | `checkpoints/codelewm-scaled-20260520-9699b53` | `abdelstark/codelewm-public-shard` | smoke/scaled diagnostic |
|
| 28 |
+
| Action-use margin run | `checkpoints/codelewm-action-use-20260520-6650183` | `abdelstark/codelewm-public-shard` | negative action-use result |
|
| 29 |
+
| Action-use retrieval run | `checkpoints/codelewm-action-use-retrieval-20260520-7895d18` | `abdelstark/codelewm-public-shard` | negative against no-action control |
|
| 30 |
+
| v0.2 action-swap/inverse-action run | `checkpoints/codelewm-v0-2-action-swap-rerun-20260520-7c7cb0b` | `abdelstark/codelewm-public-shard` | negative action-use and representation result |
|
| 31 |
+
| v0.8 execution checkpoints, seeds 42 and 1729 | `checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-{42,1729}` | `abdelstark/codelewm-execution-pack` | mixed diagnostic execution evidence |
|
| 32 |
+
|
| 33 |
+
The final v0.9 seed-42 and seed-1729 execution runs are published in
|
| 34 |
+
`abdelstark/codelewm-runs`, not in this model repository. They are documented
|
| 35 |
+
by the CodeLeWM release cards and final public artifact index.
|
| 36 |
+
|
| 37 |
+
## Dataset Information
|
| 38 |
+
|
| 39 |
+
CodeLeWM uses two public dataset surfaces:
|
| 40 |
+
|
| 41 |
+
| Dataset | Role |
|
| 42 |
+
| --- | --- |
|
| 43 |
+
| `abdelstark/codelewm-public-shard` | Historical public-safe Python code-edit transition shards used by the scaled/action-use runs. |
|
| 44 |
+
| `abdelstark/codelewm-execution-pack` | Current execution-substrate pack of 2,188 tokenized `(code, input, output)` records at revision `v0.9.0-rc1`. |
|
| 45 |
+
|
| 46 |
+
The execution pack records a deterministic sandbox policy, source provenance,
|
| 47 |
+
split policy, checksums, and a claim boundary. It contains tokenized code,
|
| 48 |
+
inputs, outputs, and metadata; training and scoring do not execute candidate
|
| 49 |
+
code.
|
| 50 |
+
|
| 51 |
+
## Intended Use
|
| 52 |
+
|
| 53 |
+
- Reproduce CodeLeWM checkpoint loading, retrieval, surprise, scorer-quality,
|
| 54 |
+
and reranking diagnostics.
|
| 55 |
+
- Compare transition-model scores against no-action, shuffled-action, lexical,
|
| 56 |
+
random, and LLM-order controls.
|
| 57 |
+
- Inspect checkpoint manifests and trust-gate metadata before using a
|
| 58 |
+
checkpoint in local scoring.
|
| 59 |
+
|
| 60 |
+
## Out Of Scope
|
| 61 |
+
|
| 62 |
+
- Generating code.
|
| 63 |
+
- Claiming broad coding improvement or live patch utility.
|
| 64 |
+
- Treating a green manifest, demo, or checkpoint load as a model-quality claim.
|
| 65 |
+
- Loading checkpoints without the CodeLeWM checkpoint trust gates and manifest
|
| 66 |
+
verification.
|
| 67 |
+
|
| 68 |
+
## Claim Boundary
|
| 69 |
+
|
| 70 |
+
The tested code-edit action-use interventions are negative. The v0.9/v1.0
|
| 71 |
+
release evidence supports a narrow HumanEval WS-D diagnostic reranking slice,
|
| 72 |
+
while the aggregate downstream claim remains closed because MBPP-Plus is
|
| 73 |
+
saturated against no-action and lexical controls. This repository therefore
|
| 74 |
+
supports reproducible diagnostic research, not a general claim that CodeLeWM
|
| 75 |
+
improves coding.
|
| 76 |
+
|
| 77 |
+
## Verification
|
| 78 |
+
|
| 79 |
+
Download a hosted checkpoint family and verify its manifests:
|
| 80 |
+
|
| 81 |
+
```bash
|
| 82 |
+
hf download abdelstark/codelewm-transition-model \
|
| 83 |
+
--repo-type model \
|
| 84 |
+
--include 'checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-42/**' \
|
| 85 |
+
--local-dir .artifacts/hf-download/codelewm-transition-model
|
| 86 |
+
|
| 87 |
+
uv run codelewm manifest verify \
|
| 88 |
+
--manifest .artifacts/hf-download/codelewm-transition-model/checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-42/manifest.json \
|
| 89 |
+
--json
|
| 90 |
+
|
| 91 |
+
uv run codelewm secret-scan \
|
| 92 |
+
.artifacts/hf-download/codelewm-transition-model/checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-42 \
|
| 93 |
+
--json
|
| 94 |
+
```
|
| 95 |
+
|
| 96 |
+
Expected result: manifest verification returns `ok=true` and the secret scan
|
| 97 |
+
returns `ok=true` with zero findings.
|
| 98 |
+
|
| 99 |
+
## Primary References
|
| 100 |
+
|
| 101 |
+
- Code repository: `https://github.com/AbdelStark/CodeLeWM`
|
| 102 |
+
- Execution dataset: `https://huggingface.co/datasets/abdelstark/codelewm-execution-pack`
|
| 103 |
+
- Historical code-edit shard: `https://huggingface.co/datasets/abdelstark/codelewm-public-shard`
|
| 104 |
+
- Run artifacts: `https://huggingface.co/datasets/abdelstark/codelewm-runs`
|
| 105 |
+
- Final artifact index: `docs/benchmark/PUBLIC_ARTIFACT_INDEX_2026-06-08.md`
|
| 106 |
+
|