abdelstark commited on
Commit
9d026a8
·
verified ·
1 Parent(s): 13b480a

Add CodeLeWM model card

Browse files
Files changed (1) hide show
  1. README.md +106 -0
README.md ADDED
@@ -0,0 +1,106 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ license: other
4
+ tags:
5
+ - code
6
+ - python
7
+ - world-model
8
+ - transition-model
9
+ - reranking
10
+ - research-artifact
11
+ datasets:
12
+ - abdelstark/codelewm-public-shard
13
+ - abdelstark/codelewm-execution-pack
14
+ ---
15
+
16
+ # CodeLeWM Transition Model Artifacts
17
+
18
+ This repository hosts CodeLeWM transition-model checkpoints and checkpoint
19
+ manifests for code-edit and execution-world-model experiments. CodeLeWM is a
20
+ research artifact for scoring and reranking candidate code states; it is not a
21
+ code generator and this repository is not an inference endpoint.
22
+
23
+ ## What Is Hosted Here
24
+
25
+ | Artifact family | Repository path | Dataset surface | Claim posture |
26
+ | --- | --- | --- | --- |
27
+ | Early scaled code-edit transition run | `checkpoints/codelewm-scaled-20260520-9699b53` | `abdelstark/codelewm-public-shard` | smoke/scaled diagnostic |
28
+ | Action-use margin run | `checkpoints/codelewm-action-use-20260520-6650183` | `abdelstark/codelewm-public-shard` | negative action-use result |
29
+ | Action-use retrieval run | `checkpoints/codelewm-action-use-retrieval-20260520-7895d18` | `abdelstark/codelewm-public-shard` | negative against no-action control |
30
+ | v0.2 action-swap/inverse-action run | `checkpoints/codelewm-v0-2-action-swap-rerun-20260520-7c7cb0b` | `abdelstark/codelewm-public-shard` | negative action-use and representation result |
31
+ | v0.8 execution checkpoints, seeds 42 and 1729 | `checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-{42,1729}` | `abdelstark/codelewm-execution-pack` | mixed diagnostic execution evidence |
32
+
33
+ The final v0.9 seed-42 and seed-1729 execution runs are published in
34
+ `abdelstark/codelewm-runs`, not in this model repository. They are documented
35
+ by the CodeLeWM release cards and final public artifact index.
36
+
37
+ ## Dataset Information
38
+
39
+ CodeLeWM uses two public dataset surfaces:
40
+
41
+ | Dataset | Role |
42
+ | --- | --- |
43
+ | `abdelstark/codelewm-public-shard` | Historical public-safe Python code-edit transition shards used by the scaled/action-use runs. |
44
+ | `abdelstark/codelewm-execution-pack` | Current execution-substrate pack of 2,188 tokenized `(code, input, output)` records at revision `v0.9.0-rc1`. |
45
+
46
+ The execution pack records a deterministic sandbox policy, source provenance,
47
+ split policy, checksums, and a claim boundary. It contains tokenized code,
48
+ inputs, outputs, and metadata; training and scoring do not execute candidate
49
+ code.
50
+
51
+ ## Intended Use
52
+
53
+ - Reproduce CodeLeWM checkpoint loading, retrieval, surprise, scorer-quality,
54
+ and reranking diagnostics.
55
+ - Compare transition-model scores against no-action, shuffled-action, lexical,
56
+ random, and LLM-order controls.
57
+ - Inspect checkpoint manifests and trust-gate metadata before using a
58
+ checkpoint in local scoring.
59
+
60
+ ## Out Of Scope
61
+
62
+ - Generating code.
63
+ - Claiming broad coding improvement or live patch utility.
64
+ - Treating a green manifest, demo, or checkpoint load as a model-quality claim.
65
+ - Loading checkpoints without the CodeLeWM checkpoint trust gates and manifest
66
+ verification.
67
+
68
+ ## Claim Boundary
69
+
70
+ The tested code-edit action-use interventions are negative. The v0.9/v1.0
71
+ release evidence supports a narrow HumanEval WS-D diagnostic reranking slice,
72
+ while the aggregate downstream claim remains closed because MBPP-Plus is
73
+ saturated against no-action and lexical controls. This repository therefore
74
+ supports reproducible diagnostic research, not a general claim that CodeLeWM
75
+ improves coding.
76
+
77
+ ## Verification
78
+
79
+ Download a hosted checkpoint family and verify its manifests:
80
+
81
+ ```bash
82
+ hf download abdelstark/codelewm-transition-model \
83
+ --repo-type model \
84
+ --include 'checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-42/**' \
85
+ --local-dir .artifacts/hf-download/codelewm-transition-model
86
+
87
+ uv run codelewm manifest verify \
88
+ --manifest .artifacts/hf-download/codelewm-transition-model/checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-42/manifest.json \
89
+ --json
90
+
91
+ uv run codelewm secret-scan \
92
+ .artifacts/hf-download/codelewm-transition-model/checkpoints/codelewm-v0-8-short-execution-20260605-1b737e4-seed-42 \
93
+ --json
94
+ ```
95
+
96
+ Expected result: manifest verification returns `ok=true` and the secret scan
97
+ returns `ok=true` with zero findings.
98
+
99
+ ## Primary References
100
+
101
+ - Code repository: `https://github.com/AbdelStark/CodeLeWM`
102
+ - Execution dataset: `https://huggingface.co/datasets/abdelstark/codelewm-execution-pack`
103
+ - Historical code-edit shard: `https://huggingface.co/datasets/abdelstark/codelewm-public-shard`
104
+ - Run artifacts: `https://huggingface.co/datasets/abdelstark/codelewm-runs`
105
+ - Final artifact index: `docs/benchmark/PUBLIC_ARTIFACT_INDEX_2026-06-08.md`
106
+