Building `bind2_0`

Verdict: BLOCKED — Does not run as-is. The blockers are listed below and are real, not cosmetic. A launcher works around what can be worked around without editing frozen files; the rest is stated honestly rather than papered over.

Dependencies

torch==2.12.1
numpy==2.4.6
tokenizers==0.22.2
flash-linear-attention==0.5.1   # CUDA-only (Triton kernels)
# on Windows also: triton-windows==3.7.1.post27

Python 3.11 is the version everything here was developed and smoke-tested against.

Known blockers and portability notes

train_bind2_0_babylm.py:20 reads os.environ['BABYLM_WORK'] as a bare subscript at module scope -- an uncaught KeyError with no default. The shipped launcher works around this without editing the file.
dev='cuda' is hardcoded at :30 with no CPU path.
flash-linear-attention is a hard dependency and its kernels are CUDA-only, so this package cannot run on CPU or on non-NVIDIA hardware at all.

Launcher

run_train.py exists because this package's trainer hardcodes machine-specific inputs inside files that are frozen and must not be edited, so the launcher supplies them from outside instead.

How it does that differs by package, so read run_train.py's own docstring rather than this paragraph. Some launchers import the frozen modules and rebind module-level constants before the entry point runs; at least one cannot, because its trainer reads an environment variable at import time and rebinding the attribute afterwards is already too late -- that launcher sets the variable first. Each launcher documents its own mechanism, and each was checked against the source it works around.

Inputs you must supply

alaya-strict-small/tokens_u16.bin (~32.6 MB) — status: REFERENCED-TOO-LARGE

Verification

Every .py in src/ is byte-identical to the working-tree file recorded in MANIFEST.json and compiles under Python 3.11 (python -m compileall src).