rjz123/colar-synth-l1b

colar-ctrl-synth-llama1b

受控合成变量链 CoLaR(synth_arith, comp4, 50ep, val acc~0.86)

• Base model: unsloth/Llama-3.2-1B-Instruct
• Files: colar_ctrl_llama1b.ckpt, hparams.yaml

Loading (PyTorch-Lightning checkpoint — NOT AutoModel-loadable)

Weights live under the top-level key ['state_dict'] and only fit the custom CoLaR scaffold (base LLM + [PAD] resize + r128 q/v LoRA + a LatentPolicy MLP), loaded strict=False. Load the base separately and splice this state_dict in. Runtime env:

COLAR_BASE=<base>  COLAR_CKPT=colar-gsm/colar_best.ckpt  COLAR_EMB_STD=0.018  COLAR_COMPRESS=5  COLAR_MAXLAT=64  TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1

TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1 is required for these older Lightning ckpts.