rjz123/colar-prosqa-l1b

colar-selftrain-llama1b-prosqa

自训 CoLaR, ProsQA

• Base model: unsloth/Llama-3.2-1B-Instruct
• Files: cot_baseline.ckpt, sft_adaptiveLRM.ckpt

Loading (PyTorch-Lightning checkpoint — NOT AutoModel-loadable)

Weights live under the top-level key ['state_dict'] and only fit the custom CoLaR scaffold (base LLM + [PAD] resize + r128 q/v LoRA + a LatentPolicy MLP), loaded strict=False. Load the base separately and splice this state_dict in. Runtime env:

COLAR_BASE=<base>  COLAR_CKPT=colar-gsm/colar_best.ckpt  COLAR_EMB_STD=0.018  COLAR_COMPRESS=5  COLAR_MAXLAT=64  TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1

TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1 is required for these older Lightning ckpts.